2024-09-12T22:21:30.327 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-12T22:21:30.355 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-12T22:21:30.446 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-12_21:32:03-powercycle-squid-distro-default-smithi/7902933 branch: squid description: powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-bitmap powercycle/default supported-distros/centos_latest tasks/cfuse_workunit_suites_fsstress thrashosds-health} email: ceph-qa@ceph.com first_in_suite: false job_id: '7902933' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi name: teuthology-2024-09-12_21:32:03-powercycle-squid-distro-default-smithi no_nested_subset: false os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: conf: mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(MDS_TRIM\) - \(MDS_SLOW_REQUEST\) - MDS_SLOW_METADATA_IO - Behind on trimming - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED - mons down - mon down - out of quorum - noscrub - nodeep-scrub sha1: 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: 7741f7f9ee20524f89b8f61d1609b32fb3b1570a owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mon.b - mon.c - mgr.x - mgr.y - mds.a - client.0 - - osd.0 - - osd.1 - - osd.2 seed: 8861 sha1: 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 sleep_before_teardown: 0 subset: 0/4 suite: powercycle suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_7741f7f9ee20524f89b8f61d1609b32fb3b1570a/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 7741f7f9ee20524f89b8f61d1609b32fb3b1570a targets: smithi019.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBF3VKjqCV+iuQ7xV0iH10HZgQza40eoM2qnINn2SJAmgFIFPWBkgvyCjnZTvxsmB2+MzV7CLC4bgeZE4SayYO20= smithi076.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFsL6/5203T85kqBOWQwf55Cc9mmMUZbHCqWC2kSk68eDUb/eDiv8uVWGVNl6tocWABbgeZNzNzwOmXWPYGJj44= smithi148.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAwERC1tikDtc4R03U3CvVxVi2ul0YRnJJV4werj6iekImfxaPYbZreAlOJmU8niYrKFn/YCQv41h7lfybMpaNQ= smithi163.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHGWBqFSl5e0CU0iZRXe/HnkgpJaBTpYlG0ujqXxASX8qqO7wT9LFHdCj/FjXNGBlEE9ePMaVU2NZYJ9zjwEE34= tasks: - install: extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: null - thrashosds: chance_down: 1.0 powercycle: true timeout: 600 - ceph-fuse: null - workunit: clients: all: - suites/fsstress.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-12_21:32:03 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-12T22:21:30.447 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_7741f7f9ee20524f89b8f61d1609b32fb3b1570a/qa; will attempt to use it 2024-09-12T22:21:30.447 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_7741f7f9ee20524f89b8f61d1609b32fb3b1570a/qa/tasks 2024-09-12T22:21:30.447 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-12T22:21:30.449 INFO:teuthology.task.internal:Checking packages... 2024-09-12T22:21:30.470 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '086c737fa75c22d521a3932c59b31c5e1d1c9ef4' 2024-09-12T22:21:30.470 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-12T22:21:30.470 INFO:teuthology.packaging:ref: None 2024-09-12T22:21:30.470 INFO:teuthology.packaging:tag: None 2024-09-12T22:21:30.470 INFO:teuthology.packaging:branch: squid 2024-09-12T22:21:30.470 INFO:teuthology.packaging:sha1: 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 2024-09-12T22:21:30.470 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-12T22:21:30.705 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-322.g7741f7f9 2024-09-12T22:21:30.706 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-12T22:21:30.712 INFO:teuthology.task.internal:no buildpackages task found 2024-09-12T22:21:30.712 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-12T22:21:30.761 INFO:teuthology.task.internal:Saving configuration 2024-09-12T22:21:30.776 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-12T22:21:30.901 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-12T22:21:30.927 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi019.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-12_21:32:03-powercycle-squid-distro-default-smithi/7902933', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 22:15:45.163088', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBF3VKjqCV+iuQ7xV0iH10HZgQza40eoM2qnINn2SJAmgFIFPWBkgvyCjnZTvxsmB2+MzV7CLC4bgeZE4SayYO20='} 2024-09-12T22:21:30.947 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi076.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-12_21:32:03-powercycle-squid-distro-default-smithi/7902933', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 22:15:45.160396', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFsL6/5203T85kqBOWQwf55Cc9mmMUZbHCqWC2kSk68eDUb/eDiv8uVWGVNl6tocWABbgeZNzNzwOmXWPYGJj44='} 2024-09-12T22:21:30.968 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi148.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-12_21:32:03-powercycle-squid-distro-default-smithi/7902933', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 22:15:45.164343', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAwERC1tikDtc4R03U3CvVxVi2ul0YRnJJV4werj6iekImfxaPYbZreAlOJmU8niYrKFn/YCQv41h7lfybMpaNQ='} 2024-09-12T22:21:30.986 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi163.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-12_21:32:03-powercycle-squid-distro-default-smithi/7902933', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 22:15:45.161891', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHGWBqFSl5e0CU0iZRXe/HnkgpJaBTpYlG0ujqXxASX8qqO7wT9LFHdCj/FjXNGBlEE9ePMaVU2NZYJ9zjwEE34='} 2024-09-12T22:21:30.987 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-12T22:21:30.993 INFO:teuthology.task.internal:roles: ubuntu@smithi019.front.sepia.ceph.com - ['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mgr.y', 'mds.a', 'client.0'] 2024-09-12T22:21:30.993 INFO:teuthology.task.internal:roles: ubuntu@smithi076.front.sepia.ceph.com - ['osd.0'] 2024-09-12T22:21:30.993 INFO:teuthology.task.internal:roles: ubuntu@smithi148.front.sepia.ceph.com - ['osd.1'] 2024-09-12T22:21:30.993 INFO:teuthology.task.internal:roles: ubuntu@smithi163.front.sepia.ceph.com - ['osd.2'] 2024-09-12T22:21:30.993 INFO:teuthology.run_tasks:Running task console_log... 2024-09-12T22:21:31.128 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f5fa16d72e0>, signals=[15]) 2024-09-12T22:21:31.128 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-12T22:21:31.135 INFO:teuthology.task.internal:Opening connections... 2024-09-12T22:21:31.135 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi019.front.sepia.ceph.com 2024-09-12T22:21:31.136 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T22:21:31.212 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi076.front.sepia.ceph.com 2024-09-12T22:21:31.213 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T22:21:31.289 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi148.front.sepia.ceph.com 2024-09-12T22:21:31.290 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T22:21:31.365 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi163.front.sepia.ceph.com 2024-09-12T22:21:31.366 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T22:21:31.441 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-12T22:21:31.448 DEBUG:teuthology.orchestra.run.smithi019:> uname -m 2024-09-12T22:21:31.466 INFO:teuthology.orchestra.run.smithi019.stdout:x86_64 2024-09-12T22:21:31.466 DEBUG:teuthology.orchestra.run.smithi019:> cat /etc/os-release 2024-09-12T22:21:31.524 INFO:teuthology.orchestra.run.smithi019.stdout:NAME="CentOS Stream" 2024-09-12T22:21:31.524 INFO:teuthology.orchestra.run.smithi019.stdout:VERSION="9" 2024-09-12T22:21:31.524 INFO:teuthology.orchestra.run.smithi019.stdout:ID="centos" 2024-09-12T22:21:31.524 INFO:teuthology.orchestra.run.smithi019.stdout:ID_LIKE="rhel fedora" 2024-09-12T22:21:31.524 INFO:teuthology.orchestra.run.smithi019.stdout:VERSION_ID="9" 2024-09-12T22:21:31.524 INFO:teuthology.orchestra.run.smithi019.stdout:PLATFORM_ID="platform:el9" 2024-09-12T22:21:31.524 INFO:teuthology.orchestra.run.smithi019.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-12T22:21:31.524 INFO:teuthology.orchestra.run.smithi019.stdout:ANSI_COLOR="0;31" 2024-09-12T22:21:31.524 INFO:teuthology.orchestra.run.smithi019.stdout:LOGO="fedora-logo-icon" 2024-09-12T22:21:31.524 INFO:teuthology.orchestra.run.smithi019.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-12T22:21:31.524 INFO:teuthology.orchestra.run.smithi019.stdout:HOME_URL="https://centos.org/" 2024-09-12T22:21:31.525 INFO:teuthology.orchestra.run.smithi019.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-12T22:21:31.525 INFO:teuthology.orchestra.run.smithi019.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-12T22:21:31.525 INFO:teuthology.orchestra.run.smithi019.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-12T22:21:31.525 INFO:teuthology.lock.ops:Updating smithi019.front.sepia.ceph.com on lock server 2024-09-12T22:21:31.549 DEBUG:teuthology.orchestra.run.smithi076:> uname -m 2024-09-12T22:21:31.567 INFO:teuthology.orchestra.run.smithi076.stdout:x86_64 2024-09-12T22:21:31.568 DEBUG:teuthology.orchestra.run.smithi076:> cat /etc/os-release 2024-09-12T22:21:31.625 INFO:teuthology.orchestra.run.smithi076.stdout:NAME="CentOS Stream" 2024-09-12T22:21:31.626 INFO:teuthology.orchestra.run.smithi076.stdout:VERSION="9" 2024-09-12T22:21:31.626 INFO:teuthology.orchestra.run.smithi076.stdout:ID="centos" 2024-09-12T22:21:31.626 INFO:teuthology.orchestra.run.smithi076.stdout:ID_LIKE="rhel fedora" 2024-09-12T22:21:31.626 INFO:teuthology.orchestra.run.smithi076.stdout:VERSION_ID="9" 2024-09-12T22:21:31.626 INFO:teuthology.orchestra.run.smithi076.stdout:PLATFORM_ID="platform:el9" 2024-09-12T22:21:31.626 INFO:teuthology.orchestra.run.smithi076.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-12T22:21:31.626 INFO:teuthology.orchestra.run.smithi076.stdout:ANSI_COLOR="0;31" 2024-09-12T22:21:31.626 INFO:teuthology.orchestra.run.smithi076.stdout:LOGO="fedora-logo-icon" 2024-09-12T22:21:31.626 INFO:teuthology.orchestra.run.smithi076.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-12T22:21:31.626 INFO:teuthology.orchestra.run.smithi076.stdout:HOME_URL="https://centos.org/" 2024-09-12T22:21:31.626 INFO:teuthology.orchestra.run.smithi076.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-12T22:21:31.626 INFO:teuthology.orchestra.run.smithi076.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-12T22:21:31.627 INFO:teuthology.orchestra.run.smithi076.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-12T22:21:31.627 INFO:teuthology.lock.ops:Updating smithi076.front.sepia.ceph.com on lock server 2024-09-12T22:21:31.655 DEBUG:teuthology.orchestra.run.smithi148:> uname -m 2024-09-12T22:21:31.675 INFO:teuthology.orchestra.run.smithi148.stdout:x86_64 2024-09-12T22:21:31.675 DEBUG:teuthology.orchestra.run.smithi148:> cat /etc/os-release 2024-09-12T22:21:31.734 INFO:teuthology.orchestra.run.smithi148.stdout:NAME="CentOS Stream" 2024-09-12T22:21:31.734 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION="9" 2024-09-12T22:21:31.734 INFO:teuthology.orchestra.run.smithi148.stdout:ID="centos" 2024-09-12T22:21:31.734 INFO:teuthology.orchestra.run.smithi148.stdout:ID_LIKE="rhel fedora" 2024-09-12T22:21:31.734 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION_ID="9" 2024-09-12T22:21:31.734 INFO:teuthology.orchestra.run.smithi148.stdout:PLATFORM_ID="platform:el9" 2024-09-12T22:21:31.734 INFO:teuthology.orchestra.run.smithi148.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-12T22:21:31.734 INFO:teuthology.orchestra.run.smithi148.stdout:ANSI_COLOR="0;31" 2024-09-12T22:21:31.735 INFO:teuthology.orchestra.run.smithi148.stdout:LOGO="fedora-logo-icon" 2024-09-12T22:21:31.735 INFO:teuthology.orchestra.run.smithi148.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-12T22:21:31.735 INFO:teuthology.orchestra.run.smithi148.stdout:HOME_URL="https://centos.org/" 2024-09-12T22:21:31.735 INFO:teuthology.orchestra.run.smithi148.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-12T22:21:31.735 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-12T22:21:31.735 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-12T22:21:31.735 INFO:teuthology.lock.ops:Updating smithi148.front.sepia.ceph.com on lock server 2024-09-12T22:21:31.764 DEBUG:teuthology.orchestra.run.smithi163:> uname -m 2024-09-12T22:21:31.783 INFO:teuthology.orchestra.run.smithi163.stdout:x86_64 2024-09-12T22:21:31.783 DEBUG:teuthology.orchestra.run.smithi163:> cat /etc/os-release 2024-09-12T22:21:31.842 INFO:teuthology.orchestra.run.smithi163.stdout:NAME="CentOS Stream" 2024-09-12T22:21:31.842 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION="9" 2024-09-12T22:21:31.842 INFO:teuthology.orchestra.run.smithi163.stdout:ID="centos" 2024-09-12T22:21:31.842 INFO:teuthology.orchestra.run.smithi163.stdout:ID_LIKE="rhel fedora" 2024-09-12T22:21:31.842 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION_ID="9" 2024-09-12T22:21:31.842 INFO:teuthology.orchestra.run.smithi163.stdout:PLATFORM_ID="platform:el9" 2024-09-12T22:21:31.842 INFO:teuthology.orchestra.run.smithi163.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-12T22:21:31.843 INFO:teuthology.orchestra.run.smithi163.stdout:ANSI_COLOR="0;31" 2024-09-12T22:21:31.843 INFO:teuthology.orchestra.run.smithi163.stdout:LOGO="fedora-logo-icon" 2024-09-12T22:21:31.843 INFO:teuthology.orchestra.run.smithi163.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-12T22:21:31.843 INFO:teuthology.orchestra.run.smithi163.stdout:HOME_URL="https://centos.org/" 2024-09-12T22:21:31.843 INFO:teuthology.orchestra.run.smithi163.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-12T22:21:31.843 INFO:teuthology.orchestra.run.smithi163.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-12T22:21:31.843 INFO:teuthology.orchestra.run.smithi163.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-12T22:21:31.843 INFO:teuthology.lock.ops:Updating smithi163.front.sepia.ceph.com on lock server 2024-09-12T22:21:31.872 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-12T22:21:31.881 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-12T22:21:31.954 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-12T22:21:31.955 DEBUG:teuthology.orchestra.run.smithi019:> test '!' -e /home/ubuntu/cephtest 2024-09-12T22:21:31.957 DEBUG:teuthology.orchestra.run.smithi076:> test '!' -e /home/ubuntu/cephtest 2024-09-12T22:21:31.960 DEBUG:teuthology.orchestra.run.smithi148:> test '!' -e /home/ubuntu/cephtest 2024-09-12T22:21:31.962 DEBUG:teuthology.orchestra.run.smithi163:> test '!' -e /home/ubuntu/cephtest 2024-09-12T22:21:31.979 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-12T22:21:32.037 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-12T22:21:32.038 DEBUG:teuthology.orchestra.run.smithi019:> test -z $(ls -A /var/lib/ceph) 2024-09-12T22:21:32.040 DEBUG:teuthology.orchestra.run.smithi076:> test -z $(ls -A /var/lib/ceph) 2024-09-12T22:21:32.043 DEBUG:teuthology.orchestra.run.smithi148:> test -z $(ls -A /var/lib/ceph) 2024-09-12T22:21:32.045 DEBUG:teuthology.orchestra.run.smithi163:> test -z $(ls -A /var/lib/ceph) 2024-09-12T22:21:32.143 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-12T22:21:32.246 INFO:teuthology.run_tasks:Running task kernel... 2024-09-12T22:21:32.260 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-12T22:21:32.260 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'osd.0': {'kdb': 1, 'sha1': 'distro'}, 'osd.1': {'kdb': 1, 'sha1': 'distro'}, 'osd.2': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-12T22:21:32.260 DEBUG:teuthology.orchestra.run.smithi019:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T22:21:32.261 DEBUG:teuthology.orchestra.run.smithi076:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T22:21:32.261 DEBUG:teuthology.orchestra.run.smithi148:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T22:21:32.261 DEBUG:teuthology.orchestra.run.smithi163:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T22:21:32.278 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T22:21:32.279 DEBUG:teuthology.orchestra.run.smithi019:> uname -r 2024-09-12T22:21:32.280 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T22:21:32.280 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T22:21:32.280 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T22:21:32.281 DEBUG:teuthology.orchestra.run.smithi163:> uname -r 2024-09-12T22:21:32.281 DEBUG:teuthology.orchestra.run.smithi076:> uname -r 2024-09-12T22:21:32.282 DEBUG:teuthology.orchestra.run.smithi148:> uname -r 2024-09-12T22:21:32.337 INFO:teuthology.orchestra.run.smithi019.stdout:5.14.0-503.el9.x86_64 2024-09-12T22:21:32.337 INFO:teuthology.task.kernel:Running kernel on smithi019: 5.14.0-503.el9.x86_64 2024-09-12T22:21:32.337 DEBUG:teuthology.orchestra.run.smithi019:> sudo yum install -y kernel 2024-09-12T22:21:32.338 INFO:teuthology.orchestra.run.smithi076.stdout:5.14.0-503.el9.x86_64 2024-09-12T22:21:32.338 INFO:teuthology.task.kernel:Running kernel on smithi076: 5.14.0-503.el9.x86_64 2024-09-12T22:21:32.338 DEBUG:teuthology.orchestra.run.smithi076:> sudo yum install -y kernel 2024-09-12T22:21:32.339 INFO:teuthology.orchestra.run.smithi163.stdout:5.14.0-503.el9.x86_64 2024-09-12T22:21:32.340 INFO:teuthology.task.kernel:Running kernel on smithi163: 5.14.0-503.el9.x86_64 2024-09-12T22:21:32.340 DEBUG:teuthology.orchestra.run.smithi163:> sudo yum install -y kernel 2024-09-12T22:21:32.341 INFO:teuthology.orchestra.run.smithi148.stdout:5.14.0-503.el9.x86_64 2024-09-12T22:21:32.341 INFO:teuthology.task.kernel:Running kernel on smithi148: 5.14.0-503.el9.x86_64 2024-09-12T22:21:32.341 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum install -y kernel 2024-09-12T22:21:35.551 INFO:teuthology.orchestra.run.smithi076.stdout:CentOS Stream 9 - BaseOS 6.1 MB/s | 8.2 MB 00:01 2024-09-12T22:21:35.748 INFO:teuthology.orchestra.run.smithi019.stdout:CentOS Stream 9 - BaseOS 4.7 MB/s | 8.2 MB 00:01 2024-09-12T22:21:36.057 INFO:teuthology.orchestra.run.smithi148.stdout:CentOS Stream 9 - BaseOS 4.3 MB/s | 8.2 MB 00:01 2024-09-12T22:21:37.377 INFO:teuthology.orchestra.run.smithi076.stdout:CentOS Stream 9 - AppStream 30 MB/s | 20 MB 00:00 2024-09-12T22:21:37.808 INFO:teuthology.orchestra.run.smithi148.stdout:CentOS Stream 9 - AppStream 32 MB/s | 20 MB 00:00 2024-09-12T22:21:38.183 INFO:teuthology.orchestra.run.smithi019.stdout:CentOS Stream 9 - AppStream 16 MB/s | 20 MB 00:01 2024-09-12T22:21:39.291 INFO:teuthology.orchestra.run.smithi163.stdout:CentOS Stream 9 - BaseOS 1.6 MB/s | 8.2 MB 00:05 2024-09-12T22:21:41.025 INFO:teuthology.orchestra.run.smithi163.stdout:CentOS Stream 9 - AppStream 33 MB/s | 20 MB 00:00 2024-09-12T22:21:41.819 INFO:teuthology.orchestra.run.smithi076.stdout:CentOS Stream 9 - CRB 12 MB/s | 6.5 MB 00:00 2024-09-12T22:21:43.383 INFO:teuthology.orchestra.run.smithi148.stdout:CentOS Stream 9 - CRB 3.6 MB/s | 6.5 MB 00:01 2024-09-12T22:21:43.842 INFO:teuthology.orchestra.run.smithi019.stdout:CentOS Stream 9 - CRB 4.5 MB/s | 6.5 MB 00:01 2024-09-12T22:21:43.878 INFO:teuthology.orchestra.run.smithi076.stdout:CentOS Stream 9 - Extras packages 27 kB/s | 19 kB 00:00 2024-09-12T22:21:44.892 INFO:teuthology.orchestra.run.smithi148.stdout:CentOS Stream 9 - Extras packages 60 kB/s | 19 kB 00:00 2024-09-12T22:21:45.082 INFO:teuthology.orchestra.run.smithi076.stdout:Extra Packages for Enterprise Linux 21 MB/s | 23 MB 00:01 2024-09-12T22:21:45.384 INFO:teuthology.orchestra.run.smithi163.stdout:CentOS Stream 9 - CRB 12 MB/s | 6.5 MB 00:00 2024-09-12T22:21:45.642 INFO:teuthology.orchestra.run.smithi019.stdout:CentOS Stream 9 - Extras packages 35 kB/s | 19 kB 00:00 2024-09-12T22:21:45.813 INFO:teuthology.orchestra.run.smithi148.stdout:Extra Packages for Enterprise Linux 28 MB/s | 23 MB 00:00 2024-09-12T22:21:46.563 INFO:teuthology.orchestra.run.smithi019.stdout:Extra Packages for Enterprise Linux 29 MB/s | 23 MB 00:00 2024-09-12T22:21:46.859 INFO:teuthology.orchestra.run.smithi163.stdout:CentOS Stream 9 - Extras packages 66 kB/s | 19 kB 00:00 2024-09-12T22:21:47.880 INFO:teuthology.orchestra.run.smithi163.stdout:Extra Packages for Enterprise Linux 25 MB/s | 23 MB 00:00 2024-09-12T22:21:50.605 INFO:teuthology.orchestra.run.smithi076.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-09-12T22:21:51.278 INFO:teuthology.orchestra.run.smithi148.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2024-09-12T22:21:52.310 INFO:teuthology.orchestra.run.smithi019.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-12T22:21:52.586 INFO:teuthology.orchestra.run.smithi076.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-12T22:21:52.586 INFO:teuthology.orchestra.run.smithi076.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-12T22:21:52.678 INFO:teuthology.orchestra.run.smithi076.stdout:Dependencies resolved. 2024-09-12T22:21:52.686 INFO:teuthology.orchestra.run.smithi076.stdout:================================================================================ 2024-09-12T22:21:52.686 INFO:teuthology.orchestra.run.smithi076.stdout: Package Architecture Version Repository Size 2024-09-12T22:21:52.686 INFO:teuthology.orchestra.run.smithi076.stdout:================================================================================ 2024-09-12T22:21:52.686 INFO:teuthology.orchestra.run.smithi076.stdout:Installing: 2024-09-12T22:21:52.686 INFO:teuthology.orchestra.run.smithi076.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-12T22:21:52.687 INFO:teuthology.orchestra.run.smithi076.stdout:Installing dependencies: 2024-09-12T22:21:52.687 INFO:teuthology.orchestra.run.smithi076.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-12T22:21:52.687 INFO:teuthology.orchestra.run.smithi076.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-12T22:21:52.687 INFO:teuthology.orchestra.run.smithi076.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-12T22:21:52.687 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-12T22:21:52.687 INFO:teuthology.orchestra.run.smithi076.stdout:Transaction Summary 2024-09-12T22:21:52.687 INFO:teuthology.orchestra.run.smithi076.stdout:================================================================================ 2024-09-12T22:21:52.687 INFO:teuthology.orchestra.run.smithi076.stdout:Install 4 Packages 2024-09-12T22:21:52.687 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-12T22:21:52.688 INFO:teuthology.orchestra.run.smithi076.stdout:Total download size: 79 M 2024-09-12T22:21:52.688 INFO:teuthology.orchestra.run.smithi076.stdout:Installed size: 126 M 2024-09-12T22:21:52.688 INFO:teuthology.orchestra.run.smithi076.stdout:Downloading Packages: 2024-09-12T22:21:53.064 INFO:teuthology.orchestra.run.smithi076.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 232 kB/s | 23 kB 00:00 2024-09-12T22:21:53.211 INFO:teuthology.orchestra.run.smithi163.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-09-12T22:21:53.283 INFO:teuthology.orchestra.run.smithi148.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-12T22:21:53.284 INFO:teuthology.orchestra.run.smithi148.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-12T22:21:53.379 INFO:teuthology.orchestra.run.smithi148.stdout:Dependencies resolved. 2024-09-12T22:21:53.388 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-12T22:21:53.388 INFO:teuthology.orchestra.run.smithi148.stdout: Package Architecture Version Repository Size 2024-09-12T22:21:53.388 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-12T22:21:53.388 INFO:teuthology.orchestra.run.smithi148.stdout:Installing: 2024-09-12T22:21:53.388 INFO:teuthology.orchestra.run.smithi148.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-12T22:21:53.388 INFO:teuthology.orchestra.run.smithi148.stdout:Installing dependencies: 2024-09-12T22:21:53.388 INFO:teuthology.orchestra.run.smithi148.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-12T22:21:53.388 INFO:teuthology.orchestra.run.smithi148.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-12T22:21:53.389 INFO:teuthology.orchestra.run.smithi148.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-12T22:21:53.389 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T22:21:53.389 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction Summary 2024-09-12T22:21:53.389 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-12T22:21:53.389 INFO:teuthology.orchestra.run.smithi148.stdout:Install 4 Packages 2024-09-12T22:21:53.389 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T22:21:53.389 INFO:teuthology.orchestra.run.smithi148.stdout:Total download size: 79 M 2024-09-12T22:21:53.390 INFO:teuthology.orchestra.run.smithi148.stdout:Installed size: 126 M 2024-09-12T22:21:53.390 INFO:teuthology.orchestra.run.smithi148.stdout:Downloading Packages: 2024-09-12T22:21:53.465 INFO:teuthology.orchestra.run.smithi076.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 31 MB/s | 16 MB 00:00 2024-09-12T22:21:53.562 INFO:teuthology.orchestra.run.smithi148.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 187 kB/s | 23 kB 00:00 2024-09-12T22:21:53.848 INFO:teuthology.orchestra.run.smithi076.stdout:(3/4): kernel-modules-core-5.14.0-505.el9.x86_6 36 MB/s | 29 MB 00:00 2024-09-12T22:21:54.157 INFO:teuthology.orchestra.run.smithi076.stdout:(4/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 29 MB/s | 35 MB 00:01 2024-09-12T22:21:54.157 INFO:teuthology.orchestra.run.smithi076.stdout:-------------------------------------------------------------------------------- 2024-09-12T22:21:54.157 INFO:teuthology.orchestra.run.smithi076.stdout:Total 54 MB/s | 79 MB 00:01 2024-09-12T22:21:54.351 INFO:teuthology.orchestra.run.smithi019.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-12T22:21:54.351 INFO:teuthology.orchestra.run.smithi019.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-12T22:21:54.455 INFO:teuthology.orchestra.run.smithi019.stdout:Dependencies resolved. 2024-09-12T22:21:54.471 INFO:teuthology.orchestra.run.smithi019.stdout:================================================================================ 2024-09-12T22:21:54.471 INFO:teuthology.orchestra.run.smithi019.stdout: Package Architecture Version Repository Size 2024-09-12T22:21:54.471 INFO:teuthology.orchestra.run.smithi019.stdout:================================================================================ 2024-09-12T22:21:54.471 INFO:teuthology.orchestra.run.smithi019.stdout:Installing: 2024-09-12T22:21:54.471 INFO:teuthology.orchestra.run.smithi019.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-12T22:21:54.471 INFO:teuthology.orchestra.run.smithi019.stdout:Installing dependencies: 2024-09-12T22:21:54.471 INFO:teuthology.orchestra.run.smithi019.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-12T22:21:54.472 INFO:teuthology.orchestra.run.smithi019.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-12T22:21:54.472 INFO:teuthology.orchestra.run.smithi019.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-12T22:21:54.472 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:21:54.472 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction Summary 2024-09-12T22:21:54.472 INFO:teuthology.orchestra.run.smithi019.stdout:================================================================================ 2024-09-12T22:21:54.472 INFO:teuthology.orchestra.run.smithi019.stdout:Install 4 Packages 2024-09-12T22:21:54.472 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:21:54.472 INFO:teuthology.orchestra.run.smithi019.stdout:Total download size: 79 M 2024-09-12T22:21:54.472 INFO:teuthology.orchestra.run.smithi019.stdout:Installed size: 126 M 2024-09-12T22:21:54.472 INFO:teuthology.orchestra.run.smithi019.stdout:Downloading Packages: 2024-09-12T22:21:54.835 INFO:teuthology.orchestra.run.smithi076.stdout:Running transaction check 2024-09-12T22:21:54.870 INFO:teuthology.orchestra.run.smithi019.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 77 kB/s | 23 kB 00:00 2024-09-12T22:21:55.207 INFO:teuthology.orchestra.run.smithi076.stdout:Transaction check succeeded. 2024-09-12T22:21:55.207 INFO:teuthology.orchestra.run.smithi076.stdout:Running transaction test 2024-09-12T22:21:55.209 INFO:teuthology.orchestra.run.smithi163.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-12T22:21:55.209 INFO:teuthology.orchestra.run.smithi163.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-12T22:21:55.298 INFO:teuthology.orchestra.run.smithi163.stdout:Dependencies resolved. 2024-09-12T22:21:55.307 INFO:teuthology.orchestra.run.smithi163.stdout:================================================================================ 2024-09-12T22:21:55.307 INFO:teuthology.orchestra.run.smithi163.stdout: Package Architecture Version Repository Size 2024-09-12T22:21:55.307 INFO:teuthology.orchestra.run.smithi163.stdout:================================================================================ 2024-09-12T22:21:55.307 INFO:teuthology.orchestra.run.smithi163.stdout:Installing: 2024-09-12T22:21:55.307 INFO:teuthology.orchestra.run.smithi163.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-12T22:21:55.307 INFO:teuthology.orchestra.run.smithi163.stdout:Installing dependencies: 2024-09-12T22:21:55.307 INFO:teuthology.orchestra.run.smithi163.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-12T22:21:55.307 INFO:teuthology.orchestra.run.smithi163.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-12T22:21:55.307 INFO:teuthology.orchestra.run.smithi163.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-12T22:21:55.307 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-09-12T22:21:55.308 INFO:teuthology.orchestra.run.smithi163.stdout:Transaction Summary 2024-09-12T22:21:55.308 INFO:teuthology.orchestra.run.smithi163.stdout:================================================================================ 2024-09-12T22:21:55.308 INFO:teuthology.orchestra.run.smithi163.stdout:Install 4 Packages 2024-09-12T22:21:55.308 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-09-12T22:21:55.309 INFO:teuthology.orchestra.run.smithi163.stdout:Total download size: 79 M 2024-09-12T22:21:55.309 INFO:teuthology.orchestra.run.smithi163.stdout:Installed size: 126 M 2024-09-12T22:21:55.309 INFO:teuthology.orchestra.run.smithi163.stdout:Downloading Packages: 2024-09-12T22:21:55.729 INFO:teuthology.orchestra.run.smithi163.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 76 kB/s | 23 kB 00:00 2024-09-12T22:21:56.167 INFO:teuthology.orchestra.run.smithi076.stdout:Transaction test succeeded. 2024-09-12T22:21:56.168 INFO:teuthology.orchestra.run.smithi076.stdout:Running transaction 2024-09-12T22:21:56.587 INFO:teuthology.orchestra.run.smithi148.stdout:(2/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 11 MB/s | 35 MB 00:03 2024-09-12T22:21:57.354 INFO:teuthology.orchestra.run.smithi148.stdout:(3/4): kernel-modules-core-5.14.0-505.el9.x86_6 7.5 MB/s | 29 MB 00:03 2024-09-12T22:21:58.270 INFO:teuthology.orchestra.run.smithi148.stdout:(4/4): kernel-core-5.14.0-505.el9.x86_64.rpm 3.2 MB/s | 16 MB 00:04 2024-09-12T22:21:58.271 INFO:teuthology.orchestra.run.smithi148.stdout:-------------------------------------------------------------------------------- 2024-09-12T22:21:58.271 INFO:teuthology.orchestra.run.smithi148.stdout:Total 16 MB/s | 79 MB 00:04 2024-09-12T22:21:58.605 INFO:teuthology.orchestra.run.smithi076.stdout: Preparing : 1/1 2024-09-12T22:21:58.949 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction check 2024-09-12T22:21:59.313 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-12T22:21:59.332 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction check succeeded. 2024-09-12T22:21:59.333 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction test 2024-09-12T22:21:59.397 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T22:22:00.289 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction test succeeded. 2024-09-12T22:22:00.289 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction 2024-09-12T22:22:02.185 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T22:22:02.322 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T22:22:02.738 INFO:teuthology.orchestra.run.smithi148.stdout: Preparing : 1/1 2024-09-12T22:22:03.453 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-12T22:22:03.537 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T22:22:03.561 INFO:teuthology.orchestra.run.smithi019.stdout:(2/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 3.8 MB/s | 35 MB 00:08 2024-09-12T22:22:03.928 INFO:teuthology.orchestra.run.smithi163.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 1.8 MB/s | 16 MB 00:08 2024-09-12T22:22:06.003 INFO:teuthology.orchestra.run.smithi163.stdout:(3/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 3.3 MB/s | 35 MB 00:10 2024-09-12T22:22:06.347 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T22:22:06.480 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T22:22:07.156 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T22:22:07.273 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T22:22:09.330 INFO:teuthology.orchestra.run.smithi163.stdout:(4/4): kernel-modules-core-5.14.0-505.el9.x86_6 2.1 MB/s | 29 MB 00:13 2024-09-12T22:22:09.330 INFO:teuthology.orchestra.run.smithi163.stdout:-------------------------------------------------------------------------------- 2024-09-12T22:22:09.330 INFO:teuthology.orchestra.run.smithi163.stdout:Total 5.6 MB/s | 79 MB 00:14 2024-09-12T22:22:09.969 INFO:teuthology.orchestra.run.smithi019.stdout:(3/4): kernel-core-5.14.0-505.el9.x86_64.rpm 1.0 MB/s | 16 MB 00:15 2024-09-12T22:22:10.013 INFO:teuthology.orchestra.run.smithi163.stdout:Running transaction check 2024-09-12T22:22:10.391 INFO:teuthology.orchestra.run.smithi163.stdout:Transaction check succeeded. 2024-09-12T22:22:10.391 INFO:teuthology.orchestra.run.smithi163.stdout:Running transaction test 2024-09-12T22:22:11.111 INFO:teuthology.orchestra.run.smithi019.stdout:(4/4): kernel-modules-core-5.14.0-505.el9.x86_6 1.8 MB/s | 29 MB 00:16 2024-09-12T22:22:11.111 INFO:teuthology.orchestra.run.smithi019.stdout:-------------------------------------------------------------------------------- 2024-09-12T22:22:11.112 INFO:teuthology.orchestra.run.smithi019.stdout:Total 4.7 MB/s | 79 MB 00:16 2024-09-12T22:22:11.303 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T22:22:11.346 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T22:22:11.362 INFO:teuthology.orchestra.run.smithi163.stdout:Transaction test succeeded. 2024-09-12T22:22:11.363 INFO:teuthology.orchestra.run.smithi163.stdout:Running transaction 2024-09-12T22:22:11.822 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction check 2024-09-12T22:22:12.095 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T22:22:12.200 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction check succeeded. 2024-09-12T22:22:12.200 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction test 2024-09-12T22:22:13.184 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction test succeeded. 2024-09-12T22:22:13.184 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction 2024-09-12T22:22:13.817 INFO:teuthology.orchestra.run.smithi163.stdout: Preparing : 1/1 2024-09-12T22:22:14.495 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-12T22:22:14.579 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T22:22:15.899 INFO:teuthology.orchestra.run.smithi019.stdout: Preparing : 1/1 2024-09-12T22:22:16.181 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T22:22:16.584 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-12T22:22:16.662 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T22:22:17.384 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T22:22:17.521 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T22:22:19.501 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T22:22:19.641 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T22:22:22.342 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T22:22:22.455 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T22:22:24.763 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T22:22:24.807 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T22:22:27.333 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T22:22:29.947 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T22:22:50.062 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T22:22:50.102 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-12T22:22:50.413 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T22:22:50.414 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-12T22:22:50.414 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T22:22:50.414 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T22:22:51.266 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T22:22:51.267 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-12T22:22:51.267 INFO:teuthology.orchestra.run.smithi076.stdout:Installed: 2024-09-12T22:22:51.267 INFO:teuthology.orchestra.run.smithi076.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-12T22:22:51.267 INFO:teuthology.orchestra.run.smithi076.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-12T22:22:51.267 INFO:teuthology.orchestra.run.smithi076.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-12T22:22:51.268 INFO:teuthology.orchestra.run.smithi076.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-12T22:22:51.268 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-12T22:22:51.268 INFO:teuthology.orchestra.run.smithi076.stdout:Complete! 2024-09-12T22:22:51.631 DEBUG:teuthology.orchestra.run.smithi076:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T22:22:51.717 INFO:teuthology.orchestra.run.smithi076.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T22:22:51.717 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T22:22:51.717 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-12T22:22:51.718 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-12T22:22:51.718 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-12T22:22:51.718 INFO:teuthology.task.kernel:Installing distro kernel on osd.0... 2024-09-12T22:22:51.718 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi076.front.sepia.ceph.com, path=None, version=distro) 2024-09-12T22:22:51.718 DEBUG:teuthology.orchestra.run.smithi076:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T22:22:51.777 INFO:teuthology.orchestra.run.smithi076.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T22:22:51.777 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T22:22:51.777 DEBUG:teuthology.orchestra.run.smithi076:> sudo rpm -qi grub2-tools 2024-09-12T22:22:51.810 INFO:teuthology.orchestra.run.smithi076.stdout:Name : grub2-tools 2024-09-12T22:22:51.810 INFO:teuthology.orchestra.run.smithi076.stdout:Epoch : 1 2024-09-12T22:22:51.810 INFO:teuthology.orchestra.run.smithi076.stdout:Version : 2.06 2024-09-12T22:22:51.810 INFO:teuthology.orchestra.run.smithi076.stdout:Release : 82.el9 2024-09-12T22:22:51.810 INFO:teuthology.orchestra.run.smithi076.stdout:Architecture: x86_64 2024-09-12T22:22:51.810 INFO:teuthology.orchestra.run.smithi076.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-12T22:22:51.810 INFO:teuthology.orchestra.run.smithi076.stdout:Group : Unspecified 2024-09-12T22:22:51.810 INFO:teuthology.orchestra.run.smithi076.stdout:Size : 8274670 2024-09-12T22:22:51.810 INFO:teuthology.orchestra.run.smithi076.stdout:License : GPLv3+ 2024-09-12T22:22:51.811 INFO:teuthology.orchestra.run.smithi076.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-12T22:22:51.811 INFO:teuthology.orchestra.run.smithi076.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-12T22:22:51.811 INFO:teuthology.orchestra.run.smithi076.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-12T22:22:51.811 INFO:teuthology.orchestra.run.smithi076.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-12T22:22:51.811 INFO:teuthology.orchestra.run.smithi076.stdout:Packager : builder@centos.org 2024-09-12T22:22:51.811 INFO:teuthology.orchestra.run.smithi076.stdout:Vendor : CentOS 2024-09-12T22:22:51.811 INFO:teuthology.orchestra.run.smithi076.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-12T22:22:51.811 INFO:teuthology.orchestra.run.smithi076.stdout:Summary : Support tools for GRUB. 2024-09-12T22:22:51.811 INFO:teuthology.orchestra.run.smithi076.stdout:Description : 2024-09-12T22:22:51.811 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-12T22:22:51.811 INFO:teuthology.orchestra.run.smithi076.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-12T22:22:51.811 INFO:teuthology.orchestra.run.smithi076.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-12T22:22:51.811 INFO:teuthology.orchestra.run.smithi076.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-12T22:22:51.812 INFO:teuthology.orchestra.run.smithi076.stdout:hardware devices. 2024-09-12T22:22:51.812 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-12T22:22:51.812 INFO:teuthology.orchestra.run.smithi076.stdout:This subpackage provides tools for support of all platforms. 2024-09-12T22:22:51.812 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-12T22:22:51.813 INFO:teuthology.task.kernel:Updating grub on smithi076 to boot 5.14.0-505.el9.x86_64 2024-09-12T22:22:51.813 DEBUG:teuthology.orchestra.run.smithi076:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-12T22:22:52.492 INFO:teuthology.orchestra.run.smithi076.stderr:Generating grub configuration file ... 2024-09-12T22:22:53.775 INFO:teuthology.orchestra.run.smithi076.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-12T22:22:53.810 INFO:teuthology.orchestra.run.smithi076.stderr:done 2024-09-12T22:22:53.812 DEBUG:teuthology.orchestra.run.smithi076:> mktemp 2024-09-12T22:22:53.827 INFO:teuthology.orchestra.run.smithi076.stdout:/tmp/tmp.xws84S2dr7 2024-09-12T22:22:53.828 DEBUG:teuthology.orchestra.run.smithi076:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.xws84S2dr7 2024-09-12T22:22:53.903 DEBUG:teuthology.orchestra.run.smithi076:> sudo chmod 0666 /tmp/tmp.xws84S2dr7 2024-09-12T22:22:54.051 DEBUG:teuthology.orchestra.remote:smithi076:/tmp/tmp.xws84S2dr7 is 6KB 2024-09-12T22:22:54.072 DEBUG:teuthology.orchestra.run.smithi076:> rm -fr /tmp/tmp.xws84S2dr7 2024-09-12T22:22:54.087 DEBUG:teuthology.orchestra.run.smithi076:> sudo /bin/ls /boot/loader/entries || true 2024-09-12T22:22:54.150 INFO:teuthology.orchestra.run.smithi076.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-12T22:22:54.151 INFO:teuthology.orchestra.run.smithi076.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-12T22:22:54.151 INFO:teuthology.orchestra.run.smithi076.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-12T22:22:54.151 INFO:teuthology.orchestra.run.smithi076.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-12T22:22:54.152 DEBUG:teuthology.orchestra.run.smithi076:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-12T22:22:54.297 DEBUG:teuthology.orchestra.run.smithi076:> sudo shutdown -r now 2024-09-12T22:22:54.427 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T22:22:54.468 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-12T22:22:54.791 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T22:22:54.791 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-12T22:22:54.791 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T22:22:54.792 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T22:22:55.653 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T22:22:55.653 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T22:22:55.653 INFO:teuthology.orchestra.run.smithi148.stdout:Installed: 2024-09-12T22:22:55.653 INFO:teuthology.orchestra.run.smithi148.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-12T22:22:55.653 INFO:teuthology.orchestra.run.smithi148.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-12T22:22:55.653 INFO:teuthology.orchestra.run.smithi148.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-12T22:22:55.653 INFO:teuthology.orchestra.run.smithi148.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-12T22:22:55.653 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T22:22:55.654 INFO:teuthology.orchestra.run.smithi148.stdout:Complete! 2024-09-12T22:22:55.985 DEBUG:teuthology.orchestra.run.smithi148:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T22:22:56.074 INFO:teuthology.orchestra.run.smithi148.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T22:22:56.074 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T22:22:56.074 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-12T22:22:56.074 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-12T22:22:56.074 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-12T22:22:56.075 INFO:teuthology.task.kernel:Installing distro kernel on osd.1... 2024-09-12T22:22:56.075 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi148.front.sepia.ceph.com, path=None, version=distro) 2024-09-12T22:22:56.075 DEBUG:teuthology.orchestra.run.smithi148:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T22:22:56.133 INFO:teuthology.orchestra.run.smithi148.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T22:22:56.134 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T22:22:56.134 DEBUG:teuthology.orchestra.run.smithi148:> sudo rpm -qi grub2-tools 2024-09-12T22:22:56.166 INFO:teuthology.orchestra.run.smithi148.stdout:Name : grub2-tools 2024-09-12T22:22:56.166 INFO:teuthology.orchestra.run.smithi148.stdout:Epoch : 1 2024-09-12T22:22:56.166 INFO:teuthology.orchestra.run.smithi148.stdout:Version : 2.06 2024-09-12T22:22:56.167 INFO:teuthology.orchestra.run.smithi148.stdout:Release : 82.el9 2024-09-12T22:22:56.167 INFO:teuthology.orchestra.run.smithi148.stdout:Architecture: x86_64 2024-09-12T22:22:56.167 INFO:teuthology.orchestra.run.smithi148.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-12T22:22:56.167 INFO:teuthology.orchestra.run.smithi148.stdout:Group : Unspecified 2024-09-12T22:22:56.167 INFO:teuthology.orchestra.run.smithi148.stdout:Size : 8274670 2024-09-12T22:22:56.167 INFO:teuthology.orchestra.run.smithi148.stdout:License : GPLv3+ 2024-09-12T22:22:56.167 INFO:teuthology.orchestra.run.smithi148.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-12T22:22:56.167 INFO:teuthology.orchestra.run.smithi148.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-12T22:22:56.167 INFO:teuthology.orchestra.run.smithi148.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-12T22:22:56.167 INFO:teuthology.orchestra.run.smithi148.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-12T22:22:56.167 INFO:teuthology.orchestra.run.smithi148.stdout:Packager : builder@centos.org 2024-09-12T22:22:56.167 INFO:teuthology.orchestra.run.smithi148.stdout:Vendor : CentOS 2024-09-12T22:22:56.168 INFO:teuthology.orchestra.run.smithi148.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-12T22:22:56.168 INFO:teuthology.orchestra.run.smithi148.stdout:Summary : Support tools for GRUB. 2024-09-12T22:22:56.168 INFO:teuthology.orchestra.run.smithi148.stdout:Description : 2024-09-12T22:22:56.168 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T22:22:56.168 INFO:teuthology.orchestra.run.smithi148.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-12T22:22:56.168 INFO:teuthology.orchestra.run.smithi148.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-12T22:22:56.168 INFO:teuthology.orchestra.run.smithi148.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-12T22:22:56.168 INFO:teuthology.orchestra.run.smithi148.stdout:hardware devices. 2024-09-12T22:22:56.168 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T22:22:56.168 INFO:teuthology.orchestra.run.smithi148.stdout:This subpackage provides tools for support of all platforms. 2024-09-12T22:22:56.169 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-12T22:22:56.169 INFO:teuthology.task.kernel:Updating grub on smithi148 to boot 5.14.0-505.el9.x86_64 2024-09-12T22:22:56.169 DEBUG:teuthology.orchestra.run.smithi148:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-12T22:22:56.827 INFO:teuthology.orchestra.run.smithi148.stderr:Generating grub configuration file ... 2024-09-12T22:22:58.147 INFO:teuthology.orchestra.run.smithi148.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-12T22:22:58.179 INFO:teuthology.orchestra.run.smithi148.stderr:done 2024-09-12T22:22:58.181 DEBUG:teuthology.orchestra.run.smithi148:> mktemp 2024-09-12T22:22:58.196 INFO:teuthology.orchestra.run.smithi148.stdout:/tmp/tmp.R764vykebk 2024-09-12T22:22:58.196 DEBUG:teuthology.orchestra.run.smithi148:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.R764vykebk 2024-09-12T22:22:58.269 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod 0666 /tmp/tmp.R764vykebk 2024-09-12T22:22:58.407 DEBUG:teuthology.orchestra.remote:smithi148:/tmp/tmp.R764vykebk is 6KB 2024-09-12T22:22:58.456 DEBUG:teuthology.orchestra.run.smithi148:> rm -fr /tmp/tmp.R764vykebk 2024-09-12T22:22:58.471 DEBUG:teuthology.orchestra.run.smithi148:> sudo /bin/ls /boot/loader/entries || true 2024-09-12T22:22:58.541 INFO:teuthology.orchestra.run.smithi148.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-12T22:22:58.541 INFO:teuthology.orchestra.run.smithi148.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-12T22:22:58.541 INFO:teuthology.orchestra.run.smithi148.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-12T22:22:58.541 INFO:teuthology.orchestra.run.smithi148.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-12T22:22:58.542 DEBUG:teuthology.orchestra.run.smithi148:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-12T22:22:58.699 DEBUG:teuthology.orchestra.run.smithi148:> sudo shutdown -r now 2024-09-12T22:23:05.458 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T22:23:05.498 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-12T22:23:05.779 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T22:23:05.779 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-12T22:23:05.779 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T22:23:05.780 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T22:23:06.633 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T22:23:06.634 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-09-12T22:23:06.634 INFO:teuthology.orchestra.run.smithi163.stdout:Installed: 2024-09-12T22:23:06.634 INFO:teuthology.orchestra.run.smithi163.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-12T22:23:06.634 INFO:teuthology.orchestra.run.smithi163.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-12T22:23:06.634 INFO:teuthology.orchestra.run.smithi163.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-12T22:23:06.634 INFO:teuthology.orchestra.run.smithi163.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-12T22:23:06.634 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-09-12T22:23:06.634 INFO:teuthology.orchestra.run.smithi163.stdout:Complete! 2024-09-12T22:23:06.990 DEBUG:teuthology.orchestra.run.smithi163:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T22:23:07.082 INFO:teuthology.orchestra.run.smithi163.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T22:23:07.082 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T22:23:07.082 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-12T22:23:07.082 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-12T22:23:07.082 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-12T22:23:07.082 INFO:teuthology.task.kernel:Installing distro kernel on osd.2... 2024-09-12T22:23:07.083 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi163.front.sepia.ceph.com, path=None, version=distro) 2024-09-12T22:23:07.083 DEBUG:teuthology.orchestra.run.smithi163:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T22:23:07.140 INFO:teuthology.orchestra.run.smithi163.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T22:23:07.141 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T22:23:07.141 DEBUG:teuthology.orchestra.run.smithi163:> sudo rpm -qi grub2-tools 2024-09-12T22:23:07.173 INFO:teuthology.orchestra.run.smithi163.stdout:Name : grub2-tools 2024-09-12T22:23:07.173 INFO:teuthology.orchestra.run.smithi163.stdout:Epoch : 1 2024-09-12T22:23:07.173 INFO:teuthology.orchestra.run.smithi163.stdout:Version : 2.06 2024-09-12T22:23:07.173 INFO:teuthology.orchestra.run.smithi163.stdout:Release : 82.el9 2024-09-12T22:23:07.173 INFO:teuthology.orchestra.run.smithi163.stdout:Architecture: x86_64 2024-09-12T22:23:07.173 INFO:teuthology.orchestra.run.smithi163.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-12T22:23:07.173 INFO:teuthology.orchestra.run.smithi163.stdout:Group : Unspecified 2024-09-12T22:23:07.173 INFO:teuthology.orchestra.run.smithi163.stdout:Size : 8274670 2024-09-12T22:23:07.174 INFO:teuthology.orchestra.run.smithi163.stdout:License : GPLv3+ 2024-09-12T22:23:07.174 INFO:teuthology.orchestra.run.smithi163.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-12T22:23:07.174 INFO:teuthology.orchestra.run.smithi163.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-12T22:23:07.174 INFO:teuthology.orchestra.run.smithi163.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-12T22:23:07.174 INFO:teuthology.orchestra.run.smithi163.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-12T22:23:07.174 INFO:teuthology.orchestra.run.smithi163.stdout:Packager : builder@centos.org 2024-09-12T22:23:07.175 INFO:teuthology.orchestra.run.smithi163.stdout:Vendor : CentOS 2024-09-12T22:23:07.175 INFO:teuthology.orchestra.run.smithi163.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-12T22:23:07.175 INFO:teuthology.orchestra.run.smithi163.stdout:Summary : Support tools for GRUB. 2024-09-12T22:23:07.175 INFO:teuthology.orchestra.run.smithi163.stdout:Description : 2024-09-12T22:23:07.175 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-09-12T22:23:07.175 INFO:teuthology.orchestra.run.smithi163.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-12T22:23:07.175 INFO:teuthology.orchestra.run.smithi163.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-12T22:23:07.175 INFO:teuthology.orchestra.run.smithi163.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-12T22:23:07.175 INFO:teuthology.orchestra.run.smithi163.stdout:hardware devices. 2024-09-12T22:23:07.175 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-09-12T22:23:07.175 INFO:teuthology.orchestra.run.smithi163.stdout:This subpackage provides tools for support of all platforms. 2024-09-12T22:23:07.176 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-12T22:23:07.176 INFO:teuthology.task.kernel:Updating grub on smithi163 to boot 5.14.0-505.el9.x86_64 2024-09-12T22:23:07.177 DEBUG:teuthology.orchestra.run.smithi163:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-12T22:23:07.773 INFO:teuthology.orchestra.run.smithi163.stderr:Generating grub configuration file ... 2024-09-12T22:23:09.062 INFO:teuthology.orchestra.run.smithi163.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-12T22:23:09.090 INFO:teuthology.orchestra.run.smithi163.stderr:done 2024-09-12T22:23:09.092 DEBUG:teuthology.orchestra.run.smithi163:> mktemp 2024-09-12T22:23:09.107 INFO:teuthology.orchestra.run.smithi163.stdout:/tmp/tmp.iUC49VAeYB 2024-09-12T22:23:09.108 DEBUG:teuthology.orchestra.run.smithi163:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.iUC49VAeYB 2024-09-12T22:23:09.183 DEBUG:teuthology.orchestra.run.smithi163:> sudo chmod 0666 /tmp/tmp.iUC49VAeYB 2024-09-12T22:23:09.331 DEBUG:teuthology.orchestra.remote:smithi163:/tmp/tmp.iUC49VAeYB is 6KB 2024-09-12T22:23:09.331 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T22:23:09.376 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-12T22:23:09.380 DEBUG:teuthology.orchestra.run.smithi163:> rm -fr /tmp/tmp.iUC49VAeYB 2024-09-12T22:23:09.395 DEBUG:teuthology.orchestra.run.smithi163:> sudo /bin/ls /boot/loader/entries || true 2024-09-12T22:23:09.458 INFO:teuthology.orchestra.run.smithi163.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-12T22:23:09.459 INFO:teuthology.orchestra.run.smithi163.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-12T22:23:09.459 INFO:teuthology.orchestra.run.smithi163.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-12T22:23:09.459 INFO:teuthology.orchestra.run.smithi163.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-12T22:23:09.460 DEBUG:teuthology.orchestra.run.smithi163:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-12T22:23:09.619 DEBUG:teuthology.orchestra.run.smithi163:> sudo shutdown -r now 2024-09-12T22:23:09.836 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T22:23:09.837 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-12T22:23:09.837 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T22:23:09.837 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T22:23:10.665 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T22:23:10.665 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:23:10.665 INFO:teuthology.orchestra.run.smithi019.stdout:Installed: 2024-09-12T22:23:10.665 INFO:teuthology.orchestra.run.smithi019.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-12T22:23:10.665 INFO:teuthology.orchestra.run.smithi019.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-12T22:23:10.665 INFO:teuthology.orchestra.run.smithi019.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-12T22:23:10.665 INFO:teuthology.orchestra.run.smithi019.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-12T22:23:10.665 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:23:10.665 INFO:teuthology.orchestra.run.smithi019.stdout:Complete! 2024-09-12T22:23:11.015 DEBUG:teuthology.orchestra.run.smithi019:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T22:23:11.109 INFO:teuthology.orchestra.run.smithi019.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T22:23:11.109 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T22:23:11.109 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-12T22:23:11.109 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-12T22:23:11.110 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-12T22:23:11.110 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-12T22:23:11.110 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi019.front.sepia.ceph.com, path=None, version=distro) 2024-09-12T22:23:11.110 DEBUG:teuthology.orchestra.run.smithi019:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T22:23:11.169 INFO:teuthology.orchestra.run.smithi019.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T22:23:11.169 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T22:23:11.170 DEBUG:teuthology.orchestra.run.smithi019:> sudo rpm -qi grub2-tools 2024-09-12T22:23:11.206 INFO:teuthology.orchestra.run.smithi019.stdout:Name : grub2-tools 2024-09-12T22:23:11.207 INFO:teuthology.orchestra.run.smithi019.stdout:Epoch : 1 2024-09-12T22:23:11.207 INFO:teuthology.orchestra.run.smithi019.stdout:Version : 2.06 2024-09-12T22:23:11.207 INFO:teuthology.orchestra.run.smithi019.stdout:Release : 82.el9 2024-09-12T22:23:11.207 INFO:teuthology.orchestra.run.smithi019.stdout:Architecture: x86_64 2024-09-12T22:23:11.207 INFO:teuthology.orchestra.run.smithi019.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-12T22:23:11.207 INFO:teuthology.orchestra.run.smithi019.stdout:Group : Unspecified 2024-09-12T22:23:11.207 INFO:teuthology.orchestra.run.smithi019.stdout:Size : 8274670 2024-09-12T22:23:11.207 INFO:teuthology.orchestra.run.smithi019.stdout:License : GPLv3+ 2024-09-12T22:23:11.207 INFO:teuthology.orchestra.run.smithi019.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-12T22:23:11.207 INFO:teuthology.orchestra.run.smithi019.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-12T22:23:11.207 INFO:teuthology.orchestra.run.smithi019.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-12T22:23:11.207 INFO:teuthology.orchestra.run.smithi019.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-12T22:23:11.208 INFO:teuthology.orchestra.run.smithi019.stdout:Packager : builder@centos.org 2024-09-12T22:23:11.208 INFO:teuthology.orchestra.run.smithi019.stdout:Vendor : CentOS 2024-09-12T22:23:11.208 INFO:teuthology.orchestra.run.smithi019.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-12T22:23:11.208 INFO:teuthology.orchestra.run.smithi019.stdout:Summary : Support tools for GRUB. 2024-09-12T22:23:11.208 INFO:teuthology.orchestra.run.smithi019.stdout:Description : 2024-09-12T22:23:11.208 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:23:11.208 INFO:teuthology.orchestra.run.smithi019.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-12T22:23:11.208 INFO:teuthology.orchestra.run.smithi019.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-12T22:23:11.208 INFO:teuthology.orchestra.run.smithi019.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-12T22:23:11.208 INFO:teuthology.orchestra.run.smithi019.stdout:hardware devices. 2024-09-12T22:23:11.208 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:23:11.208 INFO:teuthology.orchestra.run.smithi019.stdout:This subpackage provides tools for support of all platforms. 2024-09-12T22:23:11.209 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-12T22:23:11.209 INFO:teuthology.task.kernel:Updating grub on smithi019 to boot 5.14.0-505.el9.x86_64 2024-09-12T22:23:11.210 DEBUG:teuthology.orchestra.run.smithi019:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-12T22:23:11.901 INFO:teuthology.orchestra.run.smithi019.stderr:Generating grub configuration file ... 2024-09-12T22:23:13.273 INFO:teuthology.orchestra.run.smithi019.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-12T22:23:13.306 INFO:teuthology.orchestra.run.smithi019.stderr:done 2024-09-12T22:23:13.309 DEBUG:teuthology.orchestra.run.smithi019:> mktemp 2024-09-12T22:23:13.323 INFO:teuthology.orchestra.run.smithi019.stdout:/tmp/tmp.b9ZKZo0iOY 2024-09-12T22:23:13.324 DEBUG:teuthology.orchestra.run.smithi019:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.b9ZKZo0iOY 2024-09-12T22:23:13.389 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 0666 /tmp/tmp.b9ZKZo0iOY 2024-09-12T22:23:13.526 DEBUG:teuthology.orchestra.remote:smithi019:/tmp/tmp.b9ZKZo0iOY is 6KB 2024-09-12T22:23:13.573 DEBUG:teuthology.orchestra.run.smithi019:> rm -fr /tmp/tmp.b9ZKZo0iOY 2024-09-12T22:23:13.588 DEBUG:teuthology.orchestra.run.smithi019:> sudo /bin/ls /boot/loader/entries || true 2024-09-12T22:23:13.650 INFO:teuthology.orchestra.run.smithi019.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-12T22:23:13.650 INFO:teuthology.orchestra.run.smithi019.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-12T22:23:13.650 INFO:teuthology.orchestra.run.smithi019.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-12T22:23:13.650 INFO:teuthology.orchestra.run.smithi019.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-12T22:23:13.652 DEBUG:teuthology.orchestra.run.smithi019:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-12T22:23:13.811 DEBUG:teuthology.orchestra.run.smithi019:> sudo shutdown -r now 2024-09-12T22:23:24.310 INFO:teuthology.task.kernel:Checking client osd.0 for new kernel version... 2024-09-12T22:23:24.310 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi076.front.sepia.ceph.com' 2024-09-12T22:23:24.311 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T22:23:28.705 INFO:teuthology.task.kernel:Checking client osd.1 for new kernel version... 2024-09-12T22:23:28.705 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi148.front.sepia.ceph.com' 2024-09-12T22:23:28.706 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T22:23:39.629 INFO:teuthology.task.kernel:Checking client osd.2 for new kernel version... 2024-09-12T22:23:39.629 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi163.front.sepia.ceph.com' 2024-09-12T22:23:39.630 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T22:23:43.818 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-12T22:23:43.819 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi019.front.sepia.ceph.com' 2024-09-12T22:23:43.819 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T22:23:58.781 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.76 2024-09-12T22:24:03.389 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.148 2024-09-12T22:24:07.785 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi076.front.sepia.ceph.com' 2024-09-12T22:24:07.785 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T22:24:12.397 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi148.front.sepia.ceph.com' 2024-09-12T22:24:12.397 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T22:24:14.141 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.163 2024-09-12T22:24:23.149 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi163.front.sepia.ceph.com' 2024-09-12T22:24:23.150 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T22:24:26.173 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.76 2024-09-12T22:24:26.205 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.163 2024-09-12T22:24:30.781 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.148 2024-09-12T22:24:38.181 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi076.front.sepia.ceph.com' 2024-09-12T22:24:38.182 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T22:24:38.206 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi163.front.sepia.ceph.com' 2024-09-12T22:24:38.206 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T22:24:42.782 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi148.front.sepia.ceph.com' 2024-09-12T22:24:42.783 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T22:24:43.822 DEBUG:teuthology.orchestra.remote:timed out 2024-09-12T22:24:45.067 DEBUG:teuthology.orchestra.run.smithi076:> true 2024-09-12T22:24:45.251 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi076.front.sepia.ceph.com' 2024-09-12T22:24:45.251 INFO:teuthology.task.kernel:Checking kernel version of osd.0, want "5.14.0-505.el9.x86_64"... 2024-09-12T22:24:45.252 DEBUG:teuthology.orchestra.run.smithi076:> uname -r 2024-09-12T22:24:45.267 INFO:teuthology.orchestra.run.smithi076.stdout:5.14.0-505.el9.x86_64 2024-09-12T22:24:45.268 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-12T22:24:45.268 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-12T22:24:45.268 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-12T22:24:45.853 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.148 2024-09-12T22:24:46.269 INFO:teuthology.task.kernel:Enabling kdb on osd.0... 2024-09-12T22:24:46.269 DEBUG:teuthology.orchestra.run.smithi076:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-12T22:24:46.367 INFO:teuthology.orchestra.run.smithi076.stdout:ttyS1 2024-09-12T22:24:46.386 DEBUG:teuthology.parallel:result is None 2024-09-12T22:24:52.823 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi019.front.sepia.ceph.com' 2024-09-12T22:24:52.824 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T22:24:56.212 DEBUG:teuthology.orchestra.run.smithi019:> true 2024-09-12T22:24:56.591 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi019.front.sepia.ceph.com' 2024-09-12T22:24:56.591 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-505.el9.x86_64"... 2024-09-12T22:24:56.592 DEBUG:teuthology.orchestra.run.smithi019:> uname -r 2024-09-12T22:24:56.606 INFO:teuthology.orchestra.run.smithi019.stdout:5.14.0-505.el9.x86_64 2024-09-12T22:24:56.606 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-12T22:24:56.607 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-12T22:24:56.607 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-12T22:24:56.637 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.163 2024-09-12T22:24:57.608 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-12T22:24:57.608 DEBUG:teuthology.orchestra.run.smithi019:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-12T22:24:57.684 INFO:teuthology.orchestra.run.smithi019.stdout:ttyS1 2024-09-12T22:24:57.711 DEBUG:teuthology.parallel:result is None 2024-09-12T22:25:00.853 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi148.front.sepia.ceph.com' 2024-09-12T22:25:00.854 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T22:25:01.276 DEBUG:teuthology.orchestra.run.smithi148:> true 2024-09-12T22:25:01.632 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi148.front.sepia.ceph.com' 2024-09-12T22:25:01.632 INFO:teuthology.task.kernel:Checking kernel version of osd.1, want "5.14.0-505.el9.x86_64"... 2024-09-12T22:25:01.632 DEBUG:teuthology.orchestra.run.smithi148:> uname -r 2024-09-12T22:25:01.647 INFO:teuthology.orchestra.run.smithi148.stdout:5.14.0-505.el9.x86_64 2024-09-12T22:25:01.648 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-12T22:25:01.648 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-12T22:25:01.648 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-12T22:25:02.649 INFO:teuthology.task.kernel:Enabling kdb on osd.1... 2024-09-12T22:25:02.649 DEBUG:teuthology.orchestra.run.smithi148:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-12T22:25:02.710 INFO:teuthology.orchestra.run.smithi148.stdout:ttyS1 2024-09-12T22:25:02.731 DEBUG:teuthology.parallel:result is None 2024-09-12T22:25:11.639 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi163.front.sepia.ceph.com' 2024-09-12T22:25:11.640 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T22:25:11.939 DEBUG:teuthology.orchestra.run.smithi163:> true 2024-09-12T22:25:12.270 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi163.front.sepia.ceph.com' 2024-09-12T22:25:12.270 INFO:teuthology.task.kernel:Checking kernel version of osd.2, want "5.14.0-505.el9.x86_64"... 2024-09-12T22:25:12.270 DEBUG:teuthology.orchestra.run.smithi163:> uname -r 2024-09-12T22:25:12.284 INFO:teuthology.orchestra.run.smithi163.stdout:5.14.0-505.el9.x86_64 2024-09-12T22:25:12.284 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-12T22:25:12.285 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-12T22:25:12.285 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-12T22:25:13.286 INFO:teuthology.task.kernel:Enabling kdb on osd.2... 2024-09-12T22:25:13.286 DEBUG:teuthology.orchestra.run.smithi163:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-12T22:25:13.419 INFO:teuthology.orchestra.run.smithi163.stdout:ttyS1 2024-09-12T22:25:13.448 DEBUG:teuthology.parallel:result is None 2024-09-12T22:25:13.448 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-12T22:25:13.560 INFO:teuthology.task.internal:Creating test directory... 2024-09-12T22:25:13.560 DEBUG:teuthology.orchestra.run.smithi019:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T22:25:13.563 DEBUG:teuthology.orchestra.run.smithi076:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T22:25:13.567 DEBUG:teuthology.orchestra.run.smithi148:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T22:25:13.570 DEBUG:teuthology.orchestra.run.smithi163:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T22:25:13.614 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-12T22:25:13.632 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-12T22:25:13.709 INFO:teuthology.task.internal:Creating archive directory... 2024-09-12T22:25:13.709 DEBUG:teuthology.orchestra.run.smithi019:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T22:25:13.712 DEBUG:teuthology.orchestra.run.smithi076:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T22:25:13.714 DEBUG:teuthology.orchestra.run.smithi148:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T22:25:13.717 DEBUG:teuthology.orchestra.run.smithi163:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T22:25:13.784 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-12T22:25:13.790 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-12T22:25:13.791 DEBUG:teuthology.orchestra.run.smithi019:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T22:25:13.793 DEBUG:teuthology.orchestra.run.smithi076:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T22:25:13.796 DEBUG:teuthology.orchestra.run.smithi148:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T22:25:13.798 DEBUG:teuthology.orchestra.run.smithi163:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T22:25:13.822 INFO:teuthology.orchestra.run.smithi019.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T22:25:13.826 INFO:teuthology.orchestra.run.smithi076.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T22:25:13.830 INFO:teuthology.orchestra.run.smithi163.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T22:25:13.835 INFO:teuthology.orchestra.run.smithi019.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T22:25:13.837 INFO:teuthology.orchestra.run.smithi076.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T22:25:13.841 INFO:teuthology.orchestra.run.smithi163.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T22:25:13.841 INFO:teuthology.orchestra.run.smithi148.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T22:25:13.852 INFO:teuthology.orchestra.run.smithi148.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T22:25:13.854 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-12T22:25:13.861 INFO:teuthology.task.internal:Configuring sudo... 2024-09-12T22:25:13.861 DEBUG:teuthology.orchestra.run.smithi019:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T22:25:13.879 DEBUG:teuthology.orchestra.run.smithi076:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T22:25:13.884 DEBUG:teuthology.orchestra.run.smithi148:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T22:25:13.886 DEBUG:teuthology.orchestra.run.smithi163:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T22:25:13.914 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-12T22:25:13.934 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-12T22:25:13.935 DEBUG:teuthology.orchestra.run.smithi019:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T22:25:13.950 DEBUG:teuthology.orchestra.run.smithi076:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T22:25:13.952 DEBUG:teuthology.orchestra.run.smithi148:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T22:25:13.955 DEBUG:teuthology.orchestra.run.smithi163:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T22:25:13.975 DEBUG:teuthology.orchestra.run.smithi019:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T22:25:14.052 DEBUG:teuthology.orchestra.run.smithi019:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T22:25:14.102 DEBUG:teuthology.orchestra.run.smithi019:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T22:25:14.184 DEBUG:teuthology.orchestra.run.smithi019:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T22:25:14.230 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T22:25:14.231 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T22:25:14.299 DEBUG:teuthology.orchestra.run.smithi076:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T22:25:14.344 DEBUG:teuthology.orchestra.run.smithi076:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T22:25:14.398 DEBUG:teuthology.orchestra.run.smithi076:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T22:25:14.481 DEBUG:teuthology.orchestra.run.smithi076:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T22:25:14.526 DEBUG:teuthology.orchestra.run.smithi076:> set -ex 2024-09-12T22:25:14.527 DEBUG:teuthology.orchestra.run.smithi076:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T22:25:14.593 DEBUG:teuthology.orchestra.run.smithi148:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T22:25:14.639 DEBUG:teuthology.orchestra.run.smithi148:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T22:25:14.701 DEBUG:teuthology.orchestra.run.smithi148:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T22:25:14.748 DEBUG:teuthology.orchestra.run.smithi148:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T22:25:14.790 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-12T22:25:14.790 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T22:25:14.856 DEBUG:teuthology.orchestra.run.smithi163:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T22:25:14.899 DEBUG:teuthology.orchestra.run.smithi163:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T22:25:14.952 DEBUG:teuthology.orchestra.run.smithi163:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T22:25:15.034 DEBUG:teuthology.orchestra.run.smithi163:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T22:25:15.073 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-09-12T22:25:15.073 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T22:25:15.138 DEBUG:teuthology.orchestra.run.smithi019:> sudo service rsyslog restart 2024-09-12T22:25:15.141 DEBUG:teuthology.orchestra.run.smithi076:> sudo service rsyslog restart 2024-09-12T22:25:15.143 DEBUG:teuthology.orchestra.run.smithi148:> sudo service rsyslog restart 2024-09-12T22:25:15.146 DEBUG:teuthology.orchestra.run.smithi163:> sudo service rsyslog restart 2024-09-12T22:25:15.191 INFO:teuthology.orchestra.run.smithi148.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T22:25:15.193 INFO:teuthology.orchestra.run.smithi019.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T22:25:15.196 INFO:teuthology.orchestra.run.smithi076.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T22:25:15.222 INFO:teuthology.orchestra.run.smithi163.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T22:25:15.725 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-12T22:25:15.733 INFO:teuthology.task.internal:Starting timer... 2024-09-12T22:25:15.733 INFO:teuthology.run_tasks:Running task pcp... 2024-09-12T22:25:15.793 INFO:teuthology.run_tasks:Running task selinux... 2024-09-12T22:25:15.871 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-09-12T22:25:15.871 DEBUG:teuthology.orchestra.run.smithi019:> sudo service auditd rotate 2024-09-12T22:25:15.952 INFO:teuthology.orchestra.run.smithi019.stdout:Rotating logs: 2024-09-12T22:25:15.954 DEBUG:teuthology.orchestra.run.smithi076:> sudo service auditd rotate 2024-09-12T22:25:16.040 INFO:teuthology.orchestra.run.smithi076.stdout:Rotating logs: 2024-09-12T22:25:16.042 DEBUG:teuthology.orchestra.run.smithi148:> sudo service auditd rotate 2024-09-12T22:25:16.101 INFO:teuthology.orchestra.run.smithi148.stdout:Rotating logs: 2024-09-12T22:25:16.103 DEBUG:teuthology.orchestra.run.smithi163:> sudo service auditd rotate 2024-09-12T22:25:16.161 INFO:teuthology.orchestra.run.smithi163.stdout:Rotating logs: 2024-09-12T22:25:16.163 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-12T22:25:16.163 DEBUG:teuthology.orchestra.run.smithi019:> /usr/sbin/getenforce 2024-09-12T22:25:16.192 INFO:teuthology.orchestra.run.smithi019.stdout:Permissive 2024-09-12T22:25:16.192 DEBUG:teuthology.orchestra.run.smithi076:> /usr/sbin/getenforce 2024-09-12T22:25:16.217 INFO:teuthology.orchestra.run.smithi076.stdout:Permissive 2024-09-12T22:25:16.217 DEBUG:teuthology.orchestra.run.smithi148:> /usr/sbin/getenforce 2024-09-12T22:25:16.241 INFO:teuthology.orchestra.run.smithi148.stdout:Permissive 2024-09-12T22:25:16.241 DEBUG:teuthology.orchestra.run.smithi163:> /usr/sbin/getenforce 2024-09-12T22:25:16.269 INFO:teuthology.orchestra.run.smithi163.stdout:Permissive 2024-09-12T22:25:16.269 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi019.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi076.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi148.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi163.front.sepia.ceph.com': 'permissive'} 2024-09-12T22:25:16.269 DEBUG:teuthology.orchestra.run.smithi019:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T22:25:16.299 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T22:25:16.300 DEBUG:teuthology.orchestra.run.smithi076:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T22:25:16.330 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T22:25:16.331 DEBUG:teuthology.orchestra.run.smithi148:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T22:25:16.359 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T22:25:16.360 DEBUG:teuthology.orchestra.run.smithi163:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T22:25:16.388 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T22:25:16.389 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-12T22:25:16.389 DEBUG:teuthology.orchestra.run.smithi019:> sudo /usr/sbin/setenforce permissive 2024-09-12T22:25:16.424 DEBUG:teuthology.orchestra.run.smithi076:> sudo /usr/sbin/setenforce permissive 2024-09-12T22:25:16.460 DEBUG:teuthology.orchestra.run.smithi148:> sudo /usr/sbin/setenforce permissive 2024-09-12T22:25:16.496 DEBUG:teuthology.orchestra.run.smithi163:> sudo /usr/sbin/setenforce permissive 2024-09-12T22:25:16.528 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-12T22:25:16.538 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-12T22:25:16.551 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-12T22:25:16.552 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi019.front.sepia.ceph.com,smithi076.front.sepia.ceph.com,smithi148.front.sepia.ceph.com,smithi163.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-12T22:29:04.916 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi019.front.sepia.ceph.com'), Remote(name='ubuntu@smithi076.front.sepia.ceph.com'), Remote(name='ubuntu@smithi148.front.sepia.ceph.com'), Remote(name='ubuntu@smithi163.front.sepia.ceph.com')] 2024-09-12T22:29:04.917 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi019.front.sepia.ceph.com' 2024-09-12T22:29:04.919 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T22:29:04.997 DEBUG:teuthology.orchestra.run.smithi019:> true 2024-09-12T22:29:05.090 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi019.front.sepia.ceph.com' 2024-09-12T22:29:05.091 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi076.front.sepia.ceph.com' 2024-09-12T22:29:05.091 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T22:29:05.193 DEBUG:teuthology.orchestra.run.smithi076:> true 2024-09-12T22:29:05.268 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi076.front.sepia.ceph.com' 2024-09-12T22:29:05.269 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi148.front.sepia.ceph.com' 2024-09-12T22:29:05.269 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T22:29:05.348 DEBUG:teuthology.orchestra.run.smithi148:> true 2024-09-12T22:29:05.438 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi148.front.sepia.ceph.com' 2024-09-12T22:29:05.439 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi163.front.sepia.ceph.com' 2024-09-12T22:29:05.439 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T22:29:05.515 DEBUG:teuthology.orchestra.run.smithi163:> true 2024-09-12T22:29:05.597 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi163.front.sepia.ceph.com' 2024-09-12T22:29:05.598 INFO:teuthology.run_tasks:Running task clock... 2024-09-12T22:29:05.613 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-12T22:29:05.613 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T22:29:05.614 DEBUG:teuthology.orchestra.run.smithi019:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T22:29:05.617 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T22:29:05.617 DEBUG:teuthology.orchestra.run.smithi076:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T22:29:05.619 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T22:29:05.619 DEBUG:teuthology.orchestra.run.smithi148:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T22:29:05.622 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T22:29:05.622 DEBUG:teuthology.orchestra.run.smithi163:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T22:29:05.649 INFO:teuthology.orchestra.run.smithi019.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-12T22:29:05.650 INFO:teuthology.orchestra.run.smithi076.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-12T22:29:05.652 INFO:teuthology.orchestra.run.smithi148.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-12T22:29:05.665 INFO:teuthology.orchestra.run.smithi019.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-12T22:29:05.666 INFO:teuthology.orchestra.run.smithi076.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-12T22:29:05.668 INFO:teuthology.orchestra.run.smithi148.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-12T22:29:05.669 INFO:teuthology.orchestra.run.smithi163.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-12T22:29:05.684 INFO:teuthology.orchestra.run.smithi163.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-12T22:29:05.691 INFO:teuthology.orchestra.run.smithi076.stderr:sudo: ntpd: command not found 2024-09-12T22:29:05.693 INFO:teuthology.orchestra.run.smithi019.stderr:sudo: ntpd: command not found 2024-09-12T22:29:05.695 INFO:teuthology.orchestra.run.smithi148.stderr:sudo: ntpd: command not found 2024-09-12T22:29:05.703 INFO:teuthology.orchestra.run.smithi076.stdout:506 Cannot talk to daemon 2024-09-12T22:29:05.706 INFO:teuthology.orchestra.run.smithi019.stdout:506 Cannot talk to daemon 2024-09-12T22:29:05.707 INFO:teuthology.orchestra.run.smithi148.stdout:506 Cannot talk to daemon 2024-09-12T22:29:05.710 INFO:teuthology.orchestra.run.smithi163.stderr:sudo: ntpd: command not found 2024-09-12T22:29:05.718 INFO:teuthology.orchestra.run.smithi076.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-12T22:29:05.721 INFO:teuthology.orchestra.run.smithi163.stdout:506 Cannot talk to daemon 2024-09-12T22:29:05.722 INFO:teuthology.orchestra.run.smithi148.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-12T22:29:05.722 INFO:teuthology.orchestra.run.smithi019.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-12T22:29:05.732 INFO:teuthology.orchestra.run.smithi076.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-12T22:29:05.736 INFO:teuthology.orchestra.run.smithi163.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-12T22:29:05.736 INFO:teuthology.orchestra.run.smithi148.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-12T22:29:05.737 INFO:teuthology.orchestra.run.smithi019.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-12T22:29:05.750 INFO:teuthology.orchestra.run.smithi163.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-12T22:29:05.789 INFO:teuthology.orchestra.run.smithi076.stderr:bash: line 1: ntpq: command not found 2024-09-12T22:29:05.793 INFO:teuthology.orchestra.run.smithi076.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T22:29:05.793 INFO:teuthology.orchestra.run.smithi076.stdout:=============================================================================== 2024-09-12T22:29:05.793 INFO:teuthology.orchestra.run.smithi076.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T22:29:05.793 INFO:teuthology.orchestra.run.smithi076.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T22:29:05.793 INFO:teuthology.orchestra.run.smithi076.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T22:29:05.793 INFO:teuthology.orchestra.run.smithi076.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T22:29:05.795 INFO:teuthology.orchestra.run.smithi019.stderr:bash: line 1: ntpq: command not found 2024-09-12T22:29:05.799 INFO:teuthology.orchestra.run.smithi019.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T22:29:05.799 INFO:teuthology.orchestra.run.smithi019.stdout:=============================================================================== 2024-09-12T22:29:05.799 INFO:teuthology.orchestra.run.smithi019.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T22:29:05.799 INFO:teuthology.orchestra.run.smithi019.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T22:29:05.799 INFO:teuthology.orchestra.run.smithi019.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T22:29:05.799 INFO:teuthology.orchestra.run.smithi019.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T22:29:05.800 INFO:teuthology.orchestra.run.smithi148.stderr:bash: line 1: ntpq: command not found 2024-09-12T22:29:05.803 INFO:teuthology.orchestra.run.smithi148.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T22:29:05.803 INFO:teuthology.orchestra.run.smithi148.stdout:=============================================================================== 2024-09-12T22:29:05.804 INFO:teuthology.orchestra.run.smithi148.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T22:29:05.804 INFO:teuthology.orchestra.run.smithi148.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T22:29:05.804 INFO:teuthology.orchestra.run.smithi148.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T22:29:05.804 INFO:teuthology.orchestra.run.smithi148.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T22:29:05.808 INFO:teuthology.orchestra.run.smithi163.stderr:bash: line 1: ntpq: command not found 2024-09-12T22:29:05.811 INFO:teuthology.orchestra.run.smithi163.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T22:29:05.812 INFO:teuthology.orchestra.run.smithi163.stdout:=============================================================================== 2024-09-12T22:29:05.812 INFO:teuthology.orchestra.run.smithi163.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T22:29:05.812 INFO:teuthology.orchestra.run.smithi163.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T22:29:05.812 INFO:teuthology.orchestra.run.smithi163.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T22:29:05.812 INFO:teuthology.orchestra.run.smithi163.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T22:29:05.813 INFO:teuthology.run_tasks:Running task install... 2024-09-12T22:29:05.821 DEBUG:teuthology.task.install:project ceph 2024-09-12T22:29:05.821 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '086c737fa75c22d521a3932c59b31c5e1d1c9ef4'}} 2024-09-12T22:29:05.821 DEBUG:teuthology.task.install:config {'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '086c737fa75c22d521a3932c59b31c5e1d1c9ef4'} 2024-09-12T22:29:05.821 INFO:teuthology.task.install:Using flavor: default 2024-09-12T22:29:05.827 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-12T22:29:05.827 INFO:teuthology.task.install:extra packages: [] 2024-09-12T22:29:05.827 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '086c737fa75c22d521a3932c59b31c5e1d1c9ef4', 'tag': None, 'wait_for_package': False} 2024-09-12T22:29:05.828 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=086c737fa75c22d521a3932c59b31c5e1d1c9ef4 2024-09-12T22:29:05.830 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '086c737fa75c22d521a3932c59b31c5e1d1c9ef4', 'tag': None, 'wait_for_package': False} 2024-09-12T22:29:05.830 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=086c737fa75c22d521a3932c59b31c5e1d1c9ef4 2024-09-12T22:29:05.831 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '086c737fa75c22d521a3932c59b31c5e1d1c9ef4', 'tag': None, 'wait_for_package': False} 2024-09-12T22:29:05.831 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=086c737fa75c22d521a3932c59b31c5e1d1c9ef4 2024-09-12T22:29:05.832 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '086c737fa75c22d521a3932c59b31c5e1d1c9ef4', 'tag': None, 'wait_for_package': False} 2024-09-12T22:29:05.832 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=086c737fa75c22d521a3932c59b31c5e1d1c9ef4 2024-09-12T22:29:05.987 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/squid/086c737fa75c22d521a3932c59b31c5e1d1c9ef4/centos/9/flavors/default/ 2024-09-12T22:29:05.987 INFO:teuthology.task.install.rpm:Package version is 19.1.1-314.g086c737f 2024-09-12T22:29:05.990 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/squid/086c737fa75c22d521a3932c59b31c5e1d1c9ef4/centos/9/flavors/default/ 2024-09-12T22:29:05.990 INFO:teuthology.task.install.rpm:Package version is 19.1.1-314.g086c737f 2024-09-12T22:29:05.995 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/squid/086c737fa75c22d521a3932c59b31c5e1d1c9ef4/centos/9/flavors/default/ 2024-09-12T22:29:05.995 INFO:teuthology.task.install.rpm:Package version is 19.1.1-314.g086c737f 2024-09-12T22:29:05.999 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/squid/086c737fa75c22d521a3932c59b31c5e1d1c9ef4/centos/9/flavors/default/ 2024-09-12T22:29:05.999 INFO:teuthology.task.install.rpm:Package version is 19.1.1-314.g086c737f 2024-09-12T22:29:06.105 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/squid/086c737fa75c22d521a3932c59b31c5e1d1c9ef4/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/086c737fa75c22d521a3932c59b31c5e1d1c9ef4/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/086c737fa75c22d521a3932c59b31c5e1d1c9ef4/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-12T22:29:06.105 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-09-12T22:29:06.105 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-12T22:29:06.107 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/squid/086c737fa75c22d521a3932c59b31c5e1d1c9ef4/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/086c737fa75c22d521a3932c59b31c5e1d1c9ef4/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/086c737fa75c22d521a3932c59b31c5e1d1c9ef4/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-12T22:29:06.107 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-12T22:29:06.107 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-12T22:29:06.114 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/squid/086c737fa75c22d521a3932c59b31c5e1d1c9ef4/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/086c737fa75c22d521a3932c59b31c5e1d1c9ef4/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/086c737fa75c22d521a3932c59b31c5e1d1c9ef4/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-12T22:29:06.114 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T22:29:06.114 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-12T22:29:06.119 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/squid/086c737fa75c22d521a3932c59b31c5e1d1c9ef4/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/086c737fa75c22d521a3932c59b31c5e1d1c9ef4/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/086c737fa75c22d521a3932c59b31c5e1d1c9ef4/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-12T22:29:06.120 DEBUG:teuthology.orchestra.run.smithi076:> set -ex 2024-09-12T22:29:06.120 DEBUG:teuthology.orchestra.run.smithi076:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-12T22:29:06.133 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2024-09-12T22:29:06.133 DEBUG:teuthology.orchestra.run.smithi163:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/086c737fa75c22d521a3932c59b31c5e1d1c9ef4/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-12T22:29:06.135 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2024-09-12T22:29:06.135 DEBUG:teuthology.orchestra.run.smithi148:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/086c737fa75c22d521a3932c59b31c5e1d1c9ef4/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-12T22:29:06.141 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2024-09-12T22:29:06.141 DEBUG:teuthology.orchestra.run.smithi019:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/086c737fa75c22d521a3932c59b31c5e1d1c9ef4/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-12T22:29:06.145 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2024-09-12T22:29:06.145 DEBUG:teuthology.orchestra.run.smithi076:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/086c737fa75c22d521a3932c59b31c5e1d1c9ef4/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-12T22:29:06.199 DEBUG:teuthology.orchestra.run.smithi163:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-12T22:29:06.201 DEBUG:teuthology.orchestra.run.smithi148:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-12T22:29:06.208 DEBUG:teuthology.orchestra.run.smithi019:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-12T22:29:06.210 DEBUG:teuthology.orchestra.run.smithi076:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-12T22:29:06.274 DEBUG:teuthology.orchestra.run.smithi163:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-12T22:29:06.277 DEBUG:teuthology.orchestra.run.smithi148:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-12T22:29:06.285 DEBUG:teuthology.orchestra.run.smithi019:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-12T22:29:06.286 DEBUG:teuthology.orchestra.run.smithi076:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-12T22:29:06.338 INFO:teuthology.orchestra.run.smithi163.stdout:check_obsoletes = 1 2024-09-12T22:29:06.340 DEBUG:teuthology.orchestra.run.smithi163:> sudo yum clean all 2024-09-12T22:29:06.341 INFO:teuthology.orchestra.run.smithi148.stdout:check_obsoletes = 1 2024-09-12T22:29:06.342 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum clean all 2024-09-12T22:29:06.351 INFO:teuthology.orchestra.run.smithi076.stdout:check_obsoletes = 1 2024-09-12T22:29:06.351 INFO:teuthology.orchestra.run.smithi019.stdout:check_obsoletes = 1 2024-09-12T22:29:06.352 DEBUG:teuthology.orchestra.run.smithi076:> sudo yum clean all 2024-09-12T22:29:06.353 DEBUG:teuthology.orchestra.run.smithi019:> sudo yum clean all 2024-09-12T22:29:06.566 INFO:teuthology.orchestra.run.smithi163.stdout:45 files removed 2024-09-12T22:29:06.572 INFO:teuthology.orchestra.run.smithi148.stdout:45 files removed 2024-09-12T22:29:06.581 INFO:teuthology.orchestra.run.smithi076.stdout:45 files removed 2024-09-12T22:29:06.594 DEBUG:teuthology.orchestra.run.smithi163:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2024-09-12T22:29:06.600 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2024-09-12T22:29:06.604 INFO:teuthology.orchestra.run.smithi019.stdout:45 files removed 2024-09-12T22:29:06.608 DEBUG:teuthology.orchestra.run.smithi076:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2024-09-12T22:29:06.632 DEBUG:teuthology.orchestra.run.smithi019:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2024-09-12T22:29:07.143 INFO:teuthology.orchestra.run.smithi148.stdout:ceph packages for x86_64 327 kB/s | 83 kB 00:00 2024-09-12T22:29:07.160 INFO:teuthology.orchestra.run.smithi163.stdout:ceph packages for x86_64 298 kB/s | 83 kB 00:00 2024-09-12T22:29:07.161 INFO:teuthology.orchestra.run.smithi076.stdout:ceph packages for x86_64 313 kB/s | 83 kB 00:00 2024-09-12T22:29:07.212 INFO:teuthology.orchestra.run.smithi019.stdout:ceph packages for x86_64 298 kB/s | 83 kB 00:00 2024-09-12T22:29:07.427 INFO:teuthology.orchestra.run.smithi148.stdout:ceph noarch packages 49 kB/s | 12 kB 00:00 2024-09-12T22:29:07.436 INFO:teuthology.orchestra.run.smithi163.stdout:ceph noarch packages 51 kB/s | 12 kB 00:00 2024-09-12T22:29:07.444 INFO:teuthology.orchestra.run.smithi076.stdout:ceph noarch packages 49 kB/s | 12 kB 00:00 2024-09-12T22:29:07.497 INFO:teuthology.orchestra.run.smithi019.stdout:ceph noarch packages 49 kB/s | 12 kB 00:00 2024-09-12T22:29:07.695 INFO:teuthology.orchestra.run.smithi163.stdout:ceph source packages 8.4 kB/s | 1.9 kB 00:00 2024-09-12T22:29:07.711 INFO:teuthology.orchestra.run.smithi148.stdout:ceph source packages 7.5 kB/s | 1.9 kB 00:00 2024-09-12T22:29:07.720 INFO:teuthology.orchestra.run.smithi076.stdout:ceph source packages 7.8 kB/s | 1.9 kB 00:00 2024-09-12T22:29:07.772 INFO:teuthology.orchestra.run.smithi019.stdout:ceph source packages 7.9 kB/s | 1.9 kB 00:00 2024-09-12T22:29:08.170 INFO:teuthology.orchestra.run.smithi076.stdout:CentOS Stream 9 - BaseOS 20 MB/s | 8.2 MB 00:00 2024-09-12T22:29:08.236 INFO:teuthology.orchestra.run.smithi148.stdout:CentOS Stream 9 - BaseOS 17 MB/s | 8.2 MB 00:00 2024-09-12T22:29:08.297 INFO:teuthology.orchestra.run.smithi019.stdout:CentOS Stream 9 - BaseOS 17 MB/s | 8.2 MB 00:00 2024-09-12T22:29:08.545 INFO:teuthology.orchestra.run.smithi163.stdout:CentOS Stream 9 - BaseOS 10 MB/s | 8.2 MB 00:00 2024-09-12T22:29:09.947 INFO:teuthology.orchestra.run.smithi076.stdout:CentOS Stream 9 - AppStream 30 MB/s | 20 MB 00:00 2024-09-12T22:29:10.373 INFO:teuthology.orchestra.run.smithi019.stdout:CentOS Stream 9 - AppStream 23 MB/s | 20 MB 00:00 2024-09-12T22:29:11.562 INFO:teuthology.orchestra.run.smithi148.stdout:CentOS Stream 9 - AppStream 9.1 MB/s | 20 MB 00:02 2024-09-12T22:29:11.846 INFO:teuthology.orchestra.run.smithi163.stdout:CentOS Stream 9 - AppStream 9.3 MB/s | 20 MB 00:02 2024-09-12T22:29:15.881 INFO:teuthology.orchestra.run.smithi076.stdout:CentOS Stream 9 - CRB 3.0 MB/s | 6.5 MB 00:02 2024-09-12T22:29:16.099 INFO:teuthology.orchestra.run.smithi019.stdout:CentOS Stream 9 - CRB 3.7 MB/s | 6.5 MB 00:01 2024-09-12T22:29:16.880 INFO:teuthology.orchestra.run.smithi163.stdout:CentOS Stream 9 - CRB 5.5 MB/s | 6.5 MB 00:01 2024-09-12T22:29:17.146 INFO:teuthology.orchestra.run.smithi148.stdout:CentOS Stream 9 - CRB 3.7 MB/s | 6.5 MB 00:01 2024-09-12T22:29:17.415 INFO:teuthology.orchestra.run.smithi076.stdout:CentOS Stream 9 - Extras packages 99 kB/s | 19 kB 00:00 2024-09-12T22:29:17.892 INFO:teuthology.orchestra.run.smithi019.stdout:CentOS Stream 9 - Extras packages 37 kB/s | 19 kB 00:00 2024-09-12T22:29:18.695 INFO:teuthology.orchestra.run.smithi076.stdout:Extra Packages for Enterprise Linux 20 MB/s | 23 MB 00:01 2024-09-12T22:29:18.731 INFO:teuthology.orchestra.run.smithi163.stdout:CentOS Stream 9 - Extras packages 29 kB/s | 19 kB 00:00 2024-09-12T22:29:18.797 INFO:teuthology.orchestra.run.smithi148.stdout:CentOS Stream 9 - Extras packages 60 kB/s | 19 kB 00:00 2024-09-12T22:29:18.996 INFO:teuthology.orchestra.run.smithi019.stdout:Extra Packages for Enterprise Linux 23 MB/s | 23 MB 00:00 2024-09-12T22:29:19.659 INFO:teuthology.orchestra.run.smithi148.stdout:Extra Packages for Enterprise Linux 31 MB/s | 23 MB 00:00 2024-09-12T22:29:19.677 INFO:teuthology.orchestra.run.smithi163.stdout:Extra Packages for Enterprise Linux 28 MB/s | 23 MB 00:00 2024-09-12T22:29:24.168 INFO:teuthology.orchestra.run.smithi076.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-12T22:29:24.660 INFO:teuthology.orchestra.run.smithi019.stdout:lab-extras 43 kB/s | 1.7 kB 00:00 2024-09-12T22:29:25.100 INFO:teuthology.orchestra.run.smithi163.stdout:lab-extras 41 kB/s | 1.7 kB 00:00 2024-09-12T22:29:25.148 INFO:teuthology.orchestra.run.smithi148.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-09-12T22:29:26.487 INFO:teuthology.orchestra.run.smithi076.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T22:29:26.488 INFO:teuthology.orchestra.run.smithi076.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T22:29:26.559 INFO:teuthology.orchestra.run.smithi076.stdout:Dependencies resolved. 2024-09-12T22:29:26.571 INFO:teuthology.orchestra.run.smithi076.stdout:====================================================================================== 2024-09-12T22:29:26.571 INFO:teuthology.orchestra.run.smithi076.stdout: Package Arch Version Repository Size 2024-09-12T22:29:26.571 INFO:teuthology.orchestra.run.smithi076.stdout:====================================================================================== 2024-09-12T22:29:26.571 INFO:teuthology.orchestra.run.smithi076.stdout:Installing: 2024-09-12T22:29:26.571 INFO:teuthology.orchestra.run.smithi076.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-12T22:29:26.571 INFO:teuthology.orchestra.run.smithi076.stdout: ceph x86_64 2:19.1.1-314.g086c737f.el9 ceph 6.5 k 2024-09-12T22:29:26.571 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-base x86_64 2:19.1.1-314.g086c737f.el9 ceph 5.4 M 2024-09-12T22:29:26.571 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-fuse x86_64 2:19.1.1-314.g086c737f.el9 ceph 896 k 2024-09-12T22:29:26.571 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-314.g086c737f.el9 ceph 145 k 2024-09-12T22:29:26.571 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-mgr x86_64 2:19.1.1-314.g086c737f.el9 ceph 1.5 M 2024-09-12T22:29:26.571 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-mgr-cephadm noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 146 k 2024-09-12T22:29:26.572 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-mgr-dashboard noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 3.6 M 2024-09-12T22:29:26.572 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 7.4 M 2024-09-12T22:29:26.572 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-mgr-rook noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 49 k 2024-09-12T22:29:26.572 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-radosgw x86_64 2:19.1.1-314.g086c737f.el9 ceph 11 M 2024-09-12T22:29:26.572 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-test x86_64 2:19.1.1-314.g086c737f.el9 ceph 49 M 2024-09-12T22:29:26.572 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-volume noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 285 k 2024-09-12T22:29:26.572 INFO:teuthology.orchestra.run.smithi076.stdout: cephadm noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 765 k 2024-09-12T22:29:26.572 INFO:teuthology.orchestra.run.smithi076.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-12T22:29:26.572 INFO:teuthology.orchestra.run.smithi076.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-12T22:29:26.572 INFO:teuthology.orchestra.run.smithi076.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-12T22:29:26.572 INFO:teuthology.orchestra.run.smithi076.stdout: libcephfs-devel x86_64 2:19.1.1-314.g086c737f.el9 ceph 32 k 2024-09-12T22:29:26.572 INFO:teuthology.orchestra.run.smithi076.stdout: libcephfs2 x86_64 2:19.1.1-314.g086c737f.el9 ceph 753 k 2024-09-12T22:29:26.573 INFO:teuthology.orchestra.run.smithi076.stdout: librados-devel x86_64 2:19.1.1-314.g086c737f.el9 ceph 127 k 2024-09-12T22:29:26.573 INFO:teuthology.orchestra.run.smithi076.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-12T22:29:26.573 INFO:teuthology.orchestra.run.smithi076.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-12T22:29:26.573 INFO:teuthology.orchestra.run.smithi076.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-12T22:29:26.573 INFO:teuthology.orchestra.run.smithi076.stdout: python3-cephfs x86_64 2:19.1.1-314.g086c737f.el9 ceph 162 k 2024-09-12T22:29:26.573 INFO:teuthology.orchestra.run.smithi076.stdout: python3-rados x86_64 2:19.1.1-314.g086c737f.el9 ceph 320 k 2024-09-12T22:29:26.573 INFO:teuthology.orchestra.run.smithi076.stdout: python3-rbd x86_64 2:19.1.1-314.g086c737f.el9 ceph 301 k 2024-09-12T22:29:26.573 INFO:teuthology.orchestra.run.smithi076.stdout: python3-rgw x86_64 2:19.1.1-314.g086c737f.el9 ceph 99 k 2024-09-12T22:29:26.573 INFO:teuthology.orchestra.run.smithi076.stdout: rbd-fuse x86_64 2:19.1.1-314.g086c737f.el9 ceph 85 k 2024-09-12T22:29:26.573 INFO:teuthology.orchestra.run.smithi076.stdout: rbd-mirror x86_64 2:19.1.1-314.g086c737f.el9 ceph 3.1 M 2024-09-12T22:29:26.573 INFO:teuthology.orchestra.run.smithi076.stdout: rbd-nbd x86_64 2:19.1.1-314.g086c737f.el9 ceph 171 k 2024-09-12T22:29:26.574 INFO:teuthology.orchestra.run.smithi076.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-12T22:29:26.574 INFO:teuthology.orchestra.run.smithi076.stdout:Upgrading: 2024-09-12T22:29:26.574 INFO:teuthology.orchestra.run.smithi076.stdout: librados2 x86_64 2:19.1.1-314.g086c737f.el9 ceph 3.4 M 2024-09-12T22:29:26.574 INFO:teuthology.orchestra.run.smithi076.stdout: librbd1 x86_64 2:19.1.1-314.g086c737f.el9 ceph 3.2 M 2024-09-12T22:29:26.574 INFO:teuthology.orchestra.run.smithi076.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-12T22:29:26.574 INFO:teuthology.orchestra.run.smithi076.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-12T22:29:26.574 INFO:teuthology.orchestra.run.smithi076.stdout:Installing dependencies: 2024-09-12T22:29:26.574 INFO:teuthology.orchestra.run.smithi076.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-12T22:29:26.574 INFO:teuthology.orchestra.run.smithi076.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-12T22:29:26.574 INFO:teuthology.orchestra.run.smithi076.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-12T22:29:26.574 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-common x86_64 2:19.1.1-314.g086c737f.el9 ceph 21 M 2024-09-12T22:29:26.574 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-grafana-dashboards noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 32 k 2024-09-12T22:29:26.575 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-mds x86_64 2:19.1.1-314.g086c737f.el9 ceph 2.4 M 2024-09-12T22:29:26.575 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-mgr-modules-core noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 249 k 2024-09-12T22:29:26.575 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-mon x86_64 2:19.1.1-314.g086c737f.el9 ceph 4.7 M 2024-09-12T22:29:26.575 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-osd x86_64 2:19.1.1-314.g086c737f.el9 ceph 17 M 2024-09-12T22:29:26.575 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-prometheus-alerts noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 16 k 2024-09-12T22:29:26.575 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-selinux x86_64 2:19.1.1-314.g086c737f.el9 ceph 25 k 2024-09-12T22:29:26.575 INFO:teuthology.orchestra.run.smithi076.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-12T22:29:26.575 INFO:teuthology.orchestra.run.smithi076.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-12T22:29:26.575 INFO:teuthology.orchestra.run.smithi076.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-12T22:29:26.575 INFO:teuthology.orchestra.run.smithi076.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-12T22:29:26.575 INFO:teuthology.orchestra.run.smithi076.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-12T22:29:26.575 INFO:teuthology.orchestra.run.smithi076.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-12T22:29:26.576 INFO:teuthology.orchestra.run.smithi076.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-12T22:29:26.576 INFO:teuthology.orchestra.run.smithi076.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-12T22:29:26.576 INFO:teuthology.orchestra.run.smithi076.stdout: libcephsqlite x86_64 2:19.1.1-314.g086c737f.el9 ceph 164 k 2024-09-12T22:29:26.576 INFO:teuthology.orchestra.run.smithi076.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-12T22:29:26.576 INFO:teuthology.orchestra.run.smithi076.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-12T22:29:26.576 INFO:teuthology.orchestra.run.smithi076.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-12T22:29:26.576 INFO:teuthology.orchestra.run.smithi076.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-12T22:29:26.576 INFO:teuthology.orchestra.run.smithi076.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-12T22:29:26.576 INFO:teuthology.orchestra.run.smithi076.stdout: libradosstriper1 x86_64 2:19.1.1-314.g086c737f.el9 ceph 506 k 2024-09-12T22:29:26.576 INFO:teuthology.orchestra.run.smithi076.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-12T22:29:26.576 INFO:teuthology.orchestra.run.smithi076.stdout: librgw2 x86_64 2:19.1.1-314.g086c737f.el9 ceph 5.3 M 2024-09-12T22:29:26.576 INFO:teuthology.orchestra.run.smithi076.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-12T22:29:26.576 INFO:teuthology.orchestra.run.smithi076.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-12T22:29:26.577 INFO:teuthology.orchestra.run.smithi076.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-12T22:29:26.577 INFO:teuthology.orchestra.run.smithi076.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-12T22:29:26.577 INFO:teuthology.orchestra.run.smithi076.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-12T22:29:26.577 INFO:teuthology.orchestra.run.smithi076.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-12T22:29:26.577 INFO:teuthology.orchestra.run.smithi076.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-12T22:29:26.577 INFO:teuthology.orchestra.run.smithi076.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-12T22:29:26.577 INFO:teuthology.orchestra.run.smithi076.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-12T22:29:26.577 INFO:teuthology.orchestra.run.smithi076.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-12T22:29:26.577 INFO:teuthology.orchestra.run.smithi076.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-12T22:29:26.577 INFO:teuthology.orchestra.run.smithi076.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-12T22:29:26.577 INFO:teuthology.orchestra.run.smithi076.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-12T22:29:26.577 INFO:teuthology.orchestra.run.smithi076.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-12T22:29:26.578 INFO:teuthology.orchestra.run.smithi076.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-12T22:29:26.578 INFO:teuthology.orchestra.run.smithi076.stdout: python3-ceph-argparse x86_64 2:19.1.1-314.g086c737f.el9 ceph 45 k 2024-09-12T22:29:26.578 INFO:teuthology.orchestra.run.smithi076.stdout: python3-ceph-common x86_64 2:19.1.1-314.g086c737f.el9 ceph 136 k 2024-09-12T22:29:26.578 INFO:teuthology.orchestra.run.smithi076.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-12T22:29:26.578 INFO:teuthology.orchestra.run.smithi076.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-12T22:29:26.578 INFO:teuthology.orchestra.run.smithi076.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-12T22:29:26.578 INFO:teuthology.orchestra.run.smithi076.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-12T22:29:26.578 INFO:teuthology.orchestra.run.smithi076.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-12T22:29:26.578 INFO:teuthology.orchestra.run.smithi076.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-12T22:29:26.578 INFO:teuthology.orchestra.run.smithi076.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-12T22:29:26.578 INFO:teuthology.orchestra.run.smithi076.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-12T22:29:26.578 INFO:teuthology.orchestra.run.smithi076.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-12T22:29:26.578 INFO:teuthology.orchestra.run.smithi076.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-12T22:29:26.579 INFO:teuthology.orchestra.run.smithi076.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-12T22:29:26.579 INFO:teuthology.orchestra.run.smithi076.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-12T22:29:26.579 INFO:teuthology.orchestra.run.smithi076.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-12T22:29:26.579 INFO:teuthology.orchestra.run.smithi076.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-12T22:29:26.579 INFO:teuthology.orchestra.run.smithi076.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-12T22:29:26.579 INFO:teuthology.orchestra.run.smithi076.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-12T22:29:26.579 INFO:teuthology.orchestra.run.smithi076.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-12T22:29:26.579 INFO:teuthology.orchestra.run.smithi076.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-12T22:29:26.579 INFO:teuthology.orchestra.run.smithi076.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-12T22:29:26.579 INFO:teuthology.orchestra.run.smithi076.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-12T22:29:26.579 INFO:teuthology.orchestra.run.smithi076.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-12T22:29:26.579 INFO:teuthology.orchestra.run.smithi076.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-12T22:29:26.580 INFO:teuthology.orchestra.run.smithi076.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-12T22:29:26.580 INFO:teuthology.orchestra.run.smithi076.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-12T22:29:26.580 INFO:teuthology.orchestra.run.smithi076.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-12T22:29:26.580 INFO:teuthology.orchestra.run.smithi076.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-12T22:29:26.580 INFO:teuthology.orchestra.run.smithi076.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-12T22:29:26.580 INFO:teuthology.orchestra.run.smithi076.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-12T22:29:26.580 INFO:teuthology.orchestra.run.smithi076.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-12T22:29:26.580 INFO:teuthology.orchestra.run.smithi076.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-12T22:29:26.580 INFO:teuthology.orchestra.run.smithi076.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-12T22:29:26.580 INFO:teuthology.orchestra.run.smithi076.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-12T22:29:26.580 INFO:teuthology.orchestra.run.smithi076.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-12T22:29:26.580 INFO:teuthology.orchestra.run.smithi076.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-12T22:29:26.580 INFO:teuthology.orchestra.run.smithi076.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-12T22:29:26.581 INFO:teuthology.orchestra.run.smithi076.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-12T22:29:26.581 INFO:teuthology.orchestra.run.smithi076.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-12T22:29:26.581 INFO:teuthology.orchestra.run.smithi076.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-12T22:29:26.581 INFO:teuthology.orchestra.run.smithi076.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-12T22:29:26.581 INFO:teuthology.orchestra.run.smithi076.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-12T22:29:26.581 INFO:teuthology.orchestra.run.smithi076.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-12T22:29:26.581 INFO:teuthology.orchestra.run.smithi076.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-12T22:29:26.581 INFO:teuthology.orchestra.run.smithi076.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-12T22:29:26.581 INFO:teuthology.orchestra.run.smithi076.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-12T22:29:26.581 INFO:teuthology.orchestra.run.smithi076.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-12T22:29:26.581 INFO:teuthology.orchestra.run.smithi076.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-12T22:29:26.581 INFO:teuthology.orchestra.run.smithi076.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-12T22:29:26.581 INFO:teuthology.orchestra.run.smithi076.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-12T22:29:26.582 INFO:teuthology.orchestra.run.smithi076.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-12T22:29:26.582 INFO:teuthology.orchestra.run.smithi076.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-12T22:29:26.582 INFO:teuthology.orchestra.run.smithi076.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-12T22:29:26.582 INFO:teuthology.orchestra.run.smithi076.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-12T22:29:26.582 INFO:teuthology.orchestra.run.smithi076.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-12T22:29:26.582 INFO:teuthology.orchestra.run.smithi076.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-12T22:29:26.582 INFO:teuthology.orchestra.run.smithi076.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-12T22:29:26.582 INFO:teuthology.orchestra.run.smithi076.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-12T22:29:26.582 INFO:teuthology.orchestra.run.smithi076.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-12T22:29:26.582 INFO:teuthology.orchestra.run.smithi076.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-12T22:29:26.582 INFO:teuthology.orchestra.run.smithi076.stdout:Installing weak dependencies: 2024-09-12T22:29:26.582 INFO:teuthology.orchestra.run.smithi076.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-12T22:29:26.582 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-12T22:29:26.582 INFO:teuthology.orchestra.run.smithi076.stdout:Transaction Summary 2024-09-12T22:29:26.583 INFO:teuthology.orchestra.run.smithi076.stdout:====================================================================================== 2024-09-12T22:29:26.583 INFO:teuthology.orchestra.run.smithi076.stdout:Install 135 Packages 2024-09-12T22:29:26.583 INFO:teuthology.orchestra.run.smithi076.stdout:Upgrade 4 Packages 2024-09-12T22:29:26.583 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-12T22:29:26.583 INFO:teuthology.orchestra.run.smithi076.stdout:Total download size: 213 M 2024-09-12T22:29:26.583 INFO:teuthology.orchestra.run.smithi076.stdout:Downloading Packages: 2024-09-12T22:29:27.064 INFO:teuthology.orchestra.run.smithi019.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T22:29:27.064 INFO:teuthology.orchestra.run.smithi019.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T22:29:27.139 INFO:teuthology.orchestra.run.smithi019.stdout:Dependencies resolved. 2024-09-12T22:29:27.164 INFO:teuthology.orchestra.run.smithi019.stdout:====================================================================================== 2024-09-12T22:29:27.164 INFO:teuthology.orchestra.run.smithi019.stdout: Package Arch Version Repository Size 2024-09-12T22:29:27.164 INFO:teuthology.orchestra.run.smithi019.stdout:====================================================================================== 2024-09-12T22:29:27.164 INFO:teuthology.orchestra.run.smithi019.stdout:Installing: 2024-09-12T22:29:27.164 INFO:teuthology.orchestra.run.smithi019.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-12T22:29:27.164 INFO:teuthology.orchestra.run.smithi019.stdout: ceph x86_64 2:19.1.1-314.g086c737f.el9 ceph 6.5 k 2024-09-12T22:29:27.164 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-base x86_64 2:19.1.1-314.g086c737f.el9 ceph 5.4 M 2024-09-12T22:29:27.164 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-fuse x86_64 2:19.1.1-314.g086c737f.el9 ceph 896 k 2024-09-12T22:29:27.164 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-314.g086c737f.el9 ceph 145 k 2024-09-12T22:29:27.164 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr x86_64 2:19.1.1-314.g086c737f.el9 ceph 1.5 M 2024-09-12T22:29:27.164 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-cephadm noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 146 k 2024-09-12T22:29:27.164 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-dashboard noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 3.6 M 2024-09-12T22:29:27.165 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 7.4 M 2024-09-12T22:29:27.165 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-rook noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 49 k 2024-09-12T22:29:27.165 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-radosgw x86_64 2:19.1.1-314.g086c737f.el9 ceph 11 M 2024-09-12T22:29:27.165 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-test x86_64 2:19.1.1-314.g086c737f.el9 ceph 49 M 2024-09-12T22:29:27.165 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-volume noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 285 k 2024-09-12T22:29:27.165 INFO:teuthology.orchestra.run.smithi019.stdout: cephadm noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 765 k 2024-09-12T22:29:27.165 INFO:teuthology.orchestra.run.smithi019.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-12T22:29:27.165 INFO:teuthology.orchestra.run.smithi019.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-12T22:29:27.165 INFO:teuthology.orchestra.run.smithi019.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-12T22:29:27.165 INFO:teuthology.orchestra.run.smithi019.stdout: libcephfs-devel x86_64 2:19.1.1-314.g086c737f.el9 ceph 32 k 2024-09-12T22:29:27.165 INFO:teuthology.orchestra.run.smithi019.stdout: libcephfs2 x86_64 2:19.1.1-314.g086c737f.el9 ceph 753 k 2024-09-12T22:29:27.165 INFO:teuthology.orchestra.run.smithi019.stdout: librados-devel x86_64 2:19.1.1-314.g086c737f.el9 ceph 127 k 2024-09-12T22:29:27.165 INFO:teuthology.orchestra.run.smithi019.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-12T22:29:27.166 INFO:teuthology.orchestra.run.smithi019.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-12T22:29:27.166 INFO:teuthology.orchestra.run.smithi019.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-12T22:29:27.166 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cephfs x86_64 2:19.1.1-314.g086c737f.el9 ceph 162 k 2024-09-12T22:29:27.166 INFO:teuthology.orchestra.run.smithi019.stdout: python3-rados x86_64 2:19.1.1-314.g086c737f.el9 ceph 320 k 2024-09-12T22:29:27.166 INFO:teuthology.orchestra.run.smithi019.stdout: python3-rbd x86_64 2:19.1.1-314.g086c737f.el9 ceph 301 k 2024-09-12T22:29:27.166 INFO:teuthology.orchestra.run.smithi019.stdout: python3-rgw x86_64 2:19.1.1-314.g086c737f.el9 ceph 99 k 2024-09-12T22:29:27.166 INFO:teuthology.orchestra.run.smithi019.stdout: rbd-fuse x86_64 2:19.1.1-314.g086c737f.el9 ceph 85 k 2024-09-12T22:29:27.166 INFO:teuthology.orchestra.run.smithi019.stdout: rbd-mirror x86_64 2:19.1.1-314.g086c737f.el9 ceph 3.1 M 2024-09-12T22:29:27.166 INFO:teuthology.orchestra.run.smithi019.stdout: rbd-nbd x86_64 2:19.1.1-314.g086c737f.el9 ceph 171 k 2024-09-12T22:29:27.166 INFO:teuthology.orchestra.run.smithi019.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-12T22:29:27.166 INFO:teuthology.orchestra.run.smithi019.stdout:Upgrading: 2024-09-12T22:29:27.166 INFO:teuthology.orchestra.run.smithi019.stdout: librados2 x86_64 2:19.1.1-314.g086c737f.el9 ceph 3.4 M 2024-09-12T22:29:27.166 INFO:teuthology.orchestra.run.smithi019.stdout: librbd1 x86_64 2:19.1.1-314.g086c737f.el9 ceph 3.2 M 2024-09-12T22:29:27.167 INFO:teuthology.orchestra.run.smithi019.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-12T22:29:27.167 INFO:teuthology.orchestra.run.smithi019.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-12T22:29:27.167 INFO:teuthology.orchestra.run.smithi019.stdout:Installing dependencies: 2024-09-12T22:29:27.167 INFO:teuthology.orchestra.run.smithi019.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-12T22:29:27.167 INFO:teuthology.orchestra.run.smithi019.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-12T22:29:27.167 INFO:teuthology.orchestra.run.smithi019.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-12T22:29:27.167 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-common x86_64 2:19.1.1-314.g086c737f.el9 ceph 21 M 2024-09-12T22:29:27.167 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-grafana-dashboards noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 32 k 2024-09-12T22:29:27.167 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mds x86_64 2:19.1.1-314.g086c737f.el9 ceph 2.4 M 2024-09-12T22:29:27.167 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-modules-core noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 249 k 2024-09-12T22:29:27.167 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mon x86_64 2:19.1.1-314.g086c737f.el9 ceph 4.7 M 2024-09-12T22:29:27.167 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-osd x86_64 2:19.1.1-314.g086c737f.el9 ceph 17 M 2024-09-12T22:29:27.167 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-prometheus-alerts noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 16 k 2024-09-12T22:29:27.168 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-selinux x86_64 2:19.1.1-314.g086c737f.el9 ceph 25 k 2024-09-12T22:29:27.168 INFO:teuthology.orchestra.run.smithi019.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-12T22:29:27.168 INFO:teuthology.orchestra.run.smithi019.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-12T22:29:27.168 INFO:teuthology.orchestra.run.smithi019.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-12T22:29:27.168 INFO:teuthology.orchestra.run.smithi019.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-12T22:29:27.168 INFO:teuthology.orchestra.run.smithi019.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-12T22:29:27.168 INFO:teuthology.orchestra.run.smithi019.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-12T22:29:27.168 INFO:teuthology.orchestra.run.smithi019.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-12T22:29:27.168 INFO:teuthology.orchestra.run.smithi019.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-12T22:29:27.168 INFO:teuthology.orchestra.run.smithi019.stdout: libcephsqlite x86_64 2:19.1.1-314.g086c737f.el9 ceph 164 k 2024-09-12T22:29:27.168 INFO:teuthology.orchestra.run.smithi019.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-12T22:29:27.168 INFO:teuthology.orchestra.run.smithi019.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-12T22:29:27.168 INFO:teuthology.orchestra.run.smithi019.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-12T22:29:27.169 INFO:teuthology.orchestra.run.smithi019.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-12T22:29:27.169 INFO:teuthology.orchestra.run.smithi019.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-12T22:29:27.169 INFO:teuthology.orchestra.run.smithi019.stdout: libradosstriper1 x86_64 2:19.1.1-314.g086c737f.el9 ceph 506 k 2024-09-12T22:29:27.169 INFO:teuthology.orchestra.run.smithi019.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-12T22:29:27.169 INFO:teuthology.orchestra.run.smithi019.stdout: librgw2 x86_64 2:19.1.1-314.g086c737f.el9 ceph 5.3 M 2024-09-12T22:29:27.169 INFO:teuthology.orchestra.run.smithi019.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-12T22:29:27.169 INFO:teuthology.orchestra.run.smithi019.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-12T22:29:27.169 INFO:teuthology.orchestra.run.smithi019.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-12T22:29:27.169 INFO:teuthology.orchestra.run.smithi019.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-12T22:29:27.169 INFO:teuthology.orchestra.run.smithi019.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-12T22:29:27.169 INFO:teuthology.orchestra.run.smithi019.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-12T22:29:27.169 INFO:teuthology.orchestra.run.smithi019.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-12T22:29:27.169 INFO:teuthology.orchestra.run.smithi019.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-12T22:29:27.170 INFO:teuthology.orchestra.run.smithi019.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-12T22:29:27.170 INFO:teuthology.orchestra.run.smithi019.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-12T22:29:27.170 INFO:teuthology.orchestra.run.smithi019.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-12T22:29:27.170 INFO:teuthology.orchestra.run.smithi019.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-12T22:29:27.170 INFO:teuthology.orchestra.run.smithi019.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-12T22:29:27.170 INFO:teuthology.orchestra.run.smithi019.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-12T22:29:27.170 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-12T22:29:27.170 INFO:teuthology.orchestra.run.smithi019.stdout: python3-ceph-argparse x86_64 2:19.1.1-314.g086c737f.el9 ceph 45 k 2024-09-12T22:29:27.170 INFO:teuthology.orchestra.run.smithi019.stdout: python3-ceph-common x86_64 2:19.1.1-314.g086c737f.el9 ceph 136 k 2024-09-12T22:29:27.170 INFO:teuthology.orchestra.run.smithi019.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-12T22:29:27.170 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-12T22:29:27.170 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-12T22:29:27.170 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-12T22:29:27.170 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-12T22:29:27.171 INFO:teuthology.orchestra.run.smithi019.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-12T22:29:27.171 INFO:teuthology.orchestra.run.smithi019.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-12T22:29:27.171 INFO:teuthology.orchestra.run.smithi019.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-12T22:29:27.171 INFO:teuthology.orchestra.run.smithi019.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-12T22:29:27.171 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-12T22:29:27.171 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-12T22:29:27.171 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-12T22:29:27.171 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-12T22:29:27.171 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-12T22:29:27.171 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-12T22:29:27.171 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-12T22:29:27.171 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-12T22:29:27.171 INFO:teuthology.orchestra.run.smithi019.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-12T22:29:27.172 INFO:teuthology.orchestra.run.smithi019.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-12T22:29:27.172 INFO:teuthology.orchestra.run.smithi019.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-12T22:29:27.172 INFO:teuthology.orchestra.run.smithi019.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-12T22:29:27.172 INFO:teuthology.orchestra.run.smithi019.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-12T22:29:27.172 INFO:teuthology.orchestra.run.smithi019.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-12T22:29:27.172 INFO:teuthology.orchestra.run.smithi019.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-12T22:29:27.172 INFO:teuthology.orchestra.run.smithi019.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-12T22:29:27.172 INFO:teuthology.orchestra.run.smithi019.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-12T22:29:27.172 INFO:teuthology.orchestra.run.smithi019.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-12T22:29:27.172 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-12T22:29:27.172 INFO:teuthology.orchestra.run.smithi019.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-12T22:29:27.172 INFO:teuthology.orchestra.run.smithi019.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-12T22:29:27.172 INFO:teuthology.orchestra.run.smithi019.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-12T22:29:27.173 INFO:teuthology.orchestra.run.smithi019.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-12T22:29:27.173 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-12T22:29:27.173 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-12T22:29:27.173 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-12T22:29:27.173 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-12T22:29:27.173 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-12T22:29:27.173 INFO:teuthology.orchestra.run.smithi019.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-12T22:29:27.173 INFO:teuthology.orchestra.run.smithi019.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-12T22:29:27.173 INFO:teuthology.orchestra.run.smithi019.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-12T22:29:27.173 INFO:teuthology.orchestra.run.smithi019.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-12T22:29:27.173 INFO:teuthology.orchestra.run.smithi019.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-12T22:29:27.173 INFO:teuthology.orchestra.run.smithi019.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-12T22:29:27.173 INFO:teuthology.orchestra.run.smithi019.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-12T22:29:27.174 INFO:teuthology.orchestra.run.smithi019.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-12T22:29:27.174 INFO:teuthology.orchestra.run.smithi019.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-12T22:29:27.174 INFO:teuthology.orchestra.run.smithi019.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-12T22:29:27.174 INFO:teuthology.orchestra.run.smithi019.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-12T22:29:27.174 INFO:teuthology.orchestra.run.smithi019.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-12T22:29:27.174 INFO:teuthology.orchestra.run.smithi019.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-12T22:29:27.174 INFO:teuthology.orchestra.run.smithi019.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-12T22:29:27.174 INFO:teuthology.orchestra.run.smithi019.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-12T22:29:27.174 INFO:teuthology.orchestra.run.smithi019.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-12T22:29:27.174 INFO:teuthology.orchestra.run.smithi019.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-12T22:29:27.174 INFO:teuthology.orchestra.run.smithi019.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-12T22:29:27.174 INFO:teuthology.orchestra.run.smithi019.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-12T22:29:27.174 INFO:teuthology.orchestra.run.smithi019.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-12T22:29:27.174 INFO:teuthology.orchestra.run.smithi019.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-12T22:29:27.175 INFO:teuthology.orchestra.run.smithi019.stdout:Installing weak dependencies: 2024-09-12T22:29:27.175 INFO:teuthology.orchestra.run.smithi019.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-12T22:29:27.175 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:29:27.175 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction Summary 2024-09-12T22:29:27.175 INFO:teuthology.orchestra.run.smithi019.stdout:====================================================================================== 2024-09-12T22:29:27.175 INFO:teuthology.orchestra.run.smithi019.stdout:Install 135 Packages 2024-09-12T22:29:27.175 INFO:teuthology.orchestra.run.smithi019.stdout:Upgrade 4 Packages 2024-09-12T22:29:27.175 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:29:27.176 INFO:teuthology.orchestra.run.smithi019.stdout:Total download size: 213 M 2024-09-12T22:29:27.176 INFO:teuthology.orchestra.run.smithi019.stdout:Downloading Packages: 2024-09-12T22:29:27.361 INFO:teuthology.orchestra.run.smithi076.stdout:(1/139): ceph-19.1.1-314.g086c737f.el9.x86_64.r 22 kB/s | 6.5 kB 00:00 2024-09-12T22:29:27.434 INFO:teuthology.orchestra.run.smithi148.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T22:29:27.434 INFO:teuthology.orchestra.run.smithi148.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T22:29:27.502 INFO:teuthology.orchestra.run.smithi148.stdout:Dependencies resolved. 2024-09-12T22:29:27.521 INFO:teuthology.orchestra.run.smithi148.stdout:====================================================================================== 2024-09-12T22:29:27.521 INFO:teuthology.orchestra.run.smithi148.stdout: Package Arch Version Repository Size 2024-09-12T22:29:27.521 INFO:teuthology.orchestra.run.smithi148.stdout:====================================================================================== 2024-09-12T22:29:27.521 INFO:teuthology.orchestra.run.smithi148.stdout:Installing: 2024-09-12T22:29:27.521 INFO:teuthology.orchestra.run.smithi148.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-12T22:29:27.521 INFO:teuthology.orchestra.run.smithi148.stdout: ceph x86_64 2:19.1.1-314.g086c737f.el9 ceph 6.5 k 2024-09-12T22:29:27.522 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-base x86_64 2:19.1.1-314.g086c737f.el9 ceph 5.4 M 2024-09-12T22:29:27.522 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-fuse x86_64 2:19.1.1-314.g086c737f.el9 ceph 896 k 2024-09-12T22:29:27.522 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-314.g086c737f.el9 ceph 145 k 2024-09-12T22:29:27.522 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr x86_64 2:19.1.1-314.g086c737f.el9 ceph 1.5 M 2024-09-12T22:29:27.522 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-cephadm noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 146 k 2024-09-12T22:29:27.522 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-dashboard noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 3.6 M 2024-09-12T22:29:27.522 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 7.4 M 2024-09-12T22:29:27.522 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-rook noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 49 k 2024-09-12T22:29:27.522 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-radosgw x86_64 2:19.1.1-314.g086c737f.el9 ceph 11 M 2024-09-12T22:29:27.522 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-test x86_64 2:19.1.1-314.g086c737f.el9 ceph 49 M 2024-09-12T22:29:27.523 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-volume noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 285 k 2024-09-12T22:29:27.523 INFO:teuthology.orchestra.run.smithi148.stdout: cephadm noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 765 k 2024-09-12T22:29:27.523 INFO:teuthology.orchestra.run.smithi148.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-12T22:29:27.523 INFO:teuthology.orchestra.run.smithi148.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-12T22:29:27.523 INFO:teuthology.orchestra.run.smithi148.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-12T22:29:27.523 INFO:teuthology.orchestra.run.smithi148.stdout: libcephfs-devel x86_64 2:19.1.1-314.g086c737f.el9 ceph 32 k 2024-09-12T22:29:27.523 INFO:teuthology.orchestra.run.smithi148.stdout: libcephfs2 x86_64 2:19.1.1-314.g086c737f.el9 ceph 753 k 2024-09-12T22:29:27.523 INFO:teuthology.orchestra.run.smithi148.stdout: librados-devel x86_64 2:19.1.1-314.g086c737f.el9 ceph 127 k 2024-09-12T22:29:27.523 INFO:teuthology.orchestra.run.smithi148.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-12T22:29:27.523 INFO:teuthology.orchestra.run.smithi148.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-12T22:29:27.523 INFO:teuthology.orchestra.run.smithi148.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-12T22:29:27.524 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cephfs x86_64 2:19.1.1-314.g086c737f.el9 ceph 162 k 2024-09-12T22:29:27.524 INFO:teuthology.orchestra.run.smithi148.stdout: python3-rados x86_64 2:19.1.1-314.g086c737f.el9 ceph 320 k 2024-09-12T22:29:27.524 INFO:teuthology.orchestra.run.smithi148.stdout: python3-rbd x86_64 2:19.1.1-314.g086c737f.el9 ceph 301 k 2024-09-12T22:29:27.524 INFO:teuthology.orchestra.run.smithi148.stdout: python3-rgw x86_64 2:19.1.1-314.g086c737f.el9 ceph 99 k 2024-09-12T22:29:27.524 INFO:teuthology.orchestra.run.smithi148.stdout: rbd-fuse x86_64 2:19.1.1-314.g086c737f.el9 ceph 85 k 2024-09-12T22:29:27.524 INFO:teuthology.orchestra.run.smithi148.stdout: rbd-mirror x86_64 2:19.1.1-314.g086c737f.el9 ceph 3.1 M 2024-09-12T22:29:27.524 INFO:teuthology.orchestra.run.smithi148.stdout: rbd-nbd x86_64 2:19.1.1-314.g086c737f.el9 ceph 171 k 2024-09-12T22:29:27.524 INFO:teuthology.orchestra.run.smithi148.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-12T22:29:27.524 INFO:teuthology.orchestra.run.smithi148.stdout:Upgrading: 2024-09-12T22:29:27.524 INFO:teuthology.orchestra.run.smithi148.stdout: librados2 x86_64 2:19.1.1-314.g086c737f.el9 ceph 3.4 M 2024-09-12T22:29:27.524 INFO:teuthology.orchestra.run.smithi148.stdout: librbd1 x86_64 2:19.1.1-314.g086c737f.el9 ceph 3.2 M 2024-09-12T22:29:27.524 INFO:teuthology.orchestra.run.smithi148.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-12T22:29:27.525 INFO:teuthology.orchestra.run.smithi148.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-12T22:29:27.525 INFO:teuthology.orchestra.run.smithi148.stdout:Installing dependencies: 2024-09-12T22:29:27.525 INFO:teuthology.orchestra.run.smithi148.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-12T22:29:27.525 INFO:teuthology.orchestra.run.smithi148.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-12T22:29:27.525 INFO:teuthology.orchestra.run.smithi148.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-12T22:29:27.525 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-common x86_64 2:19.1.1-314.g086c737f.el9 ceph 21 M 2024-09-12T22:29:27.525 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-grafana-dashboards noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 32 k 2024-09-12T22:29:27.525 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mds x86_64 2:19.1.1-314.g086c737f.el9 ceph 2.4 M 2024-09-12T22:29:27.525 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-modules-core noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 249 k 2024-09-12T22:29:27.525 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mon x86_64 2:19.1.1-314.g086c737f.el9 ceph 4.7 M 2024-09-12T22:29:27.525 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-osd x86_64 2:19.1.1-314.g086c737f.el9 ceph 17 M 2024-09-12T22:29:27.525 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-prometheus-alerts noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 16 k 2024-09-12T22:29:27.526 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-selinux x86_64 2:19.1.1-314.g086c737f.el9 ceph 25 k 2024-09-12T22:29:27.526 INFO:teuthology.orchestra.run.smithi148.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-12T22:29:27.526 INFO:teuthology.orchestra.run.smithi148.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-12T22:29:27.526 INFO:teuthology.orchestra.run.smithi148.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-12T22:29:27.526 INFO:teuthology.orchestra.run.smithi148.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-12T22:29:27.526 INFO:teuthology.orchestra.run.smithi148.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-12T22:29:27.526 INFO:teuthology.orchestra.run.smithi148.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-12T22:29:27.526 INFO:teuthology.orchestra.run.smithi148.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-12T22:29:27.526 INFO:teuthology.orchestra.run.smithi148.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-12T22:29:27.526 INFO:teuthology.orchestra.run.smithi148.stdout: libcephsqlite x86_64 2:19.1.1-314.g086c737f.el9 ceph 164 k 2024-09-12T22:29:27.526 INFO:teuthology.orchestra.run.smithi148.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-12T22:29:27.526 INFO:teuthology.orchestra.run.smithi148.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-12T22:29:27.527 INFO:teuthology.orchestra.run.smithi148.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-12T22:29:27.527 INFO:teuthology.orchestra.run.smithi148.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-12T22:29:27.527 INFO:teuthology.orchestra.run.smithi148.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-12T22:29:27.527 INFO:teuthology.orchestra.run.smithi148.stdout: libradosstriper1 x86_64 2:19.1.1-314.g086c737f.el9 ceph 506 k 2024-09-12T22:29:27.527 INFO:teuthology.orchestra.run.smithi148.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-12T22:29:27.527 INFO:teuthology.orchestra.run.smithi148.stdout: librgw2 x86_64 2:19.1.1-314.g086c737f.el9 ceph 5.3 M 2024-09-12T22:29:27.527 INFO:teuthology.orchestra.run.smithi148.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-12T22:29:27.527 INFO:teuthology.orchestra.run.smithi148.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-12T22:29:27.527 INFO:teuthology.orchestra.run.smithi148.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-12T22:29:27.527 INFO:teuthology.orchestra.run.smithi148.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-12T22:29:27.527 INFO:teuthology.orchestra.run.smithi148.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-12T22:29:27.527 INFO:teuthology.orchestra.run.smithi148.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-12T22:29:27.528 INFO:teuthology.orchestra.run.smithi148.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-12T22:29:27.528 INFO:teuthology.orchestra.run.smithi148.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-12T22:29:27.528 INFO:teuthology.orchestra.run.smithi148.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-12T22:29:27.528 INFO:teuthology.orchestra.run.smithi148.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-12T22:29:27.528 INFO:teuthology.orchestra.run.smithi148.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-12T22:29:27.528 INFO:teuthology.orchestra.run.smithi148.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-12T22:29:27.528 INFO:teuthology.orchestra.run.smithi148.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-12T22:29:27.528 INFO:teuthology.orchestra.run.smithi148.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-12T22:29:27.528 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-12T22:29:27.528 INFO:teuthology.orchestra.run.smithi148.stdout: python3-ceph-argparse x86_64 2:19.1.1-314.g086c737f.el9 ceph 45 k 2024-09-12T22:29:27.529 INFO:teuthology.orchestra.run.smithi148.stdout: python3-ceph-common x86_64 2:19.1.1-314.g086c737f.el9 ceph 136 k 2024-09-12T22:29:27.529 INFO:teuthology.orchestra.run.smithi148.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-12T22:29:27.529 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-12T22:29:27.529 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-12T22:29:27.529 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-12T22:29:27.529 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-12T22:29:27.529 INFO:teuthology.orchestra.run.smithi148.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-12T22:29:27.529 INFO:teuthology.orchestra.run.smithi148.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-12T22:29:27.529 INFO:teuthology.orchestra.run.smithi148.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-12T22:29:27.529 INFO:teuthology.orchestra.run.smithi148.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-12T22:29:27.529 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-12T22:29:27.529 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-12T22:29:27.530 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-12T22:29:27.530 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-12T22:29:27.530 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-12T22:29:27.530 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-12T22:29:27.530 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-12T22:29:27.530 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-12T22:29:27.530 INFO:teuthology.orchestra.run.smithi148.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-12T22:29:27.530 INFO:teuthology.orchestra.run.smithi148.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-12T22:29:27.530 INFO:teuthology.orchestra.run.smithi148.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-12T22:29:27.530 INFO:teuthology.orchestra.run.smithi148.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-12T22:29:27.530 INFO:teuthology.orchestra.run.smithi148.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-12T22:29:27.530 INFO:teuthology.orchestra.run.smithi148.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-12T22:29:27.531 INFO:teuthology.orchestra.run.smithi148.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-12T22:29:27.531 INFO:teuthology.orchestra.run.smithi148.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-12T22:29:27.531 INFO:teuthology.orchestra.run.smithi148.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-12T22:29:27.531 INFO:teuthology.orchestra.run.smithi148.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-12T22:29:27.531 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-12T22:29:27.531 INFO:teuthology.orchestra.run.smithi148.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-12T22:29:27.531 INFO:teuthology.orchestra.run.smithi148.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-12T22:29:27.531 INFO:teuthology.orchestra.run.smithi148.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-12T22:29:27.531 INFO:teuthology.orchestra.run.smithi148.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-12T22:29:27.531 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-12T22:29:27.531 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-12T22:29:27.532 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-12T22:29:27.532 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-12T22:29:27.532 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-12T22:29:27.532 INFO:teuthology.orchestra.run.smithi148.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-12T22:29:27.532 INFO:teuthology.orchestra.run.smithi148.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-12T22:29:27.532 INFO:teuthology.orchestra.run.smithi148.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-12T22:29:27.532 INFO:teuthology.orchestra.run.smithi148.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-12T22:29:27.532 INFO:teuthology.orchestra.run.smithi148.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-12T22:29:27.532 INFO:teuthology.orchestra.run.smithi148.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-12T22:29:27.532 INFO:teuthology.orchestra.run.smithi148.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-12T22:29:27.532 INFO:teuthology.orchestra.run.smithi148.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-12T22:29:27.532 INFO:teuthology.orchestra.run.smithi148.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-12T22:29:27.533 INFO:teuthology.orchestra.run.smithi148.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-12T22:29:27.533 INFO:teuthology.orchestra.run.smithi148.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-12T22:29:27.533 INFO:teuthology.orchestra.run.smithi148.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-12T22:29:27.533 INFO:teuthology.orchestra.run.smithi148.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-12T22:29:27.533 INFO:teuthology.orchestra.run.smithi148.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-12T22:29:27.533 INFO:teuthology.orchestra.run.smithi148.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-12T22:29:27.533 INFO:teuthology.orchestra.run.smithi148.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-12T22:29:27.533 INFO:teuthology.orchestra.run.smithi148.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-12T22:29:27.533 INFO:teuthology.orchestra.run.smithi148.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-12T22:29:27.533 INFO:teuthology.orchestra.run.smithi148.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-12T22:29:27.533 INFO:teuthology.orchestra.run.smithi148.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-12T22:29:27.534 INFO:teuthology.orchestra.run.smithi148.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-12T22:29:27.534 INFO:teuthology.orchestra.run.smithi148.stdout:Installing weak dependencies: 2024-09-12T22:29:27.534 INFO:teuthology.orchestra.run.smithi148.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-12T22:29:27.534 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T22:29:27.534 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction Summary 2024-09-12T22:29:27.534 INFO:teuthology.orchestra.run.smithi148.stdout:====================================================================================== 2024-09-12T22:29:27.534 INFO:teuthology.orchestra.run.smithi148.stdout:Install 135 Packages 2024-09-12T22:29:27.534 INFO:teuthology.orchestra.run.smithi148.stdout:Upgrade 4 Packages 2024-09-12T22:29:27.534 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T22:29:27.535 INFO:teuthology.orchestra.run.smithi148.stdout:Total download size: 213 M 2024-09-12T22:29:27.535 INFO:teuthology.orchestra.run.smithi148.stdout:Downloading Packages: 2024-09-12T22:29:27.543 INFO:teuthology.orchestra.run.smithi163.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T22:29:27.544 INFO:teuthology.orchestra.run.smithi163.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T22:29:27.612 INFO:teuthology.orchestra.run.smithi163.stdout:Dependencies resolved. 2024-09-12T22:29:27.624 INFO:teuthology.orchestra.run.smithi163.stdout:====================================================================================== 2024-09-12T22:29:27.624 INFO:teuthology.orchestra.run.smithi163.stdout: Package Arch Version Repository Size 2024-09-12T22:29:27.625 INFO:teuthology.orchestra.run.smithi163.stdout:====================================================================================== 2024-09-12T22:29:27.625 INFO:teuthology.orchestra.run.smithi163.stdout:Installing: 2024-09-12T22:29:27.625 INFO:teuthology.orchestra.run.smithi163.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-12T22:29:27.625 INFO:teuthology.orchestra.run.smithi163.stdout: ceph x86_64 2:19.1.1-314.g086c737f.el9 ceph 6.5 k 2024-09-12T22:29:27.625 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-base x86_64 2:19.1.1-314.g086c737f.el9 ceph 5.4 M 2024-09-12T22:29:27.625 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-fuse x86_64 2:19.1.1-314.g086c737f.el9 ceph 896 k 2024-09-12T22:29:27.626 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-314.g086c737f.el9 ceph 145 k 2024-09-12T22:29:27.626 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr x86_64 2:19.1.1-314.g086c737f.el9 ceph 1.5 M 2024-09-12T22:29:27.626 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr-cephadm noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 146 k 2024-09-12T22:29:27.626 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr-dashboard noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 3.6 M 2024-09-12T22:29:27.626 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 7.4 M 2024-09-12T22:29:27.626 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr-rook noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 49 k 2024-09-12T22:29:27.626 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-radosgw x86_64 2:19.1.1-314.g086c737f.el9 ceph 11 M 2024-09-12T22:29:27.626 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-test x86_64 2:19.1.1-314.g086c737f.el9 ceph 49 M 2024-09-12T22:29:27.626 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-volume noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 285 k 2024-09-12T22:29:27.626 INFO:teuthology.orchestra.run.smithi163.stdout: cephadm noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 765 k 2024-09-12T22:29:27.626 INFO:teuthology.orchestra.run.smithi163.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-12T22:29:27.626 INFO:teuthology.orchestra.run.smithi163.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-12T22:29:27.626 INFO:teuthology.orchestra.run.smithi163.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-12T22:29:27.627 INFO:teuthology.orchestra.run.smithi163.stdout: libcephfs-devel x86_64 2:19.1.1-314.g086c737f.el9 ceph 32 k 2024-09-12T22:29:27.627 INFO:teuthology.orchestra.run.smithi163.stdout: libcephfs2 x86_64 2:19.1.1-314.g086c737f.el9 ceph 753 k 2024-09-12T22:29:27.627 INFO:teuthology.orchestra.run.smithi163.stdout: librados-devel x86_64 2:19.1.1-314.g086c737f.el9 ceph 127 k 2024-09-12T22:29:27.627 INFO:teuthology.orchestra.run.smithi163.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-12T22:29:27.627 INFO:teuthology.orchestra.run.smithi163.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-12T22:29:27.627 INFO:teuthology.orchestra.run.smithi163.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-12T22:29:27.627 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cephfs x86_64 2:19.1.1-314.g086c737f.el9 ceph 162 k 2024-09-12T22:29:27.627 INFO:teuthology.orchestra.run.smithi163.stdout: python3-rados x86_64 2:19.1.1-314.g086c737f.el9 ceph 320 k 2024-09-12T22:29:27.627 INFO:teuthology.orchestra.run.smithi163.stdout: python3-rbd x86_64 2:19.1.1-314.g086c737f.el9 ceph 301 k 2024-09-12T22:29:27.627 INFO:teuthology.orchestra.run.smithi163.stdout: python3-rgw x86_64 2:19.1.1-314.g086c737f.el9 ceph 99 k 2024-09-12T22:29:27.627 INFO:teuthology.orchestra.run.smithi163.stdout: rbd-fuse x86_64 2:19.1.1-314.g086c737f.el9 ceph 85 k 2024-09-12T22:29:27.627 INFO:teuthology.orchestra.run.smithi163.stdout: rbd-mirror x86_64 2:19.1.1-314.g086c737f.el9 ceph 3.1 M 2024-09-12T22:29:27.628 INFO:teuthology.orchestra.run.smithi163.stdout: rbd-nbd x86_64 2:19.1.1-314.g086c737f.el9 ceph 171 k 2024-09-12T22:29:27.628 INFO:teuthology.orchestra.run.smithi163.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-12T22:29:27.628 INFO:teuthology.orchestra.run.smithi163.stdout:Upgrading: 2024-09-12T22:29:27.628 INFO:teuthology.orchestra.run.smithi163.stdout: librados2 x86_64 2:19.1.1-314.g086c737f.el9 ceph 3.4 M 2024-09-12T22:29:27.628 INFO:teuthology.orchestra.run.smithi163.stdout: librbd1 x86_64 2:19.1.1-314.g086c737f.el9 ceph 3.2 M 2024-09-12T22:29:27.628 INFO:teuthology.orchestra.run.smithi163.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-12T22:29:27.628 INFO:teuthology.orchestra.run.smithi163.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-12T22:29:27.628 INFO:teuthology.orchestra.run.smithi163.stdout:Installing dependencies: 2024-09-12T22:29:27.629 INFO:teuthology.orchestra.run.smithi163.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-12T22:29:27.629 INFO:teuthology.orchestra.run.smithi163.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-12T22:29:27.629 INFO:teuthology.orchestra.run.smithi163.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-12T22:29:27.629 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-common x86_64 2:19.1.1-314.g086c737f.el9 ceph 21 M 2024-09-12T22:29:27.629 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-grafana-dashboards noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 32 k 2024-09-12T22:29:27.629 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mds x86_64 2:19.1.1-314.g086c737f.el9 ceph 2.4 M 2024-09-12T22:29:27.629 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr-modules-core noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 249 k 2024-09-12T22:29:27.629 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mon x86_64 2:19.1.1-314.g086c737f.el9 ceph 4.7 M 2024-09-12T22:29:27.629 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-osd x86_64 2:19.1.1-314.g086c737f.el9 ceph 17 M 2024-09-12T22:29:27.629 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-prometheus-alerts noarch 2:19.1.1-314.g086c737f.el9 ceph-noarch 16 k 2024-09-12T22:29:27.629 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-selinux x86_64 2:19.1.1-314.g086c737f.el9 ceph 25 k 2024-09-12T22:29:27.629 INFO:teuthology.orchestra.run.smithi163.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-12T22:29:27.630 INFO:teuthology.orchestra.run.smithi163.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-12T22:29:27.630 INFO:teuthology.orchestra.run.smithi163.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-12T22:29:27.630 INFO:teuthology.orchestra.run.smithi163.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-12T22:29:27.630 INFO:teuthology.orchestra.run.smithi163.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-12T22:29:27.630 INFO:teuthology.orchestra.run.smithi163.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-12T22:29:27.630 INFO:teuthology.orchestra.run.smithi163.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-12T22:29:27.630 INFO:teuthology.orchestra.run.smithi163.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-12T22:29:27.630 INFO:teuthology.orchestra.run.smithi163.stdout: libcephsqlite x86_64 2:19.1.1-314.g086c737f.el9 ceph 164 k 2024-09-12T22:29:27.630 INFO:teuthology.orchestra.run.smithi163.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-12T22:29:27.630 INFO:teuthology.orchestra.run.smithi163.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-12T22:29:27.630 INFO:teuthology.orchestra.run.smithi163.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-12T22:29:27.630 INFO:teuthology.orchestra.run.smithi163.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-12T22:29:27.631 INFO:teuthology.orchestra.run.smithi163.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-12T22:29:27.631 INFO:teuthology.orchestra.run.smithi163.stdout: libradosstriper1 x86_64 2:19.1.1-314.g086c737f.el9 ceph 506 k 2024-09-12T22:29:27.631 INFO:teuthology.orchestra.run.smithi163.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-12T22:29:27.631 INFO:teuthology.orchestra.run.smithi163.stdout: librgw2 x86_64 2:19.1.1-314.g086c737f.el9 ceph 5.3 M 2024-09-12T22:29:27.631 INFO:teuthology.orchestra.run.smithi163.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-12T22:29:27.631 INFO:teuthology.orchestra.run.smithi163.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-12T22:29:27.631 INFO:teuthology.orchestra.run.smithi163.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-12T22:29:27.631 INFO:teuthology.orchestra.run.smithi163.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-12T22:29:27.631 INFO:teuthology.orchestra.run.smithi163.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-12T22:29:27.631 INFO:teuthology.orchestra.run.smithi163.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-12T22:29:27.631 INFO:teuthology.orchestra.run.smithi163.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-12T22:29:27.631 INFO:teuthology.orchestra.run.smithi163.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-12T22:29:27.632 INFO:teuthology.orchestra.run.smithi163.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-12T22:29:27.632 INFO:teuthology.orchestra.run.smithi163.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-12T22:29:27.632 INFO:teuthology.orchestra.run.smithi163.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-12T22:29:27.632 INFO:teuthology.orchestra.run.smithi163.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-12T22:29:27.632 INFO:teuthology.orchestra.run.smithi163.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-12T22:29:27.632 INFO:teuthology.orchestra.run.smithi163.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-12T22:29:27.632 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-12T22:29:27.632 INFO:teuthology.orchestra.run.smithi163.stdout: python3-ceph-argparse x86_64 2:19.1.1-314.g086c737f.el9 ceph 45 k 2024-09-12T22:29:27.632 INFO:teuthology.orchestra.run.smithi163.stdout: python3-ceph-common x86_64 2:19.1.1-314.g086c737f.el9 ceph 136 k 2024-09-12T22:29:27.632 INFO:teuthology.orchestra.run.smithi163.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-12T22:29:27.632 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-12T22:29:27.632 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-12T22:29:27.633 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-12T22:29:27.633 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-12T22:29:27.633 INFO:teuthology.orchestra.run.smithi163.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-12T22:29:27.633 INFO:teuthology.orchestra.run.smithi163.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-12T22:29:27.633 INFO:teuthology.orchestra.run.smithi163.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-12T22:29:27.633 INFO:teuthology.orchestra.run.smithi163.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-12T22:29:27.633 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-12T22:29:27.633 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-12T22:29:27.633 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-12T22:29:27.633 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-12T22:29:27.633 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-12T22:29:27.633 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-12T22:29:27.634 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-12T22:29:27.634 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-12T22:29:27.634 INFO:teuthology.orchestra.run.smithi163.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-12T22:29:27.634 INFO:teuthology.orchestra.run.smithi163.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-12T22:29:27.634 INFO:teuthology.orchestra.run.smithi163.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-12T22:29:27.634 INFO:teuthology.orchestra.run.smithi163.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-12T22:29:27.634 INFO:teuthology.orchestra.run.smithi163.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-12T22:29:27.634 INFO:teuthology.orchestra.run.smithi163.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-12T22:29:27.634 INFO:teuthology.orchestra.run.smithi163.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-12T22:29:27.634 INFO:teuthology.orchestra.run.smithi163.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-12T22:29:27.634 INFO:teuthology.orchestra.run.smithi163.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-12T22:29:27.634 INFO:teuthology.orchestra.run.smithi163.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-12T22:29:27.634 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-12T22:29:27.635 INFO:teuthology.orchestra.run.smithi163.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-12T22:29:27.635 INFO:teuthology.orchestra.run.smithi163.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-12T22:29:27.635 INFO:teuthology.orchestra.run.smithi163.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-12T22:29:27.635 INFO:teuthology.orchestra.run.smithi163.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-12T22:29:27.635 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-12T22:29:27.635 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-12T22:29:27.635 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-12T22:29:27.635 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-12T22:29:27.635 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-12T22:29:27.635 INFO:teuthology.orchestra.run.smithi163.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-12T22:29:27.635 INFO:teuthology.orchestra.run.smithi163.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-12T22:29:27.635 INFO:teuthology.orchestra.run.smithi163.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-12T22:29:27.635 INFO:teuthology.orchestra.run.smithi163.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-12T22:29:27.636 INFO:teuthology.orchestra.run.smithi163.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-12T22:29:27.636 INFO:teuthology.orchestra.run.smithi163.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-12T22:29:27.636 INFO:teuthology.orchestra.run.smithi163.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-12T22:29:27.636 INFO:teuthology.orchestra.run.smithi163.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-12T22:29:27.636 INFO:teuthology.orchestra.run.smithi163.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-12T22:29:27.636 INFO:teuthology.orchestra.run.smithi163.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-12T22:29:27.636 INFO:teuthology.orchestra.run.smithi163.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-12T22:29:27.636 INFO:teuthology.orchestra.run.smithi163.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-12T22:29:27.636 INFO:teuthology.orchestra.run.smithi163.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-12T22:29:27.636 INFO:teuthology.orchestra.run.smithi163.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-12T22:29:27.636 INFO:teuthology.orchestra.run.smithi163.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-12T22:29:27.636 INFO:teuthology.orchestra.run.smithi163.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-12T22:29:27.636 INFO:teuthology.orchestra.run.smithi163.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-12T22:29:27.636 INFO:teuthology.orchestra.run.smithi163.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-12T22:29:27.637 INFO:teuthology.orchestra.run.smithi163.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-12T22:29:27.637 INFO:teuthology.orchestra.run.smithi163.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-12T22:29:27.637 INFO:teuthology.orchestra.run.smithi163.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-12T22:29:27.637 INFO:teuthology.orchestra.run.smithi163.stdout:Installing weak dependencies: 2024-09-12T22:29:27.637 INFO:teuthology.orchestra.run.smithi163.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-12T22:29:27.637 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-09-12T22:29:27.637 INFO:teuthology.orchestra.run.smithi163.stdout:Transaction Summary 2024-09-12T22:29:27.637 INFO:teuthology.orchestra.run.smithi163.stdout:====================================================================================== 2024-09-12T22:29:27.637 INFO:teuthology.orchestra.run.smithi163.stdout:Install 135 Packages 2024-09-12T22:29:27.637 INFO:teuthology.orchestra.run.smithi163.stdout:Upgrade 4 Packages 2024-09-12T22:29:27.637 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-09-12T22:29:27.638 INFO:teuthology.orchestra.run.smithi163.stdout:Total download size: 213 M 2024-09-12T22:29:27.638 INFO:teuthology.orchestra.run.smithi163.stdout:Downloading Packages: 2024-09-12T22:29:28.086 INFO:teuthology.orchestra.run.smithi076.stdout:(2/139): ceph-fuse-19.1.1-314.g086c737f.el9.x86 1.2 MB/s | 896 kB 00:00 2024-09-12T22:29:28.228 INFO:teuthology.orchestra.run.smithi019.stdout:(1/139): ceph-19.1.1-314.g086c737f.el9.x86_64.r 21 kB/s | 6.5 kB 00:00 2024-09-12T22:29:28.233 INFO:teuthology.orchestra.run.smithi148.stdout:(1/139): ceph-19.1.1-314.g086c737f.el9.x86_64.r 21 kB/s | 6.5 kB 00:00 2024-09-12T22:29:28.253 INFO:teuthology.orchestra.run.smithi076.stdout:(3/139): ceph-immutable-object-cache-19.1.1-314 872 kB/s | 145 kB 00:00 2024-09-12T22:29:28.477 INFO:teuthology.orchestra.run.smithi163.stdout:(1/139): ceph-19.1.1-314.g086c737f.el9.x86_64.r 26 kB/s | 6.5 kB 00:00 2024-09-12T22:29:28.678 INFO:teuthology.orchestra.run.smithi019.stdout:(2/139): ceph-fuse-19.1.1-314.g086c737f.el9.x86 1.9 MB/s | 896 kB 00:00 2024-09-12T22:29:28.749 INFO:teuthology.orchestra.run.smithi148.stdout:(2/139): ceph-fuse-19.1.1-314.g086c737f.el9.x86 1.7 MB/s | 896 kB 00:00 2024-09-12T22:29:28.779 INFO:teuthology.orchestra.run.smithi019.stdout:(3/139): ceph-immutable-object-cache-19.1.1-314 1.4 MB/s | 145 kB 00:00 2024-09-12T22:29:29.058 INFO:teuthology.orchestra.run.smithi148.stdout:(3/139): ceph-base-19.1.1-314.g086c737f.el9.x86 4.7 MB/s | 5.4 MB 00:01 2024-09-12T22:29:29.117 INFO:teuthology.orchestra.run.smithi148.stdout:(4/139): ceph-immutable-object-cache-19.1.1-314 396 kB/s | 145 kB 00:00 2024-09-12T22:29:29.144 INFO:teuthology.orchestra.run.smithi076.stdout:(4/139): ceph-base-19.1.1-314.g086c737f.el9.x86 2.6 MB/s | 5.4 MB 00:02 2024-09-12T22:29:29.179 INFO:teuthology.orchestra.run.smithi019.stdout:(4/139): ceph-base-19.1.1-314.g086c737f.el9.x86 4.3 MB/s | 5.4 MB 00:01 2024-09-12T22:29:29.211 INFO:teuthology.orchestra.run.smithi076.stdout:(5/139): ceph-mds-19.1.1-314.g086c737f.el9.x86_ 2.5 MB/s | 2.4 MB 00:00 2024-09-12T22:29:29.343 INFO:teuthology.orchestra.run.smithi163.stdout:(2/139): ceph-fuse-19.1.1-314.g086c737f.el9.x86 1.0 MB/s | 896 kB 00:00 2024-09-12T22:29:29.429 INFO:teuthology.orchestra.run.smithi019.stdout:(5/139): ceph-mgr-19.1.1-314.g086c737f.el9.x86_ 6.1 MB/s | 1.5 MB 00:00 2024-09-12T22:29:29.460 INFO:teuthology.orchestra.run.smithi163.stdout:(3/139): ceph-immutable-object-cache-19.1.1-314 1.2 MB/s | 145 kB 00:00 2024-09-12T22:29:29.579 INFO:teuthology.orchestra.run.smithi019.stdout:(6/139): ceph-mds-19.1.1-314.g086c737f.el9.x86_ 3.0 MB/s | 2.4 MB 00:00 2024-09-12T22:29:29.659 INFO:teuthology.orchestra.run.smithi148.stdout:(5/139): ceph-mds-19.1.1-314.g086c737f.el9.x86_ 4.0 MB/s | 2.4 MB 00:00 2024-09-12T22:29:29.662 INFO:teuthology.orchestra.run.smithi076.stdout:(6/139): ceph-mgr-19.1.1-314.g086c737f.el9.x86_ 2.9 MB/s | 1.5 MB 00:00 2024-09-12T22:29:29.930 INFO:teuthology.orchestra.run.smithi019.stdout:(7/139): ceph-mon-19.1.1-314.g086c737f.el9.x86_ 9.4 MB/s | 4.7 MB 00:00 2024-09-12T22:29:30.084 INFO:teuthology.orchestra.run.smithi148.stdout:(6/139): ceph-mgr-19.1.1-314.g086c737f.el9.x86_ 1.6 MB/s | 1.5 MB 00:00 2024-09-12T22:29:30.493 INFO:teuthology.orchestra.run.smithi148.stdout:(7/139): ceph-mon-19.1.1-314.g086c737f.el9.x86_ 5.6 MB/s | 4.7 MB 00:00 2024-09-12T22:29:30.510 INFO:teuthology.orchestra.run.smithi163.stdout:(4/139): ceph-mds-19.1.1-314.g086c737f.el9.x86_ 2.3 MB/s | 2.4 MB 00:01 2024-09-12T22:29:30.952 INFO:teuthology.orchestra.run.smithi163.stdout:(5/139): ceph-mgr-19.1.1-314.g086c737f.el9.x86_ 3.4 MB/s | 1.5 MB 00:00 2024-09-12T22:29:30.955 INFO:teuthology.orchestra.run.smithi019.stdout:(8/139): ceph-radosgw-19.1.1-314.g086c737f.el9. 10 MB/s | 11 MB 00:01 2024-09-12T22:29:31.022 INFO:teuthology.orchestra.run.smithi019.stdout:(9/139): ceph-selinux-19.1.1-314.g086c737f.el9. 379 kB/s | 25 kB 00:00 2024-09-12T22:29:31.710 INFO:teuthology.orchestra.run.smithi163.stdout:(6/139): ceph-mon-19.1.1-314.g086c737f.el9.x86_ 6.2 MB/s | 4.7 MB 00:00 2024-09-12T22:29:31.779 INFO:teuthology.orchestra.run.smithi076.stdout:(7/139): ceph-mon-19.1.1-314.g086c737f.el9.x86_ 1.8 MB/s | 4.7 MB 00:02 2024-09-12T22:29:32.759 INFO:teuthology.orchestra.run.smithi148.stdout:(8/139): ceph-radosgw-19.1.1-314.g086c737f.el9. 4.7 MB/s | 11 MB 00:02 2024-09-12T22:29:32.968 INFO:teuthology.orchestra.run.smithi148.stdout:(9/139): ceph-common-19.1.1-314.g086c737f.el9.x 4.2 MB/s | 21 MB 00:05 2024-09-12T22:29:32.993 INFO:teuthology.orchestra.run.smithi148.stdout:(10/139): ceph-selinux-19.1.1-314.g086c737f.el9 108 kB/s | 25 kB 00:00 2024-09-12T22:29:33.068 INFO:teuthology.orchestra.run.smithi148.stdout:(11/139): libcephfs-devel-19.1.1-314.g086c737f. 423 kB/s | 32 kB 00:00 2024-09-12T22:29:33.235 INFO:teuthology.orchestra.run.smithi148.stdout:(12/139): libcephfs2-19.1.1-314.g086c737f.el9.x 4.4 MB/s | 753 kB 00:00 2024-09-12T22:29:33.277 INFO:teuthology.orchestra.run.smithi163.stdout:(7/139): ceph-osd-19.1.1-314.g086c737f.el9.x86_ 11 MB/s | 17 MB 00:01 2024-09-12T22:29:33.294 INFO:teuthology.orchestra.run.smithi148.stdout:(13/139): libcephsqlite-19.1.1-314.g086c737f.el 2.7 MB/s | 164 kB 00:00 2024-09-12T22:29:33.377 INFO:teuthology.orchestra.run.smithi148.stdout:(14/139): librados-devel-19.1.1-314.g086c737f.e 1.5 MB/s | 127 kB 00:00 2024-09-12T22:29:33.405 INFO:teuthology.orchestra.run.smithi019.stdout:(10/139): ceph-common-19.1.1-314.g086c737f.el9. 3.9 MB/s | 21 MB 00:05 2024-09-12T22:29:33.452 INFO:teuthology.orchestra.run.smithi163.stdout:(8/139): ceph-base-19.1.1-314.g086c737f.el9.x86 1.0 MB/s | 5.4 MB 00:05 2024-09-12T22:29:33.480 INFO:teuthology.orchestra.run.smithi019.stdout:(11/139): libcephfs-devel-19.1.1-314.g086c737f. 425 kB/s | 32 kB 00:00 2024-09-12T22:29:33.536 INFO:teuthology.orchestra.run.smithi148.stdout:(15/139): libradosstriper1-19.1.1-314.g086c737f 3.1 MB/s | 506 kB 00:00 2024-09-12T22:29:33.552 INFO:teuthology.orchestra.run.smithi163.stdout:(9/139): ceph-selinux-19.1.1-314.g086c737f.el9. 252 kB/s | 25 kB 00:00 2024-09-12T22:29:33.722 INFO:teuthology.orchestra.run.smithi019.stdout:(12/139): libcephfs2-19.1.1-314.g086c737f.el9.x 3.0 MB/s | 753 kB 00:00 2024-09-12T22:29:33.814 INFO:teuthology.orchestra.run.smithi019.stdout:(13/139): libcephsqlite-19.1.1-314.g086c737f.el 1.7 MB/s | 164 kB 00:00 2024-09-12T22:29:33.862 INFO:teuthology.orchestra.run.smithi076.stdout:(8/139): ceph-common-19.1.1-314.g086c737f.el9.x 3.1 MB/s | 21 MB 00:06 2024-09-12T22:29:33.906 INFO:teuthology.orchestra.run.smithi019.stdout:(14/139): librados-devel-19.1.1-314.g086c737f.e 1.3 MB/s | 127 kB 00:00 2024-09-12T22:29:33.954 INFO:teuthology.orchestra.run.smithi076.stdout:(9/139): ceph-selinux-19.1.1-314.g086c737f.el9. 275 kB/s | 25 kB 00:00 2024-09-12T22:29:33.986 INFO:teuthology.orchestra.run.smithi163.stdout:(10/139): ceph-radosgw-19.1.1-314.g086c737f.el9 15 MB/s | 11 MB 00:00 2024-09-12T22:29:34.045 INFO:teuthology.orchestra.run.smithi163.stdout:(11/139): libcephfs-devel-19.1.1-314.g086c737f. 545 kB/s | 32 kB 00:00 2024-09-12T22:29:34.082 INFO:teuthology.orchestra.run.smithi019.stdout:(15/139): ceph-osd-19.1.1-314.g086c737f.el9.x86 3.7 MB/s | 17 MB 00:04 2024-09-12T22:29:34.115 INFO:teuthology.orchestra.run.smithi019.stdout:(16/139): libradosstriper1-19.1.1-314.g086c737f 2.4 MB/s | 506 kB 00:00 2024-09-12T22:29:34.128 INFO:teuthology.orchestra.run.smithi163.stdout:(12/139): libcephfs2-19.1.1-314.g086c737f.el9.x 8.8 MB/s | 753 kB 00:00 2024-09-12T22:29:34.182 INFO:teuthology.orchestra.run.smithi019.stdout:(17/139): python3-ceph-argparse-19.1.1-314.g086 677 kB/s | 45 kB 00:00 2024-09-12T22:29:34.204 INFO:teuthology.orchestra.run.smithi163.stdout:(13/139): libcephsqlite-19.1.1-314.g086c737f.el 2.1 MB/s | 164 kB 00:00 2024-09-12T22:29:34.257 INFO:teuthology.orchestra.run.smithi019.stdout:(18/139): python3-ceph-common-19.1.1-314.g086c7 1.8 MB/s | 136 kB 00:00 2024-09-12T22:29:34.279 INFO:teuthology.orchestra.run.smithi163.stdout:(14/139): librados-devel-19.1.1-314.g086c737f.e 1.6 MB/s | 127 kB 00:00 2024-09-12T22:29:34.333 INFO:teuthology.orchestra.run.smithi019.stdout:(19/139): python3-cephfs-19.1.1-314.g086c737f.e 2.1 MB/s | 162 kB 00:00 2024-09-12T22:29:34.362 INFO:teuthology.orchestra.run.smithi163.stdout:(15/139): libradosstriper1-19.1.1-314.g086c737f 5.9 MB/s | 506 kB 00:00 2024-09-12T22:29:34.386 INFO:teuthology.orchestra.run.smithi148.stdout:(16/139): librgw2-19.1.1-314.g086c737f.el9.x86_ 6.3 MB/s | 5.3 MB 00:00 2024-09-12T22:29:34.475 INFO:teuthology.orchestra.run.smithi019.stdout:(20/139): python3-rados-19.1.1-314.g086c737f.el 2.2 MB/s | 320 kB 00:00 2024-09-12T22:29:34.478 INFO:teuthology.orchestra.run.smithi148.stdout:(17/139): python3-ceph-argparse-19.1.1-314.g086 492 kB/s | 45 kB 00:00 2024-09-12T22:29:34.578 INFO:teuthology.orchestra.run.smithi148.stdout:(18/139): python3-ceph-common-19.1.1-314.g086c7 1.3 MB/s | 136 kB 00:00 2024-09-12T22:29:34.654 INFO:teuthology.orchestra.run.smithi148.stdout:(19/139): python3-cephfs-19.1.1-314.g086c737f.e 2.1 MB/s | 162 kB 00:00 2024-09-12T22:29:34.705 INFO:teuthology.orchestra.run.smithi163.stdout:(16/139): librgw2-19.1.1-314.g086c737f.el9.x86_ 16 MB/s | 5.3 MB 00:00 2024-09-12T22:29:34.720 INFO:teuthology.orchestra.run.smithi148.stdout:(20/139): python3-rados-19.1.1-314.g086c737f.el 4.7 MB/s | 320 kB 00:00 2024-09-12T22:29:34.755 INFO:teuthology.orchestra.run.smithi163.stdout:(17/139): python3-ceph-argparse-19.1.1-314.g086 907 kB/s | 45 kB 00:00 2024-09-12T22:29:34.766 INFO:teuthology.orchestra.run.smithi019.stdout:(21/139): python3-rbd-19.1.1-314.g086c737f.el9. 1.0 MB/s | 301 kB 00:00 2024-09-12T22:29:34.788 INFO:teuthology.orchestra.run.smithi148.stdout:(21/139): python3-rbd-19.1.1-314.g086c737f.el9. 4.4 MB/s | 301 kB 00:00 2024-09-12T22:29:34.830 INFO:teuthology.orchestra.run.smithi163.stdout:(18/139): python3-ceph-common-19.1.1-314.g086c7 1.8 MB/s | 136 kB 00:00 2024-09-12T22:29:34.833 INFO:teuthology.orchestra.run.smithi019.stdout:(22/139): python3-rgw-19.1.1-314.g086c737f.el9. 1.5 MB/s | 99 kB 00:00 2024-09-12T22:29:34.855 INFO:teuthology.orchestra.run.smithi148.stdout:(22/139): python3-rgw-19.1.1-314.g086c737f.el9. 1.5 MB/s | 99 kB 00:00 2024-09-12T22:29:34.889 INFO:teuthology.orchestra.run.smithi163.stdout:(19/139): python3-cephfs-19.1.1-314.g086c737f.e 2.7 MB/s | 162 kB 00:00 2024-09-12T22:29:34.901 INFO:teuthology.orchestra.run.smithi019.stdout:(23/139): rbd-fuse-19.1.1-314.g086c737f.el9.x86 1.3 MB/s | 85 kB 00:00 2024-09-12T22:29:34.930 INFO:teuthology.orchestra.run.smithi148.stdout:(23/139): rbd-fuse-19.1.1-314.g086c737f.el9.x86 1.1 MB/s | 85 kB 00:00 2024-09-12T22:29:34.956 INFO:teuthology.orchestra.run.smithi163.stdout:(20/139): python3-rados-19.1.1-314.g086c737f.el 4.7 MB/s | 320 kB 00:00 2024-09-12T22:29:35.040 INFO:teuthology.orchestra.run.smithi163.stdout:(21/139): python3-rbd-19.1.1-314.g086c737f.el9. 3.5 MB/s | 301 kB 00:00 2024-09-12T22:29:35.140 INFO:teuthology.orchestra.run.smithi163.stdout:(22/139): python3-rgw-19.1.1-314.g086c737f.el9. 994 kB/s | 99 kB 00:00 2024-09-12T22:29:35.215 INFO:teuthology.orchestra.run.smithi163.stdout:(23/139): rbd-fuse-19.1.1-314.g086c737f.el9.x86 1.1 MB/s | 85 kB 00:00 2024-09-12T22:29:35.384 INFO:teuthology.orchestra.run.smithi019.stdout:(24/139): librgw2-19.1.1-314.g086c737f.el9.x86_ 4.1 MB/s | 5.3 MB 00:01 2024-09-12T22:29:35.466 INFO:teuthology.orchestra.run.smithi163.stdout:(24/139): rbd-mirror-19.1.1-314.g086c737f.el9.x 12 MB/s | 3.1 MB 00:00 2024-09-12T22:29:35.488 INFO:teuthology.orchestra.run.smithi148.stdout:(24/139): rbd-mirror-19.1.1-314.g086c737f.el9.x 5.6 MB/s | 3.1 MB 00:00 2024-09-12T22:29:35.516 INFO:teuthology.orchestra.run.smithi163.stdout:(25/139): rbd-nbd-19.1.1-314.g086c737f.el9.x86_ 3.3 MB/s | 171 kB 00:00 2024-09-12T22:29:35.539 INFO:teuthology.orchestra.run.smithi148.stdout:(25/139): rbd-nbd-19.1.1-314.g086c737f.el9.x86_ 3.3 MB/s | 171 kB 00:00 2024-09-12T22:29:35.566 INFO:teuthology.orchestra.run.smithi163.stdout:(26/139): ceph-grafana-dashboards-19.1.1-314.g0 638 kB/s | 32 kB 00:00 2024-09-12T22:29:35.580 INFO:teuthology.orchestra.run.smithi148.stdout:(26/139): ceph-grafana-dashboards-19.1.1-314.g0 769 kB/s | 32 kB 00:00 2024-09-12T22:29:35.617 INFO:teuthology.orchestra.run.smithi163.stdout:(27/139): ceph-mgr-cephadm-19.1.1-314.g086c737f 2.9 MB/s | 146 kB 00:00 2024-09-12T22:29:35.631 INFO:teuthology.orchestra.run.smithi148.stdout:(27/139): ceph-mgr-cephadm-19.1.1-314.g086c737f 2.8 MB/s | 146 kB 00:00 2024-09-12T22:29:35.720 INFO:teuthology.orchestra.run.smithi076.stdout:(10/139): ceph-osd-19.1.1-314.g086c737f.el9.x86 2.8 MB/s | 17 MB 00:06 2024-09-12T22:29:35.787 INFO:teuthology.orchestra.run.smithi076.stdout:(11/139): libcephfs-devel-19.1.1-314.g086c737f. 478 kB/s | 32 kB 00:00 2024-09-12T22:29:35.809 INFO:teuthology.orchestra.run.smithi163.stdout:(28/139): ceph-mgr-dashboard-19.1.1-314.g086c73 19 MB/s | 3.6 MB 00:00 2024-09-12T22:29:35.818 INFO:teuthology.orchestra.run.smithi019.stdout:(25/139): ceph-test-19.1.1-314.g086c737f.el9.x8 10 MB/s | 49 MB 00:04 2024-09-12T22:29:35.843 INFO:teuthology.orchestra.run.smithi019.stdout:(26/139): rbd-nbd-19.1.1-314.g086c737f.el9.x86_ 372 kB/s | 171 kB 00:00 2024-09-12T22:29:35.902 INFO:teuthology.orchestra.run.smithi019.stdout:(27/139): rbd-mirror-19.1.1-314.g086c737f.el9.x 3.1 MB/s | 3.1 MB 00:01 2024-09-12T22:29:35.918 INFO:teuthology.orchestra.run.smithi019.stdout:(28/139): ceph-grafana-dashboards-19.1.1-314.g0 318 kB/s | 32 kB 00:00 2024-09-12T22:29:35.954 INFO:teuthology.orchestra.run.smithi076.stdout:(12/139): ceph-radosgw-19.1.1-314.g086c737f.el9 2.5 MB/s | 11 MB 00:04 2024-09-12T22:29:35.969 INFO:teuthology.orchestra.run.smithi019.stdout:(29/139): ceph-mgr-cephadm-19.1.1-314.g086c737f 1.1 MB/s | 146 kB 00:00 2024-09-12T22:29:36.046 INFO:teuthology.orchestra.run.smithi076.stdout:(13/139): libcephsqlite-19.1.1-314.g086c737f.el 1.7 MB/s | 164 kB 00:00 2024-09-12T22:29:36.105 INFO:teuthology.orchestra.run.smithi076.stdout:(14/139): libcephfs2-19.1.1-314.g086c737f.el9.x 2.3 MB/s | 753 kB 00:00 2024-09-12T22:29:36.114 INFO:teuthology.orchestra.run.smithi148.stdout:(28/139): ceph-mgr-dashboard-19.1.1-314.g086c73 7.4 MB/s | 3.6 MB 00:00 2024-09-12T22:29:36.128 INFO:teuthology.orchestra.run.smithi019.stdout:(30/139): ceph-mgr-modules-core-19.1.1-314.g086 1.5 MB/s | 249 kB 00:00 2024-09-12T22:29:36.138 INFO:teuthology.orchestra.run.smithi076.stdout:(15/139): librados-devel-19.1.1-314.g086c737f.e 1.3 MB/s | 127 kB 00:00 2024-09-12T22:29:36.211 INFO:teuthology.orchestra.run.smithi019.stdout:(31/139): ceph-mgr-rook-19.1.1-314.g086c737f.el 594 kB/s | 49 kB 00:00 2024-09-12T22:29:36.226 INFO:teuthology.orchestra.run.smithi163.stdout:(29/139): ceph-mgr-diskprediction-local-19.1.1- 18 MB/s | 7.4 MB 00:00 2024-09-12T22:29:36.278 INFO:teuthology.orchestra.run.smithi019.stdout:(32/139): ceph-prometheus-alerts-19.1.1-314.g08 246 kB/s | 16 kB 00:00 2024-09-12T22:29:36.289 INFO:teuthology.orchestra.run.smithi076.stdout:(16/139): libradosstriper1-19.1.1-314.g086c737f 2.7 MB/s | 506 kB 00:00 2024-09-12T22:29:36.301 INFO:teuthology.orchestra.run.smithi163.stdout:(30/139): ceph-mgr-modules-core-19.1.1-314.g086 3.3 MB/s | 249 kB 00:00 2024-09-12T22:29:36.364 INFO:teuthology.orchestra.run.smithi076.stdout:(17/139): python3-ceph-argparse-19.1.1-314.g086 603 kB/s | 45 kB 00:00 2024-09-12T22:29:36.393 INFO:teuthology.orchestra.run.smithi163.stdout:(31/139): ceph-mgr-rook-19.1.1-314.g086c737f.el 537 kB/s | 49 kB 00:00 2024-09-12T22:29:36.395 INFO:teuthology.orchestra.run.smithi019.stdout:(33/139): ceph-volume-19.1.1-314.g086c737f.el9. 2.4 MB/s | 285 kB 00:00 2024-09-12T22:29:36.431 INFO:teuthology.orchestra.run.smithi076.stdout:(18/139): python3-ceph-common-19.1.1-314.g086c7 2.0 MB/s | 136 kB 00:00 2024-09-12T22:29:36.460 INFO:teuthology.orchestra.run.smithi163.stdout:(32/139): ceph-prometheus-alerts-19.1.1-314.g08 247 kB/s | 16 kB 00:00 2024-09-12T22:29:36.514 INFO:teuthology.orchestra.run.smithi076.stdout:(19/139): python3-cephfs-19.1.1-314.g086c737f.e 1.9 MB/s | 162 kB 00:00 2024-09-12T22:29:36.543 INFO:teuthology.orchestra.run.smithi163.stdout:(33/139): ceph-volume-19.1.1-314.g086c737f.el9. 3.4 MB/s | 285 kB 00:00 2024-09-12T22:29:36.587 INFO:teuthology.orchestra.run.smithi019.stdout:(34/139): cephadm-19.1.1-314.g086c737f.el9.noar 3.9 MB/s | 765 kB 00:00 2024-09-12T22:29:36.632 INFO:teuthology.orchestra.run.smithi076.stdout:(20/139): python3-rados-19.1.1-314.g086c737f.el 2.7 MB/s | 320 kB 00:00 2024-09-12T22:29:36.635 INFO:teuthology.orchestra.run.smithi163.stdout:(34/139): cephadm-19.1.1-314.g086c737f.el9.noar 8.1 MB/s | 765 kB 00:00 2024-09-12T22:29:36.695 INFO:teuthology.orchestra.run.smithi019.stdout:(35/139): ceph-mgr-diskprediction-local-19.1.1- 9.6 MB/s | 7.4 MB 00:00 2024-09-12T22:29:36.723 INFO:teuthology.orchestra.run.smithi076.stdout:(21/139): python3-rbd-19.1.1-314.g086c737f.el9. 3.2 MB/s | 301 kB 00:00 2024-09-12T22:29:36.762 INFO:teuthology.orchestra.run.smithi019.stdout:(36/139): ceph-mgr-dashboard-19.1.1-314.g086c73 4.1 MB/s | 3.6 MB 00:00 2024-09-12T22:29:36.781 INFO:teuthology.orchestra.run.smithi076.stdout:(22/139): python3-rgw-19.1.1-314.g086c737f.el9. 1.7 MB/s | 99 kB 00:00 2024-09-12T22:29:36.785 INFO:teuthology.orchestra.run.smithi163.stdout:(35/139): fuse-2.9.9-16.el9.x86_64.rpm 532 kB/s | 80 kB 00:00 2024-09-12T22:29:36.788 INFO:teuthology.orchestra.run.smithi019.stdout:(37/139): fuse-2.9.9-16.el9.x86_64.rpm 398 kB/s | 80 kB 00:00 2024-09-12T22:29:36.841 INFO:teuthology.orchestra.run.smithi076.stdout:(23/139): rbd-fuse-19.1.1-314.g086c737f.el9.x86 1.4 MB/s | 85 kB 00:00 2024-09-12T22:29:36.871 INFO:teuthology.orchestra.run.smithi019.stdout:(38/139): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.0 MB/s | 253 kB 00:00 2024-09-12T22:29:36.897 INFO:teuthology.orchestra.run.smithi019.stdout:(39/139): libquadmath-11.5.0-2.el9.x86_64.rpm 1.4 MB/s | 191 kB 00:00 2024-09-12T22:29:36.947 INFO:teuthology.orchestra.run.smithi019.stdout:(40/139): libgfortran-11.5.0-2.el9.x86_64.rpm 3.1 MB/s | 801 kB 00:00 2024-09-12T22:29:36.972 INFO:teuthology.orchestra.run.smithi019.stdout:(41/139): python3-ply-3.11-14.el9.noarch.rpm 1.4 MB/s | 106 kB 00:00 2024-09-12T22:29:36.977 INFO:teuthology.orchestra.run.smithi163.stdout:(36/139): libgfortran-11.5.0-2.el9.x86_64.rpm 4.1 MB/s | 801 kB 00:00 2024-09-12T22:29:36.997 INFO:teuthology.orchestra.run.smithi019.stdout:(42/139): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-09-12T22:29:37.023 INFO:teuthology.orchestra.run.smithi019.stdout:(43/139): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-09-12T22:29:37.023 INFO:teuthology.orchestra.run.smithi148.stdout:(29/139): ceph-osd-19.1.1-314.g086c737f.el9.x86 2.4 MB/s | 17 MB 00:06 2024-09-12T22:29:37.048 INFO:teuthology.orchestra.run.smithi019.stdout:(44/139): python3-urllib3-1.26.5-6.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-09-12T22:29:37.061 INFO:teuthology.orchestra.run.smithi163.stdout:(37/139): libquadmath-11.5.0-2.el9.x86_64.rpm 2.2 MB/s | 191 kB 00:00 2024-09-12T22:29:37.082 INFO:teuthology.orchestra.run.smithi019.stdout:(45/139): python3-cryptography-36.0.1-4.el9.x86 5.8 MB/s | 1.2 MB 00:00 2024-09-12T22:29:37.115 INFO:teuthology.orchestra.run.smithi148.stdout:(30/139): ceph-mgr-diskprediction-local-19.1.1- 7.4 MB/s | 7.4 MB 00:01 2024-09-12T22:29:37.115 INFO:teuthology.orchestra.run.smithi019.stdout:(46/139): automake-1.16.2-8.el9.noarch.rpm 7.3 MB/s | 689 kB 00:00 2024-09-12T22:29:37.140 INFO:teuthology.orchestra.run.smithi148.stdout:(31/139): ceph-mgr-modules-core-19.1.1-314.g086 2.1 MB/s | 249 kB 00:00 2024-09-12T22:29:37.141 INFO:teuthology.orchestra.run.smithi019.stdout:(47/139): boost-program-options-1.75.0-8.el9.x8 1.8 MB/s | 107 kB 00:00 2024-09-12T22:29:37.145 INFO:teuthology.orchestra.run.smithi163.stdout:(38/139): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.0 MB/s | 253 kB 00:00 2024-09-12T22:29:37.166 INFO:teuthology.orchestra.run.smithi019.stdout:(48/139): elfutils-libelf-devel-0.191-4.el9.x86 433 kB/s | 22 kB 00:00 2024-09-12T22:29:37.167 INFO:teuthology.orchestra.run.smithi148.stdout:(32/139): ceph-mgr-rook-19.1.1-314.g086c737f.el 943 kB/s | 49 kB 00:00 2024-09-12T22:29:37.193 INFO:teuthology.orchestra.run.smithi148.stdout:(33/139): ceph-prometheus-alerts-19.1.1-314.g08 313 kB/s | 16 kB 00:00 2024-09-12T22:29:37.199 INFO:teuthology.orchestra.run.smithi019.stdout:(49/139): flex-2.6.4-9.el9.x86_64.rpm 5.3 MB/s | 313 kB 00:00 2024-09-12T22:29:37.227 INFO:teuthology.orchestra.run.smithi148.stdout:(34/139): ceph-volume-19.1.1-314.g086c737f.el9. 4.7 MB/s | 285 kB 00:00 2024-09-12T22:29:37.233 INFO:teuthology.orchestra.run.smithi019.stdout:(50/139): bison-3.7.4-5.el9.x86_64.rpm 5.0 MB/s | 943 kB 00:00 2024-09-12T22:29:37.241 INFO:teuthology.orchestra.run.smithi076.stdout:(24/139): librgw2-19.1.1-314.g086c737f.el9.x86_ 4.8 MB/s | 5.3 MB 00:01 2024-09-12T22:29:37.258 INFO:teuthology.orchestra.run.smithi019.stdout:(51/139): flexiblas-3.0.4-8.el9.x86_64.rpm 355 kB/s | 33 kB 00:00 2024-09-12T22:29:37.300 INFO:teuthology.orchestra.run.smithi076.stdout:(25/139): rbd-mirror-19.1.1-314.g086c737f.el9.x 6.8 MB/s | 3.1 MB 00:00 2024-09-12T22:29:37.300 INFO:teuthology.orchestra.run.smithi019.stdout:(52/139): libaio-devel-0.3.111-13.el9.x86_64.rp 269 kB/s | 11 kB 00:00 2024-09-12T22:29:37.325 INFO:teuthology.orchestra.run.smithi076.stdout:(26/139): rbd-nbd-19.1.1-314.g086c737f.el9.x86_ 2.0 MB/s | 171 kB 00:00 2024-09-12T22:29:37.327 INFO:teuthology.orchestra.run.smithi148.stdout:(35/139): fuse-2.9.9-16.el9.x86_64.rpm 800 kB/s | 80 kB 00:00 2024-09-12T22:29:37.350 INFO:teuthology.orchestra.run.smithi076.stdout:(27/139): ceph-grafana-dashboards-19.1.1-314.g0 635 kB/s | 32 kB 00:00 2024-09-12T22:29:37.369 INFO:teuthology.orchestra.run.smithi148.stdout:(36/139): cephadm-19.1.1-314.g086c737f.el9.noar 4.3 MB/s | 765 kB 00:00 2024-09-12T22:29:37.373 INFO:teuthology.orchestra.run.smithi163.stdout:(39/139): python3-cryptography-36.0.1-4.el9.x86 5.5 MB/s | 1.2 MB 00:00 2024-09-12T22:29:37.375 INFO:teuthology.orchestra.run.smithi076.stdout:(28/139): ceph-mgr-cephadm-19.1.1-314.g086c737f 2.8 MB/s | 146 kB 00:00 2024-09-12T22:29:37.420 INFO:teuthology.orchestra.run.smithi163.stdout:(40/139): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-09-12T22:29:37.442 INFO:teuthology.orchestra.run.smithi019.stdout:(53/139): flexiblas-openblas-openmp-3.0.4-8.el9 99 kB/s | 18 kB 00:00 2024-09-12T22:29:37.461 INFO:teuthology.orchestra.run.smithi148.stdout:(37/139): libgfortran-11.5.0-2.el9.x86_64.rpm 5.9 MB/s | 801 kB 00:00 2024-09-12T22:29:37.467 INFO:teuthology.orchestra.run.smithi019.stdout:(54/139): libpmemobj-1.12.1-1.el9.x86_64.rpm 959 kB/s | 160 kB 00:00 2024-09-12T22:29:37.470 INFO:teuthology.orchestra.run.smithi163.stdout:(41/139): python3-pycparser-2.20-6.el9.noarch.r 2.7 MB/s | 135 kB 00:00 2024-09-12T22:29:37.492 INFO:teuthology.orchestra.run.smithi019.stdout:(55/139): librabbitmq-0.11.0-7.el9.x86_64.rpm 904 kB/s | 45 kB 00:00 2024-09-12T22:29:37.502 INFO:teuthology.orchestra.run.smithi148.stdout:(38/139): python3-cffi-1.14.5-5.el9.x86_64.rpm 5.9 MB/s | 253 kB 00:00 2024-09-12T22:29:37.526 INFO:teuthology.orchestra.run.smithi019.stdout:(56/139): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 662 kB 00:00 2024-09-12T22:29:37.528 INFO:teuthology.orchestra.run.smithi148.stdout:(39/139): libquadmath-11.5.0-2.el9.x86_64.rpm 1.2 MB/s | 191 kB 00:00 2024-09-12T22:29:37.529 INFO:teuthology.orchestra.run.smithi163.stdout:(42/139): python3-requests-2.25.1-8.el9.noarch. 2.1 MB/s | 125 kB 00:00 2024-09-12T22:29:37.570 INFO:teuthology.orchestra.run.smithi148.stdout:(40/139): python3-cryptography-36.0.1-4.el9.x86 18 MB/s | 1.2 MB 00:00 2024-09-12T22:29:37.577 INFO:teuthology.orchestra.run.smithi019.stdout:(57/139): flexiblas-netlib-3.0.4-8.el9.x86_64.r 7.9 MB/s | 3.0 MB 00:00 2024-09-12T22:29:37.595 INFO:teuthology.orchestra.run.smithi148.stdout:(41/139): python3-ply-3.11-14.el9.noarch.rpm 1.6 MB/s | 106 kB 00:00 2024-09-12T22:29:37.602 INFO:teuthology.orchestra.run.smithi019.stdout:(58/139): libuuid-devel-2.37.4-20.el9.x86_64.rp 325 kB/s | 24 kB 00:00 2024-09-12T22:29:37.605 INFO:teuthology.orchestra.run.smithi163.stdout:(43/139): python3-urllib3-1.26.5-6.el9.noarch.r 2.8 MB/s | 215 kB 00:00 2024-09-12T22:29:37.620 INFO:teuthology.orchestra.run.smithi148.stdout:(42/139): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-09-12T22:29:37.627 INFO:teuthology.orchestra.run.smithi019.stdout:(59/139): libzstd-devel-1.5.1-2.el9.x86_64.rpm 947 kB/s | 47 kB 00:00 2024-09-12T22:29:37.647 INFO:teuthology.orchestra.run.smithi148.stdout:(43/139): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-09-12T22:29:37.652 INFO:teuthology.orchestra.run.smithi019.stdout:(60/139): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.7 MB/s | 292 kB 00:00 2024-09-12T22:29:37.671 INFO:teuthology.orchestra.run.smithi148.stdout:(44/139): python3-urllib3-1.26.5-6.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-09-12T22:29:37.686 INFO:teuthology.orchestra.run.smithi019.stdout:(61/139): libtool-2.4.6-46.el9.x86_64.rpm 2.9 MB/s | 581 kB 00:00 2024-09-12T22:29:37.703 INFO:teuthology.orchestra.run.smithi019.stdout:(62/139): openblas-0.3.26-2.el9.x86_64.rpm 765 kB/s | 38 kB 00:00 2024-09-12T22:29:37.721 INFO:teuthology.orchestra.run.smithi148.stdout:(45/139): bison-3.7.4-5.el9.x86_64.rpm 18 MB/s | 943 kB 00:00 2024-09-12T22:29:37.728 INFO:teuthology.orchestra.run.smithi019.stdout:(63/139): lua-5.4.4-4.el9.x86_64.rpm 1.8 MB/s | 188 kB 00:00 2024-09-12T22:29:37.755 INFO:teuthology.orchestra.run.smithi148.stdout:(46/139): automake-1.16.2-8.el9.noarch.rpm 6.2 MB/s | 689 kB 00:00 2024-09-12T22:29:37.780 INFO:teuthology.orchestra.run.smithi148.stdout:(47/139): boost-program-options-1.75.0-8.el9.x8 1.8 MB/s | 107 kB 00:00 2024-09-12T22:29:37.784 INFO:teuthology.orchestra.run.smithi076.stdout:(29/139): ceph-mgr-dashboard-19.1.1-314.g086c73 8.2 MB/s | 3.6 MB 00:00 2024-09-12T22:29:37.787 INFO:teuthology.orchestra.run.smithi019.stdout:(64/139): protobuf-3.14.0-13.el9.x86_64.rpm 17 MB/s | 1.0 MB 00:00 2024-09-12T22:29:37.797 INFO:teuthology.orchestra.run.smithi148.stdout:(48/139): elfutils-libelf-devel-0.191-4.el9.x86 519 kB/s | 22 kB 00:00 2024-09-12T22:29:37.831 INFO:teuthology.orchestra.run.smithi148.stdout:(49/139): flex-2.6.4-9.el9.x86_64.rpm 6.1 MB/s | 313 kB 00:00 2024-09-12T22:29:37.851 INFO:teuthology.orchestra.run.smithi076.stdout:(30/139): ceph-mgr-modules-core-19.1.1-314.g086 3.7 MB/s | 249 kB 00:00 2024-09-12T22:29:37.856 INFO:teuthology.orchestra.run.smithi148.stdout:(50/139): flexiblas-3.0.4-8.el9.x86_64.rpm 557 kB/s | 33 kB 00:00 2024-09-12T22:29:37.862 INFO:teuthology.orchestra.run.smithi019.stdout:(65/139): openssl-devel-3.2.2-6.el9.x86_64.rpm 28 MB/s | 4.4 MB 00:00 2024-09-12T22:29:37.893 INFO:teuthology.orchestra.run.smithi076.stdout:(31/139): ceph-mgr-rook-19.1.1-314.g086c737f.el 1.2 MB/s | 49 kB 00:00 2024-09-12T22:29:37.898 INFO:teuthology.orchestra.run.smithi148.stdout:(51/139): flexiblas-openblas-openmp-3.0.4-8.el9 438 kB/s | 18 kB 00:00 2024-09-12T22:29:37.935 INFO:teuthology.orchestra.run.smithi076.stdout:(32/139): ceph-prometheus-alerts-19.1.1-314.g08 394 kB/s | 16 kB 00:00 2024-09-12T22:29:37.946 INFO:teuthology.orchestra.run.smithi019.stdout:(66/139): openblas-openmp-0.3.26-2.el9.x86_64.r 19 MB/s | 4.9 MB 00:00 2024-09-12T22:29:37.948 INFO:teuthology.orchestra.run.smithi148.stdout:(52/139): flexiblas-netlib-3.0.4-8.el9.x86_64.r 26 MB/s | 3.0 MB 00:00 2024-09-12T22:29:37.971 INFO:teuthology.orchestra.run.smithi019.stdout:(67/139): python3-devel-3.9.19-8.el9.x86_64.rpm 2.2 MB/s | 245 kB 00:00 2024-09-12T22:29:37.973 INFO:teuthology.orchestra.run.smithi148.stdout:(53/139): libaio-devel-0.3.111-13.el9.x86_64.rp 148 kB/s | 11 kB 00:00 2024-09-12T22:29:37.996 INFO:teuthology.orchestra.run.smithi019.stdout:(68/139): python3-jinja2-2.11.3-6.el9.noarch.rp 4.9 MB/s | 248 kB 00:00 2024-09-12T22:29:37.999 INFO:teuthology.orchestra.run.smithi148.stdout:(54/139): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-09-12T22:29:38.002 INFO:teuthology.orchestra.run.smithi076.stdout:(33/139): ceph-volume-19.1.1-314.g086c737f.el9. 4.2 MB/s | 285 kB 00:00 2024-09-12T22:29:38.021 INFO:teuthology.orchestra.run.smithi019.stdout:(69/139): python3-jsonpatch-1.21-16.el9.noarch. 511 kB/s | 26 kB 00:00 2024-09-12T22:29:38.024 INFO:teuthology.orchestra.run.smithi148.stdout:(55/139): librabbitmq-0.11.0-7.el9.x86_64.rpm 901 kB/s | 45 kB 00:00 2024-09-12T22:29:38.047 INFO:teuthology.orchestra.run.smithi019.stdout:(70/139): python3-jsonpointer-2.0-4.el9.noarch. 382 kB/s | 19 kB 00:00 2024-09-12T22:29:38.066 INFO:teuthology.orchestra.run.smithi148.stdout:(56/139): librdkafka-1.6.1-102.el9.x86_64.rpm 9.7 MB/s | 662 kB 00:00 2024-09-12T22:29:38.072 INFO:teuthology.orchestra.run.smithi019.stdout:(71/139): python3-mako-1.1.4-6.el9.noarch.rpm 3.3 MB/s | 172 kB 00:00 2024-09-12T22:29:38.097 INFO:teuthology.orchestra.run.smithi019.stdout:(72/139): python3-markupsafe-1.1.1-12.el9.x86_6 695 kB/s | 35 kB 00:00 2024-09-12T22:29:38.099 INFO:teuthology.orchestra.run.smithi148.stdout:(57/139): libtool-2.4.6-46.el9.x86_64.rpm 7.5 MB/s | 581 kB 00:00 2024-09-12T22:29:38.119 INFO:teuthology.orchestra.run.smithi076.stdout:(34/139): cephadm-19.1.1-314.g086c737f.el9.noar 6.4 MB/s | 765 kB 00:00 2024-09-12T22:29:38.125 INFO:teuthology.orchestra.run.smithi148.stdout:(58/139): libuuid-devel-2.37.4-20.el9.x86_64.rp 420 kB/s | 24 kB 00:00 2024-09-12T22:29:38.148 INFO:teuthology.orchestra.run.smithi019.stdout:(73/139): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.9 MB/s | 250 kB 00:00 2024-09-12T22:29:38.150 INFO:teuthology.orchestra.run.smithi148.stdout:(59/139): libzstd-devel-1.5.1-2.el9.x86_64.rpm 944 kB/s | 47 kB 00:00 2024-09-12T22:29:38.175 INFO:teuthology.orchestra.run.smithi148.stdout:(60/139): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.7 MB/s | 292 kB 00:00 2024-09-12T22:29:38.201 INFO:teuthology.orchestra.run.smithi148.stdout:(61/139): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 188 kB 00:00 2024-09-12T22:29:38.226 INFO:teuthology.orchestra.run.smithi148.stdout:(62/139): openblas-0.3.26-2.el9.x86_64.rpm 764 kB/s | 38 kB 00:00 2024-09-12T22:29:38.231 INFO:teuthology.orchestra.run.smithi019.stdout:(74/139): python3-babel-2.9.1-2.el9.noarch.rpm 13 MB/s | 6.0 MB 00:00 2024-09-12T22:29:38.252 INFO:teuthology.orchestra.run.smithi076.stdout:(35/139): fuse-2.9.9-16.el9.x86_64.rpm 599 kB/s | 80 kB 00:00 2024-09-12T22:29:38.257 INFO:teuthology.orchestra.run.smithi019.stdout:(75/139): python3-oauthlib-3.1.1-5.el9.noarch.r 2.0 MB/s | 222 kB 00:00 2024-09-12T22:29:38.282 INFO:teuthology.orchestra.run.smithi019.stdout:(76/139): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-09-12T22:29:38.307 INFO:teuthology.orchestra.run.smithi019.stdout:(77/139): python3-prettytable-0.7.2-27.el9.noar 842 kB/s | 42 kB 00:00 2024-09-12T22:29:38.318 INFO:teuthology.orchestra.run.smithi148.stdout:(63/139): openblas-openmp-0.3.26-2.el9.x86_64.r 42 MB/s | 4.9 MB 00:00 2024-09-12T22:29:38.333 INFO:teuthology.orchestra.run.smithi019.stdout:(78/139): python3-protobuf-3.14.0-13.el9.noarch 5.2 MB/s | 269 kB 00:00 2024-09-12T22:29:38.358 INFO:teuthology.orchestra.run.smithi019.stdout:(79/139): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-09-12T22:29:38.378 INFO:teuthology.orchestra.run.smithi076.stdout:(36/139): ceph-mgr-diskprediction-local-19.1.1- 7.4 MB/s | 7.4 MB 00:01 2024-09-12T22:29:38.385 INFO:teuthology.orchestra.run.smithi148.stdout:(64/139): openssl-devel-3.2.2-6.el9.x86_64.rpm 28 MB/s | 4.4 MB 00:00 2024-09-12T22:29:38.419 INFO:teuthology.orchestra.run.smithi148.stdout:(65/139): protobuf-3.14.0-13.el9.x86_64.rpm 10 MB/s | 1.0 MB 00:00 2024-09-12T22:29:38.425 INFO:teuthology.orchestra.run.smithi019.stdout:(80/139): python3-numpy-1.20.1-5.el9.x86_64.rpm 14 MB/s | 5.1 MB 00:00 2024-09-12T22:29:38.450 INFO:teuthology.orchestra.run.smithi019.stdout:(81/139): python3-pytz-2021.1-5.el9.noarch.rpm 554 kB/s | 51 kB 00:00 2024-09-12T22:29:38.461 INFO:teuthology.orchestra.run.smithi148.stdout:(66/139): python3-devel-3.9.19-8.el9.x86_64.rpm 5.7 MB/s | 245 kB 00:00 2024-09-12T22:29:38.470 INFO:teuthology.orchestra.run.smithi076.stdout:(37/139): libgfortran-11.5.0-2.el9.x86_64.rpm 3.6 MB/s | 801 kB 00:00 2024-09-12T22:29:38.476 INFO:teuthology.orchestra.run.smithi019.stdout:(82/139): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-12T22:29:38.517 INFO:teuthology.orchestra.run.smithi019.stdout:(83/139): python3-pyasn1-modules-0.4.8-6.el9.no 1.5 MB/s | 279 kB 00:00 2024-09-12T22:29:38.520 INFO:teuthology.orchestra.run.smithi076.stdout:(38/139): python3-cffi-1.14.5-5.el9.x86_64.rpm 5.0 MB/s | 253 kB 00:00 2024-09-12T22:29:38.536 INFO:teuthology.orchestra.run.smithi148.stdout:(67/139): python3-babel-2.9.1-2.el9.noarch.rpm 40 MB/s | 6.0 MB 00:00 2024-09-12T22:29:38.542 INFO:teuthology.orchestra.run.smithi019.stdout:(84/139): python3-toml-0.10.2-6.el9.noarch.rpm 625 kB/s | 42 kB 00:00 2024-09-12T22:29:38.561 INFO:teuthology.orchestra.run.smithi148.stdout:(68/139): python3-jinja2-2.11.3-6.el9.noarch.rp 2.4 MB/s | 248 kB 00:00 2024-09-12T22:29:38.576 INFO:teuthology.orchestra.run.smithi019.stdout:(85/139): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-09-12T22:29:38.586 INFO:teuthology.orchestra.run.smithi148.stdout:(69/139): python3-jsonpatch-1.21-16.el9.noarch. 511 kB/s | 26 kB 00:00 2024-09-12T22:29:38.601 INFO:teuthology.orchestra.run.smithi019.stdout:(86/139): qatlib-service-24.02.0-1.el9.x86_64.r 613 kB/s | 36 kB 00:00 2024-09-12T22:29:38.612 INFO:teuthology.orchestra.run.smithi148.stdout:(70/139): python3-jsonpointer-2.0-4.el9.noarch. 380 kB/s | 19 kB 00:00 2024-09-12T22:29:38.627 INFO:teuthology.orchestra.run.smithi019.stdout:(87/139): qatzip-libs-1.2.0-1.el9.x86_64.rpm 945 kB/s | 47 kB 00:00 2024-09-12T22:29:38.637 INFO:teuthology.orchestra.run.smithi076.stdout:(39/139): python3-cryptography-36.0.1-4.el9.x86 11 MB/s | 1.2 MB 00:00 2024-09-12T22:29:38.652 INFO:teuthology.orchestra.run.smithi019.stdout:(88/139): socat-1.7.4.1-6.el9.x86_64.rpm 5.9 MB/s | 304 kB 00:00 2024-09-12T22:29:38.662 INFO:teuthology.orchestra.run.smithi076.stdout:(40/139): libquadmath-11.5.0-2.el9.x86_64.rpm 673 kB/s | 191 kB 00:00 2024-09-12T22:29:38.677 INFO:teuthology.orchestra.run.smithi019.stdout:(89/139): xfsprogs-devel-6.4.0-4.el9.x86_64.rpm 1.9 MB/s | 96 kB 00:00 2024-09-12T22:29:38.687 INFO:teuthology.orchestra.run.smithi148.stdout:(71/139): python3-mako-1.1.4-6.el9.noarch.rpm 1.7 MB/s | 172 kB 00:00 2024-09-12T22:29:38.694 INFO:teuthology.orchestra.run.smithi019.stdout:(90/139): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.5 MB/s | 64 kB 00:00 2024-09-12T22:29:38.711 INFO:teuthology.orchestra.run.smithi019.stdout:(91/139): zlib-devel-1.2.11-41.el9.x86_64.rpm 1.3 MB/s | 45 kB 00:00 2024-09-12T22:29:38.712 INFO:teuthology.orchestra.run.smithi076.stdout:(41/139): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-09-12T22:29:38.713 INFO:teuthology.orchestra.run.smithi148.stdout:(72/139): python3-markupsafe-1.1.1-12.el9.x86_6 347 kB/s | 35 kB 00:00 2024-09-12T22:29:38.738 INFO:teuthology.orchestra.run.smithi076.stdout:(42/139): python3-ply-3.11-14.el9.noarch.rpm 1.0 MB/s | 106 kB 00:00 2024-09-12T22:29:38.755 INFO:teuthology.orchestra.run.smithi148.stdout:(73/139): python3-numpy-f2py-1.20.1-5.el9.x86_6 5.9 MB/s | 250 kB 00:00 2024-09-12T22:29:38.763 INFO:teuthology.orchestra.run.smithi076.stdout:(43/139): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-09-12T22:29:38.797 INFO:teuthology.orchestra.run.smithi076.stdout:(44/139): python3-urllib3-1.26.5-6.el9.noarch.r 3.6 MB/s | 215 kB 00:00 2024-09-12T22:29:38.822 INFO:teuthology.orchestra.run.smithi163.stdout:(44/139): ceph-common-19.1.1-314.g086c737f.el9. 2.0 MB/s | 21 MB 00:10 2024-09-12T22:29:38.822 INFO:teuthology.orchestra.run.smithi148.stdout:(74/139): python3-numpy-1.20.1-5.el9.x86_64.rpm 38 MB/s | 5.1 MB 00:00 2024-09-12T22:29:38.847 INFO:teuthology.orchestra.run.smithi148.stdout:(75/139): python3-oauthlib-3.1.1-5.el9.noarch.r 2.4 MB/s | 222 kB 00:00 2024-09-12T22:29:38.872 INFO:teuthology.orchestra.run.smithi148.stdout:(76/139): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-09-12T22:29:38.897 INFO:teuthology.orchestra.run.smithi148.stdout:(77/139): python3-prettytable-0.7.2-27.el9.noar 842 kB/s | 42 kB 00:00 2024-09-12T22:29:38.923 INFO:teuthology.orchestra.run.smithi148.stdout:(78/139): python3-protobuf-3.14.0-13.el9.noarch 5.2 MB/s | 269 kB 00:00 2024-09-12T22:29:38.937 INFO:teuthology.orchestra.run.smithi019.stdout:(92/139): python3-scipy-1.6.2-8.el9.x86_64.rpm 33 MB/s | 16 MB 00:00 2024-09-12T22:29:38.947 INFO:teuthology.orchestra.run.smithi148.stdout:(79/139): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-09-12T22:29:38.973 INFO:teuthology.orchestra.run.smithi148.stdout:(80/139): python3-pyasn1-modules-0.4.8-6.el9.no 5.4 MB/s | 279 kB 00:00 2024-09-12T22:29:38.995 INFO:teuthology.orchestra.run.smithi019.stdout:(93/139): abseil-cpp-20211102.0-3.el9.x86_64.rp 9.2 MB/s | 548 kB 00:00 2024-09-12T22:29:38.998 INFO:teuthology.orchestra.run.smithi148.stdout:(81/139): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-12T22:29:39.023 INFO:teuthology.orchestra.run.smithi148.stdout:(82/139): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-12T22:29:39.029 INFO:teuthology.orchestra.run.smithi019.stdout:(94/139): gperftools-libs-2.9.1-3.el9.x86_64.rp 9.0 MB/s | 308 kB 00:00 2024-09-12T22:29:39.054 INFO:teuthology.orchestra.run.smithi019.stdout:(95/139): grpc-data-1.46.7-10.el9.noarch.rpm 1.1 MB/s | 19 kB 00:00 2024-09-12T22:29:39.057 INFO:teuthology.orchestra.run.smithi148.stdout:(83/139): python3-toml-0.10.2-6.el9.noarch.rpm 1.2 MB/s | 42 kB 00:00 2024-09-12T22:29:39.099 INFO:teuthology.orchestra.run.smithi148.stdout:(84/139): qatlib-24.02.0-1.el9.x86_64.rpm 5.2 MB/s | 221 kB 00:00 2024-09-12T22:29:39.133 INFO:teuthology.orchestra.run.smithi148.stdout:(85/139): qatlib-service-24.02.0-1.el9.x86_64.r 1.1 MB/s | 36 kB 00:00 2024-09-12T22:29:39.166 INFO:teuthology.orchestra.run.smithi148.stdout:(86/139): qatzip-libs-1.2.0-1.el9.x86_64.rpm 1.4 MB/s | 47 kB 00:00 2024-09-12T22:29:39.288 INFO:teuthology.orchestra.run.smithi019.stdout:(96/139): libarrow-9.0.0-11.el9.x86_64.rpm 19 MB/s | 4.4 MB 00:00 2024-09-12T22:29:39.321 INFO:teuthology.orchestra.run.smithi019.stdout:(97/139): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-12T22:29:39.333 INFO:teuthology.orchestra.run.smithi148.stdout:(87/139): python3-scipy-1.6.2-8.el9.x86_64.rpm 49 MB/s | 16 MB 00:00 2024-09-12T22:29:39.346 INFO:teuthology.orchestra.run.smithi019.stdout:(98/139): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-12T22:29:39.358 INFO:teuthology.orchestra.run.smithi148.stdout:(88/139): socat-1.7.4.1-6.el9.x86_64.rpm 1.5 MB/s | 304 kB 00:00 2024-09-12T22:29:39.372 INFO:teuthology.orchestra.run.smithi019.stdout:(99/139): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-12T22:29:39.384 INFO:teuthology.orchestra.run.smithi148.stdout:(89/139): xfsprogs-devel-6.4.0-4.el9.x86_64.rpm 1.9 MB/s | 96 kB 00:00 2024-09-12T22:29:39.397 INFO:teuthology.orchestra.run.smithi019.stdout:(100/139): luarocks-3.9.2-5.el9.noarch.rpm 6.0 MB/s | 151 kB 00:00 2024-09-12T22:29:39.409 INFO:teuthology.orchestra.run.smithi148.stdout:(90/139): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-12T22:29:39.430 INFO:teuthology.orchestra.run.smithi019.stdout:(101/139): parquet-libs-9.0.0-11.el9.x86_64.rpm 25 MB/s | 839 kB 00:00 2024-09-12T22:29:39.434 INFO:teuthology.orchestra.run.smithi148.stdout:(91/139): zlib-devel-1.2.11-41.el9.x86_64.rpm 891 kB/s | 45 kB 00:00 2024-09-12T22:29:39.472 INFO:teuthology.orchestra.run.smithi019.stdout:(102/139): python3-asyncssh-2.13.2-5.el9.noarch 13 MB/s | 548 kB 00:00 2024-09-12T22:29:39.498 INFO:teuthology.orchestra.run.smithi019.stdout:(103/139): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-12T22:29:39.505 INFO:teuthology.orchestra.run.smithi076.stdout:(45/139): automake-1.16.2-8.el9.noarch.rpm 929 kB/s | 689 kB 00:00 2024-09-12T22:29:39.523 INFO:teuthology.orchestra.run.smithi019.stdout:(104/139): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-12T22:29:39.526 INFO:teuthology.orchestra.run.smithi148.stdout:(92/139): lua-devel-5.4.4-4.el9.x86_64.rpm 190 kB/s | 22 kB 00:00 2024-09-12T22:29:39.548 INFO:teuthology.orchestra.run.smithi019.stdout:(105/139): lua-devel-5.4.4-4.el9.x86_64.rpm 26 kB/s | 22 kB 00:00 2024-09-12T22:29:39.574 INFO:teuthology.orchestra.run.smithi019.stdout:(106/139): python3-certifi-2023.05.07-4.el9.noa 287 kB/s | 14 kB 00:00 2024-09-12T22:29:39.577 INFO:teuthology.orchestra.run.smithi148.stdout:(93/139): abseil-cpp-20211102.0-3.el9.x86_64.rp 11 MB/s | 548 kB 00:00 2024-09-12T22:29:39.602 INFO:teuthology.orchestra.run.smithi148.stdout:(94/139): gperftools-libs-2.9.1-3.el9.x86_64.rp 12 MB/s | 308 kB 00:00 2024-09-12T22:29:39.616 INFO:teuthology.orchestra.run.smithi019.stdout:(107/139): python3-cherrypy-18.6.1-2.el9.noarch 10 MB/s | 358 kB 00:00 2024-09-12T22:29:39.628 INFO:teuthology.orchestra.run.smithi148.stdout:(95/139): grpc-data-1.46.7-10.el9.noarch.rpm 784 kB/s | 19 kB 00:00 2024-09-12T22:29:39.639 INFO:teuthology.orchestra.run.smithi076.stdout:(46/139): bison-3.7.4-5.el9.x86_64.rpm 1.1 MB/s | 943 kB 00:00 2024-09-12T22:29:39.649 INFO:teuthology.orchestra.run.smithi019.stdout:(108/139): python3-google-auth-2.34.0-1.el9.noa 6.9 MB/s | 220 kB 00:00 2024-09-12T22:29:39.664 INFO:teuthology.orchestra.run.smithi076.stdout:(47/139): boost-program-options-1.75.0-8.el9.x8 675 kB/s | 107 kB 00:00 2024-09-12T22:29:39.675 INFO:teuthology.orchestra.run.smithi019.stdout:(109/139): python3-cheroot-8.6.0-4.el9.noarch.r 1.3 MB/s | 172 kB 00:00 2024-09-12T22:29:39.708 INFO:teuthology.orchestra.run.smithi019.stdout:(110/139): python3-grpcio-tools-1.46.7-10.el9.x 4.3 MB/s | 144 kB 00:00 2024-09-12T22:29:39.734 INFO:teuthology.orchestra.run.smithi019.stdout:(111/139): python3-jaraco-8.2.1-3.el9.noarch.rp 427 kB/s | 11 kB 00:00 2024-09-12T22:29:39.736 INFO:teuthology.orchestra.run.smithi148.stdout:(96/139): libarrow-9.0.0-11.el9.x86_64.rpm 41 MB/s | 4.4 MB 00:00 2024-09-12T22:29:39.760 INFO:teuthology.orchestra.run.smithi019.stdout:(112/139): python3-jaraco-classes-3.2.1-5.el9.n 711 kB/s | 18 kB 00:00 2024-09-12T22:29:39.761 INFO:teuthology.orchestra.run.smithi148.stdout:(97/139): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-12T22:29:39.773 INFO:teuthology.orchestra.run.smithi076.stdout:(48/139): elfutils-libelf-devel-0.191-4.el9.x86 162 kB/s | 22 kB 00:00 2024-09-12T22:29:39.784 INFO:teuthology.orchestra.run.smithi019.stdout:(113/139): python3-jaraco-collections-3.0.0-8.e 933 kB/s | 23 kB 00:00 2024-09-12T22:29:39.795 INFO:teuthology.orchestra.run.smithi148.stdout:(98/139): protobuf-compiler-3.14.0-13.el9.x86_6 2.3 MB/s | 863 kB 00:00 2024-09-12T22:29:39.798 INFO:teuthology.orchestra.run.smithi076.stdout:(49/139): flex-2.6.4-9.el9.x86_64.rpm 2.3 MB/s | 313 kB 00:00 2024-09-12T22:29:39.809 INFO:teuthology.orchestra.run.smithi019.stdout:(114/139): python3-jaraco-functools-3.5.0-2.el9 785 kB/s | 19 kB 00:00 2024-09-12T22:29:39.820 INFO:teuthology.orchestra.run.smithi148.stdout:(99/139): liboath-2.6.7-2.el9.x86_64.rpm 830 kB/s | 49 kB 00:00 2024-09-12T22:29:39.836 INFO:teuthology.orchestra.run.smithi019.stdout:(115/139): python3-jaraco-text-3.2.0-6.el9.noar 789 kB/s | 20 kB 00:00 2024-09-12T22:29:39.854 INFO:teuthology.orchestra.run.smithi148.stdout:(100/139): luarocks-3.9.2-5.el9.noarch.rpm 5.7 MB/s | 151 kB 00:00 2024-09-12T22:29:39.887 INFO:teuthology.orchestra.run.smithi148.stdout:(101/139): libunwind-1.6.2-1.el9.x86_64.rpm 733 kB/s | 67 kB 00:00 2024-09-12T22:29:39.898 INFO:teuthology.orchestra.run.smithi076.stdout:(50/139): flexiblas-3.0.4-8.el9.x86_64.rpm 261 kB/s | 33 kB 00:00 2024-09-12T22:29:39.929 INFO:teuthology.orchestra.run.smithi148.stdout:(102/139): parquet-libs-9.0.0-11.el9.x86_64.rpm 11 MB/s | 839 kB 00:00 2024-09-12T22:29:39.952 INFO:teuthology.orchestra.run.smithi019.stdout:(116/139): python3-grpcio-1.46.7-10.el9.x86_64. 6.7 MB/s | 2.0 MB 00:00 2024-09-12T22:29:39.954 INFO:teuthology.orchestra.run.smithi148.stdout:(103/139): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-12T22:29:39.977 INFO:teuthology.orchestra.run.smithi019.stdout:(117/139): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-12T22:29:39.988 INFO:teuthology.orchestra.run.smithi148.stdout:(104/139): python3-asyncssh-2.13.2-5.el9.noarch 5.3 MB/s | 548 kB 00:00 2024-09-12T22:29:40.002 INFO:teuthology.orchestra.run.smithi019.stdout:(118/139): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-12T22:29:40.014 INFO:teuthology.orchestra.run.smithi148.stdout:(105/139): python3-cachetools-4.2.4-1.el9.noarc 549 kB/s | 32 kB 00:00 2024-09-12T22:29:40.036 INFO:teuthology.orchestra.run.smithi019.stdout:(119/139): python3-natsort-7.1.1-5.el9.noarch.r 1.7 MB/s | 58 kB 00:00 2024-09-12T22:29:40.040 INFO:teuthology.orchestra.run.smithi148.stdout:(106/139): python3-certifi-2023.05.07-4.el9.noa 280 kB/s | 14 kB 00:00 2024-09-12T22:29:40.064 INFO:teuthology.orchestra.run.smithi148.stdout:(107/139): python3-cheroot-8.6.0-4.el9.noarch.r 3.4 MB/s | 172 kB 00:00 2024-09-12T22:29:40.078 INFO:teuthology.orchestra.run.smithi019.stdout:(120/139): python3-kubernetes-26.1.0-2.el9.noar 4.2 MB/s | 1.0 MB 00:00 2024-09-12T22:29:40.089 INFO:teuthology.orchestra.run.smithi148.stdout:(108/139): python3-cherrypy-18.6.1-2.el9.noarch 7.0 MB/s | 358 kB 00:00 2024-09-12T22:29:40.103 INFO:teuthology.orchestra.run.smithi019.stdout:(121/139): python3-portend-3.1.0-2.el9.noarch.r 660 kB/s | 16 kB 00:00 2024-09-12T22:29:40.114 INFO:teuthology.orchestra.run.smithi148.stdout:(109/139): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-12T22:29:40.129 INFO:teuthology.orchestra.run.smithi019.stdout:(122/139): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-09-12T22:29:40.148 INFO:teuthology.orchestra.run.smithi148.stdout:(110/139): python3-grpcio-tools-1.46.7-10.el9.x 4.3 MB/s | 144 kB 00:00 2024-09-12T22:29:40.154 INFO:teuthology.orchestra.run.smithi019.stdout:(123/139): python3-pecan-1.4.2-3.el9.noarch.rpm 2.3 MB/s | 272 kB 00:00 2024-09-12T22:29:40.172 INFO:teuthology.orchestra.run.smithi163.stdout:(45/139): automake-1.16.2-8.el9.noarch.rpm 268 kB/s | 689 kB 00:02 2024-09-12T22:29:40.179 INFO:teuthology.orchestra.run.smithi019.stdout:(124/139): python3-repoze-lru-0.7-16.el9.noarch 614 kB/s | 31 kB 00:00 2024-09-12T22:29:40.205 INFO:teuthology.orchestra.run.smithi019.stdout:(125/139): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-12T22:29:40.230 INFO:teuthology.orchestra.run.smithi019.stdout:(126/139): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-09-12T22:29:40.255 INFO:teuthology.orchestra.run.smithi019.stdout:(127/139): python3-tempora-5.0.0-2.el9.noarch.r 715 kB/s | 36 kB 00:00 2024-09-12T22:29:40.280 INFO:teuthology.orchestra.run.smithi019.stdout:(128/139): python3-typing-extensions-4.12.2-2.e 1.5 MB/s | 74 kB 00:00 2024-09-12T22:29:40.305 INFO:teuthology.orchestra.run.smithi019.stdout:(129/139): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-12T22:29:40.331 INFO:teuthology.orchestra.run.smithi019.stdout:(130/139): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-09-12T22:29:40.332 INFO:teuthology.orchestra.run.smithi076.stdout:(51/139): ceph-test-19.1.1-314.g086c737f.el9.x8 7.6 MB/s | 49 MB 00:06 2024-09-12T22:29:40.348 INFO:teuthology.orchestra.run.smithi019.stdout:(131/139): python3-zc-lockfile-2.0-10.el9.noarc 1.2 MB/s | 20 kB 00:00 2024-09-12T22:29:40.357 INFO:teuthology.orchestra.run.smithi076.stdout:(52/139): flexiblas-openblas-openmp-3.0.4-8.el9 40 kB/s | 18 kB 00:00 2024-09-12T22:29:40.422 INFO:teuthology.orchestra.run.smithi019.stdout:(132/139): re2-20211101-20.el9.x86_64.rpm 2.6 MB/s | 191 kB 00:00 2024-09-12T22:29:40.466 INFO:teuthology.orchestra.run.smithi076.stdout:(53/139): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.4 MB/s | 160 kB 00:00 2024-09-12T22:29:40.482 INFO:teuthology.orchestra.run.smithi019.stdout:(133/139): python3-werkzeug-2.0.3-3.el9.1.noarc 2.4 MB/s | 427 kB 00:00 2024-09-12T22:29:40.488 INFO:teuthology.orchestra.run.smithi163.stdout:(46/139): bison-3.7.4-5.el9.x86_64.rpm 566 kB/s | 943 kB 00:01 2024-09-12T22:29:40.532 INFO:teuthology.orchestra.run.smithi019.stdout:(134/139): thrift-0.15.0-2.el9.x86_64.rpm 14 MB/s | 1.6 MB 00:00 2024-09-12T22:29:40.533 INFO:teuthology.orchestra.run.smithi076.stdout:(54/139): libaio-devel-0.3.111-13.el9.x86_64.rp 56 kB/s | 11 kB 00:00 2024-09-12T22:29:40.575 INFO:teuthology.orchestra.run.smithi076.stdout:(55/139): librabbitmq-0.11.0-7.el9.x86_64.rpm 417 kB/s | 45 kB 00:00 2024-09-12T22:29:40.582 INFO:teuthology.orchestra.run.smithi148.stdout:(111/139): ceph-test-19.1.1-314.g086c737f.el9.x 6.4 MB/s | 49 MB 00:07 2024-09-12T22:29:40.607 INFO:teuthology.orchestra.run.smithi148.stdout:(112/139): python3-jaraco-8.2.1-3.el9.noarch.rp 23 kB/s | 11 kB 00:00 2024-09-12T22:29:40.641 INFO:teuthology.orchestra.run.smithi148.stdout:(113/139): python3-jaraco-collections-3.0.0-8.e 905 kB/s | 23 kB 00:00 2024-09-12T22:29:40.660 INFO:teuthology.orchestra.run.smithi076.stdout:(56/139): flexiblas-netlib-3.0.4-8.el9.x86_64.r 3.5 MB/s | 3.0 MB 00:00 2024-09-12T22:29:40.666 INFO:teuthology.orchestra.run.smithi148.stdout:(114/139): python3-jaraco-functools-3.5.0-2.el9 848 kB/s | 19 kB 00:00 2024-09-12T22:29:40.691 INFO:teuthology.orchestra.run.smithi148.stdout:(115/139): python3-jaraco-classes-3.2.1-5.el9.n 162 kB/s | 18 kB 00:00 2024-09-12T22:29:40.716 INFO:teuthology.orchestra.run.smithi148.stdout:(116/139): python3-jaraco-text-3.2.0-6.el9.noar 390 kB/s | 20 kB 00:00 2024-09-12T22:29:40.742 INFO:teuthology.orchestra.run.smithi148.stdout:(117/139): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-12T22:29:40.767 INFO:teuthology.orchestra.run.smithi148.stdout:(118/139): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-12T22:29:40.775 INFO:teuthology.orchestra.run.smithi076.stdout:(57/139): libuuid-devel-2.37.4-20.el9.x86_64.rp 210 kB/s | 24 kB 00:00 2024-09-12T22:29:40.792 INFO:teuthology.orchestra.run.smithi148.stdout:(119/139): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-12T22:29:40.799 INFO:teuthology.orchestra.run.smithi019.stdout:(135/139): librbd1-19.1.1-314.g086c737f.el9.x86 12 MB/s | 3.2 MB 00:00 2024-09-12T22:29:40.842 INFO:teuthology.orchestra.run.smithi148.stdout:(120/139): python3-grpcio-1.46.7-10.el9.x86_64. 2.7 MB/s | 2.0 MB 00:00 2024-09-12T22:29:40.866 INFO:teuthology.orchestra.run.smithi019.stdout:(136/139): protobuf-compiler-3.14.0-13.el9.x86_ 401 kB/s | 863 kB 00:02 2024-09-12T22:29:40.867 INFO:teuthology.orchestra.run.smithi076.stdout:(58/139): libtool-2.4.6-46.el9.x86_64.rpm 1.9 MB/s | 581 kB 00:00 2024-09-12T22:29:40.867 INFO:teuthology.orchestra.run.smithi148.stdout:(121/139): python3-portend-3.1.0-2.el9.noarch.r 660 kB/s | 16 kB 00:00 2024-09-12T22:29:40.889 INFO:teuthology.orchestra.run.smithi163.stdout:(47/139): boost-program-options-1.75.0-8.el9.x8 149 kB/s | 107 kB 00:00 2024-09-12T22:29:40.893 INFO:teuthology.orchestra.run.smithi076.stdout:(59/139): libzstd-devel-1.5.1-2.el9.x86_64.rpm 405 kB/s | 47 kB 00:00 2024-09-12T22:29:40.901 INFO:teuthology.orchestra.run.smithi148.stdout:(122/139): python3-pecan-1.4.2-3.el9.noarch.rpm 2.4 MB/s | 272 kB 00:00 2024-09-12T22:29:40.919 INFO:teuthology.orchestra.run.smithi148.stdout:(123/139): python3-repoze-lru-0.7-16.el9.noarch 1.8 MB/s | 31 kB 00:00 2024-09-12T22:29:40.966 INFO:teuthology.orchestra.run.smithi019.stdout:(137/139): librados2-19.1.1-314.g086c737f.el9.x 7.1 MB/s | 3.4 MB 00:00 2024-09-12T22:29:40.985 INFO:teuthology.orchestra.run.smithi076.stdout:(60/139): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.4 MB/s | 292 kB 00:00 2024-09-12T22:29:40.994 INFO:teuthology.orchestra.run.smithi148.stdout:(124/139): python3-pyOpenSSL-21.0.0-1.el9.noarc 714 kB/s | 90 kB 00:00 2024-09-12T22:29:41.010 INFO:teuthology.orchestra.run.smithi076.stdout:(61/139): lua-5.4.4-4.el9.x86_64.rpm 1.6 MB/s | 188 kB 00:00 2024-09-12T22:29:41.011 INFO:teuthology.orchestra.run.smithi148.stdout:(125/139): python3-rsa-4.9-2.el9.noarch.rpm 3.5 MB/s | 59 kB 00:00 2024-09-12T22:29:41.015 INFO:teuthology.orchestra.run.smithi163.stdout:(48/139): elfutils-libelf-devel-0.191-4.el9.x86 41 kB/s | 22 kB 00:00 2024-09-12T22:29:41.025 INFO:teuthology.orchestra.run.smithi019.stdout:(138/139): openssl-3.2.2-6.el9.x86_64.rpm 6.0 MB/s | 1.4 MB 00:00 2024-09-12T22:29:41.044 INFO:teuthology.orchestra.run.smithi148.stdout:(126/139): python3-kubernetes-26.1.0-2.el9.noar 2.9 MB/s | 1.0 MB 00:00 2024-09-12T22:29:41.061 INFO:teuthology.orchestra.run.smithi148.stdout:(127/139): python3-tempora-5.0.0-2.el9.noarch.r 714 kB/s | 36 kB 00:00 2024-09-12T22:29:41.087 INFO:teuthology.orchestra.run.smithi148.stdout:(128/139): python3-routes-2.5.1-5.el9.noarch.rp 1.1 MB/s | 188 kB 00:00 2024-09-12T22:29:41.102 INFO:teuthology.orchestra.run.smithi076.stdout:(62/139): openblas-0.3.26-2.el9.x86_64.rpm 329 kB/s | 38 kB 00:00 2024-09-12T22:29:41.112 INFO:teuthology.orchestra.run.smithi148.stdout:(129/139): python3-typing-extensions-4.12.2-2.e 1.1 MB/s | 74 kB 00:00 2024-09-12T22:29:41.137 INFO:teuthology.orchestra.run.smithi148.stdout:(130/139): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-12T22:29:41.162 INFO:teuthology.orchestra.run.smithi148.stdout:(131/139): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-12T22:29:41.188 INFO:teuthology.orchestra.run.smithi148.stdout:(132/139): python3-zc-lockfile-2.0-10.el9.noarc 398 kB/s | 20 kB 00:00 2024-09-12T22:29:41.193 INFO:teuthology.orchestra.run.smithi076.stdout:(63/139): librdkafka-1.6.1-102.el9.x86_64.rpm 1.0 MB/s | 662 kB 00:00 2024-09-12T22:29:41.213 INFO:teuthology.orchestra.run.smithi148.stdout:(133/139): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-12T22:29:41.233 INFO:teuthology.orchestra.run.smithi019.stdout:(139/139): openssl-libs-3.2.2-6.el9.x86_64.rpm 6.5 MB/s | 2.4 MB 00:00 2024-09-12T22:29:41.238 INFO:teuthology.orchestra.run.smithi148.stdout:(134/139): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-09-12T22:29:41.239 INFO:teuthology.orchestra.run.smithi019.stdout:-------------------------------------------------------------------------------- 2024-09-12T22:29:41.239 INFO:teuthology.orchestra.run.smithi019.stdout:Total 15 MB/s | 213 MB 00:14 2024-09-12T22:29:41.280 INFO:teuthology.orchestra.run.smithi148.stdout:(135/139): thrift-0.15.0-2.el9.x86_64.rpm 17 MB/s | 1.6 MB 00:00 2024-09-12T22:29:41.411 INFO:teuthology.orchestra.run.smithi076.stdout:(64/139): protobuf-3.14.0-13.el9.x86_64.rpm 4.7 MB/s | 1.0 MB 00:00 2024-09-12T22:29:41.422 INFO:teuthology.orchestra.run.smithi148.stdout:(136/139): openssl-3.2.2-6.el9.x86_64.rpm 9.6 MB/s | 1.4 MB 00:00 2024-09-12T22:29:41.522 INFO:teuthology.orchestra.run.smithi148.stdout:(137/139): openssl-libs-3.2.2-6.el9.x86_64.rpm 24 MB/s | 2.4 MB 00:00 2024-09-12T22:29:41.639 INFO:teuthology.orchestra.run.smithi148.stdout:(138/139): librbd1-19.1.1-314.g086c737f.el9.x86 7.9 MB/s | 3.2 MB 00:00 2024-09-12T22:29:41.831 INFO:teuthology.orchestra.run.smithi148.stdout:(139/139): librados2-19.1.1-314.g086c737f.el9.x 5.5 MB/s | 3.4 MB 00:00 2024-09-12T22:29:41.838 INFO:teuthology.orchestra.run.smithi148.stdout:-------------------------------------------------------------------------------- 2024-09-12T22:29:41.838 INFO:teuthology.orchestra.run.smithi148.stdout:Total 15 MB/s | 213 MB 00:14 2024-09-12T22:29:41.998 INFO:teuthology.orchestra.run.smithi163.stdout:(49/139): ceph-test-19.1.1-314.g086c737f.el9.x8 5.8 MB/s | 49 MB 00:08 2024-09-12T22:29:42.023 INFO:teuthology.orchestra.run.smithi163.stdout:(50/139): flexiblas-3.0.4-8.el9.x86_64.rpm 32 kB/s | 33 kB 00:01 2024-09-12T22:29:42.099 INFO:teuthology.orchestra.run.smithi163.stdout:(51/139): flex-2.6.4-9.el9.x86_64.rpm 259 kB/s | 313 kB 00:01 2024-09-12T22:29:42.219 INFO:teuthology.orchestra.run.smithi076.stdout:(65/139): python3-babel-2.9.1-2.el9.noarch.rpm 7.4 MB/s | 6.0 MB 00:00 2024-09-12T22:29:42.255 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction check 2024-09-12T22:29:42.286 INFO:teuthology.orchestra.run.smithi076.stdout:(66/139): openssl-devel-3.2.2-6.el9.x86_64.rpm 3.7 MB/s | 4.4 MB 00:01 2024-09-12T22:29:42.410 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction check succeeded. 2024-09-12T22:29:42.411 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction test 2024-09-12T22:29:42.445 INFO:teuthology.orchestra.run.smithi076.stdout:(67/139): python3-jinja2-2.11.3-6.el9.noarch.rp 1.5 MB/s | 248 kB 00:00 2024-09-12T22:29:42.507 INFO:teuthology.orchestra.run.smithi163.stdout:(52/139): flexiblas-openblas-openmp-3.0.4-8.el9 38 kB/s | 18 kB 00:00 2024-09-12T22:29:42.545 INFO:teuthology.orchestra.run.smithi076.stdout:(68/139): python3-devel-3.9.19-8.el9.x86_64.rpm 752 kB/s | 245 kB 00:00 2024-09-12T22:29:42.570 INFO:teuthology.orchestra.run.smithi076.stdout:(69/139): python3-jsonpatch-1.21-16.el9.noarch. 205 kB/s | 26 kB 00:00 2024-09-12T22:29:42.583 INFO:teuthology.orchestra.run.smithi163.stdout:(53/139): libaio-devel-0.3.111-13.el9.x86_64.rp 23 kB/s | 11 kB 00:00 2024-09-12T22:29:42.654 INFO:teuthology.orchestra.run.smithi076.stdout:(70/139): python3-jsonpointer-2.0-4.el9.noarch. 176 kB/s | 19 kB 00:00 2024-09-12T22:29:42.687 INFO:teuthology.orchestra.run.smithi076.stdout:(71/139): python3-mako-1.1.4-6.el9.noarch.rpm 1.4 MB/s | 172 kB 00:00 2024-09-12T22:29:42.763 INFO:teuthology.orchestra.run.smithi076.stdout:(72/139): python3-markupsafe-1.1.1-12.el9.x86_6 320 kB/s | 35 kB 00:00 2024-09-12T22:29:42.814 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction check 2024-09-12T22:29:42.951 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction check succeeded. 2024-09-12T22:29:42.952 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction test 2024-09-12T22:29:43.055 INFO:teuthology.orchestra.run.smithi076.stdout:(73/139): python3-numpy-f2py-1.20.1-5.el9.x86_6 859 kB/s | 250 kB 00:00 2024-09-12T22:29:43.225 INFO:teuthology.orchestra.run.smithi163.stdout:(54/139): librabbitmq-0.11.0-7.el9.x86_64.rpm 70 kB/s | 45 kB 00:00 2024-09-12T22:29:43.250 INFO:teuthology.orchestra.run.smithi163.stdout:(55/139): libpmemobj-1.12.1-1.el9.x86_64.rpm 216 kB/s | 160 kB 00:00 2024-09-12T22:29:43.330 INFO:teuthology.orchestra.run.smithi076.stdout:(74/139): python3-oauthlib-3.1.1-5.el9.noarch.r 808 kB/s | 222 kB 00:00 2024-09-12T22:29:43.367 INFO:teuthology.orchestra.run.smithi163.stdout:(56/139): flexiblas-netlib-3.0.4-8.el9.x86_64.r 2.2 MB/s | 3.0 MB 00:01 2024-09-12T22:29:43.447 INFO:teuthology.orchestra.run.smithi076.stdout:(75/139): python3-packaging-20.9-5.el9.noarch.r 662 kB/s | 77 kB 00:00 2024-09-12T22:29:43.555 INFO:teuthology.orchestra.run.smithi076.stdout:(76/139): python3-prettytable-0.7.2-27.el9.noar 390 kB/s | 42 kB 00:00 2024-09-12T22:29:43.622 INFO:teuthology.orchestra.run.smithi076.stdout:(77/139): python3-numpy-1.20.1-5.el9.x86_64.rpm 5.5 MB/s | 5.1 MB 00:00 2024-09-12T22:29:43.731 INFO:teuthology.orchestra.run.smithi076.stdout:(78/139): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.4 MB/s | 159 kB 00:00 2024-09-12T22:29:43.848 INFO:teuthology.orchestra.run.smithi076.stdout:(79/139): python3-protobuf-3.14.0-13.el9.noarch 921 kB/s | 269 kB 00:00 2024-09-12T22:29:43.882 INFO:teuthology.orchestra.run.smithi076.stdout:(80/139): python3-pyasn1-modules-0.4.8-6.el9.no 1.8 MB/s | 279 kB 00:00 2024-09-12T22:29:43.917 INFO:teuthology.orchestra.run.smithi163.stdout:(57/139): libuuid-devel-2.37.4-20.el9.x86_64.rp 45 kB/s | 24 kB 00:00 2024-09-12T22:29:43.957 INFO:teuthology.orchestra.run.smithi076.stdout:(81/139): python3-pytz-2021.1-5.el9.noarch.rpm 468 kB/s | 51 kB 00:00 2024-09-12T22:29:43.991 INFO:teuthology.orchestra.run.smithi076.stdout:(82/139): python3-requests-oauthlib-1.3.0-12.el 494 kB/s | 54 kB 00:00 2024-09-12T22:29:44.108 INFO:teuthology.orchestra.run.smithi076.stdout:(83/139): python3-toml-0.10.2-6.el9.noarch.rpm 358 kB/s | 42 kB 00:00 2024-09-12T22:29:44.142 INFO:teuthology.orchestra.run.smithi163.stdout:(58/139): librdkafka-1.6.1-102.el9.x86_64.rpm 722 kB/s | 662 kB 00:00 2024-09-12T22:29:44.225 INFO:teuthology.orchestra.run.smithi076.stdout:(84/139): qatlib-24.02.0-1.el9.x86_64.rpm 1.8 MB/s | 221 kB 00:00 2024-09-12T22:29:44.234 INFO:teuthology.orchestra.run.smithi163.stdout:(59/139): libtool-2.4.6-46.el9.x86_64.rpm 590 kB/s | 581 kB 00:00 2024-09-12T22:29:44.333 INFO:teuthology.orchestra.run.smithi076.stdout:(85/139): qatlib-service-24.02.0-1.el9.x86_64.r 331 kB/s | 36 kB 00:00 2024-09-12T22:29:44.442 INFO:teuthology.orchestra.run.smithi076.stdout:(86/139): qatzip-libs-1.2.0-1.el9.x86_64.rpm 438 kB/s | 47 kB 00:00 2024-09-12T22:29:44.551 INFO:teuthology.orchestra.run.smithi163.stdout:(60/139): libzstd-devel-1.5.1-2.el9.x86_64.rpm 75 kB/s | 47 kB 00:00 2024-09-12T22:29:44.559 INFO:teuthology.orchestra.run.smithi076.stdout:(87/139): socat-1.7.4.1-6.el9.x86_64.rpm 2.5 MB/s | 304 kB 00:00 2024-09-12T22:29:44.589 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction test succeeded. 2024-09-12T22:29:44.590 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction 2024-09-12T22:29:44.667 INFO:teuthology.orchestra.run.smithi076.stdout:(88/139): xfsprogs-devel-6.4.0-4.el9.x86_64.rpm 884 kB/s | 96 kB 00:00 2024-09-12T22:29:44.785 INFO:teuthology.orchestra.run.smithi076.stdout:(89/139): xmlstarlet-1.6.1-20.el9.x86_64.rpm 545 kB/s | 64 kB 00:00 2024-09-12T22:29:44.893 INFO:teuthology.orchestra.run.smithi076.stdout:(90/139): zlib-devel-1.2.11-41.el9.x86_64.rpm 413 kB/s | 45 kB 00:00 2024-09-12T22:29:44.935 INFO:teuthology.orchestra.run.smithi163.stdout:(61/139): lttng-ust-2.12.0-6.el9.x86_64.rpm 373 kB/s | 292 kB 00:00 2024-09-12T22:29:44.990 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction test succeeded. 2024-09-12T22:29:44.991 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction 2024-09-12T22:29:45.026 INFO:teuthology.orchestra.run.smithi163.stdout:(62/139): lua-5.4.4-4.el9.x86_64.rpm 238 kB/s | 188 kB 00:00 2024-09-12T22:29:45.110 INFO:teuthology.orchestra.run.smithi163.stdout:(63/139): openblas-0.3.26-2.el9.x86_64.rpm 69 kB/s | 38 kB 00:00 2024-09-12T22:29:45.535 INFO:teuthology.orchestra.run.smithi076.stdout:(91/139): python3-scipy-1.6.2-8.el9.x86_64.rpm 10 MB/s | 16 MB 00:01 2024-09-12T22:29:45.560 INFO:teuthology.orchestra.run.smithi076.stdout:(92/139): lua-devel-5.4.4-4.el9.x86_64.rpm 33 kB/s | 22 kB 00:00 2024-09-12T22:29:45.627 INFO:teuthology.orchestra.run.smithi076.stdout:(93/139): openblas-openmp-0.3.26-2.el9.x86_64.r 1.1 MB/s | 4.9 MB 00:04 2024-09-12T22:29:45.686 INFO:teuthology.orchestra.run.smithi076.stdout:(94/139): abseil-cpp-20211102.0-3.el9.x86_64.rp 4.3 MB/s | 548 kB 00:00 2024-09-12T22:29:45.711 INFO:teuthology.orchestra.run.smithi076.stdout:(95/139): grpc-data-1.46.7-10.el9.noarch.rpm 785 kB/s | 19 kB 00:00 2024-09-12T22:29:45.736 INFO:teuthology.orchestra.run.smithi076.stdout:(96/139): gperftools-libs-2.9.1-3.el9.x86_64.rp 3.0 MB/s | 308 kB 00:00 2024-09-12T22:29:45.761 INFO:teuthology.orchestra.run.smithi076.stdout:(97/139): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-12T22:29:45.787 INFO:teuthology.orchestra.run.smithi076.stdout:(98/139): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-12T22:29:45.820 INFO:teuthology.orchestra.run.smithi076.stdout:(99/139): libunwind-1.6.2-1.el9.x86_64.rpm 2.5 MB/s | 67 kB 00:00 2024-09-12T22:29:45.846 INFO:teuthology.orchestra.run.smithi076.stdout:(100/139): luarocks-3.9.2-5.el9.noarch.rpm 6.0 MB/s | 151 kB 00:00 2024-09-12T22:29:45.896 INFO:teuthology.orchestra.run.smithi076.stdout:(101/139): parquet-libs-9.0.0-11.el9.x86_64.rpm 16 MB/s | 839 kB 00:00 2024-09-12T22:29:45.938 INFO:teuthology.orchestra.run.smithi076.stdout:(102/139): python3-asyncssh-2.13.2-5.el9.noarch 13 MB/s | 548 kB 00:00 2024-09-12T22:29:45.955 INFO:teuthology.orchestra.run.smithi076.stdout:(103/139): python3-bcrypt-3.2.2-1.el9.x86_64.rp 2.6 MB/s | 43 kB 00:00 2024-09-12T22:29:45.972 INFO:teuthology.orchestra.run.smithi076.stdout:(104/139): python3-cachetools-4.2.4-1.el9.noarc 1.9 MB/s | 32 kB 00:00 2024-09-12T22:29:45.997 INFO:teuthology.orchestra.run.smithi076.stdout:(105/139): python3-certifi-2023.05.07-4.el9.noa 568 kB/s | 14 kB 00:00 2024-09-12T22:29:46.022 INFO:teuthology.orchestra.run.smithi076.stdout:(106/139): python3-cheroot-8.6.0-4.el9.noarch.r 6.7 MB/s | 172 kB 00:00 2024-09-12T22:29:46.089 INFO:teuthology.orchestra.run.smithi076.stdout:(107/139): libarrow-9.0.0-11.el9.x86_64.rpm 12 MB/s | 4.4 MB 00:00 2024-09-12T22:29:46.115 INFO:teuthology.orchestra.run.smithi076.stdout:(108/139): python3-cherrypy-18.6.1-2.el9.noarch 3.8 MB/s | 358 kB 00:00 2024-09-12T22:29:46.140 INFO:teuthology.orchestra.run.smithi076.stdout:(109/139): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-12T22:29:46.165 INFO:teuthology.orchestra.run.smithi076.stdout:(110/139): python3-grpcio-tools-1.46.7-10.el9.x 5.6 MB/s | 144 kB 00:00 2024-09-12T22:29:46.191 INFO:teuthology.orchestra.run.smithi076.stdout:(111/139): python3-jaraco-8.2.1-3.el9.noarch.rp 431 kB/s | 11 kB 00:00 2024-09-12T22:29:46.216 INFO:teuthology.orchestra.run.smithi076.stdout:(112/139): python3-jaraco-classes-3.2.1-5.el9.n 705 kB/s | 18 kB 00:00 2024-09-12T22:29:46.241 INFO:teuthology.orchestra.run.smithi076.stdout:(113/139): python3-jaraco-collections-3.0.0-8.e 932 kB/s | 23 kB 00:00 2024-09-12T22:29:46.267 INFO:teuthology.orchestra.run.smithi076.stdout:(114/139): python3-jaraco-functools-3.5.0-2.el9 777 kB/s | 19 kB 00:00 2024-09-12T22:29:46.292 INFO:teuthology.orchestra.run.smithi076.stdout:(115/139): python3-jaraco-text-3.2.0-6.el9.noar 792 kB/s | 20 kB 00:00 2024-09-12T22:29:46.350 INFO:teuthology.orchestra.run.smithi076.stdout:(116/139): python3-grpcio-1.46.7-10.el9.x86_64. 8.7 MB/s | 2.0 MB 00:00 2024-09-12T22:29:46.375 INFO:teuthology.orchestra.run.smithi076.stdout:(117/139): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-12T22:29:46.402 INFO:teuthology.orchestra.run.smithi163.stdout:(64/139): openssl-devel-3.2.2-6.el9.x86_64.rpm 3.2 MB/s | 4.4 MB 00:01 2024-09-12T22:29:46.423 INFO:teuthology.orchestra.run.smithi076.stdout:(118/139): python3-more-itertools-8.12.0-2.el9. 1.6 MB/s | 79 kB 00:00 2024-09-12T22:29:46.451 INFO:teuthology.orchestra.run.smithi076.stdout:(119/139): python3-natsort-7.1.1-5.el9.noarch.r 2.0 MB/s | 58 kB 00:00 2024-09-12T22:29:46.485 INFO:teuthology.orchestra.run.smithi076.stdout:(120/139): python3-kubernetes-26.1.0-2.el9.noar 5.3 MB/s | 1.0 MB 00:00 2024-09-12T22:29:46.510 INFO:teuthology.orchestra.run.smithi076.stdout:(121/139): python3-portend-3.1.0-2.el9.noarch.r 663 kB/s | 16 kB 00:00 2024-09-12T22:29:46.535 INFO:teuthology.orchestra.run.smithi076.stdout:(122/139): python3-pecan-1.4.2-3.el9.noarch.rpm 3.2 MB/s | 272 kB 00:00 2024-09-12T22:29:46.561 INFO:teuthology.orchestra.run.smithi076.stdout:(123/139): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.7 MB/s | 90 kB 00:00 2024-09-12T22:29:46.586 INFO:teuthology.orchestra.run.smithi076.stdout:(124/139): python3-repoze-lru-0.7-16.el9.noarch 612 kB/s | 31 kB 00:00 2024-09-12T22:29:46.611 INFO:teuthology.orchestra.run.smithi076.stdout:(125/139): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-12T22:29:46.628 INFO:teuthology.orchestra.run.smithi076.stdout:(126/139): python3-routes-2.5.1-5.el9.noarch.rp 2.7 MB/s | 188 kB 00:00 2024-09-12T22:29:46.654 INFO:teuthology.orchestra.run.smithi076.stdout:(127/139): python3-tempora-5.0.0-2.el9.noarch.r 856 kB/s | 36 kB 00:00 2024-09-12T22:29:46.679 INFO:teuthology.orchestra.run.smithi076.stdout:(128/139): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-12T22:29:46.704 INFO:teuthology.orchestra.run.smithi076.stdout:(129/139): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-12T22:29:46.730 INFO:teuthology.orchestra.run.smithi076.stdout:(130/139): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-09-12T22:29:46.746 INFO:teuthology.orchestra.run.smithi076.stdout:(131/139): python3-zc-lockfile-2.0-10.el9.noarc 1.2 MB/s | 20 kB 00:00 2024-09-12T22:29:46.780 INFO:teuthology.orchestra.run.smithi076.stdout:(132/139): re2-20211101-20.el9.x86_64.rpm 5.7 MB/s | 191 kB 00:00 2024-09-12T22:29:46.805 INFO:teuthology.orchestra.run.smithi076.stdout:(133/139): python3-werkzeug-2.0.3-3.el9.1.noarc 4.1 MB/s | 427 kB 00:00 2024-09-12T22:29:46.855 INFO:teuthology.orchestra.run.smithi076.stdout:(134/139): thrift-0.15.0-2.el9.x86_64.rpm 21 MB/s | 1.6 MB 00:00 2024-09-12T22:29:46.935 INFO:teuthology.orchestra.run.smithi163.stdout:(65/139): protobuf-3.14.0-13.el9.x86_64.rpm 566 kB/s | 1.0 MB 00:01 2024-09-12T22:29:47.247 INFO:teuthology.orchestra.run.smithi076.stdout:(135/139): librados2-19.1.1-314.g086c737f.el9.x 7.7 MB/s | 3.4 MB 00:00 2024-09-12T22:29:47.289 INFO:teuthology.orchestra.run.smithi076.stdout:(136/139): protobuf-compiler-3.14.0-13.el9.x86_ 492 kB/s | 863 kB 00:01 2024-09-12T22:29:47.340 INFO:teuthology.orchestra.run.smithi076.stdout:(137/139): librbd1-19.1.1-314.g086c737f.el9.x86 6.5 MB/s | 3.2 MB 00:00 2024-09-12T22:29:47.642 INFO:teuthology.orchestra.run.smithi076.stdout:(138/139): openssl-3.2.2-6.el9.x86_64.rpm 3.4 MB/s | 1.4 MB 00:00 2024-09-12T22:29:47.741 INFO:teuthology.orchestra.run.smithi076.stdout:(139/139): openssl-libs-3.2.2-6.el9.x86_64.rpm 5.3 MB/s | 2.4 MB 00:00 2024-09-12T22:29:47.746 INFO:teuthology.orchestra.run.smithi076.stdout:-------------------------------------------------------------------------------- 2024-09-12T22:29:47.746 INFO:teuthology.orchestra.run.smithi076.stdout:Total 10 MB/s | 213 MB 00:21 2024-09-12T22:29:47.802 INFO:teuthology.orchestra.run.smithi163.stdout:(66/139): python3-devel-3.9.19-8.el9.x86_64.rpm 282 kB/s | 245 kB 00:00 2024-09-12T22:29:48.669 INFO:teuthology.orchestra.run.smithi163.stdout:(67/139): python3-jinja2-2.11.3-6.el9.noarch.rp 287 kB/s | 248 kB 00:00 2024-09-12T22:29:48.773 INFO:teuthology.orchestra.run.smithi076.stdout:Running transaction check 2024-09-12T22:29:48.913 INFO:teuthology.orchestra.run.smithi076.stdout:Transaction check succeeded. 2024-09-12T22:29:48.913 INFO:teuthology.orchestra.run.smithi076.stdout:Running transaction test 2024-09-12T22:29:49.244 INFO:teuthology.orchestra.run.smithi163.stdout:(68/139): python3-jsonpatch-1.21-16.el9.noarch. 45 kB/s | 26 kB 00:00 2024-09-12T22:29:49.736 INFO:teuthology.orchestra.run.smithi163.stdout:(69/139): python3-jsonpointer-2.0-4.el9.noarch. 39 kB/s | 19 kB 00:00 2024-09-12T22:29:50.012 INFO:teuthology.orchestra.run.smithi163.stdout:(70/139): openblas-openmp-0.3.26-2.el9.x86_64.r 996 kB/s | 4.9 MB 00:05 2024-09-12T22:29:50.545 INFO:teuthology.orchestra.run.smithi019.stdout: Preparing : 1/1 2024-09-12T22:29:50.578 INFO:teuthology.orchestra.run.smithi163.stdout:(71/139): python3-markupsafe-1.1.1-12.el9.x86_6 62 kB/s | 35 kB 00:00 2024-09-12T22:29:50.629 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/143 2024-09-12T22:29:50.637 INFO:teuthology.orchestra.run.smithi163.stdout:(72/139): python3-mako-1.1.4-6.el9.noarch.rpm 191 kB/s | 172 kB 00:00 2024-09-12T22:29:50.669 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/143 2024-09-12T22:29:50.728 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/143 2024-09-12T22:29:50.736 INFO:teuthology.orchestra.run.smithi148.stdout: Preparing : 1/1 2024-09-12T22:29:50.763 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/143 2024-09-12T22:29:50.789 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/143 2024-09-12T22:29:50.845 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/143 2024-09-12T22:29:50.868 INFO:teuthology.orchestra.run.smithi148.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/143 2024-09-12T22:29:50.910 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/143 2024-09-12T22:29:50.977 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/143 2024-09-12T22:29:51.010 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/143 2024-09-12T22:29:51.036 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/143 2024-09-12T22:29:51.078 INFO:teuthology.orchestra.run.smithi076.stdout:Transaction test succeeded. 2024-09-12T22:29:51.078 INFO:teuthology.orchestra.run.smithi076.stdout:Running transaction 2024-09-12T22:29:51.095 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/143 2024-09-12T22:29:51.202 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/143 2024-09-12T22:29:51.314 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : librados2-2:19.1.1-314.g086c737f.el9.x86_64 8/143 2024-09-12T22:29:51.427 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/143 2024-09-12T22:29:51.449 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: librados2-2:19.1.1-314.g086c737f.el9.x86_64 8/143 2024-09-12T22:29:51.482 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libcephfs2-2:19.1.1-314.g086c737f.el9.x86_64 9/143 2024-09-12T22:29:51.504 INFO:teuthology.orchestra.run.smithi163.stdout:(73/139): python3-numpy-f2py-1.20.1-5.el9.x86_6 289 kB/s | 250 kB 00:00 2024-09-12T22:29:51.537 INFO:teuthology.orchestra.run.smithi148.stdout: Upgrading : librados2-2:19.1.1-314.g086c737f.el9.x86_64 8/143 2024-09-12T22:29:51.559 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: libcephfs2-2:19.1.1-314.g086c737f.el9.x86_64 9/143 2024-09-12T22:29:51.598 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-rados-2:19.1.1-314.g086c737f.el9.x86_64 10/143 2024-09-12T22:29:51.626 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libcephsqlite-2:19.1.1-314.g086c737f.el9.x86_64 11/143 2024-09-12T22:29:51.658 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: librados2-2:19.1.1-314.g086c737f.el9.x86_64 8/143 2024-09-12T22:29:51.671 INFO:teuthology.orchestra.run.smithi163.stdout:(74/139): python3-babel-2.9.1-2.el9.noarch.rpm 1.1 MB/s | 6.0 MB 00:05 2024-09-12T22:29:51.680 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libcephfs2-2:19.1.1-314.g086c737f.el9.x86_64 9/143 2024-09-12T22:29:51.732 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: libcephsqlite-2:19.1.1-314.g086c737f.el9.x86_64 11/143 2024-09-12T22:29:51.760 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libradosstriper1-2:19.1.1-314.g086c737f.el9.x86_ 12/143 2024-09-12T22:29:51.762 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: libcephfs2-2:19.1.1-314.g086c737f.el9.x86_64 9/143 2024-09-12T22:29:51.802 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-rados-2:19.1.1-314.g086c737f.el9.x86_64 10/143 2024-09-12T22:29:51.806 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: libradosstriper1-2:19.1.1-314.g086c737f.el9.x86_ 12/143 2024-09-12T22:29:51.831 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libcephsqlite-2:19.1.1-314.g086c737f.el9.x86_64 11/143 2024-09-12T22:29:51.844 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 13/143 2024-09-12T22:29:51.868 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 13/143 2024-09-12T22:29:51.919 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: libcephsqlite-2:19.1.1-314.g086c737f.el9.x86_64 11/143 2024-09-12T22:29:51.940 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libradosstriper1-2:19.1.1-314.g086c737f.el9.x86_ 12/143 2024-09-12T22:29:51.986 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: libradosstriper1-2:19.1.1-314.g086c737f.el9.x86_ 12/143 2024-09-12T22:29:52.014 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 14/143 2024-09-12T22:29:52.025 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 13/143 2024-09-12T22:29:52.044 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 14/143 2024-09-12T22:29:52.049 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 13/143 2024-09-12T22:29:52.156 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/143 2024-09-12T22:29:52.244 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 14/143 2024-09-12T22:29:52.251 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/143 2024-09-12T22:29:52.292 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 14/143 2024-09-12T22:29:52.302 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 17/143 2024-09-12T22:29:52.337 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : liboath-2.6.7-2.el9.x86_64 18/143 2024-09-12T22:29:52.354 INFO:teuthology.orchestra.run.smithi163.stdout:(75/139): python3-numpy-1.20.1-5.el9.x86_64.rpm 2.9 MB/s | 5.1 MB 00:01 2024-09-12T22:29:52.371 INFO:teuthology.orchestra.run.smithi163.stdout:(76/139): python3-packaging-20.9-5.el9.noarch.r 110 kB/s | 77 kB 00:00 2024-09-12T22:29:52.397 INFO:teuthology.orchestra.run.smithi163.stdout:(77/139): python3-oauthlib-3.1.1-5.el9.noarch.r 249 kB/s | 222 kB 00:00 2024-09-12T22:29:52.399 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/143 2024-09-12T22:29:52.421 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 19/143 2024-09-12T22:29:52.472 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 20/143 2024-09-12T22:29:52.497 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/143 2024-09-12T22:29:52.512 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-packaging-20.9-5.el9.noarch 21/143 2024-09-12T22:29:52.532 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 17/143 2024-09-12T22:29:52.556 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 22/143 2024-09-12T22:29:52.567 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : liboath-2.6.7-2.el9.x86_64 18/143 2024-09-12T22:29:52.599 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 23/143 2024-09-12T22:29:52.632 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : lua-5.4.4-4.el9.x86_64 24/143 2024-09-12T22:29:52.642 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 19/143 2024-09-12T22:29:52.694 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 20/143 2024-09-12T22:29:52.704 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 25/143 2024-09-12T22:29:52.734 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-packaging-20.9-5.el9.noarch 21/143 2024-09-12T22:29:52.772 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 26/143 2024-09-12T22:29:52.777 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 22/143 2024-09-12T22:29:52.808 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 27/143 2024-09-12T22:29:52.818 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 23/143 2024-09-12T22:29:52.846 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : lua-5.4.4-4.el9.x86_64 24/143 2024-09-12T22:29:52.854 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 28/143 2024-09-12T22:29:52.916 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 25/143 2024-09-12T22:29:52.932 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 29/143 2024-09-12T22:29:52.955 INFO:teuthology.orchestra.run.smithi163.stdout:(78/139): python3-prettytable-0.7.2-27.el9.noar 70 kB/s | 42 kB 00:00 2024-09-12T22:29:52.964 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-ceph-common-2:19.1.1-314.g086c737f.el9.x 30/143 2024-09-12T22:29:52.977 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 26/143 2024-09-12T22:29:53.009 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-ceph-argparse-2:19.1.1-314.g086c737f.el9 31/143 2024-09-12T22:29:53.016 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 27/143 2024-09-12T22:29:53.036 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-cephfs-2:19.1.1-314.g086c737f.el9.x86_64 32/143 2024-09-12T22:29:53.059 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 28/143 2024-09-12T22:29:53.109 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 33/143 2024-09-12T22:29:53.136 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 29/143 2024-09-12T22:29:53.151 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : luarocks-3.9.2-5.el9.noarch 34/143 2024-09-12T22:29:53.169 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-ceph-common-2:19.1.1-314.g086c737f.el9.x 30/143 2024-09-12T22:29:53.197 INFO:teuthology.orchestra.run.smithi163.stdout:(79/139): python3-pyasn1-0.4.8-6.el9.noarch.rpm 198 kB/s | 159 kB 00:00 2024-09-12T22:29:53.213 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-ceph-argparse-2:19.1.1-314.g086c737f.el9 31/143 2024-09-12T22:29:53.236 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 35/143 2024-09-12T22:29:53.239 INFO:teuthology.orchestra.run.smithi163.stdout:(80/139): python3-protobuf-3.14.0-13.el9.noarch 310 kB/s | 269 kB 00:00 2024-09-12T22:29:53.258 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-cephfs-2:19.1.1-314.g086c737f.el9.x86_64 32/143 2024-09-12T22:29:53.329 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 33/143 2024-09-12T22:29:53.373 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : luarocks-3.9.2-5.el9.noarch 34/143 2024-09-12T22:29:53.382 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 36/143 2024-09-12T22:29:53.438 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 37/143 2024-09-12T22:29:53.448 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 35/143 2024-09-12T22:29:53.585 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 36/143 2024-09-12T22:29:53.634 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 37/143 2024-09-12T22:29:53.798 INFO:teuthology.orchestra.run.smithi163.stdout:(81/139): python3-pytz-2021.1-5.el9.noarch.rpm 86 kB/s | 51 kB 00:00 2024-09-12T22:29:53.840 INFO:teuthology.orchestra.run.smithi163.stdout:(82/139): python3-requests-oauthlib-1.3.0-12.el 89 kB/s | 54 kB 00:00 2024-09-12T22:29:53.865 INFO:teuthology.orchestra.run.smithi163.stdout:(83/139): python3-pyasn1-modules-0.4.8-6.el9.no 307 kB/s | 279 kB 00:00 2024-09-12T22:29:53.995 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-rsa-4.9-2.el9.noarch 38/143 2024-09-12T22:29:54.077 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 39/143 2024-09-12T22:29:54.111 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 40/143 2024-09-12T22:29:54.155 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 41/143 2024-09-12T22:29:54.161 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-rsa-4.9-2.el9.noarch 38/143 2024-09-12T22:29:54.192 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : librados-devel-2:19.1.1-314.g086c737f.el9.x86_64 42/143 2024-09-12T22:29:54.235 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 43/143 2024-09-12T22:29:54.236 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 39/143 2024-09-12T22:29:54.266 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 40/143 2024-09-12T22:29:54.309 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 41/143 2024-09-12T22:29:54.347 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : librados-devel-2:19.1.1-314.g086c737f.el9.x86_64 42/143 2024-09-12T22:29:54.390 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 43/143 2024-09-12T22:29:54.390 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 44/143 2024-09-12T22:29:54.440 INFO:teuthology.orchestra.run.smithi163.stdout:(84/139): python3-toml-0.10.2-6.el9.noarch.rpm 69 kB/s | 42 kB 00:00 2024-09-12T22:29:54.453 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 45/143 2024-09-12T22:29:54.510 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 46/143 2024-09-12T22:29:54.556 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 44/143 2024-09-12T22:29:54.583 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 47/143 2024-09-12T22:29:54.616 INFO:teuthology.orchestra.run.smithi148.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 45/143 2024-09-12T22:29:54.621 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 48/143 2024-09-12T22:29:54.632 INFO:teuthology.orchestra.run.smithi163.stdout:(85/139): qatlib-24.02.0-1.el9.x86_64.rpm 288 kB/s | 221 kB 00:00 2024-09-12T22:29:54.657 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 49/143 2024-09-12T22:29:54.670 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 46/143 2024-09-12T22:29:54.705 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 50/143 2024-09-12T22:29:54.745 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 47/143 2024-09-12T22:29:54.749 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 51/143 2024-09-12T22:29:54.776 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 48/143 2024-09-12T22:29:54.800 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 52/143 2024-09-12T22:29:54.820 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 49/143 2024-09-12T22:29:54.867 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 50/143 2024-09-12T22:29:54.912 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 51/143 2024-09-12T22:29:54.954 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 53/143 2024-09-12T22:29:54.954 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 52/143 2024-09-12T22:29:54.993 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 54/143 2024-09-12T22:29:55.035 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 55/143 2024-09-12T22:29:55.041 INFO:teuthology.orchestra.run.smithi163.stdout:(86/139): qatlib-service-24.02.0-1.el9.x86_64.r 60 kB/s | 36 kB 00:00 2024-09-12T22:29:55.090 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 53/143 2024-09-12T22:29:55.139 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 54/143 2024-09-12T22:29:55.141 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 56/143 2024-09-12T22:29:55.176 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 57/143 2024-09-12T22:29:55.180 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 55/143 2024-09-12T22:29:55.218 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 58/143 2024-09-12T22:29:55.258 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 59/143 2024-09-12T22:29:55.275 INFO:teuthology.orchestra.run.smithi163.stdout:(87/139): qatzip-libs-1.2.0-1.el9.x86_64.rpm 74 kB/s | 47 kB 00:00 2024-09-12T22:29:55.283 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 60/143 2024-09-12T22:29:55.284 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 56/143 2024-09-12T22:29:55.328 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 57/143 2024-09-12T22:29:55.364 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 58/143 2024-09-12T22:29:55.396 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 61/143 2024-09-12T22:29:55.397 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 59/143 2024-09-12T22:29:55.421 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 60/143 2024-09-12T22:29:55.434 INFO:teuthology.orchestra.run.smithi163.stdout:(88/139): python3-scipy-1.6.2-8.el9.x86_64.rpm 9.9 MB/s | 16 MB 00:01 2024-09-12T22:29:55.515 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 61/143 2024-09-12T22:29:55.533 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 62/143 2024-09-12T22:29:55.573 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 63/143 2024-09-12T22:29:55.608 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 64/143 2024-09-12T22:29:55.641 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 62/143 2024-09-12T22:29:55.647 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 65/143 2024-09-12T22:29:55.677 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 66/143 2024-09-12T22:29:55.678 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 63/143 2024-09-12T22:29:55.706 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 64/143 2024-09-12T22:29:55.711 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 67/143 2024-09-12T22:29:55.743 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 65/143 2024-09-12T22:29:55.773 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 66/143 2024-09-12T22:29:55.807 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 67/143 2024-09-12T22:29:55.820 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 68/143 2024-09-12T22:29:55.840 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 68/143 2024-09-12T22:29:55.882 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 69/143 2024-09-12T22:29:55.917 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 70/143 2024-09-12T22:29:55.950 INFO:teuthology.orchestra.run.smithi163.stdout:(89/139): socat-1.7.4.1-6.el9.x86_64.rpm 335 kB/s | 304 kB 00:00 2024-09-12T22:29:56.003 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 71/143 2024-09-12T22:29:56.017 INFO:teuthology.orchestra.run.smithi163.stdout:(90/139): xfsprogs-devel-6.4.0-4.el9.x86_64.rpm 130 kB/s | 96 kB 00:00 2024-09-12T22:29:56.051 INFO:teuthology.orchestra.run.smithi163.stdout:(91/139): xmlstarlet-1.6.1-20.el9.x86_64.rpm 103 kB/s | 64 kB 00:00 2024-09-12T22:29:56.055 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 72/143 2024-09-12T22:29:56.081 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 69/143 2024-09-12T22:29:56.086 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 73/143 2024-09-12T22:29:56.109 INFO:teuthology.orchestra.run.smithi163.stdout:(92/139): lua-devel-5.4.4-4.el9.x86_64.rpm 243 kB/s | 22 kB 00:00 2024-09-12T22:29:56.113 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 70/143 2024-09-12T22:29:56.159 INFO:teuthology.orchestra.run.smithi163.stdout:(93/139): abseil-cpp-20211102.0-3.el9.x86_64.rp 11 MB/s | 548 kB 00:00 2024-09-12T22:29:56.190 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 74/143 2024-09-12T22:29:56.201 INFO:teuthology.orchestra.run.smithi163.stdout:(94/139): gperftools-libs-2.9.1-3.el9.x86_64.rp 7.2 MB/s | 308 kB 00:00 2024-09-12T22:29:56.210 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 71/143 2024-09-12T22:29:56.235 INFO:teuthology.orchestra.run.smithi163.stdout:(95/139): protobuf-compiler-3.14.0-13.el9.x86_6 4.6 MB/s | 863 kB 00:00 2024-09-12T22:29:56.245 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 75/143 2024-09-12T22:29:56.260 INFO:teuthology.orchestra.run.smithi163.stdout:(96/139): grpc-data-1.46.7-10.el9.noarch.rpm 381 kB/s | 19 kB 00:00 2024-09-12T22:29:56.261 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 72/143 2024-09-12T22:29:56.294 INFO:teuthology.orchestra.run.smithi163.stdout:(97/139): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-12T22:29:56.299 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 73/143 2024-09-12T22:29:56.311 INFO:teuthology.orchestra.run.smithi163.stdout:(98/139): liboath-2.6.7-2.el9.x86_64.rpm 3.3 MB/s | 49 kB 00:00 2024-09-12T22:29:56.336 INFO:teuthology.orchestra.run.smithi163.stdout:(99/139): libunwind-1.6.2-1.el9.x86_64.rpm 2.7 MB/s | 67 kB 00:00 2024-09-12T22:29:56.370 INFO:teuthology.orchestra.run.smithi163.stdout:(100/139): luarocks-3.9.2-5.el9.noarch.rpm 4.4 MB/s | 151 kB 00:00 2024-09-12T22:29:56.411 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 74/143 2024-09-12T22:29:56.420 INFO:teuthology.orchestra.run.smithi163.stdout:(101/139): parquet-libs-9.0.0-11.el9.x86_64.rpm 16 MB/s | 839 kB 00:00 2024-09-12T22:29:56.468 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 75/143 2024-09-12T22:29:56.470 INFO:teuthology.orchestra.run.smithi163.stdout:(102/139): python3-asyncssh-2.13.2-5.el9.noarch 11 MB/s | 548 kB 00:00 2024-09-12T22:29:56.504 INFO:teuthology.orchestra.run.smithi163.stdout:(103/139): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.3 MB/s | 43 kB 00:00 2024-09-12T22:29:56.529 INFO:teuthology.orchestra.run.smithi163.stdout:(104/139): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-12T22:29:56.555 INFO:teuthology.orchestra.run.smithi163.stdout:(105/139): python3-certifi-2023.05.07-4.el9.noa 566 kB/s | 14 kB 00:00 2024-09-12T22:29:56.589 INFO:teuthology.orchestra.run.smithi163.stdout:(106/139): python3-cheroot-8.6.0-4.el9.noarch.r 5.0 MB/s | 172 kB 00:00 2024-09-12T22:29:56.614 INFO:teuthology.orchestra.run.smithi163.stdout:(107/139): zlib-devel-1.2.11-41.el9.x86_64.rpm 68 kB/s | 45 kB 00:00 2024-09-12T22:29:56.689 INFO:teuthology.orchestra.run.smithi163.stdout:(108/139): libarrow-9.0.0-11.el9.x86_64.rpm 9.7 MB/s | 4.4 MB 00:00 2024-09-12T22:29:56.764 INFO:teuthology.orchestra.run.smithi163.stdout:(109/139): python3-cherrypy-18.6.1-2.el9.noarch 2.0 MB/s | 358 kB 00:00 2024-09-12T22:29:56.798 INFO:teuthology.orchestra.run.smithi163.stdout:(110/139): python3-grpcio-tools-1.46.7-10.el9.x 4.5 MB/s | 144 kB 00:00 2024-09-12T22:29:56.823 INFO:teuthology.orchestra.run.smithi163.stdout:(111/139): python3-jaraco-8.2.1-3.el9.noarch.rp 428 kB/s | 11 kB 00:00 2024-09-12T22:29:56.849 INFO:teuthology.orchestra.run.smithi163.stdout:(112/139): python3-jaraco-classes-3.2.1-5.el9.n 713 kB/s | 18 kB 00:00 2024-09-12T22:29:56.874 INFO:teuthology.orchestra.run.smithi163.stdout:(113/139): python3-google-auth-2.34.0-1.el9.noa 848 kB/s | 220 kB 00:00 2024-09-12T22:29:56.899 INFO:teuthology.orchestra.run.smithi163.stdout:(114/139): python3-jaraco-collections-3.0.0-8.e 461 kB/s | 23 kB 00:00 2024-09-12T22:29:56.925 INFO:teuthology.orchestra.run.smithi163.stdout:(115/139): python3-jaraco-functools-3.5.0-2.el9 386 kB/s | 19 kB 00:00 2024-09-12T22:29:56.950 INFO:teuthology.orchestra.run.smithi163.stdout:(116/139): python3-jaraco-text-3.2.0-6.el9.noar 393 kB/s | 20 kB 00:00 2024-09-12T22:29:56.970 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 76/143 2024-09-12T22:29:56.975 INFO:teuthology.orchestra.run.smithi163.stdout:(117/139): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-12T22:29:57.000 INFO:teuthology.orchestra.run.smithi163.stdout:(118/139): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-12T22:29:57.002 INFO:teuthology.orchestra.run.smithi076.stdout: Preparing : 1/1 2024-09-12T22:29:57.018 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 77/143 2024-09-12T22:29:57.025 INFO:teuthology.orchestra.run.smithi163.stdout:(119/139): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-12T22:29:57.051 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 78/143 2024-09-12T22:29:57.059 INFO:teuthology.orchestra.run.smithi163.stdout:(120/139): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-09-12T22:29:57.084 INFO:teuthology.orchestra.run.smithi163.stdout:(121/139): python3-portend-3.1.0-2.el9.noarch.r 664 kB/s | 16 kB 00:00 2024-09-12T22:29:57.103 INFO:teuthology.orchestra.run.smithi076.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/143 2024-09-12T22:29:57.110 INFO:teuthology.orchestra.run.smithi163.stdout:(122/139): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-09-12T22:29:57.143 INFO:teuthology.orchestra.run.smithi163.stdout:(123/139): python3-kubernetes-26.1.0-2.el9.noar 4.7 MB/s | 1.0 MB 00:00 2024-09-12T22:29:57.150 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 79/143 2024-09-12T22:29:57.152 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/143 2024-09-12T22:29:57.169 INFO:teuthology.orchestra.run.smithi163.stdout:(124/139): python3-repoze-lru-0.7-16.el9.noarch 525 kB/s | 31 kB 00:00 2024-09-12T22:29:57.194 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 80/143 2024-09-12T22:29:57.219 INFO:teuthology.orchestra.run.smithi163.stdout:(125/139): python3-grpcio-1.46.7-10.el9.x86_64. 3.9 MB/s | 2.0 MB 00:00 2024-09-12T22:29:57.232 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 76/143 2024-09-12T22:29:57.244 INFO:teuthology.orchestra.run.smithi163.stdout:(126/139): python3-rsa-4.9-2.el9.noarch.rpm 787 kB/s | 59 kB 00:00 2024-09-12T22:29:57.270 INFO:teuthology.orchestra.run.smithi163.stdout:(127/139): python3-tempora-5.0.0-2.el9.noarch.r 711 kB/s | 36 kB 00:00 2024-09-12T22:29:57.283 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 77/143 2024-09-12T22:29:57.295 INFO:teuthology.orchestra.run.smithi163.stdout:(128/139): python3-routes-2.5.1-5.el9.noarch.rp 1.2 MB/s | 188 kB 00:00 2024-09-12T22:29:57.311 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/143 2024-09-12T22:29:57.314 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 78/143 2024-09-12T22:29:57.320 INFO:teuthology.orchestra.run.smithi163.stdout:(129/139): python3-typing-extensions-4.12.2-2.e 982 kB/s | 74 kB 00:00 2024-09-12T22:29:57.345 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/143 2024-09-12T22:29:57.346 INFO:teuthology.orchestra.run.smithi163.stdout:(130/139): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-12T22:29:57.370 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/143 2024-09-12T22:29:57.378 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : openblas-0.3.26-2.el9.x86_64 81/143 2024-09-12T22:29:57.379 INFO:teuthology.orchestra.run.smithi163.stdout:(131/139): python3-webob-1.8.8-2.el9.noarch.rpm 2.1 MB/s | 230 kB 00:00 2024-09-12T22:29:57.405 INFO:teuthology.orchestra.run.smithi163.stdout:(132/139): python3-zc-lockfile-2.0-10.el9.noarc 342 kB/s | 20 kB 00:00 2024-09-12T22:29:57.408 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 82/143 2024-09-12T22:29:57.422 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/143 2024-09-12T22:29:57.427 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 79/143 2024-09-12T22:29:57.430 INFO:teuthology.orchestra.run.smithi163.stdout:(133/139): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-12T22:29:57.464 INFO:teuthology.orchestra.run.smithi163.stdout:(134/139): python3-werkzeug-2.0.3-3.el9.1.noarc 2.9 MB/s | 427 kB 00:00 2024-09-12T22:29:57.465 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 80/143 2024-09-12T22:29:57.489 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 83/143 2024-09-12T22:29:57.514 INFO:teuthology.orchestra.run.smithi163.stdout:(135/139): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-09-12T22:29:57.667 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : openblas-0.3.26-2.el9.x86_64 81/143 2024-09-12T22:29:57.695 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 82/143 2024-09-12T22:29:57.714 INFO:teuthology.orchestra.run.smithi163.stdout:(136/139): librados2-19.1.1-314.g086c737f.el9.x 12 MB/s | 3.4 MB 00:00 2024-09-12T22:29:57.753 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/143 2024-09-12T22:29:57.780 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 83/143 2024-09-12T22:29:57.880 INFO:teuthology.orchestra.run.smithi076.stdout: Upgrading : librados2-2:19.1.1-314.g086c737f.el9.x86_64 8/143 2024-09-12T22:29:57.973 INFO:teuthology.orchestra.run.smithi163.stdout:(137/139): openssl-3.2.2-6.el9.x86_64.rpm 3.0 MB/s | 1.4 MB 00:00 2024-09-12T22:29:58.010 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: librados2-2:19.1.1-314.g086c737f.el9.x86_64 8/143 2024-09-12T22:29:58.031 INFO:teuthology.orchestra.run.smithi163.stdout:(138/139): librbd1-19.1.1-314.g086c737f.el9.x86 5.6 MB/s | 3.2 MB 00:00 2024-09-12T22:29:58.039 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : libcephfs2-2:19.1.1-314.g086c737f.el9.x86_64 9/143 2024-09-12T22:29:58.114 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: libcephfs2-2:19.1.1-314.g086c737f.el9.x86_64 9/143 2024-09-12T22:29:58.146 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 84/143 2024-09-12T22:29:58.162 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-rados-2:19.1.1-314.g086c737f.el9.x86_64 10/143 2024-09-12T22:29:58.190 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : libcephsqlite-2:19.1.1-314.g086c737f.el9.x86_64 11/143 2024-09-12T22:29:58.268 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 85/143 2024-09-12T22:29:58.295 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: libcephsqlite-2:19.1.1-314.g086c737f.el9.x86_64 11/143 2024-09-12T22:29:58.316 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : libradosstriper1-2:19.1.1-314.g086c737f.el9.x86_ 12/143 2024-09-12T22:29:58.379 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: libradosstriper1-2:19.1.1-314.g086c737f.el9.x86_ 12/143 2024-09-12T22:29:58.411 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 13/143 2024-09-12T22:29:58.436 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 13/143 2024-09-12T22:29:58.477 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 84/143 2024-09-12T22:29:58.498 INFO:teuthology.orchestra.run.smithi163.stdout:(139/139): openssl-libs-3.2.2-6.el9.x86_64.rpm 3.1 MB/s | 2.4 MB 00:00 2024-09-12T22:29:58.505 INFO:teuthology.orchestra.run.smithi163.stdout:-------------------------------------------------------------------------------- 2024-09-12T22:29:58.505 INFO:teuthology.orchestra.run.smithi163.stdout:Total 6.9 MB/s | 213 MB 00:30 2024-09-12T22:29:58.601 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 85/143 2024-09-12T22:29:58.630 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 14/143 2024-09-12T22:29:58.661 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 14/143 2024-09-12T22:29:58.794 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/143 2024-09-12T22:29:58.898 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/143 2024-09-12T22:29:58.936 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 17/143 2024-09-12T22:29:58.970 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : liboath-2.6.7-2.el9.x86_64 18/143 2024-09-12T22:29:59.044 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 19/143 2024-09-12T22:29:59.088 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 20/143 2024-09-12T22:29:59.132 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-packaging-20.9-5.el9.noarch 21/143 2024-09-12T22:29:59.180 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 22/143 2024-09-12T22:29:59.213 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 23/143 2024-09-12T22:29:59.241 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : lua-5.4.4-4.el9.x86_64 24/143 2024-09-12T22:29:59.311 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 25/143 2024-09-12T22:29:59.372 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 26/143 2024-09-12T22:29:59.411 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 27/143 2024-09-12T22:29:59.454 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 28/143 2024-09-12T22:29:59.534 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 86/143 2024-09-12T22:29:59.540 INFO:teuthology.orchestra.run.smithi163.stdout:Running transaction check 2024-09-12T22:29:59.540 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 29/143 2024-09-12T22:29:59.582 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-ceph-common-2:19.1.1-314.g086c737f.el9.x 30/143 2024-09-12T22:29:59.623 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 87/143 2024-09-12T22:29:59.626 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-ceph-argparse-2:19.1.1-314.g086c737f.el9 31/143 2024-09-12T22:29:59.651 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 88/143 2024-09-12T22:29:59.662 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-cephfs-2:19.1.1-314.g086c737f.el9.x86_64 32/143 2024-09-12T22:29:59.680 INFO:teuthology.orchestra.run.smithi163.stdout:Transaction check succeeded. 2024-09-12T22:29:59.680 INFO:teuthology.orchestra.run.smithi163.stdout:Running transaction test 2024-09-12T22:29:59.684 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 89/143 2024-09-12T22:29:59.732 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 33/143 2024-09-12T22:29:59.777 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : luarocks-3.9.2-5.el9.noarch 34/143 2024-09-12T22:29:59.852 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 35/143 2024-09-12T22:29:59.941 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 86/143 2024-09-12T22:29:59.988 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 36/143 2024-09-12T22:30:00.003 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 90/143 2024-09-12T22:30:00.042 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 87/143 2024-09-12T22:30:00.047 INFO:teuthology.orchestra.run.smithi148.stdout: Upgrading : librbd1-2:19.1.1-314.g086c737f.el9.x86_64 91/143 2024-09-12T22:30:00.047 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 37/143 2024-09-12T22:30:00.075 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 88/143 2024-09-12T22:30:00.108 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 89/143 2024-09-12T22:30:00.138 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: librbd1-2:19.1.1-314.g086c737f.el9.x86_64 91/143 2024-09-12T22:30:00.168 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-rbd-2:19.1.1-314.g086c737f.el9.x86_64 92/143 2024-09-12T22:30:00.209 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 93/143 2024-09-12T22:30:00.444 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 90/143 2024-09-12T22:30:00.496 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : librbd1-2:19.1.1-314.g086c737f.el9.x86_64 91/143 2024-09-12T22:30:00.584 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-rsa-4.9-2.el9.noarch 38/143 2024-09-12T22:30:00.587 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: librbd1-2:19.1.1-314.g086c737f.el9.x86_64 91/143 2024-09-12T22:30:00.617 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-rbd-2:19.1.1-314.g086c737f.el9.x86_64 92/143 2024-09-12T22:30:00.666 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 93/143 2024-09-12T22:30:00.667 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 39/143 2024-09-12T22:30:00.696 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 40/143 2024-09-12T22:30:00.703 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 94/143 2024-09-12T22:30:00.739 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 41/143 2024-09-12T22:30:00.742 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : librgw2-2:19.1.1-314.g086c737f.el9.x86_64 95/143 2024-09-12T22:30:00.785 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : librados-devel-2:19.1.1-314.g086c737f.el9.x86_64 42/143 2024-09-12T22:30:00.813 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: librgw2-2:19.1.1-314.g086c737f.el9.x86_64 95/143 2024-09-12T22:30:00.836 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 43/143 2024-09-12T22:30:00.843 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-rgw-2:19.1.1-314.g086c737f.el9.x86_64 96/143 2024-09-12T22:30:00.990 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 44/143 2024-09-12T22:30:01.047 INFO:teuthology.orchestra.run.smithi076.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 45/143 2024-09-12T22:30:01.101 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 46/143 2024-09-12T22:30:01.171 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 94/143 2024-09-12T22:30:01.174 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 47/143 2024-09-12T22:30:01.206 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 48/143 2024-09-12T22:30:01.207 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : librgw2-2:19.1.1-314.g086c737f.el9.x86_64 95/143 2024-09-12T22:30:01.242 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 49/143 2024-09-12T22:30:01.278 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: librgw2-2:19.1.1-314.g086c737f.el9.x86_64 95/143 2024-09-12T22:30:01.297 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 50/143 2024-09-12T22:30:01.308 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-rgw-2:19.1.1-314.g086c737f.el9.x86_64 96/143 2024-09-12T22:30:01.351 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 51/143 2024-09-12T22:30:01.401 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 52/143 2024-09-12T22:30:01.538 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 53/143 2024-09-12T22:30:01.578 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 54/143 2024-09-12T22:30:01.620 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 55/143 2024-09-12T22:30:01.722 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 56/143 2024-09-12T22:30:01.740 INFO:teuthology.orchestra.run.smithi163.stdout:Transaction test succeeded. 2024-09-12T22:30:01.741 INFO:teuthology.orchestra.run.smithi163.stdout:Running transaction 2024-09-12T22:30:01.754 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 57/143 2024-09-12T22:30:01.803 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 58/143 2024-09-12T22:30:01.844 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 59/143 2024-09-12T22:30:01.869 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 60/143 2024-09-12T22:30:01.965 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 61/143 2024-09-12T22:30:02.097 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 62/143 2024-09-12T22:30:02.135 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 63/143 2024-09-12T22:30:02.163 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 64/143 2024-09-12T22:30:02.199 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 65/143 2024-09-12T22:30:02.229 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 66/143 2024-09-12T22:30:02.264 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 67/143 2024-09-12T22:30:02.298 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 68/143 2024-09-12T22:30:02.339 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 69/143 2024-09-12T22:30:02.382 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 70/143 2024-09-12T22:30:02.469 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 71/143 2024-09-12T22:30:02.521 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 72/143 2024-09-12T22:30:02.552 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 73/143 2024-09-12T22:30:02.655 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 74/143 2024-09-12T22:30:02.711 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 75/143 2024-09-12T22:30:03.138 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-common-2:19.1.1-314.g086c737f.el9.x86_64 97/143 2024-09-12T22:30:03.181 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-common-2:19.1.1-314.g086c737f.el9.x86_64 97/143 2024-09-12T22:30:03.430 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 76/143 2024-09-12T22:30:03.476 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 77/143 2024-09-12T22:30:03.509 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 78/143 2024-09-12T22:30:03.608 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 79/143 2024-09-12T22:30:03.643 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 80/143 2024-09-12T22:30:03.749 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-common-2:19.1.1-314.g086c737f.el9.x86_64 97/143 2024-09-12T22:30:03.785 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-base-2:19.1.1-314.g086c737f.el9.x86_64 98/143 2024-09-12T22:30:03.828 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : openblas-0.3.26-2.el9.x86_64 81/143 2024-09-12T22:30:03.858 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 82/143 2024-09-12T22:30:03.875 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-base-2:19.1.1-314.g086c737f.el9.x86_64 98/143 2024-09-12T22:30:03.876 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-12T22:30:03.876 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-12T22:30:03.876 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T22:30:03.919 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-selinux-2:19.1.1-314.g086c737f.el9.x86_64 99/143 2024-09-12T22:30:03.944 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 83/143 2024-09-12T22:30:04.066 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-common-2:19.1.1-314.g086c737f.el9.x86_64 97/143 2024-09-12T22:30:04.113 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-common-2:19.1.1-314.g086c737f.el9.x86_64 97/143 2024-09-12T22:30:04.593 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 84/143 2024-09-12T22:30:04.697 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-common-2:19.1.1-314.g086c737f.el9.x86_64 97/143 2024-09-12T22:30:04.718 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 85/143 2024-09-12T22:30:04.733 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-base-2:19.1.1-314.g086c737f.el9.x86_64 98/143 2024-09-12T22:30:04.813 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-base-2:19.1.1-314.g086c737f.el9.x86_64 98/143 2024-09-12T22:30:04.813 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-12T22:30:04.813 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-12T22:30:04.813 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:30:04.851 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-selinux-2:19.1.1-314.g086c737f.el9.x86_64 99/143 2024-09-12T22:30:05.994 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 86/143 2024-09-12T22:30:06.083 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 87/143 2024-09-12T22:30:06.110 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 88/143 2024-09-12T22:30:06.144 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 89/143 2024-09-12T22:30:06.452 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 90/143 2024-09-12T22:30:06.502 INFO:teuthology.orchestra.run.smithi076.stdout: Upgrading : librbd1-2:19.1.1-314.g086c737f.el9.x86_64 91/143 2024-09-12T22:30:06.593 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: librbd1-2:19.1.1-314.g086c737f.el9.x86_64 91/143 2024-09-12T22:30:06.632 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-rbd-2:19.1.1-314.g086c737f.el9.x86_64 92/143 2024-09-12T22:30:06.673 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 93/143 2024-09-12T22:30:07.155 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 94/143 2024-09-12T22:30:07.189 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : librgw2-2:19.1.1-314.g086c737f.el9.x86_64 95/143 2024-09-12T22:30:07.259 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: librgw2-2:19.1.1-314.g086c737f.el9.x86_64 95/143 2024-09-12T22:30:07.290 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-rgw-2:19.1.1-314.g086c737f.el9.x86_64 96/143 2024-09-12T22:30:07.370 INFO:teuthology.orchestra.run.smithi163.stdout: Preparing : 1/1 2024-09-12T22:30:07.481 INFO:teuthology.orchestra.run.smithi163.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/143 2024-09-12T22:30:07.541 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/143 2024-09-12T22:30:07.595 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/143 2024-09-12T22:30:07.627 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/143 2024-09-12T22:30:07.653 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/143 2024-09-12T22:30:07.708 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/143 2024-09-12T22:30:08.044 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/143 2024-09-12T22:30:08.146 INFO:teuthology.orchestra.run.smithi163.stdout: Upgrading : librados2-2:19.1.1-314.g086c737f.el9.x86_64 8/143 2024-09-12T22:30:08.269 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: librados2-2:19.1.1-314.g086c737f.el9.x86_64 8/143 2024-09-12T22:30:08.297 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libcephfs2-2:19.1.1-314.g086c737f.el9.x86_64 9/143 2024-09-12T22:30:08.380 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: libcephfs2-2:19.1.1-314.g086c737f.el9.x86_64 9/143 2024-09-12T22:30:08.420 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-rados-2:19.1.1-314.g086c737f.el9.x86_64 10/143 2024-09-12T22:30:08.449 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libcephsqlite-2:19.1.1-314.g086c737f.el9.x86_64 11/143 2024-09-12T22:30:08.536 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: libcephsqlite-2:19.1.1-314.g086c737f.el9.x86_64 11/143 2024-09-12T22:30:08.558 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libradosstriper1-2:19.1.1-314.g086c737f.el9.x86_ 12/143 2024-09-12T22:30:08.613 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: libradosstriper1-2:19.1.1-314.g086c737f.el9.x86_ 12/143 2024-09-12T22:30:08.657 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 13/143 2024-09-12T22:30:08.678 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 13/143 2024-09-12T22:30:08.860 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 14/143 2024-09-12T22:30:08.890 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 14/143 2024-09-12T22:30:08.998 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/143 2024-09-12T22:30:09.093 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/143 2024-09-12T22:30:09.123 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 17/143 2024-09-12T22:30:09.157 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : liboath-2.6.7-2.el9.x86_64 18/143 2024-09-12T22:30:09.231 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 19/143 2024-09-12T22:30:09.283 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 20/143 2024-09-12T22:30:09.317 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-packaging-20.9-5.el9.noarch 21/143 2024-09-12T22:30:09.359 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 22/143 2024-09-12T22:30:09.392 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 23/143 2024-09-12T22:30:09.419 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : lua-5.4.4-4.el9.x86_64 24/143 2024-09-12T22:30:09.489 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 25/143 2024-09-12T22:30:09.542 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 26/143 2024-09-12T22:30:09.571 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: ceph-common-2:19.1.1-314.g086c737f.el9.x86_64 97/143 2024-09-12T22:30:09.582 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 27/143 2024-09-12T22:30:09.603 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : ceph-common-2:19.1.1-314.g086c737f.el9.x86_64 97/143 2024-09-12T22:30:09.625 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 28/143 2024-09-12T22:30:09.709 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 29/143 2024-09-12T22:30:09.743 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-ceph-common-2:19.1.1-314.g086c737f.el9.x 30/143 2024-09-12T22:30:09.787 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-ceph-argparse-2:19.1.1-314.g086c737f.el9 31/143 2024-09-12T22:30:09.815 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-cephfs-2:19.1.1-314.g086c737f.el9.x86_64 32/143 2024-09-12T22:30:09.886 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 33/143 2024-09-12T22:30:09.930 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : luarocks-3.9.2-5.el9.noarch 34/143 2024-09-12T22:30:10.005 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 35/143 2024-09-12T22:30:10.140 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 36/143 2024-09-12T22:30:10.172 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: ceph-common-2:19.1.1-314.g086c737f.el9.x86_64 97/143 2024-09-12T22:30:10.192 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 37/143 2024-09-12T22:30:10.215 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : ceph-base-2:19.1.1-314.g086c737f.el9.x86_64 98/143 2024-09-12T22:30:10.291 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: ceph-base-2:19.1.1-314.g086c737f.el9.x86_64 98/143 2024-09-12T22:30:10.291 INFO:teuthology.orchestra.run.smithi076.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-12T22:30:10.291 INFO:teuthology.orchestra.run.smithi076.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-12T22:30:10.291 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-12T22:30:10.333 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : ceph-selinux-2:19.1.1-314.g086c737f.el9.x86_64 99/143 2024-09-12T22:30:10.721 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-rsa-4.9-2.el9.noarch 38/143 2024-09-12T22:30:10.804 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 39/143 2024-09-12T22:30:10.833 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 40/143 2024-09-12T22:30:10.876 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 41/143 2024-09-12T22:30:10.914 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : librados-devel-2:19.1.1-314.g086c737f.el9.x86_64 42/143 2024-09-12T22:30:10.957 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 43/143 2024-09-12T22:30:11.119 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 44/143 2024-09-12T22:30:11.184 INFO:teuthology.orchestra.run.smithi163.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 45/143 2024-09-12T22:30:11.239 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 46/143 2024-09-12T22:30:11.312 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 47/143 2024-09-12T22:30:11.343 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 48/143 2024-09-12T22:30:11.379 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 49/143 2024-09-12T22:30:11.426 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 50/143 2024-09-12T22:30:11.471 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 51/143 2024-09-12T22:30:11.514 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 52/143 2024-09-12T22:30:11.651 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 53/143 2024-09-12T22:30:11.699 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 54/143 2024-09-12T22:30:11.740 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 55/143 2024-09-12T22:30:11.843 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 56/143 2024-09-12T22:30:11.883 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 57/143 2024-09-12T22:30:11.944 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 58/143 2024-09-12T22:30:11.973 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 59/143 2024-09-12T22:30:11.998 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 60/143 2024-09-12T22:30:12.092 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 61/143 2024-09-12T22:30:12.217 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 62/143 2024-09-12T22:30:12.255 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 63/143 2024-09-12T22:30:12.293 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 64/143 2024-09-12T22:30:12.329 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 65/143 2024-09-12T22:30:12.359 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 66/143 2024-09-12T22:30:12.393 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 67/143 2024-09-12T22:30:12.427 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 68/143 2024-09-12T22:30:12.468 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 69/143 2024-09-12T22:30:12.503 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 70/143 2024-09-12T22:30:12.590 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 71/143 2024-09-12T22:30:12.633 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 72/143 2024-09-12T22:30:12.665 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 73/143 2024-09-12T22:30:12.768 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 74/143 2024-09-12T22:30:12.816 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 75/143 2024-09-12T22:30:13.557 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 76/143 2024-09-12T22:30:13.605 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 77/143 2024-09-12T22:30:13.638 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 78/143 2024-09-12T22:30:13.738 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 79/143 2024-09-12T22:30:13.781 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 80/143 2024-09-12T22:30:13.957 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : openblas-0.3.26-2.el9.x86_64 81/143 2024-09-12T22:30:13.987 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 82/143 2024-09-12T22:30:14.065 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 83/143 2024-09-12T22:30:14.719 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 84/143 2024-09-12T22:30:14.831 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 85/143 2024-09-12T22:30:15.649 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-selinux-2:19.1.1-314.g086c737f.el9.x86_64 99/143 2024-09-12T22:30:15.649 INFO:teuthology.orchestra.run.smithi148.stdout:skipping the directory /sys 2024-09-12T22:30:15.649 INFO:teuthology.orchestra.run.smithi148.stdout:skipping the directory /proc 2024-09-12T22:30:15.649 INFO:teuthology.orchestra.run.smithi148.stdout:skipping the directory /mnt 2024-09-12T22:30:15.649 INFO:teuthology.orchestra.run.smithi148.stdout:skipping the directory /var/tmp 2024-09-12T22:30:15.649 INFO:teuthology.orchestra.run.smithi148.stdout:skipping the directory /home 2024-09-12T22:30:15.649 INFO:teuthology.orchestra.run.smithi148.stdout:skipping the directory /root 2024-09-12T22:30:15.649 INFO:teuthology.orchestra.run.smithi148.stdout:skipping the directory /tmp 2024-09-12T22:30:15.649 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T22:30:15.823 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-volume-2:19.1.1-314.g086c737f.el9.noarch 100/143 2024-09-12T22:30:15.839 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-volume-2:19.1.1-314.g086c737f.el9.noarch 100/143 2024-09-12T22:30:15.839 INFO:teuthology.orchestra.run.smithi148.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T22:30:15.839 INFO:teuthology.orchestra.run.smithi148.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-12T22:30:15.839 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T22:30:16.099 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 86/143 2024-09-12T22:30:16.188 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 87/143 2024-09-12T22:30:16.216 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 88/143 2024-09-12T22:30:16.249 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 89/143 2024-09-12T22:30:16.559 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 90/143 2024-09-12T22:30:16.604 INFO:teuthology.orchestra.run.smithi163.stdout: Upgrading : librbd1-2:19.1.1-314.g086c737f.el9.x86_64 91/143 2024-09-12T22:30:16.703 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: librbd1-2:19.1.1-314.g086c737f.el9.x86_64 91/143 2024-09-12T22:30:16.734 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-rbd-2:19.1.1-314.g086c737f.el9.x86_64 92/143 2024-09-12T22:30:16.770 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 93/143 2024-09-12T22:30:16.826 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-selinux-2:19.1.1-314.g086c737f.el9.x86_64 99/143 2024-09-12T22:30:16.826 INFO:teuthology.orchestra.run.smithi019.stdout:skipping the directory /sys 2024-09-12T22:30:16.826 INFO:teuthology.orchestra.run.smithi019.stdout:skipping the directory /proc 2024-09-12T22:30:16.826 INFO:teuthology.orchestra.run.smithi019.stdout:skipping the directory /mnt 2024-09-12T22:30:16.827 INFO:teuthology.orchestra.run.smithi019.stdout:skipping the directory /var/tmp 2024-09-12T22:30:16.827 INFO:teuthology.orchestra.run.smithi019.stdout:skipping the directory /home 2024-09-12T22:30:16.827 INFO:teuthology.orchestra.run.smithi019.stdout:skipping the directory /root 2024-09-12T22:30:16.827 INFO:teuthology.orchestra.run.smithi019.stdout:skipping the directory /tmp 2024-09-12T22:30:16.827 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:30:17.002 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-volume-2:19.1.1-314.g086c737f.el9.noarch 100/143 2024-09-12T22:30:17.019 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-volume-2:19.1.1-314.g086c737f.el9.noarch 100/143 2024-09-12T22:30:17.019 INFO:teuthology.orchestra.run.smithi019.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T22:30:17.019 INFO:teuthology.orchestra.run.smithi019.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-12T22:30:17.019 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:30:17.258 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 94/143 2024-09-12T22:30:17.290 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : librgw2-2:19.1.1-314.g086c737f.el9.x86_64 95/143 2024-09-12T22:30:17.334 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-osd-2:19.1.1-314.g086c737f.el9.x86_64 101/143 2024-09-12T22:30:17.345 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: librgw2-2:19.1.1-314.g086c737f.el9.x86_64 95/143 2024-09-12T22:30:17.361 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-osd-2:19.1.1-314.g086c737f.el9.x86_64 101/143 2024-09-12T22:30:17.361 INFO:teuthology.orchestra.run.smithi148.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T22:30:17.361 INFO:teuthology.orchestra.run.smithi148.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-12T22:30:17.361 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T22:30:17.361 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T22:30:17.361 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T22:30:17.375 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-rgw-2:19.1.1-314.g086c737f.el9.x86_64 96/143 2024-09-12T22:30:17.593 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-mds-2:19.1.1-314.g086c737f.el9.x86_64 102/143 2024-09-12T22:30:17.617 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-mds-2:19.1.1-314.g086c737f.el9.x86_64 102/143 2024-09-12T22:30:17.617 INFO:teuthology.orchestra.run.smithi148.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T22:30:17.617 INFO:teuthology.orchestra.run.smithi148.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-12T22:30:17.617 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T22:30:17.617 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T22:30:17.617 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T22:30:18.052 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-mon-2:19.1.1-314.g086c737f.el9.x86_64 103/143 2024-09-12T22:30:18.075 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-mon-2:19.1.1-314.g086c737f.el9.x86_64 103/143 2024-09-12T22:30:18.075 INFO:teuthology.orchestra.run.smithi148.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T22:30:18.075 INFO:teuthology.orchestra.run.smithi148.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-12T22:30:18.076 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T22:30:18.076 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T22:30:18.076 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T22:30:18.174 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : automake-1.16.2-8.el9.noarch 104/143 2024-09-12T22:30:18.222 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-ply-3.11-14.el9.noarch 105/143 2024-09-12T22:30:18.278 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 106/143 2024-09-12T22:30:18.464 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 107/143 2024-09-12T22:30:18.520 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 108/143 2024-09-12T22:30:18.562 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-osd-2:19.1.1-314.g086c737f.el9.x86_64 101/143 2024-09-12T22:30:18.591 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-osd-2:19.1.1-314.g086c737f.el9.x86_64 101/143 2024-09-12T22:30:18.591 INFO:teuthology.orchestra.run.smithi019.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T22:30:18.591 INFO:teuthology.orchestra.run.smithi019.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-12T22:30:18.591 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T22:30:18.591 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T22:30:18.591 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:30:18.597 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 109/143 2024-09-12T22:30:18.686 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 110/143 2024-09-12T22:30:18.828 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 111/143 2024-09-12T22:30:18.831 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-mds-2:19.1.1-314.g086c737f.el9.x86_64 102/143 2024-09-12T22:30:18.856 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-mds-2:19.1.1-314.g086c737f.el9.x86_64 102/143 2024-09-12T22:30:18.856 INFO:teuthology.orchestra.run.smithi019.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T22:30:18.856 INFO:teuthology.orchestra.run.smithi019.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-12T22:30:18.856 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T22:30:18.856 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T22:30:18.856 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:30:18.867 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 112/143 2024-09-12T22:30:18.910 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 113/143 2024-09-12T22:30:18.937 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : fuse-2.9.9-16.el9.x86_64 114/143 2024-09-12T22:30:19.299 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: cephadm-2:19.1.1-314.g086c737f.el9.noarch 115/143 2024-09-12T22:30:19.324 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-mon-2:19.1.1-314.g086c737f.el9.x86_64 103/143 2024-09-12T22:30:19.327 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : cephadm-2:19.1.1-314.g086c737f.el9.noarch 115/143 2024-09-12T22:30:19.349 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-mon-2:19.1.1-314.g086c737f.el9.x86_64 103/143 2024-09-12T22:30:19.349 INFO:teuthology.orchestra.run.smithi019.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T22:30:19.350 INFO:teuthology.orchestra.run.smithi019.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-12T22:30:19.350 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T22:30:19.350 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T22:30:19.350 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:30:19.367 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-314.g086c737f.el 116/143 2024-09-12T22:30:19.430 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-314.g086c737f.e 117/143 2024-09-12T22:30:19.464 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : automake-1.16.2-8.el9.noarch 104/143 2024-09-12T22:30:19.467 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-314.g086c737f.el9.noar 118/143 2024-09-12T22:30:19.513 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-ply-3.11-14.el9.noarch 105/143 2024-09-12T22:30:19.577 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 106/143 2024-09-12T22:30:19.639 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-common-2:19.1.1-314.g086c737f.el9.x86_64 97/143 2024-09-12T22:30:19.678 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-common-2:19.1.1-314.g086c737f.el9.x86_64 97/143 2024-09-12T22:30:19.772 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 107/143 2024-09-12T22:30:19.826 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 108/143 2024-09-12T22:30:19.907 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 109/143 2024-09-12T22:30:20.005 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 110/143 2024-09-12T22:30:20.156 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 111/143 2024-09-12T22:30:20.206 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 112/143 2024-09-12T22:30:20.227 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-common-2:19.1.1-314.g086c737f.el9.x86_64 97/143 2024-09-12T22:30:20.241 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 113/143 2024-09-12T22:30:20.267 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-base-2:19.1.1-314.g086c737f.el9.x86_64 98/143 2024-09-12T22:30:20.268 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : fuse-2.9.9-16.el9.x86_64 114/143 2024-09-12T22:30:20.365 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-base-2:19.1.1-314.g086c737f.el9.x86_64 98/143 2024-09-12T22:30:20.365 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-12T22:30:20.365 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-12T22:30:20.365 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-09-12T22:30:20.402 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-selinux-2:19.1.1-314.g086c737f.el9.x86_64 99/143 2024-09-12T22:30:20.524 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-314.g086c737f.el9.noar 118/143 2024-09-12T22:30:20.561 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-314.g086c737f.el9.no 119/143 2024-09-12T22:30:20.724 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: cephadm-2:19.1.1-314.g086c737f.el9.noarch 115/143 2024-09-12T22:30:20.750 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : cephadm-2:19.1.1-314.g086c737f.el9.noarch 115/143 2024-09-12T22:30:20.829 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-314.g086c737f.el 116/143 2024-09-12T22:30:20.846 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-314.g086c737f.e 117/143 2024-09-12T22:30:20.873 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-314.g086c737f.el9.noar 118/143 2024-09-12T22:30:21.521 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-314.g086c737f.el9.no 119/143 2024-09-12T22:30:21.553 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-314.g086c 120/143 2024-09-12T22:30:21.656 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-314.g086c 120/143 2024-09-12T22:30:21.825 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-314.g086c737f.el9 121/143 2024-09-12T22:30:21.855 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-mgr-2:19.1.1-314.g086c737f.el9.x86_64 122/143 2024-09-12T22:30:21.878 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-mgr-2:19.1.1-314.g086c737f.el9.x86_64 122/143 2024-09-12T22:30:21.878 INFO:teuthology.orchestra.run.smithi148.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T22:30:21.878 INFO:teuthology.orchestra.run.smithi148.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-12T22:30:21.878 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T22:30:21.879 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T22:30:21.879 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T22:30:21.922 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-mgr-rook-2:19.1.1-314.g086c737f.el9.noarch 123/143 2024-09-12T22:30:21.934 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-314.g086c737f.el9.noarch 123/143 2024-09-12T22:30:21.981 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-314.g086c737f.el9.noar 118/143 2024-09-12T22:30:22.016 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-314.g086c737f.el9.no 119/143 2024-09-12T22:30:22.032 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-2:19.1.1-314.g086c737f.el9.x86_64 124/143 2024-09-12T22:30:22.059 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: ceph-selinux-2:19.1.1-314.g086c737f.el9.x86_64 99/143 2024-09-12T22:30:22.059 INFO:teuthology.orchestra.run.smithi076.stdout:skipping the directory /sys 2024-09-12T22:30:22.059 INFO:teuthology.orchestra.run.smithi076.stdout:skipping the directory /proc 2024-09-12T22:30:22.059 INFO:teuthology.orchestra.run.smithi076.stdout:skipping the directory /mnt 2024-09-12T22:30:22.059 INFO:teuthology.orchestra.run.smithi076.stdout:skipping the directory /var/tmp 2024-09-12T22:30:22.059 INFO:teuthology.orchestra.run.smithi076.stdout:skipping the directory /home 2024-09-12T22:30:22.059 INFO:teuthology.orchestra.run.smithi076.stdout:skipping the directory /root 2024-09-12T22:30:22.059 INFO:teuthology.orchestra.run.smithi076.stdout:skipping the directory /tmp 2024-09-12T22:30:22.059 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-12T22:30:22.087 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-fuse-2:19.1.1-314.g086c737f.el9.x86_64 125/143 2024-09-12T22:30:22.245 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : ceph-volume-2:19.1.1-314.g086c737f.el9.noarch 100/143 2024-09-12T22:30:22.262 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: ceph-volume-2:19.1.1-314.g086c737f.el9.noarch 100/143 2024-09-12T22:30:22.262 INFO:teuthology.orchestra.run.smithi076.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T22:30:22.262 INFO:teuthology.orchestra.run.smithi076.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-12T22:30:22.262 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-12T22:30:23.018 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libtool-2.4.6-46.el9.x86_64 126/143 2024-09-12T22:30:23.037 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-314.g086c737f.el9.no 119/143 2024-09-12T22:30:23.049 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-radosgw-2:19.1.1-314.g086c737f.el9.x86_64 127/143 2024-09-12T22:30:23.066 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-314.g086c 120/143 2024-09-12T22:30:23.073 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-314.g086c737f.el9.x86_64 127/143 2024-09-12T22:30:23.073 INFO:teuthology.orchestra.run.smithi148.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T22:30:23.073 INFO:teuthology.orchestra.run.smithi148.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-12T22:30:23.074 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T22:30:23.074 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T22:30:23.074 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T22:30:23.117 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-314.g086c73 128/143 2024-09-12T22:30:23.139 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-314.g086c73 128/143 2024-09-12T22:30:23.139 INFO:teuthology.orchestra.run.smithi148.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T22:30:23.140 INFO:teuthology.orchestra.run.smithi148.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-12T22:30:23.140 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T22:30:23.175 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-314.g086c 120/143 2024-09-12T22:30:23.345 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-314.g086c737f.el9 121/143 2024-09-12T22:30:23.368 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-mgr-2:19.1.1-314.g086c737f.el9.x86_64 122/143 2024-09-12T22:30:23.394 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-mgr-2:19.1.1-314.g086c737f.el9.x86_64 122/143 2024-09-12T22:30:23.394 INFO:teuthology.orchestra.run.smithi019.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T22:30:23.394 INFO:teuthology.orchestra.run.smithi019.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-12T22:30:23.394 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T22:30:23.394 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T22:30:23.394 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:30:23.442 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : rbd-mirror-2:19.1.1-314.g086c737f.el9.x86_64 129/143 2024-09-12T22:30:23.444 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-mgr-rook-2:19.1.1-314.g086c737f.el9.noarch 123/143 2024-09-12T22:30:23.456 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-314.g086c737f.el9.noarch 123/143 2024-09-12T22:30:23.465 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: rbd-mirror-2:19.1.1-314.g086c737f.el9.x86_64 129/143 2024-09-12T22:30:23.465 INFO:teuthology.orchestra.run.smithi148.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T22:30:23.465 INFO:teuthology.orchestra.run.smithi148.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-12T22:30:23.466 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T22:30:23.466 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T22:30:23.466 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T22:30:23.559 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-2:19.1.1-314.g086c737f.el9.x86_64 124/143 2024-09-12T22:30:23.622 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-fuse-2:19.1.1-314.g086c737f.el9.x86_64 125/143 2024-09-12T22:30:23.756 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : ceph-osd-2:19.1.1-314.g086c737f.el9.x86_64 101/143 2024-09-12T22:30:23.783 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: ceph-osd-2:19.1.1-314.g086c737f.el9.x86_64 101/143 2024-09-12T22:30:23.783 INFO:teuthology.orchestra.run.smithi076.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T22:30:23.783 INFO:teuthology.orchestra.run.smithi076.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-12T22:30:23.783 INFO:teuthology.orchestra.run.smithi076.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T22:30:23.784 INFO:teuthology.orchestra.run.smithi076.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T22:30:23.784 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-12T22:30:24.007 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : ceph-mds-2:19.1.1-314.g086c737f.el9.x86_64 102/143 2024-09-12T22:30:24.031 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: ceph-mds-2:19.1.1-314.g086c737f.el9.x86_64 102/143 2024-09-12T22:30:24.031 INFO:teuthology.orchestra.run.smithi076.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T22:30:24.031 INFO:teuthology.orchestra.run.smithi076.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-12T22:30:24.031 INFO:teuthology.orchestra.run.smithi076.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T22:30:24.031 INFO:teuthology.orchestra.run.smithi076.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T22:30:24.031 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-12T22:30:24.474 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : ceph-mon-2:19.1.1-314.g086c737f.el9.x86_64 103/143 2024-09-12T22:30:24.497 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: ceph-mon-2:19.1.1-314.g086c737f.el9.x86_64 103/143 2024-09-12T22:30:24.498 INFO:teuthology.orchestra.run.smithi076.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T22:30:24.498 INFO:teuthology.orchestra.run.smithi076.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-12T22:30:24.498 INFO:teuthology.orchestra.run.smithi076.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T22:30:24.498 INFO:teuthology.orchestra.run.smithi076.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T22:30:24.498 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-12T22:30:24.615 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libtool-2.4.6-46.el9.x86_64 126/143 2024-09-12T22:30:24.621 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : automake-1.16.2-8.el9.noarch 104/143 2024-09-12T22:30:24.655 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-radosgw-2:19.1.1-314.g086c737f.el9.x86_64 127/143 2024-09-12T22:30:24.677 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-ply-3.11-14.el9.noarch 105/143 2024-09-12T22:30:24.680 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-314.g086c737f.el9.x86_64 127/143 2024-09-12T22:30:24.680 INFO:teuthology.orchestra.run.smithi019.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T22:30:24.680 INFO:teuthology.orchestra.run.smithi019.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-12T22:30:24.681 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T22:30:24.681 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T22:30:24.681 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:30:24.722 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-314.g086c73 128/143 2024-09-12T22:30:24.733 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 106/143 2024-09-12T22:30:24.746 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-314.g086c73 128/143 2024-09-12T22:30:24.747 INFO:teuthology.orchestra.run.smithi019.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T22:30:24.747 INFO:teuthology.orchestra.run.smithi019.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-12T22:30:24.747 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:30:24.917 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 107/143 2024-09-12T22:30:24.975 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 108/143 2024-09-12T22:30:25.061 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 109/143 2024-09-12T22:30:25.064 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : rbd-mirror-2:19.1.1-314.g086c737f.el9.x86_64 129/143 2024-09-12T22:30:25.089 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: rbd-mirror-2:19.1.1-314.g086c737f.el9.x86_64 129/143 2024-09-12T22:30:25.089 INFO:teuthology.orchestra.run.smithi019.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T22:30:25.089 INFO:teuthology.orchestra.run.smithi019.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-12T22:30:25.090 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T22:30:25.090 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T22:30:25.090 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:30:25.159 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 110/143 2024-09-12T22:30:25.304 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 111/143 2024-09-12T22:30:25.347 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 112/143 2024-09-12T22:30:25.382 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 113/143 2024-09-12T22:30:25.409 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : fuse-2.9.9-16.el9.x86_64 114/143 2024-09-12T22:30:25.880 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: cephadm-2:19.1.1-314.g086c737f.el9.noarch 115/143 2024-09-12T22:30:25.909 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : cephadm-2:19.1.1-314.g086c737f.el9.noarch 115/143 2024-09-12T22:30:25.940 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-314.g086c737f.el 116/143 2024-09-12T22:30:26.003 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-314.g086c737f.e 117/143 2024-09-12T22:30:26.032 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-314.g086c737f.el9.noar 118/143 2024-09-12T22:30:27.072 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-314.g086c737f.el9.noar 118/143 2024-09-12T22:30:27.100 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-314.g086c737f.el9.no 119/143 2024-09-12T22:30:28.038 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-test-2:19.1.1-314.g086c737f.el9.x86_64 130/143 2024-09-12T22:30:28.062 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-314.g086c737f.el9.no 119/143 2024-09-12T22:30:28.078 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : rbd-fuse-2:19.1.1-314.g086c737f.el9.x86_64 131/143 2024-09-12T22:30:28.092 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-314.g086c 120/143 2024-09-12T22:30:28.128 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : rbd-nbd-2:19.1.1-314.g086c737f.el9.x86_64 132/143 2024-09-12T22:30:28.160 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 133/143 2024-09-12T22:30:28.187 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 134/143 2024-09-12T22:30:28.193 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-314.g086c 120/143 2024-09-12T22:30:28.353 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-314.g086c737f.el9 121/143 2024-09-12T22:30:28.394 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : ceph-mgr-2:19.1.1-314.g086c737f.el9.x86_64 122/143 2024-09-12T22:30:28.419 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: ceph-mgr-2:19.1.1-314.g086c737f.el9.x86_64 122/143 2024-09-12T22:30:28.419 INFO:teuthology.orchestra.run.smithi076.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T22:30:28.420 INFO:teuthology.orchestra.run.smithi076.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-12T22:30:28.420 INFO:teuthology.orchestra.run.smithi076.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T22:30:28.420 INFO:teuthology.orchestra.run.smithi076.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T22:30:28.420 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-12T22:30:28.470 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : ceph-mgr-rook-2:19.1.1-314.g086c737f.el9.noarch 123/143 2024-09-12T22:30:28.482 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-314.g086c737f.el9.noarch 123/143 2024-09-12T22:30:28.581 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : ceph-2:19.1.1-314.g086c737f.el9.x86_64 124/143 2024-09-12T22:30:28.632 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : ceph-fuse-2:19.1.1-314.g086c737f.el9.x86_64 125/143 2024-09-12T22:30:29.037 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libcephfs-devel-2:19.1.1-314.g086c737f.el9.x86_6 135/143 2024-09-12T22:30:29.137 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 136/143 2024-09-12T22:30:29.197 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 137/143 2024-09-12T22:30:29.305 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : flex-2.6.4-9.el9.x86_64 138/143 2024-09-12T22:30:29.340 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : bison-3.7.4-5.el9.x86_64 139/143 2024-09-12T22:30:29.366 INFO:teuthology.orchestra.run.smithi148.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 140/143 2024-09-12T22:30:29.367 INFO:teuthology.orchestra.run.smithi148.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 141/143 2024-09-12T22:30:29.450 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 141/143 2024-09-12T22:30:29.450 INFO:teuthology.orchestra.run.smithi148.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 142/143 2024-09-12T22:30:29.541 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 142/143 2024-09-12T22:30:29.559 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : libtool-2.4.6-46.el9.x86_64 126/143 2024-09-12T22:30:29.592 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : ceph-radosgw-2:19.1.1-314.g086c737f.el9.x86_64 127/143 2024-09-12T22:30:29.607 INFO:teuthology.orchestra.run.smithi148.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 143/143 2024-09-12T22:30:29.614 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-314.g086c737f.el9.x86_64 127/143 2024-09-12T22:30:29.615 INFO:teuthology.orchestra.run.smithi076.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T22:30:29.615 INFO:teuthology.orchestra.run.smithi076.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-12T22:30:29.615 INFO:teuthology.orchestra.run.smithi076.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T22:30:29.615 INFO:teuthology.orchestra.run.smithi076.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T22:30:29.615 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-12T22:30:29.657 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-314.g086c73 128/143 2024-09-12T22:30:29.680 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-314.g086c73 128/143 2024-09-12T22:30:29.681 INFO:teuthology.orchestra.run.smithi076.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T22:30:29.681 INFO:teuthology.orchestra.run.smithi076.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-12T22:30:29.681 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-12T22:30:29.977 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-test-2:19.1.1-314.g086c737f.el9.x86_64 130/143 2024-09-12T22:30:29.991 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : rbd-mirror-2:19.1.1-314.g086c737f.el9.x86_64 129/143 2024-09-12T22:30:30.014 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: rbd-mirror-2:19.1.1-314.g086c737f.el9.x86_64 129/143 2024-09-12T22:30:30.015 INFO:teuthology.orchestra.run.smithi076.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T22:30:30.015 INFO:teuthology.orchestra.run.smithi076.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-12T22:30:30.015 INFO:teuthology.orchestra.run.smithi076.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T22:30:30.015 INFO:teuthology.orchestra.run.smithi076.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T22:30:30.015 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-12T22:30:30.018 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : rbd-fuse-2:19.1.1-314.g086c737f.el9.x86_64 131/143 2024-09-12T22:30:30.059 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : rbd-nbd-2:19.1.1-314.g086c737f.el9.x86_64 132/143 2024-09-12T22:30:30.091 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 133/143 2024-09-12T22:30:30.117 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 134/143 2024-09-12T22:30:31.033 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libcephfs-devel-2:19.1.1-314.g086c737f.el9.x86_6 135/143 2024-09-12T22:30:31.118 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 136/143 2024-09-12T22:30:31.178 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 137/143 2024-09-12T22:30:31.287 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : flex-2.6.4-9.el9.x86_64 138/143 2024-09-12T22:30:31.321 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : bison-3.7.4-5.el9.x86_64 139/143 2024-09-12T22:30:31.356 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 140/143 2024-09-12T22:30:31.356 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 141/143 2024-09-12T22:30:31.448 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 141/143 2024-09-12T22:30:31.448 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 142/143 2024-09-12T22:30:31.533 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 142/143 2024-09-12T22:30:31.600 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 143/143 2024-09-12T22:30:32.032 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-selinux-2:19.1.1-314.g086c737f.el9.x86_64 99/143 2024-09-12T22:30:32.032 INFO:teuthology.orchestra.run.smithi163.stdout:skipping the directory /sys 2024-09-12T22:30:32.032 INFO:teuthology.orchestra.run.smithi163.stdout:skipping the directory /proc 2024-09-12T22:30:32.033 INFO:teuthology.orchestra.run.smithi163.stdout:skipping the directory /mnt 2024-09-12T22:30:32.033 INFO:teuthology.orchestra.run.smithi163.stdout:skipping the directory /var/tmp 2024-09-12T22:30:32.033 INFO:teuthology.orchestra.run.smithi163.stdout:skipping the directory /home 2024-09-12T22:30:32.033 INFO:teuthology.orchestra.run.smithi163.stdout:skipping the directory /root 2024-09-12T22:30:32.033 INFO:teuthology.orchestra.run.smithi163.stdout:skipping the directory /tmp 2024-09-12T22:30:32.034 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-09-12T22:30:32.208 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-volume-2:19.1.1-314.g086c737f.el9.noarch 100/143 2024-09-12T22:30:32.226 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-volume-2:19.1.1-314.g086c737f.el9.noarch 100/143 2024-09-12T22:30:32.226 INFO:teuthology.orchestra.run.smithi163.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T22:30:32.226 INFO:teuthology.orchestra.run.smithi163.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-12T22:30:32.226 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-09-12T22:30:33.728 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-osd-2:19.1.1-314.g086c737f.el9.x86_64 101/143 2024-09-12T22:30:33.756 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-osd-2:19.1.1-314.g086c737f.el9.x86_64 101/143 2024-09-12T22:30:33.756 INFO:teuthology.orchestra.run.smithi163.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T22:30:33.756 INFO:teuthology.orchestra.run.smithi163.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-12T22:30:33.756 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T22:30:33.756 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T22:30:33.756 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-09-12T22:30:33.979 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-mds-2:19.1.1-314.g086c737f.el9.x86_64 102/143 2024-09-12T22:30:34.003 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-mds-2:19.1.1-314.g086c737f.el9.x86_64 102/143 2024-09-12T22:30:34.003 INFO:teuthology.orchestra.run.smithi163.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T22:30:34.003 INFO:teuthology.orchestra.run.smithi163.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-12T22:30:34.003 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T22:30:34.003 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T22:30:34.003 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-09-12T22:30:34.441 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-mon-2:19.1.1-314.g086c737f.el9.x86_64 103/143 2024-09-12T22:30:34.465 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-mon-2:19.1.1-314.g086c737f.el9.x86_64 103/143 2024-09-12T22:30:34.465 INFO:teuthology.orchestra.run.smithi163.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T22:30:34.465 INFO:teuthology.orchestra.run.smithi163.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-12T22:30:34.465 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T22:30:34.466 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T22:30:34.466 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-09-12T22:30:34.585 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : automake-1.16.2-8.el9.noarch 104/143 2024-09-12T22:30:34.594 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : ceph-test-2:19.1.1-314.g086c737f.el9.x86_64 130/143 2024-09-12T22:30:34.636 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : rbd-fuse-2:19.1.1-314.g086c737f.el9.x86_64 131/143 2024-09-12T22:30:34.643 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-ply-3.11-14.el9.noarch 105/143 2024-09-12T22:30:34.685 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : rbd-nbd-2:19.1.1-314.g086c737f.el9.x86_64 132/143 2024-09-12T22:30:34.698 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 106/143 2024-09-12T22:30:34.717 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 133/143 2024-09-12T22:30:34.743 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 134/143 2024-09-12T22:30:34.851 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 143/143 2024-09-12T22:30:34.851 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-2:19.1.1-314.g086c737f.el9.x86_64 1/143 2024-09-12T22:30:34.852 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-base-2:19.1.1-314.g086c737f.el9.x86_64 2/143 2024-09-12T22:30:34.852 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-common-2:19.1.1-314.g086c737f.el9.x86_64 3/143 2024-09-12T22:30:34.852 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-fuse-2:19.1.1-314.g086c737f.el9.x86_64 4/143 2024-09-12T22:30:34.852 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-314.g086c73 5/143 2024-09-12T22:30:34.852 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-mds-2:19.1.1-314.g086c737f.el9.x86_64 6/143 2024-09-12T22:30:34.852 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-mgr-2:19.1.1-314.g086c737f.el9.x86_64 7/143 2024-09-12T22:30:34.852 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-mon-2:19.1.1-314.g086c737f.el9.x86_64 8/143 2024-09-12T22:30:34.852 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-osd-2:19.1.1-314.g086c737f.el9.x86_64 9/143 2024-09-12T22:30:34.852 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-radosgw-2:19.1.1-314.g086c737f.el9.x86_64 10/143 2024-09-12T22:30:34.852 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-selinux-2:19.1.1-314.g086c737f.el9.x86_64 11/143 2024-09-12T22:30:34.852 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-test-2:19.1.1-314.g086c737f.el9.x86_64 12/143 2024-09-12T22:30:34.852 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libcephfs-devel-2:19.1.1-314.g086c737f.el9.x86_6 13/143 2024-09-12T22:30:34.853 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libcephfs2-2:19.1.1-314.g086c737f.el9.x86_64 14/143 2024-09-12T22:30:34.853 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libcephsqlite-2:19.1.1-314.g086c737f.el9.x86_64 15/143 2024-09-12T22:30:34.853 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : librados-devel-2:19.1.1-314.g086c737f.el9.x86_64 16/143 2024-09-12T22:30:34.853 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libradosstriper1-2:19.1.1-314.g086c737f.el9.x86_ 17/143 2024-09-12T22:30:34.853 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : librgw2-2:19.1.1-314.g086c737f.el9.x86_64 18/143 2024-09-12T22:30:34.853 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-ceph-argparse-2:19.1.1-314.g086c737f.el9 19/143 2024-09-12T22:30:34.853 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-ceph-common-2:19.1.1-314.g086c737f.el9.x 20/143 2024-09-12T22:30:34.853 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-cephfs-2:19.1.1-314.g086c737f.el9.x86_64 21/143 2024-09-12T22:30:34.853 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-rados-2:19.1.1-314.g086c737f.el9.x86_64 22/143 2024-09-12T22:30:34.853 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-rbd-2:19.1.1-314.g086c737f.el9.x86_64 23/143 2024-09-12T22:30:34.853 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-rgw-2:19.1.1-314.g086c737f.el9.x86_64 24/143 2024-09-12T22:30:34.853 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : rbd-fuse-2:19.1.1-314.g086c737f.el9.x86_64 25/143 2024-09-12T22:30:34.854 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : rbd-mirror-2:19.1.1-314.g086c737f.el9.x86_64 26/143 2024-09-12T22:30:34.854 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : rbd-nbd-2:19.1.1-314.g086c737f.el9.x86_64 27/143 2024-09-12T22:30:34.854 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-314.g086c737f.e 28/143 2024-09-12T22:30:34.854 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-314.g086c737f.el9.noar 29/143 2024-09-12T22:30:34.854 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-314.g086c737f.el9.no 30/143 2024-09-12T22:30:34.854 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-314.g086c 31/143 2024-09-12T22:30:34.854 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-314.g086c737f.el9 32/143 2024-09-12T22:30:34.854 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-mgr-rook-2:19.1.1-314.g086c737f.el9.noarch 33/143 2024-09-12T22:30:34.854 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-314.g086c737f.el 34/143 2024-09-12T22:30:34.854 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-volume-2:19.1.1-314.g086c737f.el9.noarch 35/143 2024-09-12T22:30:34.854 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : cephadm-2:19.1.1-314.g086c737f.el9.noarch 36/143 2024-09-12T22:30:34.854 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 37/143 2024-09-12T22:30:34.855 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 38/143 2024-09-12T22:30:34.855 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 39/143 2024-09-12T22:30:34.855 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 40/143 2024-09-12T22:30:34.855 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 41/143 2024-09-12T22:30:34.855 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-ply-3.11-14.el9.noarch 42/143 2024-09-12T22:30:34.855 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 43/143 2024-09-12T22:30:34.855 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 44/143 2024-09-12T22:30:34.855 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 45/143 2024-09-12T22:30:34.855 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : automake-1.16.2-8.el9.noarch 46/143 2024-09-12T22:30:34.855 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : bison-3.7.4-5.el9.x86_64 47/143 2024-09-12T22:30:34.855 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 48/143 2024-09-12T22:30:34.855 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 49/143 2024-09-12T22:30:34.856 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : flex-2.6.4-9.el9.x86_64 50/143 2024-09-12T22:30:34.856 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 51/143 2024-09-12T22:30:34.856 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 52/143 2024-09-12T22:30:34.856 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 53/143 2024-09-12T22:30:34.856 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 54/143 2024-09-12T22:30:34.856 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 55/143 2024-09-12T22:30:34.856 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 56/143 2024-09-12T22:30:34.856 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 57/143 2024-09-12T22:30:34.856 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 58/143 2024-09-12T22:30:34.856 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 59/143 2024-09-12T22:30:34.856 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 60/143 2024-09-12T22:30:34.856 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 61/143 2024-09-12T22:30:34.857 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : lua-5.4.4-4.el9.x86_64 62/143 2024-09-12T22:30:34.857 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 63/143 2024-09-12T22:30:34.857 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 64/143 2024-09-12T22:30:34.857 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 65/143 2024-09-12T22:30:34.857 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 66/143 2024-09-12T22:30:34.857 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 67/143 2024-09-12T22:30:34.857 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 68/143 2024-09-12T22:30:34.857 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 69/143 2024-09-12T22:30:34.857 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 70/143 2024-09-12T22:30:34.857 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 71/143 2024-09-12T22:30:34.857 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 72/143 2024-09-12T22:30:34.857 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 73/143 2024-09-12T22:30:34.857 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 74/143 2024-09-12T22:30:34.858 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 75/143 2024-09-12T22:30:34.858 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 76/143 2024-09-12T22:30:34.858 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 77/143 2024-09-12T22:30:34.858 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 78/143 2024-09-12T22:30:34.858 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 79/143 2024-09-12T22:30:34.858 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 80/143 2024-09-12T22:30:34.858 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 81/143 2024-09-12T22:30:34.858 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 82/143 2024-09-12T22:30:34.858 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/143 2024-09-12T22:30:34.858 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 84/143 2024-09-12T22:30:34.858 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 85/143 2024-09-12T22:30:34.858 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 86/143 2024-09-12T22:30:34.859 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 87/143 2024-09-12T22:30:34.859 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 88/143 2024-09-12T22:30:34.859 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 89/143 2024-09-12T22:30:34.859 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 90/143 2024-09-12T22:30:34.859 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 91/143 2024-09-12T22:30:34.859 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 92/143 2024-09-12T22:30:34.859 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 93/143 2024-09-12T22:30:34.859 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 94/143 2024-09-12T22:30:34.859 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 95/143 2024-09-12T22:30:34.859 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 96/143 2024-09-12T22:30:34.859 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 97/143 2024-09-12T22:30:34.859 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 98/143 2024-09-12T22:30:34.859 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 99/143 2024-09-12T22:30:34.860 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 100/143 2024-09-12T22:30:34.860 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 101/143 2024-09-12T22:30:34.860 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 102/143 2024-09-12T22:30:34.860 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 103/143 2024-09-12T22:30:34.860 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 104/143 2024-09-12T22:30:34.860 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 105/143 2024-09-12T22:30:34.860 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 106/143 2024-09-12T22:30:34.860 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 107/143 2024-09-12T22:30:34.860 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 108/143 2024-09-12T22:30:34.860 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 109/143 2024-09-12T22:30:34.860 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 110/143 2024-09-12T22:30:34.860 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 111/143 2024-09-12T22:30:34.861 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 112/143 2024-09-12T22:30:34.861 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 113/143 2024-09-12T22:30:34.861 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 114/143 2024-09-12T22:30:34.861 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 115/143 2024-09-12T22:30:34.861 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 116/143 2024-09-12T22:30:34.861 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 117/143 2024-09-12T22:30:34.861 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 118/143 2024-09-12T22:30:34.861 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 119/143 2024-09-12T22:30:34.861 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 120/143 2024-09-12T22:30:34.861 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 121/143 2024-09-12T22:30:34.861 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 122/143 2024-09-12T22:30:34.861 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 123/143 2024-09-12T22:30:34.861 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 124/143 2024-09-12T22:30:34.862 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 125/143 2024-09-12T22:30:34.862 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 126/143 2024-09-12T22:30:34.862 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 127/143 2024-09-12T22:30:34.862 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 128/143 2024-09-12T22:30:34.862 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 129/143 2024-09-12T22:30:34.862 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 130/143 2024-09-12T22:30:34.862 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 131/143 2024-09-12T22:30:34.862 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 132/143 2024-09-12T22:30:34.862 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 133/143 2024-09-12T22:30:34.862 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : re2-1:20211101-20.el9.x86_64 134/143 2024-09-12T22:30:34.862 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 135/143 2024-09-12T22:30:34.862 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : librados2-2:19.1.1-314.g086c737f.el9.x86_64 136/143 2024-09-12T22:30:34.862 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 137/143 2024-09-12T22:30:34.863 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : librbd1-2:19.1.1-314.g086c737f.el9.x86_64 138/143 2024-09-12T22:30:34.863 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 139/143 2024-09-12T22:30:34.863 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 140/143 2024-09-12T22:30:34.863 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 141/143 2024-09-12T22:30:34.863 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 142/143 2024-09-12T22:30:34.896 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 107/143 2024-09-12T22:30:34.940 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 108/143 2024-09-12T22:30:35.017 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 109/143 2024-09-12T22:30:35.107 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 110/143 2024-09-12T22:30:35.249 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 111/143 2024-09-12T22:30:35.299 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 112/143 2024-09-12T22:30:35.347 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 113/143 2024-09-12T22:30:35.375 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : fuse-2.9.9-16.el9.x86_64 114/143 2024-09-12T22:30:35.567 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : libcephfs-devel-2:19.1.1-314.g086c737f.el9.x86_6 135/143 2024-09-12T22:30:35.661 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 136/143 2024-09-12T22:30:35.713 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 137/143 2024-09-12T22:30:35.771 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: cephadm-2:19.1.1-314.g086c737f.el9.noarch 115/143 2024-09-12T22:30:35.791 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : cephadm-2:19.1.1-314.g086c737f.el9.noarch 115/143 2024-09-12T22:30:35.822 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-314.g086c737f.el 116/143 2024-09-12T22:30:35.824 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : flex-2.6.4-9.el9.x86_64 138/143 2024-09-12T22:30:35.857 INFO:teuthology.orchestra.run.smithi076.stdout: Installing : bison-3.7.4-5.el9.x86_64 139/143 2024-09-12T22:30:35.885 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-314.g086c737f.e 117/143 2024-09-12T22:30:35.907 INFO:teuthology.orchestra.run.smithi076.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 140/143 2024-09-12T22:30:35.907 INFO:teuthology.orchestra.run.smithi076.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 141/143 2024-09-12T22:30:35.914 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-314.g086c737f.el9.noar 118/143 2024-09-12T22:30:36.000 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 141/143 2024-09-12T22:30:36.000 INFO:teuthology.orchestra.run.smithi076.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 142/143 2024-09-12T22:30:36.089 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 142/143 2024-09-12T22:30:36.157 INFO:teuthology.orchestra.run.smithi076.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 143/143 2024-09-12T22:30:36.935 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 143/143 2024-09-12T22:30:36.936 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-2:19.1.1-314.g086c737f.el9.x86_64 1/143 2024-09-12T22:30:36.936 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-base-2:19.1.1-314.g086c737f.el9.x86_64 2/143 2024-09-12T22:30:36.936 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-common-2:19.1.1-314.g086c737f.el9.x86_64 3/143 2024-09-12T22:30:36.936 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-fuse-2:19.1.1-314.g086c737f.el9.x86_64 4/143 2024-09-12T22:30:36.936 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-314.g086c73 5/143 2024-09-12T22:30:36.936 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-mds-2:19.1.1-314.g086c737f.el9.x86_64 6/143 2024-09-12T22:30:36.936 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-mgr-2:19.1.1-314.g086c737f.el9.x86_64 7/143 2024-09-12T22:30:36.936 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-mon-2:19.1.1-314.g086c737f.el9.x86_64 8/143 2024-09-12T22:30:36.936 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-osd-2:19.1.1-314.g086c737f.el9.x86_64 9/143 2024-09-12T22:30:36.936 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-radosgw-2:19.1.1-314.g086c737f.el9.x86_64 10/143 2024-09-12T22:30:36.936 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-selinux-2:19.1.1-314.g086c737f.el9.x86_64 11/143 2024-09-12T22:30:36.936 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-test-2:19.1.1-314.g086c737f.el9.x86_64 12/143 2024-09-12T22:30:36.937 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libcephfs-devel-2:19.1.1-314.g086c737f.el9.x86_6 13/143 2024-09-12T22:30:36.937 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libcephfs2-2:19.1.1-314.g086c737f.el9.x86_64 14/143 2024-09-12T22:30:36.937 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libcephsqlite-2:19.1.1-314.g086c737f.el9.x86_64 15/143 2024-09-12T22:30:36.937 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : librados-devel-2:19.1.1-314.g086c737f.el9.x86_64 16/143 2024-09-12T22:30:36.937 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libradosstriper1-2:19.1.1-314.g086c737f.el9.x86_ 17/143 2024-09-12T22:30:36.937 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : librgw2-2:19.1.1-314.g086c737f.el9.x86_64 18/143 2024-09-12T22:30:36.937 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-ceph-argparse-2:19.1.1-314.g086c737f.el9 19/143 2024-09-12T22:30:36.937 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-ceph-common-2:19.1.1-314.g086c737f.el9.x 20/143 2024-09-12T22:30:36.937 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-cephfs-2:19.1.1-314.g086c737f.el9.x86_64 21/143 2024-09-12T22:30:36.937 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-rados-2:19.1.1-314.g086c737f.el9.x86_64 22/143 2024-09-12T22:30:36.937 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-rbd-2:19.1.1-314.g086c737f.el9.x86_64 23/143 2024-09-12T22:30:36.937 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-rgw-2:19.1.1-314.g086c737f.el9.x86_64 24/143 2024-09-12T22:30:36.937 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : rbd-fuse-2:19.1.1-314.g086c737f.el9.x86_64 25/143 2024-09-12T22:30:36.938 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : rbd-mirror-2:19.1.1-314.g086c737f.el9.x86_64 26/143 2024-09-12T22:30:36.938 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : rbd-nbd-2:19.1.1-314.g086c737f.el9.x86_64 27/143 2024-09-12T22:30:36.948 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-314.g086c737f.e 28/143 2024-09-12T22:30:36.949 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-314.g086c737f.el9.noar 29/143 2024-09-12T22:30:36.949 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-314.g086c737f.el9.no 30/143 2024-09-12T22:30:36.949 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-314.g086c 31/143 2024-09-12T22:30:36.949 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-314.g086c737f.el9 32/143 2024-09-12T22:30:36.949 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-mgr-rook-2:19.1.1-314.g086c737f.el9.noarch 33/143 2024-09-12T22:30:36.949 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-314.g086c737f.el 34/143 2024-09-12T22:30:36.949 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-volume-2:19.1.1-314.g086c737f.el9.noarch 35/143 2024-09-12T22:30:36.949 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : cephadm-2:19.1.1-314.g086c737f.el9.noarch 36/143 2024-09-12T22:30:36.949 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 37/143 2024-09-12T22:30:36.949 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 38/143 2024-09-12T22:30:36.949 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 39/143 2024-09-12T22:30:36.949 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 40/143 2024-09-12T22:30:36.950 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 41/143 2024-09-12T22:30:36.950 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-ply-3.11-14.el9.noarch 42/143 2024-09-12T22:30:36.950 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 43/143 2024-09-12T22:30:36.950 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 44/143 2024-09-12T22:30:36.950 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 45/143 2024-09-12T22:30:36.950 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : automake-1.16.2-8.el9.noarch 46/143 2024-09-12T22:30:36.950 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : bison-3.7.4-5.el9.x86_64 47/143 2024-09-12T22:30:36.951 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 48/143 2024-09-12T22:30:36.951 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 49/143 2024-09-12T22:30:36.951 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : flex-2.6.4-9.el9.x86_64 50/143 2024-09-12T22:30:36.951 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 51/143 2024-09-12T22:30:36.951 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 52/143 2024-09-12T22:30:36.951 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 53/143 2024-09-12T22:30:36.951 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 54/143 2024-09-12T22:30:36.951 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 55/143 2024-09-12T22:30:36.951 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 56/143 2024-09-12T22:30:36.951 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 57/143 2024-09-12T22:30:36.951 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 58/143 2024-09-12T22:30:36.951 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 59/143 2024-09-12T22:30:36.952 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 60/143 2024-09-12T22:30:36.952 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 61/143 2024-09-12T22:30:36.952 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : lua-5.4.4-4.el9.x86_64 62/143 2024-09-12T22:30:36.952 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 63/143 2024-09-12T22:30:36.952 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 64/143 2024-09-12T22:30:36.952 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 65/143 2024-09-12T22:30:36.952 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 66/143 2024-09-12T22:30:36.952 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 67/143 2024-09-12T22:30:36.952 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 68/143 2024-09-12T22:30:36.952 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 69/143 2024-09-12T22:30:36.952 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 70/143 2024-09-12T22:30:36.952 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 71/143 2024-09-12T22:30:36.953 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 72/143 2024-09-12T22:30:36.953 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 73/143 2024-09-12T22:30:36.953 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 74/143 2024-09-12T22:30:36.953 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 75/143 2024-09-12T22:30:36.953 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 76/143 2024-09-12T22:30:36.953 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 77/143 2024-09-12T22:30:36.953 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 78/143 2024-09-12T22:30:36.953 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 79/143 2024-09-12T22:30:36.953 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 80/143 2024-09-12T22:30:36.953 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 81/143 2024-09-12T22:30:36.953 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 82/143 2024-09-12T22:30:36.953 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/143 2024-09-12T22:30:36.953 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 84/143 2024-09-12T22:30:36.954 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 85/143 2024-09-12T22:30:36.954 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 86/143 2024-09-12T22:30:36.954 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 87/143 2024-09-12T22:30:36.954 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 88/143 2024-09-12T22:30:36.954 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 89/143 2024-09-12T22:30:36.954 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 90/143 2024-09-12T22:30:36.954 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 91/143 2024-09-12T22:30:36.954 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 92/143 2024-09-12T22:30:36.954 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 93/143 2024-09-12T22:30:36.954 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 94/143 2024-09-12T22:30:36.954 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 95/143 2024-09-12T22:30:36.954 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 96/143 2024-09-12T22:30:36.955 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 97/143 2024-09-12T22:30:36.955 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 98/143 2024-09-12T22:30:36.955 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 99/143 2024-09-12T22:30:36.955 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 100/143 2024-09-12T22:30:36.955 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 101/143 2024-09-12T22:30:36.955 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 102/143 2024-09-12T22:30:36.955 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 103/143 2024-09-12T22:30:36.955 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 104/143 2024-09-12T22:30:36.955 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 105/143 2024-09-12T22:30:36.955 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 106/143 2024-09-12T22:30:36.955 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 107/143 2024-09-12T22:30:36.955 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 108/143 2024-09-12T22:30:36.955 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 109/143 2024-09-12T22:30:36.956 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 110/143 2024-09-12T22:30:36.956 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 111/143 2024-09-12T22:30:36.956 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 112/143 2024-09-12T22:30:36.956 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 113/143 2024-09-12T22:30:36.956 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 114/143 2024-09-12T22:30:36.956 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 115/143 2024-09-12T22:30:36.956 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 116/143 2024-09-12T22:30:36.956 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 117/143 2024-09-12T22:30:36.956 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 118/143 2024-09-12T22:30:36.956 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 119/143 2024-09-12T22:30:36.956 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 120/143 2024-09-12T22:30:36.956 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 121/143 2024-09-12T22:30:36.956 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 122/143 2024-09-12T22:30:36.957 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 123/143 2024-09-12T22:30:36.957 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 124/143 2024-09-12T22:30:36.957 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 125/143 2024-09-12T22:30:36.957 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 126/143 2024-09-12T22:30:36.957 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 127/143 2024-09-12T22:30:36.957 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 128/143 2024-09-12T22:30:36.957 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 129/143 2024-09-12T22:30:36.957 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 130/143 2024-09-12T22:30:36.957 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 131/143 2024-09-12T22:30:36.957 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 132/143 2024-09-12T22:30:36.957 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 133/143 2024-09-12T22:30:36.957 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : re2-1:20211101-20.el9.x86_64 134/143 2024-09-12T22:30:36.958 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 135/143 2024-09-12T22:30:36.958 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : librados2-2:19.1.1-314.g086c737f.el9.x86_64 136/143 2024-09-12T22:30:36.958 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 137/143 2024-09-12T22:30:36.958 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : librbd1-2:19.1.1-314.g086c737f.el9.x86_64 138/143 2024-09-12T22:30:36.958 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 139/143 2024-09-12T22:30:36.958 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 140/143 2024-09-12T22:30:36.958 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 141/143 2024-09-12T22:30:36.958 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 142/143 2024-09-12T22:30:36.973 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-314.g086c737f.el9.noar 118/143 2024-09-12T22:30:37.007 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-314.g086c737f.el9.no 119/143 2024-09-12T22:30:37.412 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 143/143 2024-09-12T22:30:37.412 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T22:30:37.412 INFO:teuthology.orchestra.run.smithi148.stdout:Upgraded: 2024-09-12T22:30:37.412 INFO:teuthology.orchestra.run.smithi148.stdout: librados2-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:30:37.412 INFO:teuthology.orchestra.run.smithi148.stdout: librbd1-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:30:37.412 INFO:teuthology.orchestra.run.smithi148.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-12T22:30:37.412 INFO:teuthology.orchestra.run.smithi148.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-12T22:30:37.412 INFO:teuthology.orchestra.run.smithi148.stdout:Installed: 2024-09-12T22:30:37.412 INFO:teuthology.orchestra.run.smithi148.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-12T22:30:37.413 INFO:teuthology.orchestra.run.smithi148.stdout: automake-1.16.2-8.el9.noarch 2024-09-12T22:30:37.413 INFO:teuthology.orchestra.run.smithi148.stdout: bison-3.7.4-5.el9.x86_64 2024-09-12T22:30:37.413 INFO:teuthology.orchestra.run.smithi148.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-12T22:30:37.413 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:30:37.413 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-base-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:30:37.413 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-common-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:30:37.413 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-fuse-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:30:37.413 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-grafana-dashboards-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:30:37.413 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-immutable-object-cache-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:30:37.413 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mds-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:30:37.413 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:30:37.414 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-cephadm-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:30:37.414 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-dashboard-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:30:37.414 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-diskprediction-local-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:30:37.414 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-modules-core-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:30:37.414 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-rook-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:30:37.414 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mon-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:30:37.414 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-osd-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:30:37.414 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-prometheus-alerts-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:30:37.414 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-radosgw-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:30:37.414 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-selinux-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:30:37.414 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-test-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:30:37.414 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-volume-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:30:37.415 INFO:teuthology.orchestra.run.smithi148.stdout: cephadm-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:30:37.415 INFO:teuthology.orchestra.run.smithi148.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-12T22:30:37.415 INFO:teuthology.orchestra.run.smithi148.stdout: flex-2.6.4-9.el9.x86_64 2024-09-12T22:30:37.415 INFO:teuthology.orchestra.run.smithi148.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-12T22:30:37.415 INFO:teuthology.orchestra.run.smithi148.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-12T22:30:37.415 INFO:teuthology.orchestra.run.smithi148.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-12T22:30:37.415 INFO:teuthology.orchestra.run.smithi148.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-12T22:30:37.415 INFO:teuthology.orchestra.run.smithi148.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-12T22:30:37.415 INFO:teuthology.orchestra.run.smithi148.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-12T22:30:37.415 INFO:teuthology.orchestra.run.smithi148.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-12T22:30:37.415 INFO:teuthology.orchestra.run.smithi148.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-12T22:30:37.416 INFO:teuthology.orchestra.run.smithi148.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-12T22:30:37.416 INFO:teuthology.orchestra.run.smithi148.stdout: libcephfs-devel-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:30:37.416 INFO:teuthology.orchestra.run.smithi148.stdout: libcephfs2-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:30:37.416 INFO:teuthology.orchestra.run.smithi148.stdout: libcephsqlite-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:30:37.416 INFO:teuthology.orchestra.run.smithi148.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-12T22:30:37.416 INFO:teuthology.orchestra.run.smithi148.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-12T22:30:37.416 INFO:teuthology.orchestra.run.smithi148.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-12T22:30:37.416 INFO:teuthology.orchestra.run.smithi148.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-12T22:30:37.416 INFO:teuthology.orchestra.run.smithi148.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-12T22:30:37.416 INFO:teuthology.orchestra.run.smithi148.stdout: librados-devel-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:30:37.416 INFO:teuthology.orchestra.run.smithi148.stdout: libradosstriper1-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:30:37.416 INFO:teuthology.orchestra.run.smithi148.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-12T22:30:37.417 INFO:teuthology.orchestra.run.smithi148.stdout: librgw2-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:30:37.417 INFO:teuthology.orchestra.run.smithi148.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-12T22:30:37.417 INFO:teuthology.orchestra.run.smithi148.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-12T22:30:37.417 INFO:teuthology.orchestra.run.smithi148.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-12T22:30:37.417 INFO:teuthology.orchestra.run.smithi148.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-12T22:30:37.417 INFO:teuthology.orchestra.run.smithi148.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-12T22:30:37.417 INFO:teuthology.orchestra.run.smithi148.stdout: lua-5.4.4-4.el9.x86_64 2024-09-12T22:30:37.417 INFO:teuthology.orchestra.run.smithi148.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-12T22:30:37.417 INFO:teuthology.orchestra.run.smithi148.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-12T22:30:37.417 INFO:teuthology.orchestra.run.smithi148.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-12T22:30:37.418 INFO:teuthology.orchestra.run.smithi148.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-12T22:30:37.418 INFO:teuthology.orchestra.run.smithi148.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-12T22:30:37.418 INFO:teuthology.orchestra.run.smithi148.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-12T22:30:37.418 INFO:teuthology.orchestra.run.smithi148.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-12T22:30:37.418 INFO:teuthology.orchestra.run.smithi148.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-12T22:30:37.418 INFO:teuthology.orchestra.run.smithi148.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-12T22:30:37.419 INFO:teuthology.orchestra.run.smithi148.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-12T22:30:37.419 INFO:teuthology.orchestra.run.smithi148.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-12T22:30:37.419 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-12T22:30:37.419 INFO:teuthology.orchestra.run.smithi148.stdout: python3-ceph-argparse-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:30:37.419 INFO:teuthology.orchestra.run.smithi148.stdout: python3-ceph-common-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:30:37.419 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cephfs-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:30:37.419 INFO:teuthology.orchestra.run.smithi148.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-12T22:30:37.420 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-12T22:30:37.420 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-12T22:30:37.420 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-12T22:30:37.420 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-12T22:30:37.420 INFO:teuthology.orchestra.run.smithi148.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-12T22:30:37.420 INFO:teuthology.orchestra.run.smithi148.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-12T22:30:37.420 INFO:teuthology.orchestra.run.smithi148.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-12T22:30:37.420 INFO:teuthology.orchestra.run.smithi148.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-12T22:30:37.420 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-12T22:30:37.420 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-12T22:30:37.420 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-12T22:30:37.420 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-12T22:30:37.421 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-12T22:30:37.421 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-12T22:30:37.421 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-12T22:30:37.421 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-12T22:30:37.421 INFO:teuthology.orchestra.run.smithi148.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-12T22:30:37.421 INFO:teuthology.orchestra.run.smithi148.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-12T22:30:37.421 INFO:teuthology.orchestra.run.smithi148.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-12T22:30:37.421 INFO:teuthology.orchestra.run.smithi148.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-12T22:30:37.421 INFO:teuthology.orchestra.run.smithi148.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-12T22:30:37.421 INFO:teuthology.orchestra.run.smithi148.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-12T22:30:37.421 INFO:teuthology.orchestra.run.smithi148.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-12T22:30:37.421 INFO:teuthology.orchestra.run.smithi148.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-12T22:30:37.422 INFO:teuthology.orchestra.run.smithi148.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-12T22:30:37.422 INFO:teuthology.orchestra.run.smithi148.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-12T22:30:37.422 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-12T22:30:37.422 INFO:teuthology.orchestra.run.smithi148.stdout: python3-ply-3.11-14.el9.noarch 2024-09-12T22:30:37.422 INFO:teuthology.orchestra.run.smithi148.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-12T22:30:37.422 INFO:teuthology.orchestra.run.smithi148.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-12T22:30:37.422 INFO:teuthology.orchestra.run.smithi148.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-12T22:30:37.422 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-12T22:30:37.422 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-12T22:30:37.422 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-12T22:30:37.422 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-12T22:30:37.422 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-12T22:30:37.423 INFO:teuthology.orchestra.run.smithi148.stdout: python3-rados-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:30:37.423 INFO:teuthology.orchestra.run.smithi148.stdout: python3-rbd-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:30:37.423 INFO:teuthology.orchestra.run.smithi148.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-12T22:30:37.423 INFO:teuthology.orchestra.run.smithi148.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-12T22:30:37.423 INFO:teuthology.orchestra.run.smithi148.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-12T22:30:37.423 INFO:teuthology.orchestra.run.smithi148.stdout: python3-rgw-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:30:37.423 INFO:teuthology.orchestra.run.smithi148.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-12T22:30:37.423 INFO:teuthology.orchestra.run.smithi148.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-12T22:30:37.423 INFO:teuthology.orchestra.run.smithi148.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-12T22:30:37.423 INFO:teuthology.orchestra.run.smithi148.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-12T22:30:37.423 INFO:teuthology.orchestra.run.smithi148.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-12T22:30:37.423 INFO:teuthology.orchestra.run.smithi148.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-12T22:30:37.423 INFO:teuthology.orchestra.run.smithi148.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-12T22:30:37.423 INFO:teuthology.orchestra.run.smithi148.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-12T22:30:37.424 INFO:teuthology.orchestra.run.smithi148.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-12T22:30:37.424 INFO:teuthology.orchestra.run.smithi148.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-12T22:30:37.424 INFO:teuthology.orchestra.run.smithi148.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-12T22:30:37.424 INFO:teuthology.orchestra.run.smithi148.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-12T22:30:37.424 INFO:teuthology.orchestra.run.smithi148.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-12T22:30:37.424 INFO:teuthology.orchestra.run.smithi148.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-12T22:30:37.424 INFO:teuthology.orchestra.run.smithi148.stdout: rbd-fuse-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:30:37.424 INFO:teuthology.orchestra.run.smithi148.stdout: rbd-mirror-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:30:37.424 INFO:teuthology.orchestra.run.smithi148.stdout: rbd-nbd-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:30:37.424 INFO:teuthology.orchestra.run.smithi148.stdout: re2-1:20211101-20.el9.x86_64 2024-09-12T22:30:37.425 INFO:teuthology.orchestra.run.smithi148.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-12T22:30:37.425 INFO:teuthology.orchestra.run.smithi148.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-12T22:30:37.425 INFO:teuthology.orchestra.run.smithi148.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-12T22:30:37.425 INFO:teuthology.orchestra.run.smithi148.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-12T22:30:37.425 INFO:teuthology.orchestra.run.smithi148.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-12T22:30:37.425 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T22:30:37.426 INFO:teuthology.orchestra.run.smithi148.stdout:Complete! 2024-09-12T22:30:37.781 DEBUG:teuthology.parallel:result is None 2024-09-12T22:30:37.984 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-314.g086c737f.el9.no 119/143 2024-09-12T22:30:38.016 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-314.g086c 120/143 2024-09-12T22:30:38.120 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-314.g086c 120/143 2024-09-12T22:30:38.281 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-314.g086c737f.el9 121/143 2024-09-12T22:30:38.310 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-mgr-2:19.1.1-314.g086c737f.el9.x86_64 122/143 2024-09-12T22:30:38.334 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-mgr-2:19.1.1-314.g086c737f.el9.x86_64 122/143 2024-09-12T22:30:38.334 INFO:teuthology.orchestra.run.smithi163.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T22:30:38.334 INFO:teuthology.orchestra.run.smithi163.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-12T22:30:38.334 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T22:30:38.335 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T22:30:38.335 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-09-12T22:30:38.386 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-mgr-rook-2:19.1.1-314.g086c737f.el9.noarch 123/143 2024-09-12T22:30:38.398 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-314.g086c737f.el9.noarch 123/143 2024-09-12T22:30:38.496 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-2:19.1.1-314.g086c737f.el9.x86_64 124/143 2024-09-12T22:30:38.561 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-fuse-2:19.1.1-314.g086c737f.el9.x86_64 125/143 2024-09-12T22:30:39.508 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libtool-2.4.6-46.el9.x86_64 126/143 2024-09-12T22:30:39.539 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-radosgw-2:19.1.1-314.g086c737f.el9.x86_64 127/143 2024-09-12T22:30:39.563 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-314.g086c737f.el9.x86_64 127/143 2024-09-12T22:30:39.563 INFO:teuthology.orchestra.run.smithi163.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T22:30:39.564 INFO:teuthology.orchestra.run.smithi163.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-12T22:30:39.564 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T22:30:39.564 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T22:30:39.564 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-09-12T22:30:39.606 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-314.g086c73 128/143 2024-09-12T22:30:39.617 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 143/143 2024-09-12T22:30:39.617 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:30:39.617 INFO:teuthology.orchestra.run.smithi019.stdout:Upgraded: 2024-09-12T22:30:39.617 INFO:teuthology.orchestra.run.smithi019.stdout: librados2-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:30:39.617 INFO:teuthology.orchestra.run.smithi019.stdout: librbd1-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:30:39.617 INFO:teuthology.orchestra.run.smithi019.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-12T22:30:39.617 INFO:teuthology.orchestra.run.smithi019.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-12T22:30:39.617 INFO:teuthology.orchestra.run.smithi019.stdout:Installed: 2024-09-12T22:30:39.617 INFO:teuthology.orchestra.run.smithi019.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-12T22:30:39.617 INFO:teuthology.orchestra.run.smithi019.stdout: automake-1.16.2-8.el9.noarch 2024-09-12T22:30:39.618 INFO:teuthology.orchestra.run.smithi019.stdout: bison-3.7.4-5.el9.x86_64 2024-09-12T22:30:39.618 INFO:teuthology.orchestra.run.smithi019.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-12T22:30:39.618 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:30:39.618 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-base-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:30:39.618 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-common-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:30:39.618 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-fuse-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:30:39.618 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-grafana-dashboards-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:30:39.618 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-immutable-object-cache-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:30:39.618 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mds-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:30:39.618 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:30:39.618 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-cephadm-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:30:39.618 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-dashboard-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:30:39.619 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-diskprediction-local-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:30:39.619 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-modules-core-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:30:39.619 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-rook-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:30:39.619 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mon-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:30:39.619 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-osd-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:30:39.619 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-prometheus-alerts-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:30:39.619 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-radosgw-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:30:39.619 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-selinux-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:30:39.619 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-test-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:30:39.619 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-volume-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:30:39.619 INFO:teuthology.orchestra.run.smithi019.stdout: cephadm-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:30:39.619 INFO:teuthology.orchestra.run.smithi019.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-12T22:30:39.620 INFO:teuthology.orchestra.run.smithi019.stdout: flex-2.6.4-9.el9.x86_64 2024-09-12T22:30:39.620 INFO:teuthology.orchestra.run.smithi019.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-12T22:30:39.620 INFO:teuthology.orchestra.run.smithi019.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-12T22:30:39.620 INFO:teuthology.orchestra.run.smithi019.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-12T22:30:39.620 INFO:teuthology.orchestra.run.smithi019.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-12T22:30:39.620 INFO:teuthology.orchestra.run.smithi019.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-12T22:30:39.620 INFO:teuthology.orchestra.run.smithi019.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-12T22:30:39.620 INFO:teuthology.orchestra.run.smithi019.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-12T22:30:39.620 INFO:teuthology.orchestra.run.smithi019.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-12T22:30:39.620 INFO:teuthology.orchestra.run.smithi019.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-12T22:30:39.620 INFO:teuthology.orchestra.run.smithi019.stdout: libcephfs-devel-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:30:39.621 INFO:teuthology.orchestra.run.smithi019.stdout: libcephfs2-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:30:39.621 INFO:teuthology.orchestra.run.smithi019.stdout: libcephsqlite-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:30:39.621 INFO:teuthology.orchestra.run.smithi019.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-12T22:30:39.621 INFO:teuthology.orchestra.run.smithi019.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-12T22:30:39.621 INFO:teuthology.orchestra.run.smithi019.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-12T22:30:39.621 INFO:teuthology.orchestra.run.smithi019.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-12T22:30:39.621 INFO:teuthology.orchestra.run.smithi019.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-12T22:30:39.621 INFO:teuthology.orchestra.run.smithi019.stdout: librados-devel-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:30:39.621 INFO:teuthology.orchestra.run.smithi019.stdout: libradosstriper1-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:30:39.621 INFO:teuthology.orchestra.run.smithi019.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-12T22:30:39.621 INFO:teuthology.orchestra.run.smithi019.stdout: librgw2-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:30:39.621 INFO:teuthology.orchestra.run.smithi019.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-12T22:30:39.621 INFO:teuthology.orchestra.run.smithi019.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-12T22:30:39.622 INFO:teuthology.orchestra.run.smithi019.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-12T22:30:39.622 INFO:teuthology.orchestra.run.smithi019.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-12T22:30:39.622 INFO:teuthology.orchestra.run.smithi019.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-12T22:30:39.622 INFO:teuthology.orchestra.run.smithi019.stdout: lua-5.4.4-4.el9.x86_64 2024-09-12T22:30:39.622 INFO:teuthology.orchestra.run.smithi019.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-12T22:30:39.622 INFO:teuthology.orchestra.run.smithi019.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-12T22:30:39.622 INFO:teuthology.orchestra.run.smithi019.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-12T22:30:39.622 INFO:teuthology.orchestra.run.smithi019.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-12T22:30:39.622 INFO:teuthology.orchestra.run.smithi019.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-12T22:30:39.622 INFO:teuthology.orchestra.run.smithi019.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-12T22:30:39.622 INFO:teuthology.orchestra.run.smithi019.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-12T22:30:39.622 INFO:teuthology.orchestra.run.smithi019.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-12T22:30:39.622 INFO:teuthology.orchestra.run.smithi019.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-12T22:30:39.623 INFO:teuthology.orchestra.run.smithi019.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-12T22:30:39.623 INFO:teuthology.orchestra.run.smithi019.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-12T22:30:39.623 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-12T22:30:39.623 INFO:teuthology.orchestra.run.smithi019.stdout: python3-ceph-argparse-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:30:39.623 INFO:teuthology.orchestra.run.smithi019.stdout: python3-ceph-common-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:30:39.623 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cephfs-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:30:39.623 INFO:teuthology.orchestra.run.smithi019.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-12T22:30:39.623 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-12T22:30:39.623 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-12T22:30:39.623 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-12T22:30:39.623 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-12T22:30:39.623 INFO:teuthology.orchestra.run.smithi019.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-12T22:30:39.624 INFO:teuthology.orchestra.run.smithi019.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-12T22:30:39.624 INFO:teuthology.orchestra.run.smithi019.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-12T22:30:39.624 INFO:teuthology.orchestra.run.smithi019.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-12T22:30:39.624 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-12T22:30:39.624 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-12T22:30:39.624 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-12T22:30:39.624 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-12T22:30:39.624 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-12T22:30:39.624 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-12T22:30:39.624 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-12T22:30:39.624 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-12T22:30:39.624 INFO:teuthology.orchestra.run.smithi019.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-12T22:30:39.624 INFO:teuthology.orchestra.run.smithi019.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-12T22:30:39.625 INFO:teuthology.orchestra.run.smithi019.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-12T22:30:39.625 INFO:teuthology.orchestra.run.smithi019.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-12T22:30:39.625 INFO:teuthology.orchestra.run.smithi019.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-12T22:30:39.625 INFO:teuthology.orchestra.run.smithi019.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-12T22:30:39.625 INFO:teuthology.orchestra.run.smithi019.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-12T22:30:39.625 INFO:teuthology.orchestra.run.smithi019.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-12T22:30:39.625 INFO:teuthology.orchestra.run.smithi019.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-12T22:30:39.625 INFO:teuthology.orchestra.run.smithi019.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-12T22:30:39.626 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-12T22:30:39.626 INFO:teuthology.orchestra.run.smithi019.stdout: python3-ply-3.11-14.el9.noarch 2024-09-12T22:30:39.626 INFO:teuthology.orchestra.run.smithi019.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-12T22:30:39.626 INFO:teuthology.orchestra.run.smithi019.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-12T22:30:39.626 INFO:teuthology.orchestra.run.smithi019.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-12T22:30:39.626 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-12T22:30:39.626 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-12T22:30:39.626 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-12T22:30:39.626 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-12T22:30:39.626 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-12T22:30:39.626 INFO:teuthology.orchestra.run.smithi019.stdout: python3-rados-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:30:39.626 INFO:teuthology.orchestra.run.smithi019.stdout: python3-rbd-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:30:39.626 INFO:teuthology.orchestra.run.smithi019.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-12T22:30:39.627 INFO:teuthology.orchestra.run.smithi019.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-12T22:30:39.627 INFO:teuthology.orchestra.run.smithi019.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-12T22:30:39.627 INFO:teuthology.orchestra.run.smithi019.stdout: python3-rgw-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:30:39.627 INFO:teuthology.orchestra.run.smithi019.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-12T22:30:39.627 INFO:teuthology.orchestra.run.smithi019.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-12T22:30:39.627 INFO:teuthology.orchestra.run.smithi019.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-12T22:30:39.627 INFO:teuthology.orchestra.run.smithi019.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-12T22:30:39.627 INFO:teuthology.orchestra.run.smithi019.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-12T22:30:39.627 INFO:teuthology.orchestra.run.smithi019.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-12T22:30:39.627 INFO:teuthology.orchestra.run.smithi019.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-12T22:30:39.627 INFO:teuthology.orchestra.run.smithi019.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-12T22:30:39.627 INFO:teuthology.orchestra.run.smithi019.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-12T22:30:39.627 INFO:teuthology.orchestra.run.smithi019.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-12T22:30:39.628 INFO:teuthology.orchestra.run.smithi019.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-12T22:30:39.628 INFO:teuthology.orchestra.run.smithi019.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-12T22:30:39.628 INFO:teuthology.orchestra.run.smithi019.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-12T22:30:39.628 INFO:teuthology.orchestra.run.smithi019.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-12T22:30:39.628 INFO:teuthology.orchestra.run.smithi019.stdout: rbd-fuse-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:30:39.628 INFO:teuthology.orchestra.run.smithi019.stdout: rbd-mirror-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:30:39.628 INFO:teuthology.orchestra.run.smithi019.stdout: rbd-nbd-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:30:39.628 INFO:teuthology.orchestra.run.smithi019.stdout: re2-1:20211101-20.el9.x86_64 2024-09-12T22:30:39.628 INFO:teuthology.orchestra.run.smithi019.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-12T22:30:39.628 INFO:teuthology.orchestra.run.smithi019.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-12T22:30:39.628 INFO:teuthology.orchestra.run.smithi019.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-12T22:30:39.628 INFO:teuthology.orchestra.run.smithi019.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-12T22:30:39.628 INFO:teuthology.orchestra.run.smithi019.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-12T22:30:39.629 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:30:39.629 INFO:teuthology.orchestra.run.smithi019.stdout:Complete! 2024-09-12T22:30:39.630 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-314.g086c73 128/143 2024-09-12T22:30:39.630 INFO:teuthology.orchestra.run.smithi163.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T22:30:39.630 INFO:teuthology.orchestra.run.smithi163.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-12T22:30:39.630 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-09-12T22:30:39.932 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : rbd-mirror-2:19.1.1-314.g086c737f.el9.x86_64 129/143 2024-09-12T22:30:39.956 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: rbd-mirror-2:19.1.1-314.g086c737f.el9.x86_64 129/143 2024-09-12T22:30:39.956 INFO:teuthology.orchestra.run.smithi163.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T22:30:39.957 INFO:teuthology.orchestra.run.smithi163.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-12T22:30:39.957 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T22:30:39.957 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T22:30:39.957 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-09-12T22:30:40.129 DEBUG:teuthology.parallel:result is None 2024-09-12T22:30:41.796 INFO:teuthology.orchestra.run.smithi076.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 143/143 2024-09-12T22:30:41.796 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : ceph-2:19.1.1-314.g086c737f.el9.x86_64 1/143 2024-09-12T22:30:41.796 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : ceph-base-2:19.1.1-314.g086c737f.el9.x86_64 2/143 2024-09-12T22:30:41.796 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : ceph-common-2:19.1.1-314.g086c737f.el9.x86_64 3/143 2024-09-12T22:30:41.796 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : ceph-fuse-2:19.1.1-314.g086c737f.el9.x86_64 4/143 2024-09-12T22:30:41.796 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-314.g086c73 5/143 2024-09-12T22:30:41.797 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : ceph-mds-2:19.1.1-314.g086c737f.el9.x86_64 6/143 2024-09-12T22:30:41.797 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : ceph-mgr-2:19.1.1-314.g086c737f.el9.x86_64 7/143 2024-09-12T22:30:41.797 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : ceph-mon-2:19.1.1-314.g086c737f.el9.x86_64 8/143 2024-09-12T22:30:41.797 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : ceph-osd-2:19.1.1-314.g086c737f.el9.x86_64 9/143 2024-09-12T22:30:41.797 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : ceph-radosgw-2:19.1.1-314.g086c737f.el9.x86_64 10/143 2024-09-12T22:30:41.797 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : ceph-selinux-2:19.1.1-314.g086c737f.el9.x86_64 11/143 2024-09-12T22:30:41.797 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : ceph-test-2:19.1.1-314.g086c737f.el9.x86_64 12/143 2024-09-12T22:30:41.797 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : libcephfs-devel-2:19.1.1-314.g086c737f.el9.x86_6 13/143 2024-09-12T22:30:41.797 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : libcephfs2-2:19.1.1-314.g086c737f.el9.x86_64 14/143 2024-09-12T22:30:41.797 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : libcephsqlite-2:19.1.1-314.g086c737f.el9.x86_64 15/143 2024-09-12T22:30:41.797 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : librados-devel-2:19.1.1-314.g086c737f.el9.x86_64 16/143 2024-09-12T22:30:41.797 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : libradosstriper1-2:19.1.1-314.g086c737f.el9.x86_ 17/143 2024-09-12T22:30:41.798 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : librgw2-2:19.1.1-314.g086c737f.el9.x86_64 18/143 2024-09-12T22:30:41.798 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-ceph-argparse-2:19.1.1-314.g086c737f.el9 19/143 2024-09-12T22:30:41.798 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-ceph-common-2:19.1.1-314.g086c737f.el9.x 20/143 2024-09-12T22:30:41.798 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-cephfs-2:19.1.1-314.g086c737f.el9.x86_64 21/143 2024-09-12T22:30:41.798 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-rados-2:19.1.1-314.g086c737f.el9.x86_64 22/143 2024-09-12T22:30:41.798 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-rbd-2:19.1.1-314.g086c737f.el9.x86_64 23/143 2024-09-12T22:30:41.798 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-rgw-2:19.1.1-314.g086c737f.el9.x86_64 24/143 2024-09-12T22:30:41.798 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : rbd-fuse-2:19.1.1-314.g086c737f.el9.x86_64 25/143 2024-09-12T22:30:41.798 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : rbd-mirror-2:19.1.1-314.g086c737f.el9.x86_64 26/143 2024-09-12T22:30:41.798 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : rbd-nbd-2:19.1.1-314.g086c737f.el9.x86_64 27/143 2024-09-12T22:30:41.798 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-314.g086c737f.e 28/143 2024-09-12T22:30:41.798 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-314.g086c737f.el9.noar 29/143 2024-09-12T22:30:41.799 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-314.g086c737f.el9.no 30/143 2024-09-12T22:30:41.799 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-314.g086c 31/143 2024-09-12T22:30:41.799 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-314.g086c737f.el9 32/143 2024-09-12T22:30:41.799 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : ceph-mgr-rook-2:19.1.1-314.g086c737f.el9.noarch 33/143 2024-09-12T22:30:41.799 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-314.g086c737f.el 34/143 2024-09-12T22:30:41.799 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : ceph-volume-2:19.1.1-314.g086c737f.el9.noarch 35/143 2024-09-12T22:30:41.799 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : cephadm-2:19.1.1-314.g086c737f.el9.noarch 36/143 2024-09-12T22:30:41.799 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 37/143 2024-09-12T22:30:41.799 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 38/143 2024-09-12T22:30:41.799 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 39/143 2024-09-12T22:30:41.799 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 40/143 2024-09-12T22:30:41.800 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 41/143 2024-09-12T22:30:41.800 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-ply-3.11-14.el9.noarch 42/143 2024-09-12T22:30:41.800 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 43/143 2024-09-12T22:30:41.800 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 44/143 2024-09-12T22:30:41.800 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 45/143 2024-09-12T22:30:41.800 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : automake-1.16.2-8.el9.noarch 46/143 2024-09-12T22:30:41.800 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : bison-3.7.4-5.el9.x86_64 47/143 2024-09-12T22:30:41.800 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 48/143 2024-09-12T22:30:41.800 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 49/143 2024-09-12T22:30:41.800 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : flex-2.6.4-9.el9.x86_64 50/143 2024-09-12T22:30:41.800 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 51/143 2024-09-12T22:30:41.800 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 52/143 2024-09-12T22:30:41.801 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 53/143 2024-09-12T22:30:41.801 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 54/143 2024-09-12T22:30:41.801 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 55/143 2024-09-12T22:30:41.801 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 56/143 2024-09-12T22:30:41.801 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 57/143 2024-09-12T22:30:41.801 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 58/143 2024-09-12T22:30:41.801 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 59/143 2024-09-12T22:30:41.801 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 60/143 2024-09-12T22:30:41.801 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 61/143 2024-09-12T22:30:41.801 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : lua-5.4.4-4.el9.x86_64 62/143 2024-09-12T22:30:41.801 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 63/143 2024-09-12T22:30:41.801 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 64/143 2024-09-12T22:30:41.801 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 65/143 2024-09-12T22:30:41.802 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 66/143 2024-09-12T22:30:41.802 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 67/143 2024-09-12T22:30:41.802 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 68/143 2024-09-12T22:30:41.802 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 69/143 2024-09-12T22:30:41.802 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 70/143 2024-09-12T22:30:41.802 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 71/143 2024-09-12T22:30:41.802 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 72/143 2024-09-12T22:30:41.802 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 73/143 2024-09-12T22:30:41.802 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 74/143 2024-09-12T22:30:41.802 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 75/143 2024-09-12T22:30:41.803 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 76/143 2024-09-12T22:30:41.803 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 77/143 2024-09-12T22:30:41.803 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 78/143 2024-09-12T22:30:41.803 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 79/143 2024-09-12T22:30:41.803 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 80/143 2024-09-12T22:30:41.803 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 81/143 2024-09-12T22:30:41.803 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 82/143 2024-09-12T22:30:41.803 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/143 2024-09-12T22:30:41.803 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 84/143 2024-09-12T22:30:41.803 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 85/143 2024-09-12T22:30:41.803 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 86/143 2024-09-12T22:30:41.803 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 87/143 2024-09-12T22:30:41.803 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 88/143 2024-09-12T22:30:41.803 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 89/143 2024-09-12T22:30:41.804 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 90/143 2024-09-12T22:30:41.804 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 91/143 2024-09-12T22:30:41.804 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 92/143 2024-09-12T22:30:41.804 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 93/143 2024-09-12T22:30:41.804 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 94/143 2024-09-12T22:30:41.804 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 95/143 2024-09-12T22:30:41.804 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 96/143 2024-09-12T22:30:41.804 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 97/143 2024-09-12T22:30:41.804 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 98/143 2024-09-12T22:30:41.804 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 99/143 2024-09-12T22:30:41.804 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 100/143 2024-09-12T22:30:41.804 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 101/143 2024-09-12T22:30:41.805 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 102/143 2024-09-12T22:30:41.805 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 103/143 2024-09-12T22:30:41.805 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 104/143 2024-09-12T22:30:41.805 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 105/143 2024-09-12T22:30:41.805 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 106/143 2024-09-12T22:30:41.805 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 107/143 2024-09-12T22:30:41.805 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 108/143 2024-09-12T22:30:41.805 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 109/143 2024-09-12T22:30:41.805 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 110/143 2024-09-12T22:30:41.805 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 111/143 2024-09-12T22:30:41.805 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 112/143 2024-09-12T22:30:41.805 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 113/143 2024-09-12T22:30:41.805 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 114/143 2024-09-12T22:30:41.805 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 115/143 2024-09-12T22:30:41.806 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 116/143 2024-09-12T22:30:41.806 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 117/143 2024-09-12T22:30:41.806 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 118/143 2024-09-12T22:30:41.806 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 119/143 2024-09-12T22:30:41.806 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 120/143 2024-09-12T22:30:41.806 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 121/143 2024-09-12T22:30:41.806 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 122/143 2024-09-12T22:30:41.806 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 123/143 2024-09-12T22:30:41.806 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 124/143 2024-09-12T22:30:41.806 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 125/143 2024-09-12T22:30:41.806 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 126/143 2024-09-12T22:30:41.806 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 127/143 2024-09-12T22:30:41.807 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 128/143 2024-09-12T22:30:41.807 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 129/143 2024-09-12T22:30:41.807 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 130/143 2024-09-12T22:30:41.807 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 131/143 2024-09-12T22:30:41.807 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 132/143 2024-09-12T22:30:41.807 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 133/143 2024-09-12T22:30:41.807 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : re2-1:20211101-20.el9.x86_64 134/143 2024-09-12T22:30:41.807 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 135/143 2024-09-12T22:30:41.807 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : librados2-2:19.1.1-314.g086c737f.el9.x86_64 136/143 2024-09-12T22:30:41.807 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 137/143 2024-09-12T22:30:41.807 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : librbd1-2:19.1.1-314.g086c737f.el9.x86_64 138/143 2024-09-12T22:30:41.807 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 139/143 2024-09-12T22:30:41.807 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 140/143 2024-09-12T22:30:41.808 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 141/143 2024-09-12T22:30:41.808 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 142/143 2024-09-12T22:30:44.251 INFO:teuthology.orchestra.run.smithi076.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 143/143 2024-09-12T22:30:44.251 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-12T22:30:44.252 INFO:teuthology.orchestra.run.smithi076.stdout:Upgraded: 2024-09-12T22:30:44.252 INFO:teuthology.orchestra.run.smithi076.stdout: librados2-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:30:44.252 INFO:teuthology.orchestra.run.smithi076.stdout: librbd1-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:30:44.252 INFO:teuthology.orchestra.run.smithi076.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-12T22:30:44.252 INFO:teuthology.orchestra.run.smithi076.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-12T22:30:44.252 INFO:teuthology.orchestra.run.smithi076.stdout:Installed: 2024-09-12T22:30:44.252 INFO:teuthology.orchestra.run.smithi076.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-12T22:30:44.252 INFO:teuthology.orchestra.run.smithi076.stdout: automake-1.16.2-8.el9.noarch 2024-09-12T22:30:44.252 INFO:teuthology.orchestra.run.smithi076.stdout: bison-3.7.4-5.el9.x86_64 2024-09-12T22:30:44.252 INFO:teuthology.orchestra.run.smithi076.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-12T22:30:44.252 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:30:44.253 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-base-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:30:44.253 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-common-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:30:44.253 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-fuse-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:30:44.253 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-grafana-dashboards-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:30:44.253 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-immutable-object-cache-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:30:44.253 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-mds-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:30:44.253 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-mgr-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:30:44.253 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-mgr-cephadm-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:30:44.253 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-mgr-dashboard-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:30:44.253 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-mgr-diskprediction-local-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:30:44.253 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-mgr-modules-core-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:30:44.253 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-mgr-rook-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:30:44.254 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-mon-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:30:44.254 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-osd-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:30:44.254 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-prometheus-alerts-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:30:44.254 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-radosgw-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:30:44.254 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-selinux-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:30:44.254 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-test-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:30:44.254 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-volume-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:30:44.254 INFO:teuthology.orchestra.run.smithi076.stdout: cephadm-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:30:44.254 INFO:teuthology.orchestra.run.smithi076.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-12T22:30:44.254 INFO:teuthology.orchestra.run.smithi076.stdout: flex-2.6.4-9.el9.x86_64 2024-09-12T22:30:44.254 INFO:teuthology.orchestra.run.smithi076.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-12T22:30:44.255 INFO:teuthology.orchestra.run.smithi076.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-12T22:30:44.255 INFO:teuthology.orchestra.run.smithi076.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-12T22:30:44.255 INFO:teuthology.orchestra.run.smithi076.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-12T22:30:44.255 INFO:teuthology.orchestra.run.smithi076.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-12T22:30:44.255 INFO:teuthology.orchestra.run.smithi076.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-12T22:30:44.255 INFO:teuthology.orchestra.run.smithi076.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-12T22:30:44.255 INFO:teuthology.orchestra.run.smithi076.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-12T22:30:44.255 INFO:teuthology.orchestra.run.smithi076.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-12T22:30:44.255 INFO:teuthology.orchestra.run.smithi076.stdout: libcephfs-devel-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:30:44.255 INFO:teuthology.orchestra.run.smithi076.stdout: libcephfs2-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:30:44.255 INFO:teuthology.orchestra.run.smithi076.stdout: libcephsqlite-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:30:44.255 INFO:teuthology.orchestra.run.smithi076.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-12T22:30:44.256 INFO:teuthology.orchestra.run.smithi076.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-12T22:30:44.256 INFO:teuthology.orchestra.run.smithi076.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-12T22:30:44.256 INFO:teuthology.orchestra.run.smithi076.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-12T22:30:44.256 INFO:teuthology.orchestra.run.smithi076.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-12T22:30:44.256 INFO:teuthology.orchestra.run.smithi076.stdout: librados-devel-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:30:44.256 INFO:teuthology.orchestra.run.smithi076.stdout: libradosstriper1-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:30:44.256 INFO:teuthology.orchestra.run.smithi076.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-12T22:30:44.256 INFO:teuthology.orchestra.run.smithi076.stdout: librgw2-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:30:44.256 INFO:teuthology.orchestra.run.smithi076.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-12T22:30:44.256 INFO:teuthology.orchestra.run.smithi076.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-12T22:30:44.256 INFO:teuthology.orchestra.run.smithi076.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-12T22:30:44.256 INFO:teuthology.orchestra.run.smithi076.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-12T22:30:44.257 INFO:teuthology.orchestra.run.smithi076.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-12T22:30:44.257 INFO:teuthology.orchestra.run.smithi076.stdout: lua-5.4.4-4.el9.x86_64 2024-09-12T22:30:44.257 INFO:teuthology.orchestra.run.smithi076.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-12T22:30:44.257 INFO:teuthology.orchestra.run.smithi076.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-12T22:30:44.257 INFO:teuthology.orchestra.run.smithi076.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-12T22:30:44.257 INFO:teuthology.orchestra.run.smithi076.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-12T22:30:44.257 INFO:teuthology.orchestra.run.smithi076.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-12T22:30:44.257 INFO:teuthology.orchestra.run.smithi076.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-12T22:30:44.257 INFO:teuthology.orchestra.run.smithi076.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-12T22:30:44.257 INFO:teuthology.orchestra.run.smithi076.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-12T22:30:44.257 INFO:teuthology.orchestra.run.smithi076.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-12T22:30:44.258 INFO:teuthology.orchestra.run.smithi076.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-12T22:30:44.258 INFO:teuthology.orchestra.run.smithi076.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-12T22:30:44.258 INFO:teuthology.orchestra.run.smithi076.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-12T22:30:44.258 INFO:teuthology.orchestra.run.smithi076.stdout: python3-ceph-argparse-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:30:44.258 INFO:teuthology.orchestra.run.smithi076.stdout: python3-ceph-common-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:30:44.258 INFO:teuthology.orchestra.run.smithi076.stdout: python3-cephfs-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:30:44.258 INFO:teuthology.orchestra.run.smithi076.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-12T22:30:44.258 INFO:teuthology.orchestra.run.smithi076.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-12T22:30:44.258 INFO:teuthology.orchestra.run.smithi076.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-12T22:30:44.258 INFO:teuthology.orchestra.run.smithi076.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-12T22:30:44.258 INFO:teuthology.orchestra.run.smithi076.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-12T22:30:44.258 INFO:teuthology.orchestra.run.smithi076.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-12T22:30:44.258 INFO:teuthology.orchestra.run.smithi076.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-12T22:30:44.259 INFO:teuthology.orchestra.run.smithi076.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-12T22:30:44.259 INFO:teuthology.orchestra.run.smithi076.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-12T22:30:44.259 INFO:teuthology.orchestra.run.smithi076.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-12T22:30:44.259 INFO:teuthology.orchestra.run.smithi076.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-12T22:30:44.259 INFO:teuthology.orchestra.run.smithi076.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-12T22:30:44.259 INFO:teuthology.orchestra.run.smithi076.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-12T22:30:44.259 INFO:teuthology.orchestra.run.smithi076.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-12T22:30:44.259 INFO:teuthology.orchestra.run.smithi076.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-12T22:30:44.259 INFO:teuthology.orchestra.run.smithi076.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-12T22:30:44.259 INFO:teuthology.orchestra.run.smithi076.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-12T22:30:44.259 INFO:teuthology.orchestra.run.smithi076.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-12T22:30:44.259 INFO:teuthology.orchestra.run.smithi076.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-12T22:30:44.260 INFO:teuthology.orchestra.run.smithi076.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-12T22:30:44.260 INFO:teuthology.orchestra.run.smithi076.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-12T22:30:44.260 INFO:teuthology.orchestra.run.smithi076.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-12T22:30:44.260 INFO:teuthology.orchestra.run.smithi076.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-12T22:30:44.260 INFO:teuthology.orchestra.run.smithi076.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-12T22:30:44.260 INFO:teuthology.orchestra.run.smithi076.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-12T22:30:44.260 INFO:teuthology.orchestra.run.smithi076.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-12T22:30:44.260 INFO:teuthology.orchestra.run.smithi076.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-12T22:30:44.260 INFO:teuthology.orchestra.run.smithi076.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-12T22:30:44.260 INFO:teuthology.orchestra.run.smithi076.stdout: python3-ply-3.11-14.el9.noarch 2024-09-12T22:30:44.260 INFO:teuthology.orchestra.run.smithi076.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-12T22:30:44.260 INFO:teuthology.orchestra.run.smithi076.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-12T22:30:44.260 INFO:teuthology.orchestra.run.smithi076.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-12T22:30:44.261 INFO:teuthology.orchestra.run.smithi076.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-12T22:30:44.261 INFO:teuthology.orchestra.run.smithi076.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-12T22:30:44.261 INFO:teuthology.orchestra.run.smithi076.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-12T22:30:44.261 INFO:teuthology.orchestra.run.smithi076.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-12T22:30:44.261 INFO:teuthology.orchestra.run.smithi076.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-12T22:30:44.261 INFO:teuthology.orchestra.run.smithi076.stdout: python3-rados-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:30:44.261 INFO:teuthology.orchestra.run.smithi076.stdout: python3-rbd-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:30:44.261 INFO:teuthology.orchestra.run.smithi076.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-12T22:30:44.261 INFO:teuthology.orchestra.run.smithi076.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-12T22:30:44.261 INFO:teuthology.orchestra.run.smithi076.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-12T22:30:44.261 INFO:teuthology.orchestra.run.smithi076.stdout: python3-rgw-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:30:44.261 INFO:teuthology.orchestra.run.smithi076.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-12T22:30:44.261 INFO:teuthology.orchestra.run.smithi076.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-12T22:30:44.262 INFO:teuthology.orchestra.run.smithi076.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-12T22:30:44.262 INFO:teuthology.orchestra.run.smithi076.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-12T22:30:44.262 INFO:teuthology.orchestra.run.smithi076.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-12T22:30:44.262 INFO:teuthology.orchestra.run.smithi076.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-12T22:30:44.262 INFO:teuthology.orchestra.run.smithi076.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-12T22:30:44.262 INFO:teuthology.orchestra.run.smithi076.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-12T22:30:44.262 INFO:teuthology.orchestra.run.smithi076.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-12T22:30:44.262 INFO:teuthology.orchestra.run.smithi076.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-12T22:30:44.262 INFO:teuthology.orchestra.run.smithi076.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-12T22:30:44.262 INFO:teuthology.orchestra.run.smithi076.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-12T22:30:44.262 INFO:teuthology.orchestra.run.smithi076.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-12T22:30:44.262 INFO:teuthology.orchestra.run.smithi076.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-12T22:30:44.262 INFO:teuthology.orchestra.run.smithi076.stdout: rbd-fuse-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:30:44.263 INFO:teuthology.orchestra.run.smithi076.stdout: rbd-mirror-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:30:44.263 INFO:teuthology.orchestra.run.smithi076.stdout: rbd-nbd-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:30:44.263 INFO:teuthology.orchestra.run.smithi076.stdout: re2-1:20211101-20.el9.x86_64 2024-09-12T22:30:44.263 INFO:teuthology.orchestra.run.smithi076.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-12T22:30:44.263 INFO:teuthology.orchestra.run.smithi076.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-12T22:30:44.263 INFO:teuthology.orchestra.run.smithi076.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-12T22:30:44.263 INFO:teuthology.orchestra.run.smithi076.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-12T22:30:44.263 INFO:teuthology.orchestra.run.smithi076.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-12T22:30:44.264 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-12T22:30:44.264 INFO:teuthology.orchestra.run.smithi076.stdout:Complete! 2024-09-12T22:30:44.552 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-test-2:19.1.1-314.g086c737f.el9.x86_64 130/143 2024-09-12T22:30:44.588 DEBUG:teuthology.parallel:result is None 2024-09-12T22:30:44.593 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : rbd-fuse-2:19.1.1-314.g086c737f.el9.x86_64 131/143 2024-09-12T22:30:44.644 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : rbd-nbd-2:19.1.1-314.g086c737f.el9.x86_64 132/143 2024-09-12T22:30:44.675 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 133/143 2024-09-12T22:30:44.710 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 134/143 2024-09-12T22:30:45.549 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libcephfs-devel-2:19.1.1-314.g086c737f.el9.x86_6 135/143 2024-09-12T22:30:45.646 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 136/143 2024-09-12T22:30:45.700 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 137/143 2024-09-12T22:30:45.803 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : flex-2.6.4-9.el9.x86_64 138/143 2024-09-12T22:30:45.833 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : bison-3.7.4-5.el9.x86_64 139/143 2024-09-12T22:30:45.875 INFO:teuthology.orchestra.run.smithi163.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 140/143 2024-09-12T22:30:45.875 INFO:teuthology.orchestra.run.smithi163.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 141/143 2024-09-12T22:30:45.959 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 141/143 2024-09-12T22:30:45.959 INFO:teuthology.orchestra.run.smithi163.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 142/143 2024-09-12T22:30:46.044 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 142/143 2024-09-12T22:30:46.109 INFO:teuthology.orchestra.run.smithi163.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 143/143 2024-09-12T22:30:51.602 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 143/143 2024-09-12T22:30:51.602 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-2:19.1.1-314.g086c737f.el9.x86_64 1/143 2024-09-12T22:30:51.602 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-base-2:19.1.1-314.g086c737f.el9.x86_64 2/143 2024-09-12T22:30:51.602 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-common-2:19.1.1-314.g086c737f.el9.x86_64 3/143 2024-09-12T22:30:51.602 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-fuse-2:19.1.1-314.g086c737f.el9.x86_64 4/143 2024-09-12T22:30:51.602 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-314.g086c73 5/143 2024-09-12T22:30:51.602 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-mds-2:19.1.1-314.g086c737f.el9.x86_64 6/143 2024-09-12T22:30:51.602 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-mgr-2:19.1.1-314.g086c737f.el9.x86_64 7/143 2024-09-12T22:30:51.602 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-mon-2:19.1.1-314.g086c737f.el9.x86_64 8/143 2024-09-12T22:30:51.603 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-osd-2:19.1.1-314.g086c737f.el9.x86_64 9/143 2024-09-12T22:30:51.603 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-radosgw-2:19.1.1-314.g086c737f.el9.x86_64 10/143 2024-09-12T22:30:51.603 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-selinux-2:19.1.1-314.g086c737f.el9.x86_64 11/143 2024-09-12T22:30:51.603 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-test-2:19.1.1-314.g086c737f.el9.x86_64 12/143 2024-09-12T22:30:51.603 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libcephfs-devel-2:19.1.1-314.g086c737f.el9.x86_6 13/143 2024-09-12T22:30:51.603 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libcephfs2-2:19.1.1-314.g086c737f.el9.x86_64 14/143 2024-09-12T22:30:51.603 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libcephsqlite-2:19.1.1-314.g086c737f.el9.x86_64 15/143 2024-09-12T22:30:51.603 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : librados-devel-2:19.1.1-314.g086c737f.el9.x86_64 16/143 2024-09-12T22:30:51.603 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libradosstriper1-2:19.1.1-314.g086c737f.el9.x86_ 17/143 2024-09-12T22:30:51.603 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : librgw2-2:19.1.1-314.g086c737f.el9.x86_64 18/143 2024-09-12T22:30:51.603 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-ceph-argparse-2:19.1.1-314.g086c737f.el9 19/143 2024-09-12T22:30:51.603 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-ceph-common-2:19.1.1-314.g086c737f.el9.x 20/143 2024-09-12T22:30:51.604 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-cephfs-2:19.1.1-314.g086c737f.el9.x86_64 21/143 2024-09-12T22:30:51.604 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-rados-2:19.1.1-314.g086c737f.el9.x86_64 22/143 2024-09-12T22:30:51.604 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-rbd-2:19.1.1-314.g086c737f.el9.x86_64 23/143 2024-09-12T22:30:51.604 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-rgw-2:19.1.1-314.g086c737f.el9.x86_64 24/143 2024-09-12T22:30:51.604 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : rbd-fuse-2:19.1.1-314.g086c737f.el9.x86_64 25/143 2024-09-12T22:30:51.604 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : rbd-mirror-2:19.1.1-314.g086c737f.el9.x86_64 26/143 2024-09-12T22:30:51.604 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : rbd-nbd-2:19.1.1-314.g086c737f.el9.x86_64 27/143 2024-09-12T22:30:51.604 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-314.g086c737f.e 28/143 2024-09-12T22:30:51.604 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-314.g086c737f.el9.noar 29/143 2024-09-12T22:30:51.604 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-314.g086c737f.el9.no 30/143 2024-09-12T22:30:51.614 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-314.g086c 31/143 2024-09-12T22:30:51.615 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-314.g086c737f.el9 32/143 2024-09-12T22:30:51.615 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-mgr-rook-2:19.1.1-314.g086c737f.el9.noarch 33/143 2024-09-12T22:30:51.615 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-314.g086c737f.el 34/143 2024-09-12T22:30:51.615 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-volume-2:19.1.1-314.g086c737f.el9.noarch 35/143 2024-09-12T22:30:51.615 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : cephadm-2:19.1.1-314.g086c737f.el9.noarch 36/143 2024-09-12T22:30:51.615 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 37/143 2024-09-12T22:30:51.615 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 38/143 2024-09-12T22:30:51.615 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 39/143 2024-09-12T22:30:51.615 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 40/143 2024-09-12T22:30:51.615 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 41/143 2024-09-12T22:30:51.616 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-ply-3.11-14.el9.noarch 42/143 2024-09-12T22:30:51.616 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 43/143 2024-09-12T22:30:51.616 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 44/143 2024-09-12T22:30:51.616 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 45/143 2024-09-12T22:30:51.616 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : automake-1.16.2-8.el9.noarch 46/143 2024-09-12T22:30:51.616 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : bison-3.7.4-5.el9.x86_64 47/143 2024-09-12T22:30:51.616 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 48/143 2024-09-12T22:30:51.616 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 49/143 2024-09-12T22:30:51.616 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : flex-2.6.4-9.el9.x86_64 50/143 2024-09-12T22:30:51.616 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 51/143 2024-09-12T22:30:51.617 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 52/143 2024-09-12T22:30:51.617 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 53/143 2024-09-12T22:30:51.617 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 54/143 2024-09-12T22:30:51.617 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 55/143 2024-09-12T22:30:51.617 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 56/143 2024-09-12T22:30:51.617 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 57/143 2024-09-12T22:30:51.617 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 58/143 2024-09-12T22:30:51.617 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 59/143 2024-09-12T22:30:51.618 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 60/143 2024-09-12T22:30:51.618 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 61/143 2024-09-12T22:30:51.618 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : lua-5.4.4-4.el9.x86_64 62/143 2024-09-12T22:30:51.618 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 63/143 2024-09-12T22:30:51.618 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 64/143 2024-09-12T22:30:51.618 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 65/143 2024-09-12T22:30:51.618 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 66/143 2024-09-12T22:30:51.618 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 67/143 2024-09-12T22:30:51.618 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 68/143 2024-09-12T22:30:51.618 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 69/143 2024-09-12T22:30:51.618 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 70/143 2024-09-12T22:30:51.619 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 71/143 2024-09-12T22:30:51.619 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 72/143 2024-09-12T22:30:51.619 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 73/143 2024-09-12T22:30:51.619 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 74/143 2024-09-12T22:30:51.619 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 75/143 2024-09-12T22:30:51.619 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 76/143 2024-09-12T22:30:51.619 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 77/143 2024-09-12T22:30:51.619 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 78/143 2024-09-12T22:30:51.619 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 79/143 2024-09-12T22:30:51.619 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 80/143 2024-09-12T22:30:51.619 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 81/143 2024-09-12T22:30:51.619 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 82/143 2024-09-12T22:30:51.619 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/143 2024-09-12T22:30:51.620 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 84/143 2024-09-12T22:30:51.620 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 85/143 2024-09-12T22:30:51.620 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 86/143 2024-09-12T22:30:51.620 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 87/143 2024-09-12T22:30:51.620 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 88/143 2024-09-12T22:30:51.620 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 89/143 2024-09-12T22:30:51.620 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 90/143 2024-09-12T22:30:51.620 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 91/143 2024-09-12T22:30:51.620 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 92/143 2024-09-12T22:30:51.620 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 93/143 2024-09-12T22:30:51.620 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 94/143 2024-09-12T22:30:51.620 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 95/143 2024-09-12T22:30:51.621 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 96/143 2024-09-12T22:30:51.621 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 97/143 2024-09-12T22:30:51.621 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 98/143 2024-09-12T22:30:51.621 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 99/143 2024-09-12T22:30:51.621 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 100/143 2024-09-12T22:30:51.621 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 101/143 2024-09-12T22:30:51.621 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 102/143 2024-09-12T22:30:51.621 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 103/143 2024-09-12T22:30:51.621 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 104/143 2024-09-12T22:30:51.621 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 105/143 2024-09-12T22:30:51.621 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 106/143 2024-09-12T22:30:51.621 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 107/143 2024-09-12T22:30:51.621 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 108/143 2024-09-12T22:30:51.622 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 109/143 2024-09-12T22:30:51.622 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 110/143 2024-09-12T22:30:51.622 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 111/143 2024-09-12T22:30:51.622 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 112/143 2024-09-12T22:30:51.622 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 113/143 2024-09-12T22:30:51.622 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 114/143 2024-09-12T22:30:51.622 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 115/143 2024-09-12T22:30:51.622 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 116/143 2024-09-12T22:30:51.622 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 117/143 2024-09-12T22:30:51.622 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 118/143 2024-09-12T22:30:51.622 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 119/143 2024-09-12T22:30:51.622 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 120/143 2024-09-12T22:30:51.622 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 121/143 2024-09-12T22:30:51.623 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 122/143 2024-09-12T22:30:51.623 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 123/143 2024-09-12T22:30:51.623 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 124/143 2024-09-12T22:30:51.623 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 125/143 2024-09-12T22:30:51.623 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 126/143 2024-09-12T22:30:51.623 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 127/143 2024-09-12T22:30:51.623 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 128/143 2024-09-12T22:30:51.623 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 129/143 2024-09-12T22:30:51.623 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 130/143 2024-09-12T22:30:51.623 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 131/143 2024-09-12T22:30:51.623 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 132/143 2024-09-12T22:30:51.623 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 133/143 2024-09-12T22:30:51.623 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : re2-1:20211101-20.el9.x86_64 134/143 2024-09-12T22:30:51.624 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 135/143 2024-09-12T22:30:51.624 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : librados2-2:19.1.1-314.g086c737f.el9.x86_64 136/143 2024-09-12T22:30:51.624 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 137/143 2024-09-12T22:30:51.624 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : librbd1-2:19.1.1-314.g086c737f.el9.x86_64 138/143 2024-09-12T22:30:51.624 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 139/143 2024-09-12T22:30:51.624 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 140/143 2024-09-12T22:30:51.624 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 141/143 2024-09-12T22:30:51.624 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 142/143 2024-09-12T22:30:54.053 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 143/143 2024-09-12T22:30:54.053 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-09-12T22:30:54.053 INFO:teuthology.orchestra.run.smithi163.stdout:Upgraded: 2024-09-12T22:30:54.054 INFO:teuthology.orchestra.run.smithi163.stdout: librados2-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:30:54.054 INFO:teuthology.orchestra.run.smithi163.stdout: librbd1-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:30:54.054 INFO:teuthology.orchestra.run.smithi163.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-12T22:30:54.054 INFO:teuthology.orchestra.run.smithi163.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-12T22:30:54.054 INFO:teuthology.orchestra.run.smithi163.stdout:Installed: 2024-09-12T22:30:54.054 INFO:teuthology.orchestra.run.smithi163.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-12T22:30:54.054 INFO:teuthology.orchestra.run.smithi163.stdout: automake-1.16.2-8.el9.noarch 2024-09-12T22:30:54.054 INFO:teuthology.orchestra.run.smithi163.stdout: bison-3.7.4-5.el9.x86_64 2024-09-12T22:30:54.054 INFO:teuthology.orchestra.run.smithi163.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-12T22:30:54.055 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:30:54.055 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-base-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:30:54.055 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-common-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:30:54.055 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-fuse-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:30:54.055 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-grafana-dashboards-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:30:54.055 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-immutable-object-cache-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:30:54.055 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mds-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:30:54.055 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:30:54.055 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr-cephadm-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:30:54.055 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr-dashboard-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:30:54.056 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr-diskprediction-local-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:30:54.056 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr-modules-core-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:30:54.056 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr-rook-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:30:54.056 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mon-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:30:54.056 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-osd-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:30:54.056 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-prometheus-alerts-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:30:54.056 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-radosgw-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:30:54.056 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-selinux-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:30:54.057 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-test-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:30:54.057 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-volume-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:30:54.057 INFO:teuthology.orchestra.run.smithi163.stdout: cephadm-2:19.1.1-314.g086c737f.el9.noarch 2024-09-12T22:30:54.057 INFO:teuthology.orchestra.run.smithi163.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-12T22:30:54.057 INFO:teuthology.orchestra.run.smithi163.stdout: flex-2.6.4-9.el9.x86_64 2024-09-12T22:30:54.057 INFO:teuthology.orchestra.run.smithi163.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-12T22:30:54.057 INFO:teuthology.orchestra.run.smithi163.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-12T22:30:54.057 INFO:teuthology.orchestra.run.smithi163.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-12T22:30:54.057 INFO:teuthology.orchestra.run.smithi163.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-12T22:30:54.057 INFO:teuthology.orchestra.run.smithi163.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-12T22:30:54.058 INFO:teuthology.orchestra.run.smithi163.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-12T22:30:54.058 INFO:teuthology.orchestra.run.smithi163.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-12T22:30:54.058 INFO:teuthology.orchestra.run.smithi163.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-12T22:30:54.058 INFO:teuthology.orchestra.run.smithi163.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-12T22:30:54.058 INFO:teuthology.orchestra.run.smithi163.stdout: libcephfs-devel-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:30:54.058 INFO:teuthology.orchestra.run.smithi163.stdout: libcephfs2-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:30:54.058 INFO:teuthology.orchestra.run.smithi163.stdout: libcephsqlite-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:30:54.058 INFO:teuthology.orchestra.run.smithi163.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-12T22:30:54.059 INFO:teuthology.orchestra.run.smithi163.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-12T22:30:54.059 INFO:teuthology.orchestra.run.smithi163.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-12T22:30:54.059 INFO:teuthology.orchestra.run.smithi163.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-12T22:30:54.059 INFO:teuthology.orchestra.run.smithi163.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-12T22:30:54.059 INFO:teuthology.orchestra.run.smithi163.stdout: librados-devel-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:30:54.059 INFO:teuthology.orchestra.run.smithi163.stdout: libradosstriper1-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:30:54.059 INFO:teuthology.orchestra.run.smithi163.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-12T22:30:54.059 INFO:teuthology.orchestra.run.smithi163.stdout: librgw2-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:30:54.059 INFO:teuthology.orchestra.run.smithi163.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-12T22:30:54.059 INFO:teuthology.orchestra.run.smithi163.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-12T22:30:54.059 INFO:teuthology.orchestra.run.smithi163.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-12T22:30:54.060 INFO:teuthology.orchestra.run.smithi163.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-12T22:30:54.060 INFO:teuthology.orchestra.run.smithi163.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-12T22:30:54.060 INFO:teuthology.orchestra.run.smithi163.stdout: lua-5.4.4-4.el9.x86_64 2024-09-12T22:30:54.060 INFO:teuthology.orchestra.run.smithi163.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-12T22:30:54.060 INFO:teuthology.orchestra.run.smithi163.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-12T22:30:54.060 INFO:teuthology.orchestra.run.smithi163.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-12T22:30:54.060 INFO:teuthology.orchestra.run.smithi163.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-12T22:30:54.060 INFO:teuthology.orchestra.run.smithi163.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-12T22:30:54.060 INFO:teuthology.orchestra.run.smithi163.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-12T22:30:54.061 INFO:teuthology.orchestra.run.smithi163.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-12T22:30:54.061 INFO:teuthology.orchestra.run.smithi163.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-12T22:30:54.061 INFO:teuthology.orchestra.run.smithi163.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-12T22:30:54.061 INFO:teuthology.orchestra.run.smithi163.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-12T22:30:54.061 INFO:teuthology.orchestra.run.smithi163.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-12T22:30:54.061 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-12T22:30:54.061 INFO:teuthology.orchestra.run.smithi163.stdout: python3-ceph-argparse-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:30:54.061 INFO:teuthology.orchestra.run.smithi163.stdout: python3-ceph-common-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:30:54.061 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cephfs-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:30:54.061 INFO:teuthology.orchestra.run.smithi163.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-12T22:30:54.062 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-12T22:30:54.062 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-12T22:30:54.062 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-12T22:30:54.062 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-12T22:30:54.062 INFO:teuthology.orchestra.run.smithi163.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-12T22:30:54.063 INFO:teuthology.orchestra.run.smithi163.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-12T22:30:54.063 INFO:teuthology.orchestra.run.smithi163.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-12T22:30:54.063 INFO:teuthology.orchestra.run.smithi163.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-12T22:30:54.063 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-12T22:30:54.063 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-12T22:30:54.063 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-12T22:30:54.063 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-12T22:30:54.063 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-12T22:30:54.063 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-12T22:30:54.063 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-12T22:30:54.064 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-12T22:30:54.064 INFO:teuthology.orchestra.run.smithi163.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-12T22:30:54.064 INFO:teuthology.orchestra.run.smithi163.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-12T22:30:54.064 INFO:teuthology.orchestra.run.smithi163.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-12T22:30:54.064 INFO:teuthology.orchestra.run.smithi163.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-12T22:30:54.064 INFO:teuthology.orchestra.run.smithi163.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-12T22:30:54.064 INFO:teuthology.orchestra.run.smithi163.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-12T22:30:54.064 INFO:teuthology.orchestra.run.smithi163.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-12T22:30:54.064 INFO:teuthology.orchestra.run.smithi163.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-12T22:30:54.064 INFO:teuthology.orchestra.run.smithi163.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-12T22:30:54.065 INFO:teuthology.orchestra.run.smithi163.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-12T22:30:54.065 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-12T22:30:54.065 INFO:teuthology.orchestra.run.smithi163.stdout: python3-ply-3.11-14.el9.noarch 2024-09-12T22:30:54.065 INFO:teuthology.orchestra.run.smithi163.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-12T22:30:54.065 INFO:teuthology.orchestra.run.smithi163.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-12T22:30:54.065 INFO:teuthology.orchestra.run.smithi163.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-12T22:30:54.065 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-12T22:30:54.065 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-12T22:30:54.065 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-12T22:30:54.066 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-12T22:30:54.066 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-12T22:30:54.066 INFO:teuthology.orchestra.run.smithi163.stdout: python3-rados-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:30:54.066 INFO:teuthology.orchestra.run.smithi163.stdout: python3-rbd-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:30:54.066 INFO:teuthology.orchestra.run.smithi163.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-12T22:30:54.066 INFO:teuthology.orchestra.run.smithi163.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-12T22:30:54.066 INFO:teuthology.orchestra.run.smithi163.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-12T22:30:54.066 INFO:teuthology.orchestra.run.smithi163.stdout: python3-rgw-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:30:54.066 INFO:teuthology.orchestra.run.smithi163.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-12T22:30:54.066 INFO:teuthology.orchestra.run.smithi163.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-12T22:30:54.067 INFO:teuthology.orchestra.run.smithi163.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-12T22:30:54.067 INFO:teuthology.orchestra.run.smithi163.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-12T22:30:54.067 INFO:teuthology.orchestra.run.smithi163.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-12T22:30:54.067 INFO:teuthology.orchestra.run.smithi163.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-12T22:30:54.067 INFO:teuthology.orchestra.run.smithi163.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-12T22:30:54.067 INFO:teuthology.orchestra.run.smithi163.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-12T22:30:54.067 INFO:teuthology.orchestra.run.smithi163.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-12T22:30:54.067 INFO:teuthology.orchestra.run.smithi163.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-12T22:30:54.067 INFO:teuthology.orchestra.run.smithi163.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-12T22:30:54.067 INFO:teuthology.orchestra.run.smithi163.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-12T22:30:54.068 INFO:teuthology.orchestra.run.smithi163.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-12T22:30:54.068 INFO:teuthology.orchestra.run.smithi163.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-12T22:30:54.068 INFO:teuthology.orchestra.run.smithi163.stdout: rbd-fuse-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:30:54.068 INFO:teuthology.orchestra.run.smithi163.stdout: rbd-mirror-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:30:54.068 INFO:teuthology.orchestra.run.smithi163.stdout: rbd-nbd-2:19.1.1-314.g086c737f.el9.x86_64 2024-09-12T22:30:54.068 INFO:teuthology.orchestra.run.smithi163.stdout: re2-1:20211101-20.el9.x86_64 2024-09-12T22:30:54.068 INFO:teuthology.orchestra.run.smithi163.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-12T22:30:54.068 INFO:teuthology.orchestra.run.smithi163.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-12T22:30:54.068 INFO:teuthology.orchestra.run.smithi163.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-12T22:30:54.068 INFO:teuthology.orchestra.run.smithi163.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-12T22:30:54.069 INFO:teuthology.orchestra.run.smithi163.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-12T22:30:54.069 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-09-12T22:30:54.069 INFO:teuthology.orchestra.run.smithi163.stdout:Complete! 2024-09-12T22:30:54.451 DEBUG:teuthology.parallel:result is None 2024-09-12T22:30:54.453 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=086c737fa75c22d521a3932c59b31c5e1d1c9ef4 2024-09-12T22:30:54.605 DEBUG:teuthology.orchestra.run.smithi019:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-12T22:30:54.632 INFO:teuthology.orchestra.run.smithi019.stdout:19.1.1-314.g086c737f.el9 2024-09-12T22:30:54.633 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-314.g086c737f.el9 2024-09-12T22:30:54.633 INFO:teuthology.task.install:The correct ceph version 19.1.1-314.g086c737f is installed. 2024-09-12T22:30:54.636 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=086c737fa75c22d521a3932c59b31c5e1d1c9ef4 2024-09-12T22:30:54.781 DEBUG:teuthology.orchestra.run.smithi076:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-12T22:30:54.806 INFO:teuthology.orchestra.run.smithi076.stdout:19.1.1-314.g086c737f.el9 2024-09-12T22:30:54.807 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-314.g086c737f.el9 2024-09-12T22:30:54.807 INFO:teuthology.task.install:The correct ceph version 19.1.1-314.g086c737f is installed. 2024-09-12T22:30:54.809 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=086c737fa75c22d521a3932c59b31c5e1d1c9ef4 2024-09-12T22:30:54.962 DEBUG:teuthology.orchestra.run.smithi148:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-12T22:30:54.988 INFO:teuthology.orchestra.run.smithi148.stdout:19.1.1-314.g086c737f.el9 2024-09-12T22:30:54.989 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-314.g086c737f.el9 2024-09-12T22:30:54.989 INFO:teuthology.task.install:The correct ceph version 19.1.1-314.g086c737f is installed. 2024-09-12T22:30:54.990 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=086c737fa75c22d521a3932c59b31c5e1d1c9ef4 2024-09-12T22:30:55.132 DEBUG:teuthology.orchestra.run.smithi163:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-12T22:30:55.157 INFO:teuthology.orchestra.run.smithi163.stdout:19.1.1-314.g086c737f.el9 2024-09-12T22:30:55.157 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-314.g086c737f.el9 2024-09-12T22:30:55.157 INFO:teuthology.task.install:The correct ceph version 19.1.1-314.g086c737f is installed. 2024-09-12T22:30:55.159 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-12T22:30:55.159 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T22:30:55.160 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T22:30:55.193 DEBUG:teuthology.orchestra.run.smithi076:> set -ex 2024-09-12T22:30:55.193 DEBUG:teuthology.orchestra.run.smithi076:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T22:30:55.225 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-12T22:30:55.225 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T22:30:55.257 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-09-12T22:30:55.258 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T22:30:55.287 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-12T22:30:55.287 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T22:30:55.287 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T22:30:55.318 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T22:30:55.401 DEBUG:teuthology.orchestra.run.smithi076:> set -ex 2024-09-12T22:30:55.402 DEBUG:teuthology.orchestra.run.smithi076:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T22:30:55.430 DEBUG:teuthology.orchestra.run.smithi076:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T22:30:55.499 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-12T22:30:55.499 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T22:30:55.525 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T22:30:55.590 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-09-12T22:30:55.590 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T22:30:55.619 DEBUG:teuthology.orchestra.run.smithi163:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T22:30:55.688 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-12T22:30:55.688 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T22:30:55.688 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T22:30:55.715 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T22:30:55.781 DEBUG:teuthology.orchestra.run.smithi076:> set -ex 2024-09-12T22:30:55.781 DEBUG:teuthology.orchestra.run.smithi076:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T22:30:55.810 DEBUG:teuthology.orchestra.run.smithi076:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T22:30:55.879 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-12T22:30:55.879 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T22:30:55.905 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T22:30:55.970 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-09-12T22:30:55.970 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T22:30:55.998 DEBUG:teuthology.orchestra.run.smithi163:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T22:30:56.066 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-12T22:30:56.066 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T22:30:56.066 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T22:30:56.092 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T22:30:56.158 DEBUG:teuthology.orchestra.run.smithi076:> set -ex 2024-09-12T22:30:56.159 DEBUG:teuthology.orchestra.run.smithi076:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T22:30:56.188 DEBUG:teuthology.orchestra.run.smithi076:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T22:30:56.259 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-12T22:30:56.259 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T22:30:56.284 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T22:30:56.349 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-09-12T22:30:56.349 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T22:30:56.379 DEBUG:teuthology.orchestra.run.smithi163:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T22:30:56.448 INFO:teuthology.run_tasks:Running task ceph... 2024-09-12T22:30:56.529 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-12T22:30:56.530 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 777 /var/log/ceph 2024-09-12T22:30:56.532 DEBUG:teuthology.orchestra.run.smithi076:> sudo chmod 777 /var/log/ceph 2024-09-12T22:30:56.535 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod 777 /var/log/ceph 2024-09-12T22:30:56.537 DEBUG:teuthology.orchestra.run.smithi163:> sudo chmod 777 /var/log/ceph 2024-09-12T22:30:56.564 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-12T22:30:56.565 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-12T22:30:56.598 DEBUG:teuthology.orchestra.run.smithi076:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-12T22:30:56.603 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-12T22:30:56.606 DEBUG:teuthology.orchestra.run.smithi163:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-12T22:30:56.632 INFO:tasks.ceph:Creating extra log directories... 2024-09-12T22:30:56.633 DEBUG:teuthology.orchestra.run.smithi019:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-12T22:30:56.664 DEBUG:teuthology.orchestra.run.smithi076:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-12T22:30:56.671 DEBUG:teuthology.orchestra.run.smithi148:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-12T22:30:56.673 DEBUG:teuthology.orchestra.run.smithi163:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-12T22:30:56.710 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-12T22:30:56.710 INFO:tasks.ceph:config {'conf': {'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_TRIM\\)', '\\(MDS_SLOW_REQUEST\\)', 'MDS_SLOW_METADATA_IO', 'Behind on trimming', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-12T22:30:56.710 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-09-12_21:32:03-powercycle-squid-distro-default-smithi/7902933', 'branch': 'squid', 'description': 'powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-bitmap powercycle/default supported-distros/centos_latest tasks/cfuse_workunit_suites_fsstress thrashosds-health}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7902933', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'teuthology-2024-09-12_21:32:03-powercycle-squid-distro-default-smithi', 'no_nested_subset': False, 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'squid'}, 'ceph': {'conf': {'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_TRIM\\)', '\\(MDS_SLOW_REQUEST\\)', 'MDS_SLOW_METADATA_IO', 'Behind on trimming', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'sha1': '086c737fa75c22d521a3932c59b31c5e1d1c9ef4'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '086c737fa75c22d521a3932c59b31c5e1d1c9ef4'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'squid', 'sha1': '7741f7f9ee20524f89b8f61d1609b32fb3b1570a'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 100, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mgr.y', 'mds.a', 'client.0'], ['osd.0'], ['osd.1'], ['osd.2']], 'seed': 8861, 'sha1': '086c737fa75c22d521a3932c59b31c5e1d1c9ef4', 'sleep_before_teardown': 0, 'subset': '0/4', 'suite': 'powercycle', 'suite_branch': 'squid', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_7741f7f9ee20524f89b8f61d1609b32fb3b1570a/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': '7741f7f9ee20524f89b8f61d1609b32fb3b1570a', 'targets': {'smithi019.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBF3VKjqCV+iuQ7xV0iH10HZgQza40eoM2qnINn2SJAmgFIFPWBkgvyCjnZTvxsmB2+MzV7CLC4bgeZE4SayYO20=', 'smithi076.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFsL6/5203T85kqBOWQwf55Cc9mmMUZbHCqWC2kSk68eDUb/eDiv8uVWGVNl6tocWABbgeZNzNzwOmXWPYGJj44=', 'smithi148.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAwERC1tikDtc4R03U3CvVxVi2ul0YRnJJV4werj6iekImfxaPYbZreAlOJmU8niYrKFn/YCQv41h7lfybMpaNQ=', 'smithi163.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHGWBqFSl5e0CU0iZRXe/HnkgpJaBTpYlG0ujqXxASX8qqO7wT9LFHdCj/FjXNGBlEE9ePMaVU2NZYJ9zjwEE34='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '086c737fa75c22d521a3932c59b31c5e1d1c9ef4'}}, {'ceph': None}, {'thrashosds': {'chance_down': 1.0, 'powercycle': True, 'timeout': 600}}, {'ceph-fuse': None}, {'workunit': {'clients': {'all': ['suites/fsstress.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-12_21:32:03', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-12T22:30:56.711 DEBUG:teuthology.orchestra.run.smithi019:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-12T22:30:56.732 DEBUG:teuthology.orchestra.run.smithi076:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-12T22:30:56.739 DEBUG:teuthology.orchestra.run.smithi148:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-12T22:30:56.742 DEBUG:teuthology.orchestra.run.smithi163:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-12T22:30:56.758 DEBUG:teuthology.orchestra.run.smithi019:> sudo install -d -m0777 -- /var/run/ceph 2024-09-12T22:30:56.788 DEBUG:teuthology.orchestra.run.smithi076:> sudo install -d -m0777 -- /var/run/ceph 2024-09-12T22:30:56.796 DEBUG:teuthology.orchestra.run.smithi148:> sudo install -d -m0777 -- /var/run/ceph 2024-09-12T22:30:56.798 DEBUG:teuthology.orchestra.run.smithi163:> sudo install -d -m0777 -- /var/run/ceph 2024-09-12T22:30:56.824 DEBUG:teuthology.orchestra.run.smithi076:> set -ex 2024-09-12T22:30:56.824 DEBUG:teuthology.orchestra.run.smithi076:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T22:30:56.879 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T22:30:56.880 DEBUG:teuthology.orchestra.run.smithi076:> stat /dev/vg_nvme/lv_1 2024-09-12T22:30:56.937 INFO:teuthology.orchestra.run.smithi076.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T22:30:56.937 INFO:teuthology.orchestra.run.smithi076.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T22:30:56.937 INFO:teuthology.orchestra.run.smithi076.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-12T22:30:56.937 INFO:teuthology.orchestra.run.smithi076.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T22:30:56.937 INFO:teuthology.orchestra.run.smithi076.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T22:30:56.937 INFO:teuthology.orchestra.run.smithi076.stdout:Access: 2024-09-12 22:30:36.526086304 +0000 2024-09-12T22:30:56.937 INFO:teuthology.orchestra.run.smithi076.stdout:Modify: 2024-09-12 22:28:42.474754594 +0000 2024-09-12T22:30:56.938 INFO:teuthology.orchestra.run.smithi076.stdout:Change: 2024-09-12 22:28:42.474754594 +0000 2024-09-12T22:30:56.938 INFO:teuthology.orchestra.run.smithi076.stdout: Birth: 2024-09-12 22:28:42.474754594 +0000 2024-09-12T22:30:56.938 DEBUG:teuthology.orchestra.run.smithi076:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T22:30:57.002 INFO:teuthology.orchestra.run.smithi076.stderr:1+0 records in 2024-09-12T22:30:57.002 INFO:teuthology.orchestra.run.smithi076.stderr:1+0 records out 2024-09-12T22:30:57.002 INFO:teuthology.orchestra.run.smithi076.stderr:512 bytes copied, 0.000230935 s, 2.2 MB/s 2024-09-12T22:30:57.003 DEBUG:teuthology.orchestra.run.smithi076:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T22:30:57.061 DEBUG:teuthology.orchestra.run.smithi076:> stat /dev/vg_nvme/lv_2 2024-09-12T22:30:57.118 INFO:teuthology.orchestra.run.smithi076.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T22:30:57.118 INFO:teuthology.orchestra.run.smithi076.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T22:30:57.118 INFO:teuthology.orchestra.run.smithi076.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-12T22:30:57.118 INFO:teuthology.orchestra.run.smithi076.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T22:30:57.118 INFO:teuthology.orchestra.run.smithi076.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T22:30:57.118 INFO:teuthology.orchestra.run.smithi076.stdout:Access: 2024-09-12 22:30:36.527086274 +0000 2024-09-12T22:30:57.118 INFO:teuthology.orchestra.run.smithi076.stdout:Modify: 2024-09-12 22:28:42.806744585 +0000 2024-09-12T22:30:57.118 INFO:teuthology.orchestra.run.smithi076.stdout:Change: 2024-09-12 22:28:42.806744585 +0000 2024-09-12T22:30:57.119 INFO:teuthology.orchestra.run.smithi076.stdout: Birth: 2024-09-12 22:28:42.806744585 +0000 2024-09-12T22:30:57.119 DEBUG:teuthology.orchestra.run.smithi076:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T22:30:57.183 INFO:teuthology.orchestra.run.smithi076.stderr:1+0 records in 2024-09-12T22:30:57.183 INFO:teuthology.orchestra.run.smithi076.stderr:1+0 records out 2024-09-12T22:30:57.183 INFO:teuthology.orchestra.run.smithi076.stderr:512 bytes copied, 0.000309718 s, 1.7 MB/s 2024-09-12T22:30:57.184 DEBUG:teuthology.orchestra.run.smithi076:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T22:30:57.242 DEBUG:teuthology.orchestra.run.smithi076:> stat /dev/vg_nvme/lv_3 2024-09-12T22:30:57.298 INFO:teuthology.orchestra.run.smithi076.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T22:30:57.298 INFO:teuthology.orchestra.run.smithi076.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T22:30:57.298 INFO:teuthology.orchestra.run.smithi076.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-09-12T22:30:57.298 INFO:teuthology.orchestra.run.smithi076.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T22:30:57.298 INFO:teuthology.orchestra.run.smithi076.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T22:30:57.298 INFO:teuthology.orchestra.run.smithi076.stdout:Access: 2024-09-12 22:30:36.527086274 +0000 2024-09-12T22:30:57.298 INFO:teuthology.orchestra.run.smithi076.stdout:Modify: 2024-09-12 22:28:43.130734818 +0000 2024-09-12T22:30:57.298 INFO:teuthology.orchestra.run.smithi076.stdout:Change: 2024-09-12 22:28:43.130734818 +0000 2024-09-12T22:30:57.298 INFO:teuthology.orchestra.run.smithi076.stdout: Birth: 2024-09-12 22:28:43.130734818 +0000 2024-09-12T22:30:57.299 DEBUG:teuthology.orchestra.run.smithi076:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T22:30:57.361 INFO:teuthology.orchestra.run.smithi076.stderr:1+0 records in 2024-09-12T22:30:57.362 INFO:teuthology.orchestra.run.smithi076.stderr:1+0 records out 2024-09-12T22:30:57.362 INFO:teuthology.orchestra.run.smithi076.stderr:512 bytes copied, 0.00023236 s, 2.2 MB/s 2024-09-12T22:30:57.363 DEBUG:teuthology.orchestra.run.smithi076:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T22:30:57.420 DEBUG:teuthology.orchestra.run.smithi076:> stat /dev/vg_nvme/lv_4 2024-09-12T22:30:57.476 INFO:teuthology.orchestra.run.smithi076.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T22:30:57.476 INFO:teuthology.orchestra.run.smithi076.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T22:30:57.476 INFO:teuthology.orchestra.run.smithi076.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-09-12T22:30:57.477 INFO:teuthology.orchestra.run.smithi076.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T22:30:57.477 INFO:teuthology.orchestra.run.smithi076.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T22:30:57.477 INFO:teuthology.orchestra.run.smithi076.stdout:Access: 2024-09-12 22:30:36.527086274 +0000 2024-09-12T22:30:57.477 INFO:teuthology.orchestra.run.smithi076.stdout:Modify: 2024-09-12 22:28:43.473724477 +0000 2024-09-12T22:30:57.477 INFO:teuthology.orchestra.run.smithi076.stdout:Change: 2024-09-12 22:28:43.473724477 +0000 2024-09-12T22:30:57.477 INFO:teuthology.orchestra.run.smithi076.stdout: Birth: 2024-09-12 22:28:43.473724477 +0000 2024-09-12T22:30:57.477 DEBUG:teuthology.orchestra.run.smithi076:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T22:30:57.539 INFO:teuthology.orchestra.run.smithi076.stderr:1+0 records in 2024-09-12T22:30:57.540 INFO:teuthology.orchestra.run.smithi076.stderr:1+0 records out 2024-09-12T22:30:57.540 INFO:teuthology.orchestra.run.smithi076.stderr:512 bytes copied, 0.000183679 s, 2.8 MB/s 2024-09-12T22:30:57.541 DEBUG:teuthology.orchestra.run.smithi076:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T22:30:57.597 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-09-12T22:30:57.597 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-12T22:30:57.597 DEBUG:teuthology.orchestra.run.smithi148:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T22:30:57.615 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T22:30:57.615 DEBUG:teuthology.orchestra.run.smithi148:> stat /dev/vg_nvme/lv_1 2024-09-12T22:30:57.671 INFO:teuthology.orchestra.run.smithi148.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T22:30:57.672 INFO:teuthology.orchestra.run.smithi148.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T22:30:57.672 INFO:teuthology.orchestra.run.smithi148.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-12T22:30:57.672 INFO:teuthology.orchestra.run.smithi148.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T22:30:57.672 INFO:teuthology.orchestra.run.smithi148.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T22:30:57.672 INFO:teuthology.orchestra.run.smithi148.stdout:Access: 2024-09-12 22:30:29.963771059 +0000 2024-09-12T22:30:57.672 INFO:teuthology.orchestra.run.smithi148.stdout:Modify: 2024-09-12 22:28:44.309472912 +0000 2024-09-12T22:30:57.672 INFO:teuthology.orchestra.run.smithi148.stdout:Change: 2024-09-12 22:28:44.309472912 +0000 2024-09-12T22:30:57.672 INFO:teuthology.orchestra.run.smithi148.stdout: Birth: 2024-09-12 22:28:44.309472912 +0000 2024-09-12T22:30:57.672 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T22:30:57.737 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records in 2024-09-12T22:30:57.737 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records out 2024-09-12T22:30:57.738 INFO:teuthology.orchestra.run.smithi148.stderr:512 bytes copied, 0.000216266 s, 2.4 MB/s 2024-09-12T22:30:57.739 DEBUG:teuthology.orchestra.run.smithi148:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T22:30:57.796 DEBUG:teuthology.orchestra.run.smithi148:> stat /dev/vg_nvme/lv_2 2024-09-12T22:30:57.853 INFO:teuthology.orchestra.run.smithi148.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T22:30:57.853 INFO:teuthology.orchestra.run.smithi148.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T22:30:57.853 INFO:teuthology.orchestra.run.smithi148.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-12T22:30:57.853 INFO:teuthology.orchestra.run.smithi148.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T22:30:57.853 INFO:teuthology.orchestra.run.smithi148.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T22:30:57.854 INFO:teuthology.orchestra.run.smithi148.stdout:Access: 2024-09-12 22:30:29.964771034 +0000 2024-09-12T22:30:57.854 INFO:teuthology.orchestra.run.smithi148.stdout:Modify: 2024-09-12 22:28:44.634464833 +0000 2024-09-12T22:30:57.854 INFO:teuthology.orchestra.run.smithi148.stdout:Change: 2024-09-12 22:28:44.635464808 +0000 2024-09-12T22:30:57.854 INFO:teuthology.orchestra.run.smithi148.stdout: Birth: 2024-09-12 22:28:44.634464833 +0000 2024-09-12T22:30:57.854 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T22:30:57.917 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records in 2024-09-12T22:30:57.917 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records out 2024-09-12T22:30:57.917 INFO:teuthology.orchestra.run.smithi148.stderr:512 bytes copied, 0.000211711 s, 2.4 MB/s 2024-09-12T22:30:57.919 DEBUG:teuthology.orchestra.run.smithi148:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T22:30:57.975 DEBUG:teuthology.orchestra.run.smithi148:> stat /dev/vg_nvme/lv_3 2024-09-12T22:30:58.032 INFO:teuthology.orchestra.run.smithi148.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T22:30:58.032 INFO:teuthology.orchestra.run.smithi148.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T22:30:58.032 INFO:teuthology.orchestra.run.smithi148.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-12T22:30:58.032 INFO:teuthology.orchestra.run.smithi148.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T22:30:58.032 INFO:teuthology.orchestra.run.smithi148.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T22:30:58.032 INFO:teuthology.orchestra.run.smithi148.stdout:Access: 2024-09-12 22:30:29.964771034 +0000 2024-09-12T22:30:58.032 INFO:teuthology.orchestra.run.smithi148.stdout:Modify: 2024-09-12 22:28:44.967456555 +0000 2024-09-12T22:30:58.032 INFO:teuthology.orchestra.run.smithi148.stdout:Change: 2024-09-12 22:28:44.967456555 +0000 2024-09-12T22:30:58.032 INFO:teuthology.orchestra.run.smithi148.stdout: Birth: 2024-09-12 22:28:44.967456555 +0000 2024-09-12T22:30:58.033 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T22:30:58.095 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records in 2024-09-12T22:30:58.096 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records out 2024-09-12T22:30:58.096 INFO:teuthology.orchestra.run.smithi148.stderr:512 bytes copied, 0.000209306 s, 2.4 MB/s 2024-09-12T22:30:58.097 DEBUG:teuthology.orchestra.run.smithi148:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T22:30:58.153 DEBUG:teuthology.orchestra.run.smithi148:> stat /dev/vg_nvme/lv_4 2024-09-12T22:30:58.208 INFO:teuthology.orchestra.run.smithi148.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T22:30:58.208 INFO:teuthology.orchestra.run.smithi148.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T22:30:58.209 INFO:teuthology.orchestra.run.smithi148.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-12T22:30:58.209 INFO:teuthology.orchestra.run.smithi148.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T22:30:58.209 INFO:teuthology.orchestra.run.smithi148.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T22:30:58.209 INFO:teuthology.orchestra.run.smithi148.stdout:Access: 2024-09-12 22:30:29.964771034 +0000 2024-09-12T22:30:58.209 INFO:teuthology.orchestra.run.smithi148.stdout:Modify: 2024-09-12 22:28:45.293448451 +0000 2024-09-12T22:30:58.209 INFO:teuthology.orchestra.run.smithi148.stdout:Change: 2024-09-12 22:28:45.293448451 +0000 2024-09-12T22:30:58.209 INFO:teuthology.orchestra.run.smithi148.stdout: Birth: 2024-09-12 22:28:45.293448451 +0000 2024-09-12T22:30:58.209 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T22:30:58.272 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records in 2024-09-12T22:30:58.272 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records out 2024-09-12T22:30:58.272 INFO:teuthology.orchestra.run.smithi148.stderr:512 bytes copied, 0.000191233 s, 2.7 MB/s 2024-09-12T22:30:58.273 DEBUG:teuthology.orchestra.run.smithi148:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T22:30:58.329 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_1'} 2024-09-12T22:30:58.329 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-09-12T22:30:58.329 DEBUG:teuthology.orchestra.run.smithi163:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T22:30:58.348 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T22:30:58.349 DEBUG:teuthology.orchestra.run.smithi163:> stat /dev/vg_nvme/lv_1 2024-09-12T22:30:58.406 INFO:teuthology.orchestra.run.smithi163.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T22:30:58.406 INFO:teuthology.orchestra.run.smithi163.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T22:30:58.406 INFO:teuthology.orchestra.run.smithi163.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-12T22:30:58.407 INFO:teuthology.orchestra.run.smithi163.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T22:30:58.407 INFO:teuthology.orchestra.run.smithi163.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T22:30:58.407 INFO:teuthology.orchestra.run.smithi163.stdout:Access: 2024-09-12 22:30:46.459479005 +0000 2024-09-12T22:30:58.407 INFO:teuthology.orchestra.run.smithi163.stdout:Modify: 2024-09-12 22:28:44.712781354 +0000 2024-09-12T22:30:58.407 INFO:teuthology.orchestra.run.smithi163.stdout:Change: 2024-09-12 22:28:44.712781354 +0000 2024-09-12T22:30:58.407 INFO:teuthology.orchestra.run.smithi163.stdout: Birth: 2024-09-12 22:28:44.712781354 +0000 2024-09-12T22:30:58.407 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T22:30:58.474 INFO:teuthology.orchestra.run.smithi163.stderr:1+0 records in 2024-09-12T22:30:58.474 INFO:teuthology.orchestra.run.smithi163.stderr:1+0 records out 2024-09-12T22:30:58.474 INFO:teuthology.orchestra.run.smithi163.stderr:512 bytes copied, 0.000277985 s, 1.8 MB/s 2024-09-12T22:30:58.476 DEBUG:teuthology.orchestra.run.smithi163:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T22:30:58.535 DEBUG:teuthology.orchestra.run.smithi163:> stat /dev/vg_nvme/lv_2 2024-09-12T22:30:58.592 INFO:teuthology.orchestra.run.smithi163.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T22:30:58.592 INFO:teuthology.orchestra.run.smithi163.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T22:30:58.592 INFO:teuthology.orchestra.run.smithi163.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-09-12T22:30:58.592 INFO:teuthology.orchestra.run.smithi163.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T22:30:58.592 INFO:teuthology.orchestra.run.smithi163.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T22:30:58.593 INFO:teuthology.orchestra.run.smithi163.stdout:Access: 2024-09-12 22:30:46.459479005 +0000 2024-09-12T22:30:58.593 INFO:teuthology.orchestra.run.smithi163.stdout:Modify: 2024-09-12 22:28:45.081773027 +0000 2024-09-12T22:30:58.593 INFO:teuthology.orchestra.run.smithi163.stdout:Change: 2024-09-12 22:28:45.081773027 +0000 2024-09-12T22:30:58.593 INFO:teuthology.orchestra.run.smithi163.stdout: Birth: 2024-09-12 22:28:45.081773027 +0000 2024-09-12T22:30:58.593 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T22:30:58.657 INFO:teuthology.orchestra.run.smithi163.stderr:1+0 records in 2024-09-12T22:30:58.658 INFO:teuthology.orchestra.run.smithi163.stderr:1+0 records out 2024-09-12T22:30:58.658 INFO:teuthology.orchestra.run.smithi163.stderr:512 bytes copied, 0.00023941 s, 2.1 MB/s 2024-09-12T22:30:58.659 DEBUG:teuthology.orchestra.run.smithi163:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T22:30:58.717 DEBUG:teuthology.orchestra.run.smithi163:> stat /dev/vg_nvme/lv_3 2024-09-12T22:30:58.774 INFO:teuthology.orchestra.run.smithi163.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T22:30:58.774 INFO:teuthology.orchestra.run.smithi163.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T22:30:58.774 INFO:teuthology.orchestra.run.smithi163.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-12T22:30:58.774 INFO:teuthology.orchestra.run.smithi163.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T22:30:58.774 INFO:teuthology.orchestra.run.smithi163.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T22:30:58.774 INFO:teuthology.orchestra.run.smithi163.stdout:Access: 2024-09-12 22:30:46.459479005 +0000 2024-09-12T22:30:58.774 INFO:teuthology.orchestra.run.smithi163.stdout:Modify: 2024-09-12 22:28:45.392766009 +0000 2024-09-12T22:30:58.774 INFO:teuthology.orchestra.run.smithi163.stdout:Change: 2024-09-12 22:28:45.392766009 +0000 2024-09-12T22:30:58.774 INFO:teuthology.orchestra.run.smithi163.stdout: Birth: 2024-09-12 22:28:45.392766009 +0000 2024-09-12T22:30:58.775 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T22:30:58.838 INFO:teuthology.orchestra.run.smithi163.stderr:1+0 records in 2024-09-12T22:30:58.838 INFO:teuthology.orchestra.run.smithi163.stderr:1+0 records out 2024-09-12T22:30:58.839 INFO:teuthology.orchestra.run.smithi163.stderr:512 bytes copied, 0.000236308 s, 2.2 MB/s 2024-09-12T22:30:58.840 DEBUG:teuthology.orchestra.run.smithi163:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T22:30:58.897 DEBUG:teuthology.orchestra.run.smithi163:> stat /dev/vg_nvme/lv_4 2024-09-12T22:30:58.953 INFO:teuthology.orchestra.run.smithi163.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T22:30:58.953 INFO:teuthology.orchestra.run.smithi163.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T22:30:58.953 INFO:teuthology.orchestra.run.smithi163.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-12T22:30:58.953 INFO:teuthology.orchestra.run.smithi163.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T22:30:58.953 INFO:teuthology.orchestra.run.smithi163.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T22:30:58.953 INFO:teuthology.orchestra.run.smithi163.stdout:Access: 2024-09-12 22:30:46.460478983 +0000 2024-09-12T22:30:58.953 INFO:teuthology.orchestra.run.smithi163.stdout:Modify: 2024-09-12 22:28:45.717758676 +0000 2024-09-12T22:30:58.954 INFO:teuthology.orchestra.run.smithi163.stdout:Change: 2024-09-12 22:28:45.717758676 +0000 2024-09-12T22:30:58.954 INFO:teuthology.orchestra.run.smithi163.stdout: Birth: 2024-09-12 22:28:45.717758676 +0000 2024-09-12T22:30:58.954 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T22:30:59.017 INFO:teuthology.orchestra.run.smithi163.stderr:1+0 records in 2024-09-12T22:30:59.017 INFO:teuthology.orchestra.run.smithi163.stderr:1+0 records out 2024-09-12T22:30:59.017 INFO:teuthology.orchestra.run.smithi163.stderr:512 bytes copied, 0.000215608 s, 2.4 MB/s 2024-09-12T22:30:59.018 DEBUG:teuthology.orchestra.run.smithi163:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T22:30:59.075 INFO:tasks.ceph:osd dev map: {'osd.2': '/dev/vg_nvme/lv_1'} 2024-09-12T22:30:59.075 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi076.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi148.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi163.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1'}} 2024-09-12T22:30:59.076 INFO:tasks.ceph:Generating config... 2024-09-12T22:30:59.078 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-12T22:30:59.078 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-12T22:30:59.078 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-12T22:30:59.078 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-12T22:30:59.078 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-12T22:30:59.078 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-12T22:30:59.078 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-12T22:30:59.078 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-12T22:30:59.078 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-12T22:30:59.078 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-12T22:30:59.079 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-12T22:30:59.079 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-12T22:30:59.079 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-12T22:30:59.079 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-12T22:30:59.079 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-12T22:30:59.079 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-12T22:30:59.079 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-12T22:30:59.079 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-12T22:30:59.079 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-09-12T22:30:59.079 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-12T22:30:59.079 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-09-12T22:30:59.079 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-12T22:30:59.080 INFO:tasks.ceph:Setting up mon.a... 2024-09-12T22:30:59.080 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-12T22:30:59.139 INFO:teuthology.orchestra.run.smithi019.stdout:creating /etc/ceph/ceph.keyring 2024-09-12T22:30:59.142 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-12T22:30:59.192 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T22:30:59.220 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.19'), ('mon.b', '[v2:172.21.15.19:3301,v1:172.21.15.19:6790]'), ('mon.c', '[v2:172.21.15.19:3302,v1:172.21.15.19:6791]')] 2024-09-12T22:30:59.220 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.19,[v2:172.21.15.19:3301,v1:172.21.15.19:6790],[v2:172.21.15.19:3302,v1:172.21.15.19:6791]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}} 2024-09-12T22:30:59.221 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T22:30:59.221 DEBUG:teuthology.orchestra.run.smithi019:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-12T22:30:59.277 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.19 --addv b '[v2:172.21.15.19:3301,v1:172.21.15.19:6790]' --addv c '[v2:172.21.15.19:3302,v1:172.21.15.19:6791]' --print /home/ubuntu/cephtest/ceph.monmap 2024-09-12T22:30:59.366 INFO:teuthology.orchestra.run.smithi019.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-12T22:30:59.366 INFO:teuthology.orchestra.run.smithi019.stdout:monmaptool: generated fsid 957ce235-19cb-4350-8fee-febd6e3f2199 2024-09-12T22:30:59.366 INFO:teuthology.orchestra.run.smithi019.stdout:setting min_mon_release = quincy 2024-09-12T22:30:59.366 INFO:teuthology.orchestra.run.smithi019.stdout:epoch 0 2024-09-12T22:30:59.366 INFO:teuthology.orchestra.run.smithi019.stdout:fsid 957ce235-19cb-4350-8fee-febd6e3f2199 2024-09-12T22:30:59.366 INFO:teuthology.orchestra.run.smithi019.stdout:last_changed 2024-09-12T22:30:59.365661+0000 2024-09-12T22:30:59.366 INFO:teuthology.orchestra.run.smithi019.stdout:created 2024-09-12T22:30:59.365661+0000 2024-09-12T22:30:59.366 INFO:teuthology.orchestra.run.smithi019.stdout:min_mon_release 17 (quincy) 2024-09-12T22:30:59.367 INFO:teuthology.orchestra.run.smithi019.stdout:election_strategy: 1 2024-09-12T22:30:59.367 INFO:teuthology.orchestra.run.smithi019.stdout:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T22:30:59.367 INFO:teuthology.orchestra.run.smithi019.stdout:1: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.b 2024-09-12T22:30:59.367 INFO:teuthology.orchestra.run.smithi019.stdout:2: [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] mon.c 2024-09-12T22:30:59.367 INFO:teuthology.orchestra.run.smithi019.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-12T22:30:59.368 DEBUG:teuthology.orchestra.run.smithi019:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-12T22:30:59.384 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 957ce235-19cb-4350-8fee-febd6e3f2199... 2024-09-12T22:30:59.385 DEBUG:teuthology.orchestra.run.smithi019:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-12T22:30:59.426 DEBUG:teuthology.orchestra.run.smithi076:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-12T22:30:59.429 DEBUG:teuthology.orchestra.run.smithi148:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-12T22:30:59.432 DEBUG:teuthology.orchestra.run.smithi163:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-12T22:30:59.469 INFO:teuthology.orchestra.run.smithi019.stdout:[global] 2024-09-12T22:30:59.469 INFO:teuthology.orchestra.run.smithi019.stdout: chdir = "" 2024-09-12T22:30:59.469 INFO:teuthology.orchestra.run.smithi019.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-12T22:30:59.469 INFO:teuthology.orchestra.run.smithi019.stdout: auth supported = cephx 2024-09-12T22:30:59.469 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:30:59.469 INFO:teuthology.orchestra.run.smithi019.stdout: filestore xattr use omap = true 2024-09-12T22:30:59.470 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:30:59.470 INFO:teuthology.orchestra.run.smithi019.stdout: mon clock drift allowed = 1.000 2024-09-12T22:30:59.470 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:30:59.470 INFO:teuthology.orchestra.run.smithi019.stdout: osd crush chooseleaf type = 0 2024-09-12T22:30:59.471 INFO:teuthology.orchestra.run.smithi019.stdout: auth debug = true 2024-09-12T22:30:59.471 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:30:59.472 INFO:teuthology.orchestra.run.smithi019.stdout: ms die on old message = true 2024-09-12T22:30:59.472 INFO:teuthology.orchestra.run.smithi019.stdout: ms die on bug = true 2024-09-12T22:30:59.472 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:30:59.472 INFO:teuthology.orchestra.run.smithi019.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-12T22:30:59.472 INFO:teuthology.orchestra.run.smithi019.stdout: mon pg warn max object skew = 0 2024-09-12T22:30:59.472 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:30:59.472 INFO:teuthology.orchestra.run.smithi019.stdout: # disable pg_autoscaler by default for new pools 2024-09-12T22:30:59.472 INFO:teuthology.orchestra.run.smithi019.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-12T22:30:59.472 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:30:59.472 INFO:teuthology.orchestra.run.smithi019.stdout: osd pool default size = 2 2024-09-12T22:30:59.472 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:30:59.472 INFO:teuthology.orchestra.run.smithi019.stdout: mon osd allow primary affinity = true 2024-09-12T22:30:59.473 INFO:teuthology.orchestra.run.smithi019.stdout: mon osd allow pg remap = true 2024-09-12T22:30:59.473 INFO:teuthology.orchestra.run.smithi019.stdout: mon warn on legacy crush tunables = false 2024-09-12T22:30:59.473 INFO:teuthology.orchestra.run.smithi019.stdout: mon warn on crush straw calc version zero = false 2024-09-12T22:30:59.473 INFO:teuthology.orchestra.run.smithi019.stdout: mon warn on no sortbitwise = false 2024-09-12T22:30:59.473 INFO:teuthology.orchestra.run.smithi019.stdout: mon warn on osd down out interval zero = false 2024-09-12T22:30:59.473 INFO:teuthology.orchestra.run.smithi019.stdout: mon warn on too few osds = false 2024-09-12T22:30:59.473 INFO:teuthology.orchestra.run.smithi019.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-12T22:30:59.473 INFO:teuthology.orchestra.run.smithi019.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-12T22:30:59.473 INFO:teuthology.orchestra.run.smithi019.stdout: mon_allow_pool_size_one = true 2024-09-12T22:30:59.473 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:30:59.474 INFO:teuthology.orchestra.run.smithi019.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-12T22:30:59.474 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:30:59.474 INFO:teuthology.orchestra.run.smithi019.stdout: osd default data pool replay window = 5 2024-09-12T22:30:59.474 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:30:59.474 INFO:teuthology.orchestra.run.smithi019.stdout: mon allow pool delete = true 2024-09-12T22:30:59.474 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:30:59.474 INFO:teuthology.orchestra.run.smithi019.stdout: mon cluster log file level = debug 2024-09-12T22:30:59.474 INFO:teuthology.orchestra.run.smithi019.stdout: debug asserts on shutdown = true 2024-09-12T22:30:59.474 INFO:teuthology.orchestra.run.smithi019.stdout: mon health detail to clog = false 2024-09-12T22:30:59.474 INFO:teuthology.orchestra.run.smithi019.stdout: mon host = "172.21.15.19,[v2:172.21.15.19:3301,v1:172.21.15.19:6790],[v2:172.21.15.19:3302,v1:172.21.15.19:6791]" 2024-09-12T22:30:59.474 INFO:teuthology.orchestra.run.smithi019.stdout: fsid = 957ce235-19cb-4350-8fee-febd6e3f2199 2024-09-12T22:30:59.474 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:30:59.474 INFO:teuthology.orchestra.run.smithi019.stdout:[osd] 2024-09-12T22:30:59.474 INFO:teuthology.orchestra.run.smithi019.stdout: osd journal size = 100 2024-09-12T22:30:59.475 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:30:59.475 INFO:teuthology.orchestra.run.smithi019.stdout: osd scrub load threshold = 5.0 2024-09-12T22:30:59.475 INFO:teuthology.orchestra.run.smithi019.stdout: osd scrub max interval = 600 2024-09-12T22:30:59.475 INFO:teuthology.orchestra.run.smithi019.stdout: osd mclock profile = high_recovery_ops 2024-09-12T22:30:59.475 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:30:59.475 INFO:teuthology.orchestra.run.smithi019.stdout: osd recover clone overlap = true 2024-09-12T22:30:59.475 INFO:teuthology.orchestra.run.smithi019.stdout: osd recovery max chunk = 1048576 2024-09-12T22:30:59.475 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:30:59.475 INFO:teuthology.orchestra.run.smithi019.stdout: osd debug shutdown = true 2024-09-12T22:30:59.475 INFO:teuthology.orchestra.run.smithi019.stdout: osd debug op order = true 2024-09-12T22:30:59.475 INFO:teuthology.orchestra.run.smithi019.stdout: osd debug verify stray on activate = true 2024-09-12T22:30:59.475 INFO:teuthology.orchestra.run.smithi019.stdout: osd debug trim objects = true 2024-09-12T22:30:59.475 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:30:59.476 INFO:teuthology.orchestra.run.smithi019.stdout: osd open classes on start = true 2024-09-12T22:30:59.476 INFO:teuthology.orchestra.run.smithi019.stdout: osd debug pg log writeout = true 2024-09-12T22:30:59.476 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:30:59.476 INFO:teuthology.orchestra.run.smithi019.stdout: osd deep scrub update digest min age = 30 2024-09-12T22:30:59.476 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:30:59.476 INFO:teuthology.orchestra.run.smithi019.stdout: osd map max advance = 10 2024-09-12T22:30:59.476 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:30:59.476 INFO:teuthology.orchestra.run.smithi019.stdout: journal zero on create = true 2024-09-12T22:30:59.476 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:30:59.477 INFO:teuthology.orchestra.run.smithi019.stdout: filestore ondisk finisher threads = 3 2024-09-12T22:30:59.477 INFO:teuthology.orchestra.run.smithi019.stdout: filestore apply finisher threads = 3 2024-09-12T22:30:59.477 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:30:59.477 INFO:teuthology.orchestra.run.smithi019.stdout: bdev debug aio = true 2024-09-12T22:30:59.477 INFO:teuthology.orchestra.run.smithi019.stdout: osd debug misdirected ops = true 2024-09-12T22:30:59.478 INFO:teuthology.orchestra.run.smithi019.stdout: bdev async discard = True 2024-09-12T22:30:59.478 INFO:teuthology.orchestra.run.smithi019.stdout: bdev enable discard = True 2024-09-12T22:30:59.478 INFO:teuthology.orchestra.run.smithi019.stdout: bluestore allocator = bitmap 2024-09-12T22:30:59.478 INFO:teuthology.orchestra.run.smithi019.stdout: bluestore block size = 96636764160 2024-09-12T22:30:59.478 INFO:teuthology.orchestra.run.smithi019.stdout: bluestore fsck on mount = True 2024-09-12T22:30:59.478 INFO:teuthology.orchestra.run.smithi019.stdout: debug bluefs = 1/20 2024-09-12T22:30:59.478 INFO:teuthology.orchestra.run.smithi019.stdout: debug bluestore = 1/20 2024-09-12T22:30:59.478 INFO:teuthology.orchestra.run.smithi019.stdout: debug ms = 1 2024-09-12T22:30:59.478 INFO:teuthology.orchestra.run.smithi019.stdout: debug osd = 20 2024-09-12T22:30:59.478 INFO:teuthology.orchestra.run.smithi019.stdout: debug rocksdb = 4/10 2024-09-12T22:30:59.478 INFO:teuthology.orchestra.run.smithi019.stdout: mon osd backfillfull_ratio = 0.85 2024-09-12T22:30:59.478 INFO:teuthology.orchestra.run.smithi019.stdout: mon osd full ratio = 0.9 2024-09-12T22:30:59.479 INFO:teuthology.orchestra.run.smithi019.stdout: mon osd nearfull ratio = 0.8 2024-09-12T22:30:59.479 INFO:teuthology.orchestra.run.smithi019.stdout: osd blocked scrub grace period = 3600 2024-09-12T22:30:59.479 INFO:teuthology.orchestra.run.smithi019.stdout: osd failsafe full ratio = 0.95 2024-09-12T22:30:59.479 INFO:teuthology.orchestra.run.smithi019.stdout: osd max markdown count = 1000 2024-09-12T22:30:59.479 INFO:teuthology.orchestra.run.smithi019.stdout: osd objectstore = bluestore 2024-09-12T22:30:59.479 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:30:59.479 INFO:teuthology.orchestra.run.smithi019.stdout:[mgr] 2024-09-12T22:30:59.479 INFO:teuthology.orchestra.run.smithi019.stdout: debug ms = 1 2024-09-12T22:30:59.479 INFO:teuthology.orchestra.run.smithi019.stdout: debug mgr = 20 2024-09-12T22:30:59.479 INFO:teuthology.orchestra.run.smithi019.stdout: debug mon = 20 2024-09-12T22:30:59.479 INFO:teuthology.orchestra.run.smithi019.stdout: debug auth = 20 2024-09-12T22:30:59.479 INFO:teuthology.orchestra.run.smithi019.stdout: mon reweight min pgs per osd = 4 2024-09-12T22:30:59.480 INFO:teuthology.orchestra.run.smithi019.stdout: mon reweight min bytes per osd = 10 2024-09-12T22:30:59.480 INFO:teuthology.orchestra.run.smithi019.stdout: mgr/telemetry/nag = false 2024-09-12T22:30:59.480 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:30:59.480 INFO:teuthology.orchestra.run.smithi019.stdout:[mon] 2024-09-12T22:30:59.480 INFO:teuthology.orchestra.run.smithi019.stdout: debug ms = 1 2024-09-12T22:30:59.480 INFO:teuthology.orchestra.run.smithi019.stdout: debug mon = 20 2024-09-12T22:30:59.480 INFO:teuthology.orchestra.run.smithi019.stdout: debug paxos = 20 2024-09-12T22:30:59.480 INFO:teuthology.orchestra.run.smithi019.stdout: debug auth = 20 2024-09-12T22:30:59.480 INFO:teuthology.orchestra.run.smithi019.stdout: mon data avail warn = 5 2024-09-12T22:30:59.480 INFO:teuthology.orchestra.run.smithi019.stdout: mon mgr mkfs grace = 240 2024-09-12T22:30:59.480 INFO:teuthology.orchestra.run.smithi019.stdout: mon reweight min pgs per osd = 4 2024-09-12T22:30:59.480 INFO:teuthology.orchestra.run.smithi019.stdout: mon osd reporter subtree level = osd 2024-09-12T22:30:59.480 INFO:teuthology.orchestra.run.smithi019.stdout: mon osd prime pg temp = true 2024-09-12T22:30:59.481 INFO:teuthology.orchestra.run.smithi019.stdout: mon reweight min bytes per osd = 10 2024-09-12T22:30:59.481 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:30:59.481 INFO:teuthology.orchestra.run.smithi019.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-12T22:30:59.481 INFO:teuthology.orchestra.run.smithi019.stdout: auth mon ticket ttl = 660 # 11m 2024-09-12T22:30:59.481 INFO:teuthology.orchestra.run.smithi019.stdout: auth service ticket ttl = 240 # 4m 2024-09-12T22:30:59.481 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:30:59.481 INFO:teuthology.orchestra.run.smithi019.stdout: # don't complain about insecure global_id in the test suite 2024-09-12T22:30:59.481 INFO:teuthology.orchestra.run.smithi019.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-12T22:30:59.481 INFO:teuthology.orchestra.run.smithi019.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-12T22:30:59.481 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:30:59.481 INFO:teuthology.orchestra.run.smithi019.stdout: # 1m isn't quite enough 2024-09-12T22:30:59.481 INFO:teuthology.orchestra.run.smithi019.stdout: mon_down_mkfs_grace = 2m 2024-09-12T22:30:59.481 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:30:59.481 INFO:teuthology.orchestra.run.smithi019.stdout: mon_warn_on_filestore_osds = false 2024-09-12T22:30:59.482 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:30:59.482 INFO:teuthology.orchestra.run.smithi019.stdout:[client] 2024-09-12T22:30:59.482 INFO:teuthology.orchestra.run.smithi019.stdout: rgw cache enabled = true 2024-09-12T22:30:59.482 INFO:teuthology.orchestra.run.smithi019.stdout: rgw enable ops log = true 2024-09-12T22:30:59.482 INFO:teuthology.orchestra.run.smithi019.stdout: rgw enable usage log = true 2024-09-12T22:30:59.482 INFO:teuthology.orchestra.run.smithi019.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-12T22:30:59.482 INFO:teuthology.orchestra.run.smithi019.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-12T22:30:59.482 INFO:teuthology.orchestra.run.smithi019.stdout:[mon.a] 2024-09-12T22:30:59.482 INFO:teuthology.orchestra.run.smithi019.stdout:[mon.b] 2024-09-12T22:30:59.482 INFO:teuthology.orchestra.run.smithi019.stdout:[mon.c] 2024-09-12T22:30:59.482 INFO:teuthology.orchestra.run.smithi019.stdout:[mds.a] 2024-09-12T22:30:59.484 INFO:teuthology.orchestra.run.smithi148.stdout:[global] 2024-09-12T22:30:59.484 INFO:teuthology.orchestra.run.smithi148.stdout: chdir = "" 2024-09-12T22:30:59.484 INFO:teuthology.orchestra.run.smithi148.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-12T22:30:59.484 INFO:teuthology.orchestra.run.smithi148.stdout: auth supported = cephx 2024-09-12T22:30:59.484 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T22:30:59.484 INFO:teuthology.orchestra.run.smithi148.stdout: filestore xattr use omap = true 2024-09-12T22:30:59.484 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T22:30:59.484 INFO:teuthology.orchestra.run.smithi148.stdout: mon clock drift allowed = 1.000 2024-09-12T22:30:59.484 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T22:30:59.484 INFO:teuthology.orchestra.run.smithi148.stdout: osd crush chooseleaf type = 0 2024-09-12T22:30:59.485 INFO:teuthology.orchestra.run.smithi148.stdout: auth debug = true 2024-09-12T22:30:59.485 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T22:30:59.485 INFO:teuthology.orchestra.run.smithi148.stdout: ms die on old message = true 2024-09-12T22:30:59.485 INFO:teuthology.orchestra.run.smithi148.stdout: ms die on bug = true 2024-09-12T22:30:59.485 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T22:30:59.485 INFO:teuthology.orchestra.run.smithi148.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-12T22:30:59.485 INFO:teuthology.orchestra.run.smithi148.stdout: mon pg warn max object skew = 0 2024-09-12T22:30:59.485 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T22:30:59.485 INFO:teuthology.orchestra.run.smithi148.stdout: # disable pg_autoscaler by default for new pools 2024-09-12T22:30:59.485 INFO:teuthology.orchestra.run.smithi148.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-12T22:30:59.485 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T22:30:59.485 INFO:teuthology.orchestra.run.smithi148.stdout: osd pool default size = 2 2024-09-12T22:30:59.485 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T22:30:59.486 INFO:teuthology.orchestra.run.smithi148.stdout: mon osd allow primary affinity = true 2024-09-12T22:30:59.486 INFO:teuthology.orchestra.run.smithi148.stdout: mon osd allow pg remap = true 2024-09-12T22:30:59.486 INFO:teuthology.orchestra.run.smithi148.stdout: mon warn on legacy crush tunables = false 2024-09-12T22:30:59.486 INFO:teuthology.orchestra.run.smithi148.stdout: mon warn on crush straw calc version zero = false 2024-09-12T22:30:59.486 INFO:teuthology.orchestra.run.smithi148.stdout: mon warn on no sortbitwise = false 2024-09-12T22:30:59.486 INFO:teuthology.orchestra.run.smithi148.stdout: mon warn on osd down out interval zero = false 2024-09-12T22:30:59.486 INFO:teuthology.orchestra.run.smithi148.stdout: mon warn on too few osds = false 2024-09-12T22:30:59.486 INFO:teuthology.orchestra.run.smithi148.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-12T22:30:59.486 INFO:teuthology.orchestra.run.smithi148.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-12T22:30:59.486 INFO:teuthology.orchestra.run.smithi148.stdout: mon_allow_pool_size_one = true 2024-09-12T22:30:59.486 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T22:30:59.486 INFO:teuthology.orchestra.run.smithi148.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-12T22:30:59.486 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T22:30:59.487 INFO:teuthology.orchestra.run.smithi148.stdout: osd default data pool replay window = 5 2024-09-12T22:30:59.487 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T22:30:59.487 INFO:teuthology.orchestra.run.smithi148.stdout: mon allow pool delete = true 2024-09-12T22:30:59.487 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T22:30:59.487 INFO:teuthology.orchestra.run.smithi148.stdout: mon cluster log file level = debug 2024-09-12T22:30:59.487 INFO:teuthology.orchestra.run.smithi148.stdout: debug asserts on shutdown = true 2024-09-12T22:30:59.487 INFO:teuthology.orchestra.run.smithi148.stdout: mon health detail to clog = false 2024-09-12T22:30:59.487 INFO:teuthology.orchestra.run.smithi148.stdout: mon host = "172.21.15.19,[v2:172.21.15.19:3301,v1:172.21.15.19:6790],[v2:172.21.15.19:3302,v1:172.21.15.19:6791]" 2024-09-12T22:30:59.487 INFO:teuthology.orchestra.run.smithi148.stdout: fsid = 957ce235-19cb-4350-8fee-febd6e3f2199 2024-09-12T22:30:59.487 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T22:30:59.487 INFO:teuthology.orchestra.run.smithi148.stdout:[osd] 2024-09-12T22:30:59.487 INFO:teuthology.orchestra.run.smithi148.stdout: osd journal size = 100 2024-09-12T22:30:59.487 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T22:30:59.488 INFO:teuthology.orchestra.run.smithi148.stdout: osd scrub load threshold = 5.0 2024-09-12T22:30:59.488 INFO:teuthology.orchestra.run.smithi148.stdout: osd scrub max interval = 600 2024-09-12T22:30:59.488 INFO:teuthology.orchestra.run.smithi148.stdout: osd mclock profile = high_recovery_ops 2024-09-12T22:30:59.488 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T22:30:59.488 INFO:teuthology.orchestra.run.smithi148.stdout: osd recover clone overlap = true 2024-09-12T22:30:59.488 INFO:teuthology.orchestra.run.smithi148.stdout: osd recovery max chunk = 1048576 2024-09-12T22:30:59.488 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T22:30:59.488 INFO:teuthology.orchestra.run.smithi148.stdout: osd debug shutdown = true 2024-09-12T22:30:59.488 INFO:teuthology.orchestra.run.smithi148.stdout: osd debug op order = true 2024-09-12T22:30:59.488 INFO:teuthology.orchestra.run.smithi148.stdout: osd debug verify stray on activate = true 2024-09-12T22:30:59.488 INFO:teuthology.orchestra.run.smithi148.stdout: osd debug trim objects = true 2024-09-12T22:30:59.488 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T22:30:59.488 INFO:teuthology.orchestra.run.smithi148.stdout: osd open classes on start = true 2024-09-12T22:30:59.489 INFO:teuthology.orchestra.run.smithi148.stdout: osd debug pg log writeout = true 2024-09-12T22:30:59.489 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T22:30:59.489 INFO:teuthology.orchestra.run.smithi148.stdout: osd deep scrub update digest min age = 30 2024-09-12T22:30:59.489 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T22:30:59.489 INFO:teuthology.orchestra.run.smithi148.stdout: osd map max advance = 10 2024-09-12T22:30:59.489 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T22:30:59.489 INFO:teuthology.orchestra.run.smithi148.stdout: journal zero on create = true 2024-09-12T22:30:59.489 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T22:30:59.489 INFO:teuthology.orchestra.run.smithi148.stdout: filestore ondisk finisher threads = 3 2024-09-12T22:30:59.489 INFO:teuthology.orchestra.run.smithi148.stdout: filestore apply finisher threads = 3 2024-09-12T22:30:59.489 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T22:30:59.489 INFO:teuthology.orchestra.run.smithi148.stdout: bdev debug aio = true 2024-09-12T22:30:59.489 INFO:teuthology.orchestra.run.smithi148.stdout: osd debug misdirected ops = true 2024-09-12T22:30:59.490 INFO:teuthology.orchestra.run.smithi148.stdout: bdev async discard = True 2024-09-12T22:30:59.490 INFO:teuthology.orchestra.run.smithi148.stdout: bdev enable discard = True 2024-09-12T22:30:59.490 INFO:teuthology.orchestra.run.smithi148.stdout: bluestore allocator = bitmap 2024-09-12T22:30:59.490 INFO:teuthology.orchestra.run.smithi148.stdout: bluestore block size = 96636764160 2024-09-12T22:30:59.490 INFO:teuthology.orchestra.run.smithi148.stdout: bluestore fsck on mount = True 2024-09-12T22:30:59.490 INFO:teuthology.orchestra.run.smithi148.stdout: debug bluefs = 1/20 2024-09-12T22:30:59.490 INFO:teuthology.orchestra.run.smithi148.stdout: debug bluestore = 1/20 2024-09-12T22:30:59.490 INFO:teuthology.orchestra.run.smithi148.stdout: debug ms = 1 2024-09-12T22:30:59.491 INFO:teuthology.orchestra.run.smithi148.stdout: debug osd = 20 2024-09-12T22:30:59.491 INFO:teuthology.orchestra.run.smithi148.stdout: debug rocksdb = 4/10 2024-09-12T22:30:59.491 INFO:teuthology.orchestra.run.smithi148.stdout: mon osd backfillfull_ratio = 0.85 2024-09-12T22:30:59.491 INFO:teuthology.orchestra.run.smithi148.stdout: mon osd full ratio = 0.9 2024-09-12T22:30:59.491 INFO:teuthology.orchestra.run.smithi148.stdout: mon osd nearfull ratio = 0.8 2024-09-12T22:30:59.491 INFO:teuthology.orchestra.run.smithi148.stdout: osd blocked scrub grace period = 3600 2024-09-12T22:30:59.491 INFO:teuthology.orchestra.run.smithi148.stdout: osd failsafe full ratio = 0.95 2024-09-12T22:30:59.491 INFO:teuthology.orchestra.run.smithi148.stdout: osd max markdown count = 1000 2024-09-12T22:30:59.491 INFO:teuthology.orchestra.run.smithi148.stdout: osd objectstore = bluestore 2024-09-12T22:30:59.491 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T22:30:59.491 INFO:teuthology.orchestra.run.smithi148.stdout:[mgr] 2024-09-12T22:30:59.491 INFO:teuthology.orchestra.run.smithi148.stdout: debug ms = 1 2024-09-12T22:30:59.491 INFO:teuthology.orchestra.run.smithi148.stdout: debug mgr = 20 2024-09-12T22:30:59.492 INFO:teuthology.orchestra.run.smithi148.stdout: debug mon = 20 2024-09-12T22:30:59.492 INFO:teuthology.orchestra.run.smithi148.stdout: debug auth = 20 2024-09-12T22:30:59.492 INFO:teuthology.orchestra.run.smithi148.stdout: mon reweight min pgs per osd = 4 2024-09-12T22:30:59.492 INFO:teuthology.orchestra.run.smithi148.stdout: mon reweight min bytes per osd = 10 2024-09-12T22:30:59.492 INFO:teuthology.orchestra.run.smithi148.stdout: mgr/telemetry/nag = false 2024-09-12T22:30:59.492 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T22:30:59.492 INFO:teuthology.orchestra.run.smithi148.stdout:[mon] 2024-09-12T22:30:59.492 INFO:teuthology.orchestra.run.smithi148.stdout: debug ms = 1 2024-09-12T22:30:59.492 INFO:teuthology.orchestra.run.smithi148.stdout: debug mon = 20 2024-09-12T22:30:59.492 INFO:teuthology.orchestra.run.smithi148.stdout: debug paxos = 20 2024-09-12T22:30:59.492 INFO:teuthology.orchestra.run.smithi148.stdout: debug auth = 20 2024-09-12T22:30:59.492 INFO:teuthology.orchestra.run.smithi148.stdout: mon data avail warn = 5 2024-09-12T22:30:59.492 INFO:teuthology.orchestra.run.smithi148.stdout: mon mgr mkfs grace = 240 2024-09-12T22:30:59.492 INFO:teuthology.orchestra.run.smithi148.stdout: mon reweight min pgs per osd = 4 2024-09-12T22:30:59.493 INFO:teuthology.orchestra.run.smithi148.stdout: mon osd reporter subtree level = osd 2024-09-12T22:30:59.493 INFO:teuthology.orchestra.run.smithi148.stdout: mon osd prime pg temp = true 2024-09-12T22:30:59.493 INFO:teuthology.orchestra.run.smithi148.stdout: mon reweight min bytes per osd = 10 2024-09-12T22:30:59.493 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T22:30:59.493 INFO:teuthology.orchestra.run.smithi148.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-12T22:30:59.493 INFO:teuthology.orchestra.run.smithi148.stdout: auth mon ticket ttl = 660 # 11m 2024-09-12T22:30:59.493 INFO:teuthology.orchestra.run.smithi148.stdout: auth service ticket ttl = 240 # 4m 2024-09-12T22:30:59.493 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T22:30:59.493 INFO:teuthology.orchestra.run.smithi148.stdout: # don't complain about insecure global_id in the test suite 2024-09-12T22:30:59.493 INFO:teuthology.orchestra.run.smithi148.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-12T22:30:59.493 INFO:teuthology.orchestra.run.smithi148.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-12T22:30:59.493 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T22:30:59.493 INFO:teuthology.orchestra.run.smithi148.stdout: # 1m isn't quite enough 2024-09-12T22:30:59.493 INFO:teuthology.orchestra.run.smithi148.stdout: mon_down_mkfs_grace = 2m 2024-09-12T22:30:59.494 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T22:30:59.494 INFO:teuthology.orchestra.run.smithi148.stdout: mon_warn_on_filestore_osds = false 2024-09-12T22:30:59.494 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-12T22:30:59.494 INFO:teuthology.orchestra.run.smithi148.stdout:[client] 2024-09-12T22:30:59.494 INFO:teuthology.orchestra.run.smithi148.stdout: rgw cache enabled = true 2024-09-12T22:30:59.494 INFO:teuthology.orchestra.run.smithi148.stdout: rgw enable ops log = true 2024-09-12T22:30:59.494 INFO:teuthology.orchestra.run.smithi148.stdout: rgw enable usage log = true 2024-09-12T22:30:59.494 INFO:teuthology.orchestra.run.smithi148.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-12T22:30:59.494 INFO:teuthology.orchestra.run.smithi148.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-12T22:30:59.494 INFO:teuthology.orchestra.run.smithi148.stdout:[mon.a] 2024-09-12T22:30:59.494 INFO:teuthology.orchestra.run.smithi148.stdout:[mon.b] 2024-09-12T22:30:59.494 INFO:teuthology.orchestra.run.smithi148.stdout:[mon.c] 2024-09-12T22:30:59.494 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.a] 2024-09-12T22:30:59.495 INFO:teuthology.orchestra.run.smithi076.stdout:[global] 2024-09-12T22:30:59.495 INFO:teuthology.orchestra.run.smithi076.stdout: chdir = "" 2024-09-12T22:30:59.495 INFO:teuthology.orchestra.run.smithi076.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-12T22:30:59.495 INFO:teuthology.orchestra.run.smithi076.stdout: auth supported = cephx 2024-09-12T22:30:59.495 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-12T22:30:59.495 INFO:teuthology.orchestra.run.smithi076.stdout: filestore xattr use omap = true 2024-09-12T22:30:59.495 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-12T22:30:59.495 INFO:teuthology.orchestra.run.smithi076.stdout: mon clock drift allowed = 1.000 2024-09-12T22:30:59.495 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-12T22:30:59.495 INFO:teuthology.orchestra.run.smithi076.stdout: osd crush chooseleaf type = 0 2024-09-12T22:30:59.495 INFO:teuthology.orchestra.run.smithi076.stdout: auth debug = true 2024-09-12T22:30:59.495 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-12T22:30:59.496 INFO:teuthology.orchestra.run.smithi076.stdout: ms die on old message = true 2024-09-12T22:30:59.496 INFO:teuthology.orchestra.run.smithi076.stdout: ms die on bug = true 2024-09-12T22:30:59.496 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-12T22:30:59.496 INFO:teuthology.orchestra.run.smithi076.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-12T22:30:59.496 INFO:teuthology.orchestra.run.smithi076.stdout: mon pg warn max object skew = 0 2024-09-12T22:30:59.496 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-12T22:30:59.496 INFO:teuthology.orchestra.run.smithi076.stdout: # disable pg_autoscaler by default for new pools 2024-09-12T22:30:59.496 INFO:teuthology.orchestra.run.smithi076.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-12T22:30:59.496 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-12T22:30:59.496 INFO:teuthology.orchestra.run.smithi076.stdout: osd pool default size = 2 2024-09-12T22:30:59.496 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-12T22:30:59.496 INFO:teuthology.orchestra.run.smithi076.stdout: mon osd allow primary affinity = true 2024-09-12T22:30:59.496 INFO:teuthology.orchestra.run.smithi076.stdout: mon osd allow pg remap = true 2024-09-12T22:30:59.497 INFO:teuthology.orchestra.run.smithi076.stdout: mon warn on legacy crush tunables = false 2024-09-12T22:30:59.497 INFO:teuthology.orchestra.run.smithi076.stdout: mon warn on crush straw calc version zero = false 2024-09-12T22:30:59.497 INFO:teuthology.orchestra.run.smithi076.stdout: mon warn on no sortbitwise = false 2024-09-12T22:30:59.497 INFO:teuthology.orchestra.run.smithi076.stdout: mon warn on osd down out interval zero = false 2024-09-12T22:30:59.497 INFO:teuthology.orchestra.run.smithi076.stdout: mon warn on too few osds = false 2024-09-12T22:30:59.497 INFO:teuthology.orchestra.run.smithi076.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-12T22:30:59.497 INFO:teuthology.orchestra.run.smithi076.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-12T22:30:59.497 INFO:teuthology.orchestra.run.smithi076.stdout: mon_allow_pool_size_one = true 2024-09-12T22:30:59.497 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-12T22:30:59.497 INFO:teuthology.orchestra.run.smithi076.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-12T22:30:59.497 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-12T22:30:59.497 INFO:teuthology.orchestra.run.smithi076.stdout: osd default data pool replay window = 5 2024-09-12T22:30:59.497 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-12T22:30:59.498 INFO:teuthology.orchestra.run.smithi076.stdout: mon allow pool delete = true 2024-09-12T22:30:59.498 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-12T22:30:59.498 INFO:teuthology.orchestra.run.smithi076.stdout: mon cluster log file level = debug 2024-09-12T22:30:59.498 INFO:teuthology.orchestra.run.smithi076.stdout: debug asserts on shutdown = true 2024-09-12T22:30:59.498 INFO:teuthology.orchestra.run.smithi076.stdout: mon health detail to clog = false 2024-09-12T22:30:59.498 INFO:teuthology.orchestra.run.smithi076.stdout: mon host = "172.21.15.19,[v2:172.21.15.19:3301,v1:172.21.15.19:6790],[v2:172.21.15.19:3302,v1:172.21.15.19:6791]" 2024-09-12T22:30:59.498 INFO:teuthology.orchestra.run.smithi076.stdout: fsid = 957ce235-19cb-4350-8fee-febd6e3f2199 2024-09-12T22:30:59.498 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-12T22:30:59.499 INFO:teuthology.orchestra.run.smithi076.stdout:[osd] 2024-09-12T22:30:59.499 INFO:teuthology.orchestra.run.smithi076.stdout: osd journal size = 100 2024-09-12T22:30:59.499 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-12T22:30:59.499 INFO:teuthology.orchestra.run.smithi076.stdout: osd scrub load threshold = 5.0 2024-09-12T22:30:59.499 INFO:teuthology.orchestra.run.smithi076.stdout: osd scrub max interval = 600 2024-09-12T22:30:59.499 INFO:teuthology.orchestra.run.smithi076.stdout: osd mclock profile = high_recovery_ops 2024-09-12T22:30:59.499 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-12T22:30:59.499 INFO:teuthology.orchestra.run.smithi076.stdout: osd recover clone overlap = true 2024-09-12T22:30:59.499 INFO:teuthology.orchestra.run.smithi076.stdout: osd recovery max chunk = 1048576 2024-09-12T22:30:59.500 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-12T22:30:59.500 INFO:teuthology.orchestra.run.smithi076.stdout: osd debug shutdown = true 2024-09-12T22:30:59.500 INFO:teuthology.orchestra.run.smithi076.stdout: osd debug op order = true 2024-09-12T22:30:59.500 INFO:teuthology.orchestra.run.smithi076.stdout: osd debug verify stray on activate = true 2024-09-12T22:30:59.500 INFO:teuthology.orchestra.run.smithi076.stdout: osd debug trim objects = true 2024-09-12T22:30:59.500 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-12T22:30:59.500 INFO:teuthology.orchestra.run.smithi076.stdout: osd open classes on start = true 2024-09-12T22:30:59.500 INFO:teuthology.orchestra.run.smithi076.stdout: osd debug pg log writeout = true 2024-09-12T22:30:59.500 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-12T22:30:59.500 INFO:teuthology.orchestra.run.smithi076.stdout: osd deep scrub update digest min age = 30 2024-09-12T22:30:59.500 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-12T22:30:59.500 INFO:teuthology.orchestra.run.smithi076.stdout: osd map max advance = 10 2024-09-12T22:30:59.500 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-12T22:30:59.501 INFO:teuthology.orchestra.run.smithi076.stdout: journal zero on create = true 2024-09-12T22:30:59.501 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-12T22:30:59.501 INFO:teuthology.orchestra.run.smithi076.stdout: filestore ondisk finisher threads = 3 2024-09-12T22:30:59.501 INFO:teuthology.orchestra.run.smithi076.stdout: filestore apply finisher threads = 3 2024-09-12T22:30:59.501 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-12T22:30:59.501 INFO:teuthology.orchestra.run.smithi076.stdout: bdev debug aio = true 2024-09-12T22:30:59.501 INFO:teuthology.orchestra.run.smithi076.stdout: osd debug misdirected ops = true 2024-09-12T22:30:59.501 INFO:teuthology.orchestra.run.smithi076.stdout: bdev async discard = True 2024-09-12T22:30:59.501 INFO:teuthology.orchestra.run.smithi076.stdout: bdev enable discard = True 2024-09-12T22:30:59.501 INFO:teuthology.orchestra.run.smithi076.stdout: bluestore allocator = bitmap 2024-09-12T22:30:59.501 INFO:teuthology.orchestra.run.smithi076.stdout: bluestore block size = 96636764160 2024-09-12T22:30:59.501 INFO:teuthology.orchestra.run.smithi076.stdout: bluestore fsck on mount = True 2024-09-12T22:30:59.501 INFO:teuthology.orchestra.run.smithi076.stdout: debug bluefs = 1/20 2024-09-12T22:30:59.501 INFO:teuthology.orchestra.run.smithi076.stdout: debug bluestore = 1/20 2024-09-12T22:30:59.502 INFO:teuthology.orchestra.run.smithi076.stdout: debug ms = 1 2024-09-12T22:30:59.502 INFO:teuthology.orchestra.run.smithi076.stdout: debug osd = 20 2024-09-12T22:30:59.502 INFO:teuthology.orchestra.run.smithi076.stdout: debug rocksdb = 4/10 2024-09-12T22:30:59.502 INFO:teuthology.orchestra.run.smithi076.stdout: mon osd backfillfull_ratio = 0.85 2024-09-12T22:30:59.502 INFO:teuthology.orchestra.run.smithi076.stdout: mon osd full ratio = 0.9 2024-09-12T22:30:59.502 INFO:teuthology.orchestra.run.smithi076.stdout: mon osd nearfull ratio = 0.8 2024-09-12T22:30:59.502 INFO:teuthology.orchestra.run.smithi076.stdout: osd blocked scrub grace period = 3600 2024-09-12T22:30:59.502 INFO:teuthology.orchestra.run.smithi076.stdout: osd failsafe full ratio = 0.95 2024-09-12T22:30:59.502 INFO:teuthology.orchestra.run.smithi076.stdout: osd max markdown count = 1000 2024-09-12T22:30:59.502 INFO:teuthology.orchestra.run.smithi076.stdout: osd objectstore = bluestore 2024-09-12T22:30:59.502 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-12T22:30:59.502 INFO:teuthology.orchestra.run.smithi076.stdout:[mgr] 2024-09-12T22:30:59.502 INFO:teuthology.orchestra.run.smithi076.stdout: debug ms = 1 2024-09-12T22:30:59.502 INFO:teuthology.orchestra.run.smithi076.stdout: debug mgr = 20 2024-09-12T22:30:59.503 INFO:teuthology.orchestra.run.smithi076.stdout: debug mon = 20 2024-09-12T22:30:59.503 INFO:teuthology.orchestra.run.smithi076.stdout: debug auth = 20 2024-09-12T22:30:59.503 INFO:teuthology.orchestra.run.smithi076.stdout: mon reweight min pgs per osd = 4 2024-09-12T22:30:59.503 INFO:teuthology.orchestra.run.smithi076.stdout: mon reweight min bytes per osd = 10 2024-09-12T22:30:59.503 INFO:teuthology.orchestra.run.smithi076.stdout: mgr/telemetry/nag = false 2024-09-12T22:30:59.503 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-12T22:30:59.503 INFO:teuthology.orchestra.run.smithi076.stdout:[mon] 2024-09-12T22:30:59.503 INFO:teuthology.orchestra.run.smithi076.stdout: debug ms = 1 2024-09-12T22:30:59.503 INFO:teuthology.orchestra.run.smithi076.stdout: debug mon = 20 2024-09-12T22:30:59.503 INFO:teuthology.orchestra.run.smithi076.stdout: debug paxos = 20 2024-09-12T22:30:59.503 INFO:teuthology.orchestra.run.smithi076.stdout: debug auth = 20 2024-09-12T22:30:59.503 INFO:teuthology.orchestra.run.smithi076.stdout: mon data avail warn = 5 2024-09-12T22:30:59.503 INFO:teuthology.orchestra.run.smithi076.stdout: mon mgr mkfs grace = 240 2024-09-12T22:30:59.503 INFO:teuthology.orchestra.run.smithi076.stdout: mon reweight min pgs per osd = 4 2024-09-12T22:30:59.504 INFO:teuthology.orchestra.run.smithi076.stdout: mon osd reporter subtree level = osd 2024-09-12T22:30:59.504 INFO:teuthology.orchestra.run.smithi076.stdout: mon osd prime pg temp = true 2024-09-12T22:30:59.504 INFO:teuthology.orchestra.run.smithi076.stdout: mon reweight min bytes per osd = 10 2024-09-12T22:30:59.504 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-12T22:30:59.504 INFO:teuthology.orchestra.run.smithi076.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-12T22:30:59.504 INFO:teuthology.orchestra.run.smithi076.stdout: auth mon ticket ttl = 660 # 11m 2024-09-12T22:30:59.504 INFO:teuthology.orchestra.run.smithi076.stdout: auth service ticket ttl = 240 # 4m 2024-09-12T22:30:59.504 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-12T22:30:59.504 INFO:teuthology.orchestra.run.smithi076.stdout: # don't complain about insecure global_id in the test suite 2024-09-12T22:30:59.504 INFO:teuthology.orchestra.run.smithi076.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-12T22:30:59.504 INFO:teuthology.orchestra.run.smithi076.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-12T22:30:59.504 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-12T22:30:59.504 INFO:teuthology.orchestra.run.smithi076.stdout: # 1m isn't quite enough 2024-09-12T22:30:59.505 INFO:teuthology.orchestra.run.smithi076.stdout: mon_down_mkfs_grace = 2m 2024-09-12T22:30:59.505 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-12T22:30:59.505 INFO:teuthology.orchestra.run.smithi076.stdout: mon_warn_on_filestore_osds = false 2024-09-12T22:30:59.505 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-09-12T22:30:59.505 INFO:teuthology.orchestra.run.smithi076.stdout:[client] 2024-09-12T22:30:59.505 INFO:teuthology.orchestra.run.smithi076.stdout: rgw cache enabled = true 2024-09-12T22:30:59.505 INFO:teuthology.orchestra.run.smithi076.stdout: rgw enable ops log = true 2024-09-12T22:30:59.505 INFO:teuthology.orchestra.run.smithi076.stdout: rgw enable usage log = true 2024-09-12T22:30:59.505 INFO:teuthology.orchestra.run.smithi076.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-12T22:30:59.505 INFO:teuthology.orchestra.run.smithi076.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-12T22:30:59.505 INFO:teuthology.orchestra.run.smithi076.stdout:[mon.a] 2024-09-12T22:30:59.505 INFO:teuthology.orchestra.run.smithi076.stdout:[mon.b] 2024-09-12T22:30:59.505 INFO:teuthology.orchestra.run.smithi076.stdout:[mon.c] 2024-09-12T22:30:59.505 INFO:teuthology.orchestra.run.smithi076.stdout:[mds.a] 2024-09-12T22:30:59.506 INFO:teuthology.orchestra.run.smithi163.stdout:[global] 2024-09-12T22:30:59.506 INFO:teuthology.orchestra.run.smithi163.stdout: chdir = "" 2024-09-12T22:30:59.506 INFO:teuthology.orchestra.run.smithi163.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-12T22:30:59.506 INFO:teuthology.orchestra.run.smithi163.stdout: auth supported = cephx 2024-09-12T22:30:59.506 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-09-12T22:30:59.506 INFO:teuthology.orchestra.run.smithi163.stdout: filestore xattr use omap = true 2024-09-12T22:30:59.506 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-09-12T22:30:59.506 INFO:teuthology.orchestra.run.smithi163.stdout: mon clock drift allowed = 1.000 2024-09-12T22:30:59.506 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-09-12T22:30:59.506 INFO:teuthology.orchestra.run.smithi163.stdout: osd crush chooseleaf type = 0 2024-09-12T22:30:59.506 INFO:teuthology.orchestra.run.smithi163.stdout: auth debug = true 2024-09-12T22:30:59.506 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-09-12T22:30:59.507 INFO:teuthology.orchestra.run.smithi163.stdout: ms die on old message = true 2024-09-12T22:30:59.507 INFO:teuthology.orchestra.run.smithi163.stdout: ms die on bug = true 2024-09-12T22:30:59.507 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-09-12T22:30:59.507 INFO:teuthology.orchestra.run.smithi163.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-12T22:30:59.507 INFO:teuthology.orchestra.run.smithi163.stdout: mon pg warn max object skew = 0 2024-09-12T22:30:59.507 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-09-12T22:30:59.507 INFO:teuthology.orchestra.run.smithi163.stdout: # disable pg_autoscaler by default for new pools 2024-09-12T22:30:59.507 INFO:teuthology.orchestra.run.smithi163.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-12T22:30:59.507 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-09-12T22:30:59.507 INFO:teuthology.orchestra.run.smithi163.stdout: osd pool default size = 2 2024-09-12T22:30:59.507 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-09-12T22:30:59.507 INFO:teuthology.orchestra.run.smithi163.stdout: mon osd allow primary affinity = true 2024-09-12T22:30:59.507 INFO:teuthology.orchestra.run.smithi163.stdout: mon osd allow pg remap = true 2024-09-12T22:30:59.508 INFO:teuthology.orchestra.run.smithi163.stdout: mon warn on legacy crush tunables = false 2024-09-12T22:30:59.508 INFO:teuthology.orchestra.run.smithi163.stdout: mon warn on crush straw calc version zero = false 2024-09-12T22:30:59.508 INFO:teuthology.orchestra.run.smithi163.stdout: mon warn on no sortbitwise = false 2024-09-12T22:30:59.508 INFO:teuthology.orchestra.run.smithi163.stdout: mon warn on osd down out interval zero = false 2024-09-12T22:30:59.508 INFO:teuthology.orchestra.run.smithi163.stdout: mon warn on too few osds = false 2024-09-12T22:30:59.508 INFO:teuthology.orchestra.run.smithi163.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-12T22:30:59.508 INFO:teuthology.orchestra.run.smithi163.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-12T22:30:59.508 INFO:teuthology.orchestra.run.smithi163.stdout: mon_allow_pool_size_one = true 2024-09-12T22:30:59.508 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-09-12T22:30:59.508 INFO:teuthology.orchestra.run.smithi163.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-12T22:30:59.508 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-09-12T22:30:59.508 INFO:teuthology.orchestra.run.smithi163.stdout: osd default data pool replay window = 5 2024-09-12T22:30:59.508 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-09-12T22:30:59.509 INFO:teuthology.orchestra.run.smithi163.stdout: mon allow pool delete = true 2024-09-12T22:30:59.509 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-09-12T22:30:59.509 INFO:teuthology.orchestra.run.smithi163.stdout: mon cluster log file level = debug 2024-09-12T22:30:59.509 INFO:teuthology.orchestra.run.smithi163.stdout: debug asserts on shutdown = true 2024-09-12T22:30:59.509 INFO:teuthology.orchestra.run.smithi163.stdout: mon health detail to clog = false 2024-09-12T22:30:59.509 INFO:teuthology.orchestra.run.smithi163.stdout: mon host = "172.21.15.19,[v2:172.21.15.19:3301,v1:172.21.15.19:6790],[v2:172.21.15.19:3302,v1:172.21.15.19:6791]" 2024-09-12T22:30:59.509 INFO:teuthology.orchestra.run.smithi163.stdout: fsid = 957ce235-19cb-4350-8fee-febd6e3f2199 2024-09-12T22:30:59.509 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-09-12T22:30:59.509 INFO:teuthology.orchestra.run.smithi163.stdout:[osd] 2024-09-12T22:30:59.509 INFO:teuthology.orchestra.run.smithi163.stdout: osd journal size = 100 2024-09-12T22:30:59.509 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-09-12T22:30:59.509 INFO:teuthology.orchestra.run.smithi163.stdout: osd scrub load threshold = 5.0 2024-09-12T22:30:59.509 INFO:teuthology.orchestra.run.smithi163.stdout: osd scrub max interval = 600 2024-09-12T22:30:59.510 INFO:teuthology.orchestra.run.smithi163.stdout: osd mclock profile = high_recovery_ops 2024-09-12T22:30:59.510 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-09-12T22:30:59.510 INFO:teuthology.orchestra.run.smithi163.stdout: osd recover clone overlap = true 2024-09-12T22:30:59.510 INFO:teuthology.orchestra.run.smithi163.stdout: osd recovery max chunk = 1048576 2024-09-12T22:30:59.510 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-09-12T22:30:59.510 INFO:teuthology.orchestra.run.smithi163.stdout: osd debug shutdown = true 2024-09-12T22:30:59.510 INFO:teuthology.orchestra.run.smithi163.stdout: osd debug op order = true 2024-09-12T22:30:59.510 INFO:teuthology.orchestra.run.smithi163.stdout: osd debug verify stray on activate = true 2024-09-12T22:30:59.510 INFO:teuthology.orchestra.run.smithi163.stdout: osd debug trim objects = true 2024-09-12T22:30:59.510 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-09-12T22:30:59.510 INFO:teuthology.orchestra.run.smithi163.stdout: osd open classes on start = true 2024-09-12T22:30:59.510 INFO:teuthology.orchestra.run.smithi163.stdout: osd debug pg log writeout = true 2024-09-12T22:30:59.510 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-09-12T22:30:59.510 INFO:teuthology.orchestra.run.smithi163.stdout: osd deep scrub update digest min age = 30 2024-09-12T22:30:59.511 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-09-12T22:30:59.511 INFO:teuthology.orchestra.run.smithi163.stdout: osd map max advance = 10 2024-09-12T22:30:59.511 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-09-12T22:30:59.511 INFO:teuthology.orchestra.run.smithi163.stdout: journal zero on create = true 2024-09-12T22:30:59.511 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-09-12T22:30:59.511 INFO:teuthology.orchestra.run.smithi163.stdout: filestore ondisk finisher threads = 3 2024-09-12T22:30:59.511 INFO:teuthology.orchestra.run.smithi163.stdout: filestore apply finisher threads = 3 2024-09-12T22:30:59.511 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-09-12T22:30:59.511 INFO:teuthology.orchestra.run.smithi163.stdout: bdev debug aio = true 2024-09-12T22:30:59.511 INFO:teuthology.orchestra.run.smithi163.stdout: osd debug misdirected ops = true 2024-09-12T22:30:59.511 INFO:teuthology.orchestra.run.smithi163.stdout: bdev async discard = True 2024-09-12T22:30:59.511 INFO:teuthology.orchestra.run.smithi163.stdout: bdev enable discard = True 2024-09-12T22:30:59.511 INFO:teuthology.orchestra.run.smithi163.stdout: bluestore allocator = bitmap 2024-09-12T22:30:59.511 INFO:teuthology.orchestra.run.smithi163.stdout: bluestore block size = 96636764160 2024-09-12T22:30:59.512 INFO:teuthology.orchestra.run.smithi163.stdout: bluestore fsck on mount = True 2024-09-12T22:30:59.512 INFO:teuthology.orchestra.run.smithi163.stdout: debug bluefs = 1/20 2024-09-12T22:30:59.512 INFO:teuthology.orchestra.run.smithi163.stdout: debug bluestore = 1/20 2024-09-12T22:30:59.512 INFO:teuthology.orchestra.run.smithi163.stdout: debug ms = 1 2024-09-12T22:30:59.512 INFO:teuthology.orchestra.run.smithi163.stdout: debug osd = 20 2024-09-12T22:30:59.512 INFO:teuthology.orchestra.run.smithi163.stdout: debug rocksdb = 4/10 2024-09-12T22:30:59.512 INFO:teuthology.orchestra.run.smithi163.stdout: mon osd backfillfull_ratio = 0.85 2024-09-12T22:30:59.512 INFO:teuthology.orchestra.run.smithi163.stdout: mon osd full ratio = 0.9 2024-09-12T22:30:59.512 INFO:teuthology.orchestra.run.smithi163.stdout: mon osd nearfull ratio = 0.8 2024-09-12T22:30:59.512 INFO:teuthology.orchestra.run.smithi163.stdout: osd blocked scrub grace period = 3600 2024-09-12T22:30:59.512 INFO:teuthology.orchestra.run.smithi163.stdout: osd failsafe full ratio = 0.95 2024-09-12T22:30:59.512 INFO:teuthology.orchestra.run.smithi163.stdout: osd max markdown count = 1000 2024-09-12T22:30:59.512 INFO:teuthology.orchestra.run.smithi163.stdout: osd objectstore = bluestore 2024-09-12T22:30:59.513 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-09-12T22:30:59.513 INFO:teuthology.orchestra.run.smithi163.stdout:[mgr] 2024-09-12T22:30:59.513 INFO:teuthology.orchestra.run.smithi163.stdout: debug ms = 1 2024-09-12T22:30:59.513 INFO:teuthology.orchestra.run.smithi163.stdout: debug mgr = 20 2024-09-12T22:30:59.513 INFO:teuthology.orchestra.run.smithi163.stdout: debug mon = 20 2024-09-12T22:30:59.513 INFO:teuthology.orchestra.run.smithi163.stdout: debug auth = 20 2024-09-12T22:30:59.513 INFO:teuthology.orchestra.run.smithi163.stdout: mon reweight min pgs per osd = 4 2024-09-12T22:30:59.513 INFO:teuthology.orchestra.run.smithi163.stdout: mon reweight min bytes per osd = 10 2024-09-12T22:30:59.513 INFO:teuthology.orchestra.run.smithi163.stdout: mgr/telemetry/nag = false 2024-09-12T22:30:59.513 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-09-12T22:30:59.513 INFO:teuthology.orchestra.run.smithi163.stdout:[mon] 2024-09-12T22:30:59.513 INFO:teuthology.orchestra.run.smithi163.stdout: debug ms = 1 2024-09-12T22:30:59.513 INFO:teuthology.orchestra.run.smithi163.stdout: debug mon = 20 2024-09-12T22:30:59.513 INFO:teuthology.orchestra.run.smithi163.stdout: debug paxos = 20 2024-09-12T22:30:59.514 INFO:teuthology.orchestra.run.smithi163.stdout: debug auth = 20 2024-09-12T22:30:59.514 INFO:teuthology.orchestra.run.smithi163.stdout: mon data avail warn = 5 2024-09-12T22:30:59.514 INFO:teuthology.orchestra.run.smithi163.stdout: mon mgr mkfs grace = 240 2024-09-12T22:30:59.514 INFO:teuthology.orchestra.run.smithi163.stdout: mon reweight min pgs per osd = 4 2024-09-12T22:30:59.514 INFO:teuthology.orchestra.run.smithi163.stdout: mon osd reporter subtree level = osd 2024-09-12T22:30:59.514 INFO:teuthology.orchestra.run.smithi163.stdout: mon osd prime pg temp = true 2024-09-12T22:30:59.514 INFO:teuthology.orchestra.run.smithi163.stdout: mon reweight min bytes per osd = 10 2024-09-12T22:30:59.514 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-09-12T22:30:59.514 INFO:teuthology.orchestra.run.smithi163.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-12T22:30:59.514 INFO:teuthology.orchestra.run.smithi163.stdout: auth mon ticket ttl = 660 # 11m 2024-09-12T22:30:59.514 INFO:teuthology.orchestra.run.smithi163.stdout: auth service ticket ttl = 240 # 4m 2024-09-12T22:30:59.514 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-09-12T22:30:59.514 INFO:teuthology.orchestra.run.smithi163.stdout: # don't complain about insecure global_id in the test suite 2024-09-12T22:30:59.514 INFO:teuthology.orchestra.run.smithi163.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-12T22:30:59.515 INFO:teuthology.orchestra.run.smithi163.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-12T22:30:59.515 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-09-12T22:30:59.515 INFO:teuthology.orchestra.run.smithi163.stdout: # 1m isn't quite enough 2024-09-12T22:30:59.515 INFO:teuthology.orchestra.run.smithi163.stdout: mon_down_mkfs_grace = 2m 2024-09-12T22:30:59.515 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-09-12T22:30:59.515 INFO:teuthology.orchestra.run.smithi163.stdout: mon_warn_on_filestore_osds = false 2024-09-12T22:30:59.515 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-09-12T22:30:59.515 INFO:teuthology.orchestra.run.smithi163.stdout:[client] 2024-09-12T22:30:59.515 INFO:teuthology.orchestra.run.smithi163.stdout: rgw cache enabled = true 2024-09-12T22:30:59.515 INFO:teuthology.orchestra.run.smithi163.stdout: rgw enable ops log = true 2024-09-12T22:30:59.515 INFO:teuthology.orchestra.run.smithi163.stdout: rgw enable usage log = true 2024-09-12T22:30:59.515 INFO:teuthology.orchestra.run.smithi163.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-12T22:30:59.515 INFO:teuthology.orchestra.run.smithi163.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-12T22:30:59.516 INFO:teuthology.orchestra.run.smithi163.stdout:[mon.a] 2024-09-12T22:30:59.516 INFO:teuthology.orchestra.run.smithi163.stdout:[mon.b] 2024-09-12T22:30:59.516 INFO:teuthology.orchestra.run.smithi163.stdout:[mon.c] 2024-09-12T22:30:59.516 INFO:teuthology.orchestra.run.smithi163.stdout:[mds.a] 2024-09-12T22:30:59.518 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-12T22:30:59.518 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-12T22:30:59.613 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-12T22:30:59.613 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T22:30:59.613 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-12T22:30:59.630 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T22:30:59.630 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-12T22:30:59.686 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi019.front.sepia.ceph.com 2024-09-12T22:30:59.686 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T22:30:59.686 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-12T22:30:59.686 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T22:30:59.762 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T22:30:59.762 DEBUG:teuthology.orchestra.run.smithi019:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-12T22:30:59.818 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi076.front.sepia.ceph.com 2024-09-12T22:30:59.818 DEBUG:teuthology.orchestra.run.smithi076:> set -ex 2024-09-12T22:30:59.818 DEBUG:teuthology.orchestra.run.smithi076:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-12T22:30:59.818 DEBUG:teuthology.orchestra.run.smithi076:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T22:30:59.854 DEBUG:teuthology.orchestra.run.smithi076:> set -ex 2024-09-12T22:30:59.854 DEBUG:teuthology.orchestra.run.smithi076:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-12T22:30:59.909 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi148.front.sepia.ceph.com 2024-09-12T22:30:59.910 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-12T22:30:59.910 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-12T22:30:59.910 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T22:30:59.951 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-12T22:30:59.951 DEBUG:teuthology.orchestra.run.smithi148:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-12T22:31:00.009 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi163.front.sepia.ceph.com 2024-09-12T22:31:00.009 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-09-12T22:31:00.009 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-12T22:31:00.009 DEBUG:teuthology.orchestra.run.smithi163:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T22:31:00.047 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-09-12T22:31:00.047 DEBUG:teuthology.orchestra.run.smithi163:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-12T22:31:00.103 INFO:tasks.ceph:Setting up mon nodes... 2024-09-12T22:31:00.103 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-12T22:31:00.104 DEBUG:teuthology.orchestra.run.smithi019:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-12T22:31:00.156 INFO:teuthology.orchestra.run.smithi019.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-12T22:31:00.159 DEBUG:teuthology.orchestra.run.smithi019:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-12T22:31:00.212 INFO:teuthology.orchestra.run.smithi019.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-12T22:31:00.214 INFO:tasks.ceph:Setting up mds nodes... 2024-09-12T22:31:00.215 DEBUG:teuthology.orchestra.run.smithi019:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-09-12T22:31:00.267 INFO:teuthology.orchestra.run.smithi019.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-09-12T22:31:00.270 DEBUG:teuthology.orchestra.run.smithi019:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-09-12T22:31:00.296 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-12T22:31:00.296 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-12T22:31:00.378 INFO:teuthology.orchestra.run.smithi019.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-12T22:31:00.392 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-12T22:31:00.392 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi076.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi148.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi163.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1'}} 2024-09-12T22:31:00.392 DEBUG:teuthology.orchestra.run.smithi076:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-12T22:31:00.418 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-09-12T22:31:00.418 INFO:tasks.ceph:role: osd.0 2024-09-12T22:31:00.418 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi076.front.sepia.ceph.com 2024-09-12T22:31:00.418 DEBUG:teuthology.orchestra.run.smithi076:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-12T22:31:00.490 INFO:teuthology.orchestra.run.smithi076.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T22:31:00.491 INFO:teuthology.orchestra.run.smithi076.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T22:31:00.491 INFO:teuthology.orchestra.run.smithi076.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T22:31:00.491 INFO:teuthology.orchestra.run.smithi076.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T22:31:00.491 INFO:teuthology.orchestra.run.smithi076.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T22:31:00.491 INFO:teuthology.orchestra.run.smithi076.stdout: = sunit=0 swidth=0 blks 2024-09-12T22:31:00.491 INFO:teuthology.orchestra.run.smithi076.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T22:31:00.491 INFO:teuthology.orchestra.run.smithi076.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T22:31:00.491 INFO:teuthology.orchestra.run.smithi076.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T22:31:00.491 INFO:teuthology.orchestra.run.smithi076.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T22:31:00.996 INFO:teuthology.orchestra.run.smithi076.stdout:Discarding blocks...Done. 2024-09-12T22:31:00.998 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi076.front.sepia.ceph.com -o noatime 2024-09-12T22:31:00.998 DEBUG:teuthology.orchestra.run.smithi076:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-12T22:31:01.101 DEBUG:teuthology.orchestra.run.smithi076:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-12T22:31:01.132 DEBUG:teuthology.orchestra.run.smithi076:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T22:31:01.243 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-12T22:31:01.242+0000 7f6e129dd640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-12T22:31:01.245 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-12T22:31:01.244+0000 7f6e129dd640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-12T22:31:01.245 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-12T22:31:01.244+0000 7f6e129dd640 -1 bdev(0x555e6c8c5800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-12T22:31:01.245 INFO:teuthology.orchestra.run.smithi076.stderr:2024-09-12T22:31:01.244+0000 7f6e129dd640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-12T22:31:04.893 DEBUG:teuthology.orchestra.run.smithi076:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-12T22:31:04.921 DEBUG:teuthology.orchestra.run.smithi148:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-12T22:31:04.951 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1'} 2024-09-12T22:31:04.951 INFO:tasks.ceph:role: osd.1 2024-09-12T22:31:04.951 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi148.front.sepia.ceph.com 2024-09-12T22:31:04.952 DEBUG:teuthology.orchestra.run.smithi148:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-12T22:31:05.028 INFO:teuthology.orchestra.run.smithi148.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T22:31:05.029 INFO:teuthology.orchestra.run.smithi148.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T22:31:05.029 INFO:teuthology.orchestra.run.smithi148.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T22:31:05.029 INFO:teuthology.orchestra.run.smithi148.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T22:31:05.029 INFO:teuthology.orchestra.run.smithi148.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T22:31:05.029 INFO:teuthology.orchestra.run.smithi148.stdout: = sunit=0 swidth=0 blks 2024-09-12T22:31:05.029 INFO:teuthology.orchestra.run.smithi148.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T22:31:05.029 INFO:teuthology.orchestra.run.smithi148.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T22:31:05.029 INFO:teuthology.orchestra.run.smithi148.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T22:31:05.029 INFO:teuthology.orchestra.run.smithi148.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T22:31:05.540 INFO:teuthology.orchestra.run.smithi148.stdout:Discarding blocks...Done. 2024-09-12T22:31:05.543 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi148.front.sepia.ceph.com -o noatime 2024-09-12T22:31:05.543 DEBUG:teuthology.orchestra.run.smithi148:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2024-09-12T22:31:05.695 DEBUG:teuthology.orchestra.run.smithi148:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-12T22:31:05.733 DEBUG:teuthology.orchestra.run.smithi148:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T22:31:05.847 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-12T22:31:05.845+0000 7f519d219640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-12T22:31:05.850 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-12T22:31:05.847+0000 7f519d219640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-12T22:31:05.850 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-12T22:31:05.847+0000 7f519d219640 -1 bdev(0x561b78ee7800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-12T22:31:05.850 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-12T22:31:05.847+0000 7f519d219640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-12T22:31:09.780 DEBUG:teuthology.orchestra.run.smithi148:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-12T22:31:09.810 DEBUG:teuthology.orchestra.run.smithi163:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-12T22:31:09.840 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1'} 2024-09-12T22:31:09.840 INFO:tasks.ceph:role: osd.2 2024-09-12T22:31:09.840 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi163.front.sepia.ceph.com 2024-09-12T22:31:09.840 DEBUG:teuthology.orchestra.run.smithi163:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-12T22:31:09.917 INFO:teuthology.orchestra.run.smithi163.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T22:31:09.917 INFO:teuthology.orchestra.run.smithi163.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T22:31:09.917 INFO:teuthology.orchestra.run.smithi163.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T22:31:09.917 INFO:teuthology.orchestra.run.smithi163.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T22:31:09.917 INFO:teuthology.orchestra.run.smithi163.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T22:31:09.918 INFO:teuthology.orchestra.run.smithi163.stdout: = sunit=0 swidth=0 blks 2024-09-12T22:31:09.918 INFO:teuthology.orchestra.run.smithi163.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T22:31:09.918 INFO:teuthology.orchestra.run.smithi163.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T22:31:09.918 INFO:teuthology.orchestra.run.smithi163.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T22:31:09.918 INFO:teuthology.orchestra.run.smithi163.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T22:31:10.436 INFO:teuthology.orchestra.run.smithi163.stdout:Discarding blocks...Done. 2024-09-12T22:31:10.439 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi163.front.sepia.ceph.com -o noatime 2024-09-12T22:31:10.439 DEBUG:teuthology.orchestra.run.smithi163:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-2 2024-09-12T22:31:10.570 DEBUG:teuthology.orchestra.run.smithi163:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-12T22:31:10.603 DEBUG:teuthology.orchestra.run.smithi163:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T22:31:10.714 INFO:teuthology.orchestra.run.smithi163.stderr:2024-09-12T22:31:10.713+0000 7f4006adc640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-12T22:31:10.721 INFO:teuthology.orchestra.run.smithi163.stderr:2024-09-12T22:31:10.717+0000 7f4006adc640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-12T22:31:10.721 INFO:teuthology.orchestra.run.smithi163.stderr:2024-09-12T22:31:10.717+0000 7f4006adc640 -1 bdev(0x5603e4d93800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-12T22:31:10.721 INFO:teuthology.orchestra.run.smithi163.stderr:2024-09-12T22:31:10.717+0000 7f4006adc640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-12T22:31:14.149 DEBUG:teuthology.orchestra.run.smithi163:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-12T22:31:14.178 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-12T22:31:14.178 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T22:31:14.178 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-12T22:31:14.210 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T22:31:14.210 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-12T22:31:14.280 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T22:31:14.281 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-09-12T22:31:14.351 DEBUG:teuthology.orchestra.run.smithi076:> set -ex 2024-09-12T22:31:14.351 DEBUG:teuthology.orchestra.run.smithi076:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-12T22:31:14.380 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-12T22:31:14.380 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-12T22:31:14.411 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-09-12T22:31:14.411 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-12T22:31:14.441 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T22:31:14.441 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-12T22:31:14.460 INFO:tasks.ceph:Adding keys to all mons... 2024-09-12T22:31:14.460 DEBUG:teuthology.orchestra.run.smithi019:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-12T22:31:14.528 INFO:teuthology.orchestra.run.smithi019.stdout:[mgr.x] 2024-09-12T22:31:14.528 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQCka+Nm5I9UCRAAVmA2XDvZSAd7QHztUNW+Ew== 2024-09-12T22:31:14.529 INFO:teuthology.orchestra.run.smithi019.stdout:[mgr.y] 2024-09-12T22:31:14.529 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQCka+NmDMyhDBAAG4RZI547L2qMlbPpn/QDwQ== 2024-09-12T22:31:14.529 INFO:teuthology.orchestra.run.smithi019.stdout:[mds.a] 2024-09-12T22:31:14.529 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQCka+NmP93yDxAAPckkqZ0EVSirBOLwd3wp6Q== 2024-09-12T22:31:14.529 INFO:teuthology.orchestra.run.smithi019.stdout:[osd.0] 2024-09-12T22:31:14.529 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQCla+NmRG6BDhAArFuUMTUIChbvmybjgMS6VA== 2024-09-12T22:31:14.529 INFO:teuthology.orchestra.run.smithi019.stdout:[osd.1] 2024-09-12T22:31:14.529 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQCpa+Nmx01+MhAAbRZXr+74qnrM1sGkd1O/ng== 2024-09-12T22:31:14.529 INFO:teuthology.orchestra.run.smithi019.stdout:[osd.2] 2024-09-12T22:31:14.529 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQCua+NmoUGVKhAA7zzE4zqa/BHIQh7IXsHoag== 2024-09-12T22:31:14.529 INFO:teuthology.orchestra.run.smithi019.stdout:[client.0] 2024-09-12T22:31:14.529 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQCka+Nm35WOFhAAfCbrTTe2jtDgCbaZiEmg0A== 2024-09-12T22:31:14.530 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T22:31:14.629 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T22:31:14.683 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-12T22:31:14.739 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T22:31:14.791 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T22:31:14.843 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T22:31:14.895 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T22:31:14.950 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-12T22:31:14.950 DEBUG:teuthology.orchestra.run.smithi019:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-12T22:31:14.976 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T22:31:15.073 DEBUG:teuthology.orchestra.run.smithi019:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-12T22:31:15.098 DEBUG:teuthology.orchestra.run.smithi019:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-12T22:31:15.164 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T22:31:15.261 DEBUG:teuthology.orchestra.run.smithi019:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-12T22:31:15.286 DEBUG:teuthology.orchestra.run.smithi019:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-12T22:31:15.351 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T22:31:15.449 DEBUG:teuthology.orchestra.run.smithi019:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-12T22:31:15.475 DEBUG:teuthology.orchestra.run.smithi019:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-12T22:31:15.531 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-12T22:31:15.531 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-12T22:31:15.531 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-12T22:31:15.573 INFO:tasks.ceph.mon.a:Started 2024-09-12T22:31:15.573 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-12T22:31:15.574 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-12T22:31:15.575 INFO:tasks.ceph.mon.b:Started 2024-09-12T22:31:15.575 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-12T22:31:15.576 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-12T22:31:15.578 INFO:tasks.ceph.mon.c:Started 2024-09-12T22:31:15.578 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-12T22:31:15.578 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-12T22:31:15.578 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-12T22:31:15.580 INFO:tasks.ceph.mgr.x:Started 2024-09-12T22:31:15.580 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-12T22:31:15.580 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-12T22:31:15.582 INFO:tasks.ceph.mgr.y:Started 2024-09-12T22:31:15.582 INFO:tasks.ceph:Setting crush tunables to default 2024-09-12T22:31:15.582 DEBUG:teuthology.orchestra.run.smithi019:> sudo ceph --cluster ceph osd crush tunables default 2024-09-12T22:31:16.042 INFO:tasks.ceph.mgr.x.smithi019.stderr:2024-09-12T22:31:16.041+0000 7fb9c7920040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-12T22:31:16.055 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-09-12T22:31:16.054+0000 7fe651d8a040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-12T22:31:16.057 INFO:teuthology.orchestra.run.smithi019.stderr:adjusted tunables profile to default 2024-09-12T22:31:16.070 INFO:tasks.ceph:check_enable_crimson: False 2024-09-12T22:31:16.070 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-12T22:31:16.071 DEBUG:teuthology.orchestra.run.smithi076:> set -ex 2024-09-12T22:31:16.071 DEBUG:teuthology.orchestra.run.smithi076:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-12T22:31:16.088 INFO:tasks.ceph.mgr.x.smithi019.stderr:2024-09-12T22:31:16.087+0000 7fb9c7920040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-12T22:31:16.100 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-09-12T22:31:16.099+0000 7fe651d8a040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-12T22:31:16.100 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-12T22:31:16.101 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-12T22:31:16.131 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-09-12T22:31:16.131 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-12T22:31:16.160 DEBUG:teuthology.orchestra.run.smithi163:> sudo ceph --cluster ceph osd new 73b96314-15d5-4058-9993-ac103e997b27 0 2024-09-12T22:31:16.245 INFO:tasks.ceph.mgr.x.smithi019.stderr:2024-09-12T22:31:16.244+0000 7fb9c7920040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-12T22:31:16.246 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-09-12T22:31:16.244+0000 7fe651d8a040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-12T22:31:16.299 INFO:tasks.ceph.mgr.x.smithi019.stderr:2024-09-12T22:31:16.297+0000 7fb9c7920040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-12T22:31:16.299 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-09-12T22:31:16.298+0000 7fe651d8a040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-12T22:31:16.389 INFO:teuthology.orchestra.run.smithi163.stdout:0 2024-09-12T22:31:16.401 DEBUG:teuthology.orchestra.run.smithi163:> sudo ceph --cluster ceph osd new f82ad621-e9cf-41cb-b9c0-43470cf7ddb1 1 2024-09-12T22:31:16.469 INFO:tasks.ceph.mgr.x.smithi019.stderr:2024-09-12T22:31:16.468+0000 7fb9c7920040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-12T22:31:16.470 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-09-12T22:31:16.468+0000 7fe651d8a040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-12T22:31:16.575 INFO:teuthology.orchestra.run.smithi163.stdout:1 2024-09-12T22:31:16.586 DEBUG:teuthology.orchestra.run.smithi163:> sudo ceph --cluster ceph osd new f30dda36-a84c-4a01-a81a-afbfb88c0aed 2 2024-09-12T22:31:16.588 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-09-12T22:31:16.587+0000 7fe651d8a040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-12T22:31:16.589 INFO:tasks.ceph.mgr.x.smithi019.stderr:2024-09-12T22:31:16.587+0000 7fb9c7920040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-12T22:31:16.760 INFO:teuthology.orchestra.run.smithi163.stdout:2 2024-09-12T22:31:16.771 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-12T22:31:16.771 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-12T22:31:16.774 INFO:tasks.ceph.osd.0:Started 2024-09-12T22:31:16.774 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-12T22:31:16.774 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-12T22:31:16.777 INFO:tasks.ceph.osd.1:Started 2024-09-12T22:31:16.777 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-12T22:31:16.777 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-12T22:31:16.779 INFO:tasks.ceph.osd.2:Started 2024-09-12T22:31:16.780 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T22:31:16.945 INFO:tasks.ceph.mgr.x.smithi019.stderr:2024-09-12T22:31:16.943+0000 7fb9c7920040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-12T22:31:16.945 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-09-12T22:31:16.943+0000 7fe651d8a040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-12T22:31:16.956 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:31:16.956 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":5,"fsid":"957ce235-19cb-4350-8fee-febd6e3f2199","created":"2024-09-12T22:31:15.903133+0000","modified":"2024-09-12T22:31:16.757598+0000","last_up_change":"0.000000","last_in_change":"2024-09-12T22:31:16.757598+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"73b96314-15d5-4058-9993-ac103e997b27","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"f82ad621-e9cf-41cb-b9c0-43470cf7ddb1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"f30dda36-a84c-4a01-a81a-afbfb88c0aed","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T22:31:16.969 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-12T22:31:16.969 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-12T22:31:17.001 INFO:tasks.ceph.mgr.x.smithi019.stderr:2024-09-12T22:31:16.999+0000 7fb9c7920040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-12T22:31:17.001 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-09-12T22:31:16.999+0000 7fe651d8a040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-12T22:31:17.160 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-09-12T22:31:17.158+0000 7fe651d8a040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-12T22:31:17.160 INFO:tasks.ceph.mgr.x.smithi019.stderr:2024-09-12T22:31:17.159+0000 7fb9c7920040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-12T22:31:17.271 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T22:31:17.438 INFO:teuthology.misc.health.smithi019.stdout: 2024-09-12T22:31:17.439 INFO:teuthology.misc.health.smithi019.stdout:{"epoch":5,"fsid":"957ce235-19cb-4350-8fee-febd6e3f2199","created":"2024-09-12T22:31:15.903133+0000","modified":"2024-09-12T22:31:16.757598+0000","last_up_change":"0.000000","last_in_change":"2024-09-12T22:31:16.757598+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"73b96314-15d5-4058-9993-ac103e997b27","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"f82ad621-e9cf-41cb-b9c0-43470cf7ddb1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"f30dda36-a84c-4a01-a81a-afbfb88c0aed","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T22:31:17.448 DEBUG:teuthology.misc:0 of 3 OSDs are up 2024-09-12T22:31:18.161 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-09-12T22:31:18.160+0000 7fe651d8a040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-12T22:31:18.161 INFO:tasks.ceph.mgr.x.smithi019.stderr:2024-09-12T22:31:18.160+0000 7fb9c7920040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-12T22:31:18.195 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:31:18.194+0000 7f9499885640 -1 Falling back to public interface 2024-09-12T22:31:18.217 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-09-12T22:31:18.216+0000 7fe651d8a040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-12T22:31:18.218 INFO:tasks.ceph.mgr.x.smithi019.stderr:2024-09-12T22:31:18.217+0000 7fb9c7920040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-12T22:31:18.439 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:31:18.436+0000 7fddef702640 -1 Falling back to public interface 2024-09-12T22:31:18.610 INFO:tasks.ceph.mgr.x.smithi019.stderr:2024-09-12T22:31:18.609+0000 7fb9c7920040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-12T22:31:18.611 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-09-12T22:31:18.610+0000 7fe651d8a040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-12T22:31:18.678 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:31:18.676+0000 7fce95618640 -1 Falling back to public interface 2024-09-12T22:31:18.701 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-09-12T22:31:18.700+0000 7fe651d8a040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-12T22:31:18.701 INFO:tasks.ceph.mgr.x.smithi019.stderr:2024-09-12T22:31:18.700+0000 7fb9c7920040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-12T22:31:18.814 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-09-12T22:31:18.813+0000 7fe651d8a040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-12T22:31:18.815 INFO:tasks.ceph.mgr.x.smithi019.stderr:2024-09-12T22:31:18.814+0000 7fb9c7920040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-12T22:31:18.863 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-09-12T22:31:18.862+0000 7fe651d8a040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-12T22:31:18.864 INFO:tasks.ceph.mgr.x.smithi019.stderr:2024-09-12T22:31:18.863+0000 7fb9c7920040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-12T22:31:18.983 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-09-12T22:31:18.982+0000 7fe651d8a040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-12T22:31:18.985 INFO:tasks.ceph.mgr.x.smithi019.stderr:2024-09-12T22:31:18.984+0000 7fb9c7920040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-12T22:31:19.047 INFO:tasks.ceph.mgr.x.smithi019.stderr:2024-09-12T22:31:19.045+0000 7fb9c7920040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-12T22:31:19.047 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-09-12T22:31:19.045+0000 7fe651d8a040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-12T22:31:19.094 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-09-12T22:31:19.093+0000 7fe651d8a040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-12T22:31:19.095 INFO:tasks.ceph.mgr.x.smithi019.stderr:2024-09-12T22:31:19.093+0000 7fb9c7920040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-12T22:31:19.213 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-09-12T22:31:19.212+0000 7fe651d8a040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-12T22:31:19.213 INFO:tasks.ceph.mgr.x.smithi019.stderr:2024-09-12T22:31:19.212+0000 7fb9c7920040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-12T22:31:19.266 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-09-12T22:31:19.265+0000 7fe651d8a040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-12T22:31:19.267 INFO:tasks.ceph.mgr.x.smithi019.stderr:2024-09-12T22:31:19.266+0000 7fb9c7920040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-12T22:31:19.320 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-09-12T22:31:19.319+0000 7fe651d8a040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-12T22:31:19.321 INFO:tasks.ceph.mgr.x.smithi019.stderr:2024-09-12T22:31:19.320+0000 7fb9c7920040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-12T22:31:19.392 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-09-12T22:31:19.391+0000 7fe651d8a040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-12T22:31:19.393 INFO:tasks.ceph.mgr.x.smithi019.stderr:2024-09-12T22:31:19.392+0000 7fb9c7920040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-12T22:31:19.439 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-09-12T22:31:19.438+0000 7fe651d8a040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-12T22:31:19.441 INFO:tasks.ceph.mgr.x.smithi019.stderr:2024-09-12T22:31:19.440+0000 7fb9c7920040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-12T22:31:19.486 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-09-12T22:31:19.485+0000 7fe651d8a040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-12T22:31:19.487 INFO:tasks.ceph.mgr.x.smithi019.stderr:2024-09-12T22:31:19.487+0000 7fb9c7920040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-12T22:31:20.179 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-09-12T22:31:20.177+0000 7fe651d8a040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-12T22:31:20.179 INFO:tasks.ceph.mgr.x.smithi019.stderr:2024-09-12T22:31:20.178+0000 7fb9c7920040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-12T22:31:21.195 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-09-12T22:31:21.193+0000 7fe5f265e640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-12T22:31:21.195 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-09-12T22:31:21.194+0000 7fe5f265e640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-12T22:31:21.953 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:31:21.952+0000 7f9499885640 -1 osd.1 0 log_to_monitors true 2024-09-12T22:31:22.922 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:31:22.921+0000 7fce95618640 -1 osd.2 0 log_to_monitors true 2024-09-12T22:31:22.926 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:31:22.925+0000 7fddef702640 -1 osd.0 0 log_to_monitors true 2024-09-12T22:31:23.750 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T22:31:24.043 INFO:teuthology.misc.health.smithi019.stdout: 2024-09-12T22:31:24.043 INFO:teuthology.misc.health.smithi019.stdout:{"epoch":7,"fsid":"957ce235-19cb-4350-8fee-febd6e3f2199","created":"2024-09-12T22:31:15.903133+0000","modified":"2024-09-12T22:31:23.195705+0000","last_up_change":"0.000000","last_in_change":"2024-09-12T22:31:16.757598+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"73b96314-15d5-4058-9993-ac103e997b27","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"f82ad621-e9cf-41cb-b9c0-43470cf7ddb1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"f30dda36-a84c-4a01-a81a-afbfb88c0aed","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T22:31:24.054 DEBUG:teuthology.misc:0 of 3 OSDs are up 2024-09-12T22:31:24.123 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:31:24.122+0000 7f9496028640 -1 osd.1 0 waiting for initial osdmap 2024-09-12T22:31:24.138 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:31:24.137+0000 7f948d623640 -1 osd.1 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T22:31:25.068 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:31:25.067+0000 7fce90830640 -1 osd.2 0 waiting for initial osdmap 2024-09-12T22:31:25.082 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:31:25.081+0000 7fce88e62640 -1 osd.2 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T22:31:25.118 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:31:25.117+0000 7fddeae6e640 -1 osd.0 0 waiting for initial osdmap 2024-09-12T22:31:25.128 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:31:25.127+0000 7fdde34a0640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T22:31:30.356 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T22:31:30.648 INFO:teuthology.misc.health.smithi019.stdout: 2024-09-12T22:31:30.649 INFO:teuthology.misc.health.smithi019.stdout:{"epoch":12,"fsid":"957ce235-19cb-4350-8fee-febd6e3f2199","created":"2024-09-12T22:31:15.903133+0000","modified":"2024-09-12T22:31:28.247948+0000","last_up_change":"2024-09-12T22:31:25.209056+0000","last_in_change":"2024-09-12T22:31:16.757598+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T22:31:26.228956+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73b96314-15d5-4058-9993-ac103e997b27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6800","nonce":1343093884},{"type":"v1","addr":"172.21.15.76:6801","nonce":1343093884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6802","nonce":1343093884},{"type":"v1","addr":"172.21.15.76:6803","nonce":1343093884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6806","nonce":1343093884},{"type":"v1","addr":"172.21.15.76:6807","nonce":1343093884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6804","nonce":1343093884},{"type":"v1","addr":"172.21.15.76:6805","nonce":1343093884}]},"public_addr":"172.21.15.76:6801/1343093884","cluster_addr":"172.21.15.76:6803/1343093884","heartbeat_back_addr":"172.21.15.76:6807/1343093884","heartbeat_front_addr":"172.21.15.76:6805/1343093884","state":["exists","up"]},{"osd":1,"uuid":"f82ad621-e9cf-41cb-b9c0-43470cf7ddb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":616952176},{"type":"v1","addr":"172.21.15.148:6801","nonce":616952176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":616952176},{"type":"v1","addr":"172.21.15.148:6803","nonce":616952176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":616952176},{"type":"v1","addr":"172.21.15.148:6807","nonce":616952176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":616952176},{"type":"v1","addr":"172.21.15.148:6805","nonce":616952176}]},"public_addr":"172.21.15.148:6801/616952176","cluster_addr":"172.21.15.148:6803/616952176","heartbeat_back_addr":"172.21.15.148:6807/616952176","heartbeat_front_addr":"172.21.15.148:6805/616952176","state":["exists","up"]},{"osd":2,"uuid":"f30dda36-a84c-4a01-a81a-afbfb88c0aed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":533442754},{"type":"v1","addr":"172.21.15.163:6801","nonce":533442754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":533442754},{"type":"v1","addr":"172.21.15.163:6803","nonce":533442754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":533442754},{"type":"v1","addr":"172.21.15.163:6807","nonce":533442754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":533442754},{"type":"v1","addr":"172.21.15.163:6805","nonce":533442754}]},"public_addr":"172.21.15.163:6801/533442754","cluster_addr":"172.21.15.163:6803/533442754","heartbeat_back_addr":"172.21.15.163:6807/533442754","heartbeat_front_addr":"172.21.15.163:6805/533442754","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T22:31:23.899591+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T22:31:22.988274+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T22:31:23.932109+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T22:31:30.660 DEBUG:teuthology.misc:3 of 3 OSDs are up 2024-09-12T22:31:30.660 INFO:tasks.ceph:Creating RBD pool 2024-09-12T22:31:30.660 DEBUG:teuthology.orchestra.run.smithi019:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-12T22:31:31.271 INFO:teuthology.orchestra.run.smithi019.stderr:pool 'rbd' created 2024-09-12T22:31:31.286 DEBUG:teuthology.orchestra.run.smithi019:> rbd --cluster ceph pool init rbd 2024-09-12T22:31:34.294 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-12T22:31:34.295 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-12T22:31:34.295 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-12T22:31:34.298 INFO:tasks.ceph.mds.a:Started 2024-09-12T22:31:34.298 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-09-12T22:31:34.298 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T22:31:34.380 INFO:tasks.ceph.mds.a.smithi019.stdout:starting mds.a at 2024-09-12T22:31:34.630 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:31:34.630 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":2,"btime":"2024-09-12T22:31:34:382862+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4239,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6803/1589279329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":1589279329},{"type":"v1","addr":"172.21.15.19:6803","nonce":1589279329}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-12T22:31:34.631 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 2 2024-09-12T22:31:34.644 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-12T22:31:34.932 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:31:34.932 INFO:teuthology.orchestra.run.smithi019.stdout:[ 2024-09-12T22:31:34.932 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:31:34.932 INFO:teuthology.orchestra.run.smithi019.stdout: "poolnum": 1, 2024-09-12T22:31:34.932 INFO:teuthology.orchestra.run.smithi019.stdout: "poolname": ".mgr" 2024-09-12T22:31:34.933 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:31:34.933 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:31:34.933 INFO:teuthology.orchestra.run.smithi019.stdout: "poolnum": 2, 2024-09-12T22:31:34.933 INFO:teuthology.orchestra.run.smithi019.stdout: "poolname": "rbd" 2024-09-12T22:31:34.933 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T22:31:34.933 INFO:teuthology.orchestra.run.smithi019.stdout:] 2024-09-12T22:31:34.945 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-12T22:31:34.945 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-12T22:31:35.386 INFO:teuthology.orchestra.run.smithi019.stderr:pool 'cephfs_metadata' created 2024-09-12T22:31:35.399 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-12T22:31:36.401 INFO:teuthology.orchestra.run.smithi019.stderr:pool 'cephfs_data' created 2024-09-12T22:31:36.418 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-12T22:31:37.401 INFO:teuthology.orchestra.run.smithi019.stderr:new fs with metadata pool 3 and data pool 4 2024-09-12T22:31:37.419 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T22:31:37.716 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:31:37.716 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":19,"fsid":"957ce235-19cb-4350-8fee-febd6e3f2199","created":"2024-09-12T22:31:15.903133+0000","modified":"2024-09-12T22:31:36.753500+0000","last_up_change":"2024-09-12T22:31:25.209056+0000","last_in_change":"2024-09-12T22:31:16.757598+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T22:31:26.228956+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T22:31:30.975989+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":16,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-12T22:31:35.267679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-12T22:31:35.724475+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73b96314-15d5-4058-9993-ac103e997b27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6800","nonce":1343093884},{"type":"v1","addr":"172.21.15.76:6801","nonce":1343093884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6802","nonce":1343093884},{"type":"v1","addr":"172.21.15.76:6803","nonce":1343093884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6806","nonce":1343093884},{"type":"v1","addr":"172.21.15.76:6807","nonce":1343093884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6804","nonce":1343093884},{"type":"v1","addr":"172.21.15.76:6805","nonce":1343093884}]},"public_addr":"172.21.15.76:6801/1343093884","cluster_addr":"172.21.15.76:6803/1343093884","heartbeat_back_addr":"172.21.15.76:6807/1343093884","heartbeat_front_addr":"172.21.15.76:6805/1343093884","state":["exists","up"]},{"osd":1,"uuid":"f82ad621-e9cf-41cb-b9c0-43470cf7ddb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":616952176},{"type":"v1","addr":"172.21.15.148:6801","nonce":616952176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":616952176},{"type":"v1","addr":"172.21.15.148:6803","nonce":616952176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":616952176},{"type":"v1","addr":"172.21.15.148:6807","nonce":616952176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":616952176},{"type":"v1","addr":"172.21.15.148:6805","nonce":616952176}]},"public_addr":"172.21.15.148:6801/616952176","cluster_addr":"172.21.15.148:6803/616952176","heartbeat_back_addr":"172.21.15.148:6807/616952176","heartbeat_front_addr":"172.21.15.148:6805/616952176","state":["exists","up"]},{"osd":2,"uuid":"f30dda36-a84c-4a01-a81a-afbfb88c0aed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":533442754},{"type":"v1","addr":"172.21.15.163:6801","nonce":533442754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":533442754},{"type":"v1","addr":"172.21.15.163:6803","nonce":533442754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":533442754},{"type":"v1","addr":"172.21.15.163:6807","nonce":533442754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":533442754},{"type":"v1","addr":"172.21.15.163:6805","nonce":533442754}]},"public_addr":"172.21.15.163:6801/533442754","cluster_addr":"172.21.15.163:6803/533442754","heartbeat_back_addr":"172.21.15.163:6807/533442754","heartbeat_front_addr":"172.21.15.163:6805/533442754","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T22:31:23.899591+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T22:31:22.988274+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T22:31:23.932109+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T22:31:37.729 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T22:31:38.020 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:31:38.020 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":19,"fsid":"957ce235-19cb-4350-8fee-febd6e3f2199","created":"2024-09-12T22:31:15.903133+0000","modified":"2024-09-12T22:31:36.753500+0000","last_up_change":"2024-09-12T22:31:25.209056+0000","last_in_change":"2024-09-12T22:31:16.757598+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T22:31:26.228956+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T22:31:30.975989+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":16,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-12T22:31:35.267679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-12T22:31:35.724475+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73b96314-15d5-4058-9993-ac103e997b27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6800","nonce":1343093884},{"type":"v1","addr":"172.21.15.76:6801","nonce":1343093884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6802","nonce":1343093884},{"type":"v1","addr":"172.21.15.76:6803","nonce":1343093884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6806","nonce":1343093884},{"type":"v1","addr":"172.21.15.76:6807","nonce":1343093884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6804","nonce":1343093884},{"type":"v1","addr":"172.21.15.76:6805","nonce":1343093884}]},"public_addr":"172.21.15.76:6801/1343093884","cluster_addr":"172.21.15.76:6803/1343093884","heartbeat_back_addr":"172.21.15.76:6807/1343093884","heartbeat_front_addr":"172.21.15.76:6805/1343093884","state":["exists","up"]},{"osd":1,"uuid":"f82ad621-e9cf-41cb-b9c0-43470cf7ddb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":616952176},{"type":"v1","addr":"172.21.15.148:6801","nonce":616952176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":616952176},{"type":"v1","addr":"172.21.15.148:6803","nonce":616952176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":616952176},{"type":"v1","addr":"172.21.15.148:6807","nonce":616952176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":616952176},{"type":"v1","addr":"172.21.15.148:6805","nonce":616952176}]},"public_addr":"172.21.15.148:6801/616952176","cluster_addr":"172.21.15.148:6803/616952176","heartbeat_back_addr":"172.21.15.148:6807/616952176","heartbeat_front_addr":"172.21.15.148:6805/616952176","state":["exists","up"]},{"osd":2,"uuid":"f30dda36-a84c-4a01-a81a-afbfb88c0aed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":533442754},{"type":"v1","addr":"172.21.15.163:6801","nonce":533442754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":533442754},{"type":"v1","addr":"172.21.15.163:6803","nonce":533442754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":533442754},{"type":"v1","addr":"172.21.15.163:6807","nonce":533442754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":533442754},{"type":"v1","addr":"172.21.15.163:6805","nonce":533442754}]},"public_addr":"172.21.15.163:6801/533442754","cluster_addr":"172.21.15.163:6803/533442754","heartbeat_back_addr":"172.21.15.163:6807/533442754","heartbeat_front_addr":"172.21.15.163:6805/533442754","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T22:31:23.899591+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T22:31:22.988274+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T22:31:23.932109+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T22:31:38.033 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-12T22:31:38.424 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-12T22:31:38.424 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-12T22:31:39.390 INFO:tasks.ceph.mds.a.smithi019.stderr:2024-09-12T22:31:39.389+0000 7f94c823d640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T22:31:39.435 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-12T22:31:39.436 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T22:31:39.770 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:31:39.770 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":5,"btime":"2024-09-12T22:31:39:408658+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T22:31:36.753879+0000","modified":"2024-09-12T22:31:38.748818+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4239},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4239":{"gid":4239,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":2,"addr":"172.21.15.19:6803/1589279329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":1589279329},{"type":"v1","addr":"172.21.15.19:6803","nonce":1589279329}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4239,"qdb_cluster":[4239]},"id":1}]} 2024-09-12T22:31:39.770 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 5 2024-09-12T22:31:39.783 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T22:31:40.077 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:31:40.077 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":20,"fsid":"957ce235-19cb-4350-8fee-febd6e3f2199","created":"2024-09-12T22:31:15.903133+0000","modified":"2024-09-12T22:31:38.404324+0000","last_up_change":"2024-09-12T22:31:25.209056+0000","last_in_change":"2024-09-12T22:31:16.757598+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T22:31:26.228956+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T22:31:30.975989+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":16,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-12T22:31:35.267679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-12T22:31:35.724475+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73b96314-15d5-4058-9993-ac103e997b27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6800","nonce":1343093884},{"type":"v1","addr":"172.21.15.76:6801","nonce":1343093884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6802","nonce":1343093884},{"type":"v1","addr":"172.21.15.76:6803","nonce":1343093884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6806","nonce":1343093884},{"type":"v1","addr":"172.21.15.76:6807","nonce":1343093884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6804","nonce":1343093884},{"type":"v1","addr":"172.21.15.76:6805","nonce":1343093884}]},"public_addr":"172.21.15.76:6801/1343093884","cluster_addr":"172.21.15.76:6803/1343093884","heartbeat_back_addr":"172.21.15.76:6807/1343093884","heartbeat_front_addr":"172.21.15.76:6805/1343093884","state":["exists","up"]},{"osd":1,"uuid":"f82ad621-e9cf-41cb-b9c0-43470cf7ddb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":616952176},{"type":"v1","addr":"172.21.15.148:6801","nonce":616952176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":616952176},{"type":"v1","addr":"172.21.15.148:6803","nonce":616952176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":616952176},{"type":"v1","addr":"172.21.15.148:6807","nonce":616952176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":616952176},{"type":"v1","addr":"172.21.15.148:6805","nonce":616952176}]},"public_addr":"172.21.15.148:6801/616952176","cluster_addr":"172.21.15.148:6803/616952176","heartbeat_back_addr":"172.21.15.148:6807/616952176","heartbeat_front_addr":"172.21.15.148:6805/616952176","state":["exists","up"]},{"osd":2,"uuid":"f30dda36-a84c-4a01-a81a-afbfb88c0aed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":533442754},{"type":"v1","addr":"172.21.15.163:6801","nonce":533442754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":533442754},{"type":"v1","addr":"172.21.15.163:6803","nonce":533442754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":533442754},{"type":"v1","addr":"172.21.15.163:6807","nonce":533442754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":533442754},{"type":"v1","addr":"172.21.15.163:6805","nonce":533442754}]},"public_addr":"172.21.15.163:6801/533442754","cluster_addr":"172.21.15.163:6803/533442754","heartbeat_back_addr":"172.21.15.163:6807/533442754","heartbeat_front_addr":"172.21.15.163:6805/533442754","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T22:31:23.899591+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T22:31:22.988274+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T22:31:23.932109+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T22:31:40.090 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T22:31:40.090 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T22:31:40.390 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:31:40.391 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-12T22:31:40.396 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2024-09-12T22:31:40.188618+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":205,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":58,"acting":58,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":91000,"kb_used_data":1592,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283024520,"statfs":{"total":289910292480,"available":289817108480,"internally_reserved":0,"allocated":1630208,"data_stored":1317887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":91483471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.802366"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:31:35.389314+0000","last_change":"2024-09-12T22:31:35.389314+0000","last_active":"2024-09-12T22:31:35.383905+0000","last_peered":"2024-09-12T22:31:35.383905+0000","last_clean":"2024-09-12T22:31:35.383905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:35.389314+0000","last_undegraded":"2024-09-12T22:31:35.389314+0000","last_fullsized":"2024-09-12T22:31:35.389314+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:35.383905+0000","last_change":"2024-09-12T22:31:35.383905+0000","last_active":"2024-09-12T22:31:35.383905+0000","last_peered":"2024-09-12T22:31:35.383905+0000","last_clean":"2024-09-12T22:31:35.383905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:35.383905+0000","last_undegraded":"2024-09-12T22:31:35.383905+0000","last_fullsized":"2024-09-12T22:31:35.383905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:31:35.390845+0000","last_change":"2024-09-12T22:31:35.390845+0000","last_active":"2024-09-12T22:31:35.383905+0000","last_peered":"2024-09-12T22:31:35.383905+0000","last_clean":"2024-09-12T22:31:35.383905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:35.390845+0000","last_undegraded":"2024-09-12T22:31:35.390845+0000","last_fullsized":"2024-09-12T22:31:35.390845+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:31:35.388050+0000","last_change":"2024-09-12T22:31:35.388050+0000","last_active":"2024-09-12T22:31:35.383905+0000","last_peered":"2024-09-12T22:31:35.383905+0000","last_clean":"2024-09-12T22:31:35.383905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:35.388050+0000","last_undegraded":"2024-09-12T22:31:35.388050+0000","last_fullsized":"2024-09-12T22:31:35.388050+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:31:35.388658+0000","last_change":"2024-09-12T22:31:35.388658+0000","last_active":"2024-09-12T22:31:35.383905+0000","last_peered":"2024-09-12T22:31:35.383905+0000","last_clean":"2024-09-12T22:31:35.383905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:35.388658+0000","last_undegraded":"2024-09-12T22:31:35.388658+0000","last_fullsized":"2024-09-12T22:31:35.388658+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:31:35.390140+0000","last_change":"2024-09-12T22:31:35.390140+0000","last_active":"2024-09-12T22:31:35.383905+0000","last_peered":"2024-09-12T22:31:35.383905+0000","last_clean":"2024-09-12T22:31:35.383905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:35.390140+0000","last_undegraded":"2024-09-12T22:31:35.390140+0000","last_fullsized":"2024-09-12T22:31:35.390140+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:31:35.389214+0000","last_change":"2024-09-12T22:31:35.389214+0000","last_active":"2024-09-12T22:31:35.383905+0000","last_peered":"2024-09-12T22:31:35.383905+0000","last_clean":"2024-09-12T22:31:35.383905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:35.389214+0000","last_undegraded":"2024-09-12T22:31:35.389214+0000","last_fullsized":"2024-09-12T22:31:35.389214+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:31:35.388216+0000","last_change":"2024-09-12T22:31:35.388216+0000","last_active":"2024-09-12T22:31:35.383905+0000","last_peered":"2024-09-12T22:31:35.383905+0000","last_clean":"2024-09-12T22:31:35.383905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:35.388216+0000","last_undegraded":"2024-09-12T22:31:35.388216+0000","last_fullsized":"2024-09-12T22:31:35.388216+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:35.383905+0000","last_change":"2024-09-12T22:31:35.383905+0000","last_active":"2024-09-12T22:31:35.383905+0000","last_peered":"2024-09-12T22:31:35.383905+0000","last_clean":"2024-09-12T22:31:35.383905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:35.383905+0000","last_undegraded":"2024-09-12T22:31:35.383905+0000","last_fullsized":"2024-09-12T22:31:35.383905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:31:35.388079+0000","last_change":"2024-09-12T22:31:35.388079+0000","last_active":"2024-09-12T22:31:35.383905+0000","last_peered":"2024-09-12T22:31:35.383905+0000","last_clean":"2024-09-12T22:31:35.383905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:35.388079+0000","last_undegraded":"2024-09-12T22:31:35.388079+0000","last_fullsized":"2024-09-12T22:31:35.388079+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:31:35.390037+0000","last_change":"2024-09-12T22:31:35.390037+0000","last_active":"2024-09-12T22:31:35.383905+0000","last_peered":"2024-09-12T22:31:35.383905+0000","last_clean":"2024-09-12T22:31:35.383905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:35.390037+0000","last_undegraded":"2024-09-12T22:31:35.390037+0000","last_fullsized":"2024-09-12T22:31:35.390037+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:31:35.390875+0000","last_change":"2024-09-12T22:31:35.390875+0000","last_active":"2024-09-12T22:31:35.383905+0000","last_peered":"2024-09-12T22:31:35.383905+0000","last_clean":"2024-09-12T22:31:35.383905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:35.390875+0000","last_undegraded":"2024-09-12T22:31:35.390875+0000","last_fullsized":"2024-09-12T22:31:35.390875+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":218,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T22:31:35.390163+0000","last_change":"2024-09-12T22:31:27.631847+0000","last_active":"2024-09-12T22:31:35.390163+0000","last_peered":"2024-09-12T22:31:35.390163+0000","last_clean":"2024-09-12T22:31:35.390163+0000","last_became_active":"2024-09-12T22:31:27.631027+0000","last_became_peered":"2024-09-12T22:31:27.631027+0000","last_unstale":"2024-09-12T22:31:35.390163+0000","last_undegraded":"2024-09-12T22:31:35.390163+0000","last_fullsized":"2024-09-12T22:31:35.390163+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:26.229539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:26.229539+0000","last_clean_scrub_stamp":"2024-09-12T22:31:26.229539+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:59:24.181319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":22,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T22:31:35.390331+0000","last_change":"2024-09-12T22:31:34.286952+0000","last_active":"2024-09-12T22:31:35.390331+0000","last_peered":"2024-09-12T22:31:35.390331+0000","last_clean":"2024-09-12T22:31:35.390331+0000","last_became_active":"2024-09-12T22:31:32.283661+0000","last_became_peered":"2024-09-12T22:31:32.283661+0000","last_unstale":"2024-09-12T22:31:35.390331+0000","last_undegraded":"2024-09-12T22:31:35.390331+0000","last_fullsized":"2024-09-12T22:31:35.390331+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:21.681390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000621274,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:35.383905+0000","last_change":"2024-09-12T22:31:35.383905+0000","last_active":"2024-09-12T22:31:35.383905+0000","last_peered":"2024-09-12T22:31:35.383905+0000","last_clean":"2024-09-12T22:31:35.383905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:35.383905+0000","last_undegraded":"2024-09-12T22:31:35.383905+0000","last_fullsized":"2024-09-12T22:31:35.383905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":21,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T22:31:35.390344+0000","last_change":"2024-09-12T22:31:34.286642+0000","last_active":"2024-09-12T22:31:35.390344+0000","last_peered":"2024-09-12T22:31:35.390344+0000","last_clean":"2024-09-12T22:31:35.390344+0000","last_became_active":"2024-09-12T22:31:32.283601+0000","last_became_peered":"2024-09-12T22:31:32.283601+0000","last_unstale":"2024-09-12T22:31:35.390344+0000","last_undegraded":"2024-09-12T22:31:35.390344+0000","last_fullsized":"2024-09-12T22:31:35.390344+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:40:06.769540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037858999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:35.383905+0000","last_change":"2024-09-12T22:31:35.383905+0000","last_active":"2024-09-12T22:31:35.383905+0000","last_peered":"2024-09-12T22:31:35.383905+0000","last_clean":"2024-09-12T22:31:35.383905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:35.383905+0000","last_undegraded":"2024-09-12T22:31:35.383905+0000","last_fullsized":"2024-09-12T22:31:35.383905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-12T22:31:34.286394+0000","last_change":"2024-09-12T22:31:34.286394+0000","last_active":"2024-09-12T22:31:34.286394+0000","last_peered":"2024-09-12T22:31:34.286394+0000","last_clean":"2024-09-12T22:31:34.286394+0000","last_became_active":"2024-09-12T22:31:32.280062+0000","last_became_peered":"2024-09-12T22:31:32.280062+0000","last_unstale":"2024-09-12T22:31:34.286394+0000","last_undegraded":"2024-09-12T22:31:34.286394+0000","last_fullsized":"2024-09-12T22:31:34.286394+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:20:23.663838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039540700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.0","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:31:35.390126+0000","last_change":"2024-09-12T22:31:35.390126+0000","last_active":"2024-09-12T22:31:35.383905+0000","last_peered":"2024-09-12T22:31:35.383905+0000","last_clean":"2024-09-12T22:31:35.383905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:35.390126+0000","last_undegraded":"2024-09-12T22:31:35.390126+0000","last_fullsized":"2024-09-12T22:31:35.390126+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":23,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T22:31:35.390269+0000","last_change":"2024-09-12T22:31:34.286938+0000","last_active":"2024-09-12T22:31:35.390269+0000","last_peered":"2024-09-12T22:31:35.390269+0000","last_clean":"2024-09-12T22:31:35.390269+0000","last_became_active":"2024-09-12T22:31:32.282230+0000","last_became_peered":"2024-09-12T22:31:32.282230+0000","last_unstale":"2024-09-12T22:31:35.390269+0000","last_undegraded":"2024-09-12T22:31:35.390269+0000","last_fullsized":"2024-09-12T22:31:35.390269+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:11:05.988384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000615758,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.3","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:31:35.388119+0000","last_change":"2024-09-12T22:31:35.388119+0000","last_active":"2024-09-12T22:31:35.383905+0000","last_peered":"2024-09-12T22:31:35.383905+0000","last_clean":"2024-09-12T22:31:35.383905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:35.388119+0000","last_undegraded":"2024-09-12T22:31:35.388119+0000","last_fullsized":"2024-09-12T22:31:35.388119+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:31:35.388378+0000","last_change":"2024-09-12T22:31:35.388378+0000","last_active":"2024-09-12T22:31:35.383905+0000","last_peered":"2024-09-12T22:31:35.383905+0000","last_clean":"2024-09-12T22:31:35.383905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:35.388378+0000","last_undegraded":"2024-09-12T22:31:35.388378+0000","last_fullsized":"2024-09-12T22:31:35.388378+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-12T22:31:34.286457+0000","last_change":"2024-09-12T22:31:34.286457+0000","last_active":"2024-09-12T22:31:34.286457+0000","last_peered":"2024-09-12T22:31:34.286457+0000","last_clean":"2024-09-12T22:31:34.286457+0000","last_became_active":"2024-09-12T22:31:32.280007+0000","last_became_peered":"2024-09-12T22:31:32.280007+0000","last_unstale":"2024-09-12T22:31:34.286457+0000","last_undegraded":"2024-09-12T22:31:34.286457+0000","last_fullsized":"2024-09-12T22:31:34.286457+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:09.068038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041972500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:35.383905+0000","last_change":"2024-09-12T22:31:35.383905+0000","last_active":"2024-09-12T22:31:35.383905+0000","last_peered":"2024-09-12T22:31:35.383905+0000","last_clean":"2024-09-12T22:31:35.383905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:35.383905+0000","last_undegraded":"2024-09-12T22:31:35.383905+0000","last_fullsized":"2024-09-12T22:31:35.383905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":21,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T22:31:35.391785+0000","last_change":"2024-09-12T22:31:34.839044+0000","last_active":"2024-09-12T22:31:35.391785+0000","last_peered":"2024-09-12T22:31:35.391785+0000","last_clean":"2024-09-12T22:31:35.391785+0000","last_became_active":"2024-09-12T22:31:32.279671+0000","last_became_peered":"2024-09-12T22:31:32.279671+0000","last_unstale":"2024-09-12T22:31:35.391785+0000","last_undegraded":"2024-09-12T22:31:35.391785+0000","last_fullsized":"2024-09-12T22:31:35.391785+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:27:49.809935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036776499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:35.383905+0000","last_change":"2024-09-12T22:31:35.383905+0000","last_active":"2024-09-12T22:31:35.383905+0000","last_peered":"2024-09-12T22:31:35.383905+0000","last_clean":"2024-09-12T22:31:35.383905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:35.383905+0000","last_undegraded":"2024-09-12T22:31:35.383905+0000","last_fullsized":"2024-09-12T22:31:35.383905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-12T22:31:34.286639+0000","last_change":"2024-09-12T22:31:34.286639+0000","last_active":"2024-09-12T22:31:34.286639+0000","last_peered":"2024-09-12T22:31:34.286639+0000","last_clean":"2024-09-12T22:31:34.286639+0000","last_became_active":"2024-09-12T22:31:32.280092+0000","last_became_peered":"2024-09-12T22:31:32.280092+0000","last_unstale":"2024-09-12T22:31:34.286639+0000","last_undegraded":"2024-09-12T22:31:34.286639+0000","last_fullsized":"2024-09-12T22:31:34.286639+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:02:40.821530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058589999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:35.383905+0000","last_change":"2024-09-12T22:31:35.383905+0000","last_active":"2024-09-12T22:31:35.383905+0000","last_peered":"2024-09-12T22:31:35.383905+0000","last_clean":"2024-09-12T22:31:35.383905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:35.383905+0000","last_undegraded":"2024-09-12T22:31:35.383905+0000","last_fullsized":"2024-09-12T22:31:35.383905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":21,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T22:31:35.390567+0000","last_change":"2024-09-12T22:31:34.286699+0000","last_active":"2024-09-12T22:31:35.390567+0000","last_peered":"2024-09-12T22:31:35.390567+0000","last_clean":"2024-09-12T22:31:35.390567+0000","last_became_active":"2024-09-12T22:31:32.283606+0000","last_became_peered":"2024-09-12T22:31:32.283606+0000","last_unstale":"2024-09-12T22:31:35.390567+0000","last_undegraded":"2024-09-12T22:31:35.390567+0000","last_fullsized":"2024-09-12T22:31:35.390567+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:09:32.050798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000382109,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:31:35.389280+0000","last_change":"2024-09-12T22:31:35.389280+0000","last_active":"2024-09-12T22:31:35.383905+0000","last_peered":"2024-09-12T22:31:35.383905+0000","last_clean":"2024-09-12T22:31:35.383905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:35.389280+0000","last_undegraded":"2024-09-12T22:31:35.389280+0000","last_fullsized":"2024-09-12T22:31:35.389280+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:31:35.389979+0000","last_change":"2024-09-12T22:31:35.389979+0000","last_active":"2024-09-12T22:31:35.383905+0000","last_peered":"2024-09-12T22:31:35.383905+0000","last_clean":"2024-09-12T22:31:35.383905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:35.389979+0000","last_undegraded":"2024-09-12T22:31:35.389979+0000","last_fullsized":"2024-09-12T22:31:35.389979+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:31:35.388390+0000","last_change":"2024-09-12T22:31:35.388390+0000","last_active":"2024-09-12T22:31:35.383905+0000","last_peered":"2024-09-12T22:31:35.383905+0000","last_clean":"2024-09-12T22:31:35.383905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:35.388390+0000","last_undegraded":"2024-09-12T22:31:35.388390+0000","last_fullsized":"2024-09-12T22:31:35.388390+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:35.383905+0000","last_change":"2024-09-12T22:31:35.383905+0000","last_active":"2024-09-12T22:31:35.383905+0000","last_peered":"2024-09-12T22:31:35.383905+0000","last_clean":"2024-09-12T22:31:35.383905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:35.383905+0000","last_undegraded":"2024-09-12T22:31:35.383905+0000","last_fullsized":"2024-09-12T22:31:35.383905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:35.383905+0000","last_change":"2024-09-12T22:31:35.383905+0000","last_active":"2024-09-12T22:31:35.383905+0000","last_peered":"2024-09-12T22:31:35.383905+0000","last_clean":"2024-09-12T22:31:35.383905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:35.383905+0000","last_undegraded":"2024-09-12T22:31:35.383905+0000","last_fullsized":"2024-09-12T22:31:35.383905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:35.383905+0000","last_change":"2024-09-12T22:31:35.383905+0000","last_active":"2024-09-12T22:31:35.383905+0000","last_peered":"2024-09-12T22:31:35.383905+0000","last_clean":"2024-09-12T22:31:35.383905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:35.383905+0000","last_undegraded":"2024-09-12T22:31:35.383905+0000","last_fullsized":"2024-09-12T22:31:35.383905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:31:35.390064+0000","last_change":"2024-09-12T22:31:35.390064+0000","last_active":"2024-09-12T22:31:35.383905+0000","last_peered":"2024-09-12T22:31:35.383905+0000","last_clean":"2024-09-12T22:31:35.383905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:35.390064+0000","last_undegraded":"2024-09-12T22:31:35.390064+0000","last_fullsized":"2024-09-12T22:31:35.390064+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:31:35.390089+0000","last_change":"2024-09-12T22:31:35.390089+0000","last_active":"2024-09-12T22:31:35.383905+0000","last_peered":"2024-09-12T22:31:35.383905+0000","last_clean":"2024-09-12T22:31:35.383905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:35.390089+0000","last_undegraded":"2024-09-12T22:31:35.390089+0000","last_fullsized":"2024-09-12T22:31:35.390089+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:31:35.389650+0000","last_change":"2024-09-12T22:31:35.389650+0000","last_active":"2024-09-12T22:31:35.383905+0000","last_peered":"2024-09-12T22:31:35.383905+0000","last_clean":"2024-09-12T22:31:35.383905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:35.389650+0000","last_undegraded":"2024-09-12T22:31:35.389650+0000","last_fullsized":"2024-09-12T22:31:35.389650+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:31:35.390700+0000","last_change":"2024-09-12T22:31:35.390700+0000","last_active":"2024-09-12T22:31:35.383905+0000","last_peered":"2024-09-12T22:31:35.383905+0000","last_clean":"2024-09-12T22:31:35.383905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:35.390700+0000","last_undegraded":"2024-09-12T22:31:35.390700+0000","last_fullsized":"2024-09-12T22:31:35.390700+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:35.383905+0000","last_change":"2024-09-12T22:31:35.383905+0000","last_active":"2024-09-12T22:31:35.383905+0000","last_peered":"2024-09-12T22:31:35.383905+0000","last_clean":"2024-09-12T22:31:35.383905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:35.383905+0000","last_undegraded":"2024-09-12T22:31:35.383905+0000","last_fullsized":"2024-09-12T22:31:35.383905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:35.383905+0000","last_change":"2024-09-12T22:31:35.383905+0000","last_active":"2024-09-12T22:31:35.383905+0000","last_peered":"2024-09-12T22:31:35.383905+0000","last_clean":"2024-09-12T22:31:35.383905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:35.383905+0000","last_undegraded":"2024-09-12T22:31:35.383905+0000","last_fullsized":"2024-09-12T22:31:35.383905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":40,"acting":40,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705669,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31916,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339924,"statfs":{"total":96636764160,"available":96604082176,"internally_reserved":0,"allocated":745472,"data_stored":637474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705669,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31912,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339928,"statfs":{"total":96636764160,"available":96604086272,"internally_reserved":0,"allocated":741376,"data_stored":637455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738373,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27172,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344668,"statfs":{"total":96636764160,"available":96608940032,"internally_reserved":0,"allocated":143360,"data_stored":42958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T22:31:40.401 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T22:31:40.732 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:31:40.733 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-12T22:31:40.743 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2024-09-12T22:31:40.690819+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590969,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":214,"num_write_kb":3463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":170,"ondisk_log_size":170,"up":118,"acting":118,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":84,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":91044,"kb_used_data":1632,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283024476,"statfs":{"total":289910292480,"available":289817063424,"internally_reserved":0,"allocated":1671168,"data_stored":1336914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":91483471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":601,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.502936"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:31:38.411429+0000","last_change":"2024-09-12T22:31:37.417800+0000","last_active":"2024-09-12T22:31:38.411429+0000","last_peered":"2024-09-12T22:31:38.411429+0000","last_clean":"2024-09-12T22:31:38.411429+0000","last_became_active":"2024-09-12T22:31:37.417355+0000","last_became_peered":"2024-09-12T22:31:37.417355+0000","last_unstale":"2024-09-12T22:31:38.411429+0000","last_undegraded":"2024-09-12T22:31:38.411429+0000","last_fullsized":"2024-09-12T22:31:38.411429+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:10:17.326263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:31:38.412170+0000","last_change":"2024-09-12T22:31:37.412450+0000","last_active":"2024-09-12T22:31:38.412170+0000","last_peered":"2024-09-12T22:31:38.412170+0000","last_clean":"2024-09-12T22:31:38.412170+0000","last_became_active":"2024-09-12T22:31:37.412234+0000","last_became_peered":"2024-09-12T22:31:37.412234+0000","last_unstale":"2024-09-12T22:31:38.412170+0000","last_undegraded":"2024-09-12T22:31:38.412170+0000","last_fullsized":"2024-09-12T22:31:38.412170+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:15:59.559809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:31:38.411386+0000","last_change":"2024-09-12T22:31:37.417442+0000","last_active":"2024-09-12T22:31:38.411386+0000","last_peered":"2024-09-12T22:31:38.411386+0000","last_clean":"2024-09-12T22:31:38.411386+0000","last_became_active":"2024-09-12T22:31:37.417133+0000","last_became_peered":"2024-09-12T22:31:37.417133+0000","last_unstale":"2024-09-12T22:31:38.411386+0000","last_undegraded":"2024-09-12T22:31:38.411386+0000","last_fullsized":"2024-09-12T22:31:38.411386+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:36.458145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:31:38.410612+0000","last_change":"2024-09-12T22:31:37.410364+0000","last_active":"2024-09-12T22:31:38.410612+0000","last_peered":"2024-09-12T22:31:38.410612+0000","last_clean":"2024-09-12T22:31:38.410612+0000","last_became_active":"2024-09-12T22:31:37.409951+0000","last_became_peered":"2024-09-12T22:31:37.409951+0000","last_unstale":"2024-09-12T22:31:38.410612+0000","last_undegraded":"2024-09-12T22:31:38.410612+0000","last_fullsized":"2024-09-12T22:31:38.410612+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:39:17.785755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:31:38.411641+0000","last_change":"2024-09-12T22:31:37.411880+0000","last_active":"2024-09-12T22:31:38.411641+0000","last_peered":"2024-09-12T22:31:38.411641+0000","last_clean":"2024-09-12T22:31:38.411641+0000","last_became_active":"2024-09-12T22:31:37.410563+0000","last_became_peered":"2024-09-12T22:31:37.410563+0000","last_unstale":"2024-09-12T22:31:38.411641+0000","last_undegraded":"2024-09-12T22:31:38.411641+0000","last_fullsized":"2024-09-12T22:31:38.411641+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:47:52.560533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:31:38.411502+0000","last_change":"2024-09-12T22:31:37.414918+0000","last_active":"2024-09-12T22:31:38.411502+0000","last_peered":"2024-09-12T22:31:38.411502+0000","last_clean":"2024-09-12T22:31:38.411502+0000","last_became_active":"2024-09-12T22:31:37.414225+0000","last_became_peered":"2024-09-12T22:31:37.414225+0000","last_unstale":"2024-09-12T22:31:38.411502+0000","last_undegraded":"2024-09-12T22:31:38.411502+0000","last_fullsized":"2024-09-12T22:31:38.411502+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:56:14.649228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:31:38.410692+0000","last_change":"2024-09-12T22:31:37.415589+0000","last_active":"2024-09-12T22:31:38.410692+0000","last_peered":"2024-09-12T22:31:38.410692+0000","last_clean":"2024-09-12T22:31:38.410692+0000","last_became_active":"2024-09-12T22:31:37.415285+0000","last_became_peered":"2024-09-12T22:31:37.415285+0000","last_unstale":"2024-09-12T22:31:38.410692+0000","last_undegraded":"2024-09-12T22:31:38.410692+0000","last_fullsized":"2024-09-12T22:31:38.410692+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:06:25.913810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:31:35.389314+0000","last_change":"2024-09-12T22:31:35.389314+0000","last_active":"2024-09-12T22:31:35.383905+0000","last_peered":"2024-09-12T22:31:35.383905+0000","last_clean":"2024-09-12T22:31:35.383905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:35.389314+0000","last_undegraded":"2024-09-12T22:31:35.389314+0000","last_fullsized":"2024-09-12T22:31:35.389314+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:31:38.411173+0000","last_change":"2024-09-12T22:31:36.408563+0000","last_active":"2024-09-12T22:31:38.411173+0000","last_peered":"2024-09-12T22:31:38.411173+0000","last_clean":"2024-09-12T22:31:38.411173+0000","last_became_active":"2024-09-12T22:31:36.407447+0000","last_became_peered":"2024-09-12T22:31:36.407447+0000","last_unstale":"2024-09-12T22:31:38.411173+0000","last_undegraded":"2024-09-12T22:31:38.411173+0000","last_fullsized":"2024-09-12T22:31:38.411173+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:29:37.933109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:31:38.412069+0000","last_change":"2024-09-12T22:31:37.411680+0000","last_active":"2024-09-12T22:31:38.412069+0000","last_peered":"2024-09-12T22:31:38.412069+0000","last_clean":"2024-09-12T22:31:38.412069+0000","last_became_active":"2024-09-12T22:31:37.411168+0000","last_became_peered":"2024-09-12T22:31:37.411168+0000","last_unstale":"2024-09-12T22:31:38.412069+0000","last_undegraded":"2024-09-12T22:31:38.412069+0000","last_fullsized":"2024-09-12T22:31:38.412069+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:27.706282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:31:35.390845+0000","last_change":"2024-09-12T22:31:35.390845+0000","last_active":"2024-09-12T22:31:35.383905+0000","last_peered":"2024-09-12T22:31:35.383905+0000","last_clean":"2024-09-12T22:31:35.383905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:35.390845+0000","last_undegraded":"2024-09-12T22:31:35.390845+0000","last_fullsized":"2024-09-12T22:31:35.390845+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:31:38.411530+0000","last_change":"2024-09-12T22:31:37.411218+0000","last_active":"2024-09-12T22:31:38.411530+0000","last_peered":"2024-09-12T22:31:38.411530+0000","last_clean":"2024-09-12T22:31:38.411530+0000","last_became_active":"2024-09-12T22:31:37.409666+0000","last_became_peered":"2024-09-12T22:31:37.409666+0000","last_unstale":"2024-09-12T22:31:38.411530+0000","last_undegraded":"2024-09-12T22:31:38.411530+0000","last_fullsized":"2024-09-12T22:31:38.411530+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:45:34.230090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:31:35.388050+0000","last_change":"2024-09-12T22:31:35.388050+0000","last_active":"2024-09-12T22:31:35.383905+0000","last_peered":"2024-09-12T22:31:35.383905+0000","last_clean":"2024-09-12T22:31:35.383905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:35.388050+0000","last_undegraded":"2024-09-12T22:31:35.388050+0000","last_fullsized":"2024-09-12T22:31:35.388050+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:31:35.388658+0000","last_change":"2024-09-12T22:31:35.388658+0000","last_active":"2024-09-12T22:31:35.383905+0000","last_peered":"2024-09-12T22:31:35.383905+0000","last_clean":"2024-09-12T22:31:35.383905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:35.388658+0000","last_undegraded":"2024-09-12T22:31:35.388658+0000","last_fullsized":"2024-09-12T22:31:35.388658+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:31:35.390140+0000","last_change":"2024-09-12T22:31:35.390140+0000","last_active":"2024-09-12T22:31:35.383905+0000","last_peered":"2024-09-12T22:31:35.383905+0000","last_clean":"2024-09-12T22:31:35.383905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:35.390140+0000","last_undegraded":"2024-09-12T22:31:35.390140+0000","last_fullsized":"2024-09-12T22:31:35.390140+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:31:35.389214+0000","last_change":"2024-09-12T22:31:35.389214+0000","last_active":"2024-09-12T22:31:35.383905+0000","last_peered":"2024-09-12T22:31:35.383905+0000","last_clean":"2024-09-12T22:31:35.383905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:35.389214+0000","last_undegraded":"2024-09-12T22:31:35.389214+0000","last_fullsized":"2024-09-12T22:31:35.389214+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:31:35.388216+0000","last_change":"2024-09-12T22:31:35.388216+0000","last_active":"2024-09-12T22:31:35.383905+0000","last_peered":"2024-09-12T22:31:35.383905+0000","last_clean":"2024-09-12T22:31:35.383905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:35.388216+0000","last_undegraded":"2024-09-12T22:31:35.388216+0000","last_fullsized":"2024-09-12T22:31:35.388216+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:31:38.411709+0000","last_change":"2024-09-12T22:31:37.410303+0000","last_active":"2024-09-12T22:31:38.411709+0000","last_peered":"2024-09-12T22:31:38.411709+0000","last_clean":"2024-09-12T22:31:38.411709+0000","last_became_active":"2024-09-12T22:31:37.409607+0000","last_became_peered":"2024-09-12T22:31:37.409607+0000","last_unstale":"2024-09-12T22:31:38.411709+0000","last_undegraded":"2024-09-12T22:31:38.411709+0000","last_fullsized":"2024-09-12T22:31:38.411709+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:53:42.732654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:31:38.411860+0000","last_change":"2024-09-12T22:31:36.407974+0000","last_active":"2024-09-12T22:31:38.411860+0000","last_peered":"2024-09-12T22:31:38.411860+0000","last_clean":"2024-09-12T22:31:38.411860+0000","last_became_active":"2024-09-12T22:31:36.406955+0000","last_became_peered":"2024-09-12T22:31:36.406955+0000","last_unstale":"2024-09-12T22:31:38.411860+0000","last_undegraded":"2024-09-12T22:31:38.411860+0000","last_fullsized":"2024-09-12T22:31:38.411860+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:07:34.831264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:31:35.388079+0000","last_change":"2024-09-12T22:31:35.388079+0000","last_active":"2024-09-12T22:31:35.383905+0000","last_peered":"2024-09-12T22:31:35.383905+0000","last_clean":"2024-09-12T22:31:35.383905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:35.388079+0000","last_undegraded":"2024-09-12T22:31:35.388079+0000","last_fullsized":"2024-09-12T22:31:35.388079+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:31:35.390037+0000","last_change":"2024-09-12T22:31:35.390037+0000","last_active":"2024-09-12T22:31:35.383905+0000","last_peered":"2024-09-12T22:31:35.383905+0000","last_clean":"2024-09-12T22:31:35.383905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:35.390037+0000","last_undegraded":"2024-09-12T22:31:35.390037+0000","last_fullsized":"2024-09-12T22:31:35.390037+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:31:35.390875+0000","last_change":"2024-09-12T22:31:35.390875+0000","last_active":"2024-09-12T22:31:35.383905+0000","last_peered":"2024-09-12T22:31:35.383905+0000","last_clean":"2024-09-12T22:31:35.383905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:35.390875+0000","last_undegraded":"2024-09-12T22:31:35.390875+0000","last_fullsized":"2024-09-12T22:31:35.390875+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:31:38.411825+0000","last_change":"2024-09-12T22:31:37.417881+0000","last_active":"2024-09-12T22:31:38.411825+0000","last_peered":"2024-09-12T22:31:38.411825+0000","last_clean":"2024-09-12T22:31:38.411825+0000","last_became_active":"2024-09-12T22:31:37.417572+0000","last_became_peered":"2024-09-12T22:31:37.417572+0000","last_unstale":"2024-09-12T22:31:38.411825+0000","last_undegraded":"2024-09-12T22:31:38.411825+0000","last_fullsized":"2024-09-12T22:31:38.411825+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:19:16.367589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":218,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T22:31:35.390163+0000","last_change":"2024-09-12T22:31:27.631847+0000","last_active":"2024-09-12T22:31:35.390163+0000","last_peered":"2024-09-12T22:31:35.390163+0000","last_clean":"2024-09-12T22:31:35.390163+0000","last_became_active":"2024-09-12T22:31:27.631027+0000","last_became_peered":"2024-09-12T22:31:27.631027+0000","last_unstale":"2024-09-12T22:31:35.390163+0000","last_undegraded":"2024-09-12T22:31:35.390163+0000","last_fullsized":"2024-09-12T22:31:35.390163+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:26.229539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:26.229539+0000","last_clean_scrub_stamp":"2024-09-12T22:31:26.229539+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:59:24.181319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":22,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T22:31:35.390331+0000","last_change":"2024-09-12T22:31:34.286952+0000","last_active":"2024-09-12T22:31:35.390331+0000","last_peered":"2024-09-12T22:31:35.390331+0000","last_clean":"2024-09-12T22:31:35.390331+0000","last_became_active":"2024-09-12T22:31:32.283661+0000","last_became_peered":"2024-09-12T22:31:32.283661+0000","last_unstale":"2024-09-12T22:31:35.390331+0000","last_undegraded":"2024-09-12T22:31:35.390331+0000","last_fullsized":"2024-09-12T22:31:35.390331+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:21.681390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000621274,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:31:38.411238+0000","last_change":"2024-09-12T22:31:36.411275+0000","last_active":"2024-09-12T22:31:38.411238+0000","last_peered":"2024-09-12T22:31:38.411238+0000","last_clean":"2024-09-12T22:31:38.411238+0000","last_became_active":"2024-09-12T22:31:36.410595+0000","last_became_peered":"2024-09-12T22:31:36.410595+0000","last_unstale":"2024-09-12T22:31:38.411238+0000","last_undegraded":"2024-09-12T22:31:38.411238+0000","last_fullsized":"2024-09-12T22:31:38.411238+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:38:14.895625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":21,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T22:31:35.390344+0000","last_change":"2024-09-12T22:31:34.286642+0000","last_active":"2024-09-12T22:31:35.390344+0000","last_peered":"2024-09-12T22:31:35.390344+0000","last_clean":"2024-09-12T22:31:35.390344+0000","last_became_active":"2024-09-12T22:31:32.283601+0000","last_became_peered":"2024-09-12T22:31:32.283601+0000","last_unstale":"2024-09-12T22:31:35.390344+0000","last_undegraded":"2024-09-12T22:31:35.390344+0000","last_fullsized":"2024-09-12T22:31:35.390344+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:40:06.769540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037858999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:31:38.411132+0000","last_change":"2024-09-12T22:31:36.407395+0000","last_active":"2024-09-12T22:31:38.411132+0000","last_peered":"2024-09-12T22:31:38.411132+0000","last_clean":"2024-09-12T22:31:38.411132+0000","last_became_active":"2024-09-12T22:31:36.406770+0000","last_became_peered":"2024-09-12T22:31:36.406770+0000","last_unstale":"2024-09-12T22:31:38.411132+0000","last_undegraded":"2024-09-12T22:31:38.411132+0000","last_fullsized":"2024-09-12T22:31:38.411132+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:49:26.547848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":27,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:31:38.411228+0000","last_change":"2024-09-12T22:31:34.286394+0000","last_active":"2024-09-12T22:31:38.411228+0000","last_peered":"2024-09-12T22:31:38.411228+0000","last_clean":"2024-09-12T22:31:38.411228+0000","last_became_active":"2024-09-12T22:31:32.280062+0000","last_became_peered":"2024-09-12T22:31:32.280062+0000","last_unstale":"2024-09-12T22:31:38.411228+0000","last_undegraded":"2024-09-12T22:31:38.411228+0000","last_fullsized":"2024-09-12T22:31:38.411228+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:20:23.663838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039540700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.0","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:31:35.390126+0000","last_change":"2024-09-12T22:31:35.390126+0000","last_active":"2024-09-12T22:31:35.383905+0000","last_peered":"2024-09-12T22:31:35.383905+0000","last_clean":"2024-09-12T22:31:35.383905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:35.390126+0000","last_undegraded":"2024-09-12T22:31:35.390126+0000","last_fullsized":"2024-09-12T22:31:35.390126+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:31:38.411836+0000","last_change":"2024-09-12T22:31:37.417636+0000","last_active":"2024-09-12T22:31:38.411836+0000","last_peered":"2024-09-12T22:31:38.411836+0000","last_clean":"2024-09-12T22:31:38.411836+0000","last_became_active":"2024-09-12T22:31:37.417230+0000","last_became_peered":"2024-09-12T22:31:37.417230+0000","last_unstale":"2024-09-12T22:31:38.411836+0000","last_undegraded":"2024-09-12T22:31:38.411836+0000","last_fullsized":"2024-09-12T22:31:38.411836+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:44:29.729122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":23,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T22:31:35.390269+0000","last_change":"2024-09-12T22:31:34.286938+0000","last_active":"2024-09-12T22:31:35.390269+0000","last_peered":"2024-09-12T22:31:35.390269+0000","last_clean":"2024-09-12T22:31:35.390269+0000","last_became_active":"2024-09-12T22:31:32.282230+0000","last_became_peered":"2024-09-12T22:31:32.282230+0000","last_unstale":"2024-09-12T22:31:35.390269+0000","last_undegraded":"2024-09-12T22:31:35.390269+0000","last_fullsized":"2024-09-12T22:31:35.390269+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:11:05.988384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000615758,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.3","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:31:35.388119+0000","last_change":"2024-09-12T22:31:35.388119+0000","last_active":"2024-09-12T22:31:35.383905+0000","last_peered":"2024-09-12T22:31:35.383905+0000","last_clean":"2024-09-12T22:31:35.383905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:35.388119+0000","last_undegraded":"2024-09-12T22:31:35.388119+0000","last_fullsized":"2024-09-12T22:31:35.388119+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:31:38.411777+0000","last_change":"2024-09-12T22:31:37.414608+0000","last_active":"2024-09-12T22:31:38.411777+0000","last_peered":"2024-09-12T22:31:38.411777+0000","last_clean":"2024-09-12T22:31:38.411777+0000","last_became_active":"2024-09-12T22:31:37.414307+0000","last_became_peered":"2024-09-12T22:31:37.414307+0000","last_unstale":"2024-09-12T22:31:38.411777+0000","last_undegraded":"2024-09-12T22:31:38.411777+0000","last_fullsized":"2024-09-12T22:31:38.411777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:41:21.231511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:31:35.388378+0000","last_change":"2024-09-12T22:31:35.388378+0000","last_active":"2024-09-12T22:31:35.383905+0000","last_peered":"2024-09-12T22:31:35.383905+0000","last_clean":"2024-09-12T22:31:35.383905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:35.388378+0000","last_undegraded":"2024-09-12T22:31:35.388378+0000","last_fullsized":"2024-09-12T22:31:35.388378+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:31:38.411833+0000","last_change":"2024-09-12T22:31:34.286457+0000","last_active":"2024-09-12T22:31:38.411833+0000","last_peered":"2024-09-12T22:31:38.411833+0000","last_clean":"2024-09-12T22:31:38.411833+0000","last_became_active":"2024-09-12T22:31:32.280007+0000","last_became_peered":"2024-09-12T22:31:32.280007+0000","last_unstale":"2024-09-12T22:31:38.411833+0000","last_undegraded":"2024-09-12T22:31:38.411833+0000","last_fullsized":"2024-09-12T22:31:38.411833+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:09.068038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041972500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:31:38.411740+0000","last_change":"2024-09-12T22:31:36.410324+0000","last_active":"2024-09-12T22:31:38.411740+0000","last_peered":"2024-09-12T22:31:38.411740+0000","last_clean":"2024-09-12T22:31:38.411740+0000","last_became_active":"2024-09-12T22:31:36.409199+0000","last_became_peered":"2024-09-12T22:31:36.409199+0000","last_unstale":"2024-09-12T22:31:38.411740+0000","last_undegraded":"2024-09-12T22:31:38.411740+0000","last_fullsized":"2024-09-12T22:31:38.411740+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:06:54.608936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":21,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T22:31:35.391785+0000","last_change":"2024-09-12T22:31:34.839044+0000","last_active":"2024-09-12T22:31:35.391785+0000","last_peered":"2024-09-12T22:31:35.391785+0000","last_clean":"2024-09-12T22:31:35.391785+0000","last_became_active":"2024-09-12T22:31:32.279671+0000","last_became_peered":"2024-09-12T22:31:32.279671+0000","last_unstale":"2024-09-12T22:31:35.391785+0000","last_undegraded":"2024-09-12T22:31:35.391785+0000","last_fullsized":"2024-09-12T22:31:35.391785+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:27:49.809935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036776499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:31:38.412193+0000","last_change":"2024-09-12T22:31:36.409397+0000","last_active":"2024-09-12T22:31:38.412193+0000","last_peered":"2024-09-12T22:31:38.412193+0000","last_clean":"2024-09-12T22:31:38.412193+0000","last_became_active":"2024-09-12T22:31:36.408787+0000","last_became_peered":"2024-09-12T22:31:36.408787+0000","last_unstale":"2024-09-12T22:31:38.412193+0000","last_undegraded":"2024-09-12T22:31:38.412193+0000","last_fullsized":"2024-09-12T22:31:38.412193+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:29:03.467352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":27,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:31:38.412099+0000","last_change":"2024-09-12T22:31:34.286639+0000","last_active":"2024-09-12T22:31:38.412099+0000","last_peered":"2024-09-12T22:31:38.412099+0000","last_clean":"2024-09-12T22:31:38.412099+0000","last_became_active":"2024-09-12T22:31:32.280092+0000","last_became_peered":"2024-09-12T22:31:32.280092+0000","last_unstale":"2024-09-12T22:31:38.412099+0000","last_undegraded":"2024-09-12T22:31:38.412099+0000","last_fullsized":"2024-09-12T22:31:38.412099+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:02:40.821530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058589999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:31:38.410913+0000","last_change":"2024-09-12T22:31:37.411152+0000","last_active":"2024-09-12T22:31:38.410913+0000","last_peered":"2024-09-12T22:31:38.410913+0000","last_clean":"2024-09-12T22:31:38.410913+0000","last_became_active":"2024-09-12T22:31:37.410558+0000","last_became_peered":"2024-09-12T22:31:37.410558+0000","last_unstale":"2024-09-12T22:31:38.410913+0000","last_undegraded":"2024-09-12T22:31:38.410913+0000","last_fullsized":"2024-09-12T22:31:38.410913+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:14:29.892478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:31:39.400416+0000","last_change":"2024-09-12T22:31:36.407460+0000","last_active":"2024-09-12T22:31:39.400416+0000","last_peered":"2024-09-12T22:31:39.400416+0000","last_clean":"2024-09-12T22:31:39.400416+0000","last_became_active":"2024-09-12T22:31:36.406729+0000","last_became_peered":"2024-09-12T22:31:36.406729+0000","last_unstale":"2024-09-12T22:31:39.400416+0000","last_undegraded":"2024-09-12T22:31:39.400416+0000","last_fullsized":"2024-09-12T22:31:39.400416+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:27:58.012573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":21,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T22:31:35.390567+0000","last_change":"2024-09-12T22:31:34.286699+0000","last_active":"2024-09-12T22:31:35.390567+0000","last_peered":"2024-09-12T22:31:35.390567+0000","last_clean":"2024-09-12T22:31:35.390567+0000","last_became_active":"2024-09-12T22:31:32.283606+0000","last_became_peered":"2024-09-12T22:31:32.283606+0000","last_unstale":"2024-09-12T22:31:35.390567+0000","last_undegraded":"2024-09-12T22:31:35.390567+0000","last_fullsized":"2024-09-12T22:31:35.390567+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:09:32.050798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000382109,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:31:35.389280+0000","last_change":"2024-09-12T22:31:35.389280+0000","last_active":"2024-09-12T22:31:35.383905+0000","last_peered":"2024-09-12T22:31:35.383905+0000","last_clean":"2024-09-12T22:31:35.383905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:35.389280+0000","last_undegraded":"2024-09-12T22:31:35.389280+0000","last_fullsized":"2024-09-12T22:31:35.389280+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:31:38.410899+0000","last_change":"2024-09-12T22:31:37.414914+0000","last_active":"2024-09-12T22:31:38.410899+0000","last_peered":"2024-09-12T22:31:38.410899+0000","last_clean":"2024-09-12T22:31:38.410899+0000","last_became_active":"2024-09-12T22:31:37.414535+0000","last_became_peered":"2024-09-12T22:31:37.414535+0000","last_unstale":"2024-09-12T22:31:38.410899+0000","last_undegraded":"2024-09-12T22:31:38.410899+0000","last_fullsized":"2024-09-12T22:31:38.410899+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:14:37.010786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:31:35.389979+0000","last_change":"2024-09-12T22:31:35.389979+0000","last_active":"2024-09-12T22:31:35.383905+0000","last_peered":"2024-09-12T22:31:35.383905+0000","last_clean":"2024-09-12T22:31:35.383905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:35.389979+0000","last_undegraded":"2024-09-12T22:31:35.389979+0000","last_fullsized":"2024-09-12T22:31:35.389979+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:31:35.388390+0000","last_change":"2024-09-12T22:31:35.388390+0000","last_active":"2024-09-12T22:31:35.383905+0000","last_peered":"2024-09-12T22:31:35.383905+0000","last_clean":"2024-09-12T22:31:35.383905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:35.388390+0000","last_undegraded":"2024-09-12T22:31:35.388390+0000","last_fullsized":"2024-09-12T22:31:35.388390+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:31:38.410787+0000","last_change":"2024-09-12T22:31:37.411254+0000","last_active":"2024-09-12T22:31:38.410787+0000","last_peered":"2024-09-12T22:31:38.410787+0000","last_clean":"2024-09-12T22:31:38.410787+0000","last_became_active":"2024-09-12T22:31:37.410404+0000","last_became_peered":"2024-09-12T22:31:37.410404+0000","last_unstale":"2024-09-12T22:31:38.410787+0000","last_undegraded":"2024-09-12T22:31:38.410787+0000","last_fullsized":"2024-09-12T22:31:38.410787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:42:00.856616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:31:38.412111+0000","last_change":"2024-09-12T22:31:36.408390+0000","last_active":"2024-09-12T22:31:38.412111+0000","last_peered":"2024-09-12T22:31:38.412111+0000","last_clean":"2024-09-12T22:31:38.412111+0000","last_became_active":"2024-09-12T22:31:36.407062+0000","last_became_peered":"2024-09-12T22:31:36.407062+0000","last_unstale":"2024-09-12T22:31:38.412111+0000","last_undegraded":"2024-09-12T22:31:38.412111+0000","last_fullsized":"2024-09-12T22:31:38.412111+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:09:10.618195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:31:38.410987+0000","last_change":"2024-09-12T22:31:37.416629+0000","last_active":"2024-09-12T22:31:38.410987+0000","last_peered":"2024-09-12T22:31:38.410987+0000","last_clean":"2024-09-12T22:31:38.410987+0000","last_became_active":"2024-09-12T22:31:37.416387+0000","last_became_peered":"2024-09-12T22:31:37.416387+0000","last_unstale":"2024-09-12T22:31:38.410987+0000","last_undegraded":"2024-09-12T22:31:38.410987+0000","last_fullsized":"2024-09-12T22:31:38.410987+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:59:52.020560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:31:38.411051+0000","last_change":"2024-09-12T22:31:36.409466+0000","last_active":"2024-09-12T22:31:38.411051+0000","last_peered":"2024-09-12T22:31:38.411051+0000","last_clean":"2024-09-12T22:31:38.411051+0000","last_became_active":"2024-09-12T22:31:36.408796+0000","last_became_peered":"2024-09-12T22:31:36.408796+0000","last_unstale":"2024-09-12T22:31:38.411051+0000","last_undegraded":"2024-09-12T22:31:38.411051+0000","last_fullsized":"2024-09-12T22:31:38.411051+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:03:39.648159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:31:38.411767+0000","last_change":"2024-09-12T22:31:37.411183+0000","last_active":"2024-09-12T22:31:38.411767+0000","last_peered":"2024-09-12T22:31:38.411767+0000","last_clean":"2024-09-12T22:31:38.411767+0000","last_became_active":"2024-09-12T22:31:37.409796+0000","last_became_peered":"2024-09-12T22:31:37.409796+0000","last_unstale":"2024-09-12T22:31:38.411767+0000","last_undegraded":"2024-09-12T22:31:38.411767+0000","last_fullsized":"2024-09-12T22:31:38.411767+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:20:35.779810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:31:38.410929+0000","last_change":"2024-09-12T22:31:36.407402+0000","last_active":"2024-09-12T22:31:38.410929+0000","last_peered":"2024-09-12T22:31:38.410929+0000","last_clean":"2024-09-12T22:31:38.410929+0000","last_became_active":"2024-09-12T22:31:36.406681+0000","last_became_peered":"2024-09-12T22:31:36.406681+0000","last_unstale":"2024-09-12T22:31:38.410929+0000","last_undegraded":"2024-09-12T22:31:38.410929+0000","last_fullsized":"2024-09-12T22:31:38.410929+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:39:39.362573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:31:35.390064+0000","last_change":"2024-09-12T22:31:35.390064+0000","last_active":"2024-09-12T22:31:35.383905+0000","last_peered":"2024-09-12T22:31:35.383905+0000","last_clean":"2024-09-12T22:31:35.383905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:35.390064+0000","last_undegraded":"2024-09-12T22:31:35.390064+0000","last_fullsized":"2024-09-12T22:31:35.390064+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:31:35.390089+0000","last_change":"2024-09-12T22:31:35.390089+0000","last_active":"2024-09-12T22:31:35.383905+0000","last_peered":"2024-09-12T22:31:35.383905+0000","last_clean":"2024-09-12T22:31:35.383905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:35.390089+0000","last_undegraded":"2024-09-12T22:31:35.390089+0000","last_fullsized":"2024-09-12T22:31:35.390089+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:31:35.389650+0000","last_change":"2024-09-12T22:31:35.389650+0000","last_active":"2024-09-12T22:31:35.383905+0000","last_peered":"2024-09-12T22:31:35.383905+0000","last_clean":"2024-09-12T22:31:35.383905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:35.389650+0000","last_undegraded":"2024-09-12T22:31:35.389650+0000","last_fullsized":"2024-09-12T22:31:35.389650+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:31:35.390700+0000","last_change":"2024-09-12T22:31:35.390700+0000","last_active":"2024-09-12T22:31:35.383905+0000","last_peered":"2024-09-12T22:31:35.383905+0000","last_clean":"2024-09-12T22:31:35.383905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:35.390700+0000","last_undegraded":"2024-09-12T22:31:35.390700+0000","last_fullsized":"2024-09-12T22:31:35.390700+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:31:38.411880+0000","last_change":"2024-09-12T22:31:36.410371+0000","last_active":"2024-09-12T22:31:38.411880+0000","last_peered":"2024-09-12T22:31:38.411880+0000","last_clean":"2024-09-12T22:31:38.411880+0000","last_became_active":"2024-09-12T22:31:36.409428+0000","last_became_peered":"2024-09-12T22:31:36.409428+0000","last_unstale":"2024-09-12T22:31:38.411880+0000","last_undegraded":"2024-09-12T22:31:38.411880+0000","last_fullsized":"2024-09-12T22:31:38.411880+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:27:22.817690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:31:38.412051+0000","last_change":"2024-09-12T22:31:36.407945+0000","last_active":"2024-09-12T22:31:38.412051+0000","last_peered":"2024-09-12T22:31:38.412051+0000","last_clean":"2024-09-12T22:31:38.412051+0000","last_became_active":"2024-09-12T22:31:36.406959+0000","last_became_peered":"2024-09-12T22:31:36.406959+0000","last_unstale":"2024-09-12T22:31:38.412051+0000","last_undegraded":"2024-09-12T22:31:38.412051+0000","last_fullsized":"2024-09-12T22:31:38.412051+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:26:33.155850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":36,"acting":36,"num_store_stats":1},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":582,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10,"ondisk_log_size":10,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705669,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31916,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339924,"statfs":{"total":96636764160,"available":96604082176,"internally_reserved":0,"allocated":745472,"data_stored":637474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705669,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31912,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339928,"statfs":{"total":96636764160,"available":96604086272,"internally_reserved":0,"allocated":741376,"data_stored":637455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738374,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":184320,"data_stored":61985,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T22:31:40.748 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T22:31:41.079 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:31:41.080 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-12T22:31:41.089 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2024-09-12T22:31:40.690819+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590969,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":214,"num_write_kb":3463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":170,"ondisk_log_size":170,"up":118,"acting":118,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":84,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":91044,"kb_used_data":1632,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283024476,"statfs":{"total":289910292480,"available":289817063424,"internally_reserved":0,"allocated":1671168,"data_stored":1336914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":91483471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":601,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.502936"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:31:38.411429+0000","last_change":"2024-09-12T22:31:37.417800+0000","last_active":"2024-09-12T22:31:38.411429+0000","last_peered":"2024-09-12T22:31:38.411429+0000","last_clean":"2024-09-12T22:31:38.411429+0000","last_became_active":"2024-09-12T22:31:37.417355+0000","last_became_peered":"2024-09-12T22:31:37.417355+0000","last_unstale":"2024-09-12T22:31:38.411429+0000","last_undegraded":"2024-09-12T22:31:38.411429+0000","last_fullsized":"2024-09-12T22:31:38.411429+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:10:17.326263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:31:38.412170+0000","last_change":"2024-09-12T22:31:37.412450+0000","last_active":"2024-09-12T22:31:38.412170+0000","last_peered":"2024-09-12T22:31:38.412170+0000","last_clean":"2024-09-12T22:31:38.412170+0000","last_became_active":"2024-09-12T22:31:37.412234+0000","last_became_peered":"2024-09-12T22:31:37.412234+0000","last_unstale":"2024-09-12T22:31:38.412170+0000","last_undegraded":"2024-09-12T22:31:38.412170+0000","last_fullsized":"2024-09-12T22:31:38.412170+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:15:59.559809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:31:38.411386+0000","last_change":"2024-09-12T22:31:37.417442+0000","last_active":"2024-09-12T22:31:38.411386+0000","last_peered":"2024-09-12T22:31:38.411386+0000","last_clean":"2024-09-12T22:31:38.411386+0000","last_became_active":"2024-09-12T22:31:37.417133+0000","last_became_peered":"2024-09-12T22:31:37.417133+0000","last_unstale":"2024-09-12T22:31:38.411386+0000","last_undegraded":"2024-09-12T22:31:38.411386+0000","last_fullsized":"2024-09-12T22:31:38.411386+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:36.458145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:31:38.410612+0000","last_change":"2024-09-12T22:31:37.410364+0000","last_active":"2024-09-12T22:31:38.410612+0000","last_peered":"2024-09-12T22:31:38.410612+0000","last_clean":"2024-09-12T22:31:38.410612+0000","last_became_active":"2024-09-12T22:31:37.409951+0000","last_became_peered":"2024-09-12T22:31:37.409951+0000","last_unstale":"2024-09-12T22:31:38.410612+0000","last_undegraded":"2024-09-12T22:31:38.410612+0000","last_fullsized":"2024-09-12T22:31:38.410612+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:39:17.785755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:31:38.411641+0000","last_change":"2024-09-12T22:31:37.411880+0000","last_active":"2024-09-12T22:31:38.411641+0000","last_peered":"2024-09-12T22:31:38.411641+0000","last_clean":"2024-09-12T22:31:38.411641+0000","last_became_active":"2024-09-12T22:31:37.410563+0000","last_became_peered":"2024-09-12T22:31:37.410563+0000","last_unstale":"2024-09-12T22:31:38.411641+0000","last_undegraded":"2024-09-12T22:31:38.411641+0000","last_fullsized":"2024-09-12T22:31:38.411641+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:47:52.560533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:31:38.411502+0000","last_change":"2024-09-12T22:31:37.414918+0000","last_active":"2024-09-12T22:31:38.411502+0000","last_peered":"2024-09-12T22:31:38.411502+0000","last_clean":"2024-09-12T22:31:38.411502+0000","last_became_active":"2024-09-12T22:31:37.414225+0000","last_became_peered":"2024-09-12T22:31:37.414225+0000","last_unstale":"2024-09-12T22:31:38.411502+0000","last_undegraded":"2024-09-12T22:31:38.411502+0000","last_fullsized":"2024-09-12T22:31:38.411502+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:56:14.649228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:31:38.410692+0000","last_change":"2024-09-12T22:31:37.415589+0000","last_active":"2024-09-12T22:31:38.410692+0000","last_peered":"2024-09-12T22:31:38.410692+0000","last_clean":"2024-09-12T22:31:38.410692+0000","last_became_active":"2024-09-12T22:31:37.415285+0000","last_became_peered":"2024-09-12T22:31:37.415285+0000","last_unstale":"2024-09-12T22:31:38.410692+0000","last_undegraded":"2024-09-12T22:31:38.410692+0000","last_fullsized":"2024-09-12T22:31:38.410692+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:06:25.913810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:31:35.389314+0000","last_change":"2024-09-12T22:31:35.389314+0000","last_active":"2024-09-12T22:31:35.383905+0000","last_peered":"2024-09-12T22:31:35.383905+0000","last_clean":"2024-09-12T22:31:35.383905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:35.389314+0000","last_undegraded":"2024-09-12T22:31:35.389314+0000","last_fullsized":"2024-09-12T22:31:35.389314+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:31:38.411173+0000","last_change":"2024-09-12T22:31:36.408563+0000","last_active":"2024-09-12T22:31:38.411173+0000","last_peered":"2024-09-12T22:31:38.411173+0000","last_clean":"2024-09-12T22:31:38.411173+0000","last_became_active":"2024-09-12T22:31:36.407447+0000","last_became_peered":"2024-09-12T22:31:36.407447+0000","last_unstale":"2024-09-12T22:31:38.411173+0000","last_undegraded":"2024-09-12T22:31:38.411173+0000","last_fullsized":"2024-09-12T22:31:38.411173+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:29:37.933109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:31:38.412069+0000","last_change":"2024-09-12T22:31:37.411680+0000","last_active":"2024-09-12T22:31:38.412069+0000","last_peered":"2024-09-12T22:31:38.412069+0000","last_clean":"2024-09-12T22:31:38.412069+0000","last_became_active":"2024-09-12T22:31:37.411168+0000","last_became_peered":"2024-09-12T22:31:37.411168+0000","last_unstale":"2024-09-12T22:31:38.412069+0000","last_undegraded":"2024-09-12T22:31:38.412069+0000","last_fullsized":"2024-09-12T22:31:38.412069+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:27.706282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:31:35.390845+0000","last_change":"2024-09-12T22:31:35.390845+0000","last_active":"2024-09-12T22:31:35.383905+0000","last_peered":"2024-09-12T22:31:35.383905+0000","last_clean":"2024-09-12T22:31:35.383905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:35.390845+0000","last_undegraded":"2024-09-12T22:31:35.390845+0000","last_fullsized":"2024-09-12T22:31:35.390845+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:31:38.411530+0000","last_change":"2024-09-12T22:31:37.411218+0000","last_active":"2024-09-12T22:31:38.411530+0000","last_peered":"2024-09-12T22:31:38.411530+0000","last_clean":"2024-09-12T22:31:38.411530+0000","last_became_active":"2024-09-12T22:31:37.409666+0000","last_became_peered":"2024-09-12T22:31:37.409666+0000","last_unstale":"2024-09-12T22:31:38.411530+0000","last_undegraded":"2024-09-12T22:31:38.411530+0000","last_fullsized":"2024-09-12T22:31:38.411530+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:45:34.230090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:31:35.388050+0000","last_change":"2024-09-12T22:31:35.388050+0000","last_active":"2024-09-12T22:31:35.383905+0000","last_peered":"2024-09-12T22:31:35.383905+0000","last_clean":"2024-09-12T22:31:35.383905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:35.388050+0000","last_undegraded":"2024-09-12T22:31:35.388050+0000","last_fullsized":"2024-09-12T22:31:35.388050+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:31:35.388658+0000","last_change":"2024-09-12T22:31:35.388658+0000","last_active":"2024-09-12T22:31:35.383905+0000","last_peered":"2024-09-12T22:31:35.383905+0000","last_clean":"2024-09-12T22:31:35.383905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:35.388658+0000","last_undegraded":"2024-09-12T22:31:35.388658+0000","last_fullsized":"2024-09-12T22:31:35.388658+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:31:35.390140+0000","last_change":"2024-09-12T22:31:35.390140+0000","last_active":"2024-09-12T22:31:35.383905+0000","last_peered":"2024-09-12T22:31:35.383905+0000","last_clean":"2024-09-12T22:31:35.383905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:35.390140+0000","last_undegraded":"2024-09-12T22:31:35.390140+0000","last_fullsized":"2024-09-12T22:31:35.390140+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:31:35.389214+0000","last_change":"2024-09-12T22:31:35.389214+0000","last_active":"2024-09-12T22:31:35.383905+0000","last_peered":"2024-09-12T22:31:35.383905+0000","last_clean":"2024-09-12T22:31:35.383905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:35.389214+0000","last_undegraded":"2024-09-12T22:31:35.389214+0000","last_fullsized":"2024-09-12T22:31:35.389214+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:31:35.388216+0000","last_change":"2024-09-12T22:31:35.388216+0000","last_active":"2024-09-12T22:31:35.383905+0000","last_peered":"2024-09-12T22:31:35.383905+0000","last_clean":"2024-09-12T22:31:35.383905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:35.388216+0000","last_undegraded":"2024-09-12T22:31:35.388216+0000","last_fullsized":"2024-09-12T22:31:35.388216+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:31:38.411709+0000","last_change":"2024-09-12T22:31:37.410303+0000","last_active":"2024-09-12T22:31:38.411709+0000","last_peered":"2024-09-12T22:31:38.411709+0000","last_clean":"2024-09-12T22:31:38.411709+0000","last_became_active":"2024-09-12T22:31:37.409607+0000","last_became_peered":"2024-09-12T22:31:37.409607+0000","last_unstale":"2024-09-12T22:31:38.411709+0000","last_undegraded":"2024-09-12T22:31:38.411709+0000","last_fullsized":"2024-09-12T22:31:38.411709+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:53:42.732654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:31:38.411860+0000","last_change":"2024-09-12T22:31:36.407974+0000","last_active":"2024-09-12T22:31:38.411860+0000","last_peered":"2024-09-12T22:31:38.411860+0000","last_clean":"2024-09-12T22:31:38.411860+0000","last_became_active":"2024-09-12T22:31:36.406955+0000","last_became_peered":"2024-09-12T22:31:36.406955+0000","last_unstale":"2024-09-12T22:31:38.411860+0000","last_undegraded":"2024-09-12T22:31:38.411860+0000","last_fullsized":"2024-09-12T22:31:38.411860+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:07:34.831264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:31:35.388079+0000","last_change":"2024-09-12T22:31:35.388079+0000","last_active":"2024-09-12T22:31:35.383905+0000","last_peered":"2024-09-12T22:31:35.383905+0000","last_clean":"2024-09-12T22:31:35.383905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:35.388079+0000","last_undegraded":"2024-09-12T22:31:35.388079+0000","last_fullsized":"2024-09-12T22:31:35.388079+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:31:35.390037+0000","last_change":"2024-09-12T22:31:35.390037+0000","last_active":"2024-09-12T22:31:35.383905+0000","last_peered":"2024-09-12T22:31:35.383905+0000","last_clean":"2024-09-12T22:31:35.383905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:35.390037+0000","last_undegraded":"2024-09-12T22:31:35.390037+0000","last_fullsized":"2024-09-12T22:31:35.390037+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:31:35.390875+0000","last_change":"2024-09-12T22:31:35.390875+0000","last_active":"2024-09-12T22:31:35.383905+0000","last_peered":"2024-09-12T22:31:35.383905+0000","last_clean":"2024-09-12T22:31:35.383905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:35.390875+0000","last_undegraded":"2024-09-12T22:31:35.390875+0000","last_fullsized":"2024-09-12T22:31:35.390875+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:31:38.411825+0000","last_change":"2024-09-12T22:31:37.417881+0000","last_active":"2024-09-12T22:31:38.411825+0000","last_peered":"2024-09-12T22:31:38.411825+0000","last_clean":"2024-09-12T22:31:38.411825+0000","last_became_active":"2024-09-12T22:31:37.417572+0000","last_became_peered":"2024-09-12T22:31:37.417572+0000","last_unstale":"2024-09-12T22:31:38.411825+0000","last_undegraded":"2024-09-12T22:31:38.411825+0000","last_fullsized":"2024-09-12T22:31:38.411825+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:19:16.367589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":218,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T22:31:35.390163+0000","last_change":"2024-09-12T22:31:27.631847+0000","last_active":"2024-09-12T22:31:35.390163+0000","last_peered":"2024-09-12T22:31:35.390163+0000","last_clean":"2024-09-12T22:31:35.390163+0000","last_became_active":"2024-09-12T22:31:27.631027+0000","last_became_peered":"2024-09-12T22:31:27.631027+0000","last_unstale":"2024-09-12T22:31:35.390163+0000","last_undegraded":"2024-09-12T22:31:35.390163+0000","last_fullsized":"2024-09-12T22:31:35.390163+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:26.229539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:26.229539+0000","last_clean_scrub_stamp":"2024-09-12T22:31:26.229539+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:59:24.181319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":22,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T22:31:35.390331+0000","last_change":"2024-09-12T22:31:34.286952+0000","last_active":"2024-09-12T22:31:35.390331+0000","last_peered":"2024-09-12T22:31:35.390331+0000","last_clean":"2024-09-12T22:31:35.390331+0000","last_became_active":"2024-09-12T22:31:32.283661+0000","last_became_peered":"2024-09-12T22:31:32.283661+0000","last_unstale":"2024-09-12T22:31:35.390331+0000","last_undegraded":"2024-09-12T22:31:35.390331+0000","last_fullsized":"2024-09-12T22:31:35.390331+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:21.681390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000621274,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:31:38.411238+0000","last_change":"2024-09-12T22:31:36.411275+0000","last_active":"2024-09-12T22:31:38.411238+0000","last_peered":"2024-09-12T22:31:38.411238+0000","last_clean":"2024-09-12T22:31:38.411238+0000","last_became_active":"2024-09-12T22:31:36.410595+0000","last_became_peered":"2024-09-12T22:31:36.410595+0000","last_unstale":"2024-09-12T22:31:38.411238+0000","last_undegraded":"2024-09-12T22:31:38.411238+0000","last_fullsized":"2024-09-12T22:31:38.411238+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:38:14.895625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":21,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T22:31:35.390344+0000","last_change":"2024-09-12T22:31:34.286642+0000","last_active":"2024-09-12T22:31:35.390344+0000","last_peered":"2024-09-12T22:31:35.390344+0000","last_clean":"2024-09-12T22:31:35.390344+0000","last_became_active":"2024-09-12T22:31:32.283601+0000","last_became_peered":"2024-09-12T22:31:32.283601+0000","last_unstale":"2024-09-12T22:31:35.390344+0000","last_undegraded":"2024-09-12T22:31:35.390344+0000","last_fullsized":"2024-09-12T22:31:35.390344+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:40:06.769540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037858999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:31:38.411132+0000","last_change":"2024-09-12T22:31:36.407395+0000","last_active":"2024-09-12T22:31:38.411132+0000","last_peered":"2024-09-12T22:31:38.411132+0000","last_clean":"2024-09-12T22:31:38.411132+0000","last_became_active":"2024-09-12T22:31:36.406770+0000","last_became_peered":"2024-09-12T22:31:36.406770+0000","last_unstale":"2024-09-12T22:31:38.411132+0000","last_undegraded":"2024-09-12T22:31:38.411132+0000","last_fullsized":"2024-09-12T22:31:38.411132+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:49:26.547848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":27,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:31:38.411228+0000","last_change":"2024-09-12T22:31:34.286394+0000","last_active":"2024-09-12T22:31:38.411228+0000","last_peered":"2024-09-12T22:31:38.411228+0000","last_clean":"2024-09-12T22:31:38.411228+0000","last_became_active":"2024-09-12T22:31:32.280062+0000","last_became_peered":"2024-09-12T22:31:32.280062+0000","last_unstale":"2024-09-12T22:31:38.411228+0000","last_undegraded":"2024-09-12T22:31:38.411228+0000","last_fullsized":"2024-09-12T22:31:38.411228+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:20:23.663838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039540700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.0","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:31:35.390126+0000","last_change":"2024-09-12T22:31:35.390126+0000","last_active":"2024-09-12T22:31:35.383905+0000","last_peered":"2024-09-12T22:31:35.383905+0000","last_clean":"2024-09-12T22:31:35.383905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:35.390126+0000","last_undegraded":"2024-09-12T22:31:35.390126+0000","last_fullsized":"2024-09-12T22:31:35.390126+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:31:38.411836+0000","last_change":"2024-09-12T22:31:37.417636+0000","last_active":"2024-09-12T22:31:38.411836+0000","last_peered":"2024-09-12T22:31:38.411836+0000","last_clean":"2024-09-12T22:31:38.411836+0000","last_became_active":"2024-09-12T22:31:37.417230+0000","last_became_peered":"2024-09-12T22:31:37.417230+0000","last_unstale":"2024-09-12T22:31:38.411836+0000","last_undegraded":"2024-09-12T22:31:38.411836+0000","last_fullsized":"2024-09-12T22:31:38.411836+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:44:29.729122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":23,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T22:31:35.390269+0000","last_change":"2024-09-12T22:31:34.286938+0000","last_active":"2024-09-12T22:31:35.390269+0000","last_peered":"2024-09-12T22:31:35.390269+0000","last_clean":"2024-09-12T22:31:35.390269+0000","last_became_active":"2024-09-12T22:31:32.282230+0000","last_became_peered":"2024-09-12T22:31:32.282230+0000","last_unstale":"2024-09-12T22:31:35.390269+0000","last_undegraded":"2024-09-12T22:31:35.390269+0000","last_fullsized":"2024-09-12T22:31:35.390269+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:11:05.988384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000615758,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.3","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:31:35.388119+0000","last_change":"2024-09-12T22:31:35.388119+0000","last_active":"2024-09-12T22:31:35.383905+0000","last_peered":"2024-09-12T22:31:35.383905+0000","last_clean":"2024-09-12T22:31:35.383905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:35.388119+0000","last_undegraded":"2024-09-12T22:31:35.388119+0000","last_fullsized":"2024-09-12T22:31:35.388119+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:31:38.411777+0000","last_change":"2024-09-12T22:31:37.414608+0000","last_active":"2024-09-12T22:31:38.411777+0000","last_peered":"2024-09-12T22:31:38.411777+0000","last_clean":"2024-09-12T22:31:38.411777+0000","last_became_active":"2024-09-12T22:31:37.414307+0000","last_became_peered":"2024-09-12T22:31:37.414307+0000","last_unstale":"2024-09-12T22:31:38.411777+0000","last_undegraded":"2024-09-12T22:31:38.411777+0000","last_fullsized":"2024-09-12T22:31:38.411777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:41:21.231511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:31:35.388378+0000","last_change":"2024-09-12T22:31:35.388378+0000","last_active":"2024-09-12T22:31:35.383905+0000","last_peered":"2024-09-12T22:31:35.383905+0000","last_clean":"2024-09-12T22:31:35.383905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:35.388378+0000","last_undegraded":"2024-09-12T22:31:35.388378+0000","last_fullsized":"2024-09-12T22:31:35.388378+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:31:38.411833+0000","last_change":"2024-09-12T22:31:34.286457+0000","last_active":"2024-09-12T22:31:38.411833+0000","last_peered":"2024-09-12T22:31:38.411833+0000","last_clean":"2024-09-12T22:31:38.411833+0000","last_became_active":"2024-09-12T22:31:32.280007+0000","last_became_peered":"2024-09-12T22:31:32.280007+0000","last_unstale":"2024-09-12T22:31:38.411833+0000","last_undegraded":"2024-09-12T22:31:38.411833+0000","last_fullsized":"2024-09-12T22:31:38.411833+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:09.068038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041972500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:31:38.411740+0000","last_change":"2024-09-12T22:31:36.410324+0000","last_active":"2024-09-12T22:31:38.411740+0000","last_peered":"2024-09-12T22:31:38.411740+0000","last_clean":"2024-09-12T22:31:38.411740+0000","last_became_active":"2024-09-12T22:31:36.409199+0000","last_became_peered":"2024-09-12T22:31:36.409199+0000","last_unstale":"2024-09-12T22:31:38.411740+0000","last_undegraded":"2024-09-12T22:31:38.411740+0000","last_fullsized":"2024-09-12T22:31:38.411740+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:06:54.608936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":21,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T22:31:35.391785+0000","last_change":"2024-09-12T22:31:34.839044+0000","last_active":"2024-09-12T22:31:35.391785+0000","last_peered":"2024-09-12T22:31:35.391785+0000","last_clean":"2024-09-12T22:31:35.391785+0000","last_became_active":"2024-09-12T22:31:32.279671+0000","last_became_peered":"2024-09-12T22:31:32.279671+0000","last_unstale":"2024-09-12T22:31:35.391785+0000","last_undegraded":"2024-09-12T22:31:35.391785+0000","last_fullsized":"2024-09-12T22:31:35.391785+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:27:49.809935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036776499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:31:38.412193+0000","last_change":"2024-09-12T22:31:36.409397+0000","last_active":"2024-09-12T22:31:38.412193+0000","last_peered":"2024-09-12T22:31:38.412193+0000","last_clean":"2024-09-12T22:31:38.412193+0000","last_became_active":"2024-09-12T22:31:36.408787+0000","last_became_peered":"2024-09-12T22:31:36.408787+0000","last_unstale":"2024-09-12T22:31:38.412193+0000","last_undegraded":"2024-09-12T22:31:38.412193+0000","last_fullsized":"2024-09-12T22:31:38.412193+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:29:03.467352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":27,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:31:38.412099+0000","last_change":"2024-09-12T22:31:34.286639+0000","last_active":"2024-09-12T22:31:38.412099+0000","last_peered":"2024-09-12T22:31:38.412099+0000","last_clean":"2024-09-12T22:31:38.412099+0000","last_became_active":"2024-09-12T22:31:32.280092+0000","last_became_peered":"2024-09-12T22:31:32.280092+0000","last_unstale":"2024-09-12T22:31:38.412099+0000","last_undegraded":"2024-09-12T22:31:38.412099+0000","last_fullsized":"2024-09-12T22:31:38.412099+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:02:40.821530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058589999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:31:38.410913+0000","last_change":"2024-09-12T22:31:37.411152+0000","last_active":"2024-09-12T22:31:38.410913+0000","last_peered":"2024-09-12T22:31:38.410913+0000","last_clean":"2024-09-12T22:31:38.410913+0000","last_became_active":"2024-09-12T22:31:37.410558+0000","last_became_peered":"2024-09-12T22:31:37.410558+0000","last_unstale":"2024-09-12T22:31:38.410913+0000","last_undegraded":"2024-09-12T22:31:38.410913+0000","last_fullsized":"2024-09-12T22:31:38.410913+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:14:29.892478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:31:39.400416+0000","last_change":"2024-09-12T22:31:36.407460+0000","last_active":"2024-09-12T22:31:39.400416+0000","last_peered":"2024-09-12T22:31:39.400416+0000","last_clean":"2024-09-12T22:31:39.400416+0000","last_became_active":"2024-09-12T22:31:36.406729+0000","last_became_peered":"2024-09-12T22:31:36.406729+0000","last_unstale":"2024-09-12T22:31:39.400416+0000","last_undegraded":"2024-09-12T22:31:39.400416+0000","last_fullsized":"2024-09-12T22:31:39.400416+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:27:58.012573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":21,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T22:31:35.390567+0000","last_change":"2024-09-12T22:31:34.286699+0000","last_active":"2024-09-12T22:31:35.390567+0000","last_peered":"2024-09-12T22:31:35.390567+0000","last_clean":"2024-09-12T22:31:35.390567+0000","last_became_active":"2024-09-12T22:31:32.283606+0000","last_became_peered":"2024-09-12T22:31:32.283606+0000","last_unstale":"2024-09-12T22:31:35.390567+0000","last_undegraded":"2024-09-12T22:31:35.390567+0000","last_fullsized":"2024-09-12T22:31:35.390567+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:09:32.050798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000382109,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:31:35.389280+0000","last_change":"2024-09-12T22:31:35.389280+0000","last_active":"2024-09-12T22:31:35.383905+0000","last_peered":"2024-09-12T22:31:35.383905+0000","last_clean":"2024-09-12T22:31:35.383905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:35.389280+0000","last_undegraded":"2024-09-12T22:31:35.389280+0000","last_fullsized":"2024-09-12T22:31:35.389280+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:31:38.410899+0000","last_change":"2024-09-12T22:31:37.414914+0000","last_active":"2024-09-12T22:31:38.410899+0000","last_peered":"2024-09-12T22:31:38.410899+0000","last_clean":"2024-09-12T22:31:38.410899+0000","last_became_active":"2024-09-12T22:31:37.414535+0000","last_became_peered":"2024-09-12T22:31:37.414535+0000","last_unstale":"2024-09-12T22:31:38.410899+0000","last_undegraded":"2024-09-12T22:31:38.410899+0000","last_fullsized":"2024-09-12T22:31:38.410899+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:14:37.010786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:31:35.389979+0000","last_change":"2024-09-12T22:31:35.389979+0000","last_active":"2024-09-12T22:31:35.383905+0000","last_peered":"2024-09-12T22:31:35.383905+0000","last_clean":"2024-09-12T22:31:35.383905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:35.389979+0000","last_undegraded":"2024-09-12T22:31:35.389979+0000","last_fullsized":"2024-09-12T22:31:35.389979+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:31:35.388390+0000","last_change":"2024-09-12T22:31:35.388390+0000","last_active":"2024-09-12T22:31:35.383905+0000","last_peered":"2024-09-12T22:31:35.383905+0000","last_clean":"2024-09-12T22:31:35.383905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:35.388390+0000","last_undegraded":"2024-09-12T22:31:35.388390+0000","last_fullsized":"2024-09-12T22:31:35.388390+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:31:38.410787+0000","last_change":"2024-09-12T22:31:37.411254+0000","last_active":"2024-09-12T22:31:38.410787+0000","last_peered":"2024-09-12T22:31:38.410787+0000","last_clean":"2024-09-12T22:31:38.410787+0000","last_became_active":"2024-09-12T22:31:37.410404+0000","last_became_peered":"2024-09-12T22:31:37.410404+0000","last_unstale":"2024-09-12T22:31:38.410787+0000","last_undegraded":"2024-09-12T22:31:38.410787+0000","last_fullsized":"2024-09-12T22:31:38.410787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:42:00.856616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:31:38.412111+0000","last_change":"2024-09-12T22:31:36.408390+0000","last_active":"2024-09-12T22:31:38.412111+0000","last_peered":"2024-09-12T22:31:38.412111+0000","last_clean":"2024-09-12T22:31:38.412111+0000","last_became_active":"2024-09-12T22:31:36.407062+0000","last_became_peered":"2024-09-12T22:31:36.407062+0000","last_unstale":"2024-09-12T22:31:38.412111+0000","last_undegraded":"2024-09-12T22:31:38.412111+0000","last_fullsized":"2024-09-12T22:31:38.412111+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:09:10.618195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:31:38.410987+0000","last_change":"2024-09-12T22:31:37.416629+0000","last_active":"2024-09-12T22:31:38.410987+0000","last_peered":"2024-09-12T22:31:38.410987+0000","last_clean":"2024-09-12T22:31:38.410987+0000","last_became_active":"2024-09-12T22:31:37.416387+0000","last_became_peered":"2024-09-12T22:31:37.416387+0000","last_unstale":"2024-09-12T22:31:38.410987+0000","last_undegraded":"2024-09-12T22:31:38.410987+0000","last_fullsized":"2024-09-12T22:31:38.410987+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:59:52.020560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:31:38.411051+0000","last_change":"2024-09-12T22:31:36.409466+0000","last_active":"2024-09-12T22:31:38.411051+0000","last_peered":"2024-09-12T22:31:38.411051+0000","last_clean":"2024-09-12T22:31:38.411051+0000","last_became_active":"2024-09-12T22:31:36.408796+0000","last_became_peered":"2024-09-12T22:31:36.408796+0000","last_unstale":"2024-09-12T22:31:38.411051+0000","last_undegraded":"2024-09-12T22:31:38.411051+0000","last_fullsized":"2024-09-12T22:31:38.411051+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:03:39.648159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:31:38.411767+0000","last_change":"2024-09-12T22:31:37.411183+0000","last_active":"2024-09-12T22:31:38.411767+0000","last_peered":"2024-09-12T22:31:38.411767+0000","last_clean":"2024-09-12T22:31:38.411767+0000","last_became_active":"2024-09-12T22:31:37.409796+0000","last_became_peered":"2024-09-12T22:31:37.409796+0000","last_unstale":"2024-09-12T22:31:38.411767+0000","last_undegraded":"2024-09-12T22:31:38.411767+0000","last_fullsized":"2024-09-12T22:31:38.411767+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:20:35.779810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:31:38.410929+0000","last_change":"2024-09-12T22:31:36.407402+0000","last_active":"2024-09-12T22:31:38.410929+0000","last_peered":"2024-09-12T22:31:38.410929+0000","last_clean":"2024-09-12T22:31:38.410929+0000","last_became_active":"2024-09-12T22:31:36.406681+0000","last_became_peered":"2024-09-12T22:31:36.406681+0000","last_unstale":"2024-09-12T22:31:38.410929+0000","last_undegraded":"2024-09-12T22:31:38.410929+0000","last_fullsized":"2024-09-12T22:31:38.410929+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:39:39.362573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:31:35.390064+0000","last_change":"2024-09-12T22:31:35.390064+0000","last_active":"2024-09-12T22:31:35.383905+0000","last_peered":"2024-09-12T22:31:35.383905+0000","last_clean":"2024-09-12T22:31:35.383905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:35.390064+0000","last_undegraded":"2024-09-12T22:31:35.390064+0000","last_fullsized":"2024-09-12T22:31:35.390064+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:31:35.390089+0000","last_change":"2024-09-12T22:31:35.390089+0000","last_active":"2024-09-12T22:31:35.383905+0000","last_peered":"2024-09-12T22:31:35.383905+0000","last_clean":"2024-09-12T22:31:35.383905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:35.390089+0000","last_undegraded":"2024-09-12T22:31:35.390089+0000","last_fullsized":"2024-09-12T22:31:35.390089+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:31:35.389650+0000","last_change":"2024-09-12T22:31:35.389650+0000","last_active":"2024-09-12T22:31:35.383905+0000","last_peered":"2024-09-12T22:31:35.383905+0000","last_clean":"2024-09-12T22:31:35.383905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:35.389650+0000","last_undegraded":"2024-09-12T22:31:35.389650+0000","last_fullsized":"2024-09-12T22:31:35.389650+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:31:35.390700+0000","last_change":"2024-09-12T22:31:35.390700+0000","last_active":"2024-09-12T22:31:35.383905+0000","last_peered":"2024-09-12T22:31:35.383905+0000","last_clean":"2024-09-12T22:31:35.383905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:35.390700+0000","last_undegraded":"2024-09-12T22:31:35.390700+0000","last_fullsized":"2024-09-12T22:31:35.390700+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:31:38.411880+0000","last_change":"2024-09-12T22:31:36.410371+0000","last_active":"2024-09-12T22:31:38.411880+0000","last_peered":"2024-09-12T22:31:38.411880+0000","last_clean":"2024-09-12T22:31:38.411880+0000","last_became_active":"2024-09-12T22:31:36.409428+0000","last_became_peered":"2024-09-12T22:31:36.409428+0000","last_unstale":"2024-09-12T22:31:38.411880+0000","last_undegraded":"2024-09-12T22:31:38.411880+0000","last_fullsized":"2024-09-12T22:31:38.411880+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:27:22.817690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:31:38.412051+0000","last_change":"2024-09-12T22:31:36.407945+0000","last_active":"2024-09-12T22:31:38.412051+0000","last_peered":"2024-09-12T22:31:38.412051+0000","last_clean":"2024-09-12T22:31:38.412051+0000","last_became_active":"2024-09-12T22:31:36.406959+0000","last_became_peered":"2024-09-12T22:31:36.406959+0000","last_unstale":"2024-09-12T22:31:38.412051+0000","last_undegraded":"2024-09-12T22:31:38.412051+0000","last_fullsized":"2024-09-12T22:31:38.412051+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:26:33.155850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":36,"acting":36,"num_store_stats":1},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":582,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10,"ondisk_log_size":10,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705669,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31916,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339924,"statfs":{"total":96636764160,"available":96604082176,"internally_reserved":0,"allocated":745472,"data_stored":637474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705669,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31912,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339928,"statfs":{"total":96636764160,"available":96604086272,"internally_reserved":0,"allocated":741376,"data_stored":637455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738374,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":184320,"data_stored":61985,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T22:31:41.094 INFO:tasks.ceph.ceph_manager.ceph:PG 4.3f is not active+clean 2024-09-12T22:31:41.094 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:31:36.386296+0000', 'last_change': '2024-09-12T22:31:36.386296+0000', 'last_active': '2024-09-12T22:31:36.386296+0000', 'last_peered': '2024-09-12T22:31:36.386296+0000', 'last_clean': '2024-09-12T22:31:36.386296+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:31:36.386296+0000', 'last_undegraded': '2024-09-12T22:31:36.386296+0000', 'last_fullsized': '2024-09-12T22:31:36.386296+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'last_clean_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:31:41.094 INFO:tasks.ceph.ceph_manager.ceph:PG 4.3e is not active+clean 2024-09-12T22:31:41.094 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:31:36.386296+0000', 'last_change': '2024-09-12T22:31:36.386296+0000', 'last_active': '2024-09-12T22:31:36.386296+0000', 'last_peered': '2024-09-12T22:31:36.386296+0000', 'last_clean': '2024-09-12T22:31:36.386296+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:31:36.386296+0000', 'last_undegraded': '2024-09-12T22:31:36.386296+0000', 'last_fullsized': '2024-09-12T22:31:36.386296+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'last_clean_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:31:41.094 INFO:tasks.ceph.ceph_manager.ceph:PG 4.3d is not active+clean 2024-09-12T22:31:41.094 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:31:36.386296+0000', 'last_change': '2024-09-12T22:31:36.386296+0000', 'last_active': '2024-09-12T22:31:36.386296+0000', 'last_peered': '2024-09-12T22:31:36.386296+0000', 'last_clean': '2024-09-12T22:31:36.386296+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:31:36.386296+0000', 'last_undegraded': '2024-09-12T22:31:36.386296+0000', 'last_fullsized': '2024-09-12T22:31:36.386296+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'last_clean_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:31:41.094 INFO:tasks.ceph.ceph_manager.ceph:PG 4.3c is not active+clean 2024-09-12T22:31:41.094 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:31:36.386296+0000', 'last_change': '2024-09-12T22:31:36.386296+0000', 'last_active': '2024-09-12T22:31:36.386296+0000', 'last_peered': '2024-09-12T22:31:36.386296+0000', 'last_clean': '2024-09-12T22:31:36.386296+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:31:36.386296+0000', 'last_undegraded': '2024-09-12T22:31:36.386296+0000', 'last_fullsized': '2024-09-12T22:31:36.386296+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'last_clean_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:31:41.094 INFO:tasks.ceph.ceph_manager.ceph:PG 4.3b is not active+clean 2024-09-12T22:31:41.094 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:31:36.386296+0000', 'last_change': '2024-09-12T22:31:36.386296+0000', 'last_active': '2024-09-12T22:31:36.386296+0000', 'last_peered': '2024-09-12T22:31:36.386296+0000', 'last_clean': '2024-09-12T22:31:36.386296+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:31:36.386296+0000', 'last_undegraded': '2024-09-12T22:31:36.386296+0000', 'last_fullsized': '2024-09-12T22:31:36.386296+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'last_clean_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:31:41.095 INFO:tasks.ceph.ceph_manager.ceph:PG 4.3a is not active+clean 2024-09-12T22:31:41.095 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:31:36.386296+0000', 'last_change': '2024-09-12T22:31:36.386296+0000', 'last_active': '2024-09-12T22:31:36.386296+0000', 'last_peered': '2024-09-12T22:31:36.386296+0000', 'last_clean': '2024-09-12T22:31:36.386296+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:31:36.386296+0000', 'last_undegraded': '2024-09-12T22:31:36.386296+0000', 'last_fullsized': '2024-09-12T22:31:36.386296+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'last_clean_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:31:41.095 INFO:tasks.ceph.ceph_manager.ceph:PG 4.39 is not active+clean 2024-09-12T22:31:41.095 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:31:36.386296+0000', 'last_change': '2024-09-12T22:31:36.386296+0000', 'last_active': '2024-09-12T22:31:36.386296+0000', 'last_peered': '2024-09-12T22:31:36.386296+0000', 'last_clean': '2024-09-12T22:31:36.386296+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:31:36.386296+0000', 'last_undegraded': '2024-09-12T22:31:36.386296+0000', 'last_fullsized': '2024-09-12T22:31:36.386296+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'last_clean_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:31:41.095 INFO:tasks.ceph.ceph_manager.ceph:PG 4.38 is not active+clean 2024-09-12T22:31:41.095 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:31:36.386296+0000', 'last_change': '2024-09-12T22:31:36.386296+0000', 'last_active': '2024-09-12T22:31:36.386296+0000', 'last_peered': '2024-09-12T22:31:36.386296+0000', 'last_clean': '2024-09-12T22:31:36.386296+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:31:36.386296+0000', 'last_undegraded': '2024-09-12T22:31:36.386296+0000', 'last_fullsized': '2024-09-12T22:31:36.386296+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'last_clean_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:31:41.095 INFO:tasks.ceph.ceph_manager.ceph:PG 4.36 is not active+clean 2024-09-12T22:31:41.095 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:31:36.386296+0000', 'last_change': '2024-09-12T22:31:36.386296+0000', 'last_active': '2024-09-12T22:31:36.386296+0000', 'last_peered': '2024-09-12T22:31:36.386296+0000', 'last_clean': '2024-09-12T22:31:36.386296+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:31:36.386296+0000', 'last_undegraded': '2024-09-12T22:31:36.386296+0000', 'last_fullsized': '2024-09-12T22:31:36.386296+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'last_clean_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:31:41.095 INFO:tasks.ceph.ceph_manager.ceph:PG 4.35 is not active+clean 2024-09-12T22:31:41.095 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:31:36.386296+0000', 'last_change': '2024-09-12T22:31:36.386296+0000', 'last_active': '2024-09-12T22:31:36.386296+0000', 'last_peered': '2024-09-12T22:31:36.386296+0000', 'last_clean': '2024-09-12T22:31:36.386296+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:31:36.386296+0000', 'last_undegraded': '2024-09-12T22:31:36.386296+0000', 'last_fullsized': '2024-09-12T22:31:36.386296+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'last_clean_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:31:41.095 INFO:tasks.ceph.ceph_manager.ceph:PG 4.34 is not active+clean 2024-09-12T22:31:41.096 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:31:36.386296+0000', 'last_change': '2024-09-12T22:31:36.386296+0000', 'last_active': '2024-09-12T22:31:36.386296+0000', 'last_peered': '2024-09-12T22:31:36.386296+0000', 'last_clean': '2024-09-12T22:31:36.386296+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:31:36.386296+0000', 'last_undegraded': '2024-09-12T22:31:36.386296+0000', 'last_fullsized': '2024-09-12T22:31:36.386296+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'last_clean_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:31:41.096 INFO:tasks.ceph.ceph_manager.ceph:PG 4.33 is not active+clean 2024-09-12T22:31:41.096 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:31:36.386296+0000', 'last_change': '2024-09-12T22:31:36.386296+0000', 'last_active': '2024-09-12T22:31:36.386296+0000', 'last_peered': '2024-09-12T22:31:36.386296+0000', 'last_clean': '2024-09-12T22:31:36.386296+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:31:36.386296+0000', 'last_undegraded': '2024-09-12T22:31:36.386296+0000', 'last_fullsized': '2024-09-12T22:31:36.386296+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'last_clean_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:31:41.096 INFO:tasks.ceph.ceph_manager.ceph:PG 4.32 is not active+clean 2024-09-12T22:31:41.096 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:31:36.386296+0000', 'last_change': '2024-09-12T22:31:36.386296+0000', 'last_active': '2024-09-12T22:31:36.386296+0000', 'last_peered': '2024-09-12T22:31:36.386296+0000', 'last_clean': '2024-09-12T22:31:36.386296+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:31:36.386296+0000', 'last_undegraded': '2024-09-12T22:31:36.386296+0000', 'last_fullsized': '2024-09-12T22:31:36.386296+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'last_clean_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:31:41.096 INFO:tasks.ceph.ceph_manager.ceph:PG 4.31 is not active+clean 2024-09-12T22:31:41.096 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:31:36.386296+0000', 'last_change': '2024-09-12T22:31:36.386296+0000', 'last_active': '2024-09-12T22:31:36.386296+0000', 'last_peered': '2024-09-12T22:31:36.386296+0000', 'last_clean': '2024-09-12T22:31:36.386296+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:31:36.386296+0000', 'last_undegraded': '2024-09-12T22:31:36.386296+0000', 'last_fullsized': '2024-09-12T22:31:36.386296+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'last_clean_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:31:41.096 INFO:tasks.ceph.ceph_manager.ceph:PG 4.30 is not active+clean 2024-09-12T22:31:41.097 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:31:36.386296+0000', 'last_change': '2024-09-12T22:31:36.386296+0000', 'last_active': '2024-09-12T22:31:36.386296+0000', 'last_peered': '2024-09-12T22:31:36.386296+0000', 'last_clean': '2024-09-12T22:31:36.386296+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:31:36.386296+0000', 'last_undegraded': '2024-09-12T22:31:36.386296+0000', 'last_fullsized': '2024-09-12T22:31:36.386296+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'last_clean_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:31:41.097 INFO:tasks.ceph.ceph_manager.ceph:PG 4.2e is not active+clean 2024-09-12T22:31:41.097 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:31:36.386296+0000', 'last_change': '2024-09-12T22:31:36.386296+0000', 'last_active': '2024-09-12T22:31:36.386296+0000', 'last_peered': '2024-09-12T22:31:36.386296+0000', 'last_clean': '2024-09-12T22:31:36.386296+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:31:36.386296+0000', 'last_undegraded': '2024-09-12T22:31:36.386296+0000', 'last_fullsized': '2024-09-12T22:31:36.386296+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'last_clean_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:31:41.097 INFO:tasks.ceph.ceph_manager.ceph:PG 4.2c is not active+clean 2024-09-12T22:31:41.097 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:31:36.386296+0000', 'last_change': '2024-09-12T22:31:36.386296+0000', 'last_active': '2024-09-12T22:31:36.386296+0000', 'last_peered': '2024-09-12T22:31:36.386296+0000', 'last_clean': '2024-09-12T22:31:36.386296+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:31:36.386296+0000', 'last_undegraded': '2024-09-12T22:31:36.386296+0000', 'last_fullsized': '2024-09-12T22:31:36.386296+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'last_clean_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:31:41.097 INFO:tasks.ceph.ceph_manager.ceph:PG 4.2b is not active+clean 2024-09-12T22:31:41.097 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:31:36.386296+0000', 'last_change': '2024-09-12T22:31:36.386296+0000', 'last_active': '2024-09-12T22:31:36.386296+0000', 'last_peered': '2024-09-12T22:31:36.386296+0000', 'last_clean': '2024-09-12T22:31:36.386296+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:31:36.386296+0000', 'last_undegraded': '2024-09-12T22:31:36.386296+0000', 'last_fullsized': '2024-09-12T22:31:36.386296+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'last_clean_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:31:41.097 INFO:tasks.ceph.ceph_manager.ceph:PG 4.2a is not active+clean 2024-09-12T22:31:41.097 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:31:36.386296+0000', 'last_change': '2024-09-12T22:31:36.386296+0000', 'last_active': '2024-09-12T22:31:36.386296+0000', 'last_peered': '2024-09-12T22:31:36.386296+0000', 'last_clean': '2024-09-12T22:31:36.386296+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:31:36.386296+0000', 'last_undegraded': '2024-09-12T22:31:36.386296+0000', 'last_fullsized': '2024-09-12T22:31:36.386296+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'last_clean_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:31:41.097 INFO:tasks.ceph.ceph_manager.ceph:PG 4.28 is not active+clean 2024-09-12T22:31:41.098 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:31:36.386296+0000', 'last_change': '2024-09-12T22:31:36.386296+0000', 'last_active': '2024-09-12T22:31:36.386296+0000', 'last_peered': '2024-09-12T22:31:36.386296+0000', 'last_clean': '2024-09-12T22:31:36.386296+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:31:36.386296+0000', 'last_undegraded': '2024-09-12T22:31:36.386296+0000', 'last_fullsized': '2024-09-12T22:31:36.386296+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'last_clean_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:31:41.098 INFO:tasks.ceph.ceph_manager.ceph:PG 4.27 is not active+clean 2024-09-12T22:31:41.098 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:31:36.386296+0000', 'last_change': '2024-09-12T22:31:36.386296+0000', 'last_active': '2024-09-12T22:31:36.386296+0000', 'last_peered': '2024-09-12T22:31:36.386296+0000', 'last_clean': '2024-09-12T22:31:36.386296+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:31:36.386296+0000', 'last_undegraded': '2024-09-12T22:31:36.386296+0000', 'last_fullsized': '2024-09-12T22:31:36.386296+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'last_clean_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:31:41.098 INFO:tasks.ceph.ceph_manager.ceph:PG 4.25 is not active+clean 2024-09-12T22:31:41.098 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:31:36.386296+0000', 'last_change': '2024-09-12T22:31:36.386296+0000', 'last_active': '2024-09-12T22:31:36.386296+0000', 'last_peered': '2024-09-12T22:31:36.386296+0000', 'last_clean': '2024-09-12T22:31:36.386296+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:31:36.386296+0000', 'last_undegraded': '2024-09-12T22:31:36.386296+0000', 'last_fullsized': '2024-09-12T22:31:36.386296+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'last_clean_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:31:41.098 INFO:tasks.ceph.ceph_manager.ceph:PG 4.24 is not active+clean 2024-09-12T22:31:41.099 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:31:36.386296+0000', 'last_change': '2024-09-12T22:31:36.386296+0000', 'last_active': '2024-09-12T22:31:36.386296+0000', 'last_peered': '2024-09-12T22:31:36.386296+0000', 'last_clean': '2024-09-12T22:31:36.386296+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:31:36.386296+0000', 'last_undegraded': '2024-09-12T22:31:36.386296+0000', 'last_fullsized': '2024-09-12T22:31:36.386296+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'last_clean_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:31:41.099 INFO:tasks.ceph.ceph_manager.ceph:PG 4.22 is not active+clean 2024-09-12T22:31:41.099 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:31:36.386296+0000', 'last_change': '2024-09-12T22:31:36.386296+0000', 'last_active': '2024-09-12T22:31:36.386296+0000', 'last_peered': '2024-09-12T22:31:36.386296+0000', 'last_clean': '2024-09-12T22:31:36.386296+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:31:36.386296+0000', 'last_undegraded': '2024-09-12T22:31:36.386296+0000', 'last_fullsized': '2024-09-12T22:31:36.386296+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'last_clean_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:31:41.099 INFO:tasks.ceph.ceph_manager.ceph:PG 4.20 is not active+clean 2024-09-12T22:31:41.099 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:31:36.386296+0000', 'last_change': '2024-09-12T22:31:36.386296+0000', 'last_active': '2024-09-12T22:31:36.386296+0000', 'last_peered': '2024-09-12T22:31:36.386296+0000', 'last_clean': '2024-09-12T22:31:36.386296+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:31:36.386296+0000', 'last_undegraded': '2024-09-12T22:31:36.386296+0000', 'last_fullsized': '2024-09-12T22:31:36.386296+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'last_clean_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:31:41.099 INFO:tasks.ceph.ceph_manager.ceph:PG 4.14 is not active+clean 2024-09-12T22:31:41.099 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:31:36.386296+0000', 'last_change': '2024-09-12T22:31:36.386296+0000', 'last_active': '2024-09-12T22:31:36.386296+0000', 'last_peered': '2024-09-12T22:31:36.386296+0000', 'last_clean': '2024-09-12T22:31:36.386296+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:31:36.386296+0000', 'last_undegraded': '2024-09-12T22:31:36.386296+0000', 'last_fullsized': '2024-09-12T22:31:36.386296+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'last_clean_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:31:41.100 INFO:tasks.ceph.ceph_manager.ceph:PG 3.13 is not active+clean 2024-09-12T22:31:41.100 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2024-09-12T22:31:35.389314+0000', 'last_change': '2024-09-12T22:31:35.389314+0000', 'last_active': '2024-09-12T22:31:35.383905+0000', 'last_peered': '2024-09-12T22:31:35.383905+0000', 'last_clean': '2024-09-12T22:31:35.383905+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:31:35.389314+0000', 'last_undegraded': '2024-09-12T22:31:35.389314+0000', 'last_fullsized': '2024-09-12T22:31:35.389314+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:31:35.383905+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:31:35.383905+0000', 'last_clean_scrub_stamp': '2024-09-12T22:31:35.383905+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T22:31:41.100 INFO:tasks.ceph.ceph_manager.ceph:PG 4.15 is not active+clean 2024-09-12T22:31:41.100 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:31:36.386296+0000', 'last_change': '2024-09-12T22:31:36.386296+0000', 'last_active': '2024-09-12T22:31:36.386296+0000', 'last_peered': '2024-09-12T22:31:36.386296+0000', 'last_clean': '2024-09-12T22:31:36.386296+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:31:36.386296+0000', 'last_undegraded': '2024-09-12T22:31:36.386296+0000', 'last_fullsized': '2024-09-12T22:31:36.386296+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'last_clean_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:31:41.101 INFO:tasks.ceph.ceph_manager.ceph:PG 3.11 is not active+clean 2024-09-12T22:31:41.101 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2024-09-12T22:31:35.390845+0000', 'last_change': '2024-09-12T22:31:35.390845+0000', 'last_active': '2024-09-12T22:31:35.383905+0000', 'last_peered': '2024-09-12T22:31:35.383905+0000', 'last_clean': '2024-09-12T22:31:35.383905+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:31:35.390845+0000', 'last_undegraded': '2024-09-12T22:31:35.390845+0000', 'last_fullsized': '2024-09-12T22:31:35.390845+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:31:35.383905+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:31:35.383905+0000', 'last_clean_scrub_stamp': '2024-09-12T22:31:35.383905+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T22:31:41.101 INFO:tasks.ceph.ceph_manager.ceph:PG 3.10 is not active+clean 2024-09-12T22:31:41.101 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2024-09-12T22:31:35.388050+0000', 'last_change': '2024-09-12T22:31:35.388050+0000', 'last_active': '2024-09-12T22:31:35.383905+0000', 'last_peered': '2024-09-12T22:31:35.383905+0000', 'last_clean': '2024-09-12T22:31:35.383905+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:31:35.388050+0000', 'last_undegraded': '2024-09-12T22:31:35.388050+0000', 'last_fullsized': '2024-09-12T22:31:35.388050+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:31:35.383905+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:31:35.383905+0000', 'last_clean_scrub_stamp': '2024-09-12T22:31:35.383905+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T22:31:41.101 INFO:tasks.ceph.ceph_manager.ceph:PG 3.f is not active+clean 2024-09-12T22:31:41.101 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2024-09-12T22:31:35.388658+0000', 'last_change': '2024-09-12T22:31:35.388658+0000', 'last_active': '2024-09-12T22:31:35.383905+0000', 'last_peered': '2024-09-12T22:31:35.383905+0000', 'last_clean': '2024-09-12T22:31:35.383905+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:31:35.388658+0000', 'last_undegraded': '2024-09-12T22:31:35.388658+0000', 'last_fullsized': '2024-09-12T22:31:35.388658+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:31:35.383905+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:31:35.383905+0000', 'last_clean_scrub_stamp': '2024-09-12T22:31:35.383905+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T22:31:41.102 INFO:tasks.ceph.ceph_manager.ceph:PG 4.8 is not active+clean 2024-09-12T22:31:41.102 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:31:36.386296+0000', 'last_change': '2024-09-12T22:31:36.386296+0000', 'last_active': '2024-09-12T22:31:36.386296+0000', 'last_peered': '2024-09-12T22:31:36.386296+0000', 'last_clean': '2024-09-12T22:31:36.386296+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:31:36.386296+0000', 'last_undegraded': '2024-09-12T22:31:36.386296+0000', 'last_fullsized': '2024-09-12T22:31:36.386296+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'last_clean_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:31:41.102 INFO:tasks.ceph.ceph_manager.ceph:PG 3.e is not active+clean 2024-09-12T22:31:41.102 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2024-09-12T22:31:35.390140+0000', 'last_change': '2024-09-12T22:31:35.390140+0000', 'last_active': '2024-09-12T22:31:35.383905+0000', 'last_peered': '2024-09-12T22:31:35.383905+0000', 'last_clean': '2024-09-12T22:31:35.383905+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:31:35.390140+0000', 'last_undegraded': '2024-09-12T22:31:35.390140+0000', 'last_fullsized': '2024-09-12T22:31:35.390140+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:31:35.383905+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:31:35.383905+0000', 'last_clean_scrub_stamp': '2024-09-12T22:31:35.383905+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T22:31:41.102 INFO:tasks.ceph.ceph_manager.ceph:PG 4.9 is not active+clean 2024-09-12T22:31:41.102 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:31:36.386296+0000', 'last_change': '2024-09-12T22:31:36.386296+0000', 'last_active': '2024-09-12T22:31:36.386296+0000', 'last_peered': '2024-09-12T22:31:36.386296+0000', 'last_clean': '2024-09-12T22:31:36.386296+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:31:36.386296+0000', 'last_undegraded': '2024-09-12T22:31:36.386296+0000', 'last_fullsized': '2024-09-12T22:31:36.386296+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'last_clean_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:31:41.102 INFO:tasks.ceph.ceph_manager.ceph:PG 3.d is not active+clean 2024-09-12T22:31:41.102 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2024-09-12T22:31:35.389214+0000', 'last_change': '2024-09-12T22:31:35.389214+0000', 'last_active': '2024-09-12T22:31:35.383905+0000', 'last_peered': '2024-09-12T22:31:35.383905+0000', 'last_clean': '2024-09-12T22:31:35.383905+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:31:35.389214+0000', 'last_undegraded': '2024-09-12T22:31:35.389214+0000', 'last_fullsized': '2024-09-12T22:31:35.389214+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:31:35.383905+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:31:35.383905+0000', 'last_clean_scrub_stamp': '2024-09-12T22:31:35.383905+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T22:31:41.102 INFO:tasks.ceph.ceph_manager.ceph:PG 4.a is not active+clean 2024-09-12T22:31:41.102 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:31:36.386296+0000', 'last_change': '2024-09-12T22:31:36.386296+0000', 'last_active': '2024-09-12T22:31:36.386296+0000', 'last_peered': '2024-09-12T22:31:36.386296+0000', 'last_clean': '2024-09-12T22:31:36.386296+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:31:36.386296+0000', 'last_undegraded': '2024-09-12T22:31:36.386296+0000', 'last_fullsized': '2024-09-12T22:31:36.386296+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'last_clean_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:31:41.102 INFO:tasks.ceph.ceph_manager.ceph:PG 3.c is not active+clean 2024-09-12T22:31:41.103 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2024-09-12T22:31:35.388216+0000', 'last_change': '2024-09-12T22:31:35.388216+0000', 'last_active': '2024-09-12T22:31:35.383905+0000', 'last_peered': '2024-09-12T22:31:35.383905+0000', 'last_clean': '2024-09-12T22:31:35.383905+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:31:35.388216+0000', 'last_undegraded': '2024-09-12T22:31:35.388216+0000', 'last_fullsized': '2024-09-12T22:31:35.388216+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:31:35.383905+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:31:35.383905+0000', 'last_clean_scrub_stamp': '2024-09-12T22:31:35.383905+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T22:31:41.103 INFO:tasks.ceph.ceph_manager.ceph:PG 4.c is not active+clean 2024-09-12T22:31:41.103 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:31:36.386296+0000', 'last_change': '2024-09-12T22:31:36.386296+0000', 'last_active': '2024-09-12T22:31:36.386296+0000', 'last_peered': '2024-09-12T22:31:36.386296+0000', 'last_clean': '2024-09-12T22:31:36.386296+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:31:36.386296+0000', 'last_undegraded': '2024-09-12T22:31:36.386296+0000', 'last_fullsized': '2024-09-12T22:31:36.386296+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'last_clean_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:31:41.103 INFO:tasks.ceph.ceph_manager.ceph:PG 3.a is not active+clean 2024-09-12T22:31:41.103 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2024-09-12T22:31:35.388079+0000', 'last_change': '2024-09-12T22:31:35.388079+0000', 'last_active': '2024-09-12T22:31:35.383905+0000', 'last_peered': '2024-09-12T22:31:35.383905+0000', 'last_clean': '2024-09-12T22:31:35.383905+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:31:35.388079+0000', 'last_undegraded': '2024-09-12T22:31:35.388079+0000', 'last_fullsized': '2024-09-12T22:31:35.388079+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:31:35.383905+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:31:35.383905+0000', 'last_clean_scrub_stamp': '2024-09-12T22:31:35.383905+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T22:31:41.103 INFO:tasks.ceph.ceph_manager.ceph:PG 4.d is not active+clean 2024-09-12T22:31:41.103 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:31:36.386296+0000', 'last_change': '2024-09-12T22:31:36.386296+0000', 'last_active': '2024-09-12T22:31:36.386296+0000', 'last_peered': '2024-09-12T22:31:36.386296+0000', 'last_clean': '2024-09-12T22:31:36.386296+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:31:36.386296+0000', 'last_undegraded': '2024-09-12T22:31:36.386296+0000', 'last_fullsized': '2024-09-12T22:31:36.386296+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'last_clean_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:31:41.103 INFO:tasks.ceph.ceph_manager.ceph:PG 3.9 is not active+clean 2024-09-12T22:31:41.103 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2024-09-12T22:31:35.390037+0000', 'last_change': '2024-09-12T22:31:35.390037+0000', 'last_active': '2024-09-12T22:31:35.383905+0000', 'last_peered': '2024-09-12T22:31:35.383905+0000', 'last_clean': '2024-09-12T22:31:35.383905+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:31:35.390037+0000', 'last_undegraded': '2024-09-12T22:31:35.390037+0000', 'last_fullsized': '2024-09-12T22:31:35.390037+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:31:35.383905+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:31:35.383905+0000', 'last_clean_scrub_stamp': '2024-09-12T22:31:35.383905+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T22:31:41.103 INFO:tasks.ceph.ceph_manager.ceph:PG 4.e is not active+clean 2024-09-12T22:31:41.103 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:31:36.386296+0000', 'last_change': '2024-09-12T22:31:36.386296+0000', 'last_active': '2024-09-12T22:31:36.386296+0000', 'last_peered': '2024-09-12T22:31:36.386296+0000', 'last_clean': '2024-09-12T22:31:36.386296+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:31:36.386296+0000', 'last_undegraded': '2024-09-12T22:31:36.386296+0000', 'last_fullsized': '2024-09-12T22:31:36.386296+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'last_clean_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:31:41.104 INFO:tasks.ceph.ceph_manager.ceph:PG 3.8 is not active+clean 2024-09-12T22:31:41.104 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2024-09-12T22:31:35.390875+0000', 'last_change': '2024-09-12T22:31:35.390875+0000', 'last_active': '2024-09-12T22:31:35.383905+0000', 'last_peered': '2024-09-12T22:31:35.383905+0000', 'last_clean': '2024-09-12T22:31:35.383905+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:31:35.390875+0000', 'last_undegraded': '2024-09-12T22:31:35.390875+0000', 'last_fullsized': '2024-09-12T22:31:35.390875+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:31:35.383905+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:31:35.383905+0000', 'last_clean_scrub_stamp': '2024-09-12T22:31:35.383905+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T22:31:41.104 INFO:tasks.ceph.ceph_manager.ceph:PG 4.5 is not active+clean 2024-09-12T22:31:41.104 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:31:36.386296+0000', 'last_change': '2024-09-12T22:31:36.386296+0000', 'last_active': '2024-09-12T22:31:36.386296+0000', 'last_peered': '2024-09-12T22:31:36.386296+0000', 'last_clean': '2024-09-12T22:31:36.386296+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:31:36.386296+0000', 'last_undegraded': '2024-09-12T22:31:36.386296+0000', 'last_fullsized': '2024-09-12T22:31:36.386296+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'last_clean_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:31:41.104 INFO:tasks.ceph.ceph_manager.ceph:PG 4.6 is not active+clean 2024-09-12T22:31:41.104 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:31:36.386296+0000', 'last_change': '2024-09-12T22:31:36.386296+0000', 'last_active': '2024-09-12T22:31:36.386296+0000', 'last_peered': '2024-09-12T22:31:36.386296+0000', 'last_clean': '2024-09-12T22:31:36.386296+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:31:36.386296+0000', 'last_undegraded': '2024-09-12T22:31:36.386296+0000', 'last_fullsized': '2024-09-12T22:31:36.386296+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'last_clean_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:31:41.104 INFO:tasks.ceph.ceph_manager.ceph:PG 3.0 is not active+clean 2024-09-12T22:31:41.104 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2024-09-12T22:31:35.390126+0000', 'last_change': '2024-09-12T22:31:35.390126+0000', 'last_active': '2024-09-12T22:31:35.383905+0000', 'last_peered': '2024-09-12T22:31:35.383905+0000', 'last_clean': '2024-09-12T22:31:35.383905+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:31:35.390126+0000', 'last_undegraded': '2024-09-12T22:31:35.390126+0000', 'last_fullsized': '2024-09-12T22:31:35.390126+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:31:35.383905+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:31:35.383905+0000', 'last_clean_scrub_stamp': '2024-09-12T22:31:35.383905+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T22:31:41.104 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3 is not active+clean 2024-09-12T22:31:41.104 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2024-09-12T22:31:35.388119+0000', 'last_change': '2024-09-12T22:31:35.388119+0000', 'last_active': '2024-09-12T22:31:35.383905+0000', 'last_peered': '2024-09-12T22:31:35.383905+0000', 'last_clean': '2024-09-12T22:31:35.383905+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:31:35.388119+0000', 'last_undegraded': '2024-09-12T22:31:35.388119+0000', 'last_fullsized': '2024-09-12T22:31:35.388119+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:31:35.383905+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:31:35.383905+0000', 'last_clean_scrub_stamp': '2024-09-12T22:31:35.383905+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T22:31:41.105 INFO:tasks.ceph.ceph_manager.ceph:PG 3.5 is not active+clean 2024-09-12T22:31:41.105 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2024-09-12T22:31:35.388378+0000', 'last_change': '2024-09-12T22:31:35.388378+0000', 'last_active': '2024-09-12T22:31:35.383905+0000', 'last_peered': '2024-09-12T22:31:35.383905+0000', 'last_clean': '2024-09-12T22:31:35.383905+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:31:35.388378+0000', 'last_undegraded': '2024-09-12T22:31:35.388378+0000', 'last_fullsized': '2024-09-12T22:31:35.388378+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:31:35.383905+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:31:35.383905+0000', 'last_clean_scrub_stamp': '2024-09-12T22:31:35.383905+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T22:31:41.105 INFO:tasks.ceph.ceph_manager.ceph:PG 4.2 is not active+clean 2024-09-12T22:31:41.105 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:31:36.386296+0000', 'last_change': '2024-09-12T22:31:36.386296+0000', 'last_active': '2024-09-12T22:31:36.386296+0000', 'last_peered': '2024-09-12T22:31:36.386296+0000', 'last_clean': '2024-09-12T22:31:36.386296+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:31:36.386296+0000', 'last_undegraded': '2024-09-12T22:31:36.386296+0000', 'last_fullsized': '2024-09-12T22:31:36.386296+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'last_clean_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:31:41.105 INFO:tasks.ceph.ceph_manager.ceph:PG 4.3 is not active+clean 2024-09-12T22:31:41.105 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:31:36.386296+0000', 'last_change': '2024-09-12T22:31:36.386296+0000', 'last_active': '2024-09-12T22:31:36.386296+0000', 'last_peered': '2024-09-12T22:31:36.386296+0000', 'last_clean': '2024-09-12T22:31:36.386296+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:31:36.386296+0000', 'last_undegraded': '2024-09-12T22:31:36.386296+0000', 'last_fullsized': '2024-09-12T22:31:36.386296+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'last_clean_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:31:41.105 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1 is not active+clean 2024-09-12T22:31:41.105 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:31:36.386296+0000', 'last_change': '2024-09-12T22:31:36.386296+0000', 'last_active': '2024-09-12T22:31:36.386296+0000', 'last_peered': '2024-09-12T22:31:36.386296+0000', 'last_clean': '2024-09-12T22:31:36.386296+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:31:36.386296+0000', 'last_undegraded': '2024-09-12T22:31:36.386296+0000', 'last_fullsized': '2024-09-12T22:31:36.386296+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'last_clean_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:31:41.105 INFO:tasks.ceph.ceph_manager.ceph:PG 4.13 is not active+clean 2024-09-12T22:31:41.105 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:31:36.386296+0000', 'last_change': '2024-09-12T22:31:36.386296+0000', 'last_active': '2024-09-12T22:31:36.386296+0000', 'last_peered': '2024-09-12T22:31:36.386296+0000', 'last_clean': '2024-09-12T22:31:36.386296+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:31:36.386296+0000', 'last_undegraded': '2024-09-12T22:31:36.386296+0000', 'last_fullsized': '2024-09-12T22:31:36.386296+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'last_clean_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:31:41.106 INFO:tasks.ceph.ceph_manager.ceph:PG 3.14 is not active+clean 2024-09-12T22:31:41.106 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2024-09-12T22:31:35.389280+0000', 'last_change': '2024-09-12T22:31:35.389280+0000', 'last_active': '2024-09-12T22:31:35.383905+0000', 'last_peered': '2024-09-12T22:31:35.383905+0000', 'last_clean': '2024-09-12T22:31:35.383905+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:31:35.389280+0000', 'last_undegraded': '2024-09-12T22:31:35.389280+0000', 'last_fullsized': '2024-09-12T22:31:35.389280+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:31:35.383905+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:31:35.383905+0000', 'last_clean_scrub_stamp': '2024-09-12T22:31:35.383905+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T22:31:41.106 INFO:tasks.ceph.ceph_manager.ceph:PG 3.15 is not active+clean 2024-09-12T22:31:41.106 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2024-09-12T22:31:35.389979+0000', 'last_change': '2024-09-12T22:31:35.389979+0000', 'last_active': '2024-09-12T22:31:35.383905+0000', 'last_peered': '2024-09-12T22:31:35.383905+0000', 'last_clean': '2024-09-12T22:31:35.383905+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:31:35.389979+0000', 'last_undegraded': '2024-09-12T22:31:35.389979+0000', 'last_fullsized': '2024-09-12T22:31:35.389979+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:31:35.383905+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:31:35.383905+0000', 'last_clean_scrub_stamp': '2024-09-12T22:31:35.383905+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T22:31:41.106 INFO:tasks.ceph.ceph_manager.ceph:PG 3.16 is not active+clean 2024-09-12T22:31:41.106 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2024-09-12T22:31:35.388390+0000', 'last_change': '2024-09-12T22:31:35.388390+0000', 'last_active': '2024-09-12T22:31:35.383905+0000', 'last_peered': '2024-09-12T22:31:35.383905+0000', 'last_clean': '2024-09-12T22:31:35.383905+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:31:35.388390+0000', 'last_undegraded': '2024-09-12T22:31:35.388390+0000', 'last_fullsized': '2024-09-12T22:31:35.388390+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:31:35.383905+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:31:35.383905+0000', 'last_clean_scrub_stamp': '2024-09-12T22:31:35.383905+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T22:31:41.106 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1f is not active+clean 2024-09-12T22:31:41.106 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:31:36.386296+0000', 'last_change': '2024-09-12T22:31:36.386296+0000', 'last_active': '2024-09-12T22:31:36.386296+0000', 'last_peered': '2024-09-12T22:31:36.386296+0000', 'last_clean': '2024-09-12T22:31:36.386296+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:31:36.386296+0000', 'last_undegraded': '2024-09-12T22:31:36.386296+0000', 'last_fullsized': '2024-09-12T22:31:36.386296+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'last_clean_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:31:41.106 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1d is not active+clean 2024-09-12T22:31:41.106 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:31:36.386296+0000', 'last_change': '2024-09-12T22:31:36.386296+0000', 'last_active': '2024-09-12T22:31:36.386296+0000', 'last_peered': '2024-09-12T22:31:36.386296+0000', 'last_clean': '2024-09-12T22:31:36.386296+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:31:36.386296+0000', 'last_undegraded': '2024-09-12T22:31:36.386296+0000', 'last_fullsized': '2024-09-12T22:31:36.386296+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'last_clean_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:31:41.106 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1a is not active+clean 2024-09-12T22:31:41.107 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2024-09-12T22:31:35.390064+0000', 'last_change': '2024-09-12T22:31:35.390064+0000', 'last_active': '2024-09-12T22:31:35.383905+0000', 'last_peered': '2024-09-12T22:31:35.383905+0000', 'last_clean': '2024-09-12T22:31:35.383905+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:31:35.390064+0000', 'last_undegraded': '2024-09-12T22:31:35.390064+0000', 'last_fullsized': '2024-09-12T22:31:35.390064+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:31:35.383905+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:31:35.383905+0000', 'last_clean_scrub_stamp': '2024-09-12T22:31:35.383905+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T22:31:41.107 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1c is not active+clean 2024-09-12T22:31:41.107 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:31:36.386296+0000', 'last_change': '2024-09-12T22:31:36.386296+0000', 'last_active': '2024-09-12T22:31:36.386296+0000', 'last_peered': '2024-09-12T22:31:36.386296+0000', 'last_clean': '2024-09-12T22:31:36.386296+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:31:36.386296+0000', 'last_undegraded': '2024-09-12T22:31:36.386296+0000', 'last_fullsized': '2024-09-12T22:31:36.386296+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'last_clean_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:31:41.107 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1b is not active+clean 2024-09-12T22:31:41.107 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2024-09-12T22:31:35.390089+0000', 'last_change': '2024-09-12T22:31:35.390089+0000', 'last_active': '2024-09-12T22:31:35.383905+0000', 'last_peered': '2024-09-12T22:31:35.383905+0000', 'last_clean': '2024-09-12T22:31:35.383905+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:31:35.390089+0000', 'last_undegraded': '2024-09-12T22:31:35.390089+0000', 'last_fullsized': '2024-09-12T22:31:35.390089+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:31:35.383905+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:31:35.383905+0000', 'last_clean_scrub_stamp': '2024-09-12T22:31:35.383905+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T22:31:41.107 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1b is not active+clean 2024-09-12T22:31:41.107 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:31:36.386296+0000', 'last_change': '2024-09-12T22:31:36.386296+0000', 'last_active': '2024-09-12T22:31:36.386296+0000', 'last_peered': '2024-09-12T22:31:36.386296+0000', 'last_clean': '2024-09-12T22:31:36.386296+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:31:36.386296+0000', 'last_undegraded': '2024-09-12T22:31:36.386296+0000', 'last_fullsized': '2024-09-12T22:31:36.386296+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'last_clean_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:31:41.107 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1c is not active+clean 2024-09-12T22:31:41.107 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2024-09-12T22:31:35.389650+0000', 'last_change': '2024-09-12T22:31:35.389650+0000', 'last_active': '2024-09-12T22:31:35.383905+0000', 'last_peered': '2024-09-12T22:31:35.383905+0000', 'last_clean': '2024-09-12T22:31:35.383905+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:31:35.389650+0000', 'last_undegraded': '2024-09-12T22:31:35.389650+0000', 'last_fullsized': '2024-09-12T22:31:35.389650+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:31:35.383905+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:31:35.383905+0000', 'last_clean_scrub_stamp': '2024-09-12T22:31:35.383905+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T22:31:41.108 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1a is not active+clean 2024-09-12T22:31:41.108 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:31:36.386296+0000', 'last_change': '2024-09-12T22:31:36.386296+0000', 'last_active': '2024-09-12T22:31:36.386296+0000', 'last_peered': '2024-09-12T22:31:36.386296+0000', 'last_clean': '2024-09-12T22:31:36.386296+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:31:36.386296+0000', 'last_undegraded': '2024-09-12T22:31:36.386296+0000', 'last_fullsized': '2024-09-12T22:31:36.386296+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'last_clean_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:31:41.108 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1d is not active+clean 2024-09-12T22:31:41.108 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2024-09-12T22:31:35.390700+0000', 'last_change': '2024-09-12T22:31:35.390700+0000', 'last_active': '2024-09-12T22:31:35.383905+0000', 'last_peered': '2024-09-12T22:31:35.383905+0000', 'last_clean': '2024-09-12T22:31:35.383905+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:31:35.390700+0000', 'last_undegraded': '2024-09-12T22:31:35.390700+0000', 'last_fullsized': '2024-09-12T22:31:35.390700+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:31:35.383905+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:31:35.383905+0000', 'last_clean_scrub_stamp': '2024-09-12T22:31:35.383905+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T22:31:41.108 INFO:tasks.ceph.ceph_manager.ceph:PG 4.19 is not active+clean 2024-09-12T22:31:41.108 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:31:36.386296+0000', 'last_change': '2024-09-12T22:31:36.386296+0000', 'last_active': '2024-09-12T22:31:36.386296+0000', 'last_peered': '2024-09-12T22:31:36.386296+0000', 'last_clean': '2024-09-12T22:31:36.386296+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:31:36.386296+0000', 'last_undegraded': '2024-09-12T22:31:36.386296+0000', 'last_fullsized': '2024-09-12T22:31:36.386296+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'last_clean_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:31:41.108 INFO:tasks.ceph.ceph_manager.ceph:PG 4.18 is not active+clean 2024-09-12T22:31:41.108 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T22:31:36.386296+0000', 'last_change': '2024-09-12T22:31:36.386296+0000', 'last_active': '2024-09-12T22:31:36.386296+0000', 'last_peered': '2024-09-12T22:31:36.386296+0000', 'last_clean': '2024-09-12T22:31:36.386296+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T22:31:36.386296+0000', 'last_undegraded': '2024-09-12T22:31:36.386296+0000', 'last_fullsized': '2024-09-12T22:31:36.386296+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'last_clean_scrub_stamp': '2024-09-12T22:31:36.386296+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T22:31:41.109 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-12T22:31:41.488 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:31:41.489 INFO:teuthology.orchestra.run.smithi019.stdout:{"fsid":"957ce235-19cb-4350-8fee-febd6e3f2199","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":25,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":21,"num_osds":3,"num_up_osds":3,"osd_up_since":1726180285,"num_in_osds":3,"osd_in_since":1726180276,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":76},{"state_name":"creating+peering","count":20},{"state_name":"active+clean","count":9}],"num_pgs":105,"num_pools":4,"num_objects":4,"data_bytes":590387,"bytes_used":93184000,"bytes_avail":289817108480,"bytes_total":289910292480,"unknown_pgs_ratio":0.72380954027175903,"inactive_pgs_ratio":0.190476194024086,"write_bytes_sec":426,"read_op_per_sec":0,"write_op_per_sec":0},"fsmap":{"epoch":5,"btime":"2024-09-12T22:31:39:408658+0000","id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4239}],"up:standby":0},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2024-09-12T22:31:15.903939+0000","services":{}},"progress_events":{}} 2024-09-12T22:31:41.501 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-12T22:31:41.501 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T22:31:41.796 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:31:41.798 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-12T22:31:41.808 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2024-09-12T22:31:40.690819+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590969,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":214,"num_write_kb":3463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":170,"ondisk_log_size":170,"up":118,"acting":118,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":84,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":91044,"kb_used_data":1632,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283024476,"statfs":{"total":289910292480,"available":289817063424,"internally_reserved":0,"allocated":1671168,"data_stored":1336914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":91483471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":601,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.502936"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:31:38.411429+0000","last_change":"2024-09-12T22:31:37.417800+0000","last_active":"2024-09-12T22:31:38.411429+0000","last_peered":"2024-09-12T22:31:38.411429+0000","last_clean":"2024-09-12T22:31:38.411429+0000","last_became_active":"2024-09-12T22:31:37.417355+0000","last_became_peered":"2024-09-12T22:31:37.417355+0000","last_unstale":"2024-09-12T22:31:38.411429+0000","last_undegraded":"2024-09-12T22:31:38.411429+0000","last_fullsized":"2024-09-12T22:31:38.411429+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:10:17.326263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:31:38.412170+0000","last_change":"2024-09-12T22:31:37.412450+0000","last_active":"2024-09-12T22:31:38.412170+0000","last_peered":"2024-09-12T22:31:38.412170+0000","last_clean":"2024-09-12T22:31:38.412170+0000","last_became_active":"2024-09-12T22:31:37.412234+0000","last_became_peered":"2024-09-12T22:31:37.412234+0000","last_unstale":"2024-09-12T22:31:38.412170+0000","last_undegraded":"2024-09-12T22:31:38.412170+0000","last_fullsized":"2024-09-12T22:31:38.412170+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:15:59.559809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:31:38.411386+0000","last_change":"2024-09-12T22:31:37.417442+0000","last_active":"2024-09-12T22:31:38.411386+0000","last_peered":"2024-09-12T22:31:38.411386+0000","last_clean":"2024-09-12T22:31:38.411386+0000","last_became_active":"2024-09-12T22:31:37.417133+0000","last_became_peered":"2024-09-12T22:31:37.417133+0000","last_unstale":"2024-09-12T22:31:38.411386+0000","last_undegraded":"2024-09-12T22:31:38.411386+0000","last_fullsized":"2024-09-12T22:31:38.411386+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:36.458145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:31:38.410612+0000","last_change":"2024-09-12T22:31:37.410364+0000","last_active":"2024-09-12T22:31:38.410612+0000","last_peered":"2024-09-12T22:31:38.410612+0000","last_clean":"2024-09-12T22:31:38.410612+0000","last_became_active":"2024-09-12T22:31:37.409951+0000","last_became_peered":"2024-09-12T22:31:37.409951+0000","last_unstale":"2024-09-12T22:31:38.410612+0000","last_undegraded":"2024-09-12T22:31:38.410612+0000","last_fullsized":"2024-09-12T22:31:38.410612+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:39:17.785755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:31:38.411641+0000","last_change":"2024-09-12T22:31:37.411880+0000","last_active":"2024-09-12T22:31:38.411641+0000","last_peered":"2024-09-12T22:31:38.411641+0000","last_clean":"2024-09-12T22:31:38.411641+0000","last_became_active":"2024-09-12T22:31:37.410563+0000","last_became_peered":"2024-09-12T22:31:37.410563+0000","last_unstale":"2024-09-12T22:31:38.411641+0000","last_undegraded":"2024-09-12T22:31:38.411641+0000","last_fullsized":"2024-09-12T22:31:38.411641+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:47:52.560533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:31:38.411502+0000","last_change":"2024-09-12T22:31:37.414918+0000","last_active":"2024-09-12T22:31:38.411502+0000","last_peered":"2024-09-12T22:31:38.411502+0000","last_clean":"2024-09-12T22:31:38.411502+0000","last_became_active":"2024-09-12T22:31:37.414225+0000","last_became_peered":"2024-09-12T22:31:37.414225+0000","last_unstale":"2024-09-12T22:31:38.411502+0000","last_undegraded":"2024-09-12T22:31:38.411502+0000","last_fullsized":"2024-09-12T22:31:38.411502+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:56:14.649228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:31:38.410692+0000","last_change":"2024-09-12T22:31:37.415589+0000","last_active":"2024-09-12T22:31:38.410692+0000","last_peered":"2024-09-12T22:31:38.410692+0000","last_clean":"2024-09-12T22:31:38.410692+0000","last_became_active":"2024-09-12T22:31:37.415285+0000","last_became_peered":"2024-09-12T22:31:37.415285+0000","last_unstale":"2024-09-12T22:31:38.410692+0000","last_undegraded":"2024-09-12T22:31:38.410692+0000","last_fullsized":"2024-09-12T22:31:38.410692+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:06:25.913810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:31:35.389314+0000","last_change":"2024-09-12T22:31:35.389314+0000","last_active":"2024-09-12T22:31:35.383905+0000","last_peered":"2024-09-12T22:31:35.383905+0000","last_clean":"2024-09-12T22:31:35.383905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:35.389314+0000","last_undegraded":"2024-09-12T22:31:35.389314+0000","last_fullsized":"2024-09-12T22:31:35.389314+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:31:38.411173+0000","last_change":"2024-09-12T22:31:36.408563+0000","last_active":"2024-09-12T22:31:38.411173+0000","last_peered":"2024-09-12T22:31:38.411173+0000","last_clean":"2024-09-12T22:31:38.411173+0000","last_became_active":"2024-09-12T22:31:36.407447+0000","last_became_peered":"2024-09-12T22:31:36.407447+0000","last_unstale":"2024-09-12T22:31:38.411173+0000","last_undegraded":"2024-09-12T22:31:38.411173+0000","last_fullsized":"2024-09-12T22:31:38.411173+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:29:37.933109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:31:38.412069+0000","last_change":"2024-09-12T22:31:37.411680+0000","last_active":"2024-09-12T22:31:38.412069+0000","last_peered":"2024-09-12T22:31:38.412069+0000","last_clean":"2024-09-12T22:31:38.412069+0000","last_became_active":"2024-09-12T22:31:37.411168+0000","last_became_peered":"2024-09-12T22:31:37.411168+0000","last_unstale":"2024-09-12T22:31:38.412069+0000","last_undegraded":"2024-09-12T22:31:38.412069+0000","last_fullsized":"2024-09-12T22:31:38.412069+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:27.706282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:31:35.390845+0000","last_change":"2024-09-12T22:31:35.390845+0000","last_active":"2024-09-12T22:31:35.383905+0000","last_peered":"2024-09-12T22:31:35.383905+0000","last_clean":"2024-09-12T22:31:35.383905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:35.390845+0000","last_undegraded":"2024-09-12T22:31:35.390845+0000","last_fullsized":"2024-09-12T22:31:35.390845+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:31:38.411530+0000","last_change":"2024-09-12T22:31:37.411218+0000","last_active":"2024-09-12T22:31:38.411530+0000","last_peered":"2024-09-12T22:31:38.411530+0000","last_clean":"2024-09-12T22:31:38.411530+0000","last_became_active":"2024-09-12T22:31:37.409666+0000","last_became_peered":"2024-09-12T22:31:37.409666+0000","last_unstale":"2024-09-12T22:31:38.411530+0000","last_undegraded":"2024-09-12T22:31:38.411530+0000","last_fullsized":"2024-09-12T22:31:38.411530+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:45:34.230090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:31:35.388050+0000","last_change":"2024-09-12T22:31:35.388050+0000","last_active":"2024-09-12T22:31:35.383905+0000","last_peered":"2024-09-12T22:31:35.383905+0000","last_clean":"2024-09-12T22:31:35.383905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:35.388050+0000","last_undegraded":"2024-09-12T22:31:35.388050+0000","last_fullsized":"2024-09-12T22:31:35.388050+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:31:35.388658+0000","last_change":"2024-09-12T22:31:35.388658+0000","last_active":"2024-09-12T22:31:35.383905+0000","last_peered":"2024-09-12T22:31:35.383905+0000","last_clean":"2024-09-12T22:31:35.383905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:35.388658+0000","last_undegraded":"2024-09-12T22:31:35.388658+0000","last_fullsized":"2024-09-12T22:31:35.388658+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:31:35.390140+0000","last_change":"2024-09-12T22:31:35.390140+0000","last_active":"2024-09-12T22:31:35.383905+0000","last_peered":"2024-09-12T22:31:35.383905+0000","last_clean":"2024-09-12T22:31:35.383905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:35.390140+0000","last_undegraded":"2024-09-12T22:31:35.390140+0000","last_fullsized":"2024-09-12T22:31:35.390140+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:31:35.389214+0000","last_change":"2024-09-12T22:31:35.389214+0000","last_active":"2024-09-12T22:31:35.383905+0000","last_peered":"2024-09-12T22:31:35.383905+0000","last_clean":"2024-09-12T22:31:35.383905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:35.389214+0000","last_undegraded":"2024-09-12T22:31:35.389214+0000","last_fullsized":"2024-09-12T22:31:35.389214+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:31:35.388216+0000","last_change":"2024-09-12T22:31:35.388216+0000","last_active":"2024-09-12T22:31:35.383905+0000","last_peered":"2024-09-12T22:31:35.383905+0000","last_clean":"2024-09-12T22:31:35.383905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:35.388216+0000","last_undegraded":"2024-09-12T22:31:35.388216+0000","last_fullsized":"2024-09-12T22:31:35.388216+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:31:38.411709+0000","last_change":"2024-09-12T22:31:37.410303+0000","last_active":"2024-09-12T22:31:38.411709+0000","last_peered":"2024-09-12T22:31:38.411709+0000","last_clean":"2024-09-12T22:31:38.411709+0000","last_became_active":"2024-09-12T22:31:37.409607+0000","last_became_peered":"2024-09-12T22:31:37.409607+0000","last_unstale":"2024-09-12T22:31:38.411709+0000","last_undegraded":"2024-09-12T22:31:38.411709+0000","last_fullsized":"2024-09-12T22:31:38.411709+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:53:42.732654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:31:38.411860+0000","last_change":"2024-09-12T22:31:36.407974+0000","last_active":"2024-09-12T22:31:38.411860+0000","last_peered":"2024-09-12T22:31:38.411860+0000","last_clean":"2024-09-12T22:31:38.411860+0000","last_became_active":"2024-09-12T22:31:36.406955+0000","last_became_peered":"2024-09-12T22:31:36.406955+0000","last_unstale":"2024-09-12T22:31:38.411860+0000","last_undegraded":"2024-09-12T22:31:38.411860+0000","last_fullsized":"2024-09-12T22:31:38.411860+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:07:34.831264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:31:35.388079+0000","last_change":"2024-09-12T22:31:35.388079+0000","last_active":"2024-09-12T22:31:35.383905+0000","last_peered":"2024-09-12T22:31:35.383905+0000","last_clean":"2024-09-12T22:31:35.383905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:35.388079+0000","last_undegraded":"2024-09-12T22:31:35.388079+0000","last_fullsized":"2024-09-12T22:31:35.388079+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:31:35.390037+0000","last_change":"2024-09-12T22:31:35.390037+0000","last_active":"2024-09-12T22:31:35.383905+0000","last_peered":"2024-09-12T22:31:35.383905+0000","last_clean":"2024-09-12T22:31:35.383905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:35.390037+0000","last_undegraded":"2024-09-12T22:31:35.390037+0000","last_fullsized":"2024-09-12T22:31:35.390037+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:31:35.390875+0000","last_change":"2024-09-12T22:31:35.390875+0000","last_active":"2024-09-12T22:31:35.383905+0000","last_peered":"2024-09-12T22:31:35.383905+0000","last_clean":"2024-09-12T22:31:35.383905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:35.390875+0000","last_undegraded":"2024-09-12T22:31:35.390875+0000","last_fullsized":"2024-09-12T22:31:35.390875+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:31:38.411825+0000","last_change":"2024-09-12T22:31:37.417881+0000","last_active":"2024-09-12T22:31:38.411825+0000","last_peered":"2024-09-12T22:31:38.411825+0000","last_clean":"2024-09-12T22:31:38.411825+0000","last_became_active":"2024-09-12T22:31:37.417572+0000","last_became_peered":"2024-09-12T22:31:37.417572+0000","last_unstale":"2024-09-12T22:31:38.411825+0000","last_undegraded":"2024-09-12T22:31:38.411825+0000","last_fullsized":"2024-09-12T22:31:38.411825+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:19:16.367589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":218,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T22:31:35.390163+0000","last_change":"2024-09-12T22:31:27.631847+0000","last_active":"2024-09-12T22:31:35.390163+0000","last_peered":"2024-09-12T22:31:35.390163+0000","last_clean":"2024-09-12T22:31:35.390163+0000","last_became_active":"2024-09-12T22:31:27.631027+0000","last_became_peered":"2024-09-12T22:31:27.631027+0000","last_unstale":"2024-09-12T22:31:35.390163+0000","last_undegraded":"2024-09-12T22:31:35.390163+0000","last_fullsized":"2024-09-12T22:31:35.390163+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:26.229539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:26.229539+0000","last_clean_scrub_stamp":"2024-09-12T22:31:26.229539+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:59:24.181319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":22,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T22:31:35.390331+0000","last_change":"2024-09-12T22:31:34.286952+0000","last_active":"2024-09-12T22:31:35.390331+0000","last_peered":"2024-09-12T22:31:35.390331+0000","last_clean":"2024-09-12T22:31:35.390331+0000","last_became_active":"2024-09-12T22:31:32.283661+0000","last_became_peered":"2024-09-12T22:31:32.283661+0000","last_unstale":"2024-09-12T22:31:35.390331+0000","last_undegraded":"2024-09-12T22:31:35.390331+0000","last_fullsized":"2024-09-12T22:31:35.390331+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:21.681390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000621274,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:31:38.411238+0000","last_change":"2024-09-12T22:31:36.411275+0000","last_active":"2024-09-12T22:31:38.411238+0000","last_peered":"2024-09-12T22:31:38.411238+0000","last_clean":"2024-09-12T22:31:38.411238+0000","last_became_active":"2024-09-12T22:31:36.410595+0000","last_became_peered":"2024-09-12T22:31:36.410595+0000","last_unstale":"2024-09-12T22:31:38.411238+0000","last_undegraded":"2024-09-12T22:31:38.411238+0000","last_fullsized":"2024-09-12T22:31:38.411238+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:38:14.895625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":21,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T22:31:35.390344+0000","last_change":"2024-09-12T22:31:34.286642+0000","last_active":"2024-09-12T22:31:35.390344+0000","last_peered":"2024-09-12T22:31:35.390344+0000","last_clean":"2024-09-12T22:31:35.390344+0000","last_became_active":"2024-09-12T22:31:32.283601+0000","last_became_peered":"2024-09-12T22:31:32.283601+0000","last_unstale":"2024-09-12T22:31:35.390344+0000","last_undegraded":"2024-09-12T22:31:35.390344+0000","last_fullsized":"2024-09-12T22:31:35.390344+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:40:06.769540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037858999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:31:38.411132+0000","last_change":"2024-09-12T22:31:36.407395+0000","last_active":"2024-09-12T22:31:38.411132+0000","last_peered":"2024-09-12T22:31:38.411132+0000","last_clean":"2024-09-12T22:31:38.411132+0000","last_became_active":"2024-09-12T22:31:36.406770+0000","last_became_peered":"2024-09-12T22:31:36.406770+0000","last_unstale":"2024-09-12T22:31:38.411132+0000","last_undegraded":"2024-09-12T22:31:38.411132+0000","last_fullsized":"2024-09-12T22:31:38.411132+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:49:26.547848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":27,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:31:38.411228+0000","last_change":"2024-09-12T22:31:34.286394+0000","last_active":"2024-09-12T22:31:38.411228+0000","last_peered":"2024-09-12T22:31:38.411228+0000","last_clean":"2024-09-12T22:31:38.411228+0000","last_became_active":"2024-09-12T22:31:32.280062+0000","last_became_peered":"2024-09-12T22:31:32.280062+0000","last_unstale":"2024-09-12T22:31:38.411228+0000","last_undegraded":"2024-09-12T22:31:38.411228+0000","last_fullsized":"2024-09-12T22:31:38.411228+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:20:23.663838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039540700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.0","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:31:35.390126+0000","last_change":"2024-09-12T22:31:35.390126+0000","last_active":"2024-09-12T22:31:35.383905+0000","last_peered":"2024-09-12T22:31:35.383905+0000","last_clean":"2024-09-12T22:31:35.383905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:35.390126+0000","last_undegraded":"2024-09-12T22:31:35.390126+0000","last_fullsized":"2024-09-12T22:31:35.390126+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:31:38.411836+0000","last_change":"2024-09-12T22:31:37.417636+0000","last_active":"2024-09-12T22:31:38.411836+0000","last_peered":"2024-09-12T22:31:38.411836+0000","last_clean":"2024-09-12T22:31:38.411836+0000","last_became_active":"2024-09-12T22:31:37.417230+0000","last_became_peered":"2024-09-12T22:31:37.417230+0000","last_unstale":"2024-09-12T22:31:38.411836+0000","last_undegraded":"2024-09-12T22:31:38.411836+0000","last_fullsized":"2024-09-12T22:31:38.411836+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:44:29.729122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":23,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T22:31:35.390269+0000","last_change":"2024-09-12T22:31:34.286938+0000","last_active":"2024-09-12T22:31:35.390269+0000","last_peered":"2024-09-12T22:31:35.390269+0000","last_clean":"2024-09-12T22:31:35.390269+0000","last_became_active":"2024-09-12T22:31:32.282230+0000","last_became_peered":"2024-09-12T22:31:32.282230+0000","last_unstale":"2024-09-12T22:31:35.390269+0000","last_undegraded":"2024-09-12T22:31:35.390269+0000","last_fullsized":"2024-09-12T22:31:35.390269+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:11:05.988384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000615758,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.3","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:31:35.388119+0000","last_change":"2024-09-12T22:31:35.388119+0000","last_active":"2024-09-12T22:31:35.383905+0000","last_peered":"2024-09-12T22:31:35.383905+0000","last_clean":"2024-09-12T22:31:35.383905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:35.388119+0000","last_undegraded":"2024-09-12T22:31:35.388119+0000","last_fullsized":"2024-09-12T22:31:35.388119+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:31:38.411777+0000","last_change":"2024-09-12T22:31:37.414608+0000","last_active":"2024-09-12T22:31:38.411777+0000","last_peered":"2024-09-12T22:31:38.411777+0000","last_clean":"2024-09-12T22:31:38.411777+0000","last_became_active":"2024-09-12T22:31:37.414307+0000","last_became_peered":"2024-09-12T22:31:37.414307+0000","last_unstale":"2024-09-12T22:31:38.411777+0000","last_undegraded":"2024-09-12T22:31:38.411777+0000","last_fullsized":"2024-09-12T22:31:38.411777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:41:21.231511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:31:35.388378+0000","last_change":"2024-09-12T22:31:35.388378+0000","last_active":"2024-09-12T22:31:35.383905+0000","last_peered":"2024-09-12T22:31:35.383905+0000","last_clean":"2024-09-12T22:31:35.383905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:35.388378+0000","last_undegraded":"2024-09-12T22:31:35.388378+0000","last_fullsized":"2024-09-12T22:31:35.388378+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:31:38.411833+0000","last_change":"2024-09-12T22:31:34.286457+0000","last_active":"2024-09-12T22:31:38.411833+0000","last_peered":"2024-09-12T22:31:38.411833+0000","last_clean":"2024-09-12T22:31:38.411833+0000","last_became_active":"2024-09-12T22:31:32.280007+0000","last_became_peered":"2024-09-12T22:31:32.280007+0000","last_unstale":"2024-09-12T22:31:38.411833+0000","last_undegraded":"2024-09-12T22:31:38.411833+0000","last_fullsized":"2024-09-12T22:31:38.411833+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:09.068038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041972500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:31:38.411740+0000","last_change":"2024-09-12T22:31:36.410324+0000","last_active":"2024-09-12T22:31:38.411740+0000","last_peered":"2024-09-12T22:31:38.411740+0000","last_clean":"2024-09-12T22:31:38.411740+0000","last_became_active":"2024-09-12T22:31:36.409199+0000","last_became_peered":"2024-09-12T22:31:36.409199+0000","last_unstale":"2024-09-12T22:31:38.411740+0000","last_undegraded":"2024-09-12T22:31:38.411740+0000","last_fullsized":"2024-09-12T22:31:38.411740+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:06:54.608936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":21,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T22:31:35.391785+0000","last_change":"2024-09-12T22:31:34.839044+0000","last_active":"2024-09-12T22:31:35.391785+0000","last_peered":"2024-09-12T22:31:35.391785+0000","last_clean":"2024-09-12T22:31:35.391785+0000","last_became_active":"2024-09-12T22:31:32.279671+0000","last_became_peered":"2024-09-12T22:31:32.279671+0000","last_unstale":"2024-09-12T22:31:35.391785+0000","last_undegraded":"2024-09-12T22:31:35.391785+0000","last_fullsized":"2024-09-12T22:31:35.391785+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:27:49.809935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036776499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:31:38.412193+0000","last_change":"2024-09-12T22:31:36.409397+0000","last_active":"2024-09-12T22:31:38.412193+0000","last_peered":"2024-09-12T22:31:38.412193+0000","last_clean":"2024-09-12T22:31:38.412193+0000","last_became_active":"2024-09-12T22:31:36.408787+0000","last_became_peered":"2024-09-12T22:31:36.408787+0000","last_unstale":"2024-09-12T22:31:38.412193+0000","last_undegraded":"2024-09-12T22:31:38.412193+0000","last_fullsized":"2024-09-12T22:31:38.412193+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:29:03.467352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":27,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:31:38.412099+0000","last_change":"2024-09-12T22:31:34.286639+0000","last_active":"2024-09-12T22:31:38.412099+0000","last_peered":"2024-09-12T22:31:38.412099+0000","last_clean":"2024-09-12T22:31:38.412099+0000","last_became_active":"2024-09-12T22:31:32.280092+0000","last_became_peered":"2024-09-12T22:31:32.280092+0000","last_unstale":"2024-09-12T22:31:38.412099+0000","last_undegraded":"2024-09-12T22:31:38.412099+0000","last_fullsized":"2024-09-12T22:31:38.412099+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:02:40.821530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058589999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:31:38.410913+0000","last_change":"2024-09-12T22:31:37.411152+0000","last_active":"2024-09-12T22:31:38.410913+0000","last_peered":"2024-09-12T22:31:38.410913+0000","last_clean":"2024-09-12T22:31:38.410913+0000","last_became_active":"2024-09-12T22:31:37.410558+0000","last_became_peered":"2024-09-12T22:31:37.410558+0000","last_unstale":"2024-09-12T22:31:38.410913+0000","last_undegraded":"2024-09-12T22:31:38.410913+0000","last_fullsized":"2024-09-12T22:31:38.410913+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:14:29.892478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:31:39.400416+0000","last_change":"2024-09-12T22:31:36.407460+0000","last_active":"2024-09-12T22:31:39.400416+0000","last_peered":"2024-09-12T22:31:39.400416+0000","last_clean":"2024-09-12T22:31:39.400416+0000","last_became_active":"2024-09-12T22:31:36.406729+0000","last_became_peered":"2024-09-12T22:31:36.406729+0000","last_unstale":"2024-09-12T22:31:39.400416+0000","last_undegraded":"2024-09-12T22:31:39.400416+0000","last_fullsized":"2024-09-12T22:31:39.400416+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:27:58.012573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":21,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T22:31:35.390567+0000","last_change":"2024-09-12T22:31:34.286699+0000","last_active":"2024-09-12T22:31:35.390567+0000","last_peered":"2024-09-12T22:31:35.390567+0000","last_clean":"2024-09-12T22:31:35.390567+0000","last_became_active":"2024-09-12T22:31:32.283606+0000","last_became_peered":"2024-09-12T22:31:32.283606+0000","last_unstale":"2024-09-12T22:31:35.390567+0000","last_undegraded":"2024-09-12T22:31:35.390567+0000","last_fullsized":"2024-09-12T22:31:35.390567+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:09:32.050798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000382109,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:31:35.389280+0000","last_change":"2024-09-12T22:31:35.389280+0000","last_active":"2024-09-12T22:31:35.383905+0000","last_peered":"2024-09-12T22:31:35.383905+0000","last_clean":"2024-09-12T22:31:35.383905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:35.389280+0000","last_undegraded":"2024-09-12T22:31:35.389280+0000","last_fullsized":"2024-09-12T22:31:35.389280+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:31:38.410899+0000","last_change":"2024-09-12T22:31:37.414914+0000","last_active":"2024-09-12T22:31:38.410899+0000","last_peered":"2024-09-12T22:31:38.410899+0000","last_clean":"2024-09-12T22:31:38.410899+0000","last_became_active":"2024-09-12T22:31:37.414535+0000","last_became_peered":"2024-09-12T22:31:37.414535+0000","last_unstale":"2024-09-12T22:31:38.410899+0000","last_undegraded":"2024-09-12T22:31:38.410899+0000","last_fullsized":"2024-09-12T22:31:38.410899+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:14:37.010786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:31:35.389979+0000","last_change":"2024-09-12T22:31:35.389979+0000","last_active":"2024-09-12T22:31:35.383905+0000","last_peered":"2024-09-12T22:31:35.383905+0000","last_clean":"2024-09-12T22:31:35.383905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:35.389979+0000","last_undegraded":"2024-09-12T22:31:35.389979+0000","last_fullsized":"2024-09-12T22:31:35.389979+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:31:35.388390+0000","last_change":"2024-09-12T22:31:35.388390+0000","last_active":"2024-09-12T22:31:35.383905+0000","last_peered":"2024-09-12T22:31:35.383905+0000","last_clean":"2024-09-12T22:31:35.383905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:35.388390+0000","last_undegraded":"2024-09-12T22:31:35.388390+0000","last_fullsized":"2024-09-12T22:31:35.388390+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:31:38.410787+0000","last_change":"2024-09-12T22:31:37.411254+0000","last_active":"2024-09-12T22:31:38.410787+0000","last_peered":"2024-09-12T22:31:38.410787+0000","last_clean":"2024-09-12T22:31:38.410787+0000","last_became_active":"2024-09-12T22:31:37.410404+0000","last_became_peered":"2024-09-12T22:31:37.410404+0000","last_unstale":"2024-09-12T22:31:38.410787+0000","last_undegraded":"2024-09-12T22:31:38.410787+0000","last_fullsized":"2024-09-12T22:31:38.410787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:42:00.856616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:31:38.412111+0000","last_change":"2024-09-12T22:31:36.408390+0000","last_active":"2024-09-12T22:31:38.412111+0000","last_peered":"2024-09-12T22:31:38.412111+0000","last_clean":"2024-09-12T22:31:38.412111+0000","last_became_active":"2024-09-12T22:31:36.407062+0000","last_became_peered":"2024-09-12T22:31:36.407062+0000","last_unstale":"2024-09-12T22:31:38.412111+0000","last_undegraded":"2024-09-12T22:31:38.412111+0000","last_fullsized":"2024-09-12T22:31:38.412111+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:09:10.618195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:31:38.410987+0000","last_change":"2024-09-12T22:31:37.416629+0000","last_active":"2024-09-12T22:31:38.410987+0000","last_peered":"2024-09-12T22:31:38.410987+0000","last_clean":"2024-09-12T22:31:38.410987+0000","last_became_active":"2024-09-12T22:31:37.416387+0000","last_became_peered":"2024-09-12T22:31:37.416387+0000","last_unstale":"2024-09-12T22:31:38.410987+0000","last_undegraded":"2024-09-12T22:31:38.410987+0000","last_fullsized":"2024-09-12T22:31:38.410987+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:59:52.020560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:31:38.411051+0000","last_change":"2024-09-12T22:31:36.409466+0000","last_active":"2024-09-12T22:31:38.411051+0000","last_peered":"2024-09-12T22:31:38.411051+0000","last_clean":"2024-09-12T22:31:38.411051+0000","last_became_active":"2024-09-12T22:31:36.408796+0000","last_became_peered":"2024-09-12T22:31:36.408796+0000","last_unstale":"2024-09-12T22:31:38.411051+0000","last_undegraded":"2024-09-12T22:31:38.411051+0000","last_fullsized":"2024-09-12T22:31:38.411051+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:03:39.648159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:31:38.411767+0000","last_change":"2024-09-12T22:31:37.411183+0000","last_active":"2024-09-12T22:31:38.411767+0000","last_peered":"2024-09-12T22:31:38.411767+0000","last_clean":"2024-09-12T22:31:38.411767+0000","last_became_active":"2024-09-12T22:31:37.409796+0000","last_became_peered":"2024-09-12T22:31:37.409796+0000","last_unstale":"2024-09-12T22:31:38.411767+0000","last_undegraded":"2024-09-12T22:31:38.411767+0000","last_fullsized":"2024-09-12T22:31:38.411767+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:20:35.779810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:31:38.410929+0000","last_change":"2024-09-12T22:31:36.407402+0000","last_active":"2024-09-12T22:31:38.410929+0000","last_peered":"2024-09-12T22:31:38.410929+0000","last_clean":"2024-09-12T22:31:38.410929+0000","last_became_active":"2024-09-12T22:31:36.406681+0000","last_became_peered":"2024-09-12T22:31:36.406681+0000","last_unstale":"2024-09-12T22:31:38.410929+0000","last_undegraded":"2024-09-12T22:31:38.410929+0000","last_fullsized":"2024-09-12T22:31:38.410929+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:39:39.362573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:31:35.390064+0000","last_change":"2024-09-12T22:31:35.390064+0000","last_active":"2024-09-12T22:31:35.383905+0000","last_peered":"2024-09-12T22:31:35.383905+0000","last_clean":"2024-09-12T22:31:35.383905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:35.390064+0000","last_undegraded":"2024-09-12T22:31:35.390064+0000","last_fullsized":"2024-09-12T22:31:35.390064+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:31:35.390089+0000","last_change":"2024-09-12T22:31:35.390089+0000","last_active":"2024-09-12T22:31:35.383905+0000","last_peered":"2024-09-12T22:31:35.383905+0000","last_clean":"2024-09-12T22:31:35.383905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:35.390089+0000","last_undegraded":"2024-09-12T22:31:35.390089+0000","last_fullsized":"2024-09-12T22:31:35.390089+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:31:35.389650+0000","last_change":"2024-09-12T22:31:35.389650+0000","last_active":"2024-09-12T22:31:35.383905+0000","last_peered":"2024-09-12T22:31:35.383905+0000","last_clean":"2024-09-12T22:31:35.383905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:35.389650+0000","last_undegraded":"2024-09-12T22:31:35.389650+0000","last_fullsized":"2024-09-12T22:31:35.389650+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-12T22:31:35.390700+0000","last_change":"2024-09-12T22:31:35.390700+0000","last_active":"2024-09-12T22:31:35.383905+0000","last_peered":"2024-09-12T22:31:35.383905+0000","last_clean":"2024-09-12T22:31:35.383905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:35.390700+0000","last_undegraded":"2024-09-12T22:31:35.390700+0000","last_fullsized":"2024-09-12T22:31:35.390700+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:31:38.411880+0000","last_change":"2024-09-12T22:31:36.410371+0000","last_active":"2024-09-12T22:31:38.411880+0000","last_peered":"2024-09-12T22:31:38.411880+0000","last_clean":"2024-09-12T22:31:38.411880+0000","last_became_active":"2024-09-12T22:31:36.409428+0000","last_became_peered":"2024-09-12T22:31:36.409428+0000","last_unstale":"2024-09-12T22:31:38.411880+0000","last_undegraded":"2024-09-12T22:31:38.411880+0000","last_fullsized":"2024-09-12T22:31:38.411880+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:27:22.817690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T22:31:36.386296+0000","last_change":"2024-09-12T22:31:36.386296+0000","last_active":"2024-09-12T22:31:36.386296+0000","last_peered":"2024-09-12T22:31:36.386296+0000","last_clean":"2024-09-12T22:31:36.386296+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T22:31:36.386296+0000","last_undegraded":"2024-09-12T22:31:36.386296+0000","last_fullsized":"2024-09-12T22:31:36.386296+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:31:38.412051+0000","last_change":"2024-09-12T22:31:36.407945+0000","last_active":"2024-09-12T22:31:38.412051+0000","last_peered":"2024-09-12T22:31:38.412051+0000","last_clean":"2024-09-12T22:31:38.412051+0000","last_became_active":"2024-09-12T22:31:36.406959+0000","last_became_peered":"2024-09-12T22:31:36.406959+0000","last_unstale":"2024-09-12T22:31:38.412051+0000","last_undegraded":"2024-09-12T22:31:38.412051+0000","last_fullsized":"2024-09-12T22:31:38.412051+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:26:33.155850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":36,"acting":36,"num_store_stats":1},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":582,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10,"ondisk_log_size":10,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705669,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31916,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339924,"statfs":{"total":96636764160,"available":96604082176,"internally_reserved":0,"allocated":745472,"data_stored":637474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705669,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31912,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339928,"statfs":{"total":96636764160,"available":96604086272,"internally_reserved":0,"allocated":741376,"data_stored":637455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738374,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":184320,"data_stored":61985,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T22:31:44.813 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T22:31:45.122 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:31:45.124 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-12T22:31:45.132 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":29,"stamp":"2024-09-12T22:31:44.189532+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":250,"num_write_kb":3476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":91160,"kb_used_data":1744,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283024360,"statfs":{"total":289910292480,"available":289816944640,"internally_reserved":0,"allocated":1785856,"data_stored":1373912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":91483471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.793490"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.765207+0000","last_change":"2024-09-12T22:31:37.416383+0000","last_active":"2024-09-12T22:31:40.765207+0000","last_peered":"2024-09-12T22:31:40.765207+0000","last_clean":"2024-09-12T22:31:40.765207+0000","last_became_active":"2024-09-12T22:31:37.415457+0000","last_became_peered":"2024-09-12T22:31:37.415457+0000","last_unstale":"2024-09-12T22:31:40.765207+0000","last_undegraded":"2024-09-12T22:31:40.765207+0000","last_fullsized":"2024-09-12T22:31:40.765207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:08:29.199832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.764838+0000","last_change":"2024-09-12T22:31:37.415228+0000","last_active":"2024-09-12T22:31:40.764838+0000","last_peered":"2024-09-12T22:31:40.764838+0000","last_clean":"2024-09-12T22:31:40.764838+0000","last_became_active":"2024-09-12T22:31:37.414765+0000","last_became_peered":"2024-09-12T22:31:37.414765+0000","last_unstale":"2024-09-12T22:31:40.764838+0000","last_undegraded":"2024-09-12T22:31:40.764838+0000","last_fullsized":"2024-09-12T22:31:40.764838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:50:48.426898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.696458+0000","last_change":"2024-09-12T22:31:37.419916+0000","last_active":"2024-09-12T22:31:40.696458+0000","last_peered":"2024-09-12T22:31:40.696458+0000","last_clean":"2024-09-12T22:31:40.696458+0000","last_became_active":"2024-09-12T22:31:37.418790+0000","last_became_peered":"2024-09-12T22:31:37.418790+0000","last_unstale":"2024-09-12T22:31:40.696458+0000","last_undegraded":"2024-09-12T22:31:40.696458+0000","last_fullsized":"2024-09-12T22:31:40.696458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:05:00.440878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.696238+0000","last_change":"2024-09-12T22:31:37.413094+0000","last_active":"2024-09-12T22:31:40.696238+0000","last_peered":"2024-09-12T22:31:40.696238+0000","last_clean":"2024-09-12T22:31:40.696238+0000","last_became_active":"2024-09-12T22:31:37.412746+0000","last_became_peered":"2024-09-12T22:31:37.412746+0000","last_unstale":"2024-09-12T22:31:40.696238+0000","last_undegraded":"2024-09-12T22:31:40.696238+0000","last_fullsized":"2024-09-12T22:31:40.696238+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:32:14.415120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.764831+0000","last_change":"2024-09-12T22:31:37.411276+0000","last_active":"2024-09-12T22:31:40.764831+0000","last_peered":"2024-09-12T22:31:40.764831+0000","last_clean":"2024-09-12T22:31:40.764831+0000","last_became_active":"2024-09-12T22:31:37.410380+0000","last_became_peered":"2024-09-12T22:31:37.410380+0000","last_unstale":"2024-09-12T22:31:40.764831+0000","last_undegraded":"2024-09-12T22:31:40.764831+0000","last_fullsized":"2024-09-12T22:31:40.764831+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:12:50.090880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.695814+0000","last_change":"2024-09-12T22:31:37.409177+0000","last_active":"2024-09-12T22:31:40.695814+0000","last_peered":"2024-09-12T22:31:40.695814+0000","last_clean":"2024-09-12T22:31:40.695814+0000","last_became_active":"2024-09-12T22:31:37.408811+0000","last_became_peered":"2024-09-12T22:31:37.408811+0000","last_unstale":"2024-09-12T22:31:40.695814+0000","last_undegraded":"2024-09-12T22:31:40.695814+0000","last_fullsized":"2024-09-12T22:31:40.695814+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:17:21.695079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.695805+0000","last_change":"2024-09-12T22:31:37.413023+0000","last_active":"2024-09-12T22:31:40.695805+0000","last_peered":"2024-09-12T22:31:40.695805+0000","last_clean":"2024-09-12T22:31:40.695805+0000","last_became_active":"2024-09-12T22:31:37.412691+0000","last_became_peered":"2024-09-12T22:31:37.412691+0000","last_unstale":"2024-09-12T22:31:40.695805+0000","last_undegraded":"2024-09-12T22:31:40.695805+0000","last_fullsized":"2024-09-12T22:31:40.695805+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:02:36.454134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.695562+0000","last_change":"2024-09-12T22:31:37.411074+0000","last_active":"2024-09-12T22:31:40.695562+0000","last_peered":"2024-09-12T22:31:40.695562+0000","last_clean":"2024-09-12T22:31:40.695562+0000","last_became_active":"2024-09-12T22:31:37.410633+0000","last_became_peered":"2024-09-12T22:31:37.410633+0000","last_unstale":"2024-09-12T22:31:40.695562+0000","last_undegraded":"2024-09-12T22:31:40.695562+0000","last_fullsized":"2024-09-12T22:31:40.695562+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:39:20.383152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:31:38.411429+0000","last_change":"2024-09-12T22:31:37.417800+0000","last_active":"2024-09-12T22:31:38.411429+0000","last_peered":"2024-09-12T22:31:38.411429+0000","last_clean":"2024-09-12T22:31:38.411429+0000","last_became_active":"2024-09-12T22:31:37.417355+0000","last_became_peered":"2024-09-12T22:31:37.417355+0000","last_unstale":"2024-09-12T22:31:38.411429+0000","last_undegraded":"2024-09-12T22:31:38.411429+0000","last_fullsized":"2024-09-12T22:31:38.411429+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:10:17.326263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.765115+0000","last_change":"2024-09-12T22:31:37.415967+0000","last_active":"2024-09-12T22:31:40.765115+0000","last_peered":"2024-09-12T22:31:40.765115+0000","last_clean":"2024-09-12T22:31:40.765115+0000","last_became_active":"2024-09-12T22:31:37.415003+0000","last_became_peered":"2024-09-12T22:31:37.415003+0000","last_unstale":"2024-09-12T22:31:40.765115+0000","last_undegraded":"2024-09-12T22:31:40.765115+0000","last_fullsized":"2024-09-12T22:31:40.765115+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:42:32.307876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.696536+0000","last_change":"2024-09-12T22:31:37.414469+0000","last_active":"2024-09-12T22:31:40.696536+0000","last_peered":"2024-09-12T22:31:40.696536+0000","last_clean":"2024-09-12T22:31:40.696536+0000","last_became_active":"2024-09-12T22:31:37.414165+0000","last_became_peered":"2024-09-12T22:31:37.414165+0000","last_unstale":"2024-09-12T22:31:40.696536+0000","last_undegraded":"2024-09-12T22:31:40.696536+0000","last_fullsized":"2024-09-12T22:31:40.696536+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:25:38.148636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.764751+0000","last_change":"2024-09-12T22:31:37.413051+0000","last_active":"2024-09-12T22:31:40.764751+0000","last_peered":"2024-09-12T22:31:40.764751+0000","last_clean":"2024-09-12T22:31:40.764751+0000","last_became_active":"2024-09-12T22:31:37.412614+0000","last_became_peered":"2024-09-12T22:31:37.412614+0000","last_unstale":"2024-09-12T22:31:40.764751+0000","last_undegraded":"2024-09-12T22:31:40.764751+0000","last_fullsized":"2024-09-12T22:31:40.764751+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:07:48.430262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.764626+0000","last_change":"2024-09-12T22:31:37.413063+0000","last_active":"2024-09-12T22:31:40.764626+0000","last_peered":"2024-09-12T22:31:40.764626+0000","last_clean":"2024-09-12T22:31:40.764626+0000","last_became_active":"2024-09-12T22:31:37.412118+0000","last_became_peered":"2024-09-12T22:31:37.412118+0000","last_unstale":"2024-09-12T22:31:40.764626+0000","last_undegraded":"2024-09-12T22:31:40.764626+0000","last_fullsized":"2024-09-12T22:31:40.764626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:14:17.750388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.695833+0000","last_change":"2024-09-12T22:31:37.414084+0000","last_active":"2024-09-12T22:31:40.695833+0000","last_peered":"2024-09-12T22:31:40.695833+0000","last_clean":"2024-09-12T22:31:40.695833+0000","last_became_active":"2024-09-12T22:31:37.413671+0000","last_became_peered":"2024-09-12T22:31:37.413671+0000","last_unstale":"2024-09-12T22:31:40.695833+0000","last_undegraded":"2024-09-12T22:31:40.695833+0000","last_fullsized":"2024-09-12T22:31:40.695833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:08:29.199832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.695836+0000","last_change":"2024-09-12T22:31:37.413482+0000","last_active":"2024-09-12T22:31:40.695836+0000","last_peered":"2024-09-12T22:31:40.695836+0000","last_clean":"2024-09-12T22:31:40.695836+0000","last_became_active":"2024-09-12T22:31:37.413195+0000","last_became_peered":"2024-09-12T22:31:37.413195+0000","last_unstale":"2024-09-12T22:31:40.695836+0000","last_undegraded":"2024-09-12T22:31:40.695836+0000","last_fullsized":"2024-09-12T22:31:40.695836+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:22:40.226076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.695670+0000","last_change":"2024-09-12T22:31:37.411006+0000","last_active":"2024-09-12T22:31:40.695670+0000","last_peered":"2024-09-12T22:31:40.695670+0000","last_clean":"2024-09-12T22:31:40.695670+0000","last_became_active":"2024-09-12T22:31:37.410557+0000","last_became_peered":"2024-09-12T22:31:37.410557+0000","last_unstale":"2024-09-12T22:31:40.695670+0000","last_undegraded":"2024-09-12T22:31:40.695670+0000","last_fullsized":"2024-09-12T22:31:40.695670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:08:21.709770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:31:38.412170+0000","last_change":"2024-09-12T22:31:37.412450+0000","last_active":"2024-09-12T22:31:38.412170+0000","last_peered":"2024-09-12T22:31:38.412170+0000","last_clean":"2024-09-12T22:31:38.412170+0000","last_became_active":"2024-09-12T22:31:37.412234+0000","last_became_peered":"2024-09-12T22:31:37.412234+0000","last_unstale":"2024-09-12T22:31:38.412170+0000","last_undegraded":"2024-09-12T22:31:38.412170+0000","last_fullsized":"2024-09-12T22:31:38.412170+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:15:59.559809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.765237+0000","last_change":"2024-09-12T22:31:37.414144+0000","last_active":"2024-09-12T22:31:40.765237+0000","last_peered":"2024-09-12T22:31:40.765237+0000","last_clean":"2024-09-12T22:31:40.765237+0000","last_became_active":"2024-09-12T22:31:37.413670+0000","last_became_peered":"2024-09-12T22:31:37.413670+0000","last_unstale":"2024-09-12T22:31:40.765237+0000","last_undegraded":"2024-09-12T22:31:40.765237+0000","last_fullsized":"2024-09-12T22:31:40.765237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:42:51.694128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:31:38.411386+0000","last_change":"2024-09-12T22:31:37.417442+0000","last_active":"2024-09-12T22:31:38.411386+0000","last_peered":"2024-09-12T22:31:38.411386+0000","last_clean":"2024-09-12T22:31:38.411386+0000","last_became_active":"2024-09-12T22:31:37.417133+0000","last_became_peered":"2024-09-12T22:31:37.417133+0000","last_unstale":"2024-09-12T22:31:38.411386+0000","last_undegraded":"2024-09-12T22:31:38.411386+0000","last_fullsized":"2024-09-12T22:31:38.411386+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:36.458145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.696321+0000","last_change":"2024-09-12T22:31:37.414235+0000","last_active":"2024-09-12T22:31:40.696321+0000","last_peered":"2024-09-12T22:31:40.696321+0000","last_clean":"2024-09-12T22:31:40.696321+0000","last_became_active":"2024-09-12T22:31:37.413786+0000","last_became_peered":"2024-09-12T22:31:37.413786+0000","last_unstale":"2024-09-12T22:31:40.696321+0000","last_undegraded":"2024-09-12T22:31:40.696321+0000","last_fullsized":"2024-09-12T22:31:40.696321+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:21:11.866973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.696190+0000","last_change":"2024-09-12T22:31:37.415382+0000","last_active":"2024-09-12T22:31:40.696190+0000","last_peered":"2024-09-12T22:31:40.696190+0000","last_clean":"2024-09-12T22:31:40.696190+0000","last_became_active":"2024-09-12T22:31:37.414319+0000","last_became_peered":"2024-09-12T22:31:37.414319+0000","last_unstale":"2024-09-12T22:31:40.696190+0000","last_undegraded":"2024-09-12T22:31:40.696190+0000","last_fullsized":"2024-09-12T22:31:40.696190+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:26:25.578693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.764450+0000","last_change":"2024-09-12T22:31:37.412046+0000","last_active":"2024-09-12T22:31:40.764450+0000","last_peered":"2024-09-12T22:31:40.764450+0000","last_clean":"2024-09-12T22:31:40.764450+0000","last_became_active":"2024-09-12T22:31:37.411623+0000","last_became_peered":"2024-09-12T22:31:37.411623+0000","last_unstale":"2024-09-12T22:31:40.764450+0000","last_undegraded":"2024-09-12T22:31:40.764450+0000","last_fullsized":"2024-09-12T22:31:40.764450+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:24:15.504358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:31:38.410612+0000","last_change":"2024-09-12T22:31:37.410364+0000","last_active":"2024-09-12T22:31:38.410612+0000","last_peered":"2024-09-12T22:31:38.410612+0000","last_clean":"2024-09-12T22:31:38.410612+0000","last_became_active":"2024-09-12T22:31:37.409951+0000","last_became_peered":"2024-09-12T22:31:37.409951+0000","last_unstale":"2024-09-12T22:31:38.410612+0000","last_undegraded":"2024-09-12T22:31:38.410612+0000","last_fullsized":"2024-09-12T22:31:38.410612+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:39:17.785755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.764159+0000","last_change":"2024-09-12T22:31:37.415240+0000","last_active":"2024-09-12T22:31:40.764159+0000","last_peered":"2024-09-12T22:31:40.764159+0000","last_clean":"2024-09-12T22:31:40.764159+0000","last_became_active":"2024-09-12T22:31:37.414069+0000","last_became_peered":"2024-09-12T22:31:37.414069+0000","last_unstale":"2024-09-12T22:31:40.764159+0000","last_undegraded":"2024-09-12T22:31:40.764159+0000","last_fullsized":"2024-09-12T22:31:40.764159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:16:35.027772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.765207+0000","last_change":"2024-09-12T22:31:37.415309+0000","last_active":"2024-09-12T22:31:40.765207+0000","last_peered":"2024-09-12T22:31:40.765207+0000","last_clean":"2024-09-12T22:31:40.765207+0000","last_became_active":"2024-09-12T22:31:37.414792+0000","last_became_peered":"2024-09-12T22:31:37.414792+0000","last_unstale":"2024-09-12T22:31:40.765207+0000","last_undegraded":"2024-09-12T22:31:40.765207+0000","last_fullsized":"2024-09-12T22:31:40.765207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:08:07.115355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:31:38.411641+0000","last_change":"2024-09-12T22:31:37.411880+0000","last_active":"2024-09-12T22:31:38.411641+0000","last_peered":"2024-09-12T22:31:38.411641+0000","last_clean":"2024-09-12T22:31:38.411641+0000","last_became_active":"2024-09-12T22:31:37.410563+0000","last_became_peered":"2024-09-12T22:31:37.410563+0000","last_unstale":"2024-09-12T22:31:38.411641+0000","last_undegraded":"2024-09-12T22:31:38.411641+0000","last_fullsized":"2024-09-12T22:31:38.411641+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:47:52.560533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.696794+0000","last_change":"2024-09-12T22:31:37.419603+0000","last_active":"2024-09-12T22:31:40.696794+0000","last_peered":"2024-09-12T22:31:40.696794+0000","last_clean":"2024-09-12T22:31:40.696794+0000","last_became_active":"2024-09-12T22:31:37.418725+0000","last_became_peered":"2024-09-12T22:31:37.418725+0000","last_unstale":"2024-09-12T22:31:40.696794+0000","last_undegraded":"2024-09-12T22:31:40.696794+0000","last_fullsized":"2024-09-12T22:31:40.696794+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:02:44.183545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.765102+0000","last_change":"2024-09-12T22:31:37.412884+0000","last_active":"2024-09-12T22:31:40.765102+0000","last_peered":"2024-09-12T22:31:40.765102+0000","last_clean":"2024-09-12T22:31:40.765102+0000","last_became_active":"2024-09-12T22:31:37.412469+0000","last_became_peered":"2024-09-12T22:31:37.412469+0000","last_unstale":"2024-09-12T22:31:40.765102+0000","last_undegraded":"2024-09-12T22:31:40.765102+0000","last_fullsized":"2024-09-12T22:31:40.765102+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:05:00.440878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:31:38.411502+0000","last_change":"2024-09-12T22:31:37.414918+0000","last_active":"2024-09-12T22:31:38.411502+0000","last_peered":"2024-09-12T22:31:38.411502+0000","last_clean":"2024-09-12T22:31:38.411502+0000","last_became_active":"2024-09-12T22:31:37.414225+0000","last_became_peered":"2024-09-12T22:31:37.414225+0000","last_unstale":"2024-09-12T22:31:38.411502+0000","last_undegraded":"2024-09-12T22:31:38.411502+0000","last_fullsized":"2024-09-12T22:31:38.411502+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:56:14.649228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.764655+0000","last_change":"2024-09-12T22:31:37.411569+0000","last_active":"2024-09-12T22:31:40.764655+0000","last_peered":"2024-09-12T22:31:40.764655+0000","last_clean":"2024-09-12T22:31:40.764655+0000","last_became_active":"2024-09-12T22:31:37.410619+0000","last_became_peered":"2024-09-12T22:31:37.410619+0000","last_unstale":"2024-09-12T22:31:40.764655+0000","last_undegraded":"2024-09-12T22:31:40.764655+0000","last_fullsized":"2024-09-12T22:31:40.764655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:30:01.012271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:31:38.410692+0000","last_change":"2024-09-12T22:31:37.415589+0000","last_active":"2024-09-12T22:31:38.410692+0000","last_peered":"2024-09-12T22:31:38.410692+0000","last_clean":"2024-09-12T22:31:38.410692+0000","last_became_active":"2024-09-12T22:31:37.415285+0000","last_became_peered":"2024-09-12T22:31:37.415285+0000","last_unstale":"2024-09-12T22:31:38.410692+0000","last_undegraded":"2024-09-12T22:31:38.410692+0000","last_fullsized":"2024-09-12T22:31:38.410692+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:06:25.913810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.695680+0000","last_change":"2024-09-12T22:31:37.415190+0000","last_active":"2024-09-12T22:31:40.695680+0000","last_peered":"2024-09-12T22:31:40.695680+0000","last_clean":"2024-09-12T22:31:40.695680+0000","last_became_active":"2024-09-12T22:31:37.414265+0000","last_became_peered":"2024-09-12T22:31:37.414265+0000","last_unstale":"2024-09-12T22:31:40.695680+0000","last_undegraded":"2024-09-12T22:31:40.695680+0000","last_fullsized":"2024-09-12T22:31:40.695680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:07:02.173590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.765000+0000","last_change":"2024-09-12T22:31:37.409362+0000","last_active":"2024-09-12T22:31:40.765000+0000","last_peered":"2024-09-12T22:31:40.765000+0000","last_clean":"2024-09-12T22:31:40.765000+0000","last_became_active":"2024-09-12T22:31:37.408896+0000","last_became_peered":"2024-09-12T22:31:37.408896+0000","last_unstale":"2024-09-12T22:31:40.765000+0000","last_undegraded":"2024-09-12T22:31:40.765000+0000","last_fullsized":"2024-09-12T22:31:40.765000+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:17:21.695079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"19'2","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.696151+0000","last_change":"2024-09-12T22:31:36.412082+0000","last_active":"2024-09-12T22:31:40.696151+0000","last_peered":"2024-09-12T22:31:40.696151+0000","last_clean":"2024-09-12T22:31:40.696151+0000","last_became_active":"2024-09-12T22:31:36.410871+0000","last_became_peered":"2024-09-12T22:31:36.410871+0000","last_unstale":"2024-09-12T22:31:40.696151+0000","last_undegraded":"2024-09-12T22:31:40.696151+0000","last_fullsized":"2024-09-12T22:31:40.696151+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:30:49.127253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.765123+0000","last_change":"2024-09-12T22:31:37.411790+0000","last_active":"2024-09-12T22:31:40.765123+0000","last_peered":"2024-09-12T22:31:40.765123+0000","last_clean":"2024-09-12T22:31:40.765123+0000","last_became_active":"2024-09-12T22:31:37.411414+0000","last_became_peered":"2024-09-12T22:31:37.411414+0000","last_unstale":"2024-09-12T22:31:40.765123+0000","last_undegraded":"2024-09-12T22:31:40.765123+0000","last_fullsized":"2024-09-12T22:31:40.765123+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:22:40.226076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:31:38.411173+0000","last_change":"2024-09-12T22:31:36.408563+0000","last_active":"2024-09-12T22:31:38.411173+0000","last_peered":"2024-09-12T22:31:38.411173+0000","last_clean":"2024-09-12T22:31:38.411173+0000","last_became_active":"2024-09-12T22:31:36.407447+0000","last_became_peered":"2024-09-12T22:31:36.407447+0000","last_unstale":"2024-09-12T22:31:38.411173+0000","last_undegraded":"2024-09-12T22:31:38.411173+0000","last_fullsized":"2024-09-12T22:31:38.411173+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:29:37.933109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:31:38.412069+0000","last_change":"2024-09-12T22:31:37.411680+0000","last_active":"2024-09-12T22:31:38.412069+0000","last_peered":"2024-09-12T22:31:38.412069+0000","last_clean":"2024-09-12T22:31:38.412069+0000","last_became_active":"2024-09-12T22:31:37.411168+0000","last_became_peered":"2024-09-12T22:31:37.411168+0000","last_unstale":"2024-09-12T22:31:38.412069+0000","last_undegraded":"2024-09-12T22:31:38.412069+0000","last_fullsized":"2024-09-12T22:31:38.412069+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:27.706282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.764438+0000","last_change":"2024-09-12T22:31:36.411271+0000","last_active":"2024-09-12T22:31:40.764438+0000","last_peered":"2024-09-12T22:31:40.764438+0000","last_clean":"2024-09-12T22:31:40.764438+0000","last_became_active":"2024-09-12T22:31:36.410706+0000","last_became_peered":"2024-09-12T22:31:36.410706+0000","last_unstale":"2024-09-12T22:31:40.764438+0000","last_undegraded":"2024-09-12T22:31:40.764438+0000","last_fullsized":"2024-09-12T22:31:40.764438+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:43:22.805855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:31:38.411530+0000","last_change":"2024-09-12T22:31:37.411218+0000","last_active":"2024-09-12T22:31:38.411530+0000","last_peered":"2024-09-12T22:31:38.411530+0000","last_clean":"2024-09-12T22:31:38.411530+0000","last_became_active":"2024-09-12T22:31:37.409666+0000","last_became_peered":"2024-09-12T22:31:37.409666+0000","last_unstale":"2024-09-12T22:31:38.411530+0000","last_undegraded":"2024-09-12T22:31:38.411530+0000","last_fullsized":"2024-09-12T22:31:38.411530+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:45:34.230090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"19'8","reported_seq":24,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.695805+0000","last_change":"2024-09-12T22:31:36.411811+0000","last_active":"2024-09-12T22:31:40.695805+0000","last_peered":"2024-09-12T22:31:40.695805+0000","last_clean":"2024-09-12T22:31:40.695805+0000","last_became_active":"2024-09-12T22:31:36.410101+0000","last_became_peered":"2024-09-12T22:31:36.410101+0000","last_unstale":"2024-09-12T22:31:40.695805+0000","last_undegraded":"2024-09-12T22:31:40.695805+0000","last_fullsized":"2024-09-12T22:31:40.695805+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:33:02.410148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"19'1","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.696872+0000","last_change":"2024-09-12T22:31:36.410970+0000","last_active":"2024-09-12T22:31:40.696872+0000","last_peered":"2024-09-12T22:31:40.696872+0000","last_clean":"2024-09-12T22:31:40.696872+0000","last_became_active":"2024-09-12T22:31:36.409754+0000","last_became_peered":"2024-09-12T22:31:36.409754+0000","last_unstale":"2024-09-12T22:31:40.696872+0000","last_undegraded":"2024-09-12T22:31:40.696872+0000","last_fullsized":"2024-09-12T22:31:40.696872+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:30:07.724418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.764193+0000","last_change":"2024-09-12T22:31:37.415050+0000","last_active":"2024-09-12T22:31:40.764193+0000","last_peered":"2024-09-12T22:31:40.764193+0000","last_clean":"2024-09-12T22:31:40.764193+0000","last_became_active":"2024-09-12T22:31:37.414290+0000","last_became_peered":"2024-09-12T22:31:37.414290+0000","last_unstale":"2024-09-12T22:31:40.764193+0000","last_undegraded":"2024-09-12T22:31:40.764193+0000","last_fullsized":"2024-09-12T22:31:40.764193+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:47:15.502575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"19'2","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.765286+0000","last_change":"2024-09-12T22:31:36.411725+0000","last_active":"2024-09-12T22:31:40.765286+0000","last_peered":"2024-09-12T22:31:40.765286+0000","last_clean":"2024-09-12T22:31:40.765286+0000","last_became_active":"2024-09-12T22:31:36.411407+0000","last_became_peered":"2024-09-12T22:31:36.411407+0000","last_unstale":"2024-09-12T22:31:40.765286+0000","last_undegraded":"2024-09-12T22:31:40.765286+0000","last_fullsized":"2024-09-12T22:31:40.765286+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:30:07.724418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.764522+0000","last_change":"2024-09-12T22:31:37.413857+0000","last_active":"2024-09-12T22:31:40.764522+0000","last_peered":"2024-09-12T22:31:40.764522+0000","last_clean":"2024-09-12T22:31:40.764522+0000","last_became_active":"2024-09-12T22:31:37.412941+0000","last_became_peered":"2024-09-12T22:31:37.412941+0000","last_unstale":"2024-09-12T22:31:40.764522+0000","last_undegraded":"2024-09-12T22:31:40.764522+0000","last_fullsized":"2024-09-12T22:31:40.764522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:58:45.134258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"19'1","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.696863+0000","last_change":"2024-09-12T22:31:36.411320+0000","last_active":"2024-09-12T22:31:40.696863+0000","last_peered":"2024-09-12T22:31:40.696863+0000","last_clean":"2024-09-12T22:31:40.696863+0000","last_became_active":"2024-09-12T22:31:36.409837+0000","last_became_peered":"2024-09-12T22:31:36.409837+0000","last_unstale":"2024-09-12T22:31:40.696863+0000","last_undegraded":"2024-09-12T22:31:40.696863+0000","last_fullsized":"2024-09-12T22:31:40.696863+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:36:53.914922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.695949+0000","last_change":"2024-09-12T22:31:37.414809+0000","last_active":"2024-09-12T22:31:40.695949+0000","last_peered":"2024-09-12T22:31:40.695949+0000","last_clean":"2024-09-12T22:31:40.695949+0000","last_became_active":"2024-09-12T22:31:37.414492+0000","last_became_peered":"2024-09-12T22:31:37.414492+0000","last_unstale":"2024-09-12T22:31:40.695949+0000","last_undegraded":"2024-09-12T22:31:40.695949+0000","last_fullsized":"2024-09-12T22:31:40.695949+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:50:48.426898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.696715+0000","last_change":"2024-09-12T22:31:36.412068+0000","last_active":"2024-09-12T22:31:40.696715+0000","last_peered":"2024-09-12T22:31:40.696715+0000","last_clean":"2024-09-12T22:31:40.696715+0000","last_became_active":"2024-09-12T22:31:36.411366+0000","last_became_peered":"2024-09-12T22:31:36.411366+0000","last_unstale":"2024-09-12T22:31:40.696715+0000","last_undegraded":"2024-09-12T22:31:40.696715+0000","last_fullsized":"2024-09-12T22:31:40.696715+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:35:51.647051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:31:38.411709+0000","last_change":"2024-09-12T22:31:37.410303+0000","last_active":"2024-09-12T22:31:38.411709+0000","last_peered":"2024-09-12T22:31:38.411709+0000","last_clean":"2024-09-12T22:31:38.411709+0000","last_became_active":"2024-09-12T22:31:37.409607+0000","last_became_peered":"2024-09-12T22:31:37.409607+0000","last_unstale":"2024-09-12T22:31:38.411709+0000","last_undegraded":"2024-09-12T22:31:38.411709+0000","last_fullsized":"2024-09-12T22:31:38.411709+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:53:42.732654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:31:38.411860+0000","last_change":"2024-09-12T22:31:36.407974+0000","last_active":"2024-09-12T22:31:38.411860+0000","last_peered":"2024-09-12T22:31:38.411860+0000","last_clean":"2024-09-12T22:31:38.411860+0000","last_became_active":"2024-09-12T22:31:36.406955+0000","last_became_peered":"2024-09-12T22:31:36.406955+0000","last_unstale":"2024-09-12T22:31:38.411860+0000","last_undegraded":"2024-09-12T22:31:38.411860+0000","last_fullsized":"2024-09-12T22:31:38.411860+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:07:34.831264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.696465+0000","last_change":"2024-09-12T22:31:37.415285+0000","last_active":"2024-09-12T22:31:40.696465+0000","last_peered":"2024-09-12T22:31:40.696465+0000","last_clean":"2024-09-12T22:31:40.696465+0000","last_became_active":"2024-09-12T22:31:37.414890+0000","last_became_peered":"2024-09-12T22:31:37.414890+0000","last_unstale":"2024-09-12T22:31:40.696465+0000","last_undegraded":"2024-09-12T22:31:40.696465+0000","last_fullsized":"2024-09-12T22:31:40.696465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:38:16.956786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.696019+0000","last_change":"2024-09-12T22:31:36.412147+0000","last_active":"2024-09-12T22:31:40.696019+0000","last_peered":"2024-09-12T22:31:40.696019+0000","last_clean":"2024-09-12T22:31:40.696019+0000","last_became_active":"2024-09-12T22:31:36.411382+0000","last_became_peered":"2024-09-12T22:31:36.411382+0000","last_unstale":"2024-09-12T22:31:40.696019+0000","last_undegraded":"2024-09-12T22:31:40.696019+0000","last_fullsized":"2024-09-12T22:31:40.696019+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:54:51.454867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.696770+0000","last_change":"2024-09-12T22:31:37.420209+0000","last_active":"2024-09-12T22:31:40.696770+0000","last_peered":"2024-09-12T22:31:40.696770+0000","last_clean":"2024-09-12T22:31:40.696770+0000","last_became_active":"2024-09-12T22:31:37.419267+0000","last_became_peered":"2024-09-12T22:31:37.419267+0000","last_unstale":"2024-09-12T22:31:40.696770+0000","last_undegraded":"2024-09-12T22:31:40.696770+0000","last_fullsized":"2024-09-12T22:31:40.696770+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:36.790111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.764556+0000","last_change":"2024-09-12T22:31:36.411190+0000","last_active":"2024-09-12T22:31:40.764556+0000","last_peered":"2024-09-12T22:31:40.764556+0000","last_clean":"2024-09-12T22:31:40.764556+0000","last_became_active":"2024-09-12T22:31:36.410548+0000","last_became_peered":"2024-09-12T22:31:36.410548+0000","last_unstale":"2024-09-12T22:31:40.764556+0000","last_undegraded":"2024-09-12T22:31:40.764556+0000","last_fullsized":"2024-09-12T22:31:40.764556+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:10:20.300894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.696807+0000","last_change":"2024-09-12T22:31:37.418749+0000","last_active":"2024-09-12T22:31:40.696807+0000","last_peered":"2024-09-12T22:31:40.696807+0000","last_clean":"2024-09-12T22:31:40.696807+0000","last_became_active":"2024-09-12T22:31:37.418360+0000","last_became_peered":"2024-09-12T22:31:37.418360+0000","last_unstale":"2024-09-12T22:31:40.696807+0000","last_undegraded":"2024-09-12T22:31:40.696807+0000","last_fullsized":"2024-09-12T22:31:40.696807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:50:08.152699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.764246+0000","last_change":"2024-09-12T22:31:36.412187+0000","last_active":"2024-09-12T22:31:40.764246+0000","last_peered":"2024-09-12T22:31:40.764246+0000","last_clean":"2024-09-12T22:31:40.764246+0000","last_became_active":"2024-09-12T22:31:36.411935+0000","last_became_peered":"2024-09-12T22:31:36.411935+0000","last_unstale":"2024-09-12T22:31:40.764246+0000","last_undegraded":"2024-09-12T22:31:40.764246+0000","last_fullsized":"2024-09-12T22:31:40.764246+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:41:04.029445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:31:38.411825+0000","last_change":"2024-09-12T22:31:37.417881+0000","last_active":"2024-09-12T22:31:38.411825+0000","last_peered":"2024-09-12T22:31:38.411825+0000","last_clean":"2024-09-12T22:31:38.411825+0000","last_became_active":"2024-09-12T22:31:37.417572+0000","last_became_peered":"2024-09-12T22:31:37.417572+0000","last_unstale":"2024-09-12T22:31:38.411825+0000","last_undegraded":"2024-09-12T22:31:38.411825+0000","last_fullsized":"2024-09-12T22:31:38.411825+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:19:16.367589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":226,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.695987+0000","last_change":"2024-09-12T22:31:27.631847+0000","last_active":"2024-09-12T22:31:40.695987+0000","last_peered":"2024-09-12T22:31:40.695987+0000","last_clean":"2024-09-12T22:31:40.695987+0000","last_became_active":"2024-09-12T22:31:27.631027+0000","last_became_peered":"2024-09-12T22:31:27.631027+0000","last_unstale":"2024-09-12T22:31:40.695987+0000","last_undegraded":"2024-09-12T22:31:40.695987+0000","last_fullsized":"2024-09-12T22:31:40.695987+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:26.229539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:26.229539+0000","last_clean_scrub_stamp":"2024-09-12T22:31:26.229539+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:59:24.181319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":30,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.696417+0000","last_change":"2024-09-12T22:31:34.286952+0000","last_active":"2024-09-12T22:31:40.696417+0000","last_peered":"2024-09-12T22:31:40.696417+0000","last_clean":"2024-09-12T22:31:40.696417+0000","last_became_active":"2024-09-12T22:31:32.283661+0000","last_became_peered":"2024-09-12T22:31:32.283661+0000","last_unstale":"2024-09-12T22:31:40.696417+0000","last_undegraded":"2024-09-12T22:31:40.696417+0000","last_fullsized":"2024-09-12T22:31:40.696417+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:21.681390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000621274,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:31:38.411238+0000","last_change":"2024-09-12T22:31:36.411275+0000","last_active":"2024-09-12T22:31:38.411238+0000","last_peered":"2024-09-12T22:31:38.411238+0000","last_clean":"2024-09-12T22:31:38.411238+0000","last_became_active":"2024-09-12T22:31:36.410595+0000","last_became_peered":"2024-09-12T22:31:36.410595+0000","last_unstale":"2024-09-12T22:31:38.411238+0000","last_undegraded":"2024-09-12T22:31:38.411238+0000","last_fullsized":"2024-09-12T22:31:38.411238+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:38:14.895625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.696887+0000","last_change":"2024-09-12T22:31:37.419976+0000","last_active":"2024-09-12T22:31:40.696887+0000","last_peered":"2024-09-12T22:31:40.696887+0000","last_clean":"2024-09-12T22:31:40.696887+0000","last_became_active":"2024-09-12T22:31:37.419161+0000","last_became_peered":"2024-09-12T22:31:37.419161+0000","last_unstale":"2024-09-12T22:31:40.696887+0000","last_undegraded":"2024-09-12T22:31:40.696887+0000","last_fullsized":"2024-09-12T22:31:40.696887+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:07:26.070097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":29,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.695956+0000","last_change":"2024-09-12T22:31:34.286642+0000","last_active":"2024-09-12T22:31:40.695956+0000","last_peered":"2024-09-12T22:31:40.695956+0000","last_clean":"2024-09-12T22:31:40.695956+0000","last_became_active":"2024-09-12T22:31:32.283601+0000","last_became_peered":"2024-09-12T22:31:32.283601+0000","last_unstale":"2024-09-12T22:31:40.695956+0000","last_undegraded":"2024-09-12T22:31:40.695956+0000","last_fullsized":"2024-09-12T22:31:40.695956+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:40:06.769540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037858999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:31:38.411132+0000","last_change":"2024-09-12T22:31:36.407395+0000","last_active":"2024-09-12T22:31:38.411132+0000","last_peered":"2024-09-12T22:31:38.411132+0000","last_clean":"2024-09-12T22:31:38.411132+0000","last_became_active":"2024-09-12T22:31:36.406770+0000","last_became_peered":"2024-09-12T22:31:36.406770+0000","last_unstale":"2024-09-12T22:31:38.411132+0000","last_undegraded":"2024-09-12T22:31:38.411132+0000","last_fullsized":"2024-09-12T22:31:38.411132+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:49:26.547848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.765109+0000","last_change":"2024-09-12T22:31:37.414075+0000","last_active":"2024-09-12T22:31:40.765109+0000","last_peered":"2024-09-12T22:31:40.765109+0000","last_clean":"2024-09-12T22:31:40.765109+0000","last_became_active":"2024-09-12T22:31:37.413491+0000","last_became_peered":"2024-09-12T22:31:37.413491+0000","last_unstale":"2024-09-12T22:31:40.765109+0000","last_undegraded":"2024-09-12T22:31:40.765109+0000","last_fullsized":"2024-09-12T22:31:40.765109+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:26:25.578693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":27,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:31:38.411228+0000","last_change":"2024-09-12T22:31:34.286394+0000","last_active":"2024-09-12T22:31:38.411228+0000","last_peered":"2024-09-12T22:31:38.411228+0000","last_clean":"2024-09-12T22:31:38.411228+0000","last_became_active":"2024-09-12T22:31:32.280062+0000","last_became_peered":"2024-09-12T22:31:32.280062+0000","last_unstale":"2024-09-12T22:31:38.411228+0000","last_undegraded":"2024-09-12T22:31:38.411228+0000","last_fullsized":"2024-09-12T22:31:38.411228+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:20:23.663838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039540700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.764247+0000","last_change":"2024-09-12T22:31:36.413752+0000","last_active":"2024-09-12T22:31:40.764247+0000","last_peered":"2024-09-12T22:31:40.764247+0000","last_clean":"2024-09-12T22:31:40.764247+0000","last_became_active":"2024-09-12T22:31:36.413486+0000","last_became_peered":"2024-09-12T22:31:36.413486+0000","last_unstale":"2024-09-12T22:31:40.764247+0000","last_undegraded":"2024-09-12T22:31:40.764247+0000","last_fullsized":"2024-09-12T22:31:40.764247+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:37:20.891838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:31:38.411836+0000","last_change":"2024-09-12T22:31:37.417636+0000","last_active":"2024-09-12T22:31:38.411836+0000","last_peered":"2024-09-12T22:31:38.411836+0000","last_clean":"2024-09-12T22:31:38.411836+0000","last_became_active":"2024-09-12T22:31:37.417230+0000","last_became_peered":"2024-09-12T22:31:37.417230+0000","last_unstale":"2024-09-12T22:31:38.411836+0000","last_undegraded":"2024-09-12T22:31:38.411836+0000","last_fullsized":"2024-09-12T22:31:38.411836+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:44:29.729122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":31,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.696205+0000","last_change":"2024-09-12T22:31:34.286938+0000","last_active":"2024-09-12T22:31:40.696205+0000","last_peered":"2024-09-12T22:31:40.696205+0000","last_clean":"2024-09-12T22:31:40.696205+0000","last_became_active":"2024-09-12T22:31:32.282230+0000","last_became_peered":"2024-09-12T22:31:32.282230+0000","last_unstale":"2024-09-12T22:31:40.696205+0000","last_undegraded":"2024-09-12T22:31:40.696205+0000","last_fullsized":"2024-09-12T22:31:40.696205+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:11:05.988384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000615758,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.696467+0000","last_change":"2024-09-12T22:31:36.410694+0000","last_active":"2024-09-12T22:31:40.696467+0000","last_peered":"2024-09-12T22:31:40.696467+0000","last_clean":"2024-09-12T22:31:40.696467+0000","last_became_active":"2024-09-12T22:31:36.409816+0000","last_became_peered":"2024-09-12T22:31:36.409816+0000","last_unstale":"2024-09-12T22:31:40.696467+0000","last_undegraded":"2024-09-12T22:31:40.696467+0000","last_fullsized":"2024-09-12T22:31:40.696467+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:40:35.369213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:31:38.411777+0000","last_change":"2024-09-12T22:31:37.414608+0000","last_active":"2024-09-12T22:31:38.411777+0000","last_peered":"2024-09-12T22:31:38.411777+0000","last_clean":"2024-09-12T22:31:38.411777+0000","last_became_active":"2024-09-12T22:31:37.414307+0000","last_became_peered":"2024-09-12T22:31:37.414307+0000","last_unstale":"2024-09-12T22:31:38.411777+0000","last_undegraded":"2024-09-12T22:31:38.411777+0000","last_fullsized":"2024-09-12T22:31:38.411777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:41:21.231511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.696973+0000","last_change":"2024-09-12T22:31:36.411355+0000","last_active":"2024-09-12T22:31:40.696973+0000","last_peered":"2024-09-12T22:31:40.696973+0000","last_clean":"2024-09-12T22:31:40.696973+0000","last_became_active":"2024-09-12T22:31:36.410529+0000","last_became_peered":"2024-09-12T22:31:36.410529+0000","last_unstale":"2024-09-12T22:31:40.696973+0000","last_undegraded":"2024-09-12T22:31:40.696973+0000","last_fullsized":"2024-09-12T22:31:40.696973+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:19:47.356688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:31:38.411833+0000","last_change":"2024-09-12T22:31:34.286457+0000","last_active":"2024-09-12T22:31:38.411833+0000","last_peered":"2024-09-12T22:31:38.411833+0000","last_clean":"2024-09-12T22:31:38.411833+0000","last_became_active":"2024-09-12T22:31:32.280007+0000","last_became_peered":"2024-09-12T22:31:32.280007+0000","last_unstale":"2024-09-12T22:31:38.411833+0000","last_undegraded":"2024-09-12T22:31:38.411833+0000","last_fullsized":"2024-09-12T22:31:38.411833+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:09.068038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041972500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.764666+0000","last_change":"2024-09-12T22:31:37.410386+0000","last_active":"2024-09-12T22:31:40.764666+0000","last_peered":"2024-09-12T22:31:40.764666+0000","last_clean":"2024-09-12T22:31:40.764666+0000","last_became_active":"2024-09-12T22:31:37.409928+0000","last_became_peered":"2024-09-12T22:31:37.409928+0000","last_unstale":"2024-09-12T22:31:40.764666+0000","last_undegraded":"2024-09-12T22:31:40.764666+0000","last_fullsized":"2024-09-12T22:31:40.764666+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:02:36.454134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:31:38.411740+0000","last_change":"2024-09-12T22:31:36.410324+0000","last_active":"2024-09-12T22:31:38.411740+0000","last_peered":"2024-09-12T22:31:38.411740+0000","last_clean":"2024-09-12T22:31:38.411740+0000","last_became_active":"2024-09-12T22:31:36.409199+0000","last_became_peered":"2024-09-12T22:31:36.409199+0000","last_unstale":"2024-09-12T22:31:38.411740+0000","last_undegraded":"2024-09-12T22:31:38.411740+0000","last_fullsized":"2024-09-12T22:31:38.411740+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:06:54.608936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":29,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.765417+0000","last_change":"2024-09-12T22:31:34.839044+0000","last_active":"2024-09-12T22:31:40.765417+0000","last_peered":"2024-09-12T22:31:40.765417+0000","last_clean":"2024-09-12T22:31:40.765417+0000","last_became_active":"2024-09-12T22:31:32.279671+0000","last_became_peered":"2024-09-12T22:31:32.279671+0000","last_unstale":"2024-09-12T22:31:40.765417+0000","last_undegraded":"2024-09-12T22:31:40.765417+0000","last_fullsized":"2024-09-12T22:31:40.765417+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:27:49.809935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036776499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.764836+0000","last_change":"2024-09-12T22:31:37.410289+0000","last_active":"2024-09-12T22:31:40.764836+0000","last_peered":"2024-09-12T22:31:40.764836+0000","last_clean":"2024-09-12T22:31:40.764836+0000","last_became_active":"2024-09-12T22:31:37.409446+0000","last_became_peered":"2024-09-12T22:31:37.409446+0000","last_unstale":"2024-09-12T22:31:40.764836+0000","last_undegraded":"2024-09-12T22:31:40.764836+0000","last_fullsized":"2024-09-12T22:31:40.764836+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:03:32.167116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:31:38.412193+0000","last_change":"2024-09-12T22:31:36.409397+0000","last_active":"2024-09-12T22:31:38.412193+0000","last_peered":"2024-09-12T22:31:38.412193+0000","last_clean":"2024-09-12T22:31:38.412193+0000","last_became_active":"2024-09-12T22:31:36.408787+0000","last_became_peered":"2024-09-12T22:31:36.408787+0000","last_unstale":"2024-09-12T22:31:38.412193+0000","last_undegraded":"2024-09-12T22:31:38.412193+0000","last_fullsized":"2024-09-12T22:31:38.412193+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:29:03.467352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":27,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:31:38.412099+0000","last_change":"2024-09-12T22:31:34.286639+0000","last_active":"2024-09-12T22:31:38.412099+0000","last_peered":"2024-09-12T22:31:38.412099+0000","last_clean":"2024-09-12T22:31:38.412099+0000","last_became_active":"2024-09-12T22:31:32.280092+0000","last_became_peered":"2024-09-12T22:31:32.280092+0000","last_unstale":"2024-09-12T22:31:38.412099+0000","last_undegraded":"2024-09-12T22:31:38.412099+0000","last_fullsized":"2024-09-12T22:31:38.412099+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:02:40.821530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058589999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:31:38.410913+0000","last_change":"2024-09-12T22:31:37.411152+0000","last_active":"2024-09-12T22:31:38.410913+0000","last_peered":"2024-09-12T22:31:38.410913+0000","last_clean":"2024-09-12T22:31:38.410913+0000","last_became_active":"2024-09-12T22:31:37.410558+0000","last_became_peered":"2024-09-12T22:31:37.410558+0000","last_unstale":"2024-09-12T22:31:38.410913+0000","last_undegraded":"2024-09-12T22:31:38.410913+0000","last_fullsized":"2024-09-12T22:31:38.410913+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:14:29.892478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:31:39.400416+0000","last_change":"2024-09-12T22:31:36.407460+0000","last_active":"2024-09-12T22:31:39.400416+0000","last_peered":"2024-09-12T22:31:39.400416+0000","last_clean":"2024-09-12T22:31:39.400416+0000","last_became_active":"2024-09-12T22:31:36.406729+0000","last_became_peered":"2024-09-12T22:31:36.406729+0000","last_unstale":"2024-09-12T22:31:39.400416+0000","last_undegraded":"2024-09-12T22:31:39.400416+0000","last_fullsized":"2024-09-12T22:31:39.400416+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:27:58.012573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":29,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.696985+0000","last_change":"2024-09-12T22:31:34.286699+0000","last_active":"2024-09-12T22:31:40.696985+0000","last_peered":"2024-09-12T22:31:40.696985+0000","last_clean":"2024-09-12T22:31:40.696985+0000","last_became_active":"2024-09-12T22:31:32.283606+0000","last_became_peered":"2024-09-12T22:31:32.283606+0000","last_unstale":"2024-09-12T22:31:40.696985+0000","last_undegraded":"2024-09-12T22:31:40.696985+0000","last_fullsized":"2024-09-12T22:31:40.696985+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:09:32.050798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000382109,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.764377+0000","last_change":"2024-09-12T22:31:37.410011+0000","last_active":"2024-09-12T22:31:40.764377+0000","last_peered":"2024-09-12T22:31:40.764377+0000","last_clean":"2024-09-12T22:31:40.764377+0000","last_became_active":"2024-09-12T22:31:37.409320+0000","last_became_peered":"2024-09-12T22:31:37.409320+0000","last_unstale":"2024-09-12T22:31:40.764377+0000","last_undegraded":"2024-09-12T22:31:40.764377+0000","last_fullsized":"2024-09-12T22:31:40.764377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:27:23.661444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.696056+0000","last_change":"2024-09-12T22:31:37.415670+0000","last_active":"2024-09-12T22:31:40.696056+0000","last_peered":"2024-09-12T22:31:40.696056+0000","last_clean":"2024-09-12T22:31:40.696056+0000","last_became_active":"2024-09-12T22:31:37.415007+0000","last_became_peered":"2024-09-12T22:31:37.415007+0000","last_unstale":"2024-09-12T22:31:40.696056+0000","last_undegraded":"2024-09-12T22:31:40.696056+0000","last_fullsized":"2024-09-12T22:31:40.696056+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:42:51.694128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"19'6","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.696523+0000","last_change":"2024-09-12T22:31:36.409878+0000","last_active":"2024-09-12T22:31:40.696523+0000","last_peered":"2024-09-12T22:31:40.696523+0000","last_clean":"2024-09-12T22:31:40.696523+0000","last_became_active":"2024-09-12T22:31:36.409132+0000","last_became_peered":"2024-09-12T22:31:36.409132+0000","last_unstale":"2024-09-12T22:31:40.696523+0000","last_undegraded":"2024-09-12T22:31:40.696523+0000","last_fullsized":"2024-09-12T22:31:40.696523+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:09:56.081385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:31:38.410899+0000","last_change":"2024-09-12T22:31:37.414914+0000","last_active":"2024-09-12T22:31:38.410899+0000","last_peered":"2024-09-12T22:31:38.410899+0000","last_clean":"2024-09-12T22:31:38.410899+0000","last_became_active":"2024-09-12T22:31:37.414535+0000","last_became_peered":"2024-09-12T22:31:37.414535+0000","last_unstale":"2024-09-12T22:31:38.410899+0000","last_undegraded":"2024-09-12T22:31:38.410899+0000","last_fullsized":"2024-09-12T22:31:38.410899+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:14:37.010786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"19'3","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.765296+0000","last_change":"2024-09-12T22:31:36.410433+0000","last_active":"2024-09-12T22:31:40.765296+0000","last_peered":"2024-09-12T22:31:40.765296+0000","last_clean":"2024-09-12T22:31:40.765296+0000","last_became_active":"2024-09-12T22:31:36.410007+0000","last_became_peered":"2024-09-12T22:31:36.410007+0000","last_unstale":"2024-09-12T22:31:40.765296+0000","last_undegraded":"2024-09-12T22:31:40.765296+0000","last_fullsized":"2024-09-12T22:31:40.765296+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:08:35.385688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.696899+0000","last_change":"2024-09-12T22:31:36.411549+0000","last_active":"2024-09-12T22:31:40.696899+0000","last_peered":"2024-09-12T22:31:40.696899+0000","last_clean":"2024-09-12T22:31:40.696899+0000","last_became_active":"2024-09-12T22:31:36.410674+0000","last_became_peered":"2024-09-12T22:31:36.410674+0000","last_unstale":"2024-09-12T22:31:40.696899+0000","last_undegraded":"2024-09-12T22:31:40.696899+0000","last_fullsized":"2024-09-12T22:31:40.696899+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:58:05.676197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:31:38.410787+0000","last_change":"2024-09-12T22:31:37.411254+0000","last_active":"2024-09-12T22:31:38.410787+0000","last_peered":"2024-09-12T22:31:38.410787+0000","last_clean":"2024-09-12T22:31:38.410787+0000","last_became_active":"2024-09-12T22:31:37.410404+0000","last_became_peered":"2024-09-12T22:31:37.410404+0000","last_unstale":"2024-09-12T22:31:38.410787+0000","last_undegraded":"2024-09-12T22:31:38.410787+0000","last_fullsized":"2024-09-12T22:31:38.410787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:42:00.856616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:31:38.412111+0000","last_change":"2024-09-12T22:31:36.408390+0000","last_active":"2024-09-12T22:31:38.412111+0000","last_peered":"2024-09-12T22:31:38.412111+0000","last_clean":"2024-09-12T22:31:38.412111+0000","last_became_active":"2024-09-12T22:31:36.407062+0000","last_became_peered":"2024-09-12T22:31:36.407062+0000","last_unstale":"2024-09-12T22:31:38.412111+0000","last_undegraded":"2024-09-12T22:31:38.412111+0000","last_fullsized":"2024-09-12T22:31:38.412111+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:09:10.618195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:31:38.410987+0000","last_change":"2024-09-12T22:31:37.416629+0000","last_active":"2024-09-12T22:31:38.410987+0000","last_peered":"2024-09-12T22:31:38.410987+0000","last_clean":"2024-09-12T22:31:38.410987+0000","last_became_active":"2024-09-12T22:31:37.416387+0000","last_became_peered":"2024-09-12T22:31:37.416387+0000","last_unstale":"2024-09-12T22:31:38.410987+0000","last_undegraded":"2024-09-12T22:31:38.410987+0000","last_fullsized":"2024-09-12T22:31:38.410987+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:59:52.020560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.765320+0000","last_change":"2024-09-12T22:31:37.413777+0000","last_active":"2024-09-12T22:31:40.765320+0000","last_peered":"2024-09-12T22:31:40.765320+0000","last_clean":"2024-09-12T22:31:40.765320+0000","last_became_active":"2024-09-12T22:31:37.412669+0000","last_became_peered":"2024-09-12T22:31:37.412669+0000","last_unstale":"2024-09-12T22:31:40.765320+0000","last_undegraded":"2024-09-12T22:31:40.765320+0000","last_fullsized":"2024-09-12T22:31:40.765320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:42:17.728844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:31:38.411051+0000","last_change":"2024-09-12T22:31:36.409466+0000","last_active":"2024-09-12T22:31:38.411051+0000","last_peered":"2024-09-12T22:31:38.411051+0000","last_clean":"2024-09-12T22:31:38.411051+0000","last_became_active":"2024-09-12T22:31:36.408796+0000","last_became_peered":"2024-09-12T22:31:36.408796+0000","last_unstale":"2024-09-12T22:31:38.411051+0000","last_undegraded":"2024-09-12T22:31:38.411051+0000","last_fullsized":"2024-09-12T22:31:38.411051+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:03:39.648159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:31:38.411767+0000","last_change":"2024-09-12T22:31:37.411183+0000","last_active":"2024-09-12T22:31:38.411767+0000","last_peered":"2024-09-12T22:31:38.411767+0000","last_clean":"2024-09-12T22:31:38.411767+0000","last_became_active":"2024-09-12T22:31:37.409796+0000","last_became_peered":"2024-09-12T22:31:37.409796+0000","last_unstale":"2024-09-12T22:31:38.411767+0000","last_undegraded":"2024-09-12T22:31:38.411767+0000","last_fullsized":"2024-09-12T22:31:38.411767+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:20:35.779810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:31:38.410929+0000","last_change":"2024-09-12T22:31:36.407402+0000","last_active":"2024-09-12T22:31:38.410929+0000","last_peered":"2024-09-12T22:31:38.410929+0000","last_clean":"2024-09-12T22:31:38.410929+0000","last_became_active":"2024-09-12T22:31:36.406681+0000","last_became_peered":"2024-09-12T22:31:36.406681+0000","last_unstale":"2024-09-12T22:31:38.410929+0000","last_undegraded":"2024-09-12T22:31:38.410929+0000","last_fullsized":"2024-09-12T22:31:38.410929+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:39:39.362573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.764875+0000","last_change":"2024-09-12T22:31:37.412817+0000","last_active":"2024-09-12T22:31:40.764875+0000","last_peered":"2024-09-12T22:31:40.764875+0000","last_clean":"2024-09-12T22:31:40.764875+0000","last_became_active":"2024-09-12T22:31:37.411999+0000","last_became_peered":"2024-09-12T22:31:37.411999+0000","last_unstale":"2024-09-12T22:31:40.764875+0000","last_undegraded":"2024-09-12T22:31:40.764875+0000","last_fullsized":"2024-09-12T22:31:40.764875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:07:02.173590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.764750+0000","last_change":"2024-09-12T22:31:36.407378+0000","last_active":"2024-09-12T22:31:40.764750+0000","last_peered":"2024-09-12T22:31:40.764750+0000","last_clean":"2024-09-12T22:31:40.764750+0000","last_became_active":"2024-09-12T22:31:36.406992+0000","last_became_peered":"2024-09-12T22:31:36.406992+0000","last_unstale":"2024-09-12T22:31:40.764750+0000","last_undegraded":"2024-09-12T22:31:40.764750+0000","last_fullsized":"2024-09-12T22:31:40.764750+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:37:16.807328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.764857+0000","last_change":"2024-09-12T22:31:37.411676+0000","last_active":"2024-09-12T22:31:40.764857+0000","last_peered":"2024-09-12T22:31:40.764857+0000","last_clean":"2024-09-12T22:31:40.764857+0000","last_became_active":"2024-09-12T22:31:37.410802+0000","last_became_peered":"2024-09-12T22:31:37.410802+0000","last_unstale":"2024-09-12T22:31:40.764857+0000","last_undegraded":"2024-09-12T22:31:40.764857+0000","last_fullsized":"2024-09-12T22:31:40.764857+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:08:21.709770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"19'1","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.764889+0000","last_change":"2024-09-12T22:31:36.412289+0000","last_active":"2024-09-12T22:31:40.764889+0000","last_peered":"2024-09-12T22:31:40.764889+0000","last_clean":"2024-09-12T22:31:40.764889+0000","last_became_active":"2024-09-12T22:31:36.411985+0000","last_became_peered":"2024-09-12T22:31:36.411985+0000","last_unstale":"2024-09-12T22:31:40.764889+0000","last_undegraded":"2024-09-12T22:31:40.764889+0000","last_fullsized":"2024-09-12T22:31:40.764889+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:30:09.410370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.695976+0000","last_change":"2024-09-12T22:31:37.415365+0000","last_active":"2024-09-12T22:31:40.695976+0000","last_peered":"2024-09-12T22:31:40.695976+0000","last_clean":"2024-09-12T22:31:40.695976+0000","last_became_active":"2024-09-12T22:31:37.413933+0000","last_became_peered":"2024-09-12T22:31:37.413933+0000","last_unstale":"2024-09-12T22:31:40.695976+0000","last_undegraded":"2024-09-12T22:31:40.695976+0000","last_fullsized":"2024-09-12T22:31:40.695976+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:08:07.115355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"19'2","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.696434+0000","last_change":"2024-09-12T22:31:36.411665+0000","last_active":"2024-09-12T22:31:40.696434+0000","last_peered":"2024-09-12T22:31:40.696434+0000","last_clean":"2024-09-12T22:31:40.696434+0000","last_became_active":"2024-09-12T22:31:36.410182+0000","last_became_peered":"2024-09-12T22:31:36.410182+0000","last_unstale":"2024-09-12T22:31:40.696434+0000","last_undegraded":"2024-09-12T22:31:40.696434+0000","last_fullsized":"2024-09-12T22:31:40.696434+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:37:20.891838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.696106+0000","last_change":"2024-09-12T22:31:37.415172+0000","last_active":"2024-09-12T22:31:40.696106+0000","last_peered":"2024-09-12T22:31:40.696106+0000","last_clean":"2024-09-12T22:31:40.696106+0000","last_became_active":"2024-09-12T22:31:37.414776+0000","last_became_peered":"2024-09-12T22:31:37.414776+0000","last_unstale":"2024-09-12T22:31:40.696106+0000","last_undegraded":"2024-09-12T22:31:40.696106+0000","last_fullsized":"2024-09-12T22:31:40.696106+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:42:32.307876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"19'2","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.765168+0000","last_change":"2024-09-12T22:31:36.410362+0000","last_active":"2024-09-12T22:31:40.765168+0000","last_peered":"2024-09-12T22:31:40.765168+0000","last_clean":"2024-09-12T22:31:40.765168+0000","last_became_active":"2024-09-12T22:31:36.410029+0000","last_became_peered":"2024-09-12T22:31:36.410029+0000","last_unstale":"2024-09-12T22:31:40.765168+0000","last_undegraded":"2024-09-12T22:31:40.765168+0000","last_fullsized":"2024-09-12T22:31:40.765168+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:23:32.476870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.764699+0000","last_change":"2024-09-12T22:31:37.409214+0000","last_active":"2024-09-12T22:31:40.764699+0000","last_peered":"2024-09-12T22:31:40.764699+0000","last_clean":"2024-09-12T22:31:40.764699+0000","last_became_active":"2024-09-12T22:31:37.408849+0000","last_became_peered":"2024-09-12T22:31:37.408849+0000","last_unstale":"2024-09-12T22:31:40.764699+0000","last_undegraded":"2024-09-12T22:31:40.764699+0000","last_fullsized":"2024-09-12T22:31:40.764699+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:39:20.383152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:31:38.411880+0000","last_change":"2024-09-12T22:31:36.410371+0000","last_active":"2024-09-12T22:31:38.411880+0000","last_peered":"2024-09-12T22:31:38.411880+0000","last_clean":"2024-09-12T22:31:38.411880+0000","last_became_active":"2024-09-12T22:31:36.409428+0000","last_became_peered":"2024-09-12T22:31:36.409428+0000","last_unstale":"2024-09-12T22:31:38.411880+0000","last_undegraded":"2024-09-12T22:31:38.411880+0000","last_fullsized":"2024-09-12T22:31:38.411880+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:27:22.817690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.695839+0000","last_change":"2024-09-12T22:31:37.415390+0000","last_active":"2024-09-12T22:31:40.695839+0000","last_peered":"2024-09-12T22:31:40.695839+0000","last_clean":"2024-09-12T22:31:40.695839+0000","last_became_active":"2024-09-12T22:31:37.414781+0000","last_became_peered":"2024-09-12T22:31:37.414781+0000","last_unstale":"2024-09-12T22:31:40.695839+0000","last_undegraded":"2024-09-12T22:31:40.695839+0000","last_fullsized":"2024-09-12T22:31:40.695839+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:42:17.728844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-12T22:31:38.412051+0000","last_change":"2024-09-12T22:31:36.407945+0000","last_active":"2024-09-12T22:31:38.412051+0000","last_peered":"2024-09-12T22:31:38.412051+0000","last_clean":"2024-09-12T22:31:38.412051+0000","last_became_active":"2024-09-12T22:31:36.406959+0000","last_became_peered":"2024-09-12T22:31:36.406959+0000","last_unstale":"2024-09-12T22:31:38.412051+0000","last_undegraded":"2024-09-12T22:31:38.412051+0000","last_fullsized":"2024-09-12T22:31:38.412051+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:26:33.155850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705670,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31984,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339856,"statfs":{"total":96636764160,"available":96604012544,"internally_reserved":0,"allocated":811008,"data_stored":658415,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705670,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31960,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339880,"statfs":{"total":96636764160,"available":96604037120,"internally_reserved":0,"allocated":790528,"data_stored":653512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738374,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":184320,"data_stored":61985,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T22:31:45.136 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T22:31:45.136 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-12T22:31:45.136 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-12T22:31:45.136 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-12T22:31:45.137 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-12T22:31:45.512 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:31:45.523 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":5,"flags":0,"active_gid":4110,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":421759783},{"type":"v1","addr":"172.21.15.19:6801","nonce":421759783}]},"active_addr":"172.21.15.19:6801/421759783","active_change":"2024-09-12T22:31:20.179952+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4106,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.19:0","nonce":2706341236}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.19:0","nonce":139849582}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.19:0","nonce":2675401097}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.19:0","nonce":34386650}]}]} 2024-09-12T22:31:45.528 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-12T22:31:45.528 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-12T22:31:45.529 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T22:31:45.822 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:31:45.822 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":21,"fsid":"957ce235-19cb-4350-8fee-febd6e3f2199","created":"2024-09-12T22:31:15.903133+0000","modified":"2024-09-12T22:31:40.689351+0000","last_up_change":"2024-09-12T22:31:25.209056+0000","last_in_change":"2024-09-12T22:31:16.757598+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T22:31:26.228956+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T22:31:30.975989+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":16,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-12T22:31:35.267679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-12T22:31:35.724475+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73b96314-15d5-4058-9993-ac103e997b27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6800","nonce":1343093884},{"type":"v1","addr":"172.21.15.76:6801","nonce":1343093884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6802","nonce":1343093884},{"type":"v1","addr":"172.21.15.76:6803","nonce":1343093884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6806","nonce":1343093884},{"type":"v1","addr":"172.21.15.76:6807","nonce":1343093884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6804","nonce":1343093884},{"type":"v1","addr":"172.21.15.76:6805","nonce":1343093884}]},"public_addr":"172.21.15.76:6801/1343093884","cluster_addr":"172.21.15.76:6803/1343093884","heartbeat_back_addr":"172.21.15.76:6807/1343093884","heartbeat_front_addr":"172.21.15.76:6805/1343093884","state":["exists","up"]},{"osd":1,"uuid":"f82ad621-e9cf-41cb-b9c0-43470cf7ddb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":616952176},{"type":"v1","addr":"172.21.15.148:6801","nonce":616952176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":616952176},{"type":"v1","addr":"172.21.15.148:6803","nonce":616952176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":616952176},{"type":"v1","addr":"172.21.15.148:6807","nonce":616952176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":616952176},{"type":"v1","addr":"172.21.15.148:6805","nonce":616952176}]},"public_addr":"172.21.15.148:6801/616952176","cluster_addr":"172.21.15.148:6803/616952176","heartbeat_back_addr":"172.21.15.148:6807/616952176","heartbeat_front_addr":"172.21.15.148:6805/616952176","state":["exists","up"]},{"osd":2,"uuid":"f30dda36-a84c-4a01-a81a-afbfb88c0aed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":533442754},{"type":"v1","addr":"172.21.15.163:6801","nonce":533442754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":533442754},{"type":"v1","addr":"172.21.15.163:6803","nonce":533442754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":533442754},{"type":"v1","addr":"172.21.15.163:6807","nonce":533442754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":533442754},{"type":"v1","addr":"172.21.15.163:6805","nonce":533442754}]},"public_addr":"172.21.15.163:6801/533442754","cluster_addr":"172.21.15.163:6803/533442754","heartbeat_back_addr":"172.21.15.163:6807/533442754","heartbeat_front_addr":"172.21.15.163:6805/533442754","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T22:31:23.899591+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T22:31:22.988274+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T22:31:23.932109+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T22:31:45.835 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-12T22:31:45.835 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T22:31:46.125 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:31:46.126 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":21,"fsid":"957ce235-19cb-4350-8fee-febd6e3f2199","created":"2024-09-12T22:31:15.903133+0000","modified":"2024-09-12T22:31:40.689351+0000","last_up_change":"2024-09-12T22:31:25.209056+0000","last_in_change":"2024-09-12T22:31:16.757598+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T22:31:26.228956+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T22:31:30.975989+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":16,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-12T22:31:35.267679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-12T22:31:35.724475+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73b96314-15d5-4058-9993-ac103e997b27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6800","nonce":1343093884},{"type":"v1","addr":"172.21.15.76:6801","nonce":1343093884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6802","nonce":1343093884},{"type":"v1","addr":"172.21.15.76:6803","nonce":1343093884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6806","nonce":1343093884},{"type":"v1","addr":"172.21.15.76:6807","nonce":1343093884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6804","nonce":1343093884},{"type":"v1","addr":"172.21.15.76:6805","nonce":1343093884}]},"public_addr":"172.21.15.76:6801/1343093884","cluster_addr":"172.21.15.76:6803/1343093884","heartbeat_back_addr":"172.21.15.76:6807/1343093884","heartbeat_front_addr":"172.21.15.76:6805/1343093884","state":["exists","up"]},{"osd":1,"uuid":"f82ad621-e9cf-41cb-b9c0-43470cf7ddb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":616952176},{"type":"v1","addr":"172.21.15.148:6801","nonce":616952176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":616952176},{"type":"v1","addr":"172.21.15.148:6803","nonce":616952176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":616952176},{"type":"v1","addr":"172.21.15.148:6807","nonce":616952176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":616952176},{"type":"v1","addr":"172.21.15.148:6805","nonce":616952176}]},"public_addr":"172.21.15.148:6801/616952176","cluster_addr":"172.21.15.148:6803/616952176","heartbeat_back_addr":"172.21.15.148:6807/616952176","heartbeat_front_addr":"172.21.15.148:6805/616952176","state":["exists","up"]},{"osd":2,"uuid":"f30dda36-a84c-4a01-a81a-afbfb88c0aed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":533442754},{"type":"v1","addr":"172.21.15.163:6801","nonce":533442754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":533442754},{"type":"v1","addr":"172.21.15.163:6803","nonce":533442754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":533442754},{"type":"v1","addr":"172.21.15.163:6807","nonce":533442754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":533442754},{"type":"v1","addr":"172.21.15.163:6805","nonce":533442754}]},"public_addr":"172.21.15.163:6801/533442754","cluster_addr":"172.21.15.163:6803/533442754","heartbeat_back_addr":"172.21.15.163:6807/533442754","heartbeat_front_addr":"172.21.15.163:6805/533442754","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T22:31:23.899591+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T22:31:22.988274+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T22:31:23.932109+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T22:31:46.139 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-12T22:31:46.140 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-12T22:31:46.140 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-12T22:31:46.285 INFO:teuthology.orchestra.run.smithi019.stdout:38654705672 2024-09-12T22:31:46.286 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T22:31:46.286 INFO:teuthology.orchestra.run.smithi019.stdout:34359738376 2024-09-12T22:31:46.287 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T22:31:46.287 INFO:teuthology.orchestra.run.smithi019.stdout:38654705672 2024-09-12T22:31:46.288 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T22:31:46.633 INFO:teuthology.orchestra.run.smithi019.stdout:38654705670 2024-09-12T22:31:46.641 INFO:teuthology.orchestra.run.smithi019.stdout:38654705670 2024-09-12T22:31:46.641 INFO:teuthology.orchestra.run.smithi019.stdout:34359738374 2024-09-12T22:31:46.647 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705672 got 38654705670 for osd.2 2024-09-12T22:31:46.655 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705672 got 38654705670 for osd.0 2024-09-12T22:31:46.656 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738376 got 34359738374 for osd.1 2024-09-12T22:31:47.648 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T22:31:47.657 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T22:31:47.657 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T22:31:47.973 INFO:teuthology.orchestra.run.smithi019.stdout:38654705670 2024-09-12T22:31:47.986 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705672 got 38654705670 for osd.2 2024-09-12T22:31:48.000 INFO:teuthology.orchestra.run.smithi019.stdout:34359738375 2024-09-12T22:31:48.007 INFO:teuthology.orchestra.run.smithi019.stdout:38654705670 2024-09-12T22:31:48.014 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738376 got 34359738375 for osd.1 2024-09-12T22:31:48.020 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705672 got 38654705670 for osd.0 2024-09-12T22:31:48.987 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T22:31:49.015 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T22:31:49.021 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T22:31:49.303 INFO:teuthology.orchestra.run.smithi019.stdout:38654705672 2024-09-12T22:31:49.317 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705672 got 38654705672 for osd.2 2024-09-12T22:31:49.317 DEBUG:teuthology.parallel:result is None 2024-09-12T22:31:49.368 INFO:teuthology.orchestra.run.smithi019.stdout:34359738376 2024-09-12T22:31:49.374 INFO:teuthology.orchestra.run.smithi019.stdout:38654705672 2024-09-12T22:31:49.383 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738376 got 34359738376 for osd.1 2024-09-12T22:31:49.383 DEBUG:teuthology.parallel:result is None 2024-09-12T22:31:49.388 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705672 got 38654705672 for osd.0 2024-09-12T22:31:49.388 DEBUG:teuthology.parallel:result is None 2024-09-12T22:31:49.388 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T22:31:49.388 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T22:31:49.723 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:31:49.725 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-12T22:31:49.734 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":31,"stamp":"2024-09-12T22:31:48.190537+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":250,"num_write_kb":3476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":91172,"kb_used_data":1760,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283024348,"statfs":{"total":289910292480,"available":289816932352,"internally_reserved":0,"allocated":1802240,"data_stored":1382448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":91483471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.781742"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.765207+0000","last_change":"2024-09-12T22:31:37.416383+0000","last_active":"2024-09-12T22:31:40.765207+0000","last_peered":"2024-09-12T22:31:40.765207+0000","last_clean":"2024-09-12T22:31:40.765207+0000","last_became_active":"2024-09-12T22:31:37.415457+0000","last_became_peered":"2024-09-12T22:31:37.415457+0000","last_unstale":"2024-09-12T22:31:40.765207+0000","last_undegraded":"2024-09-12T22:31:40.765207+0000","last_fullsized":"2024-09-12T22:31:40.765207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:08:29.199832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.764838+0000","last_change":"2024-09-12T22:31:37.415228+0000","last_active":"2024-09-12T22:31:40.764838+0000","last_peered":"2024-09-12T22:31:40.764838+0000","last_clean":"2024-09-12T22:31:40.764838+0000","last_became_active":"2024-09-12T22:31:37.414765+0000","last_became_peered":"2024-09-12T22:31:37.414765+0000","last_unstale":"2024-09-12T22:31:40.764838+0000","last_undegraded":"2024-09-12T22:31:40.764838+0000","last_fullsized":"2024-09-12T22:31:40.764838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:50:48.426898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.696458+0000","last_change":"2024-09-12T22:31:37.419916+0000","last_active":"2024-09-12T22:31:40.696458+0000","last_peered":"2024-09-12T22:31:40.696458+0000","last_clean":"2024-09-12T22:31:40.696458+0000","last_became_active":"2024-09-12T22:31:37.418790+0000","last_became_peered":"2024-09-12T22:31:37.418790+0000","last_unstale":"2024-09-12T22:31:40.696458+0000","last_undegraded":"2024-09-12T22:31:40.696458+0000","last_fullsized":"2024-09-12T22:31:40.696458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:05:00.440878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.696238+0000","last_change":"2024-09-12T22:31:37.413094+0000","last_active":"2024-09-12T22:31:40.696238+0000","last_peered":"2024-09-12T22:31:40.696238+0000","last_clean":"2024-09-12T22:31:40.696238+0000","last_became_active":"2024-09-12T22:31:37.412746+0000","last_became_peered":"2024-09-12T22:31:37.412746+0000","last_unstale":"2024-09-12T22:31:40.696238+0000","last_undegraded":"2024-09-12T22:31:40.696238+0000","last_fullsized":"2024-09-12T22:31:40.696238+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:32:14.415120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.764831+0000","last_change":"2024-09-12T22:31:37.411276+0000","last_active":"2024-09-12T22:31:40.764831+0000","last_peered":"2024-09-12T22:31:40.764831+0000","last_clean":"2024-09-12T22:31:40.764831+0000","last_became_active":"2024-09-12T22:31:37.410380+0000","last_became_peered":"2024-09-12T22:31:37.410380+0000","last_unstale":"2024-09-12T22:31:40.764831+0000","last_undegraded":"2024-09-12T22:31:40.764831+0000","last_fullsized":"2024-09-12T22:31:40.764831+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:12:50.090880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.695814+0000","last_change":"2024-09-12T22:31:37.409177+0000","last_active":"2024-09-12T22:31:40.695814+0000","last_peered":"2024-09-12T22:31:40.695814+0000","last_clean":"2024-09-12T22:31:40.695814+0000","last_became_active":"2024-09-12T22:31:37.408811+0000","last_became_peered":"2024-09-12T22:31:37.408811+0000","last_unstale":"2024-09-12T22:31:40.695814+0000","last_undegraded":"2024-09-12T22:31:40.695814+0000","last_fullsized":"2024-09-12T22:31:40.695814+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:17:21.695079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.695805+0000","last_change":"2024-09-12T22:31:37.413023+0000","last_active":"2024-09-12T22:31:40.695805+0000","last_peered":"2024-09-12T22:31:40.695805+0000","last_clean":"2024-09-12T22:31:40.695805+0000","last_became_active":"2024-09-12T22:31:37.412691+0000","last_became_peered":"2024-09-12T22:31:37.412691+0000","last_unstale":"2024-09-12T22:31:40.695805+0000","last_undegraded":"2024-09-12T22:31:40.695805+0000","last_fullsized":"2024-09-12T22:31:40.695805+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:02:36.454134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.695562+0000","last_change":"2024-09-12T22:31:37.411074+0000","last_active":"2024-09-12T22:31:40.695562+0000","last_peered":"2024-09-12T22:31:40.695562+0000","last_clean":"2024-09-12T22:31:40.695562+0000","last_became_active":"2024-09-12T22:31:37.410633+0000","last_became_peered":"2024-09-12T22:31:37.410633+0000","last_unstale":"2024-09-12T22:31:40.695562+0000","last_undegraded":"2024-09-12T22:31:40.695562+0000","last_fullsized":"2024-09-12T22:31:40.695562+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:39:20.383152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.693279+0000","last_change":"2024-09-12T22:31:37.417800+0000","last_active":"2024-09-12T22:31:40.693279+0000","last_peered":"2024-09-12T22:31:40.693279+0000","last_clean":"2024-09-12T22:31:40.693279+0000","last_became_active":"2024-09-12T22:31:37.417355+0000","last_became_peered":"2024-09-12T22:31:37.417355+0000","last_unstale":"2024-09-12T22:31:40.693279+0000","last_undegraded":"2024-09-12T22:31:40.693279+0000","last_fullsized":"2024-09-12T22:31:40.693279+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:10:17.326263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.765115+0000","last_change":"2024-09-12T22:31:37.415967+0000","last_active":"2024-09-12T22:31:40.765115+0000","last_peered":"2024-09-12T22:31:40.765115+0000","last_clean":"2024-09-12T22:31:40.765115+0000","last_became_active":"2024-09-12T22:31:37.415003+0000","last_became_peered":"2024-09-12T22:31:37.415003+0000","last_unstale":"2024-09-12T22:31:40.765115+0000","last_undegraded":"2024-09-12T22:31:40.765115+0000","last_fullsized":"2024-09-12T22:31:40.765115+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:42:32.307876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.696536+0000","last_change":"2024-09-12T22:31:37.414469+0000","last_active":"2024-09-12T22:31:40.696536+0000","last_peered":"2024-09-12T22:31:40.696536+0000","last_clean":"2024-09-12T22:31:40.696536+0000","last_became_active":"2024-09-12T22:31:37.414165+0000","last_became_peered":"2024-09-12T22:31:37.414165+0000","last_unstale":"2024-09-12T22:31:40.696536+0000","last_undegraded":"2024-09-12T22:31:40.696536+0000","last_fullsized":"2024-09-12T22:31:40.696536+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:25:38.148636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.764751+0000","last_change":"2024-09-12T22:31:37.413051+0000","last_active":"2024-09-12T22:31:40.764751+0000","last_peered":"2024-09-12T22:31:40.764751+0000","last_clean":"2024-09-12T22:31:40.764751+0000","last_became_active":"2024-09-12T22:31:37.412614+0000","last_became_peered":"2024-09-12T22:31:37.412614+0000","last_unstale":"2024-09-12T22:31:40.764751+0000","last_undegraded":"2024-09-12T22:31:40.764751+0000","last_fullsized":"2024-09-12T22:31:40.764751+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:07:48.430262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.764626+0000","last_change":"2024-09-12T22:31:37.413063+0000","last_active":"2024-09-12T22:31:40.764626+0000","last_peered":"2024-09-12T22:31:40.764626+0000","last_clean":"2024-09-12T22:31:40.764626+0000","last_became_active":"2024-09-12T22:31:37.412118+0000","last_became_peered":"2024-09-12T22:31:37.412118+0000","last_unstale":"2024-09-12T22:31:40.764626+0000","last_undegraded":"2024-09-12T22:31:40.764626+0000","last_fullsized":"2024-09-12T22:31:40.764626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:14:17.750388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.695833+0000","last_change":"2024-09-12T22:31:37.414084+0000","last_active":"2024-09-12T22:31:40.695833+0000","last_peered":"2024-09-12T22:31:40.695833+0000","last_clean":"2024-09-12T22:31:40.695833+0000","last_became_active":"2024-09-12T22:31:37.413671+0000","last_became_peered":"2024-09-12T22:31:37.413671+0000","last_unstale":"2024-09-12T22:31:40.695833+0000","last_undegraded":"2024-09-12T22:31:40.695833+0000","last_fullsized":"2024-09-12T22:31:40.695833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:08:29.199832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.695836+0000","last_change":"2024-09-12T22:31:37.413482+0000","last_active":"2024-09-12T22:31:40.695836+0000","last_peered":"2024-09-12T22:31:40.695836+0000","last_clean":"2024-09-12T22:31:40.695836+0000","last_became_active":"2024-09-12T22:31:37.413195+0000","last_became_peered":"2024-09-12T22:31:37.413195+0000","last_unstale":"2024-09-12T22:31:40.695836+0000","last_undegraded":"2024-09-12T22:31:40.695836+0000","last_fullsized":"2024-09-12T22:31:40.695836+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:22:40.226076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.695670+0000","last_change":"2024-09-12T22:31:37.411006+0000","last_active":"2024-09-12T22:31:40.695670+0000","last_peered":"2024-09-12T22:31:40.695670+0000","last_clean":"2024-09-12T22:31:40.695670+0000","last_became_active":"2024-09-12T22:31:37.410557+0000","last_became_peered":"2024-09-12T22:31:37.410557+0000","last_unstale":"2024-09-12T22:31:40.695670+0000","last_undegraded":"2024-09-12T22:31:40.695670+0000","last_fullsized":"2024-09-12T22:31:40.695670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:08:21.709770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.693827+0000","last_change":"2024-09-12T22:31:37.412450+0000","last_active":"2024-09-12T22:31:40.693827+0000","last_peered":"2024-09-12T22:31:40.693827+0000","last_clean":"2024-09-12T22:31:40.693827+0000","last_became_active":"2024-09-12T22:31:37.412234+0000","last_became_peered":"2024-09-12T22:31:37.412234+0000","last_unstale":"2024-09-12T22:31:40.693827+0000","last_undegraded":"2024-09-12T22:31:40.693827+0000","last_fullsized":"2024-09-12T22:31:40.693827+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:15:59.559809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.765237+0000","last_change":"2024-09-12T22:31:37.414144+0000","last_active":"2024-09-12T22:31:40.765237+0000","last_peered":"2024-09-12T22:31:40.765237+0000","last_clean":"2024-09-12T22:31:40.765237+0000","last_became_active":"2024-09-12T22:31:37.413670+0000","last_became_peered":"2024-09-12T22:31:37.413670+0000","last_unstale":"2024-09-12T22:31:40.765237+0000","last_undegraded":"2024-09-12T22:31:40.765237+0000","last_fullsized":"2024-09-12T22:31:40.765237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:42:51.694128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.693356+0000","last_change":"2024-09-12T22:31:37.417442+0000","last_active":"2024-09-12T22:31:40.693356+0000","last_peered":"2024-09-12T22:31:40.693356+0000","last_clean":"2024-09-12T22:31:40.693356+0000","last_became_active":"2024-09-12T22:31:37.417133+0000","last_became_peered":"2024-09-12T22:31:37.417133+0000","last_unstale":"2024-09-12T22:31:40.693356+0000","last_undegraded":"2024-09-12T22:31:40.693356+0000","last_fullsized":"2024-09-12T22:31:40.693356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:36.458145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.696321+0000","last_change":"2024-09-12T22:31:37.414235+0000","last_active":"2024-09-12T22:31:40.696321+0000","last_peered":"2024-09-12T22:31:40.696321+0000","last_clean":"2024-09-12T22:31:40.696321+0000","last_became_active":"2024-09-12T22:31:37.413786+0000","last_became_peered":"2024-09-12T22:31:37.413786+0000","last_unstale":"2024-09-12T22:31:40.696321+0000","last_undegraded":"2024-09-12T22:31:40.696321+0000","last_fullsized":"2024-09-12T22:31:40.696321+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:21:11.866973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.696190+0000","last_change":"2024-09-12T22:31:37.415382+0000","last_active":"2024-09-12T22:31:40.696190+0000","last_peered":"2024-09-12T22:31:40.696190+0000","last_clean":"2024-09-12T22:31:40.696190+0000","last_became_active":"2024-09-12T22:31:37.414319+0000","last_became_peered":"2024-09-12T22:31:37.414319+0000","last_unstale":"2024-09-12T22:31:40.696190+0000","last_undegraded":"2024-09-12T22:31:40.696190+0000","last_fullsized":"2024-09-12T22:31:40.696190+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:26:25.578693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.764450+0000","last_change":"2024-09-12T22:31:37.412046+0000","last_active":"2024-09-12T22:31:40.764450+0000","last_peered":"2024-09-12T22:31:40.764450+0000","last_clean":"2024-09-12T22:31:40.764450+0000","last_became_active":"2024-09-12T22:31:37.411623+0000","last_became_peered":"2024-09-12T22:31:37.411623+0000","last_unstale":"2024-09-12T22:31:40.764450+0000","last_undegraded":"2024-09-12T22:31:40.764450+0000","last_fullsized":"2024-09-12T22:31:40.764450+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:24:15.504358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.692558+0000","last_change":"2024-09-12T22:31:37.410364+0000","last_active":"2024-09-12T22:31:40.692558+0000","last_peered":"2024-09-12T22:31:40.692558+0000","last_clean":"2024-09-12T22:31:40.692558+0000","last_became_active":"2024-09-12T22:31:37.409951+0000","last_became_peered":"2024-09-12T22:31:37.409951+0000","last_unstale":"2024-09-12T22:31:40.692558+0000","last_undegraded":"2024-09-12T22:31:40.692558+0000","last_fullsized":"2024-09-12T22:31:40.692558+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:39:17.785755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.764159+0000","last_change":"2024-09-12T22:31:37.415240+0000","last_active":"2024-09-12T22:31:40.764159+0000","last_peered":"2024-09-12T22:31:40.764159+0000","last_clean":"2024-09-12T22:31:40.764159+0000","last_became_active":"2024-09-12T22:31:37.414069+0000","last_became_peered":"2024-09-12T22:31:37.414069+0000","last_unstale":"2024-09-12T22:31:40.764159+0000","last_undegraded":"2024-09-12T22:31:40.764159+0000","last_fullsized":"2024-09-12T22:31:40.764159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:16:35.027772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.765207+0000","last_change":"2024-09-12T22:31:37.415309+0000","last_active":"2024-09-12T22:31:40.765207+0000","last_peered":"2024-09-12T22:31:40.765207+0000","last_clean":"2024-09-12T22:31:40.765207+0000","last_became_active":"2024-09-12T22:31:37.414792+0000","last_became_peered":"2024-09-12T22:31:37.414792+0000","last_unstale":"2024-09-12T22:31:40.765207+0000","last_undegraded":"2024-09-12T22:31:40.765207+0000","last_fullsized":"2024-09-12T22:31:40.765207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:08:07.115355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.693507+0000","last_change":"2024-09-12T22:31:37.411880+0000","last_active":"2024-09-12T22:31:40.693507+0000","last_peered":"2024-09-12T22:31:40.693507+0000","last_clean":"2024-09-12T22:31:40.693507+0000","last_became_active":"2024-09-12T22:31:37.410563+0000","last_became_peered":"2024-09-12T22:31:37.410563+0000","last_unstale":"2024-09-12T22:31:40.693507+0000","last_undegraded":"2024-09-12T22:31:40.693507+0000","last_fullsized":"2024-09-12T22:31:40.693507+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:47:52.560533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.696794+0000","last_change":"2024-09-12T22:31:37.419603+0000","last_active":"2024-09-12T22:31:40.696794+0000","last_peered":"2024-09-12T22:31:40.696794+0000","last_clean":"2024-09-12T22:31:40.696794+0000","last_became_active":"2024-09-12T22:31:37.418725+0000","last_became_peered":"2024-09-12T22:31:37.418725+0000","last_unstale":"2024-09-12T22:31:40.696794+0000","last_undegraded":"2024-09-12T22:31:40.696794+0000","last_fullsized":"2024-09-12T22:31:40.696794+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:02:44.183545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.765102+0000","last_change":"2024-09-12T22:31:37.412884+0000","last_active":"2024-09-12T22:31:40.765102+0000","last_peered":"2024-09-12T22:31:40.765102+0000","last_clean":"2024-09-12T22:31:40.765102+0000","last_became_active":"2024-09-12T22:31:37.412469+0000","last_became_peered":"2024-09-12T22:31:37.412469+0000","last_unstale":"2024-09-12T22:31:40.765102+0000","last_undegraded":"2024-09-12T22:31:40.765102+0000","last_fullsized":"2024-09-12T22:31:40.765102+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:05:00.440878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.693088+0000","last_change":"2024-09-12T22:31:37.414918+0000","last_active":"2024-09-12T22:31:40.693088+0000","last_peered":"2024-09-12T22:31:40.693088+0000","last_clean":"2024-09-12T22:31:40.693088+0000","last_became_active":"2024-09-12T22:31:37.414225+0000","last_became_peered":"2024-09-12T22:31:37.414225+0000","last_unstale":"2024-09-12T22:31:40.693088+0000","last_undegraded":"2024-09-12T22:31:40.693088+0000","last_fullsized":"2024-09-12T22:31:40.693088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:56:14.649228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.764655+0000","last_change":"2024-09-12T22:31:37.411569+0000","last_active":"2024-09-12T22:31:40.764655+0000","last_peered":"2024-09-12T22:31:40.764655+0000","last_clean":"2024-09-12T22:31:40.764655+0000","last_became_active":"2024-09-12T22:31:37.410619+0000","last_became_peered":"2024-09-12T22:31:37.410619+0000","last_unstale":"2024-09-12T22:31:40.764655+0000","last_undegraded":"2024-09-12T22:31:40.764655+0000","last_fullsized":"2024-09-12T22:31:40.764655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:30:01.012271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.692595+0000","last_change":"2024-09-12T22:31:37.415589+0000","last_active":"2024-09-12T22:31:40.692595+0000","last_peered":"2024-09-12T22:31:40.692595+0000","last_clean":"2024-09-12T22:31:40.692595+0000","last_became_active":"2024-09-12T22:31:37.415285+0000","last_became_peered":"2024-09-12T22:31:37.415285+0000","last_unstale":"2024-09-12T22:31:40.692595+0000","last_undegraded":"2024-09-12T22:31:40.692595+0000","last_fullsized":"2024-09-12T22:31:40.692595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:06:25.913810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.695680+0000","last_change":"2024-09-12T22:31:37.415190+0000","last_active":"2024-09-12T22:31:40.695680+0000","last_peered":"2024-09-12T22:31:40.695680+0000","last_clean":"2024-09-12T22:31:40.695680+0000","last_became_active":"2024-09-12T22:31:37.414265+0000","last_became_peered":"2024-09-12T22:31:37.414265+0000","last_unstale":"2024-09-12T22:31:40.695680+0000","last_undegraded":"2024-09-12T22:31:40.695680+0000","last_fullsized":"2024-09-12T22:31:40.695680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:07:02.173590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.765000+0000","last_change":"2024-09-12T22:31:37.409362+0000","last_active":"2024-09-12T22:31:40.765000+0000","last_peered":"2024-09-12T22:31:40.765000+0000","last_clean":"2024-09-12T22:31:40.765000+0000","last_became_active":"2024-09-12T22:31:37.408896+0000","last_became_peered":"2024-09-12T22:31:37.408896+0000","last_unstale":"2024-09-12T22:31:40.765000+0000","last_undegraded":"2024-09-12T22:31:40.765000+0000","last_fullsized":"2024-09-12T22:31:40.765000+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:17:21.695079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"19'2","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.696151+0000","last_change":"2024-09-12T22:31:36.412082+0000","last_active":"2024-09-12T22:31:40.696151+0000","last_peered":"2024-09-12T22:31:40.696151+0000","last_clean":"2024-09-12T22:31:40.696151+0000","last_became_active":"2024-09-12T22:31:36.410871+0000","last_became_peered":"2024-09-12T22:31:36.410871+0000","last_unstale":"2024-09-12T22:31:40.696151+0000","last_undegraded":"2024-09-12T22:31:40.696151+0000","last_fullsized":"2024-09-12T22:31:40.696151+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:30:49.127253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.765123+0000","last_change":"2024-09-12T22:31:37.411790+0000","last_active":"2024-09-12T22:31:40.765123+0000","last_peered":"2024-09-12T22:31:40.765123+0000","last_clean":"2024-09-12T22:31:40.765123+0000","last_became_active":"2024-09-12T22:31:37.411414+0000","last_became_peered":"2024-09-12T22:31:37.411414+0000","last_unstale":"2024-09-12T22:31:40.765123+0000","last_undegraded":"2024-09-12T22:31:40.765123+0000","last_fullsized":"2024-09-12T22:31:40.765123+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:22:40.226076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.692921+0000","last_change":"2024-09-12T22:31:36.408563+0000","last_active":"2024-09-12T22:31:40.692921+0000","last_peered":"2024-09-12T22:31:40.692921+0000","last_clean":"2024-09-12T22:31:40.692921+0000","last_became_active":"2024-09-12T22:31:36.407447+0000","last_became_peered":"2024-09-12T22:31:36.407447+0000","last_unstale":"2024-09-12T22:31:40.692921+0000","last_undegraded":"2024-09-12T22:31:40.692921+0000","last_fullsized":"2024-09-12T22:31:40.692921+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:29:37.933109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.693701+0000","last_change":"2024-09-12T22:31:37.411680+0000","last_active":"2024-09-12T22:31:40.693701+0000","last_peered":"2024-09-12T22:31:40.693701+0000","last_clean":"2024-09-12T22:31:40.693701+0000","last_became_active":"2024-09-12T22:31:37.411168+0000","last_became_peered":"2024-09-12T22:31:37.411168+0000","last_unstale":"2024-09-12T22:31:40.693701+0000","last_undegraded":"2024-09-12T22:31:40.693701+0000","last_fullsized":"2024-09-12T22:31:40.693701+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:27.706282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.764438+0000","last_change":"2024-09-12T22:31:36.411271+0000","last_active":"2024-09-12T22:31:40.764438+0000","last_peered":"2024-09-12T22:31:40.764438+0000","last_clean":"2024-09-12T22:31:40.764438+0000","last_became_active":"2024-09-12T22:31:36.410706+0000","last_became_peered":"2024-09-12T22:31:36.410706+0000","last_unstale":"2024-09-12T22:31:40.764438+0000","last_undegraded":"2024-09-12T22:31:40.764438+0000","last_fullsized":"2024-09-12T22:31:40.764438+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:43:22.805855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.693409+0000","last_change":"2024-09-12T22:31:37.411218+0000","last_active":"2024-09-12T22:31:40.693409+0000","last_peered":"2024-09-12T22:31:40.693409+0000","last_clean":"2024-09-12T22:31:40.693409+0000","last_became_active":"2024-09-12T22:31:37.409666+0000","last_became_peered":"2024-09-12T22:31:37.409666+0000","last_unstale":"2024-09-12T22:31:40.693409+0000","last_undegraded":"2024-09-12T22:31:40.693409+0000","last_fullsized":"2024-09-12T22:31:40.693409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:45:34.230090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"19'8","reported_seq":24,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.695805+0000","last_change":"2024-09-12T22:31:36.411811+0000","last_active":"2024-09-12T22:31:40.695805+0000","last_peered":"2024-09-12T22:31:40.695805+0000","last_clean":"2024-09-12T22:31:40.695805+0000","last_became_active":"2024-09-12T22:31:36.410101+0000","last_became_peered":"2024-09-12T22:31:36.410101+0000","last_unstale":"2024-09-12T22:31:40.695805+0000","last_undegraded":"2024-09-12T22:31:40.695805+0000","last_fullsized":"2024-09-12T22:31:40.695805+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:33:02.410148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"19'1","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.696872+0000","last_change":"2024-09-12T22:31:36.410970+0000","last_active":"2024-09-12T22:31:40.696872+0000","last_peered":"2024-09-12T22:31:40.696872+0000","last_clean":"2024-09-12T22:31:40.696872+0000","last_became_active":"2024-09-12T22:31:36.409754+0000","last_became_peered":"2024-09-12T22:31:36.409754+0000","last_unstale":"2024-09-12T22:31:40.696872+0000","last_undegraded":"2024-09-12T22:31:40.696872+0000","last_fullsized":"2024-09-12T22:31:40.696872+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:30:07.724418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.764193+0000","last_change":"2024-09-12T22:31:37.415050+0000","last_active":"2024-09-12T22:31:40.764193+0000","last_peered":"2024-09-12T22:31:40.764193+0000","last_clean":"2024-09-12T22:31:40.764193+0000","last_became_active":"2024-09-12T22:31:37.414290+0000","last_became_peered":"2024-09-12T22:31:37.414290+0000","last_unstale":"2024-09-12T22:31:40.764193+0000","last_undegraded":"2024-09-12T22:31:40.764193+0000","last_fullsized":"2024-09-12T22:31:40.764193+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:47:15.502575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"19'2","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.765286+0000","last_change":"2024-09-12T22:31:36.411725+0000","last_active":"2024-09-12T22:31:40.765286+0000","last_peered":"2024-09-12T22:31:40.765286+0000","last_clean":"2024-09-12T22:31:40.765286+0000","last_became_active":"2024-09-12T22:31:36.411407+0000","last_became_peered":"2024-09-12T22:31:36.411407+0000","last_unstale":"2024-09-12T22:31:40.765286+0000","last_undegraded":"2024-09-12T22:31:40.765286+0000","last_fullsized":"2024-09-12T22:31:40.765286+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:30:07.724418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.764522+0000","last_change":"2024-09-12T22:31:37.413857+0000","last_active":"2024-09-12T22:31:40.764522+0000","last_peered":"2024-09-12T22:31:40.764522+0000","last_clean":"2024-09-12T22:31:40.764522+0000","last_became_active":"2024-09-12T22:31:37.412941+0000","last_became_peered":"2024-09-12T22:31:37.412941+0000","last_unstale":"2024-09-12T22:31:40.764522+0000","last_undegraded":"2024-09-12T22:31:40.764522+0000","last_fullsized":"2024-09-12T22:31:40.764522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:58:45.134258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"19'1","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.696863+0000","last_change":"2024-09-12T22:31:36.411320+0000","last_active":"2024-09-12T22:31:40.696863+0000","last_peered":"2024-09-12T22:31:40.696863+0000","last_clean":"2024-09-12T22:31:40.696863+0000","last_became_active":"2024-09-12T22:31:36.409837+0000","last_became_peered":"2024-09-12T22:31:36.409837+0000","last_unstale":"2024-09-12T22:31:40.696863+0000","last_undegraded":"2024-09-12T22:31:40.696863+0000","last_fullsized":"2024-09-12T22:31:40.696863+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:36:53.914922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.695949+0000","last_change":"2024-09-12T22:31:37.414809+0000","last_active":"2024-09-12T22:31:40.695949+0000","last_peered":"2024-09-12T22:31:40.695949+0000","last_clean":"2024-09-12T22:31:40.695949+0000","last_became_active":"2024-09-12T22:31:37.414492+0000","last_became_peered":"2024-09-12T22:31:37.414492+0000","last_unstale":"2024-09-12T22:31:40.695949+0000","last_undegraded":"2024-09-12T22:31:40.695949+0000","last_fullsized":"2024-09-12T22:31:40.695949+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:50:48.426898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.696715+0000","last_change":"2024-09-12T22:31:36.412068+0000","last_active":"2024-09-12T22:31:40.696715+0000","last_peered":"2024-09-12T22:31:40.696715+0000","last_clean":"2024-09-12T22:31:40.696715+0000","last_became_active":"2024-09-12T22:31:36.411366+0000","last_became_peered":"2024-09-12T22:31:36.411366+0000","last_unstale":"2024-09-12T22:31:40.696715+0000","last_undegraded":"2024-09-12T22:31:40.696715+0000","last_fullsized":"2024-09-12T22:31:40.696715+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:35:51.647051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.693166+0000","last_change":"2024-09-12T22:31:37.410303+0000","last_active":"2024-09-12T22:31:40.693166+0000","last_peered":"2024-09-12T22:31:40.693166+0000","last_clean":"2024-09-12T22:31:40.693166+0000","last_became_active":"2024-09-12T22:31:37.409607+0000","last_became_peered":"2024-09-12T22:31:37.409607+0000","last_unstale":"2024-09-12T22:31:40.693166+0000","last_undegraded":"2024-09-12T22:31:40.693166+0000","last_fullsized":"2024-09-12T22:31:40.693166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:53:42.732654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"19'2","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.693353+0000","last_change":"2024-09-12T22:31:36.407974+0000","last_active":"2024-09-12T22:31:40.693353+0000","last_peered":"2024-09-12T22:31:40.693353+0000","last_clean":"2024-09-12T22:31:40.693353+0000","last_became_active":"2024-09-12T22:31:36.406955+0000","last_became_peered":"2024-09-12T22:31:36.406955+0000","last_unstale":"2024-09-12T22:31:40.693353+0000","last_undegraded":"2024-09-12T22:31:40.693353+0000","last_fullsized":"2024-09-12T22:31:40.693353+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:07:34.831264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.696465+0000","last_change":"2024-09-12T22:31:37.415285+0000","last_active":"2024-09-12T22:31:40.696465+0000","last_peered":"2024-09-12T22:31:40.696465+0000","last_clean":"2024-09-12T22:31:40.696465+0000","last_became_active":"2024-09-12T22:31:37.414890+0000","last_became_peered":"2024-09-12T22:31:37.414890+0000","last_unstale":"2024-09-12T22:31:40.696465+0000","last_undegraded":"2024-09-12T22:31:40.696465+0000","last_fullsized":"2024-09-12T22:31:40.696465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:38:16.956786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.696019+0000","last_change":"2024-09-12T22:31:36.412147+0000","last_active":"2024-09-12T22:31:40.696019+0000","last_peered":"2024-09-12T22:31:40.696019+0000","last_clean":"2024-09-12T22:31:40.696019+0000","last_became_active":"2024-09-12T22:31:36.411382+0000","last_became_peered":"2024-09-12T22:31:36.411382+0000","last_unstale":"2024-09-12T22:31:40.696019+0000","last_undegraded":"2024-09-12T22:31:40.696019+0000","last_fullsized":"2024-09-12T22:31:40.696019+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:54:51.454867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.696770+0000","last_change":"2024-09-12T22:31:37.420209+0000","last_active":"2024-09-12T22:31:40.696770+0000","last_peered":"2024-09-12T22:31:40.696770+0000","last_clean":"2024-09-12T22:31:40.696770+0000","last_became_active":"2024-09-12T22:31:37.419267+0000","last_became_peered":"2024-09-12T22:31:37.419267+0000","last_unstale":"2024-09-12T22:31:40.696770+0000","last_undegraded":"2024-09-12T22:31:40.696770+0000","last_fullsized":"2024-09-12T22:31:40.696770+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:36.790111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.764556+0000","last_change":"2024-09-12T22:31:36.411190+0000","last_active":"2024-09-12T22:31:40.764556+0000","last_peered":"2024-09-12T22:31:40.764556+0000","last_clean":"2024-09-12T22:31:40.764556+0000","last_became_active":"2024-09-12T22:31:36.410548+0000","last_became_peered":"2024-09-12T22:31:36.410548+0000","last_unstale":"2024-09-12T22:31:40.764556+0000","last_undegraded":"2024-09-12T22:31:40.764556+0000","last_fullsized":"2024-09-12T22:31:40.764556+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:10:20.300894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.696807+0000","last_change":"2024-09-12T22:31:37.418749+0000","last_active":"2024-09-12T22:31:40.696807+0000","last_peered":"2024-09-12T22:31:40.696807+0000","last_clean":"2024-09-12T22:31:40.696807+0000","last_became_active":"2024-09-12T22:31:37.418360+0000","last_became_peered":"2024-09-12T22:31:37.418360+0000","last_unstale":"2024-09-12T22:31:40.696807+0000","last_undegraded":"2024-09-12T22:31:40.696807+0000","last_fullsized":"2024-09-12T22:31:40.696807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:50:08.152699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.764246+0000","last_change":"2024-09-12T22:31:36.412187+0000","last_active":"2024-09-12T22:31:40.764246+0000","last_peered":"2024-09-12T22:31:40.764246+0000","last_clean":"2024-09-12T22:31:40.764246+0000","last_became_active":"2024-09-12T22:31:36.411935+0000","last_became_peered":"2024-09-12T22:31:36.411935+0000","last_unstale":"2024-09-12T22:31:40.764246+0000","last_undegraded":"2024-09-12T22:31:40.764246+0000","last_fullsized":"2024-09-12T22:31:40.764246+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:41:04.029445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.693559+0000","last_change":"2024-09-12T22:31:37.417881+0000","last_active":"2024-09-12T22:31:40.693559+0000","last_peered":"2024-09-12T22:31:40.693559+0000","last_clean":"2024-09-12T22:31:40.693559+0000","last_became_active":"2024-09-12T22:31:37.417572+0000","last_became_peered":"2024-09-12T22:31:37.417572+0000","last_unstale":"2024-09-12T22:31:40.693559+0000","last_undegraded":"2024-09-12T22:31:40.693559+0000","last_fullsized":"2024-09-12T22:31:40.693559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:19:16.367589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":226,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.695987+0000","last_change":"2024-09-12T22:31:27.631847+0000","last_active":"2024-09-12T22:31:40.695987+0000","last_peered":"2024-09-12T22:31:40.695987+0000","last_clean":"2024-09-12T22:31:40.695987+0000","last_became_active":"2024-09-12T22:31:27.631027+0000","last_became_peered":"2024-09-12T22:31:27.631027+0000","last_unstale":"2024-09-12T22:31:40.695987+0000","last_undegraded":"2024-09-12T22:31:40.695987+0000","last_fullsized":"2024-09-12T22:31:40.695987+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:26.229539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:26.229539+0000","last_clean_scrub_stamp":"2024-09-12T22:31:26.229539+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:59:24.181319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":30,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.696417+0000","last_change":"2024-09-12T22:31:34.286952+0000","last_active":"2024-09-12T22:31:40.696417+0000","last_peered":"2024-09-12T22:31:40.696417+0000","last_clean":"2024-09-12T22:31:40.696417+0000","last_became_active":"2024-09-12T22:31:32.283661+0000","last_became_peered":"2024-09-12T22:31:32.283661+0000","last_unstale":"2024-09-12T22:31:40.696417+0000","last_undegraded":"2024-09-12T22:31:40.696417+0000","last_fullsized":"2024-09-12T22:31:40.696417+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:21.681390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000621274,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.693061+0000","last_change":"2024-09-12T22:31:36.411275+0000","last_active":"2024-09-12T22:31:40.693061+0000","last_peered":"2024-09-12T22:31:40.693061+0000","last_clean":"2024-09-12T22:31:40.693061+0000","last_became_active":"2024-09-12T22:31:36.410595+0000","last_became_peered":"2024-09-12T22:31:36.410595+0000","last_unstale":"2024-09-12T22:31:40.693061+0000","last_undegraded":"2024-09-12T22:31:40.693061+0000","last_fullsized":"2024-09-12T22:31:40.693061+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:38:14.895625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.696887+0000","last_change":"2024-09-12T22:31:37.419976+0000","last_active":"2024-09-12T22:31:40.696887+0000","last_peered":"2024-09-12T22:31:40.696887+0000","last_clean":"2024-09-12T22:31:40.696887+0000","last_became_active":"2024-09-12T22:31:37.419161+0000","last_became_peered":"2024-09-12T22:31:37.419161+0000","last_unstale":"2024-09-12T22:31:40.696887+0000","last_undegraded":"2024-09-12T22:31:40.696887+0000","last_fullsized":"2024-09-12T22:31:40.696887+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:07:26.070097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":29,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.695956+0000","last_change":"2024-09-12T22:31:34.286642+0000","last_active":"2024-09-12T22:31:40.695956+0000","last_peered":"2024-09-12T22:31:40.695956+0000","last_clean":"2024-09-12T22:31:40.695956+0000","last_became_active":"2024-09-12T22:31:32.283601+0000","last_became_peered":"2024-09-12T22:31:32.283601+0000","last_unstale":"2024-09-12T22:31:40.695956+0000","last_undegraded":"2024-09-12T22:31:40.695956+0000","last_fullsized":"2024-09-12T22:31:40.695956+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:40:06.769540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037858999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.692788+0000","last_change":"2024-09-12T22:31:36.407395+0000","last_active":"2024-09-12T22:31:40.692788+0000","last_peered":"2024-09-12T22:31:40.692788+0000","last_clean":"2024-09-12T22:31:40.692788+0000","last_became_active":"2024-09-12T22:31:36.406770+0000","last_became_peered":"2024-09-12T22:31:36.406770+0000","last_unstale":"2024-09-12T22:31:40.692788+0000","last_undegraded":"2024-09-12T22:31:40.692788+0000","last_fullsized":"2024-09-12T22:31:40.692788+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:49:26.547848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.765109+0000","last_change":"2024-09-12T22:31:37.414075+0000","last_active":"2024-09-12T22:31:40.765109+0000","last_peered":"2024-09-12T22:31:40.765109+0000","last_clean":"2024-09-12T22:31:40.765109+0000","last_became_active":"2024-09-12T22:31:37.413491+0000","last_became_peered":"2024-09-12T22:31:37.413491+0000","last_unstale":"2024-09-12T22:31:40.765109+0000","last_undegraded":"2024-09-12T22:31:40.765109+0000","last_fullsized":"2024-09-12T22:31:40.765109+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:26:25.578693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":29,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.693038+0000","last_change":"2024-09-12T22:31:34.286394+0000","last_active":"2024-09-12T22:31:40.693038+0000","last_peered":"2024-09-12T22:31:40.693038+0000","last_clean":"2024-09-12T22:31:40.693038+0000","last_became_active":"2024-09-12T22:31:32.280062+0000","last_became_peered":"2024-09-12T22:31:32.280062+0000","last_unstale":"2024-09-12T22:31:40.693038+0000","last_undegraded":"2024-09-12T22:31:40.693038+0000","last_fullsized":"2024-09-12T22:31:40.693038+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:20:23.663838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039540700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.764247+0000","last_change":"2024-09-12T22:31:36.413752+0000","last_active":"2024-09-12T22:31:40.764247+0000","last_peered":"2024-09-12T22:31:40.764247+0000","last_clean":"2024-09-12T22:31:40.764247+0000","last_became_active":"2024-09-12T22:31:36.413486+0000","last_became_peered":"2024-09-12T22:31:36.413486+0000","last_unstale":"2024-09-12T22:31:40.764247+0000","last_undegraded":"2024-09-12T22:31:40.764247+0000","last_fullsized":"2024-09-12T22:31:40.764247+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:37:20.891838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.693603+0000","last_change":"2024-09-12T22:31:37.417636+0000","last_active":"2024-09-12T22:31:40.693603+0000","last_peered":"2024-09-12T22:31:40.693603+0000","last_clean":"2024-09-12T22:31:40.693603+0000","last_became_active":"2024-09-12T22:31:37.417230+0000","last_became_peered":"2024-09-12T22:31:37.417230+0000","last_unstale":"2024-09-12T22:31:40.693603+0000","last_undegraded":"2024-09-12T22:31:40.693603+0000","last_fullsized":"2024-09-12T22:31:40.693603+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:44:29.729122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":31,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.696205+0000","last_change":"2024-09-12T22:31:34.286938+0000","last_active":"2024-09-12T22:31:40.696205+0000","last_peered":"2024-09-12T22:31:40.696205+0000","last_clean":"2024-09-12T22:31:40.696205+0000","last_became_active":"2024-09-12T22:31:32.282230+0000","last_became_peered":"2024-09-12T22:31:32.282230+0000","last_unstale":"2024-09-12T22:31:40.696205+0000","last_undegraded":"2024-09-12T22:31:40.696205+0000","last_fullsized":"2024-09-12T22:31:40.696205+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:11:05.988384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000615758,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.696467+0000","last_change":"2024-09-12T22:31:36.410694+0000","last_active":"2024-09-12T22:31:40.696467+0000","last_peered":"2024-09-12T22:31:40.696467+0000","last_clean":"2024-09-12T22:31:40.696467+0000","last_became_active":"2024-09-12T22:31:36.409816+0000","last_became_peered":"2024-09-12T22:31:36.409816+0000","last_unstale":"2024-09-12T22:31:40.696467+0000","last_undegraded":"2024-09-12T22:31:40.696467+0000","last_fullsized":"2024-09-12T22:31:40.696467+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:40:35.369213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.693429+0000","last_change":"2024-09-12T22:31:37.414608+0000","last_active":"2024-09-12T22:31:40.693429+0000","last_peered":"2024-09-12T22:31:40.693429+0000","last_clean":"2024-09-12T22:31:40.693429+0000","last_became_active":"2024-09-12T22:31:37.414307+0000","last_became_peered":"2024-09-12T22:31:37.414307+0000","last_unstale":"2024-09-12T22:31:40.693429+0000","last_undegraded":"2024-09-12T22:31:40.693429+0000","last_fullsized":"2024-09-12T22:31:40.693429+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:41:21.231511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.696973+0000","last_change":"2024-09-12T22:31:36.411355+0000","last_active":"2024-09-12T22:31:40.696973+0000","last_peered":"2024-09-12T22:31:40.696973+0000","last_clean":"2024-09-12T22:31:40.696973+0000","last_became_active":"2024-09-12T22:31:36.410529+0000","last_became_peered":"2024-09-12T22:31:36.410529+0000","last_unstale":"2024-09-12T22:31:40.696973+0000","last_undegraded":"2024-09-12T22:31:40.696973+0000","last_fullsized":"2024-09-12T22:31:40.696973+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:19:47.356688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":29,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.693624+0000","last_change":"2024-09-12T22:31:34.286457+0000","last_active":"2024-09-12T22:31:40.693624+0000","last_peered":"2024-09-12T22:31:40.693624+0000","last_clean":"2024-09-12T22:31:40.693624+0000","last_became_active":"2024-09-12T22:31:32.280007+0000","last_became_peered":"2024-09-12T22:31:32.280007+0000","last_unstale":"2024-09-12T22:31:40.693624+0000","last_undegraded":"2024-09-12T22:31:40.693624+0000","last_fullsized":"2024-09-12T22:31:40.693624+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:09.068038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041972500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.764666+0000","last_change":"2024-09-12T22:31:37.410386+0000","last_active":"2024-09-12T22:31:40.764666+0000","last_peered":"2024-09-12T22:31:40.764666+0000","last_clean":"2024-09-12T22:31:40.764666+0000","last_became_active":"2024-09-12T22:31:37.409928+0000","last_became_peered":"2024-09-12T22:31:37.409928+0000","last_unstale":"2024-09-12T22:31:40.764666+0000","last_undegraded":"2024-09-12T22:31:40.764666+0000","last_fullsized":"2024-09-12T22:31:40.764666+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:02:36.454134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.693491+0000","last_change":"2024-09-12T22:31:36.410324+0000","last_active":"2024-09-12T22:31:40.693491+0000","last_peered":"2024-09-12T22:31:40.693491+0000","last_clean":"2024-09-12T22:31:40.693491+0000","last_became_active":"2024-09-12T22:31:36.409199+0000","last_became_peered":"2024-09-12T22:31:36.409199+0000","last_unstale":"2024-09-12T22:31:40.693491+0000","last_undegraded":"2024-09-12T22:31:40.693491+0000","last_fullsized":"2024-09-12T22:31:40.693491+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:06:54.608936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":29,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.765417+0000","last_change":"2024-09-12T22:31:34.839044+0000","last_active":"2024-09-12T22:31:40.765417+0000","last_peered":"2024-09-12T22:31:40.765417+0000","last_clean":"2024-09-12T22:31:40.765417+0000","last_became_active":"2024-09-12T22:31:32.279671+0000","last_became_peered":"2024-09-12T22:31:32.279671+0000","last_unstale":"2024-09-12T22:31:40.765417+0000","last_undegraded":"2024-09-12T22:31:40.765417+0000","last_fullsized":"2024-09-12T22:31:40.765417+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:27:49.809935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036776499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.764836+0000","last_change":"2024-09-12T22:31:37.410289+0000","last_active":"2024-09-12T22:31:40.764836+0000","last_peered":"2024-09-12T22:31:40.764836+0000","last_clean":"2024-09-12T22:31:40.764836+0000","last_became_active":"2024-09-12T22:31:37.409446+0000","last_became_peered":"2024-09-12T22:31:37.409446+0000","last_unstale":"2024-09-12T22:31:40.764836+0000","last_undegraded":"2024-09-12T22:31:40.764836+0000","last_fullsized":"2024-09-12T22:31:40.764836+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:03:32.167116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"19'2","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.693884+0000","last_change":"2024-09-12T22:31:36.409397+0000","last_active":"2024-09-12T22:31:40.693884+0000","last_peered":"2024-09-12T22:31:40.693884+0000","last_clean":"2024-09-12T22:31:40.693884+0000","last_became_active":"2024-09-12T22:31:36.408787+0000","last_became_peered":"2024-09-12T22:31:36.408787+0000","last_unstale":"2024-09-12T22:31:40.693884+0000","last_undegraded":"2024-09-12T22:31:40.693884+0000","last_fullsized":"2024-09-12T22:31:40.693884+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:29:03.467352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":29,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.693852+0000","last_change":"2024-09-12T22:31:34.286639+0000","last_active":"2024-09-12T22:31:40.693852+0000","last_peered":"2024-09-12T22:31:40.693852+0000","last_clean":"2024-09-12T22:31:40.693852+0000","last_became_active":"2024-09-12T22:31:32.280092+0000","last_became_peered":"2024-09-12T22:31:32.280092+0000","last_unstale":"2024-09-12T22:31:40.693852+0000","last_undegraded":"2024-09-12T22:31:40.693852+0000","last_fullsized":"2024-09-12T22:31:40.693852+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:02:40.821530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058589999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.692777+0000","last_change":"2024-09-12T22:31:37.411152+0000","last_active":"2024-09-12T22:31:40.692777+0000","last_peered":"2024-09-12T22:31:40.692777+0000","last_clean":"2024-09-12T22:31:40.692777+0000","last_became_active":"2024-09-12T22:31:37.410558+0000","last_became_peered":"2024-09-12T22:31:37.410558+0000","last_unstale":"2024-09-12T22:31:40.692777+0000","last_undegraded":"2024-09-12T22:31:40.692777+0000","last_fullsized":"2024-09-12T22:31:40.692777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:14:29.892478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"20'1","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.693797+0000","last_change":"2024-09-12T22:31:36.407460+0000","last_active":"2024-09-12T22:31:40.693797+0000","last_peered":"2024-09-12T22:31:40.693797+0000","last_clean":"2024-09-12T22:31:40.693797+0000","last_became_active":"2024-09-12T22:31:36.406729+0000","last_became_peered":"2024-09-12T22:31:36.406729+0000","last_unstale":"2024-09-12T22:31:40.693797+0000","last_undegraded":"2024-09-12T22:31:40.693797+0000","last_fullsized":"2024-09-12T22:31:40.693797+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:27:58.012573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":29,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.696985+0000","last_change":"2024-09-12T22:31:34.286699+0000","last_active":"2024-09-12T22:31:40.696985+0000","last_peered":"2024-09-12T22:31:40.696985+0000","last_clean":"2024-09-12T22:31:40.696985+0000","last_became_active":"2024-09-12T22:31:32.283606+0000","last_became_peered":"2024-09-12T22:31:32.283606+0000","last_unstale":"2024-09-12T22:31:40.696985+0000","last_undegraded":"2024-09-12T22:31:40.696985+0000","last_fullsized":"2024-09-12T22:31:40.696985+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:09:32.050798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000382109,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.764377+0000","last_change":"2024-09-12T22:31:37.410011+0000","last_active":"2024-09-12T22:31:40.764377+0000","last_peered":"2024-09-12T22:31:40.764377+0000","last_clean":"2024-09-12T22:31:40.764377+0000","last_became_active":"2024-09-12T22:31:37.409320+0000","last_became_peered":"2024-09-12T22:31:37.409320+0000","last_unstale":"2024-09-12T22:31:40.764377+0000","last_undegraded":"2024-09-12T22:31:40.764377+0000","last_fullsized":"2024-09-12T22:31:40.764377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:27:23.661444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.696056+0000","last_change":"2024-09-12T22:31:37.415670+0000","last_active":"2024-09-12T22:31:40.696056+0000","last_peered":"2024-09-12T22:31:40.696056+0000","last_clean":"2024-09-12T22:31:40.696056+0000","last_became_active":"2024-09-12T22:31:37.415007+0000","last_became_peered":"2024-09-12T22:31:37.415007+0000","last_unstale":"2024-09-12T22:31:40.696056+0000","last_undegraded":"2024-09-12T22:31:40.696056+0000","last_fullsized":"2024-09-12T22:31:40.696056+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:42:51.694128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"19'6","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.696523+0000","last_change":"2024-09-12T22:31:36.409878+0000","last_active":"2024-09-12T22:31:40.696523+0000","last_peered":"2024-09-12T22:31:40.696523+0000","last_clean":"2024-09-12T22:31:40.696523+0000","last_became_active":"2024-09-12T22:31:36.409132+0000","last_became_peered":"2024-09-12T22:31:36.409132+0000","last_unstale":"2024-09-12T22:31:40.696523+0000","last_undegraded":"2024-09-12T22:31:40.696523+0000","last_fullsized":"2024-09-12T22:31:40.696523+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:09:56.081385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.692753+0000","last_change":"2024-09-12T22:31:37.414914+0000","last_active":"2024-09-12T22:31:40.692753+0000","last_peered":"2024-09-12T22:31:40.692753+0000","last_clean":"2024-09-12T22:31:40.692753+0000","last_became_active":"2024-09-12T22:31:37.414535+0000","last_became_peered":"2024-09-12T22:31:37.414535+0000","last_unstale":"2024-09-12T22:31:40.692753+0000","last_undegraded":"2024-09-12T22:31:40.692753+0000","last_fullsized":"2024-09-12T22:31:40.692753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:14:37.010786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"19'3","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.765296+0000","last_change":"2024-09-12T22:31:36.410433+0000","last_active":"2024-09-12T22:31:40.765296+0000","last_peered":"2024-09-12T22:31:40.765296+0000","last_clean":"2024-09-12T22:31:40.765296+0000","last_became_active":"2024-09-12T22:31:36.410007+0000","last_became_peered":"2024-09-12T22:31:36.410007+0000","last_unstale":"2024-09-12T22:31:40.765296+0000","last_undegraded":"2024-09-12T22:31:40.765296+0000","last_fullsized":"2024-09-12T22:31:40.765296+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:08:35.385688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.696899+0000","last_change":"2024-09-12T22:31:36.411549+0000","last_active":"2024-09-12T22:31:40.696899+0000","last_peered":"2024-09-12T22:31:40.696899+0000","last_clean":"2024-09-12T22:31:40.696899+0000","last_became_active":"2024-09-12T22:31:36.410674+0000","last_became_peered":"2024-09-12T22:31:36.410674+0000","last_unstale":"2024-09-12T22:31:40.696899+0000","last_undegraded":"2024-09-12T22:31:40.696899+0000","last_fullsized":"2024-09-12T22:31:40.696899+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:58:05.676197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.692661+0000","last_change":"2024-09-12T22:31:37.411254+0000","last_active":"2024-09-12T22:31:40.692661+0000","last_peered":"2024-09-12T22:31:40.692661+0000","last_clean":"2024-09-12T22:31:40.692661+0000","last_became_active":"2024-09-12T22:31:37.410404+0000","last_became_peered":"2024-09-12T22:31:37.410404+0000","last_unstale":"2024-09-12T22:31:40.692661+0000","last_undegraded":"2024-09-12T22:31:40.692661+0000","last_fullsized":"2024-09-12T22:31:40.692661+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:42:00.856616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.693757+0000","last_change":"2024-09-12T22:31:36.408390+0000","last_active":"2024-09-12T22:31:40.693757+0000","last_peered":"2024-09-12T22:31:40.693757+0000","last_clean":"2024-09-12T22:31:40.693757+0000","last_became_active":"2024-09-12T22:31:36.407062+0000","last_became_peered":"2024-09-12T22:31:36.407062+0000","last_unstale":"2024-09-12T22:31:40.693757+0000","last_undegraded":"2024-09-12T22:31:40.693757+0000","last_fullsized":"2024-09-12T22:31:40.693757+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:09:10.618195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.692729+0000","last_change":"2024-09-12T22:31:37.416629+0000","last_active":"2024-09-12T22:31:40.692729+0000","last_peered":"2024-09-12T22:31:40.692729+0000","last_clean":"2024-09-12T22:31:40.692729+0000","last_became_active":"2024-09-12T22:31:37.416387+0000","last_became_peered":"2024-09-12T22:31:37.416387+0000","last_unstale":"2024-09-12T22:31:40.692729+0000","last_undegraded":"2024-09-12T22:31:40.692729+0000","last_fullsized":"2024-09-12T22:31:40.692729+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:59:52.020560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.765320+0000","last_change":"2024-09-12T22:31:37.413777+0000","last_active":"2024-09-12T22:31:40.765320+0000","last_peered":"2024-09-12T22:31:40.765320+0000","last_clean":"2024-09-12T22:31:40.765320+0000","last_became_active":"2024-09-12T22:31:37.412669+0000","last_became_peered":"2024-09-12T22:31:37.412669+0000","last_unstale":"2024-09-12T22:31:40.765320+0000","last_undegraded":"2024-09-12T22:31:40.765320+0000","last_fullsized":"2024-09-12T22:31:40.765320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:42:17.728844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.692865+0000","last_change":"2024-09-12T22:31:36.409466+0000","last_active":"2024-09-12T22:31:40.692865+0000","last_peered":"2024-09-12T22:31:40.692865+0000","last_clean":"2024-09-12T22:31:40.692865+0000","last_became_active":"2024-09-12T22:31:36.408796+0000","last_became_peered":"2024-09-12T22:31:36.408796+0000","last_unstale":"2024-09-12T22:31:40.692865+0000","last_undegraded":"2024-09-12T22:31:40.692865+0000","last_fullsized":"2024-09-12T22:31:40.692865+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:03:39.648159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.693567+0000","last_change":"2024-09-12T22:31:37.411183+0000","last_active":"2024-09-12T22:31:40.693567+0000","last_peered":"2024-09-12T22:31:40.693567+0000","last_clean":"2024-09-12T22:31:40.693567+0000","last_became_active":"2024-09-12T22:31:37.409796+0000","last_became_peered":"2024-09-12T22:31:37.409796+0000","last_unstale":"2024-09-12T22:31:40.693567+0000","last_undegraded":"2024-09-12T22:31:40.693567+0000","last_fullsized":"2024-09-12T22:31:40.693567+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:20:35.779810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.692792+0000","last_change":"2024-09-12T22:31:36.407402+0000","last_active":"2024-09-12T22:31:40.692792+0000","last_peered":"2024-09-12T22:31:40.692792+0000","last_clean":"2024-09-12T22:31:40.692792+0000","last_became_active":"2024-09-12T22:31:36.406681+0000","last_became_peered":"2024-09-12T22:31:36.406681+0000","last_unstale":"2024-09-12T22:31:40.692792+0000","last_undegraded":"2024-09-12T22:31:40.692792+0000","last_fullsized":"2024-09-12T22:31:40.692792+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:39:39.362573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.764875+0000","last_change":"2024-09-12T22:31:37.412817+0000","last_active":"2024-09-12T22:31:40.764875+0000","last_peered":"2024-09-12T22:31:40.764875+0000","last_clean":"2024-09-12T22:31:40.764875+0000","last_became_active":"2024-09-12T22:31:37.411999+0000","last_became_peered":"2024-09-12T22:31:37.411999+0000","last_unstale":"2024-09-12T22:31:40.764875+0000","last_undegraded":"2024-09-12T22:31:40.764875+0000","last_fullsized":"2024-09-12T22:31:40.764875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:07:02.173590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.764750+0000","last_change":"2024-09-12T22:31:36.407378+0000","last_active":"2024-09-12T22:31:40.764750+0000","last_peered":"2024-09-12T22:31:40.764750+0000","last_clean":"2024-09-12T22:31:40.764750+0000","last_became_active":"2024-09-12T22:31:36.406992+0000","last_became_peered":"2024-09-12T22:31:36.406992+0000","last_unstale":"2024-09-12T22:31:40.764750+0000","last_undegraded":"2024-09-12T22:31:40.764750+0000","last_fullsized":"2024-09-12T22:31:40.764750+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:37:16.807328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.764857+0000","last_change":"2024-09-12T22:31:37.411676+0000","last_active":"2024-09-12T22:31:40.764857+0000","last_peered":"2024-09-12T22:31:40.764857+0000","last_clean":"2024-09-12T22:31:40.764857+0000","last_became_active":"2024-09-12T22:31:37.410802+0000","last_became_peered":"2024-09-12T22:31:37.410802+0000","last_unstale":"2024-09-12T22:31:40.764857+0000","last_undegraded":"2024-09-12T22:31:40.764857+0000","last_fullsized":"2024-09-12T22:31:40.764857+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:08:21.709770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"19'1","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.764889+0000","last_change":"2024-09-12T22:31:36.412289+0000","last_active":"2024-09-12T22:31:40.764889+0000","last_peered":"2024-09-12T22:31:40.764889+0000","last_clean":"2024-09-12T22:31:40.764889+0000","last_became_active":"2024-09-12T22:31:36.411985+0000","last_became_peered":"2024-09-12T22:31:36.411985+0000","last_unstale":"2024-09-12T22:31:40.764889+0000","last_undegraded":"2024-09-12T22:31:40.764889+0000","last_fullsized":"2024-09-12T22:31:40.764889+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:30:09.410370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.695976+0000","last_change":"2024-09-12T22:31:37.415365+0000","last_active":"2024-09-12T22:31:40.695976+0000","last_peered":"2024-09-12T22:31:40.695976+0000","last_clean":"2024-09-12T22:31:40.695976+0000","last_became_active":"2024-09-12T22:31:37.413933+0000","last_became_peered":"2024-09-12T22:31:37.413933+0000","last_unstale":"2024-09-12T22:31:40.695976+0000","last_undegraded":"2024-09-12T22:31:40.695976+0000","last_fullsized":"2024-09-12T22:31:40.695976+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:08:07.115355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"19'2","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.696434+0000","last_change":"2024-09-12T22:31:36.411665+0000","last_active":"2024-09-12T22:31:40.696434+0000","last_peered":"2024-09-12T22:31:40.696434+0000","last_clean":"2024-09-12T22:31:40.696434+0000","last_became_active":"2024-09-12T22:31:36.410182+0000","last_became_peered":"2024-09-12T22:31:36.410182+0000","last_unstale":"2024-09-12T22:31:40.696434+0000","last_undegraded":"2024-09-12T22:31:40.696434+0000","last_fullsized":"2024-09-12T22:31:40.696434+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:37:20.891838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.696106+0000","last_change":"2024-09-12T22:31:37.415172+0000","last_active":"2024-09-12T22:31:40.696106+0000","last_peered":"2024-09-12T22:31:40.696106+0000","last_clean":"2024-09-12T22:31:40.696106+0000","last_became_active":"2024-09-12T22:31:37.414776+0000","last_became_peered":"2024-09-12T22:31:37.414776+0000","last_unstale":"2024-09-12T22:31:40.696106+0000","last_undegraded":"2024-09-12T22:31:40.696106+0000","last_fullsized":"2024-09-12T22:31:40.696106+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:42:32.307876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"19'2","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.765168+0000","last_change":"2024-09-12T22:31:36.410362+0000","last_active":"2024-09-12T22:31:40.765168+0000","last_peered":"2024-09-12T22:31:40.765168+0000","last_clean":"2024-09-12T22:31:40.765168+0000","last_became_active":"2024-09-12T22:31:36.410029+0000","last_became_peered":"2024-09-12T22:31:36.410029+0000","last_unstale":"2024-09-12T22:31:40.765168+0000","last_undegraded":"2024-09-12T22:31:40.765168+0000","last_fullsized":"2024-09-12T22:31:40.765168+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:23:32.476870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.764699+0000","last_change":"2024-09-12T22:31:37.409214+0000","last_active":"2024-09-12T22:31:40.764699+0000","last_peered":"2024-09-12T22:31:40.764699+0000","last_clean":"2024-09-12T22:31:40.764699+0000","last_became_active":"2024-09-12T22:31:37.408849+0000","last_became_peered":"2024-09-12T22:31:37.408849+0000","last_unstale":"2024-09-12T22:31:40.764699+0000","last_undegraded":"2024-09-12T22:31:40.764699+0000","last_fullsized":"2024-09-12T22:31:40.764699+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:39:20.383152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"19'1","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.693694+0000","last_change":"2024-09-12T22:31:36.410371+0000","last_active":"2024-09-12T22:31:40.693694+0000","last_peered":"2024-09-12T22:31:40.693694+0000","last_clean":"2024-09-12T22:31:40.693694+0000","last_became_active":"2024-09-12T22:31:36.409428+0000","last_became_peered":"2024-09-12T22:31:36.409428+0000","last_unstale":"2024-09-12T22:31:40.693694+0000","last_undegraded":"2024-09-12T22:31:40.693694+0000","last_fullsized":"2024-09-12T22:31:40.693694+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:27:22.817690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.695839+0000","last_change":"2024-09-12T22:31:37.415390+0000","last_active":"2024-09-12T22:31:40.695839+0000","last_peered":"2024-09-12T22:31:40.695839+0000","last_clean":"2024-09-12T22:31:40.695839+0000","last_became_active":"2024-09-12T22:31:37.414781+0000","last_became_peered":"2024-09-12T22:31:37.414781+0000","last_unstale":"2024-09-12T22:31:40.695839+0000","last_undegraded":"2024-09-12T22:31:40.695839+0000","last_fullsized":"2024-09-12T22:31:40.695839+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:42:17.728844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"19'4","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.693681+0000","last_change":"2024-09-12T22:31:36.407945+0000","last_active":"2024-09-12T22:31:40.693681+0000","last_peered":"2024-09-12T22:31:40.693681+0000","last_clean":"2024-09-12T22:31:40.693681+0000","last_became_active":"2024-09-12T22:31:36.406959+0000","last_became_peered":"2024-09-12T22:31:36.406959+0000","last_unstale":"2024-09-12T22:31:40.693681+0000","last_undegraded":"2024-09-12T22:31:40.693681+0000","last_fullsized":"2024-09-12T22:31:40.693681+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:26:33.155850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705672,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31984,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339856,"statfs":{"total":96636764160,"available":96604012544,"internally_reserved":0,"allocated":811008,"data_stored":658415,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705672,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31972,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339868,"statfs":{"total":96636764160,"available":96604024832,"internally_reserved":0,"allocated":798720,"data_stored":657780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738376,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":192512,"data_stored":66253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T22:31:49.738 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T22:31:50.068 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:31:50.069 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-12T22:31:50.079 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":31,"stamp":"2024-09-12T22:31:48.190537+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":250,"num_write_kb":3476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":91172,"kb_used_data":1760,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283024348,"statfs":{"total":289910292480,"available":289816932352,"internally_reserved":0,"allocated":1802240,"data_stored":1382448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":91483471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.781742"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.765207+0000","last_change":"2024-09-12T22:31:37.416383+0000","last_active":"2024-09-12T22:31:40.765207+0000","last_peered":"2024-09-12T22:31:40.765207+0000","last_clean":"2024-09-12T22:31:40.765207+0000","last_became_active":"2024-09-12T22:31:37.415457+0000","last_became_peered":"2024-09-12T22:31:37.415457+0000","last_unstale":"2024-09-12T22:31:40.765207+0000","last_undegraded":"2024-09-12T22:31:40.765207+0000","last_fullsized":"2024-09-12T22:31:40.765207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:08:29.199832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.764838+0000","last_change":"2024-09-12T22:31:37.415228+0000","last_active":"2024-09-12T22:31:40.764838+0000","last_peered":"2024-09-12T22:31:40.764838+0000","last_clean":"2024-09-12T22:31:40.764838+0000","last_became_active":"2024-09-12T22:31:37.414765+0000","last_became_peered":"2024-09-12T22:31:37.414765+0000","last_unstale":"2024-09-12T22:31:40.764838+0000","last_undegraded":"2024-09-12T22:31:40.764838+0000","last_fullsized":"2024-09-12T22:31:40.764838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:50:48.426898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.696458+0000","last_change":"2024-09-12T22:31:37.419916+0000","last_active":"2024-09-12T22:31:40.696458+0000","last_peered":"2024-09-12T22:31:40.696458+0000","last_clean":"2024-09-12T22:31:40.696458+0000","last_became_active":"2024-09-12T22:31:37.418790+0000","last_became_peered":"2024-09-12T22:31:37.418790+0000","last_unstale":"2024-09-12T22:31:40.696458+0000","last_undegraded":"2024-09-12T22:31:40.696458+0000","last_fullsized":"2024-09-12T22:31:40.696458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:05:00.440878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.696238+0000","last_change":"2024-09-12T22:31:37.413094+0000","last_active":"2024-09-12T22:31:40.696238+0000","last_peered":"2024-09-12T22:31:40.696238+0000","last_clean":"2024-09-12T22:31:40.696238+0000","last_became_active":"2024-09-12T22:31:37.412746+0000","last_became_peered":"2024-09-12T22:31:37.412746+0000","last_unstale":"2024-09-12T22:31:40.696238+0000","last_undegraded":"2024-09-12T22:31:40.696238+0000","last_fullsized":"2024-09-12T22:31:40.696238+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:32:14.415120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.764831+0000","last_change":"2024-09-12T22:31:37.411276+0000","last_active":"2024-09-12T22:31:40.764831+0000","last_peered":"2024-09-12T22:31:40.764831+0000","last_clean":"2024-09-12T22:31:40.764831+0000","last_became_active":"2024-09-12T22:31:37.410380+0000","last_became_peered":"2024-09-12T22:31:37.410380+0000","last_unstale":"2024-09-12T22:31:40.764831+0000","last_undegraded":"2024-09-12T22:31:40.764831+0000","last_fullsized":"2024-09-12T22:31:40.764831+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:12:50.090880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.695814+0000","last_change":"2024-09-12T22:31:37.409177+0000","last_active":"2024-09-12T22:31:40.695814+0000","last_peered":"2024-09-12T22:31:40.695814+0000","last_clean":"2024-09-12T22:31:40.695814+0000","last_became_active":"2024-09-12T22:31:37.408811+0000","last_became_peered":"2024-09-12T22:31:37.408811+0000","last_unstale":"2024-09-12T22:31:40.695814+0000","last_undegraded":"2024-09-12T22:31:40.695814+0000","last_fullsized":"2024-09-12T22:31:40.695814+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:17:21.695079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.695805+0000","last_change":"2024-09-12T22:31:37.413023+0000","last_active":"2024-09-12T22:31:40.695805+0000","last_peered":"2024-09-12T22:31:40.695805+0000","last_clean":"2024-09-12T22:31:40.695805+0000","last_became_active":"2024-09-12T22:31:37.412691+0000","last_became_peered":"2024-09-12T22:31:37.412691+0000","last_unstale":"2024-09-12T22:31:40.695805+0000","last_undegraded":"2024-09-12T22:31:40.695805+0000","last_fullsized":"2024-09-12T22:31:40.695805+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:02:36.454134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.695562+0000","last_change":"2024-09-12T22:31:37.411074+0000","last_active":"2024-09-12T22:31:40.695562+0000","last_peered":"2024-09-12T22:31:40.695562+0000","last_clean":"2024-09-12T22:31:40.695562+0000","last_became_active":"2024-09-12T22:31:37.410633+0000","last_became_peered":"2024-09-12T22:31:37.410633+0000","last_unstale":"2024-09-12T22:31:40.695562+0000","last_undegraded":"2024-09-12T22:31:40.695562+0000","last_fullsized":"2024-09-12T22:31:40.695562+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:39:20.383152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.693279+0000","last_change":"2024-09-12T22:31:37.417800+0000","last_active":"2024-09-12T22:31:40.693279+0000","last_peered":"2024-09-12T22:31:40.693279+0000","last_clean":"2024-09-12T22:31:40.693279+0000","last_became_active":"2024-09-12T22:31:37.417355+0000","last_became_peered":"2024-09-12T22:31:37.417355+0000","last_unstale":"2024-09-12T22:31:40.693279+0000","last_undegraded":"2024-09-12T22:31:40.693279+0000","last_fullsized":"2024-09-12T22:31:40.693279+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:10:17.326263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.765115+0000","last_change":"2024-09-12T22:31:37.415967+0000","last_active":"2024-09-12T22:31:40.765115+0000","last_peered":"2024-09-12T22:31:40.765115+0000","last_clean":"2024-09-12T22:31:40.765115+0000","last_became_active":"2024-09-12T22:31:37.415003+0000","last_became_peered":"2024-09-12T22:31:37.415003+0000","last_unstale":"2024-09-12T22:31:40.765115+0000","last_undegraded":"2024-09-12T22:31:40.765115+0000","last_fullsized":"2024-09-12T22:31:40.765115+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:42:32.307876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.696536+0000","last_change":"2024-09-12T22:31:37.414469+0000","last_active":"2024-09-12T22:31:40.696536+0000","last_peered":"2024-09-12T22:31:40.696536+0000","last_clean":"2024-09-12T22:31:40.696536+0000","last_became_active":"2024-09-12T22:31:37.414165+0000","last_became_peered":"2024-09-12T22:31:37.414165+0000","last_unstale":"2024-09-12T22:31:40.696536+0000","last_undegraded":"2024-09-12T22:31:40.696536+0000","last_fullsized":"2024-09-12T22:31:40.696536+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:25:38.148636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.764751+0000","last_change":"2024-09-12T22:31:37.413051+0000","last_active":"2024-09-12T22:31:40.764751+0000","last_peered":"2024-09-12T22:31:40.764751+0000","last_clean":"2024-09-12T22:31:40.764751+0000","last_became_active":"2024-09-12T22:31:37.412614+0000","last_became_peered":"2024-09-12T22:31:37.412614+0000","last_unstale":"2024-09-12T22:31:40.764751+0000","last_undegraded":"2024-09-12T22:31:40.764751+0000","last_fullsized":"2024-09-12T22:31:40.764751+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:07:48.430262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.764626+0000","last_change":"2024-09-12T22:31:37.413063+0000","last_active":"2024-09-12T22:31:40.764626+0000","last_peered":"2024-09-12T22:31:40.764626+0000","last_clean":"2024-09-12T22:31:40.764626+0000","last_became_active":"2024-09-12T22:31:37.412118+0000","last_became_peered":"2024-09-12T22:31:37.412118+0000","last_unstale":"2024-09-12T22:31:40.764626+0000","last_undegraded":"2024-09-12T22:31:40.764626+0000","last_fullsized":"2024-09-12T22:31:40.764626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:14:17.750388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.695833+0000","last_change":"2024-09-12T22:31:37.414084+0000","last_active":"2024-09-12T22:31:40.695833+0000","last_peered":"2024-09-12T22:31:40.695833+0000","last_clean":"2024-09-12T22:31:40.695833+0000","last_became_active":"2024-09-12T22:31:37.413671+0000","last_became_peered":"2024-09-12T22:31:37.413671+0000","last_unstale":"2024-09-12T22:31:40.695833+0000","last_undegraded":"2024-09-12T22:31:40.695833+0000","last_fullsized":"2024-09-12T22:31:40.695833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:08:29.199832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.695836+0000","last_change":"2024-09-12T22:31:37.413482+0000","last_active":"2024-09-12T22:31:40.695836+0000","last_peered":"2024-09-12T22:31:40.695836+0000","last_clean":"2024-09-12T22:31:40.695836+0000","last_became_active":"2024-09-12T22:31:37.413195+0000","last_became_peered":"2024-09-12T22:31:37.413195+0000","last_unstale":"2024-09-12T22:31:40.695836+0000","last_undegraded":"2024-09-12T22:31:40.695836+0000","last_fullsized":"2024-09-12T22:31:40.695836+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:22:40.226076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.695670+0000","last_change":"2024-09-12T22:31:37.411006+0000","last_active":"2024-09-12T22:31:40.695670+0000","last_peered":"2024-09-12T22:31:40.695670+0000","last_clean":"2024-09-12T22:31:40.695670+0000","last_became_active":"2024-09-12T22:31:37.410557+0000","last_became_peered":"2024-09-12T22:31:37.410557+0000","last_unstale":"2024-09-12T22:31:40.695670+0000","last_undegraded":"2024-09-12T22:31:40.695670+0000","last_fullsized":"2024-09-12T22:31:40.695670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:08:21.709770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.693827+0000","last_change":"2024-09-12T22:31:37.412450+0000","last_active":"2024-09-12T22:31:40.693827+0000","last_peered":"2024-09-12T22:31:40.693827+0000","last_clean":"2024-09-12T22:31:40.693827+0000","last_became_active":"2024-09-12T22:31:37.412234+0000","last_became_peered":"2024-09-12T22:31:37.412234+0000","last_unstale":"2024-09-12T22:31:40.693827+0000","last_undegraded":"2024-09-12T22:31:40.693827+0000","last_fullsized":"2024-09-12T22:31:40.693827+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:15:59.559809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.765237+0000","last_change":"2024-09-12T22:31:37.414144+0000","last_active":"2024-09-12T22:31:40.765237+0000","last_peered":"2024-09-12T22:31:40.765237+0000","last_clean":"2024-09-12T22:31:40.765237+0000","last_became_active":"2024-09-12T22:31:37.413670+0000","last_became_peered":"2024-09-12T22:31:37.413670+0000","last_unstale":"2024-09-12T22:31:40.765237+0000","last_undegraded":"2024-09-12T22:31:40.765237+0000","last_fullsized":"2024-09-12T22:31:40.765237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:42:51.694128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.693356+0000","last_change":"2024-09-12T22:31:37.417442+0000","last_active":"2024-09-12T22:31:40.693356+0000","last_peered":"2024-09-12T22:31:40.693356+0000","last_clean":"2024-09-12T22:31:40.693356+0000","last_became_active":"2024-09-12T22:31:37.417133+0000","last_became_peered":"2024-09-12T22:31:37.417133+0000","last_unstale":"2024-09-12T22:31:40.693356+0000","last_undegraded":"2024-09-12T22:31:40.693356+0000","last_fullsized":"2024-09-12T22:31:40.693356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:36.458145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.696321+0000","last_change":"2024-09-12T22:31:37.414235+0000","last_active":"2024-09-12T22:31:40.696321+0000","last_peered":"2024-09-12T22:31:40.696321+0000","last_clean":"2024-09-12T22:31:40.696321+0000","last_became_active":"2024-09-12T22:31:37.413786+0000","last_became_peered":"2024-09-12T22:31:37.413786+0000","last_unstale":"2024-09-12T22:31:40.696321+0000","last_undegraded":"2024-09-12T22:31:40.696321+0000","last_fullsized":"2024-09-12T22:31:40.696321+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:21:11.866973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.696190+0000","last_change":"2024-09-12T22:31:37.415382+0000","last_active":"2024-09-12T22:31:40.696190+0000","last_peered":"2024-09-12T22:31:40.696190+0000","last_clean":"2024-09-12T22:31:40.696190+0000","last_became_active":"2024-09-12T22:31:37.414319+0000","last_became_peered":"2024-09-12T22:31:37.414319+0000","last_unstale":"2024-09-12T22:31:40.696190+0000","last_undegraded":"2024-09-12T22:31:40.696190+0000","last_fullsized":"2024-09-12T22:31:40.696190+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:26:25.578693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.764450+0000","last_change":"2024-09-12T22:31:37.412046+0000","last_active":"2024-09-12T22:31:40.764450+0000","last_peered":"2024-09-12T22:31:40.764450+0000","last_clean":"2024-09-12T22:31:40.764450+0000","last_became_active":"2024-09-12T22:31:37.411623+0000","last_became_peered":"2024-09-12T22:31:37.411623+0000","last_unstale":"2024-09-12T22:31:40.764450+0000","last_undegraded":"2024-09-12T22:31:40.764450+0000","last_fullsized":"2024-09-12T22:31:40.764450+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:24:15.504358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.692558+0000","last_change":"2024-09-12T22:31:37.410364+0000","last_active":"2024-09-12T22:31:40.692558+0000","last_peered":"2024-09-12T22:31:40.692558+0000","last_clean":"2024-09-12T22:31:40.692558+0000","last_became_active":"2024-09-12T22:31:37.409951+0000","last_became_peered":"2024-09-12T22:31:37.409951+0000","last_unstale":"2024-09-12T22:31:40.692558+0000","last_undegraded":"2024-09-12T22:31:40.692558+0000","last_fullsized":"2024-09-12T22:31:40.692558+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:39:17.785755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.764159+0000","last_change":"2024-09-12T22:31:37.415240+0000","last_active":"2024-09-12T22:31:40.764159+0000","last_peered":"2024-09-12T22:31:40.764159+0000","last_clean":"2024-09-12T22:31:40.764159+0000","last_became_active":"2024-09-12T22:31:37.414069+0000","last_became_peered":"2024-09-12T22:31:37.414069+0000","last_unstale":"2024-09-12T22:31:40.764159+0000","last_undegraded":"2024-09-12T22:31:40.764159+0000","last_fullsized":"2024-09-12T22:31:40.764159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:16:35.027772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.765207+0000","last_change":"2024-09-12T22:31:37.415309+0000","last_active":"2024-09-12T22:31:40.765207+0000","last_peered":"2024-09-12T22:31:40.765207+0000","last_clean":"2024-09-12T22:31:40.765207+0000","last_became_active":"2024-09-12T22:31:37.414792+0000","last_became_peered":"2024-09-12T22:31:37.414792+0000","last_unstale":"2024-09-12T22:31:40.765207+0000","last_undegraded":"2024-09-12T22:31:40.765207+0000","last_fullsized":"2024-09-12T22:31:40.765207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:08:07.115355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.693507+0000","last_change":"2024-09-12T22:31:37.411880+0000","last_active":"2024-09-12T22:31:40.693507+0000","last_peered":"2024-09-12T22:31:40.693507+0000","last_clean":"2024-09-12T22:31:40.693507+0000","last_became_active":"2024-09-12T22:31:37.410563+0000","last_became_peered":"2024-09-12T22:31:37.410563+0000","last_unstale":"2024-09-12T22:31:40.693507+0000","last_undegraded":"2024-09-12T22:31:40.693507+0000","last_fullsized":"2024-09-12T22:31:40.693507+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:47:52.560533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.696794+0000","last_change":"2024-09-12T22:31:37.419603+0000","last_active":"2024-09-12T22:31:40.696794+0000","last_peered":"2024-09-12T22:31:40.696794+0000","last_clean":"2024-09-12T22:31:40.696794+0000","last_became_active":"2024-09-12T22:31:37.418725+0000","last_became_peered":"2024-09-12T22:31:37.418725+0000","last_unstale":"2024-09-12T22:31:40.696794+0000","last_undegraded":"2024-09-12T22:31:40.696794+0000","last_fullsized":"2024-09-12T22:31:40.696794+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:02:44.183545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.765102+0000","last_change":"2024-09-12T22:31:37.412884+0000","last_active":"2024-09-12T22:31:40.765102+0000","last_peered":"2024-09-12T22:31:40.765102+0000","last_clean":"2024-09-12T22:31:40.765102+0000","last_became_active":"2024-09-12T22:31:37.412469+0000","last_became_peered":"2024-09-12T22:31:37.412469+0000","last_unstale":"2024-09-12T22:31:40.765102+0000","last_undegraded":"2024-09-12T22:31:40.765102+0000","last_fullsized":"2024-09-12T22:31:40.765102+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:05:00.440878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.693088+0000","last_change":"2024-09-12T22:31:37.414918+0000","last_active":"2024-09-12T22:31:40.693088+0000","last_peered":"2024-09-12T22:31:40.693088+0000","last_clean":"2024-09-12T22:31:40.693088+0000","last_became_active":"2024-09-12T22:31:37.414225+0000","last_became_peered":"2024-09-12T22:31:37.414225+0000","last_unstale":"2024-09-12T22:31:40.693088+0000","last_undegraded":"2024-09-12T22:31:40.693088+0000","last_fullsized":"2024-09-12T22:31:40.693088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:56:14.649228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.764655+0000","last_change":"2024-09-12T22:31:37.411569+0000","last_active":"2024-09-12T22:31:40.764655+0000","last_peered":"2024-09-12T22:31:40.764655+0000","last_clean":"2024-09-12T22:31:40.764655+0000","last_became_active":"2024-09-12T22:31:37.410619+0000","last_became_peered":"2024-09-12T22:31:37.410619+0000","last_unstale":"2024-09-12T22:31:40.764655+0000","last_undegraded":"2024-09-12T22:31:40.764655+0000","last_fullsized":"2024-09-12T22:31:40.764655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:30:01.012271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.692595+0000","last_change":"2024-09-12T22:31:37.415589+0000","last_active":"2024-09-12T22:31:40.692595+0000","last_peered":"2024-09-12T22:31:40.692595+0000","last_clean":"2024-09-12T22:31:40.692595+0000","last_became_active":"2024-09-12T22:31:37.415285+0000","last_became_peered":"2024-09-12T22:31:37.415285+0000","last_unstale":"2024-09-12T22:31:40.692595+0000","last_undegraded":"2024-09-12T22:31:40.692595+0000","last_fullsized":"2024-09-12T22:31:40.692595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:06:25.913810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.695680+0000","last_change":"2024-09-12T22:31:37.415190+0000","last_active":"2024-09-12T22:31:40.695680+0000","last_peered":"2024-09-12T22:31:40.695680+0000","last_clean":"2024-09-12T22:31:40.695680+0000","last_became_active":"2024-09-12T22:31:37.414265+0000","last_became_peered":"2024-09-12T22:31:37.414265+0000","last_unstale":"2024-09-12T22:31:40.695680+0000","last_undegraded":"2024-09-12T22:31:40.695680+0000","last_fullsized":"2024-09-12T22:31:40.695680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:07:02.173590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.765000+0000","last_change":"2024-09-12T22:31:37.409362+0000","last_active":"2024-09-12T22:31:40.765000+0000","last_peered":"2024-09-12T22:31:40.765000+0000","last_clean":"2024-09-12T22:31:40.765000+0000","last_became_active":"2024-09-12T22:31:37.408896+0000","last_became_peered":"2024-09-12T22:31:37.408896+0000","last_unstale":"2024-09-12T22:31:40.765000+0000","last_undegraded":"2024-09-12T22:31:40.765000+0000","last_fullsized":"2024-09-12T22:31:40.765000+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:17:21.695079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"19'2","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.696151+0000","last_change":"2024-09-12T22:31:36.412082+0000","last_active":"2024-09-12T22:31:40.696151+0000","last_peered":"2024-09-12T22:31:40.696151+0000","last_clean":"2024-09-12T22:31:40.696151+0000","last_became_active":"2024-09-12T22:31:36.410871+0000","last_became_peered":"2024-09-12T22:31:36.410871+0000","last_unstale":"2024-09-12T22:31:40.696151+0000","last_undegraded":"2024-09-12T22:31:40.696151+0000","last_fullsized":"2024-09-12T22:31:40.696151+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:30:49.127253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.765123+0000","last_change":"2024-09-12T22:31:37.411790+0000","last_active":"2024-09-12T22:31:40.765123+0000","last_peered":"2024-09-12T22:31:40.765123+0000","last_clean":"2024-09-12T22:31:40.765123+0000","last_became_active":"2024-09-12T22:31:37.411414+0000","last_became_peered":"2024-09-12T22:31:37.411414+0000","last_unstale":"2024-09-12T22:31:40.765123+0000","last_undegraded":"2024-09-12T22:31:40.765123+0000","last_fullsized":"2024-09-12T22:31:40.765123+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:22:40.226076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.692921+0000","last_change":"2024-09-12T22:31:36.408563+0000","last_active":"2024-09-12T22:31:40.692921+0000","last_peered":"2024-09-12T22:31:40.692921+0000","last_clean":"2024-09-12T22:31:40.692921+0000","last_became_active":"2024-09-12T22:31:36.407447+0000","last_became_peered":"2024-09-12T22:31:36.407447+0000","last_unstale":"2024-09-12T22:31:40.692921+0000","last_undegraded":"2024-09-12T22:31:40.692921+0000","last_fullsized":"2024-09-12T22:31:40.692921+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:29:37.933109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.693701+0000","last_change":"2024-09-12T22:31:37.411680+0000","last_active":"2024-09-12T22:31:40.693701+0000","last_peered":"2024-09-12T22:31:40.693701+0000","last_clean":"2024-09-12T22:31:40.693701+0000","last_became_active":"2024-09-12T22:31:37.411168+0000","last_became_peered":"2024-09-12T22:31:37.411168+0000","last_unstale":"2024-09-12T22:31:40.693701+0000","last_undegraded":"2024-09-12T22:31:40.693701+0000","last_fullsized":"2024-09-12T22:31:40.693701+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:27.706282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.764438+0000","last_change":"2024-09-12T22:31:36.411271+0000","last_active":"2024-09-12T22:31:40.764438+0000","last_peered":"2024-09-12T22:31:40.764438+0000","last_clean":"2024-09-12T22:31:40.764438+0000","last_became_active":"2024-09-12T22:31:36.410706+0000","last_became_peered":"2024-09-12T22:31:36.410706+0000","last_unstale":"2024-09-12T22:31:40.764438+0000","last_undegraded":"2024-09-12T22:31:40.764438+0000","last_fullsized":"2024-09-12T22:31:40.764438+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:43:22.805855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.693409+0000","last_change":"2024-09-12T22:31:37.411218+0000","last_active":"2024-09-12T22:31:40.693409+0000","last_peered":"2024-09-12T22:31:40.693409+0000","last_clean":"2024-09-12T22:31:40.693409+0000","last_became_active":"2024-09-12T22:31:37.409666+0000","last_became_peered":"2024-09-12T22:31:37.409666+0000","last_unstale":"2024-09-12T22:31:40.693409+0000","last_undegraded":"2024-09-12T22:31:40.693409+0000","last_fullsized":"2024-09-12T22:31:40.693409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:45:34.230090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"19'8","reported_seq":24,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.695805+0000","last_change":"2024-09-12T22:31:36.411811+0000","last_active":"2024-09-12T22:31:40.695805+0000","last_peered":"2024-09-12T22:31:40.695805+0000","last_clean":"2024-09-12T22:31:40.695805+0000","last_became_active":"2024-09-12T22:31:36.410101+0000","last_became_peered":"2024-09-12T22:31:36.410101+0000","last_unstale":"2024-09-12T22:31:40.695805+0000","last_undegraded":"2024-09-12T22:31:40.695805+0000","last_fullsized":"2024-09-12T22:31:40.695805+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:33:02.410148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"19'1","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.696872+0000","last_change":"2024-09-12T22:31:36.410970+0000","last_active":"2024-09-12T22:31:40.696872+0000","last_peered":"2024-09-12T22:31:40.696872+0000","last_clean":"2024-09-12T22:31:40.696872+0000","last_became_active":"2024-09-12T22:31:36.409754+0000","last_became_peered":"2024-09-12T22:31:36.409754+0000","last_unstale":"2024-09-12T22:31:40.696872+0000","last_undegraded":"2024-09-12T22:31:40.696872+0000","last_fullsized":"2024-09-12T22:31:40.696872+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:30:07.724418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.764193+0000","last_change":"2024-09-12T22:31:37.415050+0000","last_active":"2024-09-12T22:31:40.764193+0000","last_peered":"2024-09-12T22:31:40.764193+0000","last_clean":"2024-09-12T22:31:40.764193+0000","last_became_active":"2024-09-12T22:31:37.414290+0000","last_became_peered":"2024-09-12T22:31:37.414290+0000","last_unstale":"2024-09-12T22:31:40.764193+0000","last_undegraded":"2024-09-12T22:31:40.764193+0000","last_fullsized":"2024-09-12T22:31:40.764193+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:47:15.502575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"19'2","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.765286+0000","last_change":"2024-09-12T22:31:36.411725+0000","last_active":"2024-09-12T22:31:40.765286+0000","last_peered":"2024-09-12T22:31:40.765286+0000","last_clean":"2024-09-12T22:31:40.765286+0000","last_became_active":"2024-09-12T22:31:36.411407+0000","last_became_peered":"2024-09-12T22:31:36.411407+0000","last_unstale":"2024-09-12T22:31:40.765286+0000","last_undegraded":"2024-09-12T22:31:40.765286+0000","last_fullsized":"2024-09-12T22:31:40.765286+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:30:07.724418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.764522+0000","last_change":"2024-09-12T22:31:37.413857+0000","last_active":"2024-09-12T22:31:40.764522+0000","last_peered":"2024-09-12T22:31:40.764522+0000","last_clean":"2024-09-12T22:31:40.764522+0000","last_became_active":"2024-09-12T22:31:37.412941+0000","last_became_peered":"2024-09-12T22:31:37.412941+0000","last_unstale":"2024-09-12T22:31:40.764522+0000","last_undegraded":"2024-09-12T22:31:40.764522+0000","last_fullsized":"2024-09-12T22:31:40.764522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:58:45.134258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"19'1","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.696863+0000","last_change":"2024-09-12T22:31:36.411320+0000","last_active":"2024-09-12T22:31:40.696863+0000","last_peered":"2024-09-12T22:31:40.696863+0000","last_clean":"2024-09-12T22:31:40.696863+0000","last_became_active":"2024-09-12T22:31:36.409837+0000","last_became_peered":"2024-09-12T22:31:36.409837+0000","last_unstale":"2024-09-12T22:31:40.696863+0000","last_undegraded":"2024-09-12T22:31:40.696863+0000","last_fullsized":"2024-09-12T22:31:40.696863+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:36:53.914922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.695949+0000","last_change":"2024-09-12T22:31:37.414809+0000","last_active":"2024-09-12T22:31:40.695949+0000","last_peered":"2024-09-12T22:31:40.695949+0000","last_clean":"2024-09-12T22:31:40.695949+0000","last_became_active":"2024-09-12T22:31:37.414492+0000","last_became_peered":"2024-09-12T22:31:37.414492+0000","last_unstale":"2024-09-12T22:31:40.695949+0000","last_undegraded":"2024-09-12T22:31:40.695949+0000","last_fullsized":"2024-09-12T22:31:40.695949+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:50:48.426898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.696715+0000","last_change":"2024-09-12T22:31:36.412068+0000","last_active":"2024-09-12T22:31:40.696715+0000","last_peered":"2024-09-12T22:31:40.696715+0000","last_clean":"2024-09-12T22:31:40.696715+0000","last_became_active":"2024-09-12T22:31:36.411366+0000","last_became_peered":"2024-09-12T22:31:36.411366+0000","last_unstale":"2024-09-12T22:31:40.696715+0000","last_undegraded":"2024-09-12T22:31:40.696715+0000","last_fullsized":"2024-09-12T22:31:40.696715+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:35:51.647051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.693166+0000","last_change":"2024-09-12T22:31:37.410303+0000","last_active":"2024-09-12T22:31:40.693166+0000","last_peered":"2024-09-12T22:31:40.693166+0000","last_clean":"2024-09-12T22:31:40.693166+0000","last_became_active":"2024-09-12T22:31:37.409607+0000","last_became_peered":"2024-09-12T22:31:37.409607+0000","last_unstale":"2024-09-12T22:31:40.693166+0000","last_undegraded":"2024-09-12T22:31:40.693166+0000","last_fullsized":"2024-09-12T22:31:40.693166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:53:42.732654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"19'2","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.693353+0000","last_change":"2024-09-12T22:31:36.407974+0000","last_active":"2024-09-12T22:31:40.693353+0000","last_peered":"2024-09-12T22:31:40.693353+0000","last_clean":"2024-09-12T22:31:40.693353+0000","last_became_active":"2024-09-12T22:31:36.406955+0000","last_became_peered":"2024-09-12T22:31:36.406955+0000","last_unstale":"2024-09-12T22:31:40.693353+0000","last_undegraded":"2024-09-12T22:31:40.693353+0000","last_fullsized":"2024-09-12T22:31:40.693353+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:07:34.831264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.696465+0000","last_change":"2024-09-12T22:31:37.415285+0000","last_active":"2024-09-12T22:31:40.696465+0000","last_peered":"2024-09-12T22:31:40.696465+0000","last_clean":"2024-09-12T22:31:40.696465+0000","last_became_active":"2024-09-12T22:31:37.414890+0000","last_became_peered":"2024-09-12T22:31:37.414890+0000","last_unstale":"2024-09-12T22:31:40.696465+0000","last_undegraded":"2024-09-12T22:31:40.696465+0000","last_fullsized":"2024-09-12T22:31:40.696465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:38:16.956786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.696019+0000","last_change":"2024-09-12T22:31:36.412147+0000","last_active":"2024-09-12T22:31:40.696019+0000","last_peered":"2024-09-12T22:31:40.696019+0000","last_clean":"2024-09-12T22:31:40.696019+0000","last_became_active":"2024-09-12T22:31:36.411382+0000","last_became_peered":"2024-09-12T22:31:36.411382+0000","last_unstale":"2024-09-12T22:31:40.696019+0000","last_undegraded":"2024-09-12T22:31:40.696019+0000","last_fullsized":"2024-09-12T22:31:40.696019+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:54:51.454867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.696770+0000","last_change":"2024-09-12T22:31:37.420209+0000","last_active":"2024-09-12T22:31:40.696770+0000","last_peered":"2024-09-12T22:31:40.696770+0000","last_clean":"2024-09-12T22:31:40.696770+0000","last_became_active":"2024-09-12T22:31:37.419267+0000","last_became_peered":"2024-09-12T22:31:37.419267+0000","last_unstale":"2024-09-12T22:31:40.696770+0000","last_undegraded":"2024-09-12T22:31:40.696770+0000","last_fullsized":"2024-09-12T22:31:40.696770+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:36.790111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.764556+0000","last_change":"2024-09-12T22:31:36.411190+0000","last_active":"2024-09-12T22:31:40.764556+0000","last_peered":"2024-09-12T22:31:40.764556+0000","last_clean":"2024-09-12T22:31:40.764556+0000","last_became_active":"2024-09-12T22:31:36.410548+0000","last_became_peered":"2024-09-12T22:31:36.410548+0000","last_unstale":"2024-09-12T22:31:40.764556+0000","last_undegraded":"2024-09-12T22:31:40.764556+0000","last_fullsized":"2024-09-12T22:31:40.764556+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:10:20.300894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.696807+0000","last_change":"2024-09-12T22:31:37.418749+0000","last_active":"2024-09-12T22:31:40.696807+0000","last_peered":"2024-09-12T22:31:40.696807+0000","last_clean":"2024-09-12T22:31:40.696807+0000","last_became_active":"2024-09-12T22:31:37.418360+0000","last_became_peered":"2024-09-12T22:31:37.418360+0000","last_unstale":"2024-09-12T22:31:40.696807+0000","last_undegraded":"2024-09-12T22:31:40.696807+0000","last_fullsized":"2024-09-12T22:31:40.696807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:50:08.152699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.764246+0000","last_change":"2024-09-12T22:31:36.412187+0000","last_active":"2024-09-12T22:31:40.764246+0000","last_peered":"2024-09-12T22:31:40.764246+0000","last_clean":"2024-09-12T22:31:40.764246+0000","last_became_active":"2024-09-12T22:31:36.411935+0000","last_became_peered":"2024-09-12T22:31:36.411935+0000","last_unstale":"2024-09-12T22:31:40.764246+0000","last_undegraded":"2024-09-12T22:31:40.764246+0000","last_fullsized":"2024-09-12T22:31:40.764246+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:41:04.029445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.693559+0000","last_change":"2024-09-12T22:31:37.417881+0000","last_active":"2024-09-12T22:31:40.693559+0000","last_peered":"2024-09-12T22:31:40.693559+0000","last_clean":"2024-09-12T22:31:40.693559+0000","last_became_active":"2024-09-12T22:31:37.417572+0000","last_became_peered":"2024-09-12T22:31:37.417572+0000","last_unstale":"2024-09-12T22:31:40.693559+0000","last_undegraded":"2024-09-12T22:31:40.693559+0000","last_fullsized":"2024-09-12T22:31:40.693559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:19:16.367589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":226,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.695987+0000","last_change":"2024-09-12T22:31:27.631847+0000","last_active":"2024-09-12T22:31:40.695987+0000","last_peered":"2024-09-12T22:31:40.695987+0000","last_clean":"2024-09-12T22:31:40.695987+0000","last_became_active":"2024-09-12T22:31:27.631027+0000","last_became_peered":"2024-09-12T22:31:27.631027+0000","last_unstale":"2024-09-12T22:31:40.695987+0000","last_undegraded":"2024-09-12T22:31:40.695987+0000","last_fullsized":"2024-09-12T22:31:40.695987+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:26.229539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:26.229539+0000","last_clean_scrub_stamp":"2024-09-12T22:31:26.229539+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:59:24.181319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":30,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.696417+0000","last_change":"2024-09-12T22:31:34.286952+0000","last_active":"2024-09-12T22:31:40.696417+0000","last_peered":"2024-09-12T22:31:40.696417+0000","last_clean":"2024-09-12T22:31:40.696417+0000","last_became_active":"2024-09-12T22:31:32.283661+0000","last_became_peered":"2024-09-12T22:31:32.283661+0000","last_unstale":"2024-09-12T22:31:40.696417+0000","last_undegraded":"2024-09-12T22:31:40.696417+0000","last_fullsized":"2024-09-12T22:31:40.696417+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:21.681390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000621274,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.693061+0000","last_change":"2024-09-12T22:31:36.411275+0000","last_active":"2024-09-12T22:31:40.693061+0000","last_peered":"2024-09-12T22:31:40.693061+0000","last_clean":"2024-09-12T22:31:40.693061+0000","last_became_active":"2024-09-12T22:31:36.410595+0000","last_became_peered":"2024-09-12T22:31:36.410595+0000","last_unstale":"2024-09-12T22:31:40.693061+0000","last_undegraded":"2024-09-12T22:31:40.693061+0000","last_fullsized":"2024-09-12T22:31:40.693061+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:38:14.895625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.696887+0000","last_change":"2024-09-12T22:31:37.419976+0000","last_active":"2024-09-12T22:31:40.696887+0000","last_peered":"2024-09-12T22:31:40.696887+0000","last_clean":"2024-09-12T22:31:40.696887+0000","last_became_active":"2024-09-12T22:31:37.419161+0000","last_became_peered":"2024-09-12T22:31:37.419161+0000","last_unstale":"2024-09-12T22:31:40.696887+0000","last_undegraded":"2024-09-12T22:31:40.696887+0000","last_fullsized":"2024-09-12T22:31:40.696887+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:07:26.070097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":29,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.695956+0000","last_change":"2024-09-12T22:31:34.286642+0000","last_active":"2024-09-12T22:31:40.695956+0000","last_peered":"2024-09-12T22:31:40.695956+0000","last_clean":"2024-09-12T22:31:40.695956+0000","last_became_active":"2024-09-12T22:31:32.283601+0000","last_became_peered":"2024-09-12T22:31:32.283601+0000","last_unstale":"2024-09-12T22:31:40.695956+0000","last_undegraded":"2024-09-12T22:31:40.695956+0000","last_fullsized":"2024-09-12T22:31:40.695956+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:40:06.769540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037858999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.692788+0000","last_change":"2024-09-12T22:31:36.407395+0000","last_active":"2024-09-12T22:31:40.692788+0000","last_peered":"2024-09-12T22:31:40.692788+0000","last_clean":"2024-09-12T22:31:40.692788+0000","last_became_active":"2024-09-12T22:31:36.406770+0000","last_became_peered":"2024-09-12T22:31:36.406770+0000","last_unstale":"2024-09-12T22:31:40.692788+0000","last_undegraded":"2024-09-12T22:31:40.692788+0000","last_fullsized":"2024-09-12T22:31:40.692788+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:49:26.547848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.765109+0000","last_change":"2024-09-12T22:31:37.414075+0000","last_active":"2024-09-12T22:31:40.765109+0000","last_peered":"2024-09-12T22:31:40.765109+0000","last_clean":"2024-09-12T22:31:40.765109+0000","last_became_active":"2024-09-12T22:31:37.413491+0000","last_became_peered":"2024-09-12T22:31:37.413491+0000","last_unstale":"2024-09-12T22:31:40.765109+0000","last_undegraded":"2024-09-12T22:31:40.765109+0000","last_fullsized":"2024-09-12T22:31:40.765109+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:26:25.578693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":29,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.693038+0000","last_change":"2024-09-12T22:31:34.286394+0000","last_active":"2024-09-12T22:31:40.693038+0000","last_peered":"2024-09-12T22:31:40.693038+0000","last_clean":"2024-09-12T22:31:40.693038+0000","last_became_active":"2024-09-12T22:31:32.280062+0000","last_became_peered":"2024-09-12T22:31:32.280062+0000","last_unstale":"2024-09-12T22:31:40.693038+0000","last_undegraded":"2024-09-12T22:31:40.693038+0000","last_fullsized":"2024-09-12T22:31:40.693038+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:20:23.663838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039540700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.764247+0000","last_change":"2024-09-12T22:31:36.413752+0000","last_active":"2024-09-12T22:31:40.764247+0000","last_peered":"2024-09-12T22:31:40.764247+0000","last_clean":"2024-09-12T22:31:40.764247+0000","last_became_active":"2024-09-12T22:31:36.413486+0000","last_became_peered":"2024-09-12T22:31:36.413486+0000","last_unstale":"2024-09-12T22:31:40.764247+0000","last_undegraded":"2024-09-12T22:31:40.764247+0000","last_fullsized":"2024-09-12T22:31:40.764247+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:37:20.891838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.693603+0000","last_change":"2024-09-12T22:31:37.417636+0000","last_active":"2024-09-12T22:31:40.693603+0000","last_peered":"2024-09-12T22:31:40.693603+0000","last_clean":"2024-09-12T22:31:40.693603+0000","last_became_active":"2024-09-12T22:31:37.417230+0000","last_became_peered":"2024-09-12T22:31:37.417230+0000","last_unstale":"2024-09-12T22:31:40.693603+0000","last_undegraded":"2024-09-12T22:31:40.693603+0000","last_fullsized":"2024-09-12T22:31:40.693603+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:44:29.729122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":31,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.696205+0000","last_change":"2024-09-12T22:31:34.286938+0000","last_active":"2024-09-12T22:31:40.696205+0000","last_peered":"2024-09-12T22:31:40.696205+0000","last_clean":"2024-09-12T22:31:40.696205+0000","last_became_active":"2024-09-12T22:31:32.282230+0000","last_became_peered":"2024-09-12T22:31:32.282230+0000","last_unstale":"2024-09-12T22:31:40.696205+0000","last_undegraded":"2024-09-12T22:31:40.696205+0000","last_fullsized":"2024-09-12T22:31:40.696205+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:11:05.988384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000615758,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.696467+0000","last_change":"2024-09-12T22:31:36.410694+0000","last_active":"2024-09-12T22:31:40.696467+0000","last_peered":"2024-09-12T22:31:40.696467+0000","last_clean":"2024-09-12T22:31:40.696467+0000","last_became_active":"2024-09-12T22:31:36.409816+0000","last_became_peered":"2024-09-12T22:31:36.409816+0000","last_unstale":"2024-09-12T22:31:40.696467+0000","last_undegraded":"2024-09-12T22:31:40.696467+0000","last_fullsized":"2024-09-12T22:31:40.696467+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:40:35.369213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.693429+0000","last_change":"2024-09-12T22:31:37.414608+0000","last_active":"2024-09-12T22:31:40.693429+0000","last_peered":"2024-09-12T22:31:40.693429+0000","last_clean":"2024-09-12T22:31:40.693429+0000","last_became_active":"2024-09-12T22:31:37.414307+0000","last_became_peered":"2024-09-12T22:31:37.414307+0000","last_unstale":"2024-09-12T22:31:40.693429+0000","last_undegraded":"2024-09-12T22:31:40.693429+0000","last_fullsized":"2024-09-12T22:31:40.693429+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:41:21.231511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.696973+0000","last_change":"2024-09-12T22:31:36.411355+0000","last_active":"2024-09-12T22:31:40.696973+0000","last_peered":"2024-09-12T22:31:40.696973+0000","last_clean":"2024-09-12T22:31:40.696973+0000","last_became_active":"2024-09-12T22:31:36.410529+0000","last_became_peered":"2024-09-12T22:31:36.410529+0000","last_unstale":"2024-09-12T22:31:40.696973+0000","last_undegraded":"2024-09-12T22:31:40.696973+0000","last_fullsized":"2024-09-12T22:31:40.696973+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:19:47.356688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":29,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.693624+0000","last_change":"2024-09-12T22:31:34.286457+0000","last_active":"2024-09-12T22:31:40.693624+0000","last_peered":"2024-09-12T22:31:40.693624+0000","last_clean":"2024-09-12T22:31:40.693624+0000","last_became_active":"2024-09-12T22:31:32.280007+0000","last_became_peered":"2024-09-12T22:31:32.280007+0000","last_unstale":"2024-09-12T22:31:40.693624+0000","last_undegraded":"2024-09-12T22:31:40.693624+0000","last_fullsized":"2024-09-12T22:31:40.693624+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:09.068038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041972500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.764666+0000","last_change":"2024-09-12T22:31:37.410386+0000","last_active":"2024-09-12T22:31:40.764666+0000","last_peered":"2024-09-12T22:31:40.764666+0000","last_clean":"2024-09-12T22:31:40.764666+0000","last_became_active":"2024-09-12T22:31:37.409928+0000","last_became_peered":"2024-09-12T22:31:37.409928+0000","last_unstale":"2024-09-12T22:31:40.764666+0000","last_undegraded":"2024-09-12T22:31:40.764666+0000","last_fullsized":"2024-09-12T22:31:40.764666+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:02:36.454134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.693491+0000","last_change":"2024-09-12T22:31:36.410324+0000","last_active":"2024-09-12T22:31:40.693491+0000","last_peered":"2024-09-12T22:31:40.693491+0000","last_clean":"2024-09-12T22:31:40.693491+0000","last_became_active":"2024-09-12T22:31:36.409199+0000","last_became_peered":"2024-09-12T22:31:36.409199+0000","last_unstale":"2024-09-12T22:31:40.693491+0000","last_undegraded":"2024-09-12T22:31:40.693491+0000","last_fullsized":"2024-09-12T22:31:40.693491+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:06:54.608936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":29,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.765417+0000","last_change":"2024-09-12T22:31:34.839044+0000","last_active":"2024-09-12T22:31:40.765417+0000","last_peered":"2024-09-12T22:31:40.765417+0000","last_clean":"2024-09-12T22:31:40.765417+0000","last_became_active":"2024-09-12T22:31:32.279671+0000","last_became_peered":"2024-09-12T22:31:32.279671+0000","last_unstale":"2024-09-12T22:31:40.765417+0000","last_undegraded":"2024-09-12T22:31:40.765417+0000","last_fullsized":"2024-09-12T22:31:40.765417+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:27:49.809935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036776499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.764836+0000","last_change":"2024-09-12T22:31:37.410289+0000","last_active":"2024-09-12T22:31:40.764836+0000","last_peered":"2024-09-12T22:31:40.764836+0000","last_clean":"2024-09-12T22:31:40.764836+0000","last_became_active":"2024-09-12T22:31:37.409446+0000","last_became_peered":"2024-09-12T22:31:37.409446+0000","last_unstale":"2024-09-12T22:31:40.764836+0000","last_undegraded":"2024-09-12T22:31:40.764836+0000","last_fullsized":"2024-09-12T22:31:40.764836+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:03:32.167116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"19'2","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.693884+0000","last_change":"2024-09-12T22:31:36.409397+0000","last_active":"2024-09-12T22:31:40.693884+0000","last_peered":"2024-09-12T22:31:40.693884+0000","last_clean":"2024-09-12T22:31:40.693884+0000","last_became_active":"2024-09-12T22:31:36.408787+0000","last_became_peered":"2024-09-12T22:31:36.408787+0000","last_unstale":"2024-09-12T22:31:40.693884+0000","last_undegraded":"2024-09-12T22:31:40.693884+0000","last_fullsized":"2024-09-12T22:31:40.693884+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:29:03.467352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":29,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.693852+0000","last_change":"2024-09-12T22:31:34.286639+0000","last_active":"2024-09-12T22:31:40.693852+0000","last_peered":"2024-09-12T22:31:40.693852+0000","last_clean":"2024-09-12T22:31:40.693852+0000","last_became_active":"2024-09-12T22:31:32.280092+0000","last_became_peered":"2024-09-12T22:31:32.280092+0000","last_unstale":"2024-09-12T22:31:40.693852+0000","last_undegraded":"2024-09-12T22:31:40.693852+0000","last_fullsized":"2024-09-12T22:31:40.693852+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:02:40.821530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058589999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.692777+0000","last_change":"2024-09-12T22:31:37.411152+0000","last_active":"2024-09-12T22:31:40.692777+0000","last_peered":"2024-09-12T22:31:40.692777+0000","last_clean":"2024-09-12T22:31:40.692777+0000","last_became_active":"2024-09-12T22:31:37.410558+0000","last_became_peered":"2024-09-12T22:31:37.410558+0000","last_unstale":"2024-09-12T22:31:40.692777+0000","last_undegraded":"2024-09-12T22:31:40.692777+0000","last_fullsized":"2024-09-12T22:31:40.692777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:14:29.892478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"20'1","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.693797+0000","last_change":"2024-09-12T22:31:36.407460+0000","last_active":"2024-09-12T22:31:40.693797+0000","last_peered":"2024-09-12T22:31:40.693797+0000","last_clean":"2024-09-12T22:31:40.693797+0000","last_became_active":"2024-09-12T22:31:36.406729+0000","last_became_peered":"2024-09-12T22:31:36.406729+0000","last_unstale":"2024-09-12T22:31:40.693797+0000","last_undegraded":"2024-09-12T22:31:40.693797+0000","last_fullsized":"2024-09-12T22:31:40.693797+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:27:58.012573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":29,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.696985+0000","last_change":"2024-09-12T22:31:34.286699+0000","last_active":"2024-09-12T22:31:40.696985+0000","last_peered":"2024-09-12T22:31:40.696985+0000","last_clean":"2024-09-12T22:31:40.696985+0000","last_became_active":"2024-09-12T22:31:32.283606+0000","last_became_peered":"2024-09-12T22:31:32.283606+0000","last_unstale":"2024-09-12T22:31:40.696985+0000","last_undegraded":"2024-09-12T22:31:40.696985+0000","last_fullsized":"2024-09-12T22:31:40.696985+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:09:32.050798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000382109,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.764377+0000","last_change":"2024-09-12T22:31:37.410011+0000","last_active":"2024-09-12T22:31:40.764377+0000","last_peered":"2024-09-12T22:31:40.764377+0000","last_clean":"2024-09-12T22:31:40.764377+0000","last_became_active":"2024-09-12T22:31:37.409320+0000","last_became_peered":"2024-09-12T22:31:37.409320+0000","last_unstale":"2024-09-12T22:31:40.764377+0000","last_undegraded":"2024-09-12T22:31:40.764377+0000","last_fullsized":"2024-09-12T22:31:40.764377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:27:23.661444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.696056+0000","last_change":"2024-09-12T22:31:37.415670+0000","last_active":"2024-09-12T22:31:40.696056+0000","last_peered":"2024-09-12T22:31:40.696056+0000","last_clean":"2024-09-12T22:31:40.696056+0000","last_became_active":"2024-09-12T22:31:37.415007+0000","last_became_peered":"2024-09-12T22:31:37.415007+0000","last_unstale":"2024-09-12T22:31:40.696056+0000","last_undegraded":"2024-09-12T22:31:40.696056+0000","last_fullsized":"2024-09-12T22:31:40.696056+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:42:51.694128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"19'6","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.696523+0000","last_change":"2024-09-12T22:31:36.409878+0000","last_active":"2024-09-12T22:31:40.696523+0000","last_peered":"2024-09-12T22:31:40.696523+0000","last_clean":"2024-09-12T22:31:40.696523+0000","last_became_active":"2024-09-12T22:31:36.409132+0000","last_became_peered":"2024-09-12T22:31:36.409132+0000","last_unstale":"2024-09-12T22:31:40.696523+0000","last_undegraded":"2024-09-12T22:31:40.696523+0000","last_fullsized":"2024-09-12T22:31:40.696523+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:09:56.081385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.692753+0000","last_change":"2024-09-12T22:31:37.414914+0000","last_active":"2024-09-12T22:31:40.692753+0000","last_peered":"2024-09-12T22:31:40.692753+0000","last_clean":"2024-09-12T22:31:40.692753+0000","last_became_active":"2024-09-12T22:31:37.414535+0000","last_became_peered":"2024-09-12T22:31:37.414535+0000","last_unstale":"2024-09-12T22:31:40.692753+0000","last_undegraded":"2024-09-12T22:31:40.692753+0000","last_fullsized":"2024-09-12T22:31:40.692753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:14:37.010786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"19'3","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.765296+0000","last_change":"2024-09-12T22:31:36.410433+0000","last_active":"2024-09-12T22:31:40.765296+0000","last_peered":"2024-09-12T22:31:40.765296+0000","last_clean":"2024-09-12T22:31:40.765296+0000","last_became_active":"2024-09-12T22:31:36.410007+0000","last_became_peered":"2024-09-12T22:31:36.410007+0000","last_unstale":"2024-09-12T22:31:40.765296+0000","last_undegraded":"2024-09-12T22:31:40.765296+0000","last_fullsized":"2024-09-12T22:31:40.765296+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:08:35.385688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.696899+0000","last_change":"2024-09-12T22:31:36.411549+0000","last_active":"2024-09-12T22:31:40.696899+0000","last_peered":"2024-09-12T22:31:40.696899+0000","last_clean":"2024-09-12T22:31:40.696899+0000","last_became_active":"2024-09-12T22:31:36.410674+0000","last_became_peered":"2024-09-12T22:31:36.410674+0000","last_unstale":"2024-09-12T22:31:40.696899+0000","last_undegraded":"2024-09-12T22:31:40.696899+0000","last_fullsized":"2024-09-12T22:31:40.696899+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:58:05.676197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.692661+0000","last_change":"2024-09-12T22:31:37.411254+0000","last_active":"2024-09-12T22:31:40.692661+0000","last_peered":"2024-09-12T22:31:40.692661+0000","last_clean":"2024-09-12T22:31:40.692661+0000","last_became_active":"2024-09-12T22:31:37.410404+0000","last_became_peered":"2024-09-12T22:31:37.410404+0000","last_unstale":"2024-09-12T22:31:40.692661+0000","last_undegraded":"2024-09-12T22:31:40.692661+0000","last_fullsized":"2024-09-12T22:31:40.692661+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:42:00.856616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.693757+0000","last_change":"2024-09-12T22:31:36.408390+0000","last_active":"2024-09-12T22:31:40.693757+0000","last_peered":"2024-09-12T22:31:40.693757+0000","last_clean":"2024-09-12T22:31:40.693757+0000","last_became_active":"2024-09-12T22:31:36.407062+0000","last_became_peered":"2024-09-12T22:31:36.407062+0000","last_unstale":"2024-09-12T22:31:40.693757+0000","last_undegraded":"2024-09-12T22:31:40.693757+0000","last_fullsized":"2024-09-12T22:31:40.693757+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:09:10.618195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.692729+0000","last_change":"2024-09-12T22:31:37.416629+0000","last_active":"2024-09-12T22:31:40.692729+0000","last_peered":"2024-09-12T22:31:40.692729+0000","last_clean":"2024-09-12T22:31:40.692729+0000","last_became_active":"2024-09-12T22:31:37.416387+0000","last_became_peered":"2024-09-12T22:31:37.416387+0000","last_unstale":"2024-09-12T22:31:40.692729+0000","last_undegraded":"2024-09-12T22:31:40.692729+0000","last_fullsized":"2024-09-12T22:31:40.692729+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:59:52.020560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.765320+0000","last_change":"2024-09-12T22:31:37.413777+0000","last_active":"2024-09-12T22:31:40.765320+0000","last_peered":"2024-09-12T22:31:40.765320+0000","last_clean":"2024-09-12T22:31:40.765320+0000","last_became_active":"2024-09-12T22:31:37.412669+0000","last_became_peered":"2024-09-12T22:31:37.412669+0000","last_unstale":"2024-09-12T22:31:40.765320+0000","last_undegraded":"2024-09-12T22:31:40.765320+0000","last_fullsized":"2024-09-12T22:31:40.765320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:42:17.728844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.692865+0000","last_change":"2024-09-12T22:31:36.409466+0000","last_active":"2024-09-12T22:31:40.692865+0000","last_peered":"2024-09-12T22:31:40.692865+0000","last_clean":"2024-09-12T22:31:40.692865+0000","last_became_active":"2024-09-12T22:31:36.408796+0000","last_became_peered":"2024-09-12T22:31:36.408796+0000","last_unstale":"2024-09-12T22:31:40.692865+0000","last_undegraded":"2024-09-12T22:31:40.692865+0000","last_fullsized":"2024-09-12T22:31:40.692865+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:03:39.648159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.693567+0000","last_change":"2024-09-12T22:31:37.411183+0000","last_active":"2024-09-12T22:31:40.693567+0000","last_peered":"2024-09-12T22:31:40.693567+0000","last_clean":"2024-09-12T22:31:40.693567+0000","last_became_active":"2024-09-12T22:31:37.409796+0000","last_became_peered":"2024-09-12T22:31:37.409796+0000","last_unstale":"2024-09-12T22:31:40.693567+0000","last_undegraded":"2024-09-12T22:31:40.693567+0000","last_fullsized":"2024-09-12T22:31:40.693567+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:20:35.779810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.692792+0000","last_change":"2024-09-12T22:31:36.407402+0000","last_active":"2024-09-12T22:31:40.692792+0000","last_peered":"2024-09-12T22:31:40.692792+0000","last_clean":"2024-09-12T22:31:40.692792+0000","last_became_active":"2024-09-12T22:31:36.406681+0000","last_became_peered":"2024-09-12T22:31:36.406681+0000","last_unstale":"2024-09-12T22:31:40.692792+0000","last_undegraded":"2024-09-12T22:31:40.692792+0000","last_fullsized":"2024-09-12T22:31:40.692792+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:39:39.362573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.764875+0000","last_change":"2024-09-12T22:31:37.412817+0000","last_active":"2024-09-12T22:31:40.764875+0000","last_peered":"2024-09-12T22:31:40.764875+0000","last_clean":"2024-09-12T22:31:40.764875+0000","last_became_active":"2024-09-12T22:31:37.411999+0000","last_became_peered":"2024-09-12T22:31:37.411999+0000","last_unstale":"2024-09-12T22:31:40.764875+0000","last_undegraded":"2024-09-12T22:31:40.764875+0000","last_fullsized":"2024-09-12T22:31:40.764875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:07:02.173590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.764750+0000","last_change":"2024-09-12T22:31:36.407378+0000","last_active":"2024-09-12T22:31:40.764750+0000","last_peered":"2024-09-12T22:31:40.764750+0000","last_clean":"2024-09-12T22:31:40.764750+0000","last_became_active":"2024-09-12T22:31:36.406992+0000","last_became_peered":"2024-09-12T22:31:36.406992+0000","last_unstale":"2024-09-12T22:31:40.764750+0000","last_undegraded":"2024-09-12T22:31:40.764750+0000","last_fullsized":"2024-09-12T22:31:40.764750+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:37:16.807328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.764857+0000","last_change":"2024-09-12T22:31:37.411676+0000","last_active":"2024-09-12T22:31:40.764857+0000","last_peered":"2024-09-12T22:31:40.764857+0000","last_clean":"2024-09-12T22:31:40.764857+0000","last_became_active":"2024-09-12T22:31:37.410802+0000","last_became_peered":"2024-09-12T22:31:37.410802+0000","last_unstale":"2024-09-12T22:31:40.764857+0000","last_undegraded":"2024-09-12T22:31:40.764857+0000","last_fullsized":"2024-09-12T22:31:40.764857+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:08:21.709770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"19'1","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.764889+0000","last_change":"2024-09-12T22:31:36.412289+0000","last_active":"2024-09-12T22:31:40.764889+0000","last_peered":"2024-09-12T22:31:40.764889+0000","last_clean":"2024-09-12T22:31:40.764889+0000","last_became_active":"2024-09-12T22:31:36.411985+0000","last_became_peered":"2024-09-12T22:31:36.411985+0000","last_unstale":"2024-09-12T22:31:40.764889+0000","last_undegraded":"2024-09-12T22:31:40.764889+0000","last_fullsized":"2024-09-12T22:31:40.764889+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:30:09.410370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.695976+0000","last_change":"2024-09-12T22:31:37.415365+0000","last_active":"2024-09-12T22:31:40.695976+0000","last_peered":"2024-09-12T22:31:40.695976+0000","last_clean":"2024-09-12T22:31:40.695976+0000","last_became_active":"2024-09-12T22:31:37.413933+0000","last_became_peered":"2024-09-12T22:31:37.413933+0000","last_unstale":"2024-09-12T22:31:40.695976+0000","last_undegraded":"2024-09-12T22:31:40.695976+0000","last_fullsized":"2024-09-12T22:31:40.695976+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:08:07.115355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"19'2","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.696434+0000","last_change":"2024-09-12T22:31:36.411665+0000","last_active":"2024-09-12T22:31:40.696434+0000","last_peered":"2024-09-12T22:31:40.696434+0000","last_clean":"2024-09-12T22:31:40.696434+0000","last_became_active":"2024-09-12T22:31:36.410182+0000","last_became_peered":"2024-09-12T22:31:36.410182+0000","last_unstale":"2024-09-12T22:31:40.696434+0000","last_undegraded":"2024-09-12T22:31:40.696434+0000","last_fullsized":"2024-09-12T22:31:40.696434+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:37:20.891838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.696106+0000","last_change":"2024-09-12T22:31:37.415172+0000","last_active":"2024-09-12T22:31:40.696106+0000","last_peered":"2024-09-12T22:31:40.696106+0000","last_clean":"2024-09-12T22:31:40.696106+0000","last_became_active":"2024-09-12T22:31:37.414776+0000","last_became_peered":"2024-09-12T22:31:37.414776+0000","last_unstale":"2024-09-12T22:31:40.696106+0000","last_undegraded":"2024-09-12T22:31:40.696106+0000","last_fullsized":"2024-09-12T22:31:40.696106+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:42:32.307876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"19'2","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.765168+0000","last_change":"2024-09-12T22:31:36.410362+0000","last_active":"2024-09-12T22:31:40.765168+0000","last_peered":"2024-09-12T22:31:40.765168+0000","last_clean":"2024-09-12T22:31:40.765168+0000","last_became_active":"2024-09-12T22:31:36.410029+0000","last_became_peered":"2024-09-12T22:31:36.410029+0000","last_unstale":"2024-09-12T22:31:40.765168+0000","last_undegraded":"2024-09-12T22:31:40.765168+0000","last_fullsized":"2024-09-12T22:31:40.765168+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:23:32.476870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.764699+0000","last_change":"2024-09-12T22:31:37.409214+0000","last_active":"2024-09-12T22:31:40.764699+0000","last_peered":"2024-09-12T22:31:40.764699+0000","last_clean":"2024-09-12T22:31:40.764699+0000","last_became_active":"2024-09-12T22:31:37.408849+0000","last_became_peered":"2024-09-12T22:31:37.408849+0000","last_unstale":"2024-09-12T22:31:40.764699+0000","last_undegraded":"2024-09-12T22:31:40.764699+0000","last_fullsized":"2024-09-12T22:31:40.764699+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:39:20.383152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"19'1","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.693694+0000","last_change":"2024-09-12T22:31:36.410371+0000","last_active":"2024-09-12T22:31:40.693694+0000","last_peered":"2024-09-12T22:31:40.693694+0000","last_clean":"2024-09-12T22:31:40.693694+0000","last_became_active":"2024-09-12T22:31:36.409428+0000","last_became_peered":"2024-09-12T22:31:36.409428+0000","last_unstale":"2024-09-12T22:31:40.693694+0000","last_undegraded":"2024-09-12T22:31:40.693694+0000","last_fullsized":"2024-09-12T22:31:40.693694+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:27:22.817690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.695839+0000","last_change":"2024-09-12T22:31:37.415390+0000","last_active":"2024-09-12T22:31:40.695839+0000","last_peered":"2024-09-12T22:31:40.695839+0000","last_clean":"2024-09-12T22:31:40.695839+0000","last_became_active":"2024-09-12T22:31:37.414781+0000","last_became_peered":"2024-09-12T22:31:37.414781+0000","last_unstale":"2024-09-12T22:31:40.695839+0000","last_undegraded":"2024-09-12T22:31:40.695839+0000","last_fullsized":"2024-09-12T22:31:40.695839+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:42:17.728844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"19'4","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.693681+0000","last_change":"2024-09-12T22:31:36.407945+0000","last_active":"2024-09-12T22:31:40.693681+0000","last_peered":"2024-09-12T22:31:40.693681+0000","last_clean":"2024-09-12T22:31:40.693681+0000","last_became_active":"2024-09-12T22:31:36.406959+0000","last_became_peered":"2024-09-12T22:31:36.406959+0000","last_unstale":"2024-09-12T22:31:40.693681+0000","last_undegraded":"2024-09-12T22:31:40.693681+0000","last_fullsized":"2024-09-12T22:31:40.693681+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:26:33.155850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705672,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31984,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339856,"statfs":{"total":96636764160,"available":96604012544,"internally_reserved":0,"allocated":811008,"data_stored":658415,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705672,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31972,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339868,"statfs":{"total":96636764160,"available":96604024832,"internally_reserved":0,"allocated":798720,"data_stored":657780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738376,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":192512,"data_stored":66253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T22:31:50.084 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T22:31:50.084 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-12T22:31:50.084 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-12T22:31:50.084 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-12T22:31:50.442 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:31:50.442 INFO:teuthology.orchestra.run.smithi019.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-12T22:31:50.455 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-12T22:31:50.456 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T22:31:50.780 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:31:50.780 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":5,"btime":"2024-09-12T22:31:39:408658+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T22:31:36.753879+0000","modified":"2024-09-12T22:31:38.748818+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4239},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4239":{"gid":4239,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":2,"addr":"172.21.15.19:6803/1589279329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":1589279329},{"type":"v1","addr":"172.21.15.19:6803","nonce":1589279329}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4239,"qdb_cluster":[4239]},"id":1}]} 2024-09-12T22:31:50.781 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 5 2024-09-12T22:31:50.793 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T22:31:51.119 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:31:51.119 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":5,"btime":"2024-09-12T22:31:39:408658+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T22:31:36.753879+0000","modified":"2024-09-12T22:31:38.748818+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4239},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4239":{"gid":4239,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":2,"addr":"172.21.15.19:6803/1589279329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":1589279329},{"type":"v1","addr":"172.21.15.19:6803","nonce":1589279329}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4239,"qdb_cluster":[4239]},"id":1}]} 2024-09-12T22:31:51.119 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 5 2024-09-12T22:31:51.131 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T22:31:51.420 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:31:51.420 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":21,"fsid":"957ce235-19cb-4350-8fee-febd6e3f2199","created":"2024-09-12T22:31:15.903133+0000","modified":"2024-09-12T22:31:40.689351+0000","last_up_change":"2024-09-12T22:31:25.209056+0000","last_in_change":"2024-09-12T22:31:16.757598+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T22:31:26.228956+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T22:31:30.975989+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":16,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-12T22:31:35.267679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-12T22:31:35.724475+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73b96314-15d5-4058-9993-ac103e997b27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6800","nonce":1343093884},{"type":"v1","addr":"172.21.15.76:6801","nonce":1343093884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6802","nonce":1343093884},{"type":"v1","addr":"172.21.15.76:6803","nonce":1343093884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6806","nonce":1343093884},{"type":"v1","addr":"172.21.15.76:6807","nonce":1343093884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6804","nonce":1343093884},{"type":"v1","addr":"172.21.15.76:6805","nonce":1343093884}]},"public_addr":"172.21.15.76:6801/1343093884","cluster_addr":"172.21.15.76:6803/1343093884","heartbeat_back_addr":"172.21.15.76:6807/1343093884","heartbeat_front_addr":"172.21.15.76:6805/1343093884","state":["exists","up"]},{"osd":1,"uuid":"f82ad621-e9cf-41cb-b9c0-43470cf7ddb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":616952176},{"type":"v1","addr":"172.21.15.148:6801","nonce":616952176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":616952176},{"type":"v1","addr":"172.21.15.148:6803","nonce":616952176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":616952176},{"type":"v1","addr":"172.21.15.148:6807","nonce":616952176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":616952176},{"type":"v1","addr":"172.21.15.148:6805","nonce":616952176}]},"public_addr":"172.21.15.148:6801/616952176","cluster_addr":"172.21.15.148:6803/616952176","heartbeat_back_addr":"172.21.15.148:6807/616952176","heartbeat_front_addr":"172.21.15.148:6805/616952176","state":["exists","up"]},{"osd":2,"uuid":"f30dda36-a84c-4a01-a81a-afbfb88c0aed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":533442754},{"type":"v1","addr":"172.21.15.163:6801","nonce":533442754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":533442754},{"type":"v1","addr":"172.21.15.163:6803","nonce":533442754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":533442754},{"type":"v1","addr":"172.21.15.163:6807","nonce":533442754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":533442754},{"type":"v1","addr":"172.21.15.163:6805","nonce":533442754}]},"public_addr":"172.21.15.163:6801/533442754","cluster_addr":"172.21.15.163:6803/533442754","heartbeat_back_addr":"172.21.15.163:6807/533442754","heartbeat_front_addr":"172.21.15.163:6805/533442754","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T22:31:23.899591+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T22:31:22.988274+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T22:31:23.932109+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T22:31:51.433 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T22:31:51.761 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:31:51.761 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":5,"btime":"2024-09-12T22:31:39:408658+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T22:31:36.753879+0000","modified":"2024-09-12T22:31:38.748818+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4239},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4239":{"gid":4239,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":2,"addr":"172.21.15.19:6803/1589279329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":1589279329},{"type":"v1","addr":"172.21.15.19:6803","nonce":1589279329}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4239,"qdb_cluster":[4239]},"id":1}]} 2024-09-12T22:31:51.762 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 5 2024-09-12T22:31:51.875 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 5, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T22:31:36.753879+0000', 'modified': '2024-09-12T22:31:38.748818+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4239}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4239': {'gid': 4239, 'name': 'a', 'rank': 0, 'incarnation': 3, 'state': 'up:active', 'state_seq': 2, 'addr': '172.21.15.19:6803/1589279329', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.19:6802', 'nonce': 1589279329}, {'type': 'v1', 'addr': '172.21.15.19:6803', 'nonce': 1589279329}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4239, 'qdb_cluster': [4239]} 2024-09-12T22:31:51.875 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-12T22:31:51.875 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-12T22:31:51.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T22:31:51.990+0000 7f684cff9640 0 client.4542 ms_handle_reset on v2:172.21.15.19:6802/1589279329 2024-09-12T22:31:52.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T22:31:52.013+0000 7f684cff9640 0 client.4430 ms_handle_reset on v2:172.21.15.19:6802/1589279329 2024-09-12T22:31:52.014 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T22:31:52.014 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster_fsid": "957ce235-19cb-4350-8fee-febd6e3f2199", 2024-09-12T22:31:52.014 INFO:teuthology.orchestra.run.smithi019.stdout: "whoami": 0, 2024-09-12T22:31:52.015 INFO:teuthology.orchestra.run.smithi019.stdout: "id": 4239, 2024-09-12T22:31:52.015 INFO:teuthology.orchestra.run.smithi019.stdout: "want_state": "up:active", 2024-09-12T22:31:52.015 INFO:teuthology.orchestra.run.smithi019.stdout: "state": "up:active", 2024-09-12T22:31:52.015 INFO:teuthology.orchestra.run.smithi019.stdout: "fs_name": "cephfs", 2024-09-12T22:31:52.015 INFO:teuthology.orchestra.run.smithi019.stdout: "rank_uptime": 14.618010385, 2024-09-12T22:31:52.015 INFO:teuthology.orchestra.run.smithi019.stdout: "mdsmap_epoch": 5, 2024-09-12T22:31:52.015 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch": 21, 2024-09-12T22:31:52.015 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch_barrier": 20, 2024-09-12T22:31:52.015 INFO:teuthology.orchestra.run.smithi019.stdout: "uptime": 17.63322879 2024-09-12T22:31:52.015 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T22:31:52.025 INFO:teuthology.run_tasks:Running task thrashosds... 2024-09-12T22:31:52.038 INFO:tasks.thrashosds:config is {'chance_down': 1.0, 'powercycle': True, 'timeout': 600, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0} 2024-09-12T22:31:52.038 INFO:tasks.thrashosds:overrides is {'admin_socket': {'branch': 'squid'}, 'ceph': {'conf': {'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_TRIM\\)', '\\(MDS_SLOW_REQUEST\\)', 'MDS_SLOW_METADATA_IO', 'Behind on trimming', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'sha1': '086c737fa75c22d521a3932c59b31c5e1d1c9ef4'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '086c737fa75c22d521a3932c59b31c5e1d1c9ef4'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'squid', 'sha1': '7741f7f9ee20524f89b8f61d1609b32fb3b1570a'}} 2024-09-12T22:31:52.038 INFO:tasks.thrashosds:config is {'chance_down': 1.0, 'powercycle': True, 'timeout': 600, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0, 'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5} 2024-09-12T22:31:52.038 INFO:tasks.thrashosds:Doing preliminary sync to avoid collateral damage... 2024-09-12T22:31:52.038 DEBUG:teuthology.orchestra.run.smithi019:> sync 2024-09-12T22:31:52.128 DEBUG:teuthology.orchestra.run.smithi076:> sync 2024-09-12T22:31:52.245 DEBUG:teuthology.orchestra.run.smithi148:> sync 2024-09-12T22:31:52.515 DEBUG:teuthology.orchestra.run.smithi163:> sync 2024-09-12T22:31:52.572 DEBUG:tasks.thrashosds:checking console status of smithi019 2024-09-12T22:31:52.572 DEBUG:teuthology.orchestra.console.smithi019:Waiting for login prompt 2024-09-12T22:31:52.572 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi019 2024-09-12T22:31:52.654 DEBUG:teuthology.orchestra.console.smithi019:expect before: [Enter `^Ec?' for help] 2024-09-12T22:31:52.654 DEBUG:teuthology.orchestra.console.smithi019:expect after: smithi019 login: 2024-09-12T22:31:52.706 DEBUG:teuthology.orchestra.console.smithi019:console disconnect output: [Enter `^Ec?' for help] smithi019 login: [disconnect] 2024-09-12T22:31:52.808 DEBUG:tasks.thrashosds:checking console status of smithi076 2024-09-12T22:31:52.808 DEBUG:teuthology.orchestra.console.smithi076:Waiting for login prompt 2024-09-12T22:31:52.808 DEBUG:teuthology.orchestra.console.smithi076:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi076 2024-09-12T22:31:52.907 DEBUG:teuthology.orchestra.console.smithi076:expect before: [Enter `^Ec?' for help] 2024-09-12T22:31:52.907 DEBUG:teuthology.orchestra.console.smithi076:expect after: smithi076 login: 2024-09-12T22:31:52.960 DEBUG:teuthology.orchestra.console.smithi076:console disconnect output: [Enter `^Ec?' for help] smithi076 login: [disconnect] 2024-09-12T22:31:53.060 DEBUG:tasks.thrashosds:checking console status of smithi148 2024-09-12T22:31:53.060 DEBUG:teuthology.orchestra.console.smithi148:Waiting for login prompt 2024-09-12T22:31:53.061 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi148 2024-09-12T22:31:53.177 DEBUG:teuthology.orchestra.console.smithi148:expect before: [Enter `^Ec?' for help] 2024-09-12T22:31:53.178 DEBUG:teuthology.orchestra.console.smithi148:expect after: smithi148 login: 2024-09-12T22:31:53.231 DEBUG:teuthology.orchestra.console.smithi148:console disconnect output: [Enter `^Ec?' for help] smithi148 login: [disconnect] 2024-09-12T22:31:53.332 DEBUG:tasks.thrashosds:checking console status of smithi163 2024-09-12T22:31:53.333 DEBUG:teuthology.orchestra.console.smithi163:Waiting for login prompt 2024-09-12T22:31:53.334 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi163 2024-09-12T22:31:53.615 DEBUG:teuthology.orchestra.console.smithi163:expect before: [Enter `^Ec?' for help] 2024-09-12T22:31:53.616 DEBUG:teuthology.orchestra.console.smithi163:expect after: smithi163 login: 2024-09-12T22:31:53.668 DEBUG:teuthology.orchestra.console.smithi163:console disconnect output: [Enter `^Ec?' for help] smithi163 login: [disconnect] 2024-09-12T22:31:53.769 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr_debug_aggressive_pg_num_changes true 2024-09-12T22:31:54.092 INFO:tasks.thrashosds:Beginning thrashosds... 2024-09-12T22:31:54.092 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T22:31:54.093 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T22:31:54.392 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:31:54.394 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-12T22:31:54.401 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":34,"stamp":"2024-09-12T22:31:54.191901+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":250,"num_write_kb":3476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":91172,"kb_used_data":1760,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283024348,"statfs":{"total":289910292480,"available":289816932352,"internally_reserved":0,"allocated":1802240,"data_stored":1382448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":91483471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002975"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.765207+0000","last_change":"2024-09-12T22:31:37.416383+0000","last_active":"2024-09-12T22:31:40.765207+0000","last_peered":"2024-09-12T22:31:40.765207+0000","last_clean":"2024-09-12T22:31:40.765207+0000","last_became_active":"2024-09-12T22:31:37.415457+0000","last_became_peered":"2024-09-12T22:31:37.415457+0000","last_unstale":"2024-09-12T22:31:40.765207+0000","last_undegraded":"2024-09-12T22:31:40.765207+0000","last_fullsized":"2024-09-12T22:31:40.765207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:08:29.199832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.764838+0000","last_change":"2024-09-12T22:31:37.415228+0000","last_active":"2024-09-12T22:31:40.764838+0000","last_peered":"2024-09-12T22:31:40.764838+0000","last_clean":"2024-09-12T22:31:40.764838+0000","last_became_active":"2024-09-12T22:31:37.414765+0000","last_became_peered":"2024-09-12T22:31:37.414765+0000","last_unstale":"2024-09-12T22:31:40.764838+0000","last_undegraded":"2024-09-12T22:31:40.764838+0000","last_fullsized":"2024-09-12T22:31:40.764838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:50:48.426898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.696458+0000","last_change":"2024-09-12T22:31:37.419916+0000","last_active":"2024-09-12T22:31:40.696458+0000","last_peered":"2024-09-12T22:31:40.696458+0000","last_clean":"2024-09-12T22:31:40.696458+0000","last_became_active":"2024-09-12T22:31:37.418790+0000","last_became_peered":"2024-09-12T22:31:37.418790+0000","last_unstale":"2024-09-12T22:31:40.696458+0000","last_undegraded":"2024-09-12T22:31:40.696458+0000","last_fullsized":"2024-09-12T22:31:40.696458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:05:00.440878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.696238+0000","last_change":"2024-09-12T22:31:37.413094+0000","last_active":"2024-09-12T22:31:40.696238+0000","last_peered":"2024-09-12T22:31:40.696238+0000","last_clean":"2024-09-12T22:31:40.696238+0000","last_became_active":"2024-09-12T22:31:37.412746+0000","last_became_peered":"2024-09-12T22:31:37.412746+0000","last_unstale":"2024-09-12T22:31:40.696238+0000","last_undegraded":"2024-09-12T22:31:40.696238+0000","last_fullsized":"2024-09-12T22:31:40.696238+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:32:14.415120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.764831+0000","last_change":"2024-09-12T22:31:37.411276+0000","last_active":"2024-09-12T22:31:40.764831+0000","last_peered":"2024-09-12T22:31:40.764831+0000","last_clean":"2024-09-12T22:31:40.764831+0000","last_became_active":"2024-09-12T22:31:37.410380+0000","last_became_peered":"2024-09-12T22:31:37.410380+0000","last_unstale":"2024-09-12T22:31:40.764831+0000","last_undegraded":"2024-09-12T22:31:40.764831+0000","last_fullsized":"2024-09-12T22:31:40.764831+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:12:50.090880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.695814+0000","last_change":"2024-09-12T22:31:37.409177+0000","last_active":"2024-09-12T22:31:40.695814+0000","last_peered":"2024-09-12T22:31:40.695814+0000","last_clean":"2024-09-12T22:31:40.695814+0000","last_became_active":"2024-09-12T22:31:37.408811+0000","last_became_peered":"2024-09-12T22:31:37.408811+0000","last_unstale":"2024-09-12T22:31:40.695814+0000","last_undegraded":"2024-09-12T22:31:40.695814+0000","last_fullsized":"2024-09-12T22:31:40.695814+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:17:21.695079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.695805+0000","last_change":"2024-09-12T22:31:37.413023+0000","last_active":"2024-09-12T22:31:40.695805+0000","last_peered":"2024-09-12T22:31:40.695805+0000","last_clean":"2024-09-12T22:31:40.695805+0000","last_became_active":"2024-09-12T22:31:37.412691+0000","last_became_peered":"2024-09-12T22:31:37.412691+0000","last_unstale":"2024-09-12T22:31:40.695805+0000","last_undegraded":"2024-09-12T22:31:40.695805+0000","last_fullsized":"2024-09-12T22:31:40.695805+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:02:36.454134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.695562+0000","last_change":"2024-09-12T22:31:37.411074+0000","last_active":"2024-09-12T22:31:40.695562+0000","last_peered":"2024-09-12T22:31:40.695562+0000","last_clean":"2024-09-12T22:31:40.695562+0000","last_became_active":"2024-09-12T22:31:37.410633+0000","last_became_peered":"2024-09-12T22:31:37.410633+0000","last_unstale":"2024-09-12T22:31:40.695562+0000","last_undegraded":"2024-09-12T22:31:40.695562+0000","last_fullsized":"2024-09-12T22:31:40.695562+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:39:20.383152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.693279+0000","last_change":"2024-09-12T22:31:37.417800+0000","last_active":"2024-09-12T22:31:40.693279+0000","last_peered":"2024-09-12T22:31:40.693279+0000","last_clean":"2024-09-12T22:31:40.693279+0000","last_became_active":"2024-09-12T22:31:37.417355+0000","last_became_peered":"2024-09-12T22:31:37.417355+0000","last_unstale":"2024-09-12T22:31:40.693279+0000","last_undegraded":"2024-09-12T22:31:40.693279+0000","last_fullsized":"2024-09-12T22:31:40.693279+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:10:17.326263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.765115+0000","last_change":"2024-09-12T22:31:37.415967+0000","last_active":"2024-09-12T22:31:40.765115+0000","last_peered":"2024-09-12T22:31:40.765115+0000","last_clean":"2024-09-12T22:31:40.765115+0000","last_became_active":"2024-09-12T22:31:37.415003+0000","last_became_peered":"2024-09-12T22:31:37.415003+0000","last_unstale":"2024-09-12T22:31:40.765115+0000","last_undegraded":"2024-09-12T22:31:40.765115+0000","last_fullsized":"2024-09-12T22:31:40.765115+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:42:32.307876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.696536+0000","last_change":"2024-09-12T22:31:37.414469+0000","last_active":"2024-09-12T22:31:40.696536+0000","last_peered":"2024-09-12T22:31:40.696536+0000","last_clean":"2024-09-12T22:31:40.696536+0000","last_became_active":"2024-09-12T22:31:37.414165+0000","last_became_peered":"2024-09-12T22:31:37.414165+0000","last_unstale":"2024-09-12T22:31:40.696536+0000","last_undegraded":"2024-09-12T22:31:40.696536+0000","last_fullsized":"2024-09-12T22:31:40.696536+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:25:38.148636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.764751+0000","last_change":"2024-09-12T22:31:37.413051+0000","last_active":"2024-09-12T22:31:40.764751+0000","last_peered":"2024-09-12T22:31:40.764751+0000","last_clean":"2024-09-12T22:31:40.764751+0000","last_became_active":"2024-09-12T22:31:37.412614+0000","last_became_peered":"2024-09-12T22:31:37.412614+0000","last_unstale":"2024-09-12T22:31:40.764751+0000","last_undegraded":"2024-09-12T22:31:40.764751+0000","last_fullsized":"2024-09-12T22:31:40.764751+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:07:48.430262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.764626+0000","last_change":"2024-09-12T22:31:37.413063+0000","last_active":"2024-09-12T22:31:40.764626+0000","last_peered":"2024-09-12T22:31:40.764626+0000","last_clean":"2024-09-12T22:31:40.764626+0000","last_became_active":"2024-09-12T22:31:37.412118+0000","last_became_peered":"2024-09-12T22:31:37.412118+0000","last_unstale":"2024-09-12T22:31:40.764626+0000","last_undegraded":"2024-09-12T22:31:40.764626+0000","last_fullsized":"2024-09-12T22:31:40.764626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:14:17.750388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.695833+0000","last_change":"2024-09-12T22:31:37.414084+0000","last_active":"2024-09-12T22:31:40.695833+0000","last_peered":"2024-09-12T22:31:40.695833+0000","last_clean":"2024-09-12T22:31:40.695833+0000","last_became_active":"2024-09-12T22:31:37.413671+0000","last_became_peered":"2024-09-12T22:31:37.413671+0000","last_unstale":"2024-09-12T22:31:40.695833+0000","last_undegraded":"2024-09-12T22:31:40.695833+0000","last_fullsized":"2024-09-12T22:31:40.695833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:08:29.199832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.695836+0000","last_change":"2024-09-12T22:31:37.413482+0000","last_active":"2024-09-12T22:31:40.695836+0000","last_peered":"2024-09-12T22:31:40.695836+0000","last_clean":"2024-09-12T22:31:40.695836+0000","last_became_active":"2024-09-12T22:31:37.413195+0000","last_became_peered":"2024-09-12T22:31:37.413195+0000","last_unstale":"2024-09-12T22:31:40.695836+0000","last_undegraded":"2024-09-12T22:31:40.695836+0000","last_fullsized":"2024-09-12T22:31:40.695836+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:22:40.226076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.695670+0000","last_change":"2024-09-12T22:31:37.411006+0000","last_active":"2024-09-12T22:31:40.695670+0000","last_peered":"2024-09-12T22:31:40.695670+0000","last_clean":"2024-09-12T22:31:40.695670+0000","last_became_active":"2024-09-12T22:31:37.410557+0000","last_became_peered":"2024-09-12T22:31:37.410557+0000","last_unstale":"2024-09-12T22:31:40.695670+0000","last_undegraded":"2024-09-12T22:31:40.695670+0000","last_fullsized":"2024-09-12T22:31:40.695670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:08:21.709770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.693827+0000","last_change":"2024-09-12T22:31:37.412450+0000","last_active":"2024-09-12T22:31:40.693827+0000","last_peered":"2024-09-12T22:31:40.693827+0000","last_clean":"2024-09-12T22:31:40.693827+0000","last_became_active":"2024-09-12T22:31:37.412234+0000","last_became_peered":"2024-09-12T22:31:37.412234+0000","last_unstale":"2024-09-12T22:31:40.693827+0000","last_undegraded":"2024-09-12T22:31:40.693827+0000","last_fullsized":"2024-09-12T22:31:40.693827+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:15:59.559809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.765237+0000","last_change":"2024-09-12T22:31:37.414144+0000","last_active":"2024-09-12T22:31:40.765237+0000","last_peered":"2024-09-12T22:31:40.765237+0000","last_clean":"2024-09-12T22:31:40.765237+0000","last_became_active":"2024-09-12T22:31:37.413670+0000","last_became_peered":"2024-09-12T22:31:37.413670+0000","last_unstale":"2024-09-12T22:31:40.765237+0000","last_undegraded":"2024-09-12T22:31:40.765237+0000","last_fullsized":"2024-09-12T22:31:40.765237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:42:51.694128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.693356+0000","last_change":"2024-09-12T22:31:37.417442+0000","last_active":"2024-09-12T22:31:40.693356+0000","last_peered":"2024-09-12T22:31:40.693356+0000","last_clean":"2024-09-12T22:31:40.693356+0000","last_became_active":"2024-09-12T22:31:37.417133+0000","last_became_peered":"2024-09-12T22:31:37.417133+0000","last_unstale":"2024-09-12T22:31:40.693356+0000","last_undegraded":"2024-09-12T22:31:40.693356+0000","last_fullsized":"2024-09-12T22:31:40.693356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:36.458145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.696321+0000","last_change":"2024-09-12T22:31:37.414235+0000","last_active":"2024-09-12T22:31:40.696321+0000","last_peered":"2024-09-12T22:31:40.696321+0000","last_clean":"2024-09-12T22:31:40.696321+0000","last_became_active":"2024-09-12T22:31:37.413786+0000","last_became_peered":"2024-09-12T22:31:37.413786+0000","last_unstale":"2024-09-12T22:31:40.696321+0000","last_undegraded":"2024-09-12T22:31:40.696321+0000","last_fullsized":"2024-09-12T22:31:40.696321+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:21:11.866973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.696190+0000","last_change":"2024-09-12T22:31:37.415382+0000","last_active":"2024-09-12T22:31:40.696190+0000","last_peered":"2024-09-12T22:31:40.696190+0000","last_clean":"2024-09-12T22:31:40.696190+0000","last_became_active":"2024-09-12T22:31:37.414319+0000","last_became_peered":"2024-09-12T22:31:37.414319+0000","last_unstale":"2024-09-12T22:31:40.696190+0000","last_undegraded":"2024-09-12T22:31:40.696190+0000","last_fullsized":"2024-09-12T22:31:40.696190+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:26:25.578693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.764450+0000","last_change":"2024-09-12T22:31:37.412046+0000","last_active":"2024-09-12T22:31:40.764450+0000","last_peered":"2024-09-12T22:31:40.764450+0000","last_clean":"2024-09-12T22:31:40.764450+0000","last_became_active":"2024-09-12T22:31:37.411623+0000","last_became_peered":"2024-09-12T22:31:37.411623+0000","last_unstale":"2024-09-12T22:31:40.764450+0000","last_undegraded":"2024-09-12T22:31:40.764450+0000","last_fullsized":"2024-09-12T22:31:40.764450+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:24:15.504358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.692558+0000","last_change":"2024-09-12T22:31:37.410364+0000","last_active":"2024-09-12T22:31:40.692558+0000","last_peered":"2024-09-12T22:31:40.692558+0000","last_clean":"2024-09-12T22:31:40.692558+0000","last_became_active":"2024-09-12T22:31:37.409951+0000","last_became_peered":"2024-09-12T22:31:37.409951+0000","last_unstale":"2024-09-12T22:31:40.692558+0000","last_undegraded":"2024-09-12T22:31:40.692558+0000","last_fullsized":"2024-09-12T22:31:40.692558+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:39:17.785755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.764159+0000","last_change":"2024-09-12T22:31:37.415240+0000","last_active":"2024-09-12T22:31:40.764159+0000","last_peered":"2024-09-12T22:31:40.764159+0000","last_clean":"2024-09-12T22:31:40.764159+0000","last_became_active":"2024-09-12T22:31:37.414069+0000","last_became_peered":"2024-09-12T22:31:37.414069+0000","last_unstale":"2024-09-12T22:31:40.764159+0000","last_undegraded":"2024-09-12T22:31:40.764159+0000","last_fullsized":"2024-09-12T22:31:40.764159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:16:35.027772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.765207+0000","last_change":"2024-09-12T22:31:37.415309+0000","last_active":"2024-09-12T22:31:40.765207+0000","last_peered":"2024-09-12T22:31:40.765207+0000","last_clean":"2024-09-12T22:31:40.765207+0000","last_became_active":"2024-09-12T22:31:37.414792+0000","last_became_peered":"2024-09-12T22:31:37.414792+0000","last_unstale":"2024-09-12T22:31:40.765207+0000","last_undegraded":"2024-09-12T22:31:40.765207+0000","last_fullsized":"2024-09-12T22:31:40.765207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:08:07.115355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.693507+0000","last_change":"2024-09-12T22:31:37.411880+0000","last_active":"2024-09-12T22:31:40.693507+0000","last_peered":"2024-09-12T22:31:40.693507+0000","last_clean":"2024-09-12T22:31:40.693507+0000","last_became_active":"2024-09-12T22:31:37.410563+0000","last_became_peered":"2024-09-12T22:31:37.410563+0000","last_unstale":"2024-09-12T22:31:40.693507+0000","last_undegraded":"2024-09-12T22:31:40.693507+0000","last_fullsized":"2024-09-12T22:31:40.693507+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:47:52.560533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.696794+0000","last_change":"2024-09-12T22:31:37.419603+0000","last_active":"2024-09-12T22:31:40.696794+0000","last_peered":"2024-09-12T22:31:40.696794+0000","last_clean":"2024-09-12T22:31:40.696794+0000","last_became_active":"2024-09-12T22:31:37.418725+0000","last_became_peered":"2024-09-12T22:31:37.418725+0000","last_unstale":"2024-09-12T22:31:40.696794+0000","last_undegraded":"2024-09-12T22:31:40.696794+0000","last_fullsized":"2024-09-12T22:31:40.696794+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:02:44.183545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.765102+0000","last_change":"2024-09-12T22:31:37.412884+0000","last_active":"2024-09-12T22:31:40.765102+0000","last_peered":"2024-09-12T22:31:40.765102+0000","last_clean":"2024-09-12T22:31:40.765102+0000","last_became_active":"2024-09-12T22:31:37.412469+0000","last_became_peered":"2024-09-12T22:31:37.412469+0000","last_unstale":"2024-09-12T22:31:40.765102+0000","last_undegraded":"2024-09-12T22:31:40.765102+0000","last_fullsized":"2024-09-12T22:31:40.765102+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:05:00.440878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.693088+0000","last_change":"2024-09-12T22:31:37.414918+0000","last_active":"2024-09-12T22:31:40.693088+0000","last_peered":"2024-09-12T22:31:40.693088+0000","last_clean":"2024-09-12T22:31:40.693088+0000","last_became_active":"2024-09-12T22:31:37.414225+0000","last_became_peered":"2024-09-12T22:31:37.414225+0000","last_unstale":"2024-09-12T22:31:40.693088+0000","last_undegraded":"2024-09-12T22:31:40.693088+0000","last_fullsized":"2024-09-12T22:31:40.693088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:56:14.649228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.764655+0000","last_change":"2024-09-12T22:31:37.411569+0000","last_active":"2024-09-12T22:31:40.764655+0000","last_peered":"2024-09-12T22:31:40.764655+0000","last_clean":"2024-09-12T22:31:40.764655+0000","last_became_active":"2024-09-12T22:31:37.410619+0000","last_became_peered":"2024-09-12T22:31:37.410619+0000","last_unstale":"2024-09-12T22:31:40.764655+0000","last_undegraded":"2024-09-12T22:31:40.764655+0000","last_fullsized":"2024-09-12T22:31:40.764655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:30:01.012271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.692595+0000","last_change":"2024-09-12T22:31:37.415589+0000","last_active":"2024-09-12T22:31:40.692595+0000","last_peered":"2024-09-12T22:31:40.692595+0000","last_clean":"2024-09-12T22:31:40.692595+0000","last_became_active":"2024-09-12T22:31:37.415285+0000","last_became_peered":"2024-09-12T22:31:37.415285+0000","last_unstale":"2024-09-12T22:31:40.692595+0000","last_undegraded":"2024-09-12T22:31:40.692595+0000","last_fullsized":"2024-09-12T22:31:40.692595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:06:25.913810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.695680+0000","last_change":"2024-09-12T22:31:37.415190+0000","last_active":"2024-09-12T22:31:40.695680+0000","last_peered":"2024-09-12T22:31:40.695680+0000","last_clean":"2024-09-12T22:31:40.695680+0000","last_became_active":"2024-09-12T22:31:37.414265+0000","last_became_peered":"2024-09-12T22:31:37.414265+0000","last_unstale":"2024-09-12T22:31:40.695680+0000","last_undegraded":"2024-09-12T22:31:40.695680+0000","last_fullsized":"2024-09-12T22:31:40.695680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:07:02.173590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.765000+0000","last_change":"2024-09-12T22:31:37.409362+0000","last_active":"2024-09-12T22:31:40.765000+0000","last_peered":"2024-09-12T22:31:40.765000+0000","last_clean":"2024-09-12T22:31:40.765000+0000","last_became_active":"2024-09-12T22:31:37.408896+0000","last_became_peered":"2024-09-12T22:31:37.408896+0000","last_unstale":"2024-09-12T22:31:40.765000+0000","last_undegraded":"2024-09-12T22:31:40.765000+0000","last_fullsized":"2024-09-12T22:31:40.765000+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:17:21.695079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"19'2","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.696151+0000","last_change":"2024-09-12T22:31:36.412082+0000","last_active":"2024-09-12T22:31:40.696151+0000","last_peered":"2024-09-12T22:31:40.696151+0000","last_clean":"2024-09-12T22:31:40.696151+0000","last_became_active":"2024-09-12T22:31:36.410871+0000","last_became_peered":"2024-09-12T22:31:36.410871+0000","last_unstale":"2024-09-12T22:31:40.696151+0000","last_undegraded":"2024-09-12T22:31:40.696151+0000","last_fullsized":"2024-09-12T22:31:40.696151+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:30:49.127253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.765123+0000","last_change":"2024-09-12T22:31:37.411790+0000","last_active":"2024-09-12T22:31:40.765123+0000","last_peered":"2024-09-12T22:31:40.765123+0000","last_clean":"2024-09-12T22:31:40.765123+0000","last_became_active":"2024-09-12T22:31:37.411414+0000","last_became_peered":"2024-09-12T22:31:37.411414+0000","last_unstale":"2024-09-12T22:31:40.765123+0000","last_undegraded":"2024-09-12T22:31:40.765123+0000","last_fullsized":"2024-09-12T22:31:40.765123+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:22:40.226076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.692921+0000","last_change":"2024-09-12T22:31:36.408563+0000","last_active":"2024-09-12T22:31:40.692921+0000","last_peered":"2024-09-12T22:31:40.692921+0000","last_clean":"2024-09-12T22:31:40.692921+0000","last_became_active":"2024-09-12T22:31:36.407447+0000","last_became_peered":"2024-09-12T22:31:36.407447+0000","last_unstale":"2024-09-12T22:31:40.692921+0000","last_undegraded":"2024-09-12T22:31:40.692921+0000","last_fullsized":"2024-09-12T22:31:40.692921+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:29:37.933109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.693701+0000","last_change":"2024-09-12T22:31:37.411680+0000","last_active":"2024-09-12T22:31:40.693701+0000","last_peered":"2024-09-12T22:31:40.693701+0000","last_clean":"2024-09-12T22:31:40.693701+0000","last_became_active":"2024-09-12T22:31:37.411168+0000","last_became_peered":"2024-09-12T22:31:37.411168+0000","last_unstale":"2024-09-12T22:31:40.693701+0000","last_undegraded":"2024-09-12T22:31:40.693701+0000","last_fullsized":"2024-09-12T22:31:40.693701+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:27.706282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.764438+0000","last_change":"2024-09-12T22:31:36.411271+0000","last_active":"2024-09-12T22:31:40.764438+0000","last_peered":"2024-09-12T22:31:40.764438+0000","last_clean":"2024-09-12T22:31:40.764438+0000","last_became_active":"2024-09-12T22:31:36.410706+0000","last_became_peered":"2024-09-12T22:31:36.410706+0000","last_unstale":"2024-09-12T22:31:40.764438+0000","last_undegraded":"2024-09-12T22:31:40.764438+0000","last_fullsized":"2024-09-12T22:31:40.764438+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:43:22.805855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.693409+0000","last_change":"2024-09-12T22:31:37.411218+0000","last_active":"2024-09-12T22:31:40.693409+0000","last_peered":"2024-09-12T22:31:40.693409+0000","last_clean":"2024-09-12T22:31:40.693409+0000","last_became_active":"2024-09-12T22:31:37.409666+0000","last_became_peered":"2024-09-12T22:31:37.409666+0000","last_unstale":"2024-09-12T22:31:40.693409+0000","last_undegraded":"2024-09-12T22:31:40.693409+0000","last_fullsized":"2024-09-12T22:31:40.693409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:45:34.230090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"19'8","reported_seq":24,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.695805+0000","last_change":"2024-09-12T22:31:36.411811+0000","last_active":"2024-09-12T22:31:40.695805+0000","last_peered":"2024-09-12T22:31:40.695805+0000","last_clean":"2024-09-12T22:31:40.695805+0000","last_became_active":"2024-09-12T22:31:36.410101+0000","last_became_peered":"2024-09-12T22:31:36.410101+0000","last_unstale":"2024-09-12T22:31:40.695805+0000","last_undegraded":"2024-09-12T22:31:40.695805+0000","last_fullsized":"2024-09-12T22:31:40.695805+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:33:02.410148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"19'1","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.696872+0000","last_change":"2024-09-12T22:31:36.410970+0000","last_active":"2024-09-12T22:31:40.696872+0000","last_peered":"2024-09-12T22:31:40.696872+0000","last_clean":"2024-09-12T22:31:40.696872+0000","last_became_active":"2024-09-12T22:31:36.409754+0000","last_became_peered":"2024-09-12T22:31:36.409754+0000","last_unstale":"2024-09-12T22:31:40.696872+0000","last_undegraded":"2024-09-12T22:31:40.696872+0000","last_fullsized":"2024-09-12T22:31:40.696872+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:30:07.724418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.764193+0000","last_change":"2024-09-12T22:31:37.415050+0000","last_active":"2024-09-12T22:31:40.764193+0000","last_peered":"2024-09-12T22:31:40.764193+0000","last_clean":"2024-09-12T22:31:40.764193+0000","last_became_active":"2024-09-12T22:31:37.414290+0000","last_became_peered":"2024-09-12T22:31:37.414290+0000","last_unstale":"2024-09-12T22:31:40.764193+0000","last_undegraded":"2024-09-12T22:31:40.764193+0000","last_fullsized":"2024-09-12T22:31:40.764193+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:47:15.502575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"19'2","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.765286+0000","last_change":"2024-09-12T22:31:36.411725+0000","last_active":"2024-09-12T22:31:40.765286+0000","last_peered":"2024-09-12T22:31:40.765286+0000","last_clean":"2024-09-12T22:31:40.765286+0000","last_became_active":"2024-09-12T22:31:36.411407+0000","last_became_peered":"2024-09-12T22:31:36.411407+0000","last_unstale":"2024-09-12T22:31:40.765286+0000","last_undegraded":"2024-09-12T22:31:40.765286+0000","last_fullsized":"2024-09-12T22:31:40.765286+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:30:07.724418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.764522+0000","last_change":"2024-09-12T22:31:37.413857+0000","last_active":"2024-09-12T22:31:40.764522+0000","last_peered":"2024-09-12T22:31:40.764522+0000","last_clean":"2024-09-12T22:31:40.764522+0000","last_became_active":"2024-09-12T22:31:37.412941+0000","last_became_peered":"2024-09-12T22:31:37.412941+0000","last_unstale":"2024-09-12T22:31:40.764522+0000","last_undegraded":"2024-09-12T22:31:40.764522+0000","last_fullsized":"2024-09-12T22:31:40.764522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:58:45.134258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"19'1","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.696863+0000","last_change":"2024-09-12T22:31:36.411320+0000","last_active":"2024-09-12T22:31:40.696863+0000","last_peered":"2024-09-12T22:31:40.696863+0000","last_clean":"2024-09-12T22:31:40.696863+0000","last_became_active":"2024-09-12T22:31:36.409837+0000","last_became_peered":"2024-09-12T22:31:36.409837+0000","last_unstale":"2024-09-12T22:31:40.696863+0000","last_undegraded":"2024-09-12T22:31:40.696863+0000","last_fullsized":"2024-09-12T22:31:40.696863+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:36:53.914922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.695949+0000","last_change":"2024-09-12T22:31:37.414809+0000","last_active":"2024-09-12T22:31:40.695949+0000","last_peered":"2024-09-12T22:31:40.695949+0000","last_clean":"2024-09-12T22:31:40.695949+0000","last_became_active":"2024-09-12T22:31:37.414492+0000","last_became_peered":"2024-09-12T22:31:37.414492+0000","last_unstale":"2024-09-12T22:31:40.695949+0000","last_undegraded":"2024-09-12T22:31:40.695949+0000","last_fullsized":"2024-09-12T22:31:40.695949+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:50:48.426898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.696715+0000","last_change":"2024-09-12T22:31:36.412068+0000","last_active":"2024-09-12T22:31:40.696715+0000","last_peered":"2024-09-12T22:31:40.696715+0000","last_clean":"2024-09-12T22:31:40.696715+0000","last_became_active":"2024-09-12T22:31:36.411366+0000","last_became_peered":"2024-09-12T22:31:36.411366+0000","last_unstale":"2024-09-12T22:31:40.696715+0000","last_undegraded":"2024-09-12T22:31:40.696715+0000","last_fullsized":"2024-09-12T22:31:40.696715+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:35:51.647051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.693166+0000","last_change":"2024-09-12T22:31:37.410303+0000","last_active":"2024-09-12T22:31:40.693166+0000","last_peered":"2024-09-12T22:31:40.693166+0000","last_clean":"2024-09-12T22:31:40.693166+0000","last_became_active":"2024-09-12T22:31:37.409607+0000","last_became_peered":"2024-09-12T22:31:37.409607+0000","last_unstale":"2024-09-12T22:31:40.693166+0000","last_undegraded":"2024-09-12T22:31:40.693166+0000","last_fullsized":"2024-09-12T22:31:40.693166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:53:42.732654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"19'2","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.693353+0000","last_change":"2024-09-12T22:31:36.407974+0000","last_active":"2024-09-12T22:31:40.693353+0000","last_peered":"2024-09-12T22:31:40.693353+0000","last_clean":"2024-09-12T22:31:40.693353+0000","last_became_active":"2024-09-12T22:31:36.406955+0000","last_became_peered":"2024-09-12T22:31:36.406955+0000","last_unstale":"2024-09-12T22:31:40.693353+0000","last_undegraded":"2024-09-12T22:31:40.693353+0000","last_fullsized":"2024-09-12T22:31:40.693353+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:07:34.831264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.696465+0000","last_change":"2024-09-12T22:31:37.415285+0000","last_active":"2024-09-12T22:31:40.696465+0000","last_peered":"2024-09-12T22:31:40.696465+0000","last_clean":"2024-09-12T22:31:40.696465+0000","last_became_active":"2024-09-12T22:31:37.414890+0000","last_became_peered":"2024-09-12T22:31:37.414890+0000","last_unstale":"2024-09-12T22:31:40.696465+0000","last_undegraded":"2024-09-12T22:31:40.696465+0000","last_fullsized":"2024-09-12T22:31:40.696465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:38:16.956786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.696019+0000","last_change":"2024-09-12T22:31:36.412147+0000","last_active":"2024-09-12T22:31:40.696019+0000","last_peered":"2024-09-12T22:31:40.696019+0000","last_clean":"2024-09-12T22:31:40.696019+0000","last_became_active":"2024-09-12T22:31:36.411382+0000","last_became_peered":"2024-09-12T22:31:36.411382+0000","last_unstale":"2024-09-12T22:31:40.696019+0000","last_undegraded":"2024-09-12T22:31:40.696019+0000","last_fullsized":"2024-09-12T22:31:40.696019+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:54:51.454867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.696770+0000","last_change":"2024-09-12T22:31:37.420209+0000","last_active":"2024-09-12T22:31:40.696770+0000","last_peered":"2024-09-12T22:31:40.696770+0000","last_clean":"2024-09-12T22:31:40.696770+0000","last_became_active":"2024-09-12T22:31:37.419267+0000","last_became_peered":"2024-09-12T22:31:37.419267+0000","last_unstale":"2024-09-12T22:31:40.696770+0000","last_undegraded":"2024-09-12T22:31:40.696770+0000","last_fullsized":"2024-09-12T22:31:40.696770+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:36.790111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.764556+0000","last_change":"2024-09-12T22:31:36.411190+0000","last_active":"2024-09-12T22:31:40.764556+0000","last_peered":"2024-09-12T22:31:40.764556+0000","last_clean":"2024-09-12T22:31:40.764556+0000","last_became_active":"2024-09-12T22:31:36.410548+0000","last_became_peered":"2024-09-12T22:31:36.410548+0000","last_unstale":"2024-09-12T22:31:40.764556+0000","last_undegraded":"2024-09-12T22:31:40.764556+0000","last_fullsized":"2024-09-12T22:31:40.764556+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:10:20.300894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.696807+0000","last_change":"2024-09-12T22:31:37.418749+0000","last_active":"2024-09-12T22:31:40.696807+0000","last_peered":"2024-09-12T22:31:40.696807+0000","last_clean":"2024-09-12T22:31:40.696807+0000","last_became_active":"2024-09-12T22:31:37.418360+0000","last_became_peered":"2024-09-12T22:31:37.418360+0000","last_unstale":"2024-09-12T22:31:40.696807+0000","last_undegraded":"2024-09-12T22:31:40.696807+0000","last_fullsized":"2024-09-12T22:31:40.696807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:50:08.152699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.764246+0000","last_change":"2024-09-12T22:31:36.412187+0000","last_active":"2024-09-12T22:31:40.764246+0000","last_peered":"2024-09-12T22:31:40.764246+0000","last_clean":"2024-09-12T22:31:40.764246+0000","last_became_active":"2024-09-12T22:31:36.411935+0000","last_became_peered":"2024-09-12T22:31:36.411935+0000","last_unstale":"2024-09-12T22:31:40.764246+0000","last_undegraded":"2024-09-12T22:31:40.764246+0000","last_fullsized":"2024-09-12T22:31:40.764246+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:41:04.029445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.693559+0000","last_change":"2024-09-12T22:31:37.417881+0000","last_active":"2024-09-12T22:31:40.693559+0000","last_peered":"2024-09-12T22:31:40.693559+0000","last_clean":"2024-09-12T22:31:40.693559+0000","last_became_active":"2024-09-12T22:31:37.417572+0000","last_became_peered":"2024-09-12T22:31:37.417572+0000","last_unstale":"2024-09-12T22:31:40.693559+0000","last_undegraded":"2024-09-12T22:31:40.693559+0000","last_fullsized":"2024-09-12T22:31:40.693559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:19:16.367589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":226,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.695987+0000","last_change":"2024-09-12T22:31:27.631847+0000","last_active":"2024-09-12T22:31:40.695987+0000","last_peered":"2024-09-12T22:31:40.695987+0000","last_clean":"2024-09-12T22:31:40.695987+0000","last_became_active":"2024-09-12T22:31:27.631027+0000","last_became_peered":"2024-09-12T22:31:27.631027+0000","last_unstale":"2024-09-12T22:31:40.695987+0000","last_undegraded":"2024-09-12T22:31:40.695987+0000","last_fullsized":"2024-09-12T22:31:40.695987+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:26.229539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:26.229539+0000","last_clean_scrub_stamp":"2024-09-12T22:31:26.229539+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:59:24.181319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":30,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.696417+0000","last_change":"2024-09-12T22:31:34.286952+0000","last_active":"2024-09-12T22:31:40.696417+0000","last_peered":"2024-09-12T22:31:40.696417+0000","last_clean":"2024-09-12T22:31:40.696417+0000","last_became_active":"2024-09-12T22:31:32.283661+0000","last_became_peered":"2024-09-12T22:31:32.283661+0000","last_unstale":"2024-09-12T22:31:40.696417+0000","last_undegraded":"2024-09-12T22:31:40.696417+0000","last_fullsized":"2024-09-12T22:31:40.696417+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:21.681390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000621274,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.693061+0000","last_change":"2024-09-12T22:31:36.411275+0000","last_active":"2024-09-12T22:31:40.693061+0000","last_peered":"2024-09-12T22:31:40.693061+0000","last_clean":"2024-09-12T22:31:40.693061+0000","last_became_active":"2024-09-12T22:31:36.410595+0000","last_became_peered":"2024-09-12T22:31:36.410595+0000","last_unstale":"2024-09-12T22:31:40.693061+0000","last_undegraded":"2024-09-12T22:31:40.693061+0000","last_fullsized":"2024-09-12T22:31:40.693061+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:38:14.895625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.696887+0000","last_change":"2024-09-12T22:31:37.419976+0000","last_active":"2024-09-12T22:31:40.696887+0000","last_peered":"2024-09-12T22:31:40.696887+0000","last_clean":"2024-09-12T22:31:40.696887+0000","last_became_active":"2024-09-12T22:31:37.419161+0000","last_became_peered":"2024-09-12T22:31:37.419161+0000","last_unstale":"2024-09-12T22:31:40.696887+0000","last_undegraded":"2024-09-12T22:31:40.696887+0000","last_fullsized":"2024-09-12T22:31:40.696887+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:07:26.070097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":29,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.695956+0000","last_change":"2024-09-12T22:31:34.286642+0000","last_active":"2024-09-12T22:31:40.695956+0000","last_peered":"2024-09-12T22:31:40.695956+0000","last_clean":"2024-09-12T22:31:40.695956+0000","last_became_active":"2024-09-12T22:31:32.283601+0000","last_became_peered":"2024-09-12T22:31:32.283601+0000","last_unstale":"2024-09-12T22:31:40.695956+0000","last_undegraded":"2024-09-12T22:31:40.695956+0000","last_fullsized":"2024-09-12T22:31:40.695956+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:40:06.769540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037858999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.692788+0000","last_change":"2024-09-12T22:31:36.407395+0000","last_active":"2024-09-12T22:31:40.692788+0000","last_peered":"2024-09-12T22:31:40.692788+0000","last_clean":"2024-09-12T22:31:40.692788+0000","last_became_active":"2024-09-12T22:31:36.406770+0000","last_became_peered":"2024-09-12T22:31:36.406770+0000","last_unstale":"2024-09-12T22:31:40.692788+0000","last_undegraded":"2024-09-12T22:31:40.692788+0000","last_fullsized":"2024-09-12T22:31:40.692788+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:49:26.547848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.765109+0000","last_change":"2024-09-12T22:31:37.414075+0000","last_active":"2024-09-12T22:31:40.765109+0000","last_peered":"2024-09-12T22:31:40.765109+0000","last_clean":"2024-09-12T22:31:40.765109+0000","last_became_active":"2024-09-12T22:31:37.413491+0000","last_became_peered":"2024-09-12T22:31:37.413491+0000","last_unstale":"2024-09-12T22:31:40.765109+0000","last_undegraded":"2024-09-12T22:31:40.765109+0000","last_fullsized":"2024-09-12T22:31:40.765109+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:26:25.578693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":29,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.693038+0000","last_change":"2024-09-12T22:31:34.286394+0000","last_active":"2024-09-12T22:31:40.693038+0000","last_peered":"2024-09-12T22:31:40.693038+0000","last_clean":"2024-09-12T22:31:40.693038+0000","last_became_active":"2024-09-12T22:31:32.280062+0000","last_became_peered":"2024-09-12T22:31:32.280062+0000","last_unstale":"2024-09-12T22:31:40.693038+0000","last_undegraded":"2024-09-12T22:31:40.693038+0000","last_fullsized":"2024-09-12T22:31:40.693038+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:20:23.663838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039540700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.764247+0000","last_change":"2024-09-12T22:31:36.413752+0000","last_active":"2024-09-12T22:31:40.764247+0000","last_peered":"2024-09-12T22:31:40.764247+0000","last_clean":"2024-09-12T22:31:40.764247+0000","last_became_active":"2024-09-12T22:31:36.413486+0000","last_became_peered":"2024-09-12T22:31:36.413486+0000","last_unstale":"2024-09-12T22:31:40.764247+0000","last_undegraded":"2024-09-12T22:31:40.764247+0000","last_fullsized":"2024-09-12T22:31:40.764247+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:37:20.891838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.693603+0000","last_change":"2024-09-12T22:31:37.417636+0000","last_active":"2024-09-12T22:31:40.693603+0000","last_peered":"2024-09-12T22:31:40.693603+0000","last_clean":"2024-09-12T22:31:40.693603+0000","last_became_active":"2024-09-12T22:31:37.417230+0000","last_became_peered":"2024-09-12T22:31:37.417230+0000","last_unstale":"2024-09-12T22:31:40.693603+0000","last_undegraded":"2024-09-12T22:31:40.693603+0000","last_fullsized":"2024-09-12T22:31:40.693603+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:44:29.729122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":31,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.696205+0000","last_change":"2024-09-12T22:31:34.286938+0000","last_active":"2024-09-12T22:31:40.696205+0000","last_peered":"2024-09-12T22:31:40.696205+0000","last_clean":"2024-09-12T22:31:40.696205+0000","last_became_active":"2024-09-12T22:31:32.282230+0000","last_became_peered":"2024-09-12T22:31:32.282230+0000","last_unstale":"2024-09-12T22:31:40.696205+0000","last_undegraded":"2024-09-12T22:31:40.696205+0000","last_fullsized":"2024-09-12T22:31:40.696205+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:11:05.988384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000615758,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.696467+0000","last_change":"2024-09-12T22:31:36.410694+0000","last_active":"2024-09-12T22:31:40.696467+0000","last_peered":"2024-09-12T22:31:40.696467+0000","last_clean":"2024-09-12T22:31:40.696467+0000","last_became_active":"2024-09-12T22:31:36.409816+0000","last_became_peered":"2024-09-12T22:31:36.409816+0000","last_unstale":"2024-09-12T22:31:40.696467+0000","last_undegraded":"2024-09-12T22:31:40.696467+0000","last_fullsized":"2024-09-12T22:31:40.696467+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:40:35.369213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.693429+0000","last_change":"2024-09-12T22:31:37.414608+0000","last_active":"2024-09-12T22:31:40.693429+0000","last_peered":"2024-09-12T22:31:40.693429+0000","last_clean":"2024-09-12T22:31:40.693429+0000","last_became_active":"2024-09-12T22:31:37.414307+0000","last_became_peered":"2024-09-12T22:31:37.414307+0000","last_unstale":"2024-09-12T22:31:40.693429+0000","last_undegraded":"2024-09-12T22:31:40.693429+0000","last_fullsized":"2024-09-12T22:31:40.693429+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:41:21.231511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.696973+0000","last_change":"2024-09-12T22:31:36.411355+0000","last_active":"2024-09-12T22:31:40.696973+0000","last_peered":"2024-09-12T22:31:40.696973+0000","last_clean":"2024-09-12T22:31:40.696973+0000","last_became_active":"2024-09-12T22:31:36.410529+0000","last_became_peered":"2024-09-12T22:31:36.410529+0000","last_unstale":"2024-09-12T22:31:40.696973+0000","last_undegraded":"2024-09-12T22:31:40.696973+0000","last_fullsized":"2024-09-12T22:31:40.696973+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:19:47.356688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":29,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.693624+0000","last_change":"2024-09-12T22:31:34.286457+0000","last_active":"2024-09-12T22:31:40.693624+0000","last_peered":"2024-09-12T22:31:40.693624+0000","last_clean":"2024-09-12T22:31:40.693624+0000","last_became_active":"2024-09-12T22:31:32.280007+0000","last_became_peered":"2024-09-12T22:31:32.280007+0000","last_unstale":"2024-09-12T22:31:40.693624+0000","last_undegraded":"2024-09-12T22:31:40.693624+0000","last_fullsized":"2024-09-12T22:31:40.693624+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:09.068038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041972500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.764666+0000","last_change":"2024-09-12T22:31:37.410386+0000","last_active":"2024-09-12T22:31:40.764666+0000","last_peered":"2024-09-12T22:31:40.764666+0000","last_clean":"2024-09-12T22:31:40.764666+0000","last_became_active":"2024-09-12T22:31:37.409928+0000","last_became_peered":"2024-09-12T22:31:37.409928+0000","last_unstale":"2024-09-12T22:31:40.764666+0000","last_undegraded":"2024-09-12T22:31:40.764666+0000","last_fullsized":"2024-09-12T22:31:40.764666+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:02:36.454134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.693491+0000","last_change":"2024-09-12T22:31:36.410324+0000","last_active":"2024-09-12T22:31:40.693491+0000","last_peered":"2024-09-12T22:31:40.693491+0000","last_clean":"2024-09-12T22:31:40.693491+0000","last_became_active":"2024-09-12T22:31:36.409199+0000","last_became_peered":"2024-09-12T22:31:36.409199+0000","last_unstale":"2024-09-12T22:31:40.693491+0000","last_undegraded":"2024-09-12T22:31:40.693491+0000","last_fullsized":"2024-09-12T22:31:40.693491+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:06:54.608936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":29,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.765417+0000","last_change":"2024-09-12T22:31:34.839044+0000","last_active":"2024-09-12T22:31:40.765417+0000","last_peered":"2024-09-12T22:31:40.765417+0000","last_clean":"2024-09-12T22:31:40.765417+0000","last_became_active":"2024-09-12T22:31:32.279671+0000","last_became_peered":"2024-09-12T22:31:32.279671+0000","last_unstale":"2024-09-12T22:31:40.765417+0000","last_undegraded":"2024-09-12T22:31:40.765417+0000","last_fullsized":"2024-09-12T22:31:40.765417+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:27:49.809935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036776499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.764836+0000","last_change":"2024-09-12T22:31:37.410289+0000","last_active":"2024-09-12T22:31:40.764836+0000","last_peered":"2024-09-12T22:31:40.764836+0000","last_clean":"2024-09-12T22:31:40.764836+0000","last_became_active":"2024-09-12T22:31:37.409446+0000","last_became_peered":"2024-09-12T22:31:37.409446+0000","last_unstale":"2024-09-12T22:31:40.764836+0000","last_undegraded":"2024-09-12T22:31:40.764836+0000","last_fullsized":"2024-09-12T22:31:40.764836+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:03:32.167116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"19'2","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.693884+0000","last_change":"2024-09-12T22:31:36.409397+0000","last_active":"2024-09-12T22:31:40.693884+0000","last_peered":"2024-09-12T22:31:40.693884+0000","last_clean":"2024-09-12T22:31:40.693884+0000","last_became_active":"2024-09-12T22:31:36.408787+0000","last_became_peered":"2024-09-12T22:31:36.408787+0000","last_unstale":"2024-09-12T22:31:40.693884+0000","last_undegraded":"2024-09-12T22:31:40.693884+0000","last_fullsized":"2024-09-12T22:31:40.693884+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:29:03.467352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":29,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.693852+0000","last_change":"2024-09-12T22:31:34.286639+0000","last_active":"2024-09-12T22:31:40.693852+0000","last_peered":"2024-09-12T22:31:40.693852+0000","last_clean":"2024-09-12T22:31:40.693852+0000","last_became_active":"2024-09-12T22:31:32.280092+0000","last_became_peered":"2024-09-12T22:31:32.280092+0000","last_unstale":"2024-09-12T22:31:40.693852+0000","last_undegraded":"2024-09-12T22:31:40.693852+0000","last_fullsized":"2024-09-12T22:31:40.693852+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:02:40.821530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058589999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.692777+0000","last_change":"2024-09-12T22:31:37.411152+0000","last_active":"2024-09-12T22:31:40.692777+0000","last_peered":"2024-09-12T22:31:40.692777+0000","last_clean":"2024-09-12T22:31:40.692777+0000","last_became_active":"2024-09-12T22:31:37.410558+0000","last_became_peered":"2024-09-12T22:31:37.410558+0000","last_unstale":"2024-09-12T22:31:40.692777+0000","last_undegraded":"2024-09-12T22:31:40.692777+0000","last_fullsized":"2024-09-12T22:31:40.692777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:14:29.892478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"20'1","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.693797+0000","last_change":"2024-09-12T22:31:36.407460+0000","last_active":"2024-09-12T22:31:40.693797+0000","last_peered":"2024-09-12T22:31:40.693797+0000","last_clean":"2024-09-12T22:31:40.693797+0000","last_became_active":"2024-09-12T22:31:36.406729+0000","last_became_peered":"2024-09-12T22:31:36.406729+0000","last_unstale":"2024-09-12T22:31:40.693797+0000","last_undegraded":"2024-09-12T22:31:40.693797+0000","last_fullsized":"2024-09-12T22:31:40.693797+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:27:58.012573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":29,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.696985+0000","last_change":"2024-09-12T22:31:34.286699+0000","last_active":"2024-09-12T22:31:40.696985+0000","last_peered":"2024-09-12T22:31:40.696985+0000","last_clean":"2024-09-12T22:31:40.696985+0000","last_became_active":"2024-09-12T22:31:32.283606+0000","last_became_peered":"2024-09-12T22:31:32.283606+0000","last_unstale":"2024-09-12T22:31:40.696985+0000","last_undegraded":"2024-09-12T22:31:40.696985+0000","last_fullsized":"2024-09-12T22:31:40.696985+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:09:32.050798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000382109,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.764377+0000","last_change":"2024-09-12T22:31:37.410011+0000","last_active":"2024-09-12T22:31:40.764377+0000","last_peered":"2024-09-12T22:31:40.764377+0000","last_clean":"2024-09-12T22:31:40.764377+0000","last_became_active":"2024-09-12T22:31:37.409320+0000","last_became_peered":"2024-09-12T22:31:37.409320+0000","last_unstale":"2024-09-12T22:31:40.764377+0000","last_undegraded":"2024-09-12T22:31:40.764377+0000","last_fullsized":"2024-09-12T22:31:40.764377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:27:23.661444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.696056+0000","last_change":"2024-09-12T22:31:37.415670+0000","last_active":"2024-09-12T22:31:40.696056+0000","last_peered":"2024-09-12T22:31:40.696056+0000","last_clean":"2024-09-12T22:31:40.696056+0000","last_became_active":"2024-09-12T22:31:37.415007+0000","last_became_peered":"2024-09-12T22:31:37.415007+0000","last_unstale":"2024-09-12T22:31:40.696056+0000","last_undegraded":"2024-09-12T22:31:40.696056+0000","last_fullsized":"2024-09-12T22:31:40.696056+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:42:51.694128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"19'6","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.696523+0000","last_change":"2024-09-12T22:31:36.409878+0000","last_active":"2024-09-12T22:31:40.696523+0000","last_peered":"2024-09-12T22:31:40.696523+0000","last_clean":"2024-09-12T22:31:40.696523+0000","last_became_active":"2024-09-12T22:31:36.409132+0000","last_became_peered":"2024-09-12T22:31:36.409132+0000","last_unstale":"2024-09-12T22:31:40.696523+0000","last_undegraded":"2024-09-12T22:31:40.696523+0000","last_fullsized":"2024-09-12T22:31:40.696523+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:09:56.081385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.692753+0000","last_change":"2024-09-12T22:31:37.414914+0000","last_active":"2024-09-12T22:31:40.692753+0000","last_peered":"2024-09-12T22:31:40.692753+0000","last_clean":"2024-09-12T22:31:40.692753+0000","last_became_active":"2024-09-12T22:31:37.414535+0000","last_became_peered":"2024-09-12T22:31:37.414535+0000","last_unstale":"2024-09-12T22:31:40.692753+0000","last_undegraded":"2024-09-12T22:31:40.692753+0000","last_fullsized":"2024-09-12T22:31:40.692753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:14:37.010786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"19'3","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.765296+0000","last_change":"2024-09-12T22:31:36.410433+0000","last_active":"2024-09-12T22:31:40.765296+0000","last_peered":"2024-09-12T22:31:40.765296+0000","last_clean":"2024-09-12T22:31:40.765296+0000","last_became_active":"2024-09-12T22:31:36.410007+0000","last_became_peered":"2024-09-12T22:31:36.410007+0000","last_unstale":"2024-09-12T22:31:40.765296+0000","last_undegraded":"2024-09-12T22:31:40.765296+0000","last_fullsized":"2024-09-12T22:31:40.765296+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:08:35.385688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.696899+0000","last_change":"2024-09-12T22:31:36.411549+0000","last_active":"2024-09-12T22:31:40.696899+0000","last_peered":"2024-09-12T22:31:40.696899+0000","last_clean":"2024-09-12T22:31:40.696899+0000","last_became_active":"2024-09-12T22:31:36.410674+0000","last_became_peered":"2024-09-12T22:31:36.410674+0000","last_unstale":"2024-09-12T22:31:40.696899+0000","last_undegraded":"2024-09-12T22:31:40.696899+0000","last_fullsized":"2024-09-12T22:31:40.696899+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:58:05.676197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.692661+0000","last_change":"2024-09-12T22:31:37.411254+0000","last_active":"2024-09-12T22:31:40.692661+0000","last_peered":"2024-09-12T22:31:40.692661+0000","last_clean":"2024-09-12T22:31:40.692661+0000","last_became_active":"2024-09-12T22:31:37.410404+0000","last_became_peered":"2024-09-12T22:31:37.410404+0000","last_unstale":"2024-09-12T22:31:40.692661+0000","last_undegraded":"2024-09-12T22:31:40.692661+0000","last_fullsized":"2024-09-12T22:31:40.692661+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:42:00.856616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.693757+0000","last_change":"2024-09-12T22:31:36.408390+0000","last_active":"2024-09-12T22:31:40.693757+0000","last_peered":"2024-09-12T22:31:40.693757+0000","last_clean":"2024-09-12T22:31:40.693757+0000","last_became_active":"2024-09-12T22:31:36.407062+0000","last_became_peered":"2024-09-12T22:31:36.407062+0000","last_unstale":"2024-09-12T22:31:40.693757+0000","last_undegraded":"2024-09-12T22:31:40.693757+0000","last_fullsized":"2024-09-12T22:31:40.693757+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:09:10.618195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.692729+0000","last_change":"2024-09-12T22:31:37.416629+0000","last_active":"2024-09-12T22:31:40.692729+0000","last_peered":"2024-09-12T22:31:40.692729+0000","last_clean":"2024-09-12T22:31:40.692729+0000","last_became_active":"2024-09-12T22:31:37.416387+0000","last_became_peered":"2024-09-12T22:31:37.416387+0000","last_unstale":"2024-09-12T22:31:40.692729+0000","last_undegraded":"2024-09-12T22:31:40.692729+0000","last_fullsized":"2024-09-12T22:31:40.692729+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:59:52.020560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.765320+0000","last_change":"2024-09-12T22:31:37.413777+0000","last_active":"2024-09-12T22:31:40.765320+0000","last_peered":"2024-09-12T22:31:40.765320+0000","last_clean":"2024-09-12T22:31:40.765320+0000","last_became_active":"2024-09-12T22:31:37.412669+0000","last_became_peered":"2024-09-12T22:31:37.412669+0000","last_unstale":"2024-09-12T22:31:40.765320+0000","last_undegraded":"2024-09-12T22:31:40.765320+0000","last_fullsized":"2024-09-12T22:31:40.765320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:42:17.728844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.692865+0000","last_change":"2024-09-12T22:31:36.409466+0000","last_active":"2024-09-12T22:31:40.692865+0000","last_peered":"2024-09-12T22:31:40.692865+0000","last_clean":"2024-09-12T22:31:40.692865+0000","last_became_active":"2024-09-12T22:31:36.408796+0000","last_became_peered":"2024-09-12T22:31:36.408796+0000","last_unstale":"2024-09-12T22:31:40.692865+0000","last_undegraded":"2024-09-12T22:31:40.692865+0000","last_fullsized":"2024-09-12T22:31:40.692865+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:03:39.648159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.693567+0000","last_change":"2024-09-12T22:31:37.411183+0000","last_active":"2024-09-12T22:31:40.693567+0000","last_peered":"2024-09-12T22:31:40.693567+0000","last_clean":"2024-09-12T22:31:40.693567+0000","last_became_active":"2024-09-12T22:31:37.409796+0000","last_became_peered":"2024-09-12T22:31:37.409796+0000","last_unstale":"2024-09-12T22:31:40.693567+0000","last_undegraded":"2024-09-12T22:31:40.693567+0000","last_fullsized":"2024-09-12T22:31:40.693567+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:20:35.779810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.692792+0000","last_change":"2024-09-12T22:31:36.407402+0000","last_active":"2024-09-12T22:31:40.692792+0000","last_peered":"2024-09-12T22:31:40.692792+0000","last_clean":"2024-09-12T22:31:40.692792+0000","last_became_active":"2024-09-12T22:31:36.406681+0000","last_became_peered":"2024-09-12T22:31:36.406681+0000","last_unstale":"2024-09-12T22:31:40.692792+0000","last_undegraded":"2024-09-12T22:31:40.692792+0000","last_fullsized":"2024-09-12T22:31:40.692792+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:39:39.362573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.764875+0000","last_change":"2024-09-12T22:31:37.412817+0000","last_active":"2024-09-12T22:31:40.764875+0000","last_peered":"2024-09-12T22:31:40.764875+0000","last_clean":"2024-09-12T22:31:40.764875+0000","last_became_active":"2024-09-12T22:31:37.411999+0000","last_became_peered":"2024-09-12T22:31:37.411999+0000","last_unstale":"2024-09-12T22:31:40.764875+0000","last_undegraded":"2024-09-12T22:31:40.764875+0000","last_fullsized":"2024-09-12T22:31:40.764875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:07:02.173590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.764750+0000","last_change":"2024-09-12T22:31:36.407378+0000","last_active":"2024-09-12T22:31:40.764750+0000","last_peered":"2024-09-12T22:31:40.764750+0000","last_clean":"2024-09-12T22:31:40.764750+0000","last_became_active":"2024-09-12T22:31:36.406992+0000","last_became_peered":"2024-09-12T22:31:36.406992+0000","last_unstale":"2024-09-12T22:31:40.764750+0000","last_undegraded":"2024-09-12T22:31:40.764750+0000","last_fullsized":"2024-09-12T22:31:40.764750+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:37:16.807328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.764857+0000","last_change":"2024-09-12T22:31:37.411676+0000","last_active":"2024-09-12T22:31:40.764857+0000","last_peered":"2024-09-12T22:31:40.764857+0000","last_clean":"2024-09-12T22:31:40.764857+0000","last_became_active":"2024-09-12T22:31:37.410802+0000","last_became_peered":"2024-09-12T22:31:37.410802+0000","last_unstale":"2024-09-12T22:31:40.764857+0000","last_undegraded":"2024-09-12T22:31:40.764857+0000","last_fullsized":"2024-09-12T22:31:40.764857+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:08:21.709770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"19'1","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.764889+0000","last_change":"2024-09-12T22:31:36.412289+0000","last_active":"2024-09-12T22:31:40.764889+0000","last_peered":"2024-09-12T22:31:40.764889+0000","last_clean":"2024-09-12T22:31:40.764889+0000","last_became_active":"2024-09-12T22:31:36.411985+0000","last_became_peered":"2024-09-12T22:31:36.411985+0000","last_unstale":"2024-09-12T22:31:40.764889+0000","last_undegraded":"2024-09-12T22:31:40.764889+0000","last_fullsized":"2024-09-12T22:31:40.764889+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:30:09.410370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.695976+0000","last_change":"2024-09-12T22:31:37.415365+0000","last_active":"2024-09-12T22:31:40.695976+0000","last_peered":"2024-09-12T22:31:40.695976+0000","last_clean":"2024-09-12T22:31:40.695976+0000","last_became_active":"2024-09-12T22:31:37.413933+0000","last_became_peered":"2024-09-12T22:31:37.413933+0000","last_unstale":"2024-09-12T22:31:40.695976+0000","last_undegraded":"2024-09-12T22:31:40.695976+0000","last_fullsized":"2024-09-12T22:31:40.695976+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:08:07.115355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"19'2","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.696434+0000","last_change":"2024-09-12T22:31:36.411665+0000","last_active":"2024-09-12T22:31:40.696434+0000","last_peered":"2024-09-12T22:31:40.696434+0000","last_clean":"2024-09-12T22:31:40.696434+0000","last_became_active":"2024-09-12T22:31:36.410182+0000","last_became_peered":"2024-09-12T22:31:36.410182+0000","last_unstale":"2024-09-12T22:31:40.696434+0000","last_undegraded":"2024-09-12T22:31:40.696434+0000","last_fullsized":"2024-09-12T22:31:40.696434+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:37:20.891838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.696106+0000","last_change":"2024-09-12T22:31:37.415172+0000","last_active":"2024-09-12T22:31:40.696106+0000","last_peered":"2024-09-12T22:31:40.696106+0000","last_clean":"2024-09-12T22:31:40.696106+0000","last_became_active":"2024-09-12T22:31:37.414776+0000","last_became_peered":"2024-09-12T22:31:37.414776+0000","last_unstale":"2024-09-12T22:31:40.696106+0000","last_undegraded":"2024-09-12T22:31:40.696106+0000","last_fullsized":"2024-09-12T22:31:40.696106+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:42:32.307876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"19'2","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.765168+0000","last_change":"2024-09-12T22:31:36.410362+0000","last_active":"2024-09-12T22:31:40.765168+0000","last_peered":"2024-09-12T22:31:40.765168+0000","last_clean":"2024-09-12T22:31:40.765168+0000","last_became_active":"2024-09-12T22:31:36.410029+0000","last_became_peered":"2024-09-12T22:31:36.410029+0000","last_unstale":"2024-09-12T22:31:40.765168+0000","last_undegraded":"2024-09-12T22:31:40.765168+0000","last_fullsized":"2024-09-12T22:31:40.765168+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:23:32.476870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.764699+0000","last_change":"2024-09-12T22:31:37.409214+0000","last_active":"2024-09-12T22:31:40.764699+0000","last_peered":"2024-09-12T22:31:40.764699+0000","last_clean":"2024-09-12T22:31:40.764699+0000","last_became_active":"2024-09-12T22:31:37.408849+0000","last_became_peered":"2024-09-12T22:31:37.408849+0000","last_unstale":"2024-09-12T22:31:40.764699+0000","last_undegraded":"2024-09-12T22:31:40.764699+0000","last_fullsized":"2024-09-12T22:31:40.764699+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:39:20.383152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"19'1","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.693694+0000","last_change":"2024-09-12T22:31:36.410371+0000","last_active":"2024-09-12T22:31:40.693694+0000","last_peered":"2024-09-12T22:31:40.693694+0000","last_clean":"2024-09-12T22:31:40.693694+0000","last_became_active":"2024-09-12T22:31:36.409428+0000","last_became_peered":"2024-09-12T22:31:36.409428+0000","last_unstale":"2024-09-12T22:31:40.693694+0000","last_undegraded":"2024-09-12T22:31:40.693694+0000","last_fullsized":"2024-09-12T22:31:40.693694+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:27:22.817690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.695839+0000","last_change":"2024-09-12T22:31:37.415390+0000","last_active":"2024-09-12T22:31:40.695839+0000","last_peered":"2024-09-12T22:31:40.695839+0000","last_clean":"2024-09-12T22:31:40.695839+0000","last_became_active":"2024-09-12T22:31:37.414781+0000","last_became_peered":"2024-09-12T22:31:37.414781+0000","last_unstale":"2024-09-12T22:31:40.695839+0000","last_undegraded":"2024-09-12T22:31:40.695839+0000","last_fullsized":"2024-09-12T22:31:40.695839+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:42:17.728844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"19'4","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.693681+0000","last_change":"2024-09-12T22:31:36.407945+0000","last_active":"2024-09-12T22:31:40.693681+0000","last_peered":"2024-09-12T22:31:40.693681+0000","last_clean":"2024-09-12T22:31:40.693681+0000","last_became_active":"2024-09-12T22:31:36.406959+0000","last_became_peered":"2024-09-12T22:31:36.406959+0000","last_unstale":"2024-09-12T22:31:40.693681+0000","last_undegraded":"2024-09-12T22:31:40.693681+0000","last_fullsized":"2024-09-12T22:31:40.693681+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:26:33.155850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705673,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31984,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339856,"statfs":{"total":96636764160,"available":96604012544,"internally_reserved":0,"allocated":811008,"data_stored":658415,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705673,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31972,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339868,"statfs":{"total":96636764160,"available":96604024832,"internally_reserved":0,"allocated":798720,"data_stored":657780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738377,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":192512,"data_stored":66253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T22:31:54.406 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T22:31:54.736 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:31:54.738 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-12T22:31:54.747 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":34,"stamp":"2024-09-12T22:31:54.191901+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592797,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":250,"num_write_kb":3476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":91172,"kb_used_data":1760,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283024348,"statfs":{"total":289910292480,"available":289816932352,"internally_reserved":0,"allocated":1802240,"data_stored":1382448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":91483471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002975"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.765207+0000","last_change":"2024-09-12T22:31:37.416383+0000","last_active":"2024-09-12T22:31:40.765207+0000","last_peered":"2024-09-12T22:31:40.765207+0000","last_clean":"2024-09-12T22:31:40.765207+0000","last_became_active":"2024-09-12T22:31:37.415457+0000","last_became_peered":"2024-09-12T22:31:37.415457+0000","last_unstale":"2024-09-12T22:31:40.765207+0000","last_undegraded":"2024-09-12T22:31:40.765207+0000","last_fullsized":"2024-09-12T22:31:40.765207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:08:29.199832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.764838+0000","last_change":"2024-09-12T22:31:37.415228+0000","last_active":"2024-09-12T22:31:40.764838+0000","last_peered":"2024-09-12T22:31:40.764838+0000","last_clean":"2024-09-12T22:31:40.764838+0000","last_became_active":"2024-09-12T22:31:37.414765+0000","last_became_peered":"2024-09-12T22:31:37.414765+0000","last_unstale":"2024-09-12T22:31:40.764838+0000","last_undegraded":"2024-09-12T22:31:40.764838+0000","last_fullsized":"2024-09-12T22:31:40.764838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:50:48.426898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.696458+0000","last_change":"2024-09-12T22:31:37.419916+0000","last_active":"2024-09-12T22:31:40.696458+0000","last_peered":"2024-09-12T22:31:40.696458+0000","last_clean":"2024-09-12T22:31:40.696458+0000","last_became_active":"2024-09-12T22:31:37.418790+0000","last_became_peered":"2024-09-12T22:31:37.418790+0000","last_unstale":"2024-09-12T22:31:40.696458+0000","last_undegraded":"2024-09-12T22:31:40.696458+0000","last_fullsized":"2024-09-12T22:31:40.696458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:05:00.440878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.696238+0000","last_change":"2024-09-12T22:31:37.413094+0000","last_active":"2024-09-12T22:31:40.696238+0000","last_peered":"2024-09-12T22:31:40.696238+0000","last_clean":"2024-09-12T22:31:40.696238+0000","last_became_active":"2024-09-12T22:31:37.412746+0000","last_became_peered":"2024-09-12T22:31:37.412746+0000","last_unstale":"2024-09-12T22:31:40.696238+0000","last_undegraded":"2024-09-12T22:31:40.696238+0000","last_fullsized":"2024-09-12T22:31:40.696238+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:32:14.415120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.764831+0000","last_change":"2024-09-12T22:31:37.411276+0000","last_active":"2024-09-12T22:31:40.764831+0000","last_peered":"2024-09-12T22:31:40.764831+0000","last_clean":"2024-09-12T22:31:40.764831+0000","last_became_active":"2024-09-12T22:31:37.410380+0000","last_became_peered":"2024-09-12T22:31:37.410380+0000","last_unstale":"2024-09-12T22:31:40.764831+0000","last_undegraded":"2024-09-12T22:31:40.764831+0000","last_fullsized":"2024-09-12T22:31:40.764831+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:12:50.090880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.695814+0000","last_change":"2024-09-12T22:31:37.409177+0000","last_active":"2024-09-12T22:31:40.695814+0000","last_peered":"2024-09-12T22:31:40.695814+0000","last_clean":"2024-09-12T22:31:40.695814+0000","last_became_active":"2024-09-12T22:31:37.408811+0000","last_became_peered":"2024-09-12T22:31:37.408811+0000","last_unstale":"2024-09-12T22:31:40.695814+0000","last_undegraded":"2024-09-12T22:31:40.695814+0000","last_fullsized":"2024-09-12T22:31:40.695814+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:17:21.695079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.695805+0000","last_change":"2024-09-12T22:31:37.413023+0000","last_active":"2024-09-12T22:31:40.695805+0000","last_peered":"2024-09-12T22:31:40.695805+0000","last_clean":"2024-09-12T22:31:40.695805+0000","last_became_active":"2024-09-12T22:31:37.412691+0000","last_became_peered":"2024-09-12T22:31:37.412691+0000","last_unstale":"2024-09-12T22:31:40.695805+0000","last_undegraded":"2024-09-12T22:31:40.695805+0000","last_fullsized":"2024-09-12T22:31:40.695805+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:02:36.454134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.695562+0000","last_change":"2024-09-12T22:31:37.411074+0000","last_active":"2024-09-12T22:31:40.695562+0000","last_peered":"2024-09-12T22:31:40.695562+0000","last_clean":"2024-09-12T22:31:40.695562+0000","last_became_active":"2024-09-12T22:31:37.410633+0000","last_became_peered":"2024-09-12T22:31:37.410633+0000","last_unstale":"2024-09-12T22:31:40.695562+0000","last_undegraded":"2024-09-12T22:31:40.695562+0000","last_fullsized":"2024-09-12T22:31:40.695562+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:39:20.383152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.693279+0000","last_change":"2024-09-12T22:31:37.417800+0000","last_active":"2024-09-12T22:31:40.693279+0000","last_peered":"2024-09-12T22:31:40.693279+0000","last_clean":"2024-09-12T22:31:40.693279+0000","last_became_active":"2024-09-12T22:31:37.417355+0000","last_became_peered":"2024-09-12T22:31:37.417355+0000","last_unstale":"2024-09-12T22:31:40.693279+0000","last_undegraded":"2024-09-12T22:31:40.693279+0000","last_fullsized":"2024-09-12T22:31:40.693279+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:10:17.326263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.765115+0000","last_change":"2024-09-12T22:31:37.415967+0000","last_active":"2024-09-12T22:31:40.765115+0000","last_peered":"2024-09-12T22:31:40.765115+0000","last_clean":"2024-09-12T22:31:40.765115+0000","last_became_active":"2024-09-12T22:31:37.415003+0000","last_became_peered":"2024-09-12T22:31:37.415003+0000","last_unstale":"2024-09-12T22:31:40.765115+0000","last_undegraded":"2024-09-12T22:31:40.765115+0000","last_fullsized":"2024-09-12T22:31:40.765115+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:42:32.307876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.696536+0000","last_change":"2024-09-12T22:31:37.414469+0000","last_active":"2024-09-12T22:31:40.696536+0000","last_peered":"2024-09-12T22:31:40.696536+0000","last_clean":"2024-09-12T22:31:40.696536+0000","last_became_active":"2024-09-12T22:31:37.414165+0000","last_became_peered":"2024-09-12T22:31:37.414165+0000","last_unstale":"2024-09-12T22:31:40.696536+0000","last_undegraded":"2024-09-12T22:31:40.696536+0000","last_fullsized":"2024-09-12T22:31:40.696536+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:25:38.148636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.764751+0000","last_change":"2024-09-12T22:31:37.413051+0000","last_active":"2024-09-12T22:31:40.764751+0000","last_peered":"2024-09-12T22:31:40.764751+0000","last_clean":"2024-09-12T22:31:40.764751+0000","last_became_active":"2024-09-12T22:31:37.412614+0000","last_became_peered":"2024-09-12T22:31:37.412614+0000","last_unstale":"2024-09-12T22:31:40.764751+0000","last_undegraded":"2024-09-12T22:31:40.764751+0000","last_fullsized":"2024-09-12T22:31:40.764751+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:07:48.430262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.764626+0000","last_change":"2024-09-12T22:31:37.413063+0000","last_active":"2024-09-12T22:31:40.764626+0000","last_peered":"2024-09-12T22:31:40.764626+0000","last_clean":"2024-09-12T22:31:40.764626+0000","last_became_active":"2024-09-12T22:31:37.412118+0000","last_became_peered":"2024-09-12T22:31:37.412118+0000","last_unstale":"2024-09-12T22:31:40.764626+0000","last_undegraded":"2024-09-12T22:31:40.764626+0000","last_fullsized":"2024-09-12T22:31:40.764626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:14:17.750388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.695833+0000","last_change":"2024-09-12T22:31:37.414084+0000","last_active":"2024-09-12T22:31:40.695833+0000","last_peered":"2024-09-12T22:31:40.695833+0000","last_clean":"2024-09-12T22:31:40.695833+0000","last_became_active":"2024-09-12T22:31:37.413671+0000","last_became_peered":"2024-09-12T22:31:37.413671+0000","last_unstale":"2024-09-12T22:31:40.695833+0000","last_undegraded":"2024-09-12T22:31:40.695833+0000","last_fullsized":"2024-09-12T22:31:40.695833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:08:29.199832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.695836+0000","last_change":"2024-09-12T22:31:37.413482+0000","last_active":"2024-09-12T22:31:40.695836+0000","last_peered":"2024-09-12T22:31:40.695836+0000","last_clean":"2024-09-12T22:31:40.695836+0000","last_became_active":"2024-09-12T22:31:37.413195+0000","last_became_peered":"2024-09-12T22:31:37.413195+0000","last_unstale":"2024-09-12T22:31:40.695836+0000","last_undegraded":"2024-09-12T22:31:40.695836+0000","last_fullsized":"2024-09-12T22:31:40.695836+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:22:40.226076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.695670+0000","last_change":"2024-09-12T22:31:37.411006+0000","last_active":"2024-09-12T22:31:40.695670+0000","last_peered":"2024-09-12T22:31:40.695670+0000","last_clean":"2024-09-12T22:31:40.695670+0000","last_became_active":"2024-09-12T22:31:37.410557+0000","last_became_peered":"2024-09-12T22:31:37.410557+0000","last_unstale":"2024-09-12T22:31:40.695670+0000","last_undegraded":"2024-09-12T22:31:40.695670+0000","last_fullsized":"2024-09-12T22:31:40.695670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:08:21.709770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.693827+0000","last_change":"2024-09-12T22:31:37.412450+0000","last_active":"2024-09-12T22:31:40.693827+0000","last_peered":"2024-09-12T22:31:40.693827+0000","last_clean":"2024-09-12T22:31:40.693827+0000","last_became_active":"2024-09-12T22:31:37.412234+0000","last_became_peered":"2024-09-12T22:31:37.412234+0000","last_unstale":"2024-09-12T22:31:40.693827+0000","last_undegraded":"2024-09-12T22:31:40.693827+0000","last_fullsized":"2024-09-12T22:31:40.693827+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:15:59.559809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.765237+0000","last_change":"2024-09-12T22:31:37.414144+0000","last_active":"2024-09-12T22:31:40.765237+0000","last_peered":"2024-09-12T22:31:40.765237+0000","last_clean":"2024-09-12T22:31:40.765237+0000","last_became_active":"2024-09-12T22:31:37.413670+0000","last_became_peered":"2024-09-12T22:31:37.413670+0000","last_unstale":"2024-09-12T22:31:40.765237+0000","last_undegraded":"2024-09-12T22:31:40.765237+0000","last_fullsized":"2024-09-12T22:31:40.765237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:42:51.694128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.693356+0000","last_change":"2024-09-12T22:31:37.417442+0000","last_active":"2024-09-12T22:31:40.693356+0000","last_peered":"2024-09-12T22:31:40.693356+0000","last_clean":"2024-09-12T22:31:40.693356+0000","last_became_active":"2024-09-12T22:31:37.417133+0000","last_became_peered":"2024-09-12T22:31:37.417133+0000","last_unstale":"2024-09-12T22:31:40.693356+0000","last_undegraded":"2024-09-12T22:31:40.693356+0000","last_fullsized":"2024-09-12T22:31:40.693356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:36.458145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.696321+0000","last_change":"2024-09-12T22:31:37.414235+0000","last_active":"2024-09-12T22:31:40.696321+0000","last_peered":"2024-09-12T22:31:40.696321+0000","last_clean":"2024-09-12T22:31:40.696321+0000","last_became_active":"2024-09-12T22:31:37.413786+0000","last_became_peered":"2024-09-12T22:31:37.413786+0000","last_unstale":"2024-09-12T22:31:40.696321+0000","last_undegraded":"2024-09-12T22:31:40.696321+0000","last_fullsized":"2024-09-12T22:31:40.696321+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:21:11.866973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.696190+0000","last_change":"2024-09-12T22:31:37.415382+0000","last_active":"2024-09-12T22:31:40.696190+0000","last_peered":"2024-09-12T22:31:40.696190+0000","last_clean":"2024-09-12T22:31:40.696190+0000","last_became_active":"2024-09-12T22:31:37.414319+0000","last_became_peered":"2024-09-12T22:31:37.414319+0000","last_unstale":"2024-09-12T22:31:40.696190+0000","last_undegraded":"2024-09-12T22:31:40.696190+0000","last_fullsized":"2024-09-12T22:31:40.696190+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:26:25.578693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.764450+0000","last_change":"2024-09-12T22:31:37.412046+0000","last_active":"2024-09-12T22:31:40.764450+0000","last_peered":"2024-09-12T22:31:40.764450+0000","last_clean":"2024-09-12T22:31:40.764450+0000","last_became_active":"2024-09-12T22:31:37.411623+0000","last_became_peered":"2024-09-12T22:31:37.411623+0000","last_unstale":"2024-09-12T22:31:40.764450+0000","last_undegraded":"2024-09-12T22:31:40.764450+0000","last_fullsized":"2024-09-12T22:31:40.764450+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:24:15.504358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.692558+0000","last_change":"2024-09-12T22:31:37.410364+0000","last_active":"2024-09-12T22:31:40.692558+0000","last_peered":"2024-09-12T22:31:40.692558+0000","last_clean":"2024-09-12T22:31:40.692558+0000","last_became_active":"2024-09-12T22:31:37.409951+0000","last_became_peered":"2024-09-12T22:31:37.409951+0000","last_unstale":"2024-09-12T22:31:40.692558+0000","last_undegraded":"2024-09-12T22:31:40.692558+0000","last_fullsized":"2024-09-12T22:31:40.692558+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:39:17.785755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.764159+0000","last_change":"2024-09-12T22:31:37.415240+0000","last_active":"2024-09-12T22:31:40.764159+0000","last_peered":"2024-09-12T22:31:40.764159+0000","last_clean":"2024-09-12T22:31:40.764159+0000","last_became_active":"2024-09-12T22:31:37.414069+0000","last_became_peered":"2024-09-12T22:31:37.414069+0000","last_unstale":"2024-09-12T22:31:40.764159+0000","last_undegraded":"2024-09-12T22:31:40.764159+0000","last_fullsized":"2024-09-12T22:31:40.764159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:16:35.027772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.765207+0000","last_change":"2024-09-12T22:31:37.415309+0000","last_active":"2024-09-12T22:31:40.765207+0000","last_peered":"2024-09-12T22:31:40.765207+0000","last_clean":"2024-09-12T22:31:40.765207+0000","last_became_active":"2024-09-12T22:31:37.414792+0000","last_became_peered":"2024-09-12T22:31:37.414792+0000","last_unstale":"2024-09-12T22:31:40.765207+0000","last_undegraded":"2024-09-12T22:31:40.765207+0000","last_fullsized":"2024-09-12T22:31:40.765207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:08:07.115355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.693507+0000","last_change":"2024-09-12T22:31:37.411880+0000","last_active":"2024-09-12T22:31:40.693507+0000","last_peered":"2024-09-12T22:31:40.693507+0000","last_clean":"2024-09-12T22:31:40.693507+0000","last_became_active":"2024-09-12T22:31:37.410563+0000","last_became_peered":"2024-09-12T22:31:37.410563+0000","last_unstale":"2024-09-12T22:31:40.693507+0000","last_undegraded":"2024-09-12T22:31:40.693507+0000","last_fullsized":"2024-09-12T22:31:40.693507+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:47:52.560533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.696794+0000","last_change":"2024-09-12T22:31:37.419603+0000","last_active":"2024-09-12T22:31:40.696794+0000","last_peered":"2024-09-12T22:31:40.696794+0000","last_clean":"2024-09-12T22:31:40.696794+0000","last_became_active":"2024-09-12T22:31:37.418725+0000","last_became_peered":"2024-09-12T22:31:37.418725+0000","last_unstale":"2024-09-12T22:31:40.696794+0000","last_undegraded":"2024-09-12T22:31:40.696794+0000","last_fullsized":"2024-09-12T22:31:40.696794+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:02:44.183545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.765102+0000","last_change":"2024-09-12T22:31:37.412884+0000","last_active":"2024-09-12T22:31:40.765102+0000","last_peered":"2024-09-12T22:31:40.765102+0000","last_clean":"2024-09-12T22:31:40.765102+0000","last_became_active":"2024-09-12T22:31:37.412469+0000","last_became_peered":"2024-09-12T22:31:37.412469+0000","last_unstale":"2024-09-12T22:31:40.765102+0000","last_undegraded":"2024-09-12T22:31:40.765102+0000","last_fullsized":"2024-09-12T22:31:40.765102+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:05:00.440878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.693088+0000","last_change":"2024-09-12T22:31:37.414918+0000","last_active":"2024-09-12T22:31:40.693088+0000","last_peered":"2024-09-12T22:31:40.693088+0000","last_clean":"2024-09-12T22:31:40.693088+0000","last_became_active":"2024-09-12T22:31:37.414225+0000","last_became_peered":"2024-09-12T22:31:37.414225+0000","last_unstale":"2024-09-12T22:31:40.693088+0000","last_undegraded":"2024-09-12T22:31:40.693088+0000","last_fullsized":"2024-09-12T22:31:40.693088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:56:14.649228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.764655+0000","last_change":"2024-09-12T22:31:37.411569+0000","last_active":"2024-09-12T22:31:40.764655+0000","last_peered":"2024-09-12T22:31:40.764655+0000","last_clean":"2024-09-12T22:31:40.764655+0000","last_became_active":"2024-09-12T22:31:37.410619+0000","last_became_peered":"2024-09-12T22:31:37.410619+0000","last_unstale":"2024-09-12T22:31:40.764655+0000","last_undegraded":"2024-09-12T22:31:40.764655+0000","last_fullsized":"2024-09-12T22:31:40.764655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:30:01.012271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.692595+0000","last_change":"2024-09-12T22:31:37.415589+0000","last_active":"2024-09-12T22:31:40.692595+0000","last_peered":"2024-09-12T22:31:40.692595+0000","last_clean":"2024-09-12T22:31:40.692595+0000","last_became_active":"2024-09-12T22:31:37.415285+0000","last_became_peered":"2024-09-12T22:31:37.415285+0000","last_unstale":"2024-09-12T22:31:40.692595+0000","last_undegraded":"2024-09-12T22:31:40.692595+0000","last_fullsized":"2024-09-12T22:31:40.692595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:06:25.913810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.695680+0000","last_change":"2024-09-12T22:31:37.415190+0000","last_active":"2024-09-12T22:31:40.695680+0000","last_peered":"2024-09-12T22:31:40.695680+0000","last_clean":"2024-09-12T22:31:40.695680+0000","last_became_active":"2024-09-12T22:31:37.414265+0000","last_became_peered":"2024-09-12T22:31:37.414265+0000","last_unstale":"2024-09-12T22:31:40.695680+0000","last_undegraded":"2024-09-12T22:31:40.695680+0000","last_fullsized":"2024-09-12T22:31:40.695680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:07:02.173590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.765000+0000","last_change":"2024-09-12T22:31:37.409362+0000","last_active":"2024-09-12T22:31:40.765000+0000","last_peered":"2024-09-12T22:31:40.765000+0000","last_clean":"2024-09-12T22:31:40.765000+0000","last_became_active":"2024-09-12T22:31:37.408896+0000","last_became_peered":"2024-09-12T22:31:37.408896+0000","last_unstale":"2024-09-12T22:31:40.765000+0000","last_undegraded":"2024-09-12T22:31:40.765000+0000","last_fullsized":"2024-09-12T22:31:40.765000+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:17:21.695079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"19'2","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.696151+0000","last_change":"2024-09-12T22:31:36.412082+0000","last_active":"2024-09-12T22:31:40.696151+0000","last_peered":"2024-09-12T22:31:40.696151+0000","last_clean":"2024-09-12T22:31:40.696151+0000","last_became_active":"2024-09-12T22:31:36.410871+0000","last_became_peered":"2024-09-12T22:31:36.410871+0000","last_unstale":"2024-09-12T22:31:40.696151+0000","last_undegraded":"2024-09-12T22:31:40.696151+0000","last_fullsized":"2024-09-12T22:31:40.696151+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:30:49.127253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.765123+0000","last_change":"2024-09-12T22:31:37.411790+0000","last_active":"2024-09-12T22:31:40.765123+0000","last_peered":"2024-09-12T22:31:40.765123+0000","last_clean":"2024-09-12T22:31:40.765123+0000","last_became_active":"2024-09-12T22:31:37.411414+0000","last_became_peered":"2024-09-12T22:31:37.411414+0000","last_unstale":"2024-09-12T22:31:40.765123+0000","last_undegraded":"2024-09-12T22:31:40.765123+0000","last_fullsized":"2024-09-12T22:31:40.765123+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:22:40.226076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.692921+0000","last_change":"2024-09-12T22:31:36.408563+0000","last_active":"2024-09-12T22:31:40.692921+0000","last_peered":"2024-09-12T22:31:40.692921+0000","last_clean":"2024-09-12T22:31:40.692921+0000","last_became_active":"2024-09-12T22:31:36.407447+0000","last_became_peered":"2024-09-12T22:31:36.407447+0000","last_unstale":"2024-09-12T22:31:40.692921+0000","last_undegraded":"2024-09-12T22:31:40.692921+0000","last_fullsized":"2024-09-12T22:31:40.692921+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:29:37.933109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.693701+0000","last_change":"2024-09-12T22:31:37.411680+0000","last_active":"2024-09-12T22:31:40.693701+0000","last_peered":"2024-09-12T22:31:40.693701+0000","last_clean":"2024-09-12T22:31:40.693701+0000","last_became_active":"2024-09-12T22:31:37.411168+0000","last_became_peered":"2024-09-12T22:31:37.411168+0000","last_unstale":"2024-09-12T22:31:40.693701+0000","last_undegraded":"2024-09-12T22:31:40.693701+0000","last_fullsized":"2024-09-12T22:31:40.693701+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:27.706282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.764438+0000","last_change":"2024-09-12T22:31:36.411271+0000","last_active":"2024-09-12T22:31:40.764438+0000","last_peered":"2024-09-12T22:31:40.764438+0000","last_clean":"2024-09-12T22:31:40.764438+0000","last_became_active":"2024-09-12T22:31:36.410706+0000","last_became_peered":"2024-09-12T22:31:36.410706+0000","last_unstale":"2024-09-12T22:31:40.764438+0000","last_undegraded":"2024-09-12T22:31:40.764438+0000","last_fullsized":"2024-09-12T22:31:40.764438+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:43:22.805855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.693409+0000","last_change":"2024-09-12T22:31:37.411218+0000","last_active":"2024-09-12T22:31:40.693409+0000","last_peered":"2024-09-12T22:31:40.693409+0000","last_clean":"2024-09-12T22:31:40.693409+0000","last_became_active":"2024-09-12T22:31:37.409666+0000","last_became_peered":"2024-09-12T22:31:37.409666+0000","last_unstale":"2024-09-12T22:31:40.693409+0000","last_undegraded":"2024-09-12T22:31:40.693409+0000","last_fullsized":"2024-09-12T22:31:40.693409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:45:34.230090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"19'8","reported_seq":24,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.695805+0000","last_change":"2024-09-12T22:31:36.411811+0000","last_active":"2024-09-12T22:31:40.695805+0000","last_peered":"2024-09-12T22:31:40.695805+0000","last_clean":"2024-09-12T22:31:40.695805+0000","last_became_active":"2024-09-12T22:31:36.410101+0000","last_became_peered":"2024-09-12T22:31:36.410101+0000","last_unstale":"2024-09-12T22:31:40.695805+0000","last_undegraded":"2024-09-12T22:31:40.695805+0000","last_fullsized":"2024-09-12T22:31:40.695805+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:33:02.410148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"19'1","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.696872+0000","last_change":"2024-09-12T22:31:36.410970+0000","last_active":"2024-09-12T22:31:40.696872+0000","last_peered":"2024-09-12T22:31:40.696872+0000","last_clean":"2024-09-12T22:31:40.696872+0000","last_became_active":"2024-09-12T22:31:36.409754+0000","last_became_peered":"2024-09-12T22:31:36.409754+0000","last_unstale":"2024-09-12T22:31:40.696872+0000","last_undegraded":"2024-09-12T22:31:40.696872+0000","last_fullsized":"2024-09-12T22:31:40.696872+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:30:07.724418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.764193+0000","last_change":"2024-09-12T22:31:37.415050+0000","last_active":"2024-09-12T22:31:40.764193+0000","last_peered":"2024-09-12T22:31:40.764193+0000","last_clean":"2024-09-12T22:31:40.764193+0000","last_became_active":"2024-09-12T22:31:37.414290+0000","last_became_peered":"2024-09-12T22:31:37.414290+0000","last_unstale":"2024-09-12T22:31:40.764193+0000","last_undegraded":"2024-09-12T22:31:40.764193+0000","last_fullsized":"2024-09-12T22:31:40.764193+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:47:15.502575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"19'2","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.765286+0000","last_change":"2024-09-12T22:31:36.411725+0000","last_active":"2024-09-12T22:31:40.765286+0000","last_peered":"2024-09-12T22:31:40.765286+0000","last_clean":"2024-09-12T22:31:40.765286+0000","last_became_active":"2024-09-12T22:31:36.411407+0000","last_became_peered":"2024-09-12T22:31:36.411407+0000","last_unstale":"2024-09-12T22:31:40.765286+0000","last_undegraded":"2024-09-12T22:31:40.765286+0000","last_fullsized":"2024-09-12T22:31:40.765286+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:30:07.724418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.764522+0000","last_change":"2024-09-12T22:31:37.413857+0000","last_active":"2024-09-12T22:31:40.764522+0000","last_peered":"2024-09-12T22:31:40.764522+0000","last_clean":"2024-09-12T22:31:40.764522+0000","last_became_active":"2024-09-12T22:31:37.412941+0000","last_became_peered":"2024-09-12T22:31:37.412941+0000","last_unstale":"2024-09-12T22:31:40.764522+0000","last_undegraded":"2024-09-12T22:31:40.764522+0000","last_fullsized":"2024-09-12T22:31:40.764522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:58:45.134258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"19'1","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.696863+0000","last_change":"2024-09-12T22:31:36.411320+0000","last_active":"2024-09-12T22:31:40.696863+0000","last_peered":"2024-09-12T22:31:40.696863+0000","last_clean":"2024-09-12T22:31:40.696863+0000","last_became_active":"2024-09-12T22:31:36.409837+0000","last_became_peered":"2024-09-12T22:31:36.409837+0000","last_unstale":"2024-09-12T22:31:40.696863+0000","last_undegraded":"2024-09-12T22:31:40.696863+0000","last_fullsized":"2024-09-12T22:31:40.696863+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:36:53.914922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.695949+0000","last_change":"2024-09-12T22:31:37.414809+0000","last_active":"2024-09-12T22:31:40.695949+0000","last_peered":"2024-09-12T22:31:40.695949+0000","last_clean":"2024-09-12T22:31:40.695949+0000","last_became_active":"2024-09-12T22:31:37.414492+0000","last_became_peered":"2024-09-12T22:31:37.414492+0000","last_unstale":"2024-09-12T22:31:40.695949+0000","last_undegraded":"2024-09-12T22:31:40.695949+0000","last_fullsized":"2024-09-12T22:31:40.695949+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:50:48.426898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.696715+0000","last_change":"2024-09-12T22:31:36.412068+0000","last_active":"2024-09-12T22:31:40.696715+0000","last_peered":"2024-09-12T22:31:40.696715+0000","last_clean":"2024-09-12T22:31:40.696715+0000","last_became_active":"2024-09-12T22:31:36.411366+0000","last_became_peered":"2024-09-12T22:31:36.411366+0000","last_unstale":"2024-09-12T22:31:40.696715+0000","last_undegraded":"2024-09-12T22:31:40.696715+0000","last_fullsized":"2024-09-12T22:31:40.696715+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:35:51.647051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.693166+0000","last_change":"2024-09-12T22:31:37.410303+0000","last_active":"2024-09-12T22:31:40.693166+0000","last_peered":"2024-09-12T22:31:40.693166+0000","last_clean":"2024-09-12T22:31:40.693166+0000","last_became_active":"2024-09-12T22:31:37.409607+0000","last_became_peered":"2024-09-12T22:31:37.409607+0000","last_unstale":"2024-09-12T22:31:40.693166+0000","last_undegraded":"2024-09-12T22:31:40.693166+0000","last_fullsized":"2024-09-12T22:31:40.693166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:53:42.732654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"19'2","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.693353+0000","last_change":"2024-09-12T22:31:36.407974+0000","last_active":"2024-09-12T22:31:40.693353+0000","last_peered":"2024-09-12T22:31:40.693353+0000","last_clean":"2024-09-12T22:31:40.693353+0000","last_became_active":"2024-09-12T22:31:36.406955+0000","last_became_peered":"2024-09-12T22:31:36.406955+0000","last_unstale":"2024-09-12T22:31:40.693353+0000","last_undegraded":"2024-09-12T22:31:40.693353+0000","last_fullsized":"2024-09-12T22:31:40.693353+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:07:34.831264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.696465+0000","last_change":"2024-09-12T22:31:37.415285+0000","last_active":"2024-09-12T22:31:40.696465+0000","last_peered":"2024-09-12T22:31:40.696465+0000","last_clean":"2024-09-12T22:31:40.696465+0000","last_became_active":"2024-09-12T22:31:37.414890+0000","last_became_peered":"2024-09-12T22:31:37.414890+0000","last_unstale":"2024-09-12T22:31:40.696465+0000","last_undegraded":"2024-09-12T22:31:40.696465+0000","last_fullsized":"2024-09-12T22:31:40.696465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:38:16.956786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.696019+0000","last_change":"2024-09-12T22:31:36.412147+0000","last_active":"2024-09-12T22:31:40.696019+0000","last_peered":"2024-09-12T22:31:40.696019+0000","last_clean":"2024-09-12T22:31:40.696019+0000","last_became_active":"2024-09-12T22:31:36.411382+0000","last_became_peered":"2024-09-12T22:31:36.411382+0000","last_unstale":"2024-09-12T22:31:40.696019+0000","last_undegraded":"2024-09-12T22:31:40.696019+0000","last_fullsized":"2024-09-12T22:31:40.696019+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:54:51.454867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.696770+0000","last_change":"2024-09-12T22:31:37.420209+0000","last_active":"2024-09-12T22:31:40.696770+0000","last_peered":"2024-09-12T22:31:40.696770+0000","last_clean":"2024-09-12T22:31:40.696770+0000","last_became_active":"2024-09-12T22:31:37.419267+0000","last_became_peered":"2024-09-12T22:31:37.419267+0000","last_unstale":"2024-09-12T22:31:40.696770+0000","last_undegraded":"2024-09-12T22:31:40.696770+0000","last_fullsized":"2024-09-12T22:31:40.696770+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:36.790111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.764556+0000","last_change":"2024-09-12T22:31:36.411190+0000","last_active":"2024-09-12T22:31:40.764556+0000","last_peered":"2024-09-12T22:31:40.764556+0000","last_clean":"2024-09-12T22:31:40.764556+0000","last_became_active":"2024-09-12T22:31:36.410548+0000","last_became_peered":"2024-09-12T22:31:36.410548+0000","last_unstale":"2024-09-12T22:31:40.764556+0000","last_undegraded":"2024-09-12T22:31:40.764556+0000","last_fullsized":"2024-09-12T22:31:40.764556+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:10:20.300894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.696807+0000","last_change":"2024-09-12T22:31:37.418749+0000","last_active":"2024-09-12T22:31:40.696807+0000","last_peered":"2024-09-12T22:31:40.696807+0000","last_clean":"2024-09-12T22:31:40.696807+0000","last_became_active":"2024-09-12T22:31:37.418360+0000","last_became_peered":"2024-09-12T22:31:37.418360+0000","last_unstale":"2024-09-12T22:31:40.696807+0000","last_undegraded":"2024-09-12T22:31:40.696807+0000","last_fullsized":"2024-09-12T22:31:40.696807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:50:08.152699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.764246+0000","last_change":"2024-09-12T22:31:36.412187+0000","last_active":"2024-09-12T22:31:40.764246+0000","last_peered":"2024-09-12T22:31:40.764246+0000","last_clean":"2024-09-12T22:31:40.764246+0000","last_became_active":"2024-09-12T22:31:36.411935+0000","last_became_peered":"2024-09-12T22:31:36.411935+0000","last_unstale":"2024-09-12T22:31:40.764246+0000","last_undegraded":"2024-09-12T22:31:40.764246+0000","last_fullsized":"2024-09-12T22:31:40.764246+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:41:04.029445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.693559+0000","last_change":"2024-09-12T22:31:37.417881+0000","last_active":"2024-09-12T22:31:40.693559+0000","last_peered":"2024-09-12T22:31:40.693559+0000","last_clean":"2024-09-12T22:31:40.693559+0000","last_became_active":"2024-09-12T22:31:37.417572+0000","last_became_peered":"2024-09-12T22:31:37.417572+0000","last_unstale":"2024-09-12T22:31:40.693559+0000","last_undegraded":"2024-09-12T22:31:40.693559+0000","last_fullsized":"2024-09-12T22:31:40.693559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:19:16.367589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":226,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.695987+0000","last_change":"2024-09-12T22:31:27.631847+0000","last_active":"2024-09-12T22:31:40.695987+0000","last_peered":"2024-09-12T22:31:40.695987+0000","last_clean":"2024-09-12T22:31:40.695987+0000","last_became_active":"2024-09-12T22:31:27.631027+0000","last_became_peered":"2024-09-12T22:31:27.631027+0000","last_unstale":"2024-09-12T22:31:40.695987+0000","last_undegraded":"2024-09-12T22:31:40.695987+0000","last_fullsized":"2024-09-12T22:31:40.695987+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:26.229539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:26.229539+0000","last_clean_scrub_stamp":"2024-09-12T22:31:26.229539+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:59:24.181319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":30,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.696417+0000","last_change":"2024-09-12T22:31:34.286952+0000","last_active":"2024-09-12T22:31:40.696417+0000","last_peered":"2024-09-12T22:31:40.696417+0000","last_clean":"2024-09-12T22:31:40.696417+0000","last_became_active":"2024-09-12T22:31:32.283661+0000","last_became_peered":"2024-09-12T22:31:32.283661+0000","last_unstale":"2024-09-12T22:31:40.696417+0000","last_undegraded":"2024-09-12T22:31:40.696417+0000","last_fullsized":"2024-09-12T22:31:40.696417+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:21.681390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000621274,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.693061+0000","last_change":"2024-09-12T22:31:36.411275+0000","last_active":"2024-09-12T22:31:40.693061+0000","last_peered":"2024-09-12T22:31:40.693061+0000","last_clean":"2024-09-12T22:31:40.693061+0000","last_became_active":"2024-09-12T22:31:36.410595+0000","last_became_peered":"2024-09-12T22:31:36.410595+0000","last_unstale":"2024-09-12T22:31:40.693061+0000","last_undegraded":"2024-09-12T22:31:40.693061+0000","last_fullsized":"2024-09-12T22:31:40.693061+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:38:14.895625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.696887+0000","last_change":"2024-09-12T22:31:37.419976+0000","last_active":"2024-09-12T22:31:40.696887+0000","last_peered":"2024-09-12T22:31:40.696887+0000","last_clean":"2024-09-12T22:31:40.696887+0000","last_became_active":"2024-09-12T22:31:37.419161+0000","last_became_peered":"2024-09-12T22:31:37.419161+0000","last_unstale":"2024-09-12T22:31:40.696887+0000","last_undegraded":"2024-09-12T22:31:40.696887+0000","last_fullsized":"2024-09-12T22:31:40.696887+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:07:26.070097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":29,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.695956+0000","last_change":"2024-09-12T22:31:34.286642+0000","last_active":"2024-09-12T22:31:40.695956+0000","last_peered":"2024-09-12T22:31:40.695956+0000","last_clean":"2024-09-12T22:31:40.695956+0000","last_became_active":"2024-09-12T22:31:32.283601+0000","last_became_peered":"2024-09-12T22:31:32.283601+0000","last_unstale":"2024-09-12T22:31:40.695956+0000","last_undegraded":"2024-09-12T22:31:40.695956+0000","last_fullsized":"2024-09-12T22:31:40.695956+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:40:06.769540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037858999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.692788+0000","last_change":"2024-09-12T22:31:36.407395+0000","last_active":"2024-09-12T22:31:40.692788+0000","last_peered":"2024-09-12T22:31:40.692788+0000","last_clean":"2024-09-12T22:31:40.692788+0000","last_became_active":"2024-09-12T22:31:36.406770+0000","last_became_peered":"2024-09-12T22:31:36.406770+0000","last_unstale":"2024-09-12T22:31:40.692788+0000","last_undegraded":"2024-09-12T22:31:40.692788+0000","last_fullsized":"2024-09-12T22:31:40.692788+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:49:26.547848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.765109+0000","last_change":"2024-09-12T22:31:37.414075+0000","last_active":"2024-09-12T22:31:40.765109+0000","last_peered":"2024-09-12T22:31:40.765109+0000","last_clean":"2024-09-12T22:31:40.765109+0000","last_became_active":"2024-09-12T22:31:37.413491+0000","last_became_peered":"2024-09-12T22:31:37.413491+0000","last_unstale":"2024-09-12T22:31:40.765109+0000","last_undegraded":"2024-09-12T22:31:40.765109+0000","last_fullsized":"2024-09-12T22:31:40.765109+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:26:25.578693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":29,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.693038+0000","last_change":"2024-09-12T22:31:34.286394+0000","last_active":"2024-09-12T22:31:40.693038+0000","last_peered":"2024-09-12T22:31:40.693038+0000","last_clean":"2024-09-12T22:31:40.693038+0000","last_became_active":"2024-09-12T22:31:32.280062+0000","last_became_peered":"2024-09-12T22:31:32.280062+0000","last_unstale":"2024-09-12T22:31:40.693038+0000","last_undegraded":"2024-09-12T22:31:40.693038+0000","last_fullsized":"2024-09-12T22:31:40.693038+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:20:23.663838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039540700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.764247+0000","last_change":"2024-09-12T22:31:36.413752+0000","last_active":"2024-09-12T22:31:40.764247+0000","last_peered":"2024-09-12T22:31:40.764247+0000","last_clean":"2024-09-12T22:31:40.764247+0000","last_became_active":"2024-09-12T22:31:36.413486+0000","last_became_peered":"2024-09-12T22:31:36.413486+0000","last_unstale":"2024-09-12T22:31:40.764247+0000","last_undegraded":"2024-09-12T22:31:40.764247+0000","last_fullsized":"2024-09-12T22:31:40.764247+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:37:20.891838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.693603+0000","last_change":"2024-09-12T22:31:37.417636+0000","last_active":"2024-09-12T22:31:40.693603+0000","last_peered":"2024-09-12T22:31:40.693603+0000","last_clean":"2024-09-12T22:31:40.693603+0000","last_became_active":"2024-09-12T22:31:37.417230+0000","last_became_peered":"2024-09-12T22:31:37.417230+0000","last_unstale":"2024-09-12T22:31:40.693603+0000","last_undegraded":"2024-09-12T22:31:40.693603+0000","last_fullsized":"2024-09-12T22:31:40.693603+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:44:29.729122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":31,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.696205+0000","last_change":"2024-09-12T22:31:34.286938+0000","last_active":"2024-09-12T22:31:40.696205+0000","last_peered":"2024-09-12T22:31:40.696205+0000","last_clean":"2024-09-12T22:31:40.696205+0000","last_became_active":"2024-09-12T22:31:32.282230+0000","last_became_peered":"2024-09-12T22:31:32.282230+0000","last_unstale":"2024-09-12T22:31:40.696205+0000","last_undegraded":"2024-09-12T22:31:40.696205+0000","last_fullsized":"2024-09-12T22:31:40.696205+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:11:05.988384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000615758,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.696467+0000","last_change":"2024-09-12T22:31:36.410694+0000","last_active":"2024-09-12T22:31:40.696467+0000","last_peered":"2024-09-12T22:31:40.696467+0000","last_clean":"2024-09-12T22:31:40.696467+0000","last_became_active":"2024-09-12T22:31:36.409816+0000","last_became_peered":"2024-09-12T22:31:36.409816+0000","last_unstale":"2024-09-12T22:31:40.696467+0000","last_undegraded":"2024-09-12T22:31:40.696467+0000","last_fullsized":"2024-09-12T22:31:40.696467+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:40:35.369213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.693429+0000","last_change":"2024-09-12T22:31:37.414608+0000","last_active":"2024-09-12T22:31:40.693429+0000","last_peered":"2024-09-12T22:31:40.693429+0000","last_clean":"2024-09-12T22:31:40.693429+0000","last_became_active":"2024-09-12T22:31:37.414307+0000","last_became_peered":"2024-09-12T22:31:37.414307+0000","last_unstale":"2024-09-12T22:31:40.693429+0000","last_undegraded":"2024-09-12T22:31:40.693429+0000","last_fullsized":"2024-09-12T22:31:40.693429+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:41:21.231511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.696973+0000","last_change":"2024-09-12T22:31:36.411355+0000","last_active":"2024-09-12T22:31:40.696973+0000","last_peered":"2024-09-12T22:31:40.696973+0000","last_clean":"2024-09-12T22:31:40.696973+0000","last_became_active":"2024-09-12T22:31:36.410529+0000","last_became_peered":"2024-09-12T22:31:36.410529+0000","last_unstale":"2024-09-12T22:31:40.696973+0000","last_undegraded":"2024-09-12T22:31:40.696973+0000","last_fullsized":"2024-09-12T22:31:40.696973+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:19:47.356688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":29,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.693624+0000","last_change":"2024-09-12T22:31:34.286457+0000","last_active":"2024-09-12T22:31:40.693624+0000","last_peered":"2024-09-12T22:31:40.693624+0000","last_clean":"2024-09-12T22:31:40.693624+0000","last_became_active":"2024-09-12T22:31:32.280007+0000","last_became_peered":"2024-09-12T22:31:32.280007+0000","last_unstale":"2024-09-12T22:31:40.693624+0000","last_undegraded":"2024-09-12T22:31:40.693624+0000","last_fullsized":"2024-09-12T22:31:40.693624+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:09.068038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041972500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.764666+0000","last_change":"2024-09-12T22:31:37.410386+0000","last_active":"2024-09-12T22:31:40.764666+0000","last_peered":"2024-09-12T22:31:40.764666+0000","last_clean":"2024-09-12T22:31:40.764666+0000","last_became_active":"2024-09-12T22:31:37.409928+0000","last_became_peered":"2024-09-12T22:31:37.409928+0000","last_unstale":"2024-09-12T22:31:40.764666+0000","last_undegraded":"2024-09-12T22:31:40.764666+0000","last_fullsized":"2024-09-12T22:31:40.764666+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:02:36.454134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.693491+0000","last_change":"2024-09-12T22:31:36.410324+0000","last_active":"2024-09-12T22:31:40.693491+0000","last_peered":"2024-09-12T22:31:40.693491+0000","last_clean":"2024-09-12T22:31:40.693491+0000","last_became_active":"2024-09-12T22:31:36.409199+0000","last_became_peered":"2024-09-12T22:31:36.409199+0000","last_unstale":"2024-09-12T22:31:40.693491+0000","last_undegraded":"2024-09-12T22:31:40.693491+0000","last_fullsized":"2024-09-12T22:31:40.693491+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:06:54.608936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":29,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.765417+0000","last_change":"2024-09-12T22:31:34.839044+0000","last_active":"2024-09-12T22:31:40.765417+0000","last_peered":"2024-09-12T22:31:40.765417+0000","last_clean":"2024-09-12T22:31:40.765417+0000","last_became_active":"2024-09-12T22:31:32.279671+0000","last_became_peered":"2024-09-12T22:31:32.279671+0000","last_unstale":"2024-09-12T22:31:40.765417+0000","last_undegraded":"2024-09-12T22:31:40.765417+0000","last_fullsized":"2024-09-12T22:31:40.765417+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:27:49.809935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036776499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.764836+0000","last_change":"2024-09-12T22:31:37.410289+0000","last_active":"2024-09-12T22:31:40.764836+0000","last_peered":"2024-09-12T22:31:40.764836+0000","last_clean":"2024-09-12T22:31:40.764836+0000","last_became_active":"2024-09-12T22:31:37.409446+0000","last_became_peered":"2024-09-12T22:31:37.409446+0000","last_unstale":"2024-09-12T22:31:40.764836+0000","last_undegraded":"2024-09-12T22:31:40.764836+0000","last_fullsized":"2024-09-12T22:31:40.764836+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:03:32.167116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"19'2","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.693884+0000","last_change":"2024-09-12T22:31:36.409397+0000","last_active":"2024-09-12T22:31:40.693884+0000","last_peered":"2024-09-12T22:31:40.693884+0000","last_clean":"2024-09-12T22:31:40.693884+0000","last_became_active":"2024-09-12T22:31:36.408787+0000","last_became_peered":"2024-09-12T22:31:36.408787+0000","last_unstale":"2024-09-12T22:31:40.693884+0000","last_undegraded":"2024-09-12T22:31:40.693884+0000","last_fullsized":"2024-09-12T22:31:40.693884+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:29:03.467352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":29,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.693852+0000","last_change":"2024-09-12T22:31:34.286639+0000","last_active":"2024-09-12T22:31:40.693852+0000","last_peered":"2024-09-12T22:31:40.693852+0000","last_clean":"2024-09-12T22:31:40.693852+0000","last_became_active":"2024-09-12T22:31:32.280092+0000","last_became_peered":"2024-09-12T22:31:32.280092+0000","last_unstale":"2024-09-12T22:31:40.693852+0000","last_undegraded":"2024-09-12T22:31:40.693852+0000","last_fullsized":"2024-09-12T22:31:40.693852+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:02:40.821530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058589999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.692777+0000","last_change":"2024-09-12T22:31:37.411152+0000","last_active":"2024-09-12T22:31:40.692777+0000","last_peered":"2024-09-12T22:31:40.692777+0000","last_clean":"2024-09-12T22:31:40.692777+0000","last_became_active":"2024-09-12T22:31:37.410558+0000","last_became_peered":"2024-09-12T22:31:37.410558+0000","last_unstale":"2024-09-12T22:31:40.692777+0000","last_undegraded":"2024-09-12T22:31:40.692777+0000","last_fullsized":"2024-09-12T22:31:40.692777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:14:29.892478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"20'1","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.693797+0000","last_change":"2024-09-12T22:31:36.407460+0000","last_active":"2024-09-12T22:31:40.693797+0000","last_peered":"2024-09-12T22:31:40.693797+0000","last_clean":"2024-09-12T22:31:40.693797+0000","last_became_active":"2024-09-12T22:31:36.406729+0000","last_became_peered":"2024-09-12T22:31:36.406729+0000","last_unstale":"2024-09-12T22:31:40.693797+0000","last_undegraded":"2024-09-12T22:31:40.693797+0000","last_fullsized":"2024-09-12T22:31:40.693797+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:27:58.012573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":29,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.696985+0000","last_change":"2024-09-12T22:31:34.286699+0000","last_active":"2024-09-12T22:31:40.696985+0000","last_peered":"2024-09-12T22:31:40.696985+0000","last_clean":"2024-09-12T22:31:40.696985+0000","last_became_active":"2024-09-12T22:31:32.283606+0000","last_became_peered":"2024-09-12T22:31:32.283606+0000","last_unstale":"2024-09-12T22:31:40.696985+0000","last_undegraded":"2024-09-12T22:31:40.696985+0000","last_fullsized":"2024-09-12T22:31:40.696985+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:09:32.050798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000382109,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.764377+0000","last_change":"2024-09-12T22:31:37.410011+0000","last_active":"2024-09-12T22:31:40.764377+0000","last_peered":"2024-09-12T22:31:40.764377+0000","last_clean":"2024-09-12T22:31:40.764377+0000","last_became_active":"2024-09-12T22:31:37.409320+0000","last_became_peered":"2024-09-12T22:31:37.409320+0000","last_unstale":"2024-09-12T22:31:40.764377+0000","last_undegraded":"2024-09-12T22:31:40.764377+0000","last_fullsized":"2024-09-12T22:31:40.764377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:27:23.661444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.696056+0000","last_change":"2024-09-12T22:31:37.415670+0000","last_active":"2024-09-12T22:31:40.696056+0000","last_peered":"2024-09-12T22:31:40.696056+0000","last_clean":"2024-09-12T22:31:40.696056+0000","last_became_active":"2024-09-12T22:31:37.415007+0000","last_became_peered":"2024-09-12T22:31:37.415007+0000","last_unstale":"2024-09-12T22:31:40.696056+0000","last_undegraded":"2024-09-12T22:31:40.696056+0000","last_fullsized":"2024-09-12T22:31:40.696056+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:42:51.694128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"19'6","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.696523+0000","last_change":"2024-09-12T22:31:36.409878+0000","last_active":"2024-09-12T22:31:40.696523+0000","last_peered":"2024-09-12T22:31:40.696523+0000","last_clean":"2024-09-12T22:31:40.696523+0000","last_became_active":"2024-09-12T22:31:36.409132+0000","last_became_peered":"2024-09-12T22:31:36.409132+0000","last_unstale":"2024-09-12T22:31:40.696523+0000","last_undegraded":"2024-09-12T22:31:40.696523+0000","last_fullsized":"2024-09-12T22:31:40.696523+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:09:56.081385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.692753+0000","last_change":"2024-09-12T22:31:37.414914+0000","last_active":"2024-09-12T22:31:40.692753+0000","last_peered":"2024-09-12T22:31:40.692753+0000","last_clean":"2024-09-12T22:31:40.692753+0000","last_became_active":"2024-09-12T22:31:37.414535+0000","last_became_peered":"2024-09-12T22:31:37.414535+0000","last_unstale":"2024-09-12T22:31:40.692753+0000","last_undegraded":"2024-09-12T22:31:40.692753+0000","last_fullsized":"2024-09-12T22:31:40.692753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:14:37.010786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"19'3","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.765296+0000","last_change":"2024-09-12T22:31:36.410433+0000","last_active":"2024-09-12T22:31:40.765296+0000","last_peered":"2024-09-12T22:31:40.765296+0000","last_clean":"2024-09-12T22:31:40.765296+0000","last_became_active":"2024-09-12T22:31:36.410007+0000","last_became_peered":"2024-09-12T22:31:36.410007+0000","last_unstale":"2024-09-12T22:31:40.765296+0000","last_undegraded":"2024-09-12T22:31:40.765296+0000","last_fullsized":"2024-09-12T22:31:40.765296+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:08:35.385688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.696899+0000","last_change":"2024-09-12T22:31:36.411549+0000","last_active":"2024-09-12T22:31:40.696899+0000","last_peered":"2024-09-12T22:31:40.696899+0000","last_clean":"2024-09-12T22:31:40.696899+0000","last_became_active":"2024-09-12T22:31:36.410674+0000","last_became_peered":"2024-09-12T22:31:36.410674+0000","last_unstale":"2024-09-12T22:31:40.696899+0000","last_undegraded":"2024-09-12T22:31:40.696899+0000","last_fullsized":"2024-09-12T22:31:40.696899+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:58:05.676197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.692661+0000","last_change":"2024-09-12T22:31:37.411254+0000","last_active":"2024-09-12T22:31:40.692661+0000","last_peered":"2024-09-12T22:31:40.692661+0000","last_clean":"2024-09-12T22:31:40.692661+0000","last_became_active":"2024-09-12T22:31:37.410404+0000","last_became_peered":"2024-09-12T22:31:37.410404+0000","last_unstale":"2024-09-12T22:31:40.692661+0000","last_undegraded":"2024-09-12T22:31:40.692661+0000","last_fullsized":"2024-09-12T22:31:40.692661+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:42:00.856616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.693757+0000","last_change":"2024-09-12T22:31:36.408390+0000","last_active":"2024-09-12T22:31:40.693757+0000","last_peered":"2024-09-12T22:31:40.693757+0000","last_clean":"2024-09-12T22:31:40.693757+0000","last_became_active":"2024-09-12T22:31:36.407062+0000","last_became_peered":"2024-09-12T22:31:36.407062+0000","last_unstale":"2024-09-12T22:31:40.693757+0000","last_undegraded":"2024-09-12T22:31:40.693757+0000","last_fullsized":"2024-09-12T22:31:40.693757+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:09:10.618195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.692729+0000","last_change":"2024-09-12T22:31:37.416629+0000","last_active":"2024-09-12T22:31:40.692729+0000","last_peered":"2024-09-12T22:31:40.692729+0000","last_clean":"2024-09-12T22:31:40.692729+0000","last_became_active":"2024-09-12T22:31:37.416387+0000","last_became_peered":"2024-09-12T22:31:37.416387+0000","last_unstale":"2024-09-12T22:31:40.692729+0000","last_undegraded":"2024-09-12T22:31:40.692729+0000","last_fullsized":"2024-09-12T22:31:40.692729+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:59:52.020560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.765320+0000","last_change":"2024-09-12T22:31:37.413777+0000","last_active":"2024-09-12T22:31:40.765320+0000","last_peered":"2024-09-12T22:31:40.765320+0000","last_clean":"2024-09-12T22:31:40.765320+0000","last_became_active":"2024-09-12T22:31:37.412669+0000","last_became_peered":"2024-09-12T22:31:37.412669+0000","last_unstale":"2024-09-12T22:31:40.765320+0000","last_undegraded":"2024-09-12T22:31:40.765320+0000","last_fullsized":"2024-09-12T22:31:40.765320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:42:17.728844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.692865+0000","last_change":"2024-09-12T22:31:36.409466+0000","last_active":"2024-09-12T22:31:40.692865+0000","last_peered":"2024-09-12T22:31:40.692865+0000","last_clean":"2024-09-12T22:31:40.692865+0000","last_became_active":"2024-09-12T22:31:36.408796+0000","last_became_peered":"2024-09-12T22:31:36.408796+0000","last_unstale":"2024-09-12T22:31:40.692865+0000","last_undegraded":"2024-09-12T22:31:40.692865+0000","last_fullsized":"2024-09-12T22:31:40.692865+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:03:39.648159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.693567+0000","last_change":"2024-09-12T22:31:37.411183+0000","last_active":"2024-09-12T22:31:40.693567+0000","last_peered":"2024-09-12T22:31:40.693567+0000","last_clean":"2024-09-12T22:31:40.693567+0000","last_became_active":"2024-09-12T22:31:37.409796+0000","last_became_peered":"2024-09-12T22:31:37.409796+0000","last_unstale":"2024-09-12T22:31:40.693567+0000","last_undegraded":"2024-09-12T22:31:40.693567+0000","last_fullsized":"2024-09-12T22:31:40.693567+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:20:35.779810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.692792+0000","last_change":"2024-09-12T22:31:36.407402+0000","last_active":"2024-09-12T22:31:40.692792+0000","last_peered":"2024-09-12T22:31:40.692792+0000","last_clean":"2024-09-12T22:31:40.692792+0000","last_became_active":"2024-09-12T22:31:36.406681+0000","last_became_peered":"2024-09-12T22:31:36.406681+0000","last_unstale":"2024-09-12T22:31:40.692792+0000","last_undegraded":"2024-09-12T22:31:40.692792+0000","last_fullsized":"2024-09-12T22:31:40.692792+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:39:39.362573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.764875+0000","last_change":"2024-09-12T22:31:37.412817+0000","last_active":"2024-09-12T22:31:40.764875+0000","last_peered":"2024-09-12T22:31:40.764875+0000","last_clean":"2024-09-12T22:31:40.764875+0000","last_became_active":"2024-09-12T22:31:37.411999+0000","last_became_peered":"2024-09-12T22:31:37.411999+0000","last_unstale":"2024-09-12T22:31:40.764875+0000","last_undegraded":"2024-09-12T22:31:40.764875+0000","last_fullsized":"2024-09-12T22:31:40.764875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:07:02.173590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.764750+0000","last_change":"2024-09-12T22:31:36.407378+0000","last_active":"2024-09-12T22:31:40.764750+0000","last_peered":"2024-09-12T22:31:40.764750+0000","last_clean":"2024-09-12T22:31:40.764750+0000","last_became_active":"2024-09-12T22:31:36.406992+0000","last_became_peered":"2024-09-12T22:31:36.406992+0000","last_unstale":"2024-09-12T22:31:40.764750+0000","last_undegraded":"2024-09-12T22:31:40.764750+0000","last_fullsized":"2024-09-12T22:31:40.764750+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:37:16.807328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.764857+0000","last_change":"2024-09-12T22:31:37.411676+0000","last_active":"2024-09-12T22:31:40.764857+0000","last_peered":"2024-09-12T22:31:40.764857+0000","last_clean":"2024-09-12T22:31:40.764857+0000","last_became_active":"2024-09-12T22:31:37.410802+0000","last_became_peered":"2024-09-12T22:31:37.410802+0000","last_unstale":"2024-09-12T22:31:40.764857+0000","last_undegraded":"2024-09-12T22:31:40.764857+0000","last_fullsized":"2024-09-12T22:31:40.764857+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:08:21.709770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"19'1","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.764889+0000","last_change":"2024-09-12T22:31:36.412289+0000","last_active":"2024-09-12T22:31:40.764889+0000","last_peered":"2024-09-12T22:31:40.764889+0000","last_clean":"2024-09-12T22:31:40.764889+0000","last_became_active":"2024-09-12T22:31:36.411985+0000","last_became_peered":"2024-09-12T22:31:36.411985+0000","last_unstale":"2024-09-12T22:31:40.764889+0000","last_undegraded":"2024-09-12T22:31:40.764889+0000","last_fullsized":"2024-09-12T22:31:40.764889+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:30:09.410370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.695976+0000","last_change":"2024-09-12T22:31:37.415365+0000","last_active":"2024-09-12T22:31:40.695976+0000","last_peered":"2024-09-12T22:31:40.695976+0000","last_clean":"2024-09-12T22:31:40.695976+0000","last_became_active":"2024-09-12T22:31:37.413933+0000","last_became_peered":"2024-09-12T22:31:37.413933+0000","last_unstale":"2024-09-12T22:31:40.695976+0000","last_undegraded":"2024-09-12T22:31:40.695976+0000","last_fullsized":"2024-09-12T22:31:40.695976+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:08:07.115355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"19'2","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.696434+0000","last_change":"2024-09-12T22:31:36.411665+0000","last_active":"2024-09-12T22:31:40.696434+0000","last_peered":"2024-09-12T22:31:40.696434+0000","last_clean":"2024-09-12T22:31:40.696434+0000","last_became_active":"2024-09-12T22:31:36.410182+0000","last_became_peered":"2024-09-12T22:31:36.410182+0000","last_unstale":"2024-09-12T22:31:40.696434+0000","last_undegraded":"2024-09-12T22:31:40.696434+0000","last_fullsized":"2024-09-12T22:31:40.696434+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:37:20.891838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.696106+0000","last_change":"2024-09-12T22:31:37.415172+0000","last_active":"2024-09-12T22:31:40.696106+0000","last_peered":"2024-09-12T22:31:40.696106+0000","last_clean":"2024-09-12T22:31:40.696106+0000","last_became_active":"2024-09-12T22:31:37.414776+0000","last_became_peered":"2024-09-12T22:31:37.414776+0000","last_unstale":"2024-09-12T22:31:40.696106+0000","last_undegraded":"2024-09-12T22:31:40.696106+0000","last_fullsized":"2024-09-12T22:31:40.696106+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:42:32.307876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"19'2","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.765168+0000","last_change":"2024-09-12T22:31:36.410362+0000","last_active":"2024-09-12T22:31:40.765168+0000","last_peered":"2024-09-12T22:31:40.765168+0000","last_clean":"2024-09-12T22:31:40.765168+0000","last_became_active":"2024-09-12T22:31:36.410029+0000","last_became_peered":"2024-09-12T22:31:36.410029+0000","last_unstale":"2024-09-12T22:31:40.765168+0000","last_undegraded":"2024-09-12T22:31:40.765168+0000","last_fullsized":"2024-09-12T22:31:40.765168+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:23:32.476870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.764699+0000","last_change":"2024-09-12T22:31:37.409214+0000","last_active":"2024-09-12T22:31:40.764699+0000","last_peered":"2024-09-12T22:31:40.764699+0000","last_clean":"2024-09-12T22:31:40.764699+0000","last_became_active":"2024-09-12T22:31:37.408849+0000","last_became_peered":"2024-09-12T22:31:37.408849+0000","last_unstale":"2024-09-12T22:31:40.764699+0000","last_undegraded":"2024-09-12T22:31:40.764699+0000","last_fullsized":"2024-09-12T22:31:40.764699+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:39:20.383152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"19'1","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.693694+0000","last_change":"2024-09-12T22:31:36.410371+0000","last_active":"2024-09-12T22:31:40.693694+0000","last_peered":"2024-09-12T22:31:40.693694+0000","last_clean":"2024-09-12T22:31:40.693694+0000","last_became_active":"2024-09-12T22:31:36.409428+0000","last_became_peered":"2024-09-12T22:31:36.409428+0000","last_unstale":"2024-09-12T22:31:40.693694+0000","last_undegraded":"2024-09-12T22:31:40.693694+0000","last_fullsized":"2024-09-12T22:31:40.693694+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:27:22.817690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.695839+0000","last_change":"2024-09-12T22:31:37.415390+0000","last_active":"2024-09-12T22:31:40.695839+0000","last_peered":"2024-09-12T22:31:40.695839+0000","last_clean":"2024-09-12T22:31:40.695839+0000","last_became_active":"2024-09-12T22:31:37.414781+0000","last_became_peered":"2024-09-12T22:31:37.414781+0000","last_unstale":"2024-09-12T22:31:40.695839+0000","last_undegraded":"2024-09-12T22:31:40.695839+0000","last_fullsized":"2024-09-12T22:31:40.695839+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:42:17.728844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"19'4","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T22:31:40.693681+0000","last_change":"2024-09-12T22:31:36.407945+0000","last_active":"2024-09-12T22:31:40.693681+0000","last_peered":"2024-09-12T22:31:40.693681+0000","last_clean":"2024-09-12T22:31:40.693681+0000","last_became_active":"2024-09-12T22:31:36.406959+0000","last_became_peered":"2024-09-12T22:31:36.406959+0000","last_unstale":"2024-09-12T22:31:40.693681+0000","last_undegraded":"2024-09-12T22:31:40.693681+0000","last_fullsized":"2024-09-12T22:31:40.693681+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:26:33.155850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705673,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31984,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339856,"statfs":{"total":96636764160,"available":96604012544,"internally_reserved":0,"allocated":811008,"data_stored":658415,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705673,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31972,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339868,"statfs":{"total":96636764160,"available":96604024832,"internally_reserved":0,"allocated":798720,"data_stored":657780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738377,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":192512,"data_stored":66253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T22:31:54.751 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T22:31:54.751 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2024-09-12T22:31:55.075 INFO:teuthology.orchestra.run.smithi019.stdout:epoch 21 2024-09-12T22:31:55.075 INFO:teuthology.orchestra.run.smithi019.stdout:fsid 957ce235-19cb-4350-8fee-febd6e3f2199 2024-09-12T22:31:55.075 INFO:teuthology.orchestra.run.smithi019.stdout:created 2024-09-12T22:31:15.903133+0000 2024-09-12T22:31:55.075 INFO:teuthology.orchestra.run.smithi019.stdout:modified 2024-09-12T22:31:40.689351+0000 2024-09-12T22:31:55.075 INFO:teuthology.orchestra.run.smithi019.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-12T22:31:55.076 INFO:teuthology.orchestra.run.smithi019.stdout:crush_version 5 2024-09-12T22:31:55.076 INFO:teuthology.orchestra.run.smithi019.stdout:full_ratio 0.95 2024-09-12T22:31:55.076 INFO:teuthology.orchestra.run.smithi019.stdout:backfillfull_ratio 0.9 2024-09-12T22:31:55.076 INFO:teuthology.orchestra.run.smithi019.stdout:nearfull_ratio 0.85 2024-09-12T22:31:55.076 INFO:teuthology.orchestra.run.smithi019.stdout:require_min_compat_client luminous 2024-09-12T22:31:55.076 INFO:teuthology.orchestra.run.smithi019.stdout:min_compat_client jewel 2024-09-12T22:31:55.076 INFO:teuthology.orchestra.run.smithi019.stdout:require_osd_release squid 2024-09-12T22:31:55.076 INFO:teuthology.orchestra.run.smithi019.stdout:stretch_mode_enabled false 2024-09-12T22:31:55.076 INFO:teuthology.orchestra.run.smithi019.stdout:pool 1 '.mgr' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 12 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 2.99 2024-09-12T22:31:55.076 INFO:teuthology.orchestra.run.smithi019.stdout:pool 2 'rbd' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 16 flags hashpspool,selfmanaged_snaps stripe_width 0 application rbd read_balance_score 1.50 2024-09-12T22:31:55.076 INFO:teuthology.orchestra.run.smithi019.stdout:pool 3 'cephfs_metadata' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 19 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.13 2024-09-12T22:31:55.077 INFO:teuthology.orchestra.run.smithi019.stdout:pool 4 'cephfs_data' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 20 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.13 2024-09-12T22:31:55.077 INFO:teuthology.orchestra.run.smithi019.stdout:max_osd 3 2024-09-12T22:31:55.077 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0 up in weight 1 up_from 9 up_thru 18 down_at 0 last_clean_interval [0,0) [v2:172.21.15.76:6800/1343093884,v1:172.21.15.76:6801/1343093884] [v2:172.21.15.76:6802/1343093884,v1:172.21.15.76:6803/1343093884] exists,up 73b96314-15d5-4058-9993-ac103e997b27 2024-09-12T22:31:55.077 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1 up in weight 1 up_from 8 up_thru 18 down_at 0 last_clean_interval [0,0) [v2:172.21.15.148:6800/616952176,v1:172.21.15.148:6801/616952176] [v2:172.21.15.148:6802/616952176,v1:172.21.15.148:6803/616952176] exists,up f82ad621-e9cf-41cb-b9c0-43470cf7ddb1 2024-09-12T22:31:55.077 INFO:teuthology.orchestra.run.smithi019.stdout:osd.2 up in weight 1 up_from 9 up_thru 18 down_at 0 last_clean_interval [0,0) [v2:172.21.15.163:6800/533442754,v1:172.21.15.163:6801/533442754] [v2:172.21.15.163:6802/533442754,v1:172.21.15.163:6803/533442754] exists,up f30dda36-a84c-4a01-a81a-afbfb88c0aed 2024-09-12T22:31:55.090 INFO:tasks.ceph.ceph_manager.ceph:['osd.0 up in weight 1 up_from 9 up_thru 18 down_at 0 last_clean_interval [0,0) [v2:172.21.15.76:6800/1343093884,v1:172.21.15.76:6801/1343093884] [v2:172.21.15.76:6802/1343093884,v1:172.21.15.76:6803/1343093884] exists,up 73b96314-15d5-4058-9993-ac103e997b27', 'osd.1 up in weight 1 up_from 8 up_thru 18 down_at 0 last_clean_interval [0,0) [v2:172.21.15.148:6800/616952176,v1:172.21.15.148:6801/616952176] [v2:172.21.15.148:6802/616952176,v1:172.21.15.148:6803/616952176] exists,up f82ad621-e9cf-41cb-b9c0-43470cf7ddb1', 'osd.2 up in weight 1 up_from 9 up_thru 18 down_at 0 last_clean_interval [0,0) [v2:172.21.15.163:6800/533442754,v1:172.21.15.163:6801/533442754] [v2:172.21.15.163:6802/533442754,v1:172.21.15.163:6803/533442754] exists,up f30dda36-a84c-4a01-a81a-afbfb88c0aed'] 2024-09-12T22:31:55.091 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok config show 2024-09-12T22:31:55.192 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T22:31:55.193 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "mon.a", 2024-09-12T22:31:55.193 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster": "ceph", 2024-09-12T22:31:55.193 INFO:teuthology.orchestra.run.smithi019.stdout: "admin_socket": "/var/run/ceph/ceph-mon.a.asok", 2024-09-12T22:31:55.193 INFO:teuthology.orchestra.run.smithi019.stdout: "admin_socket_mode": "", 2024-09-12T22:31:55.193 INFO:teuthology.orchestra.run.smithi019.stdout: "auth_allow_insecure_global_id_reclaim": "true", 2024-09-12T22:31:55.193 INFO:teuthology.orchestra.run.smithi019.stdout: "auth_client_required": "cephx, none", 2024-09-12T22:31:55.193 INFO:teuthology.orchestra.run.smithi019.stdout: "auth_cluster_required": "cephx", 2024-09-12T22:31:55.193 INFO:teuthology.orchestra.run.smithi019.stdout: "auth_debug": "true", 2024-09-12T22:31:55.193 INFO:teuthology.orchestra.run.smithi019.stdout: "auth_expose_insecure_global_id_reclaim": "true", 2024-09-12T22:31:55.193 INFO:teuthology.orchestra.run.smithi019.stdout: "auth_mon_ticket_ttl": "660.000000", 2024-09-12T22:31:55.193 INFO:teuthology.orchestra.run.smithi019.stdout: "auth_service_required": "cephx", 2024-09-12T22:31:55.193 INFO:teuthology.orchestra.run.smithi019.stdout: "auth_service_ticket_ttl": "240.000000", 2024-09-12T22:31:55.194 INFO:teuthology.orchestra.run.smithi019.stdout: "auth_supported": "cephx", 2024-09-12T22:31:55.194 INFO:teuthology.orchestra.run.smithi019.stdout: "bdev_aio": "true", 2024-09-12T22:31:55.194 INFO:teuthology.orchestra.run.smithi019.stdout: "bdev_aio_max_queue_depth": "1024", 2024-09-12T22:31:55.194 INFO:teuthology.orchestra.run.smithi019.stdout: "bdev_aio_poll_ms": "250", 2024-09-12T22:31:55.194 INFO:teuthology.orchestra.run.smithi019.stdout: "bdev_aio_reap_max": "16", 2024-09-12T22:31:55.194 INFO:teuthology.orchestra.run.smithi019.stdout: "bdev_async_discard": "false", 2024-09-12T22:31:55.194 INFO:teuthology.orchestra.run.smithi019.stdout: "bdev_block_size": "4096", 2024-09-12T22:31:55.194 INFO:teuthology.orchestra.run.smithi019.stdout: "bdev_debug_aio": "false", 2024-09-12T22:31:55.194 INFO:teuthology.orchestra.run.smithi019.stdout: "bdev_debug_aio_log_age": "5.000000", 2024-09-12T22:31:55.194 INFO:teuthology.orchestra.run.smithi019.stdout: "bdev_debug_aio_suicide_timeout": "60.000000", 2024-09-12T22:31:55.194 INFO:teuthology.orchestra.run.smithi019.stdout: "bdev_debug_inflight_ios": "false", 2024-09-12T22:31:55.194 INFO:teuthology.orchestra.run.smithi019.stdout: "bdev_enable_discard": "false", 2024-09-12T22:31:55.195 INFO:teuthology.orchestra.run.smithi019.stdout: "bdev_flock_retry": "3", 2024-09-12T22:31:55.195 INFO:teuthology.orchestra.run.smithi019.stdout: "bdev_flock_retry_interval": "0.100000", 2024-09-12T22:31:55.195 INFO:teuthology.orchestra.run.smithi019.stdout: "bdev_inject_crash": "0", 2024-09-12T22:31:55.195 INFO:teuthology.orchestra.run.smithi019.stdout: "bdev_inject_crash_flush_delay": "2", 2024-09-12T22:31:55.195 INFO:teuthology.orchestra.run.smithi019.stdout: "bdev_ioring": "false", 2024-09-12T22:31:55.195 INFO:teuthology.orchestra.run.smithi019.stdout: "bdev_ioring_hipri": "false", 2024-09-12T22:31:55.195 INFO:teuthology.orchestra.run.smithi019.stdout: "bdev_ioring_sqthread_poll": "false", 2024-09-12T22:31:55.195 INFO:teuthology.orchestra.run.smithi019.stdout: "bdev_nvme_unbind_from_kernel": "false", 2024-09-12T22:31:55.195 INFO:teuthology.orchestra.run.smithi019.stdout: "bdev_read_buffer_alignment": "4096", 2024-09-12T22:31:55.195 INFO:teuthology.orchestra.run.smithi019.stdout: "bdev_read_preallocated_huge_buffers": "", 2024-09-12T22:31:55.195 INFO:teuthology.orchestra.run.smithi019.stdout: "bdev_stalled_read_warn_lifetime": "86400", 2024-09-12T22:31:55.195 INFO:teuthology.orchestra.run.smithi019.stdout: "bdev_stalled_read_warn_threshold": "1", 2024-09-12T22:31:55.196 INFO:teuthology.orchestra.run.smithi019.stdout: "bdev_type": "", 2024-09-12T22:31:55.196 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_alloc_size": "1048576", 2024-09-12T22:31:55.196 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_allocator": "hybrid", 2024-09-12T22:31:55.196 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_buffered_io": "true", 2024-09-12T22:31:55.196 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_check_for_zeros": "false", 2024-09-12T22:31:55.196 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_check_volume_selector_often": "false", 2024-09-12T22:31:55.196 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_check_volume_selector_on_umount": "false", 2024-09-12T22:31:55.196 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_compact_log_sync": "false", 2024-09-12T22:31:55.196 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_failed_shared_alloc_cooldown": "600.000000", 2024-09-12T22:31:55.196 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_log_compact_min_ratio": "5.000000", 2024-09-12T22:31:55.196 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_log_compact_min_size": "16777216", 2024-09-12T22:31:55.196 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_log_replay_check_allocations": "true", 2024-09-12T22:31:55.196 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_max_log_runway": "4194304", 2024-09-12T22:31:55.197 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_max_prefetch": "1048576", 2024-09-12T22:31:55.197 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_min_flush_size": "524288", 2024-09-12T22:31:55.197 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_min_log_runway": "1048576", 2024-09-12T22:31:55.197 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_replay_recovery": "false", 2024-09-12T22:31:55.197 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_replay_recovery_disable_compact": "false", 2024-09-12T22:31:55.197 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_shared_alloc_size": "65536", 2024-09-12T22:31:55.197 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_sync_write": "false", 2024-09-12T22:31:55.197 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_2q_cache_kin_ratio": "0.500000", 2024-09-12T22:31:55.197 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_2q_cache_kout_ratio": "0.500000", 2024-09-12T22:31:55.197 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_alloc_stats_dump_interval": "86400.000000", 2024-09-12T22:31:55.197 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_allocation_from_file": "true", 2024-09-12T22:31:55.197 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_allocator": "hybrid", 2024-09-12T22:31:55.198 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_avl_alloc_bf_free_pct": "4", 2024-09-12T22:31:55.198 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_avl_alloc_bf_threshold": "131072", 2024-09-12T22:31:55.198 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_avl_alloc_ff_max_search_bytes": "16777216", 2024-09-12T22:31:55.198 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_avl_alloc_ff_max_search_count": "100", 2024-09-12T22:31:55.198 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_bdev_label_multi": "true", 2024-09-12T22:31:55.198 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_bdev_label_multi_upgrade": "false", 2024-09-12T22:31:55.198 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_bdev_label_require_all": "true", 2024-09-12T22:31:55.198 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_bitmapallocator_blocks_per_zone": "1024", 2024-09-12T22:31:55.198 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_bitmapallocator_span_size": "1024", 2024-09-12T22:31:55.198 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_blobid_prealloc": "10240", 2024-09-12T22:31:55.198 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_block_create": "true", 2024-09-12T22:31:55.198 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_block_db_create": "false", 2024-09-12T22:31:55.198 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_block_db_path": "", 2024-09-12T22:31:55.198 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_block_db_size": "0", 2024-09-12T22:31:55.199 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_block_path": "", 2024-09-12T22:31:55.199 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_block_preallocate_file": "false", 2024-09-12T22:31:55.199 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_block_size": "107374182400", 2024-09-12T22:31:55.199 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_block_wal_create": "false", 2024-09-12T22:31:55.199 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_block_wal_path": "", 2024-09-12T22:31:55.199 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_block_wal_size": "100663296", 2024-09-12T22:31:55.199 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_bluefs": "true", 2024-09-12T22:31:55.199 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_bluefs_alloc_failure_dump_interval": "0.000000", 2024-09-12T22:31:55.199 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_bluefs_env_mirror": "false", 2024-09-12T22:31:55.199 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_bluefs_max_free": "10737418240", 2024-09-12T22:31:55.199 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_age_bin_interval": "1.000000", 2024-09-12T22:31:55.199 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_age_bins_data": "1 2 6 24 120 720 0 0 0 0", 2024-09-12T22:31:55.200 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_age_bins_kv": "1 2 6 24 120 720 0 0 0 0", 2024-09-12T22:31:55.200 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_age_bins_kv_onode": "0 0 0 0 0 0 0 0 0 720", 2024-09-12T22:31:55.200 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_age_bins_meta": "1 2 6 24 120 720 0 0 0 0", 2024-09-12T22:31:55.200 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_autotune": "true", 2024-09-12T22:31:55.200 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_autotune_interval": "5.000000", 2024-09-12T22:31:55.200 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_kv_onode_ratio": "0.040000", 2024-09-12T22:31:55.200 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_kv_ratio": "0.450000", 2024-09-12T22:31:55.200 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_meta_ratio": "0.450000", 2024-09-12T22:31:55.200 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_size": "0", 2024-09-12T22:31:55.200 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_size_hdd": "1073741824", 2024-09-12T22:31:55.200 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_size_ssd": "3221225472", 2024-09-12T22:31:55.200 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_trim_interval": "0.050000", 2024-09-12T22:31:55.200 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_trim_max_skip_pinned": "1000", 2024-09-12T22:31:55.201 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_type": "2q", 2024-09-12T22:31:55.201 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cleaner_sleep_interval": "5.000000", 2024-09-12T22:31:55.201 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_clone_cow": "true", 2024-09-12T22:31:55.201 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_compression_algorithm": "snappy", 2024-09-12T22:31:55.201 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_compression_max_blob_size": "0", 2024-09-12T22:31:55.201 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_compression_max_blob_size_hdd": "65536", 2024-09-12T22:31:55.201 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_compression_max_blob_size_ssd": "65536", 2024-09-12T22:31:55.201 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_compression_min_blob_size": "0", 2024-09-12T22:31:55.201 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_compression_min_blob_size_hdd": "8192", 2024-09-12T22:31:55.201 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_compression_min_blob_size_ssd": "65536", 2024-09-12T22:31:55.201 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_compression_mode": "none", 2024-09-12T22:31:55.201 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_compression_required_ratio": "0.875000", 2024-09-12T22:31:55.201 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_csum_type": "crc32c", 2024-09-12T22:31:55.202 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_debug_enforce_settings": "default", 2024-09-12T22:31:55.202 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_debug_freelist": "false", 2024-09-12T22:31:55.202 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_debug_fsck_abort": "false", 2024-09-12T22:31:55.202 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_debug_inject_allocation_from_file_failure": "0.000000", 2024-09-12T22:31:55.202 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_debug_inject_csum_err_probability": "0.000000", 2024-09-12T22:31:55.202 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_debug_inject_read_err": "false", 2024-09-12T22:31:55.202 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_debug_legacy_omap": "false", 2024-09-12T22:31:55.202 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_debug_no_reuse_blocks": "false", 2024-09-12T22:31:55.202 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_debug_omit_block_device_write": "false", 2024-09-12T22:31:55.202 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_debug_omit_kv_commit": "false", 2024-09-12T22:31:55.202 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_debug_permit_any_bdev_label": "false", 2024-09-12T22:31:55.202 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_debug_prefragment_max": "1048576", 2024-09-12T22:31:55.202 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_debug_random_read_err": "0.000000", 2024-09-12T22:31:55.203 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_debug_randomize_serial_transaction": "0", 2024-09-12T22:31:55.203 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_debug_small_allocations": "0", 2024-09-12T22:31:55.203 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_debug_too_many_blobs_threshold": "24576", 2024-09-12T22:31:55.203 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_default_buffered_read": "true", 2024-09-12T22:31:55.203 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_default_buffered_write": "false", 2024-09-12T22:31:55.203 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_deferred_batch_ops": "0", 2024-09-12T22:31:55.203 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_deferred_batch_ops_hdd": "64", 2024-09-12T22:31:55.203 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_deferred_batch_ops_ssd": "16", 2024-09-12T22:31:55.203 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_elastic_shared_blobs": "true", 2024-09-12T22:31:55.203 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_extent_map_inline_shard_prealloc_size": "256", 2024-09-12T22:31:55.203 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_extent_map_shard_max_size": "1200", 2024-09-12T22:31:55.203 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_extent_map_shard_min_size": "150", 2024-09-12T22:31:55.203 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_extent_map_shard_target_size": "500", 2024-09-12T22:31:55.203 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_extent_map_shard_target_size_slop": "0.200000", 2024-09-12T22:31:55.204 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_fail_eio": "false", 2024-09-12T22:31:55.204 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_freelist_blocks_per_key": "128", 2024-09-12T22:31:55.204 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_fsck_error_on_no_per_pg_omap": "false", 2024-09-12T22:31:55.204 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_fsck_error_on_no_per_pool_omap": "false", 2024-09-12T22:31:55.204 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_fsck_error_on_no_per_pool_stats": "false", 2024-09-12T22:31:55.204 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_fsck_on_mkfs": "true", 2024-09-12T22:31:55.204 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_fsck_on_mkfs_deep": "false", 2024-09-12T22:31:55.204 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_fsck_on_mount": "false", 2024-09-12T22:31:55.204 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_fsck_on_mount_deep": "false", 2024-09-12T22:31:55.204 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_fsck_on_umount": "false", 2024-09-12T22:31:55.204 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_fsck_on_umount_deep": "false", 2024-09-12T22:31:55.204 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_fsck_quick_fix_on_mount": "false", 2024-09-12T22:31:55.204 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_fsck_quick_fix_threads": "2", 2024-09-12T22:31:55.205 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_fsck_read_bytes_cap": "67108864", 2024-09-12T22:31:55.205 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_fsck_shared_blob_tracker_size": "0.031250", 2024-09-12T22:31:55.205 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_gc_enable_blob_threshold": "0", 2024-09-12T22:31:55.205 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_gc_enable_total_threshold": "0", 2024-09-12T22:31:55.205 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_hybrid_alloc_mem_cap": "67108864", 2024-09-12T22:31:55.205 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_ignore_data_csum": "false", 2024-09-12T22:31:55.205 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_kv_sync_util_logging_s": "10.000000", 2024-09-12T22:31:55.205 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_kvbackend": "rocksdb", 2024-09-12T22:31:55.205 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_log_collection_list_age": "60.000000", 2024-09-12T22:31:55.205 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_log_omap_iterator_age": "5.000000", 2024-09-12T22:31:55.205 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_log_op_age": "5.000000", 2024-09-12T22:31:55.205 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_max_alloc_size": "0", 2024-09-12T22:31:55.206 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_max_blob_size": "0", 2024-09-12T22:31:55.206 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_max_blob_size_hdd": "65536", 2024-09-12T22:31:55.206 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_max_blob_size_ssd": "65536", 2024-09-12T22:31:55.206 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_max_defer_interval": "3.000000", 2024-09-12T22:31:55.206 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_max_deferred_txc": "32", 2024-09-12T22:31:55.206 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_min_alloc_size": "0", 2024-09-12T22:31:55.206 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_min_alloc_size_hdd": "4096", 2024-09-12T22:31:55.206 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_min_alloc_size_ssd": "4096", 2024-09-12T22:31:55.206 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_nid_prealloc": "1024", 2024-09-12T22:31:55.206 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_prefer_deferred_size": "0", 2024-09-12T22:31:55.207 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_prefer_deferred_size_hdd": "65536", 2024-09-12T22:31:55.207 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_prefer_deferred_size_ssd": "0", 2024-09-12T22:31:55.207 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_qfsck_on_mount": "true", 2024-09-12T22:31:55.207 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_retry_disk_reads": "3", 2024-09-12T22:31:55.207 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_rocksdb_cf": "true", 2024-09-12T22:31:55.207 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_rocksdb_cfs": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2024-09-12T22:31:55.207 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_rocksdb_options": "compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0", 2024-09-12T22:31:55.207 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_rocksdb_options_annex": "", 2024-09-12T22:31:55.207 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_slow_ops_warn_lifetime": "86400", 2024-09-12T22:31:55.207 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_slow_ops_warn_threshold": "1", 2024-09-12T22:31:55.207 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_spdk_coremask": "0x1", 2024-09-12T22:31:55.207 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_spdk_io_sleep": "5", 2024-09-12T22:31:55.207 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_spdk_max_io_completion": "0", 2024-09-12T22:31:55.208 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_spdk_mem": "512", 2024-09-12T22:31:55.208 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_sync_submit_transaction": "false", 2024-09-12T22:31:55.208 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_throttle_bytes": "67108864", 2024-09-12T22:31:55.208 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_throttle_cost_per_io": "0", 2024-09-12T22:31:55.208 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_throttle_cost_per_io_hdd": "670000", 2024-09-12T22:31:55.208 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_throttle_cost_per_io_ssd": "4000", 2024-09-12T22:31:55.208 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_throttle_deferred_bytes": "134217728", 2024-09-12T22:31:55.208 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_throttle_trace_rate": "0.000000", 2024-09-12T22:31:55.208 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_tracing": "false", 2024-09-12T22:31:55.208 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_use_optimal_io_size_for_min_alloc_size": "false", 2024-09-12T22:31:55.208 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_volume_selection_policy": "use_some_extra", 2024-09-12T22:31:55.208 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_volume_selection_reserved": "0", 2024-09-12T22:31:55.209 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_volume_selection_reserved_factor": "2.000000", 2024-09-12T22:31:55.209 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_warn_on_bluefs_spillover": "true", 2024-09-12T22:31:55.209 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_warn_on_legacy_statfs": "true", 2024-09-12T22:31:55.209 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_warn_on_no_per_pg_omap": "false", 2024-09-12T22:31:55.209 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_warn_on_no_per_pool_omap": "true", 2024-09-12T22:31:55.209 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_warn_on_spurious_read_errors": "true", 2024-09-12T22:31:55.209 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_zero_block_detection": "false", 2024-09-12T22:31:55.209 INFO:teuthology.orchestra.run.smithi019.stdout: "cephadm_path": "/usr/sbin/cephadm", 2024-09-12T22:31:55.209 INFO:teuthology.orchestra.run.smithi019.stdout: "cephfs_mirror_action_update_interval": "2", 2024-09-12T22:31:55.209 INFO:teuthology.orchestra.run.smithi019.stdout: "cephfs_mirror_directory_scan_interval": "10", 2024-09-12T22:31:55.209 INFO:teuthology.orchestra.run.smithi019.stdout: "cephfs_mirror_max_concurrent_directory_syncs": "3", 2024-09-12T22:31:55.209 INFO:teuthology.orchestra.run.smithi019.stdout: "cephfs_mirror_max_consecutive_failures_per_directory": "10", 2024-09-12T22:31:55.209 INFO:teuthology.orchestra.run.smithi019.stdout: "cephfs_mirror_max_snapshot_sync_per_cycle": "3", 2024-09-12T22:31:55.210 INFO:teuthology.orchestra.run.smithi019.stdout: "cephfs_mirror_mount_timeout": "10", 2024-09-12T22:31:55.210 INFO:teuthology.orchestra.run.smithi019.stdout: "cephfs_mirror_perf_stats_prio": "5", 2024-09-12T22:31:55.210 INFO:teuthology.orchestra.run.smithi019.stdout: "cephfs_mirror_restart_mirror_on_blocklist_interval": "30", 2024-09-12T22:31:55.210 INFO:teuthology.orchestra.run.smithi019.stdout: "cephfs_mirror_restart_mirror_on_failure_interval": "20", 2024-09-12T22:31:55.210 INFO:teuthology.orchestra.run.smithi019.stdout: "cephfs_mirror_retry_failed_directories_interval": "60", 2024-09-12T22:31:55.210 INFO:teuthology.orchestra.run.smithi019.stdout: "cephsqlite_blocklist_dead_locker": "true", 2024-09-12T22:31:55.210 INFO:teuthology.orchestra.run.smithi019.stdout: "cephsqlite_lock_renewal_interval": "2000", 2024-09-12T22:31:55.210 INFO:teuthology.orchestra.run.smithi019.stdout: "cephsqlite_lock_renewal_timeout": "30000", 2024-09-12T22:31:55.210 INFO:teuthology.orchestra.run.smithi019.stdout: "cephx_cluster_require_signatures": "false", 2024-09-12T22:31:55.210 INFO:teuthology.orchestra.run.smithi019.stdout: "cephx_cluster_require_version": "2", 2024-09-12T22:31:55.210 INFO:teuthology.orchestra.run.smithi019.stdout: "cephx_require_signatures": "false", 2024-09-12T22:31:55.210 INFO:teuthology.orchestra.run.smithi019.stdout: "cephx_require_version": "2", 2024-09-12T22:31:55.210 INFO:teuthology.orchestra.run.smithi019.stdout: "cephx_service_require_signatures": "false", 2024-09-12T22:31:55.210 INFO:teuthology.orchestra.run.smithi019.stdout: "cephx_service_require_version": "2", 2024-09-12T22:31:55.211 INFO:teuthology.orchestra.run.smithi019.stdout: "cephx_sign_messages": "true", 2024-09-12T22:31:55.211 INFO:teuthology.orchestra.run.smithi019.stdout: "chdir": "", 2024-09-12T22:31:55.211 INFO:teuthology.orchestra.run.smithi019.stdout: "client_acl_type": "", 2024-09-12T22:31:55.211 INFO:teuthology.orchestra.run.smithi019.stdout: "client_asio_thread_count": "2", 2024-09-12T22:31:55.211 INFO:teuthology.orchestra.run.smithi019.stdout: "client_cache_mid": "0.750000", 2024-09-12T22:31:55.211 INFO:teuthology.orchestra.run.smithi019.stdout: "client_cache_size": "16384", 2024-09-12T22:31:55.211 INFO:teuthology.orchestra.run.smithi019.stdout: "client_caps_release_delay": "5", 2024-09-12T22:31:55.211 INFO:teuthology.orchestra.run.smithi019.stdout: "client_check_pool_perm": "true", 2024-09-12T22:31:55.211 INFO:teuthology.orchestra.run.smithi019.stdout: "client_collect_and_send_global_metrics": "false", 2024-09-12T22:31:55.212 INFO:teuthology.orchestra.run.smithi019.stdout: "client_debug_force_sync_read": "false", 2024-09-12T22:31:55.212 INFO:teuthology.orchestra.run.smithi019.stdout: "client_debug_getattr_caps": "false", 2024-09-12T22:31:55.212 INFO:teuthology.orchestra.run.smithi019.stdout: "client_debug_inject_features": "", 2024-09-12T22:31:55.212 INFO:teuthology.orchestra.run.smithi019.stdout: "client_debug_inject_tick_delay": "0", 2024-09-12T22:31:55.212 INFO:teuthology.orchestra.run.smithi019.stdout: "client_die_on_failed_dentry_invalidate": "true", 2024-09-12T22:31:55.212 INFO:teuthology.orchestra.run.smithi019.stdout: "client_die_on_failed_remount": "false", 2024-09-12T22:31:55.212 INFO:teuthology.orchestra.run.smithi019.stdout: "client_dirsize_rbytes": "true", 2024-09-12T22:31:55.212 INFO:teuthology.orchestra.run.smithi019.stdout: "client_force_lazyio": "false", 2024-09-12T22:31:55.212 INFO:teuthology.orchestra.run.smithi019.stdout: "client_fs": "", 2024-09-12T22:31:55.212 INFO:teuthology.orchestra.run.smithi019.stdout: "client_inject_fixed_oldest_tid": "false", 2024-09-12T22:31:55.212 INFO:teuthology.orchestra.run.smithi019.stdout: "client_inject_release_failure": "false", 2024-09-12T22:31:55.212 INFO:teuthology.orchestra.run.smithi019.stdout: "client_max_inline_size": "4096", 2024-09-12T22:31:55.212 INFO:teuthology.orchestra.run.smithi019.stdout: "client_max_retries_on_remount_failure": "5", 2024-09-12T22:31:55.213 INFO:teuthology.orchestra.run.smithi019.stdout: "client_mds_namespace": "", 2024-09-12T22:31:55.213 INFO:teuthology.orchestra.run.smithi019.stdout: "client_metadata": "", 2024-09-12T22:31:55.213 INFO:teuthology.orchestra.run.smithi019.stdout: "client_mount_gid": "-1", 2024-09-12T22:31:55.213 INFO:teuthology.orchestra.run.smithi019.stdout: "client_mount_timeout": "300", 2024-09-12T22:31:55.213 INFO:teuthology.orchestra.run.smithi019.stdout: "client_mount_uid": "-1", 2024-09-12T22:31:55.213 INFO:teuthology.orchestra.run.smithi019.stdout: "client_mountpoint": "/", 2024-09-12T22:31:55.213 INFO:teuthology.orchestra.run.smithi019.stdout: "client_notify_timeout": "10", 2024-09-12T22:31:55.213 INFO:teuthology.orchestra.run.smithi019.stdout: "client_oc": "true", 2024-09-12T22:31:55.213 INFO:teuthology.orchestra.run.smithi019.stdout: "client_oc_max_dirty": "104857600", 2024-09-12T22:31:55.213 INFO:teuthology.orchestra.run.smithi019.stdout: "client_oc_max_dirty_age": "5.000000", 2024-09-12T22:31:55.213 INFO:teuthology.orchestra.run.smithi019.stdout: "client_oc_max_objects": "1000", 2024-09-12T22:31:55.213 INFO:teuthology.orchestra.run.smithi019.stdout: "client_oc_size": "209715200", 2024-09-12T22:31:55.213 INFO:teuthology.orchestra.run.smithi019.stdout: "client_oc_target_dirty": "8388608", 2024-09-12T22:31:55.214 INFO:teuthology.orchestra.run.smithi019.stdout: "client_permissions": "true", 2024-09-12T22:31:55.214 INFO:teuthology.orchestra.run.smithi019.stdout: "client_quota": "true", 2024-09-12T22:31:55.214 INFO:teuthology.orchestra.run.smithi019.stdout: "client_quota_df": "true", 2024-09-12T22:31:55.214 INFO:teuthology.orchestra.run.smithi019.stdout: "client_readahead_max_bytes": "0", 2024-09-12T22:31:55.214 INFO:teuthology.orchestra.run.smithi019.stdout: "client_readahead_max_periods": "4", 2024-09-12T22:31:55.214 INFO:teuthology.orchestra.run.smithi019.stdout: "client_readahead_min": "131072", 2024-09-12T22:31:55.214 INFO:teuthology.orchestra.run.smithi019.stdout: "client_reconnect_stale": "false", 2024-09-12T22:31:55.214 INFO:teuthology.orchestra.run.smithi019.stdout: "client_shutdown_timeout": "30", 2024-09-12T22:31:55.214 INFO:teuthology.orchestra.run.smithi019.stdout: "client_snapdir": ".snap", 2024-09-12T22:31:55.214 INFO:teuthology.orchestra.run.smithi019.stdout: "client_tick_interval": "1", 2024-09-12T22:31:55.214 INFO:teuthology.orchestra.run.smithi019.stdout: "client_trace": "", 2024-09-12T22:31:55.214 INFO:teuthology.orchestra.run.smithi019.stdout: "client_try_dentry_invalidate": "false", 2024-09-12T22:31:55.215 INFO:teuthology.orchestra.run.smithi019.stdout: "client_use_faked_inos": "false", 2024-09-12T22:31:55.215 INFO:teuthology.orchestra.run.smithi019.stdout: "client_use_random_mds": "false", 2024-09-12T22:31:55.215 INFO:teuthology.orchestra.run.smithi019.stdout: "clog_to_graylog": "false", 2024-09-12T22:31:55.215 INFO:teuthology.orchestra.run.smithi019.stdout: "clog_to_graylog_host": "127.0.0.1", 2024-09-12T22:31:55.215 INFO:teuthology.orchestra.run.smithi019.stdout: "clog_to_graylog_port": "12201", 2024-09-12T22:31:55.215 INFO:teuthology.orchestra.run.smithi019.stdout: "clog_to_monitors": "default=true", 2024-09-12T22:31:55.215 INFO:teuthology.orchestra.run.smithi019.stdout: "clog_to_syslog": "false", 2024-09-12T22:31:55.215 INFO:teuthology.orchestra.run.smithi019.stdout: "clog_to_syslog_facility": "default=daemon audit=local0", 2024-09-12T22:31:55.215 INFO:teuthology.orchestra.run.smithi019.stdout: "clog_to_syslog_level": "info", 2024-09-12T22:31:55.215 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster_addr": "-", 2024-09-12T22:31:55.215 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster_network": "", 2024-09-12T22:31:55.215 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster_network_interface": "", 2024-09-12T22:31:55.215 INFO:teuthology.orchestra.run.smithi019.stdout: "compressor_zlib_isal": "false", 2024-09-12T22:31:55.216 INFO:teuthology.orchestra.run.smithi019.stdout: "compressor_zlib_level": "5", 2024-09-12T22:31:55.216 INFO:teuthology.orchestra.run.smithi019.stdout: "compressor_zlib_winsize": "-15", 2024-09-12T22:31:55.216 INFO:teuthology.orchestra.run.smithi019.stdout: "compressor_zstd_level": "1", 2024-09-12T22:31:55.216 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image": "docker.io/ceph/daemon-base:latest-master-devel", 2024-09-12T22:31:55.216 INFO:teuthology.orchestra.run.smithi019.stdout: "crash_dir": "/var/lib/ceph/crash", 2024-09-12T22:31:55.216 INFO:teuthology.orchestra.run.smithi019.stdout: "crimson_alien_op_num_threads": "6", 2024-09-12T22:31:55.216 INFO:teuthology.orchestra.run.smithi019.stdout: "crimson_alien_thread_cpu_cores": "", 2024-09-12T22:31:55.216 INFO:teuthology.orchestra.run.smithi019.stdout: "crimson_osd_obc_lru_size": "512", 2024-09-12T22:31:55.216 INFO:teuthology.orchestra.run.smithi019.stdout: "crimson_osd_scheduler_concurrency": "0", 2024-09-12T22:31:55.216 INFO:teuthology.orchestra.run.smithi019.stdout: "crimson_osd_stat_interval": "0", 2024-09-12T22:31:55.216 INFO:teuthology.orchestra.run.smithi019.stdout: "crimson_seastar_cpu_cores": "", 2024-09-12T22:31:55.216 INFO:teuthology.orchestra.run.smithi019.stdout: "crimson_seastar_num_threads": "0", 2024-09-12T22:31:55.216 INFO:teuthology.orchestra.run.smithi019.stdout: "crush_location": "", 2024-09-12T22:31:55.217 INFO:teuthology.orchestra.run.smithi019.stdout: "crush_location_hook": "", 2024-09-12T22:31:55.217 INFO:teuthology.orchestra.run.smithi019.stdout: "crush_location_hook_timeout": "10", 2024-09-12T22:31:55.217 INFO:teuthology.orchestra.run.smithi019.stdout: "daemonize": "false", 2024-09-12T22:31:55.217 INFO:teuthology.orchestra.run.smithi019.stdout: "daos_pool": "tank", 2024-09-12T22:31:55.217 INFO:teuthology.orchestra.run.smithi019.stdout: "dbstore_config_uri": "file:/var/lib/ceph/radosgw/dbstore-config.db", 2024-09-12T22:31:55.217 INFO:teuthology.orchestra.run.smithi019.stdout: "dbstore_db_dir": "/var/lib/ceph/radosgw", 2024-09-12T22:31:55.217 INFO:teuthology.orchestra.run.smithi019.stdout: "dbstore_db_name_prefix": "dbstore", 2024-09-12T22:31:55.217 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_alienstore": "0/5", 2024-09-12T22:31:55.217 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_allow_any_pool_priority": "false", 2024-09-12T22:31:55.217 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_asok": "1/5", 2024-09-12T22:31:55.217 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_asok_assert_abort": "false", 2024-09-12T22:31:55.217 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_asserts_on_shutdown": "true", 2024-09-12T22:31:55.217 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_auth": "20/20", 2024-09-12T22:31:55.218 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_bdev": "1/3", 2024-09-12T22:31:55.218 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_bluefs": "1/5", 2024-09-12T22:31:55.218 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_bluestore": "1/5", 2024-09-12T22:31:55.218 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_buffer": "0/1", 2024-09-12T22:31:55.218 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_ceph_exporter": "1/5", 2024-09-12T22:31:55.218 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_cephfs_mirror": "0/5", 2024-09-12T22:31:55.218 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_cephsqlite": "0/5", 2024-09-12T22:31:55.218 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_client": "0/5", 2024-09-12T22:31:55.218 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_compressor": "1/5", 2024-09-12T22:31:55.218 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_context": "0/1", 2024-09-12T22:31:55.218 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_crimson_interrupt": "0/5", 2024-09-12T22:31:55.218 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_crush": "1/1", 2024-09-12T22:31:55.218 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_crypto": "1/5", 2024-09-12T22:31:55.219 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_cyanstore": "0/5", 2024-09-12T22:31:55.219 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_deliberately_leak_memory": "false", 2024-09-12T22:31:55.219 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_disable_randomized_ping": "false", 2024-09-12T22:31:55.219 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_dpdk": "1/5", 2024-09-12T22:31:55.219 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_eventtrace": "1/5", 2024-09-12T22:31:55.219 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_filer": "0/1", 2024-09-12T22:31:55.219 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_filestore": "1/3", 2024-09-12T22:31:55.219 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_finisher": "1/1", 2024-09-12T22:31:55.219 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_fuse": "1/5", 2024-09-12T22:31:55.219 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_heartbeat_testing_span": "0", 2024-09-12T22:31:55.219 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_heartbeatmap": "1/5", 2024-09-12T22:31:55.219 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_immutable_obj_cache": "0/5", 2024-09-12T22:31:55.219 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_javaclient": "1/5", 2024-09-12T22:31:55.219 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_journal": "1/3", 2024-09-12T22:31:55.220 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_journaler": "0/5", 2024-09-12T22:31:55.220 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_kstore": "1/5", 2024-09-12T22:31:55.220 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_lockdep": "0/1", 2024-09-12T22:31:55.220 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_mclock": "1/5", 2024-09-12T22:31:55.220 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_mds": "1/5", 2024-09-12T22:31:55.220 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_mds_balancer": "1/5", 2024-09-12T22:31:55.220 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_mds_locker": "1/5", 2024-09-12T22:31:55.220 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_mds_log": "1/5", 2024-09-12T22:31:55.220 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_mds_log_expire": "1/5", 2024-09-12T22:31:55.220 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_mds_migrator": "1/5", 2024-09-12T22:31:55.220 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_mds_quiesce": "3/5", 2024-09-12T22:31:55.220 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_memstore": "1/5", 2024-09-12T22:31:55.220 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_mgr": "2/5", 2024-09-12T22:31:55.221 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_mgrc": "1/5", 2024-09-12T22:31:55.221 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_mon": "20/20", 2024-09-12T22:31:55.221 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_monc": "0/10", 2024-09-12T22:31:55.221 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_ms": "1/1", 2024-09-12T22:31:55.221 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_none": "0/5", 2024-09-12T22:31:55.221 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_objclass": "0/5", 2024-09-12T22:31:55.221 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_objectcacher": "0/5", 2024-09-12T22:31:55.221 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_objecter": "0/1", 2024-09-12T22:31:55.221 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_optracker": "0/5", 2024-09-12T22:31:55.221 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_osd": "1/5", 2024-09-12T22:31:55.221 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_paxos": "20/20", 2024-09-12T22:31:55.222 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_perfcounter": "1/5", 2024-09-12T22:31:55.222 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_prioritycache": "1/5", 2024-09-12T22:31:55.222 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_rados": "0/5", 2024-09-12T22:31:55.222 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_rbd": "0/5", 2024-09-12T22:31:55.222 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_rbd_mirror": "0/5", 2024-09-12T22:31:55.222 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_rbd_pwl": "0/5", 2024-09-12T22:31:55.222 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_rbd_replay": "0/5", 2024-09-12T22:31:55.222 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_refs": "0/0", 2024-09-12T22:31:55.222 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_reserver": "1/1", 2024-09-12T22:31:55.223 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_rgw": "1/5", 2024-09-12T22:31:55.223 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_rgw_access": "1/5", 2024-09-12T22:31:55.223 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_rgw_datacache": "1/5", 2024-09-12T22:31:55.223 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_rgw_dbstore": "1/5", 2024-09-12T22:31:55.223 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_rgw_flight": "1/5", 2024-09-12T22:31:55.223 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_rgw_lifecycle": "1/5", 2024-09-12T22:31:55.223 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_rgw_sync": "1/5", 2024-09-12T22:31:55.223 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_rocksdb": "4/5", 2024-09-12T22:31:55.223 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_seastore": "0/5", 2024-09-12T22:31:55.223 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_seastore_backref": "0/5", 2024-09-12T22:31:55.223 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_seastore_cache": "0/5", 2024-09-12T22:31:55.224 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_seastore_cleaner": "0/5", 2024-09-12T22:31:55.224 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_seastore_device": "0/5", 2024-09-12T22:31:55.224 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_seastore_epm": "0/5", 2024-09-12T22:31:55.224 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_seastore_fixedkv_tree": "0/5", 2024-09-12T22:31:55.224 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_seastore_journal": "0/5", 2024-09-12T22:31:55.224 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_seastore_lba": "0/5", 2024-09-12T22:31:55.224 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_seastore_odata": "0/5", 2024-09-12T22:31:55.224 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_seastore_omap": "0/5", 2024-09-12T22:31:55.224 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_seastore_onode": "0/5", 2024-09-12T22:31:55.224 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_seastore_t": "0/5", 2024-09-12T22:31:55.224 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_seastore_tm": "0/5", 2024-09-12T22:31:55.224 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_striper": "0/1", 2024-09-12T22:31:55.225 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_test": "0/5", 2024-09-12T22:31:55.225 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_throttle": "1/1", 2024-09-12T22:31:55.225 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_timer": "0/1", 2024-09-12T22:31:55.225 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_tp": "0/5", 2024-09-12T22:31:55.225 INFO:teuthology.orchestra.run.smithi019.stdout: "debug_trace": "1/5", 2024-09-12T22:31:55.225 INFO:teuthology.orchestra.run.smithi019.stdout: "defer_client_eviction_on_laggy_osds": "false", 2024-09-12T22:31:55.225 INFO:teuthology.orchestra.run.smithi019.stdout: "device_failure_prediction_mode": "none", 2024-09-12T22:31:55.225 INFO:teuthology.orchestra.run.smithi019.stdout: "enable_experimental_unrecoverable_data_corrupting_features": "", 2024-09-12T22:31:55.225 INFO:teuthology.orchestra.run.smithi019.stdout: "erasure_code_dir": "/usr/lib64/ceph/erasure-code", 2024-09-12T22:31:55.225 INFO:teuthology.orchestra.run.smithi019.stdout: "err_to_graylog": "false", 2024-09-12T22:31:55.225 INFO:teuthology.orchestra.run.smithi019.stdout: "err_to_journald": "false", 2024-09-12T22:31:55.225 INFO:teuthology.orchestra.run.smithi019.stdout: "err_to_stderr": "true", 2024-09-12T22:31:55.226 INFO:teuthology.orchestra.run.smithi019.stdout: "err_to_syslog": "false", 2024-09-12T22:31:55.226 INFO:teuthology.orchestra.run.smithi019.stdout: "event_tracing": "false", 2024-09-12T22:31:55.226 INFO:teuthology.orchestra.run.smithi019.stdout: "exporter_addr": "0.0.0.0", 2024-09-12T22:31:55.226 INFO:teuthology.orchestra.run.smithi019.stdout: "exporter_http_port": "9926", 2024-09-12T22:31:55.226 INFO:teuthology.orchestra.run.smithi019.stdout: "exporter_prio_limit": "5", 2024-09-12T22:31:55.226 INFO:teuthology.orchestra.run.smithi019.stdout: "exporter_sock_dir": "/var/run/ceph/", 2024-09-12T22:31:55.226 INFO:teuthology.orchestra.run.smithi019.stdout: "exporter_sort_metrics": "true", 2024-09-12T22:31:55.226 INFO:teuthology.orchestra.run.smithi019.stdout: "exporter_stats_period": "5", 2024-09-12T22:31:55.226 INFO:teuthology.orchestra.run.smithi019.stdout: "fake_statfs_for_testing": "0", 2024-09-12T22:31:55.226 INFO:teuthology.orchestra.run.smithi019.stdout: "fatal_signal_handlers": "true", 2024-09-12T22:31:55.226 INFO:teuthology.orchestra.run.smithi019.stdout: "filer_max_purge_ops": "10", 2024-09-12T22:31:55.226 INFO:teuthology.orchestra.run.smithi019.stdout: "filer_max_truncate_ops": "128", 2024-09-12T22:31:55.226 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_apply_finisher_threads": "1", 2024-09-12T22:31:55.227 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_blackhole": "false", 2024-09-12T22:31:55.227 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_btrfs_clone_range": "true", 2024-09-12T22:31:55.227 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_btrfs_snap": "true", 2024-09-12T22:31:55.227 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_caller_concurrency": "10", 2024-09-12T22:31:55.227 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_collect_device_partition_information": "true", 2024-09-12T22:31:55.227 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_commit_timeout": "600.000000", 2024-09-12T22:31:55.227 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_debug_inject_read_err": "false", 2024-09-12T22:31:55.227 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_debug_omap_check": "false", 2024-09-12T22:31:55.227 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_debug_random_read_err": "0.000000", 2024-09-12T22:31:55.227 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_debug_verify_split": "false", 2024-09-12T22:31:55.227 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_dump_file": "", 2024-09-12T22:31:55.227 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_expected_throughput_bytes": "209715200.000000", 2024-09-12T22:31:55.227 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_expected_throughput_ops": "200.000000", 2024-09-12T22:31:55.228 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_fadvise": "true", 2024-09-12T22:31:55.228 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_fail_eio": "true", 2024-09-12T22:31:55.228 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_fd_cache_shards": "16", 2024-09-12T22:31:55.228 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_fd_cache_size": "128", 2024-09-12T22:31:55.228 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_fiemap": "false", 2024-09-12T22:31:55.228 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_fiemap_threshold": "4096", 2024-09-12T22:31:55.228 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_fsync_flushes_journal_data": "false", 2024-09-12T22:31:55.228 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_index_retry_probability": "0.000000", 2024-09-12T22:31:55.228 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_inject_stall": "0", 2024-09-12T22:31:55.228 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_journal_parallel": "false", 2024-09-12T22:31:55.228 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_journal_trailing": "false", 2024-09-12T22:31:55.228 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_journal_writeahead": "false", 2024-09-12T22:31:55.228 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_kill_at": "0", 2024-09-12T22:31:55.228 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_max_alloc_hint_size": "1048576", 2024-09-12T22:31:55.229 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_max_inline_xattr_size": "0", 2024-09-12T22:31:55.229 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_max_inline_xattr_size_btrfs": "2048", 2024-09-12T22:31:55.229 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_max_inline_xattr_size_other": "512", 2024-09-12T22:31:55.229 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_max_inline_xattr_size_xfs": "65536", 2024-09-12T22:31:55.229 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_max_inline_xattrs": "0", 2024-09-12T22:31:55.229 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_max_inline_xattrs_btrfs": "10", 2024-09-12T22:31:55.229 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_max_inline_xattrs_other": "2", 2024-09-12T22:31:55.229 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_max_inline_xattrs_xfs": "10", 2024-09-12T22:31:55.229 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_max_sync_interval": "5.000000", 2024-09-12T22:31:55.229 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_max_xattr_value_size": "0", 2024-09-12T22:31:55.229 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_max_xattr_value_size_btrfs": "65536", 2024-09-12T22:31:55.229 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_max_xattr_value_size_other": "1024", 2024-09-12T22:31:55.230 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_max_xattr_value_size_xfs": "65536", 2024-09-12T22:31:55.230 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_merge_threshold": "-10", 2024-09-12T22:31:55.230 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_min_sync_interval": "0.010000", 2024-09-12T22:31:55.230 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_odsync_write": "false", 2024-09-12T22:31:55.230 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_omap_backend": "rocksdb", 2024-09-12T22:31:55.230 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_omap_backend_path": "", 2024-09-12T22:31:55.230 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_omap_header_cache_size": "1024", 2024-09-12T22:31:55.230 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_ondisk_finisher_threads": "1", 2024-09-12T22:31:55.230 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_op_thread_suicide_timeout": "180", 2024-09-12T22:31:55.230 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_op_thread_timeout": "60", 2024-09-12T22:31:55.230 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_op_threads": "2", 2024-09-12T22:31:55.230 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_punch_hole": "false", 2024-09-12T22:31:55.230 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_queue_high_delay_multiple": "0.000000", 2024-09-12T22:31:55.230 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_queue_high_delay_multiple_bytes": "0.000000", 2024-09-12T22:31:55.231 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_queue_high_delay_multiple_ops": "0.000000", 2024-09-12T22:31:55.231 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_queue_high_threshhold": "0.900000", 2024-09-12T22:31:55.231 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_queue_low_threshhold": "0.300000", 2024-09-12T22:31:55.231 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_queue_max_bytes": "104857600", 2024-09-12T22:31:55.231 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_queue_max_delay_multiple": "0.000000", 2024-09-12T22:31:55.231 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_queue_max_delay_multiple_bytes": "0.000000", 2024-09-12T22:31:55.231 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_queue_max_delay_multiple_ops": "0.000000", 2024-09-12T22:31:55.231 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_queue_max_ops": "50", 2024-09-12T22:31:55.231 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_rocksdb_options": "max_background_jobs=10,compaction_readahead_size=2097152,compression=kNoCompression", 2024-09-12T22:31:55.231 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_seek_data_hole": "false", 2024-09-12T22:31:55.231 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_sloppy_crc": "false", 2024-09-12T22:31:55.231 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_sloppy_crc_block_size": "65536", 2024-09-12T22:31:55.231 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_splice": "false", 2024-09-12T22:31:55.232 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_split_multiple": "2", 2024-09-12T22:31:55.232 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_split_rand_factor": "20", 2024-09-12T22:31:55.232 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_update_to": "1000", 2024-09-12T22:31:55.232 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_wbthrottle_btrfs_bytes_hard_limit": "419430400", 2024-09-12T22:31:55.232 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_wbthrottle_btrfs_bytes_start_flusher": "41943040", 2024-09-12T22:31:55.232 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_wbthrottle_btrfs_inodes_hard_limit": "5000", 2024-09-12T22:31:55.232 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_wbthrottle_btrfs_inodes_start_flusher": "500", 2024-09-12T22:31:55.232 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_wbthrottle_btrfs_ios_hard_limit": "5000", 2024-09-12T22:31:55.232 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_wbthrottle_btrfs_ios_start_flusher": "500", 2024-09-12T22:31:55.232 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_wbthrottle_enable": "true", 2024-09-12T22:31:55.232 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_wbthrottle_xfs_bytes_hard_limit": "419430400", 2024-09-12T22:31:55.232 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_wbthrottle_xfs_bytes_start_flusher": "41943040", 2024-09-12T22:31:55.233 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_wbthrottle_xfs_inodes_hard_limit": "5000", 2024-09-12T22:31:55.233 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_wbthrottle_xfs_inodes_start_flusher": "500", 2024-09-12T22:31:55.233 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_wbthrottle_xfs_ios_hard_limit": "5000", 2024-09-12T22:31:55.233 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_wbthrottle_xfs_ios_start_flusher": "500", 2024-09-12T22:31:55.233 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_xfs_extsize": "false", 2024-09-12T22:31:55.233 INFO:teuthology.orchestra.run.smithi019.stdout: "filestore_zfs_snap": "false", 2024-09-12T22:31:55.233 INFO:teuthology.orchestra.run.smithi019.stdout: "fio_dir": "/tmp/fio", 2024-09-12T22:31:55.233 INFO:teuthology.orchestra.run.smithi019.stdout: "fsid": "957ce235-19cb-4350-8fee-febd6e3f2199", 2024-09-12T22:31:55.233 INFO:teuthology.orchestra.run.smithi019.stdout: "fuse_allow_other": "true", 2024-09-12T22:31:55.233 INFO:teuthology.orchestra.run.smithi019.stdout: "fuse_atomic_o_trunc": "true", 2024-09-12T22:31:55.233 INFO:teuthology.orchestra.run.smithi019.stdout: "fuse_big_writes": "true", 2024-09-12T22:31:55.233 INFO:teuthology.orchestra.run.smithi019.stdout: "fuse_debug": "false", 2024-09-12T22:31:55.233 INFO:teuthology.orchestra.run.smithi019.stdout: "fuse_default_permissions": "false", 2024-09-12T22:31:55.234 INFO:teuthology.orchestra.run.smithi019.stdout: "fuse_disable_pagecache": "false", 2024-09-12T22:31:55.234 INFO:teuthology.orchestra.run.smithi019.stdout: "fuse_max_write": "0", 2024-09-12T22:31:55.234 INFO:teuthology.orchestra.run.smithi019.stdout: "fuse_multithreaded": "true", 2024-09-12T22:31:55.234 INFO:teuthology.orchestra.run.smithi019.stdout: "fuse_require_active_mds": "true", 2024-09-12T22:31:55.234 INFO:teuthology.orchestra.run.smithi019.stdout: "fuse_set_user_groups": "true", 2024-09-12T22:31:55.234 INFO:teuthology.orchestra.run.smithi019.stdout: "fuse_splice_move": "true", 2024-09-12T22:31:55.234 INFO:teuthology.orchestra.run.smithi019.stdout: "fuse_splice_read": "true", 2024-09-12T22:31:55.234 INFO:teuthology.orchestra.run.smithi019.stdout: "fuse_splice_write": "true", 2024-09-12T22:31:55.234 INFO:teuthology.orchestra.run.smithi019.stdout: "fuse_syncfs_on_mksnap": "true", 2024-09-12T22:31:55.234 INFO:teuthology.orchestra.run.smithi019.stdout: "fuse_use_invalidate_cb": "true", 2024-09-12T22:31:55.234 INFO:teuthology.orchestra.run.smithi019.stdout: "gss_ktab_client_file": "/var/lib/ceph/mon.a/gss_client_mon.a.ktab", 2024-09-12T22:31:55.234 INFO:teuthology.orchestra.run.smithi019.stdout: "gss_target_name": "ceph", 2024-09-12T22:31:55.234 INFO:teuthology.orchestra.run.smithi019.stdout: "heartbeat_file": "", 2024-09-12T22:31:55.234 INFO:teuthology.orchestra.run.smithi019.stdout: "heartbeat_inject_failure": "0", 2024-09-12T22:31:55.235 INFO:teuthology.orchestra.run.smithi019.stdout: "heartbeat_interval": "5", 2024-09-12T22:31:55.235 INFO:teuthology.orchestra.run.smithi019.stdout: "host": "smithi019", 2024-09-12T22:31:55.235 INFO:teuthology.orchestra.run.smithi019.stdout: "immutable_object_cache_client_dedicated_thread_num": "2", 2024-09-12T22:31:55.235 INFO:teuthology.orchestra.run.smithi019.stdout: "immutable_object_cache_max_inflight_ops": "128", 2024-09-12T22:31:55.235 INFO:teuthology.orchestra.run.smithi019.stdout: "immutable_object_cache_max_size": "1073741824", 2024-09-12T22:31:55.235 INFO:teuthology.orchestra.run.smithi019.stdout: "immutable_object_cache_path": "/tmp/ceph_immutable_object_cache", 2024-09-12T22:31:55.235 INFO:teuthology.orchestra.run.smithi019.stdout: "immutable_object_cache_qos_bps_burst": "0", 2024-09-12T22:31:55.235 INFO:teuthology.orchestra.run.smithi019.stdout: "immutable_object_cache_qos_bps_burst_seconds": "1", 2024-09-12T22:31:55.235 INFO:teuthology.orchestra.run.smithi019.stdout: "immutable_object_cache_qos_bps_limit": "0", 2024-09-12T22:31:55.235 INFO:teuthology.orchestra.run.smithi019.stdout: "immutable_object_cache_qos_iops_burst": "0", 2024-09-12T22:31:55.235 INFO:teuthology.orchestra.run.smithi019.stdout: "immutable_object_cache_qos_iops_burst_seconds": "1", 2024-09-12T22:31:55.235 INFO:teuthology.orchestra.run.smithi019.stdout: "immutable_object_cache_qos_iops_limit": "0", 2024-09-12T22:31:55.235 INFO:teuthology.orchestra.run.smithi019.stdout: "immutable_object_cache_qos_schedule_tick_min": "50", 2024-09-12T22:31:55.236 INFO:teuthology.orchestra.run.smithi019.stdout: "immutable_object_cache_sock": "/var/run/ceph/immutable_object_cache_sock", 2024-09-12T22:31:55.236 INFO:teuthology.orchestra.run.smithi019.stdout: "immutable_object_cache_watermark": "0.900000", 2024-09-12T22:31:55.236 INFO:teuthology.orchestra.run.smithi019.stdout: "inject_early_sigterm": "false", 2024-09-12T22:31:55.236 INFO:teuthology.orchestra.run.smithi019.stdout: "jaeger_agent_port": "6799", 2024-09-12T22:31:55.236 INFO:teuthology.orchestra.run.smithi019.stdout: "jaeger_tracing_enable": "false", 2024-09-12T22:31:55.236 INFO:teuthology.orchestra.run.smithi019.stdout: "journal_aio": "true", 2024-09-12T22:31:55.236 INFO:teuthology.orchestra.run.smithi019.stdout: "journal_align_min_size": "65536", 2024-09-12T22:31:55.236 INFO:teuthology.orchestra.run.smithi019.stdout: "journal_block_align": "true", 2024-09-12T22:31:55.236 INFO:teuthology.orchestra.run.smithi019.stdout: "journal_block_size": "4096", 2024-09-12T22:31:55.236 INFO:teuthology.orchestra.run.smithi019.stdout: "journal_dio": "true", 2024-09-12T22:31:55.236 INFO:teuthology.orchestra.run.smithi019.stdout: "journal_discard": "false", 2024-09-12T22:31:55.236 INFO:teuthology.orchestra.run.smithi019.stdout: "journal_force_aio": "false", 2024-09-12T22:31:55.236 INFO:teuthology.orchestra.run.smithi019.stdout: "journal_ignore_corruption": "false", 2024-09-12T22:31:55.237 INFO:teuthology.orchestra.run.smithi019.stdout: "journal_max_write_bytes": "10485760", 2024-09-12T22:31:55.237 INFO:teuthology.orchestra.run.smithi019.stdout: "journal_max_write_entries": "100", 2024-09-12T22:31:55.237 INFO:teuthology.orchestra.run.smithi019.stdout: "journal_replay_from": "0", 2024-09-12T22:31:55.237 INFO:teuthology.orchestra.run.smithi019.stdout: "journal_throttle_high_multiple": "0.000000", 2024-09-12T22:31:55.237 INFO:teuthology.orchestra.run.smithi019.stdout: "journal_throttle_high_threshhold": "0.900000", 2024-09-12T22:31:55.237 INFO:teuthology.orchestra.run.smithi019.stdout: "journal_throttle_low_threshhold": "0.600000", 2024-09-12T22:31:55.237 INFO:teuthology.orchestra.run.smithi019.stdout: "journal_throttle_max_multiple": "0.000000", 2024-09-12T22:31:55.237 INFO:teuthology.orchestra.run.smithi019.stdout: "journal_write_header_frequency": "0", 2024-09-12T22:31:55.237 INFO:teuthology.orchestra.run.smithi019.stdout: "journal_zero_on_create": "false", 2024-09-12T22:31:55.237 INFO:teuthology.orchestra.run.smithi019.stdout: "journaler_prefetch_periods": "10", 2024-09-12T22:31:55.237 INFO:teuthology.orchestra.run.smithi019.stdout: "journaler_prezero_periods": "5", 2024-09-12T22:31:55.237 INFO:teuthology.orchestra.run.smithi019.stdout: "journaler_write_head_interval": "15", 2024-09-12T22:31:55.237 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "", 2024-09-12T22:31:55.237 INFO:teuthology.orchestra.run.smithi019.stdout: "keyfile": "", 2024-09-12T22:31:55.238 INFO:teuthology.orchestra.run.smithi019.stdout: "keyring": "/var/lib/ceph/mon/ceph-a/keyring", 2024-09-12T22:31:55.238 INFO:teuthology.orchestra.run.smithi019.stdout: "kstore_backend": "rocksdb", 2024-09-12T22:31:55.238 INFO:teuthology.orchestra.run.smithi019.stdout: "kstore_default_stripe_size": "65536", 2024-09-12T22:31:55.238 INFO:teuthology.orchestra.run.smithi019.stdout: "kstore_fsck_on_mount": "false", 2024-09-12T22:31:55.238 INFO:teuthology.orchestra.run.smithi019.stdout: "kstore_fsck_on_mount_deep": "true", 2024-09-12T22:31:55.238 INFO:teuthology.orchestra.run.smithi019.stdout: "kstore_max_bytes": "67108864", 2024-09-12T22:31:55.238 INFO:teuthology.orchestra.run.smithi019.stdout: "kstore_max_ops": "512", 2024-09-12T22:31:55.238 INFO:teuthology.orchestra.run.smithi019.stdout: "kstore_nid_prealloc": "1024", 2024-09-12T22:31:55.238 INFO:teuthology.orchestra.run.smithi019.stdout: "kstore_onode_map_size": "1024", 2024-09-12T22:31:55.238 INFO:teuthology.orchestra.run.smithi019.stdout: "kstore_rocksdb_options": "compression=kNoCompression", 2024-09-12T22:31:55.239 INFO:teuthology.orchestra.run.smithi019.stdout: "kstore_sync_submit_transaction": "false", 2024-09-12T22:31:55.239 INFO:teuthology.orchestra.run.smithi019.stdout: "kstore_sync_transaction": "false", 2024-09-12T22:31:55.239 INFO:teuthology.orchestra.run.smithi019.stdout: "librados_thread_count": "2", 2024-09-12T22:31:55.239 INFO:teuthology.orchestra.run.smithi019.stdout: "lockdep": "false", 2024-09-12T22:31:55.239 INFO:teuthology.orchestra.run.smithi019.stdout: "lockdep_force_backtrace": "false", 2024-09-12T22:31:55.239 INFO:teuthology.orchestra.run.smithi019.stdout: "log_coarse_timestamps": "true", 2024-09-12T22:31:55.239 INFO:teuthology.orchestra.run.smithi019.stdout: "log_file": "/var/log/ceph/ceph-mon.a.log", 2024-09-12T22:31:55.239 INFO:teuthology.orchestra.run.smithi019.stdout: "log_flush_on_exit": "false", 2024-09-12T22:31:55.239 INFO:teuthology.orchestra.run.smithi019.stdout: "log_graylog_host": "127.0.0.1", 2024-09-12T22:31:55.239 INFO:teuthology.orchestra.run.smithi019.stdout: "log_graylog_port": "12201", 2024-09-12T22:31:55.240 INFO:teuthology.orchestra.run.smithi019.stdout: "log_max_new": "1000", 2024-09-12T22:31:55.240 INFO:teuthology.orchestra.run.smithi019.stdout: "log_max_recent": "10000", 2024-09-12T22:31:55.240 INFO:teuthology.orchestra.run.smithi019.stdout: "log_stderr_prefix": "", 2024-09-12T22:31:55.240 INFO:teuthology.orchestra.run.smithi019.stdout: "log_stop_at_utilization": "0.970000", 2024-09-12T22:31:55.240 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": "true", 2024-09-12T22:31:55.240 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_graylog": "false", 2024-09-12T22:31:55.240 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_journald": "false", 2024-09-12T22:31:55.240 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_stderr": "false", 2024-09-12T22:31:55.240 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_syslog": "false", 2024-09-12T22:31:55.240 INFO:teuthology.orchestra.run.smithi019.stdout: "max_rotating_auth_attempts": "10", 2024-09-12T22:31:55.240 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_abort_on_newly_corrupt_dentry": "true", 2024-09-12T22:31:55.240 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_action_on_write_error": "1", 2024-09-12T22:31:55.240 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_alternate_name_max": "8192", 2024-09-12T22:31:55.241 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_asio_thread_count": "2", 2024-09-12T22:31:55.241 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_bal_export_pin": "true", 2024-09-12T22:31:55.241 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_bal_fragment_dirs": "true", 2024-09-12T22:31:55.241 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_bal_fragment_fast_factor": "1.500000", 2024-09-12T22:31:55.241 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_bal_fragment_interval": "5", 2024-09-12T22:31:55.241 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_bal_fragment_size_max": "100000", 2024-09-12T22:31:55.241 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_bal_idle_threshold": "0.000000", 2024-09-12T22:31:55.241 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_bal_interval": "10", 2024-09-12T22:31:55.241 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_bal_max": "-1", 2024-09-12T22:31:55.241 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_bal_max_until": "-1", 2024-09-12T22:31:55.241 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_bal_merge_size": "50", 2024-09-12T22:31:55.241 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_bal_midchunk": "0.300000", 2024-09-12T22:31:55.241 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_bal_min_rebalance": "0.100000", 2024-09-12T22:31:55.242 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_bal_min_start": "0.200000", 2024-09-12T22:31:55.242 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_bal_minchunk": "0.001000", 2024-09-12T22:31:55.242 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_bal_mode": "0", 2024-09-12T22:31:55.242 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_bal_need_max": "1.200000", 2024-09-12T22:31:55.242 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_bal_need_min": "0.800000", 2024-09-12T22:31:55.242 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_bal_overload_epochs": "2", 2024-09-12T22:31:55.242 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_bal_replicate_threshold": "8000.000000", 2024-09-12T22:31:55.242 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_bal_sample_interval": "3.000000", 2024-09-12T22:31:55.242 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_bal_split_bits": "3", 2024-09-12T22:31:55.242 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_bal_split_rd": "25000.000000", 2024-09-12T22:31:55.242 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_bal_split_size": "10000", 2024-09-12T22:31:55.242 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_bal_split_wr": "10000.000000", 2024-09-12T22:31:55.242 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_bal_target_decay": "10.000000", 2024-09-12T22:31:55.243 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_bal_unreplicate_threshold": "0.000000", 2024-09-12T22:31:55.243 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_beacon_grace": "15.000000", 2024-09-12T22:31:55.243 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_beacon_interval": "4.000000", 2024-09-12T22:31:55.243 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_beacon_mon_down_grace": "60", 2024-09-12T22:31:55.243 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_cache_memory_limit": "4294967296", 2024-09-12T22:31:55.243 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_cache_mid": "0.700000", 2024-09-12T22:31:55.243 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_cache_quiesce_decay_rate": "1.000000", 2024-09-12T22:31:55.243 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_cache_quiesce_delay": "0", 2024-09-12T22:31:55.243 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_cache_quiesce_sleep": "200", 2024-09-12T22:31:55.243 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_cache_quiesce_splitauth": "true", 2024-09-12T22:31:55.243 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_cache_quiesce_threshold": "524288", 2024-09-12T22:31:55.243 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_cache_release_free_interval": "10", 2024-09-12T22:31:55.243 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_cache_reservation": "0.050000", 2024-09-12T22:31:55.244 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_cache_trim_decay_rate": "1.000000", 2024-09-12T22:31:55.244 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_cache_trim_interval": "1", 2024-09-12T22:31:55.244 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_cache_trim_threshold": "262144", 2024-09-12T22:31:55.244 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_cap_acquisition_throttle_retry_request_timeout": "0.500000", 2024-09-12T22:31:55.244 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_cap_revoke_eviction_timeout": "0.000000", 2024-09-12T22:31:55.244 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_client_delegate_inos_pct": "50", 2024-09-12T22:31:55.244 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_client_prealloc_inos": "1000", 2024-09-12T22:31:55.244 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_client_writeable_range_max_inc_objs": "1024", 2024-09-12T22:31:55.244 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_connect_bootstrapping": "false", 2024-09-12T22:31:55.244 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_damage_table_max_entries": "10000", 2024-09-12T22:31:55.244 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_data": "/var/lib/ceph/mds/ceph-a", 2024-09-12T22:31:55.244 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_debug_auth_pins": "false", 2024-09-12T22:31:55.244 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_debug_frag": "false", 2024-09-12T22:31:55.245 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_debug_scatterstat": "false", 2024-09-12T22:31:55.245 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_debug_subtrees": "false", 2024-09-12T22:31:55.245 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_decay_halflife": "5.000000", 2024-09-12T22:31:55.245 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_default_dir_hash": "2", 2024-09-12T22:31:55.245 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_defer_session_stale": "true", 2024-09-12T22:31:55.245 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_deny_all_reconnect": "false", 2024-09-12T22:31:55.245 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_dir_keys_per_op": "16384", 2024-09-12T22:31:55.245 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_dir_max_commit_size": "10", 2024-09-12T22:31:55.245 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_dir_max_entries": "0", 2024-09-12T22:31:55.245 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_dir_prefetch": "true", 2024-09-12T22:31:55.245 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_dirstat_min_interval": "1.000000", 2024-09-12T22:31:55.245 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_dump_cache_after_rejoin": "false", 2024-09-12T22:31:55.245 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_dump_cache_on_map": "false", 2024-09-12T22:31:55.246 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_dump_cache_threshold_file": "0", 2024-09-12T22:31:55.246 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_dump_cache_threshold_formatter": "1073741824", 2024-09-12T22:31:55.246 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_early_reply": "true", 2024-09-12T22:31:55.246 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_enable_op_tracker": "true", 2024-09-12T22:31:55.246 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_enforce_unique_name": "true", 2024-09-12T22:31:55.246 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_export_ephemeral_distributed": "true", 2024-09-12T22:31:55.246 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_export_ephemeral_distributed_factor": "2.000000", 2024-09-12T22:31:55.246 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_export_ephemeral_random": "true", 2024-09-12T22:31:55.246 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_export_ephemeral_random_max": "0.010000", 2024-09-12T22:31:55.246 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_extraordinary_events_dump_interval": "0", 2024-09-12T22:31:55.246 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_forward_all_requests_to_auth": "false", 2024-09-12T22:31:55.246 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_freeze_tree_timeout": "30.000000", 2024-09-12T22:31:55.246 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_fscrypt_last_block_max_size": "4096", 2024-09-12T22:31:55.247 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_go_bad_corrupt_dentry": "true", 2024-09-12T22:31:55.247 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_hack_allow_loading_invalid_metadata": "false", 2024-09-12T22:31:55.247 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_health_cache_threshold": "1.500000", 2024-09-12T22:31:55.247 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_health_summarize_threshold": "10", 2024-09-12T22:31:55.247 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_heartbeat_grace": "15.000000", 2024-09-12T22:31:55.247 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_heartbeat_reset_grace": "1000", 2024-09-12T22:31:55.247 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_inject_health_dummy": "false", 2024-09-12T22:31:55.247 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_inject_journal_corrupt_dentry_first": "0.000000", 2024-09-12T22:31:55.247 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_inject_migrator_session_race": "false", 2024-09-12T22:31:55.248 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_inject_rename_corrupt_dentry_first": "0.000000", 2024-09-12T22:31:55.248 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_inject_skip_replaying_inotable": "false", 2024-09-12T22:31:55.248 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_inject_traceless_reply_probability": "0.000000", 2024-09-12T22:31:55.248 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_join_fs": "", 2024-09-12T22:31:55.248 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_journal_format": "1", 2024-09-12T22:31:55.248 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_kill_after_journal_logs_flushed": "false", 2024-09-12T22:31:55.248 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_kill_create_at": "0", 2024-09-12T22:31:55.248 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_kill_export_at": "0", 2024-09-12T22:31:55.248 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_kill_import_at": "0", 2024-09-12T22:31:55.248 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_kill_journal_at": "0", 2024-09-12T22:31:55.248 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_kill_journal_expire_at": "0", 2024-09-12T22:31:55.249 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_kill_journal_replay_at": "0", 2024-09-12T22:31:55.249 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_kill_link_at": "0", 2024-09-12T22:31:55.249 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_kill_mdstable_at": "0", 2024-09-12T22:31:55.249 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_kill_openc_at": "0", 2024-09-12T22:31:55.249 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_kill_rename_at": "0", 2024-09-12T22:31:55.249 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_kill_shutdown_at": "0", 2024-09-12T22:31:55.249 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_log_event_large_threshold": "524288", 2024-09-12T22:31:55.249 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_log_events_per_segment": "1024", 2024-09-12T22:31:55.249 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_log_major_segment_event_ratio": "12", 2024-09-12T22:31:55.249 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_log_max_events": "-1", 2024-09-12T22:31:55.249 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_log_max_segments": "128", 2024-09-12T22:31:55.250 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_log_pause": "false", 2024-09-12T22:31:55.250 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_log_segment_size": "0", 2024-09-12T22:31:55.250 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_log_skip_corrupt_events": "false", 2024-09-12T22:31:55.250 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_log_skip_unbounded_events": "false", 2024-09-12T22:31:55.250 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_log_trim_decay_rate": "1.000000", 2024-09-12T22:31:55.250 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_log_trim_threshold": "128", 2024-09-12T22:31:55.250 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_log_trim_upkeep_interval": "1000", 2024-09-12T22:31:55.250 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_log_warn_factor": "2.000000", 2024-09-12T22:31:55.250 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_max_caps_per_client": "1048576", 2024-09-12T22:31:55.250 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_max_completed_flushes": "100000", 2024-09-12T22:31:55.250 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_max_completed_requests": "100000", 2024-09-12T22:31:55.250 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_max_export_size": "20971520", 2024-09-12T22:31:55.250 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_max_file_recover": "32", 2024-09-12T22:31:55.251 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_max_purge_files": "64", 2024-09-12T22:31:55.251 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_max_purge_ops": "8192", 2024-09-12T22:31:55.251 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_max_purge_ops_per_pg": "0.500000", 2024-09-12T22:31:55.251 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_max_scrub_ops_in_progress": "5", 2024-09-12T22:31:55.251 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_max_snaps_per_dir": "100", 2024-09-12T22:31:55.251 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_metrics_update_interval": "2", 2024-09-12T22:31:55.251 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_min_caps_per_client": "100", 2024-09-12T22:31:55.251 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_min_caps_working_set": "10000", 2024-09-12T22:31:55.251 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_mon_shutdown_timeout": "5.000000", 2024-09-12T22:31:55.251 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_numa_node": "-1", 2024-09-12T22:31:55.251 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_oft_prefetch_dirfrags": "false", 2024-09-12T22:31:55.251 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_op_complaint_time": "30.000000", 2024-09-12T22:31:55.251 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_op_history_duration": "600", 2024-09-12T22:31:55.252 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_op_history_size": "20", 2024-09-12T22:31:55.252 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_op_history_slow_op_size": "20", 2024-09-12T22:31:55.252 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_op_history_slow_op_threshold": "10", 2024-09-12T22:31:55.252 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_op_log_threshold": "5", 2024-09-12T22:31:55.252 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_ping_grace": "15", 2024-09-12T22:31:55.252 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_ping_interval": "5", 2024-09-12T22:31:55.252 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_purge_queue_busy_flush_period": "1.000000", 2024-09-12T22:31:55.252 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_recall_global_max_decay_threshold": "131072", 2024-09-12T22:31:55.252 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_recall_max_caps": "30000", 2024-09-12T22:31:55.252 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_recall_max_decay_rate": "1.500000", 2024-09-12T22:31:55.252 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_recall_max_decay_threshold": "131072", 2024-09-12T22:31:55.252 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_recall_warning_decay_rate": "60.000000", 2024-09-12T22:31:55.252 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_recall_warning_threshold": "262144", 2024-09-12T22:31:55.253 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_reconnect_timeout": "45.000000", 2024-09-12T22:31:55.253 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_replay_interval": "1.000000", 2024-09-12T22:31:55.253 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_replay_unsafe_with_closed_session": "false", 2024-09-12T22:31:55.253 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_request_load_average_decay_rate": "60.000000", 2024-09-12T22:31:55.253 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_root_ino_gid": "0", 2024-09-12T22:31:55.253 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_root_ino_uid": "0", 2024-09-12T22:31:55.253 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_scatter_nudge_interval": "5.000000", 2024-09-12T22:31:55.253 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_session_blocklist_on_evict": "true", 2024-09-12T22:31:55.253 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_session_blocklist_on_timeout": "true", 2024-09-12T22:31:55.253 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_session_cache_liveness_decay_rate": "300.000000", 2024-09-12T22:31:55.253 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_session_cache_liveness_magnitude": "10", 2024-09-12T22:31:55.254 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_session_cap_acquisition_decay_rate": "30.000000", 2024-09-12T22:31:55.254 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_session_cap_acquisition_throttle": "100000", 2024-09-12T22:31:55.254 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_session_max_caps_throttle_ratio": "1.100000", 2024-09-12T22:31:55.254 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_session_metadata_threshold": "16777216", 2024-09-12T22:31:55.254 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_sessionmap_keys_per_op": "1024", 2024-09-12T22:31:55.254 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_shutdown_check": "0", 2024-09-12T22:31:55.254 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_skip_ino": "0", 2024-09-12T22:31:55.254 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_sleep_rank_change": "0.000000", 2024-09-12T22:31:55.254 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_snap_max_uid": "4294967294", 2024-09-12T22:31:55.254 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_snap_min_uid": "0", 2024-09-12T22:31:55.254 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_snap_rstat": "false", 2024-09-12T22:31:55.254 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_standby_replay_damaged": "false", 2024-09-12T22:31:55.254 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_symlink_recovery": "true", 2024-09-12T22:31:55.255 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_task_status_update_interval": "2.000000", 2024-09-12T22:31:55.255 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_thrash_exports": "0", 2024-09-12T22:31:55.255 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_thrash_fragments": "0", 2024-09-12T22:31:55.255 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_tick_interval": "5.000000", 2024-09-12T22:31:55.255 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_valgrind_exit": "false", 2024-09-12T22:31:55.255 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_verify_backtrace": "1", 2024-09-12T22:31:55.255 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_verify_scatter": "false", 2024-09-12T22:31:55.255 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_wipe_ino_prealloc": "false", 2024-09-12T22:31:55.255 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_wipe_sessions": "false", 2024-09-12T22:31:55.255 INFO:teuthology.orchestra.run.smithi019.stdout: "mempool_debug": "false", 2024-09-12T22:31:55.255 INFO:teuthology.orchestra.run.smithi019.stdout: "memstore_debug_omit_block_device_write": "false", 2024-09-12T22:31:55.255 INFO:teuthology.orchestra.run.smithi019.stdout: "memstore_device_bytes": "1073741824", 2024-09-12T22:31:55.255 INFO:teuthology.orchestra.run.smithi019.stdout: "memstore_page_set": "false", 2024-09-12T22:31:55.255 INFO:teuthology.orchestra.run.smithi019.stdout: "memstore_page_size": "65536", 2024-09-12T22:31:55.256 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr_client_bytes": "134217728", 2024-09-12T22:31:55.256 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr_client_messages": "512", 2024-09-12T22:31:55.256 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr_client_service_daemon_unregister_timeout": "1.000000", 2024-09-12T22:31:55.256 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr_connect_retry_interval": "1.000000", 2024-09-12T22:31:55.256 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr_data": "/var/lib/ceph/mgr/ceph-a", 2024-09-12T22:31:55.256 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr_debug_aggressive_pg_num_changes": "false", 2024-09-12T22:31:55.256 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr_disabled_modules": "", 2024-09-12T22:31:55.256 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr_enable_op_tracker": "true", 2024-09-12T22:31:55.256 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr_initial_modules": "restful iostat nfs", 2024-09-12T22:31:55.256 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr_max_pg_num_change": "128", 2024-09-12T22:31:55.256 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr_mds_bytes": "134217728", 2024-09-12T22:31:55.256 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr_mds_messages": "128", 2024-09-12T22:31:55.257 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr_module_path": "/usr/share/ceph/mgr", 2024-09-12T22:31:55.257 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr_mon_bytes": "134217728", 2024-09-12T22:31:55.257 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr_mon_messages": "128", 2024-09-12T22:31:55.257 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr_num_op_tracker_shard": "32", 2024-09-12T22:31:55.257 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr_op_complaint_time": "30.000000", 2024-09-12T22:31:55.257 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr_op_history_duration": "600", 2024-09-12T22:31:55.257 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr_op_history_size": "20", 2024-09-12T22:31:55.257 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr_op_history_slow_op_size": "20", 2024-09-12T22:31:55.257 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr_op_history_slow_op_threshold": "10.000000", 2024-09-12T22:31:55.257 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr_op_log_threshold": "5", 2024-09-12T22:31:55.257 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr_osd_bytes": "536870912", 2024-09-12T22:31:55.257 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr_osd_messages": "8192", 2024-09-12T22:31:55.258 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr_pool": "true", 2024-09-12T22:31:55.258 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr_service_beacon_grace": "60.000000", 2024-09-12T22:31:55.258 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr_standby_modules": "true", 2024-09-12T22:31:55.258 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr_stats_period": "5", 2024-09-12T22:31:55.258 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr_stats_threshold": "5", 2024-09-12T22:31:55.258 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr_tick_period": "2", 2024-09-12T22:31:55.258 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr_ttl_cache_expire_seconds": "0", 2024-09-12T22:31:55.258 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_accept_timeout_factor": "2.000000", 2024-09-12T22:31:55.258 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_allow_pool_delete": "true", 2024-09-12T22:31:55.259 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_allow_pool_size_one": "true", 2024-09-12T22:31:55.259 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_auth_validate_all_caps": "true", 2024-09-12T22:31:55.259 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_cache_target_full_warn_ratio": "0.660000", 2024-09-12T22:31:55.259 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_clean_pg_upmaps_per_chunk": "256", 2024-09-12T22:31:55.259 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_client_bytes": "104857600", 2024-09-12T22:31:55.259 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_client_directed_command_retry": "2", 2024-09-12T22:31:55.259 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_client_hunt_interval": "3.000000", 2024-09-12T22:31:55.259 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_client_hunt_interval_backoff": "1.500000", 2024-09-12T22:31:55.259 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_client_hunt_interval_max_multiple": "10.000000", 2024-09-12T22:31:55.259 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_client_hunt_interval_min_multiple": "1.000000", 2024-09-12T22:31:55.259 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_client_hunt_parallel": "3", 2024-09-12T22:31:55.259 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_client_log_interval": "1.000000", 2024-09-12T22:31:55.260 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_client_max_log_entries_per_message": "1000", 2024-09-12T22:31:55.260 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_client_ping_interval": "10.000000", 2024-09-12T22:31:55.260 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_client_ping_timeout": "30.000000", 2024-09-12T22:31:55.260 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_client_target_rank": "-1", 2024-09-12T22:31:55.260 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_clock_drift_allowed": "1.000000", 2024-09-12T22:31:55.260 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_clock_drift_warn_backoff": "5.000000", 2024-09-12T22:31:55.260 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_cluster_log_file": "default=/var/log/ceph/ceph.$channel.log cluster=/var/log/ceph/ceph.log", 2024-09-12T22:31:55.260 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_cluster_log_file_level": "debug", 2024-09-12T22:31:55.260 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_cluster_log_to_file": "true", 2024-09-12T22:31:55.260 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_cluster_log_to_graylog": "false", 2024-09-12T22:31:55.260 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_cluster_log_to_graylog_host": "127.0.0.1", 2024-09-12T22:31:55.260 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_cluster_log_to_graylog_port": "12201", 2024-09-12T22:31:55.260 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_cluster_log_to_journald": "false", 2024-09-12T22:31:55.261 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_cluster_log_to_stderr": "false", 2024-09-12T22:31:55.261 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_cluster_log_to_syslog": "default=false", 2024-09-12T22:31:55.261 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_cluster_log_to_syslog_facility": "daemon", 2024-09-12T22:31:55.261 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_cluster_log_to_syslog_level": "info", 2024-09-12T22:31:55.261 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_compact_on_bootstrap": "false", 2024-09-12T22:31:55.261 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_compact_on_start": "false", 2024-09-12T22:31:55.261 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_compact_on_trim": "true", 2024-09-12T22:31:55.261 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_con_tracker_persist_interval": "10", 2024-09-12T22:31:55.261 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_con_tracker_score_halflife": "43200", 2024-09-12T22:31:55.261 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_config_key_max_entry_size": "65536", 2024-09-12T22:31:55.261 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_cpu_threads": "4", 2024-09-12T22:31:55.261 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_crush_min_required_version": "hammer", 2024-09-12T22:31:55.262 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_daemon_bytes": "419430400", 2024-09-12T22:31:55.262 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_data": "/var/lib/ceph/mon/ceph-a", 2024-09-12T22:31:55.262 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_data_avail_crit": "5", 2024-09-12T22:31:55.262 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_data_avail_warn": "5", 2024-09-12T22:31:55.262 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_data_size_warn": "16106127360", 2024-09-12T22:31:55.262 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_debug_block_osdmap_trim": "false", 2024-09-12T22:31:55.262 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_debug_deprecated_as_obsolete": "false", 2024-09-12T22:31:55.262 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_debug_dump_json": "false", 2024-09-12T22:31:55.262 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_debug_dump_location": "/var/log/ceph/ceph-mon.a.tdump", 2024-09-12T22:31:55.262 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_debug_dump_transactions": "false", 2024-09-12T22:31:55.262 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_debug_extra_checks": "false", 2024-09-12T22:31:55.262 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_debug_no_initial_persistent_features": "false", 2024-09-12T22:31:55.262 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_debug_no_require_bluestore_for_ec_overwrites": "false", 2024-09-12T22:31:55.263 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_debug_no_require_reef": "false", 2024-09-12T22:31:55.263 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_debug_no_require_squid": "false", 2024-09-12T22:31:55.263 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_debug_unsafe_allow_tier_with_nonempty_snaps": "false", 2024-09-12T22:31:55.263 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_delta_reset_interval": "10.000000", 2024-09-12T22:31:55.263 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_dns_srv_name": "ceph-mon", 2024-09-12T22:31:55.263 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_down_mkfs_grace": "120", 2024-09-12T22:31:55.263 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_down_uptime_grace": "60", 2024-09-12T22:31:55.263 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_election_default_strategy": "1", 2024-09-12T22:31:55.263 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_election_timeout": "5.000000", 2024-09-12T22:31:55.263 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_elector_ignore_propose_margin": "0.000500", 2024-09-12T22:31:55.263 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_elector_ping_divisor": "2", 2024-09-12T22:31:55.263 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_elector_ping_timeout": "2.000000", 2024-09-12T22:31:55.263 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_enable_op_tracker": "true", 2024-09-12T22:31:55.264 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_fake_pool_delete": "false", 2024-09-12T22:31:55.264 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_force_quorum_join": "false", 2024-09-12T22:31:55.264 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_fsmap_prune_threshold": "300", 2024-09-12T22:31:55.264 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_globalid_prealloc": "10000", 2024-09-12T22:31:55.264 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_health_detail_to_clog": "false", 2024-09-12T22:31:55.264 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_health_log_update_period": "5", 2024-09-12T22:31:55.264 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_health_max_detail": "50", 2024-09-12T22:31:55.264 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_health_to_clog": "true", 2024-09-12T22:31:55.264 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_health_to_clog_interval": "600", 2024-09-12T22:31:55.264 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_health_to_clog_tick_interval": "60.000000", 2024-09-12T22:31:55.265 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_host": "172.21.15.19,[v2:172.21.15.19:3301,v1:172.21.15.19:6790],[v2:172.21.15.19:3302,v1:172.21.15.19:6791]", 2024-09-12T22:31:55.265 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_host_override": "", 2024-09-12T22:31:55.265 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_initial_members": "", 2024-09-12T22:31:55.265 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_inject_pg_merge_bounce_probability": "0.000000", 2024-09-12T22:31:55.265 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_inject_sync_get_chunk_delay": "0.000000", 2024-09-12T22:31:55.265 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_inject_transaction_delay_max": "10.000000", 2024-09-12T22:31:55.265 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_inject_transaction_delay_probability": "0.000000", 2024-09-12T22:31:55.266 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_keyvaluedb": "rocksdb", 2024-09-12T22:31:55.266 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_lease": "5.000000", 2024-09-12T22:31:55.266 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_lease_ack_timeout_factor": "2.000000", 2024-09-12T22:31:55.266 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_lease_renew_interval_factor": "0.600000", 2024-09-12T22:31:55.266 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_log_full_interval": "50", 2024-09-12T22:31:55.266 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_log_max": "10000", 2024-09-12T22:31:55.266 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_log_max_summary": "50", 2024-09-12T22:31:55.267 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_max_log_entries_per_event": "4096", 2024-09-12T22:31:55.267 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_max_log_epochs": "500", 2024-09-12T22:31:55.267 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_max_mdsmap_epochs": "500", 2024-09-12T22:31:55.267 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_max_mgrmap_epochs": "500", 2024-09-12T22:31:55.267 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_max_osd": "10000", 2024-09-12T22:31:55.267 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_max_pg_per_osd": "10000", 2024-09-12T22:31:55.267 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_max_pool_pg_num": "65536", 2024-09-12T22:31:55.267 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_max_snap_prune_per_epoch": "100", 2024-09-12T22:31:55.267 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_mds_blocklist_interval": "86400.000000", 2024-09-12T22:31:55.267 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_mds_force_trim_to": "0", 2024-09-12T22:31:55.267 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_mds_skip_sanity": "false", 2024-09-12T22:31:55.267 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_memory_autotune": "true", 2024-09-12T22:31:55.267 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_memory_target": "2147483648", 2024-09-12T22:31:55.268 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_mgr_beacon_grace": "30", 2024-09-12T22:31:55.268 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_mgr_blocklist_interval": "86400.000000", 2024-09-12T22:31:55.268 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_mgr_digest_period": "5", 2024-09-12T22:31:55.268 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_mgr_inactive_grace": "60", 2024-09-12T22:31:55.268 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_mgr_mkfs_grace": "240", 2024-09-12T22:31:55.268 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_mgr_proxy_client_bytes_ratio": "0.300000", 2024-09-12T22:31:55.268 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_min_osdmap_epochs": "500", 2024-09-12T22:31:55.268 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_op_complaint_time": "30", 2024-09-12T22:31:55.268 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_op_history_duration": "600", 2024-09-12T22:31:55.269 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_op_history_size": "20", 2024-09-12T22:31:55.269 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_op_history_slow_op_size": "20", 2024-09-12T22:31:55.269 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_op_history_slow_op_threshold": "10", 2024-09-12T22:31:55.269 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_op_log_threshold": "5", 2024-09-12T22:31:55.269 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_adjust_down_out_interval": "true", 2024-09-12T22:31:55.269 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_adjust_heartbeat_grace": "true", 2024-09-12T22:31:55.269 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_auto_mark_auto_out_in": "true", 2024-09-12T22:31:55.269 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_auto_mark_in": "false", 2024-09-12T22:31:55.269 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_auto_mark_new_in": "true", 2024-09-12T22:31:55.269 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_backfillfull_ratio": "0.900000", 2024-09-12T22:31:55.269 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_blocklist_default_expire": "3600.000000", 2024-09-12T22:31:55.269 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_cache_size": "500", 2024-09-12T22:31:55.270 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_cache_size_min": "134217728", 2024-09-12T22:31:55.270 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_crush_smoke_test": "true", 2024-09-12T22:31:55.270 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_destroyed_out_interval": "600", 2024-09-12T22:31:55.270 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_down_out_interval": "600", 2024-09-12T22:31:55.270 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_down_out_subtree_limit": "rack", 2024-09-12T22:31:55.270 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_err_op_age_ratio": "128.000000", 2024-09-12T22:31:55.270 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_force_trim_to": "0", 2024-09-12T22:31:55.270 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_full_ratio": "0.950000", 2024-09-12T22:31:55.270 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_initial_require_min_compat_client": "luminous", 2024-09-12T22:31:55.270 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_laggy_halflife": "3600", 2024-09-12T22:31:55.270 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_laggy_max_interval": "300", 2024-09-12T22:31:55.270 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_laggy_weight": "0.300000", 2024-09-12T22:31:55.270 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_mapping_pgs_per_chunk": "4096", 2024-09-12T22:31:55.270 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_max_creating_pgs": "1024", 2024-09-12T22:31:55.271 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_max_initial_pgs": "1024", 2024-09-12T22:31:55.271 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_min_down_reporters": "2", 2024-09-12T22:31:55.271 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_min_in_ratio": "0.750000", 2024-09-12T22:31:55.271 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_min_up_ratio": "0.300000", 2024-09-12T22:31:55.271 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_nearfull_ratio": "0.850000", 2024-09-12T22:31:55.271 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_prime_pg_temp": "true", 2024-09-12T22:31:55.271 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_prime_pg_temp_max_estimate": "0.250000", 2024-09-12T22:31:55.271 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_prime_pg_temp_max_time": "0.500000", 2024-09-12T22:31:55.271 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_report_timeout": "900", 2024-09-12T22:31:55.271 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_reporter_subtree_level": "osd", 2024-09-12T22:31:55.271 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_snap_trim_queue_warn_on": "32768", 2024-09-12T22:31:55.271 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_warn_num_repaired": "10", 2024-09-12T22:31:55.271 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osd_warn_op_age": "32.000000", 2024-09-12T22:31:55.271 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osdmap_full_prune_enabled": "true", 2024-09-12T22:31:55.272 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osdmap_full_prune_interval": "10", 2024-09-12T22:31:55.272 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osdmap_full_prune_min": "10000", 2024-09-12T22:31:55.272 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_osdmap_full_prune_txsize": "100", 2024-09-12T22:31:55.272 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_pg_check_down_all_threshold": "0.500000", 2024-09-12T22:31:55.272 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_pg_stuck_threshold": "60", 2024-09-12T22:31:55.272 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_pg_warn_max_object_skew": "0.000000", 2024-09-12T22:31:55.272 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_pg_warn_min_objects": "10000", 2024-09-12T22:31:55.272 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_pg_warn_min_per_osd": "0", 2024-09-12T22:31:55.272 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_pg_warn_min_pool_objects": "1000", 2024-09-12T22:31:55.273 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_pool_quota_crit_threshold": "0", 2024-09-12T22:31:55.273 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_pool_quota_warn_threshold": "0", 2024-09-12T22:31:55.273 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_probe_timeout": "2.000000", 2024-09-12T22:31:55.273 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_reweight_max_change": "0.050000", 2024-09-12T22:31:55.273 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_reweight_max_osds": "4", 2024-09-12T22:31:55.273 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_reweight_min_bytes_per_osd": "10", 2024-09-12T22:31:55.273 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_reweight_min_pgs_per_osd": "4", 2024-09-12T22:31:55.273 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_rocksdb_options": "write_buffer_size=33554432,compression=kNoCompression,level_compaction_dynamic_level_bytes=true", 2024-09-12T22:31:55.273 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_scrub_inject_crc_mismatch": "0.000000", 2024-09-12T22:31:55.273 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_scrub_inject_missing_keys": "0.000000", 2024-09-12T22:31:55.273 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_scrub_interval": "86400", 2024-09-12T22:31:55.273 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_scrub_max_keys": "100", 2024-09-12T22:31:55.274 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_scrub_timeout": "300", 2024-09-12T22:31:55.274 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_session_timeout": "300", 2024-09-12T22:31:55.274 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_smart_report_timeout": "5", 2024-09-12T22:31:55.274 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_stat_smooth_intervals": "6", 2024-09-12T22:31:55.274 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_stretch_cluster_recovery_ratio": "0.600000", 2024-09-12T22:31:55.274 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_stretch_pool_min_size": "2", 2024-09-12T22:31:55.274 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_stretch_pool_size": "4", 2024-09-12T22:31:55.274 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_stretch_recovery_min_wait": "15.000000", 2024-09-12T22:31:55.274 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_subscribe_interval": "86400.000000", 2024-09-12T22:31:55.274 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_sync_debug": "false", 2024-09-12T22:31:55.274 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_sync_max_payload_keys": "2000", 2024-09-12T22:31:55.274 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_sync_max_payload_size": "1048576", 2024-09-12T22:31:55.274 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_sync_provider_kill_at": "0", 2024-09-12T22:31:55.275 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_sync_requester_kill_at": "0", 2024-09-12T22:31:55.275 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_sync_timeout": "60.000000", 2024-09-12T22:31:55.275 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_target_pg_per_osd": "100", 2024-09-12T22:31:55.275 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_tick_interval": "5", 2024-09-12T22:31:55.275 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_timecheck_interval": "300.000000", 2024-09-12T22:31:55.275 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_timecheck_skew_interval": "30.000000", 2024-09-12T22:31:55.275 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_use_min_delay_socket": "false", 2024-09-12T22:31:55.275 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_warn_older_version_delay": "604800", 2024-09-12T22:31:55.275 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_warn_on_cache_pools_without_hit_sets": "true", 2024-09-12T22:31:55.275 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_warn_on_crush_straw_calc_version_zero": "false", 2024-09-12T22:31:55.275 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_warn_on_degraded_stretch_mode": "true", 2024-09-12T22:31:55.276 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_warn_on_filestore_osds": "false", 2024-09-12T22:31:55.276 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_warn_on_insecure_global_id_reclaim": "false", 2024-09-12T22:31:55.276 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed": "false", 2024-09-12T22:31:55.276 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_warn_on_legacy_crush_tunables": "false", 2024-09-12T22:31:55.276 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_warn_on_misplaced": "false", 2024-09-12T22:31:55.276 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_warn_on_msgr2_not_enabled": "true", 2024-09-12T22:31:55.276 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_warn_on_older_version": "true", 2024-09-12T22:31:55.276 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_warn_on_osd_down_out_interval_zero": "false", 2024-09-12T22:31:55.276 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_warn_on_pool_no_app": "true", 2024-09-12T22:31:55.276 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_warn_on_pool_no_redundancy": "false", 2024-09-12T22:31:55.276 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_warn_on_pool_pg_num_not_power_of_two": "false", 2024-09-12T22:31:55.276 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_warn_on_slow_ping_ratio": "0.050000", 2024-09-12T22:31:55.277 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_warn_on_slow_ping_time": "0.000000", 2024-09-12T22:31:55.277 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_warn_on_too_few_osds": "false", 2024-09-12T22:31:55.277 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_warn_pg_not_deep_scrubbed_ratio": "0.750000", 2024-09-12T22:31:55.277 INFO:teuthology.orchestra.run.smithi019.stdout: "mon_warn_pg_not_scrubbed_ratio": "0.500000", 2024-09-12T22:31:55.277 INFO:teuthology.orchestra.run.smithi019.stdout: "monmap": "", 2024-09-12T22:31:55.277 INFO:teuthology.orchestra.run.smithi019.stdout: "motr_admin_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-09-12T22:31:55.277 INFO:teuthology.orchestra.run.smithi019.stdout: "motr_admin_fid": "0x7200000000000001:0x0", 2024-09-12T22:31:55.277 INFO:teuthology.orchestra.run.smithi019.stdout: "motr_ha_endpoint": "192.168.180.182@tcp:12345:1:1", 2024-09-12T22:31:55.277 INFO:teuthology.orchestra.run.smithi019.stdout: "motr_my_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-09-12T22:31:55.277 INFO:teuthology.orchestra.run.smithi019.stdout: "motr_my_fid": "0x7200000000000001:0x0", 2024-09-12T22:31:55.277 INFO:teuthology.orchestra.run.smithi019.stdout: "motr_profile_fid": "0x7000000000000001:0x0", 2024-09-12T22:31:55.277 INFO:teuthology.orchestra.run.smithi019.stdout: "motr_tracing_enabled": "false", 2024-09-12T22:31:55.277 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_async_op_threads": "3", 2024-09-12T22:31:55.278 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_async_rdma_buffer_size": "131072", 2024-09-12T22:31:55.278 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_async_rdma_cm": "false", 2024-09-12T22:31:55.278 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_async_rdma_device_name": "", 2024-09-12T22:31:55.278 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_async_rdma_dscp": "96", 2024-09-12T22:31:55.278 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_async_rdma_enable_hugepage": "false", 2024-09-12T22:31:55.278 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_async_rdma_gid_idx": "0", 2024-09-12T22:31:55.278 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_async_rdma_local_gid": "", 2024-09-12T22:31:55.278 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_async_rdma_polling_us": "1000", 2024-09-12T22:31:55.278 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_async_rdma_port_num": "1", 2024-09-12T22:31:55.278 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_async_rdma_receive_buffers": "32768", 2024-09-12T22:31:55.278 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_async_rdma_receive_queue_len": "4096", 2024-09-12T22:31:55.278 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_async_rdma_roce_ver": "1", 2024-09-12T22:31:55.278 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_async_rdma_send_buffers": "1024", 2024-09-12T22:31:55.279 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_async_rdma_sl": "3", 2024-09-12T22:31:55.279 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_async_rdma_support_srq": "true", 2024-09-12T22:31:55.279 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_async_rdma_type": "ib", 2024-09-12T22:31:55.279 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_async_reap_threshold": "5", 2024-09-12T22:31:55.279 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_bind_before_connect": "false", 2024-09-12T22:31:55.279 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_bind_ipv4": "true", 2024-09-12T22:31:55.279 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_bind_ipv6": "false", 2024-09-12T22:31:55.279 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_bind_msgr1": "true", 2024-09-12T22:31:55.279 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_bind_msgr2": "true", 2024-09-12T22:31:55.279 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_bind_port_max": "7568", 2024-09-12T22:31:55.279 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_bind_port_min": "6800", 2024-09-12T22:31:55.279 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_bind_prefer_ipv4": "false", 2024-09-12T22:31:55.279 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_bind_retry_count": "3", 2024-09-12T22:31:55.280 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_bind_retry_delay": "5", 2024-09-12T22:31:55.280 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_blackhole_client": "false", 2024-09-12T22:31:55.280 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_blackhole_mds": "false", 2024-09-12T22:31:55.280 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_blackhole_mgr": "false", 2024-09-12T22:31:55.280 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_blackhole_mon": "false", 2024-09-12T22:31:55.280 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_blackhole_osd": "false", 2024-09-12T22:31:55.280 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_client_mode": "crc secure", 2024-09-12T22:31:55.280 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_cluster_mode": "crc secure", 2024-09-12T22:31:55.280 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_cluster_type": "", 2024-09-12T22:31:55.280 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_compress_secure": "false", 2024-09-12T22:31:55.280 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_connection_idle_timeout": "900", 2024-09-12T22:31:55.280 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_connection_ready_timeout": "10", 2024-09-12T22:31:55.280 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_crc_data": "true", 2024-09-12T22:31:55.281 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_crc_header": "true", 2024-09-12T22:31:55.281 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_die_on_bad_msg": "false", 2024-09-12T22:31:55.281 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_die_on_bug": "true", 2024-09-12T22:31:55.281 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_die_on_old_message": "true", 2024-09-12T22:31:55.281 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_die_on_skipped_message": "false", 2024-09-12T22:31:55.281 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_die_on_unhandled_msg": "false", 2024-09-12T22:31:55.281 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_dispatch_throttle_bytes": "104857600", 2024-09-12T22:31:55.281 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_dpdk_coremask": "0xF", 2024-09-12T22:31:55.281 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_dpdk_debug_allow_loopback": "false", 2024-09-12T22:31:55.281 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_dpdk_devs_allowlist": "", 2024-09-12T22:31:55.281 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_dpdk_enable_tso": "true", 2024-09-12T22:31:55.281 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_dpdk_gateway_ipv4_addr": "", 2024-09-12T22:31:55.281 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_dpdk_host_ipv4_addr": "", 2024-09-12T22:31:55.282 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_dpdk_hugepages": "", 2024-09-12T22:31:55.282 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_dpdk_hw_flow_control": "true", 2024-09-12T22:31:55.282 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_dpdk_hw_queue_weight": "1.000000", 2024-09-12T22:31:55.282 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_dpdk_lro": "true", 2024-09-12T22:31:55.282 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_dpdk_memory_channel": "4", 2024-09-12T22:31:55.282 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_dpdk_netmask_ipv4_addr": "", 2024-09-12T22:31:55.282 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_dpdk_pmd": "", 2024-09-12T22:31:55.282 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_dpdk_port_id": "0", 2024-09-12T22:31:55.283 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_dpdk_rx_buffer_count_per_core": "8192", 2024-09-12T22:31:55.283 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_dump_corrupt_message_level": "1", 2024-09-12T22:31:55.283 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_dump_on_send": "false", 2024-09-12T22:31:55.283 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_initial_backoff": "0.200000", 2024-09-12T22:31:55.283 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_inject_delay_max": "1.000000", 2024-09-12T22:31:55.283 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_inject_delay_probability": "0.000000", 2024-09-12T22:31:55.283 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_inject_delay_type": "", 2024-09-12T22:31:55.283 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_inject_internal_delays": "0.000000", 2024-09-12T22:31:55.283 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_inject_network_congestion": "0", 2024-09-12T22:31:55.283 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_inject_socket_failures": "0", 2024-09-12T22:31:55.283 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_learn_addr_from_peer": "true", 2024-09-12T22:31:55.283 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_max_accept_failures": "4", 2024-09-12T22:31:55.284 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_max_backoff": "15.000000", 2024-09-12T22:31:55.284 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_mon_client_mode": "secure crc", 2024-09-12T22:31:55.284 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_mon_cluster_mode": "secure crc", 2024-09-12T22:31:55.284 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_mon_service_mode": "secure crc", 2024-09-12T22:31:55.284 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_osd_compress_min_size": "1024", 2024-09-12T22:31:55.284 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_osd_compress_mode": "none", 2024-09-12T22:31:55.284 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_osd_compression_algorithm": "snappy", 2024-09-12T22:31:55.284 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_pq_max_tokens_per_priority": "16777216", 2024-09-12T22:31:55.284 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_pq_min_cost": "65536", 2024-09-12T22:31:55.284 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_public_type": "", 2024-09-12T22:31:55.284 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_service_mode": "crc secure", 2024-09-12T22:31:55.284 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_tcp_listen_backlog": "512", 2024-09-12T22:31:55.284 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_tcp_nodelay": "true", 2024-09-12T22:31:55.285 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_tcp_prefetch_max_size": "4096", 2024-09-12T22:31:55.285 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_tcp_rcvbuf": "0", 2024-09-12T22:31:55.285 INFO:teuthology.orchestra.run.smithi019.stdout: "ms_type": "async+posix", 2024-09-12T22:31:55.285 INFO:teuthology.orchestra.run.smithi019.stdout: "no_config_file": "false", 2024-09-12T22:31:55.285 INFO:teuthology.orchestra.run.smithi019.stdout: "objecter_completion_locks_per_session": "32", 2024-09-12T22:31:55.285 INFO:teuthology.orchestra.run.smithi019.stdout: "objecter_debug_inject_relock_delay": "false", 2024-09-12T22:31:55.285 INFO:teuthology.orchestra.run.smithi019.stdout: "objecter_inflight_op_bytes": "104857600", 2024-09-12T22:31:55.285 INFO:teuthology.orchestra.run.smithi019.stdout: "objecter_inflight_ops": "1024", 2024-09-12T22:31:55.285 INFO:teuthology.orchestra.run.smithi019.stdout: "objecter_inject_no_watch_ping": "false", 2024-09-12T22:31:55.285 INFO:teuthology.orchestra.run.smithi019.stdout: "objecter_retry_writes_after_first_reply": "false", 2024-09-12T22:31:55.285 INFO:teuthology.orchestra.run.smithi019.stdout: "objecter_tick_interval": "5.000000", 2024-09-12T22:31:55.285 INFO:teuthology.orchestra.run.smithi019.stdout: "objecter_timeout": "10.000000", 2024-09-12T22:31:55.285 INFO:teuthology.orchestra.run.smithi019.stdout: "objectstore_blackhole": "false", 2024-09-12T22:31:55.286 INFO:teuthology.orchestra.run.smithi019.stdout: "objectstore_debug_throw_on_failed_txc": "false", 2024-09-12T22:31:55.286 INFO:teuthology.orchestra.run.smithi019.stdout: "openssl_engine_opts": "", 2024-09-12T22:31:55.286 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_agent_delay_time": "5.000000", 2024-09-12T22:31:55.286 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_agent_hist_halflife": "1000", 2024-09-12T22:31:55.286 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_agent_max_low_ops": "2", 2024-09-12T22:31:55.286 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_agent_max_ops": "4", 2024-09-12T22:31:55.286 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_agent_min_evict_effort": "0.100000", 2024-09-12T22:31:55.286 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_agent_quantize_effort": "0.100000", 2024-09-12T22:31:55.286 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_agent_slop": "0.020000", 2024-09-12T22:31:55.286 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_aggregated_slow_ops_logging": "true", 2024-09-12T22:31:55.286 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_allow_recovery_below_min_size": "true", 2024-09-12T22:31:55.286 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_asio_thread_count": "2", 2024-09-12T22:31:55.286 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_async_recovery_min_cost": "100", 2024-09-12T22:31:55.287 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_auto_mark_unfound_lost": "false", 2024-09-12T22:31:55.287 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_backfill_retry_interval": "30.000000", 2024-09-12T22:31:55.287 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_backfill_scan_max": "512", 2024-09-12T22:31:55.287 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_backfill_scan_min": "64", 2024-09-12T22:31:55.287 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_backoff_on_degraded": "false", 2024-09-12T22:31:55.287 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_backoff_on_peering": "false", 2024-09-12T22:31:55.287 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_backoff_on_unfound": "true", 2024-09-12T22:31:55.287 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_beacon_report_interval": "300", 2024-09-12T22:31:55.287 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_bench_duration": "30", 2024-09-12T22:31:55.287 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_bench_large_size_max_throughput": "104857600", 2024-09-12T22:31:55.287 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_bench_max_block_size": "67108864", 2024-09-12T22:31:55.287 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_bench_small_size_max_iops": "100", 2024-09-12T22:31:55.287 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_blkin_trace_all": "false", 2024-09-12T22:31:55.288 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_blocked_scrub_grace_period": "120", 2024-09-12T22:31:55.288 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_calc_pg_upmaps_aggressively": "true", 2024-09-12T22:31:55.288 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_calc_pg_upmaps_aggressively_fast": "true", 2024-09-12T22:31:55.288 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_calc_pg_upmaps_local_fallback_retries": "100", 2024-09-12T22:31:55.288 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_check_for_log_corruption": "false", 2024-09-12T22:31:55.288 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_check_max_object_name_len_on_startup": "true", 2024-09-12T22:31:55.288 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_class_default_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-09-12T22:31:55.288 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_class_dir": "/usr/lib64/rados-classes", 2024-09-12T22:31:55.288 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_class_load_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-09-12T22:31:55.288 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_class_update_on_start": "true", 2024-09-12T22:31:55.288 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_client_message_cap": "256", 2024-09-12T22:31:55.288 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_client_message_size_cap": "524288000", 2024-09-12T22:31:55.289 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_client_op_priority": "63", 2024-09-12T22:31:55.289 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_client_watch_timeout": "30", 2024-09-12T22:31:55.289 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_command_max_records": "256", 2024-09-12T22:31:55.289 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_compact_on_start": "false", 2024-09-12T22:31:55.289 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_copyfrom_max_chunk": "8388608", 2024-09-12T22:31:55.289 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_crush_chooseleaf_type": "0", 2024-09-12T22:31:55.289 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_crush_initial_weight": "-1.000000", 2024-09-12T22:31:55.289 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_crush_update_on_start": "true", 2024-09-12T22:31:55.289 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_crush_update_weight_set": "true", 2024-09-12T22:31:55.289 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_data": "/var/lib/ceph/osd/ceph-a", 2024-09-12T22:31:55.289 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_debug_crash_on_ignored_backoff": "false", 2024-09-12T22:31:55.289 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_debug_deep_scrub_sleep": "0.000000", 2024-09-12T22:31:55.289 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_debug_drop_ping_duration": "0", 2024-09-12T22:31:55.290 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_debug_drop_ping_probability": "0.000000", 2024-09-12T22:31:55.290 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_debug_feed_pullee": "-1", 2024-09-12T22:31:55.290 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_debug_inject_copyfrom_error": "false", 2024-09-12T22:31:55.290 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_debug_inject_dispatch_delay_duration": "0.100000", 2024-09-12T22:31:55.290 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_debug_inject_dispatch_delay_probability": "0.000000", 2024-09-12T22:31:55.290 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_debug_misdirected_ops": "false", 2024-09-12T22:31:55.290 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_debug_no_acting_change": "false", 2024-09-12T22:31:55.290 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_debug_no_purge_strays": "false", 2024-09-12T22:31:55.290 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_debug_op_order": "false", 2024-09-12T22:31:55.290 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_debug_pg_log_writeout": "false", 2024-09-12T22:31:55.290 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_debug_pretend_recovery_active": "false", 2024-09-12T22:31:55.290 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_debug_random_push_read_error": "0.000000", 2024-09-12T22:31:55.291 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_debug_reject_backfill_probability": "0.000000", 2024-09-12T22:31:55.291 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_debug_shutdown": "false", 2024-09-12T22:31:55.291 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_debug_skip_full_check_in_backfill_reservation": "false", 2024-09-12T22:31:55.291 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_debug_skip_full_check_in_recovery": "false", 2024-09-12T22:31:55.291 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_debug_trim_objects": "false", 2024-09-12T22:31:55.291 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_debug_verify_cached_snaps": "false", 2024-09-12T22:31:55.291 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_debug_verify_missing_on_start": "false", 2024-09-12T22:31:55.291 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_debug_verify_snaps": "false", 2024-09-12T22:31:55.291 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_debug_verify_stray_on_activate": "false", 2024-09-12T22:31:55.291 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_deep_scrub_interval": "604800.000000", 2024-09-12T22:31:55.291 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_deep_scrub_keys": "1024", 2024-09-12T22:31:55.291 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_deep_scrub_large_omap_object_key_threshold": "200000", 2024-09-12T22:31:55.291 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_deep_scrub_large_omap_object_value_sum_threshold": "1073741824", 2024-09-12T22:31:55.292 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_deep_scrub_randomize_ratio": "0.150000", 2024-09-12T22:31:55.292 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_deep_scrub_stride": "524288", 2024-09-12T22:31:55.292 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_deep_scrub_update_digest_min_age": "7200", 2024-09-12T22:31:55.292 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_default_data_pool_replay_window": "5", 2024-09-12T22:31:55.292 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_default_notify_timeout": "30", 2024-09-12T22:31:55.292 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_delete_sleep": "0.000000", 2024-09-12T22:31:55.292 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_delete_sleep_hdd": "5.000000", 2024-09-12T22:31:55.292 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_delete_sleep_hybrid": "1.000000", 2024-09-12T22:31:55.292 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_delete_sleep_ssd": "1.000000", 2024-09-12T22:31:55.292 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_discard_disconnected_ops": "true", 2024-09-12T22:31:55.292 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_enable_op_tracker": "true", 2024-09-12T22:31:55.292 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_erasure_code_plugins": "jerasure lrc", 2024-09-12T22:31:55.292 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_extblkdev_plugins": "vdo", 2024-09-12T22:31:55.293 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_failsafe_full_ratio": "0.970000", 2024-09-12T22:31:55.293 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_fast_fail_on_connection_refused": "true", 2024-09-12T22:31:55.293 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_fast_info": "true", 2024-09-12T22:31:55.293 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_fast_shutdown": "true", 2024-09-12T22:31:55.293 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_fast_shutdown_notify_mon": "true", 2024-09-12T22:31:55.293 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_fast_shutdown_timeout": "15", 2024-09-12T22:31:55.293 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_find_best_info_ignore_history_les": "false", 2024-09-12T22:31:55.293 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_force_auth_primary_missing_objects": "100", 2024-09-12T22:31:55.293 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_force_recovery_pg_log_entries_factor": "1.300000", 2024-09-12T22:31:55.293 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_function_tracing": "false", 2024-09-12T22:31:55.293 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_heartbeat_grace": "20", 2024-09-12T22:31:55.293 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_heartbeat_interval": "6", 2024-09-12T22:31:55.294 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_heartbeat_min_healthy_ratio": "0.330000", 2024-09-12T22:31:55.294 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_heartbeat_min_peers": "10", 2024-09-12T22:31:55.294 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_heartbeat_min_size": "2000", 2024-09-12T22:31:55.294 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_heartbeat_stale": "600", 2024-09-12T22:31:55.294 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_heartbeat_use_min_delay_socket": "false", 2024-09-12T22:31:55.294 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_hit_set_max_size": "100000", 2024-09-12T22:31:55.294 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_hit_set_min_size": "1000", 2024-09-12T22:31:55.294 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_hit_set_namespace": ".ceph-internal", 2024-09-12T22:31:55.294 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_ignore_stale_divergent_priors": "false", 2024-09-12T22:31:55.294 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_inject_bad_map_crc_probability": "0.000000", 2024-09-12T22:31:55.294 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_inject_failure_on_pg_removal": "false", 2024-09-12T22:31:55.294 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_journal": "/var/lib/ceph/osd/ceph-a/journal", 2024-09-12T22:31:55.294 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_journal_flush_on_shutdown": "true", 2024-09-12T22:31:55.295 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_journal_size": "5120", 2024-09-12T22:31:55.295 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_kill_backfill_at": "0", 2024-09-12T22:31:55.295 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_loop_before_reset_tphandle": "64", 2024-09-12T22:31:55.295 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_map_cache_size": "50", 2024-09-12T22:31:55.295 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_map_dedup": "true", 2024-09-12T22:31:55.295 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_map_message_max": "40", 2024-09-12T22:31:55.295 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_map_message_max_bytes": "10485760", 2024-09-12T22:31:55.295 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_map_share_max_epochs": "40", 2024-09-12T22:31:55.295 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_max_attr_name_len": "100", 2024-09-12T22:31:55.295 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_max_attr_size": "0", 2024-09-12T22:31:55.295 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_max_backfills": "1", 2024-09-12T22:31:55.296 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_max_markdown_count": "5", 2024-09-12T22:31:55.296 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_max_markdown_period": "600", 2024-09-12T22:31:55.296 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_max_object_name_len": "2048", 2024-09-12T22:31:55.296 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_max_object_namespace_len": "256", 2024-09-12T22:31:55.296 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_max_object_size": "134217728", 2024-09-12T22:31:55.296 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_max_omap_bytes_per_request": "1073741824", 2024-09-12T22:31:55.296 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_max_omap_entries_per_request": "1024", 2024-09-12T22:31:55.296 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_max_pg_blocked_by": "16", 2024-09-12T22:31:55.296 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_max_pg_log_entries": "10000", 2024-09-12T22:31:55.296 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_max_pg_per_osd_hard_ratio": "3.000000", 2024-09-12T22:31:55.296 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_max_pgls": "1024", 2024-09-12T22:31:55.296 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_max_push_cost": "8388608", 2024-09-12T22:31:55.296 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_max_push_objects": "10", 2024-09-12T22:31:55.297 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_max_scrubs": "3", 2024-09-12T22:31:55.297 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_max_snap_prune_intervals_per_epoch": "512", 2024-09-12T22:31:55.297 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_max_trimming_pgs": "2", 2024-09-12T22:31:55.297 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_max_write_op_reply_len": "64", 2024-09-12T22:31:55.297 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_max_write_size": "90", 2024-09-12T22:31:55.297 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_mclock_force_run_benchmark_on_init": "false", 2024-09-12T22:31:55.297 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_mclock_iops_capacity_threshold_hdd": "500.000000", 2024-09-12T22:31:55.297 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_mclock_iops_capacity_threshold_ssd": "80000.000000", 2024-09-12T22:31:55.297 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_mclock_max_capacity_iops_hdd": "315.000000", 2024-09-12T22:31:55.297 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_mclock_max_capacity_iops_ssd": "21500.000000", 2024-09-12T22:31:55.297 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_mclock_max_sequential_bandwidth_hdd": "157286400", 2024-09-12T22:31:55.297 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_mclock_max_sequential_bandwidth_ssd": "1258291200", 2024-09-12T22:31:55.298 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_mclock_override_recovery_settings": "false", 2024-09-12T22:31:55.298 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_mclock_profile": "balanced", 2024-09-12T22:31:55.298 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_mclock_scheduler_anticipation_timeout": "0.000000", 2024-09-12T22:31:55.298 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_mclock_scheduler_background_best_effort_lim": "0.000000", 2024-09-12T22:31:55.298 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_mclock_scheduler_background_best_effort_res": "0.000000", 2024-09-12T22:31:55.298 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_mclock_scheduler_background_best_effort_wgt": "1", 2024-09-12T22:31:55.298 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_mclock_scheduler_background_recovery_lim": "0.000000", 2024-09-12T22:31:55.298 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_mclock_scheduler_background_recovery_res": "0.000000", 2024-09-12T22:31:55.298 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_mclock_scheduler_background_recovery_wgt": "1", 2024-09-12T22:31:55.298 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_mclock_scheduler_client_lim": "0.000000", 2024-09-12T22:31:55.298 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_mclock_scheduler_client_res": "0.000000", 2024-09-12T22:31:55.298 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_mclock_scheduler_client_wgt": "1", 2024-09-12T22:31:55.298 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_mclock_skip_benchmark": "false", 2024-09-12T22:31:55.299 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_memory_base": "805306368", 2024-09-12T22:31:55.299 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_memory_cache_min": "134217728", 2024-09-12T22:31:55.299 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_memory_cache_resize_interval": "1.000000", 2024-09-12T22:31:55.299 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_memory_expected_fragmentation": "0.150000", 2024-09-12T22:31:55.299 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_memory_target": "4294967296", 2024-09-12T22:31:55.299 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_memory_target_autotune": "false", 2024-09-12T22:31:55.299 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_memory_target_cgroup_limit_ratio": "0.800000", 2024-09-12T22:31:55.299 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_min_pg_log_entries": "250", 2024-09-12T22:31:55.299 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_min_recovery_priority": "0", 2024-09-12T22:31:55.299 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_mon_heartbeat_interval": "30", 2024-09-12T22:31:55.299 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_mon_heartbeat_stat_stale": "3600", 2024-09-12T22:31:55.299 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_mon_report_interval": "5", 2024-09-12T22:31:55.299 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_mon_report_max_in_flight": "2", 2024-09-12T22:31:55.300 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_mon_shutdown_timeout": "5.000000", 2024-09-12T22:31:55.300 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_num_cache_shards": "32", 2024-09-12T22:31:55.300 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_num_op_tracker_shard": "32", 2024-09-12T22:31:55.300 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_numa_auto_affinity": "true", 2024-09-12T22:31:55.300 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_numa_node": "-1", 2024-09-12T22:31:55.300 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_numa_prefer_iface": "true", 2024-09-12T22:31:55.300 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_object_clean_region_max_num_intervals": "10", 2024-09-12T22:31:55.300 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_objecter_finishers": "1", 2024-09-12T22:31:55.300 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_objectstore": "bluestore", 2024-09-12T22:31:55.300 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_objectstore_fuse": "false", 2024-09-12T22:31:55.301 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_objectstore_tracing": "false", 2024-09-12T22:31:55.301 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_op_complaint_time": "30.000000", 2024-09-12T22:31:55.301 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_op_history_duration": "600", 2024-09-12T22:31:55.301 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_op_history_size": "20", 2024-09-12T22:31:55.301 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_op_history_slow_op_size": "20", 2024-09-12T22:31:55.301 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_op_history_slow_op_threshold": "10.000000", 2024-09-12T22:31:55.301 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_op_log_threshold": "5", 2024-09-12T22:31:55.301 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_op_num_shards": "0", 2024-09-12T22:31:55.301 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_op_num_shards_hdd": "5", 2024-09-12T22:31:55.301 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_op_num_shards_ssd": "8", 2024-09-12T22:31:55.301 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_op_num_threads_per_shard": "0", 2024-09-12T22:31:55.301 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_op_num_threads_per_shard_hdd": "1", 2024-09-12T22:31:55.302 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_op_num_threads_per_shard_ssd": "2", 2024-09-12T22:31:55.302 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_op_pq_max_tokens_per_priority": "4194304", 2024-09-12T22:31:55.302 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_op_pq_min_cost": "65536", 2024-09-12T22:31:55.302 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_op_queue": "mclock_scheduler", 2024-09-12T22:31:55.302 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_op_queue_cut_off": "high", 2024-09-12T22:31:55.302 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_op_thread_suicide_timeout": "150", 2024-09-12T22:31:55.302 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_op_thread_timeout": "15", 2024-09-12T22:31:55.302 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_open_classes_on_start": "true", 2024-09-12T22:31:55.302 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_os_flags": "0", 2024-09-12T22:31:55.302 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_peering_op_priority": "255", 2024-09-12T22:31:55.302 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pg_delete_cost": "1048576", 2024-09-12T22:31:55.302 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pg_delete_priority": "5", 2024-09-12T22:31:55.303 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pg_epoch_max_lag_factor": "2.000000", 2024-09-12T22:31:55.303 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pg_epoch_persisted_max_stale": "40", 2024-09-12T22:31:55.303 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pg_log_dups_tracked": "3000", 2024-09-12T22:31:55.303 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pg_log_trim_max": "10000", 2024-09-12T22:31:55.303 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pg_log_trim_min": "100", 2024-09-12T22:31:55.303 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pg_max_concurrent_snap_trims": "2", 2024-09-12T22:31:55.303 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pg_object_context_cache_count": "64", 2024-09-12T22:31:55.303 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pg_stat_report_interval_max_epochs": "500", 2024-09-12T22:31:55.303 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pg_stat_report_interval_max_seconds": "5", 2024-09-12T22:31:55.303 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pool_default_cache_max_evict_check_size": "10", 2024-09-12T22:31:55.303 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pool_default_cache_min_evict_age": "0", 2024-09-12T22:31:55.303 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pool_default_cache_min_flush_age": "0", 2024-09-12T22:31:55.303 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pool_default_cache_target_dirty_high_ratio": "0.600000", 2024-09-12T22:31:55.303 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pool_default_cache_target_dirty_ratio": "0.400000", 2024-09-12T22:31:55.304 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pool_default_cache_target_full_ratio": "0.800000", 2024-09-12T22:31:55.304 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pool_default_crimson": "false", 2024-09-12T22:31:55.304 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pool_default_crush_rule": "-1", 2024-09-12T22:31:55.304 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pool_default_ec_fast_read": "false", 2024-09-12T22:31:55.304 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pool_default_erasure_code_profile": "plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd", 2024-09-12T22:31:55.304 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pool_default_flag_bulk": "false", 2024-09-12T22:31:55.304 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pool_default_flag_hashpspool": "true", 2024-09-12T22:31:55.304 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pool_default_flag_nodelete": "false", 2024-09-12T22:31:55.304 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pool_default_flag_nopgchange": "false", 2024-09-12T22:31:55.304 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pool_default_flag_nosizechange": "false", 2024-09-12T22:31:55.304 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pool_default_flags": "0", 2024-09-12T22:31:55.304 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pool_default_hit_set_bloom_fpp": "0.050000", 2024-09-12T22:31:55.305 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pool_default_min_size": "0", 2024-09-12T22:31:55.305 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pool_default_pg_autoscale_mode": "off", 2024-09-12T22:31:55.305 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pool_default_pg_num": "32", 2024-09-12T22:31:55.305 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pool_default_pgp_num": "0", 2024-09-12T22:31:55.305 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pool_default_read_lease_ratio": "0.800000", 2024-09-12T22:31:55.305 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pool_default_read_ratio": "70", 2024-09-12T22:31:55.305 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pool_default_size": "2", 2024-09-12T22:31:55.305 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pool_default_type": "replicated", 2024-09-12T22:31:55.305 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pool_erasure_code_stripe_unit": "4096", 2024-09-12T22:31:55.305 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pool_use_gmt_hitset": "true", 2024-09-12T22:31:55.305 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_push_per_object_cost": "1000", 2024-09-12T22:31:55.305 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_read_ec_check_for_errors": "false", 2024-09-12T22:31:55.306 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_recover_clone_overlap": "true", 2024-09-12T22:31:55.306 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_recover_clone_overlap_limit": "10", 2024-09-12T22:31:55.306 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_recovery_cost": "20971520", 2024-09-12T22:31:55.306 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_recovery_delay_start": "0.000000", 2024-09-12T22:31:55.306 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_recovery_max_active": "0", 2024-09-12T22:31:55.306 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_recovery_max_active_hdd": "3", 2024-09-12T22:31:55.306 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_recovery_max_active_ssd": "10", 2024-09-12T22:31:55.306 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_recovery_max_chunk": "8388608", 2024-09-12T22:31:55.306 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_recovery_max_omap_entries_per_chunk": "8096", 2024-09-12T22:31:55.306 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_recovery_max_single_start": "1", 2024-09-12T22:31:55.306 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_recovery_op_priority": "3", 2024-09-12T22:31:55.306 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_recovery_op_warn_multiple": "16", 2024-09-12T22:31:55.306 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_recovery_priority": "5", 2024-09-12T22:31:55.306 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_recovery_retry_interval": "30.000000", 2024-09-12T22:31:55.307 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_recovery_sleep": "0.000000", 2024-09-12T22:31:55.307 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_recovery_sleep_hdd": "0.100000", 2024-09-12T22:31:55.307 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_recovery_sleep_hybrid": "0.025000", 2024-09-12T22:31:55.307 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_recovery_sleep_ssd": "0.000000", 2024-09-12T22:31:55.307 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_repair_during_recovery": "false", 2024-09-12T22:31:55.307 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_requested_scrub_priority": "120", 2024-09-12T22:31:55.307 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_rocksdb_iterator_bounds_enabled": "true", 2024-09-12T22:31:55.307 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_rollback_to_cluster_snap": "", 2024-09-12T22:31:55.307 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_scrub_auto_repair": "false", 2024-09-12T22:31:55.307 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_scrub_auto_repair_num_errors": "5", 2024-09-12T22:31:55.307 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_scrub_backoff_ratio": "0.660000", 2024-09-12T22:31:55.307 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_scrub_begin_hour": "0", 2024-09-12T22:31:55.308 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_scrub_begin_week_day": "0", 2024-09-12T22:31:55.308 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_scrub_chunk_max": "25", 2024-09-12T22:31:55.308 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_scrub_chunk_min": "5", 2024-09-12T22:31:55.308 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_scrub_cost": "52428800", 2024-09-12T22:31:55.308 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_scrub_disable_reservation_queuing": "false", 2024-09-12T22:31:55.308 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_scrub_during_recovery": "false", 2024-09-12T22:31:55.308 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_scrub_end_hour": "0", 2024-09-12T22:31:55.308 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_scrub_end_week_day": "0", 2024-09-12T22:31:55.308 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_scrub_event_cost": "4096", 2024-09-12T22:31:55.308 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_scrub_extended_sleep": "0.000000", 2024-09-12T22:31:55.308 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_scrub_interval_randomize_ratio": "0.500000", 2024-09-12T22:31:55.308 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_scrub_invalid_stats": "true", 2024-09-12T22:31:55.308 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_scrub_load_threshold": "0.500000", 2024-09-12T22:31:55.309 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_scrub_max_interval": "604800.000000", 2024-09-12T22:31:55.309 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_scrub_max_preemptions": "5", 2024-09-12T22:31:55.309 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_scrub_min_interval": "86400.000000", 2024-09-12T22:31:55.309 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_scrub_priority": "5", 2024-09-12T22:31:55.309 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_scrub_sleep": "0.000000", 2024-09-12T22:31:55.309 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_shallow_scrub_chunk_max": "100", 2024-09-12T22:31:55.309 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_shallow_scrub_chunk_min": "50", 2024-09-12T22:31:55.309 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_shutdown_pgref_assert": "false", 2024-09-12T22:31:55.309 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_skip_data_digest": "false", 2024-09-12T22:31:55.309 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_smart_report_timeout": "5", 2024-09-12T22:31:55.309 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_snap_trim_cost": "1048576", 2024-09-12T22:31:55.309 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_snap_trim_priority": "5", 2024-09-12T22:31:55.310 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_snap_trim_sleep": "0.000000", 2024-09-12T22:31:55.310 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_snap_trim_sleep_hdd": "5.000000", 2024-09-12T22:31:55.310 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_snap_trim_sleep_hybrid": "2.000000", 2024-09-12T22:31:55.310 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_snap_trim_sleep_ssd": "0.000000", 2024-09-12T22:31:55.310 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_stats_update_period_not_scrubbing": "120", 2024-09-12T22:31:55.310 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_stats_update_period_scrubbing": "15", 2024-09-12T22:31:55.310 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_target_pg_log_entries_per_osd": "300000", 2024-09-12T22:31:55.310 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_target_transaction_size": "30", 2024-09-12T22:31:55.310 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_tier_default_cache_hit_set_count": "4", 2024-09-12T22:31:55.310 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_tier_default_cache_hit_set_grade_decay_rate": "20", 2024-09-12T22:31:55.310 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_tier_default_cache_hit_set_period": "1200", 2024-09-12T22:31:55.310 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_tier_default_cache_hit_set_search_last_n": "1", 2024-09-12T22:31:55.310 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_tier_default_cache_hit_set_type": "bloom", 2024-09-12T22:31:55.311 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_tier_default_cache_min_read_recency_for_promote": "1", 2024-09-12T22:31:55.311 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_tier_default_cache_min_write_recency_for_promote": "1", 2024-09-12T22:31:55.311 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_tier_default_cache_mode": "writeback", 2024-09-12T22:31:55.311 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_tier_promote_max_bytes_sec": "5242880", 2024-09-12T22:31:55.311 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_tier_promote_max_objects_sec": "25", 2024-09-12T22:31:55.311 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_tracing": "false", 2024-09-12T22:31:55.311 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_use_stale_snap": "false", 2024-09-12T22:31:55.311 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T22:31:55.311 INFO:teuthology.orchestra.run.smithi019.stdout: "osdc_blkin_trace_all": "false", 2024-09-12T22:31:55.311 INFO:teuthology.orchestra.run.smithi019.stdout: "paxos_kill_at": "0", 2024-09-12T22:31:55.311 INFO:teuthology.orchestra.run.smithi019.stdout: "paxos_max_join_drift": "10", 2024-09-12T22:31:55.311 INFO:teuthology.orchestra.run.smithi019.stdout: "paxos_min": "500", 2024-09-12T22:31:55.311 INFO:teuthology.orchestra.run.smithi019.stdout: "paxos_min_wait": "0.050000", 2024-09-12T22:31:55.311 INFO:teuthology.orchestra.run.smithi019.stdout: "paxos_propose_interval": "1.000000", 2024-09-12T22:31:55.312 INFO:teuthology.orchestra.run.smithi019.stdout: "paxos_service_trim_max": "500", 2024-09-12T22:31:55.312 INFO:teuthology.orchestra.run.smithi019.stdout: "paxos_service_trim_max_multiplier": "20", 2024-09-12T22:31:55.312 INFO:teuthology.orchestra.run.smithi019.stdout: "paxos_service_trim_min": "250", 2024-09-12T22:31:55.312 INFO:teuthology.orchestra.run.smithi019.stdout: "paxos_stash_full_interval": "25", 2024-09-12T22:31:55.312 INFO:teuthology.orchestra.run.smithi019.stdout: "paxos_trim_max": "500", 2024-09-12T22:31:55.312 INFO:teuthology.orchestra.run.smithi019.stdout: "paxos_trim_min": "250", 2024-09-12T22:31:55.312 INFO:teuthology.orchestra.run.smithi019.stdout: "perf": "true", 2024-09-12T22:31:55.312 INFO:teuthology.orchestra.run.smithi019.stdout: "pid_file": "/var/run/ceph/ceph-mon.a.pid", 2024-09-12T22:31:55.312 INFO:teuthology.orchestra.run.smithi019.stdout: "plugin_crypto_accelerator": "crypto_isal", 2024-09-12T22:31:55.312 INFO:teuthology.orchestra.run.smithi019.stdout: "plugin_dir": "/usr/lib64/ceph", 2024-09-12T22:31:55.312 INFO:teuthology.orchestra.run.smithi019.stdout: "public_addr": "-", 2024-09-12T22:31:55.312 INFO:teuthology.orchestra.run.smithi019.stdout: "public_addrv": "", 2024-09-12T22:31:55.313 INFO:teuthology.orchestra.run.smithi019.stdout: "public_bind_addr": "-", 2024-09-12T22:31:55.313 INFO:teuthology.orchestra.run.smithi019.stdout: "public_network": "", 2024-09-12T22:31:55.313 INFO:teuthology.orchestra.run.smithi019.stdout: "public_network_interface": "", 2024-09-12T22:31:55.313 INFO:teuthology.orchestra.run.smithi019.stdout: "qat_compressor_busy_polling": "false", 2024-09-12T22:31:55.313 INFO:teuthology.orchestra.run.smithi019.stdout: "qat_compressor_enabled": "false", 2024-09-12T22:31:55.313 INFO:teuthology.orchestra.run.smithi019.stdout: "qat_compressor_session_max_number": "256", 2024-09-12T22:31:55.313 INFO:teuthology.orchestra.run.smithi019.stdout: "rados_mon_op_timeout": "0", 2024-09-12T22:31:55.313 INFO:teuthology.orchestra.run.smithi019.stdout: "rados_osd_op_timeout": "0", 2024-09-12T22:31:55.313 INFO:teuthology.orchestra.run.smithi019.stdout: "rados_tracing": "false", 2024-09-12T22:31:55.313 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_atime_update_interval": "60", 2024-09-12T22:31:55.313 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_auto_exclusive_lock_until_manual_request": "true", 2024-09-12T22:31:55.313 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_balance_parent_reads": "false", 2024-09-12T22:31:55.313 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_balance_snap_reads": "false", 2024-09-12T22:31:55.314 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_blkin_trace_all": "false", 2024-09-12T22:31:55.314 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_blocklist_expire_seconds": "0", 2024-09-12T22:31:55.314 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_blocklist_on_break_lock": "true", 2024-09-12T22:31:55.314 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_cache": "true", 2024-09-12T22:31:55.314 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_cache_block_writes_upfront": "false", 2024-09-12T22:31:55.314 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_cache_max_dirty": "25165824", 2024-09-12T22:31:55.314 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_cache_max_dirty_age": "1.000000", 2024-09-12T22:31:55.314 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_cache_max_dirty_object": "0", 2024-09-12T22:31:55.314 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_cache_policy": "writearound", 2024-09-12T22:31:55.314 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_cache_size": "33554432", 2024-09-12T22:31:55.314 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_cache_target_dirty": "16777216", 2024-09-12T22:31:55.315 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_cache_writethrough_until_flush": "true", 2024-09-12T22:31:55.315 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_clone_copy_on_read": "false", 2024-09-12T22:31:55.315 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_compression_hint": "none", 2024-09-12T22:31:55.315 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_concurrent_management_ops": "10", 2024-09-12T22:31:55.315 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_config_pool_override_update_timestamp": "0", 2024-09-12T22:31:55.315 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_default_clone_format": "auto", 2024-09-12T22:31:55.315 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_default_data_pool": "", 2024-09-12T22:31:55.315 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_default_features": "61", 2024-09-12T22:31:55.315 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_default_format": "2", 2024-09-12T22:31:55.315 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_default_map_options": "", 2024-09-12T22:31:55.315 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_default_order": "22", 2024-09-12T22:31:55.315 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_default_pool": "rbd", 2024-09-12T22:31:55.315 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_default_snapshot_quiesce_mode": "required", 2024-09-12T22:31:55.316 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_default_stripe_count": "0", 2024-09-12T22:31:55.316 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_default_stripe_unit": "0", 2024-09-12T22:31:55.316 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_disable_zero_copy_writes": "true", 2024-09-12T22:31:55.316 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_discard_granularity_bytes": "65536", 2024-09-12T22:31:55.316 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_discard_on_zeroed_write_same": "true", 2024-09-12T22:31:55.316 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_enable_alloc_hint": "true", 2024-09-12T22:31:55.316 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_invalidate_object_map_on_timeout": "true", 2024-09-12T22:31:55.316 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_io_scheduler": "simple", 2024-09-12T22:31:55.316 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_io_scheduler_simple_max_delay": "0", 2024-09-12T22:31:55.316 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_journal_commit_age": "5.000000", 2024-09-12T22:31:55.316 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_journal_max_concurrent_object_sets": "0", 2024-09-12T22:31:55.316 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_journal_max_payload_bytes": "16384", 2024-09-12T22:31:55.316 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_journal_object_flush_age": "0.000000", 2024-09-12T22:31:55.317 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_journal_object_flush_bytes": "1048576", 2024-09-12T22:31:55.317 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_journal_object_flush_interval": "0", 2024-09-12T22:31:55.317 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_journal_object_max_in_flight_appends": "0", 2024-09-12T22:31:55.317 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_journal_object_writethrough_until_flush": "true", 2024-09-12T22:31:55.317 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_journal_order": "24", 2024-09-12T22:31:55.317 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_journal_pool": "", 2024-09-12T22:31:55.317 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_journal_splay_width": "4", 2024-09-12T22:31:55.317 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_localize_parent_reads": "false", 2024-09-12T22:31:55.317 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_localize_snap_reads": "false", 2024-09-12T22:31:55.317 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_mirror_concurrent_image_deletions": "1", 2024-09-12T22:31:55.318 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_mirror_concurrent_image_syncs": "5", 2024-09-12T22:31:55.318 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_mirror_delete_retry_interval": "30.000000", 2024-09-12T22:31:55.318 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_mirror_image_perf_stats_prio": "5", 2024-09-12T22:31:55.318 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_mirror_image_policy_migration_throttle": "300", 2024-09-12T22:31:55.318 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_mirror_image_policy_rebalance_timeout": "0.000000", 2024-09-12T22:31:55.318 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_mirror_image_policy_type": "simple", 2024-09-12T22:31:55.318 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_mirror_image_policy_update_throttle_interval": "1.000000", 2024-09-12T22:31:55.318 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_mirror_image_state_check_interval": "30", 2024-09-12T22:31:55.318 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_mirror_journal_commit_age": "5.000000", 2024-09-12T22:31:55.318 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_mirror_journal_poll_age": "5.000000", 2024-09-12T22:31:55.318 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_mirror_leader_heartbeat_interval": "5", 2024-09-12T22:31:55.318 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_mirror_leader_max_acquire_attempts_before_break": "3", 2024-09-12T22:31:55.318 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_mirror_leader_max_missed_heartbeats": "2", 2024-09-12T22:31:55.319 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_mirror_memory_autotune": "true", 2024-09-12T22:31:55.319 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_mirror_memory_base": "805306368", 2024-09-12T22:31:55.319 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_mirror_memory_cache_autotune_interval": "30.000000", 2024-09-12T22:31:55.319 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_mirror_memory_cache_min": "134217728", 2024-09-12T22:31:55.319 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_mirror_memory_cache_resize_interval": "5.000000", 2024-09-12T22:31:55.319 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_mirror_memory_expected_fragmentation": "0.150000", 2024-09-12T22:31:55.319 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_mirror_memory_target": "4294967296", 2024-09-12T22:31:55.319 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_mirror_perf_stats_prio": "5", 2024-09-12T22:31:55.319 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_mirror_pool_replayers_refresh_interval": "30", 2024-09-12T22:31:55.319 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_mirror_sync_point_update_age": "30.000000", 2024-09-12T22:31:55.319 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_mirroring_delete_delay": "0", 2024-09-12T22:31:55.319 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_mirroring_max_mirroring_snapshots": "5", 2024-09-12T22:31:55.319 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_mirroring_replay_delay": "0", 2024-09-12T22:31:55.320 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_mirroring_resync_after_disconnect": "false", 2024-09-12T22:31:55.320 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_move_parent_to_trash_on_remove": "false", 2024-09-12T22:31:55.320 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_move_to_trash_on_remove": "false", 2024-09-12T22:31:55.320 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_move_to_trash_on_remove_expire_seconds": "0", 2024-09-12T22:31:55.320 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_mtime_update_interval": "60", 2024-09-12T22:31:55.320 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_non_blocking_aio": "true", 2024-09-12T22:31:55.320 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_op_thread_timeout": "60", 2024-09-12T22:31:55.320 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_op_threads": "1", 2024-09-12T22:31:55.320 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_parent_cache_enabled": "false", 2024-09-12T22:31:55.320 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_persistent_cache_mode": "disabled", 2024-09-12T22:31:55.320 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_persistent_cache_path": "/tmp", 2024-09-12T22:31:55.320 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_persistent_cache_size": "1073741824", 2024-09-12T22:31:55.320 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_plugins": "", 2024-09-12T22:31:55.321 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_qos_bps_burst": "0", 2024-09-12T22:31:55.321 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_qos_bps_burst_seconds": "1", 2024-09-12T22:31:55.321 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_qos_bps_limit": "0", 2024-09-12T22:31:55.321 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_qos_exclude_ops": "0", 2024-09-12T22:31:55.321 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_qos_iops_burst": "0", 2024-09-12T22:31:55.321 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_qos_iops_burst_seconds": "1", 2024-09-12T22:31:55.321 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_qos_iops_limit": "0", 2024-09-12T22:31:55.321 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_qos_read_bps_burst": "0", 2024-09-12T22:31:55.321 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_qos_read_bps_burst_seconds": "1", 2024-09-12T22:31:55.321 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_qos_read_bps_limit": "0", 2024-09-12T22:31:55.321 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_qos_read_iops_burst": "0", 2024-09-12T22:31:55.321 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_qos_read_iops_burst_seconds": "1", 2024-09-12T22:31:55.321 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_qos_read_iops_limit": "0", 2024-09-12T22:31:55.322 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_qos_schedule_tick_min": "50", 2024-09-12T22:31:55.322 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_qos_write_bps_burst": "0", 2024-09-12T22:31:55.322 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_qos_write_bps_burst_seconds": "1", 2024-09-12T22:31:55.322 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_qos_write_bps_limit": "0", 2024-09-12T22:31:55.322 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_qos_write_iops_burst": "0", 2024-09-12T22:31:55.322 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_qos_write_iops_burst_seconds": "1", 2024-09-12T22:31:55.322 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_qos_write_iops_limit": "0", 2024-09-12T22:31:55.322 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_quiesce_notification_attempts": "10", 2024-09-12T22:31:55.322 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_read_from_replica_policy": "default", 2024-09-12T22:31:55.323 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_readahead_disable_after_bytes": "52428800", 2024-09-12T22:31:55.323 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_readahead_max_bytes": "524288", 2024-09-12T22:31:55.323 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_readahead_trigger_requests": "10", 2024-09-12T22:31:55.323 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_request_timed_out_seconds": "30", 2024-09-12T22:31:55.323 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_skip_partial_discard": "true", 2024-09-12T22:31:55.323 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_sparse_read_threshold_bytes": "65536", 2024-09-12T22:31:55.323 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_tracing": "false", 2024-09-12T22:31:55.323 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_validate_names": "true", 2024-09-12T22:31:55.324 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_validate_pool": "true", 2024-09-12T22:31:55.324 INFO:teuthology.orchestra.run.smithi019.stdout: "restapi_base_url": "", 2024-09-12T22:31:55.324 INFO:teuthology.orchestra.run.smithi019.stdout: "restapi_log_level": "", 2024-09-12T22:31:55.324 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_account_default_quota_max_objects": "-1", 2024-09-12T22:31:55.324 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_account_default_quota_max_size": "-1", 2024-09-12T22:31:55.324 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_acl_grants_max_num": "100", 2024-09-12T22:31:55.324 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_admin_entry": "admin", 2024-09-12T22:31:55.324 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_allow_notification_secrets_in_cleartext": "false", 2024-09-12T22:31:55.324 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_backend_store": "rados", 2024-09-12T22:31:55.324 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_barbican_url": "", 2024-09-12T22:31:55.324 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_beast_enable_async": "true", 2024-09-12T22:31:55.324 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_bucket_counters_cache": "false", 2024-09-12T22:31:55.325 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_bucket_counters_cache_size": "10000", 2024-09-12T22:31:55.325 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_bucket_default_quota_max_objects": "-1", 2024-09-12T22:31:55.325 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_bucket_default_quota_max_size": "-1", 2024-09-12T22:31:55.325 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_bucket_index_max_aio": "128", 2024-09-12T22:31:55.325 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_bucket_index_transaction_instrumentation": "false", 2024-09-12T22:31:55.325 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_bucket_quota_cache_size": "10000", 2024-09-12T22:31:55.325 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_bucket_quota_ttl": "600", 2024-09-12T22:31:55.325 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_bucket_sync_spawn_window": "20", 2024-09-12T22:31:55.325 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_cache_enabled": "true", 2024-09-12T22:31:55.325 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_cache_expiry_interval": "900", 2024-09-12T22:31:55.325 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_cache_lru_size": "25000", 2024-09-12T22:31:55.325 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_config_store": "rados", 2024-09-12T22:31:55.325 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_content_length_compat": "false", 2024-09-12T22:31:55.326 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_copy_obj_progress": "true", 2024-09-12T22:31:55.326 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_copy_obj_progress_every_bytes": "1048576", 2024-09-12T22:31:55.326 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_cors_rules_max_num": "100", 2024-09-12T22:31:55.326 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_cross_domain_policy": "", 2024-09-12T22:31:55.326 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_crypt_default_encryption_key": "", 2024-09-12T22:31:55.326 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_crypt_kmip_addr": "", 2024-09-12T22:31:55.326 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_crypt_kmip_ca_path": "", 2024-09-12T22:31:55.326 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_crypt_kmip_client_cert": "", 2024-09-12T22:31:55.326 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_crypt_kmip_client_key": "", 2024-09-12T22:31:55.326 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_crypt_kmip_kms_key_template": "", 2024-09-12T22:31:55.326 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_crypt_kmip_password": "", 2024-09-12T22:31:55.326 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_crypt_kmip_s3_key_template": "$keyid", 2024-09-12T22:31:55.326 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_crypt_kmip_username": "", 2024-09-12T22:31:55.327 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_crypt_require_ssl": "true", 2024-09-12T22:31:55.327 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_crypt_s3_kms_backend": "barbican", 2024-09-12T22:31:55.327 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_crypt_s3_kms_encryption_keys": "", 2024-09-12T22:31:55.327 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_crypt_sse_s3_backend": "vault", 2024-09-12T22:31:55.327 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_crypt_sse_s3_key_template": "%bucket_id", 2024-09-12T22:31:55.327 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_crypt_sse_s3_vault_addr": "", 2024-09-12T22:31:55.327 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_crypt_sse_s3_vault_auth": "token", 2024-09-12T22:31:55.327 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_crypt_sse_s3_vault_namespace": "", 2024-09-12T22:31:55.327 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_crypt_sse_s3_vault_prefix": "", 2024-09-12T22:31:55.327 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_crypt_sse_s3_vault_secret_engine": "transit", 2024-09-12T22:31:55.327 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_crypt_sse_s3_vault_ssl_cacert": "", 2024-09-12T22:31:55.327 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_crypt_sse_s3_vault_ssl_clientcert": "", 2024-09-12T22:31:55.327 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_crypt_sse_s3_vault_ssl_clientkey": "", 2024-09-12T22:31:55.327 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_crypt_sse_s3_vault_token_file": "", 2024-09-12T22:31:55.328 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_crypt_sse_s3_vault_verify_ssl": "true", 2024-09-12T22:31:55.328 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_crypt_suppress_logs": "true", 2024-09-12T22:31:55.328 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_crypt_vault_addr": "", 2024-09-12T22:31:55.328 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_crypt_vault_auth": "token", 2024-09-12T22:31:55.328 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_crypt_vault_namespace": "", 2024-09-12T22:31:55.328 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_crypt_vault_prefix": "", 2024-09-12T22:31:55.328 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_crypt_vault_secret_engine": "transit", 2024-09-12T22:31:55.328 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_crypt_vault_ssl_cacert": "", 2024-09-12T22:31:55.328 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_crypt_vault_ssl_clientcert": "", 2024-09-12T22:31:55.328 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_crypt_vault_ssl_clientkey": "", 2024-09-12T22:31:55.328 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_crypt_vault_token_file": "", 2024-09-12T22:31:55.328 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_crypt_vault_verify_ssl": "true", 2024-09-12T22:31:55.328 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_curl_buffersize": "524288", 2024-09-12T22:31:55.329 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_curl_low_speed_limit": "1024", 2024-09-12T22:31:55.329 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_curl_low_speed_time": "300", 2024-09-12T22:31:55.329 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_curl_tcp_keepalive": "0", 2024-09-12T22:31:55.329 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_curl_wait_timeout_ms": "1000", 2024-09-12T22:31:55.329 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_d3n_l1_datacache_persistent_path": "/tmp/rgw_datacache/", 2024-09-12T22:31:55.329 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_d3n_l1_datacache_size": "1073741824", 2024-09-12T22:31:55.329 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_d3n_l1_evict_cache_on_start": "true", 2024-09-12T22:31:55.329 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_d3n_l1_eviction_policy": "lru", 2024-09-12T22:31:55.329 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_d3n_l1_fadvise": "4", 2024-09-12T22:31:55.329 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_d3n_l1_local_datacache_enabled": "false", 2024-09-12T22:31:55.329 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_d3n_libaio_aio_num": "64", 2024-09-12T22:31:55.329 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_d3n_libaio_aio_threads": "20", 2024-09-12T22:31:55.330 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_d4n_host": "127.0.0.1", 2024-09-12T22:31:55.330 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_d4n_port": "6379", 2024-09-12T22:31:55.330 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_data": "/var/lib/ceph/radosgw/ceph-a", 2024-09-12T22:31:55.330 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_data_log_changes_size": "1000", 2024-09-12T22:31:55.330 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_data_log_num_shards": "128", 2024-09-12T22:31:55.330 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_data_log_obj_prefix": "data_log", 2024-09-12T22:31:55.330 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_data_log_window": "30", 2024-09-12T22:31:55.330 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_data_notify_interval_msec": "0", 2024-09-12T22:31:55.330 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_data_sync_poll_interval": "20", 2024-09-12T22:31:55.330 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_data_sync_spawn_window": "20", 2024-09-12T22:31:55.330 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_debug_inject_latency_bi_unlink": "0", 2024-09-12T22:31:55.330 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_debug_inject_olh_cancel_modification_err": "false", 2024-09-12T22:31:55.330 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_debug_inject_set_olh_err": "0", 2024-09-12T22:31:55.331 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_default_data_log_backing": "fifo", 2024-09-12T22:31:55.331 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_default_realm_info_oid": "default.realm", 2024-09-12T22:31:55.331 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_default_region_info_oid": "default.region", 2024-09-12T22:31:55.331 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_default_zone_info_oid": "default.zone", 2024-09-12T22:31:55.331 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_default_zonegroup_info_oid": "default.zonegroup", 2024-09-12T22:31:55.331 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_defer_to_bucket_acls": "", 2024-09-12T22:31:55.331 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_delete_multi_obj_max_num": "1000", 2024-09-12T22:31:55.331 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_dmclock_admin_lim": "0.000000", 2024-09-12T22:31:55.331 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_dmclock_admin_res": "100.000000", 2024-09-12T22:31:55.331 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_dmclock_admin_wgt": "100.000000", 2024-09-12T22:31:55.331 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_dmclock_auth_lim": "0.000000", 2024-09-12T22:31:55.331 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_dmclock_auth_res": "200.000000", 2024-09-12T22:31:55.331 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_dmclock_auth_wgt": "100.000000", 2024-09-12T22:31:55.332 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_dmclock_data_lim": "0.000000", 2024-09-12T22:31:55.332 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_dmclock_data_res": "500.000000", 2024-09-12T22:31:55.332 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_dmclock_data_wgt": "500.000000", 2024-09-12T22:31:55.332 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_dmclock_metadata_lim": "0.000000", 2024-09-12T22:31:55.332 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_dmclock_metadata_res": "500.000000", 2024-09-12T22:31:55.332 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_dmclock_metadata_wgt": "500.000000", 2024-09-12T22:31:55.332 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_dns_name": "", 2024-09-12T22:31:55.332 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_dns_s3website_name": "", 2024-09-12T22:31:55.332 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_dynamic_resharding": "true", 2024-09-12T22:31:55.332 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_enable_apis": "s3, s3website, swift, swift_auth, admin, sts, iam, notifications", 2024-09-12T22:31:55.332 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_enable_gc_threads": "true", 2024-09-12T22:31:55.332 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_enable_lc_threads": "true", 2024-09-12T22:31:55.332 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_enable_ops_log": "false", 2024-09-12T22:31:55.332 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_enable_quota_threads": "true", 2024-09-12T22:31:55.333 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_enable_static_website": "false", 2024-09-12T22:31:55.333 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_enable_usage_log": "false", 2024-09-12T22:31:55.333 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_enforce_swift_acls": "true", 2024-09-12T22:31:55.333 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_exit_timeout_secs": "120", 2024-09-12T22:31:55.333 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_expose_bucket": "false", 2024-09-12T22:31:55.333 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_extended_http_attrs": "", 2024-09-12T22:31:55.333 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_filter": "none", 2024-09-12T22:31:55.333 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_frontend_defaults": "beast ssl_certificate=config://rgw/cert/$realm/$zone.crt ssl_private_key=config://rgw/cert/$realm/$zone.key", 2024-09-12T22:31:55.333 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_frontends": "beast port=7480", 2024-09-12T22:31:55.333 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_gc_max_concurrent_io": "10", 2024-09-12T22:31:55.333 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_gc_max_deferred": "50", 2024-09-12T22:31:55.333 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_gc_max_deferred_entries_size": "3072", 2024-09-12T22:31:55.333 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_gc_max_objs": "32", 2024-09-12T22:31:55.334 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_gc_max_queue_size": "134213632", 2024-09-12T22:31:55.334 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_gc_max_trim_chunk": "16", 2024-09-12T22:31:55.334 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_gc_obj_min_wait": "7200", 2024-09-12T22:31:55.334 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_gc_processor_max_time": "3600", 2024-09-12T22:31:55.334 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_gc_processor_period": "3600", 2024-09-12T22:31:55.334 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_get_obj_max_req_size": "4194304", 2024-09-12T22:31:55.334 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_get_obj_window_size": "16777216", 2024-09-12T22:31:55.334 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_healthcheck_disabling_path": "", 2024-09-12T22:31:55.334 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_ignore_get_invalid_range": "false", 2024-09-12T22:31:55.334 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_init_timeout": "300", 2024-09-12T22:31:55.334 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_inject_notify_timeout_probability": "0.000000", 2024-09-12T22:31:55.334 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_json_config": "/var/lib/ceph/radosgw/config.json", 2024-09-12T22:31:55.334 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_kafka_connection_idle": "300", 2024-09-12T22:31:55.335 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_kafka_message_timeout": "5000", 2024-09-12T22:31:55.335 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_kafka_sleep_timeout": "10", 2024-09-12T22:31:55.335 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_keystone_accepted_admin_roles": "", 2024-09-12T22:31:55.335 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_keystone_accepted_reader_roles": "", 2024-09-12T22:31:55.335 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_keystone_accepted_roles": "Member, admin", 2024-09-12T22:31:55.335 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_keystone_admin_domain": "", 2024-09-12T22:31:55.335 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_keystone_admin_password": "", 2024-09-12T22:31:55.335 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_keystone_admin_password_path": "", 2024-09-12T22:31:55.335 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_keystone_admin_project": "", 2024-09-12T22:31:55.335 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_keystone_admin_tenant": "", 2024-09-12T22:31:55.335 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_keystone_admin_token": "", 2024-09-12T22:31:55.336 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_keystone_admin_token_path": "", 2024-09-12T22:31:55.336 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_keystone_admin_user": "", 2024-09-12T22:31:55.336 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_keystone_api_version": "2", 2024-09-12T22:31:55.336 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_keystone_barbican_domain": "", 2024-09-12T22:31:55.336 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_keystone_barbican_password": "", 2024-09-12T22:31:55.336 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_keystone_barbican_project": "", 2024-09-12T22:31:55.336 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_keystone_barbican_tenant": "", 2024-09-12T22:31:55.336 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_keystone_barbican_user": "", 2024-09-12T22:31:55.336 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_keystone_expired_token_cache_expiration": "3600", 2024-09-12T22:31:55.336 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_keystone_implicit_tenants": "false", 2024-09-12T22:31:55.336 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_keystone_service_token_accepted_roles": "admin", 2024-09-12T22:31:55.336 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_keystone_service_token_enabled": "false", 2024-09-12T22:31:55.336 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_keystone_token_cache_size": "10000", 2024-09-12T22:31:55.337 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_keystone_url": "", 2024-09-12T22:31:55.337 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_keystone_verify_ssl": "true", 2024-09-12T22:31:55.337 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_lc_debug_interval": "-1", 2024-09-12T22:31:55.337 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_lc_lock_max_time": "90", 2024-09-12T22:31:55.337 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_lc_max_objs": "32", 2024-09-12T22:31:55.337 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_lc_max_rules": "1000", 2024-09-12T22:31:55.337 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_lc_max_worker": "3", 2024-09-12T22:31:55.337 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_lc_max_wp_worker": "3", 2024-09-12T22:31:55.337 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_lc_thread_delay": "0", 2024-09-12T22:31:55.337 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_ldap_binddn": "uid=admin,cn=users,dc=example,dc=com", 2024-09-12T22:31:55.337 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_ldap_dnattr": "uid", 2024-09-12T22:31:55.337 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_ldap_searchdn": "cn=users,cn=accounts,dc=example,dc=com", 2024-09-12T22:31:55.337 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_ldap_searchfilter": "", 2024-09-12T22:31:55.338 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_ldap_secret": "/etc/openldap/secret", 2024-09-12T22:31:55.338 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_ldap_uri": "", 2024-09-12T22:31:55.338 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_lifecycle_work_time": "00:00-06:00", 2024-09-12T22:31:55.338 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_list_bucket_min_readahead": "1000", 2024-09-12T22:31:55.338 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_list_buckets_max_chunk": "1000", 2024-09-12T22:31:55.338 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_log_http_headers": "", 2024-09-12T22:31:55.338 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_log_nonexistent_bucket": "false", 2024-09-12T22:31:55.338 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_log_object_name": "%Y-%m-%d-%H-%i-%n", 2024-09-12T22:31:55.338 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_log_object_name_utc": "false", 2024-09-12T22:31:55.339 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_lua_max_memory_per_state": "128000", 2024-09-12T22:31:55.339 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_luarocks_location": "/tmp/rgw_luarocks/mon.a", 2024-09-12T22:31:55.339 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_max_attr_name_len": "0", 2024-09-12T22:31:55.339 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_max_attr_size": "0", 2024-09-12T22:31:55.339 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_max_attrs_num_in_req": "0", 2024-09-12T22:31:55.339 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_max_chunk_size": "4194304", 2024-09-12T22:31:55.339 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_max_concurrent_requests": "1024", 2024-09-12T22:31:55.339 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_max_copy_obj_concurrent_io": "10", 2024-09-12T22:31:55.339 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_max_dynamic_shards": "1999", 2024-09-12T22:31:55.339 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_max_listing_results": "1000", 2024-09-12T22:31:55.339 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_max_notify_retries": "10", 2024-09-12T22:31:55.339 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_max_objs_per_shard": "100000", 2024-09-12T22:31:55.339 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_max_put_param_size": "1048576", 2024-09-12T22:31:55.340 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_max_put_size": "5368709120", 2024-09-12T22:31:55.340 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_max_slo_entries": "1000", 2024-09-12T22:31:55.340 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_md_log_max_shards": "64", 2024-09-12T22:31:55.340 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_md_notify_interval_msec": "200", 2024-09-12T22:31:55.340 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_meta_sync_poll_interval": "20", 2024-09-12T22:31:55.340 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_meta_sync_spawn_window": "20", 2024-09-12T22:31:55.340 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_mime_types_file": "/etc/mime.types", 2024-09-12T22:31:55.340 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_mp_lock_max_time": "600", 2024-09-12T22:31:55.340 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_multi_obj_del_max_aio": "16", 2024-09-12T22:31:55.340 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_multipart_min_part_size": "5242880", 2024-09-12T22:31:55.340 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_multipart_part_upload_limit": "10000", 2024-09-12T22:31:55.340 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_nfs_fhcache_partitions": "3", 2024-09-12T22:31:55.341 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_nfs_fhcache_size": "2017", 2024-09-12T22:31:55.341 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_nfs_frontends": "rgw-nfs", 2024-09-12T22:31:55.341 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_nfs_lru_lane_hiwat": "911", 2024-09-12T22:31:55.341 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_nfs_lru_lanes": "5", 2024-09-12T22:31:55.341 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_nfs_max_gc": "300", 2024-09-12T22:31:55.341 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_nfs_namespace_expire_secs": "300", 2024-09-12T22:31:55.341 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_nfs_run_gc_threads": "false", 2024-09-12T22:31:55.341 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_nfs_run_lc_threads": "false", 2024-09-12T22:31:55.341 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_nfs_run_quota_threads": "false", 2024-09-12T22:31:55.341 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_nfs_run_sync_thread": "false", 2024-09-12T22:31:55.341 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_nfs_s3_fast_attrs": "false", 2024-09-12T22:31:55.341 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_nfs_write_completion_interval_s": "10", 2024-09-12T22:31:55.341 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_num_async_rados_threads": "32", 2024-09-12T22:31:55.342 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_num_control_oids": "8", 2024-09-12T22:31:55.342 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_numa_node": "-1", 2024-09-12T22:31:55.342 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_obj_stripe_size": "4194304", 2024-09-12T22:31:55.342 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_obj_tombstone_cache_size": "1000", 2024-09-12T22:31:55.342 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_objexp_chunk_size": "100", 2024-09-12T22:31:55.342 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_objexp_gc_interval": "600", 2024-09-12T22:31:55.342 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_objexp_hints_num_shards": "127", 2024-09-12T22:31:55.342 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_olh_pending_timeout_sec": "3600", 2024-09-12T22:31:55.342 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_op_thread_suicide_timeout": "0", 2024-09-12T22:31:55.342 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_op_thread_timeout": "600", 2024-09-12T22:31:55.342 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_op_tracing": "false", 2024-09-12T22:31:55.342 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_opa_token": "", 2024-09-12T22:31:55.342 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_opa_url": "", 2024-09-12T22:31:55.343 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_opa_verify_ssl": "true", 2024-09-12T22:31:55.343 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_ops_log_data_backlog": "5242880", 2024-09-12T22:31:55.343 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_ops_log_file_path": "/var/log/ceph/ops-log-ceph-mon.a.log", 2024-09-12T22:31:55.343 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_ops_log_rados": "false", 2024-09-12T22:31:55.343 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_ops_log_socket_path": "", 2024-09-12T22:31:55.343 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_override_bucket_index_max_shards": "0", 2024-09-12T22:31:55.343 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_pending_bucket_index_op_expiration": "120", 2024-09-12T22:31:55.343 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_period_latest_epoch_info_oid": ".latest_epoch", 2024-09-12T22:31:55.343 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_period_push_interval": "2.000000", 2024-09-12T22:31:55.343 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_period_push_interval_max": "30.000000", 2024-09-12T22:31:55.343 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_period_root_pool": ".rgw.root", 2024-09-12T22:31:55.343 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_policy_reject_invalid_principals": "true", 2024-09-12T22:31:55.343 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_posix_base_path": "/tmp/rgw_posix_driver", 2024-09-12T22:31:55.343 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_posix_cache_lanes": "3", 2024-09-12T22:31:55.344 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_posix_cache_lmdb_count": "3", 2024-09-12T22:31:55.344 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_posix_cache_max_buckets": "100", 2024-09-12T22:31:55.344 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_posix_cache_partitions": "3", 2024-09-12T22:31:55.344 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_posix_database_root": "/var/lib/ceph/radosgw", 2024-09-12T22:31:55.344 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_print_continue": "true", 2024-09-12T22:31:55.344 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_print_prohibited_content_length": "false", 2024-09-12T22:31:55.344 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_put_obj_max_window_size": "67108864", 2024-09-12T22:31:55.344 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_put_obj_min_window_size": "16777216", 2024-09-12T22:31:55.344 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_rados_pool_autoscale_bias": "4.000000", 2024-09-12T22:31:55.344 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_rados_pool_recovery_priority": "5", 2024-09-12T22:31:55.344 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_rados_tracing": "false", 2024-09-12T22:31:55.344 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_realm": "", 2024-09-12T22:31:55.344 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_realm_id": "", 2024-09-12T22:31:55.345 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_realm_root_pool": ".rgw.root", 2024-09-12T22:31:55.345 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_region": "", 2024-09-12T22:31:55.345 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_region_root_pool": ".rgw.root", 2024-09-12T22:31:55.345 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_relaxed_region_enforcement": "false", 2024-09-12T22:31:55.345 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_relaxed_s3_bucket_names": "false", 2024-09-12T22:31:55.345 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_remote_addr_param": "REMOTE_ADDR", 2024-09-12T22:31:55.345 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_request_uri": "", 2024-09-12T22:31:55.345 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_reshard_batch_size": "64", 2024-09-12T22:31:55.345 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_reshard_bucket_lock_duration": "360", 2024-09-12T22:31:55.345 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_reshard_max_aio": "128", 2024-09-12T22:31:55.345 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_reshard_num_logs": "16", 2024-09-12T22:31:55.345 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_reshard_thread_interval": "600", 2024-09-12T22:31:55.345 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_resolve_cname": "false", 2024-09-12T22:31:55.346 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_rest_getusage_op_compat": "false", 2024-09-12T22:31:55.346 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_run_sync_thread": "true", 2024-09-12T22:31:55.346 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_s3_auth_disable_signature_url": "false", 2024-09-12T22:31:55.346 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_s3_auth_order": "sts, external, local", 2024-09-12T22:31:55.346 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_s3_auth_use_keystone": "false", 2024-09-12T22:31:55.346 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_s3_auth_use_ldap": "false", 2024-09-12T22:31:55.346 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_s3_auth_use_rados": "true", 2024-09-12T22:31:55.346 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_s3_auth_use_sts": "false", 2024-09-12T22:31:55.346 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_s3_client_max_sig_ver": "-1", 2024-09-12T22:31:55.346 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_s3_success_create_obj_status": "0", 2024-09-12T22:31:55.346 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_safe_max_objects_per_shard": "102400", 2024-09-12T22:31:55.346 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_scheduler_type": "throttler", 2024-09-12T22:31:55.346 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_script_uri": "", 2024-09-12T22:31:55.346 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_service_provider_name": "", 2024-09-12T22:31:55.347 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_shard_warning_threshold": "90.000000", 2024-09-12T22:31:55.347 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_sts_client_id": "", 2024-09-12T22:31:55.347 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_sts_client_secret": "", 2024-09-12T22:31:55.347 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_sts_entry": "sts", 2024-09-12T22:31:55.347 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_sts_key": "sts", 2024-09-12T22:31:55.347 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_sts_max_session_duration": "43200", 2024-09-12T22:31:55.347 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_sts_min_session_duration": "900", 2024-09-12T22:31:55.347 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_sts_token_introspection_url": "", 2024-09-12T22:31:55.347 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_swift_account_in_url": "false", 2024-09-12T22:31:55.347 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_swift_auth_entry": "auth", 2024-09-12T22:31:55.347 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_swift_auth_url": "", 2024-09-12T22:31:55.347 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_swift_custom_header": "", 2024-09-12T22:31:55.347 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_swift_enforce_content_length": "false", 2024-09-12T22:31:55.348 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_swift_need_stats": "true", 2024-09-12T22:31:55.348 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_swift_tenant_name": "", 2024-09-12T22:31:55.348 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_swift_token_expiration": "86400", 2024-09-12T22:31:55.348 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_swift_url": "", 2024-09-12T22:31:55.348 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_swift_url_prefix": "swift", 2024-09-12T22:31:55.348 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_swift_versioning_enabled": "false", 2024-09-12T22:31:55.348 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_sync_data_full_inject_err_probability": "0.000000", 2024-09-12T22:31:55.348 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_sync_data_inject_err_probability": "0.000000", 2024-09-12T22:31:55.348 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_sync_lease_period": "120", 2024-09-12T22:31:55.348 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_sync_log_trim_concurrent_buckets": "4", 2024-09-12T22:31:55.348 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_sync_log_trim_interval": "1200", 2024-09-12T22:31:55.348 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_sync_log_trim_max_buckets": "16", 2024-09-12T22:31:55.349 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_sync_log_trim_min_cold_buckets": "4", 2024-09-12T22:31:55.349 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_sync_meta_inject_err_probability": "0.000000", 2024-09-12T22:31:55.349 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_sync_obj_etag_verify": "false", 2024-09-12T22:31:55.349 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_sync_trace_history_size": "4096", 2024-09-12T22:31:55.349 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_sync_trace_per_node_log_size": "32", 2024-09-12T22:31:55.349 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_sync_trace_servicemap_update_interval": "10", 2024-09-12T22:31:55.350 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_thread_pool_size": "512", 2024-09-12T22:31:55.350 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_topic_persistency_max_retries": "0", 2024-09-12T22:31:55.350 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_topic_persistency_sleep_duration": "0", 2024-09-12T22:31:55.350 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_topic_persistency_time_to_live": "0", 2024-09-12T22:31:55.350 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_topic_require_publish_policy": "false", 2024-09-12T22:31:55.350 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_torrent_comment": "", 2024-09-12T22:31:55.350 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_torrent_createby": "", 2024-09-12T22:31:55.351 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_torrent_encoding": "", 2024-09-12T22:31:55.351 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_torrent_flag": "false", 2024-09-12T22:31:55.351 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_torrent_max_size": "5368709120", 2024-09-12T22:31:55.351 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_torrent_origin": "", 2024-09-12T22:31:55.351 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_torrent_sha_unit": "524288", 2024-09-12T22:31:55.351 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_torrent_tracker": "", 2024-09-12T22:31:55.351 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_trust_forwarded_https": "false", 2024-09-12T22:31:55.351 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_usage_log_flush_threshold": "1024", 2024-09-12T22:31:55.351 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_usage_log_tick_interval": "30", 2024-09-12T22:31:55.351 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_usage_max_shards": "32", 2024-09-12T22:31:55.351 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_usage_max_user_shards": "1", 2024-09-12T22:31:55.351 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_use_opa_authz": "false", 2024-09-12T22:31:55.351 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_user_counters_cache": "false", 2024-09-12T22:31:55.352 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_user_counters_cache_size": "10000", 2024-09-12T22:31:55.352 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_user_default_quota_max_objects": "-1", 2024-09-12T22:31:55.352 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_user_default_quota_max_size": "-1", 2024-09-12T22:31:55.352 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_user_max_buckets": "1000", 2024-09-12T22:31:55.352 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_user_policies_max_num": "100", 2024-09-12T22:31:55.352 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_user_quota_bucket_sync_interval": "180", 2024-09-12T22:31:55.352 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_user_quota_sync_idle_users": "false", 2024-09-12T22:31:55.352 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_user_quota_sync_interval": "86400", 2024-09-12T22:31:55.352 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_user_quota_sync_wait_time": "86400", 2024-09-12T22:31:55.352 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_user_unique_email": "true", 2024-09-12T22:31:55.353 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_verify_ssl": "true", 2024-09-12T22:31:55.353 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_website_routing_rules_max_num": "50", 2024-09-12T22:31:55.353 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_zone": "", 2024-09-12T22:31:55.353 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_zone_id": "", 2024-09-12T22:31:55.353 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_zone_root_pool": ".rgw.root", 2024-09-12T22:31:55.353 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_zonegroup": "", 2024-09-12T22:31:55.353 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_zonegroup_id": "", 2024-09-12T22:31:55.353 INFO:teuthology.orchestra.run.smithi019.stdout: "rgw_zonegroup_root_pool": ".rgw.root", 2024-09-12T22:31:55.353 INFO:teuthology.orchestra.run.smithi019.stdout: "rgwlc_auto_session_clear": "true", 2024-09-12T22:31:55.353 INFO:teuthology.orchestra.run.smithi019.stdout: "rgwlc_skip_bucket_step": "false", 2024-09-12T22:31:55.353 INFO:teuthology.orchestra.run.smithi019.stdout: "rocksdb_block_size": "4096", 2024-09-12T22:31:55.353 INFO:teuthology.orchestra.run.smithi019.stdout: "rocksdb_bloom_bits_per_key": "20", 2024-09-12T22:31:55.353 INFO:teuthology.orchestra.run.smithi019.stdout: "rocksdb_cache_index_and_filter_blocks": "true", 2024-09-12T22:31:55.354 INFO:teuthology.orchestra.run.smithi019.stdout: "rocksdb_cache_index_and_filter_blocks_with_high_priority": "false", 2024-09-12T22:31:55.354 INFO:teuthology.orchestra.run.smithi019.stdout: "rocksdb_cache_row_ratio": "0.000000", 2024-09-12T22:31:55.354 INFO:teuthology.orchestra.run.smithi019.stdout: "rocksdb_cache_shard_bits": "4", 2024-09-12T22:31:55.354 INFO:teuthology.orchestra.run.smithi019.stdout: "rocksdb_cache_size": "536870912", 2024-09-12T22:31:55.354 INFO:teuthology.orchestra.run.smithi019.stdout: "rocksdb_cache_type": "binned_lru", 2024-09-12T22:31:55.354 INFO:teuthology.orchestra.run.smithi019.stdout: "rocksdb_cf_compact_on_deletion": "true", 2024-09-12T22:31:55.354 INFO:teuthology.orchestra.run.smithi019.stdout: "rocksdb_cf_compact_on_deletion_sliding_window": "32768", 2024-09-12T22:31:55.354 INFO:teuthology.orchestra.run.smithi019.stdout: "rocksdb_cf_compact_on_deletion_trigger": "16384", 2024-09-12T22:31:55.354 INFO:teuthology.orchestra.run.smithi019.stdout: "rocksdb_collect_compaction_stats": "false", 2024-09-12T22:31:55.354 INFO:teuthology.orchestra.run.smithi019.stdout: "rocksdb_collect_extended_stats": "false", 2024-09-12T22:31:55.354 INFO:teuthology.orchestra.run.smithi019.stdout: "rocksdb_collect_memory_stats": "false", 2024-09-12T22:31:55.354 INFO:teuthology.orchestra.run.smithi019.stdout: "rocksdb_delete_range_threshold": "1048576", 2024-09-12T22:31:55.354 INFO:teuthology.orchestra.run.smithi019.stdout: "rocksdb_index_type": "binary_search", 2024-09-12T22:31:55.355 INFO:teuthology.orchestra.run.smithi019.stdout: "rocksdb_log_to_ceph_log": "true", 2024-09-12T22:31:55.355 INFO:teuthology.orchestra.run.smithi019.stdout: "rocksdb_metadata_block_size": "4096", 2024-09-12T22:31:55.355 INFO:teuthology.orchestra.run.smithi019.stdout: "rocksdb_partition_filters": "false", 2024-09-12T22:31:55.355 INFO:teuthology.orchestra.run.smithi019.stdout: "rocksdb_perf": "false", 2024-09-12T22:31:55.355 INFO:teuthology.orchestra.run.smithi019.stdout: "rocksdb_pin_l0_filter_and_index_blocks_in_cache": "false", 2024-09-12T22:31:55.355 INFO:teuthology.orchestra.run.smithi019.stdout: "rotating_keys_bootstrap_timeout": "30", 2024-09-12T22:31:55.355 INFO:teuthology.orchestra.run.smithi019.stdout: "rotating_keys_renewal_timeout": "10", 2024-09-12T22:31:55.355 INFO:teuthology.orchestra.run.smithi019.stdout: "run_dir": "/var/run/ceph", 2024-09-12T22:31:55.355 INFO:teuthology.orchestra.run.smithi019.stdout: "seastore_block_create": "true", 2024-09-12T22:31:55.355 INFO:teuthology.orchestra.run.smithi019.stdout: "seastore_cache_lru_size": "67108864", 2024-09-12T22:31:55.355 INFO:teuthology.orchestra.run.smithi019.stdout: "seastore_cbjournal_size": "5368709120", 2024-09-12T22:31:55.355 INFO:teuthology.orchestra.run.smithi019.stdout: "seastore_data_delta_based_overwrite": "0", 2024-09-12T22:31:55.355 INFO:teuthology.orchestra.run.smithi019.stdout: "seastore_default_max_object_size": "16777216", 2024-09-12T22:31:55.356 INFO:teuthology.orchestra.run.smithi019.stdout: "seastore_default_object_metadata_reservation": "16777216", 2024-09-12T22:31:55.356 INFO:teuthology.orchestra.run.smithi019.stdout: "seastore_device_size": "53687091200", 2024-09-12T22:31:55.356 INFO:teuthology.orchestra.run.smithi019.stdout: "seastore_disable_end_to_end_data_protection": "true", 2024-09-12T22:31:55.356 INFO:teuthology.orchestra.run.smithi019.stdout: "seastore_full_integrity_check": "false", 2024-09-12T22:31:55.356 INFO:teuthology.orchestra.run.smithi019.stdout: "seastore_journal_batch_capacity": "16", 2024-09-12T22:31:55.356 INFO:teuthology.orchestra.run.smithi019.stdout: "seastore_journal_batch_flush_size": "16777216", 2024-09-12T22:31:55.356 INFO:teuthology.orchestra.run.smithi019.stdout: "seastore_journal_batch_preferred_fullness": "0.950000", 2024-09-12T22:31:55.356 INFO:teuthology.orchestra.run.smithi019.stdout: "seastore_journal_iodepth_limit": "5", 2024-09-12T22:31:55.356 INFO:teuthology.orchestra.run.smithi019.stdout: "seastore_main_device_type": "SSD", 2024-09-12T22:31:55.356 INFO:teuthology.orchestra.run.smithi019.stdout: "seastore_max_concurrent_transactions": "8", 2024-09-12T22:31:55.356 INFO:teuthology.orchestra.run.smithi019.stdout: "seastore_max_data_allocation_size": "32768", 2024-09-12T22:31:55.356 INFO:teuthology.orchestra.run.smithi019.stdout: "seastore_multiple_tiers_default_evict_ratio": "0.600000", 2024-09-12T22:31:55.357 INFO:teuthology.orchestra.run.smithi019.stdout: "seastore_multiple_tiers_fast_evict_ratio": "0.700000", 2024-09-12T22:31:55.357 INFO:teuthology.orchestra.run.smithi019.stdout: "seastore_multiple_tiers_stop_evict_ratio": "0.500000", 2024-09-12T22:31:55.357 INFO:teuthology.orchestra.run.smithi019.stdout: "seastore_obj_data_write_amplification": "1.250000", 2024-09-12T22:31:55.357 INFO:teuthology.orchestra.run.smithi019.stdout: "seastore_segment_size": "67108864", 2024-09-12T22:31:55.357 INFO:teuthology.orchestra.run.smithi019.stdout: "set_keepcaps": "false", 2024-09-12T22:31:55.357 INFO:teuthology.orchestra.run.smithi019.stdout: "setgroup": "", 2024-09-12T22:31:55.357 INFO:teuthology.orchestra.run.smithi019.stdout: "setuser": "", 2024-09-12T22:31:55.357 INFO:teuthology.orchestra.run.smithi019.stdout: "setuser_match_path": "", 2024-09-12T22:31:55.357 INFO:teuthology.orchestra.run.smithi019.stdout: "target_max_misplaced_ratio": "0.050000", 2024-09-12T22:31:55.357 INFO:teuthology.orchestra.run.smithi019.stdout: "thp": "false", 2024-09-12T22:31:55.357 INFO:teuthology.orchestra.run.smithi019.stdout: "threadpool_default_timeout": "60", 2024-09-12T22:31:55.357 INFO:teuthology.orchestra.run.smithi019.stdout: "threadpool_empty_queue_max_wait": "2", 2024-09-12T22:31:55.357 INFO:teuthology.orchestra.run.smithi019.stdout: "throttler_perf_counter": "true" 2024-09-12T22:31:55.358 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T22:31:55.360 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0 2024-09-12T22:31:55.475 INFO:teuthology.orchestra.run.smithi019.stdout:mon.a: {} 2024-09-12T22:31:55.475 INFO:teuthology.orchestra.run.smithi019.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-12T22:31:55.484 INFO:teuthology.orchestra.run.smithi019.stdout:mon.b: {} 2024-09-12T22:31:55.484 INFO:teuthology.orchestra.run.smithi019.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-12T22:31:55.492 INFO:teuthology.orchestra.run.smithi019.stdout:mon.c: {} 2024-09-12T22:31:55.493 INFO:teuthology.orchestra.run.smithi019.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-12T22:31:55.503 INFO:tasks.thrashosds.thrasher:Unable to test ceph-objectstore-tool, powercycle testing 2024-09-12T22:31:55.503 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-09-12T22:31:55.531 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-09-12T22:31:55.531 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2024-09-12T22:31:55.531 INFO:tasks.ceph_fuse:client.0 config is {} 2024-09-12T22:31:55.531 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-12T22:31:55.531 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-12T22:31:55.532 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T22:31:55.532 DEBUG:teuthology.orchestra.run.smithi019:> ip netns list 2024-09-12T22:31:55.532 INFO:tasks.thrashosds.thrasher:starting do_thrash 2024-09-12T22:31:55.532 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-09-12T22:31:55.532 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-12T22:31:55.533 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-09-12T22:31:55.533 INFO:tasks.thrashosds.thrasher:Setting osd 0 primary_affinity to 0.535302 2024-09-12T22:31:55.533 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 0 0.5353021620205664 2024-09-12T22:31:55.533 INFO:tasks.thrashosds.thrasher:starting do_sighup with a delay of 0.1 2024-09-12T22:31:55.534 INFO:tasks.thrashosds.thrasher:starting do_optrack_toggle with a delay of 2.0 2024-09-12T22:31:55.534 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T22:31:55.534 INFO:tasks.thrashosds.thrasher:starting do_dump_ops 2024-09-12T22:31:55.534 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:31:55.535 INFO:tasks.thrashosds.thrasher:starting do_noscrub_toggle with a delay of 2.0 2024-09-12T22:31:55.535 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T22:31:55.537 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:31:55.533+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:31:55.553 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T22:31:55.553 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link delete ceph-brx 2024-09-12T22:31:55.621 INFO:teuthology.orchestra.run.smithi019.stderr:Cannot find device "ceph-brx" 2024-09-12T22:31:55.622 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T22:31:55.623 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-09-12T22:31:55.623 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-12T22:31:55.623 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T22:31:55.635 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:31:55.634+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:31:55.653 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-09-12T22:31:55.653 INFO:teuthology.orchestra.run.smithi076.stdout: "ops": [], 2024-09-12T22:31:55.653 INFO:teuthology.orchestra.run.smithi076.stdout: "num_ops": 0 2024-09-12T22:31:55.653 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-09-12T22:31:55.662 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:31:55.667 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0: {} 2024-09-12T22:31:55.668 INFO:teuthology.orchestra.run.smithi019.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T22:31:55.687 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T22:31:55.687 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:31:55.706 INFO:teuthology.orchestra.run.smithi019.stdout:osd.2: {} 2024-09-12T22:31:55.706 INFO:teuthology.orchestra.run.smithi019.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T22:31:55.736 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:31:55.735+0000 7fddec6a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30331) UID: 0 2024-09-12T22:31:55.768 INFO:teuthology.orchestra.run.smithi076.stdout:ERROR: (22) Invalid argument 2024-09-12T22:31:55.769 INFO:teuthology.orchestra.run.smithi076.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:31:55.777 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:31:55.838 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:31:55.836+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:31:55.920 INFO:teuthology.orchestra.run.smithi076.stdout:ERROR: (22) Invalid argument 2024-09-12T22:31:55.920 INFO:teuthology.orchestra.run.smithi076.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:31:55.929 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:31:55.973 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:31:55.972+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:31:55.993 INFO:teuthology.orchestra.run.smithi019.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-12T22:31:56.006 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-12T22:31:56.006 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T22:31:56.006 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi019.front.sepia.ceph.com 2024-09-12T22:31:56.006 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-12T22:31:56.006 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-12T22:31:56.007 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-12T22:31:56.007 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-12T22:31:56.007 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T22:31:56.007 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T22:31:56.007 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T22:31:56.007 DEBUG:teuthology.orchestra.run.smithi019:> ip addr 2024-09-12T22:31:56.023 INFO:teuthology.orchestra.run.smithi019.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T22:31:56.023 INFO:teuthology.orchestra.run.smithi019.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T22:31:56.023 INFO:teuthology.orchestra.run.smithi019.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T22:31:56.023 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T22:31:56.023 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 ::1/128 scope host 2024-09-12T22:31:56.023 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T22:31:56.023 INFO:teuthology.orchestra.run.smithi019.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T22:31:56.023 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:6b:fd:12 brd ff:ff:ff:ff:ff:ff 2024-09-12T22:31:56.024 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp7s0f0 2024-09-12T22:31:56.024 INFO:teuthology.orchestra.run.smithi019.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T22:31:56.024 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:6b:fd:13 brd ff:ff:ff:ff:ff:ff 2024-09-12T22:31:56.024 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp7s0f1 2024-09-12T22:31:56.024 INFO:teuthology.orchestra.run.smithi019.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T22:31:56.024 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:bd:16:1e brd ff:ff:ff:ff:ff:ff 2024-09-12T22:31:56.024 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp1s0f0 2024-09-12T22:31:56.024 INFO:teuthology.orchestra.run.smithi019.stdout: inet 172.21.15.19/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-12T22:31:56.024 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft 42780sec preferred_lft 42780sec 2024-09-12T22:31:56.024 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::ec4:7aff:febd:161e/64 scope link 2024-09-12T22:31:56.024 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-12T22:31:56.024 INFO:teuthology.orchestra.run.smithi019.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T22:31:56.024 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:bd:16:1f brd ff:ff:ff:ff:ff:ff 2024-09-12T22:31:56.025 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp1s0f1 2024-09-12T22:31:56.025 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-12T22:31:56.025 DEBUG:teuthology.orchestra.run.smithi019:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T22:31:56.025 DEBUG:teuthology.orchestra.run.smithi019:> set -e 2024-09-12T22:31:56.025 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link add name ceph-brx type bridge 2024-09-12T22:31:56.025 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip addr flush dev ceph-brx 2024-09-12T22:31:56.025 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link set ceph-brx up 2024-09-12T22:31:56.025 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-12T22:31:56.026 DEBUG:teuthology.orchestra.run.smithi019:> ') 2024-09-12T22:31:56.039 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:31:56.038+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:31:56.044 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:31:56.044 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:31:56.053 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:31:56.084 INFO:teuthology.orchestra.run.smithi019.stderr:noscrub is set 2024-09-12T22:31:56.087 INFO:teuthology.orchestra.run.smithi019.stderr:set osd.0 primary-affinity to 0.535302 (8350812) 2024-09-12T22:31:56.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T22:31:56 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T22:31:56.139 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:31:56.138+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:31:56.198 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:31:56.198 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:31:56.208 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:31:56.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T22:31:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T22:31:56.239 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T22:31:56.239 DEBUG:teuthology.orchestra.run.smithi019:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T22:31:56.240 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:31:56.239+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:31:56.304 INFO:teuthology.orchestra.run.smithi019.stdout:1 2024-09-12T22:31:56.306 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T22:31:56.306 DEBUG:teuthology.orchestra.run.smithi019:> route 2024-09-12T22:31:56.341 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:31:56.340+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:31:56.351 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:31:56.351 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:31:56.360 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:31:56.381 INFO:teuthology.orchestra.run.smithi019.stdout:Kernel IP routing table 2024-09-12T22:31:56.381 INFO:teuthology.orchestra.run.smithi019.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T22:31:56.381 INFO:teuthology.orchestra.run.smithi019.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-12T22:31:56.381 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-12T22:31:56.381 INFO:teuthology.orchestra.run.smithi019.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T22:31:56.382 DEBUG:teuthology.orchestra.run.smithi019:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T22:31:56.382 DEBUG:teuthology.orchestra.run.smithi019:> set -e 2024-09-12T22:31:56.382 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-12T22:31:56.382 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-12T22:31:56.382 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-12T22:31:56.382 DEBUG:teuthology.orchestra.run.smithi019:> ') 2024-09-12T22:31:56.442 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:31:56.441+0000 7fddec6a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30331) UID: 0 2024-09-12T22:31:56.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T22:31:56 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T22:31:56.476 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:31:56.476 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:31:56.486 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:31:56.542 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:31:56.541+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:31:56.590 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:31:56.590 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:31:56.599 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:31:56.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T22:31:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T22:31:56.683 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:31:56.682+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:31:56.687 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T22:31:56.687 DEBUG:teuthology.orchestra.run.smithi019:> ip netns list 2024-09-12T22:31:56.704 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T22:31:56.704 DEBUG:teuthology.orchestra.run.smithi019:> ip netns list-id 2024-09-12T22:31:56.743 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:31:56.743 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:31:56.743 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:31:56.742+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:31:56.751 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:31:56.760 DEBUG:teuthology.orchestra.run.smithi019:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T22:31:56.760 DEBUG:teuthology.orchestra.run.smithi019:> set -e 2024-09-12T22:31:56.760 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T22:31:56.760 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-12T22:31:56.760 DEBUG:teuthology.orchestra.run.smithi019:> ') 2024-09-12T22:31:56.844 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:31:56.843+0000 7fddec6a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30331) UID: 0 2024-09-12T22:31:56.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T22:31:56 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T22:31:56.857 INFO:teuthology.orchestra.run.smithi076.stdout:ERROR: (22) Invalid argument 2024-09-12T22:31:56.858 INFO:teuthology.orchestra.run.smithi076.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:31:56.867 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:31:56.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T22:31:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T22:31:56.879 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-12T22:31:56.879 DEBUG:teuthology.orchestra.run.smithi019:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T22:31:56.880 DEBUG:teuthology.orchestra.run.smithi019:> set -e 2024-09-12T22:31:56.880 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-12T22:31:56.880 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-12T22:31:56.880 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-12T22:31:56.880 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-12T22:31:56.880 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-12T22:31:56.880 DEBUG:teuthology.orchestra.run.smithi019:> ') 2024-09-12T22:31:56.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T22:31:56 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T22:31:56.945 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:31:56.943+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:31:57.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T22:31:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T22:31:57.010 INFO:teuthology.orchestra.run.smithi076.stdout:ERROR: (22) Invalid argument 2024-09-12T22:31:57.010 INFO:teuthology.orchestra.run.smithi076.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:31:57.013 DEBUG:teuthology.orchestra.run.smithi019:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T22:31:57.013 DEBUG:teuthology.orchestra.run.smithi019:> set -e 2024-09-12T22:31:57.014 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link set brx.0 up 2024-09-12T22:31:57.014 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link set dev brx.0 master ceph-brx 2024-09-12T22:31:57.014 DEBUG:teuthology.orchestra.run.smithi019:> ') 2024-09-12T22:31:57.018 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:31:57.062 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:31:57.061+0000 7fddec6a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30331) UID: 0 2024-09-12T22:31:57.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T22:31:57 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T22:31:57.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T22:31:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T22:31:57.095 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-12T22:31:57.095 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T22:31:57.096 DEBUG:teuthology.orchestra.run.smithi019:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-12T22:31:57.111 INFO:teuthology.orchestra.run.smithi019.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-12T22:31:57.111 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T22:31:57.111 DEBUG:teuthology.orchestra.run.smithi019:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-12T22:31:57.123 INFO:teuthology.orchestra.run.smithi076.stdout:ERROR: (22) Invalid argument 2024-09-12T22:31:57.123 INFO:teuthology.orchestra.run.smithi076.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:31:57.132 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:31:57.166 DEBUG:teuthology.orchestra.run.smithi019:> sudo modprobe fuse 2024-09-12T22:31:57.176 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:31:57.175+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:31:57.233 DEBUG:teuthology.orchestra.run.smithi019:> cat /proc/self/mounts | awk '{print $2}' 2024-09-12T22:31:57.239 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:31:57.239 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:31:57.246 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:31:57.245+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:31:57.249 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:31:57.289 INFO:teuthology.orchestra.run.smithi019.stdout:/proc 2024-09-12T22:31:57.290 INFO:teuthology.orchestra.run.smithi019.stdout:/sys 2024-09-12T22:31:57.290 INFO:teuthology.orchestra.run.smithi019.stdout:/dev 2024-09-12T22:31:57.290 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/kernel/security 2024-09-12T22:31:57.290 INFO:teuthology.orchestra.run.smithi019.stdout:/dev/shm 2024-09-12T22:31:57.290 INFO:teuthology.orchestra.run.smithi019.stdout:/dev/pts 2024-09-12T22:31:57.290 INFO:teuthology.orchestra.run.smithi019.stdout:/run 2024-09-12T22:31:57.290 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/cgroup 2024-09-12T22:31:57.290 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/pstore 2024-09-12T22:31:57.290 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/bpf 2024-09-12T22:31:57.290 INFO:teuthology.orchestra.run.smithi019.stdout:/ 2024-09-12T22:31:57.291 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/selinux 2024-09-12T22:31:57.291 INFO:teuthology.orchestra.run.smithi019.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T22:31:57.291 INFO:teuthology.orchestra.run.smithi019.stdout:/dev/hugepages 2024-09-12T22:31:57.291 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/kernel/debug 2024-09-12T22:31:57.291 INFO:teuthology.orchestra.run.smithi019.stdout:/dev/mqueue 2024-09-12T22:31:57.291 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/kernel/tracing 2024-09-12T22:31:57.291 INFO:teuthology.orchestra.run.smithi019.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-12T22:31:57.291 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/fuse/connections 2024-09-12T22:31:57.291 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/kernel/config 2024-09-12T22:31:57.291 INFO:teuthology.orchestra.run.smithi019.stdout:/run/credentials/systemd-sysctl.service 2024-09-12T22:31:57.291 INFO:teuthology.orchestra.run.smithi019.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-12T22:31:57.291 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/nfs/rpc_pipefs 2024-09-12T22:31:57.291 INFO:teuthology.orchestra.run.smithi019.stdout:/run/user/1000 2024-09-12T22:31:57.292 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph 2024-09-12T22:31:57.292 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns 2024-09-12T22:31:57.292 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T22:31:57.292 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T22:31:57.292 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T22:31:57.292 DEBUG:teuthology.orchestra.run.smithi019:> ls /sys/fs/fuse/connections 2024-09-12T22:31:57.346 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-12T22:31:57.346 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-12T22:31:57.347 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:31:57.346+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:31:57.388 DEBUG:teuthology.orchestra.run.smithi019:> sudo modprobe fuse 2024-09-12T22:31:57.394 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:31:57.394 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:31:57.403 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:31:57.413 DEBUG:teuthology.orchestra.run.smithi019:> cat /proc/self/mounts | awk '{print $2}' 2024-09-12T22:31:57.470 INFO:teuthology.orchestra.run.smithi019.stdout:/proc 2024-09-12T22:31:57.471 INFO:teuthology.orchestra.run.smithi019.stdout:/sys 2024-09-12T22:31:57.471 INFO:teuthology.orchestra.run.smithi019.stdout:/dev 2024-09-12T22:31:57.471 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/kernel/security 2024-09-12T22:31:57.471 INFO:teuthology.orchestra.run.smithi019.stdout:/dev/shm 2024-09-12T22:31:57.471 INFO:teuthology.orchestra.run.smithi019.stdout:/dev/pts 2024-09-12T22:31:57.471 INFO:teuthology.orchestra.run.smithi019.stdout:/run 2024-09-12T22:31:57.471 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/cgroup 2024-09-12T22:31:57.471 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/pstore 2024-09-12T22:31:57.471 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/bpf 2024-09-12T22:31:57.471 INFO:teuthology.orchestra.run.smithi019.stdout:/ 2024-09-12T22:31:57.471 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/selinux 2024-09-12T22:31:57.472 INFO:teuthology.orchestra.run.smithi019.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T22:31:57.472 INFO:teuthology.orchestra.run.smithi019.stdout:/dev/hugepages 2024-09-12T22:31:57.472 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/kernel/debug 2024-09-12T22:31:57.472 INFO:teuthology.orchestra.run.smithi019.stdout:/dev/mqueue 2024-09-12T22:31:57.472 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/kernel/tracing 2024-09-12T22:31:57.472 INFO:teuthology.orchestra.run.smithi019.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-12T22:31:57.472 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/fs/fuse/connections 2024-09-12T22:31:57.472 INFO:teuthology.orchestra.run.smithi019.stdout:/sys/kernel/config 2024-09-12T22:31:57.472 INFO:teuthology.orchestra.run.smithi019.stdout:/run/credentials/systemd-sysctl.service 2024-09-12T22:31:57.472 INFO:teuthology.orchestra.run.smithi019.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-12T22:31:57.472 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/nfs/rpc_pipefs 2024-09-12T22:31:57.472 INFO:teuthology.orchestra.run.smithi019.stdout:/run/user/1000 2024-09-12T22:31:57.472 INFO:teuthology.orchestra.run.smithi019.stdout:/var/lib/ceph 2024-09-12T22:31:57.473 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns 2024-09-12T22:31:57.473 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T22:31:57.473 INFO:teuthology.orchestra.run.smithi019.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T22:31:57.473 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T22:31:57.473 DEBUG:teuthology.orchestra.run.smithi019:> ls /sys/fs/fuse/connections 2024-09-12T22:31:57.486 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi019.stderr:2024-09-12T22:31:57.484+0000 7f733f2eb480 -1 init, newargv = 0x565435fd1140 newargc=15 2024-09-12T22:31:57.486 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi019.stderr:ceph-fuse[32819]: starting ceph client 2024-09-12T22:31:57.487 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:31:57.486+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:31:57.494 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi019.stderr:ceph-fuse[32819]: starting fuse 2024-09-12T22:31:57.501 INFO:teuthology.orchestra.run.smithi019.stdout:41 2024-09-12T22:31:57.501 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2024-09-12T22:31:57.502 DEBUG:teuthology.orchestra.run.smithi019:> sudo stdin-killer -- python3 -c ' 2024-09-12T22:31:57.502 DEBUG:teuthology.orchestra.run.smithi019:> import glob 2024-09-12T22:31:57.502 DEBUG:teuthology.orchestra.run.smithi019:> import re 2024-09-12T22:31:57.502 DEBUG:teuthology.orchestra.run.smithi019:> import os 2024-09-12T22:31:57.502 DEBUG:teuthology.orchestra.run.smithi019:> import subprocess 2024-09-12T22:31:57.502 DEBUG:teuthology.orchestra.run.smithi019:> 2024-09-12T22:31:57.502 DEBUG:teuthology.orchestra.run.smithi019:> def _find_admin_socket(client_name): 2024-09-12T22:31:57.502 DEBUG:teuthology.orchestra.run.smithi019:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-12T22:31:57.502 DEBUG:teuthology.orchestra.run.smithi019:> files = glob.glob(asok_path) 2024-09-12T22:31:57.502 DEBUG:teuthology.orchestra.run.smithi019:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-12T22:31:57.503 DEBUG:teuthology.orchestra.run.smithi019:> 2024-09-12T22:31:57.503 DEBUG:teuthology.orchestra.run.smithi019:> # Given a non-glob path, it better be there 2024-09-12T22:31:57.503 DEBUG:teuthology.orchestra.run.smithi019:> if "*" not in asok_path: 2024-09-12T22:31:57.503 DEBUG:teuthology.orchestra.run.smithi019:> assert(len(files) == 1) 2024-09-12T22:31:57.503 DEBUG:teuthology.orchestra.run.smithi019:> return files[0] 2024-09-12T22:31:57.503 DEBUG:teuthology.orchestra.run.smithi019:> 2024-09-12T22:31:57.503 DEBUG:teuthology.orchestra.run.smithi019:> for f in files: 2024-09-12T22:31:57.503 DEBUG:teuthology.orchestra.run.smithi019:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-12T22:31:57.503 DEBUG:teuthology.orchestra.run.smithi019:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-12T22:31:57.503 DEBUG:teuthology.orchestra.run.smithi019:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-12T22:31:57.503 DEBUG:teuthology.orchestra.run.smithi019:> contents = proc_f.read() 2024-09-12T22:31:57.503 DEBUG:teuthology.orchestra.run.smithi019:> if mountpoint in contents: 2024-09-12T22:31:57.503 DEBUG:teuthology.orchestra.run.smithi019:> return f 2024-09-12T22:31:57.503 DEBUG:teuthology.orchestra.run.smithi019:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-12T22:31:57.503 DEBUG:teuthology.orchestra.run.smithi019:> 2024-09-12T22:31:57.504 DEBUG:teuthology.orchestra.run.smithi019:> print(_find_admin_socket("client.0")) 2024-09-12T22:31:57.504 DEBUG:teuthology.orchestra.run.smithi019:> ' 2024-09-12T22:31:57.546 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:31:57.546 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:31:57.549 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:31:57.548+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:31:57.554 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:31:57.622 INFO:teuthology.orchestra.run.smithi019.stdout:/var/run/ceph/ceph-client.0.32819.asok 2024-09-12T22:31:57.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T22:31:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T22:31:57.632 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.32819.asok 2024-09-12T22:31:57.632 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T22:31:57.633 DEBUG:teuthology.orchestra.run.smithi019:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.32819.asok status 2024-09-12T22:31:57.650 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:31:57.649+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:31:57.669 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:31:57.669 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:31:57.679 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:31:57.719 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T22:31:57.751 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:31:57.750+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:31:57.770 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T22:31:57.770 INFO:teuthology.orchestra.run.smithi019.stdout: "metadata": { 2024-09-12T22:31:57.771 INFO:teuthology.orchestra.run.smithi019.stdout: "ceph_sha1": "086c737fa75c22d521a3932c59b31c5e1d1c9ef4", 2024-09-12T22:31:57.771 INFO:teuthology.orchestra.run.smithi019.stdout: "ceph_version": "ceph version 19.1.1-314-g086c737f (086c737fa75c22d521a3932c59b31c5e1d1c9ef4) squid (stable)", 2024-09-12T22:31:57.771 INFO:teuthology.orchestra.run.smithi019.stdout: "entity_id": "0", 2024-09-12T22:31:57.771 INFO:teuthology.orchestra.run.smithi019.stdout: "hostname": "smithi019", 2024-09-12T22:31:57.771 INFO:teuthology.orchestra.run.smithi019.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-12T22:31:57.771 INFO:teuthology.orchestra.run.smithi019.stdout: "pid": "32819", 2024-09-12T22:31:57.771 INFO:teuthology.orchestra.run.smithi019.stdout: "root": "/" 2024-09-12T22:31:57.771 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:31:57.771 INFO:teuthology.orchestra.run.smithi019.stdout: "dentry_count": 0, 2024-09-12T22:31:57.771 INFO:teuthology.orchestra.run.smithi019.stdout: "dentry_pinned_count": 0, 2024-09-12T22:31:57.771 INFO:teuthology.orchestra.run.smithi019.stdout: "id": 4490, 2024-09-12T22:31:57.771 INFO:teuthology.orchestra.run.smithi019.stdout: "inst": { 2024-09-12T22:31:57.771 INFO:teuthology.orchestra.run.smithi019.stdout: "name": { 2024-09-12T22:31:57.772 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "client", 2024-09-12T22:31:57.772 INFO:teuthology.orchestra.run.smithi019.stdout: "num": 4490 2024-09-12T22:31:57.772 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:31:57.772 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": { 2024-09-12T22:31:57.772 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2024-09-12T22:31:57.772 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "192.168.0.1:0", 2024-09-12T22:31:57.772 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 2707118308 2024-09-12T22:31:57.772 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T22:31:57.772 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:31:57.772 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": { 2024-09-12T22:31:57.772 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2024-09-12T22:31:57.772 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "192.168.0.1:0", 2024-09-12T22:31:57.772 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 2707118308 2024-09-12T22:31:57.773 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:31:57.773 INFO:teuthology.orchestra.run.smithi019.stdout: "inst_str": "client.4490 192.168.0.1:0/2707118308", 2024-09-12T22:31:57.773 INFO:teuthology.orchestra.run.smithi019.stdout: "addr_str": "192.168.0.1:0/2707118308", 2024-09-12T22:31:57.773 INFO:teuthology.orchestra.run.smithi019.stdout: "inode_count": 1, 2024-09-12T22:31:57.773 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_epoch": 5, 2024-09-12T22:31:57.773 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_epoch": 23, 2024-09-12T22:31:57.773 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_epoch_barrier": 0, 2024-09-12T22:31:57.773 INFO:teuthology.orchestra.run.smithi019.stdout: "blocklisted": false, 2024-09-12T22:31:57.773 INFO:teuthology.orchestra.run.smithi019.stdout: "fs_name": "cephfs" 2024-09-12T22:31:57.773 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T22:31:57.779 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T22:31:57.779 DEBUG:teuthology.orchestra.run.smithi019:> stat --file-system '--printf=%T 2024-09-12T22:31:57.780 DEBUG:teuthology.orchestra.run.smithi019:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-12T22:31:57.795 INFO:teuthology.orchestra.run.smithi019.stdout:fuseblk 2024-09-12T22:31:57.796 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-12T22:31:57.796 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T22:31:57.796 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-12T22:31:57.822 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:31:57.822 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:31:57.831 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:31:57.845 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0: {} 2024-09-12T22:31:57.845 INFO:teuthology.orchestra.run.smithi019.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T22:31:57.851 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:31:57.851+0000 7fddec6a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30331) UID: 0 2024-09-12T22:31:57.862 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T22:31:57.875 INFO:tasks.workunit:Pulling workunits from ref 7741f7f9ee20524f89b8f61d1609b32fb3b1570a 2024-09-12T22:31:57.876 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T22:31:57.876 INFO:tasks.workunit:timeout=3h 2024-09-12T22:31:57.876 INFO:tasks.workunit:cleanup=True 2024-09-12T22:31:57.876 DEBUG:teuthology.orchestra.run.smithi019:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T22:31:57.877 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T22:31:57.877 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:31:57.881 INFO:teuthology.orchestra.run.smithi019.stdout:osd.2: {} 2024-09-12T22:31:57.881 INFO:teuthology.orchestra.run.smithi019.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T22:31:57.894 INFO:teuthology.orchestra.run.smithi019.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-12T22:31:57.894 INFO:teuthology.orchestra.run.smithi019.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-09-12T22:31:57.894 INFO:teuthology.orchestra.run.smithi019.stdout:Device: 29h/41d Inode: 1 Links: 2 2024-09-12T22:31:57.894 INFO:teuthology.orchestra.run.smithi019.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T22:31:57.894 INFO:teuthology.orchestra.run.smithi019.stdout:Context: system_u:object_r:fusefs_t:s0 2024-09-12T22:31:57.894 INFO:teuthology.orchestra.run.smithi019.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-09-12T22:31:57.894 INFO:teuthology.orchestra.run.smithi019.stdout:Modify: 2024-09-12 22:31:37.396834826 +0000 2024-09-12T22:31:57.895 INFO:teuthology.orchestra.run.smithi019.stdout:Change: 2024-09-12 22:31:57.860422892 +0000 2024-09-12T22:31:57.895 INFO:teuthology.orchestra.run.smithi019.stdout: Birth: - 2024-09-12T22:31:57.895 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-12T22:31:57.895 DEBUG:teuthology.orchestra.run.smithi019:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-12T22:31:57.937 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-09-12T22:31:57.937 INFO:teuthology.orchestra.run.smithi163.stdout: "size": 20, 2024-09-12T22:31:57.937 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 600, 2024-09-12T22:31:57.937 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2024-09-12T22:31:57.937 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:57.937 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-09-12T22:31:57.937 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:27.254459+0000", 2024-09-12T22:31:57.937 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 30.679951902999999, 2024-09-12T22:31:57.937 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.37816283899999997, 2024-09-12T22:31:57.938 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:31:57.938 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:31:57.938 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:31:57.938 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:31:57.938 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:31:57.938 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:31:57.938 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 1 2024-09-12T22:31:57.938 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:57.938 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:31:57.938 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:57.938 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:31:57.938 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254459+0000", 2024-09-12T22:31:57.938 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:31:57.939 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:57.939 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:57.939 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:31:57.939 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254459+0000", 2024-09-12T22:31:57.939 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:31:57.939 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:57.939 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:57.939 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:31:57.939 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254460+0000", 2024-09-12T22:31:57.939 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1739999999999999e-06 2024-09-12T22:31:57.939 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:57.939 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:57.939 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:31:57.940 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254472+0000", 2024-09-12T22:31:57.940 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2207e-05 2024-09-12T22:31:57.940 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:57.940 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:57.940 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:31:57.940 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254483+0000", 2024-09-12T22:31:57.940 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0631999999999999e-05 2024-09-12T22:31:57.940 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:57.940 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:57.940 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:31:57.940 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254492+0000", 2024-09-12T22:31:57.940 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3670000000000003e-06 2024-09-12T22:31:57.940 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:57.941 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:57.941 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:31:57.941 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254551+0000", 2024-09-12T22:31:57.941 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8687999999999998e-05 2024-09-12T22:31:57.941 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:57.941 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:57.941 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for peered", 2024-09-12T22:31:57.941 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254562+0000", 2024-09-12T22:31:57.941 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1249e-05 2024-09-12T22:31:57.941 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:57.941 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:57.941 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:31:57.941 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.631211+0000", 2024-09-12T22:31:57.941 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.376649018 2024-09-12T22:31:57.942 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:57.942 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:57.942 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:31:57.942 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.631345+0000", 2024-09-12T22:31:57.942 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013378700000000001 2024-09-12T22:31:57.942 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:57.942 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:57.942 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:31:57.942 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.631479+0000", 2024-09-12T22:31:57.942 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013352399999999999 2024-09-12T22:31:57.942 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:57.942 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:57.942 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:31:57.943 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632324+0000", 2024-09-12T22:31:57.943 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00084508100000000002 2024-09-12T22:31:57.943 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:57.943 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:57.943 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:31:57.943 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632548+0000", 2024-09-12T22:31:57.943 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000224329 2024-09-12T22:31:57.943 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:57.943 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:57.943 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:31:57.943 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632591+0000", 2024-09-12T22:31:57.943 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2564000000000001e-05 2024-09-12T22:31:57.943 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:57.943 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:57.944 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:31:57.944 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632622+0000", 2024-09-12T22:31:57.944 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1219e-05 2024-09-12T22:31:57.944 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:31:57.944 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:31:57.944 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:31:57.944 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:57.944 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:57.944 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:185 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:31:57.944 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394355+0000", 2024-09-12T22:31:57.944 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 29.540055806000002, 2024-09-12T22:31:57.944 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011302394, 2024-09-12T22:31:57.944 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:31:57.945 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:31:57.945 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:31:57.945 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:31:57.945 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:31:57.945 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:31:57.945 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 185 2024-09-12T22:31:57.945 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:57.945 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:31:57.945 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:57.945 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:31:57.945 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394355+0000", 2024-09-12T22:31:57.945 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:31:57.945 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:57.946 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:57.946 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:31:57.946 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394355+0000", 2024-09-12T22:31:57.946 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:31:57.946 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:57.946 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:57.946 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:31:57.946 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394355+0000", 2024-09-12T22:31:57.946 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9099999999999999e-07 2024-09-12T22:31:57.946 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:57.946 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:57.946 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:31:57.947 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394385+0000", 2024-09-12T22:31:57.947 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9963000000000001e-05 2024-09-12T22:31:57.947 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:57.947 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:57.947 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:31:57.947 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394390+0000", 2024-09-12T22:31:57.947 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8420000000000004e-06 2024-09-12T22:31:57.947 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:57.947 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:57.947 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:31:57.948 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394393+0000", 2024-09-12T22:31:57.948 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1e-06 2024-09-12T22:31:57.948 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:57.948 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:57.948 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:31:57.948 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.400546+0000", 2024-09-12T22:31:57.948 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0061523309999999996 2024-09-12T22:31:57.948 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:57.949 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:57.949 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:31:57.949 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.400588+0000", 2024-09-12T22:31:57.949 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1835000000000002e-05 2024-09-12T22:31:57.949 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:57.949 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:57.949 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:31:57.949 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.400677+0000", 2024-09-12T22:31:57.949 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9195000000000002e-05 2024-09-12T22:31:57.949 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:57.949 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:57.949 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:31:57.950 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405378+0000", 2024-09-12T22:31:57.950 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0047008659999999997 2024-09-12T22:31:57.950 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:57.950 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:57.950 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:31:57.950 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405569+0000", 2024-09-12T22:31:57.950 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00019148599999999999 2024-09-12T22:31:57.950 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:57.950 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:57.950 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:31:57.950 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405620+0000", 2024-09-12T22:31:57.950 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1416999999999999e-05 2024-09-12T22:31:57.950 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:57.951 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:57.951 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:31:57.951 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405657+0000", 2024-09-12T22:31:57.951 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6968000000000002e-05 2024-09-12T22:31:57.951 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:31:57.951 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:31:57.951 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:31:57.951 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:57.951 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:57.951 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:31:57.951 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394399+0000", 2024-09-12T22:31:57.951 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 29.540011594999999, 2024-09-12T22:31:57.951 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011336601999999999, 2024-09-12T22:31:57.952 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:31:57.952 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:31:57.952 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:31:57.952 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:31:57.952 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:31:57.952 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:31:57.952 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 186 2024-09-12T22:31:57.952 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:57.952 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:31:57.952 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:57.952 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:31:57.952 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394399+0000", 2024-09-12T22:31:57.953 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:31:57.953 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:57.953 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:57.953 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:31:57.953 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394399+0000", 2024-09-12T22:31:57.953 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:31:57.953 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:57.953 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:57.953 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:31:57.953 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394400+0000", 2024-09-12T22:31:57.953 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4499999999999998e-07 2024-09-12T22:31:57.953 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:57.954 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:57.954 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:31:57.954 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394402+0000", 2024-09-12T22:31:57.954 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.875e-06 2024-09-12T22:31:57.954 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:57.954 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:57.954 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:31:57.954 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394405+0000", 2024-09-12T22:31:57.954 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6799999999999999e-06 2024-09-12T22:31:57.954 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:57.954 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:57.954 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:31:57.954 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394408+0000", 2024-09-12T22:31:57.954 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.667e-06 2024-09-12T22:31:57.955 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:57.955 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:57.955 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:31:57.955 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401395+0000", 2024-09-12T22:31:57.955 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0069867230000000002 2024-09-12T22:31:57.955 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:57.955 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:57.955 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:31:57.955 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401438+0000", 2024-09-12T22:31:57.955 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3554999999999999e-05 2024-09-12T22:31:57.955 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:57.955 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:57.955 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:31:57.956 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401509+0000", 2024-09-12T22:31:57.956 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0631999999999997e-05 2024-09-12T22:31:57.956 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:57.956 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:57.956 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:31:57.956 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405392+0000", 2024-09-12T22:31:57.956 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0038830449999999999 2024-09-12T22:31:57.956 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:57.956 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:57.956 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:31:57.956 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405690+0000", 2024-09-12T22:31:57.956 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000298435 2024-09-12T22:31:57.956 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:57.957 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:57.957 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:31:57.957 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405716+0000", 2024-09-12T22:31:57.957 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5435999999999998e-05 2024-09-12T22:31:57.957 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:57.957 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:57.957 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:31:57.957 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405736+0000", 2024-09-12T22:31:57.957 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0208999999999999e-05 2024-09-12T22:31:57.957 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:31:57.957 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:31:57.957 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:31:57.957 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:57.957 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:57.958 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:31:57.958 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394411+0000", 2024-09-12T22:31:57.958 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 29.539999469000001, 2024-09-12T22:31:57.958 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011400117, 2024-09-12T22:31:57.958 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:31:57.958 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:31:57.958 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:31:57.958 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:31:57.958 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:31:57.958 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:31:57.958 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 187 2024-09-12T22:31:57.958 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:57.958 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:31:57.959 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:57.959 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:31:57.959 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394411+0000", 2024-09-12T22:31:57.959 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:31:57.959 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:57.959 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:57.959 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:31:57.959 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394411+0000", 2024-09-12T22:31:57.959 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:31:57.959 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:57.960 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:57.960 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:31:57.960 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394412+0000", 2024-09-12T22:31:57.960 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.4999999999999999e-07 2024-09-12T22:31:57.960 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:57.960 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:57.960 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:31:57.960 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394414+0000", 2024-09-12T22:31:57.960 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.984e-06 2024-09-12T22:31:57.960 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:57.960 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:57.960 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:31:57.960 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394418+0000", 2024-09-12T22:31:57.961 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0840000000000002e-06 2024-09-12T22:31:57.961 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:57.961 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:57.961 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:31:57.961 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394431+0000", 2024-09-12T22:31:57.961 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.361e-05 2024-09-12T22:31:57.961 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:57.961 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:57.961 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:31:57.961 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401778+0000", 2024-09-12T22:31:57.961 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0073462659999999997 2024-09-12T22:31:57.961 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:57.962 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:57.962 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:31:57.962 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401853+0000", 2024-09-12T22:31:57.962 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5797000000000006e-05 2024-09-12T22:31:57.962 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:57.962 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:57.962 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:31:57.962 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401990+0000", 2024-09-12T22:31:57.962 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013651399999999999 2024-09-12T22:31:57.962 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:57.962 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:57.962 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:31:57.962 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405402+0000", 2024-09-12T22:31:57.962 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0034116070000000001 2024-09-12T22:31:57.963 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:57.963 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:57.963 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:31:57.963 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405764+0000", 2024-09-12T22:31:57.963 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00036234899999999998 2024-09-12T22:31:57.963 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:57.963 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:57.963 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:31:57.963 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405791+0000", 2024-09-12T22:31:57.963 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7029000000000002e-05 2024-09-12T22:31:57.963 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:57.963 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:57.963 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:31:57.964 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405812+0000", 2024-09-12T22:31:57.964 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0627000000000001e-05 2024-09-12T22:31:57.964 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:31:57.964 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:31:57.964 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:31:57.964 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:57.964 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:57.964 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:31:57.964 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394447+0000", 2024-09-12T22:31:57.964 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 29.539964317999999, 2024-09-12T22:31:57.964 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011759588, 2024-09-12T22:31:57.964 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:31:57.964 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:31:57.965 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:31:57.965 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:31:57.965 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:31:57.965 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:31:57.965 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 188 2024-09-12T22:31:57.965 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:57.965 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:31:57.965 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:57.965 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:31:57.965 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394447+0000", 2024-09-12T22:31:57.966 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:31:57.966 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:57.966 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:57.966 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:31:57.966 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394447+0000", 2024-09-12T22:31:57.966 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:31:57.966 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:57.966 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:57.966 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:31:57.966 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394447+0000", 2024-09-12T22:31:57.966 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.15e-07 2024-09-12T22:31:57.966 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:57.966 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:57.967 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:31:57.967 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394512+0000", 2024-09-12T22:31:57.967 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4580999999999997e-05 2024-09-12T22:31:57.967 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:57.967 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:57.967 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:31:57.967 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394518+0000", 2024-09-12T22:31:57.967 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.3380000000000001e-06 2024-09-12T22:31:57.967 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:57.967 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:57.967 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:31:57.967 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394521+0000", 2024-09-12T22:31:57.967 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3340000000000002e-06 2024-09-12T22:31:57.968 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:57.968 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:57.968 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:31:57.968 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.402628+0000", 2024-09-12T22:31:57.968 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.008106996 2024-09-12T22:31:57.968 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:57.968 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:57.968 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:31:57.969 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.402670+0000", 2024-09-12T22:31:57.969 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1983000000000001e-05 2024-09-12T22:31:57.969 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:57.969 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:57.969 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:31:57.969 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.402738+0000", 2024-09-12T22:31:57.969 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.8114999999999994e-05 2024-09-12T22:31:57.969 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:57.969 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:57.969 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:31:57.969 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405668+0000", 2024-09-12T22:31:57.969 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.002929545 2024-09-12T22:31:57.969 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:57.970 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:57.970 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:31:57.970 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406162+0000", 2024-09-12T22:31:57.970 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000494408 2024-09-12T22:31:57.970 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:57.970 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:57.970 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:31:57.970 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406188+0000", 2024-09-12T22:31:57.970 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5766e-05 2024-09-12T22:31:57.970 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:57.970 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:57.970 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:31:57.970 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406206+0000", 2024-09-12T22:31:57.971 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.8107000000000001e-05 2024-09-12T22:31:57.971 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:31:57.971 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:31:57.971 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:31:57.971 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:57.971 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:57.971 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:31:57.971 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394528+0000", 2024-09-12T22:31:57.971 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 29.539882648999999, 2024-09-12T22:31:57.972 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.01195536, 2024-09-12T22:31:57.972 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:31:57.972 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:31:57.972 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:31:57.972 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:31:57.972 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:31:57.972 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:31:57.972 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 189 2024-09-12T22:31:57.972 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:57.972 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:31:57.972 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:57.972 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:31:57.972 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394528+0000", 2024-09-12T22:31:57.973 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:31:57.973 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:57.973 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:57.973 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:31:57.973 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394528+0000", 2024-09-12T22:31:57.973 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:31:57.973 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:57.973 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:57.973 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:31:57.973 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394529+0000", 2024-09-12T22:31:57.973 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4900000000000001e-07 2024-09-12T22:31:57.973 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:57.973 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:57.974 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:31:57.974 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394531+0000", 2024-09-12T22:31:57.974 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.458e-06 2024-09-12T22:31:57.974 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:57.974 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:57.974 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:31:57.974 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394535+0000", 2024-09-12T22:31:57.974 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7900000000000001e-06 2024-09-12T22:31:57.974 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:57.974 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:57.974 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:31:57.974 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394537+0000", 2024-09-12T22:31:57.974 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.632e-06 2024-09-12T22:31:57.975 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:57.975 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:57.975 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:31:57.975 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.404932+0000", 2024-09-12T22:31:57.975 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010394158000000001 2024-09-12T22:31:57.975 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:57.975 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:57.975 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:31:57.975 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405017+0000", 2024-09-12T22:31:57.975 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5525000000000005e-05 2024-09-12T22:31:57.975 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:57.975 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:57.975 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:31:57.976 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405114+0000", 2024-09-12T22:31:57.976 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.6527000000000006e-05 2024-09-12T22:31:57.976 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:57.976 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:57.976 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:31:57.976 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405818+0000", 2024-09-12T22:31:57.976 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00070412800000000005 2024-09-12T22:31:57.976 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:57.976 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:57.976 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:31:57.977 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406437+0000", 2024-09-12T22:31:57.977 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00061898900000000002 2024-09-12T22:31:57.977 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:57.977 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:57.977 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:31:57.977 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406463+0000", 2024-09-12T22:31:57.977 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6268e-05 2024-09-12T22:31:57.977 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:57.977 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:57.977 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:31:57.977 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406484+0000", 2024-09-12T22:31:57.977 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0536000000000001e-05 2024-09-12T22:31:57.978 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:31:57.978 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:31:57.978 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:31:57.978 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:57.978 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:57.978 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:31:57.978 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.401422+0000", 2024-09-12T22:31:57.978 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 20.532988744000001, 2024-09-12T22:31:57.978 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016896452999999999, 2024-09-12T22:31:57.978 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:31:57.978 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:31:57.978 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:31:57.978 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:31:57.979 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:57.979 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:31:57.979 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401422+0000", 2024-09-12T22:31:57.979 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:31:57.979 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:57.979 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:57.979 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:31:57.979 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401422+0000", 2024-09-12T22:31:57.979 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:31:57.979 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:57.979 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:57.979 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:31:57.979 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401424+0000", 2024-09-12T22:31:57.980 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9e-06 2024-09-12T22:31:57.980 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:57.980 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:57.980 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:31:57.980 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401437+0000", 2024-09-12T22:31:57.980 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2831e-05 2024-09-12T22:31:57.980 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:57.980 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:57.980 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:31:57.980 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401471+0000", 2024-09-12T22:31:57.980 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4010000000000001e-05 2024-09-12T22:31:57.980 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:57.980 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:57.981 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:31:57.981 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401484+0000", 2024-09-12T22:31:57.981 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2711000000000001e-05 2024-09-12T22:31:57.981 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:57.981 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:57.981 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:31:57.981 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405410+0000", 2024-09-12T22:31:57.981 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0039259170000000001 2024-09-12T22:31:57.981 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:57.981 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:57.981 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:31:57.981 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405529+0000", 2024-09-12T22:31:57.982 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000119778 2024-09-12T22:31:57.982 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:57.982 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:57.982 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:31:57.982 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405655+0000", 2024-09-12T22:31:57.982 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012556700000000001 2024-09-12T22:31:57.982 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:57.982 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:57.982 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:31:57.982 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410456+0000", 2024-09-12T22:31:57.982 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0048008269999999997 2024-09-12T22:31:57.982 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:57.982 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:57.983 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:31:57.983 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418226+0000", 2024-09-12T22:31:57.983 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0077707729999999999 2024-09-12T22:31:57.983 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:57.983 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:57.983 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:31:57.983 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418277+0000", 2024-09-12T22:31:57.983 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0476000000000003e-05 2024-09-12T22:31:57.983 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:57.983 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:57.983 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:31:57.983 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418319+0000", 2024-09-12T22:31:57.984 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1662999999999997e-05 2024-09-12T22:31:57.984 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:31:57.984 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:31:57.984 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:31:57.984 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:57.984 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:57.984 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:31:57.984 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.401505+0000", 2024-09-12T22:31:57.984 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 20.53290608, 2024-09-12T22:31:57.985 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016987904000000002, 2024-09-12T22:31:57.985 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:31:57.985 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:31:57.985 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:31:57.985 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:31:57.985 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:57.985 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:31:57.985 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401505+0000", 2024-09-12T22:31:57.985 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:31:57.985 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:57.985 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:57.985 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:31:57.986 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401505+0000", 2024-09-12T22:31:57.986 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:31:57.986 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:57.986 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:57.986 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:31:57.986 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401506+0000", 2024-09-12T22:31:57.986 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4700000000000001e-07 2024-09-12T22:31:57.986 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:57.986 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:57.986 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:31:57.987 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401510+0000", 2024-09-12T22:31:57.987 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6609999999999999e-06 2024-09-12T22:31:57.987 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:57.987 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:57.987 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:31:57.987 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401771+0000", 2024-09-12T22:31:57.987 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00026110700000000001 2024-09-12T22:31:57.987 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:57.987 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:57.987 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:31:57.988 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401921+0000", 2024-09-12T22:31:57.988 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014939099999999999 2024-09-12T22:31:57.988 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:57.988 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:57.988 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:31:57.988 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405944+0000", 2024-09-12T22:31:57.988 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0040235449999999999 2024-09-12T22:31:57.988 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:57.988 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:57.988 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:31:57.988 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406018+0000", 2024-09-12T22:31:57.988 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3373000000000004e-05 2024-09-12T22:31:57.988 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:57.989 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:57.989 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:31:57.989 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406172+0000", 2024-09-12T22:31:57.989 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00015435399999999999 2024-09-12T22:31:57.989 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:57.989 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:57.989 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:31:57.989 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410461+0000", 2024-09-12T22:31:57.989 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0042888609999999997 2024-09-12T22:31:57.989 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:57.990 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:57.990 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:31:57.990 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418371+0000", 2024-09-12T22:31:57.990 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0079098380000000006 2024-09-12T22:31:57.990 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:57.990 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:57.990 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:31:57.990 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418443+0000", 2024-09-12T22:31:57.990 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2705000000000003e-05 2024-09-12T22:31:57.990 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:57.991 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:57.991 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:31:57.991 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418493+0000", 2024-09-12T22:31:57.991 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9322e-05 2024-09-12T22:31:57.991 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:31:57.991 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:31:57.991 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:31:57.991 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:57.991 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:57.991 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:31:57.991 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.401939+0000", 2024-09-12T22:31:57.991 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 20.532472343999999, 2024-09-12T22:31:57.992 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016722292999999999, 2024-09-12T22:31:57.992 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:31:57.992 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:31:57.992 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:31:57.992 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:31:57.992 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:57.992 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:31:57.992 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401939+0000", 2024-09-12T22:31:57.992 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:31:57.992 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:57.992 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:57.992 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:31:57.993 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401939+0000", 2024-09-12T22:31:57.993 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:31:57.993 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:57.993 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:57.993 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:31:57.993 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401940+0000", 2024-09-12T22:31:57.993 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1990000000000001e-06 2024-09-12T22:31:57.993 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:57.993 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:57.993 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:31:57.993 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401956+0000", 2024-09-12T22:31:57.993 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.6344000000000001e-05 2024-09-12T22:31:57.994 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:57.994 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:57.994 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:31:57.994 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401974+0000", 2024-09-12T22:31:57.994 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7730000000000001e-05 2024-09-12T22:31:57.994 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:57.994 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:57.994 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:31:57.994 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401982+0000", 2024-09-12T22:31:57.994 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.7800000000000001e-06 2024-09-12T22:31:57.994 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:57.994 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:57.994 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:31:57.995 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406557+0000", 2024-09-12T22:31:57.995 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0045758489999999999 2024-09-12T22:31:57.995 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:57.995 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:57.995 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:31:57.995 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406697+0000", 2024-09-12T22:31:57.995 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013925100000000001 2024-09-12T22:31:57.995 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:57.995 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:57.995 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:31:57.995 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406830+0000", 2024-09-12T22:31:57.995 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013293499999999999 2024-09-12T22:31:57.996 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:57.996 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:57.996 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:31:57.996 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410465+0000", 2024-09-12T22:31:57.996 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0036352680000000001 2024-09-12T22:31:57.996 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:57.996 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:57.996 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:31:57.996 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418564+0000", 2024-09-12T22:31:57.997 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0080992140000000004 2024-09-12T22:31:57.997 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:57.997 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:57.997 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:31:57.997 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418621+0000", 2024-09-12T22:31:57.997 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7167999999999999e-05 2024-09-12T22:31:57.997 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:57.997 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:57.997 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:31:57.997 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418661+0000", 2024-09-12T22:31:57.997 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9555000000000003e-05 2024-09-12T22:31:57.997 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:31:57.997 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:31:57.997 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:31:57.998 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:57.998 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:57.998 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:31:57.998 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.401994+0000", 2024-09-12T22:31:57.998 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 20.532416472000001, 2024-09-12T22:31:57.998 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016804109000000001, 2024-09-12T22:31:57.998 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:31:57.998 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:31:57.998 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:31:57.998 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:31:57.998 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:57.998 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:31:57.998 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401994+0000", 2024-09-12T22:31:57.999 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:31:57.999 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:57.999 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:57.999 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:31:57.999 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401994+0000", 2024-09-12T22:31:57.999 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:31:57.999 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:57.999 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:57.999 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:31:57.999 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401995+0000", 2024-09-12T22:31:57.999 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.8899999999999998e-07 2024-09-12T22:31:57.999 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:57.999 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.000 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:31:58.000 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402000+0000", 2024-09-12T22:31:58.000 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.498e-06 2024-09-12T22:31:58.000 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:58.000 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.000 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:31:58.000 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402007+0000", 2024-09-12T22:31:58.000 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.554e-06 2024-09-12T22:31:58.000 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:58.000 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.000 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:31:58.000 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402046+0000", 2024-09-12T22:31:58.000 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9156000000000003e-05 2024-09-12T22:31:58.001 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:58.001 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.001 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:31:58.001 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407342+0000", 2024-09-12T22:31:58.001 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052957610000000004 2024-09-12T22:31:58.001 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:58.001 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.001 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:31:58.001 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407521+0000", 2024-09-12T22:31:58.001 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00017878100000000001 2024-09-12T22:31:58.001 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:58.001 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.001 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:31:58.002 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407641+0000", 2024-09-12T22:31:58.002 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012013 2024-09-12T22:31:58.002 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:58.002 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.002 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:31:58.002 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410472+0000", 2024-09-12T22:31:58.002 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.002830455 2024-09-12T22:31:58.002 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:58.002 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.002 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:31:58.002 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418714+0000", 2024-09-12T22:31:58.002 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0082422789999999999 2024-09-12T22:31:58.002 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:58.002 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.003 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:31:58.003 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418761+0000", 2024-09-12T22:31:58.003 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6956999999999998e-05 2024-09-12T22:31:58.003 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:58.003 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.003 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:31:58.003 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418799+0000", 2024-09-12T22:31:58.003 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7749000000000001e-05 2024-09-12T22:31:58.003 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:31:58.003 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:31:58.003 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:31:58.003 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:58.003 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.003 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:31:58.004 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.402060+0000", 2024-09-12T22:31:58.004 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 20.532351028000001, 2024-09-12T22:31:58.004 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016885686, 2024-09-12T22:31:58.004 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:31:58.004 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:31:58.004 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:31:58.004 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:31:58.004 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.004 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:31:58.004 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402060+0000", 2024-09-12T22:31:58.004 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:31:58.004 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:58.004 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.005 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:31:58.005 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402060+0000", 2024-09-12T22:31:58.005 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:31:58.005 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:58.005 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.005 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:31:58.005 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402061+0000", 2024-09-12T22:31:58.005 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4399999999999999e-07 2024-09-12T22:31:58.005 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:58.005 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.005 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:31:58.005 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402066+0000", 2024-09-12T22:31:58.005 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8649999999999998e-06 2024-09-12T22:31:58.005 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:58.006 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.006 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:31:58.006 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402146+0000", 2024-09-12T22:31:58.006 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9054000000000006e-05 2024-09-12T22:31:58.006 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:58.006 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.006 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:31:58.006 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402287+0000", 2024-09-12T22:31:58.006 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014108600000000001 2024-09-12T22:31:58.006 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:58.006 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.006 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:31:58.006 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408185+0000", 2024-09-12T22:31:58.006 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0058983919999999997 2024-09-12T22:31:58.007 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:58.007 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.007 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:31:58.007 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408299+0000", 2024-09-12T22:31:58.007 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114102 2024-09-12T22:31:58.007 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:58.007 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.007 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:31:58.007 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408420+0000", 2024-09-12T22:31:58.007 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000120492 2024-09-12T22:31:58.007 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:58.007 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.007 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:31:58.007 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410867+0000", 2024-09-12T22:31:58.008 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0024476430000000002 2024-09-12T22:31:58.008 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:58.008 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.008 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:31:58.008 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418851+0000", 2024-09-12T22:31:58.008 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0079841489999999994 2024-09-12T22:31:58.008 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:58.008 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.008 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:31:58.008 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418894+0000", 2024-09-12T22:31:58.008 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3090000000000002e-05 2024-09-12T22:31:58.008 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:58.008 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.009 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:31:58.009 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418946+0000", 2024-09-12T22:31:58.009 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1069000000000002e-05 2024-09-12T22:31:58.009 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:31:58.009 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:31:58.009 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:31:58.009 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:58.009 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.009 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:31:58.009 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.402375+0000", 2024-09-12T22:31:58.009 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 20.532035962999998, 2024-09-12T22:31:58.009 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016768531999999999, 2024-09-12T22:31:58.009 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:31:58.010 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:31:58.010 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:31:58.010 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:31:58.010 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.010 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:31:58.010 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402375+0000", 2024-09-12T22:31:58.010 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:31:58.010 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:58.010 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.010 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:31:58.010 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402375+0000", 2024-09-12T22:31:58.010 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:31:58.010 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:58.011 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.011 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:31:58.011 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402375+0000", 2024-09-12T22:31:58.011 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4099999999999999e-07 2024-09-12T22:31:58.011 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:58.011 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.011 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:31:58.011 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402379+0000", 2024-09-12T22:31:58.011 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9870000000000001e-06 2024-09-12T22:31:58.011 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:58.011 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.011 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:31:58.012 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402389+0000", 2024-09-12T22:31:58.012 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0000000000000001e-05 2024-09-12T22:31:58.012 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:58.012 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.012 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:31:58.012 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402401+0000", 2024-09-12T22:31:58.012 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.148e-05 2024-09-12T22:31:58.012 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:58.012 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.012 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:31:58.012 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409108+0000", 2024-09-12T22:31:58.012 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0067068429999999997 2024-09-12T22:31:58.012 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:58.013 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.013 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:31:58.013 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409189+0000", 2024-09-12T22:31:58.013 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0815999999999993e-05 2024-09-12T22:31:58.013 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:58.013 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.013 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:31:58.013 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409320+0000", 2024-09-12T22:31:58.013 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000131586 2024-09-12T22:31:58.013 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:58.013 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.013 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:31:58.013 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410872+0000", 2024-09-12T22:31:58.014 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0015521599999999999 2024-09-12T22:31:58.014 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:58.014 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.014 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:31:58.014 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419049+0000", 2024-09-12T22:31:58.014 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0081763719999999995 2024-09-12T22:31:58.014 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:58.014 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.014 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:31:58.014 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419107+0000", 2024-09-12T22:31:58.014 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7899000000000002e-05 2024-09-12T22:31:58.014 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:58.014 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.015 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:31:58.015 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419143+0000", 2024-09-12T22:31:58.015 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6847999999999997e-05 2024-09-12T22:31:58.015 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:31:58.015 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:31:58.015 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:31:58.015 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:58.015 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.015 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:31:58.015 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.402903+0000", 2024-09-12T22:31:58.015 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 20.531507551000001, 2024-09-12T22:31:58.015 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016378428, 2024-09-12T22:31:58.015 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:31:58.016 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:31:58.016 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:31:58.016 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:31:58.016 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.016 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:31:58.016 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402903+0000", 2024-09-12T22:31:58.016 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:31:58.016 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:58.016 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.016 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:31:58.016 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402903+0000", 2024-09-12T22:31:58.016 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:31:58.016 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:58.017 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.017 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:31:58.017 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402904+0000", 2024-09-12T22:31:58.017 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9500000000000001e-07 2024-09-12T22:31:58.017 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:58.017 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.017 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:31:58.017 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402944+0000", 2024-09-12T22:31:58.017 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0265000000000002e-05 2024-09-12T22:31:58.017 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:58.017 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.017 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:31:58.017 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402979+0000", 2024-09-12T22:31:58.018 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4378000000000002e-05 2024-09-12T22:31:58.018 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:58.018 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.018 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:31:58.018 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402987+0000", 2024-09-12T22:31:58.018 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3559999999999993e-06 2024-09-12T22:31:58.018 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:58.018 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.018 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:31:58.018 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409577+0000", 2024-09-12T22:31:58.018 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0065901709999999997 2024-09-12T22:31:58.018 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:58.018 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.019 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:31:58.019 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409653+0000", 2024-09-12T22:31:58.019 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5819e-05 2024-09-12T22:31:58.019 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:58.019 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.019 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:31:58.019 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409725+0000", 2024-09-12T22:31:58.019 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2200000000000007e-05 2024-09-12T22:31:58.019 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:58.019 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.019 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:31:58.019 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.411234+0000", 2024-09-12T22:31:58.019 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001508225 2024-09-12T22:31:58.019 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:58.020 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.020 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:31:58.020 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419212+0000", 2024-09-12T22:31:58.020 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0079783400000000004 2024-09-12T22:31:58.020 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:58.020 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.020 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:31:58.020 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419244+0000", 2024-09-12T22:31:58.020 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2384e-05 2024-09-12T22:31:58.020 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:58.020 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.020 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:31:58.020 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419282+0000", 2024-09-12T22:31:58.021 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7394999999999997e-05 2024-09-12T22:31:58.021 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:31:58.021 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:31:58.021 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:31:58.021 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:58.021 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.021 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:31:58.021 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.403135+0000", 2024-09-12T22:31:58.021 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 20.531275681, 2024-09-12T22:31:58.021 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016294211999999999, 2024-09-12T22:31:58.021 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:31:58.021 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:31:58.021 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:31:58.021 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:31:58.022 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.022 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:31:58.022 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403135+0000", 2024-09-12T22:31:58.022 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:31:58.022 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:58.022 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.022 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:31:58.022 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403135+0000", 2024-09-12T22:31:58.022 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:31:58.022 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:58.022 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.022 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:31:58.022 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403136+0000", 2024-09-12T22:31:58.022 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.4e-07 2024-09-12T22:31:58.022 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:58.023 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.023 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:31:58.023 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403149+0000", 2024-09-12T22:31:58.023 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2723e-05 2024-09-12T22:31:58.023 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:58.023 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.023 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:31:58.023 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403158+0000", 2024-09-12T22:31:58.023 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3919999999999992e-06 2024-09-12T22:31:58.023 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:58.023 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.023 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:31:58.024 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403166+0000", 2024-09-12T22:31:58.024 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.2309999999999996e-06 2024-09-12T22:31:58.024 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:58.024 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.024 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:31:58.024 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409944+0000", 2024-09-12T22:31:58.024 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0067775309999999998 2024-09-12T22:31:58.024 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:58.024 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.024 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:31:58.024 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410032+0000", 2024-09-12T22:31:58.024 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.7906999999999997e-05 2024-09-12T22:31:58.024 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:58.025 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.025 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:31:58.025 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410152+0000", 2024-09-12T22:31:58.025 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012037800000000001 2024-09-12T22:31:58.025 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:58.025 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.025 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:31:58.025 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.411945+0000", 2024-09-12T22:31:58.025 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0017931850000000001 2024-09-12T22:31:58.025 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:58.025 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.025 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:31:58.025 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419319+0000", 2024-09-12T22:31:58.025 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0073731780000000002 2024-09-12T22:31:58.026 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:58.026 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.026 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:31:58.026 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419376+0000", 2024-09-12T22:31:58.026 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7728e-05 2024-09-12T22:31:58.026 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:58.026 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.026 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:31:58.026 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419429+0000", 2024-09-12T22:31:58.026 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3019000000000002e-05 2024-09-12T22:31:58.026 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:31:58.026 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:31:58.026 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:31:58.027 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:58.027 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.027 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:31:58.027 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.403185+0000", 2024-09-12T22:31:58.027 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 20.531225800000001, 2024-09-12T22:31:58.027 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.014902164000000001, 2024-09-12T22:31:58.027 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:31:58.027 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:31:58.027 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:31:58.027 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:31:58.027 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.027 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:31:58.027 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403185+0000", 2024-09-12T22:31:58.027 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:31:58.028 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:58.028 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.028 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:31:58.028 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403185+0000", 2024-09-12T22:31:58.028 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:31:58.028 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:58.028 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.028 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:31:58.028 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403186+0000", 2024-09-12T22:31:58.028 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9400000000000005e-07 2024-09-12T22:31:58.028 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:58.028 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.028 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:31:58.029 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403191+0000", 2024-09-12T22:31:58.029 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6980000000000003e-06 2024-09-12T22:31:58.029 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:58.029 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.029 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:31:58.029 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403199+0000", 2024-09-12T22:31:58.029 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2520000000000002e-06 2024-09-12T22:31:58.029 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:58.029 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.029 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:31:58.029 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403205+0000", 2024-09-12T22:31:58.029 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.908e-06 2024-09-12T22:31:58.029 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:58.030 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.030 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:31:58.030 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403359+0000", 2024-09-12T22:31:58.030 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000154544 2024-09-12T22:31:58.030 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:58.030 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.030 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:31:58.030 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403528+0000", 2024-09-12T22:31:58.030 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000168455 2024-09-12T22:31:58.030 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:58.030 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.030 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:31:58.030 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403763+0000", 2024-09-12T22:31:58.030 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00023539599999999999 2024-09-12T22:31:58.031 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:58.031 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.031 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:31:58.031 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409378+0000", 2024-09-12T22:31:58.031 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056150000000000002 2024-09-12T22:31:58.031 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:58.031 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.031 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:31:58.031 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418012+0000", 2024-09-12T22:31:58.031 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0086339559999999999 2024-09-12T22:31:58.031 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:58.031 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.031 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:31:58.032 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418046+0000", 2024-09-12T22:31:58.032 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4267999999999998e-05 2024-09-12T22:31:58.032 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:58.032 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.032 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:31:58.032 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418087+0000", 2024-09-12T22:31:58.032 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0992999999999999e-05 2024-09-12T22:31:58.032 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:31:58.032 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:31:58.032 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:31:58.032 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:58.032 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.032 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:31:58.032 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.403273+0000", 2024-09-12T22:31:58.033 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 20.531137849, 2024-09-12T22:31:58.033 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.014934866, 2024-09-12T22:31:58.033 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:31:58.033 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:31:58.033 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:31:58.033 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:31:58.033 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.033 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:31:58.033 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403273+0000", 2024-09-12T22:31:58.033 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:31:58.033 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:58.033 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.033 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:31:58.034 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403273+0000", 2024-09-12T22:31:58.034 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:31:58.034 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:58.034 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.034 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:31:58.034 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403274+0000", 2024-09-12T22:31:58.034 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.297e-06 2024-09-12T22:31:58.034 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:58.034 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.034 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:31:58.034 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403282+0000", 2024-09-12T22:31:58.034 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6340000000000001e-06 2024-09-12T22:31:58.034 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:58.035 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.035 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:31:58.035 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403305+0000", 2024-09-12T22:31:58.035 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3149000000000001e-05 2024-09-12T22:31:58.035 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:58.035 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.035 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:31:58.035 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403320+0000", 2024-09-12T22:31:58.035 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4527e-05 2024-09-12T22:31:58.035 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:58.035 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.035 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:31:58.035 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.404928+0000", 2024-09-12T22:31:58.035 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001608459 2024-09-12T22:31:58.036 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:58.036 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.036 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:31:58.036 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405218+0000", 2024-09-12T22:31:58.036 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00028982900000000002 2024-09-12T22:31:58.036 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:58.036 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.036 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:31:58.036 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405829+0000", 2024-09-12T22:31:58.036 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00061127900000000005 2024-09-12T22:31:58.036 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:58.036 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.036 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:31:58.037 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409403+0000", 2024-09-12T22:31:58.037 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.003573597 2024-09-12T22:31:58.037 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:58.037 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.037 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:31:58.037 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418138+0000", 2024-09-12T22:31:58.037 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0087349969999999996 2024-09-12T22:31:58.037 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:58.037 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.037 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:31:58.037 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418178+0000", 2024-09-12T22:31:58.037 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0649999999999999e-05 2024-09-12T22:31:58.037 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:58.038 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.038 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:31:58.038 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418208+0000", 2024-09-12T22:31:58.038 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9448e-05 2024-09-12T22:31:58.038 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:31:58.038 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:31:58.038 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:31:58.038 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:58.038 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.038 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:31:58.038 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.405456+0000", 2024-09-12T22:31:58.038 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 20.528954704, 2024-09-12T22:31:58.038 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012888389, 2024-09-12T22:31:58.038 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:31:58.039 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:31:58.039 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:31:58.039 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:31:58.039 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.039 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:31:58.039 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405456+0000", 2024-09-12T22:31:58.039 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:31:58.039 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:58.039 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.039 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:31:58.039 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405456+0000", 2024-09-12T22:31:58.039 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:31:58.039 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:58.040 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.040 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:31:58.040 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405457+0000", 2024-09-12T22:31:58.040 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.6599999999999994e-07 2024-09-12T22:31:58.040 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:58.040 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.040 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:31:58.040 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405463+0000", 2024-09-12T22:31:58.040 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4739999999999996e-06 2024-09-12T22:31:58.040 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:58.040 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.040 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:31:58.040 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405474+0000", 2024-09-12T22:31:58.040 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1095e-05 2024-09-12T22:31:58.041 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:58.041 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.041 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:31:58.041 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405482+0000", 2024-09-12T22:31:58.041 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3610000000000001e-06 2024-09-12T22:31:58.041 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:58.041 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.041 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:31:58.041 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407051+0000", 2024-09-12T22:31:58.041 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0015688970000000001 2024-09-12T22:31:58.041 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:58.041 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.041 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:31:58.042 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407259+0000", 2024-09-12T22:31:58.042 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00020778300000000001 2024-09-12T22:31:58.042 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:58.042 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.042 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:31:58.042 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407622+0000", 2024-09-12T22:31:58.042 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000363066 2024-09-12T22:31:58.042 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:58.042 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.042 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:31:58.042 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409438+0000", 2024-09-12T22:31:58.042 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001816319 2024-09-12T22:31:58.043 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:58.043 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.043 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:31:58.043 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418257+0000", 2024-09-12T22:31:58.043 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0088187720000000008 2024-09-12T22:31:58.043 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:58.043 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.043 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:31:58.043 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418308+0000", 2024-09-12T22:31:58.043 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1180000000000001e-05 2024-09-12T22:31:58.043 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:58.043 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.043 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:31:58.043 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418345+0000", 2024-09-12T22:31:58.044 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6476000000000001e-05 2024-09-12T22:31:58.044 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:31:58.044 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:31:58.044 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:31:58.044 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:58.044 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.044 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:31:58.044 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.405496+0000", 2024-09-12T22:31:58.044 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 20.528915347000002, 2024-09-12T22:31:58.044 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013016012, 2024-09-12T22:31:58.044 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:31:58.044 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:31:58.044 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:31:58.045 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:31:58.045 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.045 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:31:58.045 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405496+0000", 2024-09-12T22:31:58.045 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:31:58.045 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:58.045 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.045 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:31:58.045 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405496+0000", 2024-09-12T22:31:58.045 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:31:58.045 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:58.045 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.045 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:31:58.046 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405496+0000", 2024-09-12T22:31:58.046 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7999999999999995e-07 2024-09-12T22:31:58.046 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:58.046 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.046 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:31:58.046 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405501+0000", 2024-09-12T22:31:58.046 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8359999999999999e-06 2024-09-12T22:31:58.046 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:58.046 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.046 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:31:58.046 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405514+0000", 2024-09-12T22:31:58.046 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2522e-05 2024-09-12T22:31:58.046 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:58.046 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.047 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:31:58.047 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405521+0000", 2024-09-12T22:31:58.047 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5020000000000003e-06 2024-09-12T22:31:58.047 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:58.047 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.047 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:31:58.047 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405575+0000", 2024-09-12T22:31:58.047 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4169999999999998e-05 2024-09-12T22:31:58.047 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:58.047 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.047 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:31:58.047 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405697+0000", 2024-09-12T22:31:58.047 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000121301 2024-09-12T22:31:58.048 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:58.048 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.048 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:31:58.048 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405829+0000", 2024-09-12T22:31:58.048 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000132662 2024-09-12T22:31:58.048 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:58.048 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.048 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:31:58.048 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409155+0000", 2024-09-12T22:31:58.048 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0033259050000000001 2024-09-12T22:31:58.048 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:58.048 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.048 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:31:58.048 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418425+0000", 2024-09-12T22:31:58.049 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0092696319999999999 2024-09-12T22:31:58.049 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:58.049 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.049 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:31:58.049 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418471+0000", 2024-09-12T22:31:58.049 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6213e-05 2024-09-12T22:31:58.049 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:58.049 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.049 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:31:58.049 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418512+0000", 2024-09-12T22:31:58.049 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0589000000000001e-05 2024-09-12T22:31:58.049 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:31:58.049 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:31:58.050 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:31:58.050 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:58.050 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.050 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:31:58.050 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.406108+0000", 2024-09-12T22:31:58.050 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 20.52830295, 2024-09-12T22:31:58.050 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012458175, 2024-09-12T22:31:58.050 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:31:58.050 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:31:58.050 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:31:58.050 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:31:58.050 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.050 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:31:58.051 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406108+0000", 2024-09-12T22:31:58.051 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:31:58.051 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:58.051 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.051 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:31:58.051 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406108+0000", 2024-09-12T22:31:58.051 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:31:58.051 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:58.051 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.051 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:31:58.051 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406109+0000", 2024-09-12T22:31:58.051 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9899999999999999e-07 2024-09-12T22:31:58.051 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:58.052 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.052 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:31:58.052 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406115+0000", 2024-09-12T22:31:58.052 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9030000000000001e-06 2024-09-12T22:31:58.052 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:58.052 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.052 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:31:58.052 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406141+0000", 2024-09-12T22:31:58.052 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5999e-05 2024-09-12T22:31:58.052 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:58.052 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.052 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:31:58.052 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406150+0000", 2024-09-12T22:31:58.053 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.6050000000000004e-06 2024-09-12T22:31:58.053 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:58.053 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.053 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:31:58.053 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408163+0000", 2024-09-12T22:31:58.053 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0020122769999999998 2024-09-12T22:31:58.053 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:58.053 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.053 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:31:58.053 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408309+0000", 2024-09-12T22:31:58.053 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014606999999999999 2024-09-12T22:31:58.053 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:58.053 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.054 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:31:58.054 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408433+0000", 2024-09-12T22:31:58.054 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012460300000000001 2024-09-12T22:31:58.054 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:58.054 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.054 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:31:58.054 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409903+0000", 2024-09-12T22:31:58.054 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001469499 2024-09-12T22:31:58.054 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:58.054 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.054 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:31:58.054 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418427+0000", 2024-09-12T22:31:58.054 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0085241139999999993 2024-09-12T22:31:58.055 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:58.055 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.055 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:31:58.055 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418471+0000", 2024-09-12T22:31:58.055 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4474000000000001e-05 2024-09-12T22:31:58.055 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:58.055 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.055 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:31:58.055 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418566+0000", 2024-09-12T22:31:58.055 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.4732e-05 2024-09-12T22:31:58.055 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:31:58.055 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:31:58.055 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:31:58.056 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:58.056 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.056 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:31:58.056 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.407266+0000", 2024-09-12T22:31:58.056 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 20.527145094000002, 2024-09-12T22:31:58.056 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011442905, 2024-09-12T22:31:58.056 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:31:58.056 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:31:58.056 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2024-09-12T22:31:58.056 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:31:58.056 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.056 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:31:58.056 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407266+0000", 2024-09-12T22:31:58.057 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:31:58.057 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:58.057 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.057 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:31:58.057 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407266+0000", 2024-09-12T22:31:58.057 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:31:58.057 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:58.057 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.057 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:31:58.057 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407266+0000", 2024-09-12T22:31:58.057 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7899999999999998e-07 2024-09-12T22:31:58.057 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:58.057 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.058 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:31:58.058 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407269+0000", 2024-09-12T22:31:58.058 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9210000000000001e-06 2024-09-12T22:31:58.058 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:58.058 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.058 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:31:58.058 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407331+0000", 2024-09-12T22:31:58.058 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1376000000000003e-05 2024-09-12T22:31:58.058 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:58.058 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.058 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:31:58.058 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407337+0000", 2024-09-12T22:31:58.058 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1929999999999998e-06 2024-09-12T22:31:58.058 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:58.059 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.059 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:31:58.059 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408974+0000", 2024-09-12T22:31:58.059 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0016367109999999999 2024-09-12T22:31:58.059 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:58.059 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.059 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:31:58.059 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409112+0000", 2024-09-12T22:31:58.059 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000137952 2024-09-12T22:31:58.059 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:58.059 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:58.059 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:31:58.059 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418709+0000", 2024-09-12T22:31:58.060 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0095971730000000005 2024-09-12T22:31:58.060 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:31:58.060 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:31:58.060 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:31:58.060 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:31:58.060 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:31:58.060 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-09-12T22:31:58.062 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:31:58.060+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:31:58.063 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:31:58.063 DEBUG:teuthology.orchestra.run.smithi019:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 7741f7f9ee20524f89b8f61d1609b32fb3b1570a 2024-09-12T22:31:58.100 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T22:31:58.120 INFO:tasks.workunit.client.0.smithi019.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T22:31:58.162 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:31:58.161+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:31:58.181 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-09-12T22:31:58.181 INFO:teuthology.orchestra.run.smithi076.stdout: "ops": [], 2024-09-12T22:31:58.181 INFO:teuthology.orchestra.run.smithi076.stdout: "num_ops": 0 2024-09-12T22:31:58.181 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-09-12T22:31:58.190 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:31:58.263 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:31:58.262+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:31:58.294 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-09-12T22:31:58.295 INFO:teuthology.orchestra.run.smithi076.stdout: "ops": [], 2024-09-12T22:31:58.295 INFO:teuthology.orchestra.run.smithi076.stdout: "complaint_time": 30, 2024-09-12T22:31:58.295 INFO:teuthology.orchestra.run.smithi076.stdout: "num_blocked_ops": 0 2024-09-12T22:31:58.295 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-09-12T22:31:58.304 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:31:58.365 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:31:58.364+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:31:58.408 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-09-12T22:31:58.408 INFO:teuthology.orchestra.run.smithi076.stdout: "size": 20, 2024-09-12T22:31:58.408 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 600, 2024-09-12T22:31:58.409 INFO:teuthology.orchestra.run.smithi076.stdout: "ops": [ 2024-09-12T22:31:58.409 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.409 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:31:58.409 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.400604+0000", 2024-09-12T22:31:58.409 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 21.005305187000001, 2024-09-12T22:31:58.409 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.017278814, 2024-09-12T22:31:58.409 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:31:58.409 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:31:58.409 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:31:58.409 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:31:58.409 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.409 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:31:58.409 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400604+0000", 2024-09-12T22:31:58.410 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:31:58.410 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.410 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.410 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:31:58.410 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400604+0000", 2024-09-12T22:31:58.410 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:31:58.410 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.410 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.410 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:31:58.410 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400617+0000", 2024-09-12T22:31:58.410 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.3076e-05 2024-09-12T22:31:58.410 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.410 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.410 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:31:58.411 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400623+0000", 2024-09-12T22:31:58.411 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.5780000000000004e-06 2024-09-12T22:31:58.411 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.411 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.411 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:31:58.411 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400641+0000", 2024-09-12T22:31:58.411 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.8218000000000001e-05 2024-09-12T22:31:58.411 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.411 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.411 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:31:58.411 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400652+0000", 2024-09-12T22:31:58.411 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.0421999999999999e-05 2024-09-12T22:31:58.412 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.412 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.412 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:31:58.412 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400707+0000", 2024-09-12T22:31:58.412 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.4666000000000001e-05 2024-09-12T22:31:58.412 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.412 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.412 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op must wait for map", 2024-09-12T22:31:58.412 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400711+0000", 2024-09-12T22:31:58.412 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.5340000000000001e-06 2024-09-12T22:31:58.412 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.412 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.412 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:31:58.412 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.412066+0000", 2024-09-12T22:31:58.413 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.011354797999999999 2024-09-12T22:31:58.413 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.413 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.413 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:31:58.413 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.412672+0000", 2024-09-12T22:31:58.413 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00060620499999999996 2024-09-12T22:31:58.413 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.413 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.413 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting for subops from 2", 2024-09-12T22:31:58.413 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.413032+0000", 2024-09-12T22:31:58.413 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00035955999999999998 2024-09-12T22:31:58.413 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.414 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.414 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op_commit", 2024-09-12T22:31:58.414 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417252+0000", 2024-09-12T22:31:58.414 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.004219899 2024-09-12T22:31:58.414 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.414 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.414 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:31:58.414 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417812+0000", 2024-09-12T22:31:58.414 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.000560182 2024-09-12T22:31:58.414 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.414 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.414 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:31:58.414 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417851+0000", 2024-09-12T22:31:58.415 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.9057999999999998e-05 2024-09-12T22:31:58.415 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.415 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.415 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:31:58.415 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417882+0000", 2024-09-12T22:31:58.415 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.1618000000000001e-05 2024-09-12T22:31:58.415 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:31:58.415 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:31:58.415 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:31:58.415 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.415 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.415 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:31:58.415 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.400674+0000", 2024-09-12T22:31:58.416 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 21.005234469000001, 2024-09-12T22:31:58.416 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.017348971000000001, 2024-09-12T22:31:58.416 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:31:58.416 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:31:58.416 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:31:58.416 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:31:58.416 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.416 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:31:58.416 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400674+0000", 2024-09-12T22:31:58.416 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:31:58.416 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.416 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.416 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:31:58.416 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400674+0000", 2024-09-12T22:31:58.417 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:31:58.417 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.417 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.417 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:31:58.417 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400675+0000", 2024-09-12T22:31:58.417 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.37e-07 2024-09-12T22:31:58.417 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.417 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.417 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:31:58.417 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400678+0000", 2024-09-12T22:31:58.417 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.303e-06 2024-09-12T22:31:58.417 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.417 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.418 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:31:58.418 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400684+0000", 2024-09-12T22:31:58.418 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.0290000000000002e-06 2024-09-12T22:31:58.418 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.418 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.418 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:31:58.418 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400688+0000", 2024-09-12T22:31:58.418 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.0890000000000002e-06 2024-09-12T22:31:58.418 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.418 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.418 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:31:58.418 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400806+0000", 2024-09-12T22:31:58.418 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00011814700000000001 2024-09-12T22:31:58.419 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.419 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.419 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:31:58.419 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400811+0000", 2024-09-12T22:31:58.419 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.0479999999999998e-06 2024-09-12T22:31:58.419 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.419 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.419 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:31:58.419 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.413877+0000", 2024-09-12T22:31:58.419 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.013065561 2024-09-12T22:31:58.419 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.419 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.419 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:31:58.419 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.413984+0000", 2024-09-12T22:31:58.420 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.000106566 2024-09-12T22:31:58.420 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.420 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.420 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting for subops from 2", 2024-09-12T22:31:58.420 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.414264+0000", 2024-09-12T22:31:58.420 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00028067199999999999 2024-09-12T22:31:58.420 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.420 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.420 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op_commit", 2024-09-12T22:31:58.420 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417614+0000", 2024-09-12T22:31:58.420 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0033500729999999999 2024-09-12T22:31:58.420 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.420 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.421 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:31:58.421 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417946+0000", 2024-09-12T22:31:58.421 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00033209199999999998 2024-09-12T22:31:58.421 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.421 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.421 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:31:58.421 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417995+0000", 2024-09-12T22:31:58.421 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.808e-05 2024-09-12T22:31:58.421 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.421 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.421 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:31:58.421 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.418023+0000", 2024-09-12T22:31:58.421 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.8773999999999999e-05 2024-09-12T22:31:58.422 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:31:58.422 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:31:58.422 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:31:58.422 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.422 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.422 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:31:58.422 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.400694+0000", 2024-09-12T22:31:58.422 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 21.005214840000001, 2024-09-12T22:31:58.422 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.022845628, 2024-09-12T22:31:58.422 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:31:58.422 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:31:58.422 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:31:58.422 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:31:58.423 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.423 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:31:58.423 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400694+0000", 2024-09-12T22:31:58.423 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:31:58.423 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.423 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.423 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:31:58.423 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400694+0000", 2024-09-12T22:31:58.423 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:31:58.423 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.423 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.423 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:31:58.424 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400694+0000", 2024-09-12T22:31:58.424 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.48e-07 2024-09-12T22:31:58.424 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.424 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.424 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:31:58.424 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400709+0000", 2024-09-12T22:31:58.424 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.4888999999999999e-05 2024-09-12T22:31:58.424 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.424 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.424 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:31:58.424 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400722+0000", 2024-09-12T22:31:58.424 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.2882e-05 2024-09-12T22:31:58.424 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.425 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.425 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:31:58.425 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400732+0000", 2024-09-12T22:31:58.425 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.0299000000000001e-05 2024-09-12T22:31:58.425 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.425 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.425 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:31:58.425 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400793+0000", 2024-09-12T22:31:58.425 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.0253000000000001e-05 2024-09-12T22:31:58.425 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.425 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.425 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op must wait for map", 2024-09-12T22:31:58.425 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400798+0000", 2024-09-12T22:31:58.426 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.1569999999999999e-06 2024-09-12T22:31:58.426 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.426 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.426 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:31:58.426 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415059+0000", 2024-09-12T22:31:58.426 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.014260907 2024-09-12T22:31:58.426 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.426 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.426 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:31:58.426 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415396+0000", 2024-09-12T22:31:58.426 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00033720799999999997 2024-09-12T22:31:58.426 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.426 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.426 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting for subops from 2", 2024-09-12T22:31:58.426 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415685+0000", 2024-09-12T22:31:58.427 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00028939900000000003 2024-09-12T22:31:58.427 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.427 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.427 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op_commit", 2024-09-12T22:31:58.427 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.418302+0000", 2024-09-12T22:31:58.427 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0026168039999999999 2024-09-12T22:31:58.427 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.427 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.427 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:31:58.427 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.423445+0000", 2024-09-12T22:31:58.427 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0051428150000000002 2024-09-12T22:31:58.427 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.427 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.427 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:31:58.428 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.423499+0000", 2024-09-12T22:31:58.428 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.3953000000000003e-05 2024-09-12T22:31:58.428 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.428 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.428 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:31:58.428 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.423540+0000", 2024-09-12T22:31:58.428 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.0813999999999999e-05 2024-09-12T22:31:58.428 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:31:58.428 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:31:58.428 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:31:58.428 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.428 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.428 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:31:58.428 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.400740+0000", 2024-09-12T22:31:58.429 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 21.005169117000001, 2024-09-12T22:31:58.429 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.022927528999999999, 2024-09-12T22:31:58.429 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:31:58.429 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:31:58.429 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:31:58.429 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:31:58.429 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.429 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:31:58.429 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400740+0000", 2024-09-12T22:31:58.429 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:31:58.429 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.429 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.429 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:31:58.430 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400740+0000", 2024-09-12T22:31:58.430 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:31:58.430 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.430 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.430 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:31:58.430 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400740+0000", 2024-09-12T22:31:58.430 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.3000000000000001e-07 2024-09-12T22:31:58.430 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.430 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.430 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:31:58.430 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400743+0000", 2024-09-12T22:31:58.430 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.5840000000000002e-06 2024-09-12T22:31:58.430 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.431 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.431 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:31:58.431 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400757+0000", 2024-09-12T22:31:58.431 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.3988999999999999e-05 2024-09-12T22:31:58.431 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.431 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.431 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:31:58.431 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400763+0000", 2024-09-12T22:31:58.431 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.686e-06 2024-09-12T22:31:58.431 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.431 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.431 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:31:58.431 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400818+0000", 2024-09-12T22:31:58.431 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.4941000000000001e-05 2024-09-12T22:31:58.432 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.432 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.432 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:31:58.432 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400824+0000", 2024-09-12T22:31:58.432 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.4600000000000002e-06 2024-09-12T22:31:58.432 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.432 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.432 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:31:58.432 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416227+0000", 2024-09-12T22:31:58.432 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.015403604 2024-09-12T22:31:58.432 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.432 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.432 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:31:58.433 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416306+0000", 2024-09-12T22:31:58.433 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 7.9126000000000001e-05 2024-09-12T22:31:58.433 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.433 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.433 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting for subops from 2", 2024-09-12T22:31:58.433 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416678+0000", 2024-09-12T22:31:58.433 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00037105500000000002 2024-09-12T22:31:58.433 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.433 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.433 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op_commit", 2024-09-12T22:31:58.433 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.418363+0000", 2024-09-12T22:31:58.433 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.001685095 2024-09-12T22:31:58.433 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.434 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.434 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:31:58.434 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.423591+0000", 2024-09-12T22:31:58.434 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0052283980000000004 2024-09-12T22:31:58.434 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.434 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.434 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:31:58.434 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.423624+0000", 2024-09-12T22:31:58.434 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.3024000000000001e-05 2024-09-12T22:31:58.434 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.434 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.434 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:31:58.434 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.423667+0000", 2024-09-12T22:31:58.434 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.3136999999999997e-05 2024-09-12T22:31:58.435 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:31:58.435 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:31:58.435 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:31:58.435 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.435 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.435 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:31:58.435 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.400783+0000", 2024-09-12T22:31:58.435 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 21.005125584999998, 2024-09-12T22:31:58.435 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.016563729999999999, 2024-09-12T22:31:58.435 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:31:58.435 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:31:58.435 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:31:58.435 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:31:58.435 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.436 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:31:58.436 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400783+0000", 2024-09-12T22:31:58.436 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:31:58.436 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.436 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.436 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:31:58.436 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400783+0000", 2024-09-12T22:31:58.436 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:31:58.436 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.436 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.436 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:31:58.436 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400784+0000", 2024-09-12T22:31:58.436 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.5900000000000002e-07 2024-09-12T22:31:58.436 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.437 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.437 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:31:58.437 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400787+0000", 2024-09-12T22:31:58.437 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.1690000000000001e-06 2024-09-12T22:31:58.437 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.437 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.437 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:31:58.437 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400794+0000", 2024-09-12T22:31:58.437 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 7.058e-06 2024-09-12T22:31:58.437 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.437 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.437 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:31:58.438 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400798+0000", 2024-09-12T22:31:58.438 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.335e-06 2024-09-12T22:31:58.438 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.438 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.438 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:31:58.438 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400841+0000", 2024-09-12T22:31:58.438 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.2369e-05 2024-09-12T22:31:58.438 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.438 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.438 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op must wait for map", 2024-09-12T22:31:58.438 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400844+0000", 2024-09-12T22:31:58.438 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.128e-06 2024-09-12T22:31:58.438 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.438 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.439 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:31:58.439 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.410479+0000", 2024-09-12T22:31:58.439 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0096354189999999992 2024-09-12T22:31:58.439 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.439 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.439 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:31:58.439 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.410597+0000", 2024-09-12T22:31:58.439 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.000118305 2024-09-12T22:31:58.439 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.439 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.439 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting for subops from 2", 2024-09-12T22:31:58.439 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.410838+0000", 2024-09-12T22:31:58.439 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.000240967 2024-09-12T22:31:58.439 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.440 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.440 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op_commit", 2024-09-12T22:31:58.440 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416489+0000", 2024-09-12T22:31:58.440 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0056507989999999998 2024-09-12T22:31:58.440 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.440 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.440 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:31:58.440 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417255+0000", 2024-09-12T22:31:58.440 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00076626199999999998 2024-09-12T22:31:58.440 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.440 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.440 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:31:58.440 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417306+0000", 2024-09-12T22:31:58.440 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.0319999999999999e-05 2024-09-12T22:31:58.441 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.441 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.441 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:31:58.441 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417347+0000", 2024-09-12T22:31:58.441 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.1140000000000003e-05 2024-09-12T22:31:58.441 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:31:58.441 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:31:58.441 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:31:58.441 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.441 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.441 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:31:58.441 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.400811+0000", 2024-09-12T22:31:58.441 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 21.005097515999999, 2024-09-12T22:31:58.442 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.017061263, 2024-09-12T22:31:58.442 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:31:58.442 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:31:58.442 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:31:58.442 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:31:58.442 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.442 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:31:58.442 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400811+0000", 2024-09-12T22:31:58.442 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:31:58.442 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.442 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.442 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:31:58.443 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400811+0000", 2024-09-12T22:31:58.443 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:31:58.443 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.443 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.443 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:31:58.443 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400812+0000", 2024-09-12T22:31:58.443 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.27e-07 2024-09-12T22:31:58.443 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.443 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.443 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:31:58.443 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400814+0000", 2024-09-12T22:31:58.443 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.553e-06 2024-09-12T22:31:58.443 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.443 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.444 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:31:58.444 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400819+0000", 2024-09-12T22:31:58.444 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.3569999999999997e-06 2024-09-12T22:31:58.444 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.444 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.444 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:31:58.444 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400824+0000", 2024-09-12T22:31:58.444 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.6820000000000002e-06 2024-09-12T22:31:58.444 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.444 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.444 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:31:58.444 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400871+0000", 2024-09-12T22:31:58.445 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.7311000000000002e-05 2024-09-12T22:31:58.445 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.445 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.445 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:31:58.445 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400875+0000", 2024-09-12T22:31:58.445 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.0960000000000001e-06 2024-09-12T22:31:58.445 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.445 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.445 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:31:58.445 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.412071+0000", 2024-09-12T22:31:58.445 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.011195999999999999 2024-09-12T22:31:58.445 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.445 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.446 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:31:58.446 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.412520+0000", 2024-09-12T22:31:58.446 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.000449522 2024-09-12T22:31:58.446 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.446 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.446 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting for subops from 2", 2024-09-12T22:31:58.446 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.412655+0000", 2024-09-12T22:31:58.446 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00013487899999999999 2024-09-12T22:31:58.446 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.446 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.446 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op_commit", 2024-09-12T22:31:58.446 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417096+0000", 2024-09-12T22:31:58.446 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.004441113 2024-09-12T22:31:58.446 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.447 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.447 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:31:58.447 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417768+0000", 2024-09-12T22:31:58.447 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00067161100000000002 2024-09-12T22:31:58.447 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.447 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.447 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:31:58.447 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417834+0000", 2024-09-12T22:31:58.447 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.6058999999999999e-05 2024-09-12T22:31:58.447 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.447 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.447 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:31:58.447 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417873+0000", 2024-09-12T22:31:58.448 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.8753e-05 2024-09-12T22:31:58.448 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:31:58.448 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:31:58.448 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:31:58.448 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.448 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.448 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:31:58.448 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.400842+0000", 2024-09-12T22:31:58.448 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 21.005066808999999, 2024-09-12T22:31:58.448 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.022846262999999999, 2024-09-12T22:31:58.448 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:31:58.448 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:31:58.449 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:31:58.449 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:31:58.449 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.449 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:31:58.449 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400842+0000", 2024-09-12T22:31:58.449 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:31:58.449 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.449 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.449 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:31:58.449 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400842+0000", 2024-09-12T22:31:58.449 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:31:58.449 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.449 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.450 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:31:58.450 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400842+0000", 2024-09-12T22:31:58.450 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.9900000000000002e-07 2024-09-12T22:31:58.450 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.450 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.450 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:31:58.450 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400845+0000", 2024-09-12T22:31:58.450 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.8609999999999998e-06 2024-09-12T22:31:58.450 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.450 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.450 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:31:58.450 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400850+0000", 2024-09-12T22:31:58.450 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.634e-06 2024-09-12T22:31:58.450 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.451 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.451 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:31:58.451 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400855+0000", 2024-09-12T22:31:58.451 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.8339999999999998e-06 2024-09-12T22:31:58.451 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.451 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.451 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:31:58.451 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400886+0000", 2024-09-12T22:31:58.451 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.1393999999999998e-05 2024-09-12T22:31:58.451 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.451 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.451 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:31:58.451 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400888+0000", 2024-09-12T22:31:58.452 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.3470000000000001e-06 2024-09-12T22:31:58.452 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.452 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.452 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:31:58.452 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415640+0000", 2024-09-12T22:31:58.452 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.014751965000000001 2024-09-12T22:31:58.452 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.452 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.452 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:31:58.452 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415821+0000", 2024-09-12T22:31:58.452 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00018064399999999999 2024-09-12T22:31:58.452 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.452 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.452 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting for subops from 2", 2024-09-12T22:31:58.453 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415949+0000", 2024-09-12T22:31:58.453 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00012816699999999999 2024-09-12T22:31:58.453 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.453 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.453 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op_commit", 2024-09-12T22:31:58.453 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.418337+0000", 2024-09-12T22:31:58.453 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0023878469999999998 2024-09-12T22:31:58.453 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.453 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.453 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:31:58.453 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.423588+0000", 2024-09-12T22:31:58.453 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0052509849999999997 2024-09-12T22:31:58.453 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.454 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.454 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:31:58.454 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.423650+0000", 2024-09-12T22:31:58.454 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.2026999999999994e-05 2024-09-12T22:31:58.454 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.454 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.454 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:31:58.454 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.423688+0000", 2024-09-12T22:31:58.454 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.8259000000000001e-05 2024-09-12T22:31:58.454 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:31:58.454 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:31:58.454 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:31:58.454 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.455 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.455 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:31:58.455 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.400862+0000", 2024-09-12T22:31:58.455 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 21.005046835000002, 2024-09-12T22:31:58.455 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.016404294, 2024-09-12T22:31:58.455 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:31:58.455 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:31:58.455 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "started", 2024-09-12T22:31:58.455 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:31:58.455 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.455 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:31:58.455 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400862+0000", 2024-09-12T22:31:58.455 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:31:58.456 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.456 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.456 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:31:58.456 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400862+0000", 2024-09-12T22:31:58.456 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:31:58.456 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.456 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.456 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:31:58.456 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400862+0000", 2024-09-12T22:31:58.456 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.8099999999999999e-07 2024-09-12T22:31:58.456 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.456 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.456 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:31:58.456 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400870+0000", 2024-09-12T22:31:58.457 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 8.1349999999999992e-06 2024-09-12T22:31:58.457 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.457 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.457 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:31:58.457 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400876+0000", 2024-09-12T22:31:58.457 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.2039999999999996e-06 2024-09-12T22:31:58.457 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.457 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.457 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:31:58.457 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400879+0000", 2024-09-12T22:31:58.457 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.529e-06 2024-09-12T22:31:58.457 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.458 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.458 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:31:58.458 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400912+0000", 2024-09-12T22:31:58.458 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.2653000000000001e-05 2024-09-12T22:31:58.458 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.458 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.458 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op must wait for map", 2024-09-12T22:31:58.458 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400915+0000", 2024-09-12T22:31:58.458 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.1099999999999999e-06 2024-09-12T22:31:58.458 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.458 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.458 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:31:58.458 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408727+0000", 2024-09-12T22:31:58.458 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0078123869999999996 2024-09-12T22:31:58.459 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.459 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.459 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:31:58.459 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408838+0000", 2024-09-12T22:31:58.459 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00011042700000000001 2024-09-12T22:31:58.459 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.459 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.459 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:31:58.459 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417266+0000", 2024-09-12T22:31:58.459 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0084285680000000009 2024-09-12T22:31:58.459 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:31:58.459 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:31:58.459 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:31:58.459 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.460 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.460 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:31:58.460 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.400889+0000", 2024-09-12T22:31:58.460 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 21.005019581999999, 2024-09-12T22:31:58.460 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.014929550999999999, 2024-09-12T22:31:58.460 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:31:58.460 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:31:58.460 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "started", 2024-09-12T22:31:58.460 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:31:58.460 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.460 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:31:58.460 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400889+0000", 2024-09-12T22:31:58.461 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:31:58.461 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.461 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.461 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:31:58.461 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400889+0000", 2024-09-12T22:31:58.461 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:31:58.461 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.461 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.461 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:31:58.461 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400890+0000", 2024-09-12T22:31:58.461 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.8699999999999995e-07 2024-09-12T22:31:58.461 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.461 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.462 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:31:58.462 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400893+0000", 2024-09-12T22:31:58.462 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.9569999999999998e-06 2024-09-12T22:31:58.462 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.462 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.462 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:31:58.462 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400899+0000", 2024-09-12T22:31:58.462 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.4189999999999999e-06 2024-09-12T22:31:58.462 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.463 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.463 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:31:58.463 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400905+0000", 2024-09-12T22:31:58.463 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.7880000000000003e-06 2024-09-12T22:31:58.463 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.463 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.463 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:31:58.463 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400943+0000", 2024-09-12T22:31:58.463 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.7852999999999998e-05 2024-09-12T22:31:58.463 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.463 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.463 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op must wait for map", 2024-09-12T22:31:58.463 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400945+0000", 2024-09-12T22:31:58.464 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.627e-06 2024-09-12T22:31:58.464 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.464 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.464 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:31:58.464 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408398+0000", 2024-09-12T22:31:58.464 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0074525879999999996 2024-09-12T22:31:58.464 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.464 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.464 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:31:58.464 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408581+0000", 2024-09-12T22:31:58.464 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00018321900000000001 2024-09-12T22:31:58.464 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.464 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.465 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:31:58.465 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415819+0000", 2024-09-12T22:31:58.465 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0072376130000000004 2024-09-12T22:31:58.465 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:31:58.465 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:31:58.465 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:31:58.465 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.465 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.465 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:25 3.7 e19/17 3:e0b41d06:::609.00000000:head v 19'2, mlcod=0'0)", 2024-09-12T22:31:58.465 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.402511+0000", 2024-09-12T22:31:58.465 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 21.003397439, 2024-09-12T22:31:58.465 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0089735260000000008, 2024-09-12T22:31:58.465 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:31:58.465 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:31:58.466 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:31:58.466 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:31:58.466 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.466 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:31:58.466 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.402511+0000", 2024-09-12T22:31:58.466 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:31:58.466 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.466 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.466 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:31:58.466 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.402511+0000", 2024-09-12T22:31:58.466 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:31:58.466 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.466 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.467 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:31:58.467 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.402512+0000", 2024-09-12T22:31:58.467 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 8.71e-07 2024-09-12T22:31:58.467 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.467 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.467 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:31:58.467 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.402520+0000", 2024-09-12T22:31:58.467 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 7.8529999999999992e-06 2024-09-12T22:31:58.467 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.467 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.467 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:31:58.467 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.402530+0000", 2024-09-12T22:31:58.467 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 9.859e-06 2024-09-12T22:31:58.468 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.468 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.468 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:31:58.468 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.402555+0000", 2024-09-12T22:31:58.468 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.4822000000000001e-05 2024-09-12T22:31:58.468 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.468 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.468 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:31:58.468 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.403173+0000", 2024-09-12T22:31:58.468 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00061813199999999997 2024-09-12T22:31:58.468 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.468 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.468 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:31:58.468 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.403195+0000", 2024-09-12T22:31:58.469 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.2286e-05 2024-09-12T22:31:58.469 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.469 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.469 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:31:58.469 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.411436+0000", 2024-09-12T22:31:58.469 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0082410539999999994 2024-09-12T22:31:58.469 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.469 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.469 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:31:58.469 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.411485+0000", 2024-09-12T22:31:58.469 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.8649000000000001e-05 2024-09-12T22:31:58.469 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:31:58.469 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:31:58.469 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:31:58.470 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.470 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.470 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:18 3.14 e19/17 3:2f55791f:::606.00000000:head v 19'1, mlcod=0'0)", 2024-09-12T22:31:58.470 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.406646+0000", 2024-09-12T22:31:58.470 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 20.999262287000001, 2024-09-12T22:31:58.470 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0082036980000000006, 2024-09-12T22:31:58.470 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:31:58.470 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:31:58.470 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:31:58.471 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:31:58.471 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.471 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:31:58.471 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406646+0000", 2024-09-12T22:31:58.471 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:31:58.471 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.471 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.471 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:31:58.471 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406646+0000", 2024-09-12T22:31:58.471 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:31:58.471 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.471 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.471 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:31:58.472 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406647+0000", 2024-09-12T22:31:58.472 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.4499999999999998e-07 2024-09-12T22:31:58.472 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.472 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.472 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:31:58.472 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406651+0000", 2024-09-12T22:31:58.472 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.0300000000000004e-06 2024-09-12T22:31:58.472 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.472 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.472 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:31:58.472 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406657+0000", 2024-09-12T22:31:58.472 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.1330000000000004e-06 2024-09-12T22:31:58.472 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.473 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.473 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:31:58.473 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406665+0000", 2024-09-12T22:31:58.473 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 8.3650000000000004e-06 2024-09-12T22:31:58.473 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.473 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.473 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:31:58.473 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406804+0000", 2024-09-12T22:31:58.473 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00013900699999999999 2024-09-12T22:31:58.473 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.473 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.473 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:31:58.474 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406833+0000", 2024-09-12T22:31:58.474 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.8243e-05 2024-09-12T22:31:58.474 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.474 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.474 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:31:58.474 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.414741+0000", 2024-09-12T22:31:58.474 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0079089620000000003 2024-09-12T22:31:58.474 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.474 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.474 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:31:58.474 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.414850+0000", 2024-09-12T22:31:58.474 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.000108713 2024-09-12T22:31:58.474 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:31:58.474 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:31:58.475 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:31:58.475 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.475 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.475 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:6 3.10 e19/17 3:0d82a743:::600.00000000:head v 19'1, mlcod=0'0)", 2024-09-12T22:31:58.475 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.406692+0000", 2024-09-12T22:31:58.475 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 20.999216520000001, 2024-09-12T22:31:58.475 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0093004430000000003, 2024-09-12T22:31:58.475 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:31:58.475 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:31:58.475 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:31:58.475 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:31:58.475 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.476 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:31:58.476 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406692+0000", 2024-09-12T22:31:58.476 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:31:58.476 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.476 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.476 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:31:58.476 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406692+0000", 2024-09-12T22:31:58.476 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:31:58.476 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.476 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.476 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:31:58.476 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406693+0000", 2024-09-12T22:31:58.476 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.6300000000000001e-07 2024-09-12T22:31:58.476 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.477 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.477 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:31:58.477 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406702+0000", 2024-09-12T22:31:58.477 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 9.5589999999999994e-06 2024-09-12T22:31:58.477 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.477 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.477 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:31:58.477 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406725+0000", 2024-09-12T22:31:58.477 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.2977999999999999e-05 2024-09-12T22:31:58.477 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.477 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.477 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:31:58.478 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406732+0000", 2024-09-12T22:31:58.478 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.8430000000000004e-06 2024-09-12T22:31:58.478 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.478 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.478 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:31:58.478 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406979+0000", 2024-09-12T22:31:58.478 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00024729199999999998 2024-09-12T22:31:58.478 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.478 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.478 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:31:58.478 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407000+0000", 2024-09-12T22:31:58.479 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.0573000000000001e-05 2024-09-12T22:31:58.479 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.479 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.479 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:31:58.479 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415928+0000", 2024-09-12T22:31:58.479 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0089286179999999993 2024-09-12T22:31:58.479 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.479 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.479 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:31:58.479 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415993+0000", 2024-09-12T22:31:58.479 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.4216999999999999e-05 2024-09-12T22:31:58.479 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:31:58.480 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:31:58.480 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:31:58.480 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.480 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.480 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:2 3.f e19/17 3:f1f69726:::400.00000000:head v 19'1, mlcod=0'0)", 2024-09-12T22:31:58.480 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.406942+0000", 2024-09-12T22:31:58.480 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 20.998966833000001, 2024-09-12T22:31:58.480 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0098433259999999995, 2024-09-12T22:31:58.480 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:31:58.480 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:31:58.480 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:31:58.480 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:31:58.480 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.481 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:31:58.481 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406942+0000", 2024-09-12T22:31:58.481 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:31:58.481 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.481 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.481 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:31:58.481 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406942+0000", 2024-09-12T22:31:58.481 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:31:58.481 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.481 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.481 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:31:58.481 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406943+0000", 2024-09-12T22:31:58.481 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.8800000000000002e-07 2024-09-12T22:31:58.482 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.482 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.482 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:31:58.482 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406949+0000", 2024-09-12T22:31:58.482 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.5869999999999998e-06 2024-09-12T22:31:58.482 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.482 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.482 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:31:58.482 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406960+0000", 2024-09-12T22:31:58.482 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.0873000000000001e-05 2024-09-12T22:31:58.482 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.482 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.482 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:31:58.483 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406970+0000", 2024-09-12T22:31:58.483 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 9.9119999999999993e-06 2024-09-12T22:31:58.483 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.483 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.483 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:31:58.483 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407535+0000", 2024-09-12T22:31:58.483 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00056508899999999996 2024-09-12T22:31:58.483 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.483 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.483 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:31:58.483 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407556+0000", 2024-09-12T22:31:58.483 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.1348999999999998e-05 2024-09-12T22:31:58.483 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.484 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.484 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:31:58.484 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416751+0000", 2024-09-12T22:31:58.484 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0091950109999999995 2024-09-12T22:31:58.484 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.484 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.484 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:31:58.484 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416785+0000", 2024-09-12T22:31:58.484 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.3917000000000001e-05 2024-09-12T22:31:58.484 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:31:58.484 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:31:58.484 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:31:58.484 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.485 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.485 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:19 3.14 e19/17 3:2f55791f:::606.00000000:head v 19'2, mlcod=0'0)", 2024-09-12T22:31:58.485 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.406983+0000", 2024-09-12T22:31:58.485 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 20.998925853999999, 2024-09-12T22:31:58.485 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0080362149999999993, 2024-09-12T22:31:58.485 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:31:58.485 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:31:58.485 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:31:58.485 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:31:58.485 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.485 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:31:58.485 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406983+0000", 2024-09-12T22:31:58.485 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:31:58.485 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.486 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.486 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:31:58.486 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406983+0000", 2024-09-12T22:31:58.486 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:31:58.486 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.486 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.486 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:31:58.486 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406983+0000", 2024-09-12T22:31:58.486 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.8200000000000001e-07 2024-09-12T22:31:58.486 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.486 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.486 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:31:58.486 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406999+0000", 2024-09-12T22:31:58.487 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.5747999999999999e-05 2024-09-12T22:31:58.487 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.487 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.487 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:31:58.487 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407006+0000", 2024-09-12T22:31:58.487 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 7.2609999999999996e-06 2024-09-12T22:31:58.487 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.487 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.487 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:31:58.487 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407035+0000", 2024-09-12T22:31:58.487 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.8214000000000001e-05 2024-09-12T22:31:58.487 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.487 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.488 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:31:58.488 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407092+0000", 2024-09-12T22:31:58.488 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.7027000000000001e-05 2024-09-12T22:31:58.488 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.488 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.488 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:31:58.488 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407126+0000", 2024-09-12T22:31:58.488 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.4082000000000003e-05 2024-09-12T22:31:58.488 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.488 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.488 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:31:58.488 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.414985+0000", 2024-09-12T22:31:58.489 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0078597319999999995 2024-09-12T22:31:58.489 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.489 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.489 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:31:58.489 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415019+0000", 2024-09-12T22:31:58.489 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.3769000000000001e-05 2024-09-12T22:31:58.489 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:31:58.489 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:31:58.489 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:31:58.489 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.489 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.489 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:7 3.10 e19/17 3:0d82a743:::600.00000000:head v 19'2, mlcod=0'0)", 2024-09-12T22:31:58.489 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.407048+0000", 2024-09-12T22:31:58.489 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 20.998860315999998, 2024-09-12T22:31:58.490 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.008979931, 2024-09-12T22:31:58.490 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:31:58.490 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:31:58.490 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:31:58.490 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:31:58.490 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.490 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:31:58.490 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407048+0000", 2024-09-12T22:31:58.490 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:31:58.490 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.490 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.490 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:31:58.491 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407048+0000", 2024-09-12T22:31:58.491 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:31:58.491 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.491 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.491 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:31:58.491 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407049+0000", 2024-09-12T22:31:58.491 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.9099999999999999e-07 2024-09-12T22:31:58.491 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.491 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.491 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:31:58.491 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407054+0000", 2024-09-12T22:31:58.491 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.1850000000000003e-06 2024-09-12T22:31:58.491 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.491 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.492 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:31:58.492 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407061+0000", 2024-09-12T22:31:58.492 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 7.0809999999999996e-06 2024-09-12T22:31:58.492 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.492 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.492 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:31:58.492 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407067+0000", 2024-09-12T22:31:58.492 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.9540000000000001e-06 2024-09-12T22:31:58.492 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.492 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.492 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:31:58.492 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407299+0000", 2024-09-12T22:31:58.492 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.000232122 2024-09-12T22:31:58.493 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.493 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.493 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:31:58.493 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407317+0000", 2024-09-12T22:31:58.493 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.7447000000000001e-05 2024-09-12T22:31:58.493 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.493 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.493 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:31:58.493 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415996+0000", 2024-09-12T22:31:58.493 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0086791799999999999 2024-09-12T22:31:58.493 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.493 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.493 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:31:58.494 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416028+0000", 2024-09-12T22:31:58.494 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.2570999999999997e-05 2024-09-12T22:31:58.494 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:31:58.494 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:31:58.494 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:31:58.494 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.494 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.494 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:8 3.10 e19/17 3:09401a81:::601.00000000:head v 19'3, mlcod=0'0)", 2024-09-12T22:31:58.494 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.407081+0000", 2024-09-12T22:31:58.494 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 20.998827626000001, 2024-09-12T22:31:58.494 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0089807270000000008, 2024-09-12T22:31:58.494 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:31:58.494 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:31:58.495 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:31:58.495 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:31:58.495 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.495 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:31:58.495 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407081+0000", 2024-09-12T22:31:58.495 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:31:58.495 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.495 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.495 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:31:58.495 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407081+0000", 2024-09-12T22:31:58.495 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:31:58.495 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.495 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.496 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:31:58.496 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407082+0000", 2024-09-12T22:31:58.496 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.7899999999999999e-07 2024-09-12T22:31:58.496 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.496 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.496 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:31:58.496 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407086+0000", 2024-09-12T22:31:58.496 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.7679999999999999e-06 2024-09-12T22:31:58.496 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.496 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.496 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:31:58.496 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407094+0000", 2024-09-12T22:31:58.496 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 8.1470000000000001e-06 2024-09-12T22:31:58.497 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.497 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.497 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:31:58.497 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407100+0000", 2024-09-12T22:31:58.497 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.4539999999999998e-06 2024-09-12T22:31:58.497 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.497 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.497 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:31:58.497 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407540+0000", 2024-09-12T22:31:58.497 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00043973699999999999 2024-09-12T22:31:58.497 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.497 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.497 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:31:58.498 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407553+0000", 2024-09-12T22:31:58.498 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.3368e-05 2024-09-12T22:31:58.498 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.498 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.498 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:31:58.498 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416032+0000", 2024-09-12T22:31:58.498 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0084793790000000004 2024-09-12T22:31:58.498 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.498 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.498 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:31:58.498 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416062+0000", 2024-09-12T22:31:58.498 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.9495000000000001e-05 2024-09-12T22:31:58.498 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:31:58.499 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:31:58.499 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:31:58.499 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.499 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.499 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:31 3.d e19/17 3:b50e409b:::mds_snaptable:head v 19'1, mlcod=0'0)", 2024-09-12T22:31:58.499 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.408508+0000", 2024-09-12T22:31:58.499 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 20.997401109999998, 2024-09-12T22:31:58.499 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0080056620000000002, 2024-09-12T22:31:58.499 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:31:58.499 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:31:58.499 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:31:58.499 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:31:58.499 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.500 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:31:58.500 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408508+0000", 2024-09-12T22:31:58.500 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:31:58.500 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.500 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.500 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:31:58.500 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408508+0000", 2024-09-12T22:31:58.500 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:31:58.500 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.500 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.500 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:31:58.500 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408508+0000", 2024-09-12T22:31:58.500 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.7e-07 2024-09-12T22:31:58.500 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.501 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.501 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:31:58.501 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408515+0000", 2024-09-12T22:31:58.501 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.4439999999999996e-06 2024-09-12T22:31:58.501 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.501 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.501 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:31:58.501 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408521+0000", 2024-09-12T22:31:58.501 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.2729999999999999e-06 2024-09-12T22:31:58.501 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.501 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.501 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:31:58.501 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408526+0000", 2024-09-12T22:31:58.502 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.3299999999999998e-06 2024-09-12T22:31:58.502 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.502 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.502 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:31:58.502 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.410190+0000", 2024-09-12T22:31:58.502 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.001663615 2024-09-12T22:31:58.502 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.502 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.502 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:31:58.502 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.410258+0000", 2024-09-12T22:31:58.502 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.8146999999999997e-05 2024-09-12T22:31:58.502 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.502 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.503 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:31:58.503 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416477+0000", 2024-09-12T22:31:58.503 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0062187329999999997 2024-09-12T22:31:58.503 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.503 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.503 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:31:58.503 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416513+0000", 2024-09-12T22:31:58.503 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.6650000000000003e-05 2024-09-12T22:31:58.503 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:31:58.503 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:31:58.503 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:31:58.503 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.503 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.504 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:9 3.10 e19/17 3:09401a81:::601.00000000:head v 19'4, mlcod=0'0)", 2024-09-12T22:31:58.504 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.408991+0000", 2024-09-12T22:31:58.504 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 20.996917360000001, 2024-09-12T22:31:58.504 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0080459209999999993, 2024-09-12T22:31:58.504 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:31:58.504 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:31:58.504 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:31:58.504 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:31:58.504 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.504 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:31:58.504 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408991+0000", 2024-09-12T22:31:58.504 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:31:58.504 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.505 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.505 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:31:58.505 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408991+0000", 2024-09-12T22:31:58.505 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:31:58.505 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.505 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.505 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:31:58.505 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408992+0000", 2024-09-12T22:31:58.505 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.1799999999999995e-07 2024-09-12T22:31:58.505 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.505 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.505 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:31:58.505 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409005+0000", 2024-09-12T22:31:58.506 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.261e-05 2024-09-12T22:31:58.506 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.506 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.506 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:31:58.506 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409015+0000", 2024-09-12T22:31:58.506 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.0001e-05 2024-09-12T22:31:58.506 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.506 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.506 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:31:58.506 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409023+0000", 2024-09-12T22:31:58.506 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 8.7569999999999993e-06 2024-09-12T22:31:58.506 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.506 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.507 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:31:58.507 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.411355+0000", 2024-09-12T22:31:58.507 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0023313520000000001 2024-09-12T22:31:58.507 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.507 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.507 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:31:58.507 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.411374+0000", 2024-09-12T22:31:58.507 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.8810000000000001e-05 2024-09-12T22:31:58.507 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.507 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.507 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:31:58.507 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416994+0000", 2024-09-12T22:31:58.507 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.005620524 2024-09-12T22:31:58.508 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.508 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.508 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:31:58.508 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417037+0000", 2024-09-12T22:31:58.508 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.3248999999999999e-05 2024-09-12T22:31:58.508 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:31:58.508 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:31:58.508 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:31:58.508 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.508 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.508 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:10 3.10 e19/17 3:0bd6d154:::602.00000000:head v 19'5, mlcod=0'0)", 2024-09-12T22:31:58.508 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.409038+0000", 2024-09-12T22:31:58.508 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 20.996870685000001, 2024-09-12T22:31:58.509 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0080541689999999999, 2024-09-12T22:31:58.509 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:31:58.509 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:31:58.509 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:31:58.509 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:31:58.509 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.509 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:31:58.509 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409038+0000", 2024-09-12T22:31:58.509 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:31:58.509 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.509 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.509 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:31:58.509 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409038+0000", 2024-09-12T22:31:58.510 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:31:58.510 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.510 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.510 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:31:58.510 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409038+0000", 2024-09-12T22:31:58.510 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.7899999999999999e-07 2024-09-12T22:31:58.510 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.510 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.510 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:31:58.510 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409043+0000", 2024-09-12T22:31:58.510 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.6589999999999998e-06 2024-09-12T22:31:58.510 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.510 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.510 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:31:58.510 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409050+0000", 2024-09-12T22:31:58.511 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 7.0829999999999998e-06 2024-09-12T22:31:58.511 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.511 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.511 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:31:58.511 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409058+0000", 2024-09-12T22:31:58.511 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 7.7309999999999993e-06 2024-09-12T22:31:58.511 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.511 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.511 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:31:58.511 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.411654+0000", 2024-09-12T22:31:58.511 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0025961650000000001 2024-09-12T22:31:58.511 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.511 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.511 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:31:58.512 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.411671+0000", 2024-09-12T22:31:58.512 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.7356000000000001e-05 2024-09-12T22:31:58.512 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.512 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.512 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:31:58.512 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417040+0000", 2024-09-12T22:31:58.512 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0053681889999999998 2024-09-12T22:31:58.512 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.512 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.512 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:31:58.512 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417092+0000", 2024-09-12T22:31:58.512 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.2607e-05 2024-09-12T22:31:58.512 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:31:58.513 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:31:58.513 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:31:58.513 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.513 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.513 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:11 3.10 e19/17 3:0bd6d154:::602.00000000:head v 19'6, mlcod=0'0)", 2024-09-12T22:31:58.513 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.409768+0000", 2024-09-12T22:31:58.513 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 20.996141244, 2024-09-12T22:31:58.513 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0074442759999999997, 2024-09-12T22:31:58.513 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:31:58.513 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:31:58.513 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:31:58.513 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:31:58.513 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.514 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:31:58.514 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409768+0000", 2024-09-12T22:31:58.514 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:31:58.514 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.514 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.514 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:31:58.514 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409768+0000", 2024-09-12T22:31:58.514 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:31:58.514 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.514 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.514 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:31:58.514 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409768+0000", 2024-09-12T22:31:58.514 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.37e-07 2024-09-12T22:31:58.514 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.515 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.515 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:31:58.515 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409775+0000", 2024-09-12T22:31:58.515 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.4670000000000001e-06 2024-09-12T22:31:58.515 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.515 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.515 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:31:58.515 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409793+0000", 2024-09-12T22:31:58.515 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.8162e-05 2024-09-12T22:31:58.515 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.515 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.515 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:31:58.515 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409954+0000", 2024-09-12T22:31:58.516 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00016072999999999999 2024-09-12T22:31:58.516 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.516 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.516 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:31:58.516 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.411943+0000", 2024-09-12T22:31:58.516 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0019897069999999998 2024-09-12T22:31:58.516 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.516 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.516 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:31:58.516 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.412069+0000", 2024-09-12T22:31:58.516 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00012546200000000001 2024-09-12T22:31:58.516 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.516 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.516 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:31:58.517 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417114+0000", 2024-09-12T22:31:58.517 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.005045023 2024-09-12T22:31:58.517 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:58.517 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:58.517 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:31:58.517 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417212+0000", 2024-09-12T22:31:58.517 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 9.8088e-05 2024-09-12T22:31:58.517 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:31:58.517 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:31:58.517 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:31:58.517 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:31:58.517 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:31:58.517 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-09-12T22:31:58.519 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:31:58.520 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:31:58.517+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:31:58.619 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:31:58.618+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:31:58.635 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:31:58.635 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:31:58.635 INFO:teuthology.orchestra.run.smithi148.stdout: "num_ops": 0 2024-09-12T22:31:58.635 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:31:58.644 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:31:58.720 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:31:58.719+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:31:58.748 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:31:58.748 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:31:58.748 INFO:teuthology.orchestra.run.smithi148.stdout: "complaint_time": 30, 2024-09-12T22:31:58.748 INFO:teuthology.orchestra.run.smithi148.stdout: "num_blocked_ops": 0 2024-09-12T22:31:58.748 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:31:58.757 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:31:58.820 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:31:58.819+0000 7fddec6a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30331) UID: 0 2024-09-12T22:31:58.861 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:31:58.861 INFO:teuthology.orchestra.run.smithi148.stdout: "size": 20, 2024-09-12T22:31:58.861 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 600, 2024-09-12T22:31:58.862 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [ 2024-09-12T22:31:58.862 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.862 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(client.4195.0:5 2.2 e15/13 2:5cea7035:::rbd_info:head v 15'1, mlcod=0'0)", 2024-09-12T22:31:58.862 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:33.283639+0000", 2024-09-12T22:31:58.862 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 25.575687403, 2024-09-12T22:31:58.862 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00092221499999999999, 2024-09-12T22:31:58.862 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:31:58.862 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:31:58.862 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:31:58.862 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:31:58.862 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.863 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:31:58.863 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:33.283639+0000", 2024-09-12T22:31:58.863 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:31:58.863 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.863 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.863 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:31:58.863 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:33.283639+0000", 2024-09-12T22:31:58.863 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:31:58.863 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.863 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.863 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:31:58.863 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:33.283639+0000", 2024-09-12T22:31:58.863 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.5900000000000001e-07 2024-09-12T22:31:58.864 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.864 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.864 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:31:58.864 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:33.283664+0000", 2024-09-12T22:31:58.864 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4532000000000002e-05 2024-09-12T22:31:58.864 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.864 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.864 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:31:58.864 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:33.283675+0000", 2024-09-12T22:31:58.864 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1534e-05 2024-09-12T22:31:58.864 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.864 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.864 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:31:58.865 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:33.283681+0000", 2024-09-12T22:31:58.865 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0340000000000002e-06 2024-09-12T22:31:58.865 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.865 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.865 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:31:58.865 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:33.283764+0000", 2024-09-12T22:31:58.865 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.3115999999999995e-05 2024-09-12T22:31:58.865 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.865 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.865 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:31:58.865 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:33.283778+0000", 2024-09-12T22:31:58.865 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4233000000000001e-05 2024-09-12T22:31:58.865 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.866 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.866 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:31:58.866 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:33.284523+0000", 2024-09-12T22:31:58.866 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00074424699999999996 2024-09-12T22:31:58.866 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.866 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.866 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:31:58.866 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:33.284561+0000", 2024-09-12T22:31:58.866 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.8359999999999999e-05 2024-09-12T22:31:58.866 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:31:58.866 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:31:58.866 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:31:58.866 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.867 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.867 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:31:58.867 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.400880+0000", 2024-09-12T22:31:58.867 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 21.458446487, 2024-09-12T22:31:58.867 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0095133660000000005, 2024-09-12T22:31:58.867 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:31:58.867 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:31:58.867 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:31:58.867 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:31:58.867 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.867 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:31:58.867 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400880+0000", 2024-09-12T22:31:58.867 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:31:58.867 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.868 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.868 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:31:58.868 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400880+0000", 2024-09-12T22:31:58.868 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:31:58.868 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.868 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.868 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:31:58.868 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400892+0000", 2024-09-12T22:31:58.868 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1941e-05 2024-09-12T22:31:58.868 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.868 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.868 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:31:58.868 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400900+0000", 2024-09-12T22:31:58.869 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0080000000000002e-06 2024-09-12T22:31:58.869 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.869 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.869 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:31:58.869 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400911+0000", 2024-09-12T22:31:58.869 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1452e-05 2024-09-12T22:31:58.869 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.869 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.869 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:31:58.869 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400922+0000", 2024-09-12T22:31:58.869 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0772e-05 2024-09-12T22:31:58.869 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.870 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.870 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:31:58.870 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401009+0000", 2024-09-12T22:31:58.870 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.7206000000000005e-05 2024-09-12T22:31:58.870 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.870 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.870 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:31:58.870 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401157+0000", 2024-09-12T22:31:58.870 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014831499999999999 2024-09-12T22:31:58.870 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.870 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.870 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:31:58.870 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401312+0000", 2024-09-12T22:31:58.871 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00015495600000000001 2024-09-12T22:31:58.871 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.871 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.871 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:31:58.871 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.403060+0000", 2024-09-12T22:31:58.871 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0017475220000000001 2024-09-12T22:31:58.871 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.871 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.871 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:31:58.871 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410300+0000", 2024-09-12T22:31:58.872 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0072403260000000001 2024-09-12T22:31:58.872 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.872 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.872 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:31:58.872 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410350+0000", 2024-09-12T22:31:58.872 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9814000000000001e-05 2024-09-12T22:31:58.872 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.872 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.872 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:31:58.872 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410393+0000", 2024-09-12T22:31:58.872 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3053999999999998e-05 2024-09-12T22:31:58.872 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:31:58.872 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:31:58.873 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:31:58.873 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.873 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.873 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:31:58.873 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.400952+0000", 2024-09-12T22:31:58.873 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 21.458374334999998, 2024-09-12T22:31:58.873 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0096045620000000005, 2024-09-12T22:31:58.873 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:31:58.873 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:31:58.873 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:31:58.874 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:31:58.874 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.874 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:31:58.874 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400952+0000", 2024-09-12T22:31:58.874 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:31:58.874 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.874 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.874 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:31:58.874 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400952+0000", 2024-09-12T22:31:58.874 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:31:58.874 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.875 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.875 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:31:58.875 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400953+0000", 2024-09-12T22:31:58.875 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.8000000000000005e-07 2024-09-12T22:31:58.875 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.875 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.875 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:31:58.875 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400957+0000", 2024-09-12T22:31:58.875 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.33e-06 2024-09-12T22:31:58.875 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.875 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.875 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:31:58.875 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400966+0000", 2024-09-12T22:31:58.876 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1989999999999995e-06 2024-09-12T22:31:58.876 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.876 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.876 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:31:58.876 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400973+0000", 2024-09-12T22:31:58.876 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2779999999999999e-06 2024-09-12T22:31:58.876 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.876 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.877 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:31:58.877 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401696+0000", 2024-09-12T22:31:58.877 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00072363500000000003 2024-09-12T22:31:58.877 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.877 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.877 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:31:58.877 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401788+0000", 2024-09-12T22:31:58.877 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1862999999999998e-05 2024-09-12T22:31:58.877 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.877 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.877 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:31:58.877 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401929+0000", 2024-09-12T22:31:58.878 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014096000000000001 2024-09-12T22:31:58.878 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.878 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.878 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:31:58.878 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.403542+0000", 2024-09-12T22:31:58.878 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001612963 2024-09-12T22:31:58.878 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.879 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.879 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:31:58.879 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410460+0000", 2024-09-12T22:31:58.879 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0069180500000000002 2024-09-12T22:31:58.879 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.879 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.879 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:31:58.879 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410515+0000", 2024-09-12T22:31:58.879 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5009000000000001e-05 2024-09-12T22:31:58.880 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.880 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.880 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:31:58.880 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410557+0000", 2024-09-12T22:31:58.880 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1495000000000002e-05 2024-09-12T22:31:58.880 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:31:58.880 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:31:58.881 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:31:58.881 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.881 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.881 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:31:58.881 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.400984+0000", 2024-09-12T22:31:58.881 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 21.458341839999999, 2024-09-12T22:31:58.881 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0073703950000000001, 2024-09-12T22:31:58.881 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:31:58.881 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:31:58.881 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:31:58.882 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:31:58.882 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.882 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:31:58.882 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400984+0000", 2024-09-12T22:31:58.882 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:31:58.882 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.882 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.882 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:31:58.883 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400984+0000", 2024-09-12T22:31:58.883 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:31:58.883 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.883 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.883 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:31:58.883 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400985+0000", 2024-09-12T22:31:58.883 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3200000000000005e-07 2024-09-12T22:31:58.883 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.883 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.883 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:31:58.884 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400998+0000", 2024-09-12T22:31:58.884 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2726e-05 2024-09-12T22:31:58.884 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.884 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.884 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:31:58.884 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401006+0000", 2024-09-12T22:31:58.884 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.3110000000000006e-06 2024-09-12T22:31:58.885 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.885 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.885 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:31:58.885 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401022+0000", 2024-09-12T22:31:58.885 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6249e-05 2024-09-12T22:31:58.886 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.886 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.886 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:31:58.886 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401700+0000", 2024-09-12T22:31:58.886 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00067811100000000001 2024-09-12T22:31:58.886 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.887 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.887 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:31:58.887 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401839+0000", 2024-09-12T22:31:58.887 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013865399999999999 2024-09-12T22:31:58.887 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.887 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.887 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:31:58.887 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401962+0000", 2024-09-12T22:31:58.888 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000123266 2024-09-12T22:31:58.888 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.888 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.888 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:31:58.888 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.403589+0000", 2024-09-12T22:31:58.888 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001626932 2024-09-12T22:31:58.888 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.888 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.888 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:31:58.888 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.408274+0000", 2024-09-12T22:31:58.888 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0046848100000000002 2024-09-12T22:31:58.888 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.888 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.888 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:31:58.889 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.408324+0000", 2024-09-12T22:31:58.889 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9784000000000003e-05 2024-09-12T22:31:58.889 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.889 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.889 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:31:58.889 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.408355+0000", 2024-09-12T22:31:58.889 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.1019999999999998e-05 2024-09-12T22:31:58.889 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:31:58.889 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:31:58.889 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:31:58.889 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.889 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.889 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:31:58.890 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401034+0000", 2024-09-12T22:31:58.890 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 21.458292400000001, 2024-09-12T22:31:58.890 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011063051000000001, 2024-09-12T22:31:58.890 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:31:58.890 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:31:58.890 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:31:58.890 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:31:58.890 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.890 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:31:58.890 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401034+0000", 2024-09-12T22:31:58.890 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:31:58.891 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.891 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.891 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:31:58.891 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401034+0000", 2024-09-12T22:31:58.891 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:31:58.891 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.891 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.891 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:31:58.891 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401034+0000", 2024-09-12T22:31:58.891 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8899999999999999e-07 2024-09-12T22:31:58.891 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.891 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.891 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:31:58.892 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401038+0000", 2024-09-12T22:31:58.892 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.523e-06 2024-09-12T22:31:58.892 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.892 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.892 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:31:58.892 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401046+0000", 2024-09-12T22:31:58.892 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0479999999999999e-06 2024-09-12T22:31:58.892 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.892 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.892 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:31:58.892 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401051+0000", 2024-09-12T22:31:58.893 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2619999999999998e-06 2024-09-12T22:31:58.893 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.893 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.893 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:31:58.893 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402270+0000", 2024-09-12T22:31:58.893 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012182429999999999 2024-09-12T22:31:58.893 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.893 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.893 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:31:58.893 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402325+0000", 2024-09-12T22:31:58.893 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5526999999999999e-05 2024-09-12T22:31:58.894 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.894 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.894 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:31:58.894 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402403+0000", 2024-09-12T22:31:58.894 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.7559999999999996e-05 2024-09-12T22:31:58.894 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.894 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.894 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:31:58.894 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.403655+0000", 2024-09-12T22:31:58.894 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012521489999999999 2024-09-12T22:31:58.894 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.894 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.894 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:31:58.894 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411979+0000", 2024-09-12T22:31:58.895 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0083240420000000002 2024-09-12T22:31:58.895 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.895 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.895 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:31:58.895 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.412036+0000", 2024-09-12T22:31:58.895 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7639000000000002e-05 2024-09-12T22:31:58.895 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.895 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.895 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:31:58.895 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.412097+0000", 2024-09-12T22:31:58.895 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0469e-05 2024-09-12T22:31:58.895 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:31:58.895 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:31:58.896 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:31:58.896 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.896 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.896 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:31:58.896 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401060+0000", 2024-09-12T22:31:58.896 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 21.458266647999999, 2024-09-12T22:31:58.896 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.010030172, 2024-09-12T22:31:58.896 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:31:58.896 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:31:58.896 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:31:58.896 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:31:58.896 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.896 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:31:58.897 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401060+0000", 2024-09-12T22:31:58.897 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:31:58.897 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.897 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.897 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:31:58.897 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401060+0000", 2024-09-12T22:31:58.897 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:31:58.897 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.897 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.897 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:31:58.897 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401060+0000", 2024-09-12T22:31:58.897 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2500000000000001e-07 2024-09-12T22:31:58.897 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.898 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.898 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:31:58.898 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401063+0000", 2024-09-12T22:31:58.898 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0910000000000001e-06 2024-09-12T22:31:58.898 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.898 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.898 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:31:58.898 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401070+0000", 2024-09-12T22:31:58.898 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1210000000000001e-06 2024-09-12T22:31:58.898 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.898 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.898 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:31:58.898 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401076+0000", 2024-09-12T22:31:58.898 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2830000000000001e-06 2024-09-12T22:31:58.899 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.899 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.899 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:31:58.899 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402288+0000", 2024-09-12T22:31:58.899 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012123699999999999 2024-09-12T22:31:58.899 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.899 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.899 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:31:58.899 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402359+0000", 2024-09-12T22:31:58.899 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.0988000000000005e-05 2024-09-12T22:31:58.899 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.899 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.899 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:31:58.899 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402457+0000", 2024-09-12T22:31:58.900 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.7857999999999997e-05 2024-09-12T22:31:58.900 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.900 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.900 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:31:58.900 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.404395+0000", 2024-09-12T22:31:58.900 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0019380160000000001 2024-09-12T22:31:58.900 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.900 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.900 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:31:58.900 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410603+0000", 2024-09-12T22:31:58.900 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.006208061 2024-09-12T22:31:58.900 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.900 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.901 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:31:58.901 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410687+0000", 2024-09-12T22:31:58.901 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.4623000000000006e-05 2024-09-12T22:31:58.901 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.901 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.901 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:31:58.901 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411090+0000", 2024-09-12T22:31:58.901 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00040233599999999999 2024-09-12T22:31:58.901 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:31:58.901 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:31:58.901 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:31:58.901 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.901 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.902 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:31:58.902 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401083+0000", 2024-09-12T22:31:58.902 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 21.458243232000001, 2024-09-12T22:31:58.902 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0097591850000000001, 2024-09-12T22:31:58.902 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:31:58.902 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:31:58.902 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:31:58.902 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:31:58.902 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.902 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:31:58.902 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401083+0000", 2024-09-12T22:31:58.902 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:31:58.902 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.903 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.903 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:31:58.903 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401083+0000", 2024-09-12T22:31:58.903 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:31:58.903 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.903 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.903 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:31:58.903 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401084+0000", 2024-09-12T22:31:58.903 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4799999999999999e-07 2024-09-12T22:31:58.903 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.903 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.903 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:31:58.903 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401088+0000", 2024-09-12T22:31:58.904 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6419999999999998e-06 2024-09-12T22:31:58.904 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.904 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.904 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:31:58.904 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401094+0000", 2024-09-12T22:31:58.904 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0090000000000004e-06 2024-09-12T22:31:58.904 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.904 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.904 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:31:58.904 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401108+0000", 2024-09-12T22:31:58.904 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3884e-05 2024-09-12T22:31:58.904 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.905 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.905 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:31:58.905 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401165+0000", 2024-09-12T22:31:58.905 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.6499000000000002e-05 2024-09-12T22:31:58.905 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.905 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.905 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:31:58.905 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401261+0000", 2024-09-12T22:31:58.905 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.6872000000000004e-05 2024-09-12T22:31:58.905 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.905 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.905 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:31:58.905 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401376+0000", 2024-09-12T22:31:58.906 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000114508 2024-09-12T22:31:58.906 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.906 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.906 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:31:58.906 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402666+0000", 2024-09-12T22:31:58.906 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012901659999999999 2024-09-12T22:31:58.906 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.906 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.906 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:31:58.906 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410572+0000", 2024-09-12T22:31:58.906 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0079055489999999996 2024-09-12T22:31:58.906 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.907 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.907 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:31:58.907 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410661+0000", 2024-09-12T22:31:58.907 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.9578000000000002e-05 2024-09-12T22:31:58.907 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.907 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.907 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:31:58.907 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410842+0000", 2024-09-12T22:31:58.908 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00018102999999999999 2024-09-12T22:31:58.908 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:31:58.908 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:31:58.908 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:31:58.908 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.908 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.908 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:31:58.908 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401122+0000", 2024-09-12T22:31:58.908 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 21.458204200000001, 2024-09-12T22:31:58.908 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0099122080000000005, 2024-09-12T22:31:58.908 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:31:58.908 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:31:58.908 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:31:58.909 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:31:58.909 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.909 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:31:58.909 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401122+0000", 2024-09-12T22:31:58.909 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:31:58.909 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.909 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.909 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:31:58.909 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401122+0000", 2024-09-12T22:31:58.909 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:31:58.909 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.910 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.910 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:31:58.910 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401123+0000", 2024-09-12T22:31:58.910 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2600000000000002e-07 2024-09-12T22:31:58.910 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.910 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.910 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:31:58.910 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401126+0000", 2024-09-12T22:31:58.910 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.6449999999999998e-06 2024-09-12T22:31:58.910 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.911 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.911 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:31:58.911 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401133+0000", 2024-09-12T22:31:58.911 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.9890000000000003e-06 2024-09-12T22:31:58.911 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.911 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.911 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:31:58.911 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401138+0000", 2024-09-12T22:31:58.911 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8060000000000002e-06 2024-09-12T22:31:58.911 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.911 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.911 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:31:58.912 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401703+0000", 2024-09-12T22:31:58.912 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00056509099999999999 2024-09-12T22:31:58.912 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.912 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.912 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:31:58.912 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401837+0000", 2024-09-12T22:31:58.912 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013338799999999999 2024-09-12T22:31:58.912 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.912 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.913 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:31:58.913 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411034+0000", 2024-09-12T22:31:58.913 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.009197663 2024-09-12T22:31:58.913 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:31:58.913 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:31:58.913 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:31:58.913 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.913 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.913 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:31:58.914 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401158+0000", 2024-09-12T22:31:58.914 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 21.458168421, 2024-09-12T22:31:58.914 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.010292437999999999, 2024-09-12T22:31:58.914 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:31:58.914 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:31:58.914 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:31:58.914 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:31:58.914 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.914 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:31:58.915 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401158+0000", 2024-09-12T22:31:58.915 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:31:58.915 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.915 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.915 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:31:58.915 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401158+0000", 2024-09-12T22:31:58.915 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:31:58.915 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.915 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.915 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:31:58.916 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401158+0000", 2024-09-12T22:31:58.916 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9699999999999996e-07 2024-09-12T22:31:58.916 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.916 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.916 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:31:58.916 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401161+0000", 2024-09-12T22:31:58.916 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.7410000000000001e-06 2024-09-12T22:31:58.916 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.916 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.917 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:31:58.917 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401168+0000", 2024-09-12T22:31:58.917 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.844e-06 2024-09-12T22:31:58.917 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.917 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.917 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:31:58.917 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401174+0000", 2024-09-12T22:31:58.917 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4700000000000001e-06 2024-09-12T22:31:58.918 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.918 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.918 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:31:58.918 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402799+0000", 2024-09-12T22:31:58.918 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0016256409999999999 2024-09-12T22:31:58.918 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.918 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.918 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:31:58.918 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402893+0000", 2024-09-12T22:31:58.918 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.3807999999999994e-05 2024-09-12T22:31:58.919 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.919 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.919 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:31:58.919 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411450+0000", 2024-09-12T22:31:58.919 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0085573369999999999 2024-09-12T22:31:58.919 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:31:58.919 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:31:58.920 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:31:58.920 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.920 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.920 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:31:58.920 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401183+0000", 2024-09-12T22:31:58.920 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 21.458143569000001, 2024-09-12T22:31:58.920 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0068597830000000004, 2024-09-12T22:31:58.920 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:31:58.920 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:31:58.920 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:31:58.920 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:31:58.921 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.921 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:31:58.921 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401183+0000", 2024-09-12T22:31:58.921 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:31:58.921 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.921 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.921 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:31:58.921 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401183+0000", 2024-09-12T22:31:58.921 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:31:58.921 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.921 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.921 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:31:58.921 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401183+0000", 2024-09-12T22:31:58.921 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.6700000000000003e-07 2024-09-12T22:31:58.922 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.922 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.922 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:31:58.922 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401186+0000", 2024-09-12T22:31:58.922 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4679999999999999e-06 2024-09-12T22:31:58.922 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.922 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.922 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:31:58.922 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401192+0000", 2024-09-12T22:31:58.922 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.1519999999999997e-06 2024-09-12T22:31:58.922 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.922 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.922 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:31:58.923 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401197+0000", 2024-09-12T22:31:58.923 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4669999999999998e-06 2024-09-12T22:31:58.923 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.923 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.923 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:31:58.923 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401253+0000", 2024-09-12T22:31:58.923 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.6211000000000001e-05 2024-09-12T22:31:58.923 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.923 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.923 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:31:58.923 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401413+0000", 2024-09-12T22:31:58.923 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00016021399999999999 2024-09-12T22:31:58.923 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.924 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.924 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:31:58.924 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.408043+0000", 2024-09-12T22:31:58.924 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0066295039999999996 2024-09-12T22:31:58.924 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:31:58.924 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:31:58.924 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:31:58.924 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.924 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.925 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:20 3.1c e19/17 3:3ed09add:::607.00000000:head v 19'1, mlcod=0'0)", 2024-09-12T22:31:58.925 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.409642+0000", 2024-09-12T22:31:58.925 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 21.44968411, 2024-09-12T22:31:58.925 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0038816269999999999, 2024-09-12T22:31:58.925 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:31:58.925 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:31:58.925 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:31:58.925 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:31:58.925 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.925 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:31:58.925 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409642+0000", 2024-09-12T22:31:58.926 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:31:58.926 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.926 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.926 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:31:58.926 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409642+0000", 2024-09-12T22:31:58.926 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:31:58.926 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.926 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.926 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:31:58.926 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409642+0000", 2024-09-12T22:31:58.926 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.6899999999999999e-07 2024-09-12T22:31:58.926 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.926 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.927 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:31:58.927 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409648+0000", 2024-09-12T22:31:58.927 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.49e-06 2024-09-12T22:31:58.927 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.927 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.927 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:31:58.927 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409656+0000", 2024-09-12T22:31:58.927 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.2949999999999994e-06 2024-09-12T22:31:58.927 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.927 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.927 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:31:58.927 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409664+0000", 2024-09-12T22:31:58.927 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.1219999999999995e-06 2024-09-12T22:31:58.927 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.928 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.928 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:31:58.928 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409707+0000", 2024-09-12T22:31:58.928 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2222000000000003e-05 2024-09-12T22:31:58.928 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.928 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.928 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:31:58.928 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409724+0000", 2024-09-12T22:31:58.928 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7496999999999999e-05 2024-09-12T22:31:58.928 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.928 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.929 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:31:58.929 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413439+0000", 2024-09-12T22:31:58.929 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00371448 2024-09-12T22:31:58.929 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.929 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.929 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:31:58.929 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413524+0000", 2024-09-12T22:31:58.929 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.5252000000000003e-05 2024-09-12T22:31:58.929 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:31:58.929 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:31:58.929 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:31:58.929 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.929 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.929 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:28 3.13 e19/17 3:cd5a64a3:::100.00000000:head v 19'1, mlcod=0'0)", 2024-09-12T22:31:58.930 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.409681+0000", 2024-09-12T22:31:58.930 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 21.449645626999999, 2024-09-12T22:31:58.930 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0038708710000000001, 2024-09-12T22:31:58.930 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:31:58.930 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:31:58.930 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:31:58.930 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:31:58.930 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.930 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:31:58.930 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409681+0000", 2024-09-12T22:31:58.930 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:31:58.930 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.931 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.931 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:31:58.931 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409681+0000", 2024-09-12T22:31:58.931 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:31:58.931 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.931 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.931 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:31:58.931 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409681+0000", 2024-09-12T22:31:58.931 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3000000000000002e-07 2024-09-12T22:31:58.931 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.931 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.932 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:31:58.932 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409695+0000", 2024-09-12T22:31:58.932 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4313e-05 2024-09-12T22:31:58.932 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.932 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.932 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:31:58.932 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409703+0000", 2024-09-12T22:31:58.932 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4000000000000003e-06 2024-09-12T22:31:58.932 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.932 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.932 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:31:58.932 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409708+0000", 2024-09-12T22:31:58.933 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3190000000000002e-06 2024-09-12T22:31:58.933 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.933 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.933 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:31:58.933 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409875+0000", 2024-09-12T22:31:58.933 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000167329 2024-09-12T22:31:58.933 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.933 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.933 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:31:58.933 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409892+0000", 2024-09-12T22:31:58.933 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6957999999999999e-05 2024-09-12T22:31:58.933 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.934 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.934 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:31:58.934 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413457+0000", 2024-09-12T22:31:58.934 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0035651279999999999 2024-09-12T22:31:58.934 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.934 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.934 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:31:58.934 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413552+0000", 2024-09-12T22:31:58.934 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.4093999999999997e-05 2024-09-12T22:31:58.934 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:31:58.934 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:31:58.934 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:31:58.934 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.935 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.935 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:21 3.1c e19/17 3:3ed09add:::607.00000000:head v 19'2, mlcod=0'0)", 2024-09-12T22:31:58.935 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.409718+0000", 2024-09-12T22:31:58.935 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 21.449607962000002, 2024-09-12T22:31:58.935 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003851883, 2024-09-12T22:31:58.935 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:31:58.935 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:31:58.935 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:31:58.935 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:31:58.935 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.935 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:31:58.935 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409718+0000", 2024-09-12T22:31:58.935 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:31:58.936 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.936 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.936 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:31:58.936 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409718+0000", 2024-09-12T22:31:58.936 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:31:58.936 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.936 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.936 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:31:58.936 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409719+0000", 2024-09-12T22:31:58.936 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.16e-07 2024-09-12T22:31:58.936 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.936 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.936 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:31:58.937 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409722+0000", 2024-09-12T22:31:58.937 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.692e-06 2024-09-12T22:31:58.937 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.937 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.937 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:31:58.937 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409729+0000", 2024-09-12T22:31:58.937 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.516e-06 2024-09-12T22:31:58.937 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.937 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.937 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:31:58.937 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409750+0000", 2024-09-12T22:31:58.937 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1151000000000001e-05 2024-09-12T22:31:58.937 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.937 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.938 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:31:58.938 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410015+0000", 2024-09-12T22:31:58.938 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00026477599999999999 2024-09-12T22:31:58.938 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.938 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.938 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:31:58.938 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410104+0000", 2024-09-12T22:31:58.938 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.9586000000000006e-05 2024-09-12T22:31:58.938 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.938 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.938 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:31:58.938 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413528+0000", 2024-09-12T22:31:58.939 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0034237880000000001 2024-09-12T22:31:58.939 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.939 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.939 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:31:58.939 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413570+0000", 2024-09-12T22:31:58.939 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2157999999999999e-05 2024-09-12T22:31:58.939 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:31:58.939 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:31:58.939 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:31:58.939 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.939 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.939 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:27 3.13 e19/17 3:c91d4a1d:::mds0_inotable:head v 19'2, mlcod=0'0)", 2024-09-12T22:31:58.939 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.409760+0000", 2024-09-12T22:31:58.940 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 21.449566445999999, 2024-09-12T22:31:58.940 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0039301910000000004, 2024-09-12T22:31:58.940 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:31:58.940 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:31:58.940 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:31:58.940 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:31:58.940 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.940 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:31:58.940 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409760+0000", 2024-09-12T22:31:58.940 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:31:58.940 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.940 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.940 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:31:58.941 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409760+0000", 2024-09-12T22:31:58.941 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:31:58.941 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.941 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.941 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:31:58.941 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409760+0000", 2024-09-12T22:31:58.941 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.39e-07 2024-09-12T22:31:58.941 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.941 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.941 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:31:58.941 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409765+0000", 2024-09-12T22:31:58.941 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4449999999999998e-06 2024-09-12T22:31:58.941 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.942 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.942 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:31:58.942 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409771+0000", 2024-09-12T22:31:58.942 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7159999999999997e-06 2024-09-12T22:31:58.942 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.942 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.942 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:31:58.942 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409778+0000", 2024-09-12T22:31:58.942 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.331e-06 2024-09-12T22:31:58.942 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.942 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.942 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:31:58.942 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410191+0000", 2024-09-12T22:31:58.943 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00041348300000000003 2024-09-12T22:31:58.943 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.943 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.943 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:31:58.943 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410211+0000", 2024-09-12T22:31:58.943 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9933999999999999e-05 2024-09-12T22:31:58.943 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.943 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.943 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:31:58.943 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413638+0000", 2024-09-12T22:31:58.943 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003426854 2024-09-12T22:31:58.943 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.943 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.943 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:31:58.943 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413690+0000", 2024-09-12T22:31:58.944 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2089000000000002e-05 2024-09-12T22:31:58.944 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:31:58.944 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:31:58.944 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:31:58.944 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.944 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.944 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "pg_update_log_missing_reply(3.b epoch 19/17 rep_tid 4 lcod 19'2)", 2024-09-12T22:31:58.944 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.410060+0000", 2024-09-12T22:31:58.944 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 21.449266780999999, 2024-09-12T22:31:58.944 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00098016500000000007, 2024-09-12T22:31:58.944 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:31:58.944 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:31:58.944 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "reached pg", 2024-09-12T22:31:58.945 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:31:58.945 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.945 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:31:58.945 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410060+0000", 2024-09-12T22:31:58.945 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:31:58.945 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.945 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.946 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:31:58.946 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410060+0000", 2024-09-12T22:31:58.946 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:31:58.946 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.946 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.946 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:31:58.946 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410060+0000", 2024-09-12T22:31:58.947 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.8299999999999998e-07 2024-09-12T22:31:58.947 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.947 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.947 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:31:58.948 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410062+0000", 2024-09-12T22:31:58.948 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5749999999999999e-06 2024-09-12T22:31:58.948 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.948 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.948 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:31:58.948 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410070+0000", 2024-09-12T22:31:58.948 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.909e-06 2024-09-12T22:31:58.948 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.948 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.948 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:31:58.949 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410076+0000", 2024-09-12T22:31:58.949 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7049999999999996e-06 2024-09-12T22:31:58.949 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.949 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.949 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:31:58.949 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410943+0000", 2024-09-12T22:31:58.949 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00086681900000000001 2024-09-12T22:31:58.949 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.949 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.949 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:31:58.950 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411040+0000", 2024-09-12T22:31:58.950 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.6774000000000006e-05 2024-09-12T22:31:58.950 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:31:58.950 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:31:58.950 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:31:58.950 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.950 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.950 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e19/17 ondisk, result = 0)", 2024-09-12T22:31:58.950 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.410113+0000", 2024-09-12T22:31:58.950 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 21.449213514, 2024-09-12T22:31:58.951 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00098911599999999995, 2024-09-12T22:31:58.951 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:31:58.951 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:31:58.951 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:31:58.951 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:31:58.951 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.951 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:31:58.951 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410113+0000", 2024-09-12T22:31:58.952 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:31:58.952 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.952 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.952 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:31:58.952 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410113+0000", 2024-09-12T22:31:58.952 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:31:58.952 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.952 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.952 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:31:58.952 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410113+0000", 2024-09-12T22:31:58.952 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.99e-07 2024-09-12T22:31:58.953 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.953 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.953 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:31:58.953 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410115+0000", 2024-09-12T22:31:58.953 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.046e-06 2024-09-12T22:31:58.953 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.953 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.953 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:31:58.954 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410121+0000", 2024-09-12T22:31:58.954 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0050000000000001e-06 2024-09-12T22:31:58.954 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.954 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.954 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:31:58.954 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410126+0000", 2024-09-12T22:31:58.954 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8339999999999998e-06 2024-09-12T22:31:58.954 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.955 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.955 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:31:58.955 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410587+0000", 2024-09-12T22:31:58.955 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00046095499999999998 2024-09-12T22:31:58.955 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.955 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.955 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:31:58.956 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410595+0000", 2024-09-12T22:31:58.956 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.9419999999999995e-06 2024-09-12T22:31:58.956 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.956 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.957 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:31:58.957 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411102+0000", 2024-09-12T22:31:58.957 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00050713500000000003 2024-09-12T22:31:58.957 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:31:58.957 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:31:58.958 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:31:58.958 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.958 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.958 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 19/17 rep_tid 8 lcod 19'4)", 2024-09-12T22:31:58.958 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.410133+0000", 2024-09-12T22:31:58.958 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 21.449193586, 2024-09-12T22:31:58.959 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0013504000000000001, 2024-09-12T22:31:58.959 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:31:58.959 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:31:58.959 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "reached pg", 2024-09-12T22:31:58.959 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:31:58.959 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.959 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:31:58.959 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410133+0000", 2024-09-12T22:31:58.960 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:31:58.960 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.960 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.960 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:31:58.960 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410133+0000", 2024-09-12T22:31:58.961 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:31:58.961 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.961 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.961 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:31:58.961 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410133+0000", 2024-09-12T22:31:58.961 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.0599999999999999e-07 2024-09-12T22:31:58.961 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.961 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.961 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:31:58.961 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410135+0000", 2024-09-12T22:31:58.961 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7770000000000001e-06 2024-09-12T22:31:58.961 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.961 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.962 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:31:58.962 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410140+0000", 2024-09-12T22:31:58.962 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9960000000000001e-06 2024-09-12T22:31:58.962 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.962 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.962 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:31:58.962 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410144+0000", 2024-09-12T22:31:58.962 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9500000000000003e-06 2024-09-12T22:31:58.962 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.962 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.962 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:31:58.962 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411310+0000", 2024-09-12T22:31:58.962 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001166311 2024-09-12T22:31:58.963 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.963 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.963 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:31:58.963 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411483+0000", 2024-09-12T22:31:58.963 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00017316 2024-09-12T22:31:58.963 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:31:58.963 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:31:58.963 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:31:58.963 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.963 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.963 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "pg_update_log_missing(3.1a epoch 19/17 rep_tid 0 entries 19'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T22:31:58.963 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.410617+0000", 2024-09-12T22:31:58.964 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 21.448709190999999, 2024-09-12T22:31:58.964 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0030439709999999999, 2024-09-12T22:31:58.964 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:31:58.964 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:31:58.964 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "reached pg", 2024-09-12T22:31:58.964 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:31:58.964 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.964 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:31:58.964 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410617+0000", 2024-09-12T22:31:58.965 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:31:58.965 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.965 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.965 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:31:58.965 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410617+0000", 2024-09-12T22:31:58.965 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:31:58.965 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.965 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.965 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:31:58.965 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410617+0000", 2024-09-12T22:31:58.965 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3599999999999999e-07 2024-09-12T22:31:58.966 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.966 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.966 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:31:58.966 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410625+0000", 2024-09-12T22:31:58.966 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5410000000000003e-06 2024-09-12T22:31:58.966 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.967 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.967 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:31:58.967 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410638+0000", 2024-09-12T22:31:58.967 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3261999999999999e-05 2024-09-12T22:31:58.967 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.967 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.967 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:31:58.967 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410653+0000", 2024-09-12T22:31:58.967 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4844000000000001e-05 2024-09-12T22:31:58.967 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.968 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.968 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:31:58.968 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410814+0000", 2024-09-12T22:31:58.968 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00016119999999999999 2024-09-12T22:31:58.968 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.968 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.968 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:31:58.968 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413661+0000", 2024-09-12T22:31:58.968 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0028467879999999998 2024-09-12T22:31:58.968 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:31:58.968 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:31:58.968 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:31:58.968 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.969 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.969 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-09-12T22:31:58.969 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:39.398875+0000", 2024-09-12T22:31:58.969 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 19.460450910999999, 2024-09-12T22:31:58.969 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0015679069999999999, 2024-09-12T22:31:58.969 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:31:58.970 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:31:58.970 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:31:58.970 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:31:58.970 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.970 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:31:58.970 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398875+0000", 2024-09-12T22:31:58.970 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:31:58.970 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.970 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.971 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:31:58.971 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398875+0000", 2024-09-12T22:31:58.971 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:31:58.971 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.971 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.971 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:31:58.971 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398878+0000", 2024-09-12T22:31:58.972 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1679999999999998e-06 2024-09-12T22:31:58.972 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.972 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.972 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:31:58.973 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398888+0000", 2024-09-12T22:31:58.973 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.084e-05 2024-09-12T22:31:58.973 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.973 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.973 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:31:58.973 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398906+0000", 2024-09-12T22:31:58.973 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7518000000000001e-05 2024-09-12T22:31:58.974 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.974 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.974 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:31:58.974 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398914+0000", 2024-09-12T22:31:58.974 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5989999999999996e-06 2024-09-12T22:31:58.974 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.975 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.975 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:31:58.975 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398974+0000", 2024-09-12T22:31:58.975 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0988e-05 2024-09-12T22:31:58.975 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.975 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.976 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:31:58.976 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.399078+0000", 2024-09-12T22:31:58.976 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000103133 2024-09-12T22:31:58.976 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.976 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.977 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:31:58.977 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.399166+0000", 2024-09-12T22:31:58.977 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.8183999999999995e-05 2024-09-12T22:31:58.977 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.977 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.977 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:31:58.978 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.399747+0000", 2024-09-12T22:31:58.978 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00058110599999999996 2024-09-12T22:31:58.978 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.978 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.978 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:31:58.978 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.400377+0000", 2024-09-12T22:31:58.978 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000630157 2024-09-12T22:31:58.978 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.978 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.978 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:31:58.978 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.400415+0000", 2024-09-12T22:31:58.979 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7814000000000001e-05 2024-09-12T22:31:58.979 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.979 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.979 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:31:58.979 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.400443+0000", 2024-09-12T22:31:58.980 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8399999999999999e-05 2024-09-12T22:31:58.980 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:31:58.980 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:31:58.981 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:31:58.981 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.981 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.981 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e23)", 2024-09-12T22:31:58.981 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:58.400966+0000", 2024-09-12T22:31:58.981 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.45836000300000002, 2024-09-12T22:31:58.981 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001468876, 2024-09-12T22:31:58.981 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:31:58.981 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:31:58.981 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:31:58.981 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:31:58.981 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.981 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:31:58.982 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400966+0000", 2024-09-12T22:31:58.982 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:31:58.982 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.982 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.982 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:31:58.982 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400966+0000", 2024-09-12T22:31:58.982 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:31:58.982 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.983 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.983 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:31:58.983 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400967+0000", 2024-09-12T22:31:58.983 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.046e-06 2024-09-12T22:31:58.983 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.983 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.983 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:31:58.983 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400974+0000", 2024-09-12T22:31:58.983 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2310000000000001e-06 2024-09-12T22:31:58.983 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.983 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.984 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:31:58.984 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400988+0000", 2024-09-12T22:31:58.984 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4482e-05 2024-09-12T22:31:58.984 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.984 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.984 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:31:58.984 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400997+0000", 2024-09-12T22:31:58.984 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.0189999999999995e-06 2024-09-12T22:31:58.984 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.984 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.985 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:31:58.985 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.401068+0000", 2024-09-12T22:31:58.985 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1426000000000004e-05 2024-09-12T22:31:58.985 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.985 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.986 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:31:58.986 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.401174+0000", 2024-09-12T22:31:58.986 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000105769 2024-09-12T22:31:58.986 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.986 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.987 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:31:58.987 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.401335+0000", 2024-09-12T22:31:58.987 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000161225 2024-09-12T22:31:58.987 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.987 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.987 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:31:58.987 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.402110+0000", 2024-09-12T22:31:58.987 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00077428800000000004 2024-09-12T22:31:58.988 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.988 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.988 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:31:58.988 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.402333+0000", 2024-09-12T22:31:58.988 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000223723 2024-09-12T22:31:58.988 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.988 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.988 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:31:58.989 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.402388+0000", 2024-09-12T22:31:58.989 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4700999999999997e-05 2024-09-12T22:31:58.989 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:31:58.989 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:31:58.989 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:31:58.989 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.402435+0000", 2024-09-12T22:31:58.989 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6965999999999997e-05 2024-09-12T22:31:58.989 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:31:58.989 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:31:58.989 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:31:58.989 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:31:58.989 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:31:58.989 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:31:58.991 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:31:58.992 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:31:58.990+0000 7fddec6a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30331) UID: 0 2024-09-12T22:31:59.091 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:31:59.090+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:31:59.096 INFO:teuthology.orchestra.run.smithi019.stderr:nodeep-scrub is set 2024-09-12T22:31:59.107 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-09-12T22:31:59.107 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-09-12T22:31:59.107 INFO:teuthology.orchestra.run.smithi163.stdout: "num_ops": 0 2024-09-12T22:31:59.107 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-09-12T22:31:59.117 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:31:59.192 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:31:59.191+0000 7fddec6a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30331) UID: 0 2024-09-12T22:31:59.261 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-09-12T22:31:59.261 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-09-12T22:31:59.261 INFO:teuthology.orchestra.run.smithi163.stdout: "complaint_time": 30, 2024-09-12T22:31:59.261 INFO:teuthology.orchestra.run.smithi163.stdout: "num_blocked_ops": 0 2024-09-12T22:31:59.262 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-09-12T22:31:59.270 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:31:59.292 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:31:59.291+0000 7fddec6a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30331) UID: 0 2024-09-12T22:31:59.374 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-09-12T22:31:59.375 INFO:teuthology.orchestra.run.smithi163.stdout: "size": 20, 2024-09-12T22:31:59.375 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 600, 2024-09-12T22:31:59.375 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2024-09-12T22:31:59.375 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.375 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-09-12T22:31:59.375 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:27.254459+0000", 2024-09-12T22:31:59.375 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 32.11809744, 2024-09-12T22:31:59.375 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.37816283899999997, 2024-09-12T22:31:59.375 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:31:59.375 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:31:59.375 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:31:59.376 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:31:59.376 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:31:59.376 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:31:59.376 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 1 2024-09-12T22:31:59.376 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.376 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:31:59.376 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.376 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:31:59.376 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254459+0000", 2024-09-12T22:31:59.376 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:31:59.376 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.376 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.377 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:31:59.377 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254459+0000", 2024-09-12T22:31:59.377 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:31:59.377 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.377 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.377 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:31:59.377 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254460+0000", 2024-09-12T22:31:59.377 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1739999999999999e-06 2024-09-12T22:31:59.377 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.377 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.377 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:31:59.377 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254472+0000", 2024-09-12T22:31:59.377 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2207e-05 2024-09-12T22:31:59.378 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.378 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.378 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:31:59.378 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254483+0000", 2024-09-12T22:31:59.378 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0631999999999999e-05 2024-09-12T22:31:59.378 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.378 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.378 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:31:59.378 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254492+0000", 2024-09-12T22:31:59.378 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3670000000000003e-06 2024-09-12T22:31:59.378 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.378 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.378 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:31:59.379 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254551+0000", 2024-09-12T22:31:59.379 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8687999999999998e-05 2024-09-12T22:31:59.379 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.379 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.379 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for peered", 2024-09-12T22:31:59.379 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254562+0000", 2024-09-12T22:31:59.379 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1249e-05 2024-09-12T22:31:59.379 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.379 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.379 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:31:59.379 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.631211+0000", 2024-09-12T22:31:59.379 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.376649018 2024-09-12T22:31:59.379 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.380 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.380 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:31:59.380 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.631345+0000", 2024-09-12T22:31:59.380 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013378700000000001 2024-09-12T22:31:59.380 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.380 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.380 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:31:59.380 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.631479+0000", 2024-09-12T22:31:59.381 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013352399999999999 2024-09-12T22:31:59.381 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.381 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.381 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:31:59.381 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632324+0000", 2024-09-12T22:31:59.381 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00084508100000000002 2024-09-12T22:31:59.381 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.381 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.381 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:31:59.381 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632548+0000", 2024-09-12T22:31:59.382 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000224329 2024-09-12T22:31:59.382 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.382 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.382 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:31:59.382 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632591+0000", 2024-09-12T22:31:59.382 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2564000000000001e-05 2024-09-12T22:31:59.382 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.382 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.382 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:31:59.382 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632622+0000", 2024-09-12T22:31:59.382 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1219e-05 2024-09-12T22:31:59.382 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:31:59.383 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:31:59.383 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:31:59.383 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.383 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.383 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:185 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:31:59.383 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394355+0000", 2024-09-12T22:31:59.383 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 30.978201342999999, 2024-09-12T22:31:59.383 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011302394, 2024-09-12T22:31:59.383 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:31:59.383 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:31:59.383 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:31:59.383 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:31:59.383 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:31:59.384 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:31:59.384 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 185 2024-09-12T22:31:59.384 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.384 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:31:59.384 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.384 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:31:59.384 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394355+0000", 2024-09-12T22:31:59.384 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:31:59.384 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.384 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.384 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:31:59.384 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394355+0000", 2024-09-12T22:31:59.384 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:31:59.385 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.385 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.385 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:31:59.385 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394355+0000", 2024-09-12T22:31:59.385 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9099999999999999e-07 2024-09-12T22:31:59.385 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.385 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.385 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:31:59.385 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394385+0000", 2024-09-12T22:31:59.385 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9963000000000001e-05 2024-09-12T22:31:59.385 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.385 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.385 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:31:59.386 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394390+0000", 2024-09-12T22:31:59.386 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8420000000000004e-06 2024-09-12T22:31:59.386 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.386 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.386 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:31:59.386 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394393+0000", 2024-09-12T22:31:59.386 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1e-06 2024-09-12T22:31:59.386 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.386 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.386 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:31:59.386 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.400546+0000", 2024-09-12T22:31:59.386 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0061523309999999996 2024-09-12T22:31:59.386 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.387 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.387 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:31:59.387 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.400588+0000", 2024-09-12T22:31:59.387 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1835000000000002e-05 2024-09-12T22:31:59.387 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.387 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.387 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:31:59.387 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.400677+0000", 2024-09-12T22:31:59.387 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9195000000000002e-05 2024-09-12T22:31:59.387 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.387 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.387 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:31:59.387 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405378+0000", 2024-09-12T22:31:59.387 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0047008659999999997 2024-09-12T22:31:59.388 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.388 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.388 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:31:59.388 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405569+0000", 2024-09-12T22:31:59.388 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00019148599999999999 2024-09-12T22:31:59.388 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.388 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.388 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:31:59.388 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405620+0000", 2024-09-12T22:31:59.388 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1416999999999999e-05 2024-09-12T22:31:59.388 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.388 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.388 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:31:59.389 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405657+0000", 2024-09-12T22:31:59.389 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6968000000000002e-05 2024-09-12T22:31:59.389 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:31:59.389 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:31:59.389 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:31:59.389 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.389 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.389 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:31:59.389 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394399+0000", 2024-09-12T22:31:59.389 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 30.978157132, 2024-09-12T22:31:59.389 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011336601999999999, 2024-09-12T22:31:59.389 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:31:59.390 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:31:59.390 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:31:59.390 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:31:59.390 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:31:59.390 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:31:59.390 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 186 2024-09-12T22:31:59.390 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.390 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:31:59.390 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.390 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:31:59.390 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394399+0000", 2024-09-12T22:31:59.390 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:31:59.391 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.391 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.391 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:31:59.391 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394399+0000", 2024-09-12T22:31:59.391 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:31:59.391 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.391 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.391 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:31:59.391 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394400+0000", 2024-09-12T22:31:59.391 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4499999999999998e-07 2024-09-12T22:31:59.391 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.391 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.391 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:31:59.392 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394402+0000", 2024-09-12T22:31:59.392 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.875e-06 2024-09-12T22:31:59.392 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.392 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.392 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:31:59.392 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394405+0000", 2024-09-12T22:31:59.392 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6799999999999999e-06 2024-09-12T22:31:59.392 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.392 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.392 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:31:59.392 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394408+0000", 2024-09-12T22:31:59.392 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.667e-06 2024-09-12T22:31:59.392 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.393 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.393 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:31:59.393 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401395+0000", 2024-09-12T22:31:59.393 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0069867230000000002 2024-09-12T22:31:59.393 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.393 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.393 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:31:59.393 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401438+0000", 2024-09-12T22:31:59.393 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3554999999999999e-05 2024-09-12T22:31:59.393 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.393 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.393 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:31:59.393 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401509+0000", 2024-09-12T22:31:59.394 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0631999999999997e-05 2024-09-12T22:31:59.394 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.394 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.394 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:31:59.394 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405392+0000", 2024-09-12T22:31:59.394 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0038830449999999999 2024-09-12T22:31:59.394 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.394 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.394 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:31:59.394 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405690+0000", 2024-09-12T22:31:59.394 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000298435 2024-09-12T22:31:59.394 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.395 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.395 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:31:59.395 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405716+0000", 2024-09-12T22:31:59.395 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5435999999999998e-05 2024-09-12T22:31:59.395 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.395 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.395 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:31:59.395 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405736+0000", 2024-09-12T22:31:59.395 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0208999999999999e-05 2024-09-12T22:31:59.396 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:31:59.396 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:31:59.396 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:31:59.396 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.396 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.396 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:31:59.396 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394411+0000", 2024-09-12T22:31:59.396 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 30.978145005999998, 2024-09-12T22:31:59.396 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011400117, 2024-09-12T22:31:59.396 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:31:59.397 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:31:59.397 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:31:59.397 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:31:59.397 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:31:59.397 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:31:59.397 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 187 2024-09-12T22:31:59.397 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.397 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:31:59.397 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.397 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:31:59.398 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394411+0000", 2024-09-12T22:31:59.398 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:31:59.398 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.398 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.398 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:31:59.398 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394411+0000", 2024-09-12T22:31:59.398 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:31:59.398 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.398 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.398 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:31:59.399 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394412+0000", 2024-09-12T22:31:59.399 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.4999999999999999e-07 2024-09-12T22:31:59.399 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.399 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.399 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:31:59.399 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394414+0000", 2024-09-12T22:31:59.399 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.984e-06 2024-09-12T22:31:59.399 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.399 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.399 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:31:59.399 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394418+0000", 2024-09-12T22:31:59.400 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0840000000000002e-06 2024-09-12T22:31:59.400 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.400 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.400 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:31:59.400 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394431+0000", 2024-09-12T22:31:59.400 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.361e-05 2024-09-12T22:31:59.400 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.400 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.400 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:31:59.400 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401778+0000", 2024-09-12T22:31:59.400 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0073462659999999997 2024-09-12T22:31:59.401 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.401 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.401 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:31:59.401 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401853+0000", 2024-09-12T22:31:59.401 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5797000000000006e-05 2024-09-12T22:31:59.401 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.401 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.401 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:31:59.401 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401990+0000", 2024-09-12T22:31:59.401 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013651399999999999 2024-09-12T22:31:59.401 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.402 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.402 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:31:59.402 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405402+0000", 2024-09-12T22:31:59.402 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0034116070000000001 2024-09-12T22:31:59.402 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.402 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.402 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:31:59.402 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405764+0000", 2024-09-12T22:31:59.404 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00036234899999999998 2024-09-12T22:31:59.404 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.404 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.404 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:31:59.404 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405791+0000", 2024-09-12T22:31:59.404 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7029000000000002e-05 2024-09-12T22:31:59.404 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.404 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.404 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:31:59.404 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405812+0000", 2024-09-12T22:31:59.405 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0627000000000001e-05 2024-09-12T22:31:59.405 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:31:59.405 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:31:59.405 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:31:59.405 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.405 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.405 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:31:59.405 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394447+0000", 2024-09-12T22:31:59.405 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 30.978109855, 2024-09-12T22:31:59.405 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011759588, 2024-09-12T22:31:59.405 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:31:59.406 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:31:59.406 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:31:59.406 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:31:59.406 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:31:59.406 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:31:59.406 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 188 2024-09-12T22:31:59.406 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.406 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:31:59.406 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.406 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:31:59.406 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394447+0000", 2024-09-12T22:31:59.407 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:31:59.407 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.407 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.407 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:31:59.407 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394447+0000", 2024-09-12T22:31:59.407 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:31:59.407 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.407 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.407 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:31:59.407 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394447+0000", 2024-09-12T22:31:59.407 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.15e-07 2024-09-12T22:31:59.408 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.408 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.408 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:31:59.408 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394512+0000", 2024-09-12T22:31:59.408 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4580999999999997e-05 2024-09-12T22:31:59.408 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.408 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.408 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:31:59.408 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394518+0000", 2024-09-12T22:31:59.408 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.3380000000000001e-06 2024-09-12T22:31:59.409 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.409 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.409 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:31:59.409 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394521+0000", 2024-09-12T22:31:59.409 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3340000000000002e-06 2024-09-12T22:31:59.409 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.409 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.409 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:31:59.409 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.402628+0000", 2024-09-12T22:31:59.409 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.008106996 2024-09-12T22:31:59.409 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.410 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.410 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:31:59.410 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.402670+0000", 2024-09-12T22:31:59.410 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1983000000000001e-05 2024-09-12T22:31:59.410 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.410 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.410 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:31:59.410 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.402738+0000", 2024-09-12T22:31:59.410 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.8114999999999994e-05 2024-09-12T22:31:59.410 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.410 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.411 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:31:59.411 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405668+0000", 2024-09-12T22:31:59.411 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.002929545 2024-09-12T22:31:59.411 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.411 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.411 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:31:59.411 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406162+0000", 2024-09-12T22:31:59.411 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000494408 2024-09-12T22:31:59.411 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.411 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.411 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:31:59.412 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406188+0000", 2024-09-12T22:31:59.412 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5766e-05 2024-09-12T22:31:59.412 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.412 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.412 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:31:59.412 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406206+0000", 2024-09-12T22:31:59.412 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.8107000000000001e-05 2024-09-12T22:31:59.412 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:31:59.412 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:31:59.412 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:31:59.412 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.413 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.413 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:31:59.413 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394528+0000", 2024-09-12T22:31:59.413 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 30.978028186, 2024-09-12T22:31:59.413 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.01195536, 2024-09-12T22:31:59.413 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:31:59.413 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:31:59.413 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:31:59.413 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:31:59.413 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:31:59.413 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:31:59.413 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 189 2024-09-12T22:31:59.414 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.414 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:31:59.414 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.414 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:31:59.414 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394528+0000", 2024-09-12T22:31:59.414 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:31:59.414 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.414 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.414 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:31:59.414 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394528+0000", 2024-09-12T22:31:59.414 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:31:59.415 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.415 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.415 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:31:59.415 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394529+0000", 2024-09-12T22:31:59.415 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4900000000000001e-07 2024-09-12T22:31:59.415 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.415 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.415 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:31:59.415 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394531+0000", 2024-09-12T22:31:59.415 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.458e-06 2024-09-12T22:31:59.415 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.415 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.416 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:31:59.416 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394535+0000", 2024-09-12T22:31:59.416 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7900000000000001e-06 2024-09-12T22:31:59.416 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.416 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.416 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:31:59.416 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394537+0000", 2024-09-12T22:31:59.416 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.632e-06 2024-09-12T22:31:59.416 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.416 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.416 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:31:59.417 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.404932+0000", 2024-09-12T22:31:59.417 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010394158000000001 2024-09-12T22:31:59.417 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.417 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.417 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:31:59.417 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405017+0000", 2024-09-12T22:31:59.417 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5525000000000005e-05 2024-09-12T22:31:59.417 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.417 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.417 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:31:59.418 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405114+0000", 2024-09-12T22:31:59.418 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.6527000000000006e-05 2024-09-12T22:31:59.418 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.418 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.418 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:31:59.418 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405818+0000", 2024-09-12T22:31:59.418 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00070412800000000005 2024-09-12T22:31:59.418 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.418 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.418 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:31:59.418 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406437+0000", 2024-09-12T22:31:59.419 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00061898900000000002 2024-09-12T22:31:59.419 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.419 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.419 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:31:59.419 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406463+0000", 2024-09-12T22:31:59.419 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6268e-05 2024-09-12T22:31:59.419 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.419 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.419 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:31:59.419 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406484+0000", 2024-09-12T22:31:59.419 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0536000000000001e-05 2024-09-12T22:31:59.419 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:31:59.420 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:31:59.420 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:31:59.420 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.420 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.420 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:31:59.420 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.401422+0000", 2024-09-12T22:31:59.420 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 21.971134281000001, 2024-09-12T22:31:59.420 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016896452999999999, 2024-09-12T22:31:59.420 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:31:59.420 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:31:59.421 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:31:59.421 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:31:59.421 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.421 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:31:59.421 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401422+0000", 2024-09-12T22:31:59.421 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:31:59.421 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.421 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.421 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:31:59.421 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401422+0000", 2024-09-12T22:31:59.421 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:31:59.422 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.422 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.422 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:31:59.422 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401424+0000", 2024-09-12T22:31:59.422 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9e-06 2024-09-12T22:31:59.422 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.422 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.422 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:31:59.422 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401437+0000", 2024-09-12T22:31:59.422 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2831e-05 2024-09-12T22:31:59.422 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.422 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.423 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:31:59.423 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401471+0000", 2024-09-12T22:31:59.423 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4010000000000001e-05 2024-09-12T22:31:59.423 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.423 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.423 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:31:59.423 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401484+0000", 2024-09-12T22:31:59.423 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2711000000000001e-05 2024-09-12T22:31:59.423 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.423 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.423 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:31:59.424 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405410+0000", 2024-09-12T22:31:59.424 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0039259170000000001 2024-09-12T22:31:59.424 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.424 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.424 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:31:59.424 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405529+0000", 2024-09-12T22:31:59.424 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000119778 2024-09-12T22:31:59.424 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.424 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.424 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:31:59.424 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405655+0000", 2024-09-12T22:31:59.424 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012556700000000001 2024-09-12T22:31:59.425 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.425 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.425 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:31:59.425 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410456+0000", 2024-09-12T22:31:59.425 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0048008269999999997 2024-09-12T22:31:59.425 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.425 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.425 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:31:59.425 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418226+0000", 2024-09-12T22:31:59.425 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0077707729999999999 2024-09-12T22:31:59.426 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.426 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.426 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:31:59.426 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418277+0000", 2024-09-12T22:31:59.426 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0476000000000003e-05 2024-09-12T22:31:59.426 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.426 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.426 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:31:59.426 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418319+0000", 2024-09-12T22:31:59.426 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1662999999999997e-05 2024-09-12T22:31:59.426 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:31:59.427 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:31:59.427 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:31:59.427 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.427 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.427 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:31:59.427 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.401505+0000", 2024-09-12T22:31:59.427 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 21.971051617000001, 2024-09-12T22:31:59.427 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016987904000000002, 2024-09-12T22:31:59.427 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:31:59.427 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:31:59.427 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:31:59.427 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:31:59.428 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.428 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:31:59.428 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401505+0000", 2024-09-12T22:31:59.428 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:31:59.428 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.428 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.428 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:31:59.428 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401505+0000", 2024-09-12T22:31:59.428 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:31:59.428 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.429 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.429 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:31:59.429 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401506+0000", 2024-09-12T22:31:59.429 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4700000000000001e-07 2024-09-12T22:31:59.429 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.429 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.429 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:31:59.429 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401510+0000", 2024-09-12T22:31:59.429 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6609999999999999e-06 2024-09-12T22:31:59.429 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.429 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.429 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:31:59.430 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401771+0000", 2024-09-12T22:31:59.430 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00026110700000000001 2024-09-12T22:31:59.430 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.430 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.430 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:31:59.430 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401921+0000", 2024-09-12T22:31:59.430 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014939099999999999 2024-09-12T22:31:59.430 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.430 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.430 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:31:59.431 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405944+0000", 2024-09-12T22:31:59.431 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0040235449999999999 2024-09-12T22:31:59.431 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.431 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.431 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:31:59.431 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406018+0000", 2024-09-12T22:31:59.431 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3373000000000004e-05 2024-09-12T22:31:59.431 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.431 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.431 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:31:59.431 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406172+0000", 2024-09-12T22:31:59.431 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00015435399999999999 2024-09-12T22:31:59.432 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.432 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.432 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:31:59.432 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410461+0000", 2024-09-12T22:31:59.432 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0042888609999999997 2024-09-12T22:31:59.432 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.432 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.432 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:31:59.432 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418371+0000", 2024-09-12T22:31:59.432 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0079098380000000006 2024-09-12T22:31:59.433 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.433 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.433 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:31:59.433 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418443+0000", 2024-09-12T22:31:59.433 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2705000000000003e-05 2024-09-12T22:31:59.433 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.433 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.433 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:31:59.433 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418493+0000", 2024-09-12T22:31:59.433 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9322e-05 2024-09-12T22:31:59.433 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:31:59.434 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:31:59.434 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:31:59.434 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.434 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.434 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:31:59.434 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.401939+0000", 2024-09-12T22:31:59.434 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 21.970617880999999, 2024-09-12T22:31:59.434 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016722292999999999, 2024-09-12T22:31:59.434 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:31:59.434 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:31:59.434 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:31:59.434 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:31:59.435 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.435 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:31:59.435 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401939+0000", 2024-09-12T22:31:59.435 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:31:59.435 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.435 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.435 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:31:59.435 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401939+0000", 2024-09-12T22:31:59.435 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:31:59.435 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.435 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.436 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:31:59.436 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401940+0000", 2024-09-12T22:31:59.436 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1990000000000001e-06 2024-09-12T22:31:59.436 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.436 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.436 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:31:59.436 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401956+0000", 2024-09-12T22:31:59.436 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.6344000000000001e-05 2024-09-12T22:31:59.436 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.436 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.436 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:31:59.437 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401974+0000", 2024-09-12T22:31:59.437 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7730000000000001e-05 2024-09-12T22:31:59.437 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.437 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.437 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:31:59.437 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401982+0000", 2024-09-12T22:31:59.437 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.7800000000000001e-06 2024-09-12T22:31:59.437 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.437 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.437 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:31:59.437 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406557+0000", 2024-09-12T22:31:59.437 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0045758489999999999 2024-09-12T22:31:59.438 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.438 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.438 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:31:59.438 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406697+0000", 2024-09-12T22:31:59.438 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013925100000000001 2024-09-12T22:31:59.438 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.438 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.438 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:31:59.438 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406830+0000", 2024-09-12T22:31:59.438 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013293499999999999 2024-09-12T22:31:59.438 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.439 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.439 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:31:59.439 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410465+0000", 2024-09-12T22:31:59.439 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0036352680000000001 2024-09-12T22:31:59.439 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.439 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.439 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:31:59.439 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418564+0000", 2024-09-12T22:31:59.439 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0080992140000000004 2024-09-12T22:31:59.439 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.439 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.440 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:31:59.440 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418621+0000", 2024-09-12T22:31:59.440 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7167999999999999e-05 2024-09-12T22:31:59.440 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.440 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.440 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:31:59.440 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418661+0000", 2024-09-12T22:31:59.440 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9555000000000003e-05 2024-09-12T22:31:59.440 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:31:59.440 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:31:59.440 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:31:59.440 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.441 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.441 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:31:59.441 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.401994+0000", 2024-09-12T22:31:59.441 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 21.970562008999998, 2024-09-12T22:31:59.441 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016804109000000001, 2024-09-12T22:31:59.441 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:31:59.441 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:31:59.441 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:31:59.441 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:31:59.441 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.441 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:31:59.442 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401994+0000", 2024-09-12T22:31:59.442 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:31:59.442 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.442 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.442 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:31:59.442 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401994+0000", 2024-09-12T22:31:59.442 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:31:59.442 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.442 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.442 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:31:59.442 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401995+0000", 2024-09-12T22:31:59.443 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.8899999999999998e-07 2024-09-12T22:31:59.443 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.443 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.443 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:31:59.443 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402000+0000", 2024-09-12T22:31:59.443 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.498e-06 2024-09-12T22:31:59.443 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.443 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.443 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:31:59.443 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402007+0000", 2024-09-12T22:31:59.443 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.554e-06 2024-09-12T22:31:59.444 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.444 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.444 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:31:59.444 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402046+0000", 2024-09-12T22:31:59.444 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9156000000000003e-05 2024-09-12T22:31:59.444 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.444 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.444 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:31:59.444 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407342+0000", 2024-09-12T22:31:59.444 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052957610000000004 2024-09-12T22:31:59.444 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.445 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.445 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:31:59.445 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407521+0000", 2024-09-12T22:31:59.445 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00017878100000000001 2024-09-12T22:31:59.445 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.445 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.445 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:31:59.445 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407641+0000", 2024-09-12T22:31:59.445 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012013 2024-09-12T22:31:59.445 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.445 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.446 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:31:59.446 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410472+0000", 2024-09-12T22:31:59.446 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.002830455 2024-09-12T22:31:59.446 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.446 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.446 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:31:59.446 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418714+0000", 2024-09-12T22:31:59.446 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0082422789999999999 2024-09-12T22:31:59.446 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.446 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.446 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:31:59.446 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418761+0000", 2024-09-12T22:31:59.447 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6956999999999998e-05 2024-09-12T22:31:59.447 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.447 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.447 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:31:59.447 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418799+0000", 2024-09-12T22:31:59.447 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7749000000000001e-05 2024-09-12T22:31:59.447 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:31:59.447 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:31:59.447 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:31:59.447 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.447 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.448 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:31:59.448 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.402060+0000", 2024-09-12T22:31:59.448 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 21.970496565000001, 2024-09-12T22:31:59.448 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016885686, 2024-09-12T22:31:59.448 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:31:59.448 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:31:59.448 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:31:59.448 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:31:59.448 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.448 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:31:59.448 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402060+0000", 2024-09-12T22:31:59.449 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:31:59.449 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.449 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.449 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:31:59.449 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402060+0000", 2024-09-12T22:31:59.449 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:31:59.449 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.449 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.449 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:31:59.449 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402061+0000", 2024-09-12T22:31:59.449 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4399999999999999e-07 2024-09-12T22:31:59.450 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.450 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.450 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:31:59.450 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402066+0000", 2024-09-12T22:31:59.450 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8649999999999998e-06 2024-09-12T22:31:59.450 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.450 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.450 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:31:59.450 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402146+0000", 2024-09-12T22:31:59.450 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9054000000000006e-05 2024-09-12T22:31:59.450 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.450 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.451 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:31:59.451 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402287+0000", 2024-09-12T22:31:59.451 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014108600000000001 2024-09-12T22:31:59.451 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.451 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.451 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:31:59.451 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408185+0000", 2024-09-12T22:31:59.451 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0058983919999999997 2024-09-12T22:31:59.451 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.451 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.451 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:31:59.451 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408299+0000", 2024-09-12T22:31:59.452 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114102 2024-09-12T22:31:59.452 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.452 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.452 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:31:59.452 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408420+0000", 2024-09-12T22:31:59.452 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000120492 2024-09-12T22:31:59.452 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.452 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.452 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:31:59.452 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410867+0000", 2024-09-12T22:31:59.452 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0024476430000000002 2024-09-12T22:31:59.452 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.453 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.453 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:31:59.453 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418851+0000", 2024-09-12T22:31:59.453 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0079841489999999994 2024-09-12T22:31:59.453 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.453 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.453 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:31:59.453 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418894+0000", 2024-09-12T22:31:59.453 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3090000000000002e-05 2024-09-12T22:31:59.453 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.453 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.454 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:31:59.454 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418946+0000", 2024-09-12T22:31:59.454 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1069000000000002e-05 2024-09-12T22:31:59.454 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:31:59.454 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:31:59.454 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:31:59.454 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.454 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.454 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:31:59.454 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.402375+0000", 2024-09-12T22:31:59.455 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 21.970181499999999, 2024-09-12T22:31:59.455 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016768531999999999, 2024-09-12T22:31:59.455 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:31:59.455 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:31:59.455 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:31:59.455 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:31:59.455 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.455 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:31:59.455 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402375+0000", 2024-09-12T22:31:59.455 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:31:59.455 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.456 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.456 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:31:59.456 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402375+0000", 2024-09-12T22:31:59.456 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:31:59.456 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.456 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.456 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:31:59.456 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402375+0000", 2024-09-12T22:31:59.456 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4099999999999999e-07 2024-09-12T22:31:59.456 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.456 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.456 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:31:59.457 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402379+0000", 2024-09-12T22:31:59.457 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9870000000000001e-06 2024-09-12T22:31:59.457 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.457 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.457 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:31:59.457 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402389+0000", 2024-09-12T22:31:59.457 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0000000000000001e-05 2024-09-12T22:31:59.457 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.457 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.457 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:31:59.457 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402401+0000", 2024-09-12T22:31:59.458 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.148e-05 2024-09-12T22:31:59.458 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.458 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.458 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:31:59.458 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409108+0000", 2024-09-12T22:31:59.458 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0067068429999999997 2024-09-12T22:31:59.458 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.458 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.458 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:31:59.458 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409189+0000", 2024-09-12T22:31:59.458 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0815999999999993e-05 2024-09-12T22:31:59.458 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.458 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.459 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:31:59.459 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409320+0000", 2024-09-12T22:31:59.459 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000131586 2024-09-12T22:31:59.459 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.459 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.459 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:31:59.459 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410872+0000", 2024-09-12T22:31:59.459 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0015521599999999999 2024-09-12T22:31:59.459 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.459 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.459 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:31:59.460 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419049+0000", 2024-09-12T22:31:59.460 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0081763719999999995 2024-09-12T22:31:59.460 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.460 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.460 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:31:59.460 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419107+0000", 2024-09-12T22:31:59.460 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7899000000000002e-05 2024-09-12T22:31:59.460 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.460 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.460 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:31:59.460 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419143+0000", 2024-09-12T22:31:59.461 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6847999999999997e-05 2024-09-12T22:31:59.461 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:31:59.461 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:31:59.461 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:31:59.461 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.461 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.461 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:31:59.461 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.402903+0000", 2024-09-12T22:31:59.461 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 21.969653088000001, 2024-09-12T22:31:59.461 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016378428, 2024-09-12T22:31:59.461 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:31:59.462 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:31:59.462 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:31:59.462 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:31:59.462 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.462 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:31:59.462 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402903+0000", 2024-09-12T22:31:59.462 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:31:59.462 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.462 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.462 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:31:59.462 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402903+0000", 2024-09-12T22:31:59.462 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:31:59.463 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.463 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.463 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:31:59.463 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402904+0000", 2024-09-12T22:31:59.463 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9500000000000001e-07 2024-09-12T22:31:59.463 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.463 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.463 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:31:59.463 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402944+0000", 2024-09-12T22:31:59.463 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0265000000000002e-05 2024-09-12T22:31:59.463 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.464 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.464 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:31:59.464 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402979+0000", 2024-09-12T22:31:59.464 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4378000000000002e-05 2024-09-12T22:31:59.464 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.464 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.464 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:31:59.464 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402987+0000", 2024-09-12T22:31:59.464 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3559999999999993e-06 2024-09-12T22:31:59.464 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.464 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.465 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:31:59.465 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409577+0000", 2024-09-12T22:31:59.465 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0065901709999999997 2024-09-12T22:31:59.465 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.465 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.465 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:31:59.465 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409653+0000", 2024-09-12T22:31:59.465 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5819e-05 2024-09-12T22:31:59.465 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.465 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.465 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:31:59.465 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409725+0000", 2024-09-12T22:31:59.466 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2200000000000007e-05 2024-09-12T22:31:59.466 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.466 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.466 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:31:59.466 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.411234+0000", 2024-09-12T22:31:59.466 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001508225 2024-09-12T22:31:59.466 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.466 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.466 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:31:59.466 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419212+0000", 2024-09-12T22:31:59.466 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0079783400000000004 2024-09-12T22:31:59.467 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.467 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.467 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:31:59.467 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419244+0000", 2024-09-12T22:31:59.467 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2384e-05 2024-09-12T22:31:59.467 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.467 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.467 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:31:59.467 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419282+0000", 2024-09-12T22:31:59.467 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7394999999999997e-05 2024-09-12T22:31:59.467 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:31:59.467 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:31:59.468 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:31:59.468 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.468 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.468 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:31:59.468 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.403135+0000", 2024-09-12T22:31:59.468 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 21.969421218000001, 2024-09-12T22:31:59.468 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016294211999999999, 2024-09-12T22:31:59.468 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:31:59.468 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:31:59.468 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:31:59.468 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:31:59.469 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.469 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:31:59.469 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403135+0000", 2024-09-12T22:31:59.469 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:31:59.469 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.469 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.469 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:31:59.469 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403135+0000", 2024-09-12T22:31:59.469 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:31:59.469 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.469 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.469 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:31:59.470 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403136+0000", 2024-09-12T22:31:59.470 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.4e-07 2024-09-12T22:31:59.470 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.470 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.470 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:31:59.470 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403149+0000", 2024-09-12T22:31:59.470 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2723e-05 2024-09-12T22:31:59.470 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.470 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.470 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:31:59.470 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403158+0000", 2024-09-12T22:31:59.471 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3919999999999992e-06 2024-09-12T22:31:59.471 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.471 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.471 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:31:59.471 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403166+0000", 2024-09-12T22:31:59.471 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.2309999999999996e-06 2024-09-12T22:31:59.471 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.471 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.471 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:31:59.471 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409944+0000", 2024-09-12T22:31:59.471 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0067775309999999998 2024-09-12T22:31:59.471 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.472 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.472 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:31:59.472 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410032+0000", 2024-09-12T22:31:59.472 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.7906999999999997e-05 2024-09-12T22:31:59.472 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.472 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.472 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:31:59.472 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410152+0000", 2024-09-12T22:31:59.472 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012037800000000001 2024-09-12T22:31:59.472 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.472 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.473 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:31:59.473 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.411945+0000", 2024-09-12T22:31:59.473 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0017931850000000001 2024-09-12T22:31:59.473 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.473 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.473 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:31:59.473 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419319+0000", 2024-09-12T22:31:59.473 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0073731780000000002 2024-09-12T22:31:59.473 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.473 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.473 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:31:59.473 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419376+0000", 2024-09-12T22:31:59.474 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7728e-05 2024-09-12T22:31:59.474 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.474 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.474 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:31:59.474 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419429+0000", 2024-09-12T22:31:59.474 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3019000000000002e-05 2024-09-12T22:31:59.474 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:31:59.474 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:31:59.474 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:31:59.474 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.474 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.475 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:31:59.475 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.403185+0000", 2024-09-12T22:31:59.475 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 21.969371336999998, 2024-09-12T22:31:59.475 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.014902164000000001, 2024-09-12T22:31:59.475 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:31:59.475 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:31:59.475 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:31:59.475 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:31:59.475 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.475 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:31:59.475 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403185+0000", 2024-09-12T22:31:59.476 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:31:59.476 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.476 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.476 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:31:59.476 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403185+0000", 2024-09-12T22:31:59.476 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:31:59.476 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.476 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.476 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:31:59.476 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403186+0000", 2024-09-12T22:31:59.477 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9400000000000005e-07 2024-09-12T22:31:59.477 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.477 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.477 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:31:59.477 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403191+0000", 2024-09-12T22:31:59.477 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6980000000000003e-06 2024-09-12T22:31:59.477 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.477 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.477 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:31:59.477 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403199+0000", 2024-09-12T22:31:59.477 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2520000000000002e-06 2024-09-12T22:31:59.477 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.478 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.478 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:31:59.478 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403205+0000", 2024-09-12T22:31:59.478 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.908e-06 2024-09-12T22:31:59.478 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.478 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.478 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:31:59.478 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403359+0000", 2024-09-12T22:31:59.478 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000154544 2024-09-12T22:31:59.478 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.478 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.479 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:31:59.479 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403528+0000", 2024-09-12T22:31:59.479 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000168455 2024-09-12T22:31:59.479 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.479 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.479 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:31:59.479 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403763+0000", 2024-09-12T22:31:59.479 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00023539599999999999 2024-09-12T22:31:59.479 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.479 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.480 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:31:59.480 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409378+0000", 2024-09-12T22:31:59.480 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056150000000000002 2024-09-12T22:31:59.480 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.480 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.480 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:31:59.480 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418012+0000", 2024-09-12T22:31:59.480 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0086339559999999999 2024-09-12T22:31:59.480 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.480 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.480 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:31:59.481 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418046+0000", 2024-09-12T22:31:59.481 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4267999999999998e-05 2024-09-12T22:31:59.481 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.481 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.481 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:31:59.481 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418087+0000", 2024-09-12T22:31:59.481 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0992999999999999e-05 2024-09-12T22:31:59.481 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:31:59.481 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:31:59.481 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:31:59.481 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.482 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.482 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:31:59.482 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.403273+0000", 2024-09-12T22:31:59.482 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 21.969283386000001, 2024-09-12T22:31:59.482 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.014934866, 2024-09-12T22:31:59.482 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:31:59.482 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:31:59.482 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:31:59.482 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:31:59.482 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.482 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:31:59.483 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403273+0000", 2024-09-12T22:31:59.483 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:31:59.483 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.483 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.483 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:31:59.483 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403273+0000", 2024-09-12T22:31:59.483 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:31:59.483 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.483 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.483 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:31:59.483 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403274+0000", 2024-09-12T22:31:59.483 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.297e-06 2024-09-12T22:31:59.484 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.484 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.484 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:31:59.484 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403282+0000", 2024-09-12T22:31:59.484 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6340000000000001e-06 2024-09-12T22:31:59.484 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.484 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.484 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:31:59.484 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403305+0000", 2024-09-12T22:31:59.484 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3149000000000001e-05 2024-09-12T22:31:59.484 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.485 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.485 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:31:59.485 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403320+0000", 2024-09-12T22:31:59.485 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4527e-05 2024-09-12T22:31:59.485 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.485 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.485 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:31:59.485 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.404928+0000", 2024-09-12T22:31:59.485 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001608459 2024-09-12T22:31:59.485 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.485 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.486 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:31:59.486 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405218+0000", 2024-09-12T22:31:59.486 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00028982900000000002 2024-09-12T22:31:59.486 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.486 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.486 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:31:59.486 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405829+0000", 2024-09-12T22:31:59.486 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00061127900000000005 2024-09-12T22:31:59.486 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.486 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.486 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:31:59.486 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409403+0000", 2024-09-12T22:31:59.487 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.003573597 2024-09-12T22:31:59.487 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.487 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.487 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:31:59.487 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418138+0000", 2024-09-12T22:31:59.487 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0087349969999999996 2024-09-12T22:31:59.487 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.487 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.487 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:31:59.487 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418178+0000", 2024-09-12T22:31:59.487 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0649999999999999e-05 2024-09-12T22:31:59.487 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.488 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.488 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:31:59.488 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418208+0000", 2024-09-12T22:31:59.488 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9448e-05 2024-09-12T22:31:59.488 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:31:59.488 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:31:59.488 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:31:59.488 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.488 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.488 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:31:59.488 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.405456+0000", 2024-09-12T22:31:59.489 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 21.967100241000001, 2024-09-12T22:31:59.489 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012888389, 2024-09-12T22:31:59.489 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:31:59.489 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:31:59.489 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:31:59.489 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:31:59.489 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.489 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:31:59.489 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405456+0000", 2024-09-12T22:31:59.489 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:31:59.489 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.490 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.490 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:31:59.490 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405456+0000", 2024-09-12T22:31:59.490 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:31:59.490 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.490 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.490 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:31:59.490 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405457+0000", 2024-09-12T22:31:59.490 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.6599999999999994e-07 2024-09-12T22:31:59.490 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.490 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.491 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:31:59.491 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405463+0000", 2024-09-12T22:31:59.491 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4739999999999996e-06 2024-09-12T22:31:59.491 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.491 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.491 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:31:59.491 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405474+0000", 2024-09-12T22:31:59.491 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1095e-05 2024-09-12T22:31:59.491 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.491 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.491 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:31:59.492 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405482+0000", 2024-09-12T22:31:59.492 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3610000000000001e-06 2024-09-12T22:31:59.492 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.492 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.492 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:31:59.492 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407051+0000", 2024-09-12T22:31:59.492 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0015688970000000001 2024-09-12T22:31:59.492 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.492 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.492 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:31:59.492 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407259+0000", 2024-09-12T22:31:59.492 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00020778300000000001 2024-09-12T22:31:59.493 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.493 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.493 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:31:59.493 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407622+0000", 2024-09-12T22:31:59.493 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000363066 2024-09-12T22:31:59.493 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.493 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.493 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:31:59.493 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409438+0000", 2024-09-12T22:31:59.493 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001816319 2024-09-12T22:31:59.493 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.493 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.494 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:31:59.494 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418257+0000", 2024-09-12T22:31:59.494 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0088187720000000008 2024-09-12T22:31:59.494 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.494 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.494 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:31:59.494 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418308+0000", 2024-09-12T22:31:59.494 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1180000000000001e-05 2024-09-12T22:31:59.494 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.494 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.494 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:31:59.494 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418345+0000", 2024-09-12T22:31:59.495 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6476000000000001e-05 2024-09-12T22:31:59.495 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:31:59.495 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:31:59.495 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:31:59.495 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.495 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.495 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:31:59.495 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.405496+0000", 2024-09-12T22:31:59.495 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 21.967060883999999, 2024-09-12T22:31:59.495 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013016012, 2024-09-12T22:31:59.495 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:31:59.495 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:31:59.496 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:31:59.496 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:31:59.496 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.496 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:31:59.496 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405496+0000", 2024-09-12T22:31:59.496 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:31:59.496 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.496 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.496 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:31:59.496 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405496+0000", 2024-09-12T22:31:59.496 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:31:59.496 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.497 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.497 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:31:59.497 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405496+0000", 2024-09-12T22:31:59.497 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7999999999999995e-07 2024-09-12T22:31:59.497 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.497 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.497 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:31:59.497 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405501+0000", 2024-09-12T22:31:59.497 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8359999999999999e-06 2024-09-12T22:31:59.497 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.497 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.497 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:31:59.498 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405514+0000", 2024-09-12T22:31:59.498 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2522e-05 2024-09-12T22:31:59.498 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.498 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.498 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:31:59.498 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405521+0000", 2024-09-12T22:31:59.498 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5020000000000003e-06 2024-09-12T22:31:59.498 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.498 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.498 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:31:59.499 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405575+0000", 2024-09-12T22:31:59.499 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4169999999999998e-05 2024-09-12T22:31:59.499 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.499 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.499 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:31:59.499 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405697+0000", 2024-09-12T22:31:59.499 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000121301 2024-09-12T22:31:59.499 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.499 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.499 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:31:59.499 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405829+0000", 2024-09-12T22:31:59.500 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000132662 2024-09-12T22:31:59.500 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.500 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.500 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:31:59.500 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409155+0000", 2024-09-12T22:31:59.500 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0033259050000000001 2024-09-12T22:31:59.500 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.500 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.500 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:31:59.500 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418425+0000", 2024-09-12T22:31:59.500 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0092696319999999999 2024-09-12T22:31:59.501 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.501 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.501 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:31:59.501 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418471+0000", 2024-09-12T22:31:59.501 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6213e-05 2024-09-12T22:31:59.501 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.501 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.501 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:31:59.501 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418512+0000", 2024-09-12T22:31:59.501 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0589000000000001e-05 2024-09-12T22:31:59.501 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:31:59.502 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:31:59.502 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:31:59.502 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.502 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.502 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:31:59.502 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.406108+0000", 2024-09-12T22:31:59.502 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 21.966448487000001, 2024-09-12T22:31:59.502 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012458175, 2024-09-12T22:31:59.502 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:31:59.502 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:31:59.502 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:31:59.503 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:31:59.503 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.503 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:31:59.503 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406108+0000", 2024-09-12T22:31:59.503 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:31:59.503 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.503 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.503 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:31:59.503 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406108+0000", 2024-09-12T22:31:59.503 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:31:59.503 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.503 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.503 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:31:59.504 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406109+0000", 2024-09-12T22:31:59.504 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9899999999999999e-07 2024-09-12T22:31:59.504 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.504 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.504 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:31:59.504 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406115+0000", 2024-09-12T22:31:59.504 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9030000000000001e-06 2024-09-12T22:31:59.504 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.504 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.504 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:31:59.504 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406141+0000", 2024-09-12T22:31:59.504 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5999e-05 2024-09-12T22:31:59.504 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.505 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.505 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:31:59.505 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406150+0000", 2024-09-12T22:31:59.505 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.6050000000000004e-06 2024-09-12T22:31:59.505 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.505 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.505 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:31:59.505 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408163+0000", 2024-09-12T22:31:59.505 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0020122769999999998 2024-09-12T22:31:59.505 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.505 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.505 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:31:59.506 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408309+0000", 2024-09-12T22:31:59.506 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014606999999999999 2024-09-12T22:31:59.506 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.506 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.506 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:31:59.506 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408433+0000", 2024-09-12T22:31:59.506 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012460300000000001 2024-09-12T22:31:59.506 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.506 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.506 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:31:59.506 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409903+0000", 2024-09-12T22:31:59.507 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001469499 2024-09-12T22:31:59.507 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.507 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.507 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:31:59.507 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418427+0000", 2024-09-12T22:31:59.507 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0085241139999999993 2024-09-12T22:31:59.507 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.507 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.507 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:31:59.507 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418471+0000", 2024-09-12T22:31:59.507 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4474000000000001e-05 2024-09-12T22:31:59.508 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.508 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.508 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:31:59.508 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418566+0000", 2024-09-12T22:31:59.508 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.4732e-05 2024-09-12T22:31:59.508 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:31:59.508 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:31:59.508 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:31:59.508 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.508 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.508 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:31:59.509 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.407266+0000", 2024-09-12T22:31:59.509 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 21.965290630999998, 2024-09-12T22:31:59.509 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011442905, 2024-09-12T22:31:59.509 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:31:59.509 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:31:59.509 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2024-09-12T22:31:59.509 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:31:59.509 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.509 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:31:59.509 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407266+0000", 2024-09-12T22:31:59.509 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:31:59.510 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.510 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.510 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:31:59.510 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407266+0000", 2024-09-12T22:31:59.510 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:31:59.510 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.510 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.510 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:31:59.510 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407266+0000", 2024-09-12T22:31:59.510 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7899999999999998e-07 2024-09-12T22:31:59.510 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.511 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.511 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:31:59.511 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407269+0000", 2024-09-12T22:31:59.511 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9210000000000001e-06 2024-09-12T22:31:59.511 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.511 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.511 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:31:59.511 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407331+0000", 2024-09-12T22:31:59.511 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1376000000000003e-05 2024-09-12T22:31:59.511 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.511 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.512 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:31:59.512 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407337+0000", 2024-09-12T22:31:59.512 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1929999999999998e-06 2024-09-12T22:31:59.512 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.512 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.512 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:31:59.512 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408974+0000", 2024-09-12T22:31:59.512 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0016367109999999999 2024-09-12T22:31:59.512 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.512 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.512 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:31:59.512 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409112+0000", 2024-09-12T22:31:59.513 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000137952 2024-09-12T22:31:59.513 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:31:59.513 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:31:59.513 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:31:59.513 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418709+0000", 2024-09-12T22:31:59.513 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0095971730000000005 2024-09-12T22:31:59.513 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:31:59.513 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:31:59.513 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:31:59.513 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:31:59.513 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:31:59.514 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-09-12T22:31:59.515 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:31:59.514+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:31:59.516 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:31:59.616 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:31:59.615+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:31:59.634 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-09-12T22:31:59.634 INFO:teuthology.orchestra.run.smithi076.stdout: "ops": [], 2024-09-12T22:31:59.635 INFO:teuthology.orchestra.run.smithi076.stdout: "num_ops": 0 2024-09-12T22:31:59.635 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-09-12T22:31:59.644 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:31:59.717 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:31:59.715+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:31:59.748 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-09-12T22:31:59.749 INFO:teuthology.orchestra.run.smithi076.stdout: "ops": [], 2024-09-12T22:31:59.749 INFO:teuthology.orchestra.run.smithi076.stdout: "complaint_time": 30, 2024-09-12T22:31:59.749 INFO:teuthology.orchestra.run.smithi076.stdout: "num_blocked_ops": 0 2024-09-12T22:31:59.749 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-09-12T22:31:59.757 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:31:59.818 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:31:59.817+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:31:59.861 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-09-12T22:31:59.861 INFO:teuthology.orchestra.run.smithi076.stdout: "size": 20, 2024-09-12T22:31:59.861 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 600, 2024-09-12T22:31:59.861 INFO:teuthology.orchestra.run.smithi076.stdout: "ops": [ 2024-09-12T22:31:59.861 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.861 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:31:59.861 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.400604+0000", 2024-09-12T22:31:59.862 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 22.458474657, 2024-09-12T22:31:59.862 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.017278814, 2024-09-12T22:31:59.862 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:31:59.862 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:31:59.862 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:31:59.862 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:31:59.862 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.862 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:31:59.862 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400604+0000", 2024-09-12T22:31:59.862 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:31:59.863 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.863 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.863 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:31:59.863 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400604+0000", 2024-09-12T22:31:59.863 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:31:59.863 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.863 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.863 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:31:59.863 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400617+0000", 2024-09-12T22:31:59.863 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.3076e-05 2024-09-12T22:31:59.863 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.863 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.864 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:31:59.864 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400623+0000", 2024-09-12T22:31:59.864 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.5780000000000004e-06 2024-09-12T22:31:59.864 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.864 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.864 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:31:59.864 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400641+0000", 2024-09-12T22:31:59.864 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.8218000000000001e-05 2024-09-12T22:31:59.864 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.865 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.865 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:31:59.865 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400652+0000", 2024-09-12T22:31:59.865 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.0421999999999999e-05 2024-09-12T22:31:59.865 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.865 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.865 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:31:59.865 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400707+0000", 2024-09-12T22:31:59.865 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.4666000000000001e-05 2024-09-12T22:31:59.865 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.865 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.865 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op must wait for map", 2024-09-12T22:31:59.865 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400711+0000", 2024-09-12T22:31:59.866 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.5340000000000001e-06 2024-09-12T22:31:59.866 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.866 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.866 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:31:59.866 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.412066+0000", 2024-09-12T22:31:59.866 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.011354797999999999 2024-09-12T22:31:59.866 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.866 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.866 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:31:59.866 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.412672+0000", 2024-09-12T22:31:59.866 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00060620499999999996 2024-09-12T22:31:59.866 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.866 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.866 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting for subops from 2", 2024-09-12T22:31:59.867 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.413032+0000", 2024-09-12T22:31:59.867 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00035955999999999998 2024-09-12T22:31:59.867 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.867 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.867 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op_commit", 2024-09-12T22:31:59.867 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417252+0000", 2024-09-12T22:31:59.867 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.004219899 2024-09-12T22:31:59.867 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.867 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.867 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:31:59.867 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417812+0000", 2024-09-12T22:31:59.867 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.000560182 2024-09-12T22:31:59.867 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.868 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.868 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:31:59.868 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417851+0000", 2024-09-12T22:31:59.868 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.9057999999999998e-05 2024-09-12T22:31:59.868 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.868 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.868 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:31:59.868 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417882+0000", 2024-09-12T22:31:59.868 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.1618000000000001e-05 2024-09-12T22:31:59.868 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:31:59.868 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:31:59.868 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:31:59.868 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.869 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.869 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:31:59.869 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.400674+0000", 2024-09-12T22:31:59.869 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 22.458403939, 2024-09-12T22:31:59.869 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.017348971000000001, 2024-09-12T22:31:59.869 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:31:59.869 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:31:59.869 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:31:59.869 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:31:59.869 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.869 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:31:59.869 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400674+0000", 2024-09-12T22:31:59.869 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:31:59.870 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.870 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.870 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:31:59.870 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400674+0000", 2024-09-12T22:31:59.870 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:31:59.870 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.870 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.870 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:31:59.870 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400675+0000", 2024-09-12T22:31:59.870 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.37e-07 2024-09-12T22:31:59.870 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.870 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.870 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:31:59.871 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400678+0000", 2024-09-12T22:31:59.871 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.303e-06 2024-09-12T22:31:59.871 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.871 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.871 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:31:59.871 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400684+0000", 2024-09-12T22:31:59.871 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.0290000000000002e-06 2024-09-12T22:31:59.871 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.871 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.871 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:31:59.871 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400688+0000", 2024-09-12T22:31:59.871 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.0890000000000002e-06 2024-09-12T22:31:59.871 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.871 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.872 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:31:59.872 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400806+0000", 2024-09-12T22:31:59.872 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00011814700000000001 2024-09-12T22:31:59.872 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.872 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.872 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:31:59.872 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400811+0000", 2024-09-12T22:31:59.872 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.0479999999999998e-06 2024-09-12T22:31:59.872 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.872 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.872 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:31:59.872 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.413877+0000", 2024-09-12T22:31:59.872 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.013065561 2024-09-12T22:31:59.873 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.873 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.873 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:31:59.873 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.413984+0000", 2024-09-12T22:31:59.873 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.000106566 2024-09-12T22:31:59.873 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.873 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.873 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting for subops from 2", 2024-09-12T22:31:59.873 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.414264+0000", 2024-09-12T22:31:59.873 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00028067199999999999 2024-09-12T22:31:59.873 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.873 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.873 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op_commit", 2024-09-12T22:31:59.873 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417614+0000", 2024-09-12T22:31:59.874 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0033500729999999999 2024-09-12T22:31:59.874 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.874 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.874 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:31:59.874 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417946+0000", 2024-09-12T22:31:59.874 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00033209199999999998 2024-09-12T22:31:59.874 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.874 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.874 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:31:59.874 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417995+0000", 2024-09-12T22:31:59.874 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.808e-05 2024-09-12T22:31:59.874 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.874 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.875 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:31:59.875 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.418023+0000", 2024-09-12T22:31:59.875 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.8773999999999999e-05 2024-09-12T22:31:59.875 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:31:59.875 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:31:59.875 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:31:59.875 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.875 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.875 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:31:59.875 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.400694+0000", 2024-09-12T22:31:59.875 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 22.45838431, 2024-09-12T22:31:59.875 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.022845628, 2024-09-12T22:31:59.875 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:31:59.876 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:31:59.876 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:31:59.876 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:31:59.876 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.876 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:31:59.876 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400694+0000", 2024-09-12T22:31:59.876 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:31:59.876 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.876 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.876 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:31:59.876 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400694+0000", 2024-09-12T22:31:59.876 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:31:59.877 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.877 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.877 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:31:59.877 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400694+0000", 2024-09-12T22:31:59.877 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.48e-07 2024-09-12T22:31:59.877 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.877 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.877 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:31:59.877 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400709+0000", 2024-09-12T22:31:59.877 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.4888999999999999e-05 2024-09-12T22:31:59.877 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.877 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.877 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:31:59.878 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400722+0000", 2024-09-12T22:31:59.878 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.2882e-05 2024-09-12T22:31:59.878 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.878 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.878 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:31:59.878 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400732+0000", 2024-09-12T22:31:59.878 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.0299000000000001e-05 2024-09-12T22:31:59.878 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.878 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.878 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:31:59.878 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400793+0000", 2024-09-12T22:31:59.878 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.0253000000000001e-05 2024-09-12T22:31:59.878 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.879 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.879 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op must wait for map", 2024-09-12T22:31:59.879 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400798+0000", 2024-09-12T22:31:59.879 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.1569999999999999e-06 2024-09-12T22:31:59.879 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.879 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.879 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:31:59.879 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415059+0000", 2024-09-12T22:31:59.879 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.014260907 2024-09-12T22:31:59.879 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.879 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.879 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:31:59.879 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415396+0000", 2024-09-12T22:31:59.880 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00033720799999999997 2024-09-12T22:31:59.880 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.880 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.880 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting for subops from 2", 2024-09-12T22:31:59.880 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415685+0000", 2024-09-12T22:31:59.880 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00028939900000000003 2024-09-12T22:31:59.880 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.880 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.880 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op_commit", 2024-09-12T22:31:59.880 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.418302+0000", 2024-09-12T22:31:59.880 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0026168039999999999 2024-09-12T22:31:59.880 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.881 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.881 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:31:59.881 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.423445+0000", 2024-09-12T22:31:59.881 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0051428150000000002 2024-09-12T22:31:59.881 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.881 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.881 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:31:59.881 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.423499+0000", 2024-09-12T22:31:59.881 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.3953000000000003e-05 2024-09-12T22:31:59.881 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.881 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.881 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:31:59.881 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.423540+0000", 2024-09-12T22:31:59.881 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.0813999999999999e-05 2024-09-12T22:31:59.882 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:31:59.882 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:31:59.882 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:31:59.882 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.882 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.882 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:31:59.882 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.400740+0000", 2024-09-12T22:31:59.882 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 22.458338587, 2024-09-12T22:31:59.882 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.022927528999999999, 2024-09-12T22:31:59.882 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:31:59.882 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:31:59.882 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:31:59.882 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:31:59.883 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.883 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:31:59.883 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400740+0000", 2024-09-12T22:31:59.883 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:31:59.883 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.883 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.883 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:31:59.883 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400740+0000", 2024-09-12T22:31:59.883 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:31:59.883 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.883 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.883 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:31:59.883 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400740+0000", 2024-09-12T22:31:59.884 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.3000000000000001e-07 2024-09-12T22:31:59.884 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.884 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.884 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:31:59.884 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400743+0000", 2024-09-12T22:31:59.884 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.5840000000000002e-06 2024-09-12T22:31:59.884 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.884 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.884 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:31:59.884 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400757+0000", 2024-09-12T22:31:59.884 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.3988999999999999e-05 2024-09-12T22:31:59.884 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.884 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.885 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:31:59.885 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400763+0000", 2024-09-12T22:31:59.885 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.686e-06 2024-09-12T22:31:59.885 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.885 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.885 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:31:59.885 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400818+0000", 2024-09-12T22:31:59.885 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.4941000000000001e-05 2024-09-12T22:31:59.885 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.885 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.885 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:31:59.885 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400824+0000", 2024-09-12T22:31:59.885 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.4600000000000002e-06 2024-09-12T22:31:59.886 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.886 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.886 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:31:59.886 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416227+0000", 2024-09-12T22:31:59.886 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.015403604 2024-09-12T22:31:59.886 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.886 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.886 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:31:59.886 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416306+0000", 2024-09-12T22:31:59.886 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 7.9126000000000001e-05 2024-09-12T22:31:59.886 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.886 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.886 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting for subops from 2", 2024-09-12T22:31:59.886 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416678+0000", 2024-09-12T22:31:59.887 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00037105500000000002 2024-09-12T22:31:59.887 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.887 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.887 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op_commit", 2024-09-12T22:31:59.887 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.418363+0000", 2024-09-12T22:31:59.887 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.001685095 2024-09-12T22:31:59.887 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.887 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.887 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:31:59.887 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.423591+0000", 2024-09-12T22:31:59.887 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0052283980000000004 2024-09-12T22:31:59.887 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.887 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.887 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:31:59.888 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.423624+0000", 2024-09-12T22:31:59.888 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.3024000000000001e-05 2024-09-12T22:31:59.888 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.888 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.888 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:31:59.888 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.423667+0000", 2024-09-12T22:31:59.888 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.3136999999999997e-05 2024-09-12T22:31:59.888 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:31:59.888 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:31:59.888 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:31:59.888 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.888 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.888 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:31:59.888 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.400783+0000", 2024-09-12T22:31:59.889 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 22.458295055000001, 2024-09-12T22:31:59.889 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.016563729999999999, 2024-09-12T22:31:59.889 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:31:59.889 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:31:59.889 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:31:59.889 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:31:59.889 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.889 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:31:59.889 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400783+0000", 2024-09-12T22:31:59.889 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:31:59.889 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.889 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.889 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:31:59.890 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400783+0000", 2024-09-12T22:31:59.890 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:31:59.890 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.890 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.890 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:31:59.890 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400784+0000", 2024-09-12T22:31:59.890 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.5900000000000002e-07 2024-09-12T22:31:59.890 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.890 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.890 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:31:59.890 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400787+0000", 2024-09-12T22:31:59.890 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.1690000000000001e-06 2024-09-12T22:31:59.890 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.890 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.891 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:31:59.891 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400794+0000", 2024-09-12T22:31:59.891 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 7.058e-06 2024-09-12T22:31:59.891 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.891 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.891 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:31:59.891 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400798+0000", 2024-09-12T22:31:59.891 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.335e-06 2024-09-12T22:31:59.891 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.891 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.891 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:31:59.891 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400841+0000", 2024-09-12T22:31:59.891 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.2369e-05 2024-09-12T22:31:59.892 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.892 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.892 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op must wait for map", 2024-09-12T22:31:59.892 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400844+0000", 2024-09-12T22:31:59.892 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.128e-06 2024-09-12T22:31:59.892 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.892 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.892 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:31:59.892 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.410479+0000", 2024-09-12T22:31:59.892 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0096354189999999992 2024-09-12T22:31:59.892 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.892 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.893 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:31:59.893 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.410597+0000", 2024-09-12T22:31:59.893 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.000118305 2024-09-12T22:31:59.893 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.893 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.893 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting for subops from 2", 2024-09-12T22:31:59.893 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.410838+0000", 2024-09-12T22:31:59.893 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.000240967 2024-09-12T22:31:59.893 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.893 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.893 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op_commit", 2024-09-12T22:31:59.893 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416489+0000", 2024-09-12T22:31:59.893 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0056507989999999998 2024-09-12T22:31:59.893 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.894 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.894 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:31:59.894 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417255+0000", 2024-09-12T22:31:59.894 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00076626199999999998 2024-09-12T22:31:59.894 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.894 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.894 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:31:59.894 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417306+0000", 2024-09-12T22:31:59.894 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.0319999999999999e-05 2024-09-12T22:31:59.894 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.894 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.894 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:31:59.894 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417347+0000", 2024-09-12T22:31:59.895 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.1140000000000003e-05 2024-09-12T22:31:59.895 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:31:59.895 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:31:59.895 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:31:59.895 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.895 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.895 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:31:59.895 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.400811+0000", 2024-09-12T22:31:59.895 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 22.458266986000002, 2024-09-12T22:31:59.895 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.017061263, 2024-09-12T22:31:59.895 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:31:59.895 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:31:59.895 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:31:59.896 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:31:59.896 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.896 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:31:59.896 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400811+0000", 2024-09-12T22:31:59.896 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:31:59.896 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.896 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.896 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:31:59.896 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400811+0000", 2024-09-12T22:31:59.896 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:31:59.896 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.896 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.896 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:31:59.897 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400812+0000", 2024-09-12T22:31:59.897 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.27e-07 2024-09-12T22:31:59.897 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.897 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.897 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:31:59.897 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400814+0000", 2024-09-12T22:31:59.897 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.553e-06 2024-09-12T22:31:59.897 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.897 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.897 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:31:59.897 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400819+0000", 2024-09-12T22:31:59.897 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.3569999999999997e-06 2024-09-12T22:31:59.897 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.897 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.898 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:31:59.898 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400824+0000", 2024-09-12T22:31:59.898 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.6820000000000002e-06 2024-09-12T22:31:59.898 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.898 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.898 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:31:59.898 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400871+0000", 2024-09-12T22:31:59.898 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.7311000000000002e-05 2024-09-12T22:31:59.898 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.898 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.898 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:31:59.898 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400875+0000", 2024-09-12T22:31:59.898 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.0960000000000001e-06 2024-09-12T22:31:59.899 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.899 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.899 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:31:59.899 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.412071+0000", 2024-09-12T22:31:59.899 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.011195999999999999 2024-09-12T22:31:59.899 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.899 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.899 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:31:59.899 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.412520+0000", 2024-09-12T22:31:59.899 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.000449522 2024-09-12T22:31:59.899 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.899 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.899 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting for subops from 2", 2024-09-12T22:31:59.900 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.412655+0000", 2024-09-12T22:31:59.900 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00013487899999999999 2024-09-12T22:31:59.900 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.900 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.900 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op_commit", 2024-09-12T22:31:59.900 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417096+0000", 2024-09-12T22:31:59.900 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.004441113 2024-09-12T22:31:59.900 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.900 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.900 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:31:59.900 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417768+0000", 2024-09-12T22:31:59.900 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00067161100000000002 2024-09-12T22:31:59.900 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.901 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.901 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:31:59.901 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417834+0000", 2024-09-12T22:31:59.901 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.6058999999999999e-05 2024-09-12T22:31:59.901 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.901 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.901 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:31:59.901 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417873+0000", 2024-09-12T22:31:59.901 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.8753e-05 2024-09-12T22:31:59.901 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:31:59.901 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:31:59.901 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:31:59.901 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.902 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.902 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:31:59.902 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.400842+0000", 2024-09-12T22:31:59.902 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 22.458236279000001, 2024-09-12T22:31:59.902 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.022846262999999999, 2024-09-12T22:31:59.902 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:31:59.902 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:31:59.902 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:31:59.902 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:31:59.902 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.902 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:31:59.902 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400842+0000", 2024-09-12T22:31:59.902 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:31:59.903 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.903 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.903 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:31:59.903 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400842+0000", 2024-09-12T22:31:59.903 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:31:59.903 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.903 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.903 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:31:59.903 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400842+0000", 2024-09-12T22:31:59.903 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.9900000000000002e-07 2024-09-12T22:31:59.903 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.903 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.903 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:31:59.903 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400845+0000", 2024-09-12T22:31:59.904 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.8609999999999998e-06 2024-09-12T22:31:59.904 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.904 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.904 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:31:59.904 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400850+0000", 2024-09-12T22:31:59.904 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.634e-06 2024-09-12T22:31:59.904 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.904 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.904 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:31:59.904 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400855+0000", 2024-09-12T22:31:59.904 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.8339999999999998e-06 2024-09-12T22:31:59.904 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.905 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.905 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:31:59.905 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400886+0000", 2024-09-12T22:31:59.905 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.1393999999999998e-05 2024-09-12T22:31:59.905 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.905 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.905 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:31:59.905 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400888+0000", 2024-09-12T22:31:59.905 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.3470000000000001e-06 2024-09-12T22:31:59.905 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.905 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.905 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:31:59.906 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415640+0000", 2024-09-12T22:31:59.906 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.014751965000000001 2024-09-12T22:31:59.906 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.906 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.906 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:31:59.906 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415821+0000", 2024-09-12T22:31:59.906 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00018064399999999999 2024-09-12T22:31:59.906 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.906 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.906 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting for subops from 2", 2024-09-12T22:31:59.906 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415949+0000", 2024-09-12T22:31:59.906 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00012816699999999999 2024-09-12T22:31:59.906 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.907 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.907 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op_commit", 2024-09-12T22:31:59.907 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.418337+0000", 2024-09-12T22:31:59.907 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0023878469999999998 2024-09-12T22:31:59.907 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.907 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.907 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:31:59.907 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.423588+0000", 2024-09-12T22:31:59.907 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0052509849999999997 2024-09-12T22:31:59.907 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.907 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.907 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:31:59.907 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.423650+0000", 2024-09-12T22:31:59.907 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.2026999999999994e-05 2024-09-12T22:31:59.908 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.908 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.908 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:31:59.908 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.423688+0000", 2024-09-12T22:31:59.908 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.8259000000000001e-05 2024-09-12T22:31:59.908 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:31:59.908 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:31:59.908 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:31:59.908 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.908 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.908 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:31:59.908 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.400862+0000", 2024-09-12T22:31:59.908 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 22.458216305000001, 2024-09-12T22:31:59.909 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.016404294, 2024-09-12T22:31:59.909 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:31:59.909 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:31:59.909 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "started", 2024-09-12T22:31:59.909 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:31:59.909 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.909 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:31:59.909 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400862+0000", 2024-09-12T22:31:59.909 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:31:59.909 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.909 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.909 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:31:59.909 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400862+0000", 2024-09-12T22:31:59.910 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:31:59.910 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.910 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.910 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:31:59.910 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400862+0000", 2024-09-12T22:31:59.910 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.8099999999999999e-07 2024-09-12T22:31:59.910 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.910 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.910 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:31:59.910 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400870+0000", 2024-09-12T22:31:59.910 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 8.1349999999999992e-06 2024-09-12T22:31:59.910 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.910 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.910 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:31:59.911 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400876+0000", 2024-09-12T22:31:59.911 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.2039999999999996e-06 2024-09-12T22:31:59.911 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.911 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.911 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:31:59.911 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400879+0000", 2024-09-12T22:31:59.911 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.529e-06 2024-09-12T22:31:59.911 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.911 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.911 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:31:59.911 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400912+0000", 2024-09-12T22:31:59.911 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.2653000000000001e-05 2024-09-12T22:31:59.911 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.911 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.912 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op must wait for map", 2024-09-12T22:31:59.912 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400915+0000", 2024-09-12T22:31:59.912 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.1099999999999999e-06 2024-09-12T22:31:59.912 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.912 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.912 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:31:59.912 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408727+0000", 2024-09-12T22:31:59.912 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0078123869999999996 2024-09-12T22:31:59.912 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.912 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.912 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:31:59.912 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408838+0000", 2024-09-12T22:31:59.913 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00011042700000000001 2024-09-12T22:31:59.913 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.913 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.913 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:31:59.913 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417266+0000", 2024-09-12T22:31:59.913 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0084285680000000009 2024-09-12T22:31:59.913 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:31:59.913 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:31:59.913 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:31:59.913 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.913 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.913 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:31:59.913 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.400889+0000", 2024-09-12T22:31:59.914 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 22.458189052000002, 2024-09-12T22:31:59.914 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.014929550999999999, 2024-09-12T22:31:59.914 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:31:59.914 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:31:59.914 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "started", 2024-09-12T22:31:59.914 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:31:59.914 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.914 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:31:59.914 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400889+0000", 2024-09-12T22:31:59.914 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:31:59.914 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.914 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.914 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:31:59.914 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400889+0000", 2024-09-12T22:31:59.915 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:31:59.915 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.915 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.915 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:31:59.915 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400890+0000", 2024-09-12T22:31:59.915 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.8699999999999995e-07 2024-09-12T22:31:59.915 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.915 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.915 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:31:59.915 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400893+0000", 2024-09-12T22:31:59.915 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.9569999999999998e-06 2024-09-12T22:31:59.915 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.915 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.916 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:31:59.916 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400899+0000", 2024-09-12T22:31:59.916 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.4189999999999999e-06 2024-09-12T22:31:59.916 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.916 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.916 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:31:59.916 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400905+0000", 2024-09-12T22:31:59.916 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.7880000000000003e-06 2024-09-12T22:31:59.916 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.916 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.916 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:31:59.916 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400943+0000", 2024-09-12T22:31:59.916 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.7852999999999998e-05 2024-09-12T22:31:59.917 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.917 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.917 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op must wait for map", 2024-09-12T22:31:59.917 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400945+0000", 2024-09-12T22:31:59.917 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.627e-06 2024-09-12T22:31:59.917 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.917 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.917 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:31:59.917 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408398+0000", 2024-09-12T22:31:59.917 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0074525879999999996 2024-09-12T22:31:59.917 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.917 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.917 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:31:59.917 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408581+0000", 2024-09-12T22:31:59.918 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00018321900000000001 2024-09-12T22:31:59.918 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.918 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.918 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:31:59.918 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415819+0000", 2024-09-12T22:31:59.918 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0072376130000000004 2024-09-12T22:31:59.918 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:31:59.918 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:31:59.918 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:31:59.918 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.918 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.918 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:25 3.7 e19/17 3:e0b41d06:::609.00000000:head v 19'2, mlcod=0'0)", 2024-09-12T22:31:59.918 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.402511+0000", 2024-09-12T22:31:59.918 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 22.456566908999999, 2024-09-12T22:31:59.919 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0089735260000000008, 2024-09-12T22:31:59.919 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:31:59.919 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:31:59.919 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:31:59.919 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:31:59.919 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.919 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:31:59.919 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.402511+0000", 2024-09-12T22:31:59.919 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:31:59.919 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.919 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.919 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:31:59.919 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.402511+0000", 2024-09-12T22:31:59.919 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:31:59.920 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.920 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.920 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:31:59.920 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.402512+0000", 2024-09-12T22:31:59.920 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 8.71e-07 2024-09-12T22:31:59.920 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.920 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.920 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:31:59.920 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.402520+0000", 2024-09-12T22:31:59.920 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 7.8529999999999992e-06 2024-09-12T22:31:59.920 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.920 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.920 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:31:59.921 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.402530+0000", 2024-09-12T22:31:59.921 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 9.859e-06 2024-09-12T22:31:59.921 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.921 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.921 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:31:59.921 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.402555+0000", 2024-09-12T22:31:59.921 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.4822000000000001e-05 2024-09-12T22:31:59.921 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.921 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.921 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:31:59.921 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.403173+0000", 2024-09-12T22:31:59.921 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00061813199999999997 2024-09-12T22:31:59.921 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.922 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.922 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:31:59.922 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.403195+0000", 2024-09-12T22:31:59.922 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.2286e-05 2024-09-12T22:31:59.922 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.922 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.922 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:31:59.922 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.411436+0000", 2024-09-12T22:31:59.922 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0082410539999999994 2024-09-12T22:31:59.922 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.922 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.922 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:31:59.922 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.411485+0000", 2024-09-12T22:31:59.922 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.8649000000000001e-05 2024-09-12T22:31:59.923 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:31:59.923 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:31:59.923 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:31:59.923 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.923 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.923 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:18 3.14 e19/17 3:2f55791f:::606.00000000:head v 19'1, mlcod=0'0)", 2024-09-12T22:31:59.923 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.406646+0000", 2024-09-12T22:31:59.923 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 22.452431756999999, 2024-09-12T22:31:59.923 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0082036980000000006, 2024-09-12T22:31:59.923 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:31:59.923 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:31:59.923 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:31:59.923 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:31:59.923 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.924 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:31:59.924 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406646+0000", 2024-09-12T22:31:59.924 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:31:59.924 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.924 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.924 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:31:59.924 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406646+0000", 2024-09-12T22:31:59.924 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:31:59.924 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.924 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.924 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:31:59.924 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406647+0000", 2024-09-12T22:31:59.924 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.4499999999999998e-07 2024-09-12T22:31:59.925 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.925 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.925 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:31:59.925 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406651+0000", 2024-09-12T22:31:59.925 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.0300000000000004e-06 2024-09-12T22:31:59.925 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.925 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.925 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:31:59.925 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406657+0000", 2024-09-12T22:31:59.925 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.1330000000000004e-06 2024-09-12T22:31:59.925 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.925 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.925 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:31:59.925 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406665+0000", 2024-09-12T22:31:59.926 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 8.3650000000000004e-06 2024-09-12T22:31:59.926 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.926 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.926 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:31:59.926 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406804+0000", 2024-09-12T22:31:59.926 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00013900699999999999 2024-09-12T22:31:59.926 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.926 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.926 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:31:59.926 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406833+0000", 2024-09-12T22:31:59.926 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.8243e-05 2024-09-12T22:31:59.926 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.926 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.926 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:31:59.927 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.414741+0000", 2024-09-12T22:31:59.927 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0079089620000000003 2024-09-12T22:31:59.927 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.927 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.927 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:31:59.927 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.414850+0000", 2024-09-12T22:31:59.927 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.000108713 2024-09-12T22:31:59.927 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:31:59.927 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:31:59.927 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:31:59.927 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.927 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.927 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:6 3.10 e19/17 3:0d82a743:::600.00000000:head v 19'1, mlcod=0'0)", 2024-09-12T22:31:59.928 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.406692+0000", 2024-09-12T22:31:59.928 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 22.45238599, 2024-09-12T22:31:59.928 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0093004430000000003, 2024-09-12T22:31:59.928 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:31:59.928 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:31:59.928 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:31:59.928 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:31:59.928 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.928 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:31:59.928 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406692+0000", 2024-09-12T22:31:59.928 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:31:59.928 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.928 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.928 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:31:59.929 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406692+0000", 2024-09-12T22:31:59.929 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:31:59.929 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.929 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.929 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:31:59.929 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406693+0000", 2024-09-12T22:31:59.929 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.6300000000000001e-07 2024-09-12T22:31:59.929 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.929 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.929 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:31:59.929 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406702+0000", 2024-09-12T22:31:59.929 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 9.5589999999999994e-06 2024-09-12T22:31:59.929 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.930 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.930 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:31:59.930 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406725+0000", 2024-09-12T22:31:59.930 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.2977999999999999e-05 2024-09-12T22:31:59.930 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.930 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.930 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:31:59.930 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406732+0000", 2024-09-12T22:31:59.930 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.8430000000000004e-06 2024-09-12T22:31:59.930 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.930 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.931 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:31:59.931 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406979+0000", 2024-09-12T22:31:59.931 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00024729199999999998 2024-09-12T22:31:59.931 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.931 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.931 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:31:59.931 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407000+0000", 2024-09-12T22:31:59.931 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.0573000000000001e-05 2024-09-12T22:31:59.931 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.931 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.931 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:31:59.931 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415928+0000", 2024-09-12T22:31:59.931 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0089286179999999993 2024-09-12T22:31:59.932 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.932 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.932 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:31:59.932 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415993+0000", 2024-09-12T22:31:59.932 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.4216999999999999e-05 2024-09-12T22:31:59.932 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:31:59.932 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:31:59.932 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:31:59.932 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.932 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.932 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:2 3.f e19/17 3:f1f69726:::400.00000000:head v 19'1, mlcod=0'0)", 2024-09-12T22:31:59.932 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.406942+0000", 2024-09-12T22:31:59.932 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 22.452136303, 2024-09-12T22:31:59.932 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0098433259999999995, 2024-09-12T22:31:59.933 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:31:59.933 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:31:59.933 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:31:59.933 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:31:59.933 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.933 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:31:59.933 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406942+0000", 2024-09-12T22:31:59.933 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:31:59.933 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.933 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.933 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:31:59.933 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406942+0000", 2024-09-12T22:31:59.933 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:31:59.934 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.934 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.934 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:31:59.934 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406943+0000", 2024-09-12T22:31:59.934 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.8800000000000002e-07 2024-09-12T22:31:59.934 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.934 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.934 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:31:59.934 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406949+0000", 2024-09-12T22:31:59.934 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.5869999999999998e-06 2024-09-12T22:31:59.934 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.934 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.935 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:31:59.935 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406960+0000", 2024-09-12T22:31:59.935 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.0873000000000001e-05 2024-09-12T22:31:59.935 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.935 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.935 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:31:59.935 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406970+0000", 2024-09-12T22:31:59.935 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 9.9119999999999993e-06 2024-09-12T22:31:59.935 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.935 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.935 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:31:59.935 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407535+0000", 2024-09-12T22:31:59.936 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00056508899999999996 2024-09-12T22:31:59.936 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.936 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.936 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:31:59.936 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407556+0000", 2024-09-12T22:31:59.936 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.1348999999999998e-05 2024-09-12T22:31:59.936 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.936 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.936 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:31:59.936 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416751+0000", 2024-09-12T22:31:59.936 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0091950109999999995 2024-09-12T22:31:59.936 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.936 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.936 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:31:59.937 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416785+0000", 2024-09-12T22:31:59.937 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.3917000000000001e-05 2024-09-12T22:31:59.937 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:31:59.937 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:31:59.937 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:31:59.937 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.937 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.937 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:19 3.14 e19/17 3:2f55791f:::606.00000000:head v 19'2, mlcod=0'0)", 2024-09-12T22:31:59.937 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.406983+0000", 2024-09-12T22:31:59.937 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 22.452095323999998, 2024-09-12T22:31:59.937 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0080362149999999993, 2024-09-12T22:31:59.937 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:31:59.937 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:31:59.938 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:31:59.938 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:31:59.938 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.938 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:31:59.938 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406983+0000", 2024-09-12T22:31:59.938 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:31:59.938 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.938 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.938 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:31:59.938 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406983+0000", 2024-09-12T22:31:59.938 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:31:59.938 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.938 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.938 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:31:59.939 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406983+0000", 2024-09-12T22:31:59.939 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.8200000000000001e-07 2024-09-12T22:31:59.939 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.939 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.939 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:31:59.939 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406999+0000", 2024-09-12T22:31:59.939 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.5747999999999999e-05 2024-09-12T22:31:59.939 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.939 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.939 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:31:59.939 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407006+0000", 2024-09-12T22:31:59.939 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 7.2609999999999996e-06 2024-09-12T22:31:59.939 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.940 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.940 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:31:59.940 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407035+0000", 2024-09-12T22:31:59.940 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.8214000000000001e-05 2024-09-12T22:31:59.940 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.940 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.940 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:31:59.940 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407092+0000", 2024-09-12T22:31:59.940 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.7027000000000001e-05 2024-09-12T22:31:59.940 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.940 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.940 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:31:59.940 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407126+0000", 2024-09-12T22:31:59.941 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.4082000000000003e-05 2024-09-12T22:31:59.941 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.941 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.941 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:31:59.941 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.414985+0000", 2024-09-12T22:31:59.941 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0078597319999999995 2024-09-12T22:31:59.941 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.941 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.941 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:31:59.941 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415019+0000", 2024-09-12T22:31:59.941 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.3769000000000001e-05 2024-09-12T22:31:59.941 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:31:59.941 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:31:59.942 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:31:59.942 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.942 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.942 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:7 3.10 e19/17 3:0d82a743:::600.00000000:head v 19'2, mlcod=0'0)", 2024-09-12T22:31:59.942 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.407048+0000", 2024-09-12T22:31:59.942 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 22.452029786000001, 2024-09-12T22:31:59.942 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.008979931, 2024-09-12T22:31:59.942 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:31:59.942 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:31:59.942 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:31:59.942 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:31:59.942 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.942 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:31:59.943 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407048+0000", 2024-09-12T22:31:59.943 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:31:59.943 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.943 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.943 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:31:59.943 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407048+0000", 2024-09-12T22:31:59.943 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:31:59.943 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.943 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.943 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:31:59.943 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407049+0000", 2024-09-12T22:31:59.943 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.9099999999999999e-07 2024-09-12T22:31:59.943 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.944 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.944 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:31:59.944 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407054+0000", 2024-09-12T22:31:59.944 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.1850000000000003e-06 2024-09-12T22:31:59.944 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.944 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.944 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:31:59.944 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407061+0000", 2024-09-12T22:31:59.944 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 7.0809999999999996e-06 2024-09-12T22:31:59.944 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.944 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.944 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:31:59.944 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407067+0000", 2024-09-12T22:31:59.944 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.9540000000000001e-06 2024-09-12T22:31:59.945 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.945 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.945 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:31:59.945 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407299+0000", 2024-09-12T22:31:59.945 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.000232122 2024-09-12T22:31:59.945 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.945 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.945 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:31:59.945 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407317+0000", 2024-09-12T22:31:59.945 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.7447000000000001e-05 2024-09-12T22:31:59.945 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.945 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.945 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:31:59.946 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415996+0000", 2024-09-12T22:31:59.946 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0086791799999999999 2024-09-12T22:31:59.946 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.946 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.946 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:31:59.946 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416028+0000", 2024-09-12T22:31:59.946 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.2570999999999997e-05 2024-09-12T22:31:59.946 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:31:59.946 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:31:59.946 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:31:59.946 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.946 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.946 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:8 3.10 e19/17 3:09401a81:::601.00000000:head v 19'3, mlcod=0'0)", 2024-09-12T22:31:59.946 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.407081+0000", 2024-09-12T22:31:59.947 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 22.451997095999999, 2024-09-12T22:31:59.947 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0089807270000000008, 2024-09-12T22:31:59.947 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:31:59.947 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:31:59.947 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:31:59.947 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:31:59.947 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.947 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:31:59.947 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407081+0000", 2024-09-12T22:31:59.947 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:31:59.947 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.947 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.947 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:31:59.947 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407081+0000", 2024-09-12T22:31:59.948 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:31:59.948 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.948 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.948 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:31:59.948 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407082+0000", 2024-09-12T22:31:59.948 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.7899999999999999e-07 2024-09-12T22:31:59.948 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.948 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.948 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:31:59.948 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407086+0000", 2024-09-12T22:31:59.948 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.7679999999999999e-06 2024-09-12T22:31:59.948 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.948 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.949 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:31:59.949 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407094+0000", 2024-09-12T22:31:59.949 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 8.1470000000000001e-06 2024-09-12T22:31:59.949 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.949 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.949 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:31:59.949 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407100+0000", 2024-09-12T22:31:59.949 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.4539999999999998e-06 2024-09-12T22:31:59.949 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.949 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.949 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:31:59.949 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407540+0000", 2024-09-12T22:31:59.949 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00043973699999999999 2024-09-12T22:31:59.949 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.950 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.950 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:31:59.950 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407553+0000", 2024-09-12T22:31:59.950 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.3368e-05 2024-09-12T22:31:59.950 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.950 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.950 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:31:59.950 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416032+0000", 2024-09-12T22:31:59.950 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0084793790000000004 2024-09-12T22:31:59.950 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.950 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.950 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:31:59.950 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416062+0000", 2024-09-12T22:31:59.951 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.9495000000000001e-05 2024-09-12T22:31:59.951 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:31:59.951 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:31:59.951 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:31:59.951 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.951 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.951 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:31 3.d e19/17 3:b50e409b:::mds_snaptable:head v 19'1, mlcod=0'0)", 2024-09-12T22:31:59.951 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.408508+0000", 2024-09-12T22:31:59.951 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 22.450570580000001, 2024-09-12T22:31:59.951 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0080056620000000002, 2024-09-12T22:31:59.951 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:31:59.951 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:31:59.951 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:31:59.951 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:31:59.952 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.952 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:31:59.952 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408508+0000", 2024-09-12T22:31:59.952 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:31:59.952 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.952 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.952 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:31:59.952 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408508+0000", 2024-09-12T22:31:59.952 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:31:59.952 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.952 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.952 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:31:59.952 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408508+0000", 2024-09-12T22:31:59.953 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.7e-07 2024-09-12T22:31:59.953 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.953 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.953 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:31:59.953 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408515+0000", 2024-09-12T22:31:59.953 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.4439999999999996e-06 2024-09-12T22:31:59.953 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.953 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.953 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:31:59.953 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408521+0000", 2024-09-12T22:31:59.953 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.2729999999999999e-06 2024-09-12T22:31:59.953 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.953 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.954 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:31:59.954 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408526+0000", 2024-09-12T22:31:59.954 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.3299999999999998e-06 2024-09-12T22:31:59.954 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.954 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.954 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:31:59.954 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.410190+0000", 2024-09-12T22:31:59.954 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.001663615 2024-09-12T22:31:59.954 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.954 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.954 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:31:59.954 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.410258+0000", 2024-09-12T22:31:59.954 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.8146999999999997e-05 2024-09-12T22:31:59.955 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.955 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.955 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:31:59.955 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416477+0000", 2024-09-12T22:31:59.955 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0062187329999999997 2024-09-12T22:31:59.955 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.955 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.955 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:31:59.955 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416513+0000", 2024-09-12T22:31:59.955 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.6650000000000003e-05 2024-09-12T22:31:59.955 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:31:59.955 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:31:59.956 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:31:59.956 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.956 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.956 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:9 3.10 e19/17 3:09401a81:::601.00000000:head v 19'4, mlcod=0'0)", 2024-09-12T22:31:59.956 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.408991+0000", 2024-09-12T22:31:59.956 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 22.45008683, 2024-09-12T22:31:59.956 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0080459209999999993, 2024-09-12T22:31:59.956 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:31:59.957 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:31:59.957 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:31:59.957 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:31:59.957 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.957 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:31:59.957 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408991+0000", 2024-09-12T22:31:59.957 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:31:59.957 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.957 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.957 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:31:59.957 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408991+0000", 2024-09-12T22:31:59.957 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:31:59.958 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.958 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.958 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:31:59.958 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408992+0000", 2024-09-12T22:31:59.958 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.1799999999999995e-07 2024-09-12T22:31:59.958 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.958 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.958 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:31:59.958 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409005+0000", 2024-09-12T22:31:59.958 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.261e-05 2024-09-12T22:31:59.959 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.959 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.959 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:31:59.959 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409015+0000", 2024-09-12T22:31:59.959 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.0001e-05 2024-09-12T22:31:59.959 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.959 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.959 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:31:59.959 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409023+0000", 2024-09-12T22:31:59.959 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 8.7569999999999993e-06 2024-09-12T22:31:59.959 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.959 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.959 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:31:59.960 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.411355+0000", 2024-09-12T22:31:59.960 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0023313520000000001 2024-09-12T22:31:59.960 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.960 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.960 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:31:59.960 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.411374+0000", 2024-09-12T22:31:59.960 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.8810000000000001e-05 2024-09-12T22:31:59.960 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.960 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.960 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:31:59.960 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416994+0000", 2024-09-12T22:31:59.960 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.005620524 2024-09-12T22:31:59.960 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.961 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.961 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:31:59.961 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417037+0000", 2024-09-12T22:31:59.961 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.3248999999999999e-05 2024-09-12T22:31:59.961 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:31:59.961 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:31:59.961 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:31:59.961 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.961 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.961 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:10 3.10 e19/17 3:0bd6d154:::602.00000000:head v 19'5, mlcod=0'0)", 2024-09-12T22:31:59.961 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.409038+0000", 2024-09-12T22:31:59.961 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 22.450040155, 2024-09-12T22:31:59.961 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0080541689999999999, 2024-09-12T22:31:59.961 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:31:59.962 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:31:59.962 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:31:59.962 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:31:59.962 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.962 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:31:59.962 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409038+0000", 2024-09-12T22:31:59.962 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:31:59.962 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.962 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.962 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:31:59.962 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409038+0000", 2024-09-12T22:31:59.963 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:31:59.963 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.963 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.963 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:31:59.963 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409038+0000", 2024-09-12T22:31:59.963 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.7899999999999999e-07 2024-09-12T22:31:59.963 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.963 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.963 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:31:59.963 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409043+0000", 2024-09-12T22:31:59.963 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.6589999999999998e-06 2024-09-12T22:31:59.963 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.964 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.964 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:31:59.964 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409050+0000", 2024-09-12T22:31:59.964 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 7.0829999999999998e-06 2024-09-12T22:31:59.964 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.964 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.964 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:31:59.964 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409058+0000", 2024-09-12T22:31:59.964 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 7.7309999999999993e-06 2024-09-12T22:31:59.965 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.965 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.965 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:31:59.965 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.411654+0000", 2024-09-12T22:31:59.965 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0025961650000000001 2024-09-12T22:31:59.965 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.965 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.965 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:31:59.965 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.411671+0000", 2024-09-12T22:31:59.965 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.7356000000000001e-05 2024-09-12T22:31:59.965 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.965 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.965 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:31:59.966 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417040+0000", 2024-09-12T22:31:59.966 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0053681889999999998 2024-09-12T22:31:59.966 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.966 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.966 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:31:59.966 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417092+0000", 2024-09-12T22:31:59.966 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.2607e-05 2024-09-12T22:31:59.966 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:31:59.966 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:31:59.966 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:31:59.966 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.966 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.966 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:11 3.10 e19/17 3:0bd6d154:::602.00000000:head v 19'6, mlcod=0'0)", 2024-09-12T22:31:59.967 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.409768+0000", 2024-09-12T22:31:59.967 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 22.449310713999999, 2024-09-12T22:31:59.967 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0074442759999999997, 2024-09-12T22:31:59.967 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:31:59.967 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:31:59.967 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:31:59.967 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:31:59.967 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.967 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:31:59.967 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409768+0000", 2024-09-12T22:31:59.967 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:31:59.967 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.967 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.967 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:31:59.968 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409768+0000", 2024-09-12T22:31:59.968 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:31:59.968 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.968 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.968 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:31:59.968 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409768+0000", 2024-09-12T22:31:59.968 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.37e-07 2024-09-12T22:31:59.968 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.968 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.968 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:31:59.968 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409775+0000", 2024-09-12T22:31:59.968 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.4670000000000001e-06 2024-09-12T22:31:59.968 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.969 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.969 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:31:59.969 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409793+0000", 2024-09-12T22:31:59.969 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.8162e-05 2024-09-12T22:31:59.969 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.969 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.969 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:31:59.969 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409954+0000", 2024-09-12T22:31:59.969 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00016072999999999999 2024-09-12T22:31:59.969 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.969 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.969 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:31:59.969 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.411943+0000", 2024-09-12T22:31:59.969 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0019897069999999998 2024-09-12T22:31:59.970 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.970 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.970 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:31:59.970 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.412069+0000", 2024-09-12T22:31:59.970 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00012546200000000001 2024-09-12T22:31:59.970 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.970 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.970 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:31:59.970 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417114+0000", 2024-09-12T22:31:59.970 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.005045023 2024-09-12T22:31:59.970 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:31:59.970 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:31:59.970 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:31:59.970 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417212+0000", 2024-09-12T22:31:59.971 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 9.8088e-05 2024-09-12T22:31:59.971 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:31:59.971 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:31:59.971 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:31:59.971 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:31:59.971 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:31:59.971 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-09-12T22:31:59.971 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T22:31:59.973 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:31:59.974 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:31:59.972+0000 7fddec6a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30331) UID: 0 2024-09-12T22:32:00.073 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:32:00.072+0000 7fddec6a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30331) UID: 0 2024-09-12T22:32:00.089 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:32:00.089 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:32:00.089 INFO:teuthology.orchestra.run.smithi148.stdout: "num_ops": 0 2024-09-12T22:32:00.089 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:32:00.099 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:32:00.108 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0: {} 2024-09-12T22:32:00.108 INFO:teuthology.orchestra.run.smithi019.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T22:32:00.126 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T22:32:00.126 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:32:00.143 INFO:teuthology.orchestra.run.smithi019.stdout:osd.2: {} 2024-09-12T22:32:00.143 INFO:teuthology.orchestra.run.smithi019.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T22:32:00.174 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:00.173+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:00.202 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:00.203 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:00.211 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:32:00.295 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:00.294+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:00.353 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:00.354 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:00.362 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:32:00.406 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:00.405+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:00.477 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:00.475+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:00.477 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:00.477 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:00.486 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:32:00.577 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:00.576+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:00.629 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:00.630 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:00.638 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:32:00.682 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:00.681+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:00.741 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:00.741 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:00.750 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:32:00.779 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:00.778+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:00.857 INFO:teuthology.orchestra.run.smithi076.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:00.857 INFO:teuthology.orchestra.run.smithi076.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:00.866 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:32:00.880 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:00.879+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:00.969 INFO:teuthology.orchestra.run.smithi076.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:00.969 INFO:teuthology.orchestra.run.smithi076.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:00.977 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:32:01.022 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:32:01.021+0000 7fddec6a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30331) UID: 0 2024-09-12T22:32:01.080 INFO:teuthology.orchestra.run.smithi076.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:01.081 INFO:teuthology.orchestra.run.smithi076.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:01.081 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:01.080+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:01.090 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:32:01.107 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-09-12T22:32:01.108 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-12T22:32:01.111 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T22:32:01.182 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:01.181+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:01.198 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:01.198 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:01.206 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:32:01.283 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:01.282+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:01.309 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:01.309 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:01.318 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:32:01.384 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:32:01.383+0000 7fddec6a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30331) UID: 0 2024-09-12T22:32:01.421 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:01.422 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:01.430 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:32:01.484 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:32:01.483+0000 7fddec6a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30331) UID: 0 2024-09-12T22:32:01.536 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:01.536 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:01.545 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:32:01.588 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:01.587+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:01.648 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:01.648 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:01.656 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:32:01.687 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:01.686+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:01.788 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:01.787+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:01.799 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:01.799 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:01.808 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:32:01.889 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:32:01.888+0000 7fddec6a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30331) UID: 0 2024-09-12T22:32:01.916 INFO:teuthology.orchestra.run.smithi076.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:01.917 INFO:teuthology.orchestra.run.smithi076.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:01.925 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:32:01.990 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:01.989+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:02.068 INFO:teuthology.orchestra.run.smithi076.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:02.068 INFO:teuthology.orchestra.run.smithi076.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:02.076 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:32:02.106 INFO:teuthology.orchestra.run.smithi019.stderr:reweighted osd.0 to 1 (10000) 2024-09-12T22:32:02.114 INFO:teuthology.orchestra.run.smithi019.stderr:noscrub is unset 2024-09-12T22:32:02.122 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:32:02.119+0000 7fddec6a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30331) UID: 0 2024-09-12T22:32:02.125 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-12T22:32:02.155 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T22:32:02.179 INFO:teuthology.orchestra.run.smithi076.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:02.179 INFO:teuthology.orchestra.run.smithi076.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:02.188 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:32:02.229 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:32:02.228+0000 7fddec6a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30331) UID: 0 2024-09-12T22:32:02.292 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:32:02.291+0000 7fddec6a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30331) UID: 0 2024-09-12T22:32:02.297 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:02.297 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:02.303 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0: {} 2024-09-12T22:32:02.304 INFO:teuthology.orchestra.run.smithi019.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T22:32:02.306 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:32:02.321 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T22:32:02.321 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:32:02.338 INFO:teuthology.orchestra.run.smithi019.stdout:osd.2: {} 2024-09-12T22:32:02.338 INFO:teuthology.orchestra.run.smithi019.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T22:32:02.392 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:32:02.391+0000 7fddec6a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30331) UID: 0 2024-09-12T22:32:02.409 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:32:02.409 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:32:02.409 INFO:teuthology.orchestra.run.smithi148.stdout: "complaint_time": 30, 2024-09-12T22:32:02.409 INFO:teuthology.orchestra.run.smithi148.stdout: "num_blocked_ops": 0 2024-09-12T22:32:02.409 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:32:02.418 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:32:02.493 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:32:02.492+0000 7fddec6a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30331) UID: 0 2024-09-12T22:32:02.523 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:32:02.523 INFO:teuthology.orchestra.run.smithi148.stdout: "size": 20, 2024-09-12T22:32:02.523 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 600, 2024-09-12T22:32:02.523 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [ 2024-09-12T22:32:02.523 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.523 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(client.4195.0:5 2.2 e15/13 2:5cea7035:::rbd_info:head v 15'1, mlcod=0'0)", 2024-09-12T22:32:02.523 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:33.283639+0000", 2024-09-12T22:32:02.523 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 29.237534672999999, 2024-09-12T22:32:02.524 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00092221499999999999, 2024-09-12T22:32:02.524 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:02.524 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:02.524 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:02.524 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:02.524 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.524 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:02.524 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:33.283639+0000", 2024-09-12T22:32:02.524 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:02.524 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.524 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.524 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:02.524 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:33.283639+0000", 2024-09-12T22:32:02.525 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:02.525 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.525 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.525 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:02.525 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:33.283639+0000", 2024-09-12T22:32:02.525 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.5900000000000001e-07 2024-09-12T22:32:02.525 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.525 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.525 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:02.525 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:33.283664+0000", 2024-09-12T22:32:02.525 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4532000000000002e-05 2024-09-12T22:32:02.525 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.525 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.526 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:02.526 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:33.283675+0000", 2024-09-12T22:32:02.526 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1534e-05 2024-09-12T22:32:02.526 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.526 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.526 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:02.526 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:33.283681+0000", 2024-09-12T22:32:02.526 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0340000000000002e-06 2024-09-12T22:32:02.526 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.526 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.526 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:02.527 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:33.283764+0000", 2024-09-12T22:32:02.527 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.3115999999999995e-05 2024-09-12T22:32:02.527 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.527 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.527 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:02.527 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:33.283778+0000", 2024-09-12T22:32:02.527 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4233000000000001e-05 2024-09-12T22:32:02.527 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.527 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.527 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:02.527 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:33.284523+0000", 2024-09-12T22:32:02.527 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00074424699999999996 2024-09-12T22:32:02.527 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.528 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.528 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:02.528 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:33.284561+0000", 2024-09-12T22:32:02.528 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.8359999999999999e-05 2024-09-12T22:32:02.528 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:02.528 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:02.529 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:02.529 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.529 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.529 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:02.529 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.400880+0000", 2024-09-12T22:32:02.529 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 25.120293756999999, 2024-09-12T22:32:02.529 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0095133660000000005, 2024-09-12T22:32:02.529 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:02.529 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:02.529 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:02.529 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:02.529 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.529 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:02.530 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400880+0000", 2024-09-12T22:32:02.530 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:02.530 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.530 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.530 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:02.530 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400880+0000", 2024-09-12T22:32:02.530 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:02.530 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.530 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.530 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:02.530 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400892+0000", 2024-09-12T22:32:02.530 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1941e-05 2024-09-12T22:32:02.530 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.530 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.531 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:02.531 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400900+0000", 2024-09-12T22:32:02.531 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0080000000000002e-06 2024-09-12T22:32:02.531 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.531 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.531 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:02.531 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400911+0000", 2024-09-12T22:32:02.531 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1452e-05 2024-09-12T22:32:02.531 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.531 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.531 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:02.531 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400922+0000", 2024-09-12T22:32:02.531 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0772e-05 2024-09-12T22:32:02.531 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.532 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.532 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:02.532 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401009+0000", 2024-09-12T22:32:02.532 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.7206000000000005e-05 2024-09-12T22:32:02.532 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.532 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.532 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:02.532 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401157+0000", 2024-09-12T22:32:02.532 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014831499999999999 2024-09-12T22:32:02.532 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.532 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.532 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:02.532 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401312+0000", 2024-09-12T22:32:02.533 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00015495600000000001 2024-09-12T22:32:02.533 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.533 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.533 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:02.533 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.403060+0000", 2024-09-12T22:32:02.533 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0017475220000000001 2024-09-12T22:32:02.533 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.533 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.533 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:02.533 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410300+0000", 2024-09-12T22:32:02.533 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0072403260000000001 2024-09-12T22:32:02.533 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.533 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.533 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:02.534 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410350+0000", 2024-09-12T22:32:02.534 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9814000000000001e-05 2024-09-12T22:32:02.534 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.534 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.534 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:02.534 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410393+0000", 2024-09-12T22:32:02.534 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3053999999999998e-05 2024-09-12T22:32:02.534 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:02.534 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:02.534 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:02.534 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.534 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.534 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:02.534 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.400952+0000", 2024-09-12T22:32:02.535 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 25.120221605000001, 2024-09-12T22:32:02.535 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0096045620000000005, 2024-09-12T22:32:02.535 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:02.535 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:02.535 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:02.535 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:02.535 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.535 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:02.535 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400952+0000", 2024-09-12T22:32:02.535 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:02.535 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.535 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.535 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:02.535 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400952+0000", 2024-09-12T22:32:02.536 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:02.536 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.536 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.536 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:02.536 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400953+0000", 2024-09-12T22:32:02.536 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.8000000000000005e-07 2024-09-12T22:32:02.536 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.536 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.536 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:02.536 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400957+0000", 2024-09-12T22:32:02.536 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.33e-06 2024-09-12T22:32:02.536 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.536 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.537 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:02.537 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400966+0000", 2024-09-12T22:32:02.537 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1989999999999995e-06 2024-09-12T22:32:02.537 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.537 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.537 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:02.537 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400973+0000", 2024-09-12T22:32:02.537 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2779999999999999e-06 2024-09-12T22:32:02.537 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.537 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.537 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:02.537 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401696+0000", 2024-09-12T22:32:02.537 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00072363500000000003 2024-09-12T22:32:02.537 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.538 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.538 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:02.538 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401788+0000", 2024-09-12T22:32:02.538 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1862999999999998e-05 2024-09-12T22:32:02.538 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.538 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.538 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:02.538 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401929+0000", 2024-09-12T22:32:02.538 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014096000000000001 2024-09-12T22:32:02.538 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.538 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.538 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:02.538 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.403542+0000", 2024-09-12T22:32:02.539 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001612963 2024-09-12T22:32:02.539 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.539 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.539 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:02.539 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410460+0000", 2024-09-12T22:32:02.539 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0069180500000000002 2024-09-12T22:32:02.539 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.539 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.539 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:02.539 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410515+0000", 2024-09-12T22:32:02.539 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5009000000000001e-05 2024-09-12T22:32:02.539 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.539 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.540 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:02.540 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410557+0000", 2024-09-12T22:32:02.540 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1495000000000002e-05 2024-09-12T22:32:02.540 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:02.540 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:02.540 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:02.540 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.540 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.540 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:02.540 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.400984+0000", 2024-09-12T22:32:02.540 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 25.120189109999998, 2024-09-12T22:32:02.540 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0073703950000000001, 2024-09-12T22:32:02.540 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:02.540 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:02.541 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:02.541 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:02.541 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.541 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:02.541 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400984+0000", 2024-09-12T22:32:02.541 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:02.541 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.541 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.541 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:02.541 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400984+0000", 2024-09-12T22:32:02.541 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:02.541 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.541 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.542 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:02.542 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400985+0000", 2024-09-12T22:32:02.542 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3200000000000005e-07 2024-09-12T22:32:02.542 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.542 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.542 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:02.542 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400998+0000", 2024-09-12T22:32:02.542 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2726e-05 2024-09-12T22:32:02.542 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.542 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.542 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:02.542 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401006+0000", 2024-09-12T22:32:02.542 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.3110000000000006e-06 2024-09-12T22:32:02.543 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.543 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.543 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:02.543 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401022+0000", 2024-09-12T22:32:02.543 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6249e-05 2024-09-12T22:32:02.543 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.543 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.543 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:02.543 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401700+0000", 2024-09-12T22:32:02.543 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00067811100000000001 2024-09-12T22:32:02.543 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.543 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.543 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:02.543 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401839+0000", 2024-09-12T22:32:02.544 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013865399999999999 2024-09-12T22:32:02.544 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.544 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.544 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:02.544 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401962+0000", 2024-09-12T22:32:02.544 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000123266 2024-09-12T22:32:02.544 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.544 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.544 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:02.544 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.403589+0000", 2024-09-12T22:32:02.544 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001626932 2024-09-12T22:32:02.544 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.544 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.545 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:02.545 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.408274+0000", 2024-09-12T22:32:02.545 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0046848100000000002 2024-09-12T22:32:02.545 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.545 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.545 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:02.545 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.408324+0000", 2024-09-12T22:32:02.545 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9784000000000003e-05 2024-09-12T22:32:02.545 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.545 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.545 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:02.545 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.408355+0000", 2024-09-12T22:32:02.545 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.1019999999999998e-05 2024-09-12T22:32:02.546 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:02.546 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:02.546 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:02.546 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.546 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.546 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:02.546 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401034+0000", 2024-09-12T22:32:02.546 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 25.12013967, 2024-09-12T22:32:02.546 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011063051000000001, 2024-09-12T22:32:02.546 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:02.546 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:02.546 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:02.546 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:02.546 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.547 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:02.547 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401034+0000", 2024-09-12T22:32:02.547 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:02.547 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.547 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.547 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:02.547 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401034+0000", 2024-09-12T22:32:02.547 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:02.547 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.547 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.547 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:02.548 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401034+0000", 2024-09-12T22:32:02.548 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8899999999999999e-07 2024-09-12T22:32:02.548 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.548 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.548 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:02.548 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401038+0000", 2024-09-12T22:32:02.548 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.523e-06 2024-09-12T22:32:02.548 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.548 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.548 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:02.549 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401046+0000", 2024-09-12T22:32:02.549 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0479999999999999e-06 2024-09-12T22:32:02.549 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.549 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.549 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:02.549 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401051+0000", 2024-09-12T22:32:02.549 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2619999999999998e-06 2024-09-12T22:32:02.549 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.549 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.549 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:02.549 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402270+0000", 2024-09-12T22:32:02.550 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012182429999999999 2024-09-12T22:32:02.550 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.550 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.550 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:02.550 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402325+0000", 2024-09-12T22:32:02.550 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5526999999999999e-05 2024-09-12T22:32:02.550 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.550 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.550 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:02.550 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402403+0000", 2024-09-12T22:32:02.550 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.7559999999999996e-05 2024-09-12T22:32:02.550 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.550 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.550 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:02.551 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.403655+0000", 2024-09-12T22:32:02.551 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012521489999999999 2024-09-12T22:32:02.551 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.551 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.551 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:02.551 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411979+0000", 2024-09-12T22:32:02.551 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0083240420000000002 2024-09-12T22:32:02.551 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.551 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.551 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:02.551 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.412036+0000", 2024-09-12T22:32:02.551 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7639000000000002e-05 2024-09-12T22:32:02.551 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.552 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.552 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:02.552 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.412097+0000", 2024-09-12T22:32:02.552 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0469e-05 2024-09-12T22:32:02.552 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:02.552 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:02.552 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:02.552 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.552 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.552 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:02.552 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401060+0000", 2024-09-12T22:32:02.552 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 25.120113918000001, 2024-09-12T22:32:02.552 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.010030172, 2024-09-12T22:32:02.553 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:02.553 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:02.553 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:02.553 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:02.553 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.553 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:02.553 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401060+0000", 2024-09-12T22:32:02.553 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:02.553 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.553 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.553 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:02.553 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401060+0000", 2024-09-12T22:32:02.553 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:02.554 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.554 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.554 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:02.554 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401060+0000", 2024-09-12T22:32:02.554 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2500000000000001e-07 2024-09-12T22:32:02.554 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.554 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.554 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:02.554 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401063+0000", 2024-09-12T22:32:02.554 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0910000000000001e-06 2024-09-12T22:32:02.554 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.554 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.554 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:02.555 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401070+0000", 2024-09-12T22:32:02.555 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1210000000000001e-06 2024-09-12T22:32:02.555 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.555 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.555 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:02.555 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401076+0000", 2024-09-12T22:32:02.555 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2830000000000001e-06 2024-09-12T22:32:02.555 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.555 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.555 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:02.555 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402288+0000", 2024-09-12T22:32:02.555 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012123699999999999 2024-09-12T22:32:02.555 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.555 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.556 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:02.556 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402359+0000", 2024-09-12T22:32:02.556 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.0988000000000005e-05 2024-09-12T22:32:02.556 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.556 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.556 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:02.556 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402457+0000", 2024-09-12T22:32:02.556 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.7857999999999997e-05 2024-09-12T22:32:02.556 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.556 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.556 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:02.556 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.404395+0000", 2024-09-12T22:32:02.556 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0019380160000000001 2024-09-12T22:32:02.557 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.557 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.557 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:02.557 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410603+0000", 2024-09-12T22:32:02.557 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.006208061 2024-09-12T22:32:02.557 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.557 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.557 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:02.557 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410687+0000", 2024-09-12T22:32:02.557 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.4623000000000006e-05 2024-09-12T22:32:02.557 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.557 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.557 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:02.557 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411090+0000", 2024-09-12T22:32:02.558 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00040233599999999999 2024-09-12T22:32:02.558 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:02.558 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:02.558 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:02.558 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.558 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.558 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:02.558 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401083+0000", 2024-09-12T22:32:02.558 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 25.120090502, 2024-09-12T22:32:02.558 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0097591850000000001, 2024-09-12T22:32:02.558 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:02.558 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:02.558 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:02.559 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:02.559 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.559 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:02.559 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401083+0000", 2024-09-12T22:32:02.559 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:02.559 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.559 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.559 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:02.559 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401083+0000", 2024-09-12T22:32:02.559 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:02.559 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.559 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.559 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:02.559 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401084+0000", 2024-09-12T22:32:02.560 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4799999999999999e-07 2024-09-12T22:32:02.560 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.560 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.560 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:02.560 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401088+0000", 2024-09-12T22:32:02.560 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6419999999999998e-06 2024-09-12T22:32:02.560 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.560 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.560 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:02.560 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401094+0000", 2024-09-12T22:32:02.560 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0090000000000004e-06 2024-09-12T22:32:02.560 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.560 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.561 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:02.561 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401108+0000", 2024-09-12T22:32:02.561 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3884e-05 2024-09-12T22:32:02.561 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.561 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.561 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:02.561 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401165+0000", 2024-09-12T22:32:02.561 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.6499000000000002e-05 2024-09-12T22:32:02.561 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.561 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.561 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:02.561 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401261+0000", 2024-09-12T22:32:02.561 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.6872000000000004e-05 2024-09-12T22:32:02.562 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.562 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.562 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:02.562 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401376+0000", 2024-09-12T22:32:02.562 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000114508 2024-09-12T22:32:02.562 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.562 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.562 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:02.562 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402666+0000", 2024-09-12T22:32:02.562 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012901659999999999 2024-09-12T22:32:02.562 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.562 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.562 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:02.562 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410572+0000", 2024-09-12T22:32:02.563 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0079055489999999996 2024-09-12T22:32:02.563 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.563 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.563 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:02.563 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410661+0000", 2024-09-12T22:32:02.563 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.9578000000000002e-05 2024-09-12T22:32:02.563 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.563 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.563 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:02.563 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410842+0000", 2024-09-12T22:32:02.563 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00018102999999999999 2024-09-12T22:32:02.563 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:02.563 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:02.563 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:02.564 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.564 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.564 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:02.564 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401122+0000", 2024-09-12T22:32:02.564 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 25.12005147, 2024-09-12T22:32:02.564 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0099122080000000005, 2024-09-12T22:32:02.564 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:02.564 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:02.564 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:32:02.564 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:02.564 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.564 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:02.564 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401122+0000", 2024-09-12T22:32:02.565 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:02.565 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.565 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.565 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:02.565 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401122+0000", 2024-09-12T22:32:02.565 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:02.565 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.565 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.565 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:02.565 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401123+0000", 2024-09-12T22:32:02.565 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2600000000000002e-07 2024-09-12T22:32:02.565 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.565 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.566 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:02.566 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401126+0000", 2024-09-12T22:32:02.566 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.6449999999999998e-06 2024-09-12T22:32:02.566 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.566 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.566 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:02.566 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401133+0000", 2024-09-12T22:32:02.566 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.9890000000000003e-06 2024-09-12T22:32:02.566 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.566 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.566 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:02.566 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401138+0000", 2024-09-12T22:32:02.566 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8060000000000002e-06 2024-09-12T22:32:02.566 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.567 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.567 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:02.567 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401703+0000", 2024-09-12T22:32:02.567 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00056509099999999999 2024-09-12T22:32:02.567 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.567 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.567 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:02.567 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401837+0000", 2024-09-12T22:32:02.567 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013338799999999999 2024-09-12T22:32:02.567 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.567 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.567 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:02.567 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411034+0000", 2024-09-12T22:32:02.568 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.009197663 2024-09-12T22:32:02.568 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:02.568 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:02.568 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:02.568 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.568 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.568 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:02.568 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401158+0000", 2024-09-12T22:32:02.568 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 25.120015690999999, 2024-09-12T22:32:02.568 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.010292437999999999, 2024-09-12T22:32:02.568 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:02.568 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:02.568 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:32:02.569 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:02.569 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.569 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:02.569 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401158+0000", 2024-09-12T22:32:02.569 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:02.569 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.569 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.569 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:02.569 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401158+0000", 2024-09-12T22:32:02.569 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:02.569 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.569 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.569 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:02.569 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401158+0000", 2024-09-12T22:32:02.570 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9699999999999996e-07 2024-09-12T22:32:02.570 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.570 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.570 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:02.570 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401161+0000", 2024-09-12T22:32:02.570 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.7410000000000001e-06 2024-09-12T22:32:02.570 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.570 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.570 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:02.570 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401168+0000", 2024-09-12T22:32:02.570 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.844e-06 2024-09-12T22:32:02.570 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.570 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.571 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:02.571 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401174+0000", 2024-09-12T22:32:02.571 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4700000000000001e-06 2024-09-12T22:32:02.571 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.571 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.571 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:02.571 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402799+0000", 2024-09-12T22:32:02.571 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0016256409999999999 2024-09-12T22:32:02.571 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.571 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.571 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:02.571 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402893+0000", 2024-09-12T22:32:02.571 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.3807999999999994e-05 2024-09-12T22:32:02.572 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.572 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.572 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:02.572 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411450+0000", 2024-09-12T22:32:02.572 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0085573369999999999 2024-09-12T22:32:02.572 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:02.572 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:02.572 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:02.572 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.572 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.572 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:02.572 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401183+0000", 2024-09-12T22:32:02.572 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 25.119990839, 2024-09-12T22:32:02.573 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0068597830000000004, 2024-09-12T22:32:02.573 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:02.573 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:02.573 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:32:02.573 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:02.573 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.573 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:02.573 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401183+0000", 2024-09-12T22:32:02.573 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:02.573 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.573 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.573 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:02.573 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401183+0000", 2024-09-12T22:32:02.573 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:02.574 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.574 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.574 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:02.574 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401183+0000", 2024-09-12T22:32:02.574 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.6700000000000003e-07 2024-09-12T22:32:02.574 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.574 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.574 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:02.574 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401186+0000", 2024-09-12T22:32:02.574 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4679999999999999e-06 2024-09-12T22:32:02.574 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.574 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.574 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:02.575 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401192+0000", 2024-09-12T22:32:02.575 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.1519999999999997e-06 2024-09-12T22:32:02.575 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.575 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.575 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:02.575 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401197+0000", 2024-09-12T22:32:02.575 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4669999999999998e-06 2024-09-12T22:32:02.575 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.575 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.575 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:02.575 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401253+0000", 2024-09-12T22:32:02.575 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.6211000000000001e-05 2024-09-12T22:32:02.575 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.575 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.576 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:02.576 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401413+0000", 2024-09-12T22:32:02.576 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00016021399999999999 2024-09-12T22:32:02.576 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.576 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.576 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:02.576 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.408043+0000", 2024-09-12T22:32:02.576 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0066295039999999996 2024-09-12T22:32:02.576 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:02.576 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:02.576 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:02.576 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.576 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.577 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:20 3.1c e19/17 3:3ed09add:::607.00000000:head v 19'1, mlcod=0'0)", 2024-09-12T22:32:02.577 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.409642+0000", 2024-09-12T22:32:02.577 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 25.111531379999999, 2024-09-12T22:32:02.577 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0038816269999999999, 2024-09-12T22:32:02.577 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:02.577 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:02.577 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:02.577 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:02.577 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.577 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:02.577 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409642+0000", 2024-09-12T22:32:02.577 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:02.577 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.577 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.578 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:02.578 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409642+0000", 2024-09-12T22:32:02.578 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:02.578 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.578 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.578 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:02.578 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409642+0000", 2024-09-12T22:32:02.578 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.6899999999999999e-07 2024-09-12T22:32:02.578 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.578 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.578 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:02.578 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409648+0000", 2024-09-12T22:32:02.578 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.49e-06 2024-09-12T22:32:02.579 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.579 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.579 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:02.579 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409656+0000", 2024-09-12T22:32:02.579 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.2949999999999994e-06 2024-09-12T22:32:02.579 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.579 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.579 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:02.579 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409664+0000", 2024-09-12T22:32:02.579 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.1219999999999995e-06 2024-09-12T22:32:02.579 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.579 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.579 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:02.579 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409707+0000", 2024-09-12T22:32:02.580 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2222000000000003e-05 2024-09-12T22:32:02.580 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.580 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.580 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:02.580 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409724+0000", 2024-09-12T22:32:02.580 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7496999999999999e-05 2024-09-12T22:32:02.580 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.580 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.580 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:02.580 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413439+0000", 2024-09-12T22:32:02.580 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00371448 2024-09-12T22:32:02.580 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.580 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.581 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:02.581 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413524+0000", 2024-09-12T22:32:02.581 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.5252000000000003e-05 2024-09-12T22:32:02.581 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:02.581 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:02.581 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:02.581 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.581 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.581 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:28 3.13 e19/17 3:cd5a64a3:::100.00000000:head v 19'1, mlcod=0'0)", 2024-09-12T22:32:02.581 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.409681+0000", 2024-09-12T22:32:02.581 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 25.111492897000002, 2024-09-12T22:32:02.581 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0038708710000000001, 2024-09-12T22:32:02.581 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:02.581 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:02.582 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:02.582 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:02.582 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.582 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:02.582 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409681+0000", 2024-09-12T22:32:02.582 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:02.582 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.582 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.582 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:02.582 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409681+0000", 2024-09-12T22:32:02.582 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:02.582 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.582 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.583 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:02.583 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409681+0000", 2024-09-12T22:32:02.583 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3000000000000002e-07 2024-09-12T22:32:02.583 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.583 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.583 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:02.583 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409695+0000", 2024-09-12T22:32:02.583 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4313e-05 2024-09-12T22:32:02.583 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.583 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.583 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:02.583 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409703+0000", 2024-09-12T22:32:02.583 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4000000000000003e-06 2024-09-12T22:32:02.583 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.584 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.584 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:02.584 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409708+0000", 2024-09-12T22:32:02.584 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3190000000000002e-06 2024-09-12T22:32:02.584 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.584 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.584 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:02.584 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409875+0000", 2024-09-12T22:32:02.584 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000167329 2024-09-12T22:32:02.584 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.584 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.584 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:02.584 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409892+0000", 2024-09-12T22:32:02.584 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6957999999999999e-05 2024-09-12T22:32:02.585 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.585 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.585 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:02.585 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413457+0000", 2024-09-12T22:32:02.585 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0035651279999999999 2024-09-12T22:32:02.585 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.585 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.585 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:02.585 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413552+0000", 2024-09-12T22:32:02.585 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.4093999999999997e-05 2024-09-12T22:32:02.585 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:02.585 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:02.585 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:02.586 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.586 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.586 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:21 3.1c e19/17 3:3ed09add:::607.00000000:head v 19'2, mlcod=0'0)", 2024-09-12T22:32:02.586 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.409718+0000", 2024-09-12T22:32:02.586 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 25.111455232000001, 2024-09-12T22:32:02.586 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003851883, 2024-09-12T22:32:02.586 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:02.586 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:02.586 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:02.586 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:02.586 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.586 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:02.586 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409718+0000", 2024-09-12T22:32:02.587 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:02.587 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.587 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.587 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:02.587 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409718+0000", 2024-09-12T22:32:02.587 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:02.587 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.587 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.587 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:02.587 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409719+0000", 2024-09-12T22:32:02.587 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.16e-07 2024-09-12T22:32:02.587 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.587 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.587 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:02.588 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409722+0000", 2024-09-12T22:32:02.588 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.692e-06 2024-09-12T22:32:02.588 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.588 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.588 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:02.588 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409729+0000", 2024-09-12T22:32:02.588 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.516e-06 2024-09-12T22:32:02.588 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.588 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.588 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:02.588 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409750+0000", 2024-09-12T22:32:02.588 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1151000000000001e-05 2024-09-12T22:32:02.588 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.588 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.589 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:02.589 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410015+0000", 2024-09-12T22:32:02.589 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00026477599999999999 2024-09-12T22:32:02.589 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.589 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.589 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:02.589 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410104+0000", 2024-09-12T22:32:02.589 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.9586000000000006e-05 2024-09-12T22:32:02.589 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.589 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.589 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:02.589 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413528+0000", 2024-09-12T22:32:02.589 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0034237880000000001 2024-09-12T22:32:02.589 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.590 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.590 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:02.590 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413570+0000", 2024-09-12T22:32:02.590 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2157999999999999e-05 2024-09-12T22:32:02.590 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:02.590 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:02.590 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:02.590 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.590 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.590 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:27 3.13 e19/17 3:c91d4a1d:::mds0_inotable:head v 19'2, mlcod=0'0)", 2024-09-12T22:32:02.590 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.409760+0000", 2024-09-12T22:32:02.590 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 25.111413716000001, 2024-09-12T22:32:02.590 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0039301910000000004, 2024-09-12T22:32:02.591 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:02.591 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:02.591 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:02.591 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:02.591 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.591 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:02.591 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409760+0000", 2024-09-12T22:32:02.591 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:02.591 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.591 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.591 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:02.591 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409760+0000", 2024-09-12T22:32:02.591 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:02.592 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.592 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.592 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:02.592 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409760+0000", 2024-09-12T22:32:02.592 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.39e-07 2024-09-12T22:32:02.592 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.592 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.592 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:02.592 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409765+0000", 2024-09-12T22:32:02.592 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4449999999999998e-06 2024-09-12T22:32:02.592 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.592 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.592 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:02.593 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409771+0000", 2024-09-12T22:32:02.593 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7159999999999997e-06 2024-09-12T22:32:02.593 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.593 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.593 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:02.593 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409778+0000", 2024-09-12T22:32:02.593 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.331e-06 2024-09-12T22:32:02.593 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.593 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.593 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:02.593 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410191+0000", 2024-09-12T22:32:02.593 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00041348300000000003 2024-09-12T22:32:02.593 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.593 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.594 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:02.594 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410211+0000", 2024-09-12T22:32:02.594 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9933999999999999e-05 2024-09-12T22:32:02.594 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.594 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.594 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:02.594 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413638+0000", 2024-09-12T22:32:02.594 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003426854 2024-09-12T22:32:02.594 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.594 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.594 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:02.594 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413690+0000", 2024-09-12T22:32:02.594 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2089000000000002e-05 2024-09-12T22:32:02.594 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:02.595 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:02.595 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:02.595 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.595 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.595 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "pg_update_log_missing_reply(3.b epoch 19/17 rep_tid 4 lcod 19'2)", 2024-09-12T22:32:02.595 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.410060+0000", 2024-09-12T22:32:02.595 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 25.111114051000001, 2024-09-12T22:32:02.595 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00098016500000000007, 2024-09-12T22:32:02.595 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:02.595 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:02.595 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "reached pg", 2024-09-12T22:32:02.595 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:02.595 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.595 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:02.596 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410060+0000", 2024-09-12T22:32:02.596 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:02.596 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.596 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.596 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:02.596 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410060+0000", 2024-09-12T22:32:02.596 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:02.596 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.596 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.596 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:02.596 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410060+0000", 2024-09-12T22:32:02.596 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.8299999999999998e-07 2024-09-12T22:32:02.596 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.597 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.597 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:02.597 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410062+0000", 2024-09-12T22:32:02.597 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5749999999999999e-06 2024-09-12T22:32:02.597 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.597 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.597 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:02.597 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410070+0000", 2024-09-12T22:32:02.597 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.909e-06 2024-09-12T22:32:02.597 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.597 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.597 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:02.597 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410076+0000", 2024-09-12T22:32:02.598 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7049999999999996e-06 2024-09-12T22:32:02.598 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.598 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.598 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:02.598 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410943+0000", 2024-09-12T22:32:02.598 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00086681900000000001 2024-09-12T22:32:02.598 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.598 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.598 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:02.598 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411040+0000", 2024-09-12T22:32:02.598 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.6774000000000006e-05 2024-09-12T22:32:02.598 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:02.598 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:02.598 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:02.599 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.599 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.599 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e19/17 ondisk, result = 0)", 2024-09-12T22:32:02.599 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.410113+0000", 2024-09-12T22:32:02.599 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 25.111060783999999, 2024-09-12T22:32:02.599 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00098911599999999995, 2024-09-12T22:32:02.599 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:02.599 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:02.599 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:32:02.599 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:02.599 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.599 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:02.599 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410113+0000", 2024-09-12T22:32:02.600 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:02.600 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.600 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.600 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:02.600 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410113+0000", 2024-09-12T22:32:02.600 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:02.600 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.600 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.600 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:02.600 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410113+0000", 2024-09-12T22:32:02.600 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.99e-07 2024-09-12T22:32:02.600 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.600 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.601 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:02.601 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410115+0000", 2024-09-12T22:32:02.601 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.046e-06 2024-09-12T22:32:02.601 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.601 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.601 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:02.601 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410121+0000", 2024-09-12T22:32:02.601 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0050000000000001e-06 2024-09-12T22:32:02.601 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.601 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.601 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:02.601 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410126+0000", 2024-09-12T22:32:02.601 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8339999999999998e-06 2024-09-12T22:32:02.602 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.602 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.602 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:02.602 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410587+0000", 2024-09-12T22:32:02.602 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00046095499999999998 2024-09-12T22:32:02.602 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.602 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.602 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:02.602 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410595+0000", 2024-09-12T22:32:02.602 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.9419999999999995e-06 2024-09-12T22:32:02.602 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.602 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.602 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:02.603 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411102+0000", 2024-09-12T22:32:02.603 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00050713500000000003 2024-09-12T22:32:02.603 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:02.603 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:02.603 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:02.603 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.603 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.603 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 19/17 rep_tid 8 lcod 19'4)", 2024-09-12T22:32:02.603 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.410133+0000", 2024-09-12T22:32:02.603 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 25.111040855999999, 2024-09-12T22:32:02.603 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0013504000000000001, 2024-09-12T22:32:02.603 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:02.603 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:02.603 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "reached pg", 2024-09-12T22:32:02.604 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:02.604 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.604 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:02.604 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410133+0000", 2024-09-12T22:32:02.604 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:02.604 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.604 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.604 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:02.604 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410133+0000", 2024-09-12T22:32:02.604 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:02.604 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.604 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.604 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:02.605 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410133+0000", 2024-09-12T22:32:02.605 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.0599999999999999e-07 2024-09-12T22:32:02.605 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.605 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.605 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:02.605 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410135+0000", 2024-09-12T22:32:02.605 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7770000000000001e-06 2024-09-12T22:32:02.605 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.605 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.605 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:02.605 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410140+0000", 2024-09-12T22:32:02.605 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9960000000000001e-06 2024-09-12T22:32:02.605 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.605 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.606 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:02.606 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410144+0000", 2024-09-12T22:32:02.606 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9500000000000003e-06 2024-09-12T22:32:02.606 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.606 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.606 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:02.606 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411310+0000", 2024-09-12T22:32:02.606 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001166311 2024-09-12T22:32:02.606 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.606 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.606 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:02.606 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411483+0000", 2024-09-12T22:32:02.606 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00017316 2024-09-12T22:32:02.607 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:02.607 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:02.607 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:02.607 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.607 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.607 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "pg_update_log_missing(3.1a epoch 19/17 rep_tid 0 entries 19'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T22:32:02.607 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.410617+0000", 2024-09-12T22:32:02.607 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 25.110556461000002, 2024-09-12T22:32:02.607 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0030439709999999999, 2024-09-12T22:32:02.607 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:02.607 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:02.607 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "reached pg", 2024-09-12T22:32:02.607 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:02.607 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.608 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:02.608 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410617+0000", 2024-09-12T22:32:02.608 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:02.608 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.608 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.608 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:02.608 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410617+0000", 2024-09-12T22:32:02.608 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:02.608 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.608 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.608 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:02.608 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410617+0000", 2024-09-12T22:32:02.608 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3599999999999999e-07 2024-09-12T22:32:02.609 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.609 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.609 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:02.609 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410625+0000", 2024-09-12T22:32:02.609 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5410000000000003e-06 2024-09-12T22:32:02.609 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.609 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.609 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:02.609 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410638+0000", 2024-09-12T22:32:02.609 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3261999999999999e-05 2024-09-12T22:32:02.609 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.609 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.609 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:02.609 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410653+0000", 2024-09-12T22:32:02.610 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4844000000000001e-05 2024-09-12T22:32:02.610 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.610 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.610 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:02.610 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410814+0000", 2024-09-12T22:32:02.610 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00016119999999999999 2024-09-12T22:32:02.610 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.610 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.610 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:02.610 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413661+0000", 2024-09-12T22:32:02.610 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0028467879999999998 2024-09-12T22:32:02.610 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:02.610 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:02.610 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:02.611 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.611 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.611 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-09-12T22:32:02.611 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:39.398875+0000", 2024-09-12T22:32:02.611 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 23.122298181000001, 2024-09-12T22:32:02.611 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0015679069999999999, 2024-09-12T22:32:02.611 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:02.611 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:02.611 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:02.611 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:02.611 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.611 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:02.611 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398875+0000", 2024-09-12T22:32:02.612 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:02.612 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.612 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.612 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:02.612 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398875+0000", 2024-09-12T22:32:02.612 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:02.612 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.612 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.612 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:02.612 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398878+0000", 2024-09-12T22:32:02.612 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1679999999999998e-06 2024-09-12T22:32:02.612 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.612 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.613 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:02.613 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398888+0000", 2024-09-12T22:32:02.613 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.084e-05 2024-09-12T22:32:02.613 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.613 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.613 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:02.613 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398906+0000", 2024-09-12T22:32:02.613 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7518000000000001e-05 2024-09-12T22:32:02.613 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.613 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.613 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:02.613 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398914+0000", 2024-09-12T22:32:02.613 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5989999999999996e-06 2024-09-12T22:32:02.613 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.614 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.614 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:02.614 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398974+0000", 2024-09-12T22:32:02.614 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0988e-05 2024-09-12T22:32:02.614 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.614 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.614 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:02.614 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.399078+0000", 2024-09-12T22:32:02.614 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000103133 2024-09-12T22:32:02.614 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.614 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.614 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:02.614 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.399166+0000", 2024-09-12T22:32:02.614 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.8183999999999995e-05 2024-09-12T22:32:02.615 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.615 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.615 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:02.615 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.399747+0000", 2024-09-12T22:32:02.615 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00058110599999999996 2024-09-12T22:32:02.615 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.615 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.615 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:02.615 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.400377+0000", 2024-09-12T22:32:02.615 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000630157 2024-09-12T22:32:02.615 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.615 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.615 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:02.616 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.400415+0000", 2024-09-12T22:32:02.616 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7814000000000001e-05 2024-09-12T22:32:02.616 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.616 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.616 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:02.616 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.400443+0000", 2024-09-12T22:32:02.616 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8399999999999999e-05 2024-09-12T22:32:02.616 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:02.616 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:02.616 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:02.616 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.616 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.616 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e23)", 2024-09-12T22:32:02.617 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:58.400966+0000", 2024-09-12T22:32:02.617 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 4.1202072730000001, 2024-09-12T22:32:02.617 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001468876, 2024-09-12T22:32:02.617 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:02.617 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:02.617 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:02.617 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:02.617 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.617 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:02.617 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400966+0000", 2024-09-12T22:32:02.617 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:02.617 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.617 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.617 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:02.618 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400966+0000", 2024-09-12T22:32:02.618 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:02.618 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.618 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.618 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:02.618 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400967+0000", 2024-09-12T22:32:02.618 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.046e-06 2024-09-12T22:32:02.618 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.618 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.618 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:02.618 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400974+0000", 2024-09-12T22:32:02.618 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2310000000000001e-06 2024-09-12T22:32:02.618 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.618 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.619 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:02.619 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400988+0000", 2024-09-12T22:32:02.619 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4482e-05 2024-09-12T22:32:02.619 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.619 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.619 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:02.619 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400997+0000", 2024-09-12T22:32:02.619 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.0189999999999995e-06 2024-09-12T22:32:02.619 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.619 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.619 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:02.619 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.401068+0000", 2024-09-12T22:32:02.619 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1426000000000004e-05 2024-09-12T22:32:02.619 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.620 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.620 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:02.620 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.401174+0000", 2024-09-12T22:32:02.620 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000105769 2024-09-12T22:32:02.620 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.620 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.620 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:02.620 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.401335+0000", 2024-09-12T22:32:02.620 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000161225 2024-09-12T22:32:02.620 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.620 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.620 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:02.620 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.402110+0000", 2024-09-12T22:32:02.620 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00077428800000000004 2024-09-12T22:32:02.621 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.621 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.621 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:02.621 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.402333+0000", 2024-09-12T22:32:02.621 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000223723 2024-09-12T22:32:02.621 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.621 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.621 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:02.621 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.402388+0000", 2024-09-12T22:32:02.621 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4700999999999997e-05 2024-09-12T22:32:02.621 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:02.621 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:02.621 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:02.621 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.402435+0000", 2024-09-12T22:32:02.622 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6965999999999997e-05 2024-09-12T22:32:02.622 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:02.622 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:02.622 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:02.622 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:02.622 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:02.622 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:32:02.624 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:32:02.624 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:02.622+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:02.725 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:02.723+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:02.739 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-09-12T22:32:02.739 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-09-12T22:32:02.739 INFO:teuthology.orchestra.run.smithi163.stdout: "num_ops": 0 2024-09-12T22:32:02.739 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-09-12T22:32:02.748 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:32:02.832 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:02.831+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:02.893 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-09-12T22:32:02.893 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-09-12T22:32:02.893 INFO:teuthology.orchestra.run.smithi163.stdout: "complaint_time": 30, 2024-09-12T22:32:02.893 INFO:teuthology.orchestra.run.smithi163.stdout: "num_blocked_ops": 0 2024-09-12T22:32:02.893 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-09-12T22:32:02.901 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:32:02.942 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:02.941+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:03.027 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:03.026+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:03.046 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-09-12T22:32:03.047 INFO:teuthology.orchestra.run.smithi163.stdout: "size": 20, 2024-09-12T22:32:03.047 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 600, 2024-09-12T22:32:03.047 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2024-09-12T22:32:03.047 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.047 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-09-12T22:32:03.047 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:27.254459+0000", 2024-09-12T22:32:03.047 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 35.790020067999997, 2024-09-12T22:32:03.047 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.37816283899999997, 2024-09-12T22:32:03.047 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:03.047 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:03.047 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:03.047 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:03.047 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:03.048 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:03.048 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 1 2024-09-12T22:32:03.048 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.048 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:03.048 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.048 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:03.048 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254459+0000", 2024-09-12T22:32:03.048 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:03.048 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.048 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.048 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:03.048 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254459+0000", 2024-09-12T22:32:03.049 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:03.049 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.049 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.049 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:03.049 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254460+0000", 2024-09-12T22:32:03.049 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1739999999999999e-06 2024-09-12T22:32:03.050 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.050 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.050 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:03.050 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254472+0000", 2024-09-12T22:32:03.050 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2207e-05 2024-09-12T22:32:03.050 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.050 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.050 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:03.050 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254483+0000", 2024-09-12T22:32:03.050 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0631999999999999e-05 2024-09-12T22:32:03.050 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.050 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.050 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:03.051 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254492+0000", 2024-09-12T22:32:03.051 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3670000000000003e-06 2024-09-12T22:32:03.051 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.051 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.051 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:03.051 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254551+0000", 2024-09-12T22:32:03.051 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8687999999999998e-05 2024-09-12T22:32:03.051 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.051 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.051 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for peered", 2024-09-12T22:32:03.051 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254562+0000", 2024-09-12T22:32:03.051 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1249e-05 2024-09-12T22:32:03.051 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.052 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.052 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:03.052 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.631211+0000", 2024-09-12T22:32:03.052 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.376649018 2024-09-12T22:32:03.052 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.052 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.052 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:03.052 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.631345+0000", 2024-09-12T22:32:03.052 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013378700000000001 2024-09-12T22:32:03.052 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.052 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.052 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:03.052 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.631479+0000", 2024-09-12T22:32:03.053 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013352399999999999 2024-09-12T22:32:03.053 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.053 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.053 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:03.053 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632324+0000", 2024-09-12T22:32:03.053 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00084508100000000002 2024-09-12T22:32:03.053 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.053 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.053 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:03.053 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632548+0000", 2024-09-12T22:32:03.053 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000224329 2024-09-12T22:32:03.053 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.053 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.054 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:03.054 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632591+0000", 2024-09-12T22:32:03.054 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2564000000000001e-05 2024-09-12T22:32:03.054 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.054 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.054 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:03.054 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632622+0000", 2024-09-12T22:32:03.054 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1219e-05 2024-09-12T22:32:03.054 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:03.054 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:03.054 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:03.055 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.055 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.055 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:185 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:32:03.055 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394355+0000", 2024-09-12T22:32:03.055 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 34.650123970999999, 2024-09-12T22:32:03.055 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011302394, 2024-09-12T22:32:03.055 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:03.055 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:03.055 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:03.055 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:03.055 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:03.055 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:03.055 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 185 2024-09-12T22:32:03.056 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.056 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:03.056 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.056 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:03.056 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394355+0000", 2024-09-12T22:32:03.056 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:03.056 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.056 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.056 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:03.056 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394355+0000", 2024-09-12T22:32:03.056 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:03.056 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.056 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.057 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:03.057 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394355+0000", 2024-09-12T22:32:03.057 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9099999999999999e-07 2024-09-12T22:32:03.057 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.057 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.057 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:03.057 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394385+0000", 2024-09-12T22:32:03.057 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9963000000000001e-05 2024-09-12T22:32:03.057 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.057 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.057 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:03.057 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394390+0000", 2024-09-12T22:32:03.057 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8420000000000004e-06 2024-09-12T22:32:03.057 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.058 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.058 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:03.058 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394393+0000", 2024-09-12T22:32:03.058 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1e-06 2024-09-12T22:32:03.058 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.058 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.058 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:03.058 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.400546+0000", 2024-09-12T22:32:03.058 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0061523309999999996 2024-09-12T22:32:03.058 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.058 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.058 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:03.058 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.400588+0000", 2024-09-12T22:32:03.059 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1835000000000002e-05 2024-09-12T22:32:03.059 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.059 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.059 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:03.059 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.400677+0000", 2024-09-12T22:32:03.059 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9195000000000002e-05 2024-09-12T22:32:03.059 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.059 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.059 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:03.059 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405378+0000", 2024-09-12T22:32:03.059 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0047008659999999997 2024-09-12T22:32:03.059 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.059 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.059 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:03.060 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405569+0000", 2024-09-12T22:32:03.060 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00019148599999999999 2024-09-12T22:32:03.060 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.060 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.060 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:03.060 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405620+0000", 2024-09-12T22:32:03.060 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1416999999999999e-05 2024-09-12T22:32:03.060 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.060 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.060 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:03.060 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405657+0000", 2024-09-12T22:32:03.060 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6968000000000002e-05 2024-09-12T22:32:03.060 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:03.060 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:03.061 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:03.061 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.061 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.061 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:32:03.061 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394399+0000", 2024-09-12T22:32:03.061 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 34.650079759999997, 2024-09-12T22:32:03.061 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011336601999999999, 2024-09-12T22:32:03.061 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:03.061 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:03.061 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:03.061 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:03.061 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:03.062 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:03.062 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 186 2024-09-12T22:32:03.062 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.062 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:03.062 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.062 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:03.062 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394399+0000", 2024-09-12T22:32:03.062 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:03.062 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.062 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.062 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:03.062 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394399+0000", 2024-09-12T22:32:03.062 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:03.062 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.063 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.063 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:03.063 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394400+0000", 2024-09-12T22:32:03.063 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4499999999999998e-07 2024-09-12T22:32:03.063 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.063 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.063 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:03.063 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394402+0000", 2024-09-12T22:32:03.063 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.875e-06 2024-09-12T22:32:03.063 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.063 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.063 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:03.063 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394405+0000", 2024-09-12T22:32:03.064 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6799999999999999e-06 2024-09-12T22:32:03.064 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.064 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.064 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:03.064 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394408+0000", 2024-09-12T22:32:03.064 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.667e-06 2024-09-12T22:32:03.064 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.064 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.064 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:03.064 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401395+0000", 2024-09-12T22:32:03.064 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0069867230000000002 2024-09-12T22:32:03.064 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.064 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.064 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:03.065 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401438+0000", 2024-09-12T22:32:03.065 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3554999999999999e-05 2024-09-12T22:32:03.065 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.065 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.065 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:03.065 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401509+0000", 2024-09-12T22:32:03.065 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0631999999999997e-05 2024-09-12T22:32:03.065 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.065 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.065 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:03.065 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405392+0000", 2024-09-12T22:32:03.065 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0038830449999999999 2024-09-12T22:32:03.065 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.066 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.066 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:03.066 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405690+0000", 2024-09-12T22:32:03.066 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000298435 2024-09-12T22:32:03.066 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.066 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.066 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:03.066 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405716+0000", 2024-09-12T22:32:03.066 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5435999999999998e-05 2024-09-12T22:32:03.066 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.066 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.066 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:03.066 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405736+0000", 2024-09-12T22:32:03.067 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0208999999999999e-05 2024-09-12T22:32:03.067 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:03.067 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:03.068 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:03.068 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.068 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.068 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:32:03.068 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394411+0000", 2024-09-12T22:32:03.068 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 34.650067634000003, 2024-09-12T22:32:03.068 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011400117, 2024-09-12T22:32:03.068 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:03.068 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:03.068 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:03.068 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:03.069 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:03.069 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:03.069 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 187 2024-09-12T22:32:03.069 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.069 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:03.069 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.069 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:03.069 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394411+0000", 2024-09-12T22:32:03.069 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:03.069 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.069 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.069 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:03.070 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394411+0000", 2024-09-12T22:32:03.070 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:03.070 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.070 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.070 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:03.070 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394412+0000", 2024-09-12T22:32:03.070 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.4999999999999999e-07 2024-09-12T22:32:03.070 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.070 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.070 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:03.070 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394414+0000", 2024-09-12T22:32:03.070 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.984e-06 2024-09-12T22:32:03.070 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.070 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.071 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:03.071 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394418+0000", 2024-09-12T22:32:03.071 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0840000000000002e-06 2024-09-12T22:32:03.071 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.071 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.071 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:03.071 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394431+0000", 2024-09-12T22:32:03.071 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.361e-05 2024-09-12T22:32:03.071 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.071 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.071 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:03.071 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401778+0000", 2024-09-12T22:32:03.071 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0073462659999999997 2024-09-12T22:32:03.072 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.072 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.072 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:03.072 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401853+0000", 2024-09-12T22:32:03.072 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5797000000000006e-05 2024-09-12T22:32:03.072 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.073 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.073 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:03.073 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401990+0000", 2024-09-12T22:32:03.073 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013651399999999999 2024-09-12T22:32:03.073 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.073 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.073 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:03.073 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405402+0000", 2024-09-12T22:32:03.073 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0034116070000000001 2024-09-12T22:32:03.073 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.074 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.074 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:03.074 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405764+0000", 2024-09-12T22:32:03.075 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00036234899999999998 2024-09-12T22:32:03.075 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.076 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.076 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:03.077 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405791+0000", 2024-09-12T22:32:03.081 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7029000000000002e-05 2024-09-12T22:32:03.082 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.082 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.082 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:03.082 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405812+0000", 2024-09-12T22:32:03.083 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0627000000000001e-05 2024-09-12T22:32:03.083 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:03.083 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:03.084 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:03.084 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.084 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.085 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:32:03.085 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394447+0000", 2024-09-12T22:32:03.085 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 34.650032482999997, 2024-09-12T22:32:03.085 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011759588, 2024-09-12T22:32:03.085 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:03.085 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:03.086 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:03.086 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:03.086 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:03.086 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:03.086 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 188 2024-09-12T22:32:03.086 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.087 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:03.087 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.087 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:03.087 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394447+0000", 2024-09-12T22:32:03.087 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:03.088 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.088 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.088 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:03.088 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394447+0000", 2024-09-12T22:32:03.089 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:03.089 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.089 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.089 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:03.090 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394447+0000", 2024-09-12T22:32:03.090 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.15e-07 2024-09-12T22:32:03.090 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.091 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.091 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:03.091 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394512+0000", 2024-09-12T22:32:03.092 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4580999999999997e-05 2024-09-12T22:32:03.092 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.092 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.093 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:03.093 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394518+0000", 2024-09-12T22:32:03.093 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.3380000000000001e-06 2024-09-12T22:32:03.093 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.094 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.094 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:03.094 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394521+0000", 2024-09-12T22:32:03.094 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3340000000000002e-06 2024-09-12T22:32:03.094 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.095 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.095 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:03.095 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.402628+0000", 2024-09-12T22:32:03.095 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.008106996 2024-09-12T22:32:03.096 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.096 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.096 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:03.096 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.402670+0000", 2024-09-12T22:32:03.097 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1983000000000001e-05 2024-09-12T22:32:03.098 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.098 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.098 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:03.099 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.402738+0000", 2024-09-12T22:32:03.099 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.8114999999999994e-05 2024-09-12T22:32:03.099 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.099 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.099 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:03.099 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405668+0000", 2024-09-12T22:32:03.099 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.002929545 2024-09-12T22:32:03.099 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.099 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.100 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:03.100 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406162+0000", 2024-09-12T22:32:03.100 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000494408 2024-09-12T22:32:03.100 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.100 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.100 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:03.100 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406188+0000", 2024-09-12T22:32:03.100 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5766e-05 2024-09-12T22:32:03.100 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.100 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.101 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:03.102 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406206+0000", 2024-09-12T22:32:03.102 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.8107000000000001e-05 2024-09-12T22:32:03.102 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:03.103 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:03.103 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:03.103 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.104 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.104 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:32:03.104 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394528+0000", 2024-09-12T22:32:03.105 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 34.649950814, 2024-09-12T22:32:03.105 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.01195536, 2024-09-12T22:32:03.105 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:03.106 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:03.107 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:03.107 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:03.107 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:03.107 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:03.107 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 189 2024-09-12T22:32:03.107 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.107 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:03.107 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.108 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:03.108 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394528+0000", 2024-09-12T22:32:03.108 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:03.109 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.109 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.110 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:03.110 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394528+0000", 2024-09-12T22:32:03.110 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:03.110 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.111 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.111 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:03.111 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394529+0000", 2024-09-12T22:32:03.111 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4900000000000001e-07 2024-09-12T22:32:03.111 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.112 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.112 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:03.112 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394531+0000", 2024-09-12T22:32:03.113 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.458e-06 2024-09-12T22:32:03.113 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.113 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.113 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:03.113 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394535+0000", 2024-09-12T22:32:03.114 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7900000000000001e-06 2024-09-12T22:32:03.114 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.114 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.114 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:03.115 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394537+0000", 2024-09-12T22:32:03.115 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.632e-06 2024-09-12T22:32:03.115 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.115 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.115 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:03.115 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.404932+0000", 2024-09-12T22:32:03.116 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010394158000000001 2024-09-12T22:32:03.116 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.116 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.116 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:03.116 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405017+0000", 2024-09-12T22:32:03.116 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5525000000000005e-05 2024-09-12T22:32:03.116 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.117 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.117 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:03.117 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405114+0000", 2024-09-12T22:32:03.117 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.6527000000000006e-05 2024-09-12T22:32:03.117 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.118 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.118 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:03.118 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405818+0000", 2024-09-12T22:32:03.119 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00070412800000000005 2024-09-12T22:32:03.119 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.119 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.119 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:03.120 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406437+0000", 2024-09-12T22:32:03.120 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00061898900000000002 2024-09-12T22:32:03.120 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.120 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.120 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:03.121 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406463+0000", 2024-09-12T22:32:03.121 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6268e-05 2024-09-12T22:32:03.121 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.121 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.121 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:03.121 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406484+0000", 2024-09-12T22:32:03.122 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0536000000000001e-05 2024-09-12T22:32:03.122 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:03.122 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:03.122 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:03.122 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.122 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.122 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:03.122 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.401422+0000", 2024-09-12T22:32:03.122 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 25.643056908999998, 2024-09-12T22:32:03.122 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016896452999999999, 2024-09-12T22:32:03.123 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:03.123 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:03.123 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:03.123 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:03.123 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.123 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:03.124 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401422+0000", 2024-09-12T22:32:03.124 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:03.124 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.124 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.124 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:03.124 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401422+0000", 2024-09-12T22:32:03.124 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:03.125 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.125 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.125 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:03.125 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401424+0000", 2024-09-12T22:32:03.125 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9e-06 2024-09-12T22:32:03.125 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.126 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.126 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:03.126 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401437+0000", 2024-09-12T22:32:03.126 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2831e-05 2024-09-12T22:32:03.126 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.126 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.126 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:03.126 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401471+0000", 2024-09-12T22:32:03.126 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4010000000000001e-05 2024-09-12T22:32:03.126 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.127 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.127 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:03.127 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401484+0000", 2024-09-12T22:32:03.127 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2711000000000001e-05 2024-09-12T22:32:03.127 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.127 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.127 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:03.127 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405410+0000", 2024-09-12T22:32:03.127 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0039259170000000001 2024-09-12T22:32:03.127 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.128 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.128 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:03.128 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405529+0000", 2024-09-12T22:32:03.128 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000119778 2024-09-12T22:32:03.128 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.128 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.128 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:03.128 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405655+0000", 2024-09-12T22:32:03.128 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012556700000000001 2024-09-12T22:32:03.129 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.129 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.129 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:03.129 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410456+0000", 2024-09-12T22:32:03.129 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0048008269999999997 2024-09-12T22:32:03.129 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.129 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.129 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:03.129 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418226+0000", 2024-09-12T22:32:03.129 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0077707729999999999 2024-09-12T22:32:03.129 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.129 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.129 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:03.130 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418277+0000", 2024-09-12T22:32:03.130 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0476000000000003e-05 2024-09-12T22:32:03.130 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.130 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.130 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:03.130 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418319+0000", 2024-09-12T22:32:03.130 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1662999999999997e-05 2024-09-12T22:32:03.130 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:03.130 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:03.130 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:03.131 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.131 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.131 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:03.131 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.401505+0000", 2024-09-12T22:32:03.131 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 25.642974245000001, 2024-09-12T22:32:03.131 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016987904000000002, 2024-09-12T22:32:03.131 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:03.131 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:03.131 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:03.131 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:03.132 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.132 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:03.132 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401505+0000", 2024-09-12T22:32:03.132 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:03.132 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.132 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.132 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:03.132 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401505+0000", 2024-09-12T22:32:03.132 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:03.132 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.132 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.133 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:03.133 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401506+0000", 2024-09-12T22:32:03.133 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4700000000000001e-07 2024-09-12T22:32:03.133 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.133 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.133 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:03.133 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401510+0000", 2024-09-12T22:32:03.133 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6609999999999999e-06 2024-09-12T22:32:03.133 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.133 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.133 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:03.133 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401771+0000", 2024-09-12T22:32:03.134 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00026110700000000001 2024-09-12T22:32:03.134 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.134 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.134 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:03.134 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401921+0000", 2024-09-12T22:32:03.134 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014939099999999999 2024-09-12T22:32:03.134 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.134 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.134 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:03.134 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405944+0000", 2024-09-12T22:32:03.134 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0040235449999999999 2024-09-12T22:32:03.135 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.135 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.135 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:03.135 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406018+0000", 2024-09-12T22:32:03.135 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3373000000000004e-05 2024-09-12T22:32:03.135 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.135 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.135 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:03.135 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406172+0000", 2024-09-12T22:32:03.135 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00015435399999999999 2024-09-12T22:32:03.135 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.135 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.135 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:03.136 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410461+0000", 2024-09-12T22:32:03.136 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0042888609999999997 2024-09-12T22:32:03.136 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.136 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.136 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:03.136 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418371+0000", 2024-09-12T22:32:03.136 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0079098380000000006 2024-09-12T22:32:03.136 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.136 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.136 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:03.136 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418443+0000", 2024-09-12T22:32:03.136 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2705000000000003e-05 2024-09-12T22:32:03.136 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.137 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.137 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:03.137 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418493+0000", 2024-09-12T22:32:03.137 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9322e-05 2024-09-12T22:32:03.137 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:03.137 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:03.137 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:03.137 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.137 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.137 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:03.138 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.401939+0000", 2024-09-12T22:32:03.138 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 25.642540509, 2024-09-12T22:32:03.138 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016722292999999999, 2024-09-12T22:32:03.138 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:03.138 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:03.138 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:03.138 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:03.139 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.139 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:03.139 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401939+0000", 2024-09-12T22:32:03.139 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:03.139 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.139 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.139 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:03.139 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401939+0000", 2024-09-12T22:32:03.139 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:03.139 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.139 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.140 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:03.140 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401940+0000", 2024-09-12T22:32:03.140 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1990000000000001e-06 2024-09-12T22:32:03.140 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.140 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.140 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:03.140 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401956+0000", 2024-09-12T22:32:03.140 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.6344000000000001e-05 2024-09-12T22:32:03.140 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.140 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.140 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:03.140 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401974+0000", 2024-09-12T22:32:03.140 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7730000000000001e-05 2024-09-12T22:32:03.141 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.141 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.141 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:03.141 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401982+0000", 2024-09-12T22:32:03.141 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.7800000000000001e-06 2024-09-12T22:32:03.141 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.141 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.141 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:03.141 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406557+0000", 2024-09-12T22:32:03.141 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0045758489999999999 2024-09-12T22:32:03.141 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.141 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.142 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:03.142 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406697+0000", 2024-09-12T22:32:03.142 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013925100000000001 2024-09-12T22:32:03.142 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.142 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.142 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:03.142 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406830+0000", 2024-09-12T22:32:03.142 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013293499999999999 2024-09-12T22:32:03.142 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.142 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.142 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:03.142 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410465+0000", 2024-09-12T22:32:03.142 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0036352680000000001 2024-09-12T22:32:03.143 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.143 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.143 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:03.143 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418564+0000", 2024-09-12T22:32:03.143 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0080992140000000004 2024-09-12T22:32:03.143 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.143 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.143 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:03.143 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418621+0000", 2024-09-12T22:32:03.143 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7167999999999999e-05 2024-09-12T22:32:03.143 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.143 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.143 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:03.144 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418661+0000", 2024-09-12T22:32:03.144 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9555000000000003e-05 2024-09-12T22:32:03.144 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:03.144 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:03.144 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:03.144 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.144 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.144 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:03.145 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.401994+0000", 2024-09-12T22:32:03.145 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 25.642484636999999, 2024-09-12T22:32:03.145 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016804109000000001, 2024-09-12T22:32:03.145 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:03.145 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:03.145 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:03.145 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:03.145 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.146 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:03.146 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401994+0000", 2024-09-12T22:32:03.146 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:03.146 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.146 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.146 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:03.146 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401994+0000", 2024-09-12T22:32:03.146 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:03.146 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.147 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.147 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:03.147 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401995+0000", 2024-09-12T22:32:03.147 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.8899999999999998e-07 2024-09-12T22:32:03.147 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.147 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.147 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:03.147 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402000+0000", 2024-09-12T22:32:03.147 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.498e-06 2024-09-12T22:32:03.148 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.148 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.148 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:03.148 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402007+0000", 2024-09-12T22:32:03.148 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.554e-06 2024-09-12T22:32:03.148 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.148 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.148 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:03.149 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402046+0000", 2024-09-12T22:32:03.149 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9156000000000003e-05 2024-09-12T22:32:03.149 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.149 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.149 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:03.149 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407342+0000", 2024-09-12T22:32:03.149 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052957610000000004 2024-09-12T22:32:03.149 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.149 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.149 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:03.149 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407521+0000", 2024-09-12T22:32:03.149 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00017878100000000001 2024-09-12T22:32:03.149 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.150 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.150 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:03.150 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407641+0000", 2024-09-12T22:32:03.150 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012013 2024-09-12T22:32:03.150 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.150 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.150 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:03.150 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410472+0000", 2024-09-12T22:32:03.150 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.002830455 2024-09-12T22:32:03.150 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.150 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.151 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:03.151 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418714+0000", 2024-09-12T22:32:03.151 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0082422789999999999 2024-09-12T22:32:03.151 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.151 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.151 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:03.151 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418761+0000", 2024-09-12T22:32:03.151 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6956999999999998e-05 2024-09-12T22:32:03.151 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.151 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.151 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:03.152 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418799+0000", 2024-09-12T22:32:03.152 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7749000000000001e-05 2024-09-12T22:32:03.152 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:03.152 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:03.152 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:03.152 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.152 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.152 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:03.152 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.402060+0000", 2024-09-12T22:32:03.152 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 25.642419192999999, 2024-09-12T22:32:03.153 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016885686, 2024-09-12T22:32:03.153 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:03.153 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:03.153 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:03.153 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:03.153 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.153 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:03.153 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402060+0000", 2024-09-12T22:32:03.153 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:03.153 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.154 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.154 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:03.154 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402060+0000", 2024-09-12T22:32:03.154 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:03.154 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.154 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.154 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:03.154 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402061+0000", 2024-09-12T22:32:03.154 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4399999999999999e-07 2024-09-12T22:32:03.154 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.155 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.155 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:03.155 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402066+0000", 2024-09-12T22:32:03.155 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8649999999999998e-06 2024-09-12T22:32:03.155 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.155 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.155 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:03.155 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402146+0000", 2024-09-12T22:32:03.155 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9054000000000006e-05 2024-09-12T22:32:03.156 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.156 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.156 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:03.156 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402287+0000", 2024-09-12T22:32:03.156 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014108600000000001 2024-09-12T22:32:03.156 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.156 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.156 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:03.156 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408185+0000", 2024-09-12T22:32:03.156 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0058983919999999997 2024-09-12T22:32:03.157 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.157 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.157 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:03.157 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408299+0000", 2024-09-12T22:32:03.157 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114102 2024-09-12T22:32:03.157 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.158 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.158 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:03.158 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408420+0000", 2024-09-12T22:32:03.158 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000120492 2024-09-12T22:32:03.158 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.158 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.158 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:03.158 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410867+0000", 2024-09-12T22:32:03.158 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0024476430000000002 2024-09-12T22:32:03.159 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.159 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.159 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:03.159 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418851+0000", 2024-09-12T22:32:03.159 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0079841489999999994 2024-09-12T22:32:03.159 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.159 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.159 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:03.159 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418894+0000", 2024-09-12T22:32:03.159 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3090000000000002e-05 2024-09-12T22:32:03.159 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.159 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.160 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:03.160 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418946+0000", 2024-09-12T22:32:03.160 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1069000000000002e-05 2024-09-12T22:32:03.160 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:03.160 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:03.160 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:03.160 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.160 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.160 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:03.160 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.402375+0000", 2024-09-12T22:32:03.161 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 25.642104128, 2024-09-12T22:32:03.161 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016768531999999999, 2024-09-12T22:32:03.161 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:03.161 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:03.161 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:03.161 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:03.161 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.161 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:03.161 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402375+0000", 2024-09-12T22:32:03.161 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:03.161 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.161 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.161 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:03.161 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402375+0000", 2024-09-12T22:32:03.162 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:03.162 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.162 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.162 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:03.162 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402375+0000", 2024-09-12T22:32:03.162 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4099999999999999e-07 2024-09-12T22:32:03.162 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.162 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.162 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:03.162 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402379+0000", 2024-09-12T22:32:03.162 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9870000000000001e-06 2024-09-12T22:32:03.162 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.162 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.163 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:03.163 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402389+0000", 2024-09-12T22:32:03.163 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0000000000000001e-05 2024-09-12T22:32:03.163 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.163 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.163 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:03.163 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402401+0000", 2024-09-12T22:32:03.163 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.148e-05 2024-09-12T22:32:03.163 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.163 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.163 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:03.163 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409108+0000", 2024-09-12T22:32:03.164 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0067068429999999997 2024-09-12T22:32:03.164 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.164 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.164 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:03.164 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409189+0000", 2024-09-12T22:32:03.164 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0815999999999993e-05 2024-09-12T22:32:03.164 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.164 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.164 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:03.164 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409320+0000", 2024-09-12T22:32:03.164 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000131586 2024-09-12T22:32:03.164 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.164 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.164 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:03.165 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410872+0000", 2024-09-12T22:32:03.165 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0015521599999999999 2024-09-12T22:32:03.165 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.165 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.165 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:03.165 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419049+0000", 2024-09-12T22:32:03.165 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0081763719999999995 2024-09-12T22:32:03.165 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.165 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.165 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:03.165 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419107+0000", 2024-09-12T22:32:03.165 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7899000000000002e-05 2024-09-12T22:32:03.165 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.166 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.166 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:03.166 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419143+0000", 2024-09-12T22:32:03.166 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6847999999999997e-05 2024-09-12T22:32:03.166 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:03.166 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:03.166 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:03.166 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.166 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.166 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:03.166 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.402903+0000", 2024-09-12T22:32:03.166 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 25.641575715999998, 2024-09-12T22:32:03.166 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016378428, 2024-09-12T22:32:03.167 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:03.167 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:03.167 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:03.167 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:03.167 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.167 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:03.167 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402903+0000", 2024-09-12T22:32:03.167 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:03.167 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.167 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.167 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:03.167 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402903+0000", 2024-09-12T22:32:03.167 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:03.167 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.168 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.168 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:03.168 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402904+0000", 2024-09-12T22:32:03.168 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9500000000000001e-07 2024-09-12T22:32:03.168 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.168 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.168 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:03.168 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402944+0000", 2024-09-12T22:32:03.168 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0265000000000002e-05 2024-09-12T22:32:03.168 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.168 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.168 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:03.168 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402979+0000", 2024-09-12T22:32:03.169 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4378000000000002e-05 2024-09-12T22:32:03.169 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.169 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.169 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:03.169 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402987+0000", 2024-09-12T22:32:03.169 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3559999999999993e-06 2024-09-12T22:32:03.169 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.169 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.169 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:03.169 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409577+0000", 2024-09-12T22:32:03.169 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0065901709999999997 2024-09-12T22:32:03.169 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.169 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.169 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:03.170 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409653+0000", 2024-09-12T22:32:03.170 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5819e-05 2024-09-12T22:32:03.170 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.170 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.170 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:03.170 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409725+0000", 2024-09-12T22:32:03.170 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2200000000000007e-05 2024-09-12T22:32:03.170 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.170 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.170 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:03.170 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.411234+0000", 2024-09-12T22:32:03.171 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001508225 2024-09-12T22:32:03.171 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.171 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.171 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:03.171 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419212+0000", 2024-09-12T22:32:03.171 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0079783400000000004 2024-09-12T22:32:03.171 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.171 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.171 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:03.171 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419244+0000", 2024-09-12T22:32:03.171 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2384e-05 2024-09-12T22:32:03.171 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.172 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.172 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:03.172 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419282+0000", 2024-09-12T22:32:03.172 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7394999999999997e-05 2024-09-12T22:32:03.172 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:03.172 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:03.172 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:03.172 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.172 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.172 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:03.173 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.403135+0000", 2024-09-12T22:32:03.173 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 25.641343846000002, 2024-09-12T22:32:03.173 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016294211999999999, 2024-09-12T22:32:03.173 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:03.173 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:03.173 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:03.173 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:03.173 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.173 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:03.173 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403135+0000", 2024-09-12T22:32:03.173 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:03.173 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.173 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.174 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:03.174 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403135+0000", 2024-09-12T22:32:03.174 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:03.174 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.174 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.174 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:03.174 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403136+0000", 2024-09-12T22:32:03.174 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.4e-07 2024-09-12T22:32:03.174 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.174 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.174 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:03.175 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403149+0000", 2024-09-12T22:32:03.175 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2723e-05 2024-09-12T22:32:03.175 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.175 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.175 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:03.175 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403158+0000", 2024-09-12T22:32:03.175 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3919999999999992e-06 2024-09-12T22:32:03.175 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.175 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.175 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:03.175 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403166+0000", 2024-09-12T22:32:03.176 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.2309999999999996e-06 2024-09-12T22:32:03.176 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.176 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.176 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:03.176 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409944+0000", 2024-09-12T22:32:03.176 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0067775309999999998 2024-09-12T22:32:03.176 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.176 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.176 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:03.176 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410032+0000", 2024-09-12T22:32:03.176 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.7906999999999997e-05 2024-09-12T22:32:03.176 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.177 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.177 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:03.177 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410152+0000", 2024-09-12T22:32:03.177 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012037800000000001 2024-09-12T22:32:03.177 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.177 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.177 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:03.177 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.411945+0000", 2024-09-12T22:32:03.177 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0017931850000000001 2024-09-12T22:32:03.177 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.177 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.177 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:03.177 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419319+0000", 2024-09-12T22:32:03.178 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0073731780000000002 2024-09-12T22:32:03.178 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.178 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.178 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:03.178 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419376+0000", 2024-09-12T22:32:03.178 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7728e-05 2024-09-12T22:32:03.178 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.178 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.178 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:03.178 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419429+0000", 2024-09-12T22:32:03.178 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3019000000000002e-05 2024-09-12T22:32:03.179 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:03.179 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:03.179 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:03.179 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.179 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.179 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:03.179 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.403185+0000", 2024-09-12T22:32:03.179 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 25.641293964999999, 2024-09-12T22:32:03.180 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.014902164000000001, 2024-09-12T22:32:03.180 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:03.180 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:03.180 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:03.180 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:03.180 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.180 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:03.180 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403185+0000", 2024-09-12T22:32:03.180 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:03.180 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.180 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.180 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:03.181 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403185+0000", 2024-09-12T22:32:03.181 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:03.181 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.181 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.181 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:03.181 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403186+0000", 2024-09-12T22:32:03.181 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9400000000000005e-07 2024-09-12T22:32:03.181 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.182 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.182 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:03.182 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403191+0000", 2024-09-12T22:32:03.182 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6980000000000003e-06 2024-09-12T22:32:03.182 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.182 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.182 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:03.182 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403199+0000", 2024-09-12T22:32:03.182 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2520000000000002e-06 2024-09-12T22:32:03.182 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.182 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.183 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:03.183 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403205+0000", 2024-09-12T22:32:03.183 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.908e-06 2024-09-12T22:32:03.183 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.183 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.183 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:03.183 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403359+0000", 2024-09-12T22:32:03.183 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000154544 2024-09-12T22:32:03.183 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.184 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.184 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:03.184 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403528+0000", 2024-09-12T22:32:03.184 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000168455 2024-09-12T22:32:03.184 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.184 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.184 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:03.184 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403763+0000", 2024-09-12T22:32:03.184 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00023539599999999999 2024-09-12T22:32:03.184 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.184 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.185 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:03.185 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409378+0000", 2024-09-12T22:32:03.185 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056150000000000002 2024-09-12T22:32:03.185 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.185 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.185 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:03.185 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418012+0000", 2024-09-12T22:32:03.185 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0086339559999999999 2024-09-12T22:32:03.186 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.186 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.186 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:03.186 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418046+0000", 2024-09-12T22:32:03.186 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4267999999999998e-05 2024-09-12T22:32:03.186 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.186 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.186 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:03.186 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418087+0000", 2024-09-12T22:32:03.186 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0992999999999999e-05 2024-09-12T22:32:03.187 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:03.187 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:03.187 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:03.187 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.187 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.187 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:03.187 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.403273+0000", 2024-09-12T22:32:03.187 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 25.641206014000002, 2024-09-12T22:32:03.187 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.014934866, 2024-09-12T22:32:03.188 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:03.188 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:03.188 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:03.188 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:03.188 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.188 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:03.188 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403273+0000", 2024-09-12T22:32:03.188 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:03.188 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.188 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.189 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:03.189 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403273+0000", 2024-09-12T22:32:03.189 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:03.189 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.189 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.189 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:03.189 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403274+0000", 2024-09-12T22:32:03.189 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.297e-06 2024-09-12T22:32:03.189 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.189 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.190 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:03.190 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403282+0000", 2024-09-12T22:32:03.190 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6340000000000001e-06 2024-09-12T22:32:03.190 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.190 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.190 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:03.190 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403305+0000", 2024-09-12T22:32:03.190 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3149000000000001e-05 2024-09-12T22:32:03.190 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.190 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.190 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:03.190 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403320+0000", 2024-09-12T22:32:03.190 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4527e-05 2024-09-12T22:32:03.191 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.191 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.191 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:03.191 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.404928+0000", 2024-09-12T22:32:03.191 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001608459 2024-09-12T22:32:03.191 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.191 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.191 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:03.191 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405218+0000", 2024-09-12T22:32:03.191 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00028982900000000002 2024-09-12T22:32:03.191 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.191 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.192 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:03.192 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405829+0000", 2024-09-12T22:32:03.192 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00061127900000000005 2024-09-12T22:32:03.192 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.192 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.192 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:03.192 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409403+0000", 2024-09-12T22:32:03.192 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.003573597 2024-09-12T22:32:03.192 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.192 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.193 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:03.193 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418138+0000", 2024-09-12T22:32:03.193 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0087349969999999996 2024-09-12T22:32:03.193 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.193 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.193 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:03.193 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418178+0000", 2024-09-12T22:32:03.194 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0649999999999999e-05 2024-09-12T22:32:03.194 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.194 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.194 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:03.194 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418208+0000", 2024-09-12T22:32:03.194 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9448e-05 2024-09-12T22:32:03.194 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:03.194 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:03.194 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:03.194 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.194 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.194 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:03.195 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.405456+0000", 2024-09-12T22:32:03.195 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 25.639022869000001, 2024-09-12T22:32:03.195 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012888389, 2024-09-12T22:32:03.195 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:03.195 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:03.195 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:03.195 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:03.195 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.195 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:03.195 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405456+0000", 2024-09-12T22:32:03.195 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:03.195 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.195 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.195 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:03.196 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405456+0000", 2024-09-12T22:32:03.196 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:03.196 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.196 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.196 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:03.196 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405457+0000", 2024-09-12T22:32:03.196 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.6599999999999994e-07 2024-09-12T22:32:03.196 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.196 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.196 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:03.196 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405463+0000", 2024-09-12T22:32:03.196 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4739999999999996e-06 2024-09-12T22:32:03.196 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.197 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.197 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:03.197 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405474+0000", 2024-09-12T22:32:03.197 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1095e-05 2024-09-12T22:32:03.197 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.197 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.197 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:03.197 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405482+0000", 2024-09-12T22:32:03.197 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3610000000000001e-06 2024-09-12T22:32:03.197 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.197 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.197 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:03.197 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407051+0000", 2024-09-12T22:32:03.198 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0015688970000000001 2024-09-12T22:32:03.198 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.198 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.198 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:03.198 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407259+0000", 2024-09-12T22:32:03.198 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00020778300000000001 2024-09-12T22:32:03.198 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.198 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.198 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:03.198 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407622+0000", 2024-09-12T22:32:03.198 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000363066 2024-09-12T22:32:03.198 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.198 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.199 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:03.199 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409438+0000", 2024-09-12T22:32:03.199 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001816319 2024-09-12T22:32:03.199 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.199 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.199 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:03.199 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418257+0000", 2024-09-12T22:32:03.199 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0088187720000000008 2024-09-12T22:32:03.199 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.199 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.199 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:03.199 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418308+0000", 2024-09-12T22:32:03.199 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1180000000000001e-05 2024-09-12T22:32:03.199 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.200 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.200 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:03.200 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418345+0000", 2024-09-12T22:32:03.200 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6476000000000001e-05 2024-09-12T22:32:03.200 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:03.200 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:03.200 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:03.200 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.200 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.200 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:03.200 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.405496+0000", 2024-09-12T22:32:03.200 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 25.638983511999999, 2024-09-12T22:32:03.200 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013016012, 2024-09-12T22:32:03.200 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:03.201 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:03.201 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:03.201 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:03.201 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.201 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:03.201 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405496+0000", 2024-09-12T22:32:03.201 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:03.201 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.201 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.201 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:03.201 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405496+0000", 2024-09-12T22:32:03.201 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:03.201 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.202 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.204 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:03.204 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405496+0000", 2024-09-12T22:32:03.204 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7999999999999995e-07 2024-09-12T22:32:03.204 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.204 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.204 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:03.204 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405501+0000", 2024-09-12T22:32:03.204 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8359999999999999e-06 2024-09-12T22:32:03.204 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.204 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.205 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:03.205 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405514+0000", 2024-09-12T22:32:03.205 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2522e-05 2024-09-12T22:32:03.205 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.205 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.205 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:03.205 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405521+0000", 2024-09-12T22:32:03.205 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5020000000000003e-06 2024-09-12T22:32:03.205 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.205 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.205 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:03.205 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405575+0000", 2024-09-12T22:32:03.205 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4169999999999998e-05 2024-09-12T22:32:03.206 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.206 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.206 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:03.206 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405697+0000", 2024-09-12T22:32:03.206 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000121301 2024-09-12T22:32:03.206 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.206 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.206 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:03.206 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405829+0000", 2024-09-12T22:32:03.206 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000132662 2024-09-12T22:32:03.206 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.206 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.206 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:03.207 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409155+0000", 2024-09-12T22:32:03.207 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0033259050000000001 2024-09-12T22:32:03.207 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.207 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.207 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:03.207 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418425+0000", 2024-09-12T22:32:03.207 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0092696319999999999 2024-09-12T22:32:03.207 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.207 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.207 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:03.207 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418471+0000", 2024-09-12T22:32:03.207 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6213e-05 2024-09-12T22:32:03.208 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.208 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.208 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:03.208 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418512+0000", 2024-09-12T22:32:03.208 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0589000000000001e-05 2024-09-12T22:32:03.208 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:03.208 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:03.208 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:03.208 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.208 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.208 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:03.208 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.406108+0000", 2024-09-12T22:32:03.209 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 25.638371114999998, 2024-09-12T22:32:03.209 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012458175, 2024-09-12T22:32:03.209 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:03.209 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:03.209 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:03.209 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:03.209 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.209 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:03.209 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406108+0000", 2024-09-12T22:32:03.209 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:03.209 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.209 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.209 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:03.210 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406108+0000", 2024-09-12T22:32:03.210 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:03.210 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.210 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.210 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:03.210 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406109+0000", 2024-09-12T22:32:03.210 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9899999999999999e-07 2024-09-12T22:32:03.210 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.210 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.210 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:03.210 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406115+0000", 2024-09-12T22:32:03.210 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9030000000000001e-06 2024-09-12T22:32:03.210 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.211 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.211 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:03.211 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406141+0000", 2024-09-12T22:32:03.211 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5999e-05 2024-09-12T22:32:03.211 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.211 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.211 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:03.211 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406150+0000", 2024-09-12T22:32:03.211 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.6050000000000004e-06 2024-09-12T22:32:03.211 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.211 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.211 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:03.211 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408163+0000", 2024-09-12T22:32:03.212 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0020122769999999998 2024-09-12T22:32:03.212 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.212 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.212 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:03.212 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408309+0000", 2024-09-12T22:32:03.212 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014606999999999999 2024-09-12T22:32:03.212 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.212 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.212 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:03.212 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408433+0000", 2024-09-12T22:32:03.212 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012460300000000001 2024-09-12T22:32:03.212 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.212 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.213 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:03.213 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409903+0000", 2024-09-12T22:32:03.213 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001469499 2024-09-12T22:32:03.213 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.213 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.213 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:03.213 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418427+0000", 2024-09-12T22:32:03.213 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0085241139999999993 2024-09-12T22:32:03.213 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.213 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.213 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:03.213 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418471+0000", 2024-09-12T22:32:03.213 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4474000000000001e-05 2024-09-12T22:32:03.214 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.214 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.214 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:03.214 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418566+0000", 2024-09-12T22:32:03.214 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.4732e-05 2024-09-12T22:32:03.214 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:03.214 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:03.214 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:03.214 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.214 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.214 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:03.214 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.407266+0000", 2024-09-12T22:32:03.214 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 25.637213258999999, 2024-09-12T22:32:03.214 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011442905, 2024-09-12T22:32:03.215 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:03.215 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:03.215 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2024-09-12T22:32:03.215 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:03.215 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.215 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:03.215 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407266+0000", 2024-09-12T22:32:03.215 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:03.215 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.216 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.216 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:03.216 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407266+0000", 2024-09-12T22:32:03.216 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:03.216 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.216 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.216 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:03.216 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407266+0000", 2024-09-12T22:32:03.216 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7899999999999998e-07 2024-09-12T22:32:03.216 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.217 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.217 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:03.217 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407269+0000", 2024-09-12T22:32:03.217 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9210000000000001e-06 2024-09-12T22:32:03.217 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.217 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.217 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:03.217 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407331+0000", 2024-09-12T22:32:03.217 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1376000000000003e-05 2024-09-12T22:32:03.217 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.217 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.218 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:03.218 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407337+0000", 2024-09-12T22:32:03.218 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1929999999999998e-06 2024-09-12T22:32:03.218 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.218 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.218 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:03.218 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408974+0000", 2024-09-12T22:32:03.218 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0016367109999999999 2024-09-12T22:32:03.218 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.219 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.219 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:03.219 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409112+0000", 2024-09-12T22:32:03.219 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000137952 2024-09-12T22:32:03.219 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:03.219 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:03.219 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:03.219 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418709+0000", 2024-09-12T22:32:03.219 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0095971730000000005 2024-09-12T22:32:03.219 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:03.219 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:03.219 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:03.219 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:03.220 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:03.220 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-09-12T22:32:03.222 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:32:03.220+0000 7fddec6a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30331) UID: 0 2024-09-12T22:32:03.223 INFO:teuthology.orchestra.run.smithi019.stderr:reweighted osd.1 to 1 (10000) 2024-09-12T22:32:03.223 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-12T22:32:03.224 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:32:03.322 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:03.321+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:03.338 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-09-12T22:32:03.338 INFO:teuthology.orchestra.run.smithi076.stdout: "ops": [], 2024-09-12T22:32:03.339 INFO:teuthology.orchestra.run.smithi076.stdout: "num_ops": 0 2024-09-12T22:32:03.339 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-09-12T22:32:03.348 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:32:03.423 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:03.422+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:03.451 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-09-12T22:32:03.451 INFO:teuthology.orchestra.run.smithi076.stdout: "ops": [], 2024-09-12T22:32:03.451 INFO:teuthology.orchestra.run.smithi076.stdout: "complaint_time": 30, 2024-09-12T22:32:03.451 INFO:teuthology.orchestra.run.smithi076.stdout: "num_blocked_ops": 0 2024-09-12T22:32:03.451 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-09-12T22:32:03.460 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:32:03.523 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:03.522+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:03.564 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-09-12T22:32:03.564 INFO:teuthology.orchestra.run.smithi076.stdout: "size": 20, 2024-09-12T22:32:03.564 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 600, 2024-09-12T22:32:03.564 INFO:teuthology.orchestra.run.smithi076.stdout: "ops": [ 2024-09-12T22:32:03.564 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.564 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:03.564 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.400604+0000", 2024-09-12T22:32:03.564 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 26.161260493, 2024-09-12T22:32:03.564 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.017278814, 2024-09-12T22:32:03.564 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:03.565 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:03.565 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:03.565 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:03.565 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.565 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:03.565 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400604+0000", 2024-09-12T22:32:03.565 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:03.565 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.565 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.565 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:03.565 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400604+0000", 2024-09-12T22:32:03.565 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:03.565 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.565 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.566 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:03.566 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400617+0000", 2024-09-12T22:32:03.566 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.3076e-05 2024-09-12T22:32:03.566 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.566 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.566 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:03.566 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400623+0000", 2024-09-12T22:32:03.566 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.5780000000000004e-06 2024-09-12T22:32:03.566 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.566 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.566 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:03.566 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400641+0000", 2024-09-12T22:32:03.567 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.8218000000000001e-05 2024-09-12T22:32:03.567 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.567 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.567 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:03.567 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400652+0000", 2024-09-12T22:32:03.567 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.0421999999999999e-05 2024-09-12T22:32:03.567 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.567 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.568 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:03.568 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400707+0000", 2024-09-12T22:32:03.568 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.4666000000000001e-05 2024-09-12T22:32:03.568 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.568 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.568 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op must wait for map", 2024-09-12T22:32:03.568 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400711+0000", 2024-09-12T22:32:03.568 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.5340000000000001e-06 2024-09-12T22:32:03.568 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.568 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.568 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:03.568 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.412066+0000", 2024-09-12T22:32:03.569 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.011354797999999999 2024-09-12T22:32:03.569 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.569 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.569 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:03.569 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.412672+0000", 2024-09-12T22:32:03.569 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00060620499999999996 2024-09-12T22:32:03.569 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.569 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.569 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:03.569 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.413032+0000", 2024-09-12T22:32:03.569 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00035955999999999998 2024-09-12T22:32:03.569 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.569 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.570 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op_commit", 2024-09-12T22:32:03.570 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417252+0000", 2024-09-12T22:32:03.570 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.004219899 2024-09-12T22:32:03.570 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.570 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.570 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:03.570 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417812+0000", 2024-09-12T22:32:03.570 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.000560182 2024-09-12T22:32:03.570 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.570 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.570 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:03.570 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417851+0000", 2024-09-12T22:32:03.570 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.9057999999999998e-05 2024-09-12T22:32:03.570 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.571 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.571 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:03.571 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417882+0000", 2024-09-12T22:32:03.571 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.1618000000000001e-05 2024-09-12T22:32:03.571 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:03.571 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:03.571 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:03.571 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.571 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.571 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:03.571 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.400674+0000", 2024-09-12T22:32:03.572 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 26.161189775, 2024-09-12T22:32:03.572 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.017348971000000001, 2024-09-12T22:32:03.572 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:03.572 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:03.572 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:03.572 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:03.572 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.572 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:03.572 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400674+0000", 2024-09-12T22:32:03.573 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:03.573 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.573 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.573 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:03.573 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400674+0000", 2024-09-12T22:32:03.573 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:03.573 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.573 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.573 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:03.573 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400675+0000", 2024-09-12T22:32:03.573 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.37e-07 2024-09-12T22:32:03.573 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.574 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.574 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:03.574 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400678+0000", 2024-09-12T22:32:03.574 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.303e-06 2024-09-12T22:32:03.574 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.574 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.574 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:03.574 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400684+0000", 2024-09-12T22:32:03.574 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.0290000000000002e-06 2024-09-12T22:32:03.574 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.575 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.575 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:03.575 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400688+0000", 2024-09-12T22:32:03.575 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.0890000000000002e-06 2024-09-12T22:32:03.575 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.575 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.575 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:03.575 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400806+0000", 2024-09-12T22:32:03.575 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00011814700000000001 2024-09-12T22:32:03.575 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.575 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.575 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:32:03.575 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400811+0000", 2024-09-12T22:32:03.576 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.0479999999999998e-06 2024-09-12T22:32:03.576 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.576 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.576 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:03.576 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.413877+0000", 2024-09-12T22:32:03.576 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.013065561 2024-09-12T22:32:03.576 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.576 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.576 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:03.576 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.413984+0000", 2024-09-12T22:32:03.577 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.000106566 2024-09-12T22:32:03.577 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.577 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.577 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:03.577 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.414264+0000", 2024-09-12T22:32:03.577 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00028067199999999999 2024-09-12T22:32:03.577 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.577 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.577 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op_commit", 2024-09-12T22:32:03.577 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417614+0000", 2024-09-12T22:32:03.577 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0033500729999999999 2024-09-12T22:32:03.577 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.577 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.578 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:03.578 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417946+0000", 2024-09-12T22:32:03.578 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00033209199999999998 2024-09-12T22:32:03.578 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.578 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.578 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:03.578 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417995+0000", 2024-09-12T22:32:03.578 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.808e-05 2024-09-12T22:32:03.578 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.578 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.578 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:03.578 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.418023+0000", 2024-09-12T22:32:03.578 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.8773999999999999e-05 2024-09-12T22:32:03.579 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:03.579 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:03.579 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:03.579 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.579 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.579 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:03.579 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.400694+0000", 2024-09-12T22:32:03.579 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 26.161170146, 2024-09-12T22:32:03.579 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.022845628, 2024-09-12T22:32:03.579 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:03.579 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:03.579 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:03.579 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:03.579 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.580 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:03.580 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400694+0000", 2024-09-12T22:32:03.580 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:03.580 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.580 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.580 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:03.580 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400694+0000", 2024-09-12T22:32:03.580 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:03.580 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.580 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.580 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:03.580 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400694+0000", 2024-09-12T22:32:03.581 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.48e-07 2024-09-12T22:32:03.581 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.581 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.581 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:03.581 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400709+0000", 2024-09-12T22:32:03.581 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.4888999999999999e-05 2024-09-12T22:32:03.581 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.581 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.581 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:03.581 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400722+0000", 2024-09-12T22:32:03.582 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.2882e-05 2024-09-12T22:32:03.582 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.582 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.582 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:03.582 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400732+0000", 2024-09-12T22:32:03.582 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.0299000000000001e-05 2024-09-12T22:32:03.582 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.582 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.582 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:03.582 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400793+0000", 2024-09-12T22:32:03.583 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.0253000000000001e-05 2024-09-12T22:32:03.583 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.583 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.583 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op must wait for map", 2024-09-12T22:32:03.583 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400798+0000", 2024-09-12T22:32:03.583 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.1569999999999999e-06 2024-09-12T22:32:03.583 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.583 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.583 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:03.583 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415059+0000", 2024-09-12T22:32:03.583 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.014260907 2024-09-12T22:32:03.584 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.584 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.584 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:03.584 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415396+0000", 2024-09-12T22:32:03.584 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00033720799999999997 2024-09-12T22:32:03.584 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.584 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.584 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:03.584 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415685+0000", 2024-09-12T22:32:03.584 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00028939900000000003 2024-09-12T22:32:03.585 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.585 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.585 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op_commit", 2024-09-12T22:32:03.585 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.418302+0000", 2024-09-12T22:32:03.585 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0026168039999999999 2024-09-12T22:32:03.585 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.585 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.585 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:03.585 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.423445+0000", 2024-09-12T22:32:03.586 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0051428150000000002 2024-09-12T22:32:03.586 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.586 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.586 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:03.586 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.423499+0000", 2024-09-12T22:32:03.586 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.3953000000000003e-05 2024-09-12T22:32:03.586 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.586 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.586 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:03.587 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.423540+0000", 2024-09-12T22:32:03.587 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.0813999999999999e-05 2024-09-12T22:32:03.587 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:03.587 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:03.587 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:03.587 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.587 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.587 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:03.587 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.400740+0000", 2024-09-12T22:32:03.587 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 26.161124423, 2024-09-12T22:32:03.587 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.022927528999999999, 2024-09-12T22:32:03.587 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:03.587 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:03.588 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:03.588 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:03.588 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.588 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:03.588 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400740+0000", 2024-09-12T22:32:03.588 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:03.588 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.588 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.588 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:03.588 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400740+0000", 2024-09-12T22:32:03.588 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:03.588 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.589 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.589 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:03.589 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400740+0000", 2024-09-12T22:32:03.589 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.3000000000000001e-07 2024-09-12T22:32:03.589 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.589 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.589 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:03.589 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400743+0000", 2024-09-12T22:32:03.589 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.5840000000000002e-06 2024-09-12T22:32:03.589 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.589 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.589 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:03.590 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400757+0000", 2024-09-12T22:32:03.590 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.3988999999999999e-05 2024-09-12T22:32:03.590 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.590 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.590 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:03.590 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400763+0000", 2024-09-12T22:32:03.590 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.686e-06 2024-09-12T22:32:03.590 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.590 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.590 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:03.590 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400818+0000", 2024-09-12T22:32:03.590 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.4941000000000001e-05 2024-09-12T22:32:03.591 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.591 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.591 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:32:03.591 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400824+0000", 2024-09-12T22:32:03.591 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.4600000000000002e-06 2024-09-12T22:32:03.591 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.591 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.591 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:03.591 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416227+0000", 2024-09-12T22:32:03.591 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.015403604 2024-09-12T22:32:03.591 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.591 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.591 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:03.592 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416306+0000", 2024-09-12T22:32:03.592 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 7.9126000000000001e-05 2024-09-12T22:32:03.592 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.592 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.592 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:03.592 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416678+0000", 2024-09-12T22:32:03.592 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00037105500000000002 2024-09-12T22:32:03.592 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.592 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.592 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op_commit", 2024-09-12T22:32:03.592 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.418363+0000", 2024-09-12T22:32:03.592 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.001685095 2024-09-12T22:32:03.592 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.592 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.593 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:03.593 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.423591+0000", 2024-09-12T22:32:03.593 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0052283980000000004 2024-09-12T22:32:03.593 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.593 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.593 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:03.593 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.423624+0000", 2024-09-12T22:32:03.593 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.3024000000000001e-05 2024-09-12T22:32:03.593 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.593 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.593 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:03.593 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.423667+0000", 2024-09-12T22:32:03.593 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.3136999999999997e-05 2024-09-12T22:32:03.594 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:03.594 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:03.594 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:03.594 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.594 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.594 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:03.594 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.400783+0000", 2024-09-12T22:32:03.594 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 26.161080891000001, 2024-09-12T22:32:03.594 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.016563729999999999, 2024-09-12T22:32:03.594 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:03.594 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:03.594 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:03.594 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:03.595 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.595 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:03.595 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400783+0000", 2024-09-12T22:32:03.595 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:03.595 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.595 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.595 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:03.595 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400783+0000", 2024-09-12T22:32:03.595 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:03.595 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.595 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.595 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:03.595 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400784+0000", 2024-09-12T22:32:03.595 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.5900000000000002e-07 2024-09-12T22:32:03.596 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.596 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.596 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:03.596 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400787+0000", 2024-09-12T22:32:03.596 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.1690000000000001e-06 2024-09-12T22:32:03.596 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.596 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.596 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:03.596 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400794+0000", 2024-09-12T22:32:03.596 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 7.058e-06 2024-09-12T22:32:03.596 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.596 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.596 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:03.597 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400798+0000", 2024-09-12T22:32:03.597 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.335e-06 2024-09-12T22:32:03.597 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.597 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.597 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:03.597 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400841+0000", 2024-09-12T22:32:03.597 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.2369e-05 2024-09-12T22:32:03.597 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.597 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.597 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op must wait for map", 2024-09-12T22:32:03.597 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400844+0000", 2024-09-12T22:32:03.597 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.128e-06 2024-09-12T22:32:03.597 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.597 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.598 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:03.598 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.410479+0000", 2024-09-12T22:32:03.598 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0096354189999999992 2024-09-12T22:32:03.598 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.598 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.598 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:03.598 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.410597+0000", 2024-09-12T22:32:03.598 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.000118305 2024-09-12T22:32:03.598 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.598 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.598 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:03.598 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.410838+0000", 2024-09-12T22:32:03.598 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.000240967 2024-09-12T22:32:03.599 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.599 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.599 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op_commit", 2024-09-12T22:32:03.599 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416489+0000", 2024-09-12T22:32:03.599 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0056507989999999998 2024-09-12T22:32:03.599 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.599 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.599 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:03.599 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417255+0000", 2024-09-12T22:32:03.599 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00076626199999999998 2024-09-12T22:32:03.599 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.599 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.600 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:03.600 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417306+0000", 2024-09-12T22:32:03.600 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.0319999999999999e-05 2024-09-12T22:32:03.600 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.600 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.600 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:03.600 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417347+0000", 2024-09-12T22:32:03.600 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.1140000000000003e-05 2024-09-12T22:32:03.600 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:03.600 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:03.600 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:03.600 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.600 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.601 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:03.601 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.400811+0000", 2024-09-12T22:32:03.601 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 26.161052821999998, 2024-09-12T22:32:03.601 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.017061263, 2024-09-12T22:32:03.601 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:03.601 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:03.601 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:03.601 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:03.601 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.601 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:03.601 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400811+0000", 2024-09-12T22:32:03.601 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:03.602 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.602 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.602 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:03.602 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400811+0000", 2024-09-12T22:32:03.602 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:03.602 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.602 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.602 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:03.602 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400812+0000", 2024-09-12T22:32:03.602 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.27e-07 2024-09-12T22:32:03.602 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.602 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.603 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:03.603 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400814+0000", 2024-09-12T22:32:03.603 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.553e-06 2024-09-12T22:32:03.603 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.603 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.603 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:03.603 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400819+0000", 2024-09-12T22:32:03.603 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.3569999999999997e-06 2024-09-12T22:32:03.603 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.603 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.603 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:03.603 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400824+0000", 2024-09-12T22:32:03.603 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.6820000000000002e-06 2024-09-12T22:32:03.604 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.604 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.604 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:03.604 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400871+0000", 2024-09-12T22:32:03.604 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.7311000000000002e-05 2024-09-12T22:32:03.604 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.604 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.604 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:32:03.604 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400875+0000", 2024-09-12T22:32:03.604 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.0960000000000001e-06 2024-09-12T22:32:03.604 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.604 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.604 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:03.605 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.412071+0000", 2024-09-12T22:32:03.605 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.011195999999999999 2024-09-12T22:32:03.605 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.605 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.605 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:03.605 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.412520+0000", 2024-09-12T22:32:03.605 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.000449522 2024-09-12T22:32:03.605 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.605 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.605 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:03.605 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.412655+0000", 2024-09-12T22:32:03.605 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00013487899999999999 2024-09-12T22:32:03.606 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.606 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.606 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op_commit", 2024-09-12T22:32:03.606 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417096+0000", 2024-09-12T22:32:03.606 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.004441113 2024-09-12T22:32:03.606 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.606 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.606 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:03.606 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417768+0000", 2024-09-12T22:32:03.606 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00067161100000000002 2024-09-12T22:32:03.606 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.606 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.606 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:03.607 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417834+0000", 2024-09-12T22:32:03.607 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.6058999999999999e-05 2024-09-12T22:32:03.607 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.607 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.607 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:03.607 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417873+0000", 2024-09-12T22:32:03.607 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.8753e-05 2024-09-12T22:32:03.607 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:03.607 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:03.607 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:03.607 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.607 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.607 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:03.607 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.400842+0000", 2024-09-12T22:32:03.608 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 26.161022115000002, 2024-09-12T22:32:03.608 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.022846262999999999, 2024-09-12T22:32:03.608 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:03.608 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:03.608 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:03.608 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:03.608 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.608 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:03.608 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400842+0000", 2024-09-12T22:32:03.609 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:03.609 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.609 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.609 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:03.609 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400842+0000", 2024-09-12T22:32:03.609 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:03.609 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.609 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.609 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:03.609 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400842+0000", 2024-09-12T22:32:03.609 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.9900000000000002e-07 2024-09-12T22:32:03.609 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.609 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.609 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:03.610 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400845+0000", 2024-09-12T22:32:03.610 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.8609999999999998e-06 2024-09-12T22:32:03.610 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.610 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.610 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:03.610 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400850+0000", 2024-09-12T22:32:03.610 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.634e-06 2024-09-12T22:32:03.610 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.610 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.610 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:03.610 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400855+0000", 2024-09-12T22:32:03.611 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.8339999999999998e-06 2024-09-12T22:32:03.611 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.611 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.611 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:03.611 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400886+0000", 2024-09-12T22:32:03.611 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.1393999999999998e-05 2024-09-12T22:32:03.611 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.611 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.611 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:32:03.611 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400888+0000", 2024-09-12T22:32:03.611 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.3470000000000001e-06 2024-09-12T22:32:03.611 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.612 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.612 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:03.612 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415640+0000", 2024-09-12T22:32:03.612 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.014751965000000001 2024-09-12T22:32:03.612 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.612 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.612 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:03.612 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415821+0000", 2024-09-12T22:32:03.612 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00018064399999999999 2024-09-12T22:32:03.612 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.612 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.612 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:03.613 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415949+0000", 2024-09-12T22:32:03.613 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00012816699999999999 2024-09-12T22:32:03.613 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.613 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.613 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op_commit", 2024-09-12T22:32:03.613 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.418337+0000", 2024-09-12T22:32:03.613 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0023878469999999998 2024-09-12T22:32:03.613 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.613 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.613 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:03.613 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.423588+0000", 2024-09-12T22:32:03.613 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0052509849999999997 2024-09-12T22:32:03.614 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.614 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.614 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:03.614 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.423650+0000", 2024-09-12T22:32:03.614 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.2026999999999994e-05 2024-09-12T22:32:03.614 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.614 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.614 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:03.614 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.423688+0000", 2024-09-12T22:32:03.615 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.8259000000000001e-05 2024-09-12T22:32:03.615 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:03.615 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:03.615 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:03.615 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.615 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.615 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:03.615 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.400862+0000", 2024-09-12T22:32:03.615 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 26.161002141000001, 2024-09-12T22:32:03.615 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.016404294, 2024-09-12T22:32:03.615 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:03.615 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:03.616 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "started", 2024-09-12T22:32:03.616 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:03.616 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.616 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:03.616 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400862+0000", 2024-09-12T22:32:03.616 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:03.616 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.616 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.616 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:03.616 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400862+0000", 2024-09-12T22:32:03.617 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:03.617 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.617 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.617 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:03.617 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400862+0000", 2024-09-12T22:32:03.617 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.8099999999999999e-07 2024-09-12T22:32:03.617 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.617 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.617 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:03.618 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400870+0000", 2024-09-12T22:32:03.618 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 8.1349999999999992e-06 2024-09-12T22:32:03.618 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.618 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.618 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:03.618 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400876+0000", 2024-09-12T22:32:03.618 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.2039999999999996e-06 2024-09-12T22:32:03.618 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.618 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.618 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:03.618 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400879+0000", 2024-09-12T22:32:03.619 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.529e-06 2024-09-12T22:32:03.619 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.619 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.619 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:03.619 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400912+0000", 2024-09-12T22:32:03.620 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.2653000000000001e-05 2024-09-12T22:32:03.621 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.621 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.621 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op must wait for map", 2024-09-12T22:32:03.621 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400915+0000", 2024-09-12T22:32:03.621 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.1099999999999999e-06 2024-09-12T22:32:03.621 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.621 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.621 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:03.621 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408727+0000", 2024-09-12T22:32:03.622 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0078123869999999996 2024-09-12T22:32:03.622 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.622 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.622 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:03.622 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408838+0000", 2024-09-12T22:32:03.622 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00011042700000000001 2024-09-12T22:32:03.622 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.622 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.622 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:03.622 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417266+0000", 2024-09-12T22:32:03.622 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0084285680000000009 2024-09-12T22:32:03.623 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:03.623 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:03.623 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:03.623 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.623 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.623 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:03.623 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.400889+0000", 2024-09-12T22:32:03.623 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 26.160974887999998, 2024-09-12T22:32:03.623 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.014929550999999999, 2024-09-12T22:32:03.623 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:03.623 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:03.624 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "started", 2024-09-12T22:32:03.624 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:03.624 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.624 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:03.624 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400889+0000", 2024-09-12T22:32:03.624 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:03.624 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.624 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.624 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:03.624 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400889+0000", 2024-09-12T22:32:03.624 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:03.624 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.625 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.625 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:03.625 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400890+0000", 2024-09-12T22:32:03.625 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.8699999999999995e-07 2024-09-12T22:32:03.625 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.625 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.625 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:03.625 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400893+0000", 2024-09-12T22:32:03.625 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.9569999999999998e-06 2024-09-12T22:32:03.625 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.625 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.626 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:03.626 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400899+0000", 2024-09-12T22:32:03.626 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.4189999999999999e-06 2024-09-12T22:32:03.626 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.626 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.626 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:03.626 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400905+0000", 2024-09-12T22:32:03.626 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.7880000000000003e-06 2024-09-12T22:32:03.626 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.626 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.626 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:03.626 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400943+0000", 2024-09-12T22:32:03.626 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.7852999999999998e-05 2024-09-12T22:32:03.627 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.627 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.627 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op must wait for map", 2024-09-12T22:32:03.627 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400945+0000", 2024-09-12T22:32:03.627 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.627e-06 2024-09-12T22:32:03.627 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.627 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.627 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:03.627 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408398+0000", 2024-09-12T22:32:03.627 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0074525879999999996 2024-09-12T22:32:03.627 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.628 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.628 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:03.628 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408581+0000", 2024-09-12T22:32:03.628 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00018321900000000001 2024-09-12T22:32:03.628 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.628 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.628 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:03.628 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415819+0000", 2024-09-12T22:32:03.628 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0072376130000000004 2024-09-12T22:32:03.628 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:03.628 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:03.628 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:03.628 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.629 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.629 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:25 3.7 e19/17 3:e0b41d06:::609.00000000:head v 19'2, mlcod=0'0)", 2024-09-12T22:32:03.629 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.402511+0000", 2024-09-12T22:32:03.629 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 26.159352745, 2024-09-12T22:32:03.629 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0089735260000000008, 2024-09-12T22:32:03.629 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:03.629 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:03.629 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:03.629 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:03.629 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.629 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:03.629 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.402511+0000", 2024-09-12T22:32:03.629 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:03.629 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.630 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.630 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:03.630 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.402511+0000", 2024-09-12T22:32:03.630 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:03.630 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.630 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.630 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:03.630 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.402512+0000", 2024-09-12T22:32:03.630 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 8.71e-07 2024-09-12T22:32:03.630 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.630 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.630 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:03.630 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.402520+0000", 2024-09-12T22:32:03.630 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 7.8529999999999992e-06 2024-09-12T22:32:03.631 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.631 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.631 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:03.631 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.402530+0000", 2024-09-12T22:32:03.631 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 9.859e-06 2024-09-12T22:32:03.631 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.631 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.631 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:03.631 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.402555+0000", 2024-09-12T22:32:03.631 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.4822000000000001e-05 2024-09-12T22:32:03.631 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.631 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.631 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:03.632 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.403173+0000", 2024-09-12T22:32:03.632 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00061813199999999997 2024-09-12T22:32:03.632 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.632 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.632 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:03.632 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.403195+0000", 2024-09-12T22:32:03.632 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.2286e-05 2024-09-12T22:32:03.632 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.632 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.632 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:03.632 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.411436+0000", 2024-09-12T22:32:03.632 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0082410539999999994 2024-09-12T22:32:03.632 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.632 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.633 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:03.633 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.411485+0000", 2024-09-12T22:32:03.633 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.8649000000000001e-05 2024-09-12T22:32:03.633 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:03.633 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:03.633 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:03.633 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.633 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.633 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:18 3.14 e19/17 3:2f55791f:::606.00000000:head v 19'1, mlcod=0'0)", 2024-09-12T22:32:03.633 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.406646+0000", 2024-09-12T22:32:03.633 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 26.155217593, 2024-09-12T22:32:03.633 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0082036980000000006, 2024-09-12T22:32:03.634 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:03.634 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:03.634 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:03.634 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:03.634 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.634 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:03.634 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406646+0000", 2024-09-12T22:32:03.634 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:03.634 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.634 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.634 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:03.634 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406646+0000", 2024-09-12T22:32:03.634 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:03.634 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.635 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.635 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:03.635 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406647+0000", 2024-09-12T22:32:03.635 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.4499999999999998e-07 2024-09-12T22:32:03.635 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.635 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.635 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:03.635 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406651+0000", 2024-09-12T22:32:03.635 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.0300000000000004e-06 2024-09-12T22:32:03.635 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.635 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.635 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:03.635 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406657+0000", 2024-09-12T22:32:03.635 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.1330000000000004e-06 2024-09-12T22:32:03.636 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.636 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.636 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:03.636 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406665+0000", 2024-09-12T22:32:03.636 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 8.3650000000000004e-06 2024-09-12T22:32:03.636 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.636 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.636 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:03.636 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406804+0000", 2024-09-12T22:32:03.636 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00013900699999999999 2024-09-12T22:32:03.636 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.636 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.636 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:03.637 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406833+0000", 2024-09-12T22:32:03.637 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.8243e-05 2024-09-12T22:32:03.637 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.637 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.637 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:03.637 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.414741+0000", 2024-09-12T22:32:03.637 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0079089620000000003 2024-09-12T22:32:03.637 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.637 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.637 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:03.637 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.414850+0000", 2024-09-12T22:32:03.637 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.000108713 2024-09-12T22:32:03.637 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:03.638 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:03.638 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:03.638 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.638 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.638 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:6 3.10 e19/17 3:0d82a743:::600.00000000:head v 19'1, mlcod=0'0)", 2024-09-12T22:32:03.638 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.406692+0000", 2024-09-12T22:32:03.638 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 26.155171826, 2024-09-12T22:32:03.638 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0093004430000000003, 2024-09-12T22:32:03.638 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:03.638 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:03.638 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:03.638 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:03.638 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.638 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:03.639 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406692+0000", 2024-09-12T22:32:03.639 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:03.639 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.639 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.639 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:03.639 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406692+0000", 2024-09-12T22:32:03.639 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:03.639 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.639 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.639 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:03.639 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406693+0000", 2024-09-12T22:32:03.639 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.6300000000000001e-07 2024-09-12T22:32:03.639 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.640 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.640 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:03.640 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406702+0000", 2024-09-12T22:32:03.640 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 9.5589999999999994e-06 2024-09-12T22:32:03.640 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.640 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.640 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:03.640 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406725+0000", 2024-09-12T22:32:03.640 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.2977999999999999e-05 2024-09-12T22:32:03.640 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.640 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.640 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:03.640 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406732+0000", 2024-09-12T22:32:03.641 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.8430000000000004e-06 2024-09-12T22:32:03.641 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.641 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.641 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:03.641 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406979+0000", 2024-09-12T22:32:03.641 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00024729199999999998 2024-09-12T22:32:03.641 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.641 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.641 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:03.641 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407000+0000", 2024-09-12T22:32:03.641 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.0573000000000001e-05 2024-09-12T22:32:03.641 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.641 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.642 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:03.642 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415928+0000", 2024-09-12T22:32:03.642 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0089286179999999993 2024-09-12T22:32:03.642 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.642 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.642 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:03.642 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415993+0000", 2024-09-12T22:32:03.642 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.4216999999999999e-05 2024-09-12T22:32:03.642 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:03.642 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:03.642 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:03.643 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.643 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.643 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:2 3.f e19/17 3:f1f69726:::400.00000000:head v 19'1, mlcod=0'0)", 2024-09-12T22:32:03.643 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.406942+0000", 2024-09-12T22:32:03.643 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 26.154922139, 2024-09-12T22:32:03.643 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0098433259999999995, 2024-09-12T22:32:03.643 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:03.643 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:03.643 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:03.644 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:03.644 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.644 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:03.644 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406942+0000", 2024-09-12T22:32:03.644 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:03.644 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.644 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.644 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:03.644 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406942+0000", 2024-09-12T22:32:03.644 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:03.644 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.644 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.644 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:03.644 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406943+0000", 2024-09-12T22:32:03.645 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.8800000000000002e-07 2024-09-12T22:32:03.645 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.645 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.645 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:03.645 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406949+0000", 2024-09-12T22:32:03.645 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.5869999999999998e-06 2024-09-12T22:32:03.645 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.645 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.645 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:03.646 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406960+0000", 2024-09-12T22:32:03.646 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.0873000000000001e-05 2024-09-12T22:32:03.646 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.646 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.646 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:03.646 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406970+0000", 2024-09-12T22:32:03.646 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 9.9119999999999993e-06 2024-09-12T22:32:03.646 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.646 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.646 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:03.646 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407535+0000", 2024-09-12T22:32:03.646 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00056508899999999996 2024-09-12T22:32:03.646 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.647 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.647 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:03.647 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407556+0000", 2024-09-12T22:32:03.647 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.1348999999999998e-05 2024-09-12T22:32:03.647 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.647 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.647 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:03.647 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416751+0000", 2024-09-12T22:32:03.647 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0091950109999999995 2024-09-12T22:32:03.647 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.648 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.648 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:03.648 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416785+0000", 2024-09-12T22:32:03.648 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.3917000000000001e-05 2024-09-12T22:32:03.648 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:03.648 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:03.648 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:03.648 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.648 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.648 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:19 3.14 e19/17 3:2f55791f:::606.00000000:head v 19'2, mlcod=0'0)", 2024-09-12T22:32:03.648 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.406983+0000", 2024-09-12T22:32:03.648 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 26.154881159999999, 2024-09-12T22:32:03.649 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0080362149999999993, 2024-09-12T22:32:03.649 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:03.649 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:03.649 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:03.649 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:03.649 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.649 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:03.649 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406983+0000", 2024-09-12T22:32:03.650 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:03.650 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.650 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.650 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:03.650 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406983+0000", 2024-09-12T22:32:03.650 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:03.650 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.650 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.650 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:03.650 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406983+0000", 2024-09-12T22:32:03.650 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.8200000000000001e-07 2024-09-12T22:32:03.650 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.650 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.651 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:03.651 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406999+0000", 2024-09-12T22:32:03.651 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.5747999999999999e-05 2024-09-12T22:32:03.651 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.651 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.651 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:03.651 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407006+0000", 2024-09-12T22:32:03.651 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 7.2609999999999996e-06 2024-09-12T22:32:03.651 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.651 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.651 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:03.651 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407035+0000", 2024-09-12T22:32:03.651 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.8214000000000001e-05 2024-09-12T22:32:03.652 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.652 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.652 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:03.652 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407092+0000", 2024-09-12T22:32:03.652 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.7027000000000001e-05 2024-09-12T22:32:03.652 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.652 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.652 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:03.652 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407126+0000", 2024-09-12T22:32:03.653 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.4082000000000003e-05 2024-09-12T22:32:03.653 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.653 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.653 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:03.653 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.414985+0000", 2024-09-12T22:32:03.653 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0078597319999999995 2024-09-12T22:32:03.653 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.653 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.653 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:03.653 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415019+0000", 2024-09-12T22:32:03.653 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.3769000000000001e-05 2024-09-12T22:32:03.654 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:03.654 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:03.654 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:03.654 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.654 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.654 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:7 3.10 e19/17 3:0d82a743:::600.00000000:head v 19'2, mlcod=0'0)", 2024-09-12T22:32:03.654 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.407048+0000", 2024-09-12T22:32:03.654 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 26.154815622000001, 2024-09-12T22:32:03.654 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.008979931, 2024-09-12T22:32:03.654 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:03.655 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:03.655 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:03.655 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:03.655 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.655 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:03.655 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407048+0000", 2024-09-12T22:32:03.655 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:03.655 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.655 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.656 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:03.656 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407048+0000", 2024-09-12T22:32:03.656 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:03.656 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.656 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.656 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:03.656 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407049+0000", 2024-09-12T22:32:03.656 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.9099999999999999e-07 2024-09-12T22:32:03.656 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.657 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.657 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:03.657 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407054+0000", 2024-09-12T22:32:03.657 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.1850000000000003e-06 2024-09-12T22:32:03.657 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.657 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.657 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:03.657 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407061+0000", 2024-09-12T22:32:03.658 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 7.0809999999999996e-06 2024-09-12T22:32:03.658 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.658 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.658 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:03.658 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407067+0000", 2024-09-12T22:32:03.658 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.9540000000000001e-06 2024-09-12T22:32:03.658 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.658 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.658 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:03.659 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407299+0000", 2024-09-12T22:32:03.659 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.000232122 2024-09-12T22:32:03.659 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.659 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.659 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:03.659 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407317+0000", 2024-09-12T22:32:03.659 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.7447000000000001e-05 2024-09-12T22:32:03.659 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.659 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.659 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:03.659 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415996+0000", 2024-09-12T22:32:03.659 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0086791799999999999 2024-09-12T22:32:03.659 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.660 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.660 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:03.660 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416028+0000", 2024-09-12T22:32:03.660 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.2570999999999997e-05 2024-09-12T22:32:03.660 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:03.660 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:03.660 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:03.660 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.660 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.660 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:8 3.10 e19/17 3:09401a81:::601.00000000:head v 19'3, mlcod=0'0)", 2024-09-12T22:32:03.660 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.407081+0000", 2024-09-12T22:32:03.661 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 26.154782932, 2024-09-12T22:32:03.661 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0089807270000000008, 2024-09-12T22:32:03.661 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:03.661 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:03.661 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:03.661 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:03.661 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.661 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:03.661 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407081+0000", 2024-09-12T22:32:03.661 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:03.661 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.661 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.662 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:03.662 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407081+0000", 2024-09-12T22:32:03.662 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:03.662 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.662 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.662 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:03.662 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407082+0000", 2024-09-12T22:32:03.662 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.7899999999999999e-07 2024-09-12T22:32:03.662 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.662 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.662 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:03.662 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407086+0000", 2024-09-12T22:32:03.663 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.7679999999999999e-06 2024-09-12T22:32:03.663 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.663 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.663 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:03.663 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407094+0000", 2024-09-12T22:32:03.663 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 8.1470000000000001e-06 2024-09-12T22:32:03.663 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.663 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.663 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:03.663 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407100+0000", 2024-09-12T22:32:03.663 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.4539999999999998e-06 2024-09-12T22:32:03.663 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.663 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.663 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:03.664 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407540+0000", 2024-09-12T22:32:03.664 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00043973699999999999 2024-09-12T22:32:03.664 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.664 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.664 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:03.664 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407553+0000", 2024-09-12T22:32:03.664 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.3368e-05 2024-09-12T22:32:03.664 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.664 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.664 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:03.664 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416032+0000", 2024-09-12T22:32:03.664 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0084793790000000004 2024-09-12T22:32:03.664 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.665 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.665 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:03.665 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416062+0000", 2024-09-12T22:32:03.665 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.9495000000000001e-05 2024-09-12T22:32:03.665 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:03.665 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:03.665 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:03.665 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.665 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.665 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:31 3.d e19/17 3:b50e409b:::mds_snaptable:head v 19'1, mlcod=0'0)", 2024-09-12T22:32:03.665 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.408508+0000", 2024-09-12T22:32:03.665 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 26.153356416000001, 2024-09-12T22:32:03.665 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0080056620000000002, 2024-09-12T22:32:03.665 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:03.666 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:03.666 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:03.666 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:03.666 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.666 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:03.666 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408508+0000", 2024-09-12T22:32:03.666 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:03.666 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.666 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.666 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:03.666 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408508+0000", 2024-09-12T22:32:03.666 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:03.667 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.667 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.667 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:03.667 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408508+0000", 2024-09-12T22:32:03.667 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.7e-07 2024-09-12T22:32:03.667 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.667 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.667 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:03.667 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408515+0000", 2024-09-12T22:32:03.667 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.4439999999999996e-06 2024-09-12T22:32:03.667 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.667 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.667 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:03.667 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408521+0000", 2024-09-12T22:32:03.668 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.2729999999999999e-06 2024-09-12T22:32:03.668 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.668 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.668 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:03.668 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408526+0000", 2024-09-12T22:32:03.668 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.3299999999999998e-06 2024-09-12T22:32:03.668 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.668 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.668 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:03.668 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.410190+0000", 2024-09-12T22:32:03.668 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.001663615 2024-09-12T22:32:03.668 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.668 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.669 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:03.669 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.410258+0000", 2024-09-12T22:32:03.669 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.8146999999999997e-05 2024-09-12T22:32:03.669 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.669 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.669 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:03.669 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416477+0000", 2024-09-12T22:32:03.669 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0062187329999999997 2024-09-12T22:32:03.669 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.669 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.669 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:03.669 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416513+0000", 2024-09-12T22:32:03.669 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.6650000000000003e-05 2024-09-12T22:32:03.670 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:03.670 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:03.670 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:03.670 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.670 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.670 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:9 3.10 e19/17 3:09401a81:::601.00000000:head v 19'4, mlcod=0'0)", 2024-09-12T22:32:03.670 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.408991+0000", 2024-09-12T22:32:03.670 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 26.152872666, 2024-09-12T22:32:03.670 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0080459209999999993, 2024-09-12T22:32:03.670 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:03.670 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:03.670 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:03.671 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:03.671 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.671 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:03.671 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408991+0000", 2024-09-12T22:32:03.671 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:03.671 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.671 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.671 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:03.671 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408991+0000", 2024-09-12T22:32:03.671 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:03.671 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.671 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.671 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:03.671 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408992+0000", 2024-09-12T22:32:03.672 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.1799999999999995e-07 2024-09-12T22:32:03.672 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.672 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.672 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:03.672 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409005+0000", 2024-09-12T22:32:03.672 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.261e-05 2024-09-12T22:32:03.672 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.672 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.672 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:03.672 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409015+0000", 2024-09-12T22:32:03.672 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.0001e-05 2024-09-12T22:32:03.672 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.672 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.673 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:03.673 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409023+0000", 2024-09-12T22:32:03.673 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 8.7569999999999993e-06 2024-09-12T22:32:03.673 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.673 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.673 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:03.673 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.411355+0000", 2024-09-12T22:32:03.673 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0023313520000000001 2024-09-12T22:32:03.673 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.673 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.673 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:03.674 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.411374+0000", 2024-09-12T22:32:03.674 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.8810000000000001e-05 2024-09-12T22:32:03.674 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.674 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.674 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:03.674 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416994+0000", 2024-09-12T22:32:03.674 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.005620524 2024-09-12T22:32:03.674 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.674 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.674 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:03.674 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417037+0000", 2024-09-12T22:32:03.674 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.3248999999999999e-05 2024-09-12T22:32:03.674 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:03.675 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:03.675 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:03.675 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.675 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.675 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:10 3.10 e19/17 3:0bd6d154:::602.00000000:head v 19'5, mlcod=0'0)", 2024-09-12T22:32:03.675 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.409038+0000", 2024-09-12T22:32:03.675 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 26.152825991, 2024-09-12T22:32:03.675 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0080541689999999999, 2024-09-12T22:32:03.675 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:03.675 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:03.675 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:03.676 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:03.676 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.676 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:03.676 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409038+0000", 2024-09-12T22:32:03.676 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:03.676 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.676 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.676 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:03.676 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409038+0000", 2024-09-12T22:32:03.676 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:03.676 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.676 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.676 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:03.677 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409038+0000", 2024-09-12T22:32:03.677 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.7899999999999999e-07 2024-09-12T22:32:03.677 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.677 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.677 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:03.677 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409043+0000", 2024-09-12T22:32:03.677 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.6589999999999998e-06 2024-09-12T22:32:03.677 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.677 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.677 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:03.677 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409050+0000", 2024-09-12T22:32:03.677 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 7.0829999999999998e-06 2024-09-12T22:32:03.678 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.678 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.678 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:03.678 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409058+0000", 2024-09-12T22:32:03.678 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 7.7309999999999993e-06 2024-09-12T22:32:03.678 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.678 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.678 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:03.678 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.411654+0000", 2024-09-12T22:32:03.678 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0025961650000000001 2024-09-12T22:32:03.678 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.678 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.678 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:03.679 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.411671+0000", 2024-09-12T22:32:03.679 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.7356000000000001e-05 2024-09-12T22:32:03.679 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.679 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.679 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:03.679 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417040+0000", 2024-09-12T22:32:03.679 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0053681889999999998 2024-09-12T22:32:03.679 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.679 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.679 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:03.679 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417092+0000", 2024-09-12T22:32:03.679 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.2607e-05 2024-09-12T22:32:03.680 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:03.680 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:03.680 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:03.680 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.680 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.680 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:11 3.10 e19/17 3:0bd6d154:::602.00000000:head v 19'6, mlcod=0'0)", 2024-09-12T22:32:03.680 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.409768+0000", 2024-09-12T22:32:03.680 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 26.15209655, 2024-09-12T22:32:03.680 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0074442759999999997, 2024-09-12T22:32:03.680 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:03.681 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:03.681 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:03.681 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:03.681 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.681 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:03.681 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409768+0000", 2024-09-12T22:32:03.681 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:03.681 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.681 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.681 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:03.681 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409768+0000", 2024-09-12T22:32:03.681 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:03.682 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.682 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.682 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:03.682 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409768+0000", 2024-09-12T22:32:03.682 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.37e-07 2024-09-12T22:32:03.682 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.682 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.682 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:03.682 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409775+0000", 2024-09-12T22:32:03.683 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.4670000000000001e-06 2024-09-12T22:32:03.683 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.683 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.683 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:03.683 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409793+0000", 2024-09-12T22:32:03.683 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.8162e-05 2024-09-12T22:32:03.683 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.683 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.683 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:03.683 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409954+0000", 2024-09-12T22:32:03.683 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00016072999999999999 2024-09-12T22:32:03.683 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.683 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.684 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:03.684 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.411943+0000", 2024-09-12T22:32:03.684 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0019897069999999998 2024-09-12T22:32:03.684 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.684 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.684 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:03.684 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.412069+0000", 2024-09-12T22:32:03.684 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00012546200000000001 2024-09-12T22:32:03.684 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.685 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.685 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:03.685 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417114+0000", 2024-09-12T22:32:03.685 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.005045023 2024-09-12T22:32:03.685 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:03.685 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:03.685 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:03.685 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417212+0000", 2024-09-12T22:32:03.685 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 9.8088e-05 2024-09-12T22:32:03.685 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:03.685 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:03.685 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:03.685 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:03.686 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:03.686 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-09-12T22:32:03.688 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:32:03.688 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:32:03.686+0000 7fddec6a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30331) UID: 0 2024-09-12T22:32:03.788 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:32:03.787+0000 7fddec6a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30331) UID: 0 2024-09-12T22:32:03.802 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:32:03.802 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:32:03.802 INFO:teuthology.orchestra.run.smithi148.stdout: "num_ops": 0 2024-09-12T22:32:03.802 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:32:03.812 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:32:03.890 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:32:03.889+0000 7fddec6a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30331) UID: 0 2024-09-12T22:32:03.915 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:32:03.915 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:32:03.915 INFO:teuthology.orchestra.run.smithi148.stdout: "complaint_time": 30, 2024-09-12T22:32:03.916 INFO:teuthology.orchestra.run.smithi148.stdout: "num_blocked_ops": 0 2024-09-12T22:32:03.916 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:32:03.924 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:32:03.991 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:03.990+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:04.029 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:32:04.029 INFO:teuthology.orchestra.run.smithi148.stdout: "size": 20, 2024-09-12T22:32:04.030 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 600, 2024-09-12T22:32:04.030 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [ 2024-09-12T22:32:04.030 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.030 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(client.4195.0:5 2.2 e15/13 2:5cea7035:::rbd_info:head v 15'1, mlcod=0'0)", 2024-09-12T22:32:04.030 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:33.283639+0000", 2024-09-12T22:32:04.030 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 30.743416512, 2024-09-12T22:32:04.030 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00092221499999999999, 2024-09-12T22:32:04.030 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:04.030 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:04.031 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:04.031 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:04.031 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.031 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:04.031 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:33.283639+0000", 2024-09-12T22:32:04.031 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:04.031 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.031 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.032 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:04.032 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:33.283639+0000", 2024-09-12T22:32:04.032 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:04.032 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.032 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.032 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:04.032 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:33.283639+0000", 2024-09-12T22:32:04.032 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.5900000000000001e-07 2024-09-12T22:32:04.032 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.033 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.033 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:04.033 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:33.283664+0000", 2024-09-12T22:32:04.033 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4532000000000002e-05 2024-09-12T22:32:04.033 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.033 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.033 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:04.033 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:33.283675+0000", 2024-09-12T22:32:04.033 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1534e-05 2024-09-12T22:32:04.033 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.033 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.034 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:04.034 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:33.283681+0000", 2024-09-12T22:32:04.034 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0340000000000002e-06 2024-09-12T22:32:04.034 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.034 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.034 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:04.034 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:33.283764+0000", 2024-09-12T22:32:04.034 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.3115999999999995e-05 2024-09-12T22:32:04.035 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.035 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.035 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:04.035 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:33.283778+0000", 2024-09-12T22:32:04.035 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4233000000000001e-05 2024-09-12T22:32:04.035 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.036 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.036 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:04.036 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:33.284523+0000", 2024-09-12T22:32:04.036 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00074424699999999996 2024-09-12T22:32:04.036 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.037 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.037 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:04.037 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:33.284561+0000", 2024-09-12T22:32:04.037 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.8359999999999999e-05 2024-09-12T22:32:04.037 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:04.037 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:04.038 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:04.038 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.038 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.038 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:04.038 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.400880+0000", 2024-09-12T22:32:04.039 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 26.626175596, 2024-09-12T22:32:04.039 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0095133660000000005, 2024-09-12T22:32:04.039 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:04.039 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:04.039 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:04.039 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:04.040 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.040 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:04.040 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400880+0000", 2024-09-12T22:32:04.040 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:04.040 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.040 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.040 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:04.041 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400880+0000", 2024-09-12T22:32:04.041 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:04.041 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.041 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.041 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:04.041 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400892+0000", 2024-09-12T22:32:04.041 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1941e-05 2024-09-12T22:32:04.041 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.041 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.041 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:04.041 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400900+0000", 2024-09-12T22:32:04.042 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0080000000000002e-06 2024-09-12T22:32:04.042 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.042 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.042 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:04.042 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400911+0000", 2024-09-12T22:32:04.042 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1452e-05 2024-09-12T22:32:04.042 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.042 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.042 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:04.042 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400922+0000", 2024-09-12T22:32:04.042 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0772e-05 2024-09-12T22:32:04.042 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.043 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.043 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:04.043 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401009+0000", 2024-09-12T22:32:04.043 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.7206000000000005e-05 2024-09-12T22:32:04.043 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.043 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.043 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:04.043 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401157+0000", 2024-09-12T22:32:04.043 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014831499999999999 2024-09-12T22:32:04.043 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.044 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.044 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:04.044 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401312+0000", 2024-09-12T22:32:04.044 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00015495600000000001 2024-09-12T22:32:04.044 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.044 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.044 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:04.044 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.403060+0000", 2024-09-12T22:32:04.044 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0017475220000000001 2024-09-12T22:32:04.044 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.045 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.045 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:04.045 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410300+0000", 2024-09-12T22:32:04.045 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0072403260000000001 2024-09-12T22:32:04.045 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.045 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.046 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:04.046 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410350+0000", 2024-09-12T22:32:04.046 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9814000000000001e-05 2024-09-12T22:32:04.046 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.046 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.046 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:04.046 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410393+0000", 2024-09-12T22:32:04.046 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3053999999999998e-05 2024-09-12T22:32:04.046 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:04.046 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:04.046 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:04.046 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.047 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.047 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:04.047 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.400952+0000", 2024-09-12T22:32:04.047 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 26.626103444000002, 2024-09-12T22:32:04.047 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0096045620000000005, 2024-09-12T22:32:04.047 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:04.047 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:04.047 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:04.047 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:04.048 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.048 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:04.048 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400952+0000", 2024-09-12T22:32:04.048 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:04.049 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.049 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.049 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:04.049 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400952+0000", 2024-09-12T22:32:04.049 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:04.050 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.050 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.050 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:04.050 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400953+0000", 2024-09-12T22:32:04.050 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.8000000000000005e-07 2024-09-12T22:32:04.050 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.050 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.050 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:04.051 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400957+0000", 2024-09-12T22:32:04.051 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.33e-06 2024-09-12T22:32:04.051 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.051 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.051 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:04.051 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400966+0000", 2024-09-12T22:32:04.051 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1989999999999995e-06 2024-09-12T22:32:04.051 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.051 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.051 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:04.052 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400973+0000", 2024-09-12T22:32:04.052 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2779999999999999e-06 2024-09-12T22:32:04.052 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.052 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.052 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:04.052 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401696+0000", 2024-09-12T22:32:04.052 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00072363500000000003 2024-09-12T22:32:04.052 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.053 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.053 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:04.053 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401788+0000", 2024-09-12T22:32:04.053 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1862999999999998e-05 2024-09-12T22:32:04.053 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.053 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.053 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:04.053 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401929+0000", 2024-09-12T22:32:04.053 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014096000000000001 2024-09-12T22:32:04.054 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.054 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.054 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:04.054 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.403542+0000", 2024-09-12T22:32:04.054 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001612963 2024-09-12T22:32:04.054 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.054 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.054 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:04.054 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410460+0000", 2024-09-12T22:32:04.054 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0069180500000000002 2024-09-12T22:32:04.054 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.055 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.055 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:04.055 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410515+0000", 2024-09-12T22:32:04.055 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5009000000000001e-05 2024-09-12T22:32:04.055 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.055 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.056 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:04.056 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410557+0000", 2024-09-12T22:32:04.056 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1495000000000002e-05 2024-09-12T22:32:04.056 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:04.056 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:04.056 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:04.057 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.057 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.057 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:04.057 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.400984+0000", 2024-09-12T22:32:04.057 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 26.626070948999999, 2024-09-12T22:32:04.058 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0073703950000000001, 2024-09-12T22:32:04.058 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:04.058 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:04.058 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:04.058 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:04.058 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.058 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:04.058 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400984+0000", 2024-09-12T22:32:04.058 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:04.058 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.059 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.059 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:04.059 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400984+0000", 2024-09-12T22:32:04.059 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:04.060 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.060 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.060 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:04.060 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400985+0000", 2024-09-12T22:32:04.060 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3200000000000005e-07 2024-09-12T22:32:04.061 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.061 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.061 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:04.061 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400998+0000", 2024-09-12T22:32:04.061 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2726e-05 2024-09-12T22:32:04.061 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.061 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.061 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:04.062 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401006+0000", 2024-09-12T22:32:04.062 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.3110000000000006e-06 2024-09-12T22:32:04.062 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.062 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.062 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:04.062 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401022+0000", 2024-09-12T22:32:04.063 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6249e-05 2024-09-12T22:32:04.063 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.063 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.063 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:04.063 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401700+0000", 2024-09-12T22:32:04.063 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00067811100000000001 2024-09-12T22:32:04.063 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.063 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.063 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:04.063 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401839+0000", 2024-09-12T22:32:04.064 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013865399999999999 2024-09-12T22:32:04.064 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.064 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.064 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:04.064 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401962+0000", 2024-09-12T22:32:04.064 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000123266 2024-09-12T22:32:04.064 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.065 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.065 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:04.065 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.403589+0000", 2024-09-12T22:32:04.065 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001626932 2024-09-12T22:32:04.065 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.065 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.066 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:04.066 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.408274+0000", 2024-09-12T22:32:04.066 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0046848100000000002 2024-09-12T22:32:04.066 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.066 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.066 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:04.066 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.408324+0000", 2024-09-12T22:32:04.066 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9784000000000003e-05 2024-09-12T22:32:04.067 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.067 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.067 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:04.067 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.408355+0000", 2024-09-12T22:32:04.067 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.1019999999999998e-05 2024-09-12T22:32:04.067 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:04.067 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:04.067 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:04.067 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.067 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.067 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:04.067 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401034+0000", 2024-09-12T22:32:04.067 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 26.626021509000001, 2024-09-12T22:32:04.068 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011063051000000001, 2024-09-12T22:32:04.068 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:04.068 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:04.068 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:04.068 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:04.068 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.068 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:04.068 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401034+0000", 2024-09-12T22:32:04.068 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:04.068 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.068 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.069 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:04.069 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401034+0000", 2024-09-12T22:32:04.069 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:04.069 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.069 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.069 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:04.069 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401034+0000", 2024-09-12T22:32:04.070 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8899999999999999e-07 2024-09-12T22:32:04.070 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.070 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.070 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:04.070 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401038+0000", 2024-09-12T22:32:04.070 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.523e-06 2024-09-12T22:32:04.070 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.070 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.070 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:04.070 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401046+0000", 2024-09-12T22:32:04.070 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0479999999999999e-06 2024-09-12T22:32:04.071 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.071 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.071 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:04.071 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401051+0000", 2024-09-12T22:32:04.071 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2619999999999998e-06 2024-09-12T22:32:04.071 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.071 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.071 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:04.071 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402270+0000", 2024-09-12T22:32:04.071 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012182429999999999 2024-09-12T22:32:04.071 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.071 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.071 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:04.072 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402325+0000", 2024-09-12T22:32:04.072 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5526999999999999e-05 2024-09-12T22:32:04.072 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.072 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.072 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:04.072 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402403+0000", 2024-09-12T22:32:04.072 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.7559999999999996e-05 2024-09-12T22:32:04.072 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.072 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.072 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:04.072 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.403655+0000", 2024-09-12T22:32:04.072 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012521489999999999 2024-09-12T22:32:04.072 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.072 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.073 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:04.073 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411979+0000", 2024-09-12T22:32:04.073 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0083240420000000002 2024-09-12T22:32:04.073 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.073 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.073 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:04.073 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.412036+0000", 2024-09-12T22:32:04.073 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7639000000000002e-05 2024-09-12T22:32:04.073 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.073 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.073 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:04.073 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.412097+0000", 2024-09-12T22:32:04.073 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0469e-05 2024-09-12T22:32:04.074 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:04.074 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:04.074 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:04.074 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.074 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.074 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:04.074 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401060+0000", 2024-09-12T22:32:04.074 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 26.625995756999998, 2024-09-12T22:32:04.074 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.010030172, 2024-09-12T22:32:04.074 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:04.074 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:04.074 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:04.075 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:04.075 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.075 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:04.075 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401060+0000", 2024-09-12T22:32:04.075 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:04.075 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.075 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.075 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:04.075 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401060+0000", 2024-09-12T22:32:04.075 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:04.075 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.076 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.076 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:04.076 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401060+0000", 2024-09-12T22:32:04.076 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2500000000000001e-07 2024-09-12T22:32:04.076 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.076 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.076 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:04.076 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401063+0000", 2024-09-12T22:32:04.076 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0910000000000001e-06 2024-09-12T22:32:04.076 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.076 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.076 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:04.077 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401070+0000", 2024-09-12T22:32:04.077 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1210000000000001e-06 2024-09-12T22:32:04.077 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.077 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.077 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:04.077 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401076+0000", 2024-09-12T22:32:04.077 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2830000000000001e-06 2024-09-12T22:32:04.077 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.077 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.077 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:04.077 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402288+0000", 2024-09-12T22:32:04.077 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012123699999999999 2024-09-12T22:32:04.078 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.078 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.078 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:04.078 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402359+0000", 2024-09-12T22:32:04.078 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.0988000000000005e-05 2024-09-12T22:32:04.078 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.078 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.078 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:04.078 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402457+0000", 2024-09-12T22:32:04.078 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.7857999999999997e-05 2024-09-12T22:32:04.078 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.078 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.079 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:04.079 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.404395+0000", 2024-09-12T22:32:04.079 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0019380160000000001 2024-09-12T22:32:04.079 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.079 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.079 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:04.079 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410603+0000", 2024-09-12T22:32:04.079 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.006208061 2024-09-12T22:32:04.079 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.079 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.079 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:04.079 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410687+0000", 2024-09-12T22:32:04.079 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.4623000000000006e-05 2024-09-12T22:32:04.080 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.080 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.080 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:04.080 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411090+0000", 2024-09-12T22:32:04.080 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00040233599999999999 2024-09-12T22:32:04.080 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:04.080 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:04.080 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:04.080 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.080 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.080 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:04.080 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401083+0000", 2024-09-12T22:32:04.081 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 26.625972341000001, 2024-09-12T22:32:04.081 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0097591850000000001, 2024-09-12T22:32:04.081 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:04.081 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:04.081 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:04.081 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:04.081 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.081 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:04.081 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401083+0000", 2024-09-12T22:32:04.081 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:04.081 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.081 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.081 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:04.082 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401083+0000", 2024-09-12T22:32:04.082 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:04.082 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.082 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.082 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:04.082 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401084+0000", 2024-09-12T22:32:04.082 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4799999999999999e-07 2024-09-12T22:32:04.083 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.083 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.083 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:04.083 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401088+0000", 2024-09-12T22:32:04.083 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6419999999999998e-06 2024-09-12T22:32:04.083 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.083 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.083 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:04.083 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401094+0000", 2024-09-12T22:32:04.083 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0090000000000004e-06 2024-09-12T22:32:04.083 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.083 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.083 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:04.083 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401108+0000", 2024-09-12T22:32:04.084 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3884e-05 2024-09-12T22:32:04.084 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.084 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.084 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:04.084 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401165+0000", 2024-09-12T22:32:04.084 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.6499000000000002e-05 2024-09-12T22:32:04.084 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.084 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.084 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:04.085 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401261+0000", 2024-09-12T22:32:04.085 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.6872000000000004e-05 2024-09-12T22:32:04.085 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.085 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.085 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:04.085 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401376+0000", 2024-09-12T22:32:04.085 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000114508 2024-09-12T22:32:04.085 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.085 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.085 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:04.086 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402666+0000", 2024-09-12T22:32:04.086 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012901659999999999 2024-09-12T22:32:04.086 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.086 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.086 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:04.086 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410572+0000", 2024-09-12T22:32:04.086 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0079055489999999996 2024-09-12T22:32:04.086 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.086 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.086 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:04.086 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410661+0000", 2024-09-12T22:32:04.087 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.9578000000000002e-05 2024-09-12T22:32:04.087 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.087 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.087 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:04.087 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410842+0000", 2024-09-12T22:32:04.087 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00018102999999999999 2024-09-12T22:32:04.087 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:04.087 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:04.087 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:04.087 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.088 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.088 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:04.088 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401122+0000", 2024-09-12T22:32:04.088 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 26.625933309000001, 2024-09-12T22:32:04.088 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0099122080000000005, 2024-09-12T22:32:04.088 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:04.088 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:04.088 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:32:04.088 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:04.089 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.089 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:04.089 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401122+0000", 2024-09-12T22:32:04.089 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:04.089 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.089 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.089 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:04.089 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401122+0000", 2024-09-12T22:32:04.089 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:04.089 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.090 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.090 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:04.090 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401123+0000", 2024-09-12T22:32:04.090 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2600000000000002e-07 2024-09-12T22:32:04.090 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.090 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.090 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:04.090 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401126+0000", 2024-09-12T22:32:04.090 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.6449999999999998e-06 2024-09-12T22:32:04.090 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.091 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.091 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:04.091 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401133+0000", 2024-09-12T22:32:04.091 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.9890000000000003e-06 2024-09-12T22:32:04.091 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.091 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.091 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:04.091 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401138+0000", 2024-09-12T22:32:04.092 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8060000000000002e-06 2024-09-12T22:32:04.092 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.092 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.092 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:04.092 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401703+0000", 2024-09-12T22:32:04.092 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00056509099999999999 2024-09-12T22:32:04.092 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.092 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.092 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:04.093 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401837+0000", 2024-09-12T22:32:04.093 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013338799999999999 2024-09-12T22:32:04.093 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.093 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.093 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:04.093 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411034+0000", 2024-09-12T22:32:04.093 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.009197663 2024-09-12T22:32:04.093 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:04.094 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:04.094 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:04.094 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.094 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.094 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:04.094 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401158+0000", 2024-09-12T22:32:04.094 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 26.62589753, 2024-09-12T22:32:04.094 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.010292437999999999, 2024-09-12T22:32:04.095 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:04.095 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:04.095 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:32:04.095 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:04.095 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.095 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:04.095 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401158+0000", 2024-09-12T22:32:04.095 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:04.095 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.095 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.095 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:04.095 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401158+0000", 2024-09-12T22:32:04.096 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:04.096 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.096 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.096 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:04.096 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401158+0000", 2024-09-12T22:32:04.096 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9699999999999996e-07 2024-09-12T22:32:04.096 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.096 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.096 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:04.096 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401161+0000", 2024-09-12T22:32:04.096 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.7410000000000001e-06 2024-09-12T22:32:04.096 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.096 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.097 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:04.097 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401168+0000", 2024-09-12T22:32:04.097 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.844e-06 2024-09-12T22:32:04.097 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.097 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.097 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:04.097 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401174+0000", 2024-09-12T22:32:04.097 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4700000000000001e-06 2024-09-12T22:32:04.097 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.097 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.097 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:04.098 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402799+0000", 2024-09-12T22:32:04.098 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0016256409999999999 2024-09-12T22:32:04.098 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.098 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.098 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:04.098 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402893+0000", 2024-09-12T22:32:04.098 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.3807999999999994e-05 2024-09-12T22:32:04.098 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.098 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.098 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:04.098 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411450+0000", 2024-09-12T22:32:04.098 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0085573369999999999 2024-09-12T22:32:04.098 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:04.099 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:04.099 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:04.099 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.099 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.099 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:04.099 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401183+0000", 2024-09-12T22:32:04.099 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 26.625872678, 2024-09-12T22:32:04.099 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0068597830000000004, 2024-09-12T22:32:04.099 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:04.099 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:04.100 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:32:04.100 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:04.100 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.100 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:04.100 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401183+0000", 2024-09-12T22:32:04.100 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:04.100 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.100 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.100 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:04.100 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401183+0000", 2024-09-12T22:32:04.100 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:04.100 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.101 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.101 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:04.101 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401183+0000", 2024-09-12T22:32:04.101 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.6700000000000003e-07 2024-09-12T22:32:04.101 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.101 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.101 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:04.101 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401186+0000", 2024-09-12T22:32:04.101 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4679999999999999e-06 2024-09-12T22:32:04.101 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.102 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.102 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:04.102 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401192+0000", 2024-09-12T22:32:04.102 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.1519999999999997e-06 2024-09-12T22:32:04.102 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.102 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.102 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:04.102 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401197+0000", 2024-09-12T22:32:04.103 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4669999999999998e-06 2024-09-12T22:32:04.103 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.103 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.103 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:04.103 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401253+0000", 2024-09-12T22:32:04.103 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.6211000000000001e-05 2024-09-12T22:32:04.103 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.103 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.103 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:04.103 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401413+0000", 2024-09-12T22:32:04.103 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00016021399999999999 2024-09-12T22:32:04.104 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.104 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.104 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:04.104 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.408043+0000", 2024-09-12T22:32:04.104 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0066295039999999996 2024-09-12T22:32:04.104 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:04.104 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:04.104 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:04.104 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.104 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.104 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:20 3.1c e19/17 3:3ed09add:::607.00000000:head v 19'1, mlcod=0'0)", 2024-09-12T22:32:04.105 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.409642+0000", 2024-09-12T22:32:04.105 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 26.617413218999999, 2024-09-12T22:32:04.105 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0038816269999999999, 2024-09-12T22:32:04.105 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:04.105 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:04.105 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:04.105 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:04.105 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.105 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:04.105 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409642+0000", 2024-09-12T22:32:04.105 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:04.106 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.106 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.106 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:04.106 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409642+0000", 2024-09-12T22:32:04.106 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:04.106 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.106 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.106 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:04.106 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409642+0000", 2024-09-12T22:32:04.106 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.6899999999999999e-07 2024-09-12T22:32:04.106 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.106 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.106 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:04.107 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409648+0000", 2024-09-12T22:32:04.107 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.49e-06 2024-09-12T22:32:04.107 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.107 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.107 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:04.107 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409656+0000", 2024-09-12T22:32:04.107 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.2949999999999994e-06 2024-09-12T22:32:04.107 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.107 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.107 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:04.107 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409664+0000", 2024-09-12T22:32:04.107 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.1219999999999995e-06 2024-09-12T22:32:04.108 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.108 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.108 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:04.108 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409707+0000", 2024-09-12T22:32:04.108 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2222000000000003e-05 2024-09-12T22:32:04.108 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.108 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.108 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:04.108 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409724+0000", 2024-09-12T22:32:04.108 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7496999999999999e-05 2024-09-12T22:32:04.108 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.109 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.109 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:04.109 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413439+0000", 2024-09-12T22:32:04.109 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00371448 2024-09-12T22:32:04.109 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.109 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.109 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:04.109 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413524+0000", 2024-09-12T22:32:04.109 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.5252000000000003e-05 2024-09-12T22:32:04.109 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:04.109 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:04.109 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:04.110 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.110 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.110 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:28 3.13 e19/17 3:cd5a64a3:::100.00000000:head v 19'1, mlcod=0'0)", 2024-09-12T22:32:04.110 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.409681+0000", 2024-09-12T22:32:04.110 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 26.617374735999999, 2024-09-12T22:32:04.110 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0038708710000000001, 2024-09-12T22:32:04.110 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:04.110 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:04.110 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:04.110 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:04.111 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.111 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:04.111 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409681+0000", 2024-09-12T22:32:04.111 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:04.111 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.111 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.111 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:04.111 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409681+0000", 2024-09-12T22:32:04.111 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:04.111 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.111 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.111 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:04.112 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409681+0000", 2024-09-12T22:32:04.112 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3000000000000002e-07 2024-09-12T22:32:04.112 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.112 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.112 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:04.112 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409695+0000", 2024-09-12T22:32:04.112 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4313e-05 2024-09-12T22:32:04.112 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.112 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.112 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:04.112 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409703+0000", 2024-09-12T22:32:04.112 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4000000000000003e-06 2024-09-12T22:32:04.112 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.113 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.113 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:04.113 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409708+0000", 2024-09-12T22:32:04.113 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3190000000000002e-06 2024-09-12T22:32:04.113 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.113 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.113 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:04.113 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409875+0000", 2024-09-12T22:32:04.113 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000167329 2024-09-12T22:32:04.113 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.114 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.114 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:04.114 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409892+0000", 2024-09-12T22:32:04.114 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6957999999999999e-05 2024-09-12T22:32:04.114 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.114 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.114 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:04.114 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413457+0000", 2024-09-12T22:32:04.114 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0035651279999999999 2024-09-12T22:32:04.114 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.114 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.114 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:04.114 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413552+0000", 2024-09-12T22:32:04.115 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.4093999999999997e-05 2024-09-12T22:32:04.115 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:04.115 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:04.115 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:04.115 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.115 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.115 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:21 3.1c e19/17 3:3ed09add:::607.00000000:head v 19'2, mlcod=0'0)", 2024-09-12T22:32:04.115 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.409718+0000", 2024-09-12T22:32:04.115 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 26.617337071000001, 2024-09-12T22:32:04.115 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003851883, 2024-09-12T22:32:04.115 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:04.116 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:04.116 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:04.116 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:04.116 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.116 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:04.116 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409718+0000", 2024-09-12T22:32:04.116 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:04.116 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.116 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.116 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:04.117 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409718+0000", 2024-09-12T22:32:04.117 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:04.117 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.117 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.117 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:04.117 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409719+0000", 2024-09-12T22:32:04.117 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.16e-07 2024-09-12T22:32:04.117 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.117 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.117 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:04.117 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409722+0000", 2024-09-12T22:32:04.118 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.692e-06 2024-09-12T22:32:04.118 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.118 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.118 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:04.118 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409729+0000", 2024-09-12T22:32:04.118 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.516e-06 2024-09-12T22:32:04.118 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.118 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.118 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:04.119 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409750+0000", 2024-09-12T22:32:04.119 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1151000000000001e-05 2024-09-12T22:32:04.119 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.119 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.119 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:04.119 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410015+0000", 2024-09-12T22:32:04.119 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00026477599999999999 2024-09-12T22:32:04.119 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.119 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.119 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:04.119 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410104+0000", 2024-09-12T22:32:04.119 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.9586000000000006e-05 2024-09-12T22:32:04.119 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.120 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.120 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:04.120 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413528+0000", 2024-09-12T22:32:04.120 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0034237880000000001 2024-09-12T22:32:04.120 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.120 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.120 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:04.120 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413570+0000", 2024-09-12T22:32:04.120 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2157999999999999e-05 2024-09-12T22:32:04.121 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:04.121 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:04.121 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:04.121 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.121 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.121 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:27 3.13 e19/17 3:c91d4a1d:::mds0_inotable:head v 19'2, mlcod=0'0)", 2024-09-12T22:32:04.121 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.409760+0000", 2024-09-12T22:32:04.121 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 26.617295554999998, 2024-09-12T22:32:04.121 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0039301910000000004, 2024-09-12T22:32:04.121 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:04.122 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:04.122 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:04.122 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:04.122 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.122 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:04.122 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409760+0000", 2024-09-12T22:32:04.122 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:04.123 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.123 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.123 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:04.123 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409760+0000", 2024-09-12T22:32:04.123 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:04.123 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.123 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.123 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:04.123 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409760+0000", 2024-09-12T22:32:04.123 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.39e-07 2024-09-12T22:32:04.123 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.123 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.124 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:04.124 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409765+0000", 2024-09-12T22:32:04.124 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4449999999999998e-06 2024-09-12T22:32:04.124 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.124 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.124 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:04.124 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409771+0000", 2024-09-12T22:32:04.124 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7159999999999997e-06 2024-09-12T22:32:04.124 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.124 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.124 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:04.125 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409778+0000", 2024-09-12T22:32:04.125 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.331e-06 2024-09-12T22:32:04.125 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.125 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.125 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:04.125 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410191+0000", 2024-09-12T22:32:04.125 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00041348300000000003 2024-09-12T22:32:04.125 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.125 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.125 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:04.125 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410211+0000", 2024-09-12T22:32:04.125 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9933999999999999e-05 2024-09-12T22:32:04.125 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.125 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.126 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:04.126 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413638+0000", 2024-09-12T22:32:04.126 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003426854 2024-09-12T22:32:04.126 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.126 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.126 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:04.126 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413690+0000", 2024-09-12T22:32:04.126 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2089000000000002e-05 2024-09-12T22:32:04.126 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:04.127 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:04.127 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:04.127 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.127 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.127 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "pg_update_log_missing_reply(3.b epoch 19/17 rep_tid 4 lcod 19'2)", 2024-09-12T22:32:04.127 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.410060+0000", 2024-09-12T22:32:04.127 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 26.616995889999998, 2024-09-12T22:32:04.127 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00098016500000000007, 2024-09-12T22:32:04.127 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:04.127 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:04.128 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "reached pg", 2024-09-12T22:32:04.128 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:04.128 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.128 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:04.128 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410060+0000", 2024-09-12T22:32:04.128 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:04.128 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.128 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.128 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:04.129 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410060+0000", 2024-09-12T22:32:04.129 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:04.129 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.129 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.129 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:04.129 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410060+0000", 2024-09-12T22:32:04.129 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.8299999999999998e-07 2024-09-12T22:32:04.129 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.130 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.130 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:04.130 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410062+0000", 2024-09-12T22:32:04.130 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5749999999999999e-06 2024-09-12T22:32:04.130 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.130 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.130 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:04.131 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410070+0000", 2024-09-12T22:32:04.131 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.909e-06 2024-09-12T22:32:04.131 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.131 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.131 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:04.131 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410076+0000", 2024-09-12T22:32:04.131 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7049999999999996e-06 2024-09-12T22:32:04.131 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.131 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.131 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:04.131 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410943+0000", 2024-09-12T22:32:04.132 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00086681900000000001 2024-09-12T22:32:04.132 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.132 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.132 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:04.132 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411040+0000", 2024-09-12T22:32:04.132 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.6774000000000006e-05 2024-09-12T22:32:04.132 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:04.132 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:04.132 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:04.132 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.132 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.133 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e19/17 ondisk, result = 0)", 2024-09-12T22:32:04.133 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.410113+0000", 2024-09-12T22:32:04.133 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 26.616942623, 2024-09-12T22:32:04.133 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00098911599999999995, 2024-09-12T22:32:04.133 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:04.133 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:04.133 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:32:04.133 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:04.133 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.133 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:04.133 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410113+0000", 2024-09-12T22:32:04.133 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:04.134 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.134 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.134 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:04.134 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410113+0000", 2024-09-12T22:32:04.134 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:04.134 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.134 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.134 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:04.134 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410113+0000", 2024-09-12T22:32:04.134 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.99e-07 2024-09-12T22:32:04.134 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.135 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.135 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:04.135 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410115+0000", 2024-09-12T22:32:04.135 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.046e-06 2024-09-12T22:32:04.135 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.135 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.135 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:04.135 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410121+0000", 2024-09-12T22:32:04.135 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0050000000000001e-06 2024-09-12T22:32:04.135 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.135 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.135 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:04.136 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410126+0000", 2024-09-12T22:32:04.136 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8339999999999998e-06 2024-09-12T22:32:04.136 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.136 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.136 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:04.136 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410587+0000", 2024-09-12T22:32:04.136 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00046095499999999998 2024-09-12T22:32:04.136 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.136 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.136 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:04.136 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410595+0000", 2024-09-12T22:32:04.136 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.9419999999999995e-06 2024-09-12T22:32:04.137 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.137 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.137 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:04.137 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411102+0000", 2024-09-12T22:32:04.137 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00050713500000000003 2024-09-12T22:32:04.137 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:04.137 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:04.137 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:04.137 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.137 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.137 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 19/17 rep_tid 8 lcod 19'4)", 2024-09-12T22:32:04.137 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.410133+0000", 2024-09-12T22:32:04.138 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 26.616922695, 2024-09-12T22:32:04.138 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0013504000000000001, 2024-09-12T22:32:04.138 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:04.138 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:04.138 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "reached pg", 2024-09-12T22:32:04.138 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:04.138 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.138 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:04.138 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410133+0000", 2024-09-12T22:32:04.138 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:04.138 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.138 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.139 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:04.139 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410133+0000", 2024-09-12T22:32:04.139 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:04.139 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.139 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.139 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:04.139 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410133+0000", 2024-09-12T22:32:04.139 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.0599999999999999e-07 2024-09-12T22:32:04.139 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.139 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.139 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:04.139 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410135+0000", 2024-09-12T22:32:04.139 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7770000000000001e-06 2024-09-12T22:32:04.140 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.140 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.140 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:04.140 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410140+0000", 2024-09-12T22:32:04.140 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9960000000000001e-06 2024-09-12T22:32:04.140 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.140 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.140 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:04.140 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410144+0000", 2024-09-12T22:32:04.140 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9500000000000003e-06 2024-09-12T22:32:04.140 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.140 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.140 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:04.141 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411310+0000", 2024-09-12T22:32:04.141 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001166311 2024-09-12T22:32:04.141 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.141 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.141 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:04.141 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411483+0000", 2024-09-12T22:32:04.141 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00017316 2024-09-12T22:32:04.141 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:04.141 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:04.141 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:04.141 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.141 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.142 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "pg_update_log_missing(3.1a epoch 19/17 rep_tid 0 entries 19'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T22:32:04.142 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.410617+0000", 2024-09-12T22:32:04.142 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 26.616438299999999, 2024-09-12T22:32:04.142 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0030439709999999999, 2024-09-12T22:32:04.142 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:04.142 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:04.142 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "reached pg", 2024-09-12T22:32:04.142 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:04.142 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.142 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:04.142 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410617+0000", 2024-09-12T22:32:04.142 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:04.143 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.143 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.143 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:04.143 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410617+0000", 2024-09-12T22:32:04.143 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:04.143 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.143 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.143 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:04.143 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410617+0000", 2024-09-12T22:32:04.143 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3599999999999999e-07 2024-09-12T22:32:04.143 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.143 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.143 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:04.144 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410625+0000", 2024-09-12T22:32:04.144 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5410000000000003e-06 2024-09-12T22:32:04.144 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.144 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.144 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:04.144 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410638+0000", 2024-09-12T22:32:04.144 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3261999999999999e-05 2024-09-12T22:32:04.144 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.144 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.144 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:04.145 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410653+0000", 2024-09-12T22:32:04.145 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4844000000000001e-05 2024-09-12T22:32:04.145 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.145 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.145 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:04.145 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410814+0000", 2024-09-12T22:32:04.145 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00016119999999999999 2024-09-12T22:32:04.145 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.145 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.145 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:04.145 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413661+0000", 2024-09-12T22:32:04.145 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0028467879999999998 2024-09-12T22:32:04.145 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:04.146 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:04.146 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:04.146 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.146 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.146 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-09-12T22:32:04.146 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:39.398875+0000", 2024-09-12T22:32:04.146 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 24.628180019999999, 2024-09-12T22:32:04.146 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0015679069999999999, 2024-09-12T22:32:04.146 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:04.146 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:04.146 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:04.147 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:04.147 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.147 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:04.147 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398875+0000", 2024-09-12T22:32:04.147 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:04.147 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.147 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.147 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:04.147 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398875+0000", 2024-09-12T22:32:04.147 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:04.147 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.147 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.147 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:04.148 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398878+0000", 2024-09-12T22:32:04.148 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1679999999999998e-06 2024-09-12T22:32:04.148 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.148 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.148 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:04.148 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398888+0000", 2024-09-12T22:32:04.148 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.084e-05 2024-09-12T22:32:04.148 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.148 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.148 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:04.148 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398906+0000", 2024-09-12T22:32:04.148 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7518000000000001e-05 2024-09-12T22:32:04.149 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.149 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.149 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:04.149 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398914+0000", 2024-09-12T22:32:04.149 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5989999999999996e-06 2024-09-12T22:32:04.149 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.149 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.149 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:04.149 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398974+0000", 2024-09-12T22:32:04.149 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0988e-05 2024-09-12T22:32:04.149 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.149 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.149 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:04.150 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.399078+0000", 2024-09-12T22:32:04.150 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000103133 2024-09-12T22:32:04.150 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.150 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.150 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:04.150 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.399166+0000", 2024-09-12T22:32:04.150 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.8183999999999995e-05 2024-09-12T22:32:04.150 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.150 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.150 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:04.150 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.399747+0000", 2024-09-12T22:32:04.150 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00058110599999999996 2024-09-12T22:32:04.151 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.151 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.151 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:04.151 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.400377+0000", 2024-09-12T22:32:04.151 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000630157 2024-09-12T22:32:04.151 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.151 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.151 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:04.151 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.400415+0000", 2024-09-12T22:32:04.151 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7814000000000001e-05 2024-09-12T22:32:04.151 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.151 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.151 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:04.151 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.400443+0000", 2024-09-12T22:32:04.152 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8399999999999999e-05 2024-09-12T22:32:04.152 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:04.152 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:04.152 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:04.152 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.152 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.152 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e23)", 2024-09-12T22:32:04.152 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:58.400966+0000", 2024-09-12T22:32:04.152 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 5.6260891119999998, 2024-09-12T22:32:04.152 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001468876, 2024-09-12T22:32:04.152 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:04.153 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:04.153 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:04.153 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:04.153 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.153 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:04.153 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400966+0000", 2024-09-12T22:32:04.153 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:04.153 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.153 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.154 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:04.154 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400966+0000", 2024-09-12T22:32:04.154 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:04.154 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.154 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.154 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:04.154 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400967+0000", 2024-09-12T22:32:04.154 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.046e-06 2024-09-12T22:32:04.154 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.154 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.154 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:04.154 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400974+0000", 2024-09-12T22:32:04.154 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2310000000000001e-06 2024-09-12T22:32:04.154 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.155 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.155 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:04.155 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400988+0000", 2024-09-12T22:32:04.155 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4482e-05 2024-09-12T22:32:04.155 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.155 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.155 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:04.155 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400997+0000", 2024-09-12T22:32:04.156 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.0189999999999995e-06 2024-09-12T22:32:04.156 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.156 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.156 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:04.156 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.401068+0000", 2024-09-12T22:32:04.156 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1426000000000004e-05 2024-09-12T22:32:04.156 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.156 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.156 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:04.156 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.401174+0000", 2024-09-12T22:32:04.156 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000105769 2024-09-12T22:32:04.156 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.157 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.157 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:04.157 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.401335+0000", 2024-09-12T22:32:04.157 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000161225 2024-09-12T22:32:04.157 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.157 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.157 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:04.157 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.402110+0000", 2024-09-12T22:32:04.158 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00077428800000000004 2024-09-12T22:32:04.158 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.158 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.158 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:04.158 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.402333+0000", 2024-09-12T22:32:04.158 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000223723 2024-09-12T22:32:04.158 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.158 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.158 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:04.158 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.402388+0000", 2024-09-12T22:32:04.158 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4700999999999997e-05 2024-09-12T22:32:04.158 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:04.158 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:04.159 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:04.159 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.402435+0000", 2024-09-12T22:32:04.159 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6965999999999997e-05 2024-09-12T22:32:04.159 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:04.159 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:04.159 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:04.159 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:04.160 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:04.160 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:32:04.160 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T22:32:04.162 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:04.160+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:04.163 INFO:teuthology.orchestra.run.smithi019.stderr:reweighted osd.2 to 1 (10000) 2024-09-12T22:32:04.164 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:32:04.164 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-12T22:32:04.164 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T22:32:04.262 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:04.261+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:04.280 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-09-12T22:32:04.280 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-09-12T22:32:04.280 INFO:teuthology.orchestra.run.smithi163.stdout: "num_ops": 0 2024-09-12T22:32:04.280 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-09-12T22:32:04.290 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:32:04.350 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T22:32:04.363 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:32:04.363+0000 7fddec6a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30331) UID: 0 2024-09-12T22:32:04.395 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-09-12T22:32:04.395 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-09-12T22:32:04.395 INFO:teuthology.orchestra.run.smithi163.stdout: "complaint_time": 30, 2024-09-12T22:32:04.395 INFO:teuthology.orchestra.run.smithi163.stdout: "num_blocked_ops": 0 2024-09-12T22:32:04.395 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-09-12T22:32:04.404 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:32:04.465 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:04.464+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:04.477 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0: {} 2024-09-12T22:32:04.477 INFO:teuthology.orchestra.run.smithi019.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T22:32:04.495 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T22:32:04.495 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:32:04.509 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-09-12T22:32:04.509 INFO:teuthology.orchestra.run.smithi163.stdout: "size": 20, 2024-09-12T22:32:04.509 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 600, 2024-09-12T22:32:04.509 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2024-09-12T22:32:04.509 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.509 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-09-12T22:32:04.509 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:27.254459+0000", 2024-09-12T22:32:04.509 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 37.252346080999999, 2024-09-12T22:32:04.510 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.37816283899999997, 2024-09-12T22:32:04.510 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:04.510 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:04.510 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:04.510 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:04.510 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:04.510 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:04.510 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 1 2024-09-12T22:32:04.510 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.510 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:04.510 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.510 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:04.510 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254459+0000", 2024-09-12T22:32:04.512 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:04.512 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.512 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.512 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:04.513 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254459+0000", 2024-09-12T22:32:04.513 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:04.513 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.513 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.513 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:04.513 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254460+0000", 2024-09-12T22:32:04.513 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1739999999999999e-06 2024-09-12T22:32:04.513 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.513 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.514 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:04.514 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254472+0000", 2024-09-12T22:32:04.514 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2207e-05 2024-09-12T22:32:04.514 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.514 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.514 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:04.514 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254483+0000", 2024-09-12T22:32:04.514 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0631999999999999e-05 2024-09-12T22:32:04.514 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.514 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.514 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:04.515 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254492+0000", 2024-09-12T22:32:04.515 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3670000000000003e-06 2024-09-12T22:32:04.515 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.515 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.515 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:04.515 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254551+0000", 2024-09-12T22:32:04.515 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8687999999999998e-05 2024-09-12T22:32:04.515 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.515 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.515 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for peered", 2024-09-12T22:32:04.515 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254562+0000", 2024-09-12T22:32:04.515 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1249e-05 2024-09-12T22:32:04.515 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.516 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.516 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:04.516 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.631211+0000", 2024-09-12T22:32:04.516 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.376649018 2024-09-12T22:32:04.516 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.516 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.516 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:04.516 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.631345+0000", 2024-09-12T22:32:04.516 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013378700000000001 2024-09-12T22:32:04.516 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.516 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.516 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:04.516 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.631479+0000", 2024-09-12T22:32:04.517 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013352399999999999 2024-09-12T22:32:04.517 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.517 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.517 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:04.517 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632324+0000", 2024-09-12T22:32:04.517 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00084508100000000002 2024-09-12T22:32:04.517 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.517 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.517 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:04.517 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632548+0000", 2024-09-12T22:32:04.517 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000224329 2024-09-12T22:32:04.517 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.517 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.517 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:04.518 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632591+0000", 2024-09-12T22:32:04.518 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2564000000000001e-05 2024-09-12T22:32:04.518 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.518 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.518 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:04.518 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632622+0000", 2024-09-12T22:32:04.518 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1219e-05 2024-09-12T22:32:04.518 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:04.518 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:04.518 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:04.518 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.518 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.518 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:185 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:32:04.519 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394355+0000", 2024-09-12T22:32:04.519 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 36.112449984000001, 2024-09-12T22:32:04.519 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011302394, 2024-09-12T22:32:04.519 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:04.519 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:04.519 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:04.519 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:04.519 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:04.519 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:04.519 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 185 2024-09-12T22:32:04.519 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.519 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:04.519 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.519 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:04.520 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394355+0000", 2024-09-12T22:32:04.520 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:04.520 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.520 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.520 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:04.520 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394355+0000", 2024-09-12T22:32:04.520 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:04.520 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.520 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.520 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:04.520 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394355+0000", 2024-09-12T22:32:04.520 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9099999999999999e-07 2024-09-12T22:32:04.520 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.520 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.521 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:04.521 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394385+0000", 2024-09-12T22:32:04.521 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9963000000000001e-05 2024-09-12T22:32:04.521 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.521 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.521 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:04.521 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394390+0000", 2024-09-12T22:32:04.521 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8420000000000004e-06 2024-09-12T22:32:04.521 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.521 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.521 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:04.521 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394393+0000", 2024-09-12T22:32:04.521 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1e-06 2024-09-12T22:32:04.522 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.522 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.522 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:04.522 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.400546+0000", 2024-09-12T22:32:04.522 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0061523309999999996 2024-09-12T22:32:04.522 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.522 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.522 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:04.522 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.400588+0000", 2024-09-12T22:32:04.522 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1835000000000002e-05 2024-09-12T22:32:04.522 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.522 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.522 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:04.522 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.400677+0000", 2024-09-12T22:32:04.523 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9195000000000002e-05 2024-09-12T22:32:04.523 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.523 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.523 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:04.523 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405378+0000", 2024-09-12T22:32:04.523 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0047008659999999997 2024-09-12T22:32:04.523 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.523 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.523 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:04.524 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405569+0000", 2024-09-12T22:32:04.524 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00019148599999999999 2024-09-12T22:32:04.524 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.524 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.524 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:04.524 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405620+0000", 2024-09-12T22:32:04.524 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1416999999999999e-05 2024-09-12T22:32:04.524 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.524 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.524 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:04.524 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405657+0000", 2024-09-12T22:32:04.524 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6968000000000002e-05 2024-09-12T22:32:04.524 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:04.525 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:04.525 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:04.525 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.525 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.525 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:32:04.525 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394399+0000", 2024-09-12T22:32:04.525 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 36.112405772999999, 2024-09-12T22:32:04.525 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011336601999999999, 2024-09-12T22:32:04.525 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:04.525 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:04.526 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:04.526 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:04.526 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:04.526 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:04.526 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 186 2024-09-12T22:32:04.526 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.526 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:04.526 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.526 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:04.526 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394399+0000", 2024-09-12T22:32:04.526 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:04.527 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.527 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.527 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:04.527 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394399+0000", 2024-09-12T22:32:04.527 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:04.527 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.527 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.527 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:04.527 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394400+0000", 2024-09-12T22:32:04.527 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4499999999999998e-07 2024-09-12T22:32:04.527 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.528 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.528 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:04.528 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394402+0000", 2024-09-12T22:32:04.528 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.875e-06 2024-09-12T22:32:04.528 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.528 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.528 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:04.528 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394405+0000", 2024-09-12T22:32:04.528 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6799999999999999e-06 2024-09-12T22:32:04.528 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.529 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.529 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:04.529 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394408+0000", 2024-09-12T22:32:04.529 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.667e-06 2024-09-12T22:32:04.529 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.529 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.529 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:04.529 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401395+0000", 2024-09-12T22:32:04.529 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0069867230000000002 2024-09-12T22:32:04.529 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.529 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.529 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:04.530 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401438+0000", 2024-09-12T22:32:04.530 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3554999999999999e-05 2024-09-12T22:32:04.530 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.530 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.530 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:04.530 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401509+0000", 2024-09-12T22:32:04.530 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0631999999999997e-05 2024-09-12T22:32:04.530 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.530 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.530 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:04.530 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405392+0000", 2024-09-12T22:32:04.530 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0038830449999999999 2024-09-12T22:32:04.530 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.531 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.531 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:04.531 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405690+0000", 2024-09-12T22:32:04.531 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000298435 2024-09-12T22:32:04.531 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.531 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.531 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:04.531 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405716+0000", 2024-09-12T22:32:04.531 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5435999999999998e-05 2024-09-12T22:32:04.531 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.532 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.532 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:04.532 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405736+0000", 2024-09-12T22:32:04.532 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0208999999999999e-05 2024-09-12T22:32:04.532 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:04.532 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:04.532 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:04.532 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.532 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.533 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:32:04.533 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394411+0000", 2024-09-12T22:32:04.533 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 36.112393646999998, 2024-09-12T22:32:04.533 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011400117, 2024-09-12T22:32:04.533 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:04.533 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:04.533 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:04.533 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:04.533 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:04.533 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:04.533 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 187 2024-09-12T22:32:04.533 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.533 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:04.534 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.534 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:04.534 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394411+0000", 2024-09-12T22:32:04.534 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:04.534 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.534 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.534 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:04.534 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394411+0000", 2024-09-12T22:32:04.534 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:04.534 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.534 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.535 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:04.535 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394412+0000", 2024-09-12T22:32:04.535 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.4999999999999999e-07 2024-09-12T22:32:04.535 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.535 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.535 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:04.535 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394414+0000", 2024-09-12T22:32:04.535 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.984e-06 2024-09-12T22:32:04.535 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.535 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.536 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:04.536 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394418+0000", 2024-09-12T22:32:04.536 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0840000000000002e-06 2024-09-12T22:32:04.536 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.536 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.536 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:04.536 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394431+0000", 2024-09-12T22:32:04.536 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.361e-05 2024-09-12T22:32:04.536 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.536 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.537 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:04.537 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401778+0000", 2024-09-12T22:32:04.537 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0073462659999999997 2024-09-12T22:32:04.537 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.537 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.537 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:04.537 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401853+0000", 2024-09-12T22:32:04.537 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5797000000000006e-05 2024-09-12T22:32:04.537 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.538 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.538 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:04.538 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401990+0000", 2024-09-12T22:32:04.538 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013651399999999999 2024-09-12T22:32:04.538 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.538 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.538 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:04.538 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405402+0000", 2024-09-12T22:32:04.538 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0034116070000000001 2024-09-12T22:32:04.538 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.539 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.539 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:04.539 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405764+0000", 2024-09-12T22:32:04.539 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00036234899999999998 2024-09-12T22:32:04.539 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.539 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.539 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:04.539 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405791+0000", 2024-09-12T22:32:04.539 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7029000000000002e-05 2024-09-12T22:32:04.539 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.539 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.539 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:04.539 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405812+0000", 2024-09-12T22:32:04.539 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0627000000000001e-05 2024-09-12T22:32:04.540 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:04.540 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:04.540 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:04.540 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.540 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.540 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:32:04.540 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394447+0000", 2024-09-12T22:32:04.540 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 36.112358495999999, 2024-09-12T22:32:04.540 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011759588, 2024-09-12T22:32:04.540 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:04.540 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:04.540 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:04.541 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:04.541 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:04.541 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:04.541 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 188 2024-09-12T22:32:04.541 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.541 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:04.541 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.541 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:04.541 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394447+0000", 2024-09-12T22:32:04.541 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:04.541 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.541 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.541 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:04.541 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394447+0000", 2024-09-12T22:32:04.542 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:04.542 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.542 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.542 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:04.542 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394447+0000", 2024-09-12T22:32:04.542 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.15e-07 2024-09-12T22:32:04.542 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.542 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.542 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:04.542 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394512+0000", 2024-09-12T22:32:04.542 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4580999999999997e-05 2024-09-12T22:32:04.542 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.542 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.543 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:04.543 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394518+0000", 2024-09-12T22:32:04.543 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.3380000000000001e-06 2024-09-12T22:32:04.543 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.543 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.543 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:04.543 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394521+0000", 2024-09-12T22:32:04.543 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3340000000000002e-06 2024-09-12T22:32:04.543 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.543 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.543 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:04.543 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.402628+0000", 2024-09-12T22:32:04.543 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.008106996 2024-09-12T22:32:04.543 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.544 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.544 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:04.544 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.402670+0000", 2024-09-12T22:32:04.544 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1983000000000001e-05 2024-09-12T22:32:04.544 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.544 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.544 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:04.544 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.402738+0000", 2024-09-12T22:32:04.544 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.8114999999999994e-05 2024-09-12T22:32:04.544 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.544 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.544 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:04.545 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405668+0000", 2024-09-12T22:32:04.545 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.002929545 2024-09-12T22:32:04.545 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.545 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.545 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:04.545 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406162+0000", 2024-09-12T22:32:04.545 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000494408 2024-09-12T22:32:04.545 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.545 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.545 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:04.545 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406188+0000", 2024-09-12T22:32:04.545 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5766e-05 2024-09-12T22:32:04.545 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.545 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.546 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:04.546 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406206+0000", 2024-09-12T22:32:04.546 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.8107000000000001e-05 2024-09-12T22:32:04.546 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:04.546 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:04.546 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:04.546 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.546 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.546 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:32:04.546 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394528+0000", 2024-09-12T22:32:04.546 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 36.112276827000002, 2024-09-12T22:32:04.547 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.01195536, 2024-09-12T22:32:04.547 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:04.547 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:04.547 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:04.547 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:04.547 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:04.547 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:04.547 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 189 2024-09-12T22:32:04.547 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.547 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:04.547 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.547 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:04.547 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394528+0000", 2024-09-12T22:32:04.547 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:04.548 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.548 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.548 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:04.548 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394528+0000", 2024-09-12T22:32:04.548 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:04.548 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.548 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.548 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:04.548 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394529+0000", 2024-09-12T22:32:04.548 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4900000000000001e-07 2024-09-12T22:32:04.548 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.548 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.548 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:04.549 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394531+0000", 2024-09-12T22:32:04.549 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.458e-06 2024-09-12T22:32:04.549 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.549 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.549 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:04.549 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394535+0000", 2024-09-12T22:32:04.549 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7900000000000001e-06 2024-09-12T22:32:04.549 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.549 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.549 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:04.549 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394537+0000", 2024-09-12T22:32:04.549 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.632e-06 2024-09-12T22:32:04.549 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.550 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.550 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:04.550 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.404932+0000", 2024-09-12T22:32:04.550 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010394158000000001 2024-09-12T22:32:04.550 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.550 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.550 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:04.550 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405017+0000", 2024-09-12T22:32:04.550 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5525000000000005e-05 2024-09-12T22:32:04.550 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.550 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.551 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:04.551 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405114+0000", 2024-09-12T22:32:04.551 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.6527000000000006e-05 2024-09-12T22:32:04.551 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.551 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.551 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:04.551 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405818+0000", 2024-09-12T22:32:04.551 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00070412800000000005 2024-09-12T22:32:04.551 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.551 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.551 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:04.551 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406437+0000", 2024-09-12T22:32:04.551 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00061898900000000002 2024-09-12T22:32:04.551 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.552 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.552 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:04.552 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406463+0000", 2024-09-12T22:32:04.552 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6268e-05 2024-09-12T22:32:04.552 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.552 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.552 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:04.552 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406484+0000", 2024-09-12T22:32:04.552 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0536000000000001e-05 2024-09-12T22:32:04.552 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:04.552 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:04.552 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:04.552 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.553 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.553 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:04.553 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.401422+0000", 2024-09-12T22:32:04.553 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 27.105382922, 2024-09-12T22:32:04.553 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016896452999999999, 2024-09-12T22:32:04.553 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:04.553 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:04.553 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:04.553 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:04.553 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.553 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:04.553 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401422+0000", 2024-09-12T22:32:04.553 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:04.554 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.554 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.554 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:04.554 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401422+0000", 2024-09-12T22:32:04.554 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:04.554 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.554 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.554 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:04.554 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401424+0000", 2024-09-12T22:32:04.554 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9e-06 2024-09-12T22:32:04.554 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.554 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.554 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:04.555 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401437+0000", 2024-09-12T22:32:04.555 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2831e-05 2024-09-12T22:32:04.555 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.555 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.555 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:04.555 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401471+0000", 2024-09-12T22:32:04.555 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4010000000000001e-05 2024-09-12T22:32:04.555 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.555 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.555 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:04.555 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401484+0000", 2024-09-12T22:32:04.555 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2711000000000001e-05 2024-09-12T22:32:04.555 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.555 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.555 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:04.556 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405410+0000", 2024-09-12T22:32:04.556 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0039259170000000001 2024-09-12T22:32:04.556 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.556 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.556 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:04.556 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405529+0000", 2024-09-12T22:32:04.556 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000119778 2024-09-12T22:32:04.556 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.556 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.556 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:04.556 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405655+0000", 2024-09-12T22:32:04.556 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012556700000000001 2024-09-12T22:32:04.556 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.556 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.557 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:04.557 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410456+0000", 2024-09-12T22:32:04.557 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0048008269999999997 2024-09-12T22:32:04.557 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.557 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.557 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:04.557 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418226+0000", 2024-09-12T22:32:04.557 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0077707729999999999 2024-09-12T22:32:04.557 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.557 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.557 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:04.557 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418277+0000", 2024-09-12T22:32:04.558 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0476000000000003e-05 2024-09-12T22:32:04.558 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.558 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.558 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:04.558 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418319+0000", 2024-09-12T22:32:04.558 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1662999999999997e-05 2024-09-12T22:32:04.558 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:04.558 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:04.558 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:04.558 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.558 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.558 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:04.558 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.401505+0000", 2024-09-12T22:32:04.558 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 27.105300258, 2024-09-12T22:32:04.559 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016987904000000002, 2024-09-12T22:32:04.559 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:04.559 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:04.559 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:04.559 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:04.559 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.559 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:04.559 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401505+0000", 2024-09-12T22:32:04.559 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:04.560 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.560 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.560 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:04.560 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401505+0000", 2024-09-12T22:32:04.560 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:04.560 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.560 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.560 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:04.560 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401506+0000", 2024-09-12T22:32:04.560 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4700000000000001e-07 2024-09-12T22:32:04.560 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.560 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.560 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:04.561 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401510+0000", 2024-09-12T22:32:04.561 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6609999999999999e-06 2024-09-12T22:32:04.561 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.561 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.561 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:04.561 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401771+0000", 2024-09-12T22:32:04.561 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00026110700000000001 2024-09-12T22:32:04.561 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.561 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.561 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:04.561 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401921+0000", 2024-09-12T22:32:04.561 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014939099999999999 2024-09-12T22:32:04.561 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.562 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.562 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:04.562 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405944+0000", 2024-09-12T22:32:04.562 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0040235449999999999 2024-09-12T22:32:04.562 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.562 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.562 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:04.562 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406018+0000", 2024-09-12T22:32:04.562 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3373000000000004e-05 2024-09-12T22:32:04.563 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.563 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.563 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:04.563 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406172+0000", 2024-09-12T22:32:04.563 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00015435399999999999 2024-09-12T22:32:04.563 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.563 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.563 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:04.563 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410461+0000", 2024-09-12T22:32:04.563 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0042888609999999997 2024-09-12T22:32:04.563 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.563 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.564 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:04.564 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418371+0000", 2024-09-12T22:32:04.564 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0079098380000000006 2024-09-12T22:32:04.564 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.564 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.564 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:04.564 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418443+0000", 2024-09-12T22:32:04.564 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2705000000000003e-05 2024-09-12T22:32:04.564 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.565 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.565 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:04.565 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418493+0000", 2024-09-12T22:32:04.565 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9322e-05 2024-09-12T22:32:04.565 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:04.565 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:04.565 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:04.565 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.565 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.565 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:04.565 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.401939+0000", 2024-09-12T22:32:04.566 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 27.104866521999998, 2024-09-12T22:32:04.566 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016722292999999999, 2024-09-12T22:32:04.566 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:04.566 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:04.566 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:04.566 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:04.566 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.566 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:04.566 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401939+0000", 2024-09-12T22:32:04.566 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:04.566 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.567 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.567 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:04.567 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401939+0000", 2024-09-12T22:32:04.567 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:04.567 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.567 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.567 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:04.567 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401940+0000", 2024-09-12T22:32:04.567 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1990000000000001e-06 2024-09-12T22:32:04.567 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.568 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.568 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:04.568 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401956+0000", 2024-09-12T22:32:04.568 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.6344000000000001e-05 2024-09-12T22:32:04.568 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.568 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.568 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:04.569 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401974+0000", 2024-09-12T22:32:04.569 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7730000000000001e-05 2024-09-12T22:32:04.569 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.569 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.569 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:04.569 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401982+0000", 2024-09-12T22:32:04.569 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.7800000000000001e-06 2024-09-12T22:32:04.569 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.569 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.569 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:04.569 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406557+0000", 2024-09-12T22:32:04.570 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0045758489999999999 2024-09-12T22:32:04.570 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.570 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.570 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:04.570 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406697+0000", 2024-09-12T22:32:04.570 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013925100000000001 2024-09-12T22:32:04.570 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.570 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.570 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:04.570 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406830+0000", 2024-09-12T22:32:04.570 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013293499999999999 2024-09-12T22:32:04.570 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.570 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.571 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:04.571 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410465+0000", 2024-09-12T22:32:04.571 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0036352680000000001 2024-09-12T22:32:04.571 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.571 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.571 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:04.571 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418564+0000", 2024-09-12T22:32:04.571 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0080992140000000004 2024-09-12T22:32:04.571 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.571 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.571 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:04.571 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418621+0000", 2024-09-12T22:32:04.571 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7167999999999999e-05 2024-09-12T22:32:04.571 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.572 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.572 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:04.572 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418661+0000", 2024-09-12T22:32:04.572 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9555000000000003e-05 2024-09-12T22:32:04.572 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:04.572 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:04.572 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:04.572 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.572 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.572 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:04.572 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.401994+0000", 2024-09-12T22:32:04.572 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 27.104810650000001, 2024-09-12T22:32:04.572 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016804109000000001, 2024-09-12T22:32:04.572 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:04.572 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:04.573 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:04.573 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:04.573 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.573 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:04.573 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401994+0000", 2024-09-12T22:32:04.573 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:04.573 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.573 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.573 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:04.573 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401994+0000", 2024-09-12T22:32:04.573 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:04.573 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.573 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.573 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:04.574 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401995+0000", 2024-09-12T22:32:04.574 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.8899999999999998e-07 2024-09-12T22:32:04.574 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.574 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.574 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:04.574 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402000+0000", 2024-09-12T22:32:04.574 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.498e-06 2024-09-12T22:32:04.574 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.574 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.574 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:04.574 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402007+0000", 2024-09-12T22:32:04.574 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.554e-06 2024-09-12T22:32:04.574 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.575 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.575 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:04.575 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402046+0000", 2024-09-12T22:32:04.575 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9156000000000003e-05 2024-09-12T22:32:04.575 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.575 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.575 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:04.575 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407342+0000", 2024-09-12T22:32:04.576 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052957610000000004 2024-09-12T22:32:04.576 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.576 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.576 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:04.576 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407521+0000", 2024-09-12T22:32:04.576 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00017878100000000001 2024-09-12T22:32:04.576 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.576 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.576 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:04.576 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407641+0000", 2024-09-12T22:32:04.577 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012013 2024-09-12T22:32:04.577 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.577 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.577 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:04.577 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410472+0000", 2024-09-12T22:32:04.577 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.002830455 2024-09-12T22:32:04.577 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.577 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.577 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:04.577 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418714+0000", 2024-09-12T22:32:04.578 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0082422789999999999 2024-09-12T22:32:04.578 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.578 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.578 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:04.578 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418761+0000", 2024-09-12T22:32:04.578 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6956999999999998e-05 2024-09-12T22:32:04.578 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.578 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.578 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:04.578 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418799+0000", 2024-09-12T22:32:04.578 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7749000000000001e-05 2024-09-12T22:32:04.578 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:04.579 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:04.579 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:04.579 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.579 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.579 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:04.579 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.402060+0000", 2024-09-12T22:32:04.579 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 27.104745206, 2024-09-12T22:32:04.579 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016885686, 2024-09-12T22:32:04.579 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:04.579 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:04.579 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:04.579 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:04.579 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.580 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:04.580 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402060+0000", 2024-09-12T22:32:04.580 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:04.580 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.580 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.580 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:04.580 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402060+0000", 2024-09-12T22:32:04.580 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:04.580 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.580 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.580 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:04.581 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402061+0000", 2024-09-12T22:32:04.581 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4399999999999999e-07 2024-09-12T22:32:04.581 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.581 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.581 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:04.581 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402066+0000", 2024-09-12T22:32:04.581 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8649999999999998e-06 2024-09-12T22:32:04.581 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.581 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.581 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:04.581 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402146+0000", 2024-09-12T22:32:04.582 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9054000000000006e-05 2024-09-12T22:32:04.582 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.582 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.582 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:04.582 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402287+0000", 2024-09-12T22:32:04.582 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014108600000000001 2024-09-12T22:32:04.582 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.582 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.582 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:04.582 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408185+0000", 2024-09-12T22:32:04.582 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0058983919999999997 2024-09-12T22:32:04.582 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.582 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.582 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:04.582 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408299+0000", 2024-09-12T22:32:04.583 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114102 2024-09-12T22:32:04.583 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.583 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.583 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:04.583 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408420+0000", 2024-09-12T22:32:04.583 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000120492 2024-09-12T22:32:04.583 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.583 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.583 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:04.583 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410867+0000", 2024-09-12T22:32:04.583 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0024476430000000002 2024-09-12T22:32:04.584 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.584 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.584 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:04.584 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418851+0000", 2024-09-12T22:32:04.584 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0079841489999999994 2024-09-12T22:32:04.584 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.584 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.584 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:04.584 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418894+0000", 2024-09-12T22:32:04.584 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3090000000000002e-05 2024-09-12T22:32:04.584 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.584 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.584 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:04.584 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418946+0000", 2024-09-12T22:32:04.585 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1069000000000002e-05 2024-09-12T22:32:04.585 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:04.585 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:04.585 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:04.585 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.585 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.585 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:04.585 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.402375+0000", 2024-09-12T22:32:04.585 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 27.104430141000002, 2024-09-12T22:32:04.585 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016768531999999999, 2024-09-12T22:32:04.585 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:04.585 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:04.585 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:04.586 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:04.586 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.586 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:04.586 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402375+0000", 2024-09-12T22:32:04.586 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:04.586 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.586 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.586 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:04.586 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402375+0000", 2024-09-12T22:32:04.586 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:04.586 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.586 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.586 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:04.586 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402375+0000", 2024-09-12T22:32:04.587 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4099999999999999e-07 2024-09-12T22:32:04.587 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.587 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.587 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:04.587 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402379+0000", 2024-09-12T22:32:04.587 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9870000000000001e-06 2024-09-12T22:32:04.587 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.587 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.587 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:04.587 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402389+0000", 2024-09-12T22:32:04.587 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0000000000000001e-05 2024-09-12T22:32:04.587 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.587 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.587 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:04.587 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402401+0000", 2024-09-12T22:32:04.588 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.148e-05 2024-09-12T22:32:04.588 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.588 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.588 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:04.588 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409108+0000", 2024-09-12T22:32:04.588 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0067068429999999997 2024-09-12T22:32:04.588 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.588 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.588 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:04.588 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409189+0000", 2024-09-12T22:32:04.588 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0815999999999993e-05 2024-09-12T22:32:04.588 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.588 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.589 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:04.589 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409320+0000", 2024-09-12T22:32:04.589 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000131586 2024-09-12T22:32:04.589 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.589 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.589 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:04.589 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410872+0000", 2024-09-12T22:32:04.589 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0015521599999999999 2024-09-12T22:32:04.589 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.589 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.589 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:04.589 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419049+0000", 2024-09-12T22:32:04.589 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0081763719999999995 2024-09-12T22:32:04.590 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.590 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.590 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:04.590 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419107+0000", 2024-09-12T22:32:04.590 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7899000000000002e-05 2024-09-12T22:32:04.590 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.590 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.590 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:04.590 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419143+0000", 2024-09-12T22:32:04.590 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6847999999999997e-05 2024-09-12T22:32:04.590 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:04.590 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:04.590 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:04.590 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.591 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.591 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:04.591 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.402903+0000", 2024-09-12T22:32:04.591 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 27.103901729, 2024-09-12T22:32:04.591 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016378428, 2024-09-12T22:32:04.591 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:04.591 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:04.591 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:04.591 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:04.591 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.591 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:04.591 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402903+0000", 2024-09-12T22:32:04.592 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:04.592 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.592 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.592 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:04.592 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402903+0000", 2024-09-12T22:32:04.592 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:04.592 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.592 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.592 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:04.592 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402904+0000", 2024-09-12T22:32:04.592 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9500000000000001e-07 2024-09-12T22:32:04.592 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.592 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.592 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:04.593 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402944+0000", 2024-09-12T22:32:04.593 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0265000000000002e-05 2024-09-12T22:32:04.593 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.593 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.593 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:04.593 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402979+0000", 2024-09-12T22:32:04.593 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4378000000000002e-05 2024-09-12T22:32:04.593 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.593 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.593 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:04.594 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402987+0000", 2024-09-12T22:32:04.594 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3559999999999993e-06 2024-09-12T22:32:04.594 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.594 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.594 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:04.594 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409577+0000", 2024-09-12T22:32:04.594 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0065901709999999997 2024-09-12T22:32:04.594 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.594 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.594 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:04.594 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409653+0000", 2024-09-12T22:32:04.594 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5819e-05 2024-09-12T22:32:04.595 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.595 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.595 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:04.595 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409725+0000", 2024-09-12T22:32:04.595 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2200000000000007e-05 2024-09-12T22:32:04.595 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.595 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.595 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:04.595 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.411234+0000", 2024-09-12T22:32:04.595 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001508225 2024-09-12T22:32:04.595 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.595 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.596 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:04.596 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419212+0000", 2024-09-12T22:32:04.596 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0079783400000000004 2024-09-12T22:32:04.596 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.596 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.596 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:04.596 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419244+0000", 2024-09-12T22:32:04.596 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2384e-05 2024-09-12T22:32:04.596 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.596 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.597 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:04.597 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419282+0000", 2024-09-12T22:32:04.597 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7394999999999997e-05 2024-09-12T22:32:04.597 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:04.597 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:04.597 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:04.597 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.597 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.597 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:04.597 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.403135+0000", 2024-09-12T22:32:04.597 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 27.103669859, 2024-09-12T22:32:04.598 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016294211999999999, 2024-09-12T22:32:04.598 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:04.598 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:04.598 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:04.598 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:04.598 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.598 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:04.598 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403135+0000", 2024-09-12T22:32:04.598 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:04.599 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.599 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.599 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:04.599 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403135+0000", 2024-09-12T22:32:04.599 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:04.599 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.599 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.599 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:04.599 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403136+0000", 2024-09-12T22:32:04.599 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.4e-07 2024-09-12T22:32:04.599 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.599 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.599 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:04.600 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403149+0000", 2024-09-12T22:32:04.600 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2723e-05 2024-09-12T22:32:04.600 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.600 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.600 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:04.600 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403158+0000", 2024-09-12T22:32:04.600 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3919999999999992e-06 2024-09-12T22:32:04.600 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.600 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.600 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:04.601 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403166+0000", 2024-09-12T22:32:04.601 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.2309999999999996e-06 2024-09-12T22:32:04.601 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.601 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.601 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:04.601 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409944+0000", 2024-09-12T22:32:04.601 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0067775309999999998 2024-09-12T22:32:04.601 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.601 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.601 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:04.601 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410032+0000", 2024-09-12T22:32:04.602 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.7906999999999997e-05 2024-09-12T22:32:04.602 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.602 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.602 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:04.602 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410152+0000", 2024-09-12T22:32:04.602 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012037800000000001 2024-09-12T22:32:04.602 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.602 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.602 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:04.602 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.411945+0000", 2024-09-12T22:32:04.602 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0017931850000000001 2024-09-12T22:32:04.603 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.603 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.603 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:04.603 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419319+0000", 2024-09-12T22:32:04.603 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0073731780000000002 2024-09-12T22:32:04.603 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.603 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.603 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:04.603 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419376+0000", 2024-09-12T22:32:04.603 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7728e-05 2024-09-12T22:32:04.603 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.603 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.603 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:04.603 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419429+0000", 2024-09-12T22:32:04.604 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3019000000000002e-05 2024-09-12T22:32:04.604 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:04.604 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:04.604 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:04.604 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.604 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.604 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:04.604 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.403185+0000", 2024-09-12T22:32:04.604 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 27.103619978000001, 2024-09-12T22:32:04.604 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.014902164000000001, 2024-09-12T22:32:04.604 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:04.604 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:04.605 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:04.605 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:04.605 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.605 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:04.605 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403185+0000", 2024-09-12T22:32:04.605 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:04.605 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.605 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.605 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:04.605 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403185+0000", 2024-09-12T22:32:04.606 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:04.606 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.606 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.606 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:04.606 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403186+0000", 2024-09-12T22:32:04.606 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9400000000000005e-07 2024-09-12T22:32:04.606 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.606 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.606 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:04.607 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403191+0000", 2024-09-12T22:32:04.607 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6980000000000003e-06 2024-09-12T22:32:04.607 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.607 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.607 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:04.607 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403199+0000", 2024-09-12T22:32:04.607 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2520000000000002e-06 2024-09-12T22:32:04.607 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.607 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.608 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:04.608 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403205+0000", 2024-09-12T22:32:04.608 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.908e-06 2024-09-12T22:32:04.608 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.608 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.608 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:04.608 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403359+0000", 2024-09-12T22:32:04.608 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000154544 2024-09-12T22:32:04.608 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.608 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.609 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:04.609 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403528+0000", 2024-09-12T22:32:04.609 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000168455 2024-09-12T22:32:04.609 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.609 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.609 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:04.609 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403763+0000", 2024-09-12T22:32:04.609 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00023539599999999999 2024-09-12T22:32:04.609 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.609 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.609 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:04.609 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409378+0000", 2024-09-12T22:32:04.609 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056150000000000002 2024-09-12T22:32:04.609 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.610 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.610 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:04.610 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418012+0000", 2024-09-12T22:32:04.610 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0086339559999999999 2024-09-12T22:32:04.610 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.610 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.610 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:04.610 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418046+0000", 2024-09-12T22:32:04.610 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4267999999999998e-05 2024-09-12T22:32:04.610 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.610 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.610 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:04.610 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418087+0000", 2024-09-12T22:32:04.610 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0992999999999999e-05 2024-09-12T22:32:04.611 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:04.611 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:04.611 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:04.611 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.611 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.611 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:04.611 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.403273+0000", 2024-09-12T22:32:04.611 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 27.103532027, 2024-09-12T22:32:04.611 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.014934866, 2024-09-12T22:32:04.611 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:04.611 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:04.611 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:04.611 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:04.612 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.612 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:04.612 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403273+0000", 2024-09-12T22:32:04.612 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:04.612 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.612 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.612 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:04.612 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403273+0000", 2024-09-12T22:32:04.612 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:04.612 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.612 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.612 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:04.612 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403274+0000", 2024-09-12T22:32:04.612 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.297e-06 2024-09-12T22:32:04.613 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.613 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.613 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:04.613 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403282+0000", 2024-09-12T22:32:04.613 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6340000000000001e-06 2024-09-12T22:32:04.613 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.613 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.613 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:04.613 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403305+0000", 2024-09-12T22:32:04.613 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3149000000000001e-05 2024-09-12T22:32:04.613 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.613 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.613 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:04.614 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403320+0000", 2024-09-12T22:32:04.614 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4527e-05 2024-09-12T22:32:04.614 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.614 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.614 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:04.614 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.404928+0000", 2024-09-12T22:32:04.614 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001608459 2024-09-12T22:32:04.614 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.614 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.614 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:04.614 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405218+0000", 2024-09-12T22:32:04.614 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00028982900000000002 2024-09-12T22:32:04.615 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.615 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.615 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:04.615 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405829+0000", 2024-09-12T22:32:04.615 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00061127900000000005 2024-09-12T22:32:04.615 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.615 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.615 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:04.615 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409403+0000", 2024-09-12T22:32:04.615 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.003573597 2024-09-12T22:32:04.615 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.615 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.615 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:04.616 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418138+0000", 2024-09-12T22:32:04.616 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0087349969999999996 2024-09-12T22:32:04.616 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.616 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.616 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:04.616 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418178+0000", 2024-09-12T22:32:04.616 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0649999999999999e-05 2024-09-12T22:32:04.616 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.616 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.616 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:04.616 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418208+0000", 2024-09-12T22:32:04.616 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9448e-05 2024-09-12T22:32:04.617 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:04.617 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:04.617 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:04.617 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.617 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.617 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:04.617 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.405456+0000", 2024-09-12T22:32:04.617 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 27.101348882, 2024-09-12T22:32:04.617 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012888389, 2024-09-12T22:32:04.617 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:04.617 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:04.617 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:04.617 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:04.617 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.618 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:04.618 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405456+0000", 2024-09-12T22:32:04.618 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:04.618 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.618 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.618 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:04.618 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405456+0000", 2024-09-12T22:32:04.618 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:04.618 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.618 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.618 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:04.618 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405457+0000", 2024-09-12T22:32:04.618 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.6599999999999994e-07 2024-09-12T22:32:04.618 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.619 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.619 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:04.619 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405463+0000", 2024-09-12T22:32:04.619 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4739999999999996e-06 2024-09-12T22:32:04.619 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.619 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.619 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:04.619 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405474+0000", 2024-09-12T22:32:04.619 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1095e-05 2024-09-12T22:32:04.619 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.619 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.619 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:04.619 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405482+0000", 2024-09-12T22:32:04.620 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3610000000000001e-06 2024-09-12T22:32:04.620 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.620 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.620 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:04.620 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407051+0000", 2024-09-12T22:32:04.620 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0015688970000000001 2024-09-12T22:32:04.620 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.620 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.620 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:04.620 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407259+0000", 2024-09-12T22:32:04.620 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00020778300000000001 2024-09-12T22:32:04.620 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.620 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.620 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:04.621 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407622+0000", 2024-09-12T22:32:04.621 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000363066 2024-09-12T22:32:04.621 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.621 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.621 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:04.621 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409438+0000", 2024-09-12T22:32:04.621 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001816319 2024-09-12T22:32:04.621 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.621 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.621 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:04.621 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418257+0000", 2024-09-12T22:32:04.621 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0088187720000000008 2024-09-12T22:32:04.622 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.622 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.622 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:04.622 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418308+0000", 2024-09-12T22:32:04.622 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1180000000000001e-05 2024-09-12T22:32:04.622 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.622 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.622 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:04.622 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418345+0000", 2024-09-12T22:32:04.622 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6476000000000001e-05 2024-09-12T22:32:04.622 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:04.622 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:04.622 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:04.623 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.623 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.623 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:04.623 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.405496+0000", 2024-09-12T22:32:04.623 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 27.101309525000001, 2024-09-12T22:32:04.623 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013016012, 2024-09-12T22:32:04.623 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:04.623 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:04.623 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:04.623 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:04.623 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.623 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:04.624 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405496+0000", 2024-09-12T22:32:04.624 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:04.624 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.624 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.624 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:04.624 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405496+0000", 2024-09-12T22:32:04.624 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:04.624 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.624 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.624 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:04.624 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405496+0000", 2024-09-12T22:32:04.624 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7999999999999995e-07 2024-09-12T22:32:04.624 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.624 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.625 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:04.625 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405501+0000", 2024-09-12T22:32:04.625 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8359999999999999e-06 2024-09-12T22:32:04.625 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.625 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.625 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:04.625 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405514+0000", 2024-09-12T22:32:04.625 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2522e-05 2024-09-12T22:32:04.625 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.625 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.625 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:04.625 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405521+0000", 2024-09-12T22:32:04.625 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5020000000000003e-06 2024-09-12T22:32:04.625 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.626 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.626 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:04.626 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405575+0000", 2024-09-12T22:32:04.626 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4169999999999998e-05 2024-09-12T22:32:04.626 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.626 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.626 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:04.626 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405697+0000", 2024-09-12T22:32:04.626 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000121301 2024-09-12T22:32:04.626 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.626 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.626 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:04.627 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405829+0000", 2024-09-12T22:32:04.627 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000132662 2024-09-12T22:32:04.627 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.627 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.627 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:04.627 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409155+0000", 2024-09-12T22:32:04.627 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0033259050000000001 2024-09-12T22:32:04.627 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.627 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.627 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:04.627 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418425+0000", 2024-09-12T22:32:04.628 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0092696319999999999 2024-09-12T22:32:04.628 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.628 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.628 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:04.628 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418471+0000", 2024-09-12T22:32:04.628 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6213e-05 2024-09-12T22:32:04.628 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.628 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.628 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:04.628 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418512+0000", 2024-09-12T22:32:04.628 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0589000000000001e-05 2024-09-12T22:32:04.628 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:04.628 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:04.629 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:04.629 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.629 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.629 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:04.629 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.406108+0000", 2024-09-12T22:32:04.629 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 27.100697128, 2024-09-12T22:32:04.629 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012458175, 2024-09-12T22:32:04.629 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:04.629 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:04.629 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:04.630 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:04.630 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.630 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:04.630 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406108+0000", 2024-09-12T22:32:04.630 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:04.630 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.630 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.630 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:04.630 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406108+0000", 2024-09-12T22:32:04.630 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:04.630 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.630 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.630 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:04.631 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406109+0000", 2024-09-12T22:32:04.631 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9899999999999999e-07 2024-09-12T22:32:04.631 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.631 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.631 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:04.631 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406115+0000", 2024-09-12T22:32:04.631 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9030000000000001e-06 2024-09-12T22:32:04.631 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.631 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.631 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:04.631 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406141+0000", 2024-09-12T22:32:04.631 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5999e-05 2024-09-12T22:32:04.631 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.631 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.632 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:04.632 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406150+0000", 2024-09-12T22:32:04.632 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.6050000000000004e-06 2024-09-12T22:32:04.632 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.632 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.632 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:04.632 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408163+0000", 2024-09-12T22:32:04.632 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0020122769999999998 2024-09-12T22:32:04.632 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.632 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.632 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:04.632 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408309+0000", 2024-09-12T22:32:04.632 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014606999999999999 2024-09-12T22:32:04.633 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.633 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.633 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:04.633 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408433+0000", 2024-09-12T22:32:04.633 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012460300000000001 2024-09-12T22:32:04.633 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.633 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.633 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:04.633 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409903+0000", 2024-09-12T22:32:04.633 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001469499 2024-09-12T22:32:04.633 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.633 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.633 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:04.634 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418427+0000", 2024-09-12T22:32:04.634 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0085241139999999993 2024-09-12T22:32:04.634 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.634 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.634 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:04.634 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418471+0000", 2024-09-12T22:32:04.634 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4474000000000001e-05 2024-09-12T22:32:04.634 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.634 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.634 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:04.634 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418566+0000", 2024-09-12T22:32:04.634 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.4732e-05 2024-09-12T22:32:04.635 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:04.635 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:04.635 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:04.635 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.635 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.635 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:04.635 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.407266+0000", 2024-09-12T22:32:04.635 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 27.099539272000001, 2024-09-12T22:32:04.635 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011442905, 2024-09-12T22:32:04.635 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:04.635 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:04.636 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2024-09-12T22:32:04.636 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:04.636 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.636 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:04.636 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407266+0000", 2024-09-12T22:32:04.636 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:04.636 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.636 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.636 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:04.636 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407266+0000", 2024-09-12T22:32:04.636 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:04.636 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.636 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.637 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:04.637 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407266+0000", 2024-09-12T22:32:04.637 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7899999999999998e-07 2024-09-12T22:32:04.637 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.637 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.637 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:04.637 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407269+0000", 2024-09-12T22:32:04.637 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9210000000000001e-06 2024-09-12T22:32:04.637 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.637 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.637 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:04.637 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407331+0000", 2024-09-12T22:32:04.637 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1376000000000003e-05 2024-09-12T22:32:04.638 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.638 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.638 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:04.638 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407337+0000", 2024-09-12T22:32:04.638 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1929999999999998e-06 2024-09-12T22:32:04.638 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.638 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.638 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:04.638 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408974+0000", 2024-09-12T22:32:04.638 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0016367109999999999 2024-09-12T22:32:04.638 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.639 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.639 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:04.639 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409112+0000", 2024-09-12T22:32:04.639 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000137952 2024-09-12T22:32:04.639 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:04.639 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:04.639 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:04.639 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418709+0000", 2024-09-12T22:32:04.639 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0095971730000000005 2024-09-12T22:32:04.639 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:04.639 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:04.639 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:04.639 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:04.639 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:04.640 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-09-12T22:32:04.641 INFO:teuthology.orchestra.run.smithi019.stdout:osd.2: {} 2024-09-12T22:32:04.642 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:04.640+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:04.643 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:32:04.643 INFO:teuthology.orchestra.run.smithi019.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T22:32:04.647 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:32:04.649 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-12T22:32:04.650 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":45,"stamp":"2024-09-12T22:32:04.193360+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596071,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":255,"num_write_kb":3482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":203,"ondisk_log_size":203,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":91248,"kb_used_data":1840,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283024272,"statfs":{"total":289910292480,"available":289816854528,"internally_reserved":0,"allocated":1884160,"data_stored":1427084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":91483471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3274,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.098707"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.097049+0000","last_change":"2024-09-12T22:31:37.416383+0000","last_active":"2024-09-12T22:31:59.097049+0000","last_peered":"2024-09-12T22:31:59.097049+0000","last_clean":"2024-09-12T22:31:59.097049+0000","last_became_active":"2024-09-12T22:31:37.415457+0000","last_became_peered":"2024-09-12T22:31:37.415457+0000","last_unstale":"2024-09-12T22:31:59.097049+0000","last_undegraded":"2024-09-12T22:31:59.097049+0000","last_fullsized":"2024-09-12T22:31:59.097049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:08:29.199832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096704+0000","last_change":"2024-09-12T22:31:57.100705+0000","last_active":"2024-09-12T22:31:59.096704+0000","last_peered":"2024-09-12T22:31:59.096704+0000","last_clean":"2024-09-12T22:31:59.096704+0000","last_became_active":"2024-09-12T22:31:57.100396+0000","last_became_peered":"2024-09-12T22:31:57.100396+0000","last_unstale":"2024-09-12T22:31:59.096704+0000","last_undegraded":"2024-09-12T22:31:59.096704+0000","last_fullsized":"2024-09-12T22:31:59.096704+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:47:33.283161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.161445+0000","last_change":"2024-09-12T22:31:37.419916+0000","last_active":"2024-09-12T22:31:59.161445+0000","last_peered":"2024-09-12T22:31:59.161445+0000","last_clean":"2024-09-12T22:31:59.161445+0000","last_became_active":"2024-09-12T22:31:37.418790+0000","last_became_peered":"2024-09-12T22:31:37.418790+0000","last_unstale":"2024-09-12T22:31:59.161445+0000","last_undegraded":"2024-09-12T22:31:59.161445+0000","last_fullsized":"2024-09-12T22:31:59.161445+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:05:00.440878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.161123+0000","last_change":"2024-09-12T22:31:37.413094+0000","last_active":"2024-09-12T22:31:59.161123+0000","last_peered":"2024-09-12T22:31:59.161123+0000","last_clean":"2024-09-12T22:31:59.161123+0000","last_became_active":"2024-09-12T22:31:37.412746+0000","last_became_peered":"2024-09-12T22:31:37.412746+0000","last_unstale":"2024-09-12T22:31:59.161123+0000","last_undegraded":"2024-09-12T22:31:59.161123+0000","last_fullsized":"2024-09-12T22:31:59.161123+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:32:14.415120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096642+0000","last_change":"2024-09-12T22:31:37.411276+0000","last_active":"2024-09-12T22:31:59.096642+0000","last_peered":"2024-09-12T22:31:59.096642+0000","last_clean":"2024-09-12T22:31:59.096642+0000","last_became_active":"2024-09-12T22:31:37.410380+0000","last_became_peered":"2024-09-12T22:31:37.410380+0000","last_unstale":"2024-09-12T22:31:59.096642+0000","last_undegraded":"2024-09-12T22:31:59.096642+0000","last_fullsized":"2024-09-12T22:31:59.096642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:12:50.090880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.160788+0000","last_change":"2024-09-12T22:31:37.409177+0000","last_active":"2024-09-12T22:31:59.160788+0000","last_peered":"2024-09-12T22:31:59.160788+0000","last_clean":"2024-09-12T22:31:59.160788+0000","last_became_active":"2024-09-12T22:31:37.408811+0000","last_became_peered":"2024-09-12T22:31:37.408811+0000","last_unstale":"2024-09-12T22:31:59.160788+0000","last_undegraded":"2024-09-12T22:31:59.160788+0000","last_fullsized":"2024-09-12T22:31:59.160788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:17:21.695079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.160866+0000","last_change":"2024-09-12T22:31:37.413023+0000","last_active":"2024-09-12T22:31:59.160866+0000","last_peered":"2024-09-12T22:31:59.160866+0000","last_clean":"2024-09-12T22:31:59.160866+0000","last_became_active":"2024-09-12T22:31:37.412691+0000","last_became_peered":"2024-09-12T22:31:37.412691+0000","last_unstale":"2024-09-12T22:31:59.160866+0000","last_undegraded":"2024-09-12T22:31:59.160866+0000","last_fullsized":"2024-09-12T22:31:59.160866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:02:36.454134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.160571+0000","last_change":"2024-09-12T22:31:37.411074+0000","last_active":"2024-09-12T22:31:59.160571+0000","last_peered":"2024-09-12T22:31:59.160571+0000","last_clean":"2024-09-12T22:31:59.160571+0000","last_became_active":"2024-09-12T22:31:37.410633+0000","last_became_peered":"2024-09-12T22:31:37.410633+0000","last_unstale":"2024-09-12T22:31:59.160571+0000","last_undegraded":"2024-09-12T22:31:59.160571+0000","last_fullsized":"2024-09-12T22:31:59.160571+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:39:20.383152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096571+0000","last_change":"2024-09-12T22:31:37.417800+0000","last_active":"2024-09-12T22:31:59.096571+0000","last_peered":"2024-09-12T22:31:59.096571+0000","last_clean":"2024-09-12T22:31:59.096571+0000","last_became_active":"2024-09-12T22:31:37.417355+0000","last_became_peered":"2024-09-12T22:31:37.417355+0000","last_unstale":"2024-09-12T22:31:59.096571+0000","last_undegraded":"2024-09-12T22:31:59.096571+0000","last_fullsized":"2024-09-12T22:31:59.096571+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:10:17.326263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096926+0000","last_change":"2024-09-12T22:31:37.415967+0000","last_active":"2024-09-12T22:31:59.096926+0000","last_peered":"2024-09-12T22:31:59.096926+0000","last_clean":"2024-09-12T22:31:59.096926+0000","last_became_active":"2024-09-12T22:31:37.415003+0000","last_became_peered":"2024-09-12T22:31:37.415003+0000","last_unstale":"2024-09-12T22:31:59.096926+0000","last_undegraded":"2024-09-12T22:31:59.096926+0000","last_fullsized":"2024-09-12T22:31:59.096926+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:42:32.307876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.161538+0000","last_change":"2024-09-12T22:31:37.414469+0000","last_active":"2024-09-12T22:31:59.161538+0000","last_peered":"2024-09-12T22:31:59.161538+0000","last_clean":"2024-09-12T22:31:59.161538+0000","last_became_active":"2024-09-12T22:31:37.414165+0000","last_became_peered":"2024-09-12T22:31:37.414165+0000","last_unstale":"2024-09-12T22:31:59.161538+0000","last_undegraded":"2024-09-12T22:31:59.161538+0000","last_fullsized":"2024-09-12T22:31:59.161538+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:25:38.148636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.160907+0000","last_change":"2024-09-12T22:31:57.100971+0000","last_active":"2024-09-12T22:31:59.160907+0000","last_peered":"2024-09-12T22:31:59.160907+0000","last_clean":"2024-09-12T22:31:59.160907+0000","last_became_active":"2024-09-12T22:31:57.100610+0000","last_became_peered":"2024-09-12T22:31:57.100610+0000","last_unstale":"2024-09-12T22:31:59.160907+0000","last_undegraded":"2024-09-12T22:31:59.160907+0000","last_fullsized":"2024-09-12T22:31:59.160907+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:07:30.449320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096340+0000","last_change":"2024-09-12T22:31:57.092903+0000","last_active":"2024-09-12T22:31:59.096340+0000","last_peered":"2024-09-12T22:31:59.096340+0000","last_clean":"2024-09-12T22:31:59.096340+0000","last_became_active":"2024-09-12T22:31:57.092579+0000","last_became_peered":"2024-09-12T22:31:57.092579+0000","last_unstale":"2024-09-12T22:31:59.096340+0000","last_undegraded":"2024-09-12T22:31:59.096340+0000","last_fullsized":"2024-09-12T22:31:59.096340+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:54:35.308603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.160899+0000","last_change":"2024-09-12T22:31:37.414084+0000","last_active":"2024-09-12T22:31:59.160899+0000","last_peered":"2024-09-12T22:31:59.160899+0000","last_clean":"2024-09-12T22:31:59.160899+0000","last_became_active":"2024-09-12T22:31:37.413671+0000","last_became_peered":"2024-09-12T22:31:37.413671+0000","last_unstale":"2024-09-12T22:31:59.160899+0000","last_undegraded":"2024-09-12T22:31:59.160899+0000","last_fullsized":"2024-09-12T22:31:59.160899+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:08:29.199832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.160875+0000","last_change":"2024-09-12T22:31:37.413482+0000","last_active":"2024-09-12T22:31:59.160875+0000","last_peered":"2024-09-12T22:31:59.160875+0000","last_clean":"2024-09-12T22:31:59.160875+0000","last_became_active":"2024-09-12T22:31:37.413195+0000","last_became_peered":"2024-09-12T22:31:37.413195+0000","last_unstale":"2024-09-12T22:31:59.160875+0000","last_undegraded":"2024-09-12T22:31:59.160875+0000","last_fullsized":"2024-09-12T22:31:59.160875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:22:40.226076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.160644+0000","last_change":"2024-09-12T22:31:37.411006+0000","last_active":"2024-09-12T22:31:59.160644+0000","last_peered":"2024-09-12T22:31:59.160644+0000","last_clean":"2024-09-12T22:31:59.160644+0000","last_became_active":"2024-09-12T22:31:37.410557+0000","last_became_peered":"2024-09-12T22:31:37.410557+0000","last_unstale":"2024-09-12T22:31:59.160644+0000","last_undegraded":"2024-09-12T22:31:59.160644+0000","last_fullsized":"2024-09-12T22:31:59.160644+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:08:21.709770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096887+0000","last_change":"2024-09-12T22:31:37.412450+0000","last_active":"2024-09-12T22:31:59.096887+0000","last_peered":"2024-09-12T22:31:59.096887+0000","last_clean":"2024-09-12T22:31:59.096887+0000","last_became_active":"2024-09-12T22:31:37.412234+0000","last_became_peered":"2024-09-12T22:31:37.412234+0000","last_unstale":"2024-09-12T22:31:59.096887+0000","last_undegraded":"2024-09-12T22:31:59.096887+0000","last_fullsized":"2024-09-12T22:31:59.096887+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:15:59.559809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096982+0000","last_change":"2024-09-12T22:31:57.100568+0000","last_active":"2024-09-12T22:31:59.096982+0000","last_peered":"2024-09-12T22:31:59.096982+0000","last_clean":"2024-09-12T22:31:59.096982+0000","last_became_active":"2024-09-12T22:31:57.100330+0000","last_became_peered":"2024-09-12T22:31:57.100330+0000","last_unstale":"2024-09-12T22:31:59.096982+0000","last_undegraded":"2024-09-12T22:31:59.096982+0000","last_fullsized":"2024-09-12T22:31:59.096982+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:57:20.571864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096625+0000","last_change":"2024-09-12T22:31:37.417442+0000","last_active":"2024-09-12T22:31:59.096625+0000","last_peered":"2024-09-12T22:31:59.096625+0000","last_clean":"2024-09-12T22:31:59.096625+0000","last_became_active":"2024-09-12T22:31:37.417133+0000","last_became_peered":"2024-09-12T22:31:37.417133+0000","last_unstale":"2024-09-12T22:31:59.096625+0000","last_undegraded":"2024-09-12T22:31:59.096625+0000","last_fullsized":"2024-09-12T22:31:59.096625+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:36.458145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.161235+0000","last_change":"2024-09-12T22:31:37.414235+0000","last_active":"2024-09-12T22:31:59.161235+0000","last_peered":"2024-09-12T22:31:59.161235+0000","last_clean":"2024-09-12T22:31:59.161235+0000","last_became_active":"2024-09-12T22:31:37.413786+0000","last_became_peered":"2024-09-12T22:31:37.413786+0000","last_unstale":"2024-09-12T22:31:59.161235+0000","last_undegraded":"2024-09-12T22:31:59.161235+0000","last_fullsized":"2024-09-12T22:31:59.161235+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:21:11.866973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.161553+0000","last_change":"2024-09-12T22:31:37.415382+0000","last_active":"2024-09-12T22:31:59.161553+0000","last_peered":"2024-09-12T22:31:59.161553+0000","last_clean":"2024-09-12T22:31:59.161553+0000","last_became_active":"2024-09-12T22:31:37.414319+0000","last_became_peered":"2024-09-12T22:31:37.414319+0000","last_unstale":"2024-09-12T22:31:59.161553+0000","last_undegraded":"2024-09-12T22:31:59.161553+0000","last_fullsized":"2024-09-12T22:31:59.161553+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:26:25.578693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096442+0000","last_change":"2024-09-12T22:31:37.412046+0000","last_active":"2024-09-12T22:31:59.096442+0000","last_peered":"2024-09-12T22:31:59.096442+0000","last_clean":"2024-09-12T22:31:59.096442+0000","last_became_active":"2024-09-12T22:31:37.411623+0000","last_became_peered":"2024-09-12T22:31:37.411623+0000","last_unstale":"2024-09-12T22:31:59.096442+0000","last_undegraded":"2024-09-12T22:31:59.096442+0000","last_fullsized":"2024-09-12T22:31:59.096442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:24:15.504358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.095992+0000","last_change":"2024-09-12T22:31:37.410364+0000","last_active":"2024-09-12T22:31:59.095992+0000","last_peered":"2024-09-12T22:31:59.095992+0000","last_clean":"2024-09-12T22:31:59.095992+0000","last_became_active":"2024-09-12T22:31:37.409951+0000","last_became_peered":"2024-09-12T22:31:37.409951+0000","last_unstale":"2024-09-12T22:31:59.095992+0000","last_undegraded":"2024-09-12T22:31:59.095992+0000","last_fullsized":"2024-09-12T22:31:59.095992+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:39:17.785755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.095997+0000","last_change":"2024-09-12T22:31:57.092823+0000","last_active":"2024-09-12T22:31:59.095997+0000","last_peered":"2024-09-12T22:31:59.095997+0000","last_clean":"2024-09-12T22:31:59.095997+0000","last_became_active":"2024-09-12T22:31:57.092557+0000","last_became_peered":"2024-09-12T22:31:57.092557+0000","last_unstale":"2024-09-12T22:31:59.095997+0000","last_undegraded":"2024-09-12T22:31:59.095997+0000","last_fullsized":"2024-09-12T22:31:59.095997+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:30:13.033427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.097103+0000","last_change":"2024-09-12T22:31:37.415309+0000","last_active":"2024-09-12T22:31:59.097103+0000","last_peered":"2024-09-12T22:31:59.097103+0000","last_clean":"2024-09-12T22:31:59.097103+0000","last_became_active":"2024-09-12T22:31:37.414792+0000","last_became_peered":"2024-09-12T22:31:37.414792+0000","last_unstale":"2024-09-12T22:31:59.097103+0000","last_undegraded":"2024-09-12T22:31:59.097103+0000","last_fullsized":"2024-09-12T22:31:59.097103+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:08:07.115355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096810+0000","last_change":"2024-09-12T22:31:37.411880+0000","last_active":"2024-09-12T22:31:59.096810+0000","last_peered":"2024-09-12T22:31:59.096810+0000","last_clean":"2024-09-12T22:31:59.096810+0000","last_became_active":"2024-09-12T22:31:37.410563+0000","last_became_peered":"2024-09-12T22:31:37.410563+0000","last_unstale":"2024-09-12T22:31:59.096810+0000","last_undegraded":"2024-09-12T22:31:59.096810+0000","last_fullsized":"2024-09-12T22:31:59.096810+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:47:52.560533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.161624+0000","last_change":"2024-09-12T22:31:37.419603+0000","last_active":"2024-09-12T22:31:59.161624+0000","last_peered":"2024-09-12T22:31:59.161624+0000","last_clean":"2024-09-12T22:31:59.161624+0000","last_became_active":"2024-09-12T22:31:37.418725+0000","last_became_peered":"2024-09-12T22:31:37.418725+0000","last_unstale":"2024-09-12T22:31:59.161624+0000","last_undegraded":"2024-09-12T22:31:59.161624+0000","last_fullsized":"2024-09-12T22:31:59.161624+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:02:44.183545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.161010+0000","last_change":"2024-09-12T22:31:57.100810+0000","last_active":"2024-09-12T22:31:59.161010+0000","last_peered":"2024-09-12T22:31:59.161010+0000","last_clean":"2024-09-12T22:31:59.161010+0000","last_became_active":"2024-09-12T22:31:57.100516+0000","last_became_peered":"2024-09-12T22:31:57.100516+0000","last_unstale":"2024-09-12T22:31:59.161010+0000","last_undegraded":"2024-09-12T22:31:59.161010+0000","last_fullsized":"2024-09-12T22:31:59.161010+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:21:45.140557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096420+0000","last_change":"2024-09-12T22:31:37.414918+0000","last_active":"2024-09-12T22:31:59.096420+0000","last_peered":"2024-09-12T22:31:59.096420+0000","last_clean":"2024-09-12T22:31:59.096420+0000","last_became_active":"2024-09-12T22:31:37.414225+0000","last_became_peered":"2024-09-12T22:31:37.414225+0000","last_unstale":"2024-09-12T22:31:59.096420+0000","last_undegraded":"2024-09-12T22:31:59.096420+0000","last_fullsized":"2024-09-12T22:31:59.096420+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:56:14.649228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096588+0000","last_change":"2024-09-12T22:31:37.411569+0000","last_active":"2024-09-12T22:31:59.096588+0000","last_peered":"2024-09-12T22:31:59.096588+0000","last_clean":"2024-09-12T22:31:59.096588+0000","last_became_active":"2024-09-12T22:31:37.410619+0000","last_became_peered":"2024-09-12T22:31:37.410619+0000","last_unstale":"2024-09-12T22:31:59.096588+0000","last_undegraded":"2024-09-12T22:31:59.096588+0000","last_fullsized":"2024-09-12T22:31:59.096588+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:30:01.012271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096050+0000","last_change":"2024-09-12T22:31:37.415589+0000","last_active":"2024-09-12T22:31:59.096050+0000","last_peered":"2024-09-12T22:31:59.096050+0000","last_clean":"2024-09-12T22:31:59.096050+0000","last_became_active":"2024-09-12T22:31:37.415285+0000","last_became_peered":"2024-09-12T22:31:37.415285+0000","last_unstale":"2024-09-12T22:31:59.096050+0000","last_undegraded":"2024-09-12T22:31:59.096050+0000","last_fullsized":"2024-09-12T22:31:59.096050+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:06:25.913810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.160650+0000","last_change":"2024-09-12T22:31:37.415190+0000","last_active":"2024-09-12T22:31:59.160650+0000","last_peered":"2024-09-12T22:31:59.160650+0000","last_clean":"2024-09-12T22:31:59.160650+0000","last_became_active":"2024-09-12T22:31:37.414265+0000","last_became_peered":"2024-09-12T22:31:37.414265+0000","last_unstale":"2024-09-12T22:31:59.160650+0000","last_undegraded":"2024-09-12T22:31:59.160650+0000","last_fullsized":"2024-09-12T22:31:59.160650+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:07:02.173590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096563+0000","last_change":"2024-09-12T22:31:57.100582+0000","last_active":"2024-09-12T22:31:59.096563+0000","last_peered":"2024-09-12T22:31:59.096563+0000","last_clean":"2024-09-12T22:31:59.096563+0000","last_became_active":"2024-09-12T22:31:57.100321+0000","last_became_peered":"2024-09-12T22:31:57.100321+0000","last_unstale":"2024-09-12T22:31:59.096563+0000","last_undegraded":"2024-09-12T22:31:59.096563+0000","last_fullsized":"2024-09-12T22:31:59.096563+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:59:36.843984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.161609+0000","last_change":"2024-09-12T22:31:36.412082+0000","last_active":"2024-09-12T22:31:59.161609+0000","last_peered":"2024-09-12T22:31:59.161609+0000","last_clean":"2024-09-12T22:31:59.161609+0000","last_became_active":"2024-09-12T22:31:36.410871+0000","last_became_peered":"2024-09-12T22:31:36.410871+0000","last_unstale":"2024-09-12T22:31:59.161609+0000","last_undegraded":"2024-09-12T22:31:59.161609+0000","last_fullsized":"2024-09-12T22:31:59.161609+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:30:49.127253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096903+0000","last_change":"2024-09-12T22:31:37.411790+0000","last_active":"2024-09-12T22:31:59.096903+0000","last_peered":"2024-09-12T22:31:59.096903+0000","last_clean":"2024-09-12T22:31:59.096903+0000","last_became_active":"2024-09-12T22:31:37.411414+0000","last_became_peered":"2024-09-12T22:31:37.411414+0000","last_unstale":"2024-09-12T22:31:59.096903+0000","last_undegraded":"2024-09-12T22:31:59.096903+0000","last_fullsized":"2024-09-12T22:31:59.096903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:22:40.226076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096358+0000","last_change":"2024-09-12T22:31:36.408563+0000","last_active":"2024-09-12T22:31:59.096358+0000","last_peered":"2024-09-12T22:31:59.096358+0000","last_clean":"2024-09-12T22:31:59.096358+0000","last_became_active":"2024-09-12T22:31:36.407447+0000","last_became_peered":"2024-09-12T22:31:36.407447+0000","last_unstale":"2024-09-12T22:31:59.096358+0000","last_undegraded":"2024-09-12T22:31:59.096358+0000","last_fullsized":"2024-09-12T22:31:59.096358+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:29:37.933109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.097034+0000","last_change":"2024-09-12T22:31:37.411680+0000","last_active":"2024-09-12T22:31:59.097034+0000","last_peered":"2024-09-12T22:31:59.097034+0000","last_clean":"2024-09-12T22:31:59.097034+0000","last_became_active":"2024-09-12T22:31:37.411168+0000","last_became_peered":"2024-09-12T22:31:37.411168+0000","last_unstale":"2024-09-12T22:31:59.097034+0000","last_undegraded":"2024-09-12T22:31:59.097034+0000","last_fullsized":"2024-09-12T22:31:59.097034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:27.706282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096377+0000","last_change":"2024-09-12T22:31:36.411271+0000","last_active":"2024-09-12T22:31:59.096377+0000","last_peered":"2024-09-12T22:31:59.096377+0000","last_clean":"2024-09-12T22:31:59.096377+0000","last_became_active":"2024-09-12T22:31:36.410706+0000","last_became_peered":"2024-09-12T22:31:36.410706+0000","last_unstale":"2024-09-12T22:31:59.096377+0000","last_undegraded":"2024-09-12T22:31:59.096377+0000","last_fullsized":"2024-09-12T22:31:59.096377+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:43:22.805855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096623+0000","last_change":"2024-09-12T22:31:37.411218+0000","last_active":"2024-09-12T22:31:59.096623+0000","last_peered":"2024-09-12T22:31:59.096623+0000","last_clean":"2024-09-12T22:31:59.096623+0000","last_became_active":"2024-09-12T22:31:37.409666+0000","last_became_peered":"2024-09-12T22:31:37.409666+0000","last_unstale":"2024-09-12T22:31:59.096623+0000","last_undegraded":"2024-09-12T22:31:59.096623+0000","last_fullsized":"2024-09-12T22:31:59.096623+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:45:34.230090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"19'8","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.160739+0000","last_change":"2024-09-12T22:31:36.411811+0000","last_active":"2024-09-12T22:31:59.160739+0000","last_peered":"2024-09-12T22:31:59.160739+0000","last_clean":"2024-09-12T22:31:59.160739+0000","last_became_active":"2024-09-12T22:31:36.410101+0000","last_became_peered":"2024-09-12T22:31:36.410101+0000","last_unstale":"2024-09-12T22:31:59.160739+0000","last_undegraded":"2024-09-12T22:31:59.160739+0000","last_fullsized":"2024-09-12T22:31:59.160739+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:33:02.410148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.161418+0000","last_change":"2024-09-12T22:31:36.410970+0000","last_active":"2024-09-12T22:31:59.161418+0000","last_peered":"2024-09-12T22:31:59.161418+0000","last_clean":"2024-09-12T22:31:59.161418+0000","last_became_active":"2024-09-12T22:31:36.409754+0000","last_became_peered":"2024-09-12T22:31:36.409754+0000","last_unstale":"2024-09-12T22:31:59.161418+0000","last_undegraded":"2024-09-12T22:31:59.161418+0000","last_fullsized":"2024-09-12T22:31:59.161418+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:30:07.724418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096288+0000","last_change":"2024-09-12T22:31:37.415050+0000","last_active":"2024-09-12T22:31:59.096288+0000","last_peered":"2024-09-12T22:31:59.096288+0000","last_clean":"2024-09-12T22:31:59.096288+0000","last_became_active":"2024-09-12T22:31:37.414290+0000","last_became_peered":"2024-09-12T22:31:37.414290+0000","last_unstale":"2024-09-12T22:31:59.096288+0000","last_undegraded":"2024-09-12T22:31:59.096288+0000","last_fullsized":"2024-09-12T22:31:59.096288+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:47:15.502575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.097101+0000","last_change":"2024-09-12T22:31:36.411725+0000","last_active":"2024-09-12T22:31:59.097101+0000","last_peered":"2024-09-12T22:31:59.097101+0000","last_clean":"2024-09-12T22:31:59.097101+0000","last_became_active":"2024-09-12T22:31:36.411407+0000","last_became_peered":"2024-09-12T22:31:36.411407+0000","last_unstale":"2024-09-12T22:31:59.097101+0000","last_undegraded":"2024-09-12T22:31:59.097101+0000","last_fullsized":"2024-09-12T22:31:59.097101+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:30:07.724418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096179+0000","last_change":"2024-09-12T22:31:57.092727+0000","last_active":"2024-09-12T22:31:59.096179+0000","last_peered":"2024-09-12T22:31:59.096179+0000","last_clean":"2024-09-12T22:31:59.096179+0000","last_became_active":"2024-09-12T22:31:57.092446+0000","last_became_peered":"2024-09-12T22:31:57.092446+0000","last_unstale":"2024-09-12T22:31:59.096179+0000","last_undegraded":"2024-09-12T22:31:59.096179+0000","last_fullsized":"2024-09-12T22:31:59.096179+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:09:14.524447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.161803+0000","last_change":"2024-09-12T22:31:36.411320+0000","last_active":"2024-09-12T22:31:59.161803+0000","last_peered":"2024-09-12T22:31:59.161803+0000","last_clean":"2024-09-12T22:31:59.161803+0000","last_became_active":"2024-09-12T22:31:36.409837+0000","last_became_peered":"2024-09-12T22:31:36.409837+0000","last_unstale":"2024-09-12T22:31:59.161803+0000","last_undegraded":"2024-09-12T22:31:59.161803+0000","last_fullsized":"2024-09-12T22:31:59.161803+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:36:53.914922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.160903+0000","last_change":"2024-09-12T22:31:37.414809+0000","last_active":"2024-09-12T22:31:59.160903+0000","last_peered":"2024-09-12T22:31:59.160903+0000","last_clean":"2024-09-12T22:31:59.160903+0000","last_became_active":"2024-09-12T22:31:37.414492+0000","last_became_peered":"2024-09-12T22:31:37.414492+0000","last_unstale":"2024-09-12T22:31:59.160903+0000","last_undegraded":"2024-09-12T22:31:59.160903+0000","last_fullsized":"2024-09-12T22:31:59.160903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:50:48.426898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.161505+0000","last_change":"2024-09-12T22:31:36.412068+0000","last_active":"2024-09-12T22:31:59.161505+0000","last_peered":"2024-09-12T22:31:59.161505+0000","last_clean":"2024-09-12T22:31:59.161505+0000","last_became_active":"2024-09-12T22:31:36.411366+0000","last_became_peered":"2024-09-12T22:31:36.411366+0000","last_unstale":"2024-09-12T22:31:59.161505+0000","last_undegraded":"2024-09-12T22:31:59.161505+0000","last_fullsized":"2024-09-12T22:31:59.161505+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:35:51.647051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096537+0000","last_change":"2024-09-12T22:31:37.410303+0000","last_active":"2024-09-12T22:31:59.096537+0000","last_peered":"2024-09-12T22:31:59.096537+0000","last_clean":"2024-09-12T22:31:59.096537+0000","last_became_active":"2024-09-12T22:31:37.409607+0000","last_became_peered":"2024-09-12T22:31:37.409607+0000","last_unstale":"2024-09-12T22:31:59.096537+0000","last_undegraded":"2024-09-12T22:31:59.096537+0000","last_fullsized":"2024-09-12T22:31:59.096537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:53:42.732654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096646+0000","last_change":"2024-09-12T22:31:36.407974+0000","last_active":"2024-09-12T22:31:59.096646+0000","last_peered":"2024-09-12T22:31:59.096646+0000","last_clean":"2024-09-12T22:31:59.096646+0000","last_became_active":"2024-09-12T22:31:36.406955+0000","last_became_peered":"2024-09-12T22:31:36.406955+0000","last_unstale":"2024-09-12T22:31:59.096646+0000","last_undegraded":"2024-09-12T22:31:59.096646+0000","last_fullsized":"2024-09-12T22:31:59.096646+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:07:34.831264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.161238+0000","last_change":"2024-09-12T22:31:37.415285+0000","last_active":"2024-09-12T22:31:59.161238+0000","last_peered":"2024-09-12T22:31:59.161238+0000","last_clean":"2024-09-12T22:31:59.161238+0000","last_became_active":"2024-09-12T22:31:37.414890+0000","last_became_peered":"2024-09-12T22:31:37.414890+0000","last_unstale":"2024-09-12T22:31:59.161238+0000","last_undegraded":"2024-09-12T22:31:59.161238+0000","last_fullsized":"2024-09-12T22:31:59.161238+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:38:16.956786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.161083+0000","last_change":"2024-09-12T22:31:36.412147+0000","last_active":"2024-09-12T22:31:59.161083+0000","last_peered":"2024-09-12T22:31:59.161083+0000","last_clean":"2024-09-12T22:31:59.161083+0000","last_became_active":"2024-09-12T22:31:36.411382+0000","last_became_peered":"2024-09-12T22:31:36.411382+0000","last_unstale":"2024-09-12T22:31:59.161083+0000","last_undegraded":"2024-09-12T22:31:59.161083+0000","last_fullsized":"2024-09-12T22:31:59.161083+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:54:51.454867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.161714+0000","last_change":"2024-09-12T22:31:37.420209+0000","last_active":"2024-09-12T22:31:59.161714+0000","last_peered":"2024-09-12T22:31:59.161714+0000","last_clean":"2024-09-12T22:31:59.161714+0000","last_became_active":"2024-09-12T22:31:37.419267+0000","last_became_peered":"2024-09-12T22:31:37.419267+0000","last_unstale":"2024-09-12T22:31:59.161714+0000","last_undegraded":"2024-09-12T22:31:59.161714+0000","last_fullsized":"2024-09-12T22:31:59.161714+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:36.790111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096451+0000","last_change":"2024-09-12T22:31:36.411190+0000","last_active":"2024-09-12T22:31:59.096451+0000","last_peered":"2024-09-12T22:31:59.096451+0000","last_clean":"2024-09-12T22:31:59.096451+0000","last_became_active":"2024-09-12T22:31:36.410548+0000","last_became_peered":"2024-09-12T22:31:36.410548+0000","last_unstale":"2024-09-12T22:31:59.096451+0000","last_undegraded":"2024-09-12T22:31:59.096451+0000","last_fullsized":"2024-09-12T22:31:59.096451+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:10:20.300894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.161297+0000","last_change":"2024-09-12T22:31:37.418749+0000","last_active":"2024-09-12T22:31:59.161297+0000","last_peered":"2024-09-12T22:31:59.161297+0000","last_clean":"2024-09-12T22:31:59.161297+0000","last_became_active":"2024-09-12T22:31:37.418360+0000","last_became_peered":"2024-09-12T22:31:37.418360+0000","last_unstale":"2024-09-12T22:31:59.161297+0000","last_undegraded":"2024-09-12T22:31:59.161297+0000","last_fullsized":"2024-09-12T22:31:59.161297+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:50:08.152699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096343+0000","last_change":"2024-09-12T22:31:36.412187+0000","last_active":"2024-09-12T22:31:59.096343+0000","last_peered":"2024-09-12T22:31:59.096343+0000","last_clean":"2024-09-12T22:31:59.096343+0000","last_became_active":"2024-09-12T22:31:36.411935+0000","last_became_peered":"2024-09-12T22:31:36.411935+0000","last_unstale":"2024-09-12T22:31:59.096343+0000","last_undegraded":"2024-09-12T22:31:59.096343+0000","last_fullsized":"2024-09-12T22:31:59.096343+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:41:04.029445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096677+0000","last_change":"2024-09-12T22:31:37.417881+0000","last_active":"2024-09-12T22:31:59.096677+0000","last_peered":"2024-09-12T22:31:59.096677+0000","last_clean":"2024-09-12T22:31:59.096677+0000","last_became_active":"2024-09-12T22:31:37.417572+0000","last_became_peered":"2024-09-12T22:31:37.417572+0000","last_unstale":"2024-09-12T22:31:59.096677+0000","last_undegraded":"2024-09-12T22:31:59.096677+0000","last_fullsized":"2024-09-12T22:31:59.096677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:19:16.367589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":232,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.161233+0000","last_change":"2024-09-12T22:31:27.631847+0000","last_active":"2024-09-12T22:31:59.161233+0000","last_peered":"2024-09-12T22:31:59.161233+0000","last_clean":"2024-09-12T22:31:59.161233+0000","last_became_active":"2024-09-12T22:31:27.631027+0000","last_became_peered":"2024-09-12T22:31:27.631027+0000","last_unstale":"2024-09-12T22:31:59.161233+0000","last_undegraded":"2024-09-12T22:31:59.161233+0000","last_fullsized":"2024-09-12T22:31:59.161233+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:26.229539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:26.229539+0000","last_clean_scrub_stamp":"2024-09-12T22:31:26.229539+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:59:24.181319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":36,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.161664+0000","last_change":"2024-09-12T22:31:34.286952+0000","last_active":"2024-09-12T22:31:59.161664+0000","last_peered":"2024-09-12T22:31:59.161664+0000","last_clean":"2024-09-12T22:31:59.161664+0000","last_became_active":"2024-09-12T22:31:32.283661+0000","last_became_peered":"2024-09-12T22:31:32.283661+0000","last_unstale":"2024-09-12T22:31:59.161664+0000","last_undegraded":"2024-09-12T22:31:59.161664+0000","last_fullsized":"2024-09-12T22:31:59.161664+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:21.681390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000621274,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096463+0000","last_change":"2024-09-12T22:31:36.411275+0000","last_active":"2024-09-12T22:31:59.096463+0000","last_peered":"2024-09-12T22:31:59.096463+0000","last_clean":"2024-09-12T22:31:59.096463+0000","last_became_active":"2024-09-12T22:31:36.410595+0000","last_became_peered":"2024-09-12T22:31:36.410595+0000","last_unstale":"2024-09-12T22:31:59.096463+0000","last_undegraded":"2024-09-12T22:31:59.096463+0000","last_fullsized":"2024-09-12T22:31:59.096463+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:38:14.895625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.161803+0000","last_change":"2024-09-12T22:31:37.419976+0000","last_active":"2024-09-12T22:31:59.161803+0000","last_peered":"2024-09-12T22:31:59.161803+0000","last_clean":"2024-09-12T22:31:59.161803+0000","last_became_active":"2024-09-12T22:31:37.419161+0000","last_became_peered":"2024-09-12T22:31:37.419161+0000","last_unstale":"2024-09-12T22:31:59.161803+0000","last_undegraded":"2024-09-12T22:31:59.161803+0000","last_fullsized":"2024-09-12T22:31:59.161803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:07:26.070097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":35,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.161322+0000","last_change":"2024-09-12T22:31:34.286642+0000","last_active":"2024-09-12T22:31:59.161322+0000","last_peered":"2024-09-12T22:31:59.161322+0000","last_clean":"2024-09-12T22:31:59.161322+0000","last_became_active":"2024-09-12T22:31:32.283601+0000","last_became_peered":"2024-09-12T22:31:32.283601+0000","last_unstale":"2024-09-12T22:31:59.161322+0000","last_undegraded":"2024-09-12T22:31:59.161322+0000","last_fullsized":"2024-09-12T22:31:59.161322+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:40:06.769540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037858999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096228+0000","last_change":"2024-09-12T22:31:36.407395+0000","last_active":"2024-09-12T22:31:59.096228+0000","last_peered":"2024-09-12T22:31:59.096228+0000","last_clean":"2024-09-12T22:31:59.096228+0000","last_became_active":"2024-09-12T22:31:36.406770+0000","last_became_peered":"2024-09-12T22:31:36.406770+0000","last_unstale":"2024-09-12T22:31:59.096228+0000","last_undegraded":"2024-09-12T22:31:59.096228+0000","last_fullsized":"2024-09-12T22:31:59.096228+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:49:26.547848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096930+0000","last_change":"2024-09-12T22:31:37.414075+0000","last_active":"2024-09-12T22:31:59.096930+0000","last_peered":"2024-09-12T22:31:59.096930+0000","last_clean":"2024-09-12T22:31:59.096930+0000","last_became_active":"2024-09-12T22:31:37.413491+0000","last_became_peered":"2024-09-12T22:31:37.413491+0000","last_unstale":"2024-09-12T22:31:59.096930+0000","last_undegraded":"2024-09-12T22:31:59.096930+0000","last_fullsized":"2024-09-12T22:31:59.096930+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:26:25.578693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":35,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096337+0000","last_change":"2024-09-12T22:31:34.286394+0000","last_active":"2024-09-12T22:31:59.096337+0000","last_peered":"2024-09-12T22:31:59.096337+0000","last_clean":"2024-09-12T22:31:59.096337+0000","last_became_active":"2024-09-12T22:31:32.280062+0000","last_became_peered":"2024-09-12T22:31:32.280062+0000","last_unstale":"2024-09-12T22:31:59.096337+0000","last_undegraded":"2024-09-12T22:31:59.096337+0000","last_fullsized":"2024-09-12T22:31:59.096337+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:20:23.663838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039540700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.160527+0000","last_change":"2024-09-12T22:31:57.100816+0000","last_active":"2024-09-12T22:31:59.160527+0000","last_peered":"2024-09-12T22:31:59.160527+0000","last_clean":"2024-09-12T22:31:59.160527+0000","last_became_active":"2024-09-12T22:31:57.100392+0000","last_became_peered":"2024-09-12T22:31:57.100392+0000","last_unstale":"2024-09-12T22:31:59.160527+0000","last_undegraded":"2024-09-12T22:31:59.160527+0000","last_fullsized":"2024-09-12T22:31:59.160527+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:06:12.881182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096778+0000","last_change":"2024-09-12T22:31:37.417636+0000","last_active":"2024-09-12T22:31:59.096778+0000","last_peered":"2024-09-12T22:31:59.096778+0000","last_clean":"2024-09-12T22:31:59.096778+0000","last_became_active":"2024-09-12T22:31:37.417230+0000","last_became_peered":"2024-09-12T22:31:37.417230+0000","last_unstale":"2024-09-12T22:31:59.096778+0000","last_undegraded":"2024-09-12T22:31:59.096778+0000","last_fullsized":"2024-09-12T22:31:59.096778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:44:29.729122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":37,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.161131+0000","last_change":"2024-09-12T22:31:34.286938+0000","last_active":"2024-09-12T22:31:59.161131+0000","last_peered":"2024-09-12T22:31:59.161131+0000","last_clean":"2024-09-12T22:31:59.161131+0000","last_became_active":"2024-09-12T22:31:32.282230+0000","last_became_peered":"2024-09-12T22:31:32.282230+0000","last_unstale":"2024-09-12T22:31:59.161131+0000","last_undegraded":"2024-09-12T22:31:59.161131+0000","last_fullsized":"2024-09-12T22:31:59.161131+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:11:05.988384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000615758,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.161627+0000","last_change":"2024-09-12T22:31:36.410694+0000","last_active":"2024-09-12T22:31:59.161627+0000","last_peered":"2024-09-12T22:31:59.161627+0000","last_clean":"2024-09-12T22:31:59.161627+0000","last_became_active":"2024-09-12T22:31:36.409816+0000","last_became_peered":"2024-09-12T22:31:36.409816+0000","last_unstale":"2024-09-12T22:31:59.161627+0000","last_undegraded":"2024-09-12T22:31:59.161627+0000","last_fullsized":"2024-09-12T22:31:59.161627+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:40:35.369213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096688+0000","last_change":"2024-09-12T22:31:37.414608+0000","last_active":"2024-09-12T22:31:59.096688+0000","last_peered":"2024-09-12T22:31:59.096688+0000","last_clean":"2024-09-12T22:31:59.096688+0000","last_became_active":"2024-09-12T22:31:37.414307+0000","last_became_peered":"2024-09-12T22:31:37.414307+0000","last_unstale":"2024-09-12T22:31:59.096688+0000","last_undegraded":"2024-09-12T22:31:59.096688+0000","last_fullsized":"2024-09-12T22:31:59.096688+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:41:21.231511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.161886+0000","last_change":"2024-09-12T22:31:36.411355+0000","last_active":"2024-09-12T22:31:59.161886+0000","last_peered":"2024-09-12T22:31:59.161886+0000","last_clean":"2024-09-12T22:31:59.161886+0000","last_became_active":"2024-09-12T22:31:36.410529+0000","last_became_peered":"2024-09-12T22:31:36.410529+0000","last_unstale":"2024-09-12T22:31:59.161886+0000","last_undegraded":"2024-09-12T22:31:59.161886+0000","last_fullsized":"2024-09-12T22:31:59.161886+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:19:47.356688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":35,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096788+0000","last_change":"2024-09-12T22:31:34.286457+0000","last_active":"2024-09-12T22:31:59.096788+0000","last_peered":"2024-09-12T22:31:59.096788+0000","last_clean":"2024-09-12T22:31:59.096788+0000","last_became_active":"2024-09-12T22:31:32.280007+0000","last_became_peered":"2024-09-12T22:31:32.280007+0000","last_unstale":"2024-09-12T22:31:59.096788+0000","last_undegraded":"2024-09-12T22:31:59.096788+0000","last_fullsized":"2024-09-12T22:31:59.096788+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:09.068038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041972500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096464+0000","last_change":"2024-09-12T22:31:37.410386+0000","last_active":"2024-09-12T22:31:59.096464+0000","last_peered":"2024-09-12T22:31:59.096464+0000","last_clean":"2024-09-12T22:31:59.096464+0000","last_became_active":"2024-09-12T22:31:37.409928+0000","last_became_peered":"2024-09-12T22:31:37.409928+0000","last_unstale":"2024-09-12T22:31:59.096464+0000","last_undegraded":"2024-09-12T22:31:59.096464+0000","last_fullsized":"2024-09-12T22:31:59.096464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:02:36.454134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096725+0000","last_change":"2024-09-12T22:31:36.410324+0000","last_active":"2024-09-12T22:31:59.096725+0000","last_peered":"2024-09-12T22:31:59.096725+0000","last_clean":"2024-09-12T22:31:59.096725+0000","last_became_active":"2024-09-12T22:31:36.409199+0000","last_became_peered":"2024-09-12T22:31:36.409199+0000","last_unstale":"2024-09-12T22:31:59.096725+0000","last_undegraded":"2024-09-12T22:31:59.096725+0000","last_fullsized":"2024-09-12T22:31:59.096725+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:06:54.608936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":35,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.097114+0000","last_change":"2024-09-12T22:31:34.839044+0000","last_active":"2024-09-12T22:31:59.097114+0000","last_peered":"2024-09-12T22:31:59.097114+0000","last_clean":"2024-09-12T22:31:59.097114+0000","last_became_active":"2024-09-12T22:31:32.279671+0000","last_became_peered":"2024-09-12T22:31:32.279671+0000","last_unstale":"2024-09-12T22:31:59.097114+0000","last_undegraded":"2024-09-12T22:31:59.097114+0000","last_fullsized":"2024-09-12T22:31:59.097114+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:27:49.809935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036776499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.161522+0000","last_change":"2024-09-12T22:31:57.100721+0000","last_active":"2024-09-12T22:31:59.161522+0000","last_peered":"2024-09-12T22:31:59.161522+0000","last_clean":"2024-09-12T22:31:59.161522+0000","last_became_active":"2024-09-12T22:31:57.100426+0000","last_became_peered":"2024-09-12T22:31:57.100426+0000","last_unstale":"2024-09-12T22:31:59.161522+0000","last_undegraded":"2024-09-12T22:31:59.161522+0000","last_fullsized":"2024-09-12T22:31:59.161522+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:14:31.890006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096944+0000","last_change":"2024-09-12T22:31:36.409397+0000","last_active":"2024-09-12T22:31:59.096944+0000","last_peered":"2024-09-12T22:31:59.096944+0000","last_clean":"2024-09-12T22:31:59.096944+0000","last_became_active":"2024-09-12T22:31:36.408787+0000","last_became_peered":"2024-09-12T22:31:36.408787+0000","last_unstale":"2024-09-12T22:31:59.096944+0000","last_undegraded":"2024-09-12T22:31:59.096944+0000","last_fullsized":"2024-09-12T22:31:59.096944+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:29:03.467352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":35,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.097079+0000","last_change":"2024-09-12T22:31:34.286639+0000","last_active":"2024-09-12T22:31:59.097079+0000","last_peered":"2024-09-12T22:31:59.097079+0000","last_clean":"2024-09-12T22:31:59.097079+0000","last_became_active":"2024-09-12T22:31:32.280092+0000","last_became_peered":"2024-09-12T22:31:32.280092+0000","last_unstale":"2024-09-12T22:31:59.097079+0000","last_undegraded":"2024-09-12T22:31:59.097079+0000","last_fullsized":"2024-09-12T22:31:59.097079+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:02:40.821530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058589999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096105+0000","last_change":"2024-09-12T22:31:37.411152+0000","last_active":"2024-09-12T22:31:59.096105+0000","last_peered":"2024-09-12T22:31:59.096105+0000","last_clean":"2024-09-12T22:31:59.096105+0000","last_became_active":"2024-09-12T22:31:37.410558+0000","last_became_peered":"2024-09-12T22:31:37.410558+0000","last_unstale":"2024-09-12T22:31:59.096105+0000","last_undegraded":"2024-09-12T22:31:59.096105+0000","last_fullsized":"2024-09-12T22:31:59.096105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:14:29.892478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.097031+0000","last_change":"2024-09-12T22:31:36.407460+0000","last_active":"2024-09-12T22:31:59.097031+0000","last_peered":"2024-09-12T22:31:59.097031+0000","last_clean":"2024-09-12T22:31:59.097031+0000","last_became_active":"2024-09-12T22:31:36.406729+0000","last_became_peered":"2024-09-12T22:31:36.406729+0000","last_unstale":"2024-09-12T22:31:59.097031+0000","last_undegraded":"2024-09-12T22:31:59.097031+0000","last_fullsized":"2024-09-12T22:31:59.097031+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:27:58.012573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":35,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.161521+0000","last_change":"2024-09-12T22:31:34.286699+0000","last_active":"2024-09-12T22:31:59.161521+0000","last_peered":"2024-09-12T22:31:59.161521+0000","last_clean":"2024-09-12T22:31:59.161521+0000","last_became_active":"2024-09-12T22:31:32.283606+0000","last_became_peered":"2024-09-12T22:31:32.283606+0000","last_unstale":"2024-09-12T22:31:59.161521+0000","last_undegraded":"2024-09-12T22:31:59.161521+0000","last_fullsized":"2024-09-12T22:31:59.161521+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:09:32.050798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000382109,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096345+0000","last_change":"2024-09-12T22:31:37.410011+0000","last_active":"2024-09-12T22:31:59.096345+0000","last_peered":"2024-09-12T22:31:59.096345+0000","last_clean":"2024-09-12T22:31:59.096345+0000","last_became_active":"2024-09-12T22:31:37.409320+0000","last_became_peered":"2024-09-12T22:31:37.409320+0000","last_unstale":"2024-09-12T22:31:59.096345+0000","last_undegraded":"2024-09-12T22:31:59.096345+0000","last_fullsized":"2024-09-12T22:31:59.096345+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:27:23.661444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.161245+0000","last_change":"2024-09-12T22:31:37.415670+0000","last_active":"2024-09-12T22:31:59.161245+0000","last_peered":"2024-09-12T22:31:59.161245+0000","last_clean":"2024-09-12T22:31:59.161245+0000","last_became_active":"2024-09-12T22:31:37.415007+0000","last_became_peered":"2024-09-12T22:31:37.415007+0000","last_unstale":"2024-09-12T22:31:59.161245+0000","last_undegraded":"2024-09-12T22:31:59.161245+0000","last_fullsized":"2024-09-12T22:31:59.161245+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:42:51.694128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"23'9","reported_seq":31,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.161390+0000","last_change":"2024-09-12T22:31:36.409878+0000","last_active":"2024-09-12T22:31:59.161390+0000","last_peered":"2024-09-12T22:31:59.161390+0000","last_clean":"2024-09-12T22:31:59.161390+0000","last_became_active":"2024-09-12T22:31:36.409132+0000","last_became_peered":"2024-09-12T22:31:36.409132+0000","last_unstale":"2024-09-12T22:31:59.161390+0000","last_undegraded":"2024-09-12T22:31:59.161390+0000","last_fullsized":"2024-09-12T22:31:59.161390+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:09:56.081385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4886,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096169+0000","last_change":"2024-09-12T22:31:37.414914+0000","last_active":"2024-09-12T22:31:59.096169+0000","last_peered":"2024-09-12T22:31:59.096169+0000","last_clean":"2024-09-12T22:31:59.096169+0000","last_became_active":"2024-09-12T22:31:37.414535+0000","last_became_peered":"2024-09-12T22:31:37.414535+0000","last_unstale":"2024-09-12T22:31:59.096169+0000","last_undegraded":"2024-09-12T22:31:59.096169+0000","last_fullsized":"2024-09-12T22:31:59.096169+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:14:37.010786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"19'3","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.161712+0000","last_change":"2024-09-12T22:31:57.101007+0000","last_active":"2024-09-12T22:31:59.161712+0000","last_peered":"2024-09-12T22:31:59.161712+0000","last_clean":"2024-09-12T22:31:59.161712+0000","last_became_active":"2024-09-12T22:31:57.100640+0000","last_became_peered":"2024-09-12T22:31:57.100640+0000","last_unstale":"2024-09-12T22:31:59.161712+0000","last_undegraded":"2024-09-12T22:31:59.161712+0000","last_fullsized":"2024-09-12T22:31:59.161712+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:37:12.949001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.161477+0000","last_change":"2024-09-12T22:31:36.411549+0000","last_active":"2024-09-12T22:31:59.161477+0000","last_peered":"2024-09-12T22:31:59.161477+0000","last_clean":"2024-09-12T22:31:59.161477+0000","last_became_active":"2024-09-12T22:31:36.410674+0000","last_became_peered":"2024-09-12T22:31:36.410674+0000","last_unstale":"2024-09-12T22:31:59.161477+0000","last_undegraded":"2024-09-12T22:31:59.161477+0000","last_fullsized":"2024-09-12T22:31:59.161477+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:58:05.676197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096094+0000","last_change":"2024-09-12T22:31:37.411254+0000","last_active":"2024-09-12T22:31:59.096094+0000","last_peered":"2024-09-12T22:31:59.096094+0000","last_clean":"2024-09-12T22:31:59.096094+0000","last_became_active":"2024-09-12T22:31:37.410404+0000","last_became_peered":"2024-09-12T22:31:37.410404+0000","last_unstale":"2024-09-12T22:31:59.096094+0000","last_undegraded":"2024-09-12T22:31:59.096094+0000","last_fullsized":"2024-09-12T22:31:59.096094+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:42:00.856616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096887+0000","last_change":"2024-09-12T22:31:36.408390+0000","last_active":"2024-09-12T22:31:59.096887+0000","last_peered":"2024-09-12T22:31:59.096887+0000","last_clean":"2024-09-12T22:31:59.096887+0000","last_became_active":"2024-09-12T22:31:36.407062+0000","last_became_peered":"2024-09-12T22:31:36.407062+0000","last_unstale":"2024-09-12T22:31:59.096887+0000","last_undegraded":"2024-09-12T22:31:59.096887+0000","last_fullsized":"2024-09-12T22:31:59.096887+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:09:10.618195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096087+0000","last_change":"2024-09-12T22:31:37.416629+0000","last_active":"2024-09-12T22:31:59.096087+0000","last_peered":"2024-09-12T22:31:59.096087+0000","last_clean":"2024-09-12T22:31:59.096087+0000","last_became_active":"2024-09-12T22:31:37.416387+0000","last_became_peered":"2024-09-12T22:31:37.416387+0000","last_unstale":"2024-09-12T22:31:59.096087+0000","last_undegraded":"2024-09-12T22:31:59.096087+0000","last_fullsized":"2024-09-12T22:31:59.096087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:59:52.020560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.097123+0000","last_change":"2024-09-12T22:31:37.413777+0000","last_active":"2024-09-12T22:31:59.097123+0000","last_peered":"2024-09-12T22:31:59.097123+0000","last_clean":"2024-09-12T22:31:59.097123+0000","last_became_active":"2024-09-12T22:31:37.412669+0000","last_became_peered":"2024-09-12T22:31:37.412669+0000","last_unstale":"2024-09-12T22:31:59.097123+0000","last_undegraded":"2024-09-12T22:31:59.097123+0000","last_fullsized":"2024-09-12T22:31:59.097123+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:42:17.728844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096197+0000","last_change":"2024-09-12T22:31:36.409466+0000","last_active":"2024-09-12T22:31:59.096197+0000","last_peered":"2024-09-12T22:31:59.096197+0000","last_clean":"2024-09-12T22:31:59.096197+0000","last_became_active":"2024-09-12T22:31:36.408796+0000","last_became_peered":"2024-09-12T22:31:36.408796+0000","last_unstale":"2024-09-12T22:31:59.096197+0000","last_undegraded":"2024-09-12T22:31:59.096197+0000","last_fullsized":"2024-09-12T22:31:59.096197+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:03:39.648159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096898+0000","last_change":"2024-09-12T22:31:37.411183+0000","last_active":"2024-09-12T22:31:59.096898+0000","last_peered":"2024-09-12T22:31:59.096898+0000","last_clean":"2024-09-12T22:31:59.096898+0000","last_became_active":"2024-09-12T22:31:37.409796+0000","last_became_peered":"2024-09-12T22:31:37.409796+0000","last_unstale":"2024-09-12T22:31:59.096898+0000","last_undegraded":"2024-09-12T22:31:59.096898+0000","last_fullsized":"2024-09-12T22:31:59.096898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:20:35.779810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096227+0000","last_change":"2024-09-12T22:31:36.407402+0000","last_active":"2024-09-12T22:31:59.096227+0000","last_peered":"2024-09-12T22:31:59.096227+0000","last_clean":"2024-09-12T22:31:59.096227+0000","last_became_active":"2024-09-12T22:31:36.406681+0000","last_became_peered":"2024-09-12T22:31:36.406681+0000","last_unstale":"2024-09-12T22:31:59.096227+0000","last_undegraded":"2024-09-12T22:31:59.096227+0000","last_fullsized":"2024-09-12T22:31:59.096227+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:39:39.362573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096788+0000","last_change":"2024-09-12T22:31:37.412817+0000","last_active":"2024-09-12T22:31:59.096788+0000","last_peered":"2024-09-12T22:31:59.096788+0000","last_clean":"2024-09-12T22:31:59.096788+0000","last_became_active":"2024-09-12T22:31:37.411999+0000","last_became_peered":"2024-09-12T22:31:37.411999+0000","last_unstale":"2024-09-12T22:31:59.096788+0000","last_undegraded":"2024-09-12T22:31:59.096788+0000","last_fullsized":"2024-09-12T22:31:59.096788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:07:02.173590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096309+0000","last_change":"2024-09-12T22:31:57.095289+0000","last_active":"2024-09-12T22:31:59.096309+0000","last_peered":"2024-09-12T22:31:59.096309+0000","last_clean":"2024-09-12T22:31:59.096309+0000","last_became_active":"2024-09-12T22:31:57.095039+0000","last_became_peered":"2024-09-12T22:31:57.095039+0000","last_unstale":"2024-09-12T22:31:59.096309+0000","last_undegraded":"2024-09-12T22:31:59.096309+0000","last_fullsized":"2024-09-12T22:31:59.096309+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:39:50.881312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096461+0000","last_change":"2024-09-12T22:31:57.095260+0000","last_active":"2024-09-12T22:31:59.096461+0000","last_peered":"2024-09-12T22:31:59.096461+0000","last_clean":"2024-09-12T22:31:59.096461+0000","last_became_active":"2024-09-12T22:31:57.095035+0000","last_became_peered":"2024-09-12T22:31:57.095035+0000","last_unstale":"2024-09-12T22:31:59.096461+0000","last_undegraded":"2024-09-12T22:31:59.096461+0000","last_fullsized":"2024-09-12T22:31:59.096461+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:55:51.885364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096658+0000","last_change":"2024-09-12T22:31:36.412289+0000","last_active":"2024-09-12T22:31:59.096658+0000","last_peered":"2024-09-12T22:31:59.096658+0000","last_clean":"2024-09-12T22:31:59.096658+0000","last_became_active":"2024-09-12T22:31:36.411985+0000","last_became_peered":"2024-09-12T22:31:36.411985+0000","last_unstale":"2024-09-12T22:31:59.096658+0000","last_undegraded":"2024-09-12T22:31:59.096658+0000","last_fullsized":"2024-09-12T22:31:59.096658+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:30:09.410370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.161119+0000","last_change":"2024-09-12T22:31:37.415365+0000","last_active":"2024-09-12T22:31:59.161119+0000","last_peered":"2024-09-12T22:31:59.161119+0000","last_clean":"2024-09-12T22:31:59.161119+0000","last_became_active":"2024-09-12T22:31:37.413933+0000","last_became_peered":"2024-09-12T22:31:37.413933+0000","last_unstale":"2024-09-12T22:31:59.161119+0000","last_undegraded":"2024-09-12T22:31:59.161119+0000","last_fullsized":"2024-09-12T22:31:59.161119+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:08:07.115355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.161409+0000","last_change":"2024-09-12T22:31:36.411665+0000","last_active":"2024-09-12T22:31:59.161409+0000","last_peered":"2024-09-12T22:31:59.161409+0000","last_clean":"2024-09-12T22:31:59.161409+0000","last_became_active":"2024-09-12T22:31:36.410182+0000","last_became_peered":"2024-09-12T22:31:36.410182+0000","last_unstale":"2024-09-12T22:31:59.161409+0000","last_undegraded":"2024-09-12T22:31:59.161409+0000","last_fullsized":"2024-09-12T22:31:59.161409+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:37:20.891838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.161032+0000","last_change":"2024-09-12T22:31:37.415172+0000","last_active":"2024-09-12T22:31:59.161032+0000","last_peered":"2024-09-12T22:31:59.161032+0000","last_clean":"2024-09-12T22:31:59.161032+0000","last_became_active":"2024-09-12T22:31:37.414776+0000","last_became_peered":"2024-09-12T22:31:37.414776+0000","last_unstale":"2024-09-12T22:31:59.161032+0000","last_undegraded":"2024-09-12T22:31:59.161032+0000","last_fullsized":"2024-09-12T22:31:59.161032+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:42:32.307876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.161425+0000","last_change":"2024-09-12T22:31:57.100908+0000","last_active":"2024-09-12T22:31:59.161425+0000","last_peered":"2024-09-12T22:31:59.161425+0000","last_clean":"2024-09-12T22:31:59.161425+0000","last_became_active":"2024-09-12T22:31:57.100579+0000","last_became_peered":"2024-09-12T22:31:57.100579+0000","last_unstale":"2024-09-12T22:31:59.161425+0000","last_undegraded":"2024-09-12T22:31:59.161425+0000","last_fullsized":"2024-09-12T22:31:59.161425+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:49:56.674930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096497+0000","last_change":"2024-09-12T22:31:37.409214+0000","last_active":"2024-09-12T22:31:59.096497+0000","last_peered":"2024-09-12T22:31:59.096497+0000","last_clean":"2024-09-12T22:31:59.096497+0000","last_became_active":"2024-09-12T22:31:37.408849+0000","last_became_peered":"2024-09-12T22:31:37.408849+0000","last_unstale":"2024-09-12T22:31:59.096497+0000","last_undegraded":"2024-09-12T22:31:59.096497+0000","last_fullsized":"2024-09-12T22:31:59.096497+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:39:20.383152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096977+0000","last_change":"2024-09-12T22:31:36.410371+0000","last_active":"2024-09-12T22:31:59.096977+0000","last_peered":"2024-09-12T22:31:59.096977+0000","last_clean":"2024-09-12T22:31:59.096977+0000","last_became_active":"2024-09-12T22:31:36.409428+0000","last_became_peered":"2024-09-12T22:31:36.409428+0000","last_unstale":"2024-09-12T22:31:59.096977+0000","last_undegraded":"2024-09-12T22:31:59.096977+0000","last_fullsized":"2024-09-12T22:31:59.096977+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:27:22.817690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.160747+0000","last_change":"2024-09-12T22:31:37.415390+0000","last_active":"2024-09-12T22:31:59.160747+0000","last_peered":"2024-09-12T22:31:59.160747+0000","last_clean":"2024-09-12T22:31:59.160747+0000","last_became_active":"2024-09-12T22:31:37.414781+0000","last_became_peered":"2024-09-12T22:31:37.414781+0000","last_unstale":"2024-09-12T22:31:59.160747+0000","last_undegraded":"2024-09-12T22:31:59.160747+0000","last_fullsized":"2024-09-12T22:31:59.160747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:42:17.728844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"19'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096779+0000","last_change":"2024-09-12T22:31:36.407945+0000","last_active":"2024-09-12T22:31:59.096779+0000","last_peered":"2024-09-12T22:31:59.096779+0000","last_clean":"2024-09-12T22:31:59.096779+0000","last_became_active":"2024-09-12T22:31:36.406959+0000","last_became_peered":"2024-09-12T22:31:36.406959+0000","last_unstale":"2024-09-12T22:31:59.096779+0000","last_undegraded":"2024-09-12T22:31:59.096779+0000","last_fullsized":"2024-09-12T22:31:59.096779+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:26:33.155850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":5684,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":11368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705675,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32008,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339832,"statfs":{"total":96636764160,"available":96603987968,"internally_reserved":0,"allocated":839680,"data_stored":674385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705675,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31996,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339844,"statfs":{"total":96636764160,"available":96604000256,"internally_reserved":0,"allocated":827392,"data_stored":673750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738379,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":217088,"data_stored":78949,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":5068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":5684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T22:32:04.655 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T22:32:04.742 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:04.741+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:04.759 INFO:teuthology.orchestra.run.smithi076.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:04.760 INFO:teuthology.orchestra.run.smithi076.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:04.769 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:32:04.843 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:04.842+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:04.873 INFO:teuthology.orchestra.run.smithi076.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:04.873 INFO:teuthology.orchestra.run.smithi076.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:04.881 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:32:04.944 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:32:04.943+0000 7fddec6a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30331) UID: 0 2024-09-12T22:32:04.950 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:32:04.951 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-12T22:32:04.961 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":45,"stamp":"2024-09-12T22:32:04.193360+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596071,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":255,"num_write_kb":3482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":203,"ondisk_log_size":203,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":91248,"kb_used_data":1840,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283024272,"statfs":{"total":289910292480,"available":289816854528,"internally_reserved":0,"allocated":1884160,"data_stored":1427084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":91483471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3274,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.098707"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.097049+0000","last_change":"2024-09-12T22:31:37.416383+0000","last_active":"2024-09-12T22:31:59.097049+0000","last_peered":"2024-09-12T22:31:59.097049+0000","last_clean":"2024-09-12T22:31:59.097049+0000","last_became_active":"2024-09-12T22:31:37.415457+0000","last_became_peered":"2024-09-12T22:31:37.415457+0000","last_unstale":"2024-09-12T22:31:59.097049+0000","last_undegraded":"2024-09-12T22:31:59.097049+0000","last_fullsized":"2024-09-12T22:31:59.097049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:08:29.199832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096704+0000","last_change":"2024-09-12T22:31:57.100705+0000","last_active":"2024-09-12T22:31:59.096704+0000","last_peered":"2024-09-12T22:31:59.096704+0000","last_clean":"2024-09-12T22:31:59.096704+0000","last_became_active":"2024-09-12T22:31:57.100396+0000","last_became_peered":"2024-09-12T22:31:57.100396+0000","last_unstale":"2024-09-12T22:31:59.096704+0000","last_undegraded":"2024-09-12T22:31:59.096704+0000","last_fullsized":"2024-09-12T22:31:59.096704+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:47:33.283161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.161445+0000","last_change":"2024-09-12T22:31:37.419916+0000","last_active":"2024-09-12T22:31:59.161445+0000","last_peered":"2024-09-12T22:31:59.161445+0000","last_clean":"2024-09-12T22:31:59.161445+0000","last_became_active":"2024-09-12T22:31:37.418790+0000","last_became_peered":"2024-09-12T22:31:37.418790+0000","last_unstale":"2024-09-12T22:31:59.161445+0000","last_undegraded":"2024-09-12T22:31:59.161445+0000","last_fullsized":"2024-09-12T22:31:59.161445+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:05:00.440878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.161123+0000","last_change":"2024-09-12T22:31:37.413094+0000","last_active":"2024-09-12T22:31:59.161123+0000","last_peered":"2024-09-12T22:31:59.161123+0000","last_clean":"2024-09-12T22:31:59.161123+0000","last_became_active":"2024-09-12T22:31:37.412746+0000","last_became_peered":"2024-09-12T22:31:37.412746+0000","last_unstale":"2024-09-12T22:31:59.161123+0000","last_undegraded":"2024-09-12T22:31:59.161123+0000","last_fullsized":"2024-09-12T22:31:59.161123+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:32:14.415120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096642+0000","last_change":"2024-09-12T22:31:37.411276+0000","last_active":"2024-09-12T22:31:59.096642+0000","last_peered":"2024-09-12T22:31:59.096642+0000","last_clean":"2024-09-12T22:31:59.096642+0000","last_became_active":"2024-09-12T22:31:37.410380+0000","last_became_peered":"2024-09-12T22:31:37.410380+0000","last_unstale":"2024-09-12T22:31:59.096642+0000","last_undegraded":"2024-09-12T22:31:59.096642+0000","last_fullsized":"2024-09-12T22:31:59.096642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:12:50.090880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.160788+0000","last_change":"2024-09-12T22:31:37.409177+0000","last_active":"2024-09-12T22:31:59.160788+0000","last_peered":"2024-09-12T22:31:59.160788+0000","last_clean":"2024-09-12T22:31:59.160788+0000","last_became_active":"2024-09-12T22:31:37.408811+0000","last_became_peered":"2024-09-12T22:31:37.408811+0000","last_unstale":"2024-09-12T22:31:59.160788+0000","last_undegraded":"2024-09-12T22:31:59.160788+0000","last_fullsized":"2024-09-12T22:31:59.160788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:17:21.695079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.160866+0000","last_change":"2024-09-12T22:31:37.413023+0000","last_active":"2024-09-12T22:31:59.160866+0000","last_peered":"2024-09-12T22:31:59.160866+0000","last_clean":"2024-09-12T22:31:59.160866+0000","last_became_active":"2024-09-12T22:31:37.412691+0000","last_became_peered":"2024-09-12T22:31:37.412691+0000","last_unstale":"2024-09-12T22:31:59.160866+0000","last_undegraded":"2024-09-12T22:31:59.160866+0000","last_fullsized":"2024-09-12T22:31:59.160866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:02:36.454134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.160571+0000","last_change":"2024-09-12T22:31:37.411074+0000","last_active":"2024-09-12T22:31:59.160571+0000","last_peered":"2024-09-12T22:31:59.160571+0000","last_clean":"2024-09-12T22:31:59.160571+0000","last_became_active":"2024-09-12T22:31:37.410633+0000","last_became_peered":"2024-09-12T22:31:37.410633+0000","last_unstale":"2024-09-12T22:31:59.160571+0000","last_undegraded":"2024-09-12T22:31:59.160571+0000","last_fullsized":"2024-09-12T22:31:59.160571+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:39:20.383152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096571+0000","last_change":"2024-09-12T22:31:37.417800+0000","last_active":"2024-09-12T22:31:59.096571+0000","last_peered":"2024-09-12T22:31:59.096571+0000","last_clean":"2024-09-12T22:31:59.096571+0000","last_became_active":"2024-09-12T22:31:37.417355+0000","last_became_peered":"2024-09-12T22:31:37.417355+0000","last_unstale":"2024-09-12T22:31:59.096571+0000","last_undegraded":"2024-09-12T22:31:59.096571+0000","last_fullsized":"2024-09-12T22:31:59.096571+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:10:17.326263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096926+0000","last_change":"2024-09-12T22:31:37.415967+0000","last_active":"2024-09-12T22:31:59.096926+0000","last_peered":"2024-09-12T22:31:59.096926+0000","last_clean":"2024-09-12T22:31:59.096926+0000","last_became_active":"2024-09-12T22:31:37.415003+0000","last_became_peered":"2024-09-12T22:31:37.415003+0000","last_unstale":"2024-09-12T22:31:59.096926+0000","last_undegraded":"2024-09-12T22:31:59.096926+0000","last_fullsized":"2024-09-12T22:31:59.096926+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:42:32.307876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.161538+0000","last_change":"2024-09-12T22:31:37.414469+0000","last_active":"2024-09-12T22:31:59.161538+0000","last_peered":"2024-09-12T22:31:59.161538+0000","last_clean":"2024-09-12T22:31:59.161538+0000","last_became_active":"2024-09-12T22:31:37.414165+0000","last_became_peered":"2024-09-12T22:31:37.414165+0000","last_unstale":"2024-09-12T22:31:59.161538+0000","last_undegraded":"2024-09-12T22:31:59.161538+0000","last_fullsized":"2024-09-12T22:31:59.161538+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:25:38.148636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.160907+0000","last_change":"2024-09-12T22:31:57.100971+0000","last_active":"2024-09-12T22:31:59.160907+0000","last_peered":"2024-09-12T22:31:59.160907+0000","last_clean":"2024-09-12T22:31:59.160907+0000","last_became_active":"2024-09-12T22:31:57.100610+0000","last_became_peered":"2024-09-12T22:31:57.100610+0000","last_unstale":"2024-09-12T22:31:59.160907+0000","last_undegraded":"2024-09-12T22:31:59.160907+0000","last_fullsized":"2024-09-12T22:31:59.160907+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:07:30.449320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096340+0000","last_change":"2024-09-12T22:31:57.092903+0000","last_active":"2024-09-12T22:31:59.096340+0000","last_peered":"2024-09-12T22:31:59.096340+0000","last_clean":"2024-09-12T22:31:59.096340+0000","last_became_active":"2024-09-12T22:31:57.092579+0000","last_became_peered":"2024-09-12T22:31:57.092579+0000","last_unstale":"2024-09-12T22:31:59.096340+0000","last_undegraded":"2024-09-12T22:31:59.096340+0000","last_fullsized":"2024-09-12T22:31:59.096340+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:54:35.308603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.160899+0000","last_change":"2024-09-12T22:31:37.414084+0000","last_active":"2024-09-12T22:31:59.160899+0000","last_peered":"2024-09-12T22:31:59.160899+0000","last_clean":"2024-09-12T22:31:59.160899+0000","last_became_active":"2024-09-12T22:31:37.413671+0000","last_became_peered":"2024-09-12T22:31:37.413671+0000","last_unstale":"2024-09-12T22:31:59.160899+0000","last_undegraded":"2024-09-12T22:31:59.160899+0000","last_fullsized":"2024-09-12T22:31:59.160899+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:08:29.199832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.160875+0000","last_change":"2024-09-12T22:31:37.413482+0000","last_active":"2024-09-12T22:31:59.160875+0000","last_peered":"2024-09-12T22:31:59.160875+0000","last_clean":"2024-09-12T22:31:59.160875+0000","last_became_active":"2024-09-12T22:31:37.413195+0000","last_became_peered":"2024-09-12T22:31:37.413195+0000","last_unstale":"2024-09-12T22:31:59.160875+0000","last_undegraded":"2024-09-12T22:31:59.160875+0000","last_fullsized":"2024-09-12T22:31:59.160875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:22:40.226076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.160644+0000","last_change":"2024-09-12T22:31:37.411006+0000","last_active":"2024-09-12T22:31:59.160644+0000","last_peered":"2024-09-12T22:31:59.160644+0000","last_clean":"2024-09-12T22:31:59.160644+0000","last_became_active":"2024-09-12T22:31:37.410557+0000","last_became_peered":"2024-09-12T22:31:37.410557+0000","last_unstale":"2024-09-12T22:31:59.160644+0000","last_undegraded":"2024-09-12T22:31:59.160644+0000","last_fullsized":"2024-09-12T22:31:59.160644+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:08:21.709770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096887+0000","last_change":"2024-09-12T22:31:37.412450+0000","last_active":"2024-09-12T22:31:59.096887+0000","last_peered":"2024-09-12T22:31:59.096887+0000","last_clean":"2024-09-12T22:31:59.096887+0000","last_became_active":"2024-09-12T22:31:37.412234+0000","last_became_peered":"2024-09-12T22:31:37.412234+0000","last_unstale":"2024-09-12T22:31:59.096887+0000","last_undegraded":"2024-09-12T22:31:59.096887+0000","last_fullsized":"2024-09-12T22:31:59.096887+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:15:59.559809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096982+0000","last_change":"2024-09-12T22:31:57.100568+0000","last_active":"2024-09-12T22:31:59.096982+0000","last_peered":"2024-09-12T22:31:59.096982+0000","last_clean":"2024-09-12T22:31:59.096982+0000","last_became_active":"2024-09-12T22:31:57.100330+0000","last_became_peered":"2024-09-12T22:31:57.100330+0000","last_unstale":"2024-09-12T22:31:59.096982+0000","last_undegraded":"2024-09-12T22:31:59.096982+0000","last_fullsized":"2024-09-12T22:31:59.096982+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:57:20.571864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096625+0000","last_change":"2024-09-12T22:31:37.417442+0000","last_active":"2024-09-12T22:31:59.096625+0000","last_peered":"2024-09-12T22:31:59.096625+0000","last_clean":"2024-09-12T22:31:59.096625+0000","last_became_active":"2024-09-12T22:31:37.417133+0000","last_became_peered":"2024-09-12T22:31:37.417133+0000","last_unstale":"2024-09-12T22:31:59.096625+0000","last_undegraded":"2024-09-12T22:31:59.096625+0000","last_fullsized":"2024-09-12T22:31:59.096625+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:36.458145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.161235+0000","last_change":"2024-09-12T22:31:37.414235+0000","last_active":"2024-09-12T22:31:59.161235+0000","last_peered":"2024-09-12T22:31:59.161235+0000","last_clean":"2024-09-12T22:31:59.161235+0000","last_became_active":"2024-09-12T22:31:37.413786+0000","last_became_peered":"2024-09-12T22:31:37.413786+0000","last_unstale":"2024-09-12T22:31:59.161235+0000","last_undegraded":"2024-09-12T22:31:59.161235+0000","last_fullsized":"2024-09-12T22:31:59.161235+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:21:11.866973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.161553+0000","last_change":"2024-09-12T22:31:37.415382+0000","last_active":"2024-09-12T22:31:59.161553+0000","last_peered":"2024-09-12T22:31:59.161553+0000","last_clean":"2024-09-12T22:31:59.161553+0000","last_became_active":"2024-09-12T22:31:37.414319+0000","last_became_peered":"2024-09-12T22:31:37.414319+0000","last_unstale":"2024-09-12T22:31:59.161553+0000","last_undegraded":"2024-09-12T22:31:59.161553+0000","last_fullsized":"2024-09-12T22:31:59.161553+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:26:25.578693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096442+0000","last_change":"2024-09-12T22:31:37.412046+0000","last_active":"2024-09-12T22:31:59.096442+0000","last_peered":"2024-09-12T22:31:59.096442+0000","last_clean":"2024-09-12T22:31:59.096442+0000","last_became_active":"2024-09-12T22:31:37.411623+0000","last_became_peered":"2024-09-12T22:31:37.411623+0000","last_unstale":"2024-09-12T22:31:59.096442+0000","last_undegraded":"2024-09-12T22:31:59.096442+0000","last_fullsized":"2024-09-12T22:31:59.096442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:24:15.504358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.095992+0000","last_change":"2024-09-12T22:31:37.410364+0000","last_active":"2024-09-12T22:31:59.095992+0000","last_peered":"2024-09-12T22:31:59.095992+0000","last_clean":"2024-09-12T22:31:59.095992+0000","last_became_active":"2024-09-12T22:31:37.409951+0000","last_became_peered":"2024-09-12T22:31:37.409951+0000","last_unstale":"2024-09-12T22:31:59.095992+0000","last_undegraded":"2024-09-12T22:31:59.095992+0000","last_fullsized":"2024-09-12T22:31:59.095992+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:39:17.785755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.095997+0000","last_change":"2024-09-12T22:31:57.092823+0000","last_active":"2024-09-12T22:31:59.095997+0000","last_peered":"2024-09-12T22:31:59.095997+0000","last_clean":"2024-09-12T22:31:59.095997+0000","last_became_active":"2024-09-12T22:31:57.092557+0000","last_became_peered":"2024-09-12T22:31:57.092557+0000","last_unstale":"2024-09-12T22:31:59.095997+0000","last_undegraded":"2024-09-12T22:31:59.095997+0000","last_fullsized":"2024-09-12T22:31:59.095997+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:30:13.033427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.097103+0000","last_change":"2024-09-12T22:31:37.415309+0000","last_active":"2024-09-12T22:31:59.097103+0000","last_peered":"2024-09-12T22:31:59.097103+0000","last_clean":"2024-09-12T22:31:59.097103+0000","last_became_active":"2024-09-12T22:31:37.414792+0000","last_became_peered":"2024-09-12T22:31:37.414792+0000","last_unstale":"2024-09-12T22:31:59.097103+0000","last_undegraded":"2024-09-12T22:31:59.097103+0000","last_fullsized":"2024-09-12T22:31:59.097103+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:08:07.115355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096810+0000","last_change":"2024-09-12T22:31:37.411880+0000","last_active":"2024-09-12T22:31:59.096810+0000","last_peered":"2024-09-12T22:31:59.096810+0000","last_clean":"2024-09-12T22:31:59.096810+0000","last_became_active":"2024-09-12T22:31:37.410563+0000","last_became_peered":"2024-09-12T22:31:37.410563+0000","last_unstale":"2024-09-12T22:31:59.096810+0000","last_undegraded":"2024-09-12T22:31:59.096810+0000","last_fullsized":"2024-09-12T22:31:59.096810+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:47:52.560533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.161624+0000","last_change":"2024-09-12T22:31:37.419603+0000","last_active":"2024-09-12T22:31:59.161624+0000","last_peered":"2024-09-12T22:31:59.161624+0000","last_clean":"2024-09-12T22:31:59.161624+0000","last_became_active":"2024-09-12T22:31:37.418725+0000","last_became_peered":"2024-09-12T22:31:37.418725+0000","last_unstale":"2024-09-12T22:31:59.161624+0000","last_undegraded":"2024-09-12T22:31:59.161624+0000","last_fullsized":"2024-09-12T22:31:59.161624+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:02:44.183545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.161010+0000","last_change":"2024-09-12T22:31:57.100810+0000","last_active":"2024-09-12T22:31:59.161010+0000","last_peered":"2024-09-12T22:31:59.161010+0000","last_clean":"2024-09-12T22:31:59.161010+0000","last_became_active":"2024-09-12T22:31:57.100516+0000","last_became_peered":"2024-09-12T22:31:57.100516+0000","last_unstale":"2024-09-12T22:31:59.161010+0000","last_undegraded":"2024-09-12T22:31:59.161010+0000","last_fullsized":"2024-09-12T22:31:59.161010+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:21:45.140557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096420+0000","last_change":"2024-09-12T22:31:37.414918+0000","last_active":"2024-09-12T22:31:59.096420+0000","last_peered":"2024-09-12T22:31:59.096420+0000","last_clean":"2024-09-12T22:31:59.096420+0000","last_became_active":"2024-09-12T22:31:37.414225+0000","last_became_peered":"2024-09-12T22:31:37.414225+0000","last_unstale":"2024-09-12T22:31:59.096420+0000","last_undegraded":"2024-09-12T22:31:59.096420+0000","last_fullsized":"2024-09-12T22:31:59.096420+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:56:14.649228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096588+0000","last_change":"2024-09-12T22:31:37.411569+0000","last_active":"2024-09-12T22:31:59.096588+0000","last_peered":"2024-09-12T22:31:59.096588+0000","last_clean":"2024-09-12T22:31:59.096588+0000","last_became_active":"2024-09-12T22:31:37.410619+0000","last_became_peered":"2024-09-12T22:31:37.410619+0000","last_unstale":"2024-09-12T22:31:59.096588+0000","last_undegraded":"2024-09-12T22:31:59.096588+0000","last_fullsized":"2024-09-12T22:31:59.096588+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:30:01.012271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096050+0000","last_change":"2024-09-12T22:31:37.415589+0000","last_active":"2024-09-12T22:31:59.096050+0000","last_peered":"2024-09-12T22:31:59.096050+0000","last_clean":"2024-09-12T22:31:59.096050+0000","last_became_active":"2024-09-12T22:31:37.415285+0000","last_became_peered":"2024-09-12T22:31:37.415285+0000","last_unstale":"2024-09-12T22:31:59.096050+0000","last_undegraded":"2024-09-12T22:31:59.096050+0000","last_fullsized":"2024-09-12T22:31:59.096050+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:06:25.913810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.160650+0000","last_change":"2024-09-12T22:31:37.415190+0000","last_active":"2024-09-12T22:31:59.160650+0000","last_peered":"2024-09-12T22:31:59.160650+0000","last_clean":"2024-09-12T22:31:59.160650+0000","last_became_active":"2024-09-12T22:31:37.414265+0000","last_became_peered":"2024-09-12T22:31:37.414265+0000","last_unstale":"2024-09-12T22:31:59.160650+0000","last_undegraded":"2024-09-12T22:31:59.160650+0000","last_fullsized":"2024-09-12T22:31:59.160650+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:07:02.173590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096563+0000","last_change":"2024-09-12T22:31:57.100582+0000","last_active":"2024-09-12T22:31:59.096563+0000","last_peered":"2024-09-12T22:31:59.096563+0000","last_clean":"2024-09-12T22:31:59.096563+0000","last_became_active":"2024-09-12T22:31:57.100321+0000","last_became_peered":"2024-09-12T22:31:57.100321+0000","last_unstale":"2024-09-12T22:31:59.096563+0000","last_undegraded":"2024-09-12T22:31:59.096563+0000","last_fullsized":"2024-09-12T22:31:59.096563+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:59:36.843984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.161609+0000","last_change":"2024-09-12T22:31:36.412082+0000","last_active":"2024-09-12T22:31:59.161609+0000","last_peered":"2024-09-12T22:31:59.161609+0000","last_clean":"2024-09-12T22:31:59.161609+0000","last_became_active":"2024-09-12T22:31:36.410871+0000","last_became_peered":"2024-09-12T22:31:36.410871+0000","last_unstale":"2024-09-12T22:31:59.161609+0000","last_undegraded":"2024-09-12T22:31:59.161609+0000","last_fullsized":"2024-09-12T22:31:59.161609+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:30:49.127253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096903+0000","last_change":"2024-09-12T22:31:37.411790+0000","last_active":"2024-09-12T22:31:59.096903+0000","last_peered":"2024-09-12T22:31:59.096903+0000","last_clean":"2024-09-12T22:31:59.096903+0000","last_became_active":"2024-09-12T22:31:37.411414+0000","last_became_peered":"2024-09-12T22:31:37.411414+0000","last_unstale":"2024-09-12T22:31:59.096903+0000","last_undegraded":"2024-09-12T22:31:59.096903+0000","last_fullsized":"2024-09-12T22:31:59.096903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:22:40.226076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096358+0000","last_change":"2024-09-12T22:31:36.408563+0000","last_active":"2024-09-12T22:31:59.096358+0000","last_peered":"2024-09-12T22:31:59.096358+0000","last_clean":"2024-09-12T22:31:59.096358+0000","last_became_active":"2024-09-12T22:31:36.407447+0000","last_became_peered":"2024-09-12T22:31:36.407447+0000","last_unstale":"2024-09-12T22:31:59.096358+0000","last_undegraded":"2024-09-12T22:31:59.096358+0000","last_fullsized":"2024-09-12T22:31:59.096358+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:29:37.933109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.097034+0000","last_change":"2024-09-12T22:31:37.411680+0000","last_active":"2024-09-12T22:31:59.097034+0000","last_peered":"2024-09-12T22:31:59.097034+0000","last_clean":"2024-09-12T22:31:59.097034+0000","last_became_active":"2024-09-12T22:31:37.411168+0000","last_became_peered":"2024-09-12T22:31:37.411168+0000","last_unstale":"2024-09-12T22:31:59.097034+0000","last_undegraded":"2024-09-12T22:31:59.097034+0000","last_fullsized":"2024-09-12T22:31:59.097034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:27.706282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096377+0000","last_change":"2024-09-12T22:31:36.411271+0000","last_active":"2024-09-12T22:31:59.096377+0000","last_peered":"2024-09-12T22:31:59.096377+0000","last_clean":"2024-09-12T22:31:59.096377+0000","last_became_active":"2024-09-12T22:31:36.410706+0000","last_became_peered":"2024-09-12T22:31:36.410706+0000","last_unstale":"2024-09-12T22:31:59.096377+0000","last_undegraded":"2024-09-12T22:31:59.096377+0000","last_fullsized":"2024-09-12T22:31:59.096377+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:43:22.805855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096623+0000","last_change":"2024-09-12T22:31:37.411218+0000","last_active":"2024-09-12T22:31:59.096623+0000","last_peered":"2024-09-12T22:31:59.096623+0000","last_clean":"2024-09-12T22:31:59.096623+0000","last_became_active":"2024-09-12T22:31:37.409666+0000","last_became_peered":"2024-09-12T22:31:37.409666+0000","last_unstale":"2024-09-12T22:31:59.096623+0000","last_undegraded":"2024-09-12T22:31:59.096623+0000","last_fullsized":"2024-09-12T22:31:59.096623+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:45:34.230090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"19'8","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.160739+0000","last_change":"2024-09-12T22:31:36.411811+0000","last_active":"2024-09-12T22:31:59.160739+0000","last_peered":"2024-09-12T22:31:59.160739+0000","last_clean":"2024-09-12T22:31:59.160739+0000","last_became_active":"2024-09-12T22:31:36.410101+0000","last_became_peered":"2024-09-12T22:31:36.410101+0000","last_unstale":"2024-09-12T22:31:59.160739+0000","last_undegraded":"2024-09-12T22:31:59.160739+0000","last_fullsized":"2024-09-12T22:31:59.160739+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:33:02.410148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.161418+0000","last_change":"2024-09-12T22:31:36.410970+0000","last_active":"2024-09-12T22:31:59.161418+0000","last_peered":"2024-09-12T22:31:59.161418+0000","last_clean":"2024-09-12T22:31:59.161418+0000","last_became_active":"2024-09-12T22:31:36.409754+0000","last_became_peered":"2024-09-12T22:31:36.409754+0000","last_unstale":"2024-09-12T22:31:59.161418+0000","last_undegraded":"2024-09-12T22:31:59.161418+0000","last_fullsized":"2024-09-12T22:31:59.161418+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:30:07.724418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096288+0000","last_change":"2024-09-12T22:31:37.415050+0000","last_active":"2024-09-12T22:31:59.096288+0000","last_peered":"2024-09-12T22:31:59.096288+0000","last_clean":"2024-09-12T22:31:59.096288+0000","last_became_active":"2024-09-12T22:31:37.414290+0000","last_became_peered":"2024-09-12T22:31:37.414290+0000","last_unstale":"2024-09-12T22:31:59.096288+0000","last_undegraded":"2024-09-12T22:31:59.096288+0000","last_fullsized":"2024-09-12T22:31:59.096288+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:47:15.502575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.097101+0000","last_change":"2024-09-12T22:31:36.411725+0000","last_active":"2024-09-12T22:31:59.097101+0000","last_peered":"2024-09-12T22:31:59.097101+0000","last_clean":"2024-09-12T22:31:59.097101+0000","last_became_active":"2024-09-12T22:31:36.411407+0000","last_became_peered":"2024-09-12T22:31:36.411407+0000","last_unstale":"2024-09-12T22:31:59.097101+0000","last_undegraded":"2024-09-12T22:31:59.097101+0000","last_fullsized":"2024-09-12T22:31:59.097101+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:30:07.724418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096179+0000","last_change":"2024-09-12T22:31:57.092727+0000","last_active":"2024-09-12T22:31:59.096179+0000","last_peered":"2024-09-12T22:31:59.096179+0000","last_clean":"2024-09-12T22:31:59.096179+0000","last_became_active":"2024-09-12T22:31:57.092446+0000","last_became_peered":"2024-09-12T22:31:57.092446+0000","last_unstale":"2024-09-12T22:31:59.096179+0000","last_undegraded":"2024-09-12T22:31:59.096179+0000","last_fullsized":"2024-09-12T22:31:59.096179+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:09:14.524447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.161803+0000","last_change":"2024-09-12T22:31:36.411320+0000","last_active":"2024-09-12T22:31:59.161803+0000","last_peered":"2024-09-12T22:31:59.161803+0000","last_clean":"2024-09-12T22:31:59.161803+0000","last_became_active":"2024-09-12T22:31:36.409837+0000","last_became_peered":"2024-09-12T22:31:36.409837+0000","last_unstale":"2024-09-12T22:31:59.161803+0000","last_undegraded":"2024-09-12T22:31:59.161803+0000","last_fullsized":"2024-09-12T22:31:59.161803+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:36:53.914922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.160903+0000","last_change":"2024-09-12T22:31:37.414809+0000","last_active":"2024-09-12T22:31:59.160903+0000","last_peered":"2024-09-12T22:31:59.160903+0000","last_clean":"2024-09-12T22:31:59.160903+0000","last_became_active":"2024-09-12T22:31:37.414492+0000","last_became_peered":"2024-09-12T22:31:37.414492+0000","last_unstale":"2024-09-12T22:31:59.160903+0000","last_undegraded":"2024-09-12T22:31:59.160903+0000","last_fullsized":"2024-09-12T22:31:59.160903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:50:48.426898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.161505+0000","last_change":"2024-09-12T22:31:36.412068+0000","last_active":"2024-09-12T22:31:59.161505+0000","last_peered":"2024-09-12T22:31:59.161505+0000","last_clean":"2024-09-12T22:31:59.161505+0000","last_became_active":"2024-09-12T22:31:36.411366+0000","last_became_peered":"2024-09-12T22:31:36.411366+0000","last_unstale":"2024-09-12T22:31:59.161505+0000","last_undegraded":"2024-09-12T22:31:59.161505+0000","last_fullsized":"2024-09-12T22:31:59.161505+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:35:51.647051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096537+0000","last_change":"2024-09-12T22:31:37.410303+0000","last_active":"2024-09-12T22:31:59.096537+0000","last_peered":"2024-09-12T22:31:59.096537+0000","last_clean":"2024-09-12T22:31:59.096537+0000","last_became_active":"2024-09-12T22:31:37.409607+0000","last_became_peered":"2024-09-12T22:31:37.409607+0000","last_unstale":"2024-09-12T22:31:59.096537+0000","last_undegraded":"2024-09-12T22:31:59.096537+0000","last_fullsized":"2024-09-12T22:31:59.096537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:53:42.732654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096646+0000","last_change":"2024-09-12T22:31:36.407974+0000","last_active":"2024-09-12T22:31:59.096646+0000","last_peered":"2024-09-12T22:31:59.096646+0000","last_clean":"2024-09-12T22:31:59.096646+0000","last_became_active":"2024-09-12T22:31:36.406955+0000","last_became_peered":"2024-09-12T22:31:36.406955+0000","last_unstale":"2024-09-12T22:31:59.096646+0000","last_undegraded":"2024-09-12T22:31:59.096646+0000","last_fullsized":"2024-09-12T22:31:59.096646+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:07:34.831264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.161238+0000","last_change":"2024-09-12T22:31:37.415285+0000","last_active":"2024-09-12T22:31:59.161238+0000","last_peered":"2024-09-12T22:31:59.161238+0000","last_clean":"2024-09-12T22:31:59.161238+0000","last_became_active":"2024-09-12T22:31:37.414890+0000","last_became_peered":"2024-09-12T22:31:37.414890+0000","last_unstale":"2024-09-12T22:31:59.161238+0000","last_undegraded":"2024-09-12T22:31:59.161238+0000","last_fullsized":"2024-09-12T22:31:59.161238+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:38:16.956786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.161083+0000","last_change":"2024-09-12T22:31:36.412147+0000","last_active":"2024-09-12T22:31:59.161083+0000","last_peered":"2024-09-12T22:31:59.161083+0000","last_clean":"2024-09-12T22:31:59.161083+0000","last_became_active":"2024-09-12T22:31:36.411382+0000","last_became_peered":"2024-09-12T22:31:36.411382+0000","last_unstale":"2024-09-12T22:31:59.161083+0000","last_undegraded":"2024-09-12T22:31:59.161083+0000","last_fullsized":"2024-09-12T22:31:59.161083+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:54:51.454867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.161714+0000","last_change":"2024-09-12T22:31:37.420209+0000","last_active":"2024-09-12T22:31:59.161714+0000","last_peered":"2024-09-12T22:31:59.161714+0000","last_clean":"2024-09-12T22:31:59.161714+0000","last_became_active":"2024-09-12T22:31:37.419267+0000","last_became_peered":"2024-09-12T22:31:37.419267+0000","last_unstale":"2024-09-12T22:31:59.161714+0000","last_undegraded":"2024-09-12T22:31:59.161714+0000","last_fullsized":"2024-09-12T22:31:59.161714+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:36.790111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096451+0000","last_change":"2024-09-12T22:31:36.411190+0000","last_active":"2024-09-12T22:31:59.096451+0000","last_peered":"2024-09-12T22:31:59.096451+0000","last_clean":"2024-09-12T22:31:59.096451+0000","last_became_active":"2024-09-12T22:31:36.410548+0000","last_became_peered":"2024-09-12T22:31:36.410548+0000","last_unstale":"2024-09-12T22:31:59.096451+0000","last_undegraded":"2024-09-12T22:31:59.096451+0000","last_fullsized":"2024-09-12T22:31:59.096451+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:10:20.300894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.161297+0000","last_change":"2024-09-12T22:31:37.418749+0000","last_active":"2024-09-12T22:31:59.161297+0000","last_peered":"2024-09-12T22:31:59.161297+0000","last_clean":"2024-09-12T22:31:59.161297+0000","last_became_active":"2024-09-12T22:31:37.418360+0000","last_became_peered":"2024-09-12T22:31:37.418360+0000","last_unstale":"2024-09-12T22:31:59.161297+0000","last_undegraded":"2024-09-12T22:31:59.161297+0000","last_fullsized":"2024-09-12T22:31:59.161297+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:50:08.152699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096343+0000","last_change":"2024-09-12T22:31:36.412187+0000","last_active":"2024-09-12T22:31:59.096343+0000","last_peered":"2024-09-12T22:31:59.096343+0000","last_clean":"2024-09-12T22:31:59.096343+0000","last_became_active":"2024-09-12T22:31:36.411935+0000","last_became_peered":"2024-09-12T22:31:36.411935+0000","last_unstale":"2024-09-12T22:31:59.096343+0000","last_undegraded":"2024-09-12T22:31:59.096343+0000","last_fullsized":"2024-09-12T22:31:59.096343+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:41:04.029445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096677+0000","last_change":"2024-09-12T22:31:37.417881+0000","last_active":"2024-09-12T22:31:59.096677+0000","last_peered":"2024-09-12T22:31:59.096677+0000","last_clean":"2024-09-12T22:31:59.096677+0000","last_became_active":"2024-09-12T22:31:37.417572+0000","last_became_peered":"2024-09-12T22:31:37.417572+0000","last_unstale":"2024-09-12T22:31:59.096677+0000","last_undegraded":"2024-09-12T22:31:59.096677+0000","last_fullsized":"2024-09-12T22:31:59.096677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:19:16.367589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":232,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.161233+0000","last_change":"2024-09-12T22:31:27.631847+0000","last_active":"2024-09-12T22:31:59.161233+0000","last_peered":"2024-09-12T22:31:59.161233+0000","last_clean":"2024-09-12T22:31:59.161233+0000","last_became_active":"2024-09-12T22:31:27.631027+0000","last_became_peered":"2024-09-12T22:31:27.631027+0000","last_unstale":"2024-09-12T22:31:59.161233+0000","last_undegraded":"2024-09-12T22:31:59.161233+0000","last_fullsized":"2024-09-12T22:31:59.161233+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:26.229539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:26.229539+0000","last_clean_scrub_stamp":"2024-09-12T22:31:26.229539+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:59:24.181319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":36,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.161664+0000","last_change":"2024-09-12T22:31:34.286952+0000","last_active":"2024-09-12T22:31:59.161664+0000","last_peered":"2024-09-12T22:31:59.161664+0000","last_clean":"2024-09-12T22:31:59.161664+0000","last_became_active":"2024-09-12T22:31:32.283661+0000","last_became_peered":"2024-09-12T22:31:32.283661+0000","last_unstale":"2024-09-12T22:31:59.161664+0000","last_undegraded":"2024-09-12T22:31:59.161664+0000","last_fullsized":"2024-09-12T22:31:59.161664+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:21.681390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000621274,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096463+0000","last_change":"2024-09-12T22:31:36.411275+0000","last_active":"2024-09-12T22:31:59.096463+0000","last_peered":"2024-09-12T22:31:59.096463+0000","last_clean":"2024-09-12T22:31:59.096463+0000","last_became_active":"2024-09-12T22:31:36.410595+0000","last_became_peered":"2024-09-12T22:31:36.410595+0000","last_unstale":"2024-09-12T22:31:59.096463+0000","last_undegraded":"2024-09-12T22:31:59.096463+0000","last_fullsized":"2024-09-12T22:31:59.096463+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:38:14.895625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.161803+0000","last_change":"2024-09-12T22:31:37.419976+0000","last_active":"2024-09-12T22:31:59.161803+0000","last_peered":"2024-09-12T22:31:59.161803+0000","last_clean":"2024-09-12T22:31:59.161803+0000","last_became_active":"2024-09-12T22:31:37.419161+0000","last_became_peered":"2024-09-12T22:31:37.419161+0000","last_unstale":"2024-09-12T22:31:59.161803+0000","last_undegraded":"2024-09-12T22:31:59.161803+0000","last_fullsized":"2024-09-12T22:31:59.161803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:07:26.070097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":35,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.161322+0000","last_change":"2024-09-12T22:31:34.286642+0000","last_active":"2024-09-12T22:31:59.161322+0000","last_peered":"2024-09-12T22:31:59.161322+0000","last_clean":"2024-09-12T22:31:59.161322+0000","last_became_active":"2024-09-12T22:31:32.283601+0000","last_became_peered":"2024-09-12T22:31:32.283601+0000","last_unstale":"2024-09-12T22:31:59.161322+0000","last_undegraded":"2024-09-12T22:31:59.161322+0000","last_fullsized":"2024-09-12T22:31:59.161322+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:40:06.769540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037858999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096228+0000","last_change":"2024-09-12T22:31:36.407395+0000","last_active":"2024-09-12T22:31:59.096228+0000","last_peered":"2024-09-12T22:31:59.096228+0000","last_clean":"2024-09-12T22:31:59.096228+0000","last_became_active":"2024-09-12T22:31:36.406770+0000","last_became_peered":"2024-09-12T22:31:36.406770+0000","last_unstale":"2024-09-12T22:31:59.096228+0000","last_undegraded":"2024-09-12T22:31:59.096228+0000","last_fullsized":"2024-09-12T22:31:59.096228+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:49:26.547848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096930+0000","last_change":"2024-09-12T22:31:37.414075+0000","last_active":"2024-09-12T22:31:59.096930+0000","last_peered":"2024-09-12T22:31:59.096930+0000","last_clean":"2024-09-12T22:31:59.096930+0000","last_became_active":"2024-09-12T22:31:37.413491+0000","last_became_peered":"2024-09-12T22:31:37.413491+0000","last_unstale":"2024-09-12T22:31:59.096930+0000","last_undegraded":"2024-09-12T22:31:59.096930+0000","last_fullsized":"2024-09-12T22:31:59.096930+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:26:25.578693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":35,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096337+0000","last_change":"2024-09-12T22:31:34.286394+0000","last_active":"2024-09-12T22:31:59.096337+0000","last_peered":"2024-09-12T22:31:59.096337+0000","last_clean":"2024-09-12T22:31:59.096337+0000","last_became_active":"2024-09-12T22:31:32.280062+0000","last_became_peered":"2024-09-12T22:31:32.280062+0000","last_unstale":"2024-09-12T22:31:59.096337+0000","last_undegraded":"2024-09-12T22:31:59.096337+0000","last_fullsized":"2024-09-12T22:31:59.096337+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:20:23.663838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039540700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.160527+0000","last_change":"2024-09-12T22:31:57.100816+0000","last_active":"2024-09-12T22:31:59.160527+0000","last_peered":"2024-09-12T22:31:59.160527+0000","last_clean":"2024-09-12T22:31:59.160527+0000","last_became_active":"2024-09-12T22:31:57.100392+0000","last_became_peered":"2024-09-12T22:31:57.100392+0000","last_unstale":"2024-09-12T22:31:59.160527+0000","last_undegraded":"2024-09-12T22:31:59.160527+0000","last_fullsized":"2024-09-12T22:31:59.160527+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:06:12.881182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096778+0000","last_change":"2024-09-12T22:31:37.417636+0000","last_active":"2024-09-12T22:31:59.096778+0000","last_peered":"2024-09-12T22:31:59.096778+0000","last_clean":"2024-09-12T22:31:59.096778+0000","last_became_active":"2024-09-12T22:31:37.417230+0000","last_became_peered":"2024-09-12T22:31:37.417230+0000","last_unstale":"2024-09-12T22:31:59.096778+0000","last_undegraded":"2024-09-12T22:31:59.096778+0000","last_fullsized":"2024-09-12T22:31:59.096778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:44:29.729122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":37,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.161131+0000","last_change":"2024-09-12T22:31:34.286938+0000","last_active":"2024-09-12T22:31:59.161131+0000","last_peered":"2024-09-12T22:31:59.161131+0000","last_clean":"2024-09-12T22:31:59.161131+0000","last_became_active":"2024-09-12T22:31:32.282230+0000","last_became_peered":"2024-09-12T22:31:32.282230+0000","last_unstale":"2024-09-12T22:31:59.161131+0000","last_undegraded":"2024-09-12T22:31:59.161131+0000","last_fullsized":"2024-09-12T22:31:59.161131+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:11:05.988384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000615758,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.161627+0000","last_change":"2024-09-12T22:31:36.410694+0000","last_active":"2024-09-12T22:31:59.161627+0000","last_peered":"2024-09-12T22:31:59.161627+0000","last_clean":"2024-09-12T22:31:59.161627+0000","last_became_active":"2024-09-12T22:31:36.409816+0000","last_became_peered":"2024-09-12T22:31:36.409816+0000","last_unstale":"2024-09-12T22:31:59.161627+0000","last_undegraded":"2024-09-12T22:31:59.161627+0000","last_fullsized":"2024-09-12T22:31:59.161627+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:40:35.369213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096688+0000","last_change":"2024-09-12T22:31:37.414608+0000","last_active":"2024-09-12T22:31:59.096688+0000","last_peered":"2024-09-12T22:31:59.096688+0000","last_clean":"2024-09-12T22:31:59.096688+0000","last_became_active":"2024-09-12T22:31:37.414307+0000","last_became_peered":"2024-09-12T22:31:37.414307+0000","last_unstale":"2024-09-12T22:31:59.096688+0000","last_undegraded":"2024-09-12T22:31:59.096688+0000","last_fullsized":"2024-09-12T22:31:59.096688+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:41:21.231511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.161886+0000","last_change":"2024-09-12T22:31:36.411355+0000","last_active":"2024-09-12T22:31:59.161886+0000","last_peered":"2024-09-12T22:31:59.161886+0000","last_clean":"2024-09-12T22:31:59.161886+0000","last_became_active":"2024-09-12T22:31:36.410529+0000","last_became_peered":"2024-09-12T22:31:36.410529+0000","last_unstale":"2024-09-12T22:31:59.161886+0000","last_undegraded":"2024-09-12T22:31:59.161886+0000","last_fullsized":"2024-09-12T22:31:59.161886+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:19:47.356688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":35,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096788+0000","last_change":"2024-09-12T22:31:34.286457+0000","last_active":"2024-09-12T22:31:59.096788+0000","last_peered":"2024-09-12T22:31:59.096788+0000","last_clean":"2024-09-12T22:31:59.096788+0000","last_became_active":"2024-09-12T22:31:32.280007+0000","last_became_peered":"2024-09-12T22:31:32.280007+0000","last_unstale":"2024-09-12T22:31:59.096788+0000","last_undegraded":"2024-09-12T22:31:59.096788+0000","last_fullsized":"2024-09-12T22:31:59.096788+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:09.068038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041972500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096464+0000","last_change":"2024-09-12T22:31:37.410386+0000","last_active":"2024-09-12T22:31:59.096464+0000","last_peered":"2024-09-12T22:31:59.096464+0000","last_clean":"2024-09-12T22:31:59.096464+0000","last_became_active":"2024-09-12T22:31:37.409928+0000","last_became_peered":"2024-09-12T22:31:37.409928+0000","last_unstale":"2024-09-12T22:31:59.096464+0000","last_undegraded":"2024-09-12T22:31:59.096464+0000","last_fullsized":"2024-09-12T22:31:59.096464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:02:36.454134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096725+0000","last_change":"2024-09-12T22:31:36.410324+0000","last_active":"2024-09-12T22:31:59.096725+0000","last_peered":"2024-09-12T22:31:59.096725+0000","last_clean":"2024-09-12T22:31:59.096725+0000","last_became_active":"2024-09-12T22:31:36.409199+0000","last_became_peered":"2024-09-12T22:31:36.409199+0000","last_unstale":"2024-09-12T22:31:59.096725+0000","last_undegraded":"2024-09-12T22:31:59.096725+0000","last_fullsized":"2024-09-12T22:31:59.096725+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:06:54.608936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":35,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.097114+0000","last_change":"2024-09-12T22:31:34.839044+0000","last_active":"2024-09-12T22:31:59.097114+0000","last_peered":"2024-09-12T22:31:59.097114+0000","last_clean":"2024-09-12T22:31:59.097114+0000","last_became_active":"2024-09-12T22:31:32.279671+0000","last_became_peered":"2024-09-12T22:31:32.279671+0000","last_unstale":"2024-09-12T22:31:59.097114+0000","last_undegraded":"2024-09-12T22:31:59.097114+0000","last_fullsized":"2024-09-12T22:31:59.097114+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:27:49.809935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036776499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.161522+0000","last_change":"2024-09-12T22:31:57.100721+0000","last_active":"2024-09-12T22:31:59.161522+0000","last_peered":"2024-09-12T22:31:59.161522+0000","last_clean":"2024-09-12T22:31:59.161522+0000","last_became_active":"2024-09-12T22:31:57.100426+0000","last_became_peered":"2024-09-12T22:31:57.100426+0000","last_unstale":"2024-09-12T22:31:59.161522+0000","last_undegraded":"2024-09-12T22:31:59.161522+0000","last_fullsized":"2024-09-12T22:31:59.161522+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:14:31.890006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096944+0000","last_change":"2024-09-12T22:31:36.409397+0000","last_active":"2024-09-12T22:31:59.096944+0000","last_peered":"2024-09-12T22:31:59.096944+0000","last_clean":"2024-09-12T22:31:59.096944+0000","last_became_active":"2024-09-12T22:31:36.408787+0000","last_became_peered":"2024-09-12T22:31:36.408787+0000","last_unstale":"2024-09-12T22:31:59.096944+0000","last_undegraded":"2024-09-12T22:31:59.096944+0000","last_fullsized":"2024-09-12T22:31:59.096944+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:29:03.467352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":35,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.097079+0000","last_change":"2024-09-12T22:31:34.286639+0000","last_active":"2024-09-12T22:31:59.097079+0000","last_peered":"2024-09-12T22:31:59.097079+0000","last_clean":"2024-09-12T22:31:59.097079+0000","last_became_active":"2024-09-12T22:31:32.280092+0000","last_became_peered":"2024-09-12T22:31:32.280092+0000","last_unstale":"2024-09-12T22:31:59.097079+0000","last_undegraded":"2024-09-12T22:31:59.097079+0000","last_fullsized":"2024-09-12T22:31:59.097079+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:02:40.821530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058589999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096105+0000","last_change":"2024-09-12T22:31:37.411152+0000","last_active":"2024-09-12T22:31:59.096105+0000","last_peered":"2024-09-12T22:31:59.096105+0000","last_clean":"2024-09-12T22:31:59.096105+0000","last_became_active":"2024-09-12T22:31:37.410558+0000","last_became_peered":"2024-09-12T22:31:37.410558+0000","last_unstale":"2024-09-12T22:31:59.096105+0000","last_undegraded":"2024-09-12T22:31:59.096105+0000","last_fullsized":"2024-09-12T22:31:59.096105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:14:29.892478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.097031+0000","last_change":"2024-09-12T22:31:36.407460+0000","last_active":"2024-09-12T22:31:59.097031+0000","last_peered":"2024-09-12T22:31:59.097031+0000","last_clean":"2024-09-12T22:31:59.097031+0000","last_became_active":"2024-09-12T22:31:36.406729+0000","last_became_peered":"2024-09-12T22:31:36.406729+0000","last_unstale":"2024-09-12T22:31:59.097031+0000","last_undegraded":"2024-09-12T22:31:59.097031+0000","last_fullsized":"2024-09-12T22:31:59.097031+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:27:58.012573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":35,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.161521+0000","last_change":"2024-09-12T22:31:34.286699+0000","last_active":"2024-09-12T22:31:59.161521+0000","last_peered":"2024-09-12T22:31:59.161521+0000","last_clean":"2024-09-12T22:31:59.161521+0000","last_became_active":"2024-09-12T22:31:32.283606+0000","last_became_peered":"2024-09-12T22:31:32.283606+0000","last_unstale":"2024-09-12T22:31:59.161521+0000","last_undegraded":"2024-09-12T22:31:59.161521+0000","last_fullsized":"2024-09-12T22:31:59.161521+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:09:32.050798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000382109,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096345+0000","last_change":"2024-09-12T22:31:37.410011+0000","last_active":"2024-09-12T22:31:59.096345+0000","last_peered":"2024-09-12T22:31:59.096345+0000","last_clean":"2024-09-12T22:31:59.096345+0000","last_became_active":"2024-09-12T22:31:37.409320+0000","last_became_peered":"2024-09-12T22:31:37.409320+0000","last_unstale":"2024-09-12T22:31:59.096345+0000","last_undegraded":"2024-09-12T22:31:59.096345+0000","last_fullsized":"2024-09-12T22:31:59.096345+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:27:23.661444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.161245+0000","last_change":"2024-09-12T22:31:37.415670+0000","last_active":"2024-09-12T22:31:59.161245+0000","last_peered":"2024-09-12T22:31:59.161245+0000","last_clean":"2024-09-12T22:31:59.161245+0000","last_became_active":"2024-09-12T22:31:37.415007+0000","last_became_peered":"2024-09-12T22:31:37.415007+0000","last_unstale":"2024-09-12T22:31:59.161245+0000","last_undegraded":"2024-09-12T22:31:59.161245+0000","last_fullsized":"2024-09-12T22:31:59.161245+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:42:51.694128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"23'9","reported_seq":31,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.161390+0000","last_change":"2024-09-12T22:31:36.409878+0000","last_active":"2024-09-12T22:31:59.161390+0000","last_peered":"2024-09-12T22:31:59.161390+0000","last_clean":"2024-09-12T22:31:59.161390+0000","last_became_active":"2024-09-12T22:31:36.409132+0000","last_became_peered":"2024-09-12T22:31:36.409132+0000","last_unstale":"2024-09-12T22:31:59.161390+0000","last_undegraded":"2024-09-12T22:31:59.161390+0000","last_fullsized":"2024-09-12T22:31:59.161390+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:09:56.081385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4886,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096169+0000","last_change":"2024-09-12T22:31:37.414914+0000","last_active":"2024-09-12T22:31:59.096169+0000","last_peered":"2024-09-12T22:31:59.096169+0000","last_clean":"2024-09-12T22:31:59.096169+0000","last_became_active":"2024-09-12T22:31:37.414535+0000","last_became_peered":"2024-09-12T22:31:37.414535+0000","last_unstale":"2024-09-12T22:31:59.096169+0000","last_undegraded":"2024-09-12T22:31:59.096169+0000","last_fullsized":"2024-09-12T22:31:59.096169+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:14:37.010786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"19'3","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.161712+0000","last_change":"2024-09-12T22:31:57.101007+0000","last_active":"2024-09-12T22:31:59.161712+0000","last_peered":"2024-09-12T22:31:59.161712+0000","last_clean":"2024-09-12T22:31:59.161712+0000","last_became_active":"2024-09-12T22:31:57.100640+0000","last_became_peered":"2024-09-12T22:31:57.100640+0000","last_unstale":"2024-09-12T22:31:59.161712+0000","last_undegraded":"2024-09-12T22:31:59.161712+0000","last_fullsized":"2024-09-12T22:31:59.161712+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:37:12.949001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.161477+0000","last_change":"2024-09-12T22:31:36.411549+0000","last_active":"2024-09-12T22:31:59.161477+0000","last_peered":"2024-09-12T22:31:59.161477+0000","last_clean":"2024-09-12T22:31:59.161477+0000","last_became_active":"2024-09-12T22:31:36.410674+0000","last_became_peered":"2024-09-12T22:31:36.410674+0000","last_unstale":"2024-09-12T22:31:59.161477+0000","last_undegraded":"2024-09-12T22:31:59.161477+0000","last_fullsized":"2024-09-12T22:31:59.161477+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:58:05.676197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096094+0000","last_change":"2024-09-12T22:31:37.411254+0000","last_active":"2024-09-12T22:31:59.096094+0000","last_peered":"2024-09-12T22:31:59.096094+0000","last_clean":"2024-09-12T22:31:59.096094+0000","last_became_active":"2024-09-12T22:31:37.410404+0000","last_became_peered":"2024-09-12T22:31:37.410404+0000","last_unstale":"2024-09-12T22:31:59.096094+0000","last_undegraded":"2024-09-12T22:31:59.096094+0000","last_fullsized":"2024-09-12T22:31:59.096094+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:42:00.856616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096887+0000","last_change":"2024-09-12T22:31:36.408390+0000","last_active":"2024-09-12T22:31:59.096887+0000","last_peered":"2024-09-12T22:31:59.096887+0000","last_clean":"2024-09-12T22:31:59.096887+0000","last_became_active":"2024-09-12T22:31:36.407062+0000","last_became_peered":"2024-09-12T22:31:36.407062+0000","last_unstale":"2024-09-12T22:31:59.096887+0000","last_undegraded":"2024-09-12T22:31:59.096887+0000","last_fullsized":"2024-09-12T22:31:59.096887+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:09:10.618195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096087+0000","last_change":"2024-09-12T22:31:37.416629+0000","last_active":"2024-09-12T22:31:59.096087+0000","last_peered":"2024-09-12T22:31:59.096087+0000","last_clean":"2024-09-12T22:31:59.096087+0000","last_became_active":"2024-09-12T22:31:37.416387+0000","last_became_peered":"2024-09-12T22:31:37.416387+0000","last_unstale":"2024-09-12T22:31:59.096087+0000","last_undegraded":"2024-09-12T22:31:59.096087+0000","last_fullsized":"2024-09-12T22:31:59.096087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:59:52.020560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.097123+0000","last_change":"2024-09-12T22:31:37.413777+0000","last_active":"2024-09-12T22:31:59.097123+0000","last_peered":"2024-09-12T22:31:59.097123+0000","last_clean":"2024-09-12T22:31:59.097123+0000","last_became_active":"2024-09-12T22:31:37.412669+0000","last_became_peered":"2024-09-12T22:31:37.412669+0000","last_unstale":"2024-09-12T22:31:59.097123+0000","last_undegraded":"2024-09-12T22:31:59.097123+0000","last_fullsized":"2024-09-12T22:31:59.097123+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:42:17.728844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096197+0000","last_change":"2024-09-12T22:31:36.409466+0000","last_active":"2024-09-12T22:31:59.096197+0000","last_peered":"2024-09-12T22:31:59.096197+0000","last_clean":"2024-09-12T22:31:59.096197+0000","last_became_active":"2024-09-12T22:31:36.408796+0000","last_became_peered":"2024-09-12T22:31:36.408796+0000","last_unstale":"2024-09-12T22:31:59.096197+0000","last_undegraded":"2024-09-12T22:31:59.096197+0000","last_fullsized":"2024-09-12T22:31:59.096197+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:03:39.648159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096898+0000","last_change":"2024-09-12T22:31:37.411183+0000","last_active":"2024-09-12T22:31:59.096898+0000","last_peered":"2024-09-12T22:31:59.096898+0000","last_clean":"2024-09-12T22:31:59.096898+0000","last_became_active":"2024-09-12T22:31:37.409796+0000","last_became_peered":"2024-09-12T22:31:37.409796+0000","last_unstale":"2024-09-12T22:31:59.096898+0000","last_undegraded":"2024-09-12T22:31:59.096898+0000","last_fullsized":"2024-09-12T22:31:59.096898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:20:35.779810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096227+0000","last_change":"2024-09-12T22:31:36.407402+0000","last_active":"2024-09-12T22:31:59.096227+0000","last_peered":"2024-09-12T22:31:59.096227+0000","last_clean":"2024-09-12T22:31:59.096227+0000","last_became_active":"2024-09-12T22:31:36.406681+0000","last_became_peered":"2024-09-12T22:31:36.406681+0000","last_unstale":"2024-09-12T22:31:59.096227+0000","last_undegraded":"2024-09-12T22:31:59.096227+0000","last_fullsized":"2024-09-12T22:31:59.096227+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:39:39.362573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096788+0000","last_change":"2024-09-12T22:31:37.412817+0000","last_active":"2024-09-12T22:31:59.096788+0000","last_peered":"2024-09-12T22:31:59.096788+0000","last_clean":"2024-09-12T22:31:59.096788+0000","last_became_active":"2024-09-12T22:31:37.411999+0000","last_became_peered":"2024-09-12T22:31:37.411999+0000","last_unstale":"2024-09-12T22:31:59.096788+0000","last_undegraded":"2024-09-12T22:31:59.096788+0000","last_fullsized":"2024-09-12T22:31:59.096788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:07:02.173590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096309+0000","last_change":"2024-09-12T22:31:57.095289+0000","last_active":"2024-09-12T22:31:59.096309+0000","last_peered":"2024-09-12T22:31:59.096309+0000","last_clean":"2024-09-12T22:31:59.096309+0000","last_became_active":"2024-09-12T22:31:57.095039+0000","last_became_peered":"2024-09-12T22:31:57.095039+0000","last_unstale":"2024-09-12T22:31:59.096309+0000","last_undegraded":"2024-09-12T22:31:59.096309+0000","last_fullsized":"2024-09-12T22:31:59.096309+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:39:50.881312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096461+0000","last_change":"2024-09-12T22:31:57.095260+0000","last_active":"2024-09-12T22:31:59.096461+0000","last_peered":"2024-09-12T22:31:59.096461+0000","last_clean":"2024-09-12T22:31:59.096461+0000","last_became_active":"2024-09-12T22:31:57.095035+0000","last_became_peered":"2024-09-12T22:31:57.095035+0000","last_unstale":"2024-09-12T22:31:59.096461+0000","last_undegraded":"2024-09-12T22:31:59.096461+0000","last_fullsized":"2024-09-12T22:31:59.096461+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:55:51.885364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096658+0000","last_change":"2024-09-12T22:31:36.412289+0000","last_active":"2024-09-12T22:31:59.096658+0000","last_peered":"2024-09-12T22:31:59.096658+0000","last_clean":"2024-09-12T22:31:59.096658+0000","last_became_active":"2024-09-12T22:31:36.411985+0000","last_became_peered":"2024-09-12T22:31:36.411985+0000","last_unstale":"2024-09-12T22:31:59.096658+0000","last_undegraded":"2024-09-12T22:31:59.096658+0000","last_fullsized":"2024-09-12T22:31:59.096658+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:30:09.410370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.161119+0000","last_change":"2024-09-12T22:31:37.415365+0000","last_active":"2024-09-12T22:31:59.161119+0000","last_peered":"2024-09-12T22:31:59.161119+0000","last_clean":"2024-09-12T22:31:59.161119+0000","last_became_active":"2024-09-12T22:31:37.413933+0000","last_became_peered":"2024-09-12T22:31:37.413933+0000","last_unstale":"2024-09-12T22:31:59.161119+0000","last_undegraded":"2024-09-12T22:31:59.161119+0000","last_fullsized":"2024-09-12T22:31:59.161119+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:08:07.115355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.161409+0000","last_change":"2024-09-12T22:31:36.411665+0000","last_active":"2024-09-12T22:31:59.161409+0000","last_peered":"2024-09-12T22:31:59.161409+0000","last_clean":"2024-09-12T22:31:59.161409+0000","last_became_active":"2024-09-12T22:31:36.410182+0000","last_became_peered":"2024-09-12T22:31:36.410182+0000","last_unstale":"2024-09-12T22:31:59.161409+0000","last_undegraded":"2024-09-12T22:31:59.161409+0000","last_fullsized":"2024-09-12T22:31:59.161409+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:37:20.891838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.161032+0000","last_change":"2024-09-12T22:31:37.415172+0000","last_active":"2024-09-12T22:31:59.161032+0000","last_peered":"2024-09-12T22:31:59.161032+0000","last_clean":"2024-09-12T22:31:59.161032+0000","last_became_active":"2024-09-12T22:31:37.414776+0000","last_became_peered":"2024-09-12T22:31:37.414776+0000","last_unstale":"2024-09-12T22:31:59.161032+0000","last_undegraded":"2024-09-12T22:31:59.161032+0000","last_fullsized":"2024-09-12T22:31:59.161032+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:42:32.307876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.161425+0000","last_change":"2024-09-12T22:31:57.100908+0000","last_active":"2024-09-12T22:31:59.161425+0000","last_peered":"2024-09-12T22:31:59.161425+0000","last_clean":"2024-09-12T22:31:59.161425+0000","last_became_active":"2024-09-12T22:31:57.100579+0000","last_became_peered":"2024-09-12T22:31:57.100579+0000","last_unstale":"2024-09-12T22:31:59.161425+0000","last_undegraded":"2024-09-12T22:31:59.161425+0000","last_fullsized":"2024-09-12T22:31:59.161425+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:49:56.674930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096497+0000","last_change":"2024-09-12T22:31:37.409214+0000","last_active":"2024-09-12T22:31:59.096497+0000","last_peered":"2024-09-12T22:31:59.096497+0000","last_clean":"2024-09-12T22:31:59.096497+0000","last_became_active":"2024-09-12T22:31:37.408849+0000","last_became_peered":"2024-09-12T22:31:37.408849+0000","last_unstale":"2024-09-12T22:31:59.096497+0000","last_undegraded":"2024-09-12T22:31:59.096497+0000","last_fullsized":"2024-09-12T22:31:59.096497+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:39:20.383152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096977+0000","last_change":"2024-09-12T22:31:36.410371+0000","last_active":"2024-09-12T22:31:59.096977+0000","last_peered":"2024-09-12T22:31:59.096977+0000","last_clean":"2024-09-12T22:31:59.096977+0000","last_became_active":"2024-09-12T22:31:36.409428+0000","last_became_peered":"2024-09-12T22:31:36.409428+0000","last_unstale":"2024-09-12T22:31:59.096977+0000","last_undegraded":"2024-09-12T22:31:59.096977+0000","last_fullsized":"2024-09-12T22:31:59.096977+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:27:22.817690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.160747+0000","last_change":"2024-09-12T22:31:37.415390+0000","last_active":"2024-09-12T22:31:59.160747+0000","last_peered":"2024-09-12T22:31:59.160747+0000","last_clean":"2024-09-12T22:31:59.160747+0000","last_became_active":"2024-09-12T22:31:37.414781+0000","last_became_peered":"2024-09-12T22:31:37.414781+0000","last_unstale":"2024-09-12T22:31:59.160747+0000","last_undegraded":"2024-09-12T22:31:59.160747+0000","last_fullsized":"2024-09-12T22:31:59.160747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:42:17.728844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"19'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096779+0000","last_change":"2024-09-12T22:31:36.407945+0000","last_active":"2024-09-12T22:31:59.096779+0000","last_peered":"2024-09-12T22:31:59.096779+0000","last_clean":"2024-09-12T22:31:59.096779+0000","last_became_active":"2024-09-12T22:31:36.406959+0000","last_became_peered":"2024-09-12T22:31:36.406959+0000","last_unstale":"2024-09-12T22:31:59.096779+0000","last_undegraded":"2024-09-12T22:31:59.096779+0000","last_fullsized":"2024-09-12T22:31:59.096779+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:26:33.155850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":5684,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":11368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705675,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32008,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339832,"statfs":{"total":96636764160,"available":96603987968,"internally_reserved":0,"allocated":839680,"data_stored":674385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705675,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31996,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339844,"statfs":{"total":96636764160,"available":96604000256,"internally_reserved":0,"allocated":827392,"data_stored":673750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738379,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":217088,"data_stored":78949,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":5068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":5684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T22:32:04.965 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-12T22:32:04.965 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-12T22:32:04.965 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T22:32:04.984 INFO:teuthology.orchestra.run.smithi076.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:04.984 INFO:teuthology.orchestra.run.smithi076.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:04.993 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:32:05.045 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:05.044+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:05.110 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:05.110 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:05.117 INFO:teuthology.orchestra.run.smithi019.stderr:nodeep-scrub is unset 2024-09-12T22:32:05.119 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:32:05.146 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:32:05.145+0000 7fddec6a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30331) UID: 0 2024-09-12T22:32:05.222 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:05.222 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:05.231 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:32:05.274 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:05.273+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:05.297 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:32:05.298 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-12T22:32:05.307 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":46,"stamp":"2024-09-12T22:32:05.120103+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596071,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":255,"num_write_kb":3482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":203,"ondisk_log_size":203,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":91248,"kb_used_data":1840,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283024272,"statfs":{"total":289910292480,"available":289816854528,"internally_reserved":0,"allocated":1884160,"data_stored":1427084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":91483471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3274,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.927358"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.097049+0000","last_change":"2024-09-12T22:31:37.416383+0000","last_active":"2024-09-12T22:31:59.097049+0000","last_peered":"2024-09-12T22:31:59.097049+0000","last_clean":"2024-09-12T22:31:59.097049+0000","last_became_active":"2024-09-12T22:31:37.415457+0000","last_became_peered":"2024-09-12T22:31:37.415457+0000","last_unstale":"2024-09-12T22:31:59.097049+0000","last_undegraded":"2024-09-12T22:31:59.097049+0000","last_fullsized":"2024-09-12T22:31:59.097049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:08:29.199832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096704+0000","last_change":"2024-09-12T22:31:57.100705+0000","last_active":"2024-09-12T22:31:59.096704+0000","last_peered":"2024-09-12T22:31:59.096704+0000","last_clean":"2024-09-12T22:31:59.096704+0000","last_became_active":"2024-09-12T22:31:57.100396+0000","last_became_peered":"2024-09-12T22:31:57.100396+0000","last_unstale":"2024-09-12T22:31:59.096704+0000","last_undegraded":"2024-09-12T22:31:59.096704+0000","last_fullsized":"2024-09-12T22:31:59.096704+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:47:33.283161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.161445+0000","last_change":"2024-09-12T22:31:37.419916+0000","last_active":"2024-09-12T22:31:59.161445+0000","last_peered":"2024-09-12T22:31:59.161445+0000","last_clean":"2024-09-12T22:31:59.161445+0000","last_became_active":"2024-09-12T22:31:37.418790+0000","last_became_peered":"2024-09-12T22:31:37.418790+0000","last_unstale":"2024-09-12T22:31:59.161445+0000","last_undegraded":"2024-09-12T22:31:59.161445+0000","last_fullsized":"2024-09-12T22:31:59.161445+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:05:00.440878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.161123+0000","last_change":"2024-09-12T22:31:37.413094+0000","last_active":"2024-09-12T22:31:59.161123+0000","last_peered":"2024-09-12T22:31:59.161123+0000","last_clean":"2024-09-12T22:31:59.161123+0000","last_became_active":"2024-09-12T22:31:37.412746+0000","last_became_peered":"2024-09-12T22:31:37.412746+0000","last_unstale":"2024-09-12T22:31:59.161123+0000","last_undegraded":"2024-09-12T22:31:59.161123+0000","last_fullsized":"2024-09-12T22:31:59.161123+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:32:14.415120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096642+0000","last_change":"2024-09-12T22:31:37.411276+0000","last_active":"2024-09-12T22:31:59.096642+0000","last_peered":"2024-09-12T22:31:59.096642+0000","last_clean":"2024-09-12T22:31:59.096642+0000","last_became_active":"2024-09-12T22:31:37.410380+0000","last_became_peered":"2024-09-12T22:31:37.410380+0000","last_unstale":"2024-09-12T22:31:59.096642+0000","last_undegraded":"2024-09-12T22:31:59.096642+0000","last_fullsized":"2024-09-12T22:31:59.096642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:12:50.090880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.160788+0000","last_change":"2024-09-12T22:31:37.409177+0000","last_active":"2024-09-12T22:31:59.160788+0000","last_peered":"2024-09-12T22:31:59.160788+0000","last_clean":"2024-09-12T22:31:59.160788+0000","last_became_active":"2024-09-12T22:31:37.408811+0000","last_became_peered":"2024-09-12T22:31:37.408811+0000","last_unstale":"2024-09-12T22:31:59.160788+0000","last_undegraded":"2024-09-12T22:31:59.160788+0000","last_fullsized":"2024-09-12T22:31:59.160788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:17:21.695079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.160866+0000","last_change":"2024-09-12T22:31:37.413023+0000","last_active":"2024-09-12T22:31:59.160866+0000","last_peered":"2024-09-12T22:31:59.160866+0000","last_clean":"2024-09-12T22:31:59.160866+0000","last_became_active":"2024-09-12T22:31:37.412691+0000","last_became_peered":"2024-09-12T22:31:37.412691+0000","last_unstale":"2024-09-12T22:31:59.160866+0000","last_undegraded":"2024-09-12T22:31:59.160866+0000","last_fullsized":"2024-09-12T22:31:59.160866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:02:36.454134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.160571+0000","last_change":"2024-09-12T22:31:37.411074+0000","last_active":"2024-09-12T22:31:59.160571+0000","last_peered":"2024-09-12T22:31:59.160571+0000","last_clean":"2024-09-12T22:31:59.160571+0000","last_became_active":"2024-09-12T22:31:37.410633+0000","last_became_peered":"2024-09-12T22:31:37.410633+0000","last_unstale":"2024-09-12T22:31:59.160571+0000","last_undegraded":"2024-09-12T22:31:59.160571+0000","last_fullsized":"2024-09-12T22:31:59.160571+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:39:20.383152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096571+0000","last_change":"2024-09-12T22:31:37.417800+0000","last_active":"2024-09-12T22:31:59.096571+0000","last_peered":"2024-09-12T22:31:59.096571+0000","last_clean":"2024-09-12T22:31:59.096571+0000","last_became_active":"2024-09-12T22:31:37.417355+0000","last_became_peered":"2024-09-12T22:31:37.417355+0000","last_unstale":"2024-09-12T22:31:59.096571+0000","last_undegraded":"2024-09-12T22:31:59.096571+0000","last_fullsized":"2024-09-12T22:31:59.096571+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:10:17.326263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096926+0000","last_change":"2024-09-12T22:31:37.415967+0000","last_active":"2024-09-12T22:31:59.096926+0000","last_peered":"2024-09-12T22:31:59.096926+0000","last_clean":"2024-09-12T22:31:59.096926+0000","last_became_active":"2024-09-12T22:31:37.415003+0000","last_became_peered":"2024-09-12T22:31:37.415003+0000","last_unstale":"2024-09-12T22:31:59.096926+0000","last_undegraded":"2024-09-12T22:31:59.096926+0000","last_fullsized":"2024-09-12T22:31:59.096926+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:42:32.307876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.161538+0000","last_change":"2024-09-12T22:31:37.414469+0000","last_active":"2024-09-12T22:31:59.161538+0000","last_peered":"2024-09-12T22:31:59.161538+0000","last_clean":"2024-09-12T22:31:59.161538+0000","last_became_active":"2024-09-12T22:31:37.414165+0000","last_became_peered":"2024-09-12T22:31:37.414165+0000","last_unstale":"2024-09-12T22:31:59.161538+0000","last_undegraded":"2024-09-12T22:31:59.161538+0000","last_fullsized":"2024-09-12T22:31:59.161538+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:25:38.148636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.160907+0000","last_change":"2024-09-12T22:31:57.100971+0000","last_active":"2024-09-12T22:31:59.160907+0000","last_peered":"2024-09-12T22:31:59.160907+0000","last_clean":"2024-09-12T22:31:59.160907+0000","last_became_active":"2024-09-12T22:31:57.100610+0000","last_became_peered":"2024-09-12T22:31:57.100610+0000","last_unstale":"2024-09-12T22:31:59.160907+0000","last_undegraded":"2024-09-12T22:31:59.160907+0000","last_fullsized":"2024-09-12T22:31:59.160907+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:07:30.449320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096340+0000","last_change":"2024-09-12T22:31:57.092903+0000","last_active":"2024-09-12T22:31:59.096340+0000","last_peered":"2024-09-12T22:31:59.096340+0000","last_clean":"2024-09-12T22:31:59.096340+0000","last_became_active":"2024-09-12T22:31:57.092579+0000","last_became_peered":"2024-09-12T22:31:57.092579+0000","last_unstale":"2024-09-12T22:31:59.096340+0000","last_undegraded":"2024-09-12T22:31:59.096340+0000","last_fullsized":"2024-09-12T22:31:59.096340+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:54:35.308603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.160899+0000","last_change":"2024-09-12T22:31:37.414084+0000","last_active":"2024-09-12T22:31:59.160899+0000","last_peered":"2024-09-12T22:31:59.160899+0000","last_clean":"2024-09-12T22:31:59.160899+0000","last_became_active":"2024-09-12T22:31:37.413671+0000","last_became_peered":"2024-09-12T22:31:37.413671+0000","last_unstale":"2024-09-12T22:31:59.160899+0000","last_undegraded":"2024-09-12T22:31:59.160899+0000","last_fullsized":"2024-09-12T22:31:59.160899+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:08:29.199832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.160875+0000","last_change":"2024-09-12T22:31:37.413482+0000","last_active":"2024-09-12T22:31:59.160875+0000","last_peered":"2024-09-12T22:31:59.160875+0000","last_clean":"2024-09-12T22:31:59.160875+0000","last_became_active":"2024-09-12T22:31:37.413195+0000","last_became_peered":"2024-09-12T22:31:37.413195+0000","last_unstale":"2024-09-12T22:31:59.160875+0000","last_undegraded":"2024-09-12T22:31:59.160875+0000","last_fullsized":"2024-09-12T22:31:59.160875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:22:40.226076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.160644+0000","last_change":"2024-09-12T22:31:37.411006+0000","last_active":"2024-09-12T22:31:59.160644+0000","last_peered":"2024-09-12T22:31:59.160644+0000","last_clean":"2024-09-12T22:31:59.160644+0000","last_became_active":"2024-09-12T22:31:37.410557+0000","last_became_peered":"2024-09-12T22:31:37.410557+0000","last_unstale":"2024-09-12T22:31:59.160644+0000","last_undegraded":"2024-09-12T22:31:59.160644+0000","last_fullsized":"2024-09-12T22:31:59.160644+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:08:21.709770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096887+0000","last_change":"2024-09-12T22:31:37.412450+0000","last_active":"2024-09-12T22:31:59.096887+0000","last_peered":"2024-09-12T22:31:59.096887+0000","last_clean":"2024-09-12T22:31:59.096887+0000","last_became_active":"2024-09-12T22:31:37.412234+0000","last_became_peered":"2024-09-12T22:31:37.412234+0000","last_unstale":"2024-09-12T22:31:59.096887+0000","last_undegraded":"2024-09-12T22:31:59.096887+0000","last_fullsized":"2024-09-12T22:31:59.096887+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:15:59.559809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096982+0000","last_change":"2024-09-12T22:31:57.100568+0000","last_active":"2024-09-12T22:31:59.096982+0000","last_peered":"2024-09-12T22:31:59.096982+0000","last_clean":"2024-09-12T22:31:59.096982+0000","last_became_active":"2024-09-12T22:31:57.100330+0000","last_became_peered":"2024-09-12T22:31:57.100330+0000","last_unstale":"2024-09-12T22:31:59.096982+0000","last_undegraded":"2024-09-12T22:31:59.096982+0000","last_fullsized":"2024-09-12T22:31:59.096982+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:57:20.571864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096625+0000","last_change":"2024-09-12T22:31:37.417442+0000","last_active":"2024-09-12T22:31:59.096625+0000","last_peered":"2024-09-12T22:31:59.096625+0000","last_clean":"2024-09-12T22:31:59.096625+0000","last_became_active":"2024-09-12T22:31:37.417133+0000","last_became_peered":"2024-09-12T22:31:37.417133+0000","last_unstale":"2024-09-12T22:31:59.096625+0000","last_undegraded":"2024-09-12T22:31:59.096625+0000","last_fullsized":"2024-09-12T22:31:59.096625+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:36.458145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.161235+0000","last_change":"2024-09-12T22:31:37.414235+0000","last_active":"2024-09-12T22:31:59.161235+0000","last_peered":"2024-09-12T22:31:59.161235+0000","last_clean":"2024-09-12T22:31:59.161235+0000","last_became_active":"2024-09-12T22:31:37.413786+0000","last_became_peered":"2024-09-12T22:31:37.413786+0000","last_unstale":"2024-09-12T22:31:59.161235+0000","last_undegraded":"2024-09-12T22:31:59.161235+0000","last_fullsized":"2024-09-12T22:31:59.161235+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:21:11.866973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.161553+0000","last_change":"2024-09-12T22:31:37.415382+0000","last_active":"2024-09-12T22:31:59.161553+0000","last_peered":"2024-09-12T22:31:59.161553+0000","last_clean":"2024-09-12T22:31:59.161553+0000","last_became_active":"2024-09-12T22:31:37.414319+0000","last_became_peered":"2024-09-12T22:31:37.414319+0000","last_unstale":"2024-09-12T22:31:59.161553+0000","last_undegraded":"2024-09-12T22:31:59.161553+0000","last_fullsized":"2024-09-12T22:31:59.161553+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:26:25.578693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096442+0000","last_change":"2024-09-12T22:31:37.412046+0000","last_active":"2024-09-12T22:31:59.096442+0000","last_peered":"2024-09-12T22:31:59.096442+0000","last_clean":"2024-09-12T22:31:59.096442+0000","last_became_active":"2024-09-12T22:31:37.411623+0000","last_became_peered":"2024-09-12T22:31:37.411623+0000","last_unstale":"2024-09-12T22:31:59.096442+0000","last_undegraded":"2024-09-12T22:31:59.096442+0000","last_fullsized":"2024-09-12T22:31:59.096442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:24:15.504358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.095992+0000","last_change":"2024-09-12T22:31:37.410364+0000","last_active":"2024-09-12T22:31:59.095992+0000","last_peered":"2024-09-12T22:31:59.095992+0000","last_clean":"2024-09-12T22:31:59.095992+0000","last_became_active":"2024-09-12T22:31:37.409951+0000","last_became_peered":"2024-09-12T22:31:37.409951+0000","last_unstale":"2024-09-12T22:31:59.095992+0000","last_undegraded":"2024-09-12T22:31:59.095992+0000","last_fullsized":"2024-09-12T22:31:59.095992+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:39:17.785755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.095997+0000","last_change":"2024-09-12T22:31:57.092823+0000","last_active":"2024-09-12T22:31:59.095997+0000","last_peered":"2024-09-12T22:31:59.095997+0000","last_clean":"2024-09-12T22:31:59.095997+0000","last_became_active":"2024-09-12T22:31:57.092557+0000","last_became_peered":"2024-09-12T22:31:57.092557+0000","last_unstale":"2024-09-12T22:31:59.095997+0000","last_undegraded":"2024-09-12T22:31:59.095997+0000","last_fullsized":"2024-09-12T22:31:59.095997+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:30:13.033427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.097103+0000","last_change":"2024-09-12T22:31:37.415309+0000","last_active":"2024-09-12T22:31:59.097103+0000","last_peered":"2024-09-12T22:31:59.097103+0000","last_clean":"2024-09-12T22:31:59.097103+0000","last_became_active":"2024-09-12T22:31:37.414792+0000","last_became_peered":"2024-09-12T22:31:37.414792+0000","last_unstale":"2024-09-12T22:31:59.097103+0000","last_undegraded":"2024-09-12T22:31:59.097103+0000","last_fullsized":"2024-09-12T22:31:59.097103+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:08:07.115355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096810+0000","last_change":"2024-09-12T22:31:37.411880+0000","last_active":"2024-09-12T22:31:59.096810+0000","last_peered":"2024-09-12T22:31:59.096810+0000","last_clean":"2024-09-12T22:31:59.096810+0000","last_became_active":"2024-09-12T22:31:37.410563+0000","last_became_peered":"2024-09-12T22:31:37.410563+0000","last_unstale":"2024-09-12T22:31:59.096810+0000","last_undegraded":"2024-09-12T22:31:59.096810+0000","last_fullsized":"2024-09-12T22:31:59.096810+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:47:52.560533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.161624+0000","last_change":"2024-09-12T22:31:37.419603+0000","last_active":"2024-09-12T22:31:59.161624+0000","last_peered":"2024-09-12T22:31:59.161624+0000","last_clean":"2024-09-12T22:31:59.161624+0000","last_became_active":"2024-09-12T22:31:37.418725+0000","last_became_peered":"2024-09-12T22:31:37.418725+0000","last_unstale":"2024-09-12T22:31:59.161624+0000","last_undegraded":"2024-09-12T22:31:59.161624+0000","last_fullsized":"2024-09-12T22:31:59.161624+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:02:44.183545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.161010+0000","last_change":"2024-09-12T22:31:57.100810+0000","last_active":"2024-09-12T22:31:59.161010+0000","last_peered":"2024-09-12T22:31:59.161010+0000","last_clean":"2024-09-12T22:31:59.161010+0000","last_became_active":"2024-09-12T22:31:57.100516+0000","last_became_peered":"2024-09-12T22:31:57.100516+0000","last_unstale":"2024-09-12T22:31:59.161010+0000","last_undegraded":"2024-09-12T22:31:59.161010+0000","last_fullsized":"2024-09-12T22:31:59.161010+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:21:45.140557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096420+0000","last_change":"2024-09-12T22:31:37.414918+0000","last_active":"2024-09-12T22:31:59.096420+0000","last_peered":"2024-09-12T22:31:59.096420+0000","last_clean":"2024-09-12T22:31:59.096420+0000","last_became_active":"2024-09-12T22:31:37.414225+0000","last_became_peered":"2024-09-12T22:31:37.414225+0000","last_unstale":"2024-09-12T22:31:59.096420+0000","last_undegraded":"2024-09-12T22:31:59.096420+0000","last_fullsized":"2024-09-12T22:31:59.096420+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:56:14.649228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096588+0000","last_change":"2024-09-12T22:31:37.411569+0000","last_active":"2024-09-12T22:31:59.096588+0000","last_peered":"2024-09-12T22:31:59.096588+0000","last_clean":"2024-09-12T22:31:59.096588+0000","last_became_active":"2024-09-12T22:31:37.410619+0000","last_became_peered":"2024-09-12T22:31:37.410619+0000","last_unstale":"2024-09-12T22:31:59.096588+0000","last_undegraded":"2024-09-12T22:31:59.096588+0000","last_fullsized":"2024-09-12T22:31:59.096588+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:30:01.012271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096050+0000","last_change":"2024-09-12T22:31:37.415589+0000","last_active":"2024-09-12T22:31:59.096050+0000","last_peered":"2024-09-12T22:31:59.096050+0000","last_clean":"2024-09-12T22:31:59.096050+0000","last_became_active":"2024-09-12T22:31:37.415285+0000","last_became_peered":"2024-09-12T22:31:37.415285+0000","last_unstale":"2024-09-12T22:31:59.096050+0000","last_undegraded":"2024-09-12T22:31:59.096050+0000","last_fullsized":"2024-09-12T22:31:59.096050+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:06:25.913810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.160650+0000","last_change":"2024-09-12T22:31:37.415190+0000","last_active":"2024-09-12T22:31:59.160650+0000","last_peered":"2024-09-12T22:31:59.160650+0000","last_clean":"2024-09-12T22:31:59.160650+0000","last_became_active":"2024-09-12T22:31:37.414265+0000","last_became_peered":"2024-09-12T22:31:37.414265+0000","last_unstale":"2024-09-12T22:31:59.160650+0000","last_undegraded":"2024-09-12T22:31:59.160650+0000","last_fullsized":"2024-09-12T22:31:59.160650+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:07:02.173590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096563+0000","last_change":"2024-09-12T22:31:57.100582+0000","last_active":"2024-09-12T22:31:59.096563+0000","last_peered":"2024-09-12T22:31:59.096563+0000","last_clean":"2024-09-12T22:31:59.096563+0000","last_became_active":"2024-09-12T22:31:57.100321+0000","last_became_peered":"2024-09-12T22:31:57.100321+0000","last_unstale":"2024-09-12T22:31:59.096563+0000","last_undegraded":"2024-09-12T22:31:59.096563+0000","last_fullsized":"2024-09-12T22:31:59.096563+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:59:36.843984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.161609+0000","last_change":"2024-09-12T22:31:36.412082+0000","last_active":"2024-09-12T22:31:59.161609+0000","last_peered":"2024-09-12T22:31:59.161609+0000","last_clean":"2024-09-12T22:31:59.161609+0000","last_became_active":"2024-09-12T22:31:36.410871+0000","last_became_peered":"2024-09-12T22:31:36.410871+0000","last_unstale":"2024-09-12T22:31:59.161609+0000","last_undegraded":"2024-09-12T22:31:59.161609+0000","last_fullsized":"2024-09-12T22:31:59.161609+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:30:49.127253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096903+0000","last_change":"2024-09-12T22:31:37.411790+0000","last_active":"2024-09-12T22:31:59.096903+0000","last_peered":"2024-09-12T22:31:59.096903+0000","last_clean":"2024-09-12T22:31:59.096903+0000","last_became_active":"2024-09-12T22:31:37.411414+0000","last_became_peered":"2024-09-12T22:31:37.411414+0000","last_unstale":"2024-09-12T22:31:59.096903+0000","last_undegraded":"2024-09-12T22:31:59.096903+0000","last_fullsized":"2024-09-12T22:31:59.096903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:22:40.226076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096358+0000","last_change":"2024-09-12T22:31:36.408563+0000","last_active":"2024-09-12T22:31:59.096358+0000","last_peered":"2024-09-12T22:31:59.096358+0000","last_clean":"2024-09-12T22:31:59.096358+0000","last_became_active":"2024-09-12T22:31:36.407447+0000","last_became_peered":"2024-09-12T22:31:36.407447+0000","last_unstale":"2024-09-12T22:31:59.096358+0000","last_undegraded":"2024-09-12T22:31:59.096358+0000","last_fullsized":"2024-09-12T22:31:59.096358+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:29:37.933109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.097034+0000","last_change":"2024-09-12T22:31:37.411680+0000","last_active":"2024-09-12T22:31:59.097034+0000","last_peered":"2024-09-12T22:31:59.097034+0000","last_clean":"2024-09-12T22:31:59.097034+0000","last_became_active":"2024-09-12T22:31:37.411168+0000","last_became_peered":"2024-09-12T22:31:37.411168+0000","last_unstale":"2024-09-12T22:31:59.097034+0000","last_undegraded":"2024-09-12T22:31:59.097034+0000","last_fullsized":"2024-09-12T22:31:59.097034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:27.706282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096377+0000","last_change":"2024-09-12T22:31:36.411271+0000","last_active":"2024-09-12T22:31:59.096377+0000","last_peered":"2024-09-12T22:31:59.096377+0000","last_clean":"2024-09-12T22:31:59.096377+0000","last_became_active":"2024-09-12T22:31:36.410706+0000","last_became_peered":"2024-09-12T22:31:36.410706+0000","last_unstale":"2024-09-12T22:31:59.096377+0000","last_undegraded":"2024-09-12T22:31:59.096377+0000","last_fullsized":"2024-09-12T22:31:59.096377+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:43:22.805855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096623+0000","last_change":"2024-09-12T22:31:37.411218+0000","last_active":"2024-09-12T22:31:59.096623+0000","last_peered":"2024-09-12T22:31:59.096623+0000","last_clean":"2024-09-12T22:31:59.096623+0000","last_became_active":"2024-09-12T22:31:37.409666+0000","last_became_peered":"2024-09-12T22:31:37.409666+0000","last_unstale":"2024-09-12T22:31:59.096623+0000","last_undegraded":"2024-09-12T22:31:59.096623+0000","last_fullsized":"2024-09-12T22:31:59.096623+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:45:34.230090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"19'8","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.160739+0000","last_change":"2024-09-12T22:31:36.411811+0000","last_active":"2024-09-12T22:31:59.160739+0000","last_peered":"2024-09-12T22:31:59.160739+0000","last_clean":"2024-09-12T22:31:59.160739+0000","last_became_active":"2024-09-12T22:31:36.410101+0000","last_became_peered":"2024-09-12T22:31:36.410101+0000","last_unstale":"2024-09-12T22:31:59.160739+0000","last_undegraded":"2024-09-12T22:31:59.160739+0000","last_fullsized":"2024-09-12T22:31:59.160739+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:33:02.410148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.161418+0000","last_change":"2024-09-12T22:31:36.410970+0000","last_active":"2024-09-12T22:31:59.161418+0000","last_peered":"2024-09-12T22:31:59.161418+0000","last_clean":"2024-09-12T22:31:59.161418+0000","last_became_active":"2024-09-12T22:31:36.409754+0000","last_became_peered":"2024-09-12T22:31:36.409754+0000","last_unstale":"2024-09-12T22:31:59.161418+0000","last_undegraded":"2024-09-12T22:31:59.161418+0000","last_fullsized":"2024-09-12T22:31:59.161418+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:30:07.724418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096288+0000","last_change":"2024-09-12T22:31:37.415050+0000","last_active":"2024-09-12T22:31:59.096288+0000","last_peered":"2024-09-12T22:31:59.096288+0000","last_clean":"2024-09-12T22:31:59.096288+0000","last_became_active":"2024-09-12T22:31:37.414290+0000","last_became_peered":"2024-09-12T22:31:37.414290+0000","last_unstale":"2024-09-12T22:31:59.096288+0000","last_undegraded":"2024-09-12T22:31:59.096288+0000","last_fullsized":"2024-09-12T22:31:59.096288+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:47:15.502575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.097101+0000","last_change":"2024-09-12T22:31:36.411725+0000","last_active":"2024-09-12T22:31:59.097101+0000","last_peered":"2024-09-12T22:31:59.097101+0000","last_clean":"2024-09-12T22:31:59.097101+0000","last_became_active":"2024-09-12T22:31:36.411407+0000","last_became_peered":"2024-09-12T22:31:36.411407+0000","last_unstale":"2024-09-12T22:31:59.097101+0000","last_undegraded":"2024-09-12T22:31:59.097101+0000","last_fullsized":"2024-09-12T22:31:59.097101+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:30:07.724418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096179+0000","last_change":"2024-09-12T22:31:57.092727+0000","last_active":"2024-09-12T22:31:59.096179+0000","last_peered":"2024-09-12T22:31:59.096179+0000","last_clean":"2024-09-12T22:31:59.096179+0000","last_became_active":"2024-09-12T22:31:57.092446+0000","last_became_peered":"2024-09-12T22:31:57.092446+0000","last_unstale":"2024-09-12T22:31:59.096179+0000","last_undegraded":"2024-09-12T22:31:59.096179+0000","last_fullsized":"2024-09-12T22:31:59.096179+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:09:14.524447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.161803+0000","last_change":"2024-09-12T22:31:36.411320+0000","last_active":"2024-09-12T22:31:59.161803+0000","last_peered":"2024-09-12T22:31:59.161803+0000","last_clean":"2024-09-12T22:31:59.161803+0000","last_became_active":"2024-09-12T22:31:36.409837+0000","last_became_peered":"2024-09-12T22:31:36.409837+0000","last_unstale":"2024-09-12T22:31:59.161803+0000","last_undegraded":"2024-09-12T22:31:59.161803+0000","last_fullsized":"2024-09-12T22:31:59.161803+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:36:53.914922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.160903+0000","last_change":"2024-09-12T22:31:37.414809+0000","last_active":"2024-09-12T22:31:59.160903+0000","last_peered":"2024-09-12T22:31:59.160903+0000","last_clean":"2024-09-12T22:31:59.160903+0000","last_became_active":"2024-09-12T22:31:37.414492+0000","last_became_peered":"2024-09-12T22:31:37.414492+0000","last_unstale":"2024-09-12T22:31:59.160903+0000","last_undegraded":"2024-09-12T22:31:59.160903+0000","last_fullsized":"2024-09-12T22:31:59.160903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:50:48.426898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.161505+0000","last_change":"2024-09-12T22:31:36.412068+0000","last_active":"2024-09-12T22:31:59.161505+0000","last_peered":"2024-09-12T22:31:59.161505+0000","last_clean":"2024-09-12T22:31:59.161505+0000","last_became_active":"2024-09-12T22:31:36.411366+0000","last_became_peered":"2024-09-12T22:31:36.411366+0000","last_unstale":"2024-09-12T22:31:59.161505+0000","last_undegraded":"2024-09-12T22:31:59.161505+0000","last_fullsized":"2024-09-12T22:31:59.161505+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:35:51.647051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096537+0000","last_change":"2024-09-12T22:31:37.410303+0000","last_active":"2024-09-12T22:31:59.096537+0000","last_peered":"2024-09-12T22:31:59.096537+0000","last_clean":"2024-09-12T22:31:59.096537+0000","last_became_active":"2024-09-12T22:31:37.409607+0000","last_became_peered":"2024-09-12T22:31:37.409607+0000","last_unstale":"2024-09-12T22:31:59.096537+0000","last_undegraded":"2024-09-12T22:31:59.096537+0000","last_fullsized":"2024-09-12T22:31:59.096537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:53:42.732654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096646+0000","last_change":"2024-09-12T22:31:36.407974+0000","last_active":"2024-09-12T22:31:59.096646+0000","last_peered":"2024-09-12T22:31:59.096646+0000","last_clean":"2024-09-12T22:31:59.096646+0000","last_became_active":"2024-09-12T22:31:36.406955+0000","last_became_peered":"2024-09-12T22:31:36.406955+0000","last_unstale":"2024-09-12T22:31:59.096646+0000","last_undegraded":"2024-09-12T22:31:59.096646+0000","last_fullsized":"2024-09-12T22:31:59.096646+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:07:34.831264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.161238+0000","last_change":"2024-09-12T22:31:37.415285+0000","last_active":"2024-09-12T22:31:59.161238+0000","last_peered":"2024-09-12T22:31:59.161238+0000","last_clean":"2024-09-12T22:31:59.161238+0000","last_became_active":"2024-09-12T22:31:37.414890+0000","last_became_peered":"2024-09-12T22:31:37.414890+0000","last_unstale":"2024-09-12T22:31:59.161238+0000","last_undegraded":"2024-09-12T22:31:59.161238+0000","last_fullsized":"2024-09-12T22:31:59.161238+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:38:16.956786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.161083+0000","last_change":"2024-09-12T22:31:36.412147+0000","last_active":"2024-09-12T22:31:59.161083+0000","last_peered":"2024-09-12T22:31:59.161083+0000","last_clean":"2024-09-12T22:31:59.161083+0000","last_became_active":"2024-09-12T22:31:36.411382+0000","last_became_peered":"2024-09-12T22:31:36.411382+0000","last_unstale":"2024-09-12T22:31:59.161083+0000","last_undegraded":"2024-09-12T22:31:59.161083+0000","last_fullsized":"2024-09-12T22:31:59.161083+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:54:51.454867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.161714+0000","last_change":"2024-09-12T22:31:37.420209+0000","last_active":"2024-09-12T22:31:59.161714+0000","last_peered":"2024-09-12T22:31:59.161714+0000","last_clean":"2024-09-12T22:31:59.161714+0000","last_became_active":"2024-09-12T22:31:37.419267+0000","last_became_peered":"2024-09-12T22:31:37.419267+0000","last_unstale":"2024-09-12T22:31:59.161714+0000","last_undegraded":"2024-09-12T22:31:59.161714+0000","last_fullsized":"2024-09-12T22:31:59.161714+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:36.790111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096451+0000","last_change":"2024-09-12T22:31:36.411190+0000","last_active":"2024-09-12T22:31:59.096451+0000","last_peered":"2024-09-12T22:31:59.096451+0000","last_clean":"2024-09-12T22:31:59.096451+0000","last_became_active":"2024-09-12T22:31:36.410548+0000","last_became_peered":"2024-09-12T22:31:36.410548+0000","last_unstale":"2024-09-12T22:31:59.096451+0000","last_undegraded":"2024-09-12T22:31:59.096451+0000","last_fullsized":"2024-09-12T22:31:59.096451+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:10:20.300894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.161297+0000","last_change":"2024-09-12T22:31:37.418749+0000","last_active":"2024-09-12T22:31:59.161297+0000","last_peered":"2024-09-12T22:31:59.161297+0000","last_clean":"2024-09-12T22:31:59.161297+0000","last_became_active":"2024-09-12T22:31:37.418360+0000","last_became_peered":"2024-09-12T22:31:37.418360+0000","last_unstale":"2024-09-12T22:31:59.161297+0000","last_undegraded":"2024-09-12T22:31:59.161297+0000","last_fullsized":"2024-09-12T22:31:59.161297+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:50:08.152699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096343+0000","last_change":"2024-09-12T22:31:36.412187+0000","last_active":"2024-09-12T22:31:59.096343+0000","last_peered":"2024-09-12T22:31:59.096343+0000","last_clean":"2024-09-12T22:31:59.096343+0000","last_became_active":"2024-09-12T22:31:36.411935+0000","last_became_peered":"2024-09-12T22:31:36.411935+0000","last_unstale":"2024-09-12T22:31:59.096343+0000","last_undegraded":"2024-09-12T22:31:59.096343+0000","last_fullsized":"2024-09-12T22:31:59.096343+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:41:04.029445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096677+0000","last_change":"2024-09-12T22:31:37.417881+0000","last_active":"2024-09-12T22:31:59.096677+0000","last_peered":"2024-09-12T22:31:59.096677+0000","last_clean":"2024-09-12T22:31:59.096677+0000","last_became_active":"2024-09-12T22:31:37.417572+0000","last_became_peered":"2024-09-12T22:31:37.417572+0000","last_unstale":"2024-09-12T22:31:59.096677+0000","last_undegraded":"2024-09-12T22:31:59.096677+0000","last_fullsized":"2024-09-12T22:31:59.096677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:19:16.367589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":232,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.161233+0000","last_change":"2024-09-12T22:31:27.631847+0000","last_active":"2024-09-12T22:31:59.161233+0000","last_peered":"2024-09-12T22:31:59.161233+0000","last_clean":"2024-09-12T22:31:59.161233+0000","last_became_active":"2024-09-12T22:31:27.631027+0000","last_became_peered":"2024-09-12T22:31:27.631027+0000","last_unstale":"2024-09-12T22:31:59.161233+0000","last_undegraded":"2024-09-12T22:31:59.161233+0000","last_fullsized":"2024-09-12T22:31:59.161233+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:26.229539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:26.229539+0000","last_clean_scrub_stamp":"2024-09-12T22:31:26.229539+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:59:24.181319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":36,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.161664+0000","last_change":"2024-09-12T22:31:34.286952+0000","last_active":"2024-09-12T22:31:59.161664+0000","last_peered":"2024-09-12T22:31:59.161664+0000","last_clean":"2024-09-12T22:31:59.161664+0000","last_became_active":"2024-09-12T22:31:32.283661+0000","last_became_peered":"2024-09-12T22:31:32.283661+0000","last_unstale":"2024-09-12T22:31:59.161664+0000","last_undegraded":"2024-09-12T22:31:59.161664+0000","last_fullsized":"2024-09-12T22:31:59.161664+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:21.681390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000621274,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096463+0000","last_change":"2024-09-12T22:31:36.411275+0000","last_active":"2024-09-12T22:31:59.096463+0000","last_peered":"2024-09-12T22:31:59.096463+0000","last_clean":"2024-09-12T22:31:59.096463+0000","last_became_active":"2024-09-12T22:31:36.410595+0000","last_became_peered":"2024-09-12T22:31:36.410595+0000","last_unstale":"2024-09-12T22:31:59.096463+0000","last_undegraded":"2024-09-12T22:31:59.096463+0000","last_fullsized":"2024-09-12T22:31:59.096463+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:38:14.895625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.161803+0000","last_change":"2024-09-12T22:31:37.419976+0000","last_active":"2024-09-12T22:31:59.161803+0000","last_peered":"2024-09-12T22:31:59.161803+0000","last_clean":"2024-09-12T22:31:59.161803+0000","last_became_active":"2024-09-12T22:31:37.419161+0000","last_became_peered":"2024-09-12T22:31:37.419161+0000","last_unstale":"2024-09-12T22:31:59.161803+0000","last_undegraded":"2024-09-12T22:31:59.161803+0000","last_fullsized":"2024-09-12T22:31:59.161803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:07:26.070097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":35,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.161322+0000","last_change":"2024-09-12T22:31:34.286642+0000","last_active":"2024-09-12T22:31:59.161322+0000","last_peered":"2024-09-12T22:31:59.161322+0000","last_clean":"2024-09-12T22:31:59.161322+0000","last_became_active":"2024-09-12T22:31:32.283601+0000","last_became_peered":"2024-09-12T22:31:32.283601+0000","last_unstale":"2024-09-12T22:31:59.161322+0000","last_undegraded":"2024-09-12T22:31:59.161322+0000","last_fullsized":"2024-09-12T22:31:59.161322+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:40:06.769540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037858999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096228+0000","last_change":"2024-09-12T22:31:36.407395+0000","last_active":"2024-09-12T22:31:59.096228+0000","last_peered":"2024-09-12T22:31:59.096228+0000","last_clean":"2024-09-12T22:31:59.096228+0000","last_became_active":"2024-09-12T22:31:36.406770+0000","last_became_peered":"2024-09-12T22:31:36.406770+0000","last_unstale":"2024-09-12T22:31:59.096228+0000","last_undegraded":"2024-09-12T22:31:59.096228+0000","last_fullsized":"2024-09-12T22:31:59.096228+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:49:26.547848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096930+0000","last_change":"2024-09-12T22:31:37.414075+0000","last_active":"2024-09-12T22:31:59.096930+0000","last_peered":"2024-09-12T22:31:59.096930+0000","last_clean":"2024-09-12T22:31:59.096930+0000","last_became_active":"2024-09-12T22:31:37.413491+0000","last_became_peered":"2024-09-12T22:31:37.413491+0000","last_unstale":"2024-09-12T22:31:59.096930+0000","last_undegraded":"2024-09-12T22:31:59.096930+0000","last_fullsized":"2024-09-12T22:31:59.096930+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:26:25.578693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":35,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096337+0000","last_change":"2024-09-12T22:31:34.286394+0000","last_active":"2024-09-12T22:31:59.096337+0000","last_peered":"2024-09-12T22:31:59.096337+0000","last_clean":"2024-09-12T22:31:59.096337+0000","last_became_active":"2024-09-12T22:31:32.280062+0000","last_became_peered":"2024-09-12T22:31:32.280062+0000","last_unstale":"2024-09-12T22:31:59.096337+0000","last_undegraded":"2024-09-12T22:31:59.096337+0000","last_fullsized":"2024-09-12T22:31:59.096337+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:20:23.663838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039540700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.160527+0000","last_change":"2024-09-12T22:31:57.100816+0000","last_active":"2024-09-12T22:31:59.160527+0000","last_peered":"2024-09-12T22:31:59.160527+0000","last_clean":"2024-09-12T22:31:59.160527+0000","last_became_active":"2024-09-12T22:31:57.100392+0000","last_became_peered":"2024-09-12T22:31:57.100392+0000","last_unstale":"2024-09-12T22:31:59.160527+0000","last_undegraded":"2024-09-12T22:31:59.160527+0000","last_fullsized":"2024-09-12T22:31:59.160527+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:06:12.881182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096778+0000","last_change":"2024-09-12T22:31:37.417636+0000","last_active":"2024-09-12T22:31:59.096778+0000","last_peered":"2024-09-12T22:31:59.096778+0000","last_clean":"2024-09-12T22:31:59.096778+0000","last_became_active":"2024-09-12T22:31:37.417230+0000","last_became_peered":"2024-09-12T22:31:37.417230+0000","last_unstale":"2024-09-12T22:31:59.096778+0000","last_undegraded":"2024-09-12T22:31:59.096778+0000","last_fullsized":"2024-09-12T22:31:59.096778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:44:29.729122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":37,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.161131+0000","last_change":"2024-09-12T22:31:34.286938+0000","last_active":"2024-09-12T22:31:59.161131+0000","last_peered":"2024-09-12T22:31:59.161131+0000","last_clean":"2024-09-12T22:31:59.161131+0000","last_became_active":"2024-09-12T22:31:32.282230+0000","last_became_peered":"2024-09-12T22:31:32.282230+0000","last_unstale":"2024-09-12T22:31:59.161131+0000","last_undegraded":"2024-09-12T22:31:59.161131+0000","last_fullsized":"2024-09-12T22:31:59.161131+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:11:05.988384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000615758,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.161627+0000","last_change":"2024-09-12T22:31:36.410694+0000","last_active":"2024-09-12T22:31:59.161627+0000","last_peered":"2024-09-12T22:31:59.161627+0000","last_clean":"2024-09-12T22:31:59.161627+0000","last_became_active":"2024-09-12T22:31:36.409816+0000","last_became_peered":"2024-09-12T22:31:36.409816+0000","last_unstale":"2024-09-12T22:31:59.161627+0000","last_undegraded":"2024-09-12T22:31:59.161627+0000","last_fullsized":"2024-09-12T22:31:59.161627+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:40:35.369213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096688+0000","last_change":"2024-09-12T22:31:37.414608+0000","last_active":"2024-09-12T22:31:59.096688+0000","last_peered":"2024-09-12T22:31:59.096688+0000","last_clean":"2024-09-12T22:31:59.096688+0000","last_became_active":"2024-09-12T22:31:37.414307+0000","last_became_peered":"2024-09-12T22:31:37.414307+0000","last_unstale":"2024-09-12T22:31:59.096688+0000","last_undegraded":"2024-09-12T22:31:59.096688+0000","last_fullsized":"2024-09-12T22:31:59.096688+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:41:21.231511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.161886+0000","last_change":"2024-09-12T22:31:36.411355+0000","last_active":"2024-09-12T22:31:59.161886+0000","last_peered":"2024-09-12T22:31:59.161886+0000","last_clean":"2024-09-12T22:31:59.161886+0000","last_became_active":"2024-09-12T22:31:36.410529+0000","last_became_peered":"2024-09-12T22:31:36.410529+0000","last_unstale":"2024-09-12T22:31:59.161886+0000","last_undegraded":"2024-09-12T22:31:59.161886+0000","last_fullsized":"2024-09-12T22:31:59.161886+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:19:47.356688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":35,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096788+0000","last_change":"2024-09-12T22:31:34.286457+0000","last_active":"2024-09-12T22:31:59.096788+0000","last_peered":"2024-09-12T22:31:59.096788+0000","last_clean":"2024-09-12T22:31:59.096788+0000","last_became_active":"2024-09-12T22:31:32.280007+0000","last_became_peered":"2024-09-12T22:31:32.280007+0000","last_unstale":"2024-09-12T22:31:59.096788+0000","last_undegraded":"2024-09-12T22:31:59.096788+0000","last_fullsized":"2024-09-12T22:31:59.096788+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:09.068038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041972500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096464+0000","last_change":"2024-09-12T22:31:37.410386+0000","last_active":"2024-09-12T22:31:59.096464+0000","last_peered":"2024-09-12T22:31:59.096464+0000","last_clean":"2024-09-12T22:31:59.096464+0000","last_became_active":"2024-09-12T22:31:37.409928+0000","last_became_peered":"2024-09-12T22:31:37.409928+0000","last_unstale":"2024-09-12T22:31:59.096464+0000","last_undegraded":"2024-09-12T22:31:59.096464+0000","last_fullsized":"2024-09-12T22:31:59.096464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:02:36.454134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096725+0000","last_change":"2024-09-12T22:31:36.410324+0000","last_active":"2024-09-12T22:31:59.096725+0000","last_peered":"2024-09-12T22:31:59.096725+0000","last_clean":"2024-09-12T22:31:59.096725+0000","last_became_active":"2024-09-12T22:31:36.409199+0000","last_became_peered":"2024-09-12T22:31:36.409199+0000","last_unstale":"2024-09-12T22:31:59.096725+0000","last_undegraded":"2024-09-12T22:31:59.096725+0000","last_fullsized":"2024-09-12T22:31:59.096725+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:06:54.608936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":35,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.097114+0000","last_change":"2024-09-12T22:31:34.839044+0000","last_active":"2024-09-12T22:31:59.097114+0000","last_peered":"2024-09-12T22:31:59.097114+0000","last_clean":"2024-09-12T22:31:59.097114+0000","last_became_active":"2024-09-12T22:31:32.279671+0000","last_became_peered":"2024-09-12T22:31:32.279671+0000","last_unstale":"2024-09-12T22:31:59.097114+0000","last_undegraded":"2024-09-12T22:31:59.097114+0000","last_fullsized":"2024-09-12T22:31:59.097114+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:27:49.809935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036776499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.161522+0000","last_change":"2024-09-12T22:31:57.100721+0000","last_active":"2024-09-12T22:31:59.161522+0000","last_peered":"2024-09-12T22:31:59.161522+0000","last_clean":"2024-09-12T22:31:59.161522+0000","last_became_active":"2024-09-12T22:31:57.100426+0000","last_became_peered":"2024-09-12T22:31:57.100426+0000","last_unstale":"2024-09-12T22:31:59.161522+0000","last_undegraded":"2024-09-12T22:31:59.161522+0000","last_fullsized":"2024-09-12T22:31:59.161522+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:14:31.890006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096944+0000","last_change":"2024-09-12T22:31:36.409397+0000","last_active":"2024-09-12T22:31:59.096944+0000","last_peered":"2024-09-12T22:31:59.096944+0000","last_clean":"2024-09-12T22:31:59.096944+0000","last_became_active":"2024-09-12T22:31:36.408787+0000","last_became_peered":"2024-09-12T22:31:36.408787+0000","last_unstale":"2024-09-12T22:31:59.096944+0000","last_undegraded":"2024-09-12T22:31:59.096944+0000","last_fullsized":"2024-09-12T22:31:59.096944+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:29:03.467352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":35,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.097079+0000","last_change":"2024-09-12T22:31:34.286639+0000","last_active":"2024-09-12T22:31:59.097079+0000","last_peered":"2024-09-12T22:31:59.097079+0000","last_clean":"2024-09-12T22:31:59.097079+0000","last_became_active":"2024-09-12T22:31:32.280092+0000","last_became_peered":"2024-09-12T22:31:32.280092+0000","last_unstale":"2024-09-12T22:31:59.097079+0000","last_undegraded":"2024-09-12T22:31:59.097079+0000","last_fullsized":"2024-09-12T22:31:59.097079+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:02:40.821530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058589999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096105+0000","last_change":"2024-09-12T22:31:37.411152+0000","last_active":"2024-09-12T22:31:59.096105+0000","last_peered":"2024-09-12T22:31:59.096105+0000","last_clean":"2024-09-12T22:31:59.096105+0000","last_became_active":"2024-09-12T22:31:37.410558+0000","last_became_peered":"2024-09-12T22:31:37.410558+0000","last_unstale":"2024-09-12T22:31:59.096105+0000","last_undegraded":"2024-09-12T22:31:59.096105+0000","last_fullsized":"2024-09-12T22:31:59.096105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:14:29.892478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.097031+0000","last_change":"2024-09-12T22:31:36.407460+0000","last_active":"2024-09-12T22:31:59.097031+0000","last_peered":"2024-09-12T22:31:59.097031+0000","last_clean":"2024-09-12T22:31:59.097031+0000","last_became_active":"2024-09-12T22:31:36.406729+0000","last_became_peered":"2024-09-12T22:31:36.406729+0000","last_unstale":"2024-09-12T22:31:59.097031+0000","last_undegraded":"2024-09-12T22:31:59.097031+0000","last_fullsized":"2024-09-12T22:31:59.097031+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:27:58.012573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":35,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.161521+0000","last_change":"2024-09-12T22:31:34.286699+0000","last_active":"2024-09-12T22:31:59.161521+0000","last_peered":"2024-09-12T22:31:59.161521+0000","last_clean":"2024-09-12T22:31:59.161521+0000","last_became_active":"2024-09-12T22:31:32.283606+0000","last_became_peered":"2024-09-12T22:31:32.283606+0000","last_unstale":"2024-09-12T22:31:59.161521+0000","last_undegraded":"2024-09-12T22:31:59.161521+0000","last_fullsized":"2024-09-12T22:31:59.161521+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:09:32.050798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000382109,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096345+0000","last_change":"2024-09-12T22:31:37.410011+0000","last_active":"2024-09-12T22:31:59.096345+0000","last_peered":"2024-09-12T22:31:59.096345+0000","last_clean":"2024-09-12T22:31:59.096345+0000","last_became_active":"2024-09-12T22:31:37.409320+0000","last_became_peered":"2024-09-12T22:31:37.409320+0000","last_unstale":"2024-09-12T22:31:59.096345+0000","last_undegraded":"2024-09-12T22:31:59.096345+0000","last_fullsized":"2024-09-12T22:31:59.096345+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:27:23.661444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.161245+0000","last_change":"2024-09-12T22:31:37.415670+0000","last_active":"2024-09-12T22:31:59.161245+0000","last_peered":"2024-09-12T22:31:59.161245+0000","last_clean":"2024-09-12T22:31:59.161245+0000","last_became_active":"2024-09-12T22:31:37.415007+0000","last_became_peered":"2024-09-12T22:31:37.415007+0000","last_unstale":"2024-09-12T22:31:59.161245+0000","last_undegraded":"2024-09-12T22:31:59.161245+0000","last_fullsized":"2024-09-12T22:31:59.161245+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:42:51.694128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"23'9","reported_seq":31,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.161390+0000","last_change":"2024-09-12T22:31:36.409878+0000","last_active":"2024-09-12T22:31:59.161390+0000","last_peered":"2024-09-12T22:31:59.161390+0000","last_clean":"2024-09-12T22:31:59.161390+0000","last_became_active":"2024-09-12T22:31:36.409132+0000","last_became_peered":"2024-09-12T22:31:36.409132+0000","last_unstale":"2024-09-12T22:31:59.161390+0000","last_undegraded":"2024-09-12T22:31:59.161390+0000","last_fullsized":"2024-09-12T22:31:59.161390+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:09:56.081385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4886,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096169+0000","last_change":"2024-09-12T22:31:37.414914+0000","last_active":"2024-09-12T22:31:59.096169+0000","last_peered":"2024-09-12T22:31:59.096169+0000","last_clean":"2024-09-12T22:31:59.096169+0000","last_became_active":"2024-09-12T22:31:37.414535+0000","last_became_peered":"2024-09-12T22:31:37.414535+0000","last_unstale":"2024-09-12T22:31:59.096169+0000","last_undegraded":"2024-09-12T22:31:59.096169+0000","last_fullsized":"2024-09-12T22:31:59.096169+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:14:37.010786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"19'3","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.161712+0000","last_change":"2024-09-12T22:31:57.101007+0000","last_active":"2024-09-12T22:31:59.161712+0000","last_peered":"2024-09-12T22:31:59.161712+0000","last_clean":"2024-09-12T22:31:59.161712+0000","last_became_active":"2024-09-12T22:31:57.100640+0000","last_became_peered":"2024-09-12T22:31:57.100640+0000","last_unstale":"2024-09-12T22:31:59.161712+0000","last_undegraded":"2024-09-12T22:31:59.161712+0000","last_fullsized":"2024-09-12T22:31:59.161712+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:37:12.949001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.161477+0000","last_change":"2024-09-12T22:31:36.411549+0000","last_active":"2024-09-12T22:31:59.161477+0000","last_peered":"2024-09-12T22:31:59.161477+0000","last_clean":"2024-09-12T22:31:59.161477+0000","last_became_active":"2024-09-12T22:31:36.410674+0000","last_became_peered":"2024-09-12T22:31:36.410674+0000","last_unstale":"2024-09-12T22:31:59.161477+0000","last_undegraded":"2024-09-12T22:31:59.161477+0000","last_fullsized":"2024-09-12T22:31:59.161477+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:58:05.676197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096094+0000","last_change":"2024-09-12T22:31:37.411254+0000","last_active":"2024-09-12T22:31:59.096094+0000","last_peered":"2024-09-12T22:31:59.096094+0000","last_clean":"2024-09-12T22:31:59.096094+0000","last_became_active":"2024-09-12T22:31:37.410404+0000","last_became_peered":"2024-09-12T22:31:37.410404+0000","last_unstale":"2024-09-12T22:31:59.096094+0000","last_undegraded":"2024-09-12T22:31:59.096094+0000","last_fullsized":"2024-09-12T22:31:59.096094+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:42:00.856616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096887+0000","last_change":"2024-09-12T22:31:36.408390+0000","last_active":"2024-09-12T22:31:59.096887+0000","last_peered":"2024-09-12T22:31:59.096887+0000","last_clean":"2024-09-12T22:31:59.096887+0000","last_became_active":"2024-09-12T22:31:36.407062+0000","last_became_peered":"2024-09-12T22:31:36.407062+0000","last_unstale":"2024-09-12T22:31:59.096887+0000","last_undegraded":"2024-09-12T22:31:59.096887+0000","last_fullsized":"2024-09-12T22:31:59.096887+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:09:10.618195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096087+0000","last_change":"2024-09-12T22:31:37.416629+0000","last_active":"2024-09-12T22:31:59.096087+0000","last_peered":"2024-09-12T22:31:59.096087+0000","last_clean":"2024-09-12T22:31:59.096087+0000","last_became_active":"2024-09-12T22:31:37.416387+0000","last_became_peered":"2024-09-12T22:31:37.416387+0000","last_unstale":"2024-09-12T22:31:59.096087+0000","last_undegraded":"2024-09-12T22:31:59.096087+0000","last_fullsized":"2024-09-12T22:31:59.096087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:59:52.020560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.097123+0000","last_change":"2024-09-12T22:31:37.413777+0000","last_active":"2024-09-12T22:31:59.097123+0000","last_peered":"2024-09-12T22:31:59.097123+0000","last_clean":"2024-09-12T22:31:59.097123+0000","last_became_active":"2024-09-12T22:31:37.412669+0000","last_became_peered":"2024-09-12T22:31:37.412669+0000","last_unstale":"2024-09-12T22:31:59.097123+0000","last_undegraded":"2024-09-12T22:31:59.097123+0000","last_fullsized":"2024-09-12T22:31:59.097123+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:42:17.728844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096197+0000","last_change":"2024-09-12T22:31:36.409466+0000","last_active":"2024-09-12T22:31:59.096197+0000","last_peered":"2024-09-12T22:31:59.096197+0000","last_clean":"2024-09-12T22:31:59.096197+0000","last_became_active":"2024-09-12T22:31:36.408796+0000","last_became_peered":"2024-09-12T22:31:36.408796+0000","last_unstale":"2024-09-12T22:31:59.096197+0000","last_undegraded":"2024-09-12T22:31:59.096197+0000","last_fullsized":"2024-09-12T22:31:59.096197+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:03:39.648159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096898+0000","last_change":"2024-09-12T22:31:37.411183+0000","last_active":"2024-09-12T22:31:59.096898+0000","last_peered":"2024-09-12T22:31:59.096898+0000","last_clean":"2024-09-12T22:31:59.096898+0000","last_became_active":"2024-09-12T22:31:37.409796+0000","last_became_peered":"2024-09-12T22:31:37.409796+0000","last_unstale":"2024-09-12T22:31:59.096898+0000","last_undegraded":"2024-09-12T22:31:59.096898+0000","last_fullsized":"2024-09-12T22:31:59.096898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:20:35.779810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096227+0000","last_change":"2024-09-12T22:31:36.407402+0000","last_active":"2024-09-12T22:31:59.096227+0000","last_peered":"2024-09-12T22:31:59.096227+0000","last_clean":"2024-09-12T22:31:59.096227+0000","last_became_active":"2024-09-12T22:31:36.406681+0000","last_became_peered":"2024-09-12T22:31:36.406681+0000","last_unstale":"2024-09-12T22:31:59.096227+0000","last_undegraded":"2024-09-12T22:31:59.096227+0000","last_fullsized":"2024-09-12T22:31:59.096227+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:39:39.362573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096788+0000","last_change":"2024-09-12T22:31:37.412817+0000","last_active":"2024-09-12T22:31:59.096788+0000","last_peered":"2024-09-12T22:31:59.096788+0000","last_clean":"2024-09-12T22:31:59.096788+0000","last_became_active":"2024-09-12T22:31:37.411999+0000","last_became_peered":"2024-09-12T22:31:37.411999+0000","last_unstale":"2024-09-12T22:31:59.096788+0000","last_undegraded":"2024-09-12T22:31:59.096788+0000","last_fullsized":"2024-09-12T22:31:59.096788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:07:02.173590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096309+0000","last_change":"2024-09-12T22:31:57.095289+0000","last_active":"2024-09-12T22:31:59.096309+0000","last_peered":"2024-09-12T22:31:59.096309+0000","last_clean":"2024-09-12T22:31:59.096309+0000","last_became_active":"2024-09-12T22:31:57.095039+0000","last_became_peered":"2024-09-12T22:31:57.095039+0000","last_unstale":"2024-09-12T22:31:59.096309+0000","last_undegraded":"2024-09-12T22:31:59.096309+0000","last_fullsized":"2024-09-12T22:31:59.096309+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:39:50.881312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096461+0000","last_change":"2024-09-12T22:31:57.095260+0000","last_active":"2024-09-12T22:31:59.096461+0000","last_peered":"2024-09-12T22:31:59.096461+0000","last_clean":"2024-09-12T22:31:59.096461+0000","last_became_active":"2024-09-12T22:31:57.095035+0000","last_became_peered":"2024-09-12T22:31:57.095035+0000","last_unstale":"2024-09-12T22:31:59.096461+0000","last_undegraded":"2024-09-12T22:31:59.096461+0000","last_fullsized":"2024-09-12T22:31:59.096461+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:55:51.885364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096658+0000","last_change":"2024-09-12T22:31:36.412289+0000","last_active":"2024-09-12T22:31:59.096658+0000","last_peered":"2024-09-12T22:31:59.096658+0000","last_clean":"2024-09-12T22:31:59.096658+0000","last_became_active":"2024-09-12T22:31:36.411985+0000","last_became_peered":"2024-09-12T22:31:36.411985+0000","last_unstale":"2024-09-12T22:31:59.096658+0000","last_undegraded":"2024-09-12T22:31:59.096658+0000","last_fullsized":"2024-09-12T22:31:59.096658+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:30:09.410370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.161119+0000","last_change":"2024-09-12T22:31:37.415365+0000","last_active":"2024-09-12T22:31:59.161119+0000","last_peered":"2024-09-12T22:31:59.161119+0000","last_clean":"2024-09-12T22:31:59.161119+0000","last_became_active":"2024-09-12T22:31:37.413933+0000","last_became_peered":"2024-09-12T22:31:37.413933+0000","last_unstale":"2024-09-12T22:31:59.161119+0000","last_undegraded":"2024-09-12T22:31:59.161119+0000","last_fullsized":"2024-09-12T22:31:59.161119+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:08:07.115355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.161409+0000","last_change":"2024-09-12T22:31:36.411665+0000","last_active":"2024-09-12T22:31:59.161409+0000","last_peered":"2024-09-12T22:31:59.161409+0000","last_clean":"2024-09-12T22:31:59.161409+0000","last_became_active":"2024-09-12T22:31:36.410182+0000","last_became_peered":"2024-09-12T22:31:36.410182+0000","last_unstale":"2024-09-12T22:31:59.161409+0000","last_undegraded":"2024-09-12T22:31:59.161409+0000","last_fullsized":"2024-09-12T22:31:59.161409+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:37:20.891838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.161032+0000","last_change":"2024-09-12T22:31:37.415172+0000","last_active":"2024-09-12T22:31:59.161032+0000","last_peered":"2024-09-12T22:31:59.161032+0000","last_clean":"2024-09-12T22:31:59.161032+0000","last_became_active":"2024-09-12T22:31:37.414776+0000","last_became_peered":"2024-09-12T22:31:37.414776+0000","last_unstale":"2024-09-12T22:31:59.161032+0000","last_undegraded":"2024-09-12T22:31:59.161032+0000","last_fullsized":"2024-09-12T22:31:59.161032+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:42:32.307876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.161425+0000","last_change":"2024-09-12T22:31:57.100908+0000","last_active":"2024-09-12T22:31:59.161425+0000","last_peered":"2024-09-12T22:31:59.161425+0000","last_clean":"2024-09-12T22:31:59.161425+0000","last_became_active":"2024-09-12T22:31:57.100579+0000","last_became_peered":"2024-09-12T22:31:57.100579+0000","last_unstale":"2024-09-12T22:31:59.161425+0000","last_undegraded":"2024-09-12T22:31:59.161425+0000","last_fullsized":"2024-09-12T22:31:59.161425+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:49:56.674930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096497+0000","last_change":"2024-09-12T22:31:37.409214+0000","last_active":"2024-09-12T22:31:59.096497+0000","last_peered":"2024-09-12T22:31:59.096497+0000","last_clean":"2024-09-12T22:31:59.096497+0000","last_became_active":"2024-09-12T22:31:37.408849+0000","last_became_peered":"2024-09-12T22:31:37.408849+0000","last_unstale":"2024-09-12T22:31:59.096497+0000","last_undegraded":"2024-09-12T22:31:59.096497+0000","last_fullsized":"2024-09-12T22:31:59.096497+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:39:20.383152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096977+0000","last_change":"2024-09-12T22:31:36.410371+0000","last_active":"2024-09-12T22:31:59.096977+0000","last_peered":"2024-09-12T22:31:59.096977+0000","last_clean":"2024-09-12T22:31:59.096977+0000","last_became_active":"2024-09-12T22:31:36.409428+0000","last_became_peered":"2024-09-12T22:31:36.409428+0000","last_unstale":"2024-09-12T22:31:59.096977+0000","last_undegraded":"2024-09-12T22:31:59.096977+0000","last_fullsized":"2024-09-12T22:31:59.096977+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:27:22.817690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.160747+0000","last_change":"2024-09-12T22:31:37.415390+0000","last_active":"2024-09-12T22:31:59.160747+0000","last_peered":"2024-09-12T22:31:59.160747+0000","last_clean":"2024-09-12T22:31:59.160747+0000","last_became_active":"2024-09-12T22:31:37.414781+0000","last_became_peered":"2024-09-12T22:31:37.414781+0000","last_unstale":"2024-09-12T22:31:59.160747+0000","last_undegraded":"2024-09-12T22:31:59.160747+0000","last_fullsized":"2024-09-12T22:31:59.160747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:42:17.728844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"19'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-12T22:31:59.096779+0000","last_change":"2024-09-12T22:31:36.407945+0000","last_active":"2024-09-12T22:31:59.096779+0000","last_peered":"2024-09-12T22:31:59.096779+0000","last_clean":"2024-09-12T22:31:59.096779+0000","last_became_active":"2024-09-12T22:31:36.406959+0000","last_became_peered":"2024-09-12T22:31:36.406959+0000","last_unstale":"2024-09-12T22:31:59.096779+0000","last_undegraded":"2024-09-12T22:31:59.096779+0000","last_fullsized":"2024-09-12T22:31:59.096779+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:26:33.155850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":5684,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":11368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705675,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32008,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339832,"statfs":{"total":96636764160,"available":96603987968,"internally_reserved":0,"allocated":839680,"data_stored":674385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705675,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31996,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339844,"statfs":{"total":96636764160,"available":96604000256,"internally_reserved":0,"allocated":827392,"data_stored":673750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738379,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":217088,"data_stored":78949,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":5068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":5684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T22:32:05.333 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:05.333 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:05.342 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:32:05.386 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:05.385+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:05.448 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:05.447+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:05.457 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:05.458 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:05.467 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:32:05.549 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:05.548+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:05.611 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:05.612 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:05.620 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:32:05.650 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:32:05.649+0000 7fddec6a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30331) UID: 0 2024-09-12T22:32:05.724 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:05.724 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:05.733 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:32:05.751 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:05.750+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:05.839 INFO:teuthology.orchestra.run.smithi076.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:05.840 INFO:teuthology.orchestra.run.smithi076.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:05.849 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:32:05.852 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:05.851+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:05.952 INFO:teuthology.orchestra.run.smithi076.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:05.952 INFO:teuthology.orchestra.run.smithi076.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:05.952 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:05.951+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:05.960 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:32:06.053 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:32:06.052+0000 7fddec6a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30331) UID: 0 2024-09-12T22:32:06.063 INFO:teuthology.orchestra.run.smithi076.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:06.063 INFO:teuthology.orchestra.run.smithi076.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:06.072 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:32:06.154 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:06.153+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:06.183 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:06.184 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:06.192 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:32:06.255 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:32:06.254+0000 7fddec6a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30331) UID: 0 2024-09-12T22:32:06.334 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:06.335 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:06.344 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:32:06.356 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:06.355+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:06.447 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:06.447 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:06.455 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:32:06.457 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:06.456+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:06.558 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:06.556+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:06.571 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:06.571 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:06.580 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:32:06.645 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T22:32:06.658 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:06.657+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:06.726 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:06.726 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:06.735 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:32:06.759 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:06.758+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:06.783 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0: {} 2024-09-12T22:32:06.783 INFO:teuthology.orchestra.run.smithi019.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T22:32:06.802 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T22:32:06.802 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:32:06.819 INFO:teuthology.orchestra.run.smithi019.stdout:osd.2: {} 2024-09-12T22:32:06.820 INFO:teuthology.orchestra.run.smithi019.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T22:32:06.842 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-09-12T22:32:06.842 INFO:teuthology.orchestra.run.smithi163.stdout: "size": 20, 2024-09-12T22:32:06.842 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 600, 2024-09-12T22:32:06.843 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2024-09-12T22:32:06.843 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.843 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-09-12T22:32:06.843 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:27.254459+0000", 2024-09-12T22:32:06.843 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 39.585656555, 2024-09-12T22:32:06.843 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.37816283899999997, 2024-09-12T22:32:06.843 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:06.843 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:06.844 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:06.844 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:06.844 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:06.844 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:06.844 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 1 2024-09-12T22:32:06.844 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.844 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:06.844 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.844 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:06.844 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254459+0000", 2024-09-12T22:32:06.844 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:06.844 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.844 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.845 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:06.845 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254459+0000", 2024-09-12T22:32:06.845 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:06.845 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.845 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.845 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:06.845 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254460+0000", 2024-09-12T22:32:06.845 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1739999999999999e-06 2024-09-12T22:32:06.845 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.845 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.845 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:06.845 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254472+0000", 2024-09-12T22:32:06.845 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2207e-05 2024-09-12T22:32:06.846 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.846 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.846 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:06.846 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254483+0000", 2024-09-12T22:32:06.846 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0631999999999999e-05 2024-09-12T22:32:06.846 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.846 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.846 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:06.846 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254492+0000", 2024-09-12T22:32:06.846 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3670000000000003e-06 2024-09-12T22:32:06.846 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.846 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.847 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:06.847 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254551+0000", 2024-09-12T22:32:06.847 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8687999999999998e-05 2024-09-12T22:32:06.847 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.847 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.847 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for peered", 2024-09-12T22:32:06.847 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254562+0000", 2024-09-12T22:32:06.847 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1249e-05 2024-09-12T22:32:06.847 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.848 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.848 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:06.848 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.631211+0000", 2024-09-12T22:32:06.848 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.376649018 2024-09-12T22:32:06.848 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.848 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.848 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:06.848 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.631345+0000", 2024-09-12T22:32:06.848 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013378700000000001 2024-09-12T22:32:06.848 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.848 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.849 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:06.849 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.631479+0000", 2024-09-12T22:32:06.849 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013352399999999999 2024-09-12T22:32:06.849 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.849 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.849 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:06.849 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632324+0000", 2024-09-12T22:32:06.849 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00084508100000000002 2024-09-12T22:32:06.849 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.849 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.849 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:06.849 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632548+0000", 2024-09-12T22:32:06.849 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000224329 2024-09-12T22:32:06.850 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.850 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.850 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:06.850 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632591+0000", 2024-09-12T22:32:06.850 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2564000000000001e-05 2024-09-12T22:32:06.850 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.850 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.850 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:06.850 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632622+0000", 2024-09-12T22:32:06.850 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1219e-05 2024-09-12T22:32:06.850 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:06.850 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:06.850 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:06.851 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.851 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.851 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:185 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:32:06.851 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394355+0000", 2024-09-12T22:32:06.851 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 38.445760458000002, 2024-09-12T22:32:06.851 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011302394, 2024-09-12T22:32:06.851 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:06.851 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:06.851 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:06.851 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:06.851 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:06.851 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:06.851 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 185 2024-09-12T22:32:06.852 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.852 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:06.852 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.852 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:06.852 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394355+0000", 2024-09-12T22:32:06.852 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:06.852 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.852 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.852 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:06.852 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394355+0000", 2024-09-12T22:32:06.852 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:06.852 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.852 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.853 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:06.853 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394355+0000", 2024-09-12T22:32:06.853 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9099999999999999e-07 2024-09-12T22:32:06.853 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.853 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.853 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:06.853 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394385+0000", 2024-09-12T22:32:06.853 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9963000000000001e-05 2024-09-12T22:32:06.853 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.853 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.853 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:06.853 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394390+0000", 2024-09-12T22:32:06.854 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8420000000000004e-06 2024-09-12T22:32:06.854 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.854 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.854 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:06.854 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394393+0000", 2024-09-12T22:32:06.854 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1e-06 2024-09-12T22:32:06.854 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.854 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.854 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:06.854 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.400546+0000", 2024-09-12T22:32:06.854 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0061523309999999996 2024-09-12T22:32:06.854 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.855 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.855 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:06.855 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.400588+0000", 2024-09-12T22:32:06.855 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1835000000000002e-05 2024-09-12T22:32:06.855 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.855 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.855 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:06.855 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.400677+0000", 2024-09-12T22:32:06.855 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9195000000000002e-05 2024-09-12T22:32:06.855 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.855 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.855 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:06.855 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405378+0000", 2024-09-12T22:32:06.856 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0047008659999999997 2024-09-12T22:32:06.856 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.856 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.856 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:06.856 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405569+0000", 2024-09-12T22:32:06.856 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00019148599999999999 2024-09-12T22:32:06.856 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.856 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.856 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:06.856 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405620+0000", 2024-09-12T22:32:06.856 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1416999999999999e-05 2024-09-12T22:32:06.856 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.857 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.857 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:06.857 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405657+0000", 2024-09-12T22:32:06.857 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6968000000000002e-05 2024-09-12T22:32:06.857 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:06.857 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:06.857 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:06.857 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.857 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.857 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:32:06.857 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394399+0000", 2024-09-12T22:32:06.857 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 38.445716247, 2024-09-12T22:32:06.857 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011336601999999999, 2024-09-12T22:32:06.858 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:06.858 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:06.858 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:06.858 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:06.858 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:06.858 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:06.858 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 186 2024-09-12T22:32:06.858 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.858 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:06.858 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.858 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:06.858 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394399+0000", 2024-09-12T22:32:06.859 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:06.859 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.859 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.859 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:06.859 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394399+0000", 2024-09-12T22:32:06.859 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:06.859 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.859 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.859 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:06.859 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394400+0000", 2024-09-12T22:32:06.859 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4499999999999998e-07 2024-09-12T22:32:06.859 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.859 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.859 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:06.860 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394402+0000", 2024-09-12T22:32:06.860 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.875e-06 2024-09-12T22:32:06.860 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.860 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.860 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:06.860 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394405+0000", 2024-09-12T22:32:06.860 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6799999999999999e-06 2024-09-12T22:32:06.860 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.860 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.860 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:06.860 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394408+0000", 2024-09-12T22:32:06.860 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.667e-06 2024-09-12T22:32:06.860 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.861 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.861 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:06.861 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401395+0000", 2024-09-12T22:32:06.861 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0069867230000000002 2024-09-12T22:32:06.861 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.861 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.861 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:06.861 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401438+0000", 2024-09-12T22:32:06.861 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3554999999999999e-05 2024-09-12T22:32:06.861 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.861 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.861 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:06.861 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401509+0000", 2024-09-12T22:32:06.861 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0631999999999997e-05 2024-09-12T22:32:06.862 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.862 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.862 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:06.862 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405392+0000", 2024-09-12T22:32:06.862 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0038830449999999999 2024-09-12T22:32:06.862 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.862 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.862 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:06.862 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405690+0000", 2024-09-12T22:32:06.862 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000298435 2024-09-12T22:32:06.863 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.863 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.863 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:06.863 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405716+0000", 2024-09-12T22:32:06.863 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5435999999999998e-05 2024-09-12T22:32:06.863 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.863 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.863 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:06.863 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405736+0000", 2024-09-12T22:32:06.863 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0208999999999999e-05 2024-09-12T22:32:06.863 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:06.863 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:06.863 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:06.863 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.864 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.864 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:32:06.864 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394411+0000", 2024-09-12T22:32:06.864 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 38.445704120999999, 2024-09-12T22:32:06.864 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011400117, 2024-09-12T22:32:06.864 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:06.864 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:06.864 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:06.864 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:06.864 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:06.865 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:06.865 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 187 2024-09-12T22:32:06.865 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.865 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:06.865 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.865 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:06.865 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394411+0000", 2024-09-12T22:32:06.865 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:06.865 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.865 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.865 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:06.865 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394411+0000", 2024-09-12T22:32:06.866 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:06.866 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.866 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.866 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:06.866 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394412+0000", 2024-09-12T22:32:06.866 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.4999999999999999e-07 2024-09-12T22:32:06.866 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.866 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.866 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:06.866 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394414+0000", 2024-09-12T22:32:06.867 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.984e-06 2024-09-12T22:32:06.867 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.867 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.867 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:06.867 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394418+0000", 2024-09-12T22:32:06.867 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0840000000000002e-06 2024-09-12T22:32:06.867 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.867 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.867 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:06.867 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394431+0000", 2024-09-12T22:32:06.867 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.361e-05 2024-09-12T22:32:06.867 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.867 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.867 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:06.868 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401778+0000", 2024-09-12T22:32:06.868 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0073462659999999997 2024-09-12T22:32:06.868 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.868 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.868 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:06.868 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401853+0000", 2024-09-12T22:32:06.868 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5797000000000006e-05 2024-09-12T22:32:06.868 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.868 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.868 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:06.868 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401990+0000", 2024-09-12T22:32:06.869 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013651399999999999 2024-09-12T22:32:06.869 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.869 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.869 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:06.869 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405402+0000", 2024-09-12T22:32:06.869 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0034116070000000001 2024-09-12T22:32:06.869 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.869 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.869 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:06.869 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405764+0000", 2024-09-12T22:32:06.869 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00036234899999999998 2024-09-12T22:32:06.869 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.869 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.870 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:06.870 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405791+0000", 2024-09-12T22:32:06.870 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7029000000000002e-05 2024-09-12T22:32:06.870 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.870 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.870 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:06.870 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405812+0000", 2024-09-12T22:32:06.870 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0627000000000001e-05 2024-09-12T22:32:06.870 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:06.870 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:06.870 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:06.871 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.871 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.871 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:32:06.871 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394447+0000", 2024-09-12T22:32:06.871 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 38.44566897, 2024-09-12T22:32:06.871 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011759588, 2024-09-12T22:32:06.871 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:06.871 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:06.871 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:06.871 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:06.871 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:06.871 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:06.872 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 188 2024-09-12T22:32:06.872 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.872 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:06.872 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.872 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:06.872 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394447+0000", 2024-09-12T22:32:06.872 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:06.872 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.872 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.872 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:06.872 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394447+0000", 2024-09-12T22:32:06.872 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:06.872 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.873 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.873 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:06.873 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394447+0000", 2024-09-12T22:32:06.873 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.15e-07 2024-09-12T22:32:06.873 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.873 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.873 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:06.873 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394512+0000", 2024-09-12T22:32:06.873 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4580999999999997e-05 2024-09-12T22:32:06.873 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.873 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.873 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:06.873 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394518+0000", 2024-09-12T22:32:06.874 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.3380000000000001e-06 2024-09-12T22:32:06.874 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.874 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.874 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:06.874 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394521+0000", 2024-09-12T22:32:06.874 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3340000000000002e-06 2024-09-12T22:32:06.874 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.874 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.874 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:06.874 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.402628+0000", 2024-09-12T22:32:06.874 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.008106996 2024-09-12T22:32:06.874 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.874 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.875 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:06.875 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.402670+0000", 2024-09-12T22:32:06.875 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1983000000000001e-05 2024-09-12T22:32:06.875 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.875 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.875 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:06.875 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.402738+0000", 2024-09-12T22:32:06.875 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.8114999999999994e-05 2024-09-12T22:32:06.875 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.875 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.875 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:06.875 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405668+0000", 2024-09-12T22:32:06.875 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.002929545 2024-09-12T22:32:06.876 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.876 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.876 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:06.876 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406162+0000", 2024-09-12T22:32:06.876 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000494408 2024-09-12T22:32:06.876 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.876 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.876 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:06.876 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406188+0000", 2024-09-12T22:32:06.876 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5766e-05 2024-09-12T22:32:06.876 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.876 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.877 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:06.877 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406206+0000", 2024-09-12T22:32:06.877 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.8107000000000001e-05 2024-09-12T22:32:06.877 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:06.877 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:06.877 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:06.877 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.877 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.877 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:32:06.877 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394528+0000", 2024-09-12T22:32:06.878 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 38.445587301000003, 2024-09-12T22:32:06.878 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.01195536, 2024-09-12T22:32:06.878 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:06.878 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:06.878 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:06.878 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:06.878 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:06.878 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:06.878 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 189 2024-09-12T22:32:06.878 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.878 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:06.879 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.879 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:06.879 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394528+0000", 2024-09-12T22:32:06.879 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:06.879 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.879 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.879 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:06.879 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394528+0000", 2024-09-12T22:32:06.879 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:06.879 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.879 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.879 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:06.879 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394529+0000", 2024-09-12T22:32:06.880 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4900000000000001e-07 2024-09-12T22:32:06.880 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.880 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.880 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:06.880 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394531+0000", 2024-09-12T22:32:06.880 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.458e-06 2024-09-12T22:32:06.880 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.880 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.880 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:06.880 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394535+0000", 2024-09-12T22:32:06.880 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7900000000000001e-06 2024-09-12T22:32:06.880 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.881 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.881 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:06.881 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394537+0000", 2024-09-12T22:32:06.881 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.632e-06 2024-09-12T22:32:06.881 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.881 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.881 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:06.881 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.404932+0000", 2024-09-12T22:32:06.881 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010394158000000001 2024-09-12T22:32:06.881 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.881 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.881 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:06.881 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405017+0000", 2024-09-12T22:32:06.882 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5525000000000005e-05 2024-09-12T22:32:06.882 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.882 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.882 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:06.882 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405114+0000", 2024-09-12T22:32:06.882 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.6527000000000006e-05 2024-09-12T22:32:06.882 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.882 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.882 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:06.882 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405818+0000", 2024-09-12T22:32:06.882 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00070412800000000005 2024-09-12T22:32:06.882 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.882 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.882 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:06.882 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406437+0000", 2024-09-12T22:32:06.883 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00061898900000000002 2024-09-12T22:32:06.883 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.883 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.883 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:06.883 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406463+0000", 2024-09-12T22:32:06.883 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6268e-05 2024-09-12T22:32:06.883 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.883 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.883 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:06.883 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406484+0000", 2024-09-12T22:32:06.883 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0536000000000001e-05 2024-09-12T22:32:06.884 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:06.884 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:06.884 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:06.884 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.884 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.884 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:06.884 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.401422+0000", 2024-09-12T22:32:06.884 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 29.438693396000001, 2024-09-12T22:32:06.884 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016896452999999999, 2024-09-12T22:32:06.884 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:06.884 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:06.884 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:06.884 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:06.885 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.885 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:06.885 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401422+0000", 2024-09-12T22:32:06.885 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:06.885 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.885 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.885 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:06.885 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401422+0000", 2024-09-12T22:32:06.885 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:06.885 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.885 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.885 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:06.885 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401424+0000", 2024-09-12T22:32:06.886 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9e-06 2024-09-12T22:32:06.886 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.886 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.886 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:06.886 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401437+0000", 2024-09-12T22:32:06.886 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2831e-05 2024-09-12T22:32:06.886 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.886 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.886 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:06.886 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401471+0000", 2024-09-12T22:32:06.886 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4010000000000001e-05 2024-09-12T22:32:06.886 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.886 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.887 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:06.887 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401484+0000", 2024-09-12T22:32:06.887 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2711000000000001e-05 2024-09-12T22:32:06.887 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.887 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.887 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:06.887 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405410+0000", 2024-09-12T22:32:06.887 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0039259170000000001 2024-09-12T22:32:06.887 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.887 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.887 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:06.887 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405529+0000", 2024-09-12T22:32:06.887 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000119778 2024-09-12T22:32:06.887 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.888 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.888 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:06.888 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405655+0000", 2024-09-12T22:32:06.888 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012556700000000001 2024-09-12T22:32:06.888 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.888 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.888 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:06.888 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410456+0000", 2024-09-12T22:32:06.888 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0048008269999999997 2024-09-12T22:32:06.888 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.888 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.888 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:06.888 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418226+0000", 2024-09-12T22:32:06.888 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0077707729999999999 2024-09-12T22:32:06.889 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.889 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.889 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:06.889 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418277+0000", 2024-09-12T22:32:06.889 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0476000000000003e-05 2024-09-12T22:32:06.889 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.889 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.889 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:06.889 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418319+0000", 2024-09-12T22:32:06.889 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1662999999999997e-05 2024-09-12T22:32:06.889 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:06.889 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:06.889 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:06.890 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.890 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.890 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:06.890 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.401505+0000", 2024-09-12T22:32:06.890 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 29.438610732000001, 2024-09-12T22:32:06.890 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016987904000000002, 2024-09-12T22:32:06.890 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:06.890 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:06.890 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:06.890 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:06.890 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.890 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:06.890 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401505+0000", 2024-09-12T22:32:06.890 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:06.891 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.891 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.891 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:06.891 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401505+0000", 2024-09-12T22:32:06.891 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:06.891 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.891 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.891 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:06.891 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401506+0000", 2024-09-12T22:32:06.891 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4700000000000001e-07 2024-09-12T22:32:06.891 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.891 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.891 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:06.891 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401510+0000", 2024-09-12T22:32:06.891 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6609999999999999e-06 2024-09-12T22:32:06.892 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.892 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.892 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:06.892 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401771+0000", 2024-09-12T22:32:06.892 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00026110700000000001 2024-09-12T22:32:06.892 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.892 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.892 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:06.892 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401921+0000", 2024-09-12T22:32:06.892 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014939099999999999 2024-09-12T22:32:06.892 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.892 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.893 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:06.893 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405944+0000", 2024-09-12T22:32:06.893 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0040235449999999999 2024-09-12T22:32:06.893 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.893 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.893 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:06.893 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406018+0000", 2024-09-12T22:32:06.893 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3373000000000004e-05 2024-09-12T22:32:06.893 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.893 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.893 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:06.893 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406172+0000", 2024-09-12T22:32:06.893 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00015435399999999999 2024-09-12T22:32:06.894 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.894 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.894 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:06.894 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410461+0000", 2024-09-12T22:32:06.894 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0042888609999999997 2024-09-12T22:32:06.894 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.894 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.894 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:06.894 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418371+0000", 2024-09-12T22:32:06.894 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0079098380000000006 2024-09-12T22:32:06.894 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.894 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.894 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:06.894 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418443+0000", 2024-09-12T22:32:06.894 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2705000000000003e-05 2024-09-12T22:32:06.895 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.895 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.895 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:06.895 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418493+0000", 2024-09-12T22:32:06.895 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9322e-05 2024-09-12T22:32:06.895 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:06.895 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:06.895 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:06.895 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.895 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.895 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:06.895 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.401939+0000", 2024-09-12T22:32:06.895 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 29.438176995999999, 2024-09-12T22:32:06.895 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016722292999999999, 2024-09-12T22:32:06.895 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:06.896 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:06.896 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:06.896 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:06.896 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.896 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:06.896 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401939+0000", 2024-09-12T22:32:06.896 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:06.896 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.896 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.896 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:06.896 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401939+0000", 2024-09-12T22:32:06.897 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:06.897 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.897 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.897 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:06.897 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401940+0000", 2024-09-12T22:32:06.897 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1990000000000001e-06 2024-09-12T22:32:06.897 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.897 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.897 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:06.897 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401956+0000", 2024-09-12T22:32:06.897 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.6344000000000001e-05 2024-09-12T22:32:06.897 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.898 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.898 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:06.898 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401974+0000", 2024-09-12T22:32:06.898 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7730000000000001e-05 2024-09-12T22:32:06.898 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.898 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.898 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:06.898 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401982+0000", 2024-09-12T22:32:06.898 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.7800000000000001e-06 2024-09-12T22:32:06.898 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.898 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.898 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:06.898 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406557+0000", 2024-09-12T22:32:06.899 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0045758489999999999 2024-09-12T22:32:06.899 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.899 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.899 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:06.899 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406697+0000", 2024-09-12T22:32:06.899 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013925100000000001 2024-09-12T22:32:06.899 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.899 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.899 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:06.899 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406830+0000", 2024-09-12T22:32:06.899 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013293499999999999 2024-09-12T22:32:06.899 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.899 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.900 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:06.900 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410465+0000", 2024-09-12T22:32:06.900 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0036352680000000001 2024-09-12T22:32:06.900 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.900 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.900 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:06.900 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418564+0000", 2024-09-12T22:32:06.900 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0080992140000000004 2024-09-12T22:32:06.900 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.900 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.900 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:06.900 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418621+0000", 2024-09-12T22:32:06.900 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7167999999999999e-05 2024-09-12T22:32:06.900 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.901 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.901 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:06.901 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418661+0000", 2024-09-12T22:32:06.901 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9555000000000003e-05 2024-09-12T22:32:06.901 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:06.901 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:06.901 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:06.901 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.901 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.901 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:06.901 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.401994+0000", 2024-09-12T22:32:06.901 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 29.438121123999998, 2024-09-12T22:32:06.901 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016804109000000001, 2024-09-12T22:32:06.902 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:06.902 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:06.902 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:06.902 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:06.902 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.902 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:06.902 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401994+0000", 2024-09-12T22:32:06.902 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:06.902 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.902 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.902 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:06.902 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401994+0000", 2024-09-12T22:32:06.902 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:06.902 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.903 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.903 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:06.903 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401995+0000", 2024-09-12T22:32:06.903 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.8899999999999998e-07 2024-09-12T22:32:06.903 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.903 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.903 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:06.903 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402000+0000", 2024-09-12T22:32:06.903 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.498e-06 2024-09-12T22:32:06.903 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.903 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.903 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:06.903 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402007+0000", 2024-09-12T22:32:06.904 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.554e-06 2024-09-12T22:32:06.904 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.904 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.904 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:06.904 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402046+0000", 2024-09-12T22:32:06.904 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9156000000000003e-05 2024-09-12T22:32:06.904 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.904 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.904 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:06.904 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407342+0000", 2024-09-12T22:32:06.904 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052957610000000004 2024-09-12T22:32:06.904 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.904 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.905 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:06.905 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407521+0000", 2024-09-12T22:32:06.905 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00017878100000000001 2024-09-12T22:32:06.905 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.905 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.905 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:06.905 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407641+0000", 2024-09-12T22:32:06.905 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012013 2024-09-12T22:32:06.905 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.905 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.905 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:06.905 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410472+0000", 2024-09-12T22:32:06.905 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.002830455 2024-09-12T22:32:06.906 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.906 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.906 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:06.906 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418714+0000", 2024-09-12T22:32:06.906 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0082422789999999999 2024-09-12T22:32:06.906 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.906 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.906 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:06.906 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418761+0000", 2024-09-12T22:32:06.906 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6956999999999998e-05 2024-09-12T22:32:06.906 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.906 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.906 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:06.906 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418799+0000", 2024-09-12T22:32:06.907 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7749000000000001e-05 2024-09-12T22:32:06.907 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:06.907 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:06.907 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:06.907 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.907 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.907 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:06.907 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.402060+0000", 2024-09-12T22:32:06.907 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 29.438055680000002, 2024-09-12T22:32:06.907 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016885686, 2024-09-12T22:32:06.907 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:06.907 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:06.907 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:06.908 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:06.908 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.908 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:06.908 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402060+0000", 2024-09-12T22:32:06.908 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:06.908 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.908 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.908 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:06.908 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402060+0000", 2024-09-12T22:32:06.908 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:06.908 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.908 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.908 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:06.909 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402061+0000", 2024-09-12T22:32:06.909 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4399999999999999e-07 2024-09-12T22:32:06.909 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.909 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.909 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:06.909 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402066+0000", 2024-09-12T22:32:06.909 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8649999999999998e-06 2024-09-12T22:32:06.909 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.909 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.909 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:06.909 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402146+0000", 2024-09-12T22:32:06.909 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9054000000000006e-05 2024-09-12T22:32:06.909 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.910 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.910 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:06.910 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402287+0000", 2024-09-12T22:32:06.910 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014108600000000001 2024-09-12T22:32:06.910 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.910 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.910 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:06.910 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408185+0000", 2024-09-12T22:32:06.910 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0058983919999999997 2024-09-12T22:32:06.910 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.910 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.910 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:06.910 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408299+0000", 2024-09-12T22:32:06.910 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114102 2024-09-12T22:32:06.911 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.911 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.911 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:06.911 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408420+0000", 2024-09-12T22:32:06.911 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000120492 2024-09-12T22:32:06.911 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.911 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.911 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:06.911 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410867+0000", 2024-09-12T22:32:06.911 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0024476430000000002 2024-09-12T22:32:06.911 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.911 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.911 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:06.911 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418851+0000", 2024-09-12T22:32:06.912 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0079841489999999994 2024-09-12T22:32:06.912 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.912 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.912 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:06.912 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418894+0000", 2024-09-12T22:32:06.912 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3090000000000002e-05 2024-09-12T22:32:06.912 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.912 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.912 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:06.912 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418946+0000", 2024-09-12T22:32:06.912 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1069000000000002e-05 2024-09-12T22:32:06.912 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:06.912 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:06.912 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:06.913 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.913 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.913 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:06.913 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.402375+0000", 2024-09-12T22:32:06.913 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 29.437740614999999, 2024-09-12T22:32:06.913 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016768531999999999, 2024-09-12T22:32:06.913 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:06.913 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:06.913 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:06.913 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:06.913 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.913 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:06.913 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402375+0000", 2024-09-12T22:32:06.914 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:06.914 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.914 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.914 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:06.914 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402375+0000", 2024-09-12T22:32:06.914 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:06.914 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.914 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.914 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:06.914 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402375+0000", 2024-09-12T22:32:06.914 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4099999999999999e-07 2024-09-12T22:32:06.914 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.914 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.914 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:06.915 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402379+0000", 2024-09-12T22:32:06.915 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9870000000000001e-06 2024-09-12T22:32:06.915 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.915 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.915 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:06.915 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402389+0000", 2024-09-12T22:32:06.915 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0000000000000001e-05 2024-09-12T22:32:06.915 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.915 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.915 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:06.915 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402401+0000", 2024-09-12T22:32:06.915 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.148e-05 2024-09-12T22:32:06.915 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.916 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.916 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:06.916 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409108+0000", 2024-09-12T22:32:06.916 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0067068429999999997 2024-09-12T22:32:06.916 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.916 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.916 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:06.916 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409189+0000", 2024-09-12T22:32:06.916 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0815999999999993e-05 2024-09-12T22:32:06.916 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.916 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.916 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:06.916 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409320+0000", 2024-09-12T22:32:06.917 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000131586 2024-09-12T22:32:06.917 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.917 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.917 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:06.917 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410872+0000", 2024-09-12T22:32:06.917 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0015521599999999999 2024-09-12T22:32:06.917 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.917 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.917 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:06.917 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419049+0000", 2024-09-12T22:32:06.917 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0081763719999999995 2024-09-12T22:32:06.917 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.918 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.918 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:06.918 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419107+0000", 2024-09-12T22:32:06.918 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7899000000000002e-05 2024-09-12T22:32:06.918 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.918 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.918 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:06.918 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419143+0000", 2024-09-12T22:32:06.918 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6847999999999997e-05 2024-09-12T22:32:06.918 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:06.918 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:06.918 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:06.919 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.919 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.919 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:06.919 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.402903+0000", 2024-09-12T22:32:06.919 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 29.437212203000001, 2024-09-12T22:32:06.919 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016378428, 2024-09-12T22:32:06.919 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:06.919 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:06.919 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:06.919 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:06.919 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.919 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:06.919 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402903+0000", 2024-09-12T22:32:06.919 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:06.920 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.920 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.920 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:06.920 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402903+0000", 2024-09-12T22:32:06.920 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:06.920 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.920 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.920 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:06.920 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402904+0000", 2024-09-12T22:32:06.920 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9500000000000001e-07 2024-09-12T22:32:06.920 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.920 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.920 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:06.921 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402944+0000", 2024-09-12T22:32:06.921 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0265000000000002e-05 2024-09-12T22:32:06.921 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.921 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.921 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:06.921 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402979+0000", 2024-09-12T22:32:06.921 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4378000000000002e-05 2024-09-12T22:32:06.921 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.921 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.921 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:06.921 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402987+0000", 2024-09-12T22:32:06.921 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3559999999999993e-06 2024-09-12T22:32:06.921 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.921 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.922 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:06.922 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409577+0000", 2024-09-12T22:32:06.922 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0065901709999999997 2024-09-12T22:32:06.922 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.922 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.922 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:06.922 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409653+0000", 2024-09-12T22:32:06.922 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5819e-05 2024-09-12T22:32:06.922 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.922 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.922 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:06.923 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409725+0000", 2024-09-12T22:32:06.923 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2200000000000007e-05 2024-09-12T22:32:06.923 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.923 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.923 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:06.923 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.411234+0000", 2024-09-12T22:32:06.923 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001508225 2024-09-12T22:32:06.923 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.923 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.923 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:06.923 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419212+0000", 2024-09-12T22:32:06.923 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0079783400000000004 2024-09-12T22:32:06.923 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.923 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.924 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:06.924 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419244+0000", 2024-09-12T22:32:06.924 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2384e-05 2024-09-12T22:32:06.924 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.924 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.924 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:06.924 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419282+0000", 2024-09-12T22:32:06.924 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7394999999999997e-05 2024-09-12T22:32:06.924 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:06.924 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:06.924 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:06.924 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.925 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.925 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:06.925 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.403135+0000", 2024-09-12T22:32:06.925 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 29.436980333000001, 2024-09-12T22:32:06.925 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016294211999999999, 2024-09-12T22:32:06.925 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:06.925 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:06.925 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:06.925 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:06.925 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.925 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:06.925 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403135+0000", 2024-09-12T22:32:06.925 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:06.926 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.926 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.926 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:06.926 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403135+0000", 2024-09-12T22:32:06.926 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:06.926 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.926 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.926 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:06.926 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403136+0000", 2024-09-12T22:32:06.926 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.4e-07 2024-09-12T22:32:06.926 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.926 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.926 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:06.926 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403149+0000", 2024-09-12T22:32:06.927 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2723e-05 2024-09-12T22:32:06.927 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.927 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.927 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:06.927 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403158+0000", 2024-09-12T22:32:06.927 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3919999999999992e-06 2024-09-12T22:32:06.927 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.927 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.927 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:06.927 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403166+0000", 2024-09-12T22:32:06.927 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.2309999999999996e-06 2024-09-12T22:32:06.927 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.927 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.928 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:06.928 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409944+0000", 2024-09-12T22:32:06.928 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0067775309999999998 2024-09-12T22:32:06.928 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.928 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.928 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:06.928 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410032+0000", 2024-09-12T22:32:06.928 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.7906999999999997e-05 2024-09-12T22:32:06.928 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.928 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.928 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:06.928 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410152+0000", 2024-09-12T22:32:06.929 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012037800000000001 2024-09-12T22:32:06.929 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.929 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.929 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:06.929 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.411945+0000", 2024-09-12T22:32:06.929 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0017931850000000001 2024-09-12T22:32:06.929 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.929 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.929 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:06.929 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419319+0000", 2024-09-12T22:32:06.929 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0073731780000000002 2024-09-12T22:32:06.929 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.929 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.930 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:06.930 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419376+0000", 2024-09-12T22:32:06.930 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7728e-05 2024-09-12T22:32:06.930 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.930 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.930 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:06.930 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419429+0000", 2024-09-12T22:32:06.930 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3019000000000002e-05 2024-09-12T22:32:06.930 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:06.930 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:06.930 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:06.930 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.930 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.930 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:06.930 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.403185+0000", 2024-09-12T22:32:06.931 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 29.436930451999999, 2024-09-12T22:32:06.931 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.014902164000000001, 2024-09-12T22:32:06.931 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:06.931 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:06.931 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:06.931 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:06.931 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.931 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:06.931 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403185+0000", 2024-09-12T22:32:06.931 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:06.931 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.932 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.932 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:06.932 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403185+0000", 2024-09-12T22:32:06.932 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:06.932 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.932 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.932 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:06.932 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403186+0000", 2024-09-12T22:32:06.932 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9400000000000005e-07 2024-09-12T22:32:06.932 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.932 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.932 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:06.932 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403191+0000", 2024-09-12T22:32:06.933 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6980000000000003e-06 2024-09-12T22:32:06.933 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.933 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.933 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:06.933 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403199+0000", 2024-09-12T22:32:06.933 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2520000000000002e-06 2024-09-12T22:32:06.933 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.933 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.933 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:06.933 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403205+0000", 2024-09-12T22:32:06.933 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.908e-06 2024-09-12T22:32:06.933 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.934 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.934 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:06.934 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403359+0000", 2024-09-12T22:32:06.934 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000154544 2024-09-12T22:32:06.934 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.934 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.934 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:06.934 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403528+0000", 2024-09-12T22:32:06.934 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000168455 2024-09-12T22:32:06.934 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.934 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.934 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:06.934 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403763+0000", 2024-09-12T22:32:06.935 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00023539599999999999 2024-09-12T22:32:06.935 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.935 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.935 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:06.935 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409378+0000", 2024-09-12T22:32:06.935 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056150000000000002 2024-09-12T22:32:06.935 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.935 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.935 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:06.935 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418012+0000", 2024-09-12T22:32:06.935 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0086339559999999999 2024-09-12T22:32:06.935 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.935 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.936 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:06.936 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418046+0000", 2024-09-12T22:32:06.936 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4267999999999998e-05 2024-09-12T22:32:06.936 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.936 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.936 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:06.936 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418087+0000", 2024-09-12T22:32:06.936 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0992999999999999e-05 2024-09-12T22:32:06.936 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:06.936 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:06.936 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:06.937 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.937 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.937 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:06.937 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.403273+0000", 2024-09-12T22:32:06.937 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 29.436842501000001, 2024-09-12T22:32:06.937 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.014934866, 2024-09-12T22:32:06.937 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:06.937 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:06.937 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:06.937 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:06.937 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.937 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:06.938 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403273+0000", 2024-09-12T22:32:06.938 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:06.938 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.938 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.938 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:06.938 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403273+0000", 2024-09-12T22:32:06.938 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:06.938 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.938 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.938 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:06.938 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403274+0000", 2024-09-12T22:32:06.938 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.297e-06 2024-09-12T22:32:06.939 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.939 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.939 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:06.939 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403282+0000", 2024-09-12T22:32:06.939 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6340000000000001e-06 2024-09-12T22:32:06.939 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.939 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.939 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:06.939 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403305+0000", 2024-09-12T22:32:06.939 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3149000000000001e-05 2024-09-12T22:32:06.939 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.939 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.939 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:06.940 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403320+0000", 2024-09-12T22:32:06.940 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4527e-05 2024-09-12T22:32:06.940 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.940 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.940 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:06.940 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.404928+0000", 2024-09-12T22:32:06.940 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001608459 2024-09-12T22:32:06.940 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.940 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.940 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:06.940 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405218+0000", 2024-09-12T22:32:06.941 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00028982900000000002 2024-09-12T22:32:06.941 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.941 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.941 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:06.941 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405829+0000", 2024-09-12T22:32:06.941 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00061127900000000005 2024-09-12T22:32:06.941 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.941 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.941 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:06.941 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409403+0000", 2024-09-12T22:32:06.941 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.003573597 2024-09-12T22:32:06.941 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.941 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.942 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:06.942 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418138+0000", 2024-09-12T22:32:06.942 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0087349969999999996 2024-09-12T22:32:06.942 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.942 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.942 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:06.942 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418178+0000", 2024-09-12T22:32:06.942 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0649999999999999e-05 2024-09-12T22:32:06.942 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.942 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.942 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:06.942 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418208+0000", 2024-09-12T22:32:06.942 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9448e-05 2024-09-12T22:32:06.943 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:06.943 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:06.943 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:06.943 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.943 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.943 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:06.943 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.405456+0000", 2024-09-12T22:32:06.943 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 29.434659356000001, 2024-09-12T22:32:06.943 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012888389, 2024-09-12T22:32:06.943 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:06.943 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:06.943 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:06.943 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:06.944 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.944 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:06.944 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405456+0000", 2024-09-12T22:32:06.944 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:06.944 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.944 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.944 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:06.944 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405456+0000", 2024-09-12T22:32:06.944 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:06.944 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.944 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.944 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:06.944 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405457+0000", 2024-09-12T22:32:06.945 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.6599999999999994e-07 2024-09-12T22:32:06.945 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.945 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.945 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:06.945 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405463+0000", 2024-09-12T22:32:06.945 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4739999999999996e-06 2024-09-12T22:32:06.945 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.945 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.945 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:06.945 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405474+0000", 2024-09-12T22:32:06.945 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1095e-05 2024-09-12T22:32:06.945 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.945 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.946 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:06.946 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405482+0000", 2024-09-12T22:32:06.946 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3610000000000001e-06 2024-09-12T22:32:06.946 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.946 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.946 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:06.946 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407051+0000", 2024-09-12T22:32:06.946 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0015688970000000001 2024-09-12T22:32:06.946 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.946 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.946 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:06.946 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407259+0000", 2024-09-12T22:32:06.946 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00020778300000000001 2024-09-12T22:32:06.946 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.947 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.947 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:06.947 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407622+0000", 2024-09-12T22:32:06.947 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000363066 2024-09-12T22:32:06.947 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.947 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.947 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:06.947 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409438+0000", 2024-09-12T22:32:06.947 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001816319 2024-09-12T22:32:06.947 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.947 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.947 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:06.947 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418257+0000", 2024-09-12T22:32:06.948 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0088187720000000008 2024-09-12T22:32:06.948 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.948 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.948 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:06.948 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418308+0000", 2024-09-12T22:32:06.948 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1180000000000001e-05 2024-09-12T22:32:06.948 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.948 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.948 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:06.948 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418345+0000", 2024-09-12T22:32:06.948 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6476000000000001e-05 2024-09-12T22:32:06.948 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:06.948 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:06.949 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:06.949 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.949 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.949 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:06.949 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.405496+0000", 2024-09-12T22:32:06.949 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 29.434619998999999, 2024-09-12T22:32:06.949 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013016012, 2024-09-12T22:32:06.949 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:06.949 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:06.949 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:06.949 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:06.949 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.949 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:06.950 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405496+0000", 2024-09-12T22:32:06.950 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:06.950 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.950 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.950 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:06.950 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405496+0000", 2024-09-12T22:32:06.950 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:06.950 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.950 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.950 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:06.950 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405496+0000", 2024-09-12T22:32:06.950 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7999999999999995e-07 2024-09-12T22:32:06.950 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.951 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.951 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:06.951 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405501+0000", 2024-09-12T22:32:06.951 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8359999999999999e-06 2024-09-12T22:32:06.951 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.951 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.951 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:06.951 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405514+0000", 2024-09-12T22:32:06.951 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2522e-05 2024-09-12T22:32:06.951 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.951 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.951 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:06.951 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405521+0000", 2024-09-12T22:32:06.952 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5020000000000003e-06 2024-09-12T22:32:06.952 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.952 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.952 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:06.952 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405575+0000", 2024-09-12T22:32:06.952 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4169999999999998e-05 2024-09-12T22:32:06.952 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.952 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.952 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:06.952 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405697+0000", 2024-09-12T22:32:06.952 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000121301 2024-09-12T22:32:06.952 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.953 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.953 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:06.953 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405829+0000", 2024-09-12T22:32:06.953 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000132662 2024-09-12T22:32:06.953 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.953 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.953 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:06.953 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409155+0000", 2024-09-12T22:32:06.953 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0033259050000000001 2024-09-12T22:32:06.953 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.953 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.953 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:06.953 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418425+0000", 2024-09-12T22:32:06.954 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0092696319999999999 2024-09-12T22:32:06.954 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.954 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.954 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:06.954 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418471+0000", 2024-09-12T22:32:06.954 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6213e-05 2024-09-12T22:32:06.954 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.954 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.954 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:06.954 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418512+0000", 2024-09-12T22:32:06.954 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0589000000000001e-05 2024-09-12T22:32:06.954 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:06.955 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:06.955 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:06.955 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.955 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.955 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:06.955 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.406108+0000", 2024-09-12T22:32:06.955 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 29.434007602000001, 2024-09-12T22:32:06.955 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012458175, 2024-09-12T22:32:06.955 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:06.955 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:06.955 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:06.955 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:06.955 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.955 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:06.956 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406108+0000", 2024-09-12T22:32:06.956 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:06.956 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.956 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.956 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:06.956 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406108+0000", 2024-09-12T22:32:06.956 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:06.956 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.956 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.956 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:06.956 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406109+0000", 2024-09-12T22:32:06.956 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9899999999999999e-07 2024-09-12T22:32:06.956 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.956 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.957 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:06.957 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406115+0000", 2024-09-12T22:32:06.957 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9030000000000001e-06 2024-09-12T22:32:06.957 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.957 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.957 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:06.957 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406141+0000", 2024-09-12T22:32:06.957 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5999e-05 2024-09-12T22:32:06.957 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.957 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.957 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:06.957 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406150+0000", 2024-09-12T22:32:06.957 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.6050000000000004e-06 2024-09-12T22:32:06.958 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.958 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.958 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:06.958 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408163+0000", 2024-09-12T22:32:06.958 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0020122769999999998 2024-09-12T22:32:06.958 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.958 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.958 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:06.958 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408309+0000", 2024-09-12T22:32:06.958 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014606999999999999 2024-09-12T22:32:06.958 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.958 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.958 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:06.958 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408433+0000", 2024-09-12T22:32:06.959 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012460300000000001 2024-09-12T22:32:06.959 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.959 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.959 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:06.959 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409903+0000", 2024-09-12T22:32:06.959 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001469499 2024-09-12T22:32:06.959 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.959 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.959 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:06.959 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418427+0000", 2024-09-12T22:32:06.959 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0085241139999999993 2024-09-12T22:32:06.960 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.960 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.960 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:06.960 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418471+0000", 2024-09-12T22:32:06.960 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4474000000000001e-05 2024-09-12T22:32:06.960 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.960 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.961 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:06.961 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418566+0000", 2024-09-12T22:32:06.961 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.4732e-05 2024-09-12T22:32:06.961 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:06.961 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:06.961 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:06.961 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.961 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.961 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:06.961 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.407266+0000", 2024-09-12T22:32:06.961 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 29.432849745999999, 2024-09-12T22:32:06.961 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011442905, 2024-09-12T22:32:06.961 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:06.962 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:06.962 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2024-09-12T22:32:06.962 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:06.962 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.962 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:06.962 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407266+0000", 2024-09-12T22:32:06.962 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:06.962 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.962 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.962 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:06.962 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407266+0000", 2024-09-12T22:32:06.962 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:06.962 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.963 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.963 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:06.963 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407266+0000", 2024-09-12T22:32:06.963 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7899999999999998e-07 2024-09-12T22:32:06.963 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.963 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.963 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:06.963 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407269+0000", 2024-09-12T22:32:06.963 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9210000000000001e-06 2024-09-12T22:32:06.963 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.963 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.963 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:06.963 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407331+0000", 2024-09-12T22:32:06.963 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1376000000000003e-05 2024-09-12T22:32:06.964 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.964 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.964 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:06.964 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407337+0000", 2024-09-12T22:32:06.964 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1929999999999998e-06 2024-09-12T22:32:06.964 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.964 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.964 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:06.964 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408974+0000", 2024-09-12T22:32:06.964 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0016367109999999999 2024-09-12T22:32:06.964 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.965 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.965 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:06.965 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409112+0000", 2024-09-12T22:32:06.965 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000137952 2024-09-12T22:32:06.965 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:06.965 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:06.965 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:06.965 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418709+0000", 2024-09-12T22:32:06.965 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0095971730000000005 2024-09-12T22:32:06.965 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:06.965 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:06.965 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:06.965 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:06.966 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:06.966 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-09-12T22:32:06.967 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:06.966+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:06.968 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:32:07.068 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:32:07.067+0000 7fddec6a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30331) UID: 0 2024-09-12T22:32:07.080 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-09-12T22:32:07.080 INFO:teuthology.orchestra.run.smithi076.stdout: "ops": [], 2024-09-12T22:32:07.080 INFO:teuthology.orchestra.run.smithi076.stdout: "num_ops": 0 2024-09-12T22:32:07.080 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-09-12T22:32:07.089 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:32:07.131 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T22:32:07.169 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:07.168+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:07.233 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-09-12T22:32:07.233 INFO:teuthology.orchestra.run.smithi076.stdout: "ops": [], 2024-09-12T22:32:07.233 INFO:teuthology.orchestra.run.smithi076.stdout: "complaint_time": 30, 2024-09-12T22:32:07.233 INFO:teuthology.orchestra.run.smithi076.stdout: "num_blocked_ops": 0 2024-09-12T22:32:07.233 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-09-12T22:32:07.242 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:32:07.286 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:32:07.285+0000 7fddec6a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30331) UID: 0 2024-09-12T22:32:07.346 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-09-12T22:32:07.346 INFO:teuthology.orchestra.run.smithi076.stdout: "size": 20, 2024-09-12T22:32:07.346 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 600, 2024-09-12T22:32:07.346 INFO:teuthology.orchestra.run.smithi076.stdout: "ops": [ 2024-09-12T22:32:07.346 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.346 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:07.346 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.400604+0000", 2024-09-12T22:32:07.346 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 29.943468294999999, 2024-09-12T22:32:07.347 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.017278814, 2024-09-12T22:32:07.347 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:07.347 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:07.347 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:07.347 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:07.347 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.347 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:07.347 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400604+0000", 2024-09-12T22:32:07.347 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:07.347 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.347 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.347 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:07.347 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400604+0000", 2024-09-12T22:32:07.348 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:07.348 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.348 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.348 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:07.348 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400617+0000", 2024-09-12T22:32:07.348 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.3076e-05 2024-09-12T22:32:07.348 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.348 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.348 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:07.348 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400623+0000", 2024-09-12T22:32:07.348 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.5780000000000004e-06 2024-09-12T22:32:07.348 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.349 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.349 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:07.349 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400641+0000", 2024-09-12T22:32:07.349 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.8218000000000001e-05 2024-09-12T22:32:07.349 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.349 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.349 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:07.349 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400652+0000", 2024-09-12T22:32:07.349 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.0421999999999999e-05 2024-09-12T22:32:07.349 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.349 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.349 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:07.349 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400707+0000", 2024-09-12T22:32:07.349 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.4666000000000001e-05 2024-09-12T22:32:07.350 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.350 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.350 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op must wait for map", 2024-09-12T22:32:07.350 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400711+0000", 2024-09-12T22:32:07.350 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.5340000000000001e-06 2024-09-12T22:32:07.350 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.350 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.350 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:07.350 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.412066+0000", 2024-09-12T22:32:07.350 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.011354797999999999 2024-09-12T22:32:07.350 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.350 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.350 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:07.351 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.412672+0000", 2024-09-12T22:32:07.351 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00060620499999999996 2024-09-12T22:32:07.351 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.351 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.351 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:07.351 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.413032+0000", 2024-09-12T22:32:07.351 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00035955999999999998 2024-09-12T22:32:07.351 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.351 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.351 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op_commit", 2024-09-12T22:32:07.351 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417252+0000", 2024-09-12T22:32:07.351 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.004219899 2024-09-12T22:32:07.351 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.352 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.352 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:07.352 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417812+0000", 2024-09-12T22:32:07.352 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.000560182 2024-09-12T22:32:07.352 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.352 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.352 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:07.352 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417851+0000", 2024-09-12T22:32:07.352 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.9057999999999998e-05 2024-09-12T22:32:07.352 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.352 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.352 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:07.352 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417882+0000", 2024-09-12T22:32:07.353 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.1618000000000001e-05 2024-09-12T22:32:07.353 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:07.353 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:07.353 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:07.353 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.353 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.353 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:07.353 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.400674+0000", 2024-09-12T22:32:07.353 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 29.943397576999999, 2024-09-12T22:32:07.353 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.017348971000000001, 2024-09-12T22:32:07.353 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:07.353 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:07.353 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:07.354 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:07.354 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.354 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:07.354 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400674+0000", 2024-09-12T22:32:07.354 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:07.354 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.354 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.354 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:07.354 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400674+0000", 2024-09-12T22:32:07.354 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:07.354 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.354 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.354 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:07.354 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400675+0000", 2024-09-12T22:32:07.355 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.37e-07 2024-09-12T22:32:07.355 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.355 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.355 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:07.355 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400678+0000", 2024-09-12T22:32:07.355 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.303e-06 2024-09-12T22:32:07.355 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.355 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.355 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:07.355 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400684+0000", 2024-09-12T22:32:07.355 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.0290000000000002e-06 2024-09-12T22:32:07.355 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.355 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.356 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:07.356 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400688+0000", 2024-09-12T22:32:07.356 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.0890000000000002e-06 2024-09-12T22:32:07.356 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.356 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.356 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:07.356 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400806+0000", 2024-09-12T22:32:07.356 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00011814700000000001 2024-09-12T22:32:07.356 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.356 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.356 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:32:07.356 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400811+0000", 2024-09-12T22:32:07.357 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.0479999999999998e-06 2024-09-12T22:32:07.357 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.357 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.357 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:07.357 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.413877+0000", 2024-09-12T22:32:07.357 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.013065561 2024-09-12T22:32:07.357 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.357 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.357 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:07.357 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.413984+0000", 2024-09-12T22:32:07.357 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.000106566 2024-09-12T22:32:07.357 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.357 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.357 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:07.358 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.414264+0000", 2024-09-12T22:32:07.358 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00028067199999999999 2024-09-12T22:32:07.358 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.358 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.358 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op_commit", 2024-09-12T22:32:07.358 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417614+0000", 2024-09-12T22:32:07.358 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0033500729999999999 2024-09-12T22:32:07.358 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.358 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.358 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:07.358 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417946+0000", 2024-09-12T22:32:07.358 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00033209199999999998 2024-09-12T22:32:07.359 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.359 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.359 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:07.359 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417995+0000", 2024-09-12T22:32:07.359 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.808e-05 2024-09-12T22:32:07.359 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.359 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.359 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:07.359 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.418023+0000", 2024-09-12T22:32:07.359 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.8773999999999999e-05 2024-09-12T22:32:07.359 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:07.359 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:07.359 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:07.359 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.359 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.360 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:07.360 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.400694+0000", 2024-09-12T22:32:07.360 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 29.943377947999998, 2024-09-12T22:32:07.360 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.022845628, 2024-09-12T22:32:07.360 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:07.360 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:07.360 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:07.360 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:07.360 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.360 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:07.360 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400694+0000", 2024-09-12T22:32:07.360 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:07.360 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.361 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.361 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:07.361 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400694+0000", 2024-09-12T22:32:07.361 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:07.361 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.361 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.361 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:07.361 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400694+0000", 2024-09-12T22:32:07.361 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.48e-07 2024-09-12T22:32:07.361 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.361 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.361 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:07.361 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400709+0000", 2024-09-12T22:32:07.362 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.4888999999999999e-05 2024-09-12T22:32:07.362 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.362 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.362 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:07.362 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400722+0000", 2024-09-12T22:32:07.362 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.2882e-05 2024-09-12T22:32:07.362 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.362 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.362 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:07.362 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400732+0000", 2024-09-12T22:32:07.362 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.0299000000000001e-05 2024-09-12T22:32:07.362 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.363 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.363 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:07.363 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400793+0000", 2024-09-12T22:32:07.363 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.0253000000000001e-05 2024-09-12T22:32:07.363 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.363 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.363 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op must wait for map", 2024-09-12T22:32:07.363 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400798+0000", 2024-09-12T22:32:07.363 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.1569999999999999e-06 2024-09-12T22:32:07.363 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.364 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.364 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:07.364 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415059+0000", 2024-09-12T22:32:07.364 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.014260907 2024-09-12T22:32:07.364 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.364 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.364 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:07.364 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415396+0000", 2024-09-12T22:32:07.364 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00033720799999999997 2024-09-12T22:32:07.364 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.364 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.364 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:07.364 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415685+0000", 2024-09-12T22:32:07.365 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00028939900000000003 2024-09-12T22:32:07.365 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.365 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.365 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op_commit", 2024-09-12T22:32:07.365 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.418302+0000", 2024-09-12T22:32:07.365 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0026168039999999999 2024-09-12T22:32:07.365 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.365 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.365 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:07.366 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.423445+0000", 2024-09-12T22:32:07.366 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0051428150000000002 2024-09-12T22:32:07.366 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.366 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.366 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:07.366 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.423499+0000", 2024-09-12T22:32:07.366 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.3953000000000003e-05 2024-09-12T22:32:07.366 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.366 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.366 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:07.366 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.423540+0000", 2024-09-12T22:32:07.366 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.0813999999999999e-05 2024-09-12T22:32:07.366 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:07.367 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:07.367 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:07.367 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.367 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.367 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:07.367 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.400740+0000", 2024-09-12T22:32:07.367 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 29.943332224999999, 2024-09-12T22:32:07.367 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.022927528999999999, 2024-09-12T22:32:07.367 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:07.367 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:07.367 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:07.368 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:07.368 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.368 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:07.368 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400740+0000", 2024-09-12T22:32:07.368 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:07.368 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.368 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.368 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:07.368 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400740+0000", 2024-09-12T22:32:07.368 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:07.368 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.368 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.369 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:07.369 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400740+0000", 2024-09-12T22:32:07.369 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.3000000000000001e-07 2024-09-12T22:32:07.369 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.369 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.369 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:07.369 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400743+0000", 2024-09-12T22:32:07.369 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.5840000000000002e-06 2024-09-12T22:32:07.369 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.369 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.369 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:07.369 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400757+0000", 2024-09-12T22:32:07.369 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.3988999999999999e-05 2024-09-12T22:32:07.370 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.370 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.370 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:07.370 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400763+0000", 2024-09-12T22:32:07.370 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.686e-06 2024-09-12T22:32:07.370 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.370 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.370 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:07.370 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400818+0000", 2024-09-12T22:32:07.370 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.4941000000000001e-05 2024-09-12T22:32:07.370 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.370 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.371 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:32:07.371 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400824+0000", 2024-09-12T22:32:07.371 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.4600000000000002e-06 2024-09-12T22:32:07.371 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.371 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.371 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:07.371 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416227+0000", 2024-09-12T22:32:07.371 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.015403604 2024-09-12T22:32:07.371 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.371 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.371 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:07.371 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416306+0000", 2024-09-12T22:32:07.371 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 7.9126000000000001e-05 2024-09-12T22:32:07.372 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.372 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.372 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:07.372 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416678+0000", 2024-09-12T22:32:07.372 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00037105500000000002 2024-09-12T22:32:07.372 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.372 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.372 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op_commit", 2024-09-12T22:32:07.372 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.418363+0000", 2024-09-12T22:32:07.372 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.001685095 2024-09-12T22:32:07.372 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.372 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.372 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:07.373 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.423591+0000", 2024-09-12T22:32:07.373 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0052283980000000004 2024-09-12T22:32:07.373 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.373 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.373 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:07.373 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.423624+0000", 2024-09-12T22:32:07.373 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.3024000000000001e-05 2024-09-12T22:32:07.373 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.373 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.373 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:07.373 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.423667+0000", 2024-09-12T22:32:07.373 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.3136999999999997e-05 2024-09-12T22:32:07.373 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:07.374 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:07.374 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:07.374 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.374 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.374 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:07.374 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.400783+0000", 2024-09-12T22:32:07.374 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 29.943288693, 2024-09-12T22:32:07.374 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.016563729999999999, 2024-09-12T22:32:07.374 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:07.374 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:07.374 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:07.374 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:07.374 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.374 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:07.375 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400783+0000", 2024-09-12T22:32:07.375 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:07.375 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.375 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.375 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:07.375 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400783+0000", 2024-09-12T22:32:07.375 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:07.375 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.375 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.375 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:07.375 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400784+0000", 2024-09-12T22:32:07.375 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.5900000000000002e-07 2024-09-12T22:32:07.375 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.376 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.376 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:07.376 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400787+0000", 2024-09-12T22:32:07.376 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.1690000000000001e-06 2024-09-12T22:32:07.376 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.376 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.376 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:07.376 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400794+0000", 2024-09-12T22:32:07.376 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 7.058e-06 2024-09-12T22:32:07.376 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.376 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.376 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:07.376 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400798+0000", 2024-09-12T22:32:07.377 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.335e-06 2024-09-12T22:32:07.377 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.377 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.377 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:07.377 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400841+0000", 2024-09-12T22:32:07.377 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.2369e-05 2024-09-12T22:32:07.377 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.377 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.377 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op must wait for map", 2024-09-12T22:32:07.377 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400844+0000", 2024-09-12T22:32:07.377 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.128e-06 2024-09-12T22:32:07.377 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.378 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.378 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:07.378 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.410479+0000", 2024-09-12T22:32:07.378 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0096354189999999992 2024-09-12T22:32:07.378 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.378 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.378 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:07.378 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.410597+0000", 2024-09-12T22:32:07.378 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.000118305 2024-09-12T22:32:07.378 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.378 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.378 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:07.378 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.410838+0000", 2024-09-12T22:32:07.379 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.000240967 2024-09-12T22:32:07.379 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.379 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.379 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op_commit", 2024-09-12T22:32:07.379 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416489+0000", 2024-09-12T22:32:07.379 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0056507989999999998 2024-09-12T22:32:07.379 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.379 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.379 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:07.379 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417255+0000", 2024-09-12T22:32:07.379 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00076626199999999998 2024-09-12T22:32:07.379 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.379 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.379 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:07.380 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417306+0000", 2024-09-12T22:32:07.380 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.0319999999999999e-05 2024-09-12T22:32:07.380 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.380 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.380 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:07.380 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417347+0000", 2024-09-12T22:32:07.380 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.1140000000000003e-05 2024-09-12T22:32:07.380 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:07.380 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:07.380 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:07.380 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.380 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.380 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:07.381 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.400811+0000", 2024-09-12T22:32:07.381 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 29.943260624000001, 2024-09-12T22:32:07.381 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.017061263, 2024-09-12T22:32:07.381 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:07.381 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:07.381 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:07.381 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:07.381 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.381 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:07.381 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400811+0000", 2024-09-12T22:32:07.381 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:07.381 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.381 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.382 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:07.382 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400811+0000", 2024-09-12T22:32:07.382 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:07.382 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.382 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.382 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:07.382 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400812+0000", 2024-09-12T22:32:07.382 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.27e-07 2024-09-12T22:32:07.382 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.382 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.382 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:07.382 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400814+0000", 2024-09-12T22:32:07.382 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.553e-06 2024-09-12T22:32:07.382 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.383 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.383 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:07.383 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400819+0000", 2024-09-12T22:32:07.383 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.3569999999999997e-06 2024-09-12T22:32:07.383 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.383 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.383 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:07.383 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400824+0000", 2024-09-12T22:32:07.383 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.6820000000000002e-06 2024-09-12T22:32:07.383 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.383 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.383 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:07.383 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400871+0000", 2024-09-12T22:32:07.384 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.7311000000000002e-05 2024-09-12T22:32:07.384 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.384 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.384 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:32:07.384 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400875+0000", 2024-09-12T22:32:07.384 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.0960000000000001e-06 2024-09-12T22:32:07.384 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.384 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.384 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:07.384 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.412071+0000", 2024-09-12T22:32:07.384 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.011195999999999999 2024-09-12T22:32:07.384 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.385 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.385 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:07.385 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.412520+0000", 2024-09-12T22:32:07.385 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.000449522 2024-09-12T22:32:07.385 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.385 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.385 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:07.385 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.412655+0000", 2024-09-12T22:32:07.385 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00013487899999999999 2024-09-12T22:32:07.385 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.385 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.385 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op_commit", 2024-09-12T22:32:07.386 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417096+0000", 2024-09-12T22:32:07.386 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.004441113 2024-09-12T22:32:07.386 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.386 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.386 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:07.386 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417768+0000", 2024-09-12T22:32:07.386 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00067161100000000002 2024-09-12T22:32:07.386 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.386 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.386 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:07.386 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417834+0000", 2024-09-12T22:32:07.386 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.6058999999999999e-05 2024-09-12T22:32:07.386 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.386 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.386 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:07.387 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417873+0000", 2024-09-12T22:32:07.387 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.8753e-05 2024-09-12T22:32:07.387 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:07.387 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:07.387 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:07.387 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.387 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.387 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:07.387 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.400842+0000", 2024-09-12T22:32:07.387 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 29.943229917, 2024-09-12T22:32:07.387 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.022846262999999999, 2024-09-12T22:32:07.387 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:07.387 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:07.387 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:07.387 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:07.388 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.388 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:07.388 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400842+0000", 2024-09-12T22:32:07.388 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:07.388 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.388 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.388 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:07.388 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400842+0000", 2024-09-12T22:32:07.388 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:07.388 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.388 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.388 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:07.388 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400842+0000", 2024-09-12T22:32:07.389 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.9900000000000002e-07 2024-09-12T22:32:07.389 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.389 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.389 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:07.389 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400845+0000", 2024-09-12T22:32:07.389 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.8609999999999998e-06 2024-09-12T22:32:07.389 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.389 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.389 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:07.389 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400850+0000", 2024-09-12T22:32:07.389 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.634e-06 2024-09-12T22:32:07.389 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.389 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.389 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:07.390 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400855+0000", 2024-09-12T22:32:07.390 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.8339999999999998e-06 2024-09-12T22:32:07.390 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.390 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.390 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:07.390 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400886+0000", 2024-09-12T22:32:07.390 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.1393999999999998e-05 2024-09-12T22:32:07.390 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.390 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.390 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:32:07.390 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400888+0000", 2024-09-12T22:32:07.390 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.3470000000000001e-06 2024-09-12T22:32:07.390 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.390 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.390 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:07.391 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415640+0000", 2024-09-12T22:32:07.391 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.014751965000000001 2024-09-12T22:32:07.391 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.391 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.391 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:07.391 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415821+0000", 2024-09-12T22:32:07.391 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00018064399999999999 2024-09-12T22:32:07.391 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.391 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.391 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:07.391 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415949+0000", 2024-09-12T22:32:07.391 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00012816699999999999 2024-09-12T22:32:07.391 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.391 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.391 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op_commit", 2024-09-12T22:32:07.392 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.418337+0000", 2024-09-12T22:32:07.392 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0023878469999999998 2024-09-12T22:32:07.392 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.392 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.392 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:07.392 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.423588+0000", 2024-09-12T22:32:07.392 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0052509849999999997 2024-09-12T22:32:07.392 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.392 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.392 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:07.392 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.423650+0000", 2024-09-12T22:32:07.392 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.2026999999999994e-05 2024-09-12T22:32:07.392 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.392 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.393 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:07.393 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.423688+0000", 2024-09-12T22:32:07.393 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.8259000000000001e-05 2024-09-12T22:32:07.393 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:07.393 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:07.393 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:07.393 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.393 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.393 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:07.393 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.400862+0000", 2024-09-12T22:32:07.393 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 29.943209942999999, 2024-09-12T22:32:07.393 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.016404294, 2024-09-12T22:32:07.393 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:07.393 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:07.394 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "started", 2024-09-12T22:32:07.394 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:07.394 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.394 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:07.394 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400862+0000", 2024-09-12T22:32:07.394 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:07.394 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.394 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.394 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:07.394 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400862+0000", 2024-09-12T22:32:07.394 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:07.394 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.394 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.394 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:07.394 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400862+0000", 2024-09-12T22:32:07.395 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.8099999999999999e-07 2024-09-12T22:32:07.395 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.395 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.395 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:07.395 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400870+0000", 2024-09-12T22:32:07.395 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 8.1349999999999992e-06 2024-09-12T22:32:07.395 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.395 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.395 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:07.395 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400876+0000", 2024-09-12T22:32:07.395 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.2039999999999996e-06 2024-09-12T22:32:07.395 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.395 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.395 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:07.396 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400879+0000", 2024-09-12T22:32:07.396 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.529e-06 2024-09-12T22:32:07.396 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.396 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.396 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:07.396 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400912+0000", 2024-09-12T22:32:07.396 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.2653000000000001e-05 2024-09-12T22:32:07.396 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.396 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.396 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op must wait for map", 2024-09-12T22:32:07.396 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400915+0000", 2024-09-12T22:32:07.396 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.1099999999999999e-06 2024-09-12T22:32:07.396 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.396 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.396 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:07.397 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408727+0000", 2024-09-12T22:32:07.397 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0078123869999999996 2024-09-12T22:32:07.397 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.397 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.397 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:07.397 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408838+0000", 2024-09-12T22:32:07.397 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00011042700000000001 2024-09-12T22:32:07.397 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.397 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.397 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:07.397 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417266+0000", 2024-09-12T22:32:07.397 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0084285680000000009 2024-09-12T22:32:07.397 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:07.397 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:07.398 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:07.398 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.398 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.398 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:07.398 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.400889+0000", 2024-09-12T22:32:07.398 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 29.94318269, 2024-09-12T22:32:07.398 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.014929550999999999, 2024-09-12T22:32:07.398 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:07.398 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:07.398 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "started", 2024-09-12T22:32:07.398 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:07.398 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.398 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:07.398 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400889+0000", 2024-09-12T22:32:07.399 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:07.399 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.399 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.399 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:07.399 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400889+0000", 2024-09-12T22:32:07.399 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:07.399 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.399 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.399 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:07.399 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400890+0000", 2024-09-12T22:32:07.399 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.8699999999999995e-07 2024-09-12T22:32:07.399 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.399 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.399 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:07.400 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400893+0000", 2024-09-12T22:32:07.400 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.9569999999999998e-06 2024-09-12T22:32:07.400 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.400 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.400 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:07.400 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400899+0000", 2024-09-12T22:32:07.400 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.4189999999999999e-06 2024-09-12T22:32:07.400 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.400 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.400 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:07.400 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400905+0000", 2024-09-12T22:32:07.400 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.7880000000000003e-06 2024-09-12T22:32:07.400 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.400 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.401 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:07.401 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400943+0000", 2024-09-12T22:32:07.401 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.7852999999999998e-05 2024-09-12T22:32:07.401 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.401 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.401 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op must wait for map", 2024-09-12T22:32:07.401 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400945+0000", 2024-09-12T22:32:07.401 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.627e-06 2024-09-12T22:32:07.401 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.401 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.401 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:07.401 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408398+0000", 2024-09-12T22:32:07.401 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0074525879999999996 2024-09-12T22:32:07.402 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.402 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.402 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:07.402 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408581+0000", 2024-09-12T22:32:07.402 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00018321900000000001 2024-09-12T22:32:07.402 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.402 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.402 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:07.402 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415819+0000", 2024-09-12T22:32:07.402 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0072376130000000004 2024-09-12T22:32:07.402 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:07.402 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:07.402 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:07.402 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.403 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.403 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:25 3.7 e19/17 3:e0b41d06:::609.00000000:head v 19'2, mlcod=0'0)", 2024-09-12T22:32:07.403 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.402511+0000", 2024-09-12T22:32:07.403 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 29.941560547000002, 2024-09-12T22:32:07.403 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0089735260000000008, 2024-09-12T22:32:07.403 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:07.403 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:07.403 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:07.403 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:07.403 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.403 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:07.403 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.402511+0000", 2024-09-12T22:32:07.403 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:07.403 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.404 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.404 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:07.404 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.402511+0000", 2024-09-12T22:32:07.404 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:07.404 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.404 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.404 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:07.404 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.402512+0000", 2024-09-12T22:32:07.404 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 8.71e-07 2024-09-12T22:32:07.404 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.404 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.404 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:07.405 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.402520+0000", 2024-09-12T22:32:07.405 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 7.8529999999999992e-06 2024-09-12T22:32:07.405 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.405 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.405 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:07.405 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.402530+0000", 2024-09-12T22:32:07.405 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 9.859e-06 2024-09-12T22:32:07.405 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.405 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.405 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:07.405 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.402555+0000", 2024-09-12T22:32:07.405 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.4822000000000001e-05 2024-09-12T22:32:07.405 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.405 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.406 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:07.406 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.403173+0000", 2024-09-12T22:32:07.406 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00061813199999999997 2024-09-12T22:32:07.406 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.406 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.406 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:07.406 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.403195+0000", 2024-09-12T22:32:07.406 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.2286e-05 2024-09-12T22:32:07.406 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.406 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.406 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:07.406 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.411436+0000", 2024-09-12T22:32:07.406 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0082410539999999994 2024-09-12T22:32:07.407 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.407 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.407 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:07.407 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.411485+0000", 2024-09-12T22:32:07.407 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.8649000000000001e-05 2024-09-12T22:32:07.407 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:07.407 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:07.407 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:07.407 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.407 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.407 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:18 3.14 e19/17 3:2f55791f:::606.00000000:head v 19'1, mlcod=0'0)", 2024-09-12T22:32:07.407 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.406646+0000", 2024-09-12T22:32:07.407 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 29.937425394999998, 2024-09-12T22:32:07.407 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0082036980000000006, 2024-09-12T22:32:07.408 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:07.408 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:07.408 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:07.408 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:07.408 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.408 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:07.408 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406646+0000", 2024-09-12T22:32:07.408 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:07.408 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.408 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.408 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:07.408 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406646+0000", 2024-09-12T22:32:07.408 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:07.409 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.409 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.409 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:07.409 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406647+0000", 2024-09-12T22:32:07.409 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.4499999999999998e-07 2024-09-12T22:32:07.409 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.409 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.409 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:07.409 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406651+0000", 2024-09-12T22:32:07.409 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.0300000000000004e-06 2024-09-12T22:32:07.409 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.409 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.409 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:07.409 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406657+0000", 2024-09-12T22:32:07.410 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.1330000000000004e-06 2024-09-12T22:32:07.410 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.410 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.410 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:07.410 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406665+0000", 2024-09-12T22:32:07.410 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 8.3650000000000004e-06 2024-09-12T22:32:07.410 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.410 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.410 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:07.410 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406804+0000", 2024-09-12T22:32:07.410 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00013900699999999999 2024-09-12T22:32:07.410 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.411 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.411 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:07.411 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406833+0000", 2024-09-12T22:32:07.411 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.8243e-05 2024-09-12T22:32:07.411 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.411 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.411 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:07.411 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.414741+0000", 2024-09-12T22:32:07.411 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0079089620000000003 2024-09-12T22:32:07.412 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.412 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.412 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:07.412 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.414850+0000", 2024-09-12T22:32:07.412 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.000108713 2024-09-12T22:32:07.412 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:07.412 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:07.412 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:07.412 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.412 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.413 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:6 3.10 e19/17 3:0d82a743:::600.00000000:head v 19'1, mlcod=0'0)", 2024-09-12T22:32:07.413 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.406692+0000", 2024-09-12T22:32:07.413 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 29.937379627999999, 2024-09-12T22:32:07.413 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0093004430000000003, 2024-09-12T22:32:07.413 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:07.413 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:07.413 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:07.413 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:07.413 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.414 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:07.414 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406692+0000", 2024-09-12T22:32:07.414 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:07.414 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.414 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.414 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:07.414 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406692+0000", 2024-09-12T22:32:07.414 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:07.414 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.414 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.414 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:07.414 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406693+0000", 2024-09-12T22:32:07.414 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.6300000000000001e-07 2024-09-12T22:32:07.415 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.415 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.415 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:07.415 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406702+0000", 2024-09-12T22:32:07.415 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 9.5589999999999994e-06 2024-09-12T22:32:07.415 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.415 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.415 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:07.415 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406725+0000", 2024-09-12T22:32:07.415 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.2977999999999999e-05 2024-09-12T22:32:07.415 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.415 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.415 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:07.415 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406732+0000", 2024-09-12T22:32:07.416 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.8430000000000004e-06 2024-09-12T22:32:07.416 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.416 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.416 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:07.416 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406979+0000", 2024-09-12T22:32:07.416 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00024729199999999998 2024-09-12T22:32:07.416 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.416 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.416 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:07.416 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407000+0000", 2024-09-12T22:32:07.416 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.0573000000000001e-05 2024-09-12T22:32:07.416 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.417 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.417 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:07.417 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415928+0000", 2024-09-12T22:32:07.417 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0089286179999999993 2024-09-12T22:32:07.417 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.417 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.417 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:07.417 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415993+0000", 2024-09-12T22:32:07.417 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.4216999999999999e-05 2024-09-12T22:32:07.417 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:07.417 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:07.417 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:07.417 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.418 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.418 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:2 3.f e19/17 3:f1f69726:::400.00000000:head v 19'1, mlcod=0'0)", 2024-09-12T22:32:07.418 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.406942+0000", 2024-09-12T22:32:07.418 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 29.937129940999998, 2024-09-12T22:32:07.418 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0098433259999999995, 2024-09-12T22:32:07.418 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:07.418 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:07.418 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:07.418 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:07.418 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.418 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:07.418 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406942+0000", 2024-09-12T22:32:07.418 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:07.419 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.419 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.419 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:07.419 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406942+0000", 2024-09-12T22:32:07.419 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:07.419 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.419 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.419 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:07.419 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406943+0000", 2024-09-12T22:32:07.419 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.8800000000000002e-07 2024-09-12T22:32:07.419 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.419 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.419 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:07.419 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406949+0000", 2024-09-12T22:32:07.420 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.5869999999999998e-06 2024-09-12T22:32:07.420 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.420 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.420 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:07.420 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406960+0000", 2024-09-12T22:32:07.420 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.0873000000000001e-05 2024-09-12T22:32:07.420 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.420 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.420 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:07.420 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406970+0000", 2024-09-12T22:32:07.420 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 9.9119999999999993e-06 2024-09-12T22:32:07.420 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.420 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.421 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:07.421 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407535+0000", 2024-09-12T22:32:07.421 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00056508899999999996 2024-09-12T22:32:07.421 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.421 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.421 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:07.421 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407556+0000", 2024-09-12T22:32:07.421 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.1348999999999998e-05 2024-09-12T22:32:07.421 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.421 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.421 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:07.421 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416751+0000", 2024-09-12T22:32:07.421 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0091950109999999995 2024-09-12T22:32:07.422 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.422 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.422 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:07.422 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416785+0000", 2024-09-12T22:32:07.422 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.3917000000000001e-05 2024-09-12T22:32:07.422 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:07.422 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:07.422 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:07.422 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.422 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.422 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:19 3.14 e19/17 3:2f55791f:::606.00000000:head v 19'2, mlcod=0'0)", 2024-09-12T22:32:07.422 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.406983+0000", 2024-09-12T22:32:07.422 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 29.937088962000001, 2024-09-12T22:32:07.422 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0080362149999999993, 2024-09-12T22:32:07.423 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:07.423 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:07.423 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:07.423 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:07.423 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.423 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:07.423 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406983+0000", 2024-09-12T22:32:07.423 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:07.423 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.423 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.423 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:07.423 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406983+0000", 2024-09-12T22:32:07.423 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:07.423 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.424 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.424 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:07.424 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406983+0000", 2024-09-12T22:32:07.424 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.8200000000000001e-07 2024-09-12T22:32:07.424 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.424 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.424 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:07.424 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406999+0000", 2024-09-12T22:32:07.424 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.5747999999999999e-05 2024-09-12T22:32:07.424 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.424 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.424 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:07.425 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407006+0000", 2024-09-12T22:32:07.425 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 7.2609999999999996e-06 2024-09-12T22:32:07.425 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.425 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.425 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:07.425 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407035+0000", 2024-09-12T22:32:07.425 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.8214000000000001e-05 2024-09-12T22:32:07.425 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.425 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.425 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:07.425 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407092+0000", 2024-09-12T22:32:07.425 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.7027000000000001e-05 2024-09-12T22:32:07.425 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.425 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.425 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:07.426 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407126+0000", 2024-09-12T22:32:07.426 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.4082000000000003e-05 2024-09-12T22:32:07.426 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.426 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.426 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:07.426 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.414985+0000", 2024-09-12T22:32:07.426 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0078597319999999995 2024-09-12T22:32:07.426 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.426 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.426 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:07.426 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415019+0000", 2024-09-12T22:32:07.426 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.3769000000000001e-05 2024-09-12T22:32:07.426 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:07.426 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:07.427 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:07.427 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.427 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.427 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:7 3.10 e19/17 3:0d82a743:::600.00000000:head v 19'2, mlcod=0'0)", 2024-09-12T22:32:07.427 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.407048+0000", 2024-09-12T22:32:07.427 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 29.937023423999999, 2024-09-12T22:32:07.427 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.008979931, 2024-09-12T22:32:07.427 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:07.427 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:07.427 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:07.427 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:07.427 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.427 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:07.428 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407048+0000", 2024-09-12T22:32:07.428 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:07.428 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.428 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.428 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:07.428 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407048+0000", 2024-09-12T22:32:07.428 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:07.428 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.428 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.428 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:07.428 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407049+0000", 2024-09-12T22:32:07.428 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.9099999999999999e-07 2024-09-12T22:32:07.428 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.429 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.429 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:07.429 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407054+0000", 2024-09-12T22:32:07.429 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.1850000000000003e-06 2024-09-12T22:32:07.429 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.429 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.429 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:07.429 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407061+0000", 2024-09-12T22:32:07.429 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 7.0809999999999996e-06 2024-09-12T22:32:07.429 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.429 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.429 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:07.430 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407067+0000", 2024-09-12T22:32:07.430 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.9540000000000001e-06 2024-09-12T22:32:07.430 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.430 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.430 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:07.430 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407299+0000", 2024-09-12T22:32:07.430 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.000232122 2024-09-12T22:32:07.430 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.430 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.430 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:07.430 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407317+0000", 2024-09-12T22:32:07.430 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.7447000000000001e-05 2024-09-12T22:32:07.430 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.431 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.431 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:07.431 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415996+0000", 2024-09-12T22:32:07.431 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0086791799999999999 2024-09-12T22:32:07.431 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.431 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.431 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:07.431 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416028+0000", 2024-09-12T22:32:07.431 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.2570999999999997e-05 2024-09-12T22:32:07.431 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:07.431 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:07.431 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:07.431 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.431 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.432 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:8 3.10 e19/17 3:09401a81:::601.00000000:head v 19'3, mlcod=0'0)", 2024-09-12T22:32:07.432 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.407081+0000", 2024-09-12T22:32:07.432 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 29.936990733999998, 2024-09-12T22:32:07.432 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0089807270000000008, 2024-09-12T22:32:07.432 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:07.432 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:07.432 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:07.432 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:07.432 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.432 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:07.432 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407081+0000", 2024-09-12T22:32:07.432 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:07.433 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.433 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.433 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:07.433 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407081+0000", 2024-09-12T22:32:07.433 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:07.433 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.433 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.433 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:07.433 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407082+0000", 2024-09-12T22:32:07.433 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.7899999999999999e-07 2024-09-12T22:32:07.433 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.433 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.433 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:07.434 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407086+0000", 2024-09-12T22:32:07.434 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.7679999999999999e-06 2024-09-12T22:32:07.434 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.434 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.434 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:07.434 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407094+0000", 2024-09-12T22:32:07.434 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 8.1470000000000001e-06 2024-09-12T22:32:07.434 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.434 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.434 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:07.435 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407100+0000", 2024-09-12T22:32:07.435 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.4539999999999998e-06 2024-09-12T22:32:07.435 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.435 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.435 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:07.435 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407540+0000", 2024-09-12T22:32:07.435 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00043973699999999999 2024-09-12T22:32:07.435 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.435 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.435 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:07.435 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407553+0000", 2024-09-12T22:32:07.435 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.3368e-05 2024-09-12T22:32:07.435 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.436 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.436 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:07.436 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416032+0000", 2024-09-12T22:32:07.436 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0084793790000000004 2024-09-12T22:32:07.436 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.436 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.436 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:07.436 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416062+0000", 2024-09-12T22:32:07.436 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.9495000000000001e-05 2024-09-12T22:32:07.436 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:07.436 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:07.436 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:07.437 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.437 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.437 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:31 3.d e19/17 3:b50e409b:::mds_snaptable:head v 19'1, mlcod=0'0)", 2024-09-12T22:32:07.437 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.408508+0000", 2024-09-12T22:32:07.437 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 29.935564218, 2024-09-12T22:32:07.437 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0080056620000000002, 2024-09-12T22:32:07.437 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:07.437 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:07.437 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:07.438 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:07.438 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.438 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:07.438 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408508+0000", 2024-09-12T22:32:07.438 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:07.438 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.438 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.438 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:07.438 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408508+0000", 2024-09-12T22:32:07.438 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:07.438 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.438 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.438 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:07.439 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408508+0000", 2024-09-12T22:32:07.439 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.7e-07 2024-09-12T22:32:07.439 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.439 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.439 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:07.439 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408515+0000", 2024-09-12T22:32:07.439 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.4439999999999996e-06 2024-09-12T22:32:07.439 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.439 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.440 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:07.440 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408521+0000", 2024-09-12T22:32:07.440 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.2729999999999999e-06 2024-09-12T22:32:07.440 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.440 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.440 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:07.440 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408526+0000", 2024-09-12T22:32:07.440 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.3299999999999998e-06 2024-09-12T22:32:07.440 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.440 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.440 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:07.441 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.410190+0000", 2024-09-12T22:32:07.441 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.001663615 2024-09-12T22:32:07.441 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.441 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.441 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:07.441 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.410258+0000", 2024-09-12T22:32:07.441 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.8146999999999997e-05 2024-09-12T22:32:07.441 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.441 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.442 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:07.442 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416477+0000", 2024-09-12T22:32:07.442 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0062187329999999997 2024-09-12T22:32:07.442 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.442 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.442 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:07.442 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416513+0000", 2024-09-12T22:32:07.442 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.6650000000000003e-05 2024-09-12T22:32:07.442 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:07.442 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:07.443 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:07.443 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.443 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.443 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:9 3.10 e19/17 3:09401a81:::601.00000000:head v 19'4, mlcod=0'0)", 2024-09-12T22:32:07.443 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.408991+0000", 2024-09-12T22:32:07.443 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 29.935080467999999, 2024-09-12T22:32:07.443 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0080459209999999993, 2024-09-12T22:32:07.443 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:07.443 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:07.443 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:07.444 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:07.444 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.444 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:07.444 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408991+0000", 2024-09-12T22:32:07.444 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:07.444 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.444 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.444 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:07.444 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408991+0000", 2024-09-12T22:32:07.445 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:07.445 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.445 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.445 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:07.445 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408992+0000", 2024-09-12T22:32:07.445 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.1799999999999995e-07 2024-09-12T22:32:07.445 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.445 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.445 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:07.446 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409005+0000", 2024-09-12T22:32:07.446 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.261e-05 2024-09-12T22:32:07.446 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.446 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.446 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:07.446 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409015+0000", 2024-09-12T22:32:07.446 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.0001e-05 2024-09-12T22:32:07.446 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.446 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.447 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:07.447 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409023+0000", 2024-09-12T22:32:07.447 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 8.7569999999999993e-06 2024-09-12T22:32:07.447 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.447 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.447 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:07.447 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.411355+0000", 2024-09-12T22:32:07.447 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0023313520000000001 2024-09-12T22:32:07.447 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.447 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.447 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:07.447 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.411374+0000", 2024-09-12T22:32:07.448 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.8810000000000001e-05 2024-09-12T22:32:07.448 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.448 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.448 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:07.448 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416994+0000", 2024-09-12T22:32:07.448 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.005620524 2024-09-12T22:32:07.448 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.448 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.448 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:07.448 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417037+0000", 2024-09-12T22:32:07.448 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.3248999999999999e-05 2024-09-12T22:32:07.448 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:07.448 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:07.449 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:07.449 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.449 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.449 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:10 3.10 e19/17 3:0bd6d154:::602.00000000:head v 19'5, mlcod=0'0)", 2024-09-12T22:32:07.449 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.409038+0000", 2024-09-12T22:32:07.449 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 29.935033792999999, 2024-09-12T22:32:07.449 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0080541689999999999, 2024-09-12T22:32:07.449 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:07.449 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:07.449 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:07.449 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:07.450 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.450 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:07.450 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409038+0000", 2024-09-12T22:32:07.450 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:07.450 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.450 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.450 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:07.450 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409038+0000", 2024-09-12T22:32:07.450 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:07.450 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.450 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.450 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:07.451 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409038+0000", 2024-09-12T22:32:07.451 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.7899999999999999e-07 2024-09-12T22:32:07.451 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.451 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.451 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:07.451 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409043+0000", 2024-09-12T22:32:07.451 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.6589999999999998e-06 2024-09-12T22:32:07.451 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.451 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.451 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:07.451 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409050+0000", 2024-09-12T22:32:07.451 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 7.0829999999999998e-06 2024-09-12T22:32:07.451 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.452 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.452 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:07.452 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409058+0000", 2024-09-12T22:32:07.452 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 7.7309999999999993e-06 2024-09-12T22:32:07.452 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.452 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.452 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:07.452 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.411654+0000", 2024-09-12T22:32:07.452 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0025961650000000001 2024-09-12T22:32:07.452 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.452 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.452 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:07.452 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.411671+0000", 2024-09-12T22:32:07.453 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.7356000000000001e-05 2024-09-12T22:32:07.453 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.453 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.453 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:07.453 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417040+0000", 2024-09-12T22:32:07.453 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0053681889999999998 2024-09-12T22:32:07.453 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.453 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.453 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:07.453 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417092+0000", 2024-09-12T22:32:07.453 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.2607e-05 2024-09-12T22:32:07.454 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:07.454 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:07.454 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:07.454 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.454 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.454 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:11 3.10 e19/17 3:0bd6d154:::602.00000000:head v 19'6, mlcod=0'0)", 2024-09-12T22:32:07.454 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.409768+0000", 2024-09-12T22:32:07.454 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 29.934304352000002, 2024-09-12T22:32:07.454 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0074442759999999997, 2024-09-12T22:32:07.454 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:07.454 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:07.454 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:07.455 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:07.455 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.455 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:07.455 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409768+0000", 2024-09-12T22:32:07.455 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:07.455 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.455 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.455 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:07.455 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409768+0000", 2024-09-12T22:32:07.455 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:07.455 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.455 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.455 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:07.455 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409768+0000", 2024-09-12T22:32:07.455 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.37e-07 2024-09-12T22:32:07.456 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.456 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.456 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:07.456 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409775+0000", 2024-09-12T22:32:07.456 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.4670000000000001e-06 2024-09-12T22:32:07.456 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.456 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.456 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:07.456 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409793+0000", 2024-09-12T22:32:07.456 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.8162e-05 2024-09-12T22:32:07.456 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.456 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.456 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:07.457 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409954+0000", 2024-09-12T22:32:07.457 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00016072999999999999 2024-09-12T22:32:07.457 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.457 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.457 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:07.457 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.411943+0000", 2024-09-12T22:32:07.457 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0019897069999999998 2024-09-12T22:32:07.457 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.457 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.457 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:07.457 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.412069+0000", 2024-09-12T22:32:07.457 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00012546200000000001 2024-09-12T22:32:07.457 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.457 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.458 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:07.458 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417114+0000", 2024-09-12T22:32:07.458 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.005045023 2024-09-12T22:32:07.458 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:07.458 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:07.458 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:07.458 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417212+0000", 2024-09-12T22:32:07.458 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 9.8088e-05 2024-09-12T22:32:07.458 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:07.458 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:07.458 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:07.458 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:07.458 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:07.458 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-09-12T22:32:07.460 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:32:07.460 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:07.458+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:07.560 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:32:07.559+0000 7fddec6a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30331) UID: 0 2024-09-12T22:32:07.576 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:32:07.577 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:32:07.577 INFO:teuthology.orchestra.run.smithi148.stdout: "num_ops": 0 2024-09-12T22:32:07.577 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:32:07.587 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:32:07.661 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:07.660+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:07.691 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:32:07.691 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:32:07.691 INFO:teuthology.orchestra.run.smithi148.stdout: "complaint_time": 30, 2024-09-12T22:32:07.691 INFO:teuthology.orchestra.run.smithi148.stdout: "num_blocked_ops": 0 2024-09-12T22:32:07.692 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:32:07.700 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:32:07.762 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:07.760+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:07.806 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:32:07.806 INFO:teuthology.orchestra.run.smithi148.stdout: "size": 20, 2024-09-12T22:32:07.806 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 600, 2024-09-12T22:32:07.806 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [ 2024-09-12T22:32:07.806 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.806 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:07.806 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.400880+0000", 2024-09-12T22:32:07.806 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 30.402057152000001, 2024-09-12T22:32:07.806 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0095133660000000005, 2024-09-12T22:32:07.806 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:07.807 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:07.807 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:07.807 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:07.807 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.807 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:07.807 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400880+0000", 2024-09-12T22:32:07.807 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:07.807 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.807 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.807 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:07.807 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400880+0000", 2024-09-12T22:32:07.807 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:07.807 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.807 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.807 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:07.808 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400892+0000", 2024-09-12T22:32:07.808 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1941e-05 2024-09-12T22:32:07.808 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.808 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.808 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:07.808 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400900+0000", 2024-09-12T22:32:07.808 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0080000000000002e-06 2024-09-12T22:32:07.808 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.808 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.808 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:07.808 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400911+0000", 2024-09-12T22:32:07.808 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1452e-05 2024-09-12T22:32:07.808 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.809 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.809 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:07.809 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400922+0000", 2024-09-12T22:32:07.809 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0772e-05 2024-09-12T22:32:07.809 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.809 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.809 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:07.809 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401009+0000", 2024-09-12T22:32:07.809 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.7206000000000005e-05 2024-09-12T22:32:07.809 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.809 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.809 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:07.809 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401157+0000", 2024-09-12T22:32:07.809 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014831499999999999 2024-09-12T22:32:07.810 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.810 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.810 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:07.810 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401312+0000", 2024-09-12T22:32:07.810 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00015495600000000001 2024-09-12T22:32:07.810 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.810 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.810 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:07.810 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.403060+0000", 2024-09-12T22:32:07.810 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0017475220000000001 2024-09-12T22:32:07.810 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.811 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.811 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:07.811 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410300+0000", 2024-09-12T22:32:07.811 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0072403260000000001 2024-09-12T22:32:07.812 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.812 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.812 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:07.812 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410350+0000", 2024-09-12T22:32:07.812 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9814000000000001e-05 2024-09-12T22:32:07.812 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.812 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.812 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:07.812 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410393+0000", 2024-09-12T22:32:07.813 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3053999999999998e-05 2024-09-12T22:32:07.813 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:07.813 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:07.813 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:07.813 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.813 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.813 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:07.813 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.400952+0000", 2024-09-12T22:32:07.813 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 30.401985, 2024-09-12T22:32:07.813 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0096045620000000005, 2024-09-12T22:32:07.813 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:07.813 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:07.814 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:07.814 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:07.814 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.814 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:07.814 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400952+0000", 2024-09-12T22:32:07.814 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:07.814 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.814 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.814 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:07.814 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400952+0000", 2024-09-12T22:32:07.814 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:07.814 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.814 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.815 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:07.815 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400953+0000", 2024-09-12T22:32:07.815 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.8000000000000005e-07 2024-09-12T22:32:07.815 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.815 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.815 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:07.815 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400957+0000", 2024-09-12T22:32:07.815 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.33e-06 2024-09-12T22:32:07.815 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.815 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.815 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:07.816 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400966+0000", 2024-09-12T22:32:07.816 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1989999999999995e-06 2024-09-12T22:32:07.816 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.816 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.816 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:07.816 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400973+0000", 2024-09-12T22:32:07.816 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2779999999999999e-06 2024-09-12T22:32:07.816 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.816 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.816 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:07.816 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401696+0000", 2024-09-12T22:32:07.816 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00072363500000000003 2024-09-12T22:32:07.816 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.817 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.817 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:07.817 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401788+0000", 2024-09-12T22:32:07.817 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1862999999999998e-05 2024-09-12T22:32:07.817 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.817 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.817 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:07.817 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401929+0000", 2024-09-12T22:32:07.817 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014096000000000001 2024-09-12T22:32:07.817 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.817 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.817 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:07.817 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.403542+0000", 2024-09-12T22:32:07.818 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001612963 2024-09-12T22:32:07.818 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.818 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.818 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:07.818 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410460+0000", 2024-09-12T22:32:07.818 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0069180500000000002 2024-09-12T22:32:07.818 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.818 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.818 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:07.819 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410515+0000", 2024-09-12T22:32:07.819 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5009000000000001e-05 2024-09-12T22:32:07.819 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.819 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.819 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:07.819 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410557+0000", 2024-09-12T22:32:07.819 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1495000000000002e-05 2024-09-12T22:32:07.819 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:07.819 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:07.819 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:07.819 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.819 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.819 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:07.820 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.400984+0000", 2024-09-12T22:32:07.820 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 30.401952505000001, 2024-09-12T22:32:07.820 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0073703950000000001, 2024-09-12T22:32:07.820 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:07.820 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:07.820 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:07.820 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:07.820 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.820 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:07.821 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400984+0000", 2024-09-12T22:32:07.821 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:07.821 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.821 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.821 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:07.821 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400984+0000", 2024-09-12T22:32:07.821 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:07.821 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.821 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.821 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:07.821 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400985+0000", 2024-09-12T22:32:07.821 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3200000000000005e-07 2024-09-12T22:32:07.821 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.821 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.822 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:07.822 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400998+0000", 2024-09-12T22:32:07.822 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2726e-05 2024-09-12T22:32:07.822 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.822 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.822 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:07.822 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401006+0000", 2024-09-12T22:32:07.822 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.3110000000000006e-06 2024-09-12T22:32:07.822 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.823 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.823 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:07.823 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401022+0000", 2024-09-12T22:32:07.823 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6249e-05 2024-09-12T22:32:07.823 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.823 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.823 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:07.823 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401700+0000", 2024-09-12T22:32:07.823 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00067811100000000001 2024-09-12T22:32:07.823 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.823 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.823 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:07.823 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401839+0000", 2024-09-12T22:32:07.824 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013865399999999999 2024-09-12T22:32:07.824 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.824 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.824 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:07.824 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401962+0000", 2024-09-12T22:32:07.824 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000123266 2024-09-12T22:32:07.824 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.824 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.824 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:07.825 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.403589+0000", 2024-09-12T22:32:07.825 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001626932 2024-09-12T22:32:07.825 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.825 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.825 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:07.825 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.408274+0000", 2024-09-12T22:32:07.825 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0046848100000000002 2024-09-12T22:32:07.825 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.825 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.826 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:07.826 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.408324+0000", 2024-09-12T22:32:07.826 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9784000000000003e-05 2024-09-12T22:32:07.826 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.826 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.826 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:07.826 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.408355+0000", 2024-09-12T22:32:07.826 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.1019999999999998e-05 2024-09-12T22:32:07.826 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:07.826 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:07.827 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:07.827 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.827 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.827 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:07.827 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401034+0000", 2024-09-12T22:32:07.827 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 30.401903064999999, 2024-09-12T22:32:07.827 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011063051000000001, 2024-09-12T22:32:07.827 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:07.827 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:07.827 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:07.827 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:07.827 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.827 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:07.827 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401034+0000", 2024-09-12T22:32:07.828 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:07.828 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.828 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.828 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:07.828 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401034+0000", 2024-09-12T22:32:07.828 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:07.828 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.828 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.828 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:07.828 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401034+0000", 2024-09-12T22:32:07.828 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8899999999999999e-07 2024-09-12T22:32:07.828 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.828 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.829 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:07.829 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401038+0000", 2024-09-12T22:32:07.829 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.523e-06 2024-09-12T22:32:07.829 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.829 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.829 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:07.829 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401046+0000", 2024-09-12T22:32:07.829 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0479999999999999e-06 2024-09-12T22:32:07.829 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.829 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.829 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:07.829 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401051+0000", 2024-09-12T22:32:07.830 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2619999999999998e-06 2024-09-12T22:32:07.830 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.830 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.830 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:07.830 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402270+0000", 2024-09-12T22:32:07.830 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012182429999999999 2024-09-12T22:32:07.830 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.830 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.830 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:07.830 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402325+0000", 2024-09-12T22:32:07.830 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5526999999999999e-05 2024-09-12T22:32:07.830 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.830 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.830 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:07.831 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402403+0000", 2024-09-12T22:32:07.831 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.7559999999999996e-05 2024-09-12T22:32:07.831 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.831 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.831 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:07.831 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.403655+0000", 2024-09-12T22:32:07.831 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012521489999999999 2024-09-12T22:32:07.831 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.831 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.831 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:07.831 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411979+0000", 2024-09-12T22:32:07.831 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0083240420000000002 2024-09-12T22:32:07.831 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.832 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.832 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:07.832 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.412036+0000", 2024-09-12T22:32:07.832 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7639000000000002e-05 2024-09-12T22:32:07.832 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.832 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.832 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:07.832 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.412097+0000", 2024-09-12T22:32:07.832 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0469e-05 2024-09-12T22:32:07.832 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:07.832 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:07.832 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:07.832 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.832 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.833 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:07.833 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401060+0000", 2024-09-12T22:32:07.833 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 30.401877313, 2024-09-12T22:32:07.833 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.010030172, 2024-09-12T22:32:07.833 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:07.833 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:07.833 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:07.833 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:07.833 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.833 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:07.833 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401060+0000", 2024-09-12T22:32:07.833 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:07.833 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.833 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.834 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:07.834 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401060+0000", 2024-09-12T22:32:07.834 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:07.834 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.834 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.834 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:07.834 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401060+0000", 2024-09-12T22:32:07.834 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2500000000000001e-07 2024-09-12T22:32:07.834 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.835 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.835 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:07.835 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401063+0000", 2024-09-12T22:32:07.835 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0910000000000001e-06 2024-09-12T22:32:07.835 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.835 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.835 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:07.835 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401070+0000", 2024-09-12T22:32:07.835 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1210000000000001e-06 2024-09-12T22:32:07.835 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.835 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.835 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:07.835 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401076+0000", 2024-09-12T22:32:07.835 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2830000000000001e-06 2024-09-12T22:32:07.836 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.836 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.836 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:07.836 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402288+0000", 2024-09-12T22:32:07.836 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012123699999999999 2024-09-12T22:32:07.836 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.836 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.836 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:07.836 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402359+0000", 2024-09-12T22:32:07.836 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.0988000000000005e-05 2024-09-12T22:32:07.836 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.836 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.836 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:07.837 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402457+0000", 2024-09-12T22:32:07.837 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.7857999999999997e-05 2024-09-12T22:32:07.837 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.837 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.837 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:07.837 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.404395+0000", 2024-09-12T22:32:07.837 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0019380160000000001 2024-09-12T22:32:07.837 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.837 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.837 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:07.837 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410603+0000", 2024-09-12T22:32:07.837 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.006208061 2024-09-12T22:32:07.838 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.838 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.838 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:07.838 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410687+0000", 2024-09-12T22:32:07.838 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.4623000000000006e-05 2024-09-12T22:32:07.838 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.838 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.838 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:07.838 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411090+0000", 2024-09-12T22:32:07.838 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00040233599999999999 2024-09-12T22:32:07.838 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:07.838 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:07.838 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:07.839 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.839 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.839 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:07.839 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401083+0000", 2024-09-12T22:32:07.839 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 30.401853896999999, 2024-09-12T22:32:07.839 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0097591850000000001, 2024-09-12T22:32:07.839 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:07.839 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:07.839 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:07.839 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:07.839 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.839 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:07.839 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401083+0000", 2024-09-12T22:32:07.839 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:07.840 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.840 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.840 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:07.840 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401083+0000", 2024-09-12T22:32:07.840 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:07.840 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.840 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.840 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:07.840 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401084+0000", 2024-09-12T22:32:07.840 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4799999999999999e-07 2024-09-12T22:32:07.840 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.840 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.840 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:07.840 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401088+0000", 2024-09-12T22:32:07.841 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6419999999999998e-06 2024-09-12T22:32:07.841 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.841 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.841 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:07.841 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401094+0000", 2024-09-12T22:32:07.841 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0090000000000004e-06 2024-09-12T22:32:07.841 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.841 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.841 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:07.841 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401108+0000", 2024-09-12T22:32:07.841 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3884e-05 2024-09-12T22:32:07.841 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.841 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.842 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:07.842 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401165+0000", 2024-09-12T22:32:07.842 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.6499000000000002e-05 2024-09-12T22:32:07.842 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.842 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.842 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:07.842 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401261+0000", 2024-09-12T22:32:07.842 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.6872000000000004e-05 2024-09-12T22:32:07.842 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.842 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.842 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:07.842 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401376+0000", 2024-09-12T22:32:07.842 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000114508 2024-09-12T22:32:07.842 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.843 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.843 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:07.843 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402666+0000", 2024-09-12T22:32:07.843 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012901659999999999 2024-09-12T22:32:07.843 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.843 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.843 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:07.843 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410572+0000", 2024-09-12T22:32:07.843 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0079055489999999996 2024-09-12T22:32:07.843 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.843 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.843 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:07.843 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410661+0000", 2024-09-12T22:32:07.843 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.9578000000000002e-05 2024-09-12T22:32:07.844 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.844 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.844 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:07.844 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410842+0000", 2024-09-12T22:32:07.844 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00018102999999999999 2024-09-12T22:32:07.844 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:07.844 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:07.844 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:07.844 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.844 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.844 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:07.844 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401122+0000", 2024-09-12T22:32:07.844 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 30.401814864999999, 2024-09-12T22:32:07.845 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0099122080000000005, 2024-09-12T22:32:07.845 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:07.845 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:07.845 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:32:07.845 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:07.845 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.845 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:07.845 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401122+0000", 2024-09-12T22:32:07.845 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:07.845 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.845 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.845 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:07.845 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401122+0000", 2024-09-12T22:32:07.846 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:07.846 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.846 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.846 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:07.846 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401123+0000", 2024-09-12T22:32:07.846 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2600000000000002e-07 2024-09-12T22:32:07.846 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.846 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.846 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:07.846 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401126+0000", 2024-09-12T22:32:07.846 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.6449999999999998e-06 2024-09-12T22:32:07.846 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.846 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.847 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:07.847 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401133+0000", 2024-09-12T22:32:07.847 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.9890000000000003e-06 2024-09-12T22:32:07.847 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.847 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.847 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:07.847 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401138+0000", 2024-09-12T22:32:07.847 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8060000000000002e-06 2024-09-12T22:32:07.847 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.847 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.847 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:07.847 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401703+0000", 2024-09-12T22:32:07.847 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00056509099999999999 2024-09-12T22:32:07.848 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.848 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.848 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:07.848 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401837+0000", 2024-09-12T22:32:07.848 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013338799999999999 2024-09-12T22:32:07.848 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.848 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.848 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:07.848 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411034+0000", 2024-09-12T22:32:07.848 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.009197663 2024-09-12T22:32:07.848 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:07.848 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:07.848 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:07.849 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.849 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.849 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:07.849 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401158+0000", 2024-09-12T22:32:07.849 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 30.401779086000001, 2024-09-12T22:32:07.849 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.010292437999999999, 2024-09-12T22:32:07.849 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:07.849 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:07.849 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:32:07.849 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:07.849 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.849 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:07.849 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401158+0000", 2024-09-12T22:32:07.850 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:07.850 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.850 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.850 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:07.850 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401158+0000", 2024-09-12T22:32:07.850 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:07.850 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.850 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.850 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:07.850 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401158+0000", 2024-09-12T22:32:07.850 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9699999999999996e-07 2024-09-12T22:32:07.850 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.850 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.851 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:07.851 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401161+0000", 2024-09-12T22:32:07.851 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.7410000000000001e-06 2024-09-12T22:32:07.851 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.851 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.851 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:07.851 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401168+0000", 2024-09-12T22:32:07.851 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.844e-06 2024-09-12T22:32:07.851 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.851 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.851 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:07.851 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401174+0000", 2024-09-12T22:32:07.851 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4700000000000001e-06 2024-09-12T22:32:07.852 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.852 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.852 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:07.852 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402799+0000", 2024-09-12T22:32:07.852 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0016256409999999999 2024-09-12T22:32:07.852 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.852 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.852 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:07.852 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402893+0000", 2024-09-12T22:32:07.852 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.3807999999999994e-05 2024-09-12T22:32:07.852 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.852 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.852 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:07.853 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411450+0000", 2024-09-12T22:32:07.853 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0085573369999999999 2024-09-12T22:32:07.853 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:07.853 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:07.853 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:07.853 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.853 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.853 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:07.853 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401183+0000", 2024-09-12T22:32:07.853 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 30.401754233999998, 2024-09-12T22:32:07.853 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0068597830000000004, 2024-09-12T22:32:07.853 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:07.854 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:07.854 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:32:07.854 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:07.854 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.854 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:07.854 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401183+0000", 2024-09-12T22:32:07.854 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:07.854 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.854 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.854 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:07.854 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401183+0000", 2024-09-12T22:32:07.854 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:07.854 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.855 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.855 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:07.855 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401183+0000", 2024-09-12T22:32:07.855 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.6700000000000003e-07 2024-09-12T22:32:07.855 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.855 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.855 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:07.855 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401186+0000", 2024-09-12T22:32:07.855 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4679999999999999e-06 2024-09-12T22:32:07.855 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.855 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.855 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:07.855 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401192+0000", 2024-09-12T22:32:07.856 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.1519999999999997e-06 2024-09-12T22:32:07.856 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.856 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.856 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:07.856 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401197+0000", 2024-09-12T22:32:07.856 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4669999999999998e-06 2024-09-12T22:32:07.856 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.856 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.856 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:07.856 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401253+0000", 2024-09-12T22:32:07.856 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.6211000000000001e-05 2024-09-12T22:32:07.856 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.856 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.856 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:07.857 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401413+0000", 2024-09-12T22:32:07.857 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00016021399999999999 2024-09-12T22:32:07.857 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.857 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.857 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:07.857 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.408043+0000", 2024-09-12T22:32:07.857 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0066295039999999996 2024-09-12T22:32:07.857 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:07.857 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:07.857 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:07.857 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.857 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.857 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:20 3.1c e19/17 3:3ed09add:::607.00000000:head v 19'1, mlcod=0'0)", 2024-09-12T22:32:07.858 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.409642+0000", 2024-09-12T22:32:07.858 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 30.393294775000001, 2024-09-12T22:32:07.858 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0038816269999999999, 2024-09-12T22:32:07.858 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:07.858 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:07.858 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:07.858 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:07.858 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.858 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:07.858 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409642+0000", 2024-09-12T22:32:07.858 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:07.858 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.858 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.859 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:07.859 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409642+0000", 2024-09-12T22:32:07.859 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:07.859 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.859 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.859 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:07.859 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409642+0000", 2024-09-12T22:32:07.859 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.6899999999999999e-07 2024-09-12T22:32:07.859 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.859 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.859 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:07.859 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409648+0000", 2024-09-12T22:32:07.859 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.49e-06 2024-09-12T22:32:07.860 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.860 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.860 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:07.860 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409656+0000", 2024-09-12T22:32:07.860 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.2949999999999994e-06 2024-09-12T22:32:07.860 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.860 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.860 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:07.860 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409664+0000", 2024-09-12T22:32:07.860 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.1219999999999995e-06 2024-09-12T22:32:07.860 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.860 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.860 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:07.861 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409707+0000", 2024-09-12T22:32:07.861 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2222000000000003e-05 2024-09-12T22:32:07.861 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.861 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.861 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:07.861 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409724+0000", 2024-09-12T22:32:07.861 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7496999999999999e-05 2024-09-12T22:32:07.861 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.861 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.861 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:07.861 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413439+0000", 2024-09-12T22:32:07.861 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00371448 2024-09-12T22:32:07.861 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.861 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.862 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:07.862 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413524+0000", 2024-09-12T22:32:07.862 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.5252000000000003e-05 2024-09-12T22:32:07.862 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:07.862 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:07.862 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:07.862 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.862 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.862 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:28 3.13 e19/17 3:cd5a64a3:::100.00000000:head v 19'1, mlcod=0'0)", 2024-09-12T22:32:07.862 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.409681+0000", 2024-09-12T22:32:07.862 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 30.393256292, 2024-09-12T22:32:07.862 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0038708710000000001, 2024-09-12T22:32:07.863 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:07.863 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:07.863 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:07.863 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:07.863 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.863 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:07.863 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409681+0000", 2024-09-12T22:32:07.863 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:07.863 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.863 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.863 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:07.863 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409681+0000", 2024-09-12T22:32:07.863 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:07.863 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.864 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.864 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:07.864 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409681+0000", 2024-09-12T22:32:07.864 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3000000000000002e-07 2024-09-12T22:32:07.864 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.864 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.864 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:07.864 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409695+0000", 2024-09-12T22:32:07.864 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4313e-05 2024-09-12T22:32:07.864 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.864 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.864 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:07.864 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409703+0000", 2024-09-12T22:32:07.865 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4000000000000003e-06 2024-09-12T22:32:07.865 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.865 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.865 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:07.865 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409708+0000", 2024-09-12T22:32:07.865 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3190000000000002e-06 2024-09-12T22:32:07.865 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.865 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.865 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:07.865 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409875+0000", 2024-09-12T22:32:07.865 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000167329 2024-09-12T22:32:07.865 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.865 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.865 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:07.866 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409892+0000", 2024-09-12T22:32:07.866 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6957999999999999e-05 2024-09-12T22:32:07.866 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.866 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.866 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:07.866 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413457+0000", 2024-09-12T22:32:07.866 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0035651279999999999 2024-09-12T22:32:07.866 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.866 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.866 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:07.866 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413552+0000", 2024-09-12T22:32:07.866 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.4093999999999997e-05 2024-09-12T22:32:07.866 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:07.867 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:07.867 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:07.867 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.867 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.867 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:21 3.1c e19/17 3:3ed09add:::607.00000000:head v 19'2, mlcod=0'0)", 2024-09-12T22:32:07.867 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.409718+0000", 2024-09-12T22:32:07.867 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 30.393218627, 2024-09-12T22:32:07.867 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003851883, 2024-09-12T22:32:07.867 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:07.867 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:07.867 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:07.867 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:07.867 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.868 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:07.868 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409718+0000", 2024-09-12T22:32:07.868 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:07.868 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.868 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.868 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:07.868 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409718+0000", 2024-09-12T22:32:07.868 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:07.868 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.868 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.868 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:07.868 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409719+0000", 2024-09-12T22:32:07.868 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.16e-07 2024-09-12T22:32:07.868 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.869 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.869 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:07.869 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409722+0000", 2024-09-12T22:32:07.869 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.692e-06 2024-09-12T22:32:07.869 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.869 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.869 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:07.869 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409729+0000", 2024-09-12T22:32:07.869 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.516e-06 2024-09-12T22:32:07.869 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.869 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.869 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:07.869 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409750+0000", 2024-09-12T22:32:07.870 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1151000000000001e-05 2024-09-12T22:32:07.870 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.870 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.870 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:07.870 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410015+0000", 2024-09-12T22:32:07.870 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00026477599999999999 2024-09-12T22:32:07.870 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.870 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.870 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:07.870 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410104+0000", 2024-09-12T22:32:07.870 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.9586000000000006e-05 2024-09-12T22:32:07.870 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.870 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.870 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:07.871 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413528+0000", 2024-09-12T22:32:07.871 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0034237880000000001 2024-09-12T22:32:07.871 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.871 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.871 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:07.871 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413570+0000", 2024-09-12T22:32:07.871 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2157999999999999e-05 2024-09-12T22:32:07.871 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:07.871 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:07.871 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:07.871 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.871 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.871 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:27 3.13 e19/17 3:c91d4a1d:::mds0_inotable:head v 19'2, mlcod=0'0)", 2024-09-12T22:32:07.872 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.409760+0000", 2024-09-12T22:32:07.872 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 30.393177111, 2024-09-12T22:32:07.872 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0039301910000000004, 2024-09-12T22:32:07.872 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:07.872 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:07.872 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:07.872 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:07.872 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.872 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:07.872 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409760+0000", 2024-09-12T22:32:07.872 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:07.872 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.872 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.873 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:07.873 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409760+0000", 2024-09-12T22:32:07.873 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:07.873 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.873 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.873 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:07.873 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409760+0000", 2024-09-12T22:32:07.873 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.39e-07 2024-09-12T22:32:07.873 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.873 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.873 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:07.873 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409765+0000", 2024-09-12T22:32:07.873 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4449999999999998e-06 2024-09-12T22:32:07.874 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.874 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.874 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:07.874 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409771+0000", 2024-09-12T22:32:07.874 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7159999999999997e-06 2024-09-12T22:32:07.874 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.874 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.874 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:07.874 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409778+0000", 2024-09-12T22:32:07.874 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.331e-06 2024-09-12T22:32:07.874 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.874 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.874 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:07.874 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410191+0000", 2024-09-12T22:32:07.875 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00041348300000000003 2024-09-12T22:32:07.875 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.875 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.875 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:07.875 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410211+0000", 2024-09-12T22:32:07.875 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9933999999999999e-05 2024-09-12T22:32:07.875 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.875 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.875 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:07.875 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413638+0000", 2024-09-12T22:32:07.875 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003426854 2024-09-12T22:32:07.875 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.875 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.876 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:07.876 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413690+0000", 2024-09-12T22:32:07.876 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2089000000000002e-05 2024-09-12T22:32:07.876 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:07.876 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:07.876 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:07.876 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.876 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.876 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "pg_update_log_missing_reply(3.b epoch 19/17 rep_tid 4 lcod 19'2)", 2024-09-12T22:32:07.876 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.410060+0000", 2024-09-12T22:32:07.876 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 30.392877446, 2024-09-12T22:32:07.876 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00098016500000000007, 2024-09-12T22:32:07.876 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:07.877 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:07.877 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "reached pg", 2024-09-12T22:32:07.877 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:07.877 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.877 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:07.877 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410060+0000", 2024-09-12T22:32:07.877 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:07.877 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.877 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.877 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:07.877 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410060+0000", 2024-09-12T22:32:07.877 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:07.877 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.877 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.878 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:07.878 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410060+0000", 2024-09-12T22:32:07.878 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.8299999999999998e-07 2024-09-12T22:32:07.878 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.878 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.878 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:07.878 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410062+0000", 2024-09-12T22:32:07.878 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5749999999999999e-06 2024-09-12T22:32:07.878 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.878 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.878 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:07.878 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410070+0000", 2024-09-12T22:32:07.878 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.909e-06 2024-09-12T22:32:07.879 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.879 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.879 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:07.879 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410076+0000", 2024-09-12T22:32:07.879 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7049999999999996e-06 2024-09-12T22:32:07.879 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.879 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.879 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:07.879 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410943+0000", 2024-09-12T22:32:07.879 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00086681900000000001 2024-09-12T22:32:07.879 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.879 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.879 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:07.880 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411040+0000", 2024-09-12T22:32:07.880 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.6774000000000006e-05 2024-09-12T22:32:07.880 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:07.880 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:07.880 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:07.880 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.880 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.880 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e19/17 ondisk, result = 0)", 2024-09-12T22:32:07.880 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.410113+0000", 2024-09-12T22:32:07.880 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 30.392824179000002, 2024-09-12T22:32:07.880 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00098911599999999995, 2024-09-12T22:32:07.880 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:07.880 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:07.880 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:32:07.881 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:07.881 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.881 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:07.881 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410113+0000", 2024-09-12T22:32:07.881 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:07.881 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.881 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.881 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:07.881 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410113+0000", 2024-09-12T22:32:07.881 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:07.881 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.881 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.881 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:07.881 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410113+0000", 2024-09-12T22:32:07.882 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.99e-07 2024-09-12T22:32:07.882 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.882 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.882 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:07.882 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410115+0000", 2024-09-12T22:32:07.882 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.046e-06 2024-09-12T22:32:07.882 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.882 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.882 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:07.882 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410121+0000", 2024-09-12T22:32:07.882 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0050000000000001e-06 2024-09-12T22:32:07.882 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.882 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.882 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:07.883 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410126+0000", 2024-09-12T22:32:07.883 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8339999999999998e-06 2024-09-12T22:32:07.883 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.883 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.883 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:07.883 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410587+0000", 2024-09-12T22:32:07.883 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00046095499999999998 2024-09-12T22:32:07.883 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.883 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.883 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:07.883 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410595+0000", 2024-09-12T22:32:07.883 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.9419999999999995e-06 2024-09-12T22:32:07.883 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.884 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.884 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:07.884 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411102+0000", 2024-09-12T22:32:07.884 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00050713500000000003 2024-09-12T22:32:07.884 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:07.884 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:07.884 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:07.884 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.884 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.884 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 19/17 rep_tid 8 lcod 19'4)", 2024-09-12T22:32:07.884 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.410133+0000", 2024-09-12T22:32:07.884 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 30.392804251000001, 2024-09-12T22:32:07.885 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0013504000000000001, 2024-09-12T22:32:07.885 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:07.885 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:07.885 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "reached pg", 2024-09-12T22:32:07.885 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:07.885 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.885 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:07.885 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410133+0000", 2024-09-12T22:32:07.885 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:07.885 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.885 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.885 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:07.885 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410133+0000", 2024-09-12T22:32:07.886 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:07.886 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.886 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.886 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:07.886 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410133+0000", 2024-09-12T22:32:07.886 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.0599999999999999e-07 2024-09-12T22:32:07.886 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.886 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.887 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:07.887 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410135+0000", 2024-09-12T22:32:07.887 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7770000000000001e-06 2024-09-12T22:32:07.887 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.887 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.887 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:07.887 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410140+0000", 2024-09-12T22:32:07.887 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9960000000000001e-06 2024-09-12T22:32:07.887 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.887 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.887 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:07.888 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410144+0000", 2024-09-12T22:32:07.888 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9500000000000003e-06 2024-09-12T22:32:07.888 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.888 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.888 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:07.888 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411310+0000", 2024-09-12T22:32:07.888 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001166311 2024-09-12T22:32:07.888 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.888 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.888 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:07.888 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411483+0000", 2024-09-12T22:32:07.888 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00017316 2024-09-12T22:32:07.889 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:07.889 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:07.889 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:07.889 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.889 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.889 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "pg_update_log_missing(3.1a epoch 19/17 rep_tid 0 entries 19'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T22:32:07.889 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.410617+0000", 2024-09-12T22:32:07.889 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 30.392319856, 2024-09-12T22:32:07.889 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0030439709999999999, 2024-09-12T22:32:07.889 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:07.889 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:07.889 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "reached pg", 2024-09-12T22:32:07.890 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:07.890 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.890 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:07.890 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410617+0000", 2024-09-12T22:32:07.890 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:07.890 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.890 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.890 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:07.890 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410617+0000", 2024-09-12T22:32:07.890 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:07.890 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.890 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.890 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:07.891 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410617+0000", 2024-09-12T22:32:07.891 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3599999999999999e-07 2024-09-12T22:32:07.891 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.891 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.891 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:07.891 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410625+0000", 2024-09-12T22:32:07.891 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5410000000000003e-06 2024-09-12T22:32:07.891 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.891 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.891 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:07.891 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410638+0000", 2024-09-12T22:32:07.891 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3261999999999999e-05 2024-09-12T22:32:07.891 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.891 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.892 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:07.892 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410653+0000", 2024-09-12T22:32:07.892 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4844000000000001e-05 2024-09-12T22:32:07.892 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.892 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.892 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:07.892 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410814+0000", 2024-09-12T22:32:07.892 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00016119999999999999 2024-09-12T22:32:07.892 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.892 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.892 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:07.892 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413661+0000", 2024-09-12T22:32:07.892 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0028467879999999998 2024-09-12T22:32:07.893 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:07.893 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:07.893 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:07.893 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.893 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.893 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-09-12T22:32:07.893 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:39.398875+0000", 2024-09-12T22:32:07.893 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 28.404061576, 2024-09-12T22:32:07.893 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0015679069999999999, 2024-09-12T22:32:07.893 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:07.893 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:07.893 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:07.893 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:07.893 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.894 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:07.894 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398875+0000", 2024-09-12T22:32:07.894 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:07.894 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.894 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.894 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:07.894 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398875+0000", 2024-09-12T22:32:07.894 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:07.894 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.894 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.894 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:07.894 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398878+0000", 2024-09-12T22:32:07.894 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1679999999999998e-06 2024-09-12T22:32:07.894 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.895 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.895 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:07.895 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398888+0000", 2024-09-12T22:32:07.895 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.084e-05 2024-09-12T22:32:07.895 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.895 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.895 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:07.895 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398906+0000", 2024-09-12T22:32:07.895 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7518000000000001e-05 2024-09-12T22:32:07.895 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.895 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.895 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:07.895 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398914+0000", 2024-09-12T22:32:07.895 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5989999999999996e-06 2024-09-12T22:32:07.896 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.896 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.896 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:07.896 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398974+0000", 2024-09-12T22:32:07.896 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0988e-05 2024-09-12T22:32:07.896 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.896 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.896 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:07.896 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.399078+0000", 2024-09-12T22:32:07.896 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000103133 2024-09-12T22:32:07.896 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.896 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.896 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:07.897 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.399166+0000", 2024-09-12T22:32:07.897 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.8183999999999995e-05 2024-09-12T22:32:07.897 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.897 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.897 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:07.897 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.399747+0000", 2024-09-12T22:32:07.897 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00058110599999999996 2024-09-12T22:32:07.897 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.897 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.897 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:07.897 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.400377+0000", 2024-09-12T22:32:07.897 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000630157 2024-09-12T22:32:07.897 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.897 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.897 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:07.898 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.400415+0000", 2024-09-12T22:32:07.898 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7814000000000001e-05 2024-09-12T22:32:07.898 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.898 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.898 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:07.898 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.400443+0000", 2024-09-12T22:32:07.898 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8399999999999999e-05 2024-09-12T22:32:07.898 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:07.898 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:07.898 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:07.898 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.898 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.898 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e23)", 2024-09-12T22:32:07.899 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:58.400966+0000", 2024-09-12T22:32:07.899 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 9.4019706680000006, 2024-09-12T22:32:07.899 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001468876, 2024-09-12T22:32:07.899 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:07.899 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:07.899 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:07.899 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:07.899 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.899 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:07.899 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400966+0000", 2024-09-12T22:32:07.899 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:07.899 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.899 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.900 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:07.900 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400966+0000", 2024-09-12T22:32:07.900 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:07.900 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.900 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.900 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:07.900 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400967+0000", 2024-09-12T22:32:07.900 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.046e-06 2024-09-12T22:32:07.900 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.900 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.901 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:07.901 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400974+0000", 2024-09-12T22:32:07.901 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2310000000000001e-06 2024-09-12T22:32:07.901 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.901 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.901 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:07.901 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400988+0000", 2024-09-12T22:32:07.901 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4482e-05 2024-09-12T22:32:07.901 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.901 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.901 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:07.901 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400997+0000", 2024-09-12T22:32:07.901 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.0189999999999995e-06 2024-09-12T22:32:07.902 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.902 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.902 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:07.902 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.401068+0000", 2024-09-12T22:32:07.902 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1426000000000004e-05 2024-09-12T22:32:07.902 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.902 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.902 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:07.902 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.401174+0000", 2024-09-12T22:32:07.902 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000105769 2024-09-12T22:32:07.902 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.902 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.902 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:07.903 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.401335+0000", 2024-09-12T22:32:07.903 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000161225 2024-09-12T22:32:07.903 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.903 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.903 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:07.903 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.402110+0000", 2024-09-12T22:32:07.903 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00077428800000000004 2024-09-12T22:32:07.903 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.903 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.903 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:07.903 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.402333+0000", 2024-09-12T22:32:07.903 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000223723 2024-09-12T22:32:07.903 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.903 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.904 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:07.904 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.402388+0000", 2024-09-12T22:32:07.904 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4700999999999997e-05 2024-09-12T22:32:07.904 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.904 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.904 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:07.904 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.402435+0000", 2024-09-12T22:32:07.904 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6965999999999997e-05 2024-09-12T22:32:07.904 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:07.904 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:07.904 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:07.904 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.904 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.905 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:45 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e27)", 2024-09-12T22:32:07.905 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:32:04.401614+0000", 2024-09-12T22:32:07.905 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 3.4013232389999999, 2024-09-12T22:32:07.905 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0014279749999999999, 2024-09-12T22:32:07.905 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:07.905 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:07.905 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:07.905 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:07.905 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.905 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:07.905 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401614+0000", 2024-09-12T22:32:07.905 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:07.905 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.905 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.906 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:07.906 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401614+0000", 2024-09-12T22:32:07.906 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:07.906 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.906 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.906 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:07.906 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401615+0000", 2024-09-12T22:32:07.906 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.161e-06 2024-09-12T22:32:07.906 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.906 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.906 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:07.906 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401621+0000", 2024-09-12T22:32:07.906 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8730000000000004e-06 2024-09-12T22:32:07.906 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.907 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.907 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:07.907 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401633+0000", 2024-09-12T22:32:07.907 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1800000000000001e-05 2024-09-12T22:32:07.907 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.907 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.907 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:07.907 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401656+0000", 2024-09-12T22:32:07.907 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.3521999999999999e-05 2024-09-12T22:32:07.907 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.907 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.907 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:07.907 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401713+0000", 2024-09-12T22:32:07.908 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7259000000000002e-05 2024-09-12T22:32:07.908 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.908 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.908 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:07.908 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401849+0000", 2024-09-12T22:32:07.908 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013613500000000001 2024-09-12T22:32:07.908 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.908 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.908 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:07.908 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.402009+0000", 2024-09-12T22:32:07.908 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00015947199999999999 2024-09-12T22:32:07.908 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.908 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.908 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:07.909 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.402629+0000", 2024-09-12T22:32:07.909 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00061962200000000001 2024-09-12T22:32:07.909 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.909 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.909 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:07.909 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.402983+0000", 2024-09-12T22:32:07.909 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00035447499999999998 2024-09-12T22:32:07.909 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.909 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.909 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:07.909 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.403016+0000", 2024-09-12T22:32:07.909 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3108999999999998e-05 2024-09-12T22:32:07.909 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:07.909 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:07.910 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:07.910 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.403042+0000", 2024-09-12T22:32:07.910 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5547000000000001e-05 2024-09-12T22:32:07.910 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:07.910 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:07.910 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:07.910 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:07.910 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:07.910 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:32:07.912 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:32:07.912 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:07.910+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:08.013 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:08.012+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:08.026 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-09-12T22:32:08.026 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-09-12T22:32:08.026 INFO:teuthology.orchestra.run.smithi163.stdout: "num_ops": 0 2024-09-12T22:32:08.026 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-09-12T22:32:08.035 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:32:08.114 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:08.112+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:08.128 INFO:teuthology.orchestra.run.smithi019.stderr:noscrub is set 2024-09-12T22:32:08.138 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-09-12T22:32:08.138 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-09-12T22:32:08.138 INFO:teuthology.orchestra.run.smithi163.stdout: "complaint_time": 30, 2024-09-12T22:32:08.138 INFO:teuthology.orchestra.run.smithi163.stdout: "num_blocked_ops": 0 2024-09-12T22:32:08.138 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-09-12T22:32:08.147 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:32:08.232 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:08.231+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:08.293 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-09-12T22:32:08.293 INFO:teuthology.orchestra.run.smithi163.stdout: "size": 20, 2024-09-12T22:32:08.293 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 600, 2024-09-12T22:32:08.293 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2024-09-12T22:32:08.293 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.294 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-09-12T22:32:08.294 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:27.254459+0000", 2024-09-12T22:32:08.294 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 41.036257374999998, 2024-09-12T22:32:08.294 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.37816283899999997, 2024-09-12T22:32:08.294 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:08.294 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:08.294 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:08.294 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:08.294 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:08.294 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:08.295 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 1 2024-09-12T22:32:08.295 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.295 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:08.295 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.295 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:08.295 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254459+0000", 2024-09-12T22:32:08.296 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:08.296 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.296 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.296 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:08.296 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254459+0000", 2024-09-12T22:32:08.296 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:08.296 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.296 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.296 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:08.296 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254460+0000", 2024-09-12T22:32:08.296 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1739999999999999e-06 2024-09-12T22:32:08.297 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.297 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.297 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:08.297 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254472+0000", 2024-09-12T22:32:08.297 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2207e-05 2024-09-12T22:32:08.297 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.297 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.298 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:08.298 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254483+0000", 2024-09-12T22:32:08.298 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0631999999999999e-05 2024-09-12T22:32:08.298 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.298 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.298 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:08.298 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254492+0000", 2024-09-12T22:32:08.298 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3670000000000003e-06 2024-09-12T22:32:08.298 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.298 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.298 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:08.298 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254551+0000", 2024-09-12T22:32:08.298 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8687999999999998e-05 2024-09-12T22:32:08.298 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.299 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.299 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for peered", 2024-09-12T22:32:08.299 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254562+0000", 2024-09-12T22:32:08.299 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1249e-05 2024-09-12T22:32:08.299 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.299 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.299 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:08.299 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.631211+0000", 2024-09-12T22:32:08.299 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.376649018 2024-09-12T22:32:08.299 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.299 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.299 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:08.299 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.631345+0000", 2024-09-12T22:32:08.300 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013378700000000001 2024-09-12T22:32:08.300 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.300 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.300 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:08.300 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.631479+0000", 2024-09-12T22:32:08.300 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013352399999999999 2024-09-12T22:32:08.300 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.300 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.301 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:08.301 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632324+0000", 2024-09-12T22:32:08.301 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00084508100000000002 2024-09-12T22:32:08.301 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.301 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.301 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:08.301 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632548+0000", 2024-09-12T22:32:08.301 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000224329 2024-09-12T22:32:08.301 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.302 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.302 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:08.302 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632591+0000", 2024-09-12T22:32:08.302 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2564000000000001e-05 2024-09-12T22:32:08.302 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.302 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.302 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:08.303 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632622+0000", 2024-09-12T22:32:08.303 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1219e-05 2024-09-12T22:32:08.303 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:08.303 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:08.303 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:08.303 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.303 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.303 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:185 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:32:08.303 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394355+0000", 2024-09-12T22:32:08.303 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 39.896361278000001, 2024-09-12T22:32:08.303 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011302394, 2024-09-12T22:32:08.303 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:08.303 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:08.304 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:08.304 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:08.304 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:08.304 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:08.304 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 185 2024-09-12T22:32:08.304 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.304 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:08.304 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.304 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:08.304 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394355+0000", 2024-09-12T22:32:08.304 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:08.304 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.304 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.304 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:08.305 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394355+0000", 2024-09-12T22:32:08.305 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:08.305 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.305 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.305 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:08.305 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394355+0000", 2024-09-12T22:32:08.305 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9099999999999999e-07 2024-09-12T22:32:08.305 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.305 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.305 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:08.305 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394385+0000", 2024-09-12T22:32:08.305 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9963000000000001e-05 2024-09-12T22:32:08.305 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.306 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.306 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:08.306 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394390+0000", 2024-09-12T22:32:08.306 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8420000000000004e-06 2024-09-12T22:32:08.306 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.306 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.306 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:08.306 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394393+0000", 2024-09-12T22:32:08.306 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1e-06 2024-09-12T22:32:08.306 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.306 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.306 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:08.306 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.400546+0000", 2024-09-12T22:32:08.306 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0061523309999999996 2024-09-12T22:32:08.307 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.307 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.307 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:08.307 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.400588+0000", 2024-09-12T22:32:08.307 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1835000000000002e-05 2024-09-12T22:32:08.307 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.307 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.307 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:08.307 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.400677+0000", 2024-09-12T22:32:08.307 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9195000000000002e-05 2024-09-12T22:32:08.307 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.308 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.308 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:08.308 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405378+0000", 2024-09-12T22:32:08.308 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0047008659999999997 2024-09-12T22:32:08.308 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.308 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.308 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:08.308 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405569+0000", 2024-09-12T22:32:08.308 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00019148599999999999 2024-09-12T22:32:08.308 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.308 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.308 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:08.308 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405620+0000", 2024-09-12T22:32:08.309 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1416999999999999e-05 2024-09-12T22:32:08.309 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.309 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.309 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:08.309 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405657+0000", 2024-09-12T22:32:08.309 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6968000000000002e-05 2024-09-12T22:32:08.309 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:08.309 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:08.309 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:08.309 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.309 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.309 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:32:08.310 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394399+0000", 2024-09-12T22:32:08.310 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 39.896317066999998, 2024-09-12T22:32:08.310 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011336601999999999, 2024-09-12T22:32:08.310 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:08.310 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:08.310 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:08.310 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:08.310 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:08.310 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:08.310 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 186 2024-09-12T22:32:08.310 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.310 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:08.310 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.311 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:08.311 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394399+0000", 2024-09-12T22:32:08.311 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:08.311 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.311 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.311 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:08.311 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394399+0000", 2024-09-12T22:32:08.311 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:08.311 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.311 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.311 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:08.311 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394400+0000", 2024-09-12T22:32:08.311 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4499999999999998e-07 2024-09-12T22:32:08.311 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.312 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.312 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:08.312 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394402+0000", 2024-09-12T22:32:08.312 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.875e-06 2024-09-12T22:32:08.312 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.312 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.312 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:08.312 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394405+0000", 2024-09-12T22:32:08.313 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6799999999999999e-06 2024-09-12T22:32:08.313 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.313 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.313 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:08.313 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394408+0000", 2024-09-12T22:32:08.313 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.667e-06 2024-09-12T22:32:08.313 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.313 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.313 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:08.314 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401395+0000", 2024-09-12T22:32:08.314 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0069867230000000002 2024-09-12T22:32:08.314 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.314 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.314 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:08.314 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401438+0000", 2024-09-12T22:32:08.314 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3554999999999999e-05 2024-09-12T22:32:08.314 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.314 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.314 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:08.314 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401509+0000", 2024-09-12T22:32:08.314 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0631999999999997e-05 2024-09-12T22:32:08.314 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.314 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.315 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:08.315 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405392+0000", 2024-09-12T22:32:08.315 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0038830449999999999 2024-09-12T22:32:08.315 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.315 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.315 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:08.315 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405690+0000", 2024-09-12T22:32:08.315 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000298435 2024-09-12T22:32:08.315 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.315 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.315 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:08.315 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405716+0000", 2024-09-12T22:32:08.315 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5435999999999998e-05 2024-09-12T22:32:08.315 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.316 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.316 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:08.316 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405736+0000", 2024-09-12T22:32:08.316 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0208999999999999e-05 2024-09-12T22:32:08.316 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:08.316 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:08.316 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:08.316 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.316 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.316 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:32:08.317 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394411+0000", 2024-09-12T22:32:08.317 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 39.896304940999997, 2024-09-12T22:32:08.317 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011400117, 2024-09-12T22:32:08.317 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:08.317 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:08.317 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:08.317 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:08.317 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:08.317 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:08.317 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 187 2024-09-12T22:32:08.317 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.317 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:08.317 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.317 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:08.318 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394411+0000", 2024-09-12T22:32:08.318 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:08.318 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.318 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.318 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:08.318 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394411+0000", 2024-09-12T22:32:08.318 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:08.318 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.318 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.318 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:08.318 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394412+0000", 2024-09-12T22:32:08.318 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.4999999999999999e-07 2024-09-12T22:32:08.319 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.319 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.319 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:08.319 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394414+0000", 2024-09-12T22:32:08.319 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.984e-06 2024-09-12T22:32:08.319 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.319 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.319 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:08.319 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394418+0000", 2024-09-12T22:32:08.319 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0840000000000002e-06 2024-09-12T22:32:08.319 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.319 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.319 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:08.319 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394431+0000", 2024-09-12T22:32:08.319 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.361e-05 2024-09-12T22:32:08.320 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.320 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.320 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:08.320 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401778+0000", 2024-09-12T22:32:08.320 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0073462659999999997 2024-09-12T22:32:08.320 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.320 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.320 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:08.320 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401853+0000", 2024-09-12T22:32:08.320 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5797000000000006e-05 2024-09-12T22:32:08.320 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.320 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.320 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:08.320 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401990+0000", 2024-09-12T22:32:08.321 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013651399999999999 2024-09-12T22:32:08.321 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.321 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.321 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:08.321 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405402+0000", 2024-09-12T22:32:08.321 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0034116070000000001 2024-09-12T22:32:08.321 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.321 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.321 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:08.321 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405764+0000", 2024-09-12T22:32:08.321 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00036234899999999998 2024-09-12T22:32:08.321 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.321 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.321 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:08.322 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405791+0000", 2024-09-12T22:32:08.322 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7029000000000002e-05 2024-09-12T22:32:08.322 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.322 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.322 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:08.322 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405812+0000", 2024-09-12T22:32:08.322 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0627000000000001e-05 2024-09-12T22:32:08.322 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:08.322 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:08.322 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:08.322 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.322 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.322 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:32:08.322 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394447+0000", 2024-09-12T22:32:08.323 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 39.896269789999998, 2024-09-12T22:32:08.323 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011759588, 2024-09-12T22:32:08.323 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:08.323 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:08.323 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:08.323 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:08.323 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:08.323 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:08.323 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 188 2024-09-12T22:32:08.323 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.323 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:08.323 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.323 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:08.323 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394447+0000", 2024-09-12T22:32:08.324 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:08.324 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.324 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.324 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:08.324 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394447+0000", 2024-09-12T22:32:08.324 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:08.324 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.324 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.324 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:08.324 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394447+0000", 2024-09-12T22:32:08.324 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.15e-07 2024-09-12T22:32:08.324 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.324 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.324 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:08.325 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394512+0000", 2024-09-12T22:32:08.325 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4580999999999997e-05 2024-09-12T22:32:08.325 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.325 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.325 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:08.325 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394518+0000", 2024-09-12T22:32:08.325 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.3380000000000001e-06 2024-09-12T22:32:08.325 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.325 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.325 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:08.325 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394521+0000", 2024-09-12T22:32:08.325 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3340000000000002e-06 2024-09-12T22:32:08.325 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.326 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.326 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:08.326 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.402628+0000", 2024-09-12T22:32:08.326 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.008106996 2024-09-12T22:32:08.326 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.326 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.326 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:08.326 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.402670+0000", 2024-09-12T22:32:08.326 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1983000000000001e-05 2024-09-12T22:32:08.326 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.326 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.326 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:08.326 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.402738+0000", 2024-09-12T22:32:08.326 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.8114999999999994e-05 2024-09-12T22:32:08.327 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.327 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.327 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:08.327 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405668+0000", 2024-09-12T22:32:08.327 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.002929545 2024-09-12T22:32:08.327 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.327 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.327 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:08.327 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406162+0000", 2024-09-12T22:32:08.327 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000494408 2024-09-12T22:32:08.327 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.327 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.327 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:08.327 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406188+0000", 2024-09-12T22:32:08.328 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5766e-05 2024-09-12T22:32:08.328 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.328 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.328 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:08.328 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406206+0000", 2024-09-12T22:32:08.328 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.8107000000000001e-05 2024-09-12T22:32:08.328 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:08.328 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:08.328 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:08.328 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.328 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.328 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:32:08.328 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394528+0000", 2024-09-12T22:32:08.329 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 39.896188121000002, 2024-09-12T22:32:08.329 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.01195536, 2024-09-12T22:32:08.329 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:08.329 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:08.329 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:08.329 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:08.329 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:08.329 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:08.329 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 189 2024-09-12T22:32:08.329 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.329 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:08.329 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.329 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:08.329 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394528+0000", 2024-09-12T22:32:08.330 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:08.330 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.330 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.330 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:08.330 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394528+0000", 2024-09-12T22:32:08.330 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:08.330 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.330 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.330 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:08.330 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394529+0000", 2024-09-12T22:32:08.330 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4900000000000001e-07 2024-09-12T22:32:08.330 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.330 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.330 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:08.331 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394531+0000", 2024-09-12T22:32:08.331 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.458e-06 2024-09-12T22:32:08.331 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.331 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.331 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:08.331 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394535+0000", 2024-09-12T22:32:08.331 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7900000000000001e-06 2024-09-12T22:32:08.331 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.331 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.331 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:08.331 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394537+0000", 2024-09-12T22:32:08.331 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.632e-06 2024-09-12T22:32:08.331 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.331 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.331 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:08.332 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.404932+0000", 2024-09-12T22:32:08.332 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010394158000000001 2024-09-12T22:32:08.332 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.332 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.332 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:08.332 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405017+0000", 2024-09-12T22:32:08.332 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5525000000000005e-05 2024-09-12T22:32:08.332 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.332 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.332 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:08.332 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405114+0000", 2024-09-12T22:32:08.332 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.6527000000000006e-05 2024-09-12T22:32:08.332 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.333 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.333 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:08.333 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405818+0000", 2024-09-12T22:32:08.333 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00070412800000000005 2024-09-12T22:32:08.333 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.333 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.333 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:08.333 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406437+0000", 2024-09-12T22:32:08.333 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00061898900000000002 2024-09-12T22:32:08.333 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.333 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.333 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:08.333 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406463+0000", 2024-09-12T22:32:08.333 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6268e-05 2024-09-12T22:32:08.334 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.334 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.334 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:08.334 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406484+0000", 2024-09-12T22:32:08.334 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0536000000000001e-05 2024-09-12T22:32:08.334 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:08.334 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:08.334 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:08.334 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.334 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.334 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:08.334 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.401422+0000", 2024-09-12T22:32:08.334 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 30.889294216, 2024-09-12T22:32:08.334 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016896452999999999, 2024-09-12T22:32:08.335 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:08.335 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:08.335 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:08.335 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:08.335 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.335 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:08.335 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401422+0000", 2024-09-12T22:32:08.335 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:08.335 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.335 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.335 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:08.335 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401422+0000", 2024-09-12T22:32:08.335 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:08.335 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.336 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.336 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:08.336 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401424+0000", 2024-09-12T22:32:08.336 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9e-06 2024-09-12T22:32:08.336 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.336 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.336 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:08.336 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401437+0000", 2024-09-12T22:32:08.336 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2831e-05 2024-09-12T22:32:08.336 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.336 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.336 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:08.336 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401471+0000", 2024-09-12T22:32:08.336 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4010000000000001e-05 2024-09-12T22:32:08.337 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.337 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.337 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:08.337 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401484+0000", 2024-09-12T22:32:08.337 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2711000000000001e-05 2024-09-12T22:32:08.337 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.337 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.337 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:08.337 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405410+0000", 2024-09-12T22:32:08.337 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0039259170000000001 2024-09-12T22:32:08.337 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.337 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.337 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:08.338 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405529+0000", 2024-09-12T22:32:08.338 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000119778 2024-09-12T22:32:08.338 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.338 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.338 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:08.338 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405655+0000", 2024-09-12T22:32:08.338 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012556700000000001 2024-09-12T22:32:08.338 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.338 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.338 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:08.338 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410456+0000", 2024-09-12T22:32:08.338 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0048008269999999997 2024-09-12T22:32:08.338 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.338 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.339 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:08.339 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418226+0000", 2024-09-12T22:32:08.339 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0077707729999999999 2024-09-12T22:32:08.339 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.339 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.339 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:08.339 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418277+0000", 2024-09-12T22:32:08.339 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0476000000000003e-05 2024-09-12T22:32:08.339 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.339 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.339 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:08.339 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418319+0000", 2024-09-12T22:32:08.340 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1662999999999997e-05 2024-09-12T22:32:08.340 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:08.340 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:08.340 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:08.340 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.340 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.340 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:08.340 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.401505+0000", 2024-09-12T22:32:08.340 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 30.889211551999999, 2024-09-12T22:32:08.340 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016987904000000002, 2024-09-12T22:32:08.340 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:08.340 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:08.340 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:08.340 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:08.341 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.341 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:08.341 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401505+0000", 2024-09-12T22:32:08.341 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:08.341 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.341 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.341 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:08.341 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401505+0000", 2024-09-12T22:32:08.341 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:08.341 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.341 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.341 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:08.341 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401506+0000", 2024-09-12T22:32:08.341 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4700000000000001e-07 2024-09-12T22:32:08.342 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.342 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.342 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:08.342 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401510+0000", 2024-09-12T22:32:08.342 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6609999999999999e-06 2024-09-12T22:32:08.342 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.342 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.342 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:08.342 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401771+0000", 2024-09-12T22:32:08.342 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00026110700000000001 2024-09-12T22:32:08.342 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.342 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.342 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:08.343 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401921+0000", 2024-09-12T22:32:08.343 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014939099999999999 2024-09-12T22:32:08.343 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.343 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.343 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:08.343 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405944+0000", 2024-09-12T22:32:08.343 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0040235449999999999 2024-09-12T22:32:08.343 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.343 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.343 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:08.343 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406018+0000", 2024-09-12T22:32:08.343 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3373000000000004e-05 2024-09-12T22:32:08.343 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.343 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.344 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:08.344 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406172+0000", 2024-09-12T22:32:08.344 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00015435399999999999 2024-09-12T22:32:08.344 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.344 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.344 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:08.344 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410461+0000", 2024-09-12T22:32:08.344 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0042888609999999997 2024-09-12T22:32:08.344 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.344 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.344 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:08.344 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418371+0000", 2024-09-12T22:32:08.344 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0079098380000000006 2024-09-12T22:32:08.344 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.345 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.345 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:08.345 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418443+0000", 2024-09-12T22:32:08.345 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2705000000000003e-05 2024-09-12T22:32:08.345 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.345 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.345 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:08.345 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418493+0000", 2024-09-12T22:32:08.345 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9322e-05 2024-09-12T22:32:08.345 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:08.345 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:08.345 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:08.345 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.345 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.346 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:08.346 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.401939+0000", 2024-09-12T22:32:08.346 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 30.888777816000001, 2024-09-12T22:32:08.346 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016722292999999999, 2024-09-12T22:32:08.346 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:08.346 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:08.346 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:08.346 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:08.346 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.346 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:08.346 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401939+0000", 2024-09-12T22:32:08.346 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:08.346 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.347 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.347 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:08.347 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401939+0000", 2024-09-12T22:32:08.347 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:08.347 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.347 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.347 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:08.347 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401940+0000", 2024-09-12T22:32:08.347 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1990000000000001e-06 2024-09-12T22:32:08.347 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.347 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.347 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:08.347 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401956+0000", 2024-09-12T22:32:08.348 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.6344000000000001e-05 2024-09-12T22:32:08.348 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.348 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.348 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:08.348 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401974+0000", 2024-09-12T22:32:08.348 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7730000000000001e-05 2024-09-12T22:32:08.348 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.348 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.348 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:08.348 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401982+0000", 2024-09-12T22:32:08.349 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.7800000000000001e-06 2024-09-12T22:32:08.349 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.349 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.349 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:08.349 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406557+0000", 2024-09-12T22:32:08.349 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0045758489999999999 2024-09-12T22:32:08.349 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.349 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.349 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:08.349 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406697+0000", 2024-09-12T22:32:08.349 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013925100000000001 2024-09-12T22:32:08.349 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.349 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.350 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:08.350 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406830+0000", 2024-09-12T22:32:08.350 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013293499999999999 2024-09-12T22:32:08.350 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.350 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.350 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:08.350 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410465+0000", 2024-09-12T22:32:08.350 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0036352680000000001 2024-09-12T22:32:08.350 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.350 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.350 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:08.350 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418564+0000", 2024-09-12T22:32:08.350 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0080992140000000004 2024-09-12T22:32:08.350 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.351 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.351 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:08.351 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418621+0000", 2024-09-12T22:32:08.351 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7167999999999999e-05 2024-09-12T22:32:08.351 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.351 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.351 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:08.351 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418661+0000", 2024-09-12T22:32:08.351 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9555000000000003e-05 2024-09-12T22:32:08.351 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:08.351 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:08.351 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:08.351 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.351 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.352 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:08.352 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.401994+0000", 2024-09-12T22:32:08.352 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 30.888721944, 2024-09-12T22:32:08.352 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016804109000000001, 2024-09-12T22:32:08.352 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:08.352 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:08.352 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:08.352 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:08.352 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.352 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:08.352 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401994+0000", 2024-09-12T22:32:08.352 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:08.352 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.352 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.353 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:08.353 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401994+0000", 2024-09-12T22:32:08.353 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:08.353 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.353 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.353 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:08.353 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401995+0000", 2024-09-12T22:32:08.353 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.8899999999999998e-07 2024-09-12T22:32:08.353 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.353 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.353 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:08.353 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402000+0000", 2024-09-12T22:32:08.353 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.498e-06 2024-09-12T22:32:08.354 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.354 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.354 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:08.354 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402007+0000", 2024-09-12T22:32:08.354 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.554e-06 2024-09-12T22:32:08.354 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.354 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.354 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:08.354 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402046+0000", 2024-09-12T22:32:08.354 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9156000000000003e-05 2024-09-12T22:32:08.354 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.354 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.354 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:08.355 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407342+0000", 2024-09-12T22:32:08.355 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052957610000000004 2024-09-12T22:32:08.355 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.355 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.355 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:08.355 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407521+0000", 2024-09-12T22:32:08.355 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00017878100000000001 2024-09-12T22:32:08.355 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.355 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.355 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:08.355 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407641+0000", 2024-09-12T22:32:08.355 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012013 2024-09-12T22:32:08.355 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.355 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.355 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:08.356 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410472+0000", 2024-09-12T22:32:08.356 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.002830455 2024-09-12T22:32:08.356 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.356 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.356 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:08.356 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418714+0000", 2024-09-12T22:32:08.356 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0082422789999999999 2024-09-12T22:32:08.356 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.356 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.356 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:08.356 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418761+0000", 2024-09-12T22:32:08.356 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6956999999999998e-05 2024-09-12T22:32:08.356 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.356 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.356 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:08.357 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418799+0000", 2024-09-12T22:32:08.357 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7749000000000001e-05 2024-09-12T22:32:08.357 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:08.357 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:08.357 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:08.357 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.357 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.357 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:08.357 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.402060+0000", 2024-09-12T22:32:08.357 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 30.8886565, 2024-09-12T22:32:08.357 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016885686, 2024-09-12T22:32:08.357 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:08.357 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:08.357 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:08.358 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:08.358 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.358 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:08.358 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402060+0000", 2024-09-12T22:32:08.358 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:08.358 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.358 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.358 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:08.358 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402060+0000", 2024-09-12T22:32:08.358 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:08.358 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.358 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.358 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:08.358 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402061+0000", 2024-09-12T22:32:08.358 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4399999999999999e-07 2024-09-12T22:32:08.359 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.359 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.359 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:08.359 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402066+0000", 2024-09-12T22:32:08.359 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8649999999999998e-06 2024-09-12T22:32:08.359 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.359 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.359 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:08.359 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402146+0000", 2024-09-12T22:32:08.359 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9054000000000006e-05 2024-09-12T22:32:08.359 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.359 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.359 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:08.359 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402287+0000", 2024-09-12T22:32:08.360 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014108600000000001 2024-09-12T22:32:08.360 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.360 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.360 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:08.360 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408185+0000", 2024-09-12T22:32:08.360 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0058983919999999997 2024-09-12T22:32:08.360 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.360 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.360 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:08.360 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408299+0000", 2024-09-12T22:32:08.360 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114102 2024-09-12T22:32:08.360 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.360 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.361 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:08.361 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408420+0000", 2024-09-12T22:32:08.361 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000120492 2024-09-12T22:32:08.361 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.361 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.361 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:08.361 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410867+0000", 2024-09-12T22:32:08.361 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0024476430000000002 2024-09-12T22:32:08.361 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.361 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.361 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:08.361 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418851+0000", 2024-09-12T22:32:08.361 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0079841489999999994 2024-09-12T22:32:08.361 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.362 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.362 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:08.362 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418894+0000", 2024-09-12T22:32:08.362 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3090000000000002e-05 2024-09-12T22:32:08.362 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.362 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.362 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:08.362 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418946+0000", 2024-09-12T22:32:08.362 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1069000000000002e-05 2024-09-12T22:32:08.362 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:08.362 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:08.362 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:08.362 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.362 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.363 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:08.363 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.402375+0000", 2024-09-12T22:32:08.363 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 30.888341435000001, 2024-09-12T22:32:08.363 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016768531999999999, 2024-09-12T22:32:08.363 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:08.363 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:08.363 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:08.363 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:08.363 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.363 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:08.363 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402375+0000", 2024-09-12T22:32:08.363 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:08.363 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.363 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.363 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:08.364 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402375+0000", 2024-09-12T22:32:08.364 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:08.364 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.364 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.364 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:08.364 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402375+0000", 2024-09-12T22:32:08.364 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4099999999999999e-07 2024-09-12T22:32:08.364 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.364 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.364 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:08.364 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402379+0000", 2024-09-12T22:32:08.364 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9870000000000001e-06 2024-09-12T22:32:08.365 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.365 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.365 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:08.365 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402389+0000", 2024-09-12T22:32:08.365 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0000000000000001e-05 2024-09-12T22:32:08.365 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.365 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.365 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:08.365 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402401+0000", 2024-09-12T22:32:08.365 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.148e-05 2024-09-12T22:32:08.365 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.365 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.365 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:08.365 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409108+0000", 2024-09-12T22:32:08.366 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0067068429999999997 2024-09-12T22:32:08.366 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.366 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.366 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:08.366 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409189+0000", 2024-09-12T22:32:08.366 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0815999999999993e-05 2024-09-12T22:32:08.366 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.366 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.366 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:08.366 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409320+0000", 2024-09-12T22:32:08.366 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000131586 2024-09-12T22:32:08.366 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.366 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.366 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:08.366 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410872+0000", 2024-09-12T22:32:08.367 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0015521599999999999 2024-09-12T22:32:08.367 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.367 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.367 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:08.367 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419049+0000", 2024-09-12T22:32:08.367 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0081763719999999995 2024-09-12T22:32:08.367 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.367 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.367 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:08.367 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419107+0000", 2024-09-12T22:32:08.367 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7899000000000002e-05 2024-09-12T22:32:08.367 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.367 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.367 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:08.367 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419143+0000", 2024-09-12T22:32:08.368 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6847999999999997e-05 2024-09-12T22:32:08.368 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:08.368 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:08.368 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:08.368 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.368 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.368 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:08.368 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.402903+0000", 2024-09-12T22:32:08.368 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 30.887813023, 2024-09-12T22:32:08.368 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016378428, 2024-09-12T22:32:08.369 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:08.369 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:08.369 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:08.369 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:08.369 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.369 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:08.369 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402903+0000", 2024-09-12T22:32:08.369 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:08.369 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.369 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.369 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:08.370 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402903+0000", 2024-09-12T22:32:08.370 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:08.370 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.370 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.370 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:08.370 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402904+0000", 2024-09-12T22:32:08.370 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9500000000000001e-07 2024-09-12T22:32:08.370 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.370 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.370 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:08.370 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402944+0000", 2024-09-12T22:32:08.370 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0265000000000002e-05 2024-09-12T22:32:08.370 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.370 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.370 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:08.371 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402979+0000", 2024-09-12T22:32:08.371 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4378000000000002e-05 2024-09-12T22:32:08.371 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.371 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.371 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:08.371 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402987+0000", 2024-09-12T22:32:08.371 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3559999999999993e-06 2024-09-12T22:32:08.371 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.371 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.371 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:08.371 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409577+0000", 2024-09-12T22:32:08.371 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0065901709999999997 2024-09-12T22:32:08.372 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.372 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.372 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:08.372 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409653+0000", 2024-09-12T22:32:08.372 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5819e-05 2024-09-12T22:32:08.372 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.372 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.372 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:08.372 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409725+0000", 2024-09-12T22:32:08.372 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2200000000000007e-05 2024-09-12T22:32:08.372 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.372 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.372 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:08.372 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.411234+0000", 2024-09-12T22:32:08.372 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001508225 2024-09-12T22:32:08.373 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.373 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.373 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:08.373 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419212+0000", 2024-09-12T22:32:08.373 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0079783400000000004 2024-09-12T22:32:08.373 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.373 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.373 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:08.373 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419244+0000", 2024-09-12T22:32:08.373 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2384e-05 2024-09-12T22:32:08.373 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.373 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.373 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:08.373 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419282+0000", 2024-09-12T22:32:08.374 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7394999999999997e-05 2024-09-12T22:32:08.374 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:08.374 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:08.374 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:08.374 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.374 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.374 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:08.374 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.403135+0000", 2024-09-12T22:32:08.374 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 30.887581152999999, 2024-09-12T22:32:08.374 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016294211999999999, 2024-09-12T22:32:08.374 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:08.374 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:08.374 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:08.374 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:08.374 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.375 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:08.375 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403135+0000", 2024-09-12T22:32:08.375 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:08.375 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.375 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.375 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:08.375 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403135+0000", 2024-09-12T22:32:08.375 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:08.375 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.375 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.375 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:08.375 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403136+0000", 2024-09-12T22:32:08.375 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.4e-07 2024-09-12T22:32:08.375 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.375 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.376 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:08.376 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403149+0000", 2024-09-12T22:32:08.376 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2723e-05 2024-09-12T22:32:08.376 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.376 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.376 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:08.376 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403158+0000", 2024-09-12T22:32:08.376 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3919999999999992e-06 2024-09-12T22:32:08.376 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.376 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.376 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:08.376 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403166+0000", 2024-09-12T22:32:08.376 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.2309999999999996e-06 2024-09-12T22:32:08.376 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.376 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.377 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:08.377 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409944+0000", 2024-09-12T22:32:08.377 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0067775309999999998 2024-09-12T22:32:08.377 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.377 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.377 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:08.377 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410032+0000", 2024-09-12T22:32:08.377 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.7906999999999997e-05 2024-09-12T22:32:08.377 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.377 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.377 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:08.377 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410152+0000", 2024-09-12T22:32:08.377 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012037800000000001 2024-09-12T22:32:08.377 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.377 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.378 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:08.378 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.411945+0000", 2024-09-12T22:32:08.378 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0017931850000000001 2024-09-12T22:32:08.378 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.378 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.378 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:08.378 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419319+0000", 2024-09-12T22:32:08.378 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0073731780000000002 2024-09-12T22:32:08.378 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.378 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.378 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:08.378 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419376+0000", 2024-09-12T22:32:08.378 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7728e-05 2024-09-12T22:32:08.378 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.378 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.378 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:08.379 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419429+0000", 2024-09-12T22:32:08.379 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3019000000000002e-05 2024-09-12T22:32:08.379 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:08.379 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:08.379 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:08.379 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.379 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.379 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:08.379 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.403185+0000", 2024-09-12T22:32:08.379 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 30.887531272, 2024-09-12T22:32:08.379 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.014902164000000001, 2024-09-12T22:32:08.379 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:08.379 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:08.379 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:08.379 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:08.380 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.380 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:08.380 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403185+0000", 2024-09-12T22:32:08.380 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:08.380 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.380 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.380 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:08.380 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403185+0000", 2024-09-12T22:32:08.380 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:08.380 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.380 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.380 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:08.380 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403186+0000", 2024-09-12T22:32:08.380 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9400000000000005e-07 2024-09-12T22:32:08.381 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.381 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.381 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:08.381 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403191+0000", 2024-09-12T22:32:08.381 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6980000000000003e-06 2024-09-12T22:32:08.381 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.381 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.381 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:08.381 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403199+0000", 2024-09-12T22:32:08.381 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2520000000000002e-06 2024-09-12T22:32:08.381 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.381 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.381 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:08.381 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403205+0000", 2024-09-12T22:32:08.381 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.908e-06 2024-09-12T22:32:08.382 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.382 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.382 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:08.382 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403359+0000", 2024-09-12T22:32:08.382 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000154544 2024-09-12T22:32:08.382 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.382 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.382 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:08.382 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403528+0000", 2024-09-12T22:32:08.382 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000168455 2024-09-12T22:32:08.382 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.382 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.382 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:08.382 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403763+0000", 2024-09-12T22:32:08.383 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00023539599999999999 2024-09-12T22:32:08.383 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.383 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.383 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:08.383 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409378+0000", 2024-09-12T22:32:08.383 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056150000000000002 2024-09-12T22:32:08.383 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.383 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.383 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:08.383 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418012+0000", 2024-09-12T22:32:08.383 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0086339559999999999 2024-09-12T22:32:08.383 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.383 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.383 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:08.384 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418046+0000", 2024-09-12T22:32:08.384 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4267999999999998e-05 2024-09-12T22:32:08.384 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.384 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.384 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:08.384 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418087+0000", 2024-09-12T22:32:08.384 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0992999999999999e-05 2024-09-12T22:32:08.384 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:08.384 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:08.384 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:08.384 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.384 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.384 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:08.384 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.403273+0000", 2024-09-12T22:32:08.385 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 30.887443320999999, 2024-09-12T22:32:08.385 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.014934866, 2024-09-12T22:32:08.385 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:08.385 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:08.385 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:08.385 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:08.385 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.385 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:08.385 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403273+0000", 2024-09-12T22:32:08.385 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:08.385 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.385 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.385 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:08.386 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403273+0000", 2024-09-12T22:32:08.386 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:08.386 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.386 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.386 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:08.386 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403274+0000", 2024-09-12T22:32:08.386 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.297e-06 2024-09-12T22:32:08.386 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.386 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.386 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:08.386 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403282+0000", 2024-09-12T22:32:08.386 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6340000000000001e-06 2024-09-12T22:32:08.386 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.386 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.387 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:08.387 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403305+0000", 2024-09-12T22:32:08.387 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3149000000000001e-05 2024-09-12T22:32:08.387 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.387 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.387 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:08.387 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403320+0000", 2024-09-12T22:32:08.387 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4527e-05 2024-09-12T22:32:08.387 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.387 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.387 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:08.387 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.404928+0000", 2024-09-12T22:32:08.387 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001608459 2024-09-12T22:32:08.387 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.388 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.388 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:08.388 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405218+0000", 2024-09-12T22:32:08.388 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00028982900000000002 2024-09-12T22:32:08.388 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.388 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.388 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:08.388 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405829+0000", 2024-09-12T22:32:08.388 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00061127900000000005 2024-09-12T22:32:08.388 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.388 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.388 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:08.388 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409403+0000", 2024-09-12T22:32:08.389 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.003573597 2024-09-12T22:32:08.389 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.389 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.389 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:08.389 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418138+0000", 2024-09-12T22:32:08.389 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0087349969999999996 2024-09-12T22:32:08.389 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.389 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.389 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:08.389 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418178+0000", 2024-09-12T22:32:08.389 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0649999999999999e-05 2024-09-12T22:32:08.389 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.389 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.389 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:08.390 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418208+0000", 2024-09-12T22:32:08.390 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9448e-05 2024-09-12T22:32:08.390 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:08.390 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:08.390 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:08.390 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.390 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.390 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:08.390 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.405456+0000", 2024-09-12T22:32:08.390 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 30.885260175999999, 2024-09-12T22:32:08.390 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012888389, 2024-09-12T22:32:08.390 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:08.390 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:08.390 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:08.391 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:08.391 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.391 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:08.391 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405456+0000", 2024-09-12T22:32:08.391 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:08.391 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.391 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.391 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:08.391 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405456+0000", 2024-09-12T22:32:08.391 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:08.391 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.391 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.391 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:08.392 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405457+0000", 2024-09-12T22:32:08.392 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.6599999999999994e-07 2024-09-12T22:32:08.392 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.392 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.392 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:08.392 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405463+0000", 2024-09-12T22:32:08.392 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4739999999999996e-06 2024-09-12T22:32:08.392 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.392 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.392 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:08.392 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405474+0000", 2024-09-12T22:32:08.392 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1095e-05 2024-09-12T22:32:08.392 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.392 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.392 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:08.393 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405482+0000", 2024-09-12T22:32:08.393 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3610000000000001e-06 2024-09-12T22:32:08.393 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.393 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.393 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:08.393 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407051+0000", 2024-09-12T22:32:08.393 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0015688970000000001 2024-09-12T22:32:08.393 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.393 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.393 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:08.393 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407259+0000", 2024-09-12T22:32:08.393 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00020778300000000001 2024-09-12T22:32:08.393 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.393 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.394 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:08.394 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407622+0000", 2024-09-12T22:32:08.394 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000363066 2024-09-12T22:32:08.394 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.394 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.394 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:08.394 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409438+0000", 2024-09-12T22:32:08.394 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001816319 2024-09-12T22:32:08.394 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.394 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.394 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:08.394 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418257+0000", 2024-09-12T22:32:08.394 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0088187720000000008 2024-09-12T22:32:08.395 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.395 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.395 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:08.395 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418308+0000", 2024-09-12T22:32:08.395 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1180000000000001e-05 2024-09-12T22:32:08.395 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.395 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.395 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:08.395 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418345+0000", 2024-09-12T22:32:08.395 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6476000000000001e-05 2024-09-12T22:32:08.395 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:08.395 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:08.395 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:08.395 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.395 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.396 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:08.396 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.405496+0000", 2024-09-12T22:32:08.396 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 30.885220819000001, 2024-09-12T22:32:08.396 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013016012, 2024-09-12T22:32:08.396 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:08.396 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:08.396 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:08.396 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:08.396 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.396 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:08.396 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405496+0000", 2024-09-12T22:32:08.396 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:08.396 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.397 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.397 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:08.397 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405496+0000", 2024-09-12T22:32:08.397 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:08.397 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.397 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.397 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:08.397 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405496+0000", 2024-09-12T22:32:08.397 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7999999999999995e-07 2024-09-12T22:32:08.397 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.397 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.397 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:08.397 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405501+0000", 2024-09-12T22:32:08.397 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8359999999999999e-06 2024-09-12T22:32:08.398 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.398 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.398 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:08.398 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405514+0000", 2024-09-12T22:32:08.398 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2522e-05 2024-09-12T22:32:08.398 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.398 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.398 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:08.398 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405521+0000", 2024-09-12T22:32:08.398 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5020000000000003e-06 2024-09-12T22:32:08.398 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.398 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.398 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:08.398 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405575+0000", 2024-09-12T22:32:08.399 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4169999999999998e-05 2024-09-12T22:32:08.399 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.399 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.399 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:08.399 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405697+0000", 2024-09-12T22:32:08.399 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000121301 2024-09-12T22:32:08.399 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.399 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.399 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:08.399 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405829+0000", 2024-09-12T22:32:08.399 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000132662 2024-09-12T22:32:08.399 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.399 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.400 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:08.400 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409155+0000", 2024-09-12T22:32:08.400 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0033259050000000001 2024-09-12T22:32:08.400 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.400 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.400 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:08.400 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418425+0000", 2024-09-12T22:32:08.400 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0092696319999999999 2024-09-12T22:32:08.400 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.400 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.400 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:08.400 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418471+0000", 2024-09-12T22:32:08.400 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6213e-05 2024-09-12T22:32:08.400 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.401 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.401 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:08.401 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418512+0000", 2024-09-12T22:32:08.401 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0589000000000001e-05 2024-09-12T22:32:08.401 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:08.401 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:08.401 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:08.401 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.401 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.401 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:08.401 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.406108+0000", 2024-09-12T22:32:08.401 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 30.884608421999999, 2024-09-12T22:32:08.401 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012458175, 2024-09-12T22:32:08.402 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:08.402 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:08.402 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:08.402 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:08.402 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.402 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:08.402 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406108+0000", 2024-09-12T22:32:08.402 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:08.402 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.402 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.402 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:08.402 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406108+0000", 2024-09-12T22:32:08.402 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:08.402 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.403 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.403 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:08.403 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406109+0000", 2024-09-12T22:32:08.403 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9899999999999999e-07 2024-09-12T22:32:08.403 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.403 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.403 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:08.403 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406115+0000", 2024-09-12T22:32:08.403 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9030000000000001e-06 2024-09-12T22:32:08.403 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.403 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.403 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:08.403 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406141+0000", 2024-09-12T22:32:08.403 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5999e-05 2024-09-12T22:32:08.404 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.404 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.404 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:08.404 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406150+0000", 2024-09-12T22:32:08.404 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.6050000000000004e-06 2024-09-12T22:32:08.404 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.404 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.404 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:08.404 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408163+0000", 2024-09-12T22:32:08.404 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0020122769999999998 2024-09-12T22:32:08.404 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.404 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.404 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:08.404 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408309+0000", 2024-09-12T22:32:08.405 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014606999999999999 2024-09-12T22:32:08.405 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.405 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.405 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:08.405 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408433+0000", 2024-09-12T22:32:08.405 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012460300000000001 2024-09-12T22:32:08.405 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.405 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.405 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:08.405 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409903+0000", 2024-09-12T22:32:08.405 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001469499 2024-09-12T22:32:08.405 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.405 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.405 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:08.406 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418427+0000", 2024-09-12T22:32:08.406 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0085241139999999993 2024-09-12T22:32:08.406 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.406 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.406 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:08.406 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418471+0000", 2024-09-12T22:32:08.406 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4474000000000001e-05 2024-09-12T22:32:08.406 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.406 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.406 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:08.406 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418566+0000", 2024-09-12T22:32:08.406 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.4732e-05 2024-09-12T22:32:08.406 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:08.406 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:08.407 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:08.407 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.407 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.407 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:08.407 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.407266+0000", 2024-09-12T22:32:08.407 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 30.883450566, 2024-09-12T22:32:08.407 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011442905, 2024-09-12T22:32:08.407 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:08.407 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:08.407 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2024-09-12T22:32:08.407 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:08.407 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.407 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:08.407 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407266+0000", 2024-09-12T22:32:08.408 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:08.408 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.408 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.408 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:08.408 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407266+0000", 2024-09-12T22:32:08.408 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:08.408 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.408 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.408 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:08.408 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407266+0000", 2024-09-12T22:32:08.408 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7899999999999998e-07 2024-09-12T22:32:08.408 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.408 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.409 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:08.409 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407269+0000", 2024-09-12T22:32:08.409 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9210000000000001e-06 2024-09-12T22:32:08.409 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.409 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.409 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:08.409 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407331+0000", 2024-09-12T22:32:08.409 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1376000000000003e-05 2024-09-12T22:32:08.409 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.409 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.409 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:08.409 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407337+0000", 2024-09-12T22:32:08.409 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1929999999999998e-06 2024-09-12T22:32:08.409 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.410 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.410 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:08.410 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408974+0000", 2024-09-12T22:32:08.410 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0016367109999999999 2024-09-12T22:32:08.410 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.410 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.410 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:08.410 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409112+0000", 2024-09-12T22:32:08.410 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000137952 2024-09-12T22:32:08.410 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:08.410 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:08.410 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:08.410 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418709+0000", 2024-09-12T22:32:08.410 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0095971730000000005 2024-09-12T22:32:08.410 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:08.411 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:08.411 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:08.411 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:08.411 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:08.411 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-09-12T22:32:08.412 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:32:08.413 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:32:08.411+0000 7fddec6a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30331) UID: 0 2024-09-12T22:32:08.513 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:32:08.512+0000 7fddec6a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30331) UID: 0 2024-09-12T22:32:08.532 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-09-12T22:32:08.532 INFO:teuthology.orchestra.run.smithi076.stdout: "ops": [], 2024-09-12T22:32:08.532 INFO:teuthology.orchestra.run.smithi076.stdout: "num_ops": 0 2024-09-12T22:32:08.532 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-09-12T22:32:08.542 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:32:08.614 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:08.613+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:08.688 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-09-12T22:32:08.689 INFO:teuthology.orchestra.run.smithi076.stdout: "ops": [], 2024-09-12T22:32:08.689 INFO:teuthology.orchestra.run.smithi076.stdout: "complaint_time": 30, 2024-09-12T22:32:08.689 INFO:teuthology.orchestra.run.smithi076.stdout: "num_blocked_ops": 0 2024-09-12T22:32:08.689 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-09-12T22:32:08.697 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:32:08.715 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:08.714+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:08.801 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-09-12T22:32:08.801 INFO:teuthology.orchestra.run.smithi076.stdout: "size": 20, 2024-09-12T22:32:08.802 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 600, 2024-09-12T22:32:08.802 INFO:teuthology.orchestra.run.smithi076.stdout: "ops": [ 2024-09-12T22:32:08.802 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.802 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:08.802 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.400604+0000", 2024-09-12T22:32:08.802 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 31.398805193000001, 2024-09-12T22:32:08.802 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.017278814, 2024-09-12T22:32:08.802 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:08.802 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:08.802 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:08.802 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:08.802 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.802 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:08.803 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400604+0000", 2024-09-12T22:32:08.803 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:08.803 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.803 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.803 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:08.803 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400604+0000", 2024-09-12T22:32:08.803 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:08.803 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.803 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.803 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:08.803 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400617+0000", 2024-09-12T22:32:08.803 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.3076e-05 2024-09-12T22:32:08.803 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.803 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.803 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:08.804 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400623+0000", 2024-09-12T22:32:08.804 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.5780000000000004e-06 2024-09-12T22:32:08.804 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.804 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.804 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:08.804 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400641+0000", 2024-09-12T22:32:08.804 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.8218000000000001e-05 2024-09-12T22:32:08.804 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.804 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.804 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:08.804 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400652+0000", 2024-09-12T22:32:08.804 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.0421999999999999e-05 2024-09-12T22:32:08.804 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.804 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.805 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:08.805 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400707+0000", 2024-09-12T22:32:08.805 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.4666000000000001e-05 2024-09-12T22:32:08.805 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.805 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.805 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op must wait for map", 2024-09-12T22:32:08.805 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400711+0000", 2024-09-12T22:32:08.805 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.5340000000000001e-06 2024-09-12T22:32:08.805 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.805 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.805 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:08.805 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.412066+0000", 2024-09-12T22:32:08.805 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.011354797999999999 2024-09-12T22:32:08.806 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.806 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.806 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:08.806 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.412672+0000", 2024-09-12T22:32:08.806 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00060620499999999996 2024-09-12T22:32:08.806 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.806 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.806 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:08.806 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.413032+0000", 2024-09-12T22:32:08.806 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00035955999999999998 2024-09-12T22:32:08.806 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.806 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.807 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op_commit", 2024-09-12T22:32:08.807 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417252+0000", 2024-09-12T22:32:08.807 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.004219899 2024-09-12T22:32:08.807 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.807 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.807 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:08.807 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417812+0000", 2024-09-12T22:32:08.807 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.000560182 2024-09-12T22:32:08.807 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.807 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.807 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:08.807 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417851+0000", 2024-09-12T22:32:08.807 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.9057999999999998e-05 2024-09-12T22:32:08.808 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.808 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.808 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:08.808 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417882+0000", 2024-09-12T22:32:08.808 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.1618000000000001e-05 2024-09-12T22:32:08.808 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:08.808 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:08.808 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:08.808 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.808 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.808 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:08.808 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.400674+0000", 2024-09-12T22:32:08.808 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 31.398734475000001, 2024-09-12T22:32:08.809 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.017348971000000001, 2024-09-12T22:32:08.809 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:08.809 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:08.809 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:08.809 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:08.809 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.809 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:08.809 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400674+0000", 2024-09-12T22:32:08.809 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:08.809 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.809 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.809 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:08.809 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400674+0000", 2024-09-12T22:32:08.809 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:08.810 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.810 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.810 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:08.810 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400675+0000", 2024-09-12T22:32:08.810 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.37e-07 2024-09-12T22:32:08.810 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.810 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.810 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:08.810 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400678+0000", 2024-09-12T22:32:08.810 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.303e-06 2024-09-12T22:32:08.810 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.810 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.811 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:08.811 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400684+0000", 2024-09-12T22:32:08.811 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.0290000000000002e-06 2024-09-12T22:32:08.811 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.811 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.811 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:08.811 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400688+0000", 2024-09-12T22:32:08.811 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.0890000000000002e-06 2024-09-12T22:32:08.811 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.811 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.811 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:08.811 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400806+0000", 2024-09-12T22:32:08.811 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00011814700000000001 2024-09-12T22:32:08.811 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.812 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.812 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:32:08.812 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400811+0000", 2024-09-12T22:32:08.812 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.0479999999999998e-06 2024-09-12T22:32:08.812 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.812 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.812 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:08.812 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.413877+0000", 2024-09-12T22:32:08.812 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.013065561 2024-09-12T22:32:08.812 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.812 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.812 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:08.812 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.413984+0000", 2024-09-12T22:32:08.813 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.000106566 2024-09-12T22:32:08.813 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.813 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.813 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:08.813 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.414264+0000", 2024-09-12T22:32:08.813 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00028067199999999999 2024-09-12T22:32:08.813 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.813 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.813 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op_commit", 2024-09-12T22:32:08.813 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417614+0000", 2024-09-12T22:32:08.813 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0033500729999999999 2024-09-12T22:32:08.813 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.813 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.814 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:08.814 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417946+0000", 2024-09-12T22:32:08.814 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00033209199999999998 2024-09-12T22:32:08.814 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.814 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.814 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:08.814 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417995+0000", 2024-09-12T22:32:08.814 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.808e-05 2024-09-12T22:32:08.814 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.814 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.814 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:08.814 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.418023+0000", 2024-09-12T22:32:08.814 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.8773999999999999e-05 2024-09-12T22:32:08.814 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:08.815 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:08.815 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:08.815 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.815 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.815 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:08.815 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.400694+0000", 2024-09-12T22:32:08.815 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 31.398714846000001, 2024-09-12T22:32:08.815 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.022845628, 2024-09-12T22:32:08.815 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:08.815 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:08.815 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:08.815 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:08.815 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.816 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:08.816 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400694+0000", 2024-09-12T22:32:08.816 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:08.816 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.816 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.816 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:08.816 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400694+0000", 2024-09-12T22:32:08.816 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:08.816 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.816 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.816 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:08.816 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400694+0000", 2024-09-12T22:32:08.816 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.48e-07 2024-09-12T22:32:08.817 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.817 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.817 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:08.817 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400709+0000", 2024-09-12T22:32:08.817 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.4888999999999999e-05 2024-09-12T22:32:08.817 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.817 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.817 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:08.817 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400722+0000", 2024-09-12T22:32:08.817 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.2882e-05 2024-09-12T22:32:08.818 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.818 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.818 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:08.818 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400732+0000", 2024-09-12T22:32:08.818 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.0299000000000001e-05 2024-09-12T22:32:08.818 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.818 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.818 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:08.818 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400793+0000", 2024-09-12T22:32:08.818 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.0253000000000001e-05 2024-09-12T22:32:08.818 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.818 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.818 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op must wait for map", 2024-09-12T22:32:08.818 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400798+0000", 2024-09-12T22:32:08.819 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.1569999999999999e-06 2024-09-12T22:32:08.819 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.819 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.819 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:08.819 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415059+0000", 2024-09-12T22:32:08.819 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.014260907 2024-09-12T22:32:08.819 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.819 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.819 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:08.819 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415396+0000", 2024-09-12T22:32:08.819 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00033720799999999997 2024-09-12T22:32:08.819 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.819 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.819 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:08.820 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415685+0000", 2024-09-12T22:32:08.820 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00028939900000000003 2024-09-12T22:32:08.820 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.820 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.820 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op_commit", 2024-09-12T22:32:08.820 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.418302+0000", 2024-09-12T22:32:08.820 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0026168039999999999 2024-09-12T22:32:08.820 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.820 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.820 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:08.820 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.423445+0000", 2024-09-12T22:32:08.820 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0051428150000000002 2024-09-12T22:32:08.820 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.820 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.821 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:08.821 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.423499+0000", 2024-09-12T22:32:08.821 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.3953000000000003e-05 2024-09-12T22:32:08.821 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.821 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.821 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:08.821 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.423540+0000", 2024-09-12T22:32:08.821 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.0813999999999999e-05 2024-09-12T22:32:08.821 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:08.821 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:08.821 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:08.821 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.821 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.822 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:08.822 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.400740+0000", 2024-09-12T22:32:08.822 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 31.398669123000001, 2024-09-12T22:32:08.822 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.022927528999999999, 2024-09-12T22:32:08.822 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:08.822 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:08.822 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:08.822 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:08.822 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.822 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:08.822 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400740+0000", 2024-09-12T22:32:08.822 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:08.822 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.823 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.823 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:08.823 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400740+0000", 2024-09-12T22:32:08.823 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:08.823 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.823 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.823 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:08.823 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400740+0000", 2024-09-12T22:32:08.823 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.3000000000000001e-07 2024-09-12T22:32:08.823 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.823 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.823 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:08.823 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400743+0000", 2024-09-12T22:32:08.823 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.5840000000000002e-06 2024-09-12T22:32:08.824 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.824 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.824 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:08.824 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400757+0000", 2024-09-12T22:32:08.824 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.3988999999999999e-05 2024-09-12T22:32:08.824 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.824 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.824 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:08.824 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400763+0000", 2024-09-12T22:32:08.824 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.686e-06 2024-09-12T22:32:08.824 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.824 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.824 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:08.825 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400818+0000", 2024-09-12T22:32:08.825 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.4941000000000001e-05 2024-09-12T22:32:08.825 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.825 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.825 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:32:08.825 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400824+0000", 2024-09-12T22:32:08.825 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.4600000000000002e-06 2024-09-12T22:32:08.825 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.825 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.825 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:08.825 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416227+0000", 2024-09-12T22:32:08.825 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.015403604 2024-09-12T22:32:08.825 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.826 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.826 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:08.826 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416306+0000", 2024-09-12T22:32:08.826 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 7.9126000000000001e-05 2024-09-12T22:32:08.826 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.826 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.826 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:08.826 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416678+0000", 2024-09-12T22:32:08.826 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00037105500000000002 2024-09-12T22:32:08.826 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.826 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.827 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op_commit", 2024-09-12T22:32:08.827 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.418363+0000", 2024-09-12T22:32:08.827 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.001685095 2024-09-12T22:32:08.827 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.827 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.827 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:08.827 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.423591+0000", 2024-09-12T22:32:08.827 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0052283980000000004 2024-09-12T22:32:08.827 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.827 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.828 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:08.828 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.423624+0000", 2024-09-12T22:32:08.828 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.3024000000000001e-05 2024-09-12T22:32:08.828 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.828 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.828 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:08.828 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.423667+0000", 2024-09-12T22:32:08.828 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.3136999999999997e-05 2024-09-12T22:32:08.828 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:08.828 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:08.828 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:08.828 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.829 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.829 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:08.829 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.400783+0000", 2024-09-12T22:32:08.829 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 31.398625590999998, 2024-09-12T22:32:08.829 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.016563729999999999, 2024-09-12T22:32:08.829 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:08.829 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:08.829 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:08.829 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:08.829 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.829 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:08.829 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400783+0000", 2024-09-12T22:32:08.829 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:08.830 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.830 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.830 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:08.830 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400783+0000", 2024-09-12T22:32:08.830 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:08.830 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.830 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.830 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:08.830 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400784+0000", 2024-09-12T22:32:08.830 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.5900000000000002e-07 2024-09-12T22:32:08.830 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.830 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.830 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:08.830 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400787+0000", 2024-09-12T22:32:08.831 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.1690000000000001e-06 2024-09-12T22:32:08.831 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.831 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.831 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:08.831 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400794+0000", 2024-09-12T22:32:08.831 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 7.058e-06 2024-09-12T22:32:08.831 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.831 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.831 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:08.831 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400798+0000", 2024-09-12T22:32:08.831 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.335e-06 2024-09-12T22:32:08.831 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.831 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.832 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:08.832 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400841+0000", 2024-09-12T22:32:08.832 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.2369e-05 2024-09-12T22:32:08.832 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.832 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.832 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op must wait for map", 2024-09-12T22:32:08.832 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400844+0000", 2024-09-12T22:32:08.832 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.128e-06 2024-09-12T22:32:08.832 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.832 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.832 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:08.832 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.410479+0000", 2024-09-12T22:32:08.832 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0096354189999999992 2024-09-12T22:32:08.832 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.833 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.833 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:08.833 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.410597+0000", 2024-09-12T22:32:08.833 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.000118305 2024-09-12T22:32:08.833 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.833 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.833 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:08.833 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.410838+0000", 2024-09-12T22:32:08.833 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.000240967 2024-09-12T22:32:08.833 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.834 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.834 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op_commit", 2024-09-12T22:32:08.834 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416489+0000", 2024-09-12T22:32:08.834 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0056507989999999998 2024-09-12T22:32:08.834 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.834 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.834 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:08.834 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417255+0000", 2024-09-12T22:32:08.834 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00076626199999999998 2024-09-12T22:32:08.834 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.834 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.834 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:08.834 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417306+0000", 2024-09-12T22:32:08.834 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.0319999999999999e-05 2024-09-12T22:32:08.835 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.835 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.835 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:08.835 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417347+0000", 2024-09-12T22:32:08.835 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.1140000000000003e-05 2024-09-12T22:32:08.835 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:08.835 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:08.835 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:08.835 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.835 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.835 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:08.835 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.400811+0000", 2024-09-12T22:32:08.835 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 31.398597521999999, 2024-09-12T22:32:08.835 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.017061263, 2024-09-12T22:32:08.836 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:08.836 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:08.836 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:08.836 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:08.836 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.836 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:08.836 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400811+0000", 2024-09-12T22:32:08.836 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:08.836 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.836 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.836 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:08.836 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400811+0000", 2024-09-12T22:32:08.836 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:08.837 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.837 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.837 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:08.837 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400812+0000", 2024-09-12T22:32:08.837 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.27e-07 2024-09-12T22:32:08.837 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.837 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.837 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:08.837 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400814+0000", 2024-09-12T22:32:08.837 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.553e-06 2024-09-12T22:32:08.837 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.837 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.838 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:08.838 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400819+0000", 2024-09-12T22:32:08.838 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.3569999999999997e-06 2024-09-12T22:32:08.838 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.838 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.838 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:08.838 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400824+0000", 2024-09-12T22:32:08.838 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.6820000000000002e-06 2024-09-12T22:32:08.838 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.838 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.838 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:08.838 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400871+0000", 2024-09-12T22:32:08.838 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.7311000000000002e-05 2024-09-12T22:32:08.839 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.839 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.839 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:32:08.839 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400875+0000", 2024-09-12T22:32:08.839 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.0960000000000001e-06 2024-09-12T22:32:08.839 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.839 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.839 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:08.839 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.412071+0000", 2024-09-12T22:32:08.839 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.011195999999999999 2024-09-12T22:32:08.839 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.839 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.840 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:08.840 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.412520+0000", 2024-09-12T22:32:08.840 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.000449522 2024-09-12T22:32:08.840 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.840 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.840 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:08.840 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.412655+0000", 2024-09-12T22:32:08.840 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00013487899999999999 2024-09-12T22:32:08.840 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.840 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.840 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op_commit", 2024-09-12T22:32:08.840 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417096+0000", 2024-09-12T22:32:08.840 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.004441113 2024-09-12T22:32:08.841 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.841 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.841 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:08.841 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417768+0000", 2024-09-12T22:32:08.841 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00067161100000000002 2024-09-12T22:32:08.841 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.841 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.841 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:08.841 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417834+0000", 2024-09-12T22:32:08.841 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.6058999999999999e-05 2024-09-12T22:32:08.841 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.841 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.841 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:08.842 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417873+0000", 2024-09-12T22:32:08.842 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.8753e-05 2024-09-12T22:32:08.842 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:08.842 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:08.842 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:08.842 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.842 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.842 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:08.842 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.400842+0000", 2024-09-12T22:32:08.842 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 31.398566814999999, 2024-09-12T22:32:08.842 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.022846262999999999, 2024-09-12T22:32:08.842 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:08.842 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:08.843 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:08.843 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:08.843 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.843 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:08.843 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400842+0000", 2024-09-12T22:32:08.843 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:08.843 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.843 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.843 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:08.843 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400842+0000", 2024-09-12T22:32:08.843 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:08.843 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.843 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.844 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:08.844 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400842+0000", 2024-09-12T22:32:08.844 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.9900000000000002e-07 2024-09-12T22:32:08.844 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.844 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.844 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:08.844 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400845+0000", 2024-09-12T22:32:08.844 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.8609999999999998e-06 2024-09-12T22:32:08.844 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.844 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.844 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:08.844 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400850+0000", 2024-09-12T22:32:08.844 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.634e-06 2024-09-12T22:32:08.844 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.844 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.845 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:08.845 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400855+0000", 2024-09-12T22:32:08.845 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.8339999999999998e-06 2024-09-12T22:32:08.845 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.845 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.845 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:08.845 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400886+0000", 2024-09-12T22:32:08.845 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.1393999999999998e-05 2024-09-12T22:32:08.845 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.845 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.845 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:32:08.845 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400888+0000", 2024-09-12T22:32:08.846 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.3470000000000001e-06 2024-09-12T22:32:08.846 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.846 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.846 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:08.846 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415640+0000", 2024-09-12T22:32:08.846 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.014751965000000001 2024-09-12T22:32:08.846 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.846 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.846 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:08.846 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415821+0000", 2024-09-12T22:32:08.846 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00018064399999999999 2024-09-12T22:32:08.847 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.847 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.847 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:08.847 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415949+0000", 2024-09-12T22:32:08.847 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00012816699999999999 2024-09-12T22:32:08.847 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.847 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.847 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op_commit", 2024-09-12T22:32:08.847 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.418337+0000", 2024-09-12T22:32:08.847 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0023878469999999998 2024-09-12T22:32:08.847 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.847 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.847 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:08.848 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.423588+0000", 2024-09-12T22:32:08.848 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0052509849999999997 2024-09-12T22:32:08.848 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.848 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.848 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:08.848 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.423650+0000", 2024-09-12T22:32:08.848 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.2026999999999994e-05 2024-09-12T22:32:08.848 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.848 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.848 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:08.848 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.423688+0000", 2024-09-12T22:32:08.848 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.8259000000000001e-05 2024-09-12T22:32:08.848 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:08.849 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:08.849 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:08.849 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.849 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.849 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:08.849 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.400862+0000", 2024-09-12T22:32:08.849 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 31.398546841000002, 2024-09-12T22:32:08.849 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.016404294, 2024-09-12T22:32:08.849 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:08.849 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:08.849 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "started", 2024-09-12T22:32:08.849 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:08.849 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.850 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:08.850 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400862+0000", 2024-09-12T22:32:08.850 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:08.850 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.850 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.850 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:08.850 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400862+0000", 2024-09-12T22:32:08.850 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:08.850 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.850 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.850 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:08.850 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400862+0000", 2024-09-12T22:32:08.850 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.8099999999999999e-07 2024-09-12T22:32:08.851 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.851 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.851 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:08.851 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400870+0000", 2024-09-12T22:32:08.851 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 8.1349999999999992e-06 2024-09-12T22:32:08.851 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.851 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.851 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:08.851 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400876+0000", 2024-09-12T22:32:08.851 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.2039999999999996e-06 2024-09-12T22:32:08.851 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.851 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.851 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:08.851 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400879+0000", 2024-09-12T22:32:08.851 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.529e-06 2024-09-12T22:32:08.852 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.852 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.852 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:08.852 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400912+0000", 2024-09-12T22:32:08.852 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.2653000000000001e-05 2024-09-12T22:32:08.852 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.852 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.852 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op must wait for map", 2024-09-12T22:32:08.852 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400915+0000", 2024-09-12T22:32:08.852 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.1099999999999999e-06 2024-09-12T22:32:08.852 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.852 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.852 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:08.852 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408727+0000", 2024-09-12T22:32:08.853 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0078123869999999996 2024-09-12T22:32:08.853 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.853 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.853 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:08.853 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408838+0000", 2024-09-12T22:32:08.853 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00011042700000000001 2024-09-12T22:32:08.853 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.853 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.853 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:08.853 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417266+0000", 2024-09-12T22:32:08.853 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0084285680000000009 2024-09-12T22:32:08.853 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:08.853 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:08.854 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:08.854 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.854 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.854 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:08.854 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.400889+0000", 2024-09-12T22:32:08.854 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 31.398519587999999, 2024-09-12T22:32:08.854 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.014929550999999999, 2024-09-12T22:32:08.854 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:08.854 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:08.854 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "started", 2024-09-12T22:32:08.854 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:08.854 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.854 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:08.855 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400889+0000", 2024-09-12T22:32:08.855 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:08.855 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.855 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.855 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:08.855 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400889+0000", 2024-09-12T22:32:08.855 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:08.855 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.855 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.855 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:08.855 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400890+0000", 2024-09-12T22:32:08.855 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.8699999999999995e-07 2024-09-12T22:32:08.855 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.855 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.856 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:08.856 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400893+0000", 2024-09-12T22:32:08.856 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.9569999999999998e-06 2024-09-12T22:32:08.856 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.856 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.856 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:08.856 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400899+0000", 2024-09-12T22:32:08.856 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.4189999999999999e-06 2024-09-12T22:32:08.856 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.856 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.856 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:08.856 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400905+0000", 2024-09-12T22:32:08.856 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.7880000000000003e-06 2024-09-12T22:32:08.857 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.857 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.857 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:08.857 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400943+0000", 2024-09-12T22:32:08.857 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.7852999999999998e-05 2024-09-12T22:32:08.857 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.857 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.857 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op must wait for map", 2024-09-12T22:32:08.857 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400945+0000", 2024-09-12T22:32:08.857 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.627e-06 2024-09-12T22:32:08.857 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.857 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.857 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:08.858 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408398+0000", 2024-09-12T22:32:08.858 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0074525879999999996 2024-09-12T22:32:08.858 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.858 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.858 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:08.858 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408581+0000", 2024-09-12T22:32:08.858 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00018321900000000001 2024-09-12T22:32:08.858 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.858 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.858 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:08.858 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415819+0000", 2024-09-12T22:32:08.858 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0072376130000000004 2024-09-12T22:32:08.858 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:08.858 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:08.859 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:08.859 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.859 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.859 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:25 3.7 e19/17 3:e0b41d06:::609.00000000:head v 19'2, mlcod=0'0)", 2024-09-12T22:32:08.859 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.402511+0000", 2024-09-12T22:32:08.859 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 31.396897445, 2024-09-12T22:32:08.859 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0089735260000000008, 2024-09-12T22:32:08.859 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:08.859 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:08.859 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:08.859 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:08.859 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.859 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:08.860 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.402511+0000", 2024-09-12T22:32:08.860 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:08.860 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.860 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.860 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:08.860 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.402511+0000", 2024-09-12T22:32:08.860 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:08.860 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.860 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.860 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:08.860 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.402512+0000", 2024-09-12T22:32:08.860 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 8.71e-07 2024-09-12T22:32:08.860 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.861 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.861 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:08.861 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.402520+0000", 2024-09-12T22:32:08.861 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 7.8529999999999992e-06 2024-09-12T22:32:08.861 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.861 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.861 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:08.861 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.402530+0000", 2024-09-12T22:32:08.861 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 9.859e-06 2024-09-12T22:32:08.861 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.861 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.861 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:08.861 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.402555+0000", 2024-09-12T22:32:08.861 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.4822000000000001e-05 2024-09-12T22:32:08.862 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.862 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.862 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:08.862 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.403173+0000", 2024-09-12T22:32:08.862 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00061813199999999997 2024-09-12T22:32:08.862 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.862 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.862 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:08.862 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.403195+0000", 2024-09-12T22:32:08.862 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.2286e-05 2024-09-12T22:32:08.862 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.862 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.862 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:08.862 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.411436+0000", 2024-09-12T22:32:08.862 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0082410539999999994 2024-09-12T22:32:08.863 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.863 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.863 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:08.863 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.411485+0000", 2024-09-12T22:32:08.863 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.8649000000000001e-05 2024-09-12T22:32:08.863 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:08.863 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:08.863 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:08.863 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.863 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.863 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:18 3.14 e19/17 3:2f55791f:::606.00000000:head v 19'1, mlcod=0'0)", 2024-09-12T22:32:08.863 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.406646+0000", 2024-09-12T22:32:08.863 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 31.392762293000001, 2024-09-12T22:32:08.863 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0082036980000000006, 2024-09-12T22:32:08.864 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:08.864 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:08.864 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:08.864 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:08.864 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.864 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:08.864 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406646+0000", 2024-09-12T22:32:08.864 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:08.864 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.864 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.864 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:08.864 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406646+0000", 2024-09-12T22:32:08.864 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:08.865 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.865 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.865 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:08.865 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406647+0000", 2024-09-12T22:32:08.865 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.4499999999999998e-07 2024-09-12T22:32:08.865 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.865 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.865 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:08.865 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406651+0000", 2024-09-12T22:32:08.865 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.0300000000000004e-06 2024-09-12T22:32:08.865 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.865 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.865 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:08.866 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406657+0000", 2024-09-12T22:32:08.866 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.1330000000000004e-06 2024-09-12T22:32:08.866 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.866 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.866 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:08.866 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406665+0000", 2024-09-12T22:32:08.866 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 8.3650000000000004e-06 2024-09-12T22:32:08.866 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.866 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.866 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:08.866 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406804+0000", 2024-09-12T22:32:08.866 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00013900699999999999 2024-09-12T22:32:08.867 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.867 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.867 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:08.867 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406833+0000", 2024-09-12T22:32:08.867 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.8243e-05 2024-09-12T22:32:08.867 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.867 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.867 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:08.867 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.414741+0000", 2024-09-12T22:32:08.867 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0079089620000000003 2024-09-12T22:32:08.867 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.867 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.867 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:08.867 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.414850+0000", 2024-09-12T22:32:08.868 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.000108713 2024-09-12T22:32:08.868 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:08.868 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:08.868 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:08.868 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.868 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.868 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:6 3.10 e19/17 3:0d82a743:::600.00000000:head v 19'1, mlcod=0'0)", 2024-09-12T22:32:08.868 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.406692+0000", 2024-09-12T22:32:08.868 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 31.392716526000001, 2024-09-12T22:32:08.868 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0093004430000000003, 2024-09-12T22:32:08.868 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:08.868 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:08.868 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:08.869 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:08.869 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.869 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:08.869 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406692+0000", 2024-09-12T22:32:08.869 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:08.869 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.869 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.869 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:08.869 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406692+0000", 2024-09-12T22:32:08.869 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:08.869 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.869 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.869 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:08.869 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406693+0000", 2024-09-12T22:32:08.870 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.6300000000000001e-07 2024-09-12T22:32:08.870 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.870 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.870 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:08.870 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406702+0000", 2024-09-12T22:32:08.870 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 9.5589999999999994e-06 2024-09-12T22:32:08.870 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.870 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.870 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:08.870 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406725+0000", 2024-09-12T22:32:08.870 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.2977999999999999e-05 2024-09-12T22:32:08.870 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.870 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.871 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:08.871 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406732+0000", 2024-09-12T22:32:08.871 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.8430000000000004e-06 2024-09-12T22:32:08.871 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.871 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.871 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:08.871 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406979+0000", 2024-09-12T22:32:08.871 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00024729199999999998 2024-09-12T22:32:08.871 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.871 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.871 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:08.871 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407000+0000", 2024-09-12T22:32:08.871 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.0573000000000001e-05 2024-09-12T22:32:08.872 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.872 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.872 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:08.872 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415928+0000", 2024-09-12T22:32:08.872 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0089286179999999993 2024-09-12T22:32:08.872 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.872 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.872 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:08.872 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415993+0000", 2024-09-12T22:32:08.872 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.4216999999999999e-05 2024-09-12T22:32:08.872 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:08.872 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:08.872 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:08.873 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.873 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.873 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:2 3.f e19/17 3:f1f69726:::400.00000000:head v 19'1, mlcod=0'0)", 2024-09-12T22:32:08.873 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.406942+0000", 2024-09-12T22:32:08.873 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 31.392466839000001, 2024-09-12T22:32:08.873 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0098433259999999995, 2024-09-12T22:32:08.873 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:08.873 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:08.873 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:08.873 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:08.873 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.873 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:08.873 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406942+0000", 2024-09-12T22:32:08.873 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:08.874 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.874 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.874 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:08.874 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406942+0000", 2024-09-12T22:32:08.874 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:08.874 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.874 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.874 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:08.874 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406943+0000", 2024-09-12T22:32:08.874 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.8800000000000002e-07 2024-09-12T22:32:08.874 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.874 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.874 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:08.874 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406949+0000", 2024-09-12T22:32:08.874 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.5869999999999998e-06 2024-09-12T22:32:08.875 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.875 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.875 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:08.875 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406960+0000", 2024-09-12T22:32:08.875 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.0873000000000001e-05 2024-09-12T22:32:08.875 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.875 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.875 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:08.875 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406970+0000", 2024-09-12T22:32:08.875 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 9.9119999999999993e-06 2024-09-12T22:32:08.875 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.875 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.875 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:08.876 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407535+0000", 2024-09-12T22:32:08.876 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00056508899999999996 2024-09-12T22:32:08.876 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.876 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.876 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:08.876 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407556+0000", 2024-09-12T22:32:08.876 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.1348999999999998e-05 2024-09-12T22:32:08.876 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.876 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.876 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:08.876 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416751+0000", 2024-09-12T22:32:08.876 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0091950109999999995 2024-09-12T22:32:08.876 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.876 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.877 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:08.877 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416785+0000", 2024-09-12T22:32:08.877 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.3917000000000001e-05 2024-09-12T22:32:08.877 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:08.877 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:08.877 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:08.877 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.877 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.877 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:19 3.14 e19/17 3:2f55791f:::606.00000000:head v 19'2, mlcod=0'0)", 2024-09-12T22:32:08.877 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.406983+0000", 2024-09-12T22:32:08.877 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 31.392425859999999, 2024-09-12T22:32:08.877 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0080362149999999993, 2024-09-12T22:32:08.877 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:08.877 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:08.878 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:08.878 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:08.878 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.878 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:08.878 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406983+0000", 2024-09-12T22:32:08.878 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:08.878 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.878 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.878 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:08.878 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406983+0000", 2024-09-12T22:32:08.878 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:08.878 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.878 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.879 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:08.879 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406983+0000", 2024-09-12T22:32:08.879 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.8200000000000001e-07 2024-09-12T22:32:08.879 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.879 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.879 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:08.879 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406999+0000", 2024-09-12T22:32:08.879 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.5747999999999999e-05 2024-09-12T22:32:08.879 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.879 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.879 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:08.879 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407006+0000", 2024-09-12T22:32:08.879 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 7.2609999999999996e-06 2024-09-12T22:32:08.880 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.880 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.880 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:08.880 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407035+0000", 2024-09-12T22:32:08.880 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.8214000000000001e-05 2024-09-12T22:32:08.880 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.880 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.880 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:08.880 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407092+0000", 2024-09-12T22:32:08.880 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.7027000000000001e-05 2024-09-12T22:32:08.880 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.880 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.880 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:08.881 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407126+0000", 2024-09-12T22:32:08.881 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.4082000000000003e-05 2024-09-12T22:32:08.881 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.881 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.881 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:08.881 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.414985+0000", 2024-09-12T22:32:08.881 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0078597319999999995 2024-09-12T22:32:08.881 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.881 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.881 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:08.881 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415019+0000", 2024-09-12T22:32:08.881 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.3769000000000001e-05 2024-09-12T22:32:08.881 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:08.882 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:08.882 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:08.882 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.882 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.882 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:7 3.10 e19/17 3:0d82a743:::600.00000000:head v 19'2, mlcod=0'0)", 2024-09-12T22:32:08.882 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.407048+0000", 2024-09-12T22:32:08.882 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 31.392360321999998, 2024-09-12T22:32:08.882 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.008979931, 2024-09-12T22:32:08.882 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:08.882 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:08.882 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:08.882 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:08.882 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.882 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:08.883 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407048+0000", 2024-09-12T22:32:08.883 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:08.883 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.883 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.883 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:08.883 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407048+0000", 2024-09-12T22:32:08.883 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:08.883 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.883 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.883 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:08.883 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407049+0000", 2024-09-12T22:32:08.883 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.9099999999999999e-07 2024-09-12T22:32:08.883 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.884 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.884 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:08.884 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407054+0000", 2024-09-12T22:32:08.884 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.1850000000000003e-06 2024-09-12T22:32:08.884 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.884 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.884 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:08.884 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407061+0000", 2024-09-12T22:32:08.884 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 7.0809999999999996e-06 2024-09-12T22:32:08.884 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.884 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.884 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:08.884 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407067+0000", 2024-09-12T22:32:08.885 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.9540000000000001e-06 2024-09-12T22:32:08.885 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.885 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.885 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:08.885 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407299+0000", 2024-09-12T22:32:08.885 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.000232122 2024-09-12T22:32:08.885 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.885 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.885 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:08.885 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407317+0000", 2024-09-12T22:32:08.885 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.7447000000000001e-05 2024-09-12T22:32:08.885 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.885 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.886 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:08.886 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415996+0000", 2024-09-12T22:32:08.886 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0086791799999999999 2024-09-12T22:32:08.886 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.886 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.886 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:08.886 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416028+0000", 2024-09-12T22:32:08.886 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.2570999999999997e-05 2024-09-12T22:32:08.886 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:08.886 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:08.886 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:08.886 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.886 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.886 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:8 3.10 e19/17 3:09401a81:::601.00000000:head v 19'3, mlcod=0'0)", 2024-09-12T22:32:08.887 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.407081+0000", 2024-09-12T22:32:08.887 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 31.392327632000001, 2024-09-12T22:32:08.887 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0089807270000000008, 2024-09-12T22:32:08.887 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:08.887 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:08.887 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:08.887 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:08.887 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.887 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:08.887 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407081+0000", 2024-09-12T22:32:08.887 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:08.887 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.887 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.888 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:08.888 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407081+0000", 2024-09-12T22:32:08.888 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:08.888 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.888 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.888 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:08.888 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407082+0000", 2024-09-12T22:32:08.888 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.7899999999999999e-07 2024-09-12T22:32:08.888 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.888 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.888 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:08.888 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407086+0000", 2024-09-12T22:32:08.888 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.7679999999999999e-06 2024-09-12T22:32:08.889 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.889 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.889 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:08.889 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407094+0000", 2024-09-12T22:32:08.889 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 8.1470000000000001e-06 2024-09-12T22:32:08.889 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.889 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.889 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:08.889 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407100+0000", 2024-09-12T22:32:08.889 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.4539999999999998e-06 2024-09-12T22:32:08.889 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.889 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.889 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:08.890 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407540+0000", 2024-09-12T22:32:08.890 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00043973699999999999 2024-09-12T22:32:08.890 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.890 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.890 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:08.890 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407553+0000", 2024-09-12T22:32:08.890 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.3368e-05 2024-09-12T22:32:08.890 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.890 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.890 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:08.890 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416032+0000", 2024-09-12T22:32:08.890 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0084793790000000004 2024-09-12T22:32:08.890 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.890 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.891 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:08.891 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416062+0000", 2024-09-12T22:32:08.891 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.9495000000000001e-05 2024-09-12T22:32:08.891 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:08.891 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:08.891 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:08.891 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.891 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.891 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:31 3.d e19/17 3:b50e409b:::mds_snaptable:head v 19'1, mlcod=0'0)", 2024-09-12T22:32:08.891 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.408508+0000", 2024-09-12T22:32:08.891 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 31.390901115999998, 2024-09-12T22:32:08.891 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0080056620000000002, 2024-09-12T22:32:08.891 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:08.891 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:08.892 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:08.892 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:08.892 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.892 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:08.892 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408508+0000", 2024-09-12T22:32:08.892 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:08.892 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.892 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.892 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:08.892 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408508+0000", 2024-09-12T22:32:08.892 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:08.892 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.892 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.892 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:08.893 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408508+0000", 2024-09-12T22:32:08.893 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.7e-07 2024-09-12T22:32:08.893 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.893 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.893 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:08.893 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408515+0000", 2024-09-12T22:32:08.893 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.4439999999999996e-06 2024-09-12T22:32:08.893 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.893 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.893 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:08.893 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408521+0000", 2024-09-12T22:32:08.893 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.2729999999999999e-06 2024-09-12T22:32:08.893 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.893 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.893 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:08.894 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408526+0000", 2024-09-12T22:32:08.894 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.3299999999999998e-06 2024-09-12T22:32:08.894 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.894 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.894 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:08.894 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.410190+0000", 2024-09-12T22:32:08.894 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.001663615 2024-09-12T22:32:08.894 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.894 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.894 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:08.894 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.410258+0000", 2024-09-12T22:32:08.894 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.8146999999999997e-05 2024-09-12T22:32:08.894 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.894 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.895 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:08.895 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416477+0000", 2024-09-12T22:32:08.895 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0062187329999999997 2024-09-12T22:32:08.895 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.895 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.895 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:08.895 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416513+0000", 2024-09-12T22:32:08.895 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.6650000000000003e-05 2024-09-12T22:32:08.895 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:08.895 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:08.895 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:08.895 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.895 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.896 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:9 3.10 e19/17 3:09401a81:::601.00000000:head v 19'4, mlcod=0'0)", 2024-09-12T22:32:08.896 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.408991+0000", 2024-09-12T22:32:08.896 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 31.390417366000001, 2024-09-12T22:32:08.896 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0080459209999999993, 2024-09-12T22:32:08.896 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:08.896 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:08.896 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:08.896 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:08.896 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.896 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:08.896 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408991+0000", 2024-09-12T22:32:08.896 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:08.896 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.896 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.897 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:08.897 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408991+0000", 2024-09-12T22:32:08.897 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:08.897 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.897 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.897 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:08.897 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408992+0000", 2024-09-12T22:32:08.897 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.1799999999999995e-07 2024-09-12T22:32:08.897 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.897 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.897 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:08.897 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409005+0000", 2024-09-12T22:32:08.897 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.261e-05 2024-09-12T22:32:08.897 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.898 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.898 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:08.898 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409015+0000", 2024-09-12T22:32:08.898 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.0001e-05 2024-09-12T22:32:08.898 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.898 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.898 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:08.898 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409023+0000", 2024-09-12T22:32:08.898 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 8.7569999999999993e-06 2024-09-12T22:32:08.898 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.898 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.898 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:08.898 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.411355+0000", 2024-09-12T22:32:08.898 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0023313520000000001 2024-09-12T22:32:08.899 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.899 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.899 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:08.899 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.411374+0000", 2024-09-12T22:32:08.899 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.8810000000000001e-05 2024-09-12T22:32:08.899 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.899 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.899 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:08.899 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416994+0000", 2024-09-12T22:32:08.899 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.005620524 2024-09-12T22:32:08.899 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.899 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.899 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:08.899 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417037+0000", 2024-09-12T22:32:08.900 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.3248999999999999e-05 2024-09-12T22:32:08.900 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:08.900 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:08.900 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:08.900 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.900 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.900 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:10 3.10 e19/17 3:0bd6d154:::602.00000000:head v 19'5, mlcod=0'0)", 2024-09-12T22:32:08.900 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.409038+0000", 2024-09-12T22:32:08.900 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 31.390370691000001, 2024-09-12T22:32:08.900 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0080541689999999999, 2024-09-12T22:32:08.900 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:08.900 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:08.900 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:08.901 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:08.901 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.901 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:08.901 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409038+0000", 2024-09-12T22:32:08.901 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:08.901 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.901 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.901 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:08.901 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409038+0000", 2024-09-12T22:32:08.901 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:08.901 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.901 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.901 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:08.901 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409038+0000", 2024-09-12T22:32:08.902 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.7899999999999999e-07 2024-09-12T22:32:08.902 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.902 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.902 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:08.902 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409043+0000", 2024-09-12T22:32:08.902 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.6589999999999998e-06 2024-09-12T22:32:08.902 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.902 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.902 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:08.902 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409050+0000", 2024-09-12T22:32:08.902 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 7.0829999999999998e-06 2024-09-12T22:32:08.902 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.902 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.902 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:08.903 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409058+0000", 2024-09-12T22:32:08.903 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 7.7309999999999993e-06 2024-09-12T22:32:08.903 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.903 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.903 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:08.903 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.411654+0000", 2024-09-12T22:32:08.903 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0025961650000000001 2024-09-12T22:32:08.903 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.903 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.903 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:08.903 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.411671+0000", 2024-09-12T22:32:08.903 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.7356000000000001e-05 2024-09-12T22:32:08.903 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.903 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.904 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:08.904 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417040+0000", 2024-09-12T22:32:08.904 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0053681889999999998 2024-09-12T22:32:08.904 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.904 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.904 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:08.904 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417092+0000", 2024-09-12T22:32:08.904 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.2607e-05 2024-09-12T22:32:08.904 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:08.904 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:08.904 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:08.904 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.904 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.905 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:11 3.10 e19/17 3:0bd6d154:::602.00000000:head v 19'6, mlcod=0'0)", 2024-09-12T22:32:08.905 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.409768+0000", 2024-09-12T22:32:08.905 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 31.38964125, 2024-09-12T22:32:08.905 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0074442759999999997, 2024-09-12T22:32:08.905 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:08.905 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:08.905 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:08.905 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:08.905 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.905 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:08.905 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409768+0000", 2024-09-12T22:32:08.905 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:08.905 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.905 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.906 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:08.906 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409768+0000", 2024-09-12T22:32:08.906 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:08.906 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.906 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.906 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:08.906 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409768+0000", 2024-09-12T22:32:08.906 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.37e-07 2024-09-12T22:32:08.906 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.906 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.906 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:08.906 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409775+0000", 2024-09-12T22:32:08.906 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.4670000000000001e-06 2024-09-12T22:32:08.906 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.907 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.907 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:08.907 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409793+0000", 2024-09-12T22:32:08.907 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.8162e-05 2024-09-12T22:32:08.907 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.907 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.907 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:08.907 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409954+0000", 2024-09-12T22:32:08.907 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00016072999999999999 2024-09-12T22:32:08.907 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.907 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.907 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:08.907 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.411943+0000", 2024-09-12T22:32:08.907 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0019897069999999998 2024-09-12T22:32:08.908 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.908 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.908 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:08.908 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.412069+0000", 2024-09-12T22:32:08.908 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00012546200000000001 2024-09-12T22:32:08.908 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.908 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.908 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:08.908 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417114+0000", 2024-09-12T22:32:08.908 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.005045023 2024-09-12T22:32:08.908 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:08.908 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:08.908 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:08.908 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417212+0000", 2024-09-12T22:32:08.909 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 9.8088e-05 2024-09-12T22:32:08.909 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:08.909 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:08.909 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:08.909 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:08.909 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:08.909 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-09-12T22:32:08.910 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T22:32:08.911 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:08.909+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:08.911 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:32:09.011 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:09.010+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:09.027 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:32:09.027 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:32:09.027 INFO:teuthology.orchestra.run.smithi148.stdout: "num_ops": 0 2024-09-12T22:32:09.027 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:32:09.036 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:32:09.047 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0: {} 2024-09-12T22:32:09.047 INFO:teuthology.orchestra.run.smithi019.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T22:32:09.065 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T22:32:09.065 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:32:09.082 INFO:teuthology.orchestra.run.smithi019.stdout:osd.2: {} 2024-09-12T22:32:09.082 INFO:teuthology.orchestra.run.smithi019.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T22:32:09.120 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:09.119+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:09.179 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:09.180 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:09.188 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:32:09.213 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:32:09.212+0000 7fddec6a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30331) UID: 0 2024-09-12T22:32:09.314 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:09.313+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:09.331 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:09.331 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:09.340 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:32:09.417 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:09.416+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:09.458 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:09.458 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:09.467 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:32:09.518 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:09.517+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:09.612 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:09.612 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:09.621 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:32:09.622 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:09.619+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:09.721 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:32:09.721+0000 7fddec6a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30331) UID: 0 2024-09-12T22:32:09.764 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:09.764 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:09.773 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:32:09.822 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:32:09.821+0000 7fddec6a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30331) UID: 0 2024-09-12T22:32:09.886 INFO:teuthology.orchestra.run.smithi076.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:09.887 INFO:teuthology.orchestra.run.smithi076.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:09.895 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:32:09.923 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:09.922+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:10.024 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:10.023+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:10.038 INFO:teuthology.orchestra.run.smithi076.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:10.038 INFO:teuthology.orchestra.run.smithi076.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:10.047 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:32:10.124 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:32:10.123+0000 7fddec6a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30331) UID: 0 2024-09-12T22:32:10.146 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T22:32:10.150 INFO:teuthology.orchestra.run.smithi076.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:10.150 INFO:teuthology.orchestra.run.smithi076.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:10.159 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:32:10.225 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:32:10.225+0000 7fddec6a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30331) UID: 0 2024-09-12T22:32:10.265 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:10.265 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:10.273 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:32:10.313 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-09-12T22:32:10.313 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-12T22:32:10.313 INFO:tasks.thrashosds.thrasher:inject_pause on osd.2 2024-09-12T22:32:10.313 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-12T22:32:10.313 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-12T22:32:10.314 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok config set filestore_inject_stall 3 2024-09-12T22:32:10.326 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:10.325+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:10.376 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:10.376 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:10.385 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:32:10.416 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-09-12T22:32:10.416 INFO:teuthology.orchestra.run.smithi163.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-09-12T22:32:10.416 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-09-12T22:32:10.427 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:10.426+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:10.528 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:10.528 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:10.528 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:32:10.527+0000 7fddec6a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30331) UID: 0 2024-09-12T22:32:10.537 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:32:10.629 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:10.628+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:10.641 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:10.641 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:10.649 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:32:10.733 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:10.732+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:10.792 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:10.792 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:10.800 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:32:10.841 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:10.840+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:10.932 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:10.931+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:10.944 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:10.944 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:10.952 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:32:11.033 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:32:11.032+0000 7fddec6a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30331) UID: 0 2024-09-12T22:32:11.061 INFO:teuthology.orchestra.run.smithi076.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:11.062 INFO:teuthology.orchestra.run.smithi076.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:11.070 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:32:11.094 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T22:32:11.133 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:11.132+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:11.213 INFO:teuthology.orchestra.run.smithi076.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:11.213 INFO:teuthology.orchestra.run.smithi076.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:11.222 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:32:11.227 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0: {} 2024-09-12T22:32:11.227 INFO:teuthology.orchestra.run.smithi019.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T22:32:11.246 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T22:32:11.246 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:32:11.254 INFO:teuthology.orchestra.run.smithi019.stderr:nodeep-scrub is set 2024-09-12T22:32:11.266 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:32:11.265+0000 7fddec6a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30331) UID: 0 2024-09-12T22:32:11.272 INFO:teuthology.orchestra.run.smithi019.stdout:osd.2: {} 2024-09-12T22:32:11.273 INFO:teuthology.orchestra.run.smithi019.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T22:32:11.328 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-09-12T22:32:11.328 INFO:teuthology.orchestra.run.smithi076.stdout: "size": 20, 2024-09-12T22:32:11.328 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 600, 2024-09-12T22:32:11.328 INFO:teuthology.orchestra.run.smithi076.stdout: "ops": [ 2024-09-12T22:32:11.329 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.329 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:11.329 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.400604+0000", 2024-09-12T22:32:11.329 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 33.925588814000001, 2024-09-12T22:32:11.329 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.017278814, 2024-09-12T22:32:11.329 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:11.329 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:11.329 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:11.329 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:11.329 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.329 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:11.329 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400604+0000", 2024-09-12T22:32:11.329 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:11.330 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.330 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.330 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:11.330 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400604+0000", 2024-09-12T22:32:11.330 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:11.330 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.330 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.330 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:11.330 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400617+0000", 2024-09-12T22:32:11.330 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.3076e-05 2024-09-12T22:32:11.330 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.330 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.330 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:11.331 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400623+0000", 2024-09-12T22:32:11.331 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.5780000000000004e-06 2024-09-12T22:32:11.331 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.331 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.331 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:11.331 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400641+0000", 2024-09-12T22:32:11.331 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.8218000000000001e-05 2024-09-12T22:32:11.331 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.331 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.331 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:11.331 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400652+0000", 2024-09-12T22:32:11.331 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.0421999999999999e-05 2024-09-12T22:32:11.331 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.331 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.332 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:11.332 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400707+0000", 2024-09-12T22:32:11.332 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.4666000000000001e-05 2024-09-12T22:32:11.332 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.332 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.332 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op must wait for map", 2024-09-12T22:32:11.332 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400711+0000", 2024-09-12T22:32:11.332 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.5340000000000001e-06 2024-09-12T22:32:11.332 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.332 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.332 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:11.332 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.412066+0000", 2024-09-12T22:32:11.333 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.011354797999999999 2024-09-12T22:32:11.333 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.333 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.333 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:11.333 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.412672+0000", 2024-09-12T22:32:11.333 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00060620499999999996 2024-09-12T22:32:11.333 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.333 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.333 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:11.333 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.413032+0000", 2024-09-12T22:32:11.333 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00035955999999999998 2024-09-12T22:32:11.333 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.333 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.334 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op_commit", 2024-09-12T22:32:11.334 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417252+0000", 2024-09-12T22:32:11.334 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.004219899 2024-09-12T22:32:11.334 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.334 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.334 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:11.334 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417812+0000", 2024-09-12T22:32:11.334 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.000560182 2024-09-12T22:32:11.334 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.334 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.334 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:11.334 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417851+0000", 2024-09-12T22:32:11.334 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.9057999999999998e-05 2024-09-12T22:32:11.334 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.335 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.335 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:11.335 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417882+0000", 2024-09-12T22:32:11.335 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.1618000000000001e-05 2024-09-12T22:32:11.335 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:11.335 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:11.335 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:11.335 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.335 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.335 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:11.335 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.400674+0000", 2024-09-12T22:32:11.335 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 33.925518095999998, 2024-09-12T22:32:11.335 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.017348971000000001, 2024-09-12T22:32:11.336 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:11.336 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:11.336 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:11.336 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:11.336 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.336 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:11.336 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400674+0000", 2024-09-12T22:32:11.336 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:11.336 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.336 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.336 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:11.336 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400674+0000", 2024-09-12T22:32:11.336 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:11.337 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.337 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.337 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:11.337 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400675+0000", 2024-09-12T22:32:11.337 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.37e-07 2024-09-12T22:32:11.337 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.337 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.337 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:11.337 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400678+0000", 2024-09-12T22:32:11.337 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.303e-06 2024-09-12T22:32:11.337 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.337 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.337 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:11.338 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400684+0000", 2024-09-12T22:32:11.338 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.0290000000000002e-06 2024-09-12T22:32:11.338 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.338 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.338 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:11.338 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400688+0000", 2024-09-12T22:32:11.338 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.0890000000000002e-06 2024-09-12T22:32:11.338 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.338 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.338 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:11.338 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400806+0000", 2024-09-12T22:32:11.338 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00011814700000000001 2024-09-12T22:32:11.338 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.339 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.339 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:32:11.339 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400811+0000", 2024-09-12T22:32:11.339 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.0479999999999998e-06 2024-09-12T22:32:11.339 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.339 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.339 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:11.339 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.413877+0000", 2024-09-12T22:32:11.339 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.013065561 2024-09-12T22:32:11.339 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.339 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.339 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:11.339 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.413984+0000", 2024-09-12T22:32:11.339 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.000106566 2024-09-12T22:32:11.340 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.340 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.340 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:11.340 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.414264+0000", 2024-09-12T22:32:11.340 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00028067199999999999 2024-09-12T22:32:11.340 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.340 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.340 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op_commit", 2024-09-12T22:32:11.340 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417614+0000", 2024-09-12T22:32:11.340 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0033500729999999999 2024-09-12T22:32:11.340 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.340 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.340 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:11.341 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417946+0000", 2024-09-12T22:32:11.341 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00033209199999999998 2024-09-12T22:32:11.341 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.341 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.341 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:11.341 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417995+0000", 2024-09-12T22:32:11.341 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.808e-05 2024-09-12T22:32:11.341 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.341 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.341 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:11.341 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.418023+0000", 2024-09-12T22:32:11.341 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.8773999999999999e-05 2024-09-12T22:32:11.341 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:11.342 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:11.342 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:11.342 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.342 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.342 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:11.342 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.400694+0000", 2024-09-12T22:32:11.342 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 33.925498466999997, 2024-09-12T22:32:11.342 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.022845628, 2024-09-12T22:32:11.342 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:11.342 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:11.342 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:11.342 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:11.342 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.342 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:11.343 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400694+0000", 2024-09-12T22:32:11.343 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:11.343 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.343 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.343 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:11.343 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400694+0000", 2024-09-12T22:32:11.343 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:11.343 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.343 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.343 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:11.343 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400694+0000", 2024-09-12T22:32:11.343 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.48e-07 2024-09-12T22:32:11.343 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.344 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.344 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:11.344 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400709+0000", 2024-09-12T22:32:11.344 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.4888999999999999e-05 2024-09-12T22:32:11.344 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.344 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.344 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:11.344 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400722+0000", 2024-09-12T22:32:11.344 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.2882e-05 2024-09-12T22:32:11.344 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.344 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.344 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:11.344 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400732+0000", 2024-09-12T22:32:11.344 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.0299000000000001e-05 2024-09-12T22:32:11.345 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.345 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.345 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:11.345 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400793+0000", 2024-09-12T22:32:11.345 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.0253000000000001e-05 2024-09-12T22:32:11.345 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.345 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.345 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op must wait for map", 2024-09-12T22:32:11.345 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400798+0000", 2024-09-12T22:32:11.345 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.1569999999999999e-06 2024-09-12T22:32:11.345 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.345 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.345 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:11.345 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415059+0000", 2024-09-12T22:32:11.346 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.014260907 2024-09-12T22:32:11.346 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.346 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.346 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:11.346 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415396+0000", 2024-09-12T22:32:11.346 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00033720799999999997 2024-09-12T22:32:11.346 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.346 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.346 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:11.346 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415685+0000", 2024-09-12T22:32:11.346 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00028939900000000003 2024-09-12T22:32:11.346 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.346 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.347 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op_commit", 2024-09-12T22:32:11.347 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.418302+0000", 2024-09-12T22:32:11.347 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0026168039999999999 2024-09-12T22:32:11.347 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.347 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.347 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:11.347 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.423445+0000", 2024-09-12T22:32:11.347 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0051428150000000002 2024-09-12T22:32:11.347 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.347 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.347 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:11.347 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.423499+0000", 2024-09-12T22:32:11.347 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.3953000000000003e-05 2024-09-12T22:32:11.347 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.348 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.348 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:11.348 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.423540+0000", 2024-09-12T22:32:11.348 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.0813999999999999e-05 2024-09-12T22:32:11.348 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:11.348 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:11.348 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:11.348 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.348 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.348 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:11.348 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.400740+0000", 2024-09-12T22:32:11.348 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 33.925452743999998, 2024-09-12T22:32:11.349 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.022927528999999999, 2024-09-12T22:32:11.349 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:11.349 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:11.349 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:11.349 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:11.349 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.349 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:11.349 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400740+0000", 2024-09-12T22:32:11.349 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:11.349 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.349 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.349 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:11.349 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400740+0000", 2024-09-12T22:32:11.349 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:11.350 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.350 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.350 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:11.350 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400740+0000", 2024-09-12T22:32:11.350 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.3000000000000001e-07 2024-09-12T22:32:11.350 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.350 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.350 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:11.350 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400743+0000", 2024-09-12T22:32:11.350 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.5840000000000002e-06 2024-09-12T22:32:11.350 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.350 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.351 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:11.351 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400757+0000", 2024-09-12T22:32:11.351 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.3988999999999999e-05 2024-09-12T22:32:11.351 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.351 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.351 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:11.351 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400763+0000", 2024-09-12T22:32:11.351 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.686e-06 2024-09-12T22:32:11.351 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.351 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.351 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:11.351 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400818+0000", 2024-09-12T22:32:11.351 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.4941000000000001e-05 2024-09-12T22:32:11.351 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.352 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.352 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:32:11.352 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400824+0000", 2024-09-12T22:32:11.352 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.4600000000000002e-06 2024-09-12T22:32:11.352 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.352 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.352 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:11.352 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416227+0000", 2024-09-12T22:32:11.352 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.015403604 2024-09-12T22:32:11.352 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.352 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.352 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:11.352 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416306+0000", 2024-09-12T22:32:11.352 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 7.9126000000000001e-05 2024-09-12T22:32:11.353 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.353 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.353 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:11.353 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416678+0000", 2024-09-12T22:32:11.353 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00037105500000000002 2024-09-12T22:32:11.353 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.353 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.353 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op_commit", 2024-09-12T22:32:11.353 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.418363+0000", 2024-09-12T22:32:11.353 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.001685095 2024-09-12T22:32:11.353 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.353 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.353 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:11.354 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.423591+0000", 2024-09-12T22:32:11.354 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0052283980000000004 2024-09-12T22:32:11.354 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.354 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.354 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:11.354 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.423624+0000", 2024-09-12T22:32:11.354 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.3024000000000001e-05 2024-09-12T22:32:11.354 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.354 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.354 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:11.354 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.423667+0000", 2024-09-12T22:32:11.354 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.3136999999999997e-05 2024-09-12T22:32:11.354 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:11.354 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:11.354 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:11.355 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.355 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.355 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:11.355 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.400783+0000", 2024-09-12T22:32:11.355 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 33.925409211999998, 2024-09-12T22:32:11.355 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.016563729999999999, 2024-09-12T22:32:11.355 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:11.355 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:11.355 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:11.355 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:11.355 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.355 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:11.355 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400783+0000", 2024-09-12T22:32:11.356 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:11.356 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.356 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.356 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:11.356 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400783+0000", 2024-09-12T22:32:11.356 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:11.356 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.356 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.356 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:11.356 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400784+0000", 2024-09-12T22:32:11.356 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.5900000000000002e-07 2024-09-12T22:32:11.356 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.356 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.357 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:11.357 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400787+0000", 2024-09-12T22:32:11.357 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.1690000000000001e-06 2024-09-12T22:32:11.357 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.357 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.357 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:11.357 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400794+0000", 2024-09-12T22:32:11.357 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 7.058e-06 2024-09-12T22:32:11.357 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.357 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.357 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:11.357 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400798+0000", 2024-09-12T22:32:11.357 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.335e-06 2024-09-12T22:32:11.358 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.358 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.358 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:11.358 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400841+0000", 2024-09-12T22:32:11.358 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.2369e-05 2024-09-12T22:32:11.358 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.358 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.358 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op must wait for map", 2024-09-12T22:32:11.358 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400844+0000", 2024-09-12T22:32:11.358 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.128e-06 2024-09-12T22:32:11.358 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.358 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.358 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:11.359 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.410479+0000", 2024-09-12T22:32:11.359 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0096354189999999992 2024-09-12T22:32:11.359 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.359 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.359 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:11.359 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.410597+0000", 2024-09-12T22:32:11.359 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.000118305 2024-09-12T22:32:11.359 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.359 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.359 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:11.359 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.410838+0000", 2024-09-12T22:32:11.359 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.000240967 2024-09-12T22:32:11.359 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.360 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.360 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op_commit", 2024-09-12T22:32:11.360 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416489+0000", 2024-09-12T22:32:11.360 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0056507989999999998 2024-09-12T22:32:11.360 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.360 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.360 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:11.360 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417255+0000", 2024-09-12T22:32:11.360 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00076626199999999998 2024-09-12T22:32:11.360 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.360 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.360 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:11.361 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417306+0000", 2024-09-12T22:32:11.361 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.0319999999999999e-05 2024-09-12T22:32:11.361 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.361 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.361 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:11.361 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417347+0000", 2024-09-12T22:32:11.361 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.1140000000000003e-05 2024-09-12T22:32:11.361 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:11.361 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:11.361 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:11.361 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.361 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.361 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:11.362 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.400811+0000", 2024-09-12T22:32:11.362 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 33.925381143000003, 2024-09-12T22:32:11.362 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.017061263, 2024-09-12T22:32:11.362 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:11.362 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:11.362 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:11.362 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:11.362 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.362 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:11.362 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400811+0000", 2024-09-12T22:32:11.362 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:11.362 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.363 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.363 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:11.363 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400811+0000", 2024-09-12T22:32:11.363 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:11.363 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.363 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.363 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:11.363 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400812+0000", 2024-09-12T22:32:11.363 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.27e-07 2024-09-12T22:32:11.363 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.363 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.363 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:11.363 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400814+0000", 2024-09-12T22:32:11.363 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.553e-06 2024-09-12T22:32:11.364 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.364 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.364 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:11.364 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400819+0000", 2024-09-12T22:32:11.364 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.3569999999999997e-06 2024-09-12T22:32:11.364 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.364 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.364 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:11.364 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400824+0000", 2024-09-12T22:32:11.364 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.6820000000000002e-06 2024-09-12T22:32:11.364 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.364 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.364 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:11.365 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400871+0000", 2024-09-12T22:32:11.365 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.7311000000000002e-05 2024-09-12T22:32:11.365 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.365 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.365 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:32:11.365 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400875+0000", 2024-09-12T22:32:11.365 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.0960000000000001e-06 2024-09-12T22:32:11.365 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.365 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.365 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:11.365 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.412071+0000", 2024-09-12T22:32:11.365 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.011195999999999999 2024-09-12T22:32:11.365 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.366 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.366 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:11.366 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.412520+0000", 2024-09-12T22:32:11.366 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.000449522 2024-09-12T22:32:11.366 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.366 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.366 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:11.366 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.412655+0000", 2024-09-12T22:32:11.366 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00013487899999999999 2024-09-12T22:32:11.366 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.366 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.366 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op_commit", 2024-09-12T22:32:11.366 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417096+0000", 2024-09-12T22:32:11.366 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.004441113 2024-09-12T22:32:11.367 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.367 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.367 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:11.367 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417768+0000", 2024-09-12T22:32:11.367 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00067161100000000002 2024-09-12T22:32:11.367 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.367 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.367 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:11.367 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417834+0000", 2024-09-12T22:32:11.367 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.6058999999999999e-05 2024-09-12T22:32:11.367 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.367 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.367 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:11.367 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417873+0000", 2024-09-12T22:32:11.368 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.8753e-05 2024-09-12T22:32:11.368 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:11.368 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:11.368 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:11.368 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.368 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.368 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:11.368 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.400842+0000", 2024-09-12T22:32:11.368 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 33.925350436000002, 2024-09-12T22:32:11.368 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.022846262999999999, 2024-09-12T22:32:11.368 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:11.368 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:11.368 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:11.369 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:11.369 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.369 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:11.369 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400842+0000", 2024-09-12T22:32:11.369 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:11.369 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.369 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.369 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:11.369 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400842+0000", 2024-09-12T22:32:11.369 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:11.369 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.369 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.369 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:11.369 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400842+0000", 2024-09-12T22:32:11.370 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.9900000000000002e-07 2024-09-12T22:32:11.370 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.370 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.370 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:11.370 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400845+0000", 2024-09-12T22:32:11.370 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.8609999999999998e-06 2024-09-12T22:32:11.370 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.370 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.370 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:11.370 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400850+0000", 2024-09-12T22:32:11.370 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.634e-06 2024-09-12T22:32:11.370 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.370 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.371 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:11.371 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400855+0000", 2024-09-12T22:32:11.371 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.8339999999999998e-06 2024-09-12T22:32:11.371 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.371 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.371 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:11.371 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400886+0000", 2024-09-12T22:32:11.371 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.1393999999999998e-05 2024-09-12T22:32:11.371 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.371 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.371 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:32:11.371 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400888+0000", 2024-09-12T22:32:11.371 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.3470000000000001e-06 2024-09-12T22:32:11.372 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.372 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.372 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:11.372 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415640+0000", 2024-09-12T22:32:11.372 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.014751965000000001 2024-09-12T22:32:11.372 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.372 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.372 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:11.372 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415821+0000", 2024-09-12T22:32:11.372 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00018064399999999999 2024-09-12T22:32:11.372 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.372 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.372 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:11.373 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415949+0000", 2024-09-12T22:32:11.373 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00012816699999999999 2024-09-12T22:32:11.373 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.373 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.373 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op_commit", 2024-09-12T22:32:11.373 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.418337+0000", 2024-09-12T22:32:11.373 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0023878469999999998 2024-09-12T22:32:11.373 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.373 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.373 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:11.373 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.423588+0000", 2024-09-12T22:32:11.373 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0052509849999999997 2024-09-12T22:32:11.373 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.373 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.374 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:11.374 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.423650+0000", 2024-09-12T22:32:11.374 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.2026999999999994e-05 2024-09-12T22:32:11.374 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.374 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.374 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:11.374 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.423688+0000", 2024-09-12T22:32:11.374 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.8259000000000001e-05 2024-09-12T22:32:11.374 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:11.374 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:11.374 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:11.374 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.374 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.374 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:11.375 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.400862+0000", 2024-09-12T22:32:11.375 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 33.925330461999998, 2024-09-12T22:32:11.375 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.016404294, 2024-09-12T22:32:11.375 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:11.375 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:11.375 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "started", 2024-09-12T22:32:11.375 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:11.375 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.375 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:11.375 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400862+0000", 2024-09-12T22:32:11.375 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:11.375 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.375 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.375 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:11.376 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400862+0000", 2024-09-12T22:32:11.376 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:11.376 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.376 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.376 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:11.376 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400862+0000", 2024-09-12T22:32:11.376 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.8099999999999999e-07 2024-09-12T22:32:11.376 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.376 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.376 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:11.376 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400870+0000", 2024-09-12T22:32:11.376 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 8.1349999999999992e-06 2024-09-12T22:32:11.376 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.377 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.377 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:11.377 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400876+0000", 2024-09-12T22:32:11.377 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.2039999999999996e-06 2024-09-12T22:32:11.377 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.377 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.377 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:11.377 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400879+0000", 2024-09-12T22:32:11.377 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.529e-06 2024-09-12T22:32:11.377 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.377 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.377 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:11.377 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400912+0000", 2024-09-12T22:32:11.377 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.2653000000000001e-05 2024-09-12T22:32:11.378 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.378 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.378 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op must wait for map", 2024-09-12T22:32:11.378 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400915+0000", 2024-09-12T22:32:11.378 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.1099999999999999e-06 2024-09-12T22:32:11.378 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.378 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.378 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:11.378 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408727+0000", 2024-09-12T22:32:11.378 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0078123869999999996 2024-09-12T22:32:11.378 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.378 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.378 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:11.378 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408838+0000", 2024-09-12T22:32:11.379 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00011042700000000001 2024-09-12T22:32:11.379 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.379 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.379 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:11.379 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417266+0000", 2024-09-12T22:32:11.379 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0084285680000000009 2024-09-12T22:32:11.379 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:11.379 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:11.379 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:11.379 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.379 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.379 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:11.379 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.400889+0000", 2024-09-12T22:32:11.379 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 33.925303208999999, 2024-09-12T22:32:11.380 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.014929550999999999, 2024-09-12T22:32:11.380 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:11.380 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:11.380 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "started", 2024-09-12T22:32:11.380 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:11.380 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.380 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:11.380 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400889+0000", 2024-09-12T22:32:11.380 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:11.380 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.380 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.380 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:11.380 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400889+0000", 2024-09-12T22:32:11.381 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:11.381 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.381 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.381 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:11.381 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400890+0000", 2024-09-12T22:32:11.381 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.8699999999999995e-07 2024-09-12T22:32:11.381 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.381 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.381 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:11.381 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400893+0000", 2024-09-12T22:32:11.381 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.9569999999999998e-06 2024-09-12T22:32:11.381 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.381 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.381 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:11.382 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400899+0000", 2024-09-12T22:32:11.382 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.4189999999999999e-06 2024-09-12T22:32:11.382 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.382 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.382 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:11.382 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400905+0000", 2024-09-12T22:32:11.382 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.7880000000000003e-06 2024-09-12T22:32:11.382 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.382 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.382 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:11.382 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400943+0000", 2024-09-12T22:32:11.382 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.7852999999999998e-05 2024-09-12T22:32:11.382 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.382 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.383 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op must wait for map", 2024-09-12T22:32:11.383 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400945+0000", 2024-09-12T22:32:11.383 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.627e-06 2024-09-12T22:32:11.383 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.383 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.383 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:11.383 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408398+0000", 2024-09-12T22:32:11.383 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0074525879999999996 2024-09-12T22:32:11.383 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.383 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.383 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:11.383 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408581+0000", 2024-09-12T22:32:11.383 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00018321900000000001 2024-09-12T22:32:11.384 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.384 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.384 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:11.384 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415819+0000", 2024-09-12T22:32:11.384 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0072376130000000004 2024-09-12T22:32:11.384 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:11.384 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:11.384 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:11.384 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.384 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.384 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:25 3.7 e19/17 3:e0b41d06:::609.00000000:head v 19'2, mlcod=0'0)", 2024-09-12T22:32:11.384 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.402511+0000", 2024-09-12T22:32:11.384 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 33.923681066, 2024-09-12T22:32:11.384 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0089735260000000008, 2024-09-12T22:32:11.385 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:11.385 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:11.385 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:11.385 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:11.385 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.385 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:11.385 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.402511+0000", 2024-09-12T22:32:11.385 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:11.385 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.385 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.385 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:11.385 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.402511+0000", 2024-09-12T22:32:11.385 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:11.386 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.386 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.386 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:11.386 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.402512+0000", 2024-09-12T22:32:11.386 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 8.71e-07 2024-09-12T22:32:11.386 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.386 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.386 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:11.386 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.402520+0000", 2024-09-12T22:32:11.386 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 7.8529999999999992e-06 2024-09-12T22:32:11.386 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.386 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.386 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:11.386 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.402530+0000", 2024-09-12T22:32:11.387 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 9.859e-06 2024-09-12T22:32:11.387 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.387 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.387 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:11.387 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.402555+0000", 2024-09-12T22:32:11.387 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.4822000000000001e-05 2024-09-12T22:32:11.387 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.387 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.387 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:11.387 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.403173+0000", 2024-09-12T22:32:11.387 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00061813199999999997 2024-09-12T22:32:11.387 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.387 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.387 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:11.388 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.403195+0000", 2024-09-12T22:32:11.388 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.2286e-05 2024-09-12T22:32:11.388 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.388 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.388 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:11.388 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.411436+0000", 2024-09-12T22:32:11.388 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0082410539999999994 2024-09-12T22:32:11.388 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.388 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.388 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:11.388 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.411485+0000", 2024-09-12T22:32:11.388 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.8649000000000001e-05 2024-09-12T22:32:11.388 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:11.388 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:11.389 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:11.389 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.389 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.389 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:18 3.14 e19/17 3:2f55791f:::606.00000000:head v 19'1, mlcod=0'0)", 2024-09-12T22:32:11.389 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.406646+0000", 2024-09-12T22:32:11.389 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 33.919545913999997, 2024-09-12T22:32:11.389 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0082036980000000006, 2024-09-12T22:32:11.389 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:11.389 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:11.389 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:11.389 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:11.389 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.389 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:11.390 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406646+0000", 2024-09-12T22:32:11.390 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:11.390 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.390 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.390 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:11.390 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406646+0000", 2024-09-12T22:32:11.390 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:11.390 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.390 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.390 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:11.390 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406647+0000", 2024-09-12T22:32:11.390 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.4499999999999998e-07 2024-09-12T22:32:11.390 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.390 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.391 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:11.391 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406651+0000", 2024-09-12T22:32:11.391 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.0300000000000004e-06 2024-09-12T22:32:11.391 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.391 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.391 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:11.391 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406657+0000", 2024-09-12T22:32:11.391 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.1330000000000004e-06 2024-09-12T22:32:11.391 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.391 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.391 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:11.391 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406665+0000", 2024-09-12T22:32:11.391 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 8.3650000000000004e-06 2024-09-12T22:32:11.392 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.392 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.392 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:11.392 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406804+0000", 2024-09-12T22:32:11.392 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00013900699999999999 2024-09-12T22:32:11.392 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.392 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.392 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:11.392 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406833+0000", 2024-09-12T22:32:11.392 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.8243e-05 2024-09-12T22:32:11.392 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.392 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.392 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:11.392 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.414741+0000", 2024-09-12T22:32:11.393 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0079089620000000003 2024-09-12T22:32:11.393 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.393 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.393 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:11.393 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.414850+0000", 2024-09-12T22:32:11.393 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.000108713 2024-09-12T22:32:11.393 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:11.393 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:11.393 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:11.393 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.393 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.393 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:6 3.10 e19/17 3:0d82a743:::600.00000000:head v 19'1, mlcod=0'0)", 2024-09-12T22:32:11.393 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.406692+0000", 2024-09-12T22:32:11.394 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 33.919500147000001, 2024-09-12T22:32:11.394 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0093004430000000003, 2024-09-12T22:32:11.394 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:11.394 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:11.394 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:11.394 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:11.394 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.394 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:11.394 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406692+0000", 2024-09-12T22:32:11.394 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:11.394 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.394 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.394 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:11.394 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406692+0000", 2024-09-12T22:32:11.395 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:11.395 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.395 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.395 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:11.395 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406693+0000", 2024-09-12T22:32:11.395 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.6300000000000001e-07 2024-09-12T22:32:11.395 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.395 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.395 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:11.395 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406702+0000", 2024-09-12T22:32:11.395 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 9.5589999999999994e-06 2024-09-12T22:32:11.395 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.395 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.395 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:11.396 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406725+0000", 2024-09-12T22:32:11.396 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.2977999999999999e-05 2024-09-12T22:32:11.396 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.396 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.396 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:11.396 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406732+0000", 2024-09-12T22:32:11.396 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.8430000000000004e-06 2024-09-12T22:32:11.396 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.396 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.396 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:11.396 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406979+0000", 2024-09-12T22:32:11.396 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00024729199999999998 2024-09-12T22:32:11.396 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.397 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.397 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:11.397 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407000+0000", 2024-09-12T22:32:11.397 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.0573000000000001e-05 2024-09-12T22:32:11.397 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.397 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.397 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:11.397 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415928+0000", 2024-09-12T22:32:11.397 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0089286179999999993 2024-09-12T22:32:11.397 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.397 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.397 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:11.397 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415993+0000", 2024-09-12T22:32:11.398 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.4216999999999999e-05 2024-09-12T22:32:11.398 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:11.398 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:11.398 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:11.398 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.398 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.398 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:2 3.f e19/17 3:f1f69726:::400.00000000:head v 19'1, mlcod=0'0)", 2024-09-12T22:32:11.398 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.406942+0000", 2024-09-12T22:32:11.398 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 33.919250460000001, 2024-09-12T22:32:11.398 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0098433259999999995, 2024-09-12T22:32:11.398 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:11.398 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:11.398 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:11.398 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:11.399 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.399 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:11.399 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406942+0000", 2024-09-12T22:32:11.399 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:11.399 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.399 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.399 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:11.399 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406942+0000", 2024-09-12T22:32:11.399 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:11.399 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.399 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.399 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:11.399 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406943+0000", 2024-09-12T22:32:11.400 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.8800000000000002e-07 2024-09-12T22:32:11.400 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.400 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.400 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:11.400 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406949+0000", 2024-09-12T22:32:11.400 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.5869999999999998e-06 2024-09-12T22:32:11.400 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.400 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.400 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:11.400 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406960+0000", 2024-09-12T22:32:11.400 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.0873000000000001e-05 2024-09-12T22:32:11.400 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.400 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.401 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:11.401 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406970+0000", 2024-09-12T22:32:11.401 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 9.9119999999999993e-06 2024-09-12T22:32:11.401 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.401 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.401 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:11.401 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407535+0000", 2024-09-12T22:32:11.401 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00056508899999999996 2024-09-12T22:32:11.401 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.401 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.401 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:11.401 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407556+0000", 2024-09-12T22:32:11.401 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.1348999999999998e-05 2024-09-12T22:32:11.402 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.402 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.402 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:11.402 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416751+0000", 2024-09-12T22:32:11.402 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0091950109999999995 2024-09-12T22:32:11.402 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.402 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.402 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:11.402 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416785+0000", 2024-09-12T22:32:11.402 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.3917000000000001e-05 2024-09-12T22:32:11.402 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:11.402 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:11.402 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:11.402 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.403 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.403 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:19 3.14 e19/17 3:2f55791f:::606.00000000:head v 19'2, mlcod=0'0)", 2024-09-12T22:32:11.403 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.406983+0000", 2024-09-12T22:32:11.403 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 33.919209481000003, 2024-09-12T22:32:11.403 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0080362149999999993, 2024-09-12T22:32:11.403 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:11.403 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:11.403 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:11.403 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:11.403 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.403 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:11.403 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406983+0000", 2024-09-12T22:32:11.403 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:11.404 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.404 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.404 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:11.404 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406983+0000", 2024-09-12T22:32:11.404 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:11.404 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.404 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.404 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:11.404 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406983+0000", 2024-09-12T22:32:11.404 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.8200000000000001e-07 2024-09-12T22:32:11.404 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.404 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.404 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:11.405 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406999+0000", 2024-09-12T22:32:11.405 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.5747999999999999e-05 2024-09-12T22:32:11.405 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.405 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.405 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:11.405 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407006+0000", 2024-09-12T22:32:11.405 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 7.2609999999999996e-06 2024-09-12T22:32:11.405 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.405 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.405 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:11.405 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407035+0000", 2024-09-12T22:32:11.405 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.8214000000000001e-05 2024-09-12T22:32:11.405 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.405 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.406 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:11.406 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407092+0000", 2024-09-12T22:32:11.406 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.7027000000000001e-05 2024-09-12T22:32:11.406 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.406 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.406 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:11.406 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407126+0000", 2024-09-12T22:32:11.406 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.4082000000000003e-05 2024-09-12T22:32:11.406 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.406 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.406 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:11.406 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.414985+0000", 2024-09-12T22:32:11.406 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0078597319999999995 2024-09-12T22:32:11.407 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.407 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.407 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:11.407 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415019+0000", 2024-09-12T22:32:11.407 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.3769000000000001e-05 2024-09-12T22:32:11.407 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:11.407 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:11.407 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:11.407 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.407 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.407 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:7 3.10 e19/17 3:0d82a743:::600.00000000:head v 19'2, mlcod=0'0)", 2024-09-12T22:32:11.407 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.407048+0000", 2024-09-12T22:32:11.407 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 33.919143943000002, 2024-09-12T22:32:11.408 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.008979931, 2024-09-12T22:32:11.408 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:11.408 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:11.408 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:11.408 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:11.408 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.408 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:11.408 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407048+0000", 2024-09-12T22:32:11.408 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:11.408 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.408 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.408 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:11.408 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407048+0000", 2024-09-12T22:32:11.408 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:11.409 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.409 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.409 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:11.409 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407049+0000", 2024-09-12T22:32:11.409 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.9099999999999999e-07 2024-09-12T22:32:11.409 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.409 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.409 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:11.409 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407054+0000", 2024-09-12T22:32:11.409 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.1850000000000003e-06 2024-09-12T22:32:11.409 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.409 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.409 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:11.409 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407061+0000", 2024-09-12T22:32:11.410 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 7.0809999999999996e-06 2024-09-12T22:32:11.410 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.410 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.410 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:11.410 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407067+0000", 2024-09-12T22:32:11.410 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.9540000000000001e-06 2024-09-12T22:32:11.410 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.410 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.410 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:11.410 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407299+0000", 2024-09-12T22:32:11.410 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.000232122 2024-09-12T22:32:11.410 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.410 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.411 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:11.411 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407317+0000", 2024-09-12T22:32:11.411 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.7447000000000001e-05 2024-09-12T22:32:11.411 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.411 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.411 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:11.411 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415996+0000", 2024-09-12T22:32:11.411 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0086791799999999999 2024-09-12T22:32:11.411 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.411 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.411 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:11.411 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416028+0000", 2024-09-12T22:32:11.411 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.2570999999999997e-05 2024-09-12T22:32:11.411 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:11.412 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:11.412 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:11.412 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.412 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.412 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:8 3.10 e19/17 3:09401a81:::601.00000000:head v 19'3, mlcod=0'0)", 2024-09-12T22:32:11.412 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.407081+0000", 2024-09-12T22:32:11.412 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 33.919111252999997, 2024-09-12T22:32:11.412 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0089807270000000008, 2024-09-12T22:32:11.412 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:11.412 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:11.412 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:11.412 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:11.412 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.412 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:11.413 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407081+0000", 2024-09-12T22:32:11.413 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:11.413 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.413 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.413 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:11.413 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407081+0000", 2024-09-12T22:32:11.413 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:11.413 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.413 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.413 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:11.413 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407082+0000", 2024-09-12T22:32:11.413 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.7899999999999999e-07 2024-09-12T22:32:11.413 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.414 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.414 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:11.414 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407086+0000", 2024-09-12T22:32:11.414 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.7679999999999999e-06 2024-09-12T22:32:11.414 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.414 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.414 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:11.414 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407094+0000", 2024-09-12T22:32:11.414 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 8.1470000000000001e-06 2024-09-12T22:32:11.414 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.414 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.414 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:11.414 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407100+0000", 2024-09-12T22:32:11.414 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.4539999999999998e-06 2024-09-12T22:32:11.415 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.415 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.415 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:11.415 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407540+0000", 2024-09-12T22:32:11.415 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00043973699999999999 2024-09-12T22:32:11.415 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.415 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.415 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:11.415 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407553+0000", 2024-09-12T22:32:11.415 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.3368e-05 2024-09-12T22:32:11.415 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.416 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.416 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:11.416 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416032+0000", 2024-09-12T22:32:11.416 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0084793790000000004 2024-09-12T22:32:11.416 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.416 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.416 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:11.416 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416062+0000", 2024-09-12T22:32:11.416 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.9495000000000001e-05 2024-09-12T22:32:11.416 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:11.416 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:11.416 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:11.417 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.417 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.417 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:31 3.d e19/17 3:b50e409b:::mds_snaptable:head v 19'1, mlcod=0'0)", 2024-09-12T22:32:11.417 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.408508+0000", 2024-09-12T22:32:11.417 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 33.917684737000002, 2024-09-12T22:32:11.417 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0080056620000000002, 2024-09-12T22:32:11.417 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:11.417 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:11.417 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:11.417 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:11.417 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.417 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:11.417 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408508+0000", 2024-09-12T22:32:11.418 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:11.418 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.418 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.418 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:11.418 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408508+0000", 2024-09-12T22:32:11.418 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:11.418 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.418 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.418 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:11.418 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408508+0000", 2024-09-12T22:32:11.418 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.7e-07 2024-09-12T22:32:11.418 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.418 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.419 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:11.419 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408515+0000", 2024-09-12T22:32:11.419 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.4439999999999996e-06 2024-09-12T22:32:11.419 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.419 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.419 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:11.419 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408521+0000", 2024-09-12T22:32:11.419 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.2729999999999999e-06 2024-09-12T22:32:11.419 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.419 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.419 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:11.419 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408526+0000", 2024-09-12T22:32:11.419 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.3299999999999998e-06 2024-09-12T22:32:11.419 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.420 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.420 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:11.420 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.410190+0000", 2024-09-12T22:32:11.420 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.001663615 2024-09-12T22:32:11.420 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.420 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.420 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:11.420 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.410258+0000", 2024-09-12T22:32:11.420 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.8146999999999997e-05 2024-09-12T22:32:11.420 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.420 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.420 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:11.420 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416477+0000", 2024-09-12T22:32:11.421 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0062187329999999997 2024-09-12T22:32:11.421 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.421 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.421 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:11.421 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416513+0000", 2024-09-12T22:32:11.421 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.6650000000000003e-05 2024-09-12T22:32:11.421 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:11.421 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:11.421 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:11.421 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.421 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.421 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:9 3.10 e19/17 3:09401a81:::601.00000000:head v 19'4, mlcod=0'0)", 2024-09-12T22:32:11.421 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.408991+0000", 2024-09-12T22:32:11.421 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 33.917200987000001, 2024-09-12T22:32:11.422 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0080459209999999993, 2024-09-12T22:32:11.422 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:11.422 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:11.422 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:11.422 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:11.422 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.422 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:11.422 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408991+0000", 2024-09-12T22:32:11.422 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:11.422 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.422 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.422 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:11.422 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408991+0000", 2024-09-12T22:32:11.422 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:11.423 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.423 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.423 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:11.423 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408992+0000", 2024-09-12T22:32:11.423 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.1799999999999995e-07 2024-09-12T22:32:11.423 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.423 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.423 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:11.423 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409005+0000", 2024-09-12T22:32:11.423 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.261e-05 2024-09-12T22:32:11.423 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.423 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.423 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:11.424 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409015+0000", 2024-09-12T22:32:11.424 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.0001e-05 2024-09-12T22:32:11.424 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.424 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.424 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:11.424 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409023+0000", 2024-09-12T22:32:11.424 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 8.7569999999999993e-06 2024-09-12T22:32:11.424 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.424 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.424 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:11.424 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.411355+0000", 2024-09-12T22:32:11.424 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0023313520000000001 2024-09-12T22:32:11.424 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.425 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.425 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:11.425 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.411374+0000", 2024-09-12T22:32:11.425 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.8810000000000001e-05 2024-09-12T22:32:11.425 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.425 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.425 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:11.425 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416994+0000", 2024-09-12T22:32:11.425 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.005620524 2024-09-12T22:32:11.425 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.425 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.425 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:11.425 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417037+0000", 2024-09-12T22:32:11.425 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.3248999999999999e-05 2024-09-12T22:32:11.426 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:11.426 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:11.426 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:11.426 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.426 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.426 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:10 3.10 e19/17 3:0bd6d154:::602.00000000:head v 19'5, mlcod=0'0)", 2024-09-12T22:32:11.426 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.409038+0000", 2024-09-12T22:32:11.426 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 33.917154312000001, 2024-09-12T22:32:11.426 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0080541689999999999, 2024-09-12T22:32:11.426 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:11.426 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:11.426 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:11.426 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:11.426 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.427 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:11.427 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409038+0000", 2024-09-12T22:32:11.427 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:11.427 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.427 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.427 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:11.427 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409038+0000", 2024-09-12T22:32:11.427 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:11.427 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.427 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.427 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:11.427 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409038+0000", 2024-09-12T22:32:11.427 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.7899999999999999e-07 2024-09-12T22:32:11.427 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.428 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.428 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:11.428 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409043+0000", 2024-09-12T22:32:11.428 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.6589999999999998e-06 2024-09-12T22:32:11.428 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.428 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.428 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:11.428 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409050+0000", 2024-09-12T22:32:11.428 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 7.0829999999999998e-06 2024-09-12T22:32:11.428 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.428 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.428 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:11.428 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409058+0000", 2024-09-12T22:32:11.428 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 7.7309999999999993e-06 2024-09-12T22:32:11.429 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.429 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.429 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:11.429 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.411654+0000", 2024-09-12T22:32:11.429 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0025961650000000001 2024-09-12T22:32:11.429 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.429 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.429 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:11.429 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.411671+0000", 2024-09-12T22:32:11.429 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.7356000000000001e-05 2024-09-12T22:32:11.429 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.429 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.429 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:11.429 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417040+0000", 2024-09-12T22:32:11.430 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0053681889999999998 2024-09-12T22:32:11.430 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.430 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.430 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:11.430 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417092+0000", 2024-09-12T22:32:11.430 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.2607e-05 2024-09-12T22:32:11.430 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:11.430 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:11.430 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:11.430 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.430 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.430 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:11 3.10 e19/17 3:0bd6d154:::602.00000000:head v 19'6, mlcod=0'0)", 2024-09-12T22:32:11.430 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.409768+0000", 2024-09-12T22:32:11.431 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 33.916424870999997, 2024-09-12T22:32:11.431 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0074442759999999997, 2024-09-12T22:32:11.431 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:11.431 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:11.431 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:11.431 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:11.431 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.431 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:11.431 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409768+0000", 2024-09-12T22:32:11.431 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:11.431 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.431 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.431 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:11.431 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409768+0000", 2024-09-12T22:32:11.432 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:11.432 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.432 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.432 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:11.432 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409768+0000", 2024-09-12T22:32:11.432 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.37e-07 2024-09-12T22:32:11.432 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.432 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.432 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:11.432 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409775+0000", 2024-09-12T22:32:11.432 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.4670000000000001e-06 2024-09-12T22:32:11.432 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.432 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.433 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:11.433 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409793+0000", 2024-09-12T22:32:11.433 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.8162e-05 2024-09-12T22:32:11.433 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.433 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.433 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:11.433 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409954+0000", 2024-09-12T22:32:11.433 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00016072999999999999 2024-09-12T22:32:11.433 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.433 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.433 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:11.433 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.411943+0000", 2024-09-12T22:32:11.433 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0019897069999999998 2024-09-12T22:32:11.433 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.433 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.434 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:11.434 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.412069+0000", 2024-09-12T22:32:11.434 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00012546200000000001 2024-09-12T22:32:11.434 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.434 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.434 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:11.434 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417114+0000", 2024-09-12T22:32:11.434 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.005045023 2024-09-12T22:32:11.434 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:11.434 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:11.434 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:11.434 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417212+0000", 2024-09-12T22:32:11.434 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 9.8088e-05 2024-09-12T22:32:11.434 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:11.435 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:11.435 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:11.435 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:11.435 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:11.435 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-09-12T22:32:11.436 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:32:11.437 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:32:11.435+0000 7fddec6a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30331) UID: 0 2024-09-12T22:32:11.536 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:11.535+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:11.552 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:32:11.552 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:32:11.552 INFO:teuthology.orchestra.run.smithi148.stdout: "num_ops": 0 2024-09-12T22:32:11.552 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:32:11.562 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:32:11.638 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:11.637+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:11.705 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:32:11.706 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:32:11.706 INFO:teuthology.orchestra.run.smithi148.stdout: "complaint_time": 30, 2024-09-12T22:32:11.706 INFO:teuthology.orchestra.run.smithi148.stdout: "num_blocked_ops": 0 2024-09-12T22:32:11.706 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:32:11.715 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:32:11.738 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:32:11.738+0000 7fddec6a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30331) UID: 0 2024-09-12T22:32:11.820 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:32:11.820 INFO:teuthology.orchestra.run.smithi148.stdout: "size": 20, 2024-09-12T22:32:11.821 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 600, 2024-09-12T22:32:11.821 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [ 2024-09-12T22:32:11.821 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.821 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:11.821 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.400880+0000", 2024-09-12T22:32:11.821 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 34.417624261, 2024-09-12T22:32:11.821 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0095133660000000005, 2024-09-12T22:32:11.821 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:11.821 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:11.821 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:11.821 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:11.821 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.822 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:11.822 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400880+0000", 2024-09-12T22:32:11.822 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:11.822 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.822 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.822 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:11.822 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400880+0000", 2024-09-12T22:32:11.822 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:11.822 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.822 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.822 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:11.822 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400892+0000", 2024-09-12T22:32:11.822 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1941e-05 2024-09-12T22:32:11.823 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.823 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.823 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:11.823 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400900+0000", 2024-09-12T22:32:11.823 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0080000000000002e-06 2024-09-12T22:32:11.823 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.823 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.823 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:11.823 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400911+0000", 2024-09-12T22:32:11.823 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1452e-05 2024-09-12T22:32:11.823 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.823 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.823 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:11.823 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400922+0000", 2024-09-12T22:32:11.824 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0772e-05 2024-09-12T22:32:11.824 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.824 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.824 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:11.824 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401009+0000", 2024-09-12T22:32:11.824 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.7206000000000005e-05 2024-09-12T22:32:11.824 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.824 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.824 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:11.824 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401157+0000", 2024-09-12T22:32:11.824 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014831499999999999 2024-09-12T22:32:11.824 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.824 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.825 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:11.825 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401312+0000", 2024-09-12T22:32:11.825 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00015495600000000001 2024-09-12T22:32:11.825 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.825 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.825 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:11.825 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.403060+0000", 2024-09-12T22:32:11.825 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0017475220000000001 2024-09-12T22:32:11.825 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.825 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.825 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:11.826 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410300+0000", 2024-09-12T22:32:11.826 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0072403260000000001 2024-09-12T22:32:11.826 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.826 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.826 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:11.826 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410350+0000", 2024-09-12T22:32:11.826 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9814000000000001e-05 2024-09-12T22:32:11.826 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.826 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.826 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:11.826 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410393+0000", 2024-09-12T22:32:11.826 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3053999999999998e-05 2024-09-12T22:32:11.826 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:11.827 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:11.827 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:11.827 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.827 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.827 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:11.827 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.400952+0000", 2024-09-12T22:32:11.827 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 34.417552108999999, 2024-09-12T22:32:11.827 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0096045620000000005, 2024-09-12T22:32:11.827 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:11.827 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:11.827 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:11.827 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:11.827 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.827 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:11.828 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400952+0000", 2024-09-12T22:32:11.828 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:11.828 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.828 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.828 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:11.828 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400952+0000", 2024-09-12T22:32:11.828 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:11.828 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.828 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.828 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:11.828 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400953+0000", 2024-09-12T22:32:11.828 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.8000000000000005e-07 2024-09-12T22:32:11.828 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.829 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.829 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:11.829 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400957+0000", 2024-09-12T22:32:11.829 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.33e-06 2024-09-12T22:32:11.829 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.829 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.829 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:11.829 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400966+0000", 2024-09-12T22:32:11.829 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1989999999999995e-06 2024-09-12T22:32:11.829 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.829 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.829 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:11.829 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400973+0000", 2024-09-12T22:32:11.830 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2779999999999999e-06 2024-09-12T22:32:11.830 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.830 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.830 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:11.830 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401696+0000", 2024-09-12T22:32:11.830 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00072363500000000003 2024-09-12T22:32:11.830 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.830 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.830 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:11.830 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401788+0000", 2024-09-12T22:32:11.830 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1862999999999998e-05 2024-09-12T22:32:11.830 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.830 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.831 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:11.831 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401929+0000", 2024-09-12T22:32:11.831 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014096000000000001 2024-09-12T22:32:11.831 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.831 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.831 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:11.831 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.403542+0000", 2024-09-12T22:32:11.831 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001612963 2024-09-12T22:32:11.831 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.831 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.831 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:11.831 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410460+0000", 2024-09-12T22:32:11.831 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0069180500000000002 2024-09-12T22:32:11.832 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.832 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.832 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:11.832 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410515+0000", 2024-09-12T22:32:11.832 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5009000000000001e-05 2024-09-12T22:32:11.832 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.832 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.832 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:11.832 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410557+0000", 2024-09-12T22:32:11.832 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1495000000000002e-05 2024-09-12T22:32:11.832 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:11.832 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:11.832 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:11.832 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.833 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.833 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:11.833 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.400984+0000", 2024-09-12T22:32:11.833 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 34.417519614, 2024-09-12T22:32:11.833 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0073703950000000001, 2024-09-12T22:32:11.833 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:11.833 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:11.833 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:11.833 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:11.833 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.833 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:11.833 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400984+0000", 2024-09-12T22:32:11.833 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:11.834 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.834 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.834 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:11.834 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400984+0000", 2024-09-12T22:32:11.834 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:11.834 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.834 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.834 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:11.834 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400985+0000", 2024-09-12T22:32:11.834 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3200000000000005e-07 2024-09-12T22:32:11.834 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.834 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.834 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:11.835 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400998+0000", 2024-09-12T22:32:11.835 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2726e-05 2024-09-12T22:32:11.835 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.835 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.835 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:11.835 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401006+0000", 2024-09-12T22:32:11.835 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.3110000000000006e-06 2024-09-12T22:32:11.835 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.835 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.835 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:11.835 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401022+0000", 2024-09-12T22:32:11.835 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6249e-05 2024-09-12T22:32:11.835 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.836 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.836 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:11.836 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401700+0000", 2024-09-12T22:32:11.836 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00067811100000000001 2024-09-12T22:32:11.836 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.836 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.836 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:11.836 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401839+0000", 2024-09-12T22:32:11.836 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013865399999999999 2024-09-12T22:32:11.836 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.836 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.836 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:11.836 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401962+0000", 2024-09-12T22:32:11.837 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000123266 2024-09-12T22:32:11.837 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.837 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.837 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:11.837 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.403589+0000", 2024-09-12T22:32:11.837 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001626932 2024-09-12T22:32:11.837 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.837 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.837 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:11.837 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.408274+0000", 2024-09-12T22:32:11.837 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0046848100000000002 2024-09-12T22:32:11.837 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.837 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.838 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:11.838 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.408324+0000", 2024-09-12T22:32:11.838 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9784000000000003e-05 2024-09-12T22:32:11.838 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.838 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.838 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:11.838 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.408355+0000", 2024-09-12T22:32:11.838 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.1019999999999998e-05 2024-09-12T22:32:11.838 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:11.838 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:11.838 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:11.838 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.838 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.839 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:11.839 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401034+0000", 2024-09-12T22:32:11.839 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 34.417470174000002, 2024-09-12T22:32:11.839 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011063051000000001, 2024-09-12T22:32:11.839 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:11.839 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:11.839 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:11.839 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:11.839 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.839 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:11.839 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401034+0000", 2024-09-12T22:32:11.839 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:11.839 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.839 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.840 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:11.840 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401034+0000", 2024-09-12T22:32:11.840 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:11.840 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.840 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.840 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:11.840 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401034+0000", 2024-09-12T22:32:11.840 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8899999999999999e-07 2024-09-12T22:32:11.840 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.840 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.840 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:11.840 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401038+0000", 2024-09-12T22:32:11.841 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.523e-06 2024-09-12T22:32:11.841 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.841 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.841 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:11.841 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401046+0000", 2024-09-12T22:32:11.841 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0479999999999999e-06 2024-09-12T22:32:11.841 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.841 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.841 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:11.841 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401051+0000", 2024-09-12T22:32:11.841 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2619999999999998e-06 2024-09-12T22:32:11.841 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.841 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.842 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:11.842 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402270+0000", 2024-09-12T22:32:11.842 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012182429999999999 2024-09-12T22:32:11.842 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.842 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.842 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:11.842 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402325+0000", 2024-09-12T22:32:11.842 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5526999999999999e-05 2024-09-12T22:32:11.842 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.842 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.842 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:11.842 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402403+0000", 2024-09-12T22:32:11.842 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.7559999999999996e-05 2024-09-12T22:32:11.843 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.843 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.843 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:11.843 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.403655+0000", 2024-09-12T22:32:11.843 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012521489999999999 2024-09-12T22:32:11.843 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.843 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.843 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:11.843 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411979+0000", 2024-09-12T22:32:11.843 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0083240420000000002 2024-09-12T22:32:11.843 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.843 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.843 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:11.844 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.412036+0000", 2024-09-12T22:32:11.844 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7639000000000002e-05 2024-09-12T22:32:11.844 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.844 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.844 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:11.844 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.412097+0000", 2024-09-12T22:32:11.844 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0469e-05 2024-09-12T22:32:11.844 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:11.844 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:11.845 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:11.845 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.845 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.845 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:11.845 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401060+0000", 2024-09-12T22:32:11.845 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 34.417444422000003, 2024-09-12T22:32:11.845 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.010030172, 2024-09-12T22:32:11.845 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:11.845 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:11.845 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:11.845 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:11.845 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.846 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:11.846 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401060+0000", 2024-09-12T22:32:11.846 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:11.846 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.846 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.846 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:11.846 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401060+0000", 2024-09-12T22:32:11.846 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:11.846 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.846 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.846 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:11.846 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401060+0000", 2024-09-12T22:32:11.846 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2500000000000001e-07 2024-09-12T22:32:11.847 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.847 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.847 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:11.847 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401063+0000", 2024-09-12T22:32:11.847 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0910000000000001e-06 2024-09-12T22:32:11.847 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.847 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.847 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:11.847 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401070+0000", 2024-09-12T22:32:11.847 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1210000000000001e-06 2024-09-12T22:32:11.847 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.847 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.847 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:11.847 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401076+0000", 2024-09-12T22:32:11.848 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2830000000000001e-06 2024-09-12T22:32:11.848 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.848 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.848 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:11.848 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402288+0000", 2024-09-12T22:32:11.848 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012123699999999999 2024-09-12T22:32:11.848 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.848 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.848 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:11.848 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402359+0000", 2024-09-12T22:32:11.848 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.0988000000000005e-05 2024-09-12T22:32:11.848 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.848 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.849 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:11.849 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402457+0000", 2024-09-12T22:32:11.849 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.7857999999999997e-05 2024-09-12T22:32:11.849 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.849 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.849 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:11.849 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.404395+0000", 2024-09-12T22:32:11.849 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0019380160000000001 2024-09-12T22:32:11.849 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.849 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.849 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:11.849 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410603+0000", 2024-09-12T22:32:11.849 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.006208061 2024-09-12T22:32:11.849 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.850 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.850 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:11.850 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410687+0000", 2024-09-12T22:32:11.850 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.4623000000000006e-05 2024-09-12T22:32:11.850 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.850 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.850 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:11.850 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411090+0000", 2024-09-12T22:32:11.850 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00040233599999999999 2024-09-12T22:32:11.850 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:11.850 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:11.850 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:11.850 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.851 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.851 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:11.851 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401083+0000", 2024-09-12T22:32:11.851 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 34.417421005999998, 2024-09-12T22:32:11.851 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0097591850000000001, 2024-09-12T22:32:11.851 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:11.851 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:11.851 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:11.851 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:11.851 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.851 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:11.851 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401083+0000", 2024-09-12T22:32:11.851 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:11.852 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.852 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.852 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:11.852 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401083+0000", 2024-09-12T22:32:11.852 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:11.852 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.852 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.852 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:11.852 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401084+0000", 2024-09-12T22:32:11.852 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4799999999999999e-07 2024-09-12T22:32:11.852 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.852 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.853 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:11.853 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401088+0000", 2024-09-12T22:32:11.853 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6419999999999998e-06 2024-09-12T22:32:11.853 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.853 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.853 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:11.853 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401094+0000", 2024-09-12T22:32:11.853 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0090000000000004e-06 2024-09-12T22:32:11.853 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.853 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.853 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:11.853 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401108+0000", 2024-09-12T22:32:11.853 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3884e-05 2024-09-12T22:32:11.854 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.854 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.854 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:11.854 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401165+0000", 2024-09-12T22:32:11.854 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.6499000000000002e-05 2024-09-12T22:32:11.854 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.854 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.854 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:11.854 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401261+0000", 2024-09-12T22:32:11.854 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.6872000000000004e-05 2024-09-12T22:32:11.854 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.854 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.854 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:11.854 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401376+0000", 2024-09-12T22:32:11.855 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000114508 2024-09-12T22:32:11.855 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.855 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.855 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:11.855 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402666+0000", 2024-09-12T22:32:11.855 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012901659999999999 2024-09-12T22:32:11.855 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.855 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.855 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:11.855 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410572+0000", 2024-09-12T22:32:11.855 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0079055489999999996 2024-09-12T22:32:11.855 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.856 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.856 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:11.856 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410661+0000", 2024-09-12T22:32:11.856 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.9578000000000002e-05 2024-09-12T22:32:11.856 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.856 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.856 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:11.856 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410842+0000", 2024-09-12T22:32:11.856 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00018102999999999999 2024-09-12T22:32:11.856 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:11.856 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:11.856 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:11.856 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.856 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.857 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:11.857 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401122+0000", 2024-09-12T22:32:11.857 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 34.417381974000001, 2024-09-12T22:32:11.857 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0099122080000000005, 2024-09-12T22:32:11.857 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:11.857 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:11.857 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:32:11.857 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:11.857 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.857 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:11.857 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401122+0000", 2024-09-12T22:32:11.857 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:11.858 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.858 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.858 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:11.858 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401122+0000", 2024-09-12T22:32:11.858 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:11.858 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.858 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.858 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:11.858 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401123+0000", 2024-09-12T22:32:11.858 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2600000000000002e-07 2024-09-12T22:32:11.858 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.858 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.858 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:11.859 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401126+0000", 2024-09-12T22:32:11.859 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.6449999999999998e-06 2024-09-12T22:32:11.859 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.859 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.859 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:11.859 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401133+0000", 2024-09-12T22:32:11.859 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.9890000000000003e-06 2024-09-12T22:32:11.859 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.859 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.859 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:11.859 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401138+0000", 2024-09-12T22:32:11.859 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8060000000000002e-06 2024-09-12T22:32:11.859 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.860 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.860 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:11.860 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401703+0000", 2024-09-12T22:32:11.860 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00056509099999999999 2024-09-12T22:32:11.860 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.860 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.860 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:11.860 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401837+0000", 2024-09-12T22:32:11.860 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013338799999999999 2024-09-12T22:32:11.860 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.860 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.860 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:11.860 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411034+0000", 2024-09-12T22:32:11.861 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.009197663 2024-09-12T22:32:11.861 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:11.861 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:11.861 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:11.861 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.861 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.861 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:11.861 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401158+0000", 2024-09-12T22:32:11.861 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 34.417346195, 2024-09-12T22:32:11.861 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.010292437999999999, 2024-09-12T22:32:11.861 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:11.861 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:11.862 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:32:11.862 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:11.862 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.862 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:11.862 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401158+0000", 2024-09-12T22:32:11.862 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:11.862 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.862 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.862 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:11.862 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401158+0000", 2024-09-12T22:32:11.863 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:11.863 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.863 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.863 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:11.863 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401158+0000", 2024-09-12T22:32:11.863 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9699999999999996e-07 2024-09-12T22:32:11.863 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.863 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.863 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:11.863 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401161+0000", 2024-09-12T22:32:11.863 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.7410000000000001e-06 2024-09-12T22:32:11.863 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.863 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.863 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:11.864 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401168+0000", 2024-09-12T22:32:11.864 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.844e-06 2024-09-12T22:32:11.864 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.864 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.864 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:11.864 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401174+0000", 2024-09-12T22:32:11.864 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4700000000000001e-06 2024-09-12T22:32:11.864 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.864 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.864 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:11.864 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402799+0000", 2024-09-12T22:32:11.865 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0016256409999999999 2024-09-12T22:32:11.865 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.865 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.865 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:11.865 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402893+0000", 2024-09-12T22:32:11.865 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.3807999999999994e-05 2024-09-12T22:32:11.865 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.865 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.865 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:11.865 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411450+0000", 2024-09-12T22:32:11.865 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0085573369999999999 2024-09-12T22:32:11.865 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:11.866 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:11.866 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:11.866 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.866 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.866 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:11.866 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401183+0000", 2024-09-12T22:32:11.866 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 34.417321342999998, 2024-09-12T22:32:11.866 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0068597830000000004, 2024-09-12T22:32:11.866 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:11.866 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:11.866 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:32:11.866 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:11.867 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.867 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:11.867 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401183+0000", 2024-09-12T22:32:11.867 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:11.867 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.867 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.867 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:11.867 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401183+0000", 2024-09-12T22:32:11.867 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:11.867 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.867 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.867 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:11.867 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401183+0000", 2024-09-12T22:32:11.868 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.6700000000000003e-07 2024-09-12T22:32:11.868 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.868 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.868 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:11.868 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401186+0000", 2024-09-12T22:32:11.868 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4679999999999999e-06 2024-09-12T22:32:11.868 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.868 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.868 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:11.868 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401192+0000", 2024-09-12T22:32:11.868 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.1519999999999997e-06 2024-09-12T22:32:11.868 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.868 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.869 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:11.869 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401197+0000", 2024-09-12T22:32:11.869 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4669999999999998e-06 2024-09-12T22:32:11.869 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.869 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.869 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:11.869 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401253+0000", 2024-09-12T22:32:11.869 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.6211000000000001e-05 2024-09-12T22:32:11.869 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.869 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.869 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:11.869 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401413+0000", 2024-09-12T22:32:11.869 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00016021399999999999 2024-09-12T22:32:11.870 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.870 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.870 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:11.870 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.408043+0000", 2024-09-12T22:32:11.870 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0066295039999999996 2024-09-12T22:32:11.870 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:11.870 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:11.870 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:11.870 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.870 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.870 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:20 3.1c e19/17 3:3ed09add:::607.00000000:head v 19'1, mlcod=0'0)", 2024-09-12T22:32:11.870 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.409642+0000", 2024-09-12T22:32:11.870 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 34.408861883999997, 2024-09-12T22:32:11.871 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0038816269999999999, 2024-09-12T22:32:11.871 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:11.871 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:11.871 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:11.871 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:11.871 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.871 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:11.871 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409642+0000", 2024-09-12T22:32:11.871 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:11.871 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.871 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.871 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:11.871 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409642+0000", 2024-09-12T22:32:11.871 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:11.872 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.872 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.872 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:11.872 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409642+0000", 2024-09-12T22:32:11.872 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.6899999999999999e-07 2024-09-12T22:32:11.872 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.872 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.872 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:11.872 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409648+0000", 2024-09-12T22:32:11.872 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.49e-06 2024-09-12T22:32:11.872 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.872 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.872 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:11.873 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409656+0000", 2024-09-12T22:32:11.873 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.2949999999999994e-06 2024-09-12T22:32:11.873 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.873 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.873 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:11.873 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409664+0000", 2024-09-12T22:32:11.873 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.1219999999999995e-06 2024-09-12T22:32:11.873 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.873 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.873 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:11.873 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409707+0000", 2024-09-12T22:32:11.873 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2222000000000003e-05 2024-09-12T22:32:11.873 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.874 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.874 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:11.874 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409724+0000", 2024-09-12T22:32:11.874 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7496999999999999e-05 2024-09-12T22:32:11.874 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.874 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.874 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:11.874 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413439+0000", 2024-09-12T22:32:11.874 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00371448 2024-09-12T22:32:11.874 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.874 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.874 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:11.874 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413524+0000", 2024-09-12T22:32:11.874 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.5252000000000003e-05 2024-09-12T22:32:11.875 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:11.875 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:11.875 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:11.875 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.875 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.875 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:28 3.13 e19/17 3:cd5a64a3:::100.00000000:head v 19'1, mlcod=0'0)", 2024-09-12T22:32:11.875 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.409681+0000", 2024-09-12T22:32:11.875 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 34.408823400999999, 2024-09-12T22:32:11.875 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0038708710000000001, 2024-09-12T22:32:11.875 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:11.875 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:11.875 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:11.875 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:11.876 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.876 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:11.876 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409681+0000", 2024-09-12T22:32:11.876 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:11.876 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.876 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.876 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:11.876 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409681+0000", 2024-09-12T22:32:11.876 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:11.876 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.876 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.876 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:11.876 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409681+0000", 2024-09-12T22:32:11.877 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3000000000000002e-07 2024-09-12T22:32:11.877 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.877 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.877 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:11.877 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409695+0000", 2024-09-12T22:32:11.877 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4313e-05 2024-09-12T22:32:11.877 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.877 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.877 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:11.877 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409703+0000", 2024-09-12T22:32:11.877 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4000000000000003e-06 2024-09-12T22:32:11.877 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.877 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.877 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:11.878 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409708+0000", 2024-09-12T22:32:11.878 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3190000000000002e-06 2024-09-12T22:32:11.878 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.878 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.878 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:11.878 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409875+0000", 2024-09-12T22:32:11.878 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000167329 2024-09-12T22:32:11.878 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.878 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.878 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:11.878 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409892+0000", 2024-09-12T22:32:11.878 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6957999999999999e-05 2024-09-12T22:32:11.878 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.878 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.879 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:11.879 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413457+0000", 2024-09-12T22:32:11.879 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0035651279999999999 2024-09-12T22:32:11.879 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.879 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.879 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:11.879 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413552+0000", 2024-09-12T22:32:11.879 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.4093999999999997e-05 2024-09-12T22:32:11.879 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:11.879 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:11.879 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:11.879 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.879 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.880 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:21 3.1c e19/17 3:3ed09add:::607.00000000:head v 19'2, mlcod=0'0)", 2024-09-12T22:32:11.880 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.409718+0000", 2024-09-12T22:32:11.880 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 34.408785735999999, 2024-09-12T22:32:11.880 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003851883, 2024-09-12T22:32:11.880 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:11.880 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:11.880 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:11.880 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:11.880 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.880 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:11.880 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409718+0000", 2024-09-12T22:32:11.880 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:11.881 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.881 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.881 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:11.881 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409718+0000", 2024-09-12T22:32:11.881 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:11.881 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.881 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.881 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:11.881 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409719+0000", 2024-09-12T22:32:11.881 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.16e-07 2024-09-12T22:32:11.881 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.881 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.881 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:11.882 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409722+0000", 2024-09-12T22:32:11.882 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.692e-06 2024-09-12T22:32:11.882 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.882 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.882 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:11.882 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409729+0000", 2024-09-12T22:32:11.882 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.516e-06 2024-09-12T22:32:11.882 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.882 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.882 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:11.882 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409750+0000", 2024-09-12T22:32:11.882 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1151000000000001e-05 2024-09-12T22:32:11.882 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.883 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.883 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:11.883 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410015+0000", 2024-09-12T22:32:11.883 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00026477599999999999 2024-09-12T22:32:11.883 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.883 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.883 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:11.883 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410104+0000", 2024-09-12T22:32:11.883 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.9586000000000006e-05 2024-09-12T22:32:11.883 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.883 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.883 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:11.883 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413528+0000", 2024-09-12T22:32:11.883 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0034237880000000001 2024-09-12T22:32:11.884 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.884 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.884 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:11.884 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413570+0000", 2024-09-12T22:32:11.884 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2157999999999999e-05 2024-09-12T22:32:11.884 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:11.884 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:11.884 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:11.884 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.884 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.884 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:27 3.13 e19/17 3:c91d4a1d:::mds0_inotable:head v 19'2, mlcod=0'0)", 2024-09-12T22:32:11.884 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.409760+0000", 2024-09-12T22:32:11.884 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 34.408744220000003, 2024-09-12T22:32:11.885 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0039301910000000004, 2024-09-12T22:32:11.885 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:11.885 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:11.885 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:11.885 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:11.885 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.885 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:11.885 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409760+0000", 2024-09-12T22:32:11.885 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:11.885 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.885 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.885 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:11.885 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409760+0000", 2024-09-12T22:32:11.886 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:11.886 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.886 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.886 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:11.886 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409760+0000", 2024-09-12T22:32:11.886 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.39e-07 2024-09-12T22:32:11.886 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.886 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.886 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:11.886 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409765+0000", 2024-09-12T22:32:11.886 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4449999999999998e-06 2024-09-12T22:32:11.886 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.887 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.887 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:11.887 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409771+0000", 2024-09-12T22:32:11.887 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7159999999999997e-06 2024-09-12T22:32:11.887 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.887 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.887 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:11.887 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409778+0000", 2024-09-12T22:32:11.887 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.331e-06 2024-09-12T22:32:11.887 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.887 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.887 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:11.887 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410191+0000", 2024-09-12T22:32:11.887 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00041348300000000003 2024-09-12T22:32:11.887 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.888 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.888 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:11.888 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410211+0000", 2024-09-12T22:32:11.888 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9933999999999999e-05 2024-09-12T22:32:11.888 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.888 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.888 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:11.888 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413638+0000", 2024-09-12T22:32:11.888 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003426854 2024-09-12T22:32:11.888 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.888 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.888 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:11.889 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413690+0000", 2024-09-12T22:32:11.889 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2089000000000002e-05 2024-09-12T22:32:11.889 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:11.889 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:11.889 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:11.889 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.889 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.889 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "pg_update_log_missing_reply(3.b epoch 19/17 rep_tid 4 lcod 19'2)", 2024-09-12T22:32:11.889 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.410060+0000", 2024-09-12T22:32:11.889 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 34.408444555000003, 2024-09-12T22:32:11.889 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00098016500000000007, 2024-09-12T22:32:11.889 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:11.889 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:11.890 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "reached pg", 2024-09-12T22:32:11.890 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:11.890 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.890 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:11.890 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410060+0000", 2024-09-12T22:32:11.890 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:11.890 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.890 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.890 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:11.890 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410060+0000", 2024-09-12T22:32:11.890 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:11.890 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.890 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.890 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:11.891 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410060+0000", 2024-09-12T22:32:11.891 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.8299999999999998e-07 2024-09-12T22:32:11.891 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.891 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.891 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:11.891 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410062+0000", 2024-09-12T22:32:11.891 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5749999999999999e-06 2024-09-12T22:32:11.891 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.891 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.891 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:11.891 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410070+0000", 2024-09-12T22:32:11.891 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.909e-06 2024-09-12T22:32:11.891 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.892 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.892 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:11.892 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410076+0000", 2024-09-12T22:32:11.892 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7049999999999996e-06 2024-09-12T22:32:11.892 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.892 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.892 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:11.892 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410943+0000", 2024-09-12T22:32:11.892 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00086681900000000001 2024-09-12T22:32:11.892 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.892 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.892 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:11.892 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411040+0000", 2024-09-12T22:32:11.893 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.6774000000000006e-05 2024-09-12T22:32:11.893 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:11.893 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:11.893 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:11.893 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.893 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.893 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e19/17 ondisk, result = 0)", 2024-09-12T22:32:11.893 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.410113+0000", 2024-09-12T22:32:11.893 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 34.408391287999997, 2024-09-12T22:32:11.893 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00098911599999999995, 2024-09-12T22:32:11.893 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:11.893 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:11.893 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:32:11.893 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:11.894 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.894 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:11.894 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410113+0000", 2024-09-12T22:32:11.894 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:11.894 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.894 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.894 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:11.894 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410113+0000", 2024-09-12T22:32:11.894 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:11.894 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.894 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.894 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:11.894 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410113+0000", 2024-09-12T22:32:11.895 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.99e-07 2024-09-12T22:32:11.895 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.895 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.895 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:11.895 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410115+0000", 2024-09-12T22:32:11.895 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.046e-06 2024-09-12T22:32:11.895 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.895 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.895 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:11.895 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410121+0000", 2024-09-12T22:32:11.895 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0050000000000001e-06 2024-09-12T22:32:11.895 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.895 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.896 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:11.896 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410126+0000", 2024-09-12T22:32:11.896 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8339999999999998e-06 2024-09-12T22:32:11.896 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.896 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.896 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:11.896 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410587+0000", 2024-09-12T22:32:11.896 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00046095499999999998 2024-09-12T22:32:11.896 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.896 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.896 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:11.896 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410595+0000", 2024-09-12T22:32:11.896 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.9419999999999995e-06 2024-09-12T22:32:11.897 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.897 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.897 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:11.897 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411102+0000", 2024-09-12T22:32:11.897 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00050713500000000003 2024-09-12T22:32:11.897 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:11.897 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:11.897 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:11.897 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.897 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.897 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 19/17 rep_tid 8 lcod 19'4)", 2024-09-12T22:32:11.897 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.410133+0000", 2024-09-12T22:32:11.897 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 34.408371359999997, 2024-09-12T22:32:11.897 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0013504000000000001, 2024-09-12T22:32:11.898 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:11.898 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:11.898 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "reached pg", 2024-09-12T22:32:11.898 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:11.898 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.898 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:11.898 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410133+0000", 2024-09-12T22:32:11.898 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:11.898 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.898 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.898 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:11.898 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410133+0000", 2024-09-12T22:32:11.898 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:11.899 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.899 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.899 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:11.899 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410133+0000", 2024-09-12T22:32:11.899 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.0599999999999999e-07 2024-09-12T22:32:11.899 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.899 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.899 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:11.899 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410135+0000", 2024-09-12T22:32:11.899 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7770000000000001e-06 2024-09-12T22:32:11.899 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.899 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.899 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:11.900 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410140+0000", 2024-09-12T22:32:11.900 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9960000000000001e-06 2024-09-12T22:32:11.900 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.900 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.900 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:11.900 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410144+0000", 2024-09-12T22:32:11.900 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9500000000000003e-06 2024-09-12T22:32:11.900 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.900 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.900 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:11.900 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411310+0000", 2024-09-12T22:32:11.900 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001166311 2024-09-12T22:32:11.900 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.900 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.901 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:11.901 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411483+0000", 2024-09-12T22:32:11.901 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00017316 2024-09-12T22:32:11.901 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:11.901 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:11.901 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:11.901 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.901 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.901 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "pg_update_log_missing(3.1a epoch 19/17 rep_tid 0 entries 19'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T22:32:11.901 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.410617+0000", 2024-09-12T22:32:11.901 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 34.407886965000003, 2024-09-12T22:32:11.901 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0030439709999999999, 2024-09-12T22:32:11.901 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:11.902 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:11.902 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "reached pg", 2024-09-12T22:32:11.902 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:11.902 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.902 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:11.902 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410617+0000", 2024-09-12T22:32:11.902 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:11.902 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.902 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.902 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:11.902 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410617+0000", 2024-09-12T22:32:11.902 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:11.902 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.903 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.903 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:11.903 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410617+0000", 2024-09-12T22:32:11.903 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3599999999999999e-07 2024-09-12T22:32:11.903 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.903 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.903 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:11.903 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410625+0000", 2024-09-12T22:32:11.903 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5410000000000003e-06 2024-09-12T22:32:11.903 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.903 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.903 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:11.903 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410638+0000", 2024-09-12T22:32:11.904 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3261999999999999e-05 2024-09-12T22:32:11.904 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.904 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.904 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:11.904 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410653+0000", 2024-09-12T22:32:11.904 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4844000000000001e-05 2024-09-12T22:32:11.904 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.904 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.904 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:11.904 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410814+0000", 2024-09-12T22:32:11.904 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00016119999999999999 2024-09-12T22:32:11.904 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.904 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.905 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:11.905 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413661+0000", 2024-09-12T22:32:11.905 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0028467879999999998 2024-09-12T22:32:11.905 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:11.905 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:11.905 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:11.905 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.905 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.905 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-09-12T22:32:11.905 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:39.398875+0000", 2024-09-12T22:32:11.905 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 32.419628684999999, 2024-09-12T22:32:11.905 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0015679069999999999, 2024-09-12T22:32:11.905 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:11.905 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:11.906 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:11.906 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:11.906 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.906 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:11.906 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398875+0000", 2024-09-12T22:32:11.906 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:11.906 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.906 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.906 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:11.906 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398875+0000", 2024-09-12T22:32:11.906 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:11.906 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.906 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.907 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:11.907 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398878+0000", 2024-09-12T22:32:11.907 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1679999999999998e-06 2024-09-12T22:32:11.907 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.907 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.907 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:11.907 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398888+0000", 2024-09-12T22:32:11.907 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.084e-05 2024-09-12T22:32:11.907 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.907 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.907 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:11.907 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398906+0000", 2024-09-12T22:32:11.907 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7518000000000001e-05 2024-09-12T22:32:11.907 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.908 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.908 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:11.908 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398914+0000", 2024-09-12T22:32:11.908 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5989999999999996e-06 2024-09-12T22:32:11.908 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.908 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.908 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:11.908 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398974+0000", 2024-09-12T22:32:11.908 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0988e-05 2024-09-12T22:32:11.908 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.908 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.908 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:11.908 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.399078+0000", 2024-09-12T22:32:11.908 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000103133 2024-09-12T22:32:11.909 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.909 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.909 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:11.909 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.399166+0000", 2024-09-12T22:32:11.909 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.8183999999999995e-05 2024-09-12T22:32:11.909 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.909 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.909 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:11.909 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.399747+0000", 2024-09-12T22:32:11.909 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00058110599999999996 2024-09-12T22:32:11.909 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.909 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.909 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:11.910 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.400377+0000", 2024-09-12T22:32:11.910 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000630157 2024-09-12T22:32:11.910 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.910 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.910 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:11.910 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.400415+0000", 2024-09-12T22:32:11.910 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7814000000000001e-05 2024-09-12T22:32:11.910 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.910 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.910 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:11.910 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.400443+0000", 2024-09-12T22:32:11.910 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8399999999999999e-05 2024-09-12T22:32:11.910 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:11.911 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:11.911 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:11.911 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.911 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.911 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e23)", 2024-09-12T22:32:11.911 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:58.400966+0000", 2024-09-12T22:32:11.911 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 13.417537777, 2024-09-12T22:32:11.911 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001468876, 2024-09-12T22:32:11.911 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:11.911 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:11.911 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:11.911 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:11.911 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.912 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:11.912 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400966+0000", 2024-09-12T22:32:11.912 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:11.912 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.912 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.912 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:11.912 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400966+0000", 2024-09-12T22:32:11.912 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:11.912 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.912 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.912 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:11.912 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400967+0000", 2024-09-12T22:32:11.912 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.046e-06 2024-09-12T22:32:11.913 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.913 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.913 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:11.913 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400974+0000", 2024-09-12T22:32:11.913 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2310000000000001e-06 2024-09-12T22:32:11.913 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.913 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.913 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:11.913 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400988+0000", 2024-09-12T22:32:11.913 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4482e-05 2024-09-12T22:32:11.913 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.913 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.913 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:11.914 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400997+0000", 2024-09-12T22:32:11.914 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.0189999999999995e-06 2024-09-12T22:32:11.914 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.914 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.914 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:11.914 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.401068+0000", 2024-09-12T22:32:11.914 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1426000000000004e-05 2024-09-12T22:32:11.914 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.914 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.914 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:11.914 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.401174+0000", 2024-09-12T22:32:11.914 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000105769 2024-09-12T22:32:11.914 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.915 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.915 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:11.915 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.401335+0000", 2024-09-12T22:32:11.915 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000161225 2024-09-12T22:32:11.915 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.915 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.915 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:11.915 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.402110+0000", 2024-09-12T22:32:11.915 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00077428800000000004 2024-09-12T22:32:11.915 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.915 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.915 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:11.915 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.402333+0000", 2024-09-12T22:32:11.915 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000223723 2024-09-12T22:32:11.916 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.916 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.916 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:11.916 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.402388+0000", 2024-09-12T22:32:11.916 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4700999999999997e-05 2024-09-12T22:32:11.916 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.916 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.916 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:11.916 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.402435+0000", 2024-09-12T22:32:11.916 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6965999999999997e-05 2024-09-12T22:32:11.916 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:11.916 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:11.916 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:11.917 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.917 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.917 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:45 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e27)", 2024-09-12T22:32:11.917 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:32:04.401614+0000", 2024-09-12T22:32:11.917 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 7.4168903479999999, 2024-09-12T22:32:11.917 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0014279749999999999, 2024-09-12T22:32:11.917 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:11.917 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:11.917 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:11.918 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:11.918 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.918 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:11.918 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401614+0000", 2024-09-12T22:32:11.918 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:11.918 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.918 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.918 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:11.918 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401614+0000", 2024-09-12T22:32:11.918 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:11.918 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.918 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.918 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:11.919 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401615+0000", 2024-09-12T22:32:11.919 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.161e-06 2024-09-12T22:32:11.919 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.919 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.919 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:11.919 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401621+0000", 2024-09-12T22:32:11.919 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8730000000000004e-06 2024-09-12T22:32:11.919 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.919 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.919 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:11.919 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401633+0000", 2024-09-12T22:32:11.919 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1800000000000001e-05 2024-09-12T22:32:11.919 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.920 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.920 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:11.920 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401656+0000", 2024-09-12T22:32:11.920 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.3521999999999999e-05 2024-09-12T22:32:11.920 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.920 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.920 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:11.920 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401713+0000", 2024-09-12T22:32:11.920 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7259000000000002e-05 2024-09-12T22:32:11.920 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.920 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.920 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:11.920 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401849+0000", 2024-09-12T22:32:11.921 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013613500000000001 2024-09-12T22:32:11.921 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.921 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.921 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:11.921 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.402009+0000", 2024-09-12T22:32:11.921 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00015947199999999999 2024-09-12T22:32:11.921 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.921 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.921 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:11.921 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.402629+0000", 2024-09-12T22:32:11.921 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00061962200000000001 2024-09-12T22:32:11.921 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.921 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.921 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:11.922 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.402983+0000", 2024-09-12T22:32:11.922 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00035447499999999998 2024-09-12T22:32:11.922 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.922 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.922 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:11.922 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.403016+0000", 2024-09-12T22:32:11.922 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3108999999999998e-05 2024-09-12T22:32:11.922 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:11.922 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:11.922 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:11.922 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.403042+0000", 2024-09-12T22:32:11.922 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5547000000000001e-05 2024-09-12T22:32:11.922 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:11.923 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:11.923 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:11.923 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:11.923 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:11.923 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:32:11.924 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:32:11.925 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:11.923+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:12.025 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:12.024+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:12.039 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-09-12T22:32:12.039 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-09-12T22:32:12.039 INFO:teuthology.orchestra.run.smithi163.stdout: "num_ops": 0 2024-09-12T22:32:12.039 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-09-12T22:32:12.048 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:32:12.126 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:32:12.125+0000 7fddec6a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30331) UID: 0 2024-09-12T22:32:12.153 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-09-12T22:32:12.153 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-09-12T22:32:12.153 INFO:teuthology.orchestra.run.smithi163.stdout: "complaint_time": 30, 2024-09-12T22:32:12.153 INFO:teuthology.orchestra.run.smithi163.stdout: "num_blocked_ops": 0 2024-09-12T22:32:12.153 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-09-12T22:32:12.161 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:32:12.227 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:32:12.226+0000 7fddec6a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30331) UID: 0 2024-09-12T22:32:12.265 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-09-12T22:32:12.265 INFO:teuthology.orchestra.run.smithi163.stdout: "size": 20, 2024-09-12T22:32:12.265 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 600, 2024-09-12T22:32:12.265 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2024-09-12T22:32:12.266 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.266 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-09-12T22:32:12.266 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:27.254459+0000", 2024-09-12T22:32:12.266 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 45.008701346000002, 2024-09-12T22:32:12.266 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.37816283899999997, 2024-09-12T22:32:12.266 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:12.266 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:12.266 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:12.266 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:12.266 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:12.266 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:12.266 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 1 2024-09-12T22:32:12.266 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.267 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:12.267 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.267 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:12.267 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254459+0000", 2024-09-12T22:32:12.267 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:12.267 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.267 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.267 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:12.267 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254459+0000", 2024-09-12T22:32:12.267 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:12.267 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.267 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.267 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:12.268 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254460+0000", 2024-09-12T22:32:12.268 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1739999999999999e-06 2024-09-12T22:32:12.268 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.268 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.268 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:12.268 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254472+0000", 2024-09-12T22:32:12.268 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2207e-05 2024-09-12T22:32:12.268 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.268 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.268 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:12.268 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254483+0000", 2024-09-12T22:32:12.268 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0631999999999999e-05 2024-09-12T22:32:12.268 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.268 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.269 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:12.269 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254492+0000", 2024-09-12T22:32:12.269 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3670000000000003e-06 2024-09-12T22:32:12.269 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.269 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.269 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:12.269 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254551+0000", 2024-09-12T22:32:12.269 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8687999999999998e-05 2024-09-12T22:32:12.269 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.269 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.269 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for peered", 2024-09-12T22:32:12.269 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254562+0000", 2024-09-12T22:32:12.269 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1249e-05 2024-09-12T22:32:12.269 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.270 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.270 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:12.270 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.631211+0000", 2024-09-12T22:32:12.270 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.376649018 2024-09-12T22:32:12.270 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.270 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.270 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:12.270 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.631345+0000", 2024-09-12T22:32:12.270 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013378700000000001 2024-09-12T22:32:12.270 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.270 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.270 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:12.270 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.631479+0000", 2024-09-12T22:32:12.270 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013352399999999999 2024-09-12T22:32:12.271 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.271 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.271 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:12.271 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632324+0000", 2024-09-12T22:32:12.271 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00084508100000000002 2024-09-12T22:32:12.271 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.271 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.271 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:12.271 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632548+0000", 2024-09-12T22:32:12.271 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000224329 2024-09-12T22:32:12.271 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.271 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.271 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:12.271 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632591+0000", 2024-09-12T22:32:12.272 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2564000000000001e-05 2024-09-12T22:32:12.272 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.272 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.272 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:12.272 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632622+0000", 2024-09-12T22:32:12.272 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1219e-05 2024-09-12T22:32:12.272 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:12.272 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:12.272 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:12.272 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.272 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.272 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:185 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:32:12.272 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394355+0000", 2024-09-12T22:32:12.273 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 43.868805248999998, 2024-09-12T22:32:12.273 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011302394, 2024-09-12T22:32:12.273 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:12.273 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:12.273 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:12.273 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:12.273 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:12.273 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:12.273 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 185 2024-09-12T22:32:12.276 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.276 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:12.276 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.276 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:12.276 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394355+0000", 2024-09-12T22:32:12.276 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:12.276 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.276 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.277 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:12.277 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394355+0000", 2024-09-12T22:32:12.277 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:12.277 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.277 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.277 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:12.277 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394355+0000", 2024-09-12T22:32:12.277 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9099999999999999e-07 2024-09-12T22:32:12.277 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.277 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.277 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:12.277 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394385+0000", 2024-09-12T22:32:12.277 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9963000000000001e-05 2024-09-12T22:32:12.278 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.278 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.278 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:12.278 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394390+0000", 2024-09-12T22:32:12.278 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8420000000000004e-06 2024-09-12T22:32:12.278 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.278 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.278 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:12.278 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394393+0000", 2024-09-12T22:32:12.278 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1e-06 2024-09-12T22:32:12.278 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.278 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.278 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:12.278 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.400546+0000", 2024-09-12T22:32:12.279 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0061523309999999996 2024-09-12T22:32:12.279 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.279 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.279 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:12.279 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.400588+0000", 2024-09-12T22:32:12.279 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1835000000000002e-05 2024-09-12T22:32:12.279 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.279 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.279 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:12.279 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.400677+0000", 2024-09-12T22:32:12.279 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9195000000000002e-05 2024-09-12T22:32:12.279 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.279 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.280 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:12.280 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405378+0000", 2024-09-12T22:32:12.280 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0047008659999999997 2024-09-12T22:32:12.280 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.280 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.280 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:12.280 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405569+0000", 2024-09-12T22:32:12.280 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00019148599999999999 2024-09-12T22:32:12.280 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.280 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.280 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:12.280 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405620+0000", 2024-09-12T22:32:12.280 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1416999999999999e-05 2024-09-12T22:32:12.280 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.281 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.281 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:12.281 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405657+0000", 2024-09-12T22:32:12.281 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6968000000000002e-05 2024-09-12T22:32:12.281 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:12.281 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:12.281 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:12.281 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.281 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.281 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:32:12.281 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394399+0000", 2024-09-12T22:32:12.281 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 43.868761038000002, 2024-09-12T22:32:12.281 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011336601999999999, 2024-09-12T22:32:12.281 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:12.282 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:12.282 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:12.282 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:12.282 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:12.282 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:12.282 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 186 2024-09-12T22:32:12.282 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.282 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:12.282 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.282 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:12.282 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394399+0000", 2024-09-12T22:32:12.282 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:12.282 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.283 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.283 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:12.283 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394399+0000", 2024-09-12T22:32:12.283 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:12.283 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.283 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.283 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:12.283 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394400+0000", 2024-09-12T22:32:12.283 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4499999999999998e-07 2024-09-12T22:32:12.283 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.283 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.283 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:12.283 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394402+0000", 2024-09-12T22:32:12.284 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.875e-06 2024-09-12T22:32:12.284 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.284 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.284 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:12.284 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394405+0000", 2024-09-12T22:32:12.284 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6799999999999999e-06 2024-09-12T22:32:12.284 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.284 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.284 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:12.284 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394408+0000", 2024-09-12T22:32:12.284 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.667e-06 2024-09-12T22:32:12.284 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.284 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.285 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:12.285 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401395+0000", 2024-09-12T22:32:12.285 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0069867230000000002 2024-09-12T22:32:12.285 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.285 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.285 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:12.285 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401438+0000", 2024-09-12T22:32:12.285 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3554999999999999e-05 2024-09-12T22:32:12.285 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.285 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.285 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:12.286 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401509+0000", 2024-09-12T22:32:12.286 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0631999999999997e-05 2024-09-12T22:32:12.286 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.286 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.286 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:12.286 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405392+0000", 2024-09-12T22:32:12.286 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0038830449999999999 2024-09-12T22:32:12.286 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.286 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.286 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:12.286 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405690+0000", 2024-09-12T22:32:12.286 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000298435 2024-09-12T22:32:12.286 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.287 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.287 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:12.287 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405716+0000", 2024-09-12T22:32:12.287 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5435999999999998e-05 2024-09-12T22:32:12.287 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.287 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.287 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:12.287 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405736+0000", 2024-09-12T22:32:12.287 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0208999999999999e-05 2024-09-12T22:32:12.287 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:12.287 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:12.287 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:12.288 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.288 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.288 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:32:12.288 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394411+0000", 2024-09-12T22:32:12.288 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 43.868748912000001, 2024-09-12T22:32:12.288 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011400117, 2024-09-12T22:32:12.288 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:12.288 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:12.288 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:12.288 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:12.288 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:12.288 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:12.288 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 187 2024-09-12T22:32:12.289 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.289 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:12.289 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.289 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:12.289 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394411+0000", 2024-09-12T22:32:12.289 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:12.289 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.289 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.289 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:12.289 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394411+0000", 2024-09-12T22:32:12.289 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:12.289 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.289 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.290 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:12.290 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394412+0000", 2024-09-12T22:32:12.290 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.4999999999999999e-07 2024-09-12T22:32:12.290 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.290 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.290 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:12.290 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394414+0000", 2024-09-12T22:32:12.290 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.984e-06 2024-09-12T22:32:12.290 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.290 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.290 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:12.290 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394418+0000", 2024-09-12T22:32:12.291 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0840000000000002e-06 2024-09-12T22:32:12.291 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.291 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.291 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:12.291 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394431+0000", 2024-09-12T22:32:12.291 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.361e-05 2024-09-12T22:32:12.291 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.291 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.291 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:12.291 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401778+0000", 2024-09-12T22:32:12.291 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0073462659999999997 2024-09-12T22:32:12.291 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.291 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.292 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:12.292 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401853+0000", 2024-09-12T22:32:12.292 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5797000000000006e-05 2024-09-12T22:32:12.292 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.292 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.292 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:12.292 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401990+0000", 2024-09-12T22:32:12.292 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013651399999999999 2024-09-12T22:32:12.292 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.292 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.292 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:12.292 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405402+0000", 2024-09-12T22:32:12.292 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0034116070000000001 2024-09-12T22:32:12.293 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.293 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.293 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:12.293 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405764+0000", 2024-09-12T22:32:12.293 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00036234899999999998 2024-09-12T22:32:12.293 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.293 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.293 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:12.293 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405791+0000", 2024-09-12T22:32:12.293 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7029000000000002e-05 2024-09-12T22:32:12.293 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.293 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.293 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:12.294 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405812+0000", 2024-09-12T22:32:12.294 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0627000000000001e-05 2024-09-12T22:32:12.294 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:12.294 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:12.294 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:12.294 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.294 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.294 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:32:12.294 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394447+0000", 2024-09-12T22:32:12.294 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 43.868713761000002, 2024-09-12T22:32:12.294 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011759588, 2024-09-12T22:32:12.294 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:12.294 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:12.294 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:12.295 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:12.295 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:12.295 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:12.295 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 188 2024-09-12T22:32:12.295 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.295 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:12.295 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.295 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:12.295 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394447+0000", 2024-09-12T22:32:12.295 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:12.295 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.295 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.295 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:12.295 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394447+0000", 2024-09-12T22:32:12.296 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:12.296 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.296 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.296 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:12.296 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394447+0000", 2024-09-12T22:32:12.296 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.15e-07 2024-09-12T22:32:12.296 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.296 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.296 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:12.296 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394512+0000", 2024-09-12T22:32:12.296 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4580999999999997e-05 2024-09-12T22:32:12.296 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.296 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.296 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:12.297 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394518+0000", 2024-09-12T22:32:12.297 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.3380000000000001e-06 2024-09-12T22:32:12.297 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.297 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.297 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:12.297 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394521+0000", 2024-09-12T22:32:12.297 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3340000000000002e-06 2024-09-12T22:32:12.297 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.297 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.297 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:12.297 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.402628+0000", 2024-09-12T22:32:12.297 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.008106996 2024-09-12T22:32:12.297 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.298 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.298 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:12.298 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.402670+0000", 2024-09-12T22:32:12.298 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1983000000000001e-05 2024-09-12T22:32:12.298 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.298 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.298 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:12.298 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.402738+0000", 2024-09-12T22:32:12.298 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.8114999999999994e-05 2024-09-12T22:32:12.298 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.298 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.298 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:12.298 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405668+0000", 2024-09-12T22:32:12.298 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.002929545 2024-09-12T22:32:12.299 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.299 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.299 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:12.299 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406162+0000", 2024-09-12T22:32:12.299 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000494408 2024-09-12T22:32:12.299 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.299 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.299 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:12.299 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406188+0000", 2024-09-12T22:32:12.299 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5766e-05 2024-09-12T22:32:12.299 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.299 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.299 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:12.299 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406206+0000", 2024-09-12T22:32:12.300 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.8107000000000001e-05 2024-09-12T22:32:12.300 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:12.300 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:12.300 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:12.300 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.300 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.300 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:32:12.300 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394528+0000", 2024-09-12T22:32:12.300 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 43.868632091999999, 2024-09-12T22:32:12.300 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.01195536, 2024-09-12T22:32:12.300 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:12.300 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:12.300 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:12.300 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:12.301 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:12.301 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:12.301 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 189 2024-09-12T22:32:12.301 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.301 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:12.301 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.301 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:12.301 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394528+0000", 2024-09-12T22:32:12.301 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:12.301 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.301 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.301 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:12.301 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394528+0000", 2024-09-12T22:32:12.302 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:12.302 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.302 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.302 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:12.302 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394529+0000", 2024-09-12T22:32:12.302 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4900000000000001e-07 2024-09-12T22:32:12.302 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.302 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.302 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:12.302 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394531+0000", 2024-09-12T22:32:12.302 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.458e-06 2024-09-12T22:32:12.302 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.303 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.303 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:12.303 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394535+0000", 2024-09-12T22:32:12.303 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7900000000000001e-06 2024-09-12T22:32:12.303 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.303 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.303 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:12.303 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394537+0000", 2024-09-12T22:32:12.303 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.632e-06 2024-09-12T22:32:12.303 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.303 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.303 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:12.303 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.404932+0000", 2024-09-12T22:32:12.304 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010394158000000001 2024-09-12T22:32:12.304 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.304 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.304 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:12.304 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405017+0000", 2024-09-12T22:32:12.304 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5525000000000005e-05 2024-09-12T22:32:12.304 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.304 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.304 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:12.304 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405114+0000", 2024-09-12T22:32:12.304 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.6527000000000006e-05 2024-09-12T22:32:12.304 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.304 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.304 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:12.305 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405818+0000", 2024-09-12T22:32:12.305 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00070412800000000005 2024-09-12T22:32:12.305 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.305 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.305 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:12.305 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406437+0000", 2024-09-12T22:32:12.305 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00061898900000000002 2024-09-12T22:32:12.305 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.305 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.305 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:12.305 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406463+0000", 2024-09-12T22:32:12.305 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6268e-05 2024-09-12T22:32:12.305 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.306 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.306 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:12.306 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406484+0000", 2024-09-12T22:32:12.306 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0536000000000001e-05 2024-09-12T22:32:12.306 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:12.306 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:12.306 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:12.306 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.306 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.306 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:12.306 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.401422+0000", 2024-09-12T22:32:12.307 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 34.861738187, 2024-09-12T22:32:12.307 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016896452999999999, 2024-09-12T22:32:12.307 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:12.307 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:12.307 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:12.307 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:12.307 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.307 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:12.307 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401422+0000", 2024-09-12T22:32:12.307 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:12.307 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.307 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.307 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:12.308 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401422+0000", 2024-09-12T22:32:12.308 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:12.308 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.308 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.308 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:12.308 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401424+0000", 2024-09-12T22:32:12.308 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9e-06 2024-09-12T22:32:12.308 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.308 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.308 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:12.309 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401437+0000", 2024-09-12T22:32:12.309 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2831e-05 2024-09-12T22:32:12.309 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.309 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.309 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:12.309 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401471+0000", 2024-09-12T22:32:12.309 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4010000000000001e-05 2024-09-12T22:32:12.309 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.309 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.309 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:12.309 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401484+0000", 2024-09-12T22:32:12.310 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2711000000000001e-05 2024-09-12T22:32:12.310 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.310 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.310 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:12.310 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405410+0000", 2024-09-12T22:32:12.310 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0039259170000000001 2024-09-12T22:32:12.310 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.310 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.310 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:12.310 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405529+0000", 2024-09-12T22:32:12.310 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000119778 2024-09-12T22:32:12.310 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.311 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.311 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:12.311 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405655+0000", 2024-09-12T22:32:12.311 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012556700000000001 2024-09-12T22:32:12.311 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.311 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.311 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:12.311 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410456+0000", 2024-09-12T22:32:12.311 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0048008269999999997 2024-09-12T22:32:12.311 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.311 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.311 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:12.312 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418226+0000", 2024-09-12T22:32:12.312 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0077707729999999999 2024-09-12T22:32:12.312 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.312 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.312 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:12.312 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418277+0000", 2024-09-12T22:32:12.312 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0476000000000003e-05 2024-09-12T22:32:12.312 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.312 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.312 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:12.312 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418319+0000", 2024-09-12T22:32:12.312 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1662999999999997e-05 2024-09-12T22:32:12.313 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:12.313 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:12.313 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:12.313 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.313 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.313 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:12.313 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.401505+0000", 2024-09-12T22:32:12.313 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 34.861655523000003, 2024-09-12T22:32:12.313 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016987904000000002, 2024-09-12T22:32:12.313 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:12.313 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:12.313 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:12.313 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:12.314 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.314 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:12.314 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401505+0000", 2024-09-12T22:32:12.314 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:12.314 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.314 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.314 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:12.314 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401505+0000", 2024-09-12T22:32:12.314 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:12.314 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.314 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.314 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:12.314 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401506+0000", 2024-09-12T22:32:12.315 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4700000000000001e-07 2024-09-12T22:32:12.315 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.315 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.315 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:12.315 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401510+0000", 2024-09-12T22:32:12.315 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6609999999999999e-06 2024-09-12T22:32:12.315 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.315 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.315 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:12.315 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401771+0000", 2024-09-12T22:32:12.315 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00026110700000000001 2024-09-12T22:32:12.315 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.315 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.315 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:12.316 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401921+0000", 2024-09-12T22:32:12.316 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014939099999999999 2024-09-12T22:32:12.316 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.316 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.316 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:12.316 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405944+0000", 2024-09-12T22:32:12.316 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0040235449999999999 2024-09-12T22:32:12.316 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.316 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.316 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:12.316 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406018+0000", 2024-09-12T22:32:12.316 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3373000000000004e-05 2024-09-12T22:32:12.316 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.317 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.317 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:12.317 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406172+0000", 2024-09-12T22:32:12.317 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00015435399999999999 2024-09-12T22:32:12.317 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.317 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.317 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:12.317 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410461+0000", 2024-09-12T22:32:12.317 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0042888609999999997 2024-09-12T22:32:12.317 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.317 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.317 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:12.317 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418371+0000", 2024-09-12T22:32:12.318 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0079098380000000006 2024-09-12T22:32:12.318 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.318 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.318 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:12.318 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418443+0000", 2024-09-12T22:32:12.318 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2705000000000003e-05 2024-09-12T22:32:12.318 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.318 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.318 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:12.318 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418493+0000", 2024-09-12T22:32:12.318 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9322e-05 2024-09-12T22:32:12.318 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:12.318 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:12.318 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:12.319 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.319 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.319 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:12.319 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.401939+0000", 2024-09-12T22:32:12.319 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 34.861221786999998, 2024-09-12T22:32:12.319 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016722292999999999, 2024-09-12T22:32:12.319 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:12.319 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:12.319 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:12.319 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:12.319 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.319 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:12.319 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401939+0000", 2024-09-12T22:32:12.319 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:12.320 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.320 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.320 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:12.320 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401939+0000", 2024-09-12T22:32:12.320 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:12.320 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.320 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.320 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:12.320 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401940+0000", 2024-09-12T22:32:12.320 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1990000000000001e-06 2024-09-12T22:32:12.320 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.320 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.320 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:12.321 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401956+0000", 2024-09-12T22:32:12.321 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.6344000000000001e-05 2024-09-12T22:32:12.321 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.321 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.321 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:12.321 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401974+0000", 2024-09-12T22:32:12.321 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7730000000000001e-05 2024-09-12T22:32:12.321 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.321 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.321 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:12.321 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401982+0000", 2024-09-12T22:32:12.322 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.7800000000000001e-06 2024-09-12T22:32:12.322 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.322 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.322 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:12.322 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406557+0000", 2024-09-12T22:32:12.322 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0045758489999999999 2024-09-12T22:32:12.322 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.322 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.322 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:12.322 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406697+0000", 2024-09-12T22:32:12.322 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013925100000000001 2024-09-12T22:32:12.322 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.322 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.322 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:12.323 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406830+0000", 2024-09-12T22:32:12.323 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013293499999999999 2024-09-12T22:32:12.323 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.323 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.323 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:12.323 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410465+0000", 2024-09-12T22:32:12.323 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0036352680000000001 2024-09-12T22:32:12.323 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.323 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.323 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:12.323 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418564+0000", 2024-09-12T22:32:12.324 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0080992140000000004 2024-09-12T22:32:12.324 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.324 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.324 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:12.324 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418621+0000", 2024-09-12T22:32:12.324 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7167999999999999e-05 2024-09-12T22:32:12.324 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.324 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.324 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:12.324 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418661+0000", 2024-09-12T22:32:12.324 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9555000000000003e-05 2024-09-12T22:32:12.324 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:12.324 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:12.324 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:12.325 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.325 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.325 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:12.325 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.401994+0000", 2024-09-12T22:32:12.325 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 34.861165915000001, 2024-09-12T22:32:12.325 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016804109000000001, 2024-09-12T22:32:12.325 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:12.325 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:12.325 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:12.325 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:12.325 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.325 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:12.325 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401994+0000", 2024-09-12T22:32:12.325 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:12.326 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.326 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.326 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:12.326 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401994+0000", 2024-09-12T22:32:12.326 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:12.326 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.326 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.326 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:12.326 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401995+0000", 2024-09-12T22:32:12.326 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.8899999999999998e-07 2024-09-12T22:32:12.326 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.326 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.326 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:12.326 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402000+0000", 2024-09-12T22:32:12.327 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.498e-06 2024-09-12T22:32:12.327 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.327 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.327 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:12.327 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402007+0000", 2024-09-12T22:32:12.327 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.554e-06 2024-09-12T22:32:12.327 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.327 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.327 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:12.327 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402046+0000", 2024-09-12T22:32:12.327 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9156000000000003e-05 2024-09-12T22:32:12.327 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.327 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.327 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:12.328 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407342+0000", 2024-09-12T22:32:12.328 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052957610000000004 2024-09-12T22:32:12.328 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.328 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.328 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:12.328 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407521+0000", 2024-09-12T22:32:12.328 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00017878100000000001 2024-09-12T22:32:12.328 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.328 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.328 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:12.328 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407641+0000", 2024-09-12T22:32:12.328 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012013 2024-09-12T22:32:12.328 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.328 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.329 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:12.329 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410472+0000", 2024-09-12T22:32:12.329 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.002830455 2024-09-12T22:32:12.329 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.329 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.329 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:12.329 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418714+0000", 2024-09-12T22:32:12.329 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0082422789999999999 2024-09-12T22:32:12.329 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.329 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.329 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:12.329 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418761+0000", 2024-09-12T22:32:12.329 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6956999999999998e-05 2024-09-12T22:32:12.329 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.330 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.330 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:12.330 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418799+0000", 2024-09-12T22:32:12.330 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7749000000000001e-05 2024-09-12T22:32:12.330 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:12.330 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:12.330 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:12.330 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.330 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.330 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:12.330 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.402060+0000", 2024-09-12T22:32:12.330 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 34.861100471, 2024-09-12T22:32:12.330 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016885686, 2024-09-12T22:32:12.330 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:12.331 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:12.331 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:12.331 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:12.331 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.331 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:12.331 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402060+0000", 2024-09-12T22:32:12.331 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:12.331 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.331 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.331 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:12.331 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402060+0000", 2024-09-12T22:32:12.331 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:12.331 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.332 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.332 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:12.332 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402061+0000", 2024-09-12T22:32:12.332 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4399999999999999e-07 2024-09-12T22:32:12.332 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.332 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.332 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:12.332 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402066+0000", 2024-09-12T22:32:12.332 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8649999999999998e-06 2024-09-12T22:32:12.332 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.332 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.332 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:12.332 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402146+0000", 2024-09-12T22:32:12.332 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9054000000000006e-05 2024-09-12T22:32:12.333 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.333 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.333 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:12.333 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402287+0000", 2024-09-12T22:32:12.333 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014108600000000001 2024-09-12T22:32:12.333 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.333 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.333 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:12.333 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408185+0000", 2024-09-12T22:32:12.333 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0058983919999999997 2024-09-12T22:32:12.333 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.333 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.333 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:12.334 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408299+0000", 2024-09-12T22:32:12.334 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114102 2024-09-12T22:32:12.334 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.334 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.334 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:12.334 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408420+0000", 2024-09-12T22:32:12.334 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000120492 2024-09-12T22:32:12.334 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.334 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.334 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:12.334 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410867+0000", 2024-09-12T22:32:12.334 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0024476430000000002 2024-09-12T22:32:12.334 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.334 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.335 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:12.335 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418851+0000", 2024-09-12T22:32:12.335 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0079841489999999994 2024-09-12T22:32:12.335 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.335 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.335 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:12.335 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418894+0000", 2024-09-12T22:32:12.335 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3090000000000002e-05 2024-09-12T22:32:12.335 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.335 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.335 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:12.335 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418946+0000", 2024-09-12T22:32:12.336 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1069000000000002e-05 2024-09-12T22:32:12.336 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:12.336 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:12.336 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:12.336 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.336 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.336 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:12.336 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.402375+0000", 2024-09-12T22:32:12.336 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 34.860785405999998, 2024-09-12T22:32:12.336 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016768531999999999, 2024-09-12T22:32:12.336 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:12.336 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:12.336 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:12.337 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:12.337 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.337 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:12.337 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402375+0000", 2024-09-12T22:32:12.337 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:12.337 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.337 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.337 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:12.337 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402375+0000", 2024-09-12T22:32:12.337 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:12.337 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.337 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.337 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:12.338 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402375+0000", 2024-09-12T22:32:12.338 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4099999999999999e-07 2024-09-12T22:32:12.338 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.338 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.338 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:12.338 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402379+0000", 2024-09-12T22:32:12.338 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9870000000000001e-06 2024-09-12T22:32:12.338 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.338 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.338 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:12.338 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402389+0000", 2024-09-12T22:32:12.338 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0000000000000001e-05 2024-09-12T22:32:12.338 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.338 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.339 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:12.339 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402401+0000", 2024-09-12T22:32:12.339 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.148e-05 2024-09-12T22:32:12.339 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.339 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.339 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:12.339 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409108+0000", 2024-09-12T22:32:12.339 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0067068429999999997 2024-09-12T22:32:12.339 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.339 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.339 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:12.339 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409189+0000", 2024-09-12T22:32:12.339 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0815999999999993e-05 2024-09-12T22:32:12.339 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.340 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.340 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:12.340 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409320+0000", 2024-09-12T22:32:12.340 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000131586 2024-09-12T22:32:12.340 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.340 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.340 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:12.340 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410872+0000", 2024-09-12T22:32:12.340 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0015521599999999999 2024-09-12T22:32:12.340 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.340 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.340 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:12.340 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419049+0000", 2024-09-12T22:32:12.341 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0081763719999999995 2024-09-12T22:32:12.341 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.341 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.341 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:12.341 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419107+0000", 2024-09-12T22:32:12.341 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7899000000000002e-05 2024-09-12T22:32:12.341 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.341 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.341 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:12.341 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419143+0000", 2024-09-12T22:32:12.341 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6847999999999997e-05 2024-09-12T22:32:12.341 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:12.341 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:12.341 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:12.342 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.342 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.342 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:12.342 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.402903+0000", 2024-09-12T22:32:12.342 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 34.860256993999997, 2024-09-12T22:32:12.342 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016378428, 2024-09-12T22:32:12.342 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:12.342 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:12.342 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:12.342 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:12.342 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.342 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:12.342 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402903+0000", 2024-09-12T22:32:12.342 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:12.343 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.343 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.343 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:12.343 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402903+0000", 2024-09-12T22:32:12.343 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:12.343 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.343 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.343 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:12.343 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402904+0000", 2024-09-12T22:32:12.343 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9500000000000001e-07 2024-09-12T22:32:12.343 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.343 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.343 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:12.343 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402944+0000", 2024-09-12T22:32:12.344 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0265000000000002e-05 2024-09-12T22:32:12.344 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.344 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.344 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:12.344 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402979+0000", 2024-09-12T22:32:12.344 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4378000000000002e-05 2024-09-12T22:32:12.344 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.344 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.344 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:12.344 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402987+0000", 2024-09-12T22:32:12.344 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3559999999999993e-06 2024-09-12T22:32:12.344 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.344 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.344 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:12.345 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409577+0000", 2024-09-12T22:32:12.345 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0065901709999999997 2024-09-12T22:32:12.345 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.345 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.345 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:12.345 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409653+0000", 2024-09-12T22:32:12.345 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5819e-05 2024-09-12T22:32:12.345 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.345 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.345 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:12.345 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409725+0000", 2024-09-12T22:32:12.346 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2200000000000007e-05 2024-09-12T22:32:12.346 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.346 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.346 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:12.346 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.411234+0000", 2024-09-12T22:32:12.346 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001508225 2024-09-12T22:32:12.346 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.346 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.346 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:12.346 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419212+0000", 2024-09-12T22:32:12.346 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0079783400000000004 2024-09-12T22:32:12.346 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.347 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.347 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:12.347 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419244+0000", 2024-09-12T22:32:12.347 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2384e-05 2024-09-12T22:32:12.347 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.347 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.347 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:12.347 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419282+0000", 2024-09-12T22:32:12.347 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7394999999999997e-05 2024-09-12T22:32:12.347 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:12.347 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:12.347 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:12.347 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.348 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.348 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:12.348 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.403135+0000", 2024-09-12T22:32:12.348 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 34.860025124000003, 2024-09-12T22:32:12.348 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016294211999999999, 2024-09-12T22:32:12.348 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:12.348 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:12.348 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:12.348 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:12.348 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.348 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:12.348 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403135+0000", 2024-09-12T22:32:12.348 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:12.349 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.349 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.349 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:12.349 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403135+0000", 2024-09-12T22:32:12.349 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:12.349 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.349 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.349 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:12.349 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403136+0000", 2024-09-12T22:32:12.349 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.4e-07 2024-09-12T22:32:12.349 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.349 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.349 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:12.349 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403149+0000", 2024-09-12T22:32:12.350 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2723e-05 2024-09-12T22:32:12.350 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.350 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.350 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:12.350 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403158+0000", 2024-09-12T22:32:12.350 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3919999999999992e-06 2024-09-12T22:32:12.350 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.350 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.350 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:12.350 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403166+0000", 2024-09-12T22:32:12.350 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.2309999999999996e-06 2024-09-12T22:32:12.350 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.351 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.351 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:12.351 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409944+0000", 2024-09-12T22:32:12.351 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0067775309999999998 2024-09-12T22:32:12.351 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.351 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.351 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:12.351 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410032+0000", 2024-09-12T22:32:12.351 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.7906999999999997e-05 2024-09-12T22:32:12.351 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.351 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.351 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:12.351 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410152+0000", 2024-09-12T22:32:12.351 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012037800000000001 2024-09-12T22:32:12.352 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.352 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.352 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:12.352 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.411945+0000", 2024-09-12T22:32:12.352 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0017931850000000001 2024-09-12T22:32:12.352 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.352 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.352 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:12.352 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419319+0000", 2024-09-12T22:32:12.352 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0073731780000000002 2024-09-12T22:32:12.352 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.352 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.352 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:12.352 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419376+0000", 2024-09-12T22:32:12.353 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7728e-05 2024-09-12T22:32:12.353 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.353 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.353 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:12.353 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419429+0000", 2024-09-12T22:32:12.353 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3019000000000002e-05 2024-09-12T22:32:12.353 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:12.353 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:12.353 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:12.353 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.353 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.353 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:12.353 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.403185+0000", 2024-09-12T22:32:12.353 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 34.859975243000001, 2024-09-12T22:32:12.354 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.014902164000000001, 2024-09-12T22:32:12.354 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:12.354 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:12.354 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:12.354 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:12.354 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.354 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:12.354 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403185+0000", 2024-09-12T22:32:12.354 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:12.354 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.354 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.354 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:12.354 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403185+0000", 2024-09-12T22:32:12.355 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:12.355 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.355 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.355 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:12.355 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403186+0000", 2024-09-12T22:32:12.355 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9400000000000005e-07 2024-09-12T22:32:12.355 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.355 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.355 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:12.355 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403191+0000", 2024-09-12T22:32:12.355 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6980000000000003e-06 2024-09-12T22:32:12.355 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.355 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.355 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:12.356 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403199+0000", 2024-09-12T22:32:12.356 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2520000000000002e-06 2024-09-12T22:32:12.356 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.356 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.356 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:12.356 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403205+0000", 2024-09-12T22:32:12.356 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.908e-06 2024-09-12T22:32:12.356 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.356 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.356 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:12.356 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403359+0000", 2024-09-12T22:32:12.356 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000154544 2024-09-12T22:32:12.356 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.356 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.357 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:12.357 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403528+0000", 2024-09-12T22:32:12.357 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000168455 2024-09-12T22:32:12.357 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.357 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.357 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:12.357 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403763+0000", 2024-09-12T22:32:12.357 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00023539599999999999 2024-09-12T22:32:12.357 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.357 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.357 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:12.357 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409378+0000", 2024-09-12T22:32:12.357 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056150000000000002 2024-09-12T22:32:12.357 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.358 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.358 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:12.358 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418012+0000", 2024-09-12T22:32:12.358 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0086339559999999999 2024-09-12T22:32:12.358 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.358 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.358 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:12.358 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418046+0000", 2024-09-12T22:32:12.358 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4267999999999998e-05 2024-09-12T22:32:12.358 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.358 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.358 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:12.359 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418087+0000", 2024-09-12T22:32:12.359 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0992999999999999e-05 2024-09-12T22:32:12.359 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:12.359 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:12.359 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:12.359 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.359 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.359 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:12.359 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.403273+0000", 2024-09-12T22:32:12.359 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 34.859887292000003, 2024-09-12T22:32:12.359 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.014934866, 2024-09-12T22:32:12.359 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:12.359 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:12.360 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:12.360 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:12.360 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.360 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:12.360 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403273+0000", 2024-09-12T22:32:12.360 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:12.360 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.360 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.360 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:12.360 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403273+0000", 2024-09-12T22:32:12.360 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:12.360 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.360 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.361 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:12.361 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403274+0000", 2024-09-12T22:32:12.361 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.297e-06 2024-09-12T22:32:12.361 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.361 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.361 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:12.361 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403282+0000", 2024-09-12T22:32:12.361 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6340000000000001e-06 2024-09-12T22:32:12.361 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.361 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.361 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:12.361 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403305+0000", 2024-09-12T22:32:12.361 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3149000000000001e-05 2024-09-12T22:32:12.361 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.362 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.362 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:12.362 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403320+0000", 2024-09-12T22:32:12.362 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4527e-05 2024-09-12T22:32:12.362 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.362 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.362 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:12.362 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.404928+0000", 2024-09-12T22:32:12.362 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001608459 2024-09-12T22:32:12.362 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.362 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.362 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:12.362 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405218+0000", 2024-09-12T22:32:12.363 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00028982900000000002 2024-09-12T22:32:12.363 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.363 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.363 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:12.363 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405829+0000", 2024-09-12T22:32:12.363 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00061127900000000005 2024-09-12T22:32:12.363 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.363 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.363 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:12.363 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409403+0000", 2024-09-12T22:32:12.364 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.003573597 2024-09-12T22:32:12.364 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.364 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.364 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:12.364 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418138+0000", 2024-09-12T22:32:12.364 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0087349969999999996 2024-09-12T22:32:12.364 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.364 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.364 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:12.364 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418178+0000", 2024-09-12T22:32:12.364 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0649999999999999e-05 2024-09-12T22:32:12.364 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.365 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.365 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:12.365 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418208+0000", 2024-09-12T22:32:12.365 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9448e-05 2024-09-12T22:32:12.365 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:12.365 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:12.365 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:12.365 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.365 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.365 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:12.365 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.405456+0000", 2024-09-12T22:32:12.365 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 34.857704147, 2024-09-12T22:32:12.365 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012888389, 2024-09-12T22:32:12.365 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:12.366 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:12.366 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:12.366 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:12.366 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.366 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:12.366 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405456+0000", 2024-09-12T22:32:12.366 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:12.366 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.366 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.366 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:12.366 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405456+0000", 2024-09-12T22:32:12.366 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:12.366 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.366 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.367 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:12.367 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405457+0000", 2024-09-12T22:32:12.367 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.6599999999999994e-07 2024-09-12T22:32:12.367 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.367 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.367 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:12.367 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405463+0000", 2024-09-12T22:32:12.367 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4739999999999996e-06 2024-09-12T22:32:12.367 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.367 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.367 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:12.367 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405474+0000", 2024-09-12T22:32:12.368 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1095e-05 2024-09-12T22:32:12.368 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.368 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.368 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:12.368 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405482+0000", 2024-09-12T22:32:12.368 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3610000000000001e-06 2024-09-12T22:32:12.368 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.368 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.368 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:12.368 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407051+0000", 2024-09-12T22:32:12.368 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0015688970000000001 2024-09-12T22:32:12.368 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.368 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.368 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:12.369 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407259+0000", 2024-09-12T22:32:12.369 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00020778300000000001 2024-09-12T22:32:12.369 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.369 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.369 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:12.369 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407622+0000", 2024-09-12T22:32:12.369 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000363066 2024-09-12T22:32:12.369 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.369 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.369 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:12.369 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409438+0000", 2024-09-12T22:32:12.369 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001816319 2024-09-12T22:32:12.370 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.370 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.370 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:12.370 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418257+0000", 2024-09-12T22:32:12.370 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0088187720000000008 2024-09-12T22:32:12.370 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.370 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.370 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:12.370 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418308+0000", 2024-09-12T22:32:12.370 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1180000000000001e-05 2024-09-12T22:32:12.370 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.370 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.370 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:12.371 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418345+0000", 2024-09-12T22:32:12.371 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6476000000000001e-05 2024-09-12T22:32:12.371 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:12.371 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:12.371 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:12.371 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.371 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.371 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:12.371 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.405496+0000", 2024-09-12T22:32:12.371 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 34.857664790000001, 2024-09-12T22:32:12.371 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013016012, 2024-09-12T22:32:12.371 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:12.371 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:12.371 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:12.372 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:12.372 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.372 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:12.372 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405496+0000", 2024-09-12T22:32:12.372 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:12.372 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.372 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.372 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:12.372 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405496+0000", 2024-09-12T22:32:12.372 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:12.372 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.372 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.372 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:12.372 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405496+0000", 2024-09-12T22:32:12.373 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7999999999999995e-07 2024-09-12T22:32:12.373 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.373 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.373 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:12.373 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405501+0000", 2024-09-12T22:32:12.373 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8359999999999999e-06 2024-09-12T22:32:12.373 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.373 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.373 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:12.373 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405514+0000", 2024-09-12T22:32:12.373 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2522e-05 2024-09-12T22:32:12.373 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.373 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.374 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:12.374 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405521+0000", 2024-09-12T22:32:12.374 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5020000000000003e-06 2024-09-12T22:32:12.374 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.374 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.374 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:12.374 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405575+0000", 2024-09-12T22:32:12.374 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4169999999999998e-05 2024-09-12T22:32:12.374 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.374 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.374 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:12.374 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405697+0000", 2024-09-12T22:32:12.374 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000121301 2024-09-12T22:32:12.374 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.375 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.375 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:12.375 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405829+0000", 2024-09-12T22:32:12.375 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000132662 2024-09-12T22:32:12.375 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.375 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.375 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:12.375 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409155+0000", 2024-09-12T22:32:12.375 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0033259050000000001 2024-09-12T22:32:12.375 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.375 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.375 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:12.375 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418425+0000", 2024-09-12T22:32:12.375 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0092696319999999999 2024-09-12T22:32:12.376 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.376 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.376 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:12.376 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418471+0000", 2024-09-12T22:32:12.376 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6213e-05 2024-09-12T22:32:12.376 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.376 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.376 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:12.376 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418512+0000", 2024-09-12T22:32:12.376 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0589000000000001e-05 2024-09-12T22:32:12.376 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:12.376 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:12.376 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:12.377 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.377 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.377 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:12.377 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.406108+0000", 2024-09-12T22:32:12.377 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 34.857052393000004, 2024-09-12T22:32:12.377 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012458175, 2024-09-12T22:32:12.377 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:12.377 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:12.377 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:12.377 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:12.377 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.377 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:12.377 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406108+0000", 2024-09-12T22:32:12.377 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:12.378 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.378 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.378 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:12.378 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406108+0000", 2024-09-12T22:32:12.378 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:12.378 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.378 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.378 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:12.378 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406109+0000", 2024-09-12T22:32:12.378 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9899999999999999e-07 2024-09-12T22:32:12.378 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.378 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.378 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:12.378 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406115+0000", 2024-09-12T22:32:12.379 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9030000000000001e-06 2024-09-12T22:32:12.379 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.379 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.379 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:12.379 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406141+0000", 2024-09-12T22:32:12.379 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5999e-05 2024-09-12T22:32:12.379 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.379 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.379 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:12.379 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406150+0000", 2024-09-12T22:32:12.379 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.6050000000000004e-06 2024-09-12T22:32:12.379 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.379 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.379 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:12.380 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408163+0000", 2024-09-12T22:32:12.380 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0020122769999999998 2024-09-12T22:32:12.380 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.380 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.380 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:12.380 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408309+0000", 2024-09-12T22:32:12.380 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014606999999999999 2024-09-12T22:32:12.380 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.380 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.380 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:12.380 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408433+0000", 2024-09-12T22:32:12.380 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012460300000000001 2024-09-12T22:32:12.380 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.381 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.381 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:12.381 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409903+0000", 2024-09-12T22:32:12.381 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001469499 2024-09-12T22:32:12.381 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.381 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.381 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:12.381 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418427+0000", 2024-09-12T22:32:12.381 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0085241139999999993 2024-09-12T22:32:12.381 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.381 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.381 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:12.381 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418471+0000", 2024-09-12T22:32:12.381 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4474000000000001e-05 2024-09-12T22:32:12.381 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.382 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.382 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:12.382 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418566+0000", 2024-09-12T22:32:12.382 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.4732e-05 2024-09-12T22:32:12.382 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:12.382 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:12.382 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:12.382 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.382 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.382 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:12.382 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.407266+0000", 2024-09-12T22:32:12.382 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 34.855894536999998, 2024-09-12T22:32:12.382 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011442905, 2024-09-12T22:32:12.382 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:12.383 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:12.383 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2024-09-12T22:32:12.383 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:12.383 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.383 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:12.383 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407266+0000", 2024-09-12T22:32:12.383 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:12.383 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.383 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.383 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:12.383 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407266+0000", 2024-09-12T22:32:12.383 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:12.383 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.383 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.384 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:12.384 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407266+0000", 2024-09-12T22:32:12.384 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7899999999999998e-07 2024-09-12T22:32:12.384 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.384 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.384 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:12.384 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407269+0000", 2024-09-12T22:32:12.384 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9210000000000001e-06 2024-09-12T22:32:12.384 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.384 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.384 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:12.384 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407331+0000", 2024-09-12T22:32:12.384 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1376000000000003e-05 2024-09-12T22:32:12.385 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.385 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.385 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:12.385 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407337+0000", 2024-09-12T22:32:12.385 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1929999999999998e-06 2024-09-12T22:32:12.385 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.385 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.385 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:12.385 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408974+0000", 2024-09-12T22:32:12.385 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0016367109999999999 2024-09-12T22:32:12.385 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.385 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.385 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:12.385 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409112+0000", 2024-09-12T22:32:12.386 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000137952 2024-09-12T22:32:12.386 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:12.386 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:12.386 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:12.386 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418709+0000", 2024-09-12T22:32:12.386 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0095971730000000005 2024-09-12T22:32:12.386 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:12.386 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:12.386 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:12.386 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:12.386 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:12.386 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-09-12T22:32:12.388 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:32:12.388 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:12.387+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:12.489 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:12.488+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:12.508 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-09-12T22:32:12.508 INFO:teuthology.orchestra.run.smithi076.stdout: "ops": [], 2024-09-12T22:32:12.508 INFO:teuthology.orchestra.run.smithi076.stdout: "num_ops": 0 2024-09-12T22:32:12.508 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-09-12T22:32:12.518 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:32:12.590 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:32:12.589+0000 7fddec6a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30331) UID: 0 2024-09-12T22:32:12.623 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-09-12T22:32:12.623 INFO:teuthology.orchestra.run.smithi076.stdout: "ops": [], 2024-09-12T22:32:12.623 INFO:teuthology.orchestra.run.smithi076.stdout: "complaint_time": 30, 2024-09-12T22:32:12.623 INFO:teuthology.orchestra.run.smithi076.stdout: "num_blocked_ops": 0 2024-09-12T22:32:12.624 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-09-12T22:32:12.632 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:32:12.691 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:12.690+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:12.776 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-09-12T22:32:12.777 INFO:teuthology.orchestra.run.smithi076.stdout: "size": 20, 2024-09-12T22:32:12.777 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 600, 2024-09-12T22:32:12.777 INFO:teuthology.orchestra.run.smithi076.stdout: "ops": [ 2024-09-12T22:32:12.777 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.777 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:12.777 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.400604+0000", 2024-09-12T22:32:12.777 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 35.374002521000001, 2024-09-12T22:32:12.777 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.017278814, 2024-09-12T22:32:12.777 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:12.777 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:12.777 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:12.777 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:12.778 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.778 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:12.778 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400604+0000", 2024-09-12T22:32:12.778 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:12.778 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.778 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.778 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:12.778 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400604+0000", 2024-09-12T22:32:12.778 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:12.778 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.778 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.778 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:12.778 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400617+0000", 2024-09-12T22:32:12.779 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.3076e-05 2024-09-12T22:32:12.779 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.779 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.779 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:12.779 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400623+0000", 2024-09-12T22:32:12.779 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.5780000000000004e-06 2024-09-12T22:32:12.779 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.779 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.779 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:12.779 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400641+0000", 2024-09-12T22:32:12.779 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.8218000000000001e-05 2024-09-12T22:32:12.779 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.779 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.779 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:12.780 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400652+0000", 2024-09-12T22:32:12.780 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.0421999999999999e-05 2024-09-12T22:32:12.780 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.780 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.780 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:12.780 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400707+0000", 2024-09-12T22:32:12.780 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.4666000000000001e-05 2024-09-12T22:32:12.780 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.780 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.780 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op must wait for map", 2024-09-12T22:32:12.780 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400711+0000", 2024-09-12T22:32:12.780 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.5340000000000001e-06 2024-09-12T22:32:12.780 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.781 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.781 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:12.781 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.412066+0000", 2024-09-12T22:32:12.781 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.011354797999999999 2024-09-12T22:32:12.781 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.781 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.781 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:12.781 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.412672+0000", 2024-09-12T22:32:12.781 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00060620499999999996 2024-09-12T22:32:12.781 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.781 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.781 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:12.781 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.413032+0000", 2024-09-12T22:32:12.782 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00035955999999999998 2024-09-12T22:32:12.782 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.782 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.782 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op_commit", 2024-09-12T22:32:12.782 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417252+0000", 2024-09-12T22:32:12.782 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.004219899 2024-09-12T22:32:12.782 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.782 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.782 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:12.782 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417812+0000", 2024-09-12T22:32:12.782 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.000560182 2024-09-12T22:32:12.782 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.782 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.783 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:12.783 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417851+0000", 2024-09-12T22:32:12.783 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.9057999999999998e-05 2024-09-12T22:32:12.783 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.783 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.783 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:12.783 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417882+0000", 2024-09-12T22:32:12.783 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.1618000000000001e-05 2024-09-12T22:32:12.783 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:12.783 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:12.783 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:12.783 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.783 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.783 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:12.784 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.400674+0000", 2024-09-12T22:32:12.784 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 35.373931802999998, 2024-09-12T22:32:12.784 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.017348971000000001, 2024-09-12T22:32:12.784 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:12.784 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:12.784 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:12.784 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:12.784 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.784 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:12.784 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400674+0000", 2024-09-12T22:32:12.784 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:12.784 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.784 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.785 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:12.785 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400674+0000", 2024-09-12T22:32:12.785 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:12.785 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.785 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.785 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:12.785 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400675+0000", 2024-09-12T22:32:12.785 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.37e-07 2024-09-12T22:32:12.785 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.785 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.785 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:12.785 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400678+0000", 2024-09-12T22:32:12.786 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.303e-06 2024-09-12T22:32:12.786 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.786 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.786 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:12.786 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400684+0000", 2024-09-12T22:32:12.786 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.0290000000000002e-06 2024-09-12T22:32:12.786 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.786 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.786 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:12.786 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400688+0000", 2024-09-12T22:32:12.786 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.0890000000000002e-06 2024-09-12T22:32:12.786 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.786 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.786 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:12.787 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400806+0000", 2024-09-12T22:32:12.787 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00011814700000000001 2024-09-12T22:32:12.787 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.787 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.787 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:32:12.787 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400811+0000", 2024-09-12T22:32:12.787 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.0479999999999998e-06 2024-09-12T22:32:12.787 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.787 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.787 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:12.787 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.413877+0000", 2024-09-12T22:32:12.787 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.013065561 2024-09-12T22:32:12.787 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.788 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.788 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:12.788 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.413984+0000", 2024-09-12T22:32:12.788 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.000106566 2024-09-12T22:32:12.788 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.788 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.788 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:12.788 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.414264+0000", 2024-09-12T22:32:12.788 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00028067199999999999 2024-09-12T22:32:12.788 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.788 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.788 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op_commit", 2024-09-12T22:32:12.788 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417614+0000", 2024-09-12T22:32:12.789 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0033500729999999999 2024-09-12T22:32:12.789 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.789 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.789 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:12.789 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417946+0000", 2024-09-12T22:32:12.789 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00033209199999999998 2024-09-12T22:32:12.789 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.789 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.789 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:12.789 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417995+0000", 2024-09-12T22:32:12.789 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.808e-05 2024-09-12T22:32:12.789 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.789 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.790 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:12.790 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.418023+0000", 2024-09-12T22:32:12.790 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.8773999999999999e-05 2024-09-12T22:32:12.790 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:12.790 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:12.790 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:12.790 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.790 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.790 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:12.790 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.400694+0000", 2024-09-12T22:32:12.790 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 35.373912173999997, 2024-09-12T22:32:12.790 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.022845628, 2024-09-12T22:32:12.790 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:12.791 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:12.791 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:12.791 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:12.791 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.791 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:12.791 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400694+0000", 2024-09-12T22:32:12.791 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:12.791 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.791 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.791 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:12.791 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400694+0000", 2024-09-12T22:32:12.791 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:12.791 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.792 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.792 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:12.792 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400694+0000", 2024-09-12T22:32:12.792 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.48e-07 2024-09-12T22:32:12.792 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.792 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.792 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:12.792 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400709+0000", 2024-09-12T22:32:12.792 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.4888999999999999e-05 2024-09-12T22:32:12.792 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.792 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.792 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:12.792 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400722+0000", 2024-09-12T22:32:12.793 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.2882e-05 2024-09-12T22:32:12.793 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.793 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.793 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:12.793 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400732+0000", 2024-09-12T22:32:12.793 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.0299000000000001e-05 2024-09-12T22:32:12.793 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.793 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.793 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:12.793 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400793+0000", 2024-09-12T22:32:12.793 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.0253000000000001e-05 2024-09-12T22:32:12.793 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.793 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.794 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op must wait for map", 2024-09-12T22:32:12.794 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400798+0000", 2024-09-12T22:32:12.794 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.1569999999999999e-06 2024-09-12T22:32:12.794 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.794 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.794 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:12.794 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415059+0000", 2024-09-12T22:32:12.794 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.014260907 2024-09-12T22:32:12.794 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.794 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.794 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:12.794 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415396+0000", 2024-09-12T22:32:12.794 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00033720799999999997 2024-09-12T22:32:12.794 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.795 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.795 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:12.795 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415685+0000", 2024-09-12T22:32:12.795 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00028939900000000003 2024-09-12T22:32:12.795 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.795 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.795 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op_commit", 2024-09-12T22:32:12.795 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.418302+0000", 2024-09-12T22:32:12.795 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0026168039999999999 2024-09-12T22:32:12.795 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.795 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.795 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:12.795 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.423445+0000", 2024-09-12T22:32:12.796 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0051428150000000002 2024-09-12T22:32:12.796 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.796 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.796 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:12.796 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.423499+0000", 2024-09-12T22:32:12.796 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.3953000000000003e-05 2024-09-12T22:32:12.796 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.796 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.796 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:12.796 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.423540+0000", 2024-09-12T22:32:12.796 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.0813999999999999e-05 2024-09-12T22:32:12.796 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:12.796 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:12.796 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:12.797 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.797 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.797 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:12.797 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.400740+0000", 2024-09-12T22:32:12.797 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 35.373866450999998, 2024-09-12T22:32:12.797 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.022927528999999999, 2024-09-12T22:32:12.797 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:12.797 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:12.797 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:12.797 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:12.798 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.798 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:12.798 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400740+0000", 2024-09-12T22:32:12.798 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:12.798 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.798 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.798 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:12.798 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400740+0000", 2024-09-12T22:32:12.798 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:12.798 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.798 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.798 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:12.798 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400740+0000", 2024-09-12T22:32:12.799 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.3000000000000001e-07 2024-09-12T22:32:12.799 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.799 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.799 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:12.799 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400743+0000", 2024-09-12T22:32:12.799 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.5840000000000002e-06 2024-09-12T22:32:12.799 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.799 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.799 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:12.799 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400757+0000", 2024-09-12T22:32:12.799 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.3988999999999999e-05 2024-09-12T22:32:12.799 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.799 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.800 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:12.800 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400763+0000", 2024-09-12T22:32:12.800 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.686e-06 2024-09-12T22:32:12.800 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.800 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.800 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:12.800 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400818+0000", 2024-09-12T22:32:12.800 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.4941000000000001e-05 2024-09-12T22:32:12.800 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.800 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.800 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:32:12.800 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400824+0000", 2024-09-12T22:32:12.800 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.4600000000000002e-06 2024-09-12T22:32:12.801 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.801 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.801 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:12.801 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416227+0000", 2024-09-12T22:32:12.801 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.015403604 2024-09-12T22:32:12.801 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.801 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.801 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:12.801 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416306+0000", 2024-09-12T22:32:12.801 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 7.9126000000000001e-05 2024-09-12T22:32:12.801 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.801 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.801 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:12.801 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416678+0000", 2024-09-12T22:32:12.802 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00037105500000000002 2024-09-12T22:32:12.802 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.802 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.802 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op_commit", 2024-09-12T22:32:12.802 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.418363+0000", 2024-09-12T22:32:12.802 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.001685095 2024-09-12T22:32:12.802 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.802 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.802 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:12.802 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.423591+0000", 2024-09-12T22:32:12.802 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0052283980000000004 2024-09-12T22:32:12.802 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.802 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.803 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:12.803 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.423624+0000", 2024-09-12T22:32:12.803 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.3024000000000001e-05 2024-09-12T22:32:12.803 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.803 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.803 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:12.803 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.423667+0000", 2024-09-12T22:32:12.803 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.3136999999999997e-05 2024-09-12T22:32:12.803 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:12.803 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:12.803 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:12.803 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.803 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.803 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:12.804 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.400783+0000", 2024-09-12T22:32:12.804 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 35.373822918999998, 2024-09-12T22:32:12.804 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.016563729999999999, 2024-09-12T22:32:12.804 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:12.804 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:12.804 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:12.804 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:12.804 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.804 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:12.804 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400783+0000", 2024-09-12T22:32:12.804 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:12.804 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.804 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.804 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:12.805 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400783+0000", 2024-09-12T22:32:12.805 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:12.805 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.805 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.805 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:12.805 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400784+0000", 2024-09-12T22:32:12.805 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.5900000000000002e-07 2024-09-12T22:32:12.805 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.805 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.805 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:12.805 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400787+0000", 2024-09-12T22:32:12.805 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.1690000000000001e-06 2024-09-12T22:32:12.805 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.806 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.806 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:12.806 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400794+0000", 2024-09-12T22:32:12.806 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 7.058e-06 2024-09-12T22:32:12.806 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.806 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.806 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:12.806 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400798+0000", 2024-09-12T22:32:12.806 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.335e-06 2024-09-12T22:32:12.806 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.806 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.806 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:12.806 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400841+0000", 2024-09-12T22:32:12.807 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.2369e-05 2024-09-12T22:32:12.807 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.807 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.807 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op must wait for map", 2024-09-12T22:32:12.807 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400844+0000", 2024-09-12T22:32:12.807 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.128e-06 2024-09-12T22:32:12.807 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.807 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.807 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:12.807 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.410479+0000", 2024-09-12T22:32:12.807 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0096354189999999992 2024-09-12T22:32:12.807 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.807 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.807 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:12.808 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.410597+0000", 2024-09-12T22:32:12.808 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.000118305 2024-09-12T22:32:12.808 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.808 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.808 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:12.808 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.410838+0000", 2024-09-12T22:32:12.808 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.000240967 2024-09-12T22:32:12.808 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.808 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.808 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op_commit", 2024-09-12T22:32:12.808 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416489+0000", 2024-09-12T22:32:12.808 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0056507989999999998 2024-09-12T22:32:12.808 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.809 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.809 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:12.809 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417255+0000", 2024-09-12T22:32:12.809 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00076626199999999998 2024-09-12T22:32:12.809 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.809 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.809 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:12.809 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417306+0000", 2024-09-12T22:32:12.809 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.0319999999999999e-05 2024-09-12T22:32:12.809 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.809 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.809 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:12.809 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417347+0000", 2024-09-12T22:32:12.810 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.1140000000000003e-05 2024-09-12T22:32:12.810 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:12.810 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:12.810 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:12.810 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.810 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.810 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:12.810 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.400811+0000", 2024-09-12T22:32:12.810 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 35.373794850000003, 2024-09-12T22:32:12.810 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.017061263, 2024-09-12T22:32:12.810 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:12.810 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:12.810 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:12.811 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:12.811 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.811 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:12.811 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400811+0000", 2024-09-12T22:32:12.811 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:12.811 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.811 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.811 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:12.811 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400811+0000", 2024-09-12T22:32:12.811 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:12.811 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.811 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.811 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:12.812 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400812+0000", 2024-09-12T22:32:12.812 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.27e-07 2024-09-12T22:32:12.812 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.812 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.812 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:12.812 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400814+0000", 2024-09-12T22:32:12.812 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.553e-06 2024-09-12T22:32:12.812 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.812 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.812 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:12.812 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400819+0000", 2024-09-12T22:32:12.812 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.3569999999999997e-06 2024-09-12T22:32:12.812 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.813 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.813 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:12.813 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400824+0000", 2024-09-12T22:32:12.813 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.6820000000000002e-06 2024-09-12T22:32:12.813 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.813 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.813 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:12.813 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400871+0000", 2024-09-12T22:32:12.813 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.7311000000000002e-05 2024-09-12T22:32:12.813 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.813 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.813 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:32:12.813 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400875+0000", 2024-09-12T22:32:12.813 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.0960000000000001e-06 2024-09-12T22:32:12.814 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.814 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.814 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:12.814 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.412071+0000", 2024-09-12T22:32:12.814 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.011195999999999999 2024-09-12T22:32:12.814 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.814 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.814 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:12.814 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.412520+0000", 2024-09-12T22:32:12.814 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.000449522 2024-09-12T22:32:12.814 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.814 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.814 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:12.815 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.412655+0000", 2024-09-12T22:32:12.815 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00013487899999999999 2024-09-12T22:32:12.815 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.815 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.815 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op_commit", 2024-09-12T22:32:12.815 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417096+0000", 2024-09-12T22:32:12.815 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.004441113 2024-09-12T22:32:12.815 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.815 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.815 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:12.815 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417768+0000", 2024-09-12T22:32:12.815 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00067161100000000002 2024-09-12T22:32:12.815 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.816 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.816 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:12.816 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417834+0000", 2024-09-12T22:32:12.816 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.6058999999999999e-05 2024-09-12T22:32:12.816 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.816 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.816 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:12.816 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417873+0000", 2024-09-12T22:32:12.816 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.8753e-05 2024-09-12T22:32:12.816 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:12.816 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:12.816 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:12.816 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.817 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.817 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:12.817 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.400842+0000", 2024-09-12T22:32:12.817 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 35.373764143000002, 2024-09-12T22:32:12.817 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.022846262999999999, 2024-09-12T22:32:12.817 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:12.817 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:12.817 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:12.817 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:12.817 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.817 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:12.817 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400842+0000", 2024-09-12T22:32:12.817 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:12.818 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.818 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.818 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:12.818 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400842+0000", 2024-09-12T22:32:12.818 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:12.818 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.818 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.818 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:12.818 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400842+0000", 2024-09-12T22:32:12.818 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.9900000000000002e-07 2024-09-12T22:32:12.818 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.818 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.818 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:12.819 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400845+0000", 2024-09-12T22:32:12.819 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.8609999999999998e-06 2024-09-12T22:32:12.819 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.819 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.819 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:12.819 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400850+0000", 2024-09-12T22:32:12.819 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.634e-06 2024-09-12T22:32:12.819 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.819 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.819 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:12.819 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400855+0000", 2024-09-12T22:32:12.819 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.8339999999999998e-06 2024-09-12T22:32:12.819 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.820 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.820 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:12.820 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400886+0000", 2024-09-12T22:32:12.820 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.1393999999999998e-05 2024-09-12T22:32:12.820 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.820 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.820 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:32:12.820 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400888+0000", 2024-09-12T22:32:12.820 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.3470000000000001e-06 2024-09-12T22:32:12.820 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.820 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.820 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:12.821 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415640+0000", 2024-09-12T22:32:12.821 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.014751965000000001 2024-09-12T22:32:12.821 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.821 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.821 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:12.821 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415821+0000", 2024-09-12T22:32:12.821 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00018064399999999999 2024-09-12T22:32:12.821 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.821 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.821 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:12.821 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415949+0000", 2024-09-12T22:32:12.821 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00012816699999999999 2024-09-12T22:32:12.821 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.822 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.822 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op_commit", 2024-09-12T22:32:12.822 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.418337+0000", 2024-09-12T22:32:12.822 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0023878469999999998 2024-09-12T22:32:12.822 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.822 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.822 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:12.822 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.423588+0000", 2024-09-12T22:32:12.822 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0052509849999999997 2024-09-12T22:32:12.822 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.822 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.822 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:12.822 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.423650+0000", 2024-09-12T22:32:12.822 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.2026999999999994e-05 2024-09-12T22:32:12.823 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.823 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.823 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:12.823 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.423688+0000", 2024-09-12T22:32:12.823 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.8259000000000001e-05 2024-09-12T22:32:12.823 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:12.823 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:12.823 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:12.823 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.823 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.823 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:12.823 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.400862+0000", 2024-09-12T22:32:12.823 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 35.373744168999998, 2024-09-12T22:32:12.823 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.016404294, 2024-09-12T22:32:12.824 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:12.824 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:12.824 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "started", 2024-09-12T22:32:12.824 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:12.824 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.824 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:12.824 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400862+0000", 2024-09-12T22:32:12.824 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:12.824 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.824 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.824 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:12.824 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400862+0000", 2024-09-12T22:32:12.824 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:12.824 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.825 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.825 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:12.825 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400862+0000", 2024-09-12T22:32:12.825 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.8099999999999999e-07 2024-09-12T22:32:12.825 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.825 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.825 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:12.825 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400870+0000", 2024-09-12T22:32:12.825 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 8.1349999999999992e-06 2024-09-12T22:32:12.825 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.825 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.825 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:12.825 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400876+0000", 2024-09-12T22:32:12.825 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.2039999999999996e-06 2024-09-12T22:32:12.826 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.826 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.826 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:12.826 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400879+0000", 2024-09-12T22:32:12.826 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.529e-06 2024-09-12T22:32:12.826 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.826 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.826 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:12.826 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400912+0000", 2024-09-12T22:32:12.826 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.2653000000000001e-05 2024-09-12T22:32:12.826 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.826 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.826 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op must wait for map", 2024-09-12T22:32:12.827 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400915+0000", 2024-09-12T22:32:12.827 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.1099999999999999e-06 2024-09-12T22:32:12.827 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.827 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.827 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:12.827 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408727+0000", 2024-09-12T22:32:12.827 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0078123869999999996 2024-09-12T22:32:12.827 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.827 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.827 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:12.827 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408838+0000", 2024-09-12T22:32:12.827 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00011042700000000001 2024-09-12T22:32:12.827 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.828 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.828 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:12.828 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417266+0000", 2024-09-12T22:32:12.828 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0084285680000000009 2024-09-12T22:32:12.828 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:12.828 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:12.828 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:12.828 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.828 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.828 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:12.828 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.400889+0000", 2024-09-12T22:32:12.828 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 35.373716915999999, 2024-09-12T22:32:12.828 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.014929550999999999, 2024-09-12T22:32:12.829 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:12.829 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:12.829 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "started", 2024-09-12T22:32:12.829 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:12.829 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.829 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:12.829 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400889+0000", 2024-09-12T22:32:12.829 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:12.829 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.829 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.829 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:12.829 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400889+0000", 2024-09-12T22:32:12.829 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:12.830 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.830 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.830 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:12.830 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400890+0000", 2024-09-12T22:32:12.830 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.8699999999999995e-07 2024-09-12T22:32:12.830 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.830 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.830 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:12.830 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400893+0000", 2024-09-12T22:32:12.830 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.9569999999999998e-06 2024-09-12T22:32:12.830 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.830 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.830 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:12.831 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400899+0000", 2024-09-12T22:32:12.831 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.4189999999999999e-06 2024-09-12T22:32:12.831 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.831 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.831 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:12.831 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400905+0000", 2024-09-12T22:32:12.831 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.7880000000000003e-06 2024-09-12T22:32:12.831 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.831 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.831 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:12.831 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400943+0000", 2024-09-12T22:32:12.831 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.7852999999999998e-05 2024-09-12T22:32:12.831 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.832 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.832 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op must wait for map", 2024-09-12T22:32:12.832 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400945+0000", 2024-09-12T22:32:12.832 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.627e-06 2024-09-12T22:32:12.832 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.832 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.832 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:12.832 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408398+0000", 2024-09-12T22:32:12.832 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0074525879999999996 2024-09-12T22:32:12.832 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.832 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.832 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:12.832 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408581+0000", 2024-09-12T22:32:12.832 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00018321900000000001 2024-09-12T22:32:12.833 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.833 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.833 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:12.833 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415819+0000", 2024-09-12T22:32:12.833 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0072376130000000004 2024-09-12T22:32:12.833 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:12.833 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:12.833 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:12.833 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.833 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.833 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:25 3.7 e19/17 3:e0b41d06:::609.00000000:head v 19'2, mlcod=0'0)", 2024-09-12T22:32:12.833 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.402511+0000", 2024-09-12T22:32:12.833 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 35.372094773000001, 2024-09-12T22:32:12.834 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0089735260000000008, 2024-09-12T22:32:12.834 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:12.834 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:12.834 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:12.834 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:12.834 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.834 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:12.834 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.402511+0000", 2024-09-12T22:32:12.834 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:12.834 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.834 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.834 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:12.834 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.402511+0000", 2024-09-12T22:32:12.835 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:12.835 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.835 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.835 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:12.835 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.402512+0000", 2024-09-12T22:32:12.835 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 8.71e-07 2024-09-12T22:32:12.835 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.835 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.835 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:12.835 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.402520+0000", 2024-09-12T22:32:12.835 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 7.8529999999999992e-06 2024-09-12T22:32:12.835 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.835 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.835 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:12.836 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.402530+0000", 2024-09-12T22:32:12.836 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 9.859e-06 2024-09-12T22:32:12.836 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.836 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.836 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:12.836 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.402555+0000", 2024-09-12T22:32:12.836 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.4822000000000001e-05 2024-09-12T22:32:12.836 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.836 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.836 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:12.836 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.403173+0000", 2024-09-12T22:32:12.836 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00061813199999999997 2024-09-12T22:32:12.836 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.837 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.837 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:12.837 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.403195+0000", 2024-09-12T22:32:12.837 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.2286e-05 2024-09-12T22:32:12.837 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.837 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.837 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:12.837 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.411436+0000", 2024-09-12T22:32:12.837 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0082410539999999994 2024-09-12T22:32:12.837 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.837 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.837 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:12.837 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.411485+0000", 2024-09-12T22:32:12.838 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.8649000000000001e-05 2024-09-12T22:32:12.838 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:12.838 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:12.838 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:12.838 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.838 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.838 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:18 3.14 e19/17 3:2f55791f:::606.00000000:head v 19'1, mlcod=0'0)", 2024-09-12T22:32:12.838 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.406646+0000", 2024-09-12T22:32:12.838 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 35.367959620999997, 2024-09-12T22:32:12.838 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0082036980000000006, 2024-09-12T22:32:12.838 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:12.838 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:12.838 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:12.838 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:12.839 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.839 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:12.839 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406646+0000", 2024-09-12T22:32:12.839 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:12.839 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.839 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.839 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:12.839 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406646+0000", 2024-09-12T22:32:12.839 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:12.839 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.839 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.839 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:12.839 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406647+0000", 2024-09-12T22:32:12.840 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.4499999999999998e-07 2024-09-12T22:32:12.840 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.840 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.840 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:12.840 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406651+0000", 2024-09-12T22:32:12.840 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.0300000000000004e-06 2024-09-12T22:32:12.840 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.840 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.840 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:12.840 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406657+0000", 2024-09-12T22:32:12.840 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.1330000000000004e-06 2024-09-12T22:32:12.840 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.840 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.841 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:12.841 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406665+0000", 2024-09-12T22:32:12.841 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 8.3650000000000004e-06 2024-09-12T22:32:12.841 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.841 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.841 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:12.841 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406804+0000", 2024-09-12T22:32:12.841 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00013900699999999999 2024-09-12T22:32:12.841 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.841 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.841 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:12.841 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406833+0000", 2024-09-12T22:32:12.841 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.8243e-05 2024-09-12T22:32:12.841 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.842 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.842 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:12.842 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.414741+0000", 2024-09-12T22:32:12.842 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0079089620000000003 2024-09-12T22:32:12.842 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.842 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.842 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:12.842 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.414850+0000", 2024-09-12T22:32:12.842 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.000108713 2024-09-12T22:32:12.842 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:12.842 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:12.842 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:12.842 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.842 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.843 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:6 3.10 e19/17 3:0d82a743:::600.00000000:head v 19'1, mlcod=0'0)", 2024-09-12T22:32:12.843 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.406692+0000", 2024-09-12T22:32:12.843 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 35.367913854000001, 2024-09-12T22:32:12.843 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0093004430000000003, 2024-09-12T22:32:12.843 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:12.843 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:12.843 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:12.843 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:12.843 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.843 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:12.843 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406692+0000", 2024-09-12T22:32:12.843 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:12.843 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.844 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.844 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:12.844 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406692+0000", 2024-09-12T22:32:12.844 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:12.844 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.844 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.844 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:12.844 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406693+0000", 2024-09-12T22:32:12.844 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.6300000000000001e-07 2024-09-12T22:32:12.844 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.844 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.844 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:12.844 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406702+0000", 2024-09-12T22:32:12.845 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 9.5589999999999994e-06 2024-09-12T22:32:12.845 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.845 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.845 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:12.845 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406725+0000", 2024-09-12T22:32:12.845 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.2977999999999999e-05 2024-09-12T22:32:12.845 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.845 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.845 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:12.845 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406732+0000", 2024-09-12T22:32:12.845 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.8430000000000004e-06 2024-09-12T22:32:12.845 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.846 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.846 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:12.846 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406979+0000", 2024-09-12T22:32:12.846 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00024729199999999998 2024-09-12T22:32:12.846 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.846 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.846 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:12.846 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407000+0000", 2024-09-12T22:32:12.846 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.0573000000000001e-05 2024-09-12T22:32:12.846 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.846 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.846 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:12.846 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415928+0000", 2024-09-12T22:32:12.846 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0089286179999999993 2024-09-12T22:32:12.847 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.847 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.847 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:12.847 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415993+0000", 2024-09-12T22:32:12.847 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.4216999999999999e-05 2024-09-12T22:32:12.847 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:12.847 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:12.847 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:12.848 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.848 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.848 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:2 3.f e19/17 3:f1f69726:::400.00000000:head v 19'1, mlcod=0'0)", 2024-09-12T22:32:12.848 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.406942+0000", 2024-09-12T22:32:12.848 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 35.367664167000001, 2024-09-12T22:32:12.848 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0098433259999999995, 2024-09-12T22:32:12.848 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:12.848 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:12.848 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:12.848 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:12.848 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.848 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:12.848 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406942+0000", 2024-09-12T22:32:12.849 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:12.849 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.849 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.849 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:12.849 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406942+0000", 2024-09-12T22:32:12.849 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:12.849 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.849 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.849 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:12.849 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406943+0000", 2024-09-12T22:32:12.849 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.8800000000000002e-07 2024-09-12T22:32:12.849 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.849 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.850 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:12.850 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406949+0000", 2024-09-12T22:32:12.850 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.5869999999999998e-06 2024-09-12T22:32:12.850 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.850 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.850 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:12.850 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406960+0000", 2024-09-12T22:32:12.850 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.0873000000000001e-05 2024-09-12T22:32:12.850 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.850 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.850 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:12.850 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406970+0000", 2024-09-12T22:32:12.850 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 9.9119999999999993e-06 2024-09-12T22:32:12.851 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.851 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.851 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:12.851 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407535+0000", 2024-09-12T22:32:12.851 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00056508899999999996 2024-09-12T22:32:12.851 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.851 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.851 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:12.851 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407556+0000", 2024-09-12T22:32:12.851 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.1348999999999998e-05 2024-09-12T22:32:12.851 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.851 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.851 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:12.852 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416751+0000", 2024-09-12T22:32:12.852 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0091950109999999995 2024-09-12T22:32:12.852 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.852 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.852 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:12.852 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416785+0000", 2024-09-12T22:32:12.852 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.3917000000000001e-05 2024-09-12T22:32:12.852 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:12.852 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:12.852 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:12.852 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.852 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.852 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:19 3.14 e19/17 3:2f55791f:::606.00000000:head v 19'2, mlcod=0'0)", 2024-09-12T22:32:12.853 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.406983+0000", 2024-09-12T22:32:12.853 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 35.367623188000003, 2024-09-12T22:32:12.853 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0080362149999999993, 2024-09-12T22:32:12.853 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:12.853 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:12.853 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:12.853 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:12.853 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.853 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:12.853 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406983+0000", 2024-09-12T22:32:12.853 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:12.853 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.853 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.853 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:12.854 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406983+0000", 2024-09-12T22:32:12.854 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:12.854 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.854 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.854 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:12.854 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406983+0000", 2024-09-12T22:32:12.854 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.8200000000000001e-07 2024-09-12T22:32:12.854 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.854 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.854 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:12.854 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406999+0000", 2024-09-12T22:32:12.854 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.5747999999999999e-05 2024-09-12T22:32:12.854 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.855 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.855 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:12.855 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407006+0000", 2024-09-12T22:32:12.855 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 7.2609999999999996e-06 2024-09-12T22:32:12.855 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.855 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.855 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:12.855 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407035+0000", 2024-09-12T22:32:12.855 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.8214000000000001e-05 2024-09-12T22:32:12.855 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.855 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.855 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:12.855 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407092+0000", 2024-09-12T22:32:12.856 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.7027000000000001e-05 2024-09-12T22:32:12.856 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.856 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.856 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:12.856 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407126+0000", 2024-09-12T22:32:12.856 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.4082000000000003e-05 2024-09-12T22:32:12.856 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.856 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.856 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:12.856 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.414985+0000", 2024-09-12T22:32:12.856 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0078597319999999995 2024-09-12T22:32:12.856 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.856 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.857 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:12.857 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415019+0000", 2024-09-12T22:32:12.857 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.3769000000000001e-05 2024-09-12T22:32:12.857 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:12.857 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:12.857 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:12.857 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.857 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.857 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:7 3.10 e19/17 3:0d82a743:::600.00000000:head v 19'2, mlcod=0'0)", 2024-09-12T22:32:12.857 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.407048+0000", 2024-09-12T22:32:12.857 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 35.367557650000002, 2024-09-12T22:32:12.857 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.008979931, 2024-09-12T22:32:12.857 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:12.858 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:12.858 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:12.858 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:12.858 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.858 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:12.858 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407048+0000", 2024-09-12T22:32:12.858 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:12.858 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.858 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.858 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:12.858 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407048+0000", 2024-09-12T22:32:12.858 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:12.858 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.858 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.859 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:12.859 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407049+0000", 2024-09-12T22:32:12.859 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.9099999999999999e-07 2024-09-12T22:32:12.859 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.859 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.859 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:12.859 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407054+0000", 2024-09-12T22:32:12.859 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.1850000000000003e-06 2024-09-12T22:32:12.859 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.859 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.859 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:12.859 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407061+0000", 2024-09-12T22:32:12.859 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 7.0809999999999996e-06 2024-09-12T22:32:12.860 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.860 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.860 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:12.860 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407067+0000", 2024-09-12T22:32:12.860 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.9540000000000001e-06 2024-09-12T22:32:12.860 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.860 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.860 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:12.860 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407299+0000", 2024-09-12T22:32:12.860 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.000232122 2024-09-12T22:32:12.860 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.860 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.860 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:12.860 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407317+0000", 2024-09-12T22:32:12.861 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.7447000000000001e-05 2024-09-12T22:32:12.861 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.861 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.861 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:12.861 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415996+0000", 2024-09-12T22:32:12.861 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0086791799999999999 2024-09-12T22:32:12.861 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.861 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.861 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:12.861 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416028+0000", 2024-09-12T22:32:12.861 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.2570999999999997e-05 2024-09-12T22:32:12.861 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:12.861 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:12.862 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:12.862 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.862 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.862 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:8 3.10 e19/17 3:09401a81:::601.00000000:head v 19'3, mlcod=0'0)", 2024-09-12T22:32:12.862 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.407081+0000", 2024-09-12T22:32:12.862 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 35.367524959999997, 2024-09-12T22:32:12.862 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0089807270000000008, 2024-09-12T22:32:12.862 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:12.862 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:12.862 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:12.862 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:12.862 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.862 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:12.863 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407081+0000", 2024-09-12T22:32:12.863 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:12.863 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.863 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.863 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:12.863 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407081+0000", 2024-09-12T22:32:12.863 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:12.863 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.863 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.863 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:12.863 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407082+0000", 2024-09-12T22:32:12.863 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.7899999999999999e-07 2024-09-12T22:32:12.863 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.863 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.864 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:12.864 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407086+0000", 2024-09-12T22:32:12.864 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.7679999999999999e-06 2024-09-12T22:32:12.864 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.864 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.864 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:12.864 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407094+0000", 2024-09-12T22:32:12.864 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 8.1470000000000001e-06 2024-09-12T22:32:12.864 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.864 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.864 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:12.864 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407100+0000", 2024-09-12T22:32:12.864 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.4539999999999998e-06 2024-09-12T22:32:12.865 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.865 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.865 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:12.865 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407540+0000", 2024-09-12T22:32:12.865 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00043973699999999999 2024-09-12T22:32:12.865 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.865 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.865 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:12.865 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407553+0000", 2024-09-12T22:32:12.865 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.3368e-05 2024-09-12T22:32:12.865 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.865 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.866 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:12.866 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416032+0000", 2024-09-12T22:32:12.866 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0084793790000000004 2024-09-12T22:32:12.866 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.866 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.866 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:12.866 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416062+0000", 2024-09-12T22:32:12.866 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.9495000000000001e-05 2024-09-12T22:32:12.866 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:12.866 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:12.866 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:12.866 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.866 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.866 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:31 3.d e19/17 3:b50e409b:::mds_snaptable:head v 19'1, mlcod=0'0)", 2024-09-12T22:32:12.867 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.408508+0000", 2024-09-12T22:32:12.867 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 35.366098444000002, 2024-09-12T22:32:12.867 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0080056620000000002, 2024-09-12T22:32:12.867 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:12.867 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:12.867 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:12.867 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:12.867 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.867 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:12.867 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408508+0000", 2024-09-12T22:32:12.867 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:12.867 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.867 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.868 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:12.868 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408508+0000", 2024-09-12T22:32:12.868 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:12.868 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.868 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.868 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:12.868 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408508+0000", 2024-09-12T22:32:12.868 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.7e-07 2024-09-12T22:32:12.868 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.868 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.868 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:12.868 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408515+0000", 2024-09-12T22:32:12.868 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.4439999999999996e-06 2024-09-12T22:32:12.869 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.869 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.869 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:12.869 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408521+0000", 2024-09-12T22:32:12.869 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.2729999999999999e-06 2024-09-12T22:32:12.869 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.869 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.869 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:12.869 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408526+0000", 2024-09-12T22:32:12.869 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.3299999999999998e-06 2024-09-12T22:32:12.869 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.869 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.869 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:12.869 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.410190+0000", 2024-09-12T22:32:12.870 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.001663615 2024-09-12T22:32:12.870 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.870 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.870 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:12.870 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.410258+0000", 2024-09-12T22:32:12.870 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.8146999999999997e-05 2024-09-12T22:32:12.870 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.870 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.870 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:12.870 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416477+0000", 2024-09-12T22:32:12.870 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0062187329999999997 2024-09-12T22:32:12.870 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.870 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.871 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:12.871 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416513+0000", 2024-09-12T22:32:12.871 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.6650000000000003e-05 2024-09-12T22:32:12.871 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:12.871 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:12.871 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:12.871 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.871 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.871 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:9 3.10 e19/17 3:09401a81:::601.00000000:head v 19'4, mlcod=0'0)", 2024-09-12T22:32:12.871 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.408991+0000", 2024-09-12T22:32:12.871 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 35.365614694000001, 2024-09-12T22:32:12.871 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0080459209999999993, 2024-09-12T22:32:12.871 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:12.872 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:12.872 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:12.872 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:12.872 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.872 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:12.872 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408991+0000", 2024-09-12T22:32:12.872 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:12.872 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.872 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.872 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:12.872 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408991+0000", 2024-09-12T22:32:12.872 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:12.872 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.873 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.873 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:12.873 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408992+0000", 2024-09-12T22:32:12.873 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.1799999999999995e-07 2024-09-12T22:32:12.873 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.873 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.873 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:12.873 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409005+0000", 2024-09-12T22:32:12.873 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.261e-05 2024-09-12T22:32:12.873 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.873 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.873 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:12.873 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409015+0000", 2024-09-12T22:32:12.874 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.0001e-05 2024-09-12T22:32:12.874 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.874 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.874 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:12.874 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409023+0000", 2024-09-12T22:32:12.874 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 8.7569999999999993e-06 2024-09-12T22:32:12.874 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.874 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.874 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:12.874 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.411355+0000", 2024-09-12T22:32:12.874 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0023313520000000001 2024-09-12T22:32:12.874 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.874 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.875 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:12.875 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.411374+0000", 2024-09-12T22:32:12.875 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.8810000000000001e-05 2024-09-12T22:32:12.875 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.875 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.875 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:12.875 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416994+0000", 2024-09-12T22:32:12.875 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.005620524 2024-09-12T22:32:12.875 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.875 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.875 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:12.875 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417037+0000", 2024-09-12T22:32:12.875 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.3248999999999999e-05 2024-09-12T22:32:12.876 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:12.876 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:12.876 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:12.876 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.876 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.876 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:10 3.10 e19/17 3:0bd6d154:::602.00000000:head v 19'5, mlcod=0'0)", 2024-09-12T22:32:12.876 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.409038+0000", 2024-09-12T22:32:12.876 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 35.365568019000001, 2024-09-12T22:32:12.876 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0080541689999999999, 2024-09-12T22:32:12.876 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:12.876 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:12.876 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:12.876 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:12.877 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.877 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:12.877 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409038+0000", 2024-09-12T22:32:12.877 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:12.877 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.877 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.877 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:12.877 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409038+0000", 2024-09-12T22:32:12.877 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:12.877 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.877 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.877 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:12.877 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409038+0000", 2024-09-12T22:32:12.878 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.7899999999999999e-07 2024-09-12T22:32:12.878 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.878 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.878 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:12.878 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409043+0000", 2024-09-12T22:32:12.878 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.6589999999999998e-06 2024-09-12T22:32:12.878 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.878 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.878 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:12.878 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409050+0000", 2024-09-12T22:32:12.878 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 7.0829999999999998e-06 2024-09-12T22:32:12.878 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.878 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.879 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:12.879 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409058+0000", 2024-09-12T22:32:12.879 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 7.7309999999999993e-06 2024-09-12T22:32:12.879 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.879 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.879 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:12.879 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.411654+0000", 2024-09-12T22:32:12.879 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0025961650000000001 2024-09-12T22:32:12.879 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.879 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.879 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:12.879 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.411671+0000", 2024-09-12T22:32:12.879 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.7356000000000001e-05 2024-09-12T22:32:12.880 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.880 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.880 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:12.880 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417040+0000", 2024-09-12T22:32:12.880 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0053681889999999998 2024-09-12T22:32:12.880 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.880 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.880 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:12.880 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417092+0000", 2024-09-12T22:32:12.880 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.2607e-05 2024-09-12T22:32:12.880 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:12.880 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:12.880 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:12.881 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.881 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.881 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:11 3.10 e19/17 3:0bd6d154:::602.00000000:head v 19'6, mlcod=0'0)", 2024-09-12T22:32:12.881 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.409768+0000", 2024-09-12T22:32:12.881 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 35.364838577999997, 2024-09-12T22:32:12.881 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0074442759999999997, 2024-09-12T22:32:12.881 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:12.881 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:12.881 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:12.881 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:12.881 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.881 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:12.881 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409768+0000", 2024-09-12T22:32:12.882 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:12.882 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.882 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.882 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:12.882 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409768+0000", 2024-09-12T22:32:12.882 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:12.882 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.882 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.882 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:12.882 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409768+0000", 2024-09-12T22:32:12.882 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.37e-07 2024-09-12T22:32:12.882 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.882 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.883 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:12.883 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409775+0000", 2024-09-12T22:32:12.883 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.4670000000000001e-06 2024-09-12T22:32:12.883 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.883 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.883 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:12.883 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409793+0000", 2024-09-12T22:32:12.883 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.8162e-05 2024-09-12T22:32:12.883 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.883 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.883 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:12.883 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409954+0000", 2024-09-12T22:32:12.883 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00016072999999999999 2024-09-12T22:32:12.883 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.884 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.884 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:12.884 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.411943+0000", 2024-09-12T22:32:12.884 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0019897069999999998 2024-09-12T22:32:12.884 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.884 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.884 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:12.884 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.412069+0000", 2024-09-12T22:32:12.884 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00012546200000000001 2024-09-12T22:32:12.884 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.884 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.884 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:12.884 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417114+0000", 2024-09-12T22:32:12.885 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.005045023 2024-09-12T22:32:12.885 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:12.885 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:12.885 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:12.885 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417212+0000", 2024-09-12T22:32:12.885 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 9.8088e-05 2024-09-12T22:32:12.885 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:12.885 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:12.885 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:12.885 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:12.885 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:12.885 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-09-12T22:32:12.887 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:32:12.887 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:12.885+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:12.987 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:32:12.986+0000 7fddec6a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30331) UID: 0 2024-09-12T22:32:13.003 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:32:13.003 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:32:13.003 INFO:teuthology.orchestra.run.smithi148.stdout: "num_ops": 0 2024-09-12T22:32:13.003 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:32:13.013 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:32:13.088 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:13.087+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:13.117 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:32:13.118 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:32:13.118 INFO:teuthology.orchestra.run.smithi148.stdout: "complaint_time": 30, 2024-09-12T22:32:13.118 INFO:teuthology.orchestra.run.smithi148.stdout: "num_blocked_ops": 0 2024-09-12T22:32:13.118 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:32:13.126 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:32:13.189 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:13.188+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:13.232 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:32:13.232 INFO:teuthology.orchestra.run.smithi148.stdout: "size": 20, 2024-09-12T22:32:13.232 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 600, 2024-09-12T22:32:13.232 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [ 2024-09-12T22:32:13.232 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.232 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:13.232 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.400880+0000", 2024-09-12T22:32:13.232 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 35.829262804000003, 2024-09-12T22:32:13.233 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0095133660000000005, 2024-09-12T22:32:13.233 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:13.233 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:13.233 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:13.233 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:13.233 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.233 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:13.233 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400880+0000", 2024-09-12T22:32:13.233 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:13.233 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.233 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.233 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:13.233 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400880+0000", 2024-09-12T22:32:13.234 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:13.234 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.234 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.234 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:13.234 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400892+0000", 2024-09-12T22:32:13.234 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1941e-05 2024-09-12T22:32:13.234 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.234 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.234 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:13.234 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400900+0000", 2024-09-12T22:32:13.234 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0080000000000002e-06 2024-09-12T22:32:13.234 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.234 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.235 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:13.235 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400911+0000", 2024-09-12T22:32:13.235 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1452e-05 2024-09-12T22:32:13.235 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.235 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.235 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:13.235 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400922+0000", 2024-09-12T22:32:13.235 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0772e-05 2024-09-12T22:32:13.235 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.235 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.235 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:13.235 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401009+0000", 2024-09-12T22:32:13.235 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.7206000000000005e-05 2024-09-12T22:32:13.236 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.236 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.236 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:13.236 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401157+0000", 2024-09-12T22:32:13.236 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014831499999999999 2024-09-12T22:32:13.236 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.236 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.236 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:13.236 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401312+0000", 2024-09-12T22:32:13.236 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00015495600000000001 2024-09-12T22:32:13.236 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.236 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.237 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:13.237 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.403060+0000", 2024-09-12T22:32:13.237 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0017475220000000001 2024-09-12T22:32:13.237 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.237 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.237 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:13.237 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410300+0000", 2024-09-12T22:32:13.237 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0072403260000000001 2024-09-12T22:32:13.237 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.237 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.237 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:13.237 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410350+0000", 2024-09-12T22:32:13.237 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9814000000000001e-05 2024-09-12T22:32:13.238 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.238 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.238 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:13.238 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410393+0000", 2024-09-12T22:32:13.238 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3053999999999998e-05 2024-09-12T22:32:13.238 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:13.238 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:13.238 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:13.238 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.238 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.238 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:13.238 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.400952+0000", 2024-09-12T22:32:13.239 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 35.829190652000001, 2024-09-12T22:32:13.239 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0096045620000000005, 2024-09-12T22:32:13.239 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:13.239 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:13.239 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:13.239 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:13.239 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.239 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:13.239 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400952+0000", 2024-09-12T22:32:13.239 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:13.239 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.239 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.239 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:13.240 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400952+0000", 2024-09-12T22:32:13.240 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:13.240 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.240 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.240 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:13.240 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400953+0000", 2024-09-12T22:32:13.240 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.8000000000000005e-07 2024-09-12T22:32:13.240 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.240 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.240 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:13.240 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400957+0000", 2024-09-12T22:32:13.240 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.33e-06 2024-09-12T22:32:13.241 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.241 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.241 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:13.241 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400966+0000", 2024-09-12T22:32:13.241 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1989999999999995e-06 2024-09-12T22:32:13.241 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.241 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.241 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:13.241 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400973+0000", 2024-09-12T22:32:13.241 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2779999999999999e-06 2024-09-12T22:32:13.241 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.241 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.241 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:13.242 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401696+0000", 2024-09-12T22:32:13.242 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00072363500000000003 2024-09-12T22:32:13.242 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.242 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.242 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:13.242 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401788+0000", 2024-09-12T22:32:13.242 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1862999999999998e-05 2024-09-12T22:32:13.242 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.242 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.242 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:13.242 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401929+0000", 2024-09-12T22:32:13.242 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014096000000000001 2024-09-12T22:32:13.242 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.242 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.243 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:13.243 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.403542+0000", 2024-09-12T22:32:13.243 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001612963 2024-09-12T22:32:13.243 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.243 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.243 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:13.243 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410460+0000", 2024-09-12T22:32:13.243 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0069180500000000002 2024-09-12T22:32:13.243 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.243 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.243 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:13.243 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410515+0000", 2024-09-12T22:32:13.243 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5009000000000001e-05 2024-09-12T22:32:13.244 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.244 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.244 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:13.244 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410557+0000", 2024-09-12T22:32:13.244 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1495000000000002e-05 2024-09-12T22:32:13.244 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:13.244 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:13.244 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:13.244 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.244 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.244 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:13.244 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.400984+0000", 2024-09-12T22:32:13.244 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 35.829158157000002, 2024-09-12T22:32:13.245 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0073703950000000001, 2024-09-12T22:32:13.245 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:13.245 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:13.245 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:13.245 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:13.245 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.245 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:13.245 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400984+0000", 2024-09-12T22:32:13.245 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:13.245 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.245 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.245 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:13.245 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400984+0000", 2024-09-12T22:32:13.246 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:13.246 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.246 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.246 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:13.246 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400985+0000", 2024-09-12T22:32:13.246 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3200000000000005e-07 2024-09-12T22:32:13.246 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.246 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.246 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:13.246 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400998+0000", 2024-09-12T22:32:13.246 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2726e-05 2024-09-12T22:32:13.246 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.246 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.246 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:13.247 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401006+0000", 2024-09-12T22:32:13.247 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.3110000000000006e-06 2024-09-12T22:32:13.247 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.247 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.247 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:13.247 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401022+0000", 2024-09-12T22:32:13.247 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6249e-05 2024-09-12T22:32:13.247 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.247 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.247 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:13.247 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401700+0000", 2024-09-12T22:32:13.247 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00067811100000000001 2024-09-12T22:32:13.247 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.248 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.248 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:13.248 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401839+0000", 2024-09-12T22:32:13.248 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013865399999999999 2024-09-12T22:32:13.248 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.248 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.248 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:13.248 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401962+0000", 2024-09-12T22:32:13.248 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000123266 2024-09-12T22:32:13.248 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.249 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.249 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:13.249 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.403589+0000", 2024-09-12T22:32:13.249 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001626932 2024-09-12T22:32:13.249 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.249 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.249 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:13.249 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.408274+0000", 2024-09-12T22:32:13.249 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0046848100000000002 2024-09-12T22:32:13.249 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.249 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.249 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:13.249 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.408324+0000", 2024-09-12T22:32:13.250 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9784000000000003e-05 2024-09-12T22:32:13.250 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.250 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.250 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:13.250 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.408355+0000", 2024-09-12T22:32:13.250 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.1019999999999998e-05 2024-09-12T22:32:13.250 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:13.250 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:13.250 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:13.250 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.250 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.250 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:13.250 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401034+0000", 2024-09-12T22:32:13.251 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 35.829108716999997, 2024-09-12T22:32:13.251 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011063051000000001, 2024-09-12T22:32:13.251 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:13.251 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:13.251 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:13.251 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:13.251 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.251 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:13.251 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401034+0000", 2024-09-12T22:32:13.251 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:13.251 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.251 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.251 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:13.251 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401034+0000", 2024-09-12T22:32:13.252 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:13.252 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.252 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.252 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:13.252 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401034+0000", 2024-09-12T22:32:13.252 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8899999999999999e-07 2024-09-12T22:32:13.252 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.252 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.252 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:13.252 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401038+0000", 2024-09-12T22:32:13.252 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.523e-06 2024-09-12T22:32:13.252 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.252 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.253 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:13.253 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401046+0000", 2024-09-12T22:32:13.253 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0479999999999999e-06 2024-09-12T22:32:13.253 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.253 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.253 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:13.253 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401051+0000", 2024-09-12T22:32:13.253 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2619999999999998e-06 2024-09-12T22:32:13.253 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.253 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.253 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:13.253 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402270+0000", 2024-09-12T22:32:13.253 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012182429999999999 2024-09-12T22:32:13.253 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.254 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.254 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:13.254 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402325+0000", 2024-09-12T22:32:13.254 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5526999999999999e-05 2024-09-12T22:32:13.254 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.254 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.254 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:13.254 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402403+0000", 2024-09-12T22:32:13.254 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.7559999999999996e-05 2024-09-12T22:32:13.254 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.254 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.254 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:13.254 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.403655+0000", 2024-09-12T22:32:13.255 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012521489999999999 2024-09-12T22:32:13.255 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.255 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.255 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:13.255 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411979+0000", 2024-09-12T22:32:13.255 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0083240420000000002 2024-09-12T22:32:13.255 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.255 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.255 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:13.255 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.412036+0000", 2024-09-12T22:32:13.255 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7639000000000002e-05 2024-09-12T22:32:13.255 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.255 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.256 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:13.256 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.412097+0000", 2024-09-12T22:32:13.256 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0469e-05 2024-09-12T22:32:13.256 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:13.256 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:13.256 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:13.256 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.256 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.256 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:13.256 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401060+0000", 2024-09-12T22:32:13.256 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 35.829082964999998, 2024-09-12T22:32:13.256 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.010030172, 2024-09-12T22:32:13.256 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:13.257 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:13.257 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:13.257 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:13.257 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.257 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:13.257 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401060+0000", 2024-09-12T22:32:13.257 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:13.257 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.257 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.257 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:13.257 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401060+0000", 2024-09-12T22:32:13.257 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:13.257 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.257 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.258 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:13.258 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401060+0000", 2024-09-12T22:32:13.258 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2500000000000001e-07 2024-09-12T22:32:13.258 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.258 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.258 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:13.258 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401063+0000", 2024-09-12T22:32:13.258 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0910000000000001e-06 2024-09-12T22:32:13.258 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.258 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.258 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:13.258 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401070+0000", 2024-09-12T22:32:13.258 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1210000000000001e-06 2024-09-12T22:32:13.259 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.259 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.259 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:13.259 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401076+0000", 2024-09-12T22:32:13.259 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2830000000000001e-06 2024-09-12T22:32:13.259 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.259 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.259 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:13.259 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402288+0000", 2024-09-12T22:32:13.259 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012123699999999999 2024-09-12T22:32:13.259 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.259 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.259 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:13.260 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402359+0000", 2024-09-12T22:32:13.260 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.0988000000000005e-05 2024-09-12T22:32:13.260 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.260 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.260 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:13.260 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402457+0000", 2024-09-12T22:32:13.260 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.7857999999999997e-05 2024-09-12T22:32:13.260 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.260 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.260 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:13.260 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.404395+0000", 2024-09-12T22:32:13.260 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0019380160000000001 2024-09-12T22:32:13.260 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.261 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.261 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:13.261 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410603+0000", 2024-09-12T22:32:13.261 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.006208061 2024-09-12T22:32:13.261 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.261 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.261 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:13.261 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410687+0000", 2024-09-12T22:32:13.261 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.4623000000000006e-05 2024-09-12T22:32:13.261 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.261 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.261 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:13.262 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411090+0000", 2024-09-12T22:32:13.262 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00040233599999999999 2024-09-12T22:32:13.262 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:13.262 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:13.262 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:13.262 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.262 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.262 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:13.262 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401083+0000", 2024-09-12T22:32:13.262 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 35.829059549, 2024-09-12T22:32:13.262 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0097591850000000001, 2024-09-12T22:32:13.262 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:13.262 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:13.263 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:13.263 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:13.263 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.263 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:13.263 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401083+0000", 2024-09-12T22:32:13.263 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:13.263 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.263 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.263 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:13.263 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401083+0000", 2024-09-12T22:32:13.263 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:13.263 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.264 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.264 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:13.264 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401084+0000", 2024-09-12T22:32:13.264 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4799999999999999e-07 2024-09-12T22:32:13.264 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.264 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.264 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:13.264 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401088+0000", 2024-09-12T22:32:13.264 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6419999999999998e-06 2024-09-12T22:32:13.264 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.264 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.264 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:13.264 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401094+0000", 2024-09-12T22:32:13.265 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0090000000000004e-06 2024-09-12T22:32:13.265 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.265 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.265 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:13.265 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401108+0000", 2024-09-12T22:32:13.265 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3884e-05 2024-09-12T22:32:13.265 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.265 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.265 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:13.265 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401165+0000", 2024-09-12T22:32:13.265 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.6499000000000002e-05 2024-09-12T22:32:13.265 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.266 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.266 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:13.266 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401261+0000", 2024-09-12T22:32:13.266 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.6872000000000004e-05 2024-09-12T22:32:13.266 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.266 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.266 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:13.266 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401376+0000", 2024-09-12T22:32:13.266 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000114508 2024-09-12T22:32:13.266 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.266 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.266 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:13.266 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402666+0000", 2024-09-12T22:32:13.267 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012901659999999999 2024-09-12T22:32:13.267 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.267 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.267 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:13.267 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410572+0000", 2024-09-12T22:32:13.267 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0079055489999999996 2024-09-12T22:32:13.267 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.267 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.267 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:13.267 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410661+0000", 2024-09-12T22:32:13.267 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.9578000000000002e-05 2024-09-12T22:32:13.267 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.267 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.267 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:13.268 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410842+0000", 2024-09-12T22:32:13.268 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00018102999999999999 2024-09-12T22:32:13.268 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:13.268 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:13.268 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:13.268 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.268 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.268 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:13.268 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401122+0000", 2024-09-12T22:32:13.268 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 35.829020517000004, 2024-09-12T22:32:13.268 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0099122080000000005, 2024-09-12T22:32:13.268 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:13.268 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:13.269 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:32:13.269 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:13.269 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.269 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:13.269 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401122+0000", 2024-09-12T22:32:13.269 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:13.269 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.269 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.269 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:13.269 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401122+0000", 2024-09-12T22:32:13.269 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:13.269 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.269 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.270 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:13.270 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401123+0000", 2024-09-12T22:32:13.270 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2600000000000002e-07 2024-09-12T22:32:13.270 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.270 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.270 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:13.270 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401126+0000", 2024-09-12T22:32:13.270 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.6449999999999998e-06 2024-09-12T22:32:13.270 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.270 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.270 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:13.270 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401133+0000", 2024-09-12T22:32:13.270 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.9890000000000003e-06 2024-09-12T22:32:13.271 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.271 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.271 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:13.271 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401138+0000", 2024-09-12T22:32:13.271 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8060000000000002e-06 2024-09-12T22:32:13.271 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.271 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.271 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:13.271 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401703+0000", 2024-09-12T22:32:13.271 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00056509099999999999 2024-09-12T22:32:13.271 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.271 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.271 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:13.272 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401837+0000", 2024-09-12T22:32:13.272 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013338799999999999 2024-09-12T22:32:13.272 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.272 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.272 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:13.272 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411034+0000", 2024-09-12T22:32:13.272 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.009197663 2024-09-12T22:32:13.272 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:13.272 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:13.272 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:13.272 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.272 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.272 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:13.273 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401158+0000", 2024-09-12T22:32:13.273 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 35.828984738000003, 2024-09-12T22:32:13.273 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.010292437999999999, 2024-09-12T22:32:13.273 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:13.273 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:13.273 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:32:13.273 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:13.273 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.273 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:13.273 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401158+0000", 2024-09-12T22:32:13.273 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:13.273 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.273 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.274 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:13.274 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401158+0000", 2024-09-12T22:32:13.274 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:13.274 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.274 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.274 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:13.274 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401158+0000", 2024-09-12T22:32:13.274 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9699999999999996e-07 2024-09-12T22:32:13.274 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.274 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.274 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:13.274 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401161+0000", 2024-09-12T22:32:13.274 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.7410000000000001e-06 2024-09-12T22:32:13.274 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.275 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.275 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:13.275 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401168+0000", 2024-09-12T22:32:13.275 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.844e-06 2024-09-12T22:32:13.275 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.275 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.275 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:13.275 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401174+0000", 2024-09-12T22:32:13.275 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4700000000000001e-06 2024-09-12T22:32:13.275 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.275 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.275 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:13.275 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402799+0000", 2024-09-12T22:32:13.275 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0016256409999999999 2024-09-12T22:32:13.276 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.276 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.276 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:13.276 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402893+0000", 2024-09-12T22:32:13.276 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.3807999999999994e-05 2024-09-12T22:32:13.276 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.276 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.276 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:13.276 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411450+0000", 2024-09-12T22:32:13.276 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0085573369999999999 2024-09-12T22:32:13.276 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:13.276 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:13.276 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:13.277 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.277 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.277 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:13.277 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401183+0000", 2024-09-12T22:32:13.277 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 35.828959886, 2024-09-12T22:32:13.277 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0068597830000000004, 2024-09-12T22:32:13.277 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:13.277 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:13.277 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:32:13.277 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:13.277 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.277 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:13.277 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401183+0000", 2024-09-12T22:32:13.278 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:13.278 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.278 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.278 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:13.278 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401183+0000", 2024-09-12T22:32:13.278 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:13.278 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.278 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.278 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:13.278 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401183+0000", 2024-09-12T22:32:13.278 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.6700000000000003e-07 2024-09-12T22:32:13.278 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.278 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.278 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:13.279 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401186+0000", 2024-09-12T22:32:13.279 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4679999999999999e-06 2024-09-12T22:32:13.279 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.279 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.279 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:13.279 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401192+0000", 2024-09-12T22:32:13.279 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.1519999999999997e-06 2024-09-12T22:32:13.279 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.279 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.279 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:13.279 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401197+0000", 2024-09-12T22:32:13.279 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4669999999999998e-06 2024-09-12T22:32:13.279 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.280 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.280 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:13.280 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401253+0000", 2024-09-12T22:32:13.280 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.6211000000000001e-05 2024-09-12T22:32:13.280 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.280 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.280 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:13.280 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401413+0000", 2024-09-12T22:32:13.280 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00016021399999999999 2024-09-12T22:32:13.280 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.280 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.280 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:13.280 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.408043+0000", 2024-09-12T22:32:13.281 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0066295039999999996 2024-09-12T22:32:13.281 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:13.281 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:13.281 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:13.281 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.281 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.281 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:20 3.1c e19/17 3:3ed09add:::607.00000000:head v 19'1, mlcod=0'0)", 2024-09-12T22:32:13.281 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.409642+0000", 2024-09-12T22:32:13.281 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 35.820500426999999, 2024-09-12T22:32:13.281 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0038816269999999999, 2024-09-12T22:32:13.281 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:13.281 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:13.282 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:13.282 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:13.282 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.282 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:13.282 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409642+0000", 2024-09-12T22:32:13.282 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:13.282 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.282 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.282 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:13.282 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409642+0000", 2024-09-12T22:32:13.282 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:13.282 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.282 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.283 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:13.283 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409642+0000", 2024-09-12T22:32:13.283 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.6899999999999999e-07 2024-09-12T22:32:13.283 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.283 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.283 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:13.283 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409648+0000", 2024-09-12T22:32:13.283 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.49e-06 2024-09-12T22:32:13.283 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.283 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.283 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:13.283 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409656+0000", 2024-09-12T22:32:13.283 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.2949999999999994e-06 2024-09-12T22:32:13.283 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.284 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.284 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:13.284 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409664+0000", 2024-09-12T22:32:13.284 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.1219999999999995e-06 2024-09-12T22:32:13.284 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.284 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.284 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:13.284 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409707+0000", 2024-09-12T22:32:13.284 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2222000000000003e-05 2024-09-12T22:32:13.284 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.284 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.284 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:13.284 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409724+0000", 2024-09-12T22:32:13.285 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7496999999999999e-05 2024-09-12T22:32:13.285 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.285 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.285 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:13.285 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413439+0000", 2024-09-12T22:32:13.285 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00371448 2024-09-12T22:32:13.285 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.285 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.285 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:13.285 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413524+0000", 2024-09-12T22:32:13.285 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.5252000000000003e-05 2024-09-12T22:32:13.285 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:13.285 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:13.286 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:13.286 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.286 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.286 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:28 3.13 e19/17 3:cd5a64a3:::100.00000000:head v 19'1, mlcod=0'0)", 2024-09-12T22:32:13.286 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.409681+0000", 2024-09-12T22:32:13.286 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 35.820461944000002, 2024-09-12T22:32:13.286 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0038708710000000001, 2024-09-12T22:32:13.286 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:13.286 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:13.286 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:13.286 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:13.286 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.286 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:13.287 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409681+0000", 2024-09-12T22:32:13.287 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:13.287 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.287 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.287 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:13.287 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409681+0000", 2024-09-12T22:32:13.287 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:13.287 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.287 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.287 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:13.287 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409681+0000", 2024-09-12T22:32:13.287 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3000000000000002e-07 2024-09-12T22:32:13.287 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.288 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.288 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:13.288 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409695+0000", 2024-09-12T22:32:13.288 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4313e-05 2024-09-12T22:32:13.288 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.288 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.288 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:13.288 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409703+0000", 2024-09-12T22:32:13.288 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4000000000000003e-06 2024-09-12T22:32:13.288 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.288 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.288 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:13.288 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409708+0000", 2024-09-12T22:32:13.289 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3190000000000002e-06 2024-09-12T22:32:13.289 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.289 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.289 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:13.289 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409875+0000", 2024-09-12T22:32:13.289 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000167329 2024-09-12T22:32:13.289 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.289 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.289 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:13.289 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409892+0000", 2024-09-12T22:32:13.289 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6957999999999999e-05 2024-09-12T22:32:13.289 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.289 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.290 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:13.290 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413457+0000", 2024-09-12T22:32:13.290 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0035651279999999999 2024-09-12T22:32:13.290 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.290 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.290 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:13.290 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413552+0000", 2024-09-12T22:32:13.290 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.4093999999999997e-05 2024-09-12T22:32:13.290 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:13.290 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:13.290 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:13.290 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.290 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.290 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:21 3.1c e19/17 3:3ed09add:::607.00000000:head v 19'2, mlcod=0'0)", 2024-09-12T22:32:13.291 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.409718+0000", 2024-09-12T22:32:13.291 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 35.820424279000001, 2024-09-12T22:32:13.291 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003851883, 2024-09-12T22:32:13.291 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:13.291 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:13.291 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:13.291 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:13.291 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.291 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:13.291 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409718+0000", 2024-09-12T22:32:13.291 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:13.291 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.291 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.292 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:13.292 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409718+0000", 2024-09-12T22:32:13.292 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:13.292 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.292 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.292 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:13.292 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409719+0000", 2024-09-12T22:32:13.292 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.16e-07 2024-09-12T22:32:13.292 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.292 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.292 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:13.292 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409722+0000", 2024-09-12T22:32:13.292 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.692e-06 2024-09-12T22:32:13.293 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.293 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.293 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:13.293 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409729+0000", 2024-09-12T22:32:13.293 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.516e-06 2024-09-12T22:32:13.293 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.293 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.293 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:13.293 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409750+0000", 2024-09-12T22:32:13.293 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1151000000000001e-05 2024-09-12T22:32:13.293 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.293 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.293 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:13.294 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410015+0000", 2024-09-12T22:32:13.294 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00026477599999999999 2024-09-12T22:32:13.294 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.294 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.294 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:13.294 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410104+0000", 2024-09-12T22:32:13.294 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.9586000000000006e-05 2024-09-12T22:32:13.294 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.294 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.294 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:13.294 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413528+0000", 2024-09-12T22:32:13.294 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0034237880000000001 2024-09-12T22:32:13.294 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.294 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.295 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:13.295 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413570+0000", 2024-09-12T22:32:13.295 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2157999999999999e-05 2024-09-12T22:32:13.295 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:13.295 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:13.295 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:13.295 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.295 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.295 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:27 3.13 e19/17 3:c91d4a1d:::mds0_inotable:head v 19'2, mlcod=0'0)", 2024-09-12T22:32:13.295 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.409760+0000", 2024-09-12T22:32:13.295 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 35.820382762999998, 2024-09-12T22:32:13.295 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0039301910000000004, 2024-09-12T22:32:13.295 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:13.295 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:13.296 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:13.296 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:13.296 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.296 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:13.296 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409760+0000", 2024-09-12T22:32:13.296 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:13.296 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.296 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.296 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:13.296 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409760+0000", 2024-09-12T22:32:13.296 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:13.296 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.297 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.297 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:13.297 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409760+0000", 2024-09-12T22:32:13.297 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.39e-07 2024-09-12T22:32:13.297 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.297 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.297 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:13.297 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409765+0000", 2024-09-12T22:32:13.297 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4449999999999998e-06 2024-09-12T22:32:13.297 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.297 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.297 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:13.297 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409771+0000", 2024-09-12T22:32:13.298 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7159999999999997e-06 2024-09-12T22:32:13.298 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.298 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.298 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:13.298 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409778+0000", 2024-09-12T22:32:13.298 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.331e-06 2024-09-12T22:32:13.298 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.298 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.298 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:13.298 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410191+0000", 2024-09-12T22:32:13.298 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00041348300000000003 2024-09-12T22:32:13.298 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.298 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.299 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:13.299 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410211+0000", 2024-09-12T22:32:13.299 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9933999999999999e-05 2024-09-12T22:32:13.299 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.299 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.299 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:13.299 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413638+0000", 2024-09-12T22:32:13.299 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003426854 2024-09-12T22:32:13.299 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.299 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.299 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:13.299 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413690+0000", 2024-09-12T22:32:13.299 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2089000000000002e-05 2024-09-12T22:32:13.299 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:13.300 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:13.300 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:13.300 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.300 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.300 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "pg_update_log_missing_reply(3.b epoch 19/17 rep_tid 4 lcod 19'2)", 2024-09-12T22:32:13.300 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.410060+0000", 2024-09-12T22:32:13.300 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 35.820083097999998, 2024-09-12T22:32:13.300 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00098016500000000007, 2024-09-12T22:32:13.300 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:13.300 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:13.300 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "reached pg", 2024-09-12T22:32:13.300 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:13.300 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.301 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:13.301 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410060+0000", 2024-09-12T22:32:13.301 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:13.301 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.301 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.301 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:13.301 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410060+0000", 2024-09-12T22:32:13.301 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:13.301 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.301 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.301 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:13.301 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410060+0000", 2024-09-12T22:32:13.301 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.8299999999999998e-07 2024-09-12T22:32:13.302 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.302 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.302 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:13.302 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410062+0000", 2024-09-12T22:32:13.302 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5749999999999999e-06 2024-09-12T22:32:13.302 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.302 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.302 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:13.302 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410070+0000", 2024-09-12T22:32:13.302 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.909e-06 2024-09-12T22:32:13.302 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.302 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.302 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:13.303 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410076+0000", 2024-09-12T22:32:13.303 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7049999999999996e-06 2024-09-12T22:32:13.303 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.303 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.303 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:13.303 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410943+0000", 2024-09-12T22:32:13.303 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00086681900000000001 2024-09-12T22:32:13.303 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.303 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.303 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:13.303 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411040+0000", 2024-09-12T22:32:13.303 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.6774000000000006e-05 2024-09-12T22:32:13.303 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:13.303 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:13.304 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:13.304 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.304 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.304 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e19/17 ondisk, result = 0)", 2024-09-12T22:32:13.304 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.410113+0000", 2024-09-12T22:32:13.304 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 35.820029830999999, 2024-09-12T22:32:13.304 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00098911599999999995, 2024-09-12T22:32:13.304 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:13.304 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:13.304 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:32:13.304 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:13.304 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.304 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:13.305 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410113+0000", 2024-09-12T22:32:13.305 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:13.305 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.305 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.305 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:13.305 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410113+0000", 2024-09-12T22:32:13.305 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:13.305 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.305 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.305 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:13.305 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410113+0000", 2024-09-12T22:32:13.305 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.99e-07 2024-09-12T22:32:13.305 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.305 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.306 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:13.306 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410115+0000", 2024-09-12T22:32:13.306 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.046e-06 2024-09-12T22:32:13.306 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.306 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.306 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:13.306 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410121+0000", 2024-09-12T22:32:13.306 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0050000000000001e-06 2024-09-12T22:32:13.306 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.306 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.306 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:13.306 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410126+0000", 2024-09-12T22:32:13.307 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8339999999999998e-06 2024-09-12T22:32:13.307 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.307 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.307 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:13.307 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410587+0000", 2024-09-12T22:32:13.307 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00046095499999999998 2024-09-12T22:32:13.307 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.307 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.307 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:13.307 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410595+0000", 2024-09-12T22:32:13.307 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.9419999999999995e-06 2024-09-12T22:32:13.307 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.307 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.307 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:13.308 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411102+0000", 2024-09-12T22:32:13.308 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00050713500000000003 2024-09-12T22:32:13.308 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:13.308 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:13.308 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:13.308 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.308 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.308 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 19/17 rep_tid 8 lcod 19'4)", 2024-09-12T22:32:13.308 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.410133+0000", 2024-09-12T22:32:13.308 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 35.820009902999999, 2024-09-12T22:32:13.308 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0013504000000000001, 2024-09-12T22:32:13.308 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:13.308 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:13.308 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "reached pg", 2024-09-12T22:32:13.309 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:13.309 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.309 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:13.309 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410133+0000", 2024-09-12T22:32:13.309 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:13.309 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.309 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.309 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:13.309 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410133+0000", 2024-09-12T22:32:13.309 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:13.309 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.309 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.310 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:13.310 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410133+0000", 2024-09-12T22:32:13.310 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.0599999999999999e-07 2024-09-12T22:32:13.310 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.310 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.310 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:13.310 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410135+0000", 2024-09-12T22:32:13.310 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7770000000000001e-06 2024-09-12T22:32:13.310 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.310 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.310 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:13.310 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410140+0000", 2024-09-12T22:32:13.310 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9960000000000001e-06 2024-09-12T22:32:13.311 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.311 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.311 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:13.311 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410144+0000", 2024-09-12T22:32:13.311 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9500000000000003e-06 2024-09-12T22:32:13.311 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.311 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.311 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:13.311 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411310+0000", 2024-09-12T22:32:13.311 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001166311 2024-09-12T22:32:13.311 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.311 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.311 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:13.311 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411483+0000", 2024-09-12T22:32:13.312 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00017316 2024-09-12T22:32:13.312 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:13.312 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:13.312 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:13.312 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.312 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.312 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "pg_update_log_missing(3.1a epoch 19/17 rep_tid 0 entries 19'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T22:32:13.312 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.410617+0000", 2024-09-12T22:32:13.312 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 35.819525507999998, 2024-09-12T22:32:13.312 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0030439709999999999, 2024-09-12T22:32:13.312 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:13.312 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:13.312 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "reached pg", 2024-09-12T22:32:13.313 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:13.313 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.313 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:13.313 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410617+0000", 2024-09-12T22:32:13.313 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:13.313 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.313 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.313 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:13.313 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410617+0000", 2024-09-12T22:32:13.313 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:13.313 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.313 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.313 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:13.313 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410617+0000", 2024-09-12T22:32:13.314 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3599999999999999e-07 2024-09-12T22:32:13.314 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.314 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.314 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:13.314 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410625+0000", 2024-09-12T22:32:13.314 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5410000000000003e-06 2024-09-12T22:32:13.314 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.314 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.314 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:13.314 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410638+0000", 2024-09-12T22:32:13.314 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3261999999999999e-05 2024-09-12T22:32:13.314 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.314 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.315 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:13.315 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410653+0000", 2024-09-12T22:32:13.315 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4844000000000001e-05 2024-09-12T22:32:13.315 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.315 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.315 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:13.315 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410814+0000", 2024-09-12T22:32:13.315 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00016119999999999999 2024-09-12T22:32:13.315 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.315 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.315 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:13.315 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413661+0000", 2024-09-12T22:32:13.315 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0028467879999999998 2024-09-12T22:32:13.316 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:13.316 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:13.316 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:13.316 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.316 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.316 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-09-12T22:32:13.316 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:39.398875+0000", 2024-09-12T22:32:13.316 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 33.831267228000002, 2024-09-12T22:32:13.316 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0015679069999999999, 2024-09-12T22:32:13.316 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:13.316 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:13.316 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:13.316 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:13.317 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.317 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:13.317 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398875+0000", 2024-09-12T22:32:13.317 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:13.317 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.317 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.317 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:13.317 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398875+0000", 2024-09-12T22:32:13.317 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:13.317 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.317 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.317 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:13.317 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398878+0000", 2024-09-12T22:32:13.318 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1679999999999998e-06 2024-09-12T22:32:13.318 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.318 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.318 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:13.318 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398888+0000", 2024-09-12T22:32:13.318 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.084e-05 2024-09-12T22:32:13.318 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.318 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.318 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:13.318 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398906+0000", 2024-09-12T22:32:13.318 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7518000000000001e-05 2024-09-12T22:32:13.318 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.318 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.318 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:13.319 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398914+0000", 2024-09-12T22:32:13.319 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5989999999999996e-06 2024-09-12T22:32:13.319 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.319 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.319 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:13.319 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398974+0000", 2024-09-12T22:32:13.319 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0988e-05 2024-09-12T22:32:13.319 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.319 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.319 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:13.319 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.399078+0000", 2024-09-12T22:32:13.319 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000103133 2024-09-12T22:32:13.319 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.320 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.320 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:13.320 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.399166+0000", 2024-09-12T22:32:13.320 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.8183999999999995e-05 2024-09-12T22:32:13.320 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.320 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.320 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:13.320 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.399747+0000", 2024-09-12T22:32:13.320 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00058110599999999996 2024-09-12T22:32:13.320 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.320 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.320 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:13.320 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.400377+0000", 2024-09-12T22:32:13.320 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000630157 2024-09-12T22:32:13.321 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.321 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.321 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:13.321 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.400415+0000", 2024-09-12T22:32:13.321 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7814000000000001e-05 2024-09-12T22:32:13.321 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.321 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.321 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:13.321 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.400443+0000", 2024-09-12T22:32:13.321 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8399999999999999e-05 2024-09-12T22:32:13.321 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:13.321 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:13.321 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:13.321 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.322 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.322 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e23)", 2024-09-12T22:32:13.322 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:58.400966+0000", 2024-09-12T22:32:13.322 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 14.82917632, 2024-09-12T22:32:13.322 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001468876, 2024-09-12T22:32:13.322 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:13.322 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:13.322 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:13.322 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:13.322 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.322 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:13.322 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400966+0000", 2024-09-12T22:32:13.323 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:13.323 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.323 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.323 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:13.323 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400966+0000", 2024-09-12T22:32:13.323 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:13.323 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.323 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.323 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:13.323 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400967+0000", 2024-09-12T22:32:13.323 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.046e-06 2024-09-12T22:32:13.323 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.323 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.324 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:13.324 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400974+0000", 2024-09-12T22:32:13.324 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2310000000000001e-06 2024-09-12T22:32:13.324 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.324 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.324 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:13.324 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400988+0000", 2024-09-12T22:32:13.324 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4482e-05 2024-09-12T22:32:13.324 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.324 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.324 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:13.324 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400997+0000", 2024-09-12T22:32:13.324 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.0189999999999995e-06 2024-09-12T22:32:13.325 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.325 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.325 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:13.325 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.401068+0000", 2024-09-12T22:32:13.325 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1426000000000004e-05 2024-09-12T22:32:13.325 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.325 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.325 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:13.325 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.401174+0000", 2024-09-12T22:32:13.325 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000105769 2024-09-12T22:32:13.325 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.325 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.325 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:13.326 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.401335+0000", 2024-09-12T22:32:13.326 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000161225 2024-09-12T22:32:13.326 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.326 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.326 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:13.326 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.402110+0000", 2024-09-12T22:32:13.326 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00077428800000000004 2024-09-12T22:32:13.326 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.326 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.326 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:13.326 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.402333+0000", 2024-09-12T22:32:13.326 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000223723 2024-09-12T22:32:13.326 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.327 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.327 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:13.327 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.402388+0000", 2024-09-12T22:32:13.327 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4700999999999997e-05 2024-09-12T22:32:13.327 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.327 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.327 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:13.327 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.402435+0000", 2024-09-12T22:32:13.327 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6965999999999997e-05 2024-09-12T22:32:13.327 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:13.327 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:13.327 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:13.327 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.328 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.328 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:45 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e27)", 2024-09-12T22:32:13.328 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:32:04.401614+0000", 2024-09-12T22:32:13.328 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 8.8285288909999995, 2024-09-12T22:32:13.328 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0014279749999999999, 2024-09-12T22:32:13.328 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:13.328 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:13.328 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:13.328 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:13.328 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.328 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:13.328 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401614+0000", 2024-09-12T22:32:13.328 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:13.329 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.329 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.329 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:13.329 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401614+0000", 2024-09-12T22:32:13.329 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:13.329 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.329 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.329 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:13.329 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401615+0000", 2024-09-12T22:32:13.329 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.161e-06 2024-09-12T22:32:13.329 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.329 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.329 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:13.330 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401621+0000", 2024-09-12T22:32:13.330 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8730000000000004e-06 2024-09-12T22:32:13.330 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.330 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.330 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:13.330 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401633+0000", 2024-09-12T22:32:13.330 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1800000000000001e-05 2024-09-12T22:32:13.330 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.330 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.330 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:13.330 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401656+0000", 2024-09-12T22:32:13.330 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.3521999999999999e-05 2024-09-12T22:32:13.330 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.331 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.331 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:13.331 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401713+0000", 2024-09-12T22:32:13.331 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7259000000000002e-05 2024-09-12T22:32:13.331 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.331 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.331 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:13.331 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401849+0000", 2024-09-12T22:32:13.331 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013613500000000001 2024-09-12T22:32:13.331 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.331 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.331 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:13.331 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.402009+0000", 2024-09-12T22:32:13.331 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00015947199999999999 2024-09-12T22:32:13.332 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.332 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.332 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:13.332 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.402629+0000", 2024-09-12T22:32:13.332 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00061962200000000001 2024-09-12T22:32:13.332 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.332 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.332 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:13.332 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.402983+0000", 2024-09-12T22:32:13.332 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00035447499999999998 2024-09-12T22:32:13.332 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.332 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.332 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:13.333 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.403016+0000", 2024-09-12T22:32:13.333 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3108999999999998e-05 2024-09-12T22:32:13.333 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:13.333 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:13.333 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:13.333 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.403042+0000", 2024-09-12T22:32:13.333 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5547000000000001e-05 2024-09-12T22:32:13.333 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:13.333 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:13.333 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:13.333 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:13.333 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:13.333 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:32:13.334 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T22:32:13.334 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T22:32:13.336 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:32:13.337 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:13.335+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:13.437 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:13.435+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:13.452 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-09-12T22:32:13.452 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-09-12T22:32:13.452 INFO:teuthology.orchestra.run.smithi163.stdout: "num_ops": 0 2024-09-12T22:32:13.452 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-09-12T22:32:13.461 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:32:13.479 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0: {} 2024-09-12T22:32:13.480 INFO:teuthology.orchestra.run.smithi019.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T22:32:13.500 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T22:32:13.500 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:32:13.514 INFO:teuthology.orchestra.run.smithi019.stdout:osd.2: {} 2024-09-12T22:32:13.515 INFO:teuthology.orchestra.run.smithi019.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T22:32:13.537 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:32:13.536+0000 7fddec6a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30331) UID: 0 2024-09-12T22:32:13.605 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:13.606 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:13.614 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:32:13.658 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:13.657+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:13.718 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:13.718 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:13.726 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:32:13.767 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:13.766+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:13.840 INFO:teuthology.orchestra.run.smithi076.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:13.840 INFO:teuthology.orchestra.run.smithi076.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:13.840 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:13.839+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:13.849 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:32:13.941 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:13.940+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:13.952 INFO:teuthology.orchestra.run.smithi076.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:13.952 INFO:teuthology.orchestra.run.smithi076.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:13.961 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:32:14.041 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:14.041+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:14.064 INFO:teuthology.orchestra.run.smithi076.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:14.064 INFO:teuthology.orchestra.run.smithi076.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:14.073 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:32:14.142 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:14.141+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:14.182 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:14.182 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:14.192 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:32:14.244 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:14.242+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:14.264 INFO:teuthology.orchestra.run.smithi019.stderr:noscrub is unset 2024-09-12T22:32:14.296 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:14.296 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:14.305 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:32:14.346 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:14.345+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:14.445 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:14.444+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:14.447 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:14.448 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:14.457 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:32:14.546 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:14.546+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:14.573 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:14.574 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:14.583 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:32:14.647 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:32:14.646+0000 7fddec6a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30331) UID: 0 2024-09-12T22:32:14.688 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:14.688 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:14.697 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:32:14.748 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:32:14.747+0000 7fddec6a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30331) UID: 0 2024-09-12T22:32:14.799 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:14.799 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:14.808 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:32:14.849 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:14.848+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:14.914 INFO:teuthology.orchestra.run.smithi076.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:14.914 INFO:teuthology.orchestra.run.smithi076.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:14.923 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:32:14.949 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:14.949+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:15.026 INFO:teuthology.orchestra.run.smithi076.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:15.027 INFO:teuthology.orchestra.run.smithi076.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:15.035 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:32:15.079 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:32:15.078+0000 7fddec6a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30331) UID: 0 2024-09-12T22:32:15.140 INFO:teuthology.orchestra.run.smithi076.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:15.140 INFO:teuthology.orchestra.run.smithi076.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:15.149 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:32:15.150 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:15.149+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:15.251 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:15.251+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:15.257 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:15.257 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:15.265 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:32:15.353 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:15.352+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:15.368 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:15.368 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:15.376 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:32:15.425 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-09-12T22:32:15.425 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-12T22:32:15.426 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '3.0', 'overage': '110', 'type': 'test-reweight-by-utilization'} 2024-09-12T22:32:15.426 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd test-reweight-by-utilization 110 3.0 2024-09-12T22:32:15.453 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:15.452+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:15.480 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:15.480 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:15.488 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:32:15.527 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T22:32:15.554 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:32:15.553+0000 7fddec6a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30331) UID: 0 2024-09-12T22:32:15.599 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:15.599 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:15.608 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:32:15.654 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:32:15.654+0000 7fddec6a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30331) UID: 0 2024-09-12T22:32:15.656 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0: {} 2024-09-12T22:32:15.656 INFO:teuthology.orchestra.run.smithi019.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T22:32:15.675 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T22:32:15.676 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:32:15.694 INFO:teuthology.orchestra.run.smithi019.stdout:osd.2: {} 2024-09-12T22:32:15.694 INFO:teuthology.orchestra.run.smithi019.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T22:32:15.711 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-09-12T22:32:15.712 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-09-12T22:32:15.712 INFO:teuthology.orchestra.run.smithi163.stdout: "complaint_time": 30, 2024-09-12T22:32:15.712 INFO:teuthology.orchestra.run.smithi163.stdout: "num_blocked_ops": 0 2024-09-12T22:32:15.712 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-09-12T22:32:15.720 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:32:15.739 INFO:teuthology.orchestra.run.smithi019.stdout:moved 0 / 210 (0%) 2024-09-12T22:32:15.739 INFO:teuthology.orchestra.run.smithi019.stdout:avg 70 2024-09-12T22:32:15.739 INFO:teuthology.orchestra.run.smithi019.stdout:stddev 2.16025 -> 2.16025 (expected baseline 6.8313) 2024-09-12T22:32:15.739 INFO:teuthology.orchestra.run.smithi019.stdout:min osd.0 with 67 -> 67 pgs (0.957143 -> 0.957143 * mean) 2024-09-12T22:32:15.739 INFO:teuthology.orchestra.run.smithi019.stdout:max osd.1 with 72 -> 72 pgs (1.02857 -> 1.02857 * mean) 2024-09-12T22:32:15.739 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:32:15.739 INFO:teuthology.orchestra.run.smithi019.stdout:oload 110 2024-09-12T22:32:15.739 INFO:teuthology.orchestra.run.smithi019.stdout:max_change 3 2024-09-12T22:32:15.739 INFO:teuthology.orchestra.run.smithi019.stdout:max_change_osds 4 2024-09-12T22:32:15.739 INFO:teuthology.orchestra.run.smithi019.stdout:average_utilization 0.0003 2024-09-12T22:32:15.739 INFO:teuthology.orchestra.run.smithi019.stdout:overload_utilization 0.0004 2024-09-12T22:32:15.740 INFO:teuthology.orchestra.run.smithi019.stderr:no change 2024-09-12T22:32:15.753 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '0.05', 'overage': '1000', 'type': 'reweight-by-utilization'} 2024-09-12T22:32:15.753 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight-by-utilization 1000 0.05 2024-09-12T22:32:15.755 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:32:15.755+0000 7fddec6a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30331) UID: 0 2024-09-12T22:32:15.826 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-09-12T22:32:15.826 INFO:teuthology.orchestra.run.smithi163.stdout: "size": 20, 2024-09-12T22:32:15.826 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 600, 2024-09-12T22:32:15.826 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2024-09-12T22:32:15.826 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.826 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-09-12T22:32:15.826 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:27.254459+0000", 2024-09-12T22:32:15.826 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 48.569262791, 2024-09-12T22:32:15.826 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.37816283899999997, 2024-09-12T22:32:15.827 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:15.827 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:15.827 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:15.827 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:15.827 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:15.827 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:15.827 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 1 2024-09-12T22:32:15.827 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.827 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:15.827 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.827 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:15.827 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254459+0000", 2024-09-12T22:32:15.827 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:15.828 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.828 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.828 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:15.828 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254459+0000", 2024-09-12T22:32:15.828 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:15.828 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.828 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.828 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:15.828 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254460+0000", 2024-09-12T22:32:15.828 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1739999999999999e-06 2024-09-12T22:32:15.828 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.829 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.829 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:15.829 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254472+0000", 2024-09-12T22:32:15.829 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2207e-05 2024-09-12T22:32:15.829 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.829 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.829 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:15.829 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254483+0000", 2024-09-12T22:32:15.829 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0631999999999999e-05 2024-09-12T22:32:15.829 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.829 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.830 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:15.830 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254492+0000", 2024-09-12T22:32:15.830 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3670000000000003e-06 2024-09-12T22:32:15.830 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.830 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.830 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:15.830 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254551+0000", 2024-09-12T22:32:15.830 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8687999999999998e-05 2024-09-12T22:32:15.830 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.830 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.830 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for peered", 2024-09-12T22:32:15.830 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254562+0000", 2024-09-12T22:32:15.830 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1249e-05 2024-09-12T22:32:15.831 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.831 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.831 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:15.831 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.631211+0000", 2024-09-12T22:32:15.831 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.376649018 2024-09-12T22:32:15.831 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.831 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.831 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:15.831 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.631345+0000", 2024-09-12T22:32:15.831 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013378700000000001 2024-09-12T22:32:15.831 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.831 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.831 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:15.832 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.631479+0000", 2024-09-12T22:32:15.832 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013352399999999999 2024-09-12T22:32:15.832 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.832 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.832 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:15.832 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632324+0000", 2024-09-12T22:32:15.832 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00084508100000000002 2024-09-12T22:32:15.832 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.832 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.833 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:15.833 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632548+0000", 2024-09-12T22:32:15.833 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000224329 2024-09-12T22:32:15.833 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.833 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.833 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:15.833 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632591+0000", 2024-09-12T22:32:15.833 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2564000000000001e-05 2024-09-12T22:32:15.833 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.833 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.833 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:15.833 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632622+0000", 2024-09-12T22:32:15.833 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1219e-05 2024-09-12T22:32:15.834 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:15.834 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:15.834 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:15.834 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.834 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.834 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:185 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:32:15.834 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394355+0000", 2024-09-12T22:32:15.834 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 47.429366694000002, 2024-09-12T22:32:15.834 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011302394, 2024-09-12T22:32:15.834 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:15.834 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:15.834 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:15.834 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:15.835 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:15.835 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:15.835 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 185 2024-09-12T22:32:15.835 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.835 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:15.835 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.835 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:15.835 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394355+0000", 2024-09-12T22:32:15.835 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:15.835 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.835 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.835 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:15.835 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394355+0000", 2024-09-12T22:32:15.835 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:15.836 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.836 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.836 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:15.836 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394355+0000", 2024-09-12T22:32:15.836 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9099999999999999e-07 2024-09-12T22:32:15.836 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.836 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.836 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:15.836 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394385+0000", 2024-09-12T22:32:15.836 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9963000000000001e-05 2024-09-12T22:32:15.836 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.836 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.836 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:15.837 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394390+0000", 2024-09-12T22:32:15.837 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8420000000000004e-06 2024-09-12T22:32:15.837 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.837 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.837 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:15.837 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394393+0000", 2024-09-12T22:32:15.837 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1e-06 2024-09-12T22:32:15.837 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.837 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.837 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:15.837 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.400546+0000", 2024-09-12T22:32:15.837 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0061523309999999996 2024-09-12T22:32:15.837 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.838 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.838 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:15.838 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.400588+0000", 2024-09-12T22:32:15.838 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1835000000000002e-05 2024-09-12T22:32:15.838 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.838 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.838 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:15.838 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.400677+0000", 2024-09-12T22:32:15.838 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9195000000000002e-05 2024-09-12T22:32:15.838 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.839 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.839 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:15.839 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405378+0000", 2024-09-12T22:32:15.839 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0047008659999999997 2024-09-12T22:32:15.839 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.839 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.839 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:15.839 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405569+0000", 2024-09-12T22:32:15.839 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00019148599999999999 2024-09-12T22:32:15.839 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.839 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.839 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:15.839 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405620+0000", 2024-09-12T22:32:15.840 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1416999999999999e-05 2024-09-12T22:32:15.840 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.840 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.840 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:15.840 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405657+0000", 2024-09-12T22:32:15.840 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6968000000000002e-05 2024-09-12T22:32:15.840 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:15.840 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:15.840 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:15.840 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.841 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.841 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:32:15.841 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394399+0000", 2024-09-12T22:32:15.841 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 47.429322483, 2024-09-12T22:32:15.841 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011336601999999999, 2024-09-12T22:32:15.841 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:15.841 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:15.841 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:15.841 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:15.841 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:15.841 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:15.841 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 186 2024-09-12T22:32:15.841 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.842 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:15.842 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.842 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:15.842 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394399+0000", 2024-09-12T22:32:15.842 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:15.842 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.842 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.842 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:15.842 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394399+0000", 2024-09-12T22:32:15.842 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:15.842 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.843 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.843 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:15.843 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394400+0000", 2024-09-12T22:32:15.843 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4499999999999998e-07 2024-09-12T22:32:15.843 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.843 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.843 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:15.843 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394402+0000", 2024-09-12T22:32:15.843 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.875e-06 2024-09-12T22:32:15.843 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.843 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.843 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:15.843 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394405+0000", 2024-09-12T22:32:15.844 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6799999999999999e-06 2024-09-12T22:32:15.844 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.844 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.844 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:15.844 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394408+0000", 2024-09-12T22:32:15.844 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.667e-06 2024-09-12T22:32:15.844 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.844 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.844 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:15.844 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401395+0000", 2024-09-12T22:32:15.844 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0069867230000000002 2024-09-12T22:32:15.844 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.844 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.845 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:15.845 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401438+0000", 2024-09-12T22:32:15.845 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3554999999999999e-05 2024-09-12T22:32:15.845 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.845 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.845 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:15.845 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401509+0000", 2024-09-12T22:32:15.845 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0631999999999997e-05 2024-09-12T22:32:15.845 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.845 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.845 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:15.845 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405392+0000", 2024-09-12T22:32:15.845 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0038830449999999999 2024-09-12T22:32:15.845 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.846 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.846 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:15.846 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405690+0000", 2024-09-12T22:32:15.846 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000298435 2024-09-12T22:32:15.846 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.846 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.846 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:15.846 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405716+0000", 2024-09-12T22:32:15.846 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5435999999999998e-05 2024-09-12T22:32:15.846 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.846 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.846 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:15.846 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405736+0000", 2024-09-12T22:32:15.847 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0208999999999999e-05 2024-09-12T22:32:15.847 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:15.847 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:15.847 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:15.847 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.847 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.847 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:32:15.847 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394411+0000", 2024-09-12T22:32:15.847 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 47.429310356999999, 2024-09-12T22:32:15.847 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011400117, 2024-09-12T22:32:15.847 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:15.847 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:15.847 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:15.847 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:15.848 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:15.848 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:15.848 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 187 2024-09-12T22:32:15.848 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.848 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:15.848 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.848 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:15.848 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394411+0000", 2024-09-12T22:32:15.848 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:15.849 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.849 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.849 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:15.849 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394411+0000", 2024-09-12T22:32:15.849 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:15.849 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.849 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.849 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:15.849 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394412+0000", 2024-09-12T22:32:15.849 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.4999999999999999e-07 2024-09-12T22:32:15.850 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.850 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.850 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:15.850 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394414+0000", 2024-09-12T22:32:15.850 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.984e-06 2024-09-12T22:32:15.850 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.850 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.850 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:15.850 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394418+0000", 2024-09-12T22:32:15.850 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0840000000000002e-06 2024-09-12T22:32:15.850 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.850 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.850 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:15.850 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394431+0000", 2024-09-12T22:32:15.851 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.361e-05 2024-09-12T22:32:15.851 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.851 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.851 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:15.851 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401778+0000", 2024-09-12T22:32:15.851 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0073462659999999997 2024-09-12T22:32:15.851 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.851 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.851 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:15.851 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401853+0000", 2024-09-12T22:32:15.851 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5797000000000006e-05 2024-09-12T22:32:15.851 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.851 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.852 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:15.852 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401990+0000", 2024-09-12T22:32:15.852 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013651399999999999 2024-09-12T22:32:15.852 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.852 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.852 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:15.852 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405402+0000", 2024-09-12T22:32:15.852 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0034116070000000001 2024-09-12T22:32:15.852 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.852 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.852 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:15.852 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405764+0000", 2024-09-12T22:32:15.852 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00036234899999999998 2024-09-12T22:32:15.853 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.853 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.853 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:15.853 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405791+0000", 2024-09-12T22:32:15.853 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7029000000000002e-05 2024-09-12T22:32:15.853 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.853 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.853 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:15.853 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405812+0000", 2024-09-12T22:32:15.853 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0627000000000001e-05 2024-09-12T22:32:15.853 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:15.853 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:15.853 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:15.854 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.854 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.854 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:32:15.854 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394447+0000", 2024-09-12T22:32:15.854 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 47.429275206, 2024-09-12T22:32:15.854 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011759588, 2024-09-12T22:32:15.854 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:15.854 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:15.854 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:15.854 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:15.854 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:15.854 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:15.854 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 188 2024-09-12T22:32:15.855 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.855 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:15.855 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.855 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:15.855 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394447+0000", 2024-09-12T22:32:15.855 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:15.855 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.855 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.855 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:15.855 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394447+0000", 2024-09-12T22:32:15.855 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:15.855 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.855 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.855 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:15.856 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394447+0000", 2024-09-12T22:32:15.856 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.15e-07 2024-09-12T22:32:15.856 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.856 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.856 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:15.856 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394512+0000", 2024-09-12T22:32:15.856 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4580999999999997e-05 2024-09-12T22:32:15.856 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.856 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.856 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:15.856 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394518+0000", 2024-09-12T22:32:15.856 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.3380000000000001e-06 2024-09-12T22:32:15.857 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.857 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.857 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:15.857 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394521+0000", 2024-09-12T22:32:15.857 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3340000000000002e-06 2024-09-12T22:32:15.857 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.857 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.857 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:15.857 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.402628+0000", 2024-09-12T22:32:15.857 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.008106996 2024-09-12T22:32:15.857 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.857 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.858 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:15.858 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.402670+0000", 2024-09-12T22:32:15.858 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1983000000000001e-05 2024-09-12T22:32:15.858 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.858 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.858 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:15.858 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.402738+0000", 2024-09-12T22:32:15.858 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.8114999999999994e-05 2024-09-12T22:32:15.858 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.858 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.858 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:15.858 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405668+0000", 2024-09-12T22:32:15.858 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.002929545 2024-09-12T22:32:15.858 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.859 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.859 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:15.859 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406162+0000", 2024-09-12T22:32:15.859 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000494408 2024-09-12T22:32:15.859 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.859 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.859 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:15.859 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406188+0000", 2024-09-12T22:32:15.859 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5766e-05 2024-09-12T22:32:15.859 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.859 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.859 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:15.859 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406206+0000", 2024-09-12T22:32:15.860 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.8107000000000001e-05 2024-09-12T22:32:15.860 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:15.860 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:15.860 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:15.860 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.860 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.860 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:32:15.860 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394528+0000", 2024-09-12T22:32:15.860 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 47.429193537000003, 2024-09-12T22:32:15.860 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.01195536, 2024-09-12T22:32:15.860 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:15.860 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:15.860 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:15.861 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:15.861 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:15.861 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:15.861 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 189 2024-09-12T22:32:15.861 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.861 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:15.861 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.861 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:15.861 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394528+0000", 2024-09-12T22:32:15.861 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:15.861 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.861 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.861 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:15.862 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394528+0000", 2024-09-12T22:32:15.862 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:15.862 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.862 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.862 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:15.862 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394529+0000", 2024-09-12T22:32:15.862 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4900000000000001e-07 2024-09-12T22:32:15.862 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.862 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.862 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:15.862 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394531+0000", 2024-09-12T22:32:15.862 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.458e-06 2024-09-12T22:32:15.862 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.862 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.863 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:15.863 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394535+0000", 2024-09-12T22:32:15.863 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7900000000000001e-06 2024-09-12T22:32:15.863 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.863 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.863 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:15.863 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394537+0000", 2024-09-12T22:32:15.863 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.632e-06 2024-09-12T22:32:15.863 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.863 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.863 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:15.863 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.404932+0000", 2024-09-12T22:32:15.863 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010394158000000001 2024-09-12T22:32:15.863 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.864 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.864 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:15.864 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405017+0000", 2024-09-12T22:32:15.864 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5525000000000005e-05 2024-09-12T22:32:15.864 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.864 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.864 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:15.864 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405114+0000", 2024-09-12T22:32:15.864 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.6527000000000006e-05 2024-09-12T22:32:15.864 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.864 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.864 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:15.864 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405818+0000", 2024-09-12T22:32:15.865 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00070412800000000005 2024-09-12T22:32:15.865 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.865 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.865 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:15.865 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406437+0000", 2024-09-12T22:32:15.865 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00061898900000000002 2024-09-12T22:32:15.865 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.865 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.865 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:15.865 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406463+0000", 2024-09-12T22:32:15.865 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6268e-05 2024-09-12T22:32:15.865 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.865 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.866 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:15.866 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406484+0000", 2024-09-12T22:32:15.866 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0536000000000001e-05 2024-09-12T22:32:15.866 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:15.866 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:15.866 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:15.866 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.866 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.866 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:15.866 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.401422+0000", 2024-09-12T22:32:15.866 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 38.422299631999998, 2024-09-12T22:32:15.866 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016896452999999999, 2024-09-12T22:32:15.866 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:15.866 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:15.867 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:15.867 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:15.867 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.867 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:15.867 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401422+0000", 2024-09-12T22:32:15.867 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:15.867 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.867 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.867 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:15.867 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401422+0000", 2024-09-12T22:32:15.867 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:15.867 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.867 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.867 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:15.868 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401424+0000", 2024-09-12T22:32:15.868 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9e-06 2024-09-12T22:32:15.868 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.868 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.868 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:15.868 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401437+0000", 2024-09-12T22:32:15.868 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2831e-05 2024-09-12T22:32:15.868 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.868 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.868 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:15.868 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401471+0000", 2024-09-12T22:32:15.868 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4010000000000001e-05 2024-09-12T22:32:15.868 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.869 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.869 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:15.869 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401484+0000", 2024-09-12T22:32:15.869 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2711000000000001e-05 2024-09-12T22:32:15.869 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.869 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.869 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:15.869 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405410+0000", 2024-09-12T22:32:15.869 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0039259170000000001 2024-09-12T22:32:15.869 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.869 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.869 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:15.869 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405529+0000", 2024-09-12T22:32:15.869 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000119778 2024-09-12T22:32:15.870 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.870 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.870 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:15.870 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405655+0000", 2024-09-12T22:32:15.870 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012556700000000001 2024-09-12T22:32:15.870 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.870 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.870 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:15.870 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410456+0000", 2024-09-12T22:32:15.870 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0048008269999999997 2024-09-12T22:32:15.870 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.870 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.870 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:15.870 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418226+0000", 2024-09-12T22:32:15.871 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0077707729999999999 2024-09-12T22:32:15.871 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.871 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.871 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:15.871 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418277+0000", 2024-09-12T22:32:15.871 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0476000000000003e-05 2024-09-12T22:32:15.871 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.871 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.871 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:15.871 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418319+0000", 2024-09-12T22:32:15.871 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1662999999999997e-05 2024-09-12T22:32:15.871 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:15.871 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:15.872 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:15.872 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.872 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.872 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:15.872 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.401505+0000", 2024-09-12T22:32:15.872 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 38.422216968000001, 2024-09-12T22:32:15.872 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016987904000000002, 2024-09-12T22:32:15.872 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:15.872 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:15.872 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:15.872 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:15.872 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.872 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:15.873 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401505+0000", 2024-09-12T22:32:15.873 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:15.873 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.873 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.873 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:15.873 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401505+0000", 2024-09-12T22:32:15.873 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:15.873 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.873 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.873 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:15.873 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401506+0000", 2024-09-12T22:32:15.873 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4700000000000001e-07 2024-09-12T22:32:15.873 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.873 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.874 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:15.874 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401510+0000", 2024-09-12T22:32:15.874 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6609999999999999e-06 2024-09-12T22:32:15.874 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.874 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.874 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:15.874 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401771+0000", 2024-09-12T22:32:15.874 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00026110700000000001 2024-09-12T22:32:15.874 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.874 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.874 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:15.874 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401921+0000", 2024-09-12T22:32:15.874 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014939099999999999 2024-09-12T22:32:15.875 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.875 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.875 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:15.875 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405944+0000", 2024-09-12T22:32:15.875 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0040235449999999999 2024-09-12T22:32:15.875 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.875 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.875 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:15.875 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406018+0000", 2024-09-12T22:32:15.875 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3373000000000004e-05 2024-09-12T22:32:15.875 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.875 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.875 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:15.875 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406172+0000", 2024-09-12T22:32:15.876 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00015435399999999999 2024-09-12T22:32:15.876 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.876 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.876 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:15.876 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410461+0000", 2024-09-12T22:32:15.876 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0042888609999999997 2024-09-12T22:32:15.876 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.876 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.876 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:15.876 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418371+0000", 2024-09-12T22:32:15.876 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0079098380000000006 2024-09-12T22:32:15.876 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.876 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.877 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:15.877 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418443+0000", 2024-09-12T22:32:15.877 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2705000000000003e-05 2024-09-12T22:32:15.877 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.877 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.877 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:15.877 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418493+0000", 2024-09-12T22:32:15.877 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9322e-05 2024-09-12T22:32:15.877 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:15.877 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:15.877 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:15.877 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.877 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.878 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:15.878 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.401939+0000", 2024-09-12T22:32:15.878 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 38.421783232000003, 2024-09-12T22:32:15.878 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016722292999999999, 2024-09-12T22:32:15.878 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:15.878 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:15.878 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:15.878 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:15.878 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.878 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:15.878 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401939+0000", 2024-09-12T22:32:15.878 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:15.878 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.879 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.879 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:15.879 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401939+0000", 2024-09-12T22:32:15.879 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:15.879 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.879 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.879 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:15.879 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401940+0000", 2024-09-12T22:32:15.879 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1990000000000001e-06 2024-09-12T22:32:15.879 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.879 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.879 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:15.879 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401956+0000", 2024-09-12T22:32:15.880 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.6344000000000001e-05 2024-09-12T22:32:15.880 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.880 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.880 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:15.880 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401974+0000", 2024-09-12T22:32:15.880 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7730000000000001e-05 2024-09-12T22:32:15.880 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.880 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.880 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:15.880 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401982+0000", 2024-09-12T22:32:15.880 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.7800000000000001e-06 2024-09-12T22:32:15.880 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.880 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.880 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:15.881 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406557+0000", 2024-09-12T22:32:15.881 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0045758489999999999 2024-09-12T22:32:15.881 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.881 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.881 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:15.881 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406697+0000", 2024-09-12T22:32:15.881 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013925100000000001 2024-09-12T22:32:15.881 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.881 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.881 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:15.881 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406830+0000", 2024-09-12T22:32:15.881 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013293499999999999 2024-09-12T22:32:15.881 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.882 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.882 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:15.882 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410465+0000", 2024-09-12T22:32:15.882 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0036352680000000001 2024-09-12T22:32:15.882 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.882 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.882 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:15.882 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418564+0000", 2024-09-12T22:32:15.882 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0080992140000000004 2024-09-12T22:32:15.882 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.882 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.882 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:15.882 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418621+0000", 2024-09-12T22:32:15.882 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7167999999999999e-05 2024-09-12T22:32:15.883 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.883 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.883 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:15.883 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418661+0000", 2024-09-12T22:32:15.883 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9555000000000003e-05 2024-09-12T22:32:15.883 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:15.883 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:15.883 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:15.883 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.883 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.883 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:15.883 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.401994+0000", 2024-09-12T22:32:15.883 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 38.421727359999998, 2024-09-12T22:32:15.884 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016804109000000001, 2024-09-12T22:32:15.884 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:15.884 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:15.884 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:15.884 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:15.884 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.884 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:15.884 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401994+0000", 2024-09-12T22:32:15.884 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:15.884 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.884 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.884 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:15.884 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401994+0000", 2024-09-12T22:32:15.884 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:15.885 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.885 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.885 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:15.885 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401995+0000", 2024-09-12T22:32:15.885 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.8899999999999998e-07 2024-09-12T22:32:15.885 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.885 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.885 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:15.885 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402000+0000", 2024-09-12T22:32:15.885 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.498e-06 2024-09-12T22:32:15.885 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.885 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.886 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:15.886 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402007+0000", 2024-09-12T22:32:15.886 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.554e-06 2024-09-12T22:32:15.886 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.886 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.886 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:15.886 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402046+0000", 2024-09-12T22:32:15.886 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9156000000000003e-05 2024-09-12T22:32:15.886 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.886 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.886 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:15.886 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407342+0000", 2024-09-12T22:32:15.886 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052957610000000004 2024-09-12T22:32:15.886 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.887 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.887 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:15.887 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407521+0000", 2024-09-12T22:32:15.887 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00017878100000000001 2024-09-12T22:32:15.887 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.887 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.887 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:15.887 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407641+0000", 2024-09-12T22:32:15.887 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012013 2024-09-12T22:32:15.887 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.887 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.887 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:15.887 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410472+0000", 2024-09-12T22:32:15.888 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.002830455 2024-09-12T22:32:15.888 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.888 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.888 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:15.888 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418714+0000", 2024-09-12T22:32:15.888 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0082422789999999999 2024-09-12T22:32:15.888 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.888 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.888 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:15.888 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418761+0000", 2024-09-12T22:32:15.888 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6956999999999998e-05 2024-09-12T22:32:15.888 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.888 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.888 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:15.889 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418799+0000", 2024-09-12T22:32:15.889 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7749000000000001e-05 2024-09-12T22:32:15.889 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:15.889 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:15.889 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:15.889 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.889 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.889 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:15.889 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.402060+0000", 2024-09-12T22:32:15.889 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 38.421661915999998, 2024-09-12T22:32:15.889 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016885686, 2024-09-12T22:32:15.889 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:15.889 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:15.889 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:15.890 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:15.890 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.890 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:15.890 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402060+0000", 2024-09-12T22:32:15.890 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:15.890 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.890 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.890 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:15.890 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402060+0000", 2024-09-12T22:32:15.890 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:15.890 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.890 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.890 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:15.890 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402061+0000", 2024-09-12T22:32:15.891 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4399999999999999e-07 2024-09-12T22:32:15.891 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.891 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.891 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:15.891 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402066+0000", 2024-09-12T22:32:15.891 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8649999999999998e-06 2024-09-12T22:32:15.891 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.891 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.891 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:15.891 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402146+0000", 2024-09-12T22:32:15.891 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9054000000000006e-05 2024-09-12T22:32:15.891 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.891 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.891 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:15.892 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402287+0000", 2024-09-12T22:32:15.892 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014108600000000001 2024-09-12T22:32:15.892 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.892 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.892 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:15.892 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408185+0000", 2024-09-12T22:32:15.892 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0058983919999999997 2024-09-12T22:32:15.892 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.892 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.892 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:15.892 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408299+0000", 2024-09-12T22:32:15.892 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114102 2024-09-12T22:32:15.893 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.893 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.893 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:15.893 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408420+0000", 2024-09-12T22:32:15.893 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000120492 2024-09-12T22:32:15.893 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.893 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.893 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:15.893 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410867+0000", 2024-09-12T22:32:15.893 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0024476430000000002 2024-09-12T22:32:15.893 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.894 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.894 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:15.894 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418851+0000", 2024-09-12T22:32:15.894 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0079841489999999994 2024-09-12T22:32:15.894 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.894 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.894 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:15.894 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418894+0000", 2024-09-12T22:32:15.894 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3090000000000002e-05 2024-09-12T22:32:15.894 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.894 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.894 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:15.894 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418946+0000", 2024-09-12T22:32:15.895 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1069000000000002e-05 2024-09-12T22:32:15.895 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:15.895 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:15.895 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:15.895 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.895 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.895 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:15.895 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.402375+0000", 2024-09-12T22:32:15.895 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 38.421346851000003, 2024-09-12T22:32:15.895 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016768531999999999, 2024-09-12T22:32:15.895 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:15.895 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:15.895 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:15.896 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:15.896 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.896 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:15.896 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402375+0000", 2024-09-12T22:32:15.896 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:15.896 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.896 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.896 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:15.896 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402375+0000", 2024-09-12T22:32:15.896 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:15.896 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.896 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.896 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:15.896 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402375+0000", 2024-09-12T22:32:15.897 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4099999999999999e-07 2024-09-12T22:32:15.897 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.897 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.897 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:15.897 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402379+0000", 2024-09-12T22:32:15.897 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9870000000000001e-06 2024-09-12T22:32:15.897 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.897 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.897 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:15.897 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402389+0000", 2024-09-12T22:32:15.897 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0000000000000001e-05 2024-09-12T22:32:15.897 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.897 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.898 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:15.898 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402401+0000", 2024-09-12T22:32:15.898 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.148e-05 2024-09-12T22:32:15.898 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.898 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.898 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:15.898 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409108+0000", 2024-09-12T22:32:15.898 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0067068429999999997 2024-09-12T22:32:15.898 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.898 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.898 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:15.898 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409189+0000", 2024-09-12T22:32:15.898 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0815999999999993e-05 2024-09-12T22:32:15.898 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.899 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.899 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:15.899 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409320+0000", 2024-09-12T22:32:15.899 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000131586 2024-09-12T22:32:15.899 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.899 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.899 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:15.899 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410872+0000", 2024-09-12T22:32:15.899 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0015521599999999999 2024-09-12T22:32:15.899 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.899 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.899 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:15.899 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419049+0000", 2024-09-12T22:32:15.899 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0081763719999999995 2024-09-12T22:32:15.900 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.900 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.900 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:15.900 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419107+0000", 2024-09-12T22:32:15.900 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7899000000000002e-05 2024-09-12T22:32:15.900 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.900 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.900 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:15.900 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419143+0000", 2024-09-12T22:32:15.900 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6847999999999997e-05 2024-09-12T22:32:15.900 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:15.900 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:15.900 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:15.901 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.901 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.901 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:15.901 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.402903+0000", 2024-09-12T22:32:15.901 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 38.420818439000001, 2024-09-12T22:32:15.901 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016378428, 2024-09-12T22:32:15.901 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:15.901 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:15.901 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:15.901 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:15.901 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.901 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:15.901 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402903+0000", 2024-09-12T22:32:15.901 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:15.902 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.902 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.902 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:15.902 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402903+0000", 2024-09-12T22:32:15.902 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:15.902 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.902 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.902 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:15.902 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402904+0000", 2024-09-12T22:32:15.902 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9500000000000001e-07 2024-09-12T22:32:15.902 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.902 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.902 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:15.902 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402944+0000", 2024-09-12T22:32:15.903 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0265000000000002e-05 2024-09-12T22:32:15.903 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.903 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.903 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:15.903 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402979+0000", 2024-09-12T22:32:15.903 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4378000000000002e-05 2024-09-12T22:32:15.903 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.903 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.903 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:15.903 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402987+0000", 2024-09-12T22:32:15.903 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3559999999999993e-06 2024-09-12T22:32:15.903 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.903 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.903 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:15.904 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409577+0000", 2024-09-12T22:32:15.904 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0065901709999999997 2024-09-12T22:32:15.904 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.904 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.904 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:15.904 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409653+0000", 2024-09-12T22:32:15.904 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5819e-05 2024-09-12T22:32:15.904 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.904 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.904 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:15.904 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409725+0000", 2024-09-12T22:32:15.904 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2200000000000007e-05 2024-09-12T22:32:15.904 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.905 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.905 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:15.905 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.411234+0000", 2024-09-12T22:32:15.905 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001508225 2024-09-12T22:32:15.905 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.905 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.905 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:15.905 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419212+0000", 2024-09-12T22:32:15.905 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0079783400000000004 2024-09-12T22:32:15.905 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.905 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.905 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:15.905 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419244+0000", 2024-09-12T22:32:15.905 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2384e-05 2024-09-12T22:32:15.906 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.906 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.906 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:15.906 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419282+0000", 2024-09-12T22:32:15.906 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7394999999999997e-05 2024-09-12T22:32:15.906 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:15.906 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:15.906 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:15.906 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.906 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.906 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:15.906 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.403135+0000", 2024-09-12T22:32:15.906 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 38.420586569000001, 2024-09-12T22:32:15.907 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016294211999999999, 2024-09-12T22:32:15.907 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:15.907 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:15.907 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:15.907 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:15.907 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.907 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:15.907 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403135+0000", 2024-09-12T22:32:15.907 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:15.907 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.907 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.907 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:15.907 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403135+0000", 2024-09-12T22:32:15.907 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:15.908 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.908 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.908 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:15.908 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403136+0000", 2024-09-12T22:32:15.908 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.4e-07 2024-09-12T22:32:15.908 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.908 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.908 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:15.908 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403149+0000", 2024-09-12T22:32:15.908 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2723e-05 2024-09-12T22:32:15.908 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.908 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.908 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:15.909 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403158+0000", 2024-09-12T22:32:15.909 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3919999999999992e-06 2024-09-12T22:32:15.909 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.909 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.909 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:15.909 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403166+0000", 2024-09-12T22:32:15.909 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.2309999999999996e-06 2024-09-12T22:32:15.909 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.909 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.909 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:15.909 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409944+0000", 2024-09-12T22:32:15.909 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0067775309999999998 2024-09-12T22:32:15.909 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.910 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.910 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:15.910 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410032+0000", 2024-09-12T22:32:15.910 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.7906999999999997e-05 2024-09-12T22:32:15.910 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.910 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.910 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:15.910 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410152+0000", 2024-09-12T22:32:15.910 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012037800000000001 2024-09-12T22:32:15.910 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.910 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.910 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:15.910 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.411945+0000", 2024-09-12T22:32:15.911 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0017931850000000001 2024-09-12T22:32:15.911 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.911 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.911 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:15.911 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419319+0000", 2024-09-12T22:32:15.911 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0073731780000000002 2024-09-12T22:32:15.911 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.911 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.911 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:15.911 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419376+0000", 2024-09-12T22:32:15.911 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7728e-05 2024-09-12T22:32:15.911 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.911 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.911 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:15.912 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419429+0000", 2024-09-12T22:32:15.912 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3019000000000002e-05 2024-09-12T22:32:15.912 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:15.912 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:15.912 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:15.912 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.912 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.912 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:15.912 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.403185+0000", 2024-09-12T22:32:15.912 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 38.420536687999999, 2024-09-12T22:32:15.912 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.014902164000000001, 2024-09-12T22:32:15.912 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:15.912 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:15.912 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:15.913 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:15.913 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.913 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:15.913 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403185+0000", 2024-09-12T22:32:15.913 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:15.913 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.913 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.913 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:15.913 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403185+0000", 2024-09-12T22:32:15.913 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:15.913 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.913 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.913 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:15.914 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403186+0000", 2024-09-12T22:32:15.914 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9400000000000005e-07 2024-09-12T22:32:15.914 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.914 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.914 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:15.914 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403191+0000", 2024-09-12T22:32:15.914 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6980000000000003e-06 2024-09-12T22:32:15.914 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.914 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.914 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:15.914 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403199+0000", 2024-09-12T22:32:15.914 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2520000000000002e-06 2024-09-12T22:32:15.914 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.915 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.915 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:15.915 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403205+0000", 2024-09-12T22:32:15.915 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.908e-06 2024-09-12T22:32:15.915 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.915 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.915 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:15.915 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403359+0000", 2024-09-12T22:32:15.915 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000154544 2024-09-12T22:32:15.915 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.915 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.915 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:15.915 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403528+0000", 2024-09-12T22:32:15.915 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000168455 2024-09-12T22:32:15.916 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.916 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.916 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:15.916 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403763+0000", 2024-09-12T22:32:15.916 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00023539599999999999 2024-09-12T22:32:15.916 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.916 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.916 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:15.916 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409378+0000", 2024-09-12T22:32:15.916 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056150000000000002 2024-09-12T22:32:15.916 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.916 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.916 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:15.916 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418012+0000", 2024-09-12T22:32:15.917 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0086339559999999999 2024-09-12T22:32:15.917 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.917 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.917 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:15.917 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418046+0000", 2024-09-12T22:32:15.917 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4267999999999998e-05 2024-09-12T22:32:15.917 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.917 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.917 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:15.917 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418087+0000", 2024-09-12T22:32:15.917 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0992999999999999e-05 2024-09-12T22:32:15.917 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:15.917 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:15.918 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:15.918 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.918 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.918 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:15.918 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.403273+0000", 2024-09-12T22:32:15.918 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 38.420448737000001, 2024-09-12T22:32:15.918 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.014934866, 2024-09-12T22:32:15.918 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:15.918 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:15.918 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:15.918 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:15.918 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.918 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:15.919 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403273+0000", 2024-09-12T22:32:15.919 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:15.919 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.919 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.919 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:15.919 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403273+0000", 2024-09-12T22:32:15.919 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:15.919 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.919 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.919 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:15.919 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403274+0000", 2024-09-12T22:32:15.919 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.297e-06 2024-09-12T22:32:15.919 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.920 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.920 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:15.920 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403282+0000", 2024-09-12T22:32:15.920 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6340000000000001e-06 2024-09-12T22:32:15.920 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.920 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.920 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:15.920 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403305+0000", 2024-09-12T22:32:15.920 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3149000000000001e-05 2024-09-12T22:32:15.920 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.920 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.920 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:15.920 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403320+0000", 2024-09-12T22:32:15.920 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4527e-05 2024-09-12T22:32:15.921 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.921 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.921 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:15.921 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.404928+0000", 2024-09-12T22:32:15.921 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001608459 2024-09-12T22:32:15.921 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.921 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.921 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:15.921 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405218+0000", 2024-09-12T22:32:15.921 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00028982900000000002 2024-09-12T22:32:15.921 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.921 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.921 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:15.922 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405829+0000", 2024-09-12T22:32:15.922 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00061127900000000005 2024-09-12T22:32:15.922 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.922 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.922 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:15.922 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409403+0000", 2024-09-12T22:32:15.922 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.003573597 2024-09-12T22:32:15.922 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.922 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.922 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:15.922 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418138+0000", 2024-09-12T22:32:15.922 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0087349969999999996 2024-09-12T22:32:15.922 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.922 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.923 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:15.923 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418178+0000", 2024-09-12T22:32:15.923 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0649999999999999e-05 2024-09-12T22:32:15.923 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.923 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.923 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:15.923 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418208+0000", 2024-09-12T22:32:15.923 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9448e-05 2024-09-12T22:32:15.923 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:15.923 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:15.923 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:15.923 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.923 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.923 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:15.924 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.405456+0000", 2024-09-12T22:32:15.924 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 38.418265591999997, 2024-09-12T22:32:15.924 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012888389, 2024-09-12T22:32:15.924 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:15.924 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:15.924 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:15.924 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:15.924 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.924 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:15.924 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405456+0000", 2024-09-12T22:32:15.924 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:15.924 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.924 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.924 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:15.925 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405456+0000", 2024-09-12T22:32:15.925 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:15.925 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.925 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.925 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:15.925 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405457+0000", 2024-09-12T22:32:15.925 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.6599999999999994e-07 2024-09-12T22:32:15.925 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.925 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.925 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:15.925 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405463+0000", 2024-09-12T22:32:15.925 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4739999999999996e-06 2024-09-12T22:32:15.925 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.926 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.926 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:15.926 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405474+0000", 2024-09-12T22:32:15.926 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1095e-05 2024-09-12T22:32:15.926 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.926 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.926 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:15.926 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405482+0000", 2024-09-12T22:32:15.926 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3610000000000001e-06 2024-09-12T22:32:15.926 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.926 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.926 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:15.926 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407051+0000", 2024-09-12T22:32:15.926 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0015688970000000001 2024-09-12T22:32:15.927 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.927 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.927 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:15.927 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407259+0000", 2024-09-12T22:32:15.927 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00020778300000000001 2024-09-12T22:32:15.927 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.927 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.927 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:15.927 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407622+0000", 2024-09-12T22:32:15.927 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000363066 2024-09-12T22:32:15.927 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.927 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.927 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:15.927 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409438+0000", 2024-09-12T22:32:15.928 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001816319 2024-09-12T22:32:15.928 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.928 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.928 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:15.928 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418257+0000", 2024-09-12T22:32:15.928 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0088187720000000008 2024-09-12T22:32:15.928 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.928 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.928 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:15.928 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418308+0000", 2024-09-12T22:32:15.928 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1180000000000001e-05 2024-09-12T22:32:15.928 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.928 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.928 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:15.929 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418345+0000", 2024-09-12T22:32:15.929 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6476000000000001e-05 2024-09-12T22:32:15.929 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:15.929 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:15.929 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:15.929 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.929 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.929 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:15.929 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.405496+0000", 2024-09-12T22:32:15.929 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 38.418226234999999, 2024-09-12T22:32:15.929 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013016012, 2024-09-12T22:32:15.929 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:15.929 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:15.930 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:15.930 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:15.930 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.930 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:15.930 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405496+0000", 2024-09-12T22:32:15.930 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:15.930 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.930 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.930 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:15.930 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405496+0000", 2024-09-12T22:32:15.930 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:15.930 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.930 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.930 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:15.931 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405496+0000", 2024-09-12T22:32:15.931 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7999999999999995e-07 2024-09-12T22:32:15.931 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.931 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.931 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:15.931 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405501+0000", 2024-09-12T22:32:15.931 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8359999999999999e-06 2024-09-12T22:32:15.931 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.931 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.931 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:15.931 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405514+0000", 2024-09-12T22:32:15.931 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2522e-05 2024-09-12T22:32:15.931 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.932 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.932 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:15.932 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405521+0000", 2024-09-12T22:32:15.932 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5020000000000003e-06 2024-09-12T22:32:15.932 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.932 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.932 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:15.932 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405575+0000", 2024-09-12T22:32:15.932 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4169999999999998e-05 2024-09-12T22:32:15.932 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.932 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.932 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:15.932 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405697+0000", 2024-09-12T22:32:15.933 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000121301 2024-09-12T22:32:15.933 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.933 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.933 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:15.933 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405829+0000", 2024-09-12T22:32:15.933 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000132662 2024-09-12T22:32:15.933 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.933 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.933 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:15.933 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409155+0000", 2024-09-12T22:32:15.933 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0033259050000000001 2024-09-12T22:32:15.933 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.933 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.934 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:15.934 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418425+0000", 2024-09-12T22:32:15.934 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0092696319999999999 2024-09-12T22:32:15.934 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.934 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.934 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:15.934 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418471+0000", 2024-09-12T22:32:15.934 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6213e-05 2024-09-12T22:32:15.934 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.934 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.934 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:15.934 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418512+0000", 2024-09-12T22:32:15.934 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0589000000000001e-05 2024-09-12T22:32:15.934 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:15.935 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:15.935 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:15.935 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.935 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.935 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:15.935 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.406108+0000", 2024-09-12T22:32:15.935 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 38.417613838000001, 2024-09-12T22:32:15.935 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012458175, 2024-09-12T22:32:15.935 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:15.935 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:15.935 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:15.935 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:15.935 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.935 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:15.936 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406108+0000", 2024-09-12T22:32:15.936 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:15.936 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.936 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.936 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:15.936 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406108+0000", 2024-09-12T22:32:15.936 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:15.936 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.936 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.936 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:15.936 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406109+0000", 2024-09-12T22:32:15.936 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9899999999999999e-07 2024-09-12T22:32:15.937 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.937 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.937 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:15.937 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406115+0000", 2024-09-12T22:32:15.937 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9030000000000001e-06 2024-09-12T22:32:15.937 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.937 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.937 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:15.937 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406141+0000", 2024-09-12T22:32:15.937 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5999e-05 2024-09-12T22:32:15.937 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.937 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.937 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:15.938 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406150+0000", 2024-09-12T22:32:15.938 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.6050000000000004e-06 2024-09-12T22:32:15.938 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.938 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.938 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:15.938 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408163+0000", 2024-09-12T22:32:15.938 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0020122769999999998 2024-09-12T22:32:15.938 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.938 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.938 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:15.938 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408309+0000", 2024-09-12T22:32:15.938 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014606999999999999 2024-09-12T22:32:15.938 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.938 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.939 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:15.939 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408433+0000", 2024-09-12T22:32:15.939 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012460300000000001 2024-09-12T22:32:15.939 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.939 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.939 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:15.939 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409903+0000", 2024-09-12T22:32:15.939 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001469499 2024-09-12T22:32:15.939 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.939 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.939 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:15.939 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418427+0000", 2024-09-12T22:32:15.939 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0085241139999999993 2024-09-12T22:32:15.939 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.940 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.940 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:15.940 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418471+0000", 2024-09-12T22:32:15.940 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4474000000000001e-05 2024-09-12T22:32:15.940 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.940 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.940 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:15.940 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418566+0000", 2024-09-12T22:32:15.940 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.4732e-05 2024-09-12T22:32:15.940 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:15.940 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:15.940 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:15.940 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.940 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.941 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:15.941 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.407266+0000", 2024-09-12T22:32:15.941 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 38.416455982000002, 2024-09-12T22:32:15.941 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011442905, 2024-09-12T22:32:15.941 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:15.941 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:15.941 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2024-09-12T22:32:15.941 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:15.941 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.941 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:15.941 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407266+0000", 2024-09-12T22:32:15.941 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:15.941 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.941 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.942 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:15.942 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407266+0000", 2024-09-12T22:32:15.942 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:15.942 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.942 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.942 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:15.942 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407266+0000", 2024-09-12T22:32:15.942 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7899999999999998e-07 2024-09-12T22:32:15.942 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.943 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.943 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:15.943 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407269+0000", 2024-09-12T22:32:15.943 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9210000000000001e-06 2024-09-12T22:32:15.943 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.943 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.943 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:15.943 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407331+0000", 2024-09-12T22:32:15.943 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1376000000000003e-05 2024-09-12T22:32:15.943 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.943 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.943 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:15.943 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407337+0000", 2024-09-12T22:32:15.944 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1929999999999998e-06 2024-09-12T22:32:15.944 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.944 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.944 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:15.944 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408974+0000", 2024-09-12T22:32:15.944 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0016367109999999999 2024-09-12T22:32:15.944 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.944 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.944 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:15.944 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409112+0000", 2024-09-12T22:32:15.944 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000137952 2024-09-12T22:32:15.944 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:15.944 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:15.945 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:15.945 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418709+0000", 2024-09-12T22:32:15.945 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0095971730000000005 2024-09-12T22:32:15.945 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:15.945 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:15.945 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:15.945 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:15.945 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:15.945 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-09-12T22:32:15.947 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:32:15.947 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:15.946+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:16.047 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:16.046+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:16.054 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-09-12T22:32:16.054 INFO:teuthology.orchestra.run.smithi076.stdout: "ops": [], 2024-09-12T22:32:16.054 INFO:teuthology.orchestra.run.smithi076.stdout: "num_ops": 0 2024-09-12T22:32:16.054 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-09-12T22:32:16.063 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:32:16.099 INFO:teuthology.orchestra.run.smithi019.stdout:moved 0 / 210 (0%) 2024-09-12T22:32:16.100 INFO:teuthology.orchestra.run.smithi019.stdout:avg 70 2024-09-12T22:32:16.100 INFO:teuthology.orchestra.run.smithi019.stdout:stddev 2.16025 -> 2.16025 (expected baseline 6.8313) 2024-09-12T22:32:16.100 INFO:teuthology.orchestra.run.smithi019.stdout:min osd.0 with 67 -> 67 pgs (0.957143 -> 0.957143 * mean) 2024-09-12T22:32:16.100 INFO:teuthology.orchestra.run.smithi019.stdout:max osd.1 with 72 -> 72 pgs (1.02857 -> 1.02857 * mean) 2024-09-12T22:32:16.100 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:32:16.100 INFO:teuthology.orchestra.run.smithi019.stdout:oload 1000 2024-09-12T22:32:16.100 INFO:teuthology.orchestra.run.smithi019.stdout:max_change 0.05 2024-09-12T22:32:16.100 INFO:teuthology.orchestra.run.smithi019.stdout:max_change_osds 4 2024-09-12T22:32:16.100 INFO:teuthology.orchestra.run.smithi019.stdout:average_utilization 0.0003 2024-09-12T22:32:16.100 INFO:teuthology.orchestra.run.smithi019.stdout:overload_utilization 0.0032 2024-09-12T22:32:16.101 INFO:teuthology.orchestra.run.smithi019.stderr:no change 2024-09-12T22:32:16.113 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '0.05', 'overage': '110', 'type': 'test-reweight-by-utilization'} 2024-09-12T22:32:16.113 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd test-reweight-by-utilization 110 0.05 2024-09-12T22:32:16.148 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:16.147+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:16.166 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-09-12T22:32:16.166 INFO:teuthology.orchestra.run.smithi076.stdout: "ops": [], 2024-09-12T22:32:16.166 INFO:teuthology.orchestra.run.smithi076.stdout: "complaint_time": 30, 2024-09-12T22:32:16.166 INFO:teuthology.orchestra.run.smithi076.stdout: "num_blocked_ops": 0 2024-09-12T22:32:16.166 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-09-12T22:32:16.174 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:32:16.249 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:32:16.248+0000 7fddec6a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30331) UID: 0 2024-09-12T22:32:16.279 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-09-12T22:32:16.280 INFO:teuthology.orchestra.run.smithi076.stdout: "size": 20, 2024-09-12T22:32:16.280 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 600, 2024-09-12T22:32:16.280 INFO:teuthology.orchestra.run.smithi076.stdout: "ops": [ 2024-09-12T22:32:16.280 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.280 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:16.280 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.400604+0000", 2024-09-12T22:32:16.280 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 38.876701335, 2024-09-12T22:32:16.280 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.017278814, 2024-09-12T22:32:16.281 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:16.281 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:16.281 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:16.281 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:16.281 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.281 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:16.281 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400604+0000", 2024-09-12T22:32:16.281 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:16.281 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.281 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.282 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:16.282 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400604+0000", 2024-09-12T22:32:16.282 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:16.282 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.282 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.282 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:16.282 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400617+0000", 2024-09-12T22:32:16.282 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.3076e-05 2024-09-12T22:32:16.282 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.282 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.283 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:16.283 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400623+0000", 2024-09-12T22:32:16.283 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.5780000000000004e-06 2024-09-12T22:32:16.283 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.283 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.283 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:16.283 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400641+0000", 2024-09-12T22:32:16.283 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.8218000000000001e-05 2024-09-12T22:32:16.283 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.284 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.284 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:16.284 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400652+0000", 2024-09-12T22:32:16.284 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.0421999999999999e-05 2024-09-12T22:32:16.284 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.284 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.284 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:16.284 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400707+0000", 2024-09-12T22:32:16.284 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.4666000000000001e-05 2024-09-12T22:32:16.285 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.285 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.285 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op must wait for map", 2024-09-12T22:32:16.285 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400711+0000", 2024-09-12T22:32:16.285 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.5340000000000001e-06 2024-09-12T22:32:16.285 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.285 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.285 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:16.285 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.412066+0000", 2024-09-12T22:32:16.286 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.011354797999999999 2024-09-12T22:32:16.286 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.286 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.286 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:16.286 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.412672+0000", 2024-09-12T22:32:16.286 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00060620499999999996 2024-09-12T22:32:16.286 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.286 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.286 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:16.286 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.413032+0000", 2024-09-12T22:32:16.286 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00035955999999999998 2024-09-12T22:32:16.287 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.287 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.287 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op_commit", 2024-09-12T22:32:16.287 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417252+0000", 2024-09-12T22:32:16.287 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.004219899 2024-09-12T22:32:16.287 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.287 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.287 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:16.287 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417812+0000", 2024-09-12T22:32:16.287 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.000560182 2024-09-12T22:32:16.287 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.287 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.287 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:16.287 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417851+0000", 2024-09-12T22:32:16.288 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.9057999999999998e-05 2024-09-12T22:32:16.288 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.288 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.288 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:16.288 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417882+0000", 2024-09-12T22:32:16.288 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.1618000000000001e-05 2024-09-12T22:32:16.288 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:16.288 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:16.288 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:16.288 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.288 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.288 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:16.288 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.400674+0000", 2024-09-12T22:32:16.289 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 38.876630617000004, 2024-09-12T22:32:16.289 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.017348971000000001, 2024-09-12T22:32:16.289 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:16.289 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:16.289 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:16.289 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:16.289 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.289 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:16.289 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400674+0000", 2024-09-12T22:32:16.289 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:16.289 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.289 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.289 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:16.289 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400674+0000", 2024-09-12T22:32:16.290 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:16.290 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.290 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.290 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:16.290 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400675+0000", 2024-09-12T22:32:16.290 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.37e-07 2024-09-12T22:32:16.290 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.290 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.290 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:16.290 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400678+0000", 2024-09-12T22:32:16.290 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.303e-06 2024-09-12T22:32:16.290 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.290 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.291 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:16.291 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400684+0000", 2024-09-12T22:32:16.291 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.0290000000000002e-06 2024-09-12T22:32:16.291 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.291 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.291 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:16.291 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400688+0000", 2024-09-12T22:32:16.291 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.0890000000000002e-06 2024-09-12T22:32:16.291 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.291 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.291 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:16.291 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400806+0000", 2024-09-12T22:32:16.291 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00011814700000000001 2024-09-12T22:32:16.291 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.292 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.292 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:32:16.292 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400811+0000", 2024-09-12T22:32:16.292 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.0479999999999998e-06 2024-09-12T22:32:16.292 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.292 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.292 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:16.292 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.413877+0000", 2024-09-12T22:32:16.292 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.013065561 2024-09-12T22:32:16.292 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.292 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.292 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:16.292 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.413984+0000", 2024-09-12T22:32:16.292 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.000106566 2024-09-12T22:32:16.293 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.293 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.293 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:16.293 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.414264+0000", 2024-09-12T22:32:16.293 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00028067199999999999 2024-09-12T22:32:16.293 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.293 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.293 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op_commit", 2024-09-12T22:32:16.293 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417614+0000", 2024-09-12T22:32:16.293 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0033500729999999999 2024-09-12T22:32:16.293 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.293 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.293 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:16.294 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417946+0000", 2024-09-12T22:32:16.294 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00033209199999999998 2024-09-12T22:32:16.294 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.294 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.294 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:16.294 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417995+0000", 2024-09-12T22:32:16.294 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.808e-05 2024-09-12T22:32:16.294 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.294 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.294 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:16.294 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.418023+0000", 2024-09-12T22:32:16.294 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.8773999999999999e-05 2024-09-12T22:32:16.294 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:16.295 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:16.295 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:16.295 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.295 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.295 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:16.295 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.400694+0000", 2024-09-12T22:32:16.295 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 38.876610988000003, 2024-09-12T22:32:16.295 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.022845628, 2024-09-12T22:32:16.295 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:16.295 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:16.295 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:16.295 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:16.295 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.295 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:16.296 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400694+0000", 2024-09-12T22:32:16.296 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:16.296 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.296 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.296 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:16.296 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400694+0000", 2024-09-12T22:32:16.296 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:16.296 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.296 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.296 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:16.296 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400694+0000", 2024-09-12T22:32:16.296 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.48e-07 2024-09-12T22:32:16.296 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.297 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.297 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:16.297 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400709+0000", 2024-09-12T22:32:16.297 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.4888999999999999e-05 2024-09-12T22:32:16.297 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.297 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.297 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:16.297 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400722+0000", 2024-09-12T22:32:16.297 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.2882e-05 2024-09-12T22:32:16.297 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.297 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.297 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:16.297 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400732+0000", 2024-09-12T22:32:16.297 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.0299000000000001e-05 2024-09-12T22:32:16.298 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.298 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.298 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:16.298 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400793+0000", 2024-09-12T22:32:16.298 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.0253000000000001e-05 2024-09-12T22:32:16.298 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.298 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.298 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op must wait for map", 2024-09-12T22:32:16.298 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400798+0000", 2024-09-12T22:32:16.298 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.1569999999999999e-06 2024-09-12T22:32:16.298 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.298 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.298 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:16.298 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415059+0000", 2024-09-12T22:32:16.299 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.014260907 2024-09-12T22:32:16.299 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.299 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.299 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:16.299 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415396+0000", 2024-09-12T22:32:16.299 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00033720799999999997 2024-09-12T22:32:16.299 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.299 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.299 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:16.299 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415685+0000", 2024-09-12T22:32:16.299 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00028939900000000003 2024-09-12T22:32:16.299 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.299 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.299 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op_commit", 2024-09-12T22:32:16.300 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.418302+0000", 2024-09-12T22:32:16.300 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0026168039999999999 2024-09-12T22:32:16.300 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.300 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.300 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:16.300 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.423445+0000", 2024-09-12T22:32:16.300 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0051428150000000002 2024-09-12T22:32:16.300 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.300 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.300 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:16.300 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.423499+0000", 2024-09-12T22:32:16.300 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.3953000000000003e-05 2024-09-12T22:32:16.300 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.300 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.301 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:16.301 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.423540+0000", 2024-09-12T22:32:16.301 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.0813999999999999e-05 2024-09-12T22:32:16.301 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:16.301 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:16.301 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:16.301 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.301 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.301 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:16.301 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.400740+0000", 2024-09-12T22:32:16.301 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 38.876565264999996, 2024-09-12T22:32:16.301 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.022927528999999999, 2024-09-12T22:32:16.301 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:16.301 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:16.302 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:16.302 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:16.302 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.302 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:16.302 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400740+0000", 2024-09-12T22:32:16.302 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:16.302 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.302 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.302 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:16.302 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400740+0000", 2024-09-12T22:32:16.302 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:16.302 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.302 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.302 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:16.303 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400740+0000", 2024-09-12T22:32:16.303 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.3000000000000001e-07 2024-09-12T22:32:16.303 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.303 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.303 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:16.303 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400743+0000", 2024-09-12T22:32:16.303 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.5840000000000002e-06 2024-09-12T22:32:16.303 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.303 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.303 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:16.303 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400757+0000", 2024-09-12T22:32:16.303 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.3988999999999999e-05 2024-09-12T22:32:16.303 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.304 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.304 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:16.304 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400763+0000", 2024-09-12T22:32:16.304 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.686e-06 2024-09-12T22:32:16.304 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.304 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.304 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:16.304 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400818+0000", 2024-09-12T22:32:16.304 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.4941000000000001e-05 2024-09-12T22:32:16.304 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.304 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.304 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:32:16.304 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400824+0000", 2024-09-12T22:32:16.304 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.4600000000000002e-06 2024-09-12T22:32:16.305 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.305 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.305 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:16.305 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416227+0000", 2024-09-12T22:32:16.305 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.015403604 2024-09-12T22:32:16.305 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.305 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.305 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:16.305 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416306+0000", 2024-09-12T22:32:16.305 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 7.9126000000000001e-05 2024-09-12T22:32:16.305 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.305 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.305 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:16.305 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416678+0000", 2024-09-12T22:32:16.306 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00037105500000000002 2024-09-12T22:32:16.306 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.306 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.306 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op_commit", 2024-09-12T22:32:16.306 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.418363+0000", 2024-09-12T22:32:16.306 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.001685095 2024-09-12T22:32:16.306 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.306 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.306 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:16.307 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.423591+0000", 2024-09-12T22:32:16.307 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0052283980000000004 2024-09-12T22:32:16.307 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.307 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.307 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:16.307 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.423624+0000", 2024-09-12T22:32:16.307 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.3024000000000001e-05 2024-09-12T22:32:16.307 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.307 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.307 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:16.307 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.423667+0000", 2024-09-12T22:32:16.307 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.3136999999999997e-05 2024-09-12T22:32:16.307 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:16.307 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:16.308 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:16.308 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.308 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.308 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:16.308 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.400783+0000", 2024-09-12T22:32:16.308 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 38.876521732999997, 2024-09-12T22:32:16.308 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.016563729999999999, 2024-09-12T22:32:16.308 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:16.308 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:16.308 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:16.308 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:16.308 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.308 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:16.308 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400783+0000", 2024-09-12T22:32:16.309 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:16.309 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.309 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.309 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:16.309 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400783+0000", 2024-09-12T22:32:16.309 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:16.309 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.309 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.309 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:16.309 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400784+0000", 2024-09-12T22:32:16.309 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.5900000000000002e-07 2024-09-12T22:32:16.309 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.309 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.309 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:16.310 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400787+0000", 2024-09-12T22:32:16.310 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.1690000000000001e-06 2024-09-12T22:32:16.310 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.310 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.310 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:16.310 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400794+0000", 2024-09-12T22:32:16.310 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 7.058e-06 2024-09-12T22:32:16.310 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.310 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.310 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:16.310 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400798+0000", 2024-09-12T22:32:16.310 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.335e-06 2024-09-12T22:32:16.310 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.311 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.311 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:16.311 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400841+0000", 2024-09-12T22:32:16.311 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.2369e-05 2024-09-12T22:32:16.311 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.311 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.311 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op must wait for map", 2024-09-12T22:32:16.311 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400844+0000", 2024-09-12T22:32:16.311 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.128e-06 2024-09-12T22:32:16.311 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.311 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.311 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:16.311 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.410479+0000", 2024-09-12T22:32:16.311 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0096354189999999992 2024-09-12T22:32:16.312 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.312 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.312 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:16.312 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.410597+0000", 2024-09-12T22:32:16.312 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.000118305 2024-09-12T22:32:16.312 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.312 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.312 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:16.312 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.410838+0000", 2024-09-12T22:32:16.312 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.000240967 2024-09-12T22:32:16.312 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.312 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.312 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op_commit", 2024-09-12T22:32:16.313 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416489+0000", 2024-09-12T22:32:16.313 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0056507989999999998 2024-09-12T22:32:16.313 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.313 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.313 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:16.313 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417255+0000", 2024-09-12T22:32:16.313 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00076626199999999998 2024-09-12T22:32:16.313 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.313 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.313 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:16.314 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417306+0000", 2024-09-12T22:32:16.314 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.0319999999999999e-05 2024-09-12T22:32:16.314 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.314 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.314 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:16.314 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417347+0000", 2024-09-12T22:32:16.314 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.1140000000000003e-05 2024-09-12T22:32:16.314 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:16.314 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:16.314 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:16.314 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.314 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.314 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:16.315 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.400811+0000", 2024-09-12T22:32:16.315 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 38.876493664000002, 2024-09-12T22:32:16.315 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.017061263, 2024-09-12T22:32:16.315 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:16.315 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:16.315 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:16.315 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:16.315 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.315 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:16.316 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400811+0000", 2024-09-12T22:32:16.316 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:16.316 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.316 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.316 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:16.316 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400811+0000", 2024-09-12T22:32:16.316 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:16.316 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.316 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.316 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:16.316 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400812+0000", 2024-09-12T22:32:16.316 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.27e-07 2024-09-12T22:32:16.317 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.317 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.317 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:16.317 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400814+0000", 2024-09-12T22:32:16.317 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.553e-06 2024-09-12T22:32:16.317 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.317 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.317 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:16.317 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400819+0000", 2024-09-12T22:32:16.318 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.3569999999999997e-06 2024-09-12T22:32:16.318 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.318 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.318 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:16.318 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400824+0000", 2024-09-12T22:32:16.318 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.6820000000000002e-06 2024-09-12T22:32:16.318 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.318 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.318 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:16.318 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400871+0000", 2024-09-12T22:32:16.318 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.7311000000000002e-05 2024-09-12T22:32:16.319 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.319 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.319 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:32:16.319 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400875+0000", 2024-09-12T22:32:16.319 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.0960000000000001e-06 2024-09-12T22:32:16.319 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.319 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.319 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:16.319 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.412071+0000", 2024-09-12T22:32:16.319 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.011195999999999999 2024-09-12T22:32:16.319 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.320 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.320 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:16.320 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.412520+0000", 2024-09-12T22:32:16.320 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.000449522 2024-09-12T22:32:16.320 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.320 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.320 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:16.320 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.412655+0000", 2024-09-12T22:32:16.320 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00013487899999999999 2024-09-12T22:32:16.320 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.321 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.321 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op_commit", 2024-09-12T22:32:16.321 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417096+0000", 2024-09-12T22:32:16.321 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.004441113 2024-09-12T22:32:16.321 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.321 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.321 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:16.321 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417768+0000", 2024-09-12T22:32:16.322 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00067161100000000002 2024-09-12T22:32:16.322 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.322 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.322 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:16.322 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417834+0000", 2024-09-12T22:32:16.322 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.6058999999999999e-05 2024-09-12T22:32:16.322 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.322 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.322 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:16.323 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417873+0000", 2024-09-12T22:32:16.323 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.8753e-05 2024-09-12T22:32:16.323 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:16.323 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:16.323 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:16.323 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.323 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.323 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:16.323 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.400842+0000", 2024-09-12T22:32:16.323 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 38.876462957000001, 2024-09-12T22:32:16.323 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.022846262999999999, 2024-09-12T22:32:16.323 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:16.324 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:16.324 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:16.324 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:16.324 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.324 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:16.324 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400842+0000", 2024-09-12T22:32:16.324 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:16.324 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.324 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.324 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:16.324 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400842+0000", 2024-09-12T22:32:16.324 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:16.325 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.325 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.325 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:16.325 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400842+0000", 2024-09-12T22:32:16.325 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.9900000000000002e-07 2024-09-12T22:32:16.325 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.325 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.325 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:16.325 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400845+0000", 2024-09-12T22:32:16.325 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.8609999999999998e-06 2024-09-12T22:32:16.325 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.325 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.325 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:16.326 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400850+0000", 2024-09-12T22:32:16.326 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.634e-06 2024-09-12T22:32:16.326 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.326 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.326 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:16.326 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400855+0000", 2024-09-12T22:32:16.326 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.8339999999999998e-06 2024-09-12T22:32:16.326 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.326 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.326 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:16.326 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400886+0000", 2024-09-12T22:32:16.326 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.1393999999999998e-05 2024-09-12T22:32:16.326 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.326 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.326 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:32:16.327 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400888+0000", 2024-09-12T22:32:16.327 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.3470000000000001e-06 2024-09-12T22:32:16.327 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.327 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.327 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:16.327 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415640+0000", 2024-09-12T22:32:16.327 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.014751965000000001 2024-09-12T22:32:16.327 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.327 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.327 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:16.327 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415821+0000", 2024-09-12T22:32:16.327 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00018064399999999999 2024-09-12T22:32:16.328 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.328 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.328 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:16.328 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415949+0000", 2024-09-12T22:32:16.328 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00012816699999999999 2024-09-12T22:32:16.328 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.328 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.328 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op_commit", 2024-09-12T22:32:16.328 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.418337+0000", 2024-09-12T22:32:16.328 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0023878469999999998 2024-09-12T22:32:16.328 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.328 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.328 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:16.329 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.423588+0000", 2024-09-12T22:32:16.329 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0052509849999999997 2024-09-12T22:32:16.329 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.329 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.329 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:16.329 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.423650+0000", 2024-09-12T22:32:16.329 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.2026999999999994e-05 2024-09-12T22:32:16.329 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.329 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.329 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:16.329 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.423688+0000", 2024-09-12T22:32:16.329 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.8259000000000001e-05 2024-09-12T22:32:16.329 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:16.330 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:16.330 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:16.330 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.330 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.330 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:16.330 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.400862+0000", 2024-09-12T22:32:16.330 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 38.876442982999997, 2024-09-12T22:32:16.330 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.016404294, 2024-09-12T22:32:16.330 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:16.330 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:16.330 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "started", 2024-09-12T22:32:16.330 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:16.330 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.330 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:16.331 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400862+0000", 2024-09-12T22:32:16.331 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:16.331 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.331 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.331 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:16.331 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400862+0000", 2024-09-12T22:32:16.331 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:16.331 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.331 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.331 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:16.331 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400862+0000", 2024-09-12T22:32:16.331 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.8099999999999999e-07 2024-09-12T22:32:16.331 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.332 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.332 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:16.332 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400870+0000", 2024-09-12T22:32:16.332 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 8.1349999999999992e-06 2024-09-12T22:32:16.332 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.332 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.332 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:16.332 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400876+0000", 2024-09-12T22:32:16.332 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.2039999999999996e-06 2024-09-12T22:32:16.332 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.332 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.332 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:16.332 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400879+0000", 2024-09-12T22:32:16.333 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.529e-06 2024-09-12T22:32:16.333 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.333 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.333 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:16.333 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400912+0000", 2024-09-12T22:32:16.333 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.2653000000000001e-05 2024-09-12T22:32:16.333 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.333 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.333 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op must wait for map", 2024-09-12T22:32:16.333 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400915+0000", 2024-09-12T22:32:16.333 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.1099999999999999e-06 2024-09-12T22:32:16.333 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.333 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.333 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:16.334 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408727+0000", 2024-09-12T22:32:16.334 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0078123869999999996 2024-09-12T22:32:16.334 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.334 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.334 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:16.334 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408838+0000", 2024-09-12T22:32:16.334 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00011042700000000001 2024-09-12T22:32:16.334 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.334 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.334 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:16.334 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417266+0000", 2024-09-12T22:32:16.334 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0084285680000000009 2024-09-12T22:32:16.334 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:16.335 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:16.335 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:16.335 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.335 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.335 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:16.335 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.400889+0000", 2024-09-12T22:32:16.335 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 38.876415729999998, 2024-09-12T22:32:16.335 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.014929550999999999, 2024-09-12T22:32:16.335 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:16.335 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:16.335 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "started", 2024-09-12T22:32:16.336 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:16.336 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.336 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:16.336 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400889+0000", 2024-09-12T22:32:16.336 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:16.336 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.336 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.336 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:16.336 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400889+0000", 2024-09-12T22:32:16.336 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:16.336 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.336 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.336 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:16.337 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400890+0000", 2024-09-12T22:32:16.337 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.8699999999999995e-07 2024-09-12T22:32:16.337 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.337 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.337 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:16.337 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400893+0000", 2024-09-12T22:32:16.337 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.9569999999999998e-06 2024-09-12T22:32:16.337 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.337 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.337 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:16.337 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400899+0000", 2024-09-12T22:32:16.337 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.4189999999999999e-06 2024-09-12T22:32:16.337 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.338 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.338 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:16.338 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400905+0000", 2024-09-12T22:32:16.338 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.7880000000000003e-06 2024-09-12T22:32:16.338 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.338 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.338 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:16.338 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400943+0000", 2024-09-12T22:32:16.338 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.7852999999999998e-05 2024-09-12T22:32:16.338 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.338 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.338 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op must wait for map", 2024-09-12T22:32:16.338 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400945+0000", 2024-09-12T22:32:16.339 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.627e-06 2024-09-12T22:32:16.339 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.339 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.339 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:16.339 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408398+0000", 2024-09-12T22:32:16.339 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0074525879999999996 2024-09-12T22:32:16.339 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.339 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.339 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:16.339 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408581+0000", 2024-09-12T22:32:16.339 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00018321900000000001 2024-09-12T22:32:16.339 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.339 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.340 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:16.340 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415819+0000", 2024-09-12T22:32:16.340 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0072376130000000004 2024-09-12T22:32:16.340 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:16.340 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:16.340 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:16.340 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.340 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.340 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:25 3.7 e19/17 3:e0b41d06:::609.00000000:head v 19'2, mlcod=0'0)", 2024-09-12T22:32:16.340 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.402511+0000", 2024-09-12T22:32:16.340 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 38.874793586999999, 2024-09-12T22:32:16.340 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0089735260000000008, 2024-09-12T22:32:16.340 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:16.340 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:16.341 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:16.341 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:16.341 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.341 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:16.341 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.402511+0000", 2024-09-12T22:32:16.341 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:16.341 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.341 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.341 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:16.341 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.402511+0000", 2024-09-12T22:32:16.341 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:16.341 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.341 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.342 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:16.342 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.402512+0000", 2024-09-12T22:32:16.342 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 8.71e-07 2024-09-12T22:32:16.342 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.342 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.342 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:16.342 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.402520+0000", 2024-09-12T22:32:16.342 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 7.8529999999999992e-06 2024-09-12T22:32:16.342 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.342 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.342 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:16.342 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.402530+0000", 2024-09-12T22:32:16.342 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 9.859e-06 2024-09-12T22:32:16.343 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.343 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.343 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:16.343 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.402555+0000", 2024-09-12T22:32:16.343 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.4822000000000001e-05 2024-09-12T22:32:16.343 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.343 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.343 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:16.343 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.403173+0000", 2024-09-12T22:32:16.343 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00061813199999999997 2024-09-12T22:32:16.343 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.343 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.344 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:16.344 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.403195+0000", 2024-09-12T22:32:16.344 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.2286e-05 2024-09-12T22:32:16.344 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.344 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.344 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:16.344 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.411436+0000", 2024-09-12T22:32:16.344 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0082410539999999994 2024-09-12T22:32:16.344 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.344 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.345 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:16.345 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.411485+0000", 2024-09-12T22:32:16.345 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.8649000000000001e-05 2024-09-12T22:32:16.345 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:16.345 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:16.345 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:16.345 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.345 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.345 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:18 3.14 e19/17 3:2f55791f:::606.00000000:head v 19'1, mlcod=0'0)", 2024-09-12T22:32:16.345 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.406646+0000", 2024-09-12T22:32:16.345 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 38.870658435000003, 2024-09-12T22:32:16.346 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0082036980000000006, 2024-09-12T22:32:16.346 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:16.346 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:16.346 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:16.346 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:16.346 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.346 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:16.346 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406646+0000", 2024-09-12T22:32:16.346 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:16.346 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.346 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.346 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:16.346 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406646+0000", 2024-09-12T22:32:16.347 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:16.347 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.347 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.347 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:16.347 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406647+0000", 2024-09-12T22:32:16.347 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.4499999999999998e-07 2024-09-12T22:32:16.347 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.347 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.347 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:16.348 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406651+0000", 2024-09-12T22:32:16.348 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.0300000000000004e-06 2024-09-12T22:32:16.348 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.348 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.348 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:16.348 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406657+0000", 2024-09-12T22:32:16.348 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.1330000000000004e-06 2024-09-12T22:32:16.348 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.348 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.348 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:16.348 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406665+0000", 2024-09-12T22:32:16.348 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 8.3650000000000004e-06 2024-09-12T22:32:16.349 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.349 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.349 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:16.349 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406804+0000", 2024-09-12T22:32:16.349 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00013900699999999999 2024-09-12T22:32:16.349 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.349 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.349 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:16.349 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406833+0000", 2024-09-12T22:32:16.349 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.8243e-05 2024-09-12T22:32:16.350 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.350 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.350 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:16.350 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.414741+0000", 2024-09-12T22:32:16.350 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0079089620000000003 2024-09-12T22:32:16.350 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.350 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.350 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:16.350 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.414850+0000", 2024-09-12T22:32:16.350 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.000108713 2024-09-12T22:32:16.350 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:16.350 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:16.351 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:16.351 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.351 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.351 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:6 3.10 e19/17 3:0d82a743:::600.00000000:head v 19'1, mlcod=0'0)", 2024-09-12T22:32:16.351 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.406692+0000", 2024-09-12T22:32:16.351 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 38.870612668, 2024-09-12T22:32:16.351 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0093004430000000003, 2024-09-12T22:32:16.351 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:16.351 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:16.352 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:16.352 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:16.352 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.352 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:16.352 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406692+0000", 2024-09-12T22:32:16.352 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:16.352 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.352 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.352 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:16.352 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406692+0000", 2024-09-12T22:32:16.352 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:16.353 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.353 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.353 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:16.353 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406693+0000", 2024-09-12T22:32:16.353 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.6300000000000001e-07 2024-09-12T22:32:16.353 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.353 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.353 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:16.353 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406702+0000", 2024-09-12T22:32:16.353 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 9.5589999999999994e-06 2024-09-12T22:32:16.354 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.354 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.354 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:16.354 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406725+0000", 2024-09-12T22:32:16.354 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.2977999999999999e-05 2024-09-12T22:32:16.354 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.354 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.354 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:16.354 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406732+0000", 2024-09-12T22:32:16.354 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.8430000000000004e-06 2024-09-12T22:32:16.355 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.355 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.355 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:16.355 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406979+0000", 2024-09-12T22:32:16.355 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00024729199999999998 2024-09-12T22:32:16.355 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.355 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.355 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:16.355 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407000+0000", 2024-09-12T22:32:16.355 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.0573000000000001e-05 2024-09-12T22:32:16.356 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.356 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.356 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:16.356 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415928+0000", 2024-09-12T22:32:16.356 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0089286179999999993 2024-09-12T22:32:16.356 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.356 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.356 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:16.356 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415993+0000", 2024-09-12T22:32:16.357 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.4216999999999999e-05 2024-09-12T22:32:16.357 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:16.357 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:16.357 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:16.357 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.357 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.357 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:2 3.f e19/17 3:f1f69726:::400.00000000:head v 19'1, mlcod=0'0)", 2024-09-12T22:32:16.357 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.406942+0000", 2024-09-12T22:32:16.357 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 38.870362981, 2024-09-12T22:32:16.357 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0098433259999999995, 2024-09-12T22:32:16.357 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:16.357 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:16.357 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:16.358 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:16.358 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.358 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:16.358 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406942+0000", 2024-09-12T22:32:16.358 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:16.358 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.358 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.358 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:16.358 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406942+0000", 2024-09-12T22:32:16.358 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:16.358 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.358 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.358 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:16.359 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406943+0000", 2024-09-12T22:32:16.359 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.8800000000000002e-07 2024-09-12T22:32:16.359 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.359 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.359 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:16.359 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406949+0000", 2024-09-12T22:32:16.359 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.5869999999999998e-06 2024-09-12T22:32:16.359 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.359 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.359 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:16.359 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406960+0000", 2024-09-12T22:32:16.359 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.0873000000000001e-05 2024-09-12T22:32:16.359 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.359 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.360 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:16.360 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406970+0000", 2024-09-12T22:32:16.360 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 9.9119999999999993e-06 2024-09-12T22:32:16.360 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.360 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.360 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:16.360 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407535+0000", 2024-09-12T22:32:16.360 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00056508899999999996 2024-09-12T22:32:16.360 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.360 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.360 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:16.361 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407556+0000", 2024-09-12T22:32:16.361 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.1348999999999998e-05 2024-09-12T22:32:16.361 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.361 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.361 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:16.361 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416751+0000", 2024-09-12T22:32:16.361 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0091950109999999995 2024-09-12T22:32:16.361 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.361 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.361 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:16.361 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416785+0000", 2024-09-12T22:32:16.361 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.3917000000000001e-05 2024-09-12T22:32:16.361 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:16.362 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:16.362 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:16.362 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.362 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.362 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:19 3.14 e19/17 3:2f55791f:::606.00000000:head v 19'2, mlcod=0'0)", 2024-09-12T22:32:16.362 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.406983+0000", 2024-09-12T22:32:16.362 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 38.870322002000002, 2024-09-12T22:32:16.362 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0080362149999999993, 2024-09-12T22:32:16.362 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:16.362 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:16.362 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:16.362 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:16.362 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.363 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:16.363 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406983+0000", 2024-09-12T22:32:16.363 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:16.363 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.363 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.363 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:16.363 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406983+0000", 2024-09-12T22:32:16.363 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:16.363 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.363 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.363 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:16.363 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406983+0000", 2024-09-12T22:32:16.363 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.8200000000000001e-07 2024-09-12T22:32:16.364 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.364 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.364 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:16.364 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406999+0000", 2024-09-12T22:32:16.364 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.5747999999999999e-05 2024-09-12T22:32:16.364 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.364 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.364 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:16.364 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407006+0000", 2024-09-12T22:32:16.364 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 7.2609999999999996e-06 2024-09-12T22:32:16.364 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.364 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.364 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:16.365 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407035+0000", 2024-09-12T22:32:16.365 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.8214000000000001e-05 2024-09-12T22:32:16.365 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.365 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.365 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:16.365 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407092+0000", 2024-09-12T22:32:16.365 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.7027000000000001e-05 2024-09-12T22:32:16.365 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.365 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.365 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:16.365 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407126+0000", 2024-09-12T22:32:16.365 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.4082000000000003e-05 2024-09-12T22:32:16.365 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.365 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.366 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:16.366 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.414985+0000", 2024-09-12T22:32:16.366 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0078597319999999995 2024-09-12T22:32:16.366 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.366 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.366 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:16.366 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415019+0000", 2024-09-12T22:32:16.366 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.3769000000000001e-05 2024-09-12T22:32:16.366 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:16.366 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:16.366 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:16.366 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.366 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.366 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:7 3.10 e19/17 3:0d82a743:::600.00000000:head v 19'2, mlcod=0'0)", 2024-09-12T22:32:16.366 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.407048+0000", 2024-09-12T22:32:16.367 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 38.870256464000001, 2024-09-12T22:32:16.367 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.008979931, 2024-09-12T22:32:16.367 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:16.367 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:16.367 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:16.367 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:16.367 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.367 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:16.367 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407048+0000", 2024-09-12T22:32:16.367 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:16.367 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.367 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.367 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:16.368 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407048+0000", 2024-09-12T22:32:16.368 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:16.368 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.368 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.368 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:16.368 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407049+0000", 2024-09-12T22:32:16.368 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.9099999999999999e-07 2024-09-12T22:32:16.368 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.368 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.368 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:16.368 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407054+0000", 2024-09-12T22:32:16.368 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.1850000000000003e-06 2024-09-12T22:32:16.369 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.369 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.369 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:16.369 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407061+0000", 2024-09-12T22:32:16.369 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 7.0809999999999996e-06 2024-09-12T22:32:16.369 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.369 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.369 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:16.369 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407067+0000", 2024-09-12T22:32:16.369 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.9540000000000001e-06 2024-09-12T22:32:16.369 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.369 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.369 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:16.370 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407299+0000", 2024-09-12T22:32:16.370 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.000232122 2024-09-12T22:32:16.370 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.370 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.370 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:16.370 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407317+0000", 2024-09-12T22:32:16.370 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.7447000000000001e-05 2024-09-12T22:32:16.370 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.370 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.370 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:16.370 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415996+0000", 2024-09-12T22:32:16.370 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0086791799999999999 2024-09-12T22:32:16.370 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.370 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.371 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:16.371 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416028+0000", 2024-09-12T22:32:16.371 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.2570999999999997e-05 2024-09-12T22:32:16.371 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:16.371 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:16.371 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:16.371 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.371 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.371 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:8 3.10 e19/17 3:09401a81:::601.00000000:head v 19'3, mlcod=0'0)", 2024-09-12T22:32:16.371 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.407081+0000", 2024-09-12T22:32:16.371 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 38.870223774000003, 2024-09-12T22:32:16.371 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0089807270000000008, 2024-09-12T22:32:16.371 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:16.371 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:16.372 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:16.372 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:16.372 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.372 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:16.372 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407081+0000", 2024-09-12T22:32:16.372 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:16.372 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.372 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.372 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:16.372 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407081+0000", 2024-09-12T22:32:16.372 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:16.372 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.372 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.373 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:16.373 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407082+0000", 2024-09-12T22:32:16.373 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.7899999999999999e-07 2024-09-12T22:32:16.373 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.373 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.373 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:16.373 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407086+0000", 2024-09-12T22:32:16.373 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.7679999999999999e-06 2024-09-12T22:32:16.373 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.373 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.373 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:16.373 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407094+0000", 2024-09-12T22:32:16.373 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 8.1470000000000001e-06 2024-09-12T22:32:16.373 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.374 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.374 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:16.374 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407100+0000", 2024-09-12T22:32:16.374 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.4539999999999998e-06 2024-09-12T22:32:16.374 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.374 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.374 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:16.374 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407540+0000", 2024-09-12T22:32:16.374 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00043973699999999999 2024-09-12T22:32:16.374 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.374 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.374 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:16.374 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407553+0000", 2024-09-12T22:32:16.375 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.3368e-05 2024-09-12T22:32:16.375 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.375 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.375 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:16.375 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416032+0000", 2024-09-12T22:32:16.375 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0084793790000000004 2024-09-12T22:32:16.375 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.375 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.375 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:16.375 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416062+0000", 2024-09-12T22:32:16.375 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.9495000000000001e-05 2024-09-12T22:32:16.375 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:16.375 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:16.375 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:16.376 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.376 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.376 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:31 3.d e19/17 3:b50e409b:::mds_snaptable:head v 19'1, mlcod=0'0)", 2024-09-12T22:32:16.376 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.408508+0000", 2024-09-12T22:32:16.376 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 38.868797258000001, 2024-09-12T22:32:16.376 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0080056620000000002, 2024-09-12T22:32:16.376 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:16.376 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:16.376 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:16.376 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:16.376 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.376 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:16.376 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408508+0000", 2024-09-12T22:32:16.377 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:16.377 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.377 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.377 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:16.377 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408508+0000", 2024-09-12T22:32:16.377 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:16.377 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.377 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.377 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:16.377 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408508+0000", 2024-09-12T22:32:16.377 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.7e-07 2024-09-12T22:32:16.377 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.378 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.378 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:16.378 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408515+0000", 2024-09-12T22:32:16.378 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.4439999999999996e-06 2024-09-12T22:32:16.378 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.378 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.378 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:16.378 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408521+0000", 2024-09-12T22:32:16.379 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.2729999999999999e-06 2024-09-12T22:32:16.379 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.379 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.379 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:16.379 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408526+0000", 2024-09-12T22:32:16.379 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.3299999999999998e-06 2024-09-12T22:32:16.379 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.379 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.379 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:16.379 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.410190+0000", 2024-09-12T22:32:16.379 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.001663615 2024-09-12T22:32:16.380 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.380 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.380 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:16.380 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.410258+0000", 2024-09-12T22:32:16.380 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.8146999999999997e-05 2024-09-12T22:32:16.380 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.380 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.380 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:16.380 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416477+0000", 2024-09-12T22:32:16.380 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0062187329999999997 2024-09-12T22:32:16.381 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.381 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.381 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:16.381 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416513+0000", 2024-09-12T22:32:16.381 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.6650000000000003e-05 2024-09-12T22:32:16.381 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:16.381 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:16.381 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:16.381 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.381 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.382 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:9 3.10 e19/17 3:09401a81:::601.00000000:head v 19'4, mlcod=0'0)", 2024-09-12T22:32:16.382 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.408991+0000", 2024-09-12T22:32:16.382 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 38.868313508, 2024-09-12T22:32:16.382 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0080459209999999993, 2024-09-12T22:32:16.382 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:16.382 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:16.382 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:16.382 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:16.382 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.382 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:16.382 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408991+0000", 2024-09-12T22:32:16.382 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:16.382 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.382 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.383 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:16.383 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408991+0000", 2024-09-12T22:32:16.383 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:16.383 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.383 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.383 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:16.383 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408992+0000", 2024-09-12T22:32:16.383 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.1799999999999995e-07 2024-09-12T22:32:16.383 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.383 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.383 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:16.383 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409005+0000", 2024-09-12T22:32:16.383 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.261e-05 2024-09-12T22:32:16.384 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.384 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.384 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:16.384 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409015+0000", 2024-09-12T22:32:16.384 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.0001e-05 2024-09-12T22:32:16.384 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.384 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.384 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:16.384 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409023+0000", 2024-09-12T22:32:16.384 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 8.7569999999999993e-06 2024-09-12T22:32:16.384 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.384 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.384 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:16.384 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.411355+0000", 2024-09-12T22:32:16.385 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0023313520000000001 2024-09-12T22:32:16.385 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.385 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.385 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:16.385 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.411374+0000", 2024-09-12T22:32:16.385 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.8810000000000001e-05 2024-09-12T22:32:16.385 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.385 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.385 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:16.385 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416994+0000", 2024-09-12T22:32:16.385 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.005620524 2024-09-12T22:32:16.386 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.386 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.386 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:16.386 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417037+0000", 2024-09-12T22:32:16.386 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.3248999999999999e-05 2024-09-12T22:32:16.386 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:16.386 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:16.386 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:16.386 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.386 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.386 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:10 3.10 e19/17 3:0bd6d154:::602.00000000:head v 19'5, mlcod=0'0)", 2024-09-12T22:32:16.386 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.409038+0000", 2024-09-12T22:32:16.386 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 38.868266833, 2024-09-12T22:32:16.386 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0080541689999999999, 2024-09-12T22:32:16.387 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:16.387 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:16.387 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:16.387 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:16.387 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.387 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:16.387 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409038+0000", 2024-09-12T22:32:16.387 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:16.387 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.387 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.387 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:16.387 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409038+0000", 2024-09-12T22:32:16.387 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:16.388 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.388 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.388 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:16.388 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409038+0000", 2024-09-12T22:32:16.388 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.7899999999999999e-07 2024-09-12T22:32:16.388 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.388 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.388 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:16.388 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409043+0000", 2024-09-12T22:32:16.388 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.6589999999999998e-06 2024-09-12T22:32:16.388 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.389 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.389 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:16.389 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409050+0000", 2024-09-12T22:32:16.389 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 7.0829999999999998e-06 2024-09-12T22:32:16.389 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.389 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.389 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:16.389 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409058+0000", 2024-09-12T22:32:16.389 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 7.7309999999999993e-06 2024-09-12T22:32:16.389 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.390 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.390 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:16.390 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.411654+0000", 2024-09-12T22:32:16.390 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0025961650000000001 2024-09-12T22:32:16.390 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.390 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.390 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:16.390 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.411671+0000", 2024-09-12T22:32:16.390 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.7356000000000001e-05 2024-09-12T22:32:16.390 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.390 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.391 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:16.391 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417040+0000", 2024-09-12T22:32:16.391 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0053681889999999998 2024-09-12T22:32:16.391 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.391 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.391 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:16.391 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417092+0000", 2024-09-12T22:32:16.391 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.2607e-05 2024-09-12T22:32:16.391 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:16.392 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:16.392 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:16.392 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.392 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.392 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:11 3.10 e19/17 3:0bd6d154:::602.00000000:head v 19'6, mlcod=0'0)", 2024-09-12T22:32:16.392 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.409768+0000", 2024-09-12T22:32:16.392 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 38.867537392000003, 2024-09-12T22:32:16.392 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0074442759999999997, 2024-09-12T22:32:16.392 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:16.393 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:16.393 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:16.393 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:16.393 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.393 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:16.393 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409768+0000", 2024-09-12T22:32:16.393 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:16.393 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.394 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.394 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:16.394 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409768+0000", 2024-09-12T22:32:16.394 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:16.394 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.394 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.394 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:16.394 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409768+0000", 2024-09-12T22:32:16.394 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.37e-07 2024-09-12T22:32:16.394 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.394 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.394 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:16.394 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409775+0000", 2024-09-12T22:32:16.395 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.4670000000000001e-06 2024-09-12T22:32:16.395 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.395 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.395 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:16.395 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409793+0000", 2024-09-12T22:32:16.395 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.8162e-05 2024-09-12T22:32:16.395 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.395 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.395 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:16.395 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409954+0000", 2024-09-12T22:32:16.395 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00016072999999999999 2024-09-12T22:32:16.395 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.395 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.395 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:16.396 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.411943+0000", 2024-09-12T22:32:16.396 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0019897069999999998 2024-09-12T22:32:16.396 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.396 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.396 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:16.396 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.412069+0000", 2024-09-12T22:32:16.396 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00012546200000000001 2024-09-12T22:32:16.396 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.396 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.396 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:16.396 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417114+0000", 2024-09-12T22:32:16.396 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.005045023 2024-09-12T22:32:16.396 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:16.396 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:16.397 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:16.397 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417212+0000", 2024-09-12T22:32:16.397 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 9.8088e-05 2024-09-12T22:32:16.397 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:16.397 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:16.397 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:16.397 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:16.397 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:16.397 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-09-12T22:32:16.397 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T22:32:16.399 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:32:16.400 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:32:16.398+0000 7fddec6a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30331) UID: 0 2024-09-12T22:32:16.429 INFO:teuthology.orchestra.run.smithi019.stdout:moved 0 / 210 (0%) 2024-09-12T22:32:16.429 INFO:teuthology.orchestra.run.smithi019.stdout:avg 70 2024-09-12T22:32:16.429 INFO:teuthology.orchestra.run.smithi019.stdout:stddev 2.16025 -> 2.16025 (expected baseline 6.8313) 2024-09-12T22:32:16.429 INFO:teuthology.orchestra.run.smithi019.stdout:min osd.0 with 67 -> 67 pgs (0.957143 -> 0.957143 * mean) 2024-09-12T22:32:16.429 INFO:teuthology.orchestra.run.smithi019.stdout:max osd.1 with 72 -> 72 pgs (1.02857 -> 1.02857 * mean) 2024-09-12T22:32:16.429 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:32:16.429 INFO:teuthology.orchestra.run.smithi019.stdout:oload 110 2024-09-12T22:32:16.429 INFO:teuthology.orchestra.run.smithi019.stdout:max_change 0.05 2024-09-12T22:32:16.430 INFO:teuthology.orchestra.run.smithi019.stdout:max_change_osds 4 2024-09-12T22:32:16.430 INFO:teuthology.orchestra.run.smithi019.stdout:average_utilization 0.0003 2024-09-12T22:32:16.430 INFO:teuthology.orchestra.run.smithi019.stdout:overload_utilization 0.0004 2024-09-12T22:32:16.430 INFO:teuthology.orchestra.run.smithi019.stderr:no change 2024-09-12T22:32:16.444 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '0.05', 'overage': '110', 'type': 'reweight-by-utilization'} 2024-09-12T22:32:16.444 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight-by-utilization 110 0.05 2024-09-12T22:32:16.500 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:16.499+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:16.514 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:32:16.514 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:32:16.514 INFO:teuthology.orchestra.run.smithi148.stdout: "num_ops": 0 2024-09-12T22:32:16.514 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:32:16.524 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:32:16.601 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:32:16.600+0000 7fddec6a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30331) UID: 0 2024-09-12T22:32:16.626 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:32:16.626 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:32:16.626 INFO:teuthology.orchestra.run.smithi148.stdout: "complaint_time": 30, 2024-09-12T22:32:16.626 INFO:teuthology.orchestra.run.smithi148.stdout: "num_blocked_ops": 0 2024-09-12T22:32:16.626 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:32:16.635 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:32:16.702 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:32:16.701+0000 7fddec6a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30331) UID: 0 2024-09-12T22:32:16.740 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:32:16.740 INFO:teuthology.orchestra.run.smithi148.stdout: "size": 20, 2024-09-12T22:32:16.740 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 600, 2024-09-12T22:32:16.740 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [ 2024-09-12T22:32:16.740 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.740 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:16.740 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.400880+0000", 2024-09-12T22:32:16.741 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 39.337391046999997, 2024-09-12T22:32:16.741 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0095133660000000005, 2024-09-12T22:32:16.741 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:16.741 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:16.741 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:16.741 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:16.741 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.741 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:16.741 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400880+0000", 2024-09-12T22:32:16.741 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:16.741 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.741 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.741 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:16.741 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400880+0000", 2024-09-12T22:32:16.742 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:16.742 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.742 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.742 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:16.742 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400892+0000", 2024-09-12T22:32:16.742 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1941e-05 2024-09-12T22:32:16.742 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.742 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.742 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:16.742 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400900+0000", 2024-09-12T22:32:16.742 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0080000000000002e-06 2024-09-12T22:32:16.742 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.742 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.743 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:16.743 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400911+0000", 2024-09-12T22:32:16.743 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1452e-05 2024-09-12T22:32:16.743 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.743 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.743 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:16.743 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400922+0000", 2024-09-12T22:32:16.743 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0772e-05 2024-09-12T22:32:16.743 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.743 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.743 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:16.743 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401009+0000", 2024-09-12T22:32:16.743 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.7206000000000005e-05 2024-09-12T22:32:16.743 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.744 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.744 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:16.744 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401157+0000", 2024-09-12T22:32:16.744 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014831499999999999 2024-09-12T22:32:16.744 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.744 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.744 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:16.744 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401312+0000", 2024-09-12T22:32:16.744 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00015495600000000001 2024-09-12T22:32:16.744 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.744 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.744 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:16.744 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.403060+0000", 2024-09-12T22:32:16.744 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0017475220000000001 2024-09-12T22:32:16.745 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.745 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.745 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:16.745 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410300+0000", 2024-09-12T22:32:16.745 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0072403260000000001 2024-09-12T22:32:16.745 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.745 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.745 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:16.745 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410350+0000", 2024-09-12T22:32:16.745 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9814000000000001e-05 2024-09-12T22:32:16.745 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.745 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.745 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:16.746 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410393+0000", 2024-09-12T22:32:16.746 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3053999999999998e-05 2024-09-12T22:32:16.746 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:16.746 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:16.746 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:16.746 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.746 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.746 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:16.746 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.400952+0000", 2024-09-12T22:32:16.746 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 39.337318895000003, 2024-09-12T22:32:16.746 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0096045620000000005, 2024-09-12T22:32:16.746 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:16.746 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:16.747 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:16.747 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:16.747 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.747 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:16.747 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400952+0000", 2024-09-12T22:32:16.747 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:16.747 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.747 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.747 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:16.747 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400952+0000", 2024-09-12T22:32:16.747 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:16.747 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.747 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.748 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:16.748 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400953+0000", 2024-09-12T22:32:16.748 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.8000000000000005e-07 2024-09-12T22:32:16.748 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.748 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.748 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:16.748 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400957+0000", 2024-09-12T22:32:16.748 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.33e-06 2024-09-12T22:32:16.748 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.748 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.748 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:16.748 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400966+0000", 2024-09-12T22:32:16.748 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1989999999999995e-06 2024-09-12T22:32:16.748 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.749 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.749 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:16.749 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400973+0000", 2024-09-12T22:32:16.749 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2779999999999999e-06 2024-09-12T22:32:16.749 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.749 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.749 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:16.749 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401696+0000", 2024-09-12T22:32:16.749 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00072363500000000003 2024-09-12T22:32:16.749 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.749 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.749 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:16.749 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401788+0000", 2024-09-12T22:32:16.750 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1862999999999998e-05 2024-09-12T22:32:16.750 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.750 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.750 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:16.750 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401929+0000", 2024-09-12T22:32:16.750 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014096000000000001 2024-09-12T22:32:16.750 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.750 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.750 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:16.750 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.403542+0000", 2024-09-12T22:32:16.750 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001612963 2024-09-12T22:32:16.750 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.750 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.751 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:16.751 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410460+0000", 2024-09-12T22:32:16.751 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0069180500000000002 2024-09-12T22:32:16.751 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.751 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.751 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:16.751 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410515+0000", 2024-09-12T22:32:16.751 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5009000000000001e-05 2024-09-12T22:32:16.751 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.751 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.751 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:16.751 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410557+0000", 2024-09-12T22:32:16.751 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1495000000000002e-05 2024-09-12T22:32:16.751 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:16.752 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:16.752 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:16.752 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.752 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.752 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:16.752 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.400984+0000", 2024-09-12T22:32:16.752 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 39.337286399999996, 2024-09-12T22:32:16.752 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0073703950000000001, 2024-09-12T22:32:16.752 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:16.752 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:16.752 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:16.752 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:16.752 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.753 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:16.753 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400984+0000", 2024-09-12T22:32:16.753 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:16.753 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.753 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.753 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:16.753 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400984+0000", 2024-09-12T22:32:16.753 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:16.753 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.753 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.753 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:16.753 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400985+0000", 2024-09-12T22:32:16.753 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3200000000000005e-07 2024-09-12T22:32:16.753 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.754 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.754 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:16.754 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400998+0000", 2024-09-12T22:32:16.754 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2726e-05 2024-09-12T22:32:16.754 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.754 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.754 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:16.754 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401006+0000", 2024-09-12T22:32:16.754 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.3110000000000006e-06 2024-09-12T22:32:16.754 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.754 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.754 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:16.754 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401022+0000", 2024-09-12T22:32:16.755 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6249e-05 2024-09-12T22:32:16.755 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.755 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.755 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:16.755 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401700+0000", 2024-09-12T22:32:16.755 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00067811100000000001 2024-09-12T22:32:16.755 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.755 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.755 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:16.755 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401839+0000", 2024-09-12T22:32:16.755 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013865399999999999 2024-09-12T22:32:16.755 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.755 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.755 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:16.756 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401962+0000", 2024-09-12T22:32:16.756 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000123266 2024-09-12T22:32:16.756 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.756 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.756 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:16.756 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.403589+0000", 2024-09-12T22:32:16.756 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001626932 2024-09-12T22:32:16.756 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.756 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.756 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:16.756 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.408274+0000", 2024-09-12T22:32:16.756 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0046848100000000002 2024-09-12T22:32:16.756 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.757 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.757 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:16.757 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.408324+0000", 2024-09-12T22:32:16.757 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9784000000000003e-05 2024-09-12T22:32:16.757 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.757 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.757 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:16.757 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.408355+0000", 2024-09-12T22:32:16.757 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.1019999999999998e-05 2024-09-12T22:32:16.757 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:16.757 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:16.757 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:16.757 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.758 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.758 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:16.758 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401034+0000", 2024-09-12T22:32:16.758 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 39.337236959999998, 2024-09-12T22:32:16.758 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011063051000000001, 2024-09-12T22:32:16.758 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:16.758 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:16.758 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:16.758 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:16.758 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.758 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:16.758 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401034+0000", 2024-09-12T22:32:16.758 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:16.759 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.759 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.759 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:16.759 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401034+0000", 2024-09-12T22:32:16.759 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:16.759 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.759 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.759 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:16.759 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401034+0000", 2024-09-12T22:32:16.759 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8899999999999999e-07 2024-09-12T22:32:16.759 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.759 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.759 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:16.760 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401038+0000", 2024-09-12T22:32:16.760 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.523e-06 2024-09-12T22:32:16.760 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.760 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.760 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:16.760 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401046+0000", 2024-09-12T22:32:16.760 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0479999999999999e-06 2024-09-12T22:32:16.760 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.760 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.760 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:16.760 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401051+0000", 2024-09-12T22:32:16.760 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2619999999999998e-06 2024-09-12T22:32:16.760 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.761 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.761 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:16.761 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402270+0000", 2024-09-12T22:32:16.761 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012182429999999999 2024-09-12T22:32:16.761 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.761 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.761 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:16.761 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402325+0000", 2024-09-12T22:32:16.761 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5526999999999999e-05 2024-09-12T22:32:16.761 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.761 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.761 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:16.761 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402403+0000", 2024-09-12T22:32:16.761 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.7559999999999996e-05 2024-09-12T22:32:16.762 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.762 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.762 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:16.762 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.403655+0000", 2024-09-12T22:32:16.762 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012521489999999999 2024-09-12T22:32:16.762 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.762 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.762 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:16.762 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411979+0000", 2024-09-12T22:32:16.762 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0083240420000000002 2024-09-12T22:32:16.764 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.764 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.764 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:16.764 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.412036+0000", 2024-09-12T22:32:16.764 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7639000000000002e-05 2024-09-12T22:32:16.764 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.764 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.764 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:16.764 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.412097+0000", 2024-09-12T22:32:16.764 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0469e-05 2024-09-12T22:32:16.764 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:16.765 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:16.765 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:16.765 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.765 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.765 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:16.765 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401060+0000", 2024-09-12T22:32:16.765 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 39.337211207999999, 2024-09-12T22:32:16.765 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.010030172, 2024-09-12T22:32:16.765 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:16.765 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:16.765 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:16.765 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:16.765 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.765 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:16.766 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401060+0000", 2024-09-12T22:32:16.766 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:16.766 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.766 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.766 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:16.766 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401060+0000", 2024-09-12T22:32:16.766 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:16.766 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.766 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.766 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:16.766 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401060+0000", 2024-09-12T22:32:16.766 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2500000000000001e-07 2024-09-12T22:32:16.766 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.766 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.767 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:16.767 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401063+0000", 2024-09-12T22:32:16.767 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0910000000000001e-06 2024-09-12T22:32:16.767 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.767 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.767 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:16.767 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401070+0000", 2024-09-12T22:32:16.767 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1210000000000001e-06 2024-09-12T22:32:16.767 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.767 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.767 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:16.767 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401076+0000", 2024-09-12T22:32:16.767 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2830000000000001e-06 2024-09-12T22:32:16.768 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.768 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.768 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:16.768 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402288+0000", 2024-09-12T22:32:16.768 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012123699999999999 2024-09-12T22:32:16.768 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.768 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.768 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:16.768 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402359+0000", 2024-09-12T22:32:16.768 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.0988000000000005e-05 2024-09-12T22:32:16.768 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.768 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.768 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:16.768 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402457+0000", 2024-09-12T22:32:16.769 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.7857999999999997e-05 2024-09-12T22:32:16.769 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.769 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.769 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:16.769 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.404395+0000", 2024-09-12T22:32:16.769 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0019380160000000001 2024-09-12T22:32:16.769 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.769 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.769 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:16.769 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410603+0000", 2024-09-12T22:32:16.769 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.006208061 2024-09-12T22:32:16.769 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.769 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.770 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:16.770 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410687+0000", 2024-09-12T22:32:16.770 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.4623000000000006e-05 2024-09-12T22:32:16.770 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.770 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.770 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:16.770 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411090+0000", 2024-09-12T22:32:16.770 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00040233599999999999 2024-09-12T22:32:16.770 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:16.770 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:16.770 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:16.770 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.770 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.771 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:16.771 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401083+0000", 2024-09-12T22:32:16.771 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 39.337187792000002, 2024-09-12T22:32:16.771 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0097591850000000001, 2024-09-12T22:32:16.771 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:16.771 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:16.771 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:16.771 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:16.771 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.771 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:16.771 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401083+0000", 2024-09-12T22:32:16.771 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:16.771 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.772 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.772 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:16.772 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401083+0000", 2024-09-12T22:32:16.772 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:16.772 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.772 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.772 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:16.772 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401084+0000", 2024-09-12T22:32:16.772 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4799999999999999e-07 2024-09-12T22:32:16.772 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.772 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.772 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:16.772 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401088+0000", 2024-09-12T22:32:16.772 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6419999999999998e-06 2024-09-12T22:32:16.773 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.773 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.773 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:16.773 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401094+0000", 2024-09-12T22:32:16.773 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0090000000000004e-06 2024-09-12T22:32:16.773 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.773 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.773 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:16.773 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401108+0000", 2024-09-12T22:32:16.773 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3884e-05 2024-09-12T22:32:16.773 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.773 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.773 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:16.774 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401165+0000", 2024-09-12T22:32:16.774 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.6499000000000002e-05 2024-09-12T22:32:16.774 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.774 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.774 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:16.774 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401261+0000", 2024-09-12T22:32:16.774 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.6872000000000004e-05 2024-09-12T22:32:16.774 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.774 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.774 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:16.774 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401376+0000", 2024-09-12T22:32:16.774 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000114508 2024-09-12T22:32:16.774 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.775 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.775 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:16.775 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402666+0000", 2024-09-12T22:32:16.775 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012901659999999999 2024-09-12T22:32:16.775 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.775 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.775 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:16.775 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410572+0000", 2024-09-12T22:32:16.775 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0079055489999999996 2024-09-12T22:32:16.775 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.775 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.775 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:16.775 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410661+0000", 2024-09-12T22:32:16.775 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.9578000000000002e-05 2024-09-12T22:32:16.776 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.776 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.776 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:16.776 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410842+0000", 2024-09-12T22:32:16.776 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00018102999999999999 2024-09-12T22:32:16.776 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:16.776 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:16.776 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:16.776 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.776 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.776 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:16.776 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401122+0000", 2024-09-12T22:32:16.776 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 39.337148759999998, 2024-09-12T22:32:16.777 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0099122080000000005, 2024-09-12T22:32:16.777 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:16.777 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:16.777 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:32:16.777 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:16.777 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.777 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:16.777 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401122+0000", 2024-09-12T22:32:16.777 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:16.777 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.777 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.777 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:16.778 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401122+0000", 2024-09-12T22:32:16.778 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:16.778 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.778 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.778 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:16.778 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401123+0000", 2024-09-12T22:32:16.778 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2600000000000002e-07 2024-09-12T22:32:16.778 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.778 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.778 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:16.778 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401126+0000", 2024-09-12T22:32:16.778 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.6449999999999998e-06 2024-09-12T22:32:16.778 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.778 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.779 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:16.779 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401133+0000", 2024-09-12T22:32:16.779 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.9890000000000003e-06 2024-09-12T22:32:16.779 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.779 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.779 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:16.779 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401138+0000", 2024-09-12T22:32:16.779 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8060000000000002e-06 2024-09-12T22:32:16.779 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.779 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.779 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:16.779 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401703+0000", 2024-09-12T22:32:16.779 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00056509099999999999 2024-09-12T22:32:16.779 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.780 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.780 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:16.780 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401837+0000", 2024-09-12T22:32:16.780 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013338799999999999 2024-09-12T22:32:16.780 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.780 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.780 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:16.780 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411034+0000", 2024-09-12T22:32:16.780 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.009197663 2024-09-12T22:32:16.780 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:16.780 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:16.780 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:16.780 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.780 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.781 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:16.781 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401158+0000", 2024-09-12T22:32:16.781 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 39.337112980999997, 2024-09-12T22:32:16.781 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.010292437999999999, 2024-09-12T22:32:16.781 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:16.781 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:16.781 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:32:16.781 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:16.781 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.781 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:16.781 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401158+0000", 2024-09-12T22:32:16.781 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:16.781 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.781 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.782 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:16.782 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401158+0000", 2024-09-12T22:32:16.782 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:16.782 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.782 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.782 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:16.782 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401158+0000", 2024-09-12T22:32:16.782 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9699999999999996e-07 2024-09-12T22:32:16.782 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.782 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.782 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:16.782 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401161+0000", 2024-09-12T22:32:16.782 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.7410000000000001e-06 2024-09-12T22:32:16.782 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.783 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.783 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:16.783 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401168+0000", 2024-09-12T22:32:16.783 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.844e-06 2024-09-12T22:32:16.783 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.783 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.783 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:16.783 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401174+0000", 2024-09-12T22:32:16.783 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4700000000000001e-06 2024-09-12T22:32:16.783 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.783 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.783 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:16.783 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402799+0000", 2024-09-12T22:32:16.783 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0016256409999999999 2024-09-12T22:32:16.783 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.784 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.784 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:16.784 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402893+0000", 2024-09-12T22:32:16.784 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.3807999999999994e-05 2024-09-12T22:32:16.784 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.784 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.784 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:16.784 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411450+0000", 2024-09-12T22:32:16.784 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0085573369999999999 2024-09-12T22:32:16.784 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:16.784 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:16.784 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:16.784 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.785 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.785 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:16.785 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401183+0000", 2024-09-12T22:32:16.785 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 39.337088129000001, 2024-09-12T22:32:16.785 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0068597830000000004, 2024-09-12T22:32:16.785 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:16.785 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:16.785 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:32:16.785 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:16.785 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.785 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:16.785 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401183+0000", 2024-09-12T22:32:16.786 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:16.786 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.786 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.786 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:16.786 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401183+0000", 2024-09-12T22:32:16.786 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:16.786 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.786 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.786 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:16.786 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401183+0000", 2024-09-12T22:32:16.786 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.6700000000000003e-07 2024-09-12T22:32:16.786 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.786 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.787 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:16.787 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401186+0000", 2024-09-12T22:32:16.787 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4679999999999999e-06 2024-09-12T22:32:16.787 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.787 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.787 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:16.787 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401192+0000", 2024-09-12T22:32:16.787 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.1519999999999997e-06 2024-09-12T22:32:16.787 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.787 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.787 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:16.787 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401197+0000", 2024-09-12T22:32:16.787 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4669999999999998e-06 2024-09-12T22:32:16.787 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.788 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.788 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:16.788 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401253+0000", 2024-09-12T22:32:16.788 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.6211000000000001e-05 2024-09-12T22:32:16.788 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.788 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.788 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:16.788 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401413+0000", 2024-09-12T22:32:16.788 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00016021399999999999 2024-09-12T22:32:16.788 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.788 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.788 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:16.788 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.408043+0000", 2024-09-12T22:32:16.789 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0066295039999999996 2024-09-12T22:32:16.789 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:16.789 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:16.789 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:16.789 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.789 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.789 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:20 3.1c e19/17 3:3ed09add:::607.00000000:head v 19'1, mlcod=0'0)", 2024-09-12T22:32:16.789 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.409642+0000", 2024-09-12T22:32:16.789 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 39.328628670000001, 2024-09-12T22:32:16.789 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0038816269999999999, 2024-09-12T22:32:16.789 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:16.789 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:16.789 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:16.790 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:16.790 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.790 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:16.790 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409642+0000", 2024-09-12T22:32:16.790 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:16.790 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.790 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.790 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:16.790 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409642+0000", 2024-09-12T22:32:16.790 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:16.790 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.790 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.790 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:16.790 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409642+0000", 2024-09-12T22:32:16.791 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.6899999999999999e-07 2024-09-12T22:32:16.791 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.791 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.791 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:16.791 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409648+0000", 2024-09-12T22:32:16.791 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.49e-06 2024-09-12T22:32:16.791 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.791 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.791 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:16.791 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409656+0000", 2024-09-12T22:32:16.791 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.2949999999999994e-06 2024-09-12T22:32:16.791 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.791 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.791 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:16.792 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409664+0000", 2024-09-12T22:32:16.792 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.1219999999999995e-06 2024-09-12T22:32:16.792 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.792 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.792 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:16.792 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409707+0000", 2024-09-12T22:32:16.792 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2222000000000003e-05 2024-09-12T22:32:16.792 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.792 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.792 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:16.792 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409724+0000", 2024-09-12T22:32:16.792 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7496999999999999e-05 2024-09-12T22:32:16.792 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.793 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.793 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:16.793 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413439+0000", 2024-09-12T22:32:16.793 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00371448 2024-09-12T22:32:16.793 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.793 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.793 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:16.793 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413524+0000", 2024-09-12T22:32:16.793 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.5252000000000003e-05 2024-09-12T22:32:16.793 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:16.793 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:16.793 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:16.793 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.793 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.794 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:28 3.13 e19/17 3:cd5a64a3:::100.00000000:head v 19'1, mlcod=0'0)", 2024-09-12T22:32:16.794 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.409681+0000", 2024-09-12T22:32:16.794 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 39.328590187000003, 2024-09-12T22:32:16.794 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0038708710000000001, 2024-09-12T22:32:16.794 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:16.794 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:16.794 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:16.794 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:16.794 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.794 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:16.794 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409681+0000", 2024-09-12T22:32:16.794 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:16.794 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.795 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.795 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:16.795 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409681+0000", 2024-09-12T22:32:16.795 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:16.795 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.795 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.795 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:16.795 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409681+0000", 2024-09-12T22:32:16.795 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3000000000000002e-07 2024-09-12T22:32:16.795 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.795 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.795 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:16.795 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409695+0000", 2024-09-12T22:32:16.796 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4313e-05 2024-09-12T22:32:16.796 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.796 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.796 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:16.796 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409703+0000", 2024-09-12T22:32:16.796 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4000000000000003e-06 2024-09-12T22:32:16.796 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.796 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.796 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:16.796 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409708+0000", 2024-09-12T22:32:16.796 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3190000000000002e-06 2024-09-12T22:32:16.796 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.796 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.796 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:16.797 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409875+0000", 2024-09-12T22:32:16.797 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000167329 2024-09-12T22:32:16.797 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.797 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.797 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:16.797 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409892+0000", 2024-09-12T22:32:16.797 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6957999999999999e-05 2024-09-12T22:32:16.797 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.797 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.797 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:16.797 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413457+0000", 2024-09-12T22:32:16.797 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0035651279999999999 2024-09-12T22:32:16.797 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.797 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.798 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:16.798 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413552+0000", 2024-09-12T22:32:16.798 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.4093999999999997e-05 2024-09-12T22:32:16.798 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:16.798 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:16.798 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:16.798 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.798 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.798 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:21 3.1c e19/17 3:3ed09add:::607.00000000:head v 19'2, mlcod=0'0)", 2024-09-12T22:32:16.798 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.409718+0000", 2024-09-12T22:32:16.798 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 39.328552522000003, 2024-09-12T22:32:16.798 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003851883, 2024-09-12T22:32:16.798 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:16.799 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:16.799 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:16.799 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:16.799 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.799 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:16.799 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409718+0000", 2024-09-12T22:32:16.799 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:16.799 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.799 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.799 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:16.799 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409718+0000", 2024-09-12T22:32:16.799 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:16.799 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.799 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.800 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:16.800 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409719+0000", 2024-09-12T22:32:16.800 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.16e-07 2024-09-12T22:32:16.800 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.800 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.800 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:16.800 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409722+0000", 2024-09-12T22:32:16.800 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.692e-06 2024-09-12T22:32:16.800 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.800 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.800 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:16.800 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409729+0000", 2024-09-12T22:32:16.800 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.516e-06 2024-09-12T22:32:16.801 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.801 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.801 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:16.801 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409750+0000", 2024-09-12T22:32:16.801 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1151000000000001e-05 2024-09-12T22:32:16.801 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.801 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.801 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:16.801 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410015+0000", 2024-09-12T22:32:16.801 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00026477599999999999 2024-09-12T22:32:16.801 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.801 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.801 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:16.801 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410104+0000", 2024-09-12T22:32:16.802 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.9586000000000006e-05 2024-09-12T22:32:16.802 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.802 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.802 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:16.802 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413528+0000", 2024-09-12T22:32:16.802 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0034237880000000001 2024-09-12T22:32:16.802 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.802 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.802 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:16.802 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413570+0000", 2024-09-12T22:32:16.802 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2157999999999999e-05 2024-09-12T22:32:16.802 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:16.802 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:16.802 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:16.803 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.803 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.803 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:27 3.13 e19/17 3:c91d4a1d:::mds0_inotable:head v 19'2, mlcod=0'0)", 2024-09-12T22:32:16.803 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.409760+0000", 2024-09-12T22:32:16.803 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 39.328511005999999, 2024-09-12T22:32:16.803 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0039301910000000004, 2024-09-12T22:32:16.803 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:16.803 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:16.803 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:16.803 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:16.803 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.803 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:16.803 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409760+0000", 2024-09-12T22:32:16.804 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:16.804 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.804 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.804 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:16.804 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409760+0000", 2024-09-12T22:32:16.804 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:16.804 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.804 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.804 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:16.804 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409760+0000", 2024-09-12T22:32:16.804 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.39e-07 2024-09-12T22:32:16.804 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.804 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.804 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:16.805 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409765+0000", 2024-09-12T22:32:16.805 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4449999999999998e-06 2024-09-12T22:32:16.805 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.805 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.805 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:16.805 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409771+0000", 2024-09-12T22:32:16.805 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7159999999999997e-06 2024-09-12T22:32:16.805 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.805 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.805 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:16.805 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409778+0000", 2024-09-12T22:32:16.805 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.331e-06 2024-09-12T22:32:16.805 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.805 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.806 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:16.806 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410191+0000", 2024-09-12T22:32:16.806 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00041348300000000003 2024-09-12T22:32:16.806 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.806 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.806 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:16.806 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410211+0000", 2024-09-12T22:32:16.806 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9933999999999999e-05 2024-09-12T22:32:16.806 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.806 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.806 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:16.806 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413638+0000", 2024-09-12T22:32:16.806 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003426854 2024-09-12T22:32:16.806 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.807 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.807 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:16.807 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413690+0000", 2024-09-12T22:32:16.807 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2089000000000002e-05 2024-09-12T22:32:16.807 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:16.807 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:16.807 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:16.807 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.807 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.807 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "pg_update_log_missing_reply(3.b epoch 19/17 rep_tid 4 lcod 19'2)", 2024-09-12T22:32:16.807 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.410060+0000", 2024-09-12T22:32:16.807 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 39.328211340999999, 2024-09-12T22:32:16.807 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00098016500000000007, 2024-09-12T22:32:16.807 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:16.808 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:16.808 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "reached pg", 2024-09-12T22:32:16.808 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:16.808 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.808 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:16.808 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410060+0000", 2024-09-12T22:32:16.808 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:16.808 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.808 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.808 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:16.808 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410060+0000", 2024-09-12T22:32:16.808 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:16.808 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.809 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.809 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:16.809 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410060+0000", 2024-09-12T22:32:16.809 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.8299999999999998e-07 2024-09-12T22:32:16.809 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.809 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.809 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:16.809 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410062+0000", 2024-09-12T22:32:16.809 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5749999999999999e-06 2024-09-12T22:32:16.809 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.809 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.809 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:16.809 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410070+0000", 2024-09-12T22:32:16.809 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.909e-06 2024-09-12T22:32:16.810 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.810 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.810 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:16.810 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410076+0000", 2024-09-12T22:32:16.810 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7049999999999996e-06 2024-09-12T22:32:16.810 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.810 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.810 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:16.810 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410943+0000", 2024-09-12T22:32:16.810 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00086681900000000001 2024-09-12T22:32:16.810 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.810 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.810 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:16.811 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411040+0000", 2024-09-12T22:32:16.811 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.6774000000000006e-05 2024-09-12T22:32:16.811 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:16.811 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:16.811 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:16.811 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.811 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.811 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e19/17 ondisk, result = 0)", 2024-09-12T22:32:16.811 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.410113+0000", 2024-09-12T22:32:16.811 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 39.328158074000001, 2024-09-12T22:32:16.811 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00098911599999999995, 2024-09-12T22:32:16.811 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:16.811 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:16.811 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:32:16.812 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:16.812 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.812 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:16.812 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410113+0000", 2024-09-12T22:32:16.812 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:16.812 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.812 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.812 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:16.812 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410113+0000", 2024-09-12T22:32:16.812 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:16.812 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.812 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.812 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:16.813 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410113+0000", 2024-09-12T22:32:16.813 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.99e-07 2024-09-12T22:32:16.813 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.813 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.813 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:16.813 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410115+0000", 2024-09-12T22:32:16.813 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.046e-06 2024-09-12T22:32:16.813 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.813 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.813 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:16.813 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410121+0000", 2024-09-12T22:32:16.813 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0050000000000001e-06 2024-09-12T22:32:16.813 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.813 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.814 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:16.814 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410126+0000", 2024-09-12T22:32:16.814 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8339999999999998e-06 2024-09-12T22:32:16.814 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.814 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.814 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:16.814 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410587+0000", 2024-09-12T22:32:16.814 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00046095499999999998 2024-09-12T22:32:16.814 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.814 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.814 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:16.814 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410595+0000", 2024-09-12T22:32:16.815 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.9419999999999995e-06 2024-09-12T22:32:16.815 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.815 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.815 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:16.815 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411102+0000", 2024-09-12T22:32:16.815 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00050713500000000003 2024-09-12T22:32:16.815 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:16.815 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:16.815 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:16.815 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.815 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.815 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 19/17 rep_tid 8 lcod 19'4)", 2024-09-12T22:32:16.815 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.410133+0000", 2024-09-12T22:32:16.815 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 39.328138146000001, 2024-09-12T22:32:16.816 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0013504000000000001, 2024-09-12T22:32:16.816 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:16.816 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:16.816 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "reached pg", 2024-09-12T22:32:16.816 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:16.816 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.816 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:16.816 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410133+0000", 2024-09-12T22:32:16.816 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:16.816 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.816 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.816 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:16.817 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410133+0000", 2024-09-12T22:32:16.817 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:16.817 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.817 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.817 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:16.817 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410133+0000", 2024-09-12T22:32:16.817 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.0599999999999999e-07 2024-09-12T22:32:16.817 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.817 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.817 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:16.817 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410135+0000", 2024-09-12T22:32:16.817 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7770000000000001e-06 2024-09-12T22:32:16.817 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.817 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.818 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:16.818 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410140+0000", 2024-09-12T22:32:16.818 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9960000000000001e-06 2024-09-12T22:32:16.818 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.818 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.818 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:16.818 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410144+0000", 2024-09-12T22:32:16.818 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9500000000000003e-06 2024-09-12T22:32:16.818 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.818 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.818 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:16.818 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411310+0000", 2024-09-12T22:32:16.818 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001166311 2024-09-12T22:32:16.819 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.819 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.819 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:16.819 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411483+0000", 2024-09-12T22:32:16.819 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00017316 2024-09-12T22:32:16.819 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:16.819 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:16.819 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:16.819 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.819 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.819 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "pg_update_log_missing(3.1a epoch 19/17 rep_tid 0 entries 19'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T22:32:16.819 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.410617+0000", 2024-09-12T22:32:16.819 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 39.327653751, 2024-09-12T22:32:16.820 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0030439709999999999, 2024-09-12T22:32:16.820 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:16.820 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:16.820 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "reached pg", 2024-09-12T22:32:16.820 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:16.820 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.820 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:16.820 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410617+0000", 2024-09-12T22:32:16.820 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:16.820 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.820 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.820 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:16.820 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410617+0000", 2024-09-12T22:32:16.821 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:16.821 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.821 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.821 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:16.821 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410617+0000", 2024-09-12T22:32:16.821 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3599999999999999e-07 2024-09-12T22:32:16.821 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.821 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.821 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:16.821 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410625+0000", 2024-09-12T22:32:16.821 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5410000000000003e-06 2024-09-12T22:32:16.821 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.822 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.822 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:16.822 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410638+0000", 2024-09-12T22:32:16.822 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3261999999999999e-05 2024-09-12T22:32:16.822 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.822 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.822 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:16.822 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410653+0000", 2024-09-12T22:32:16.822 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4844000000000001e-05 2024-09-12T22:32:16.822 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.822 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.822 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:16.822 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410814+0000", 2024-09-12T22:32:16.823 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00016119999999999999 2024-09-12T22:32:16.823 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.823 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.823 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:16.823 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413661+0000", 2024-09-12T22:32:16.823 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0028467879999999998 2024-09-12T22:32:16.823 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:16.823 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:16.823 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:16.823 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.823 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.823 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-09-12T22:32:16.824 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:39.398875+0000", 2024-09-12T22:32:16.824 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 37.339395471000003, 2024-09-12T22:32:16.824 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0015679069999999999, 2024-09-12T22:32:16.824 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:16.824 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:16.824 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:16.824 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:16.824 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.824 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:16.824 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398875+0000", 2024-09-12T22:32:16.824 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:16.824 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.824 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.825 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:16.825 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398875+0000", 2024-09-12T22:32:16.825 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:16.825 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.825 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.825 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:16.825 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398878+0000", 2024-09-12T22:32:16.825 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1679999999999998e-06 2024-09-12T22:32:16.825 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.825 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.825 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:16.825 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398888+0000", 2024-09-12T22:32:16.825 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.084e-05 2024-09-12T22:32:16.826 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.826 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.826 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:16.826 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398906+0000", 2024-09-12T22:32:16.826 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7518000000000001e-05 2024-09-12T22:32:16.826 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.826 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.826 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:16.826 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398914+0000", 2024-09-12T22:32:16.826 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5989999999999996e-06 2024-09-12T22:32:16.826 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.826 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.827 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:16.827 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398974+0000", 2024-09-12T22:32:16.827 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0988e-05 2024-09-12T22:32:16.827 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.827 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.827 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:16.827 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.399078+0000", 2024-09-12T22:32:16.827 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000103133 2024-09-12T22:32:16.827 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.827 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.827 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:16.827 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.399166+0000", 2024-09-12T22:32:16.827 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.8183999999999995e-05 2024-09-12T22:32:16.828 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.828 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.828 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:16.828 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.399747+0000", 2024-09-12T22:32:16.828 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00058110599999999996 2024-09-12T22:32:16.828 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.828 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.828 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:16.828 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.400377+0000", 2024-09-12T22:32:16.828 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000630157 2024-09-12T22:32:16.828 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.828 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.828 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:16.829 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.400415+0000", 2024-09-12T22:32:16.829 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7814000000000001e-05 2024-09-12T22:32:16.829 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.829 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.829 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:16.829 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.400443+0000", 2024-09-12T22:32:16.829 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8399999999999999e-05 2024-09-12T22:32:16.829 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:16.829 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:16.829 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:16.829 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.829 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.829 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e23)", 2024-09-12T22:32:16.830 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:58.400966+0000", 2024-09-12T22:32:16.830 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 18.337304563, 2024-09-12T22:32:16.830 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001468876, 2024-09-12T22:32:16.830 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:16.830 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:16.830 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:16.830 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:16.830 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.830 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:16.830 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400966+0000", 2024-09-12T22:32:16.830 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:16.830 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.831 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.831 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:16.831 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400966+0000", 2024-09-12T22:32:16.831 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:16.831 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.831 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.831 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:16.831 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400967+0000", 2024-09-12T22:32:16.831 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.046e-06 2024-09-12T22:32:16.831 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.831 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.831 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:16.831 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400974+0000", 2024-09-12T22:32:16.832 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2310000000000001e-06 2024-09-12T22:32:16.832 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.832 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.832 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:16.832 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400988+0000", 2024-09-12T22:32:16.832 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4482e-05 2024-09-12T22:32:16.832 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.832 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.832 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:16.832 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400997+0000", 2024-09-12T22:32:16.832 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.0189999999999995e-06 2024-09-12T22:32:16.832 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.832 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.833 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:16.833 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.401068+0000", 2024-09-12T22:32:16.833 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1426000000000004e-05 2024-09-12T22:32:16.833 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.833 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.833 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:16.833 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.401174+0000", 2024-09-12T22:32:16.833 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000105769 2024-09-12T22:32:16.833 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.833 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.833 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:16.833 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.401335+0000", 2024-09-12T22:32:16.833 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000161225 2024-09-12T22:32:16.834 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.834 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.834 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:16.834 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.402110+0000", 2024-09-12T22:32:16.834 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00077428800000000004 2024-09-12T22:32:16.834 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.834 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.834 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:16.834 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.402333+0000", 2024-09-12T22:32:16.834 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000223723 2024-09-12T22:32:16.834 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.834 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.834 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:16.834 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.402388+0000", 2024-09-12T22:32:16.835 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4700999999999997e-05 2024-09-12T22:32:16.835 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.835 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.835 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:16.835 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.402435+0000", 2024-09-12T22:32:16.835 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6965999999999997e-05 2024-09-12T22:32:16.835 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:16.835 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:16.835 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:16.835 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.835 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.835 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:45 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e27)", 2024-09-12T22:32:16.835 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:32:04.401614+0000", 2024-09-12T22:32:16.835 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 12.336657133999999, 2024-09-12T22:32:16.836 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0014279749999999999, 2024-09-12T22:32:16.836 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:16.836 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:16.836 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:16.836 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:16.836 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.836 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:16.836 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401614+0000", 2024-09-12T22:32:16.836 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:16.836 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.836 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.836 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:16.836 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401614+0000", 2024-09-12T22:32:16.837 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:16.837 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.837 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.837 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:16.837 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401615+0000", 2024-09-12T22:32:16.837 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.161e-06 2024-09-12T22:32:16.837 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.837 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.837 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:16.837 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401621+0000", 2024-09-12T22:32:16.837 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8730000000000004e-06 2024-09-12T22:32:16.837 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.837 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.837 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:16.838 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401633+0000", 2024-09-12T22:32:16.838 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1800000000000001e-05 2024-09-12T22:32:16.838 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.838 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.838 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:16.838 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401656+0000", 2024-09-12T22:32:16.838 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.3521999999999999e-05 2024-09-12T22:32:16.838 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.838 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.838 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:16.838 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401713+0000", 2024-09-12T22:32:16.838 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7259000000000002e-05 2024-09-12T22:32:16.838 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.839 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.839 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:16.839 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401849+0000", 2024-09-12T22:32:16.839 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013613500000000001 2024-09-12T22:32:16.839 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.839 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.839 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:16.839 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.402009+0000", 2024-09-12T22:32:16.839 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00015947199999999999 2024-09-12T22:32:16.839 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.839 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.839 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:16.839 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.402629+0000", 2024-09-12T22:32:16.840 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00061962200000000001 2024-09-12T22:32:16.840 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.840 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.840 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:16.840 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.402983+0000", 2024-09-12T22:32:16.840 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00035447499999999998 2024-09-12T22:32:16.840 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.840 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.840 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:16.840 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.403016+0000", 2024-09-12T22:32:16.840 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3108999999999998e-05 2024-09-12T22:32:16.840 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:16.840 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:16.840 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:16.841 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.403042+0000", 2024-09-12T22:32:16.841 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5547000000000001e-05 2024-09-12T22:32:16.841 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:16.841 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:16.841 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:16.841 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:16.841 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:16.841 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:32:16.842 INFO:teuthology.orchestra.run.smithi019.stdout:moved 0 / 210 (0%) 2024-09-12T22:32:16.842 INFO:teuthology.orchestra.run.smithi019.stdout:avg 70 2024-09-12T22:32:16.842 INFO:teuthology.orchestra.run.smithi019.stdout:stddev 2.16025 -> 2.16025 (expected baseline 6.8313) 2024-09-12T22:32:16.842 INFO:teuthology.orchestra.run.smithi019.stdout:min osd.0 with 67 -> 67 pgs (0.957143 -> 0.957143 * mean) 2024-09-12T22:32:16.842 INFO:teuthology.orchestra.run.smithi019.stdout:max osd.1 with 72 -> 72 pgs (1.02857 -> 1.02857 * mean) 2024-09-12T22:32:16.843 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:32:16.843 INFO:teuthology.orchestra.run.smithi019.stdout:oload 110 2024-09-12T22:32:16.843 INFO:teuthology.orchestra.run.smithi019.stdout:max_change 0.05 2024-09-12T22:32:16.843 INFO:teuthology.orchestra.run.smithi019.stdout:max_change_osds 4 2024-09-12T22:32:16.843 INFO:teuthology.orchestra.run.smithi019.stdout:average_utilization 0.0003 2024-09-12T22:32:16.843 INFO:teuthology.orchestra.run.smithi019.stdout:overload_utilization 0.0004 2024-09-12T22:32:16.844 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:32:16.845 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:16.842+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:16.845 INFO:teuthology.orchestra.run.smithi019.stderr:no change 2024-09-12T22:32:16.845 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '1.0', 'overage': '110', 'type': 'reweight-by-utilization'} 2024-09-12T22:32:16.846 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight-by-utilization 110 1.0 2024-09-12T22:32:16.944 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:16.943+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:16.961 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-09-12T22:32:16.961 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-09-12T22:32:16.961 INFO:teuthology.orchestra.run.smithi163.stdout: "num_ops": 0 2024-09-12T22:32:16.961 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-09-12T22:32:16.971 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:32:17.045 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:32:17.044+0000 7fddec6a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30331) UID: 0 2024-09-12T22:32:17.116 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-09-12T22:32:17.116 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-09-12T22:32:17.116 INFO:teuthology.orchestra.run.smithi163.stdout: "complaint_time": 30, 2024-09-12T22:32:17.116 INFO:teuthology.orchestra.run.smithi163.stdout: "num_blocked_ops": 0 2024-09-12T22:32:17.116 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-09-12T22:32:17.125 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:32:17.146 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:32:17.145+0000 7fddec6a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30331) UID: 0 2024-09-12T22:32:17.153 INFO:teuthology.orchestra.run.smithi019.stdout:moved 0 / 210 (0%) 2024-09-12T22:32:17.153 INFO:teuthology.orchestra.run.smithi019.stdout:avg 70 2024-09-12T22:32:17.153 INFO:teuthology.orchestra.run.smithi019.stdout:stddev 2.16025 -> 2.16025 (expected baseline 6.8313) 2024-09-12T22:32:17.153 INFO:teuthology.orchestra.run.smithi019.stdout:min osd.0 with 67 -> 67 pgs (0.957143 -> 0.957143 * mean) 2024-09-12T22:32:17.153 INFO:teuthology.orchestra.run.smithi019.stdout:max osd.1 with 72 -> 72 pgs (1.02857 -> 1.02857 * mean) 2024-09-12T22:32:17.153 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:32:17.153 INFO:teuthology.orchestra.run.smithi019.stdout:oload 110 2024-09-12T22:32:17.153 INFO:teuthology.orchestra.run.smithi019.stdout:max_change 1 2024-09-12T22:32:17.153 INFO:teuthology.orchestra.run.smithi019.stdout:max_change_osds 4 2024-09-12T22:32:17.154 INFO:teuthology.orchestra.run.smithi019.stdout:average_utilization 0.0003 2024-09-12T22:32:17.154 INFO:teuthology.orchestra.run.smithi019.stdout:overload_utilization 0.0004 2024-09-12T22:32:17.154 INFO:teuthology.orchestra.run.smithi019.stderr:no change 2024-09-12T22:32:17.230 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-09-12T22:32:17.230 INFO:teuthology.orchestra.run.smithi163.stdout: "size": 20, 2024-09-12T22:32:17.230 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 600, 2024-09-12T22:32:17.230 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2024-09-12T22:32:17.230 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.230 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-09-12T22:32:17.230 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:27.254459+0000", 2024-09-12T22:32:17.230 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 49.973469739000002, 2024-09-12T22:32:17.230 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.37816283899999997, 2024-09-12T22:32:17.231 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:17.231 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:17.231 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:17.231 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:17.231 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:17.231 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:17.231 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 1 2024-09-12T22:32:17.231 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.231 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:17.231 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.231 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:17.231 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254459+0000", 2024-09-12T22:32:17.231 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:17.232 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.232 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.232 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:17.232 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254459+0000", 2024-09-12T22:32:17.232 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:17.232 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.232 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.232 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:17.232 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254460+0000", 2024-09-12T22:32:17.232 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1739999999999999e-06 2024-09-12T22:32:17.232 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.232 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.232 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:17.232 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254472+0000", 2024-09-12T22:32:17.233 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2207e-05 2024-09-12T22:32:17.233 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.233 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.233 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:17.233 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254483+0000", 2024-09-12T22:32:17.233 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0631999999999999e-05 2024-09-12T22:32:17.233 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.233 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.233 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:17.233 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254492+0000", 2024-09-12T22:32:17.233 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3670000000000003e-06 2024-09-12T22:32:17.233 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.233 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.233 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:17.234 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254551+0000", 2024-09-12T22:32:17.234 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8687999999999998e-05 2024-09-12T22:32:17.234 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.234 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.234 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for peered", 2024-09-12T22:32:17.234 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254562+0000", 2024-09-12T22:32:17.234 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1249e-05 2024-09-12T22:32:17.234 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.234 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.234 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:17.235 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.631211+0000", 2024-09-12T22:32:17.235 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.376649018 2024-09-12T22:32:17.235 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.235 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.235 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:17.235 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.631345+0000", 2024-09-12T22:32:17.235 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013378700000000001 2024-09-12T22:32:17.235 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.235 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.235 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:17.235 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.631479+0000", 2024-09-12T22:32:17.235 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013352399999999999 2024-09-12T22:32:17.235 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.235 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.236 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:17.236 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632324+0000", 2024-09-12T22:32:17.236 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00084508100000000002 2024-09-12T22:32:17.236 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.236 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.236 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:17.236 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632548+0000", 2024-09-12T22:32:17.236 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000224329 2024-09-12T22:32:17.236 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.237 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.237 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:17.237 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632591+0000", 2024-09-12T22:32:17.237 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2564000000000001e-05 2024-09-12T22:32:17.237 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.237 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.237 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:17.237 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632622+0000", 2024-09-12T22:32:17.237 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1219e-05 2024-09-12T22:32:17.237 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:17.237 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:17.237 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:17.237 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.237 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.238 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:185 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:32:17.238 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394355+0000", 2024-09-12T22:32:17.238 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 48.833573641999998, 2024-09-12T22:32:17.238 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011302394, 2024-09-12T22:32:17.238 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:17.238 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:17.238 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:17.238 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:17.238 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:17.238 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:17.238 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 185 2024-09-12T22:32:17.238 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.238 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:17.239 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.239 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:17.239 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394355+0000", 2024-09-12T22:32:17.239 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:17.239 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.239 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.239 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:17.239 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394355+0000", 2024-09-12T22:32:17.239 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:17.239 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.239 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.239 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:17.239 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394355+0000", 2024-09-12T22:32:17.239 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9099999999999999e-07 2024-09-12T22:32:17.240 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.240 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.240 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:17.240 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394385+0000", 2024-09-12T22:32:17.240 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9963000000000001e-05 2024-09-12T22:32:17.240 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.240 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.240 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:17.240 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394390+0000", 2024-09-12T22:32:17.240 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8420000000000004e-06 2024-09-12T22:32:17.240 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.240 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.240 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:17.240 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394393+0000", 2024-09-12T22:32:17.241 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1e-06 2024-09-12T22:32:17.241 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.241 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.241 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:17.241 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.400546+0000", 2024-09-12T22:32:17.241 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0061523309999999996 2024-09-12T22:32:17.241 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.241 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.241 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:17.241 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.400588+0000", 2024-09-12T22:32:17.241 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1835000000000002e-05 2024-09-12T22:32:17.241 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.241 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.242 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:17.242 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.400677+0000", 2024-09-12T22:32:17.242 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9195000000000002e-05 2024-09-12T22:32:17.242 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.242 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.242 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:17.242 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405378+0000", 2024-09-12T22:32:17.242 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0047008659999999997 2024-09-12T22:32:17.242 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.242 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.242 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:17.242 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405569+0000", 2024-09-12T22:32:17.242 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00019148599999999999 2024-09-12T22:32:17.242 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.243 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.243 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:17.243 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405620+0000", 2024-09-12T22:32:17.243 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1416999999999999e-05 2024-09-12T22:32:17.243 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.243 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.243 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:17.243 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405657+0000", 2024-09-12T22:32:17.243 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6968000000000002e-05 2024-09-12T22:32:17.243 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:17.243 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:17.243 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:17.243 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.243 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.244 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:32:17.244 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394399+0000", 2024-09-12T22:32:17.244 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 48.833529431000002, 2024-09-12T22:32:17.244 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011336601999999999, 2024-09-12T22:32:17.244 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:17.244 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:17.244 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:17.244 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:17.244 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:17.244 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:17.244 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 186 2024-09-12T22:32:17.244 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.244 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:17.245 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.245 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:17.245 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394399+0000", 2024-09-12T22:32:17.245 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:17.245 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.245 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.245 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:17.245 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394399+0000", 2024-09-12T22:32:17.245 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:17.245 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.245 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.245 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:17.245 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394400+0000", 2024-09-12T22:32:17.246 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4499999999999998e-07 2024-09-12T22:32:17.246 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.246 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.246 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:17.246 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394402+0000", 2024-09-12T22:32:17.246 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.875e-06 2024-09-12T22:32:17.246 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.246 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.246 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:17.246 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394405+0000", 2024-09-12T22:32:17.246 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6799999999999999e-06 2024-09-12T22:32:17.246 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.246 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.246 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:17.247 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394408+0000", 2024-09-12T22:32:17.247 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.667e-06 2024-09-12T22:32:17.247 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.247 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.247 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:17.247 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401395+0000", 2024-09-12T22:32:17.247 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0069867230000000002 2024-09-12T22:32:17.247 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.247 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.247 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:17.247 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401438+0000", 2024-09-12T22:32:17.247 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3554999999999999e-05 2024-09-12T22:32:17.247 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.247 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.248 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:17.248 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401509+0000", 2024-09-12T22:32:17.248 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0631999999999997e-05 2024-09-12T22:32:17.248 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.248 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.248 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:17.248 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405392+0000", 2024-09-12T22:32:17.248 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0038830449999999999 2024-09-12T22:32:17.248 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.248 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.248 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:17.248 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405690+0000", 2024-09-12T22:32:17.248 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000298435 2024-09-12T22:32:17.249 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.249 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.249 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:17.249 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405716+0000", 2024-09-12T22:32:17.249 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5435999999999998e-05 2024-09-12T22:32:17.249 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.249 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.249 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:17.249 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405736+0000", 2024-09-12T22:32:17.249 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0208999999999999e-05 2024-09-12T22:32:17.249 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:17.249 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:17.249 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:17.249 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.250 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.250 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:32:17.250 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394411+0000", 2024-09-12T22:32:17.250 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 48.833517305000001, 2024-09-12T22:32:17.250 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011400117, 2024-09-12T22:32:17.250 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:17.250 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:17.250 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:17.250 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:17.250 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:17.250 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:17.250 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 187 2024-09-12T22:32:17.250 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.251 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:17.251 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.251 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:17.251 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394411+0000", 2024-09-12T22:32:17.251 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:17.251 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.251 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.251 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:17.251 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394411+0000", 2024-09-12T22:32:17.251 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:17.251 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.251 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.251 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:17.251 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394412+0000", 2024-09-12T22:32:17.252 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.4999999999999999e-07 2024-09-12T22:32:17.252 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.252 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.252 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:17.252 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394414+0000", 2024-09-12T22:32:17.252 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.984e-06 2024-09-12T22:32:17.252 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.252 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.252 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:17.252 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394418+0000", 2024-09-12T22:32:17.252 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0840000000000002e-06 2024-09-12T22:32:17.252 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.252 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.252 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:17.253 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394431+0000", 2024-09-12T22:32:17.253 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.361e-05 2024-09-12T22:32:17.253 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.253 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.253 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:17.253 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401778+0000", 2024-09-12T22:32:17.253 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0073462659999999997 2024-09-12T22:32:17.253 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.253 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.253 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:17.253 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401853+0000", 2024-09-12T22:32:17.253 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5797000000000006e-05 2024-09-12T22:32:17.253 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.254 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.254 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:17.254 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401990+0000", 2024-09-12T22:32:17.254 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013651399999999999 2024-09-12T22:32:17.254 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.254 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.254 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:17.254 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405402+0000", 2024-09-12T22:32:17.254 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0034116070000000001 2024-09-12T22:32:17.254 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.254 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.254 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:17.254 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405764+0000", 2024-09-12T22:32:17.254 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00036234899999999998 2024-09-12T22:32:17.255 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.255 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.255 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:17.255 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405791+0000", 2024-09-12T22:32:17.255 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7029000000000002e-05 2024-09-12T22:32:17.255 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.255 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.255 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:17.255 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405812+0000", 2024-09-12T22:32:17.255 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0627000000000001e-05 2024-09-12T22:32:17.255 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:17.255 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:17.255 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:17.255 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.256 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.256 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:32:17.256 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394447+0000", 2024-09-12T22:32:17.256 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 48.833482154000002, 2024-09-12T22:32:17.256 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011759588, 2024-09-12T22:32:17.256 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:17.256 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:17.256 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:17.256 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:17.256 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:17.256 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:17.256 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 188 2024-09-12T22:32:17.256 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.256 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:17.257 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.257 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:17.257 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394447+0000", 2024-09-12T22:32:17.257 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:17.257 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.257 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.257 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:17.257 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394447+0000", 2024-09-12T22:32:17.257 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:17.257 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.257 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.257 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:17.257 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394447+0000", 2024-09-12T22:32:17.257 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.15e-07 2024-09-12T22:32:17.258 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.258 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.258 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:17.258 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394512+0000", 2024-09-12T22:32:17.258 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4580999999999997e-05 2024-09-12T22:32:17.258 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.258 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.258 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:17.258 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394518+0000", 2024-09-12T22:32:17.258 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.3380000000000001e-06 2024-09-12T22:32:17.258 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.258 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.258 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:17.259 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394521+0000", 2024-09-12T22:32:17.259 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3340000000000002e-06 2024-09-12T22:32:17.259 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.259 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.259 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:17.259 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.402628+0000", 2024-09-12T22:32:17.259 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.008106996 2024-09-12T22:32:17.259 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.259 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.259 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:17.259 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.402670+0000", 2024-09-12T22:32:17.259 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1983000000000001e-05 2024-09-12T22:32:17.259 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.259 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.260 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:17.260 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.402738+0000", 2024-09-12T22:32:17.260 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.8114999999999994e-05 2024-09-12T22:32:17.260 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.260 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.260 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:17.260 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405668+0000", 2024-09-12T22:32:17.260 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.002929545 2024-09-12T22:32:17.260 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.261 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.261 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:17.261 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406162+0000", 2024-09-12T22:32:17.261 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000494408 2024-09-12T22:32:17.261 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.261 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.261 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:17.261 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406188+0000", 2024-09-12T22:32:17.261 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5766e-05 2024-09-12T22:32:17.261 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.261 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.261 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:17.261 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406206+0000", 2024-09-12T22:32:17.262 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.8107000000000001e-05 2024-09-12T22:32:17.262 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:17.262 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:17.262 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:17.262 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.262 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.262 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:32:17.262 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394528+0000", 2024-09-12T22:32:17.262 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 48.833400484999999, 2024-09-12T22:32:17.262 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.01195536, 2024-09-12T22:32:17.262 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:17.262 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:17.262 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:17.262 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:17.263 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:17.263 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:17.263 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 189 2024-09-12T22:32:17.263 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.263 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:17.263 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.263 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:17.263 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394528+0000", 2024-09-12T22:32:17.263 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:17.263 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.263 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.263 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:17.263 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394528+0000", 2024-09-12T22:32:17.264 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:17.264 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.264 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.264 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:17.264 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394529+0000", 2024-09-12T22:32:17.264 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4900000000000001e-07 2024-09-12T22:32:17.264 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.264 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.264 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:17.264 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394531+0000", 2024-09-12T22:32:17.264 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.458e-06 2024-09-12T22:32:17.264 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.264 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.265 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:17.265 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394535+0000", 2024-09-12T22:32:17.265 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7900000000000001e-06 2024-09-12T22:32:17.265 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.265 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.265 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:17.265 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394537+0000", 2024-09-12T22:32:17.265 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.632e-06 2024-09-12T22:32:17.265 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.265 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.265 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:17.265 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.404932+0000", 2024-09-12T22:32:17.265 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010394158000000001 2024-09-12T22:32:17.266 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.266 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.266 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:17.266 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405017+0000", 2024-09-12T22:32:17.266 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5525000000000005e-05 2024-09-12T22:32:17.266 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.266 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.266 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:17.266 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405114+0000", 2024-09-12T22:32:17.266 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.6527000000000006e-05 2024-09-12T22:32:17.266 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.266 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.266 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:17.266 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405818+0000", 2024-09-12T22:32:17.267 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00070412800000000005 2024-09-12T22:32:17.267 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.267 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.267 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:17.267 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406437+0000", 2024-09-12T22:32:17.267 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00061898900000000002 2024-09-12T22:32:17.267 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.267 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.267 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:17.267 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406463+0000", 2024-09-12T22:32:17.267 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6268e-05 2024-09-12T22:32:17.267 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.267 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.267 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:17.268 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406484+0000", 2024-09-12T22:32:17.268 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0536000000000001e-05 2024-09-12T22:32:17.268 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:17.268 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:17.268 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:17.268 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.268 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.268 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:17.268 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.401422+0000", 2024-09-12T22:32:17.268 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 39.82650658, 2024-09-12T22:32:17.268 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016896452999999999, 2024-09-12T22:32:17.268 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:17.268 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:17.269 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:17.269 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:17.269 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.269 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:17.269 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401422+0000", 2024-09-12T22:32:17.269 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:17.269 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.269 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.269 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:17.269 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401422+0000", 2024-09-12T22:32:17.269 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:17.269 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.269 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.269 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:17.270 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401424+0000", 2024-09-12T22:32:17.270 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9e-06 2024-09-12T22:32:17.270 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.270 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.270 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:17.270 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401437+0000", 2024-09-12T22:32:17.270 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2831e-05 2024-09-12T22:32:17.270 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.270 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.270 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:17.270 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401471+0000", 2024-09-12T22:32:17.270 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4010000000000001e-05 2024-09-12T22:32:17.270 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.270 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.271 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:17.271 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401484+0000", 2024-09-12T22:32:17.271 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2711000000000001e-05 2024-09-12T22:32:17.271 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.271 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.271 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:17.271 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405410+0000", 2024-09-12T22:32:17.271 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0039259170000000001 2024-09-12T22:32:17.271 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.271 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.271 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:17.271 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405529+0000", 2024-09-12T22:32:17.271 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000119778 2024-09-12T22:32:17.271 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.272 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.272 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:17.272 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405655+0000", 2024-09-12T22:32:17.272 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012556700000000001 2024-09-12T22:32:17.272 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.272 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.272 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:17.272 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410456+0000", 2024-09-12T22:32:17.272 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0048008269999999997 2024-09-12T22:32:17.272 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.272 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.272 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:17.272 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418226+0000", 2024-09-12T22:32:17.273 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0077707729999999999 2024-09-12T22:32:17.273 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.273 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.273 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:17.273 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418277+0000", 2024-09-12T22:32:17.273 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0476000000000003e-05 2024-09-12T22:32:17.273 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.273 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.273 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:17.273 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418319+0000", 2024-09-12T22:32:17.273 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1662999999999997e-05 2024-09-12T22:32:17.273 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:17.273 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:17.273 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:17.274 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.274 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.274 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:17.274 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.401505+0000", 2024-09-12T22:32:17.274 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 39.826423916000003, 2024-09-12T22:32:17.274 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016987904000000002, 2024-09-12T22:32:17.274 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:17.274 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:17.274 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:17.274 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:17.274 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.274 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:17.274 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401505+0000", 2024-09-12T22:32:17.275 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:17.275 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.275 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.275 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:17.275 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401505+0000", 2024-09-12T22:32:17.275 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:17.275 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.275 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.275 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:17.275 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401506+0000", 2024-09-12T22:32:17.275 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4700000000000001e-07 2024-09-12T22:32:17.275 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.275 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.276 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:17.276 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401510+0000", 2024-09-12T22:32:17.276 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6609999999999999e-06 2024-09-12T22:32:17.276 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.276 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.276 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:17.276 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401771+0000", 2024-09-12T22:32:17.276 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00026110700000000001 2024-09-12T22:32:17.276 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.276 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.276 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:17.276 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401921+0000", 2024-09-12T22:32:17.276 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014939099999999999 2024-09-12T22:32:17.276 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.277 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.277 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:17.277 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405944+0000", 2024-09-12T22:32:17.277 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0040235449999999999 2024-09-12T22:32:17.277 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.277 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.277 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:17.277 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406018+0000", 2024-09-12T22:32:17.277 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3373000000000004e-05 2024-09-12T22:32:17.277 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.277 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.277 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:17.277 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406172+0000", 2024-09-12T22:32:17.278 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00015435399999999999 2024-09-12T22:32:17.278 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.278 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.278 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:17.278 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410461+0000", 2024-09-12T22:32:17.278 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0042888609999999997 2024-09-12T22:32:17.278 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.278 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.278 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:17.278 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418371+0000", 2024-09-12T22:32:17.279 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0079098380000000006 2024-09-12T22:32:17.279 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.279 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.279 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:17.279 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418443+0000", 2024-09-12T22:32:17.279 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2705000000000003e-05 2024-09-12T22:32:17.279 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.279 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.280 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:17.280 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418493+0000", 2024-09-12T22:32:17.280 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9322e-05 2024-09-12T22:32:17.280 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:17.280 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:17.280 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:17.280 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.280 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.280 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:17.281 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.401939+0000", 2024-09-12T22:32:17.281 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 39.825990179999998, 2024-09-12T22:32:17.281 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016722292999999999, 2024-09-12T22:32:17.281 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:17.281 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:17.281 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:17.281 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:17.281 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.281 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:17.281 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401939+0000", 2024-09-12T22:32:17.281 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:17.281 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.281 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.282 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:17.282 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401939+0000", 2024-09-12T22:32:17.282 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:17.282 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.282 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.282 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:17.282 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401940+0000", 2024-09-12T22:32:17.282 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1990000000000001e-06 2024-09-12T22:32:17.282 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.282 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.282 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:17.282 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401956+0000", 2024-09-12T22:32:17.282 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.6344000000000001e-05 2024-09-12T22:32:17.282 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.283 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.283 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:17.283 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401974+0000", 2024-09-12T22:32:17.283 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7730000000000001e-05 2024-09-12T22:32:17.283 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.283 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.283 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:17.283 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401982+0000", 2024-09-12T22:32:17.283 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.7800000000000001e-06 2024-09-12T22:32:17.283 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.283 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.283 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:17.283 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406557+0000", 2024-09-12T22:32:17.283 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0045758489999999999 2024-09-12T22:32:17.284 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.284 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.284 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:17.284 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406697+0000", 2024-09-12T22:32:17.284 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013925100000000001 2024-09-12T22:32:17.284 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.284 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.284 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:17.284 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406830+0000", 2024-09-12T22:32:17.284 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013293499999999999 2024-09-12T22:32:17.284 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.284 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.284 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:17.284 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410465+0000", 2024-09-12T22:32:17.285 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0036352680000000001 2024-09-12T22:32:17.285 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.285 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.285 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:17.285 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418564+0000", 2024-09-12T22:32:17.285 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0080992140000000004 2024-09-12T22:32:17.285 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.285 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.285 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:17.285 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418621+0000", 2024-09-12T22:32:17.285 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7167999999999999e-05 2024-09-12T22:32:17.285 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.285 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.285 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:17.286 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418661+0000", 2024-09-12T22:32:17.286 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9555000000000003e-05 2024-09-12T22:32:17.286 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:17.286 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:17.286 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:17.286 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.286 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.286 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:17.286 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.401994+0000", 2024-09-12T22:32:17.286 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 39.825934308000001, 2024-09-12T22:32:17.286 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016804109000000001, 2024-09-12T22:32:17.286 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:17.286 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:17.287 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:17.287 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:17.287 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.287 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:17.287 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401994+0000", 2024-09-12T22:32:17.287 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:17.287 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.287 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.287 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:17.287 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401994+0000", 2024-09-12T22:32:17.287 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:17.287 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.287 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.287 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:17.288 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401995+0000", 2024-09-12T22:32:17.288 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.8899999999999998e-07 2024-09-12T22:32:17.288 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.288 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.288 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:17.288 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402000+0000", 2024-09-12T22:32:17.288 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.498e-06 2024-09-12T22:32:17.288 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.288 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.288 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:17.288 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402007+0000", 2024-09-12T22:32:17.288 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.554e-06 2024-09-12T22:32:17.288 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.289 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.289 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:17.289 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402046+0000", 2024-09-12T22:32:17.289 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9156000000000003e-05 2024-09-12T22:32:17.289 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.289 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.289 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:17.289 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407342+0000", 2024-09-12T22:32:17.289 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052957610000000004 2024-09-12T22:32:17.289 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.289 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.289 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:17.289 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407521+0000", 2024-09-12T22:32:17.289 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00017878100000000001 2024-09-12T22:32:17.290 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.290 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.290 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:17.290 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407641+0000", 2024-09-12T22:32:17.290 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012013 2024-09-12T22:32:17.290 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.290 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.290 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:17.290 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410472+0000", 2024-09-12T22:32:17.290 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.002830455 2024-09-12T22:32:17.290 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.290 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.290 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:17.290 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418714+0000", 2024-09-12T22:32:17.291 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0082422789999999999 2024-09-12T22:32:17.291 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.291 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.291 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:17.291 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418761+0000", 2024-09-12T22:32:17.291 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6956999999999998e-05 2024-09-12T22:32:17.291 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.291 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.291 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:17.291 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418799+0000", 2024-09-12T22:32:17.291 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7749000000000001e-05 2024-09-12T22:32:17.291 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:17.291 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:17.291 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:17.292 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.292 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.292 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:17.292 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.402060+0000", 2024-09-12T22:32:17.292 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 39.825868864, 2024-09-12T22:32:17.292 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016885686, 2024-09-12T22:32:17.292 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:17.292 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:17.292 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:17.292 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:17.292 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.292 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:17.292 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402060+0000", 2024-09-12T22:32:17.293 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:17.293 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.293 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.293 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:17.293 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402060+0000", 2024-09-12T22:32:17.293 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:17.293 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.293 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.293 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:17.293 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402061+0000", 2024-09-12T22:32:17.293 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4399999999999999e-07 2024-09-12T22:32:17.293 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.294 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.294 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:17.294 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402066+0000", 2024-09-12T22:32:17.294 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8649999999999998e-06 2024-09-12T22:32:17.294 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.294 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.294 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:17.294 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402146+0000", 2024-09-12T22:32:17.294 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9054000000000006e-05 2024-09-12T22:32:17.294 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.294 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.294 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:17.294 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402287+0000", 2024-09-12T22:32:17.294 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014108600000000001 2024-09-12T22:32:17.295 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.295 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.295 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:17.295 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408185+0000", 2024-09-12T22:32:17.295 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0058983919999999997 2024-09-12T22:32:17.295 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.295 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.295 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:17.295 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408299+0000", 2024-09-12T22:32:17.295 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114102 2024-09-12T22:32:17.295 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.295 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.295 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:17.296 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408420+0000", 2024-09-12T22:32:17.296 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000120492 2024-09-12T22:32:17.296 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.296 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.296 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:17.296 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410867+0000", 2024-09-12T22:32:17.296 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0024476430000000002 2024-09-12T22:32:17.296 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.296 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.296 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:17.296 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418851+0000", 2024-09-12T22:32:17.296 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0079841489999999994 2024-09-12T22:32:17.296 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.296 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.297 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:17.297 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418894+0000", 2024-09-12T22:32:17.297 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3090000000000002e-05 2024-09-12T22:32:17.297 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.297 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.297 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:17.297 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418946+0000", 2024-09-12T22:32:17.297 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1069000000000002e-05 2024-09-12T22:32:17.297 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:17.297 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:17.297 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:17.297 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.297 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.298 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:17.298 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.402375+0000", 2024-09-12T22:32:17.298 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 39.825553798999998, 2024-09-12T22:32:17.298 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016768531999999999, 2024-09-12T22:32:17.298 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:17.298 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:17.298 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:17.298 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:17.298 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.298 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:17.298 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402375+0000", 2024-09-12T22:32:17.298 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:17.298 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.299 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.299 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:17.299 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402375+0000", 2024-09-12T22:32:17.299 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:17.299 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.299 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.299 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:17.299 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402375+0000", 2024-09-12T22:32:17.299 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4099999999999999e-07 2024-09-12T22:32:17.299 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.299 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.299 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:17.299 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402379+0000", 2024-09-12T22:32:17.299 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9870000000000001e-06 2024-09-12T22:32:17.300 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.300 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.300 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:17.300 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402389+0000", 2024-09-12T22:32:17.300 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0000000000000001e-05 2024-09-12T22:32:17.300 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.300 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.300 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:17.300 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402401+0000", 2024-09-12T22:32:17.300 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.148e-05 2024-09-12T22:32:17.300 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.300 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.300 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:17.300 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409108+0000", 2024-09-12T22:32:17.301 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0067068429999999997 2024-09-12T22:32:17.301 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.301 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.301 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:17.301 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409189+0000", 2024-09-12T22:32:17.301 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0815999999999993e-05 2024-09-12T22:32:17.301 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.301 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.301 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:17.301 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409320+0000", 2024-09-12T22:32:17.301 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000131586 2024-09-12T22:32:17.301 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.302 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.302 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:17.302 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410872+0000", 2024-09-12T22:32:17.302 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0015521599999999999 2024-09-12T22:32:17.302 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.302 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.302 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:17.302 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419049+0000", 2024-09-12T22:32:17.302 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0081763719999999995 2024-09-12T22:32:17.302 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.302 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.302 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:17.303 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419107+0000", 2024-09-12T22:32:17.303 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7899000000000002e-05 2024-09-12T22:32:17.303 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.303 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.303 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:17.303 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419143+0000", 2024-09-12T22:32:17.303 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6847999999999997e-05 2024-09-12T22:32:17.303 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:17.303 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:17.303 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:17.303 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.303 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.303 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:17.304 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.402903+0000", 2024-09-12T22:32:17.304 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 39.825025386999997, 2024-09-12T22:32:17.304 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016378428, 2024-09-12T22:32:17.304 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:17.304 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:17.304 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:17.304 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:17.304 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.304 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:17.304 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402903+0000", 2024-09-12T22:32:17.304 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:17.304 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.304 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.305 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:17.305 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402903+0000", 2024-09-12T22:32:17.305 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:17.305 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.305 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.305 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:17.305 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402904+0000", 2024-09-12T22:32:17.305 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9500000000000001e-07 2024-09-12T22:32:17.305 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.305 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.305 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:17.305 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402944+0000", 2024-09-12T22:32:17.305 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0265000000000002e-05 2024-09-12T22:32:17.305 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.306 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.306 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:17.306 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402979+0000", 2024-09-12T22:32:17.306 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4378000000000002e-05 2024-09-12T22:32:17.306 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.306 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.306 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:17.306 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402987+0000", 2024-09-12T22:32:17.306 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3559999999999993e-06 2024-09-12T22:32:17.306 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.306 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.306 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:17.306 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409577+0000", 2024-09-12T22:32:17.307 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0065901709999999997 2024-09-12T22:32:17.307 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.307 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.307 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:17.307 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409653+0000", 2024-09-12T22:32:17.307 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5819e-05 2024-09-12T22:32:17.307 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.307 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.307 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:17.307 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409725+0000", 2024-09-12T22:32:17.307 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2200000000000007e-05 2024-09-12T22:32:17.307 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.307 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.307 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:17.308 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.411234+0000", 2024-09-12T22:32:17.308 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001508225 2024-09-12T22:32:17.308 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.308 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.308 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:17.308 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419212+0000", 2024-09-12T22:32:17.308 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0079783400000000004 2024-09-12T22:32:17.308 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.308 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.308 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:17.308 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419244+0000", 2024-09-12T22:32:17.308 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2384e-05 2024-09-12T22:32:17.308 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.309 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.309 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:17.312 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419282+0000", 2024-09-12T22:32:17.312 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7394999999999997e-05 2024-09-12T22:32:17.312 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:17.312 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:17.312 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:17.312 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.312 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.313 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:17.313 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.403135+0000", 2024-09-12T22:32:17.313 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 39.824793517000003, 2024-09-12T22:32:17.313 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016294211999999999, 2024-09-12T22:32:17.313 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:17.313 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:17.313 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:17.313 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:17.313 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.313 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:17.313 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403135+0000", 2024-09-12T22:32:17.313 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:17.313 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.313 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.314 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:17.314 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403135+0000", 2024-09-12T22:32:17.314 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:17.314 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.314 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.314 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:17.314 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403136+0000", 2024-09-12T22:32:17.314 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.4e-07 2024-09-12T22:32:17.314 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.314 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.314 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:17.314 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403149+0000", 2024-09-12T22:32:17.314 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2723e-05 2024-09-12T22:32:17.315 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.315 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.315 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:17.315 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403158+0000", 2024-09-12T22:32:17.315 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3919999999999992e-06 2024-09-12T22:32:17.315 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.315 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.315 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:17.315 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403166+0000", 2024-09-12T22:32:17.315 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.2309999999999996e-06 2024-09-12T22:32:17.315 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.315 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.315 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:17.316 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409944+0000", 2024-09-12T22:32:17.316 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0067775309999999998 2024-09-12T22:32:17.316 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.316 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.316 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:17.316 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410032+0000", 2024-09-12T22:32:17.316 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.7906999999999997e-05 2024-09-12T22:32:17.316 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.316 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.316 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:17.316 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410152+0000", 2024-09-12T22:32:17.316 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012037800000000001 2024-09-12T22:32:17.316 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.316 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.317 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:17.317 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.411945+0000", 2024-09-12T22:32:17.317 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0017931850000000001 2024-09-12T22:32:17.317 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.317 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.317 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:17.317 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419319+0000", 2024-09-12T22:32:17.317 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0073731780000000002 2024-09-12T22:32:17.317 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.317 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.317 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:17.317 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419376+0000", 2024-09-12T22:32:17.317 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7728e-05 2024-09-12T22:32:17.318 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.318 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.318 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:17.318 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419429+0000", 2024-09-12T22:32:17.318 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3019000000000002e-05 2024-09-12T22:32:17.318 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:17.318 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:17.318 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:17.318 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.318 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.318 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:17.318 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.403185+0000", 2024-09-12T22:32:17.318 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 39.824743636000001, 2024-09-12T22:32:17.318 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.014902164000000001, 2024-09-12T22:32:17.319 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:17.319 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:17.319 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:17.319 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:17.319 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.319 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:17.319 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403185+0000", 2024-09-12T22:32:17.319 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:17.319 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.319 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.319 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:17.319 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403185+0000", 2024-09-12T22:32:17.319 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:17.320 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.320 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.320 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:17.320 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403186+0000", 2024-09-12T22:32:17.320 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9400000000000005e-07 2024-09-12T22:32:17.320 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.320 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.320 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:17.320 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403191+0000", 2024-09-12T22:32:17.320 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6980000000000003e-06 2024-09-12T22:32:17.320 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.320 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.320 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:17.321 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403199+0000", 2024-09-12T22:32:17.321 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2520000000000002e-06 2024-09-12T22:32:17.321 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.321 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.321 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:17.321 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403205+0000", 2024-09-12T22:32:17.321 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.908e-06 2024-09-12T22:32:17.321 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.321 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.321 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:17.321 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403359+0000", 2024-09-12T22:32:17.321 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000154544 2024-09-12T22:32:17.321 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.321 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.322 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:17.322 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403528+0000", 2024-09-12T22:32:17.322 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000168455 2024-09-12T22:32:17.322 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.322 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.322 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:17.322 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403763+0000", 2024-09-12T22:32:17.322 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00023539599999999999 2024-09-12T22:32:17.322 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.322 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.322 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:17.322 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409378+0000", 2024-09-12T22:32:17.322 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056150000000000002 2024-09-12T22:32:17.323 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.323 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.323 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:17.323 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418012+0000", 2024-09-12T22:32:17.323 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0086339559999999999 2024-09-12T22:32:17.323 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.323 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.323 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:17.323 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418046+0000", 2024-09-12T22:32:17.323 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4267999999999998e-05 2024-09-12T22:32:17.323 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.323 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.323 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:17.323 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418087+0000", 2024-09-12T22:32:17.324 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0992999999999999e-05 2024-09-12T22:32:17.324 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:17.324 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:17.324 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:17.324 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.324 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.324 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:17.324 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.403273+0000", 2024-09-12T22:32:17.324 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 39.824655685000003, 2024-09-12T22:32:17.324 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.014934866, 2024-09-12T22:32:17.324 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:17.324 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:17.324 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:17.325 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:17.325 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.325 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:17.325 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403273+0000", 2024-09-12T22:32:17.325 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:17.325 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.325 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.325 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:17.325 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403273+0000", 2024-09-12T22:32:17.325 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:17.325 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.325 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.325 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:17.326 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403274+0000", 2024-09-12T22:32:17.326 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.297e-06 2024-09-12T22:32:17.326 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.326 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.326 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:17.326 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403282+0000", 2024-09-12T22:32:17.326 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6340000000000001e-06 2024-09-12T22:32:17.326 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.326 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.326 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:17.326 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403305+0000", 2024-09-12T22:32:17.326 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3149000000000001e-05 2024-09-12T22:32:17.326 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.327 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.327 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:17.327 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403320+0000", 2024-09-12T22:32:17.327 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4527e-05 2024-09-12T22:32:17.327 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.327 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.327 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:17.327 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.404928+0000", 2024-09-12T22:32:17.327 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001608459 2024-09-12T22:32:17.327 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.327 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.327 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:17.327 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405218+0000", 2024-09-12T22:32:17.328 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00028982900000000002 2024-09-12T22:32:17.328 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.328 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.328 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:17.328 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405829+0000", 2024-09-12T22:32:17.328 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00061127900000000005 2024-09-12T22:32:17.328 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.328 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.328 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:17.328 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409403+0000", 2024-09-12T22:32:17.328 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.003573597 2024-09-12T22:32:17.328 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.328 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.328 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:17.329 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418138+0000", 2024-09-12T22:32:17.329 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0087349969999999996 2024-09-12T22:32:17.329 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.329 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.329 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:17.329 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418178+0000", 2024-09-12T22:32:17.329 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0649999999999999e-05 2024-09-12T22:32:17.329 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.329 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.329 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:17.329 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418208+0000", 2024-09-12T22:32:17.329 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9448e-05 2024-09-12T22:32:17.329 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:17.330 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:17.330 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:17.330 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.330 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.330 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:17.330 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.405456+0000", 2024-09-12T22:32:17.330 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 39.82247254, 2024-09-12T22:32:17.330 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012888389, 2024-09-12T22:32:17.330 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:17.330 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:17.330 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:17.330 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:17.330 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.330 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:17.331 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405456+0000", 2024-09-12T22:32:17.331 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:17.331 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.331 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.331 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:17.331 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405456+0000", 2024-09-12T22:32:17.331 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:17.331 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.331 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.331 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:17.331 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405457+0000", 2024-09-12T22:32:17.331 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.6599999999999994e-07 2024-09-12T22:32:17.331 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.332 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.332 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:17.332 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405463+0000", 2024-09-12T22:32:17.332 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4739999999999996e-06 2024-09-12T22:32:17.332 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.332 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.332 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:17.332 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405474+0000", 2024-09-12T22:32:17.332 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1095e-05 2024-09-12T22:32:17.332 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.332 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.332 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:17.332 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405482+0000", 2024-09-12T22:32:17.332 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3610000000000001e-06 2024-09-12T22:32:17.333 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.333 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.333 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:17.333 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407051+0000", 2024-09-12T22:32:17.333 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0015688970000000001 2024-09-12T22:32:17.333 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.333 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.333 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:17.333 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407259+0000", 2024-09-12T22:32:17.333 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00020778300000000001 2024-09-12T22:32:17.333 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.333 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.333 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:17.333 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407622+0000", 2024-09-12T22:32:17.334 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000363066 2024-09-12T22:32:17.334 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.334 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.334 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:17.334 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409438+0000", 2024-09-12T22:32:17.334 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001816319 2024-09-12T22:32:17.334 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.334 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.334 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:17.334 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418257+0000", 2024-09-12T22:32:17.334 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0088187720000000008 2024-09-12T22:32:17.334 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.335 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.335 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:17.335 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418308+0000", 2024-09-12T22:32:17.335 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1180000000000001e-05 2024-09-12T22:32:17.335 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.335 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.335 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:17.335 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418345+0000", 2024-09-12T22:32:17.335 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6476000000000001e-05 2024-09-12T22:32:17.335 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:17.335 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:17.335 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:17.335 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.335 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.336 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:17.336 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.405496+0000", 2024-09-12T22:32:17.336 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 39.822433183000001, 2024-09-12T22:32:17.336 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013016012, 2024-09-12T22:32:17.336 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:17.336 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:17.336 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:17.336 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:17.336 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.337 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:17.337 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405496+0000", 2024-09-12T22:32:17.337 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:17.337 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.337 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.337 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:17.337 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405496+0000", 2024-09-12T22:32:17.337 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:17.337 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.337 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.337 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:17.337 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405496+0000", 2024-09-12T22:32:17.337 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7999999999999995e-07 2024-09-12T22:32:17.337 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.338 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.338 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:17.338 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405501+0000", 2024-09-12T22:32:17.338 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8359999999999999e-06 2024-09-12T22:32:17.338 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.338 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.338 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:17.338 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405514+0000", 2024-09-12T22:32:17.338 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2522e-05 2024-09-12T22:32:17.338 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.338 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.338 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:17.338 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405521+0000", 2024-09-12T22:32:17.339 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5020000000000003e-06 2024-09-12T22:32:17.339 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.339 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.339 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:17.339 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405575+0000", 2024-09-12T22:32:17.339 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4169999999999998e-05 2024-09-12T22:32:17.339 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.339 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.339 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:17.339 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405697+0000", 2024-09-12T22:32:17.339 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000121301 2024-09-12T22:32:17.339 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.339 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.339 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:17.340 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405829+0000", 2024-09-12T22:32:17.340 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000132662 2024-09-12T22:32:17.340 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.340 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.340 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:17.340 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409155+0000", 2024-09-12T22:32:17.340 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0033259050000000001 2024-09-12T22:32:17.340 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.340 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.340 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:17.340 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418425+0000", 2024-09-12T22:32:17.340 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0092696319999999999 2024-09-12T22:32:17.340 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.341 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.341 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:17.341 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418471+0000", 2024-09-12T22:32:17.341 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6213e-05 2024-09-12T22:32:17.341 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.341 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.341 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:17.341 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418512+0000", 2024-09-12T22:32:17.341 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0589000000000001e-05 2024-09-12T22:32:17.341 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:17.341 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:17.341 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:17.341 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.341 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.342 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:17.342 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.406108+0000", 2024-09-12T22:32:17.342 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 39.821820786000004, 2024-09-12T22:32:17.342 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012458175, 2024-09-12T22:32:17.342 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:17.342 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:17.342 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:17.342 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:17.342 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.342 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:17.342 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406108+0000", 2024-09-12T22:32:17.342 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:17.342 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.343 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.343 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:17.343 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406108+0000", 2024-09-12T22:32:17.343 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:17.343 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.343 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.343 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:17.343 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406109+0000", 2024-09-12T22:32:17.343 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9899999999999999e-07 2024-09-12T22:32:17.343 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.343 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.343 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:17.343 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406115+0000", 2024-09-12T22:32:17.343 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9030000000000001e-06 2024-09-12T22:32:17.344 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.344 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.344 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:17.344 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406141+0000", 2024-09-12T22:32:17.344 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5999e-05 2024-09-12T22:32:17.344 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.344 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.344 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:17.344 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406150+0000", 2024-09-12T22:32:17.344 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.6050000000000004e-06 2024-09-12T22:32:17.344 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.344 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.344 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:17.345 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408163+0000", 2024-09-12T22:32:17.345 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0020122769999999998 2024-09-12T22:32:17.345 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.345 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.345 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:17.345 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408309+0000", 2024-09-12T22:32:17.345 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014606999999999999 2024-09-12T22:32:17.345 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.345 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.345 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:17.345 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408433+0000", 2024-09-12T22:32:17.345 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012460300000000001 2024-09-12T22:32:17.345 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.346 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.346 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:17.346 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409903+0000", 2024-09-12T22:32:17.346 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001469499 2024-09-12T22:32:17.346 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.346 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.346 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:17.346 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418427+0000", 2024-09-12T22:32:17.346 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0085241139999999993 2024-09-12T22:32:17.346 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.346 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.346 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:17.346 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418471+0000", 2024-09-12T22:32:17.346 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4474000000000001e-05 2024-09-12T22:32:17.347 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.347 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.347 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:17.347 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418566+0000", 2024-09-12T22:32:17.347 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.4732e-05 2024-09-12T22:32:17.347 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:17.347 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:17.347 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:17.347 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.347 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.347 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:17.347 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.407266+0000", 2024-09-12T22:32:17.347 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 39.820662929999997, 2024-09-12T22:32:17.348 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011442905, 2024-09-12T22:32:17.348 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:17.348 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:17.348 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2024-09-12T22:32:17.348 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:17.348 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.348 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:17.348 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407266+0000", 2024-09-12T22:32:17.348 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:17.348 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.348 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.348 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:17.348 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407266+0000", 2024-09-12T22:32:17.348 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:17.349 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.349 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.349 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:17.349 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407266+0000", 2024-09-12T22:32:17.349 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7899999999999998e-07 2024-09-12T22:32:17.349 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.349 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.349 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:17.349 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407269+0000", 2024-09-12T22:32:17.349 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9210000000000001e-06 2024-09-12T22:32:17.349 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.349 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.349 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:17.350 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407331+0000", 2024-09-12T22:32:17.350 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1376000000000003e-05 2024-09-12T22:32:17.350 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.350 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.350 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:17.350 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407337+0000", 2024-09-12T22:32:17.350 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1929999999999998e-06 2024-09-12T22:32:17.350 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.350 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.350 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:17.350 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408974+0000", 2024-09-12T22:32:17.350 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0016367109999999999 2024-09-12T22:32:17.350 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.350 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.351 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:17.351 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409112+0000", 2024-09-12T22:32:17.351 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000137952 2024-09-12T22:32:17.351 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:17.351 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:17.351 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:17.351 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418709+0000", 2024-09-12T22:32:17.351 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0095971730000000005 2024-09-12T22:32:17.351 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:17.351 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:17.351 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:17.351 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:17.351 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:17.351 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-09-12T22:32:17.353 INFO:teuthology.orchestra.run.smithi019.stderr:nodeep-scrub is unset 2024-09-12T22:32:17.354 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:17.352+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:17.354 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:32:17.454 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:32:17.453+0000 7fddec6a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30331) UID: 0 2024-09-12T22:32:17.467 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-09-12T22:32:17.467 INFO:teuthology.orchestra.run.smithi076.stdout: "ops": [], 2024-09-12T22:32:17.467 INFO:teuthology.orchestra.run.smithi076.stdout: "num_ops": 0 2024-09-12T22:32:17.467 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-09-12T22:32:17.476 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:32:17.560 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:32:17.559+0000 7fddec6a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30331) UID: 0 2024-09-12T22:32:17.619 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-09-12T22:32:17.619 INFO:teuthology.orchestra.run.smithi076.stdout: "ops": [], 2024-09-12T22:32:17.619 INFO:teuthology.orchestra.run.smithi076.stdout: "complaint_time": 30, 2024-09-12T22:32:17.619 INFO:teuthology.orchestra.run.smithi076.stdout: "num_blocked_ops": 0 2024-09-12T22:32:17.619 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-09-12T22:32:17.628 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:32:17.656 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:17.655+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:17.706 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T22:32:17.757 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:32:17.756+0000 7fddec6a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30331) UID: 0 2024-09-12T22:32:17.774 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-09-12T22:32:17.774 INFO:teuthology.orchestra.run.smithi076.stdout: "size": 20, 2024-09-12T22:32:17.774 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 600, 2024-09-12T22:32:17.774 INFO:teuthology.orchestra.run.smithi076.stdout: "ops": [ 2024-09-12T22:32:17.774 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.774 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:17.774 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.400604+0000", 2024-09-12T22:32:17.774 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 40.371636195999997, 2024-09-12T22:32:17.775 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.017278814, 2024-09-12T22:32:17.775 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:17.775 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:17.775 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:17.775 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:17.775 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.775 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:17.775 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400604+0000", 2024-09-12T22:32:17.775 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:17.775 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.775 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.775 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:17.775 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400604+0000", 2024-09-12T22:32:17.775 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:17.776 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.776 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.776 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:17.776 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400617+0000", 2024-09-12T22:32:17.776 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.3076e-05 2024-09-12T22:32:17.776 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.776 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.776 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:17.776 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400623+0000", 2024-09-12T22:32:17.776 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.5780000000000004e-06 2024-09-12T22:32:17.776 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.776 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.776 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:17.777 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400641+0000", 2024-09-12T22:32:17.777 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.8218000000000001e-05 2024-09-12T22:32:17.777 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.777 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.777 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:17.777 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400652+0000", 2024-09-12T22:32:17.777 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.0421999999999999e-05 2024-09-12T22:32:17.777 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.777 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.777 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:17.777 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400707+0000", 2024-09-12T22:32:17.777 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.4666000000000001e-05 2024-09-12T22:32:17.777 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.777 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.778 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op must wait for map", 2024-09-12T22:32:17.778 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400711+0000", 2024-09-12T22:32:17.778 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.5340000000000001e-06 2024-09-12T22:32:17.778 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.778 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.778 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:17.778 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.412066+0000", 2024-09-12T22:32:17.778 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.011354797999999999 2024-09-12T22:32:17.778 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.778 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.778 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:17.778 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.412672+0000", 2024-09-12T22:32:17.778 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00060620499999999996 2024-09-12T22:32:17.778 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.779 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.779 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:17.779 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.413032+0000", 2024-09-12T22:32:17.779 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00035955999999999998 2024-09-12T22:32:17.779 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.779 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.779 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op_commit", 2024-09-12T22:32:17.779 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417252+0000", 2024-09-12T22:32:17.779 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.004219899 2024-09-12T22:32:17.779 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.779 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.780 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:17.780 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417812+0000", 2024-09-12T22:32:17.780 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.000560182 2024-09-12T22:32:17.780 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.780 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.780 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:17.780 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417851+0000", 2024-09-12T22:32:17.780 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.9057999999999998e-05 2024-09-12T22:32:17.780 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.781 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.781 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:17.781 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417882+0000", 2024-09-12T22:32:17.781 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.1618000000000001e-05 2024-09-12T22:32:17.781 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:17.781 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:17.781 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:17.781 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.781 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.781 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:17.781 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.400674+0000", 2024-09-12T22:32:17.781 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 40.371565478000001, 2024-09-12T22:32:17.781 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.017348971000000001, 2024-09-12T22:32:17.782 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:17.784 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:17.784 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:17.784 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:17.784 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.784 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:17.784 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400674+0000", 2024-09-12T22:32:17.785 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:17.785 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.785 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.785 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:17.785 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400674+0000", 2024-09-12T22:32:17.785 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:17.785 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.785 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.785 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:17.785 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400675+0000", 2024-09-12T22:32:17.785 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.37e-07 2024-09-12T22:32:17.785 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.785 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.786 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:17.786 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400678+0000", 2024-09-12T22:32:17.786 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.303e-06 2024-09-12T22:32:17.786 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.786 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.786 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:17.786 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400684+0000", 2024-09-12T22:32:17.786 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.0290000000000002e-06 2024-09-12T22:32:17.786 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.786 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.786 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:17.786 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400688+0000", 2024-09-12T22:32:17.786 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.0890000000000002e-06 2024-09-12T22:32:17.787 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.787 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.787 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:17.787 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400806+0000", 2024-09-12T22:32:17.787 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00011814700000000001 2024-09-12T22:32:17.787 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.787 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.787 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:32:17.787 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400811+0000", 2024-09-12T22:32:17.787 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.0479999999999998e-06 2024-09-12T22:32:17.787 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.787 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.787 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:17.787 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.413877+0000", 2024-09-12T22:32:17.787 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.013065561 2024-09-12T22:32:17.788 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.788 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.788 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:17.788 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.413984+0000", 2024-09-12T22:32:17.788 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.000106566 2024-09-12T22:32:17.788 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.788 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.788 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:17.788 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.414264+0000", 2024-09-12T22:32:17.788 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00028067199999999999 2024-09-12T22:32:17.788 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.788 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.788 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op_commit", 2024-09-12T22:32:17.789 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417614+0000", 2024-09-12T22:32:17.789 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0033500729999999999 2024-09-12T22:32:17.789 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.789 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.789 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:17.789 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417946+0000", 2024-09-12T22:32:17.789 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00033209199999999998 2024-09-12T22:32:17.789 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.789 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.789 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:17.789 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417995+0000", 2024-09-12T22:32:17.789 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.808e-05 2024-09-12T22:32:17.789 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.789 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.789 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:17.790 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.418023+0000", 2024-09-12T22:32:17.790 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.8773999999999999e-05 2024-09-12T22:32:17.790 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:17.790 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:17.790 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:17.790 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.790 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.790 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:17.790 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.400694+0000", 2024-09-12T22:32:17.790 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 40.371545849, 2024-09-12T22:32:17.790 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.022845628, 2024-09-12T22:32:17.790 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:17.791 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:17.791 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:17.791 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:17.791 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.791 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:17.791 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400694+0000", 2024-09-12T22:32:17.791 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:17.791 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.791 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.791 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:17.791 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400694+0000", 2024-09-12T22:32:17.791 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:17.791 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.792 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.792 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:17.792 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400694+0000", 2024-09-12T22:32:17.792 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.48e-07 2024-09-12T22:32:17.792 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.792 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.792 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:17.792 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400709+0000", 2024-09-12T22:32:17.792 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.4888999999999999e-05 2024-09-12T22:32:17.792 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.792 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.792 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:17.792 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400722+0000", 2024-09-12T22:32:17.792 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.2882e-05 2024-09-12T22:32:17.793 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.793 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.793 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:17.793 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400732+0000", 2024-09-12T22:32:17.793 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.0299000000000001e-05 2024-09-12T22:32:17.793 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.793 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.793 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:17.793 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400793+0000", 2024-09-12T22:32:17.793 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.0253000000000001e-05 2024-09-12T22:32:17.793 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.793 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.793 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op must wait for map", 2024-09-12T22:32:17.793 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400798+0000", 2024-09-12T22:32:17.794 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.1569999999999999e-06 2024-09-12T22:32:17.794 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.794 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.794 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:17.794 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415059+0000", 2024-09-12T22:32:17.794 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.014260907 2024-09-12T22:32:17.794 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.794 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.794 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:17.794 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415396+0000", 2024-09-12T22:32:17.794 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00033720799999999997 2024-09-12T22:32:17.794 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.794 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.794 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:17.795 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415685+0000", 2024-09-12T22:32:17.795 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00028939900000000003 2024-09-12T22:32:17.795 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.795 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.795 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op_commit", 2024-09-12T22:32:17.795 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.418302+0000", 2024-09-12T22:32:17.795 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0026168039999999999 2024-09-12T22:32:17.795 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.795 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.795 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:17.795 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.423445+0000", 2024-09-12T22:32:17.795 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0051428150000000002 2024-09-12T22:32:17.795 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.796 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.796 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:17.796 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.423499+0000", 2024-09-12T22:32:17.796 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.3953000000000003e-05 2024-09-12T22:32:17.796 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.796 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.796 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:17.796 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.423540+0000", 2024-09-12T22:32:17.796 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.0813999999999999e-05 2024-09-12T22:32:17.796 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:17.796 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:17.796 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:17.796 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.796 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.797 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:17.797 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.400740+0000", 2024-09-12T22:32:17.797 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 40.371500126000001, 2024-09-12T22:32:17.797 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.022927528999999999, 2024-09-12T22:32:17.797 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:17.797 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:17.797 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:17.797 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:17.797 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.797 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:17.797 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400740+0000", 2024-09-12T22:32:17.797 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:17.798 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.798 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.798 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:17.798 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400740+0000", 2024-09-12T22:32:17.798 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:17.798 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.798 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.798 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:17.798 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400740+0000", 2024-09-12T22:32:17.798 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.3000000000000001e-07 2024-09-12T22:32:17.798 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.798 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.798 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:17.799 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400743+0000", 2024-09-12T22:32:17.799 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.5840000000000002e-06 2024-09-12T22:32:17.799 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.799 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.799 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:17.799 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400757+0000", 2024-09-12T22:32:17.799 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.3988999999999999e-05 2024-09-12T22:32:17.799 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.799 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.799 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:17.799 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400763+0000", 2024-09-12T22:32:17.799 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.686e-06 2024-09-12T22:32:17.799 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.799 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.800 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:17.800 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400818+0000", 2024-09-12T22:32:17.800 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.4941000000000001e-05 2024-09-12T22:32:17.800 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.800 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.800 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:32:17.800 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400824+0000", 2024-09-12T22:32:17.800 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.4600000000000002e-06 2024-09-12T22:32:17.800 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.800 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.800 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:17.800 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416227+0000", 2024-09-12T22:32:17.800 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.015403604 2024-09-12T22:32:17.800 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.800 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.801 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:17.801 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416306+0000", 2024-09-12T22:32:17.801 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 7.9126000000000001e-05 2024-09-12T22:32:17.801 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.801 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.801 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:17.801 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416678+0000", 2024-09-12T22:32:17.801 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00037105500000000002 2024-09-12T22:32:17.801 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.801 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.801 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op_commit", 2024-09-12T22:32:17.801 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.418363+0000", 2024-09-12T22:32:17.801 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.001685095 2024-09-12T22:32:17.802 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.802 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.802 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:17.802 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.423591+0000", 2024-09-12T22:32:17.802 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0052283980000000004 2024-09-12T22:32:17.802 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.802 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.802 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:17.802 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.423624+0000", 2024-09-12T22:32:17.802 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.3024000000000001e-05 2024-09-12T22:32:17.802 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.802 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.803 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:17.803 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.423667+0000", 2024-09-12T22:32:17.803 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.3136999999999997e-05 2024-09-12T22:32:17.803 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:17.803 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:17.803 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:17.803 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.803 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.803 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:17.803 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.400783+0000", 2024-09-12T22:32:17.803 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 40.371456594000001, 2024-09-12T22:32:17.803 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.016563729999999999, 2024-09-12T22:32:17.803 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:17.803 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:17.804 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:17.804 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:17.804 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.804 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:17.804 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400783+0000", 2024-09-12T22:32:17.804 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:17.804 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.804 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.804 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:17.804 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400783+0000", 2024-09-12T22:32:17.804 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:17.804 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.804 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.805 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:17.805 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400784+0000", 2024-09-12T22:32:17.805 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.5900000000000002e-07 2024-09-12T22:32:17.805 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.805 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.805 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:17.805 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400787+0000", 2024-09-12T22:32:17.805 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.1690000000000001e-06 2024-09-12T22:32:17.805 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.805 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.805 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:17.805 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400794+0000", 2024-09-12T22:32:17.805 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 7.058e-06 2024-09-12T22:32:17.806 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.806 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.806 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:17.806 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400798+0000", 2024-09-12T22:32:17.806 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.335e-06 2024-09-12T22:32:17.806 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.806 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.806 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:17.806 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400841+0000", 2024-09-12T22:32:17.806 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.2369e-05 2024-09-12T22:32:17.806 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.806 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.806 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op must wait for map", 2024-09-12T22:32:17.807 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400844+0000", 2024-09-12T22:32:17.807 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.128e-06 2024-09-12T22:32:17.807 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.807 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.807 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:17.807 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.410479+0000", 2024-09-12T22:32:17.807 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0096354189999999992 2024-09-12T22:32:17.807 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.807 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.807 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:17.807 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.410597+0000", 2024-09-12T22:32:17.807 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.000118305 2024-09-12T22:32:17.807 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.807 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.808 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:17.808 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.410838+0000", 2024-09-12T22:32:17.808 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.000240967 2024-09-12T22:32:17.808 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.808 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.808 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op_commit", 2024-09-12T22:32:17.808 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416489+0000", 2024-09-12T22:32:17.808 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0056507989999999998 2024-09-12T22:32:17.808 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.808 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.808 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:17.808 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417255+0000", 2024-09-12T22:32:17.808 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00076626199999999998 2024-09-12T22:32:17.809 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.809 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.809 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:17.809 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417306+0000", 2024-09-12T22:32:17.809 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.0319999999999999e-05 2024-09-12T22:32:17.809 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.809 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.809 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:17.809 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417347+0000", 2024-09-12T22:32:17.809 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.1140000000000003e-05 2024-09-12T22:32:17.809 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:17.809 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:17.809 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:17.809 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.809 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.810 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:17.810 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.400811+0000", 2024-09-12T22:32:17.810 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 40.371428524999999, 2024-09-12T22:32:17.810 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.017061263, 2024-09-12T22:32:17.810 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:17.810 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:17.810 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:17.810 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:17.810 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.810 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:17.810 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400811+0000", 2024-09-12T22:32:17.810 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:17.811 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.811 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.811 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:17.811 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400811+0000", 2024-09-12T22:32:17.811 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:17.811 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.811 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.811 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:17.811 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400812+0000", 2024-09-12T22:32:17.811 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.27e-07 2024-09-12T22:32:17.811 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.811 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.811 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:17.812 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400814+0000", 2024-09-12T22:32:17.812 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.553e-06 2024-09-12T22:32:17.812 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.812 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.812 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:17.812 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400819+0000", 2024-09-12T22:32:17.812 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.3569999999999997e-06 2024-09-12T22:32:17.812 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.812 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.812 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:17.812 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400824+0000", 2024-09-12T22:32:17.812 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.6820000000000002e-06 2024-09-12T22:32:17.812 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.812 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.813 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:17.813 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400871+0000", 2024-09-12T22:32:17.813 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.7311000000000002e-05 2024-09-12T22:32:17.813 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.813 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.813 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:32:17.813 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400875+0000", 2024-09-12T22:32:17.813 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.0960000000000001e-06 2024-09-12T22:32:17.813 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.813 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.813 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:17.813 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.412071+0000", 2024-09-12T22:32:17.813 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.011195999999999999 2024-09-12T22:32:17.813 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.814 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.814 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:17.814 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.412520+0000", 2024-09-12T22:32:17.814 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.000449522 2024-09-12T22:32:17.814 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.814 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.814 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:17.814 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.412655+0000", 2024-09-12T22:32:17.814 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00013487899999999999 2024-09-12T22:32:17.814 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.814 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.814 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op_commit", 2024-09-12T22:32:17.814 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417096+0000", 2024-09-12T22:32:17.814 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.004441113 2024-09-12T22:32:17.815 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.815 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.815 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:17.815 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417768+0000", 2024-09-12T22:32:17.815 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00067161100000000002 2024-09-12T22:32:17.815 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.815 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.815 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:17.815 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417834+0000", 2024-09-12T22:32:17.815 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.6058999999999999e-05 2024-09-12T22:32:17.815 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.815 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.815 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:17.815 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417873+0000", 2024-09-12T22:32:17.816 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.8753e-05 2024-09-12T22:32:17.816 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:17.816 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:17.816 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:17.816 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.816 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.816 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:17.816 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.400842+0000", 2024-09-12T22:32:17.816 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 40.371397817999998, 2024-09-12T22:32:17.816 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.022846262999999999, 2024-09-12T22:32:17.816 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:17.816 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:17.816 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:17.816 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:17.817 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.817 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:17.817 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400842+0000", 2024-09-12T22:32:17.817 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:17.817 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.817 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.817 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:17.817 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400842+0000", 2024-09-12T22:32:17.817 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:17.817 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.817 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.817 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:17.817 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400842+0000", 2024-09-12T22:32:17.817 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.9900000000000002e-07 2024-09-12T22:32:17.818 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.818 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.818 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:17.818 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400845+0000", 2024-09-12T22:32:17.818 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.8609999999999998e-06 2024-09-12T22:32:17.818 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.818 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.818 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:17.818 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400850+0000", 2024-09-12T22:32:17.818 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.634e-06 2024-09-12T22:32:17.818 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.818 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.818 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:17.818 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400855+0000", 2024-09-12T22:32:17.819 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.8339999999999998e-06 2024-09-12T22:32:17.819 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.819 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.819 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:17.819 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400886+0000", 2024-09-12T22:32:17.819 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.1393999999999998e-05 2024-09-12T22:32:17.819 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.819 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.819 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:32:17.819 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400888+0000", 2024-09-12T22:32:17.819 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.3470000000000001e-06 2024-09-12T22:32:17.819 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.819 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.819 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:17.820 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415640+0000", 2024-09-12T22:32:17.820 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.014751965000000001 2024-09-12T22:32:17.820 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.820 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.820 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:17.820 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415821+0000", 2024-09-12T22:32:17.820 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00018064399999999999 2024-09-12T22:32:17.820 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.820 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.820 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:17.821 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415949+0000", 2024-09-12T22:32:17.821 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00012816699999999999 2024-09-12T22:32:17.821 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.821 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.821 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op_commit", 2024-09-12T22:32:17.821 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.418337+0000", 2024-09-12T22:32:17.821 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0023878469999999998 2024-09-12T22:32:17.821 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.821 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.821 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:17.821 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.423588+0000", 2024-09-12T22:32:17.821 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0052509849999999997 2024-09-12T22:32:17.821 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.821 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.822 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:17.822 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.423650+0000", 2024-09-12T22:32:17.822 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.2026999999999994e-05 2024-09-12T22:32:17.822 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.822 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.822 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:17.822 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.423688+0000", 2024-09-12T22:32:17.822 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.8259000000000001e-05 2024-09-12T22:32:17.822 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:17.822 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:17.822 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:17.822 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.822 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.823 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:17.823 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.400862+0000", 2024-09-12T22:32:17.823 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 40.371377844000001, 2024-09-12T22:32:17.823 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.016404294, 2024-09-12T22:32:17.823 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:17.823 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:17.823 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "started", 2024-09-12T22:32:17.823 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:17.823 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.823 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:17.823 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400862+0000", 2024-09-12T22:32:17.823 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:17.823 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.823 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.824 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:17.824 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400862+0000", 2024-09-12T22:32:17.824 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:17.824 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.824 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.824 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:17.824 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400862+0000", 2024-09-12T22:32:17.824 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.8099999999999999e-07 2024-09-12T22:32:17.824 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.824 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.824 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:17.824 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400870+0000", 2024-09-12T22:32:17.824 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 8.1349999999999992e-06 2024-09-12T22:32:17.824 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.825 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.825 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:17.825 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400876+0000", 2024-09-12T22:32:17.825 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.2039999999999996e-06 2024-09-12T22:32:17.825 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.825 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.825 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:17.825 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400879+0000", 2024-09-12T22:32:17.825 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.529e-06 2024-09-12T22:32:17.825 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.825 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.825 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:17.825 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400912+0000", 2024-09-12T22:32:17.825 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.2653000000000001e-05 2024-09-12T22:32:17.826 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.826 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.826 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op must wait for map", 2024-09-12T22:32:17.826 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400915+0000", 2024-09-12T22:32:17.826 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.1099999999999999e-06 2024-09-12T22:32:17.826 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.826 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.826 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:17.826 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408727+0000", 2024-09-12T22:32:17.826 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0078123869999999996 2024-09-12T22:32:17.826 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.826 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.826 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:17.826 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408838+0000", 2024-09-12T22:32:17.827 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00011042700000000001 2024-09-12T22:32:17.827 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.827 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.827 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:17.827 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417266+0000", 2024-09-12T22:32:17.827 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0084285680000000009 2024-09-12T22:32:17.827 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:17.827 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:17.827 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:17.827 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.827 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.827 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:17.827 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.400889+0000", 2024-09-12T22:32:17.827 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 40.371350591000002, 2024-09-12T22:32:17.828 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.014929550999999999, 2024-09-12T22:32:17.828 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:17.828 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:17.828 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "started", 2024-09-12T22:32:17.828 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:17.828 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.828 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:17.828 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400889+0000", 2024-09-12T22:32:17.828 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:17.828 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.828 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.828 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:17.828 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400889+0000", 2024-09-12T22:32:17.829 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:17.829 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.829 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.829 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:17.829 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400890+0000", 2024-09-12T22:32:17.829 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.8699999999999995e-07 2024-09-12T22:32:17.829 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.829 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.829 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:17.829 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400893+0000", 2024-09-12T22:32:17.829 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.9569999999999998e-06 2024-09-12T22:32:17.829 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.830 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.830 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:17.830 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400899+0000", 2024-09-12T22:32:17.830 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.4189999999999999e-06 2024-09-12T22:32:17.830 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.830 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.830 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:17.830 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400905+0000", 2024-09-12T22:32:17.830 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.7880000000000003e-06 2024-09-12T22:32:17.830 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.830 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.830 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:17.830 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400943+0000", 2024-09-12T22:32:17.830 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.7852999999999998e-05 2024-09-12T22:32:17.830 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.831 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.831 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op must wait for map", 2024-09-12T22:32:17.831 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400945+0000", 2024-09-12T22:32:17.831 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.627e-06 2024-09-12T22:32:17.831 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.831 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.831 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:17.831 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408398+0000", 2024-09-12T22:32:17.831 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0074525879999999996 2024-09-12T22:32:17.831 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.831 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.831 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:17.831 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408581+0000", 2024-09-12T22:32:17.832 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00018321900000000001 2024-09-12T22:32:17.832 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.832 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.832 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:17.832 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415819+0000", 2024-09-12T22:32:17.832 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0072376130000000004 2024-09-12T22:32:17.832 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:17.832 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:17.832 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:17.832 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.832 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.832 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:25 3.7 e19/17 3:e0b41d06:::609.00000000:head v 19'2, mlcod=0'0)", 2024-09-12T22:32:17.832 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.402511+0000", 2024-09-12T22:32:17.833 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 40.369728447999996, 2024-09-12T22:32:17.833 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0089735260000000008, 2024-09-12T22:32:17.833 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:17.833 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:17.833 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:17.833 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:17.833 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.833 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:17.833 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.402511+0000", 2024-09-12T22:32:17.833 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:17.833 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.833 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.833 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:17.833 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.402511+0000", 2024-09-12T22:32:17.834 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:17.834 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.834 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.834 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:17.834 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.402512+0000", 2024-09-12T22:32:17.834 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 8.71e-07 2024-09-12T22:32:17.834 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.834 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.834 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:17.834 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.402520+0000", 2024-09-12T22:32:17.834 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 7.8529999999999992e-06 2024-09-12T22:32:17.834 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.834 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.834 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:17.835 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.402530+0000", 2024-09-12T22:32:17.835 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 9.859e-06 2024-09-12T22:32:17.835 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.835 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.835 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:17.835 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.402555+0000", 2024-09-12T22:32:17.835 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.4822000000000001e-05 2024-09-12T22:32:17.835 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.835 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.835 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:17.835 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.403173+0000", 2024-09-12T22:32:17.835 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00061813199999999997 2024-09-12T22:32:17.836 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.836 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.836 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:17.836 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.403195+0000", 2024-09-12T22:32:17.836 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.2286e-05 2024-09-12T22:32:17.836 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.836 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.836 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:17.836 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.411436+0000", 2024-09-12T22:32:17.836 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0082410539999999994 2024-09-12T22:32:17.836 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.836 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.837 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:17.837 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.411485+0000", 2024-09-12T22:32:17.837 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.8649000000000001e-05 2024-09-12T22:32:17.837 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:17.837 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:17.837 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:17.837 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.837 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.837 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:18 3.14 e19/17 3:2f55791f:::606.00000000:head v 19'1, mlcod=0'0)", 2024-09-12T22:32:17.837 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.406646+0000", 2024-09-12T22:32:17.837 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 40.365593296, 2024-09-12T22:32:17.837 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0082036980000000006, 2024-09-12T22:32:17.837 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:17.837 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:17.838 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:17.838 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:17.838 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.838 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:17.838 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406646+0000", 2024-09-12T22:32:17.838 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:17.838 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.838 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.838 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:17.838 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406646+0000", 2024-09-12T22:32:17.838 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:17.838 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.839 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.839 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:17.839 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406647+0000", 2024-09-12T22:32:17.839 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.4499999999999998e-07 2024-09-12T22:32:17.839 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.839 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.839 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:17.839 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406651+0000", 2024-09-12T22:32:17.839 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.0300000000000004e-06 2024-09-12T22:32:17.839 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.839 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.839 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:17.839 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406657+0000", 2024-09-12T22:32:17.839 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.1330000000000004e-06 2024-09-12T22:32:17.840 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.840 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.840 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:17.840 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406665+0000", 2024-09-12T22:32:17.840 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 8.3650000000000004e-06 2024-09-12T22:32:17.840 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.840 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.840 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:17.840 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406804+0000", 2024-09-12T22:32:17.840 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00013900699999999999 2024-09-12T22:32:17.840 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.840 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.840 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:17.841 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406833+0000", 2024-09-12T22:32:17.841 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.8243e-05 2024-09-12T22:32:17.841 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.841 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.841 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:17.841 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.414741+0000", 2024-09-12T22:32:17.841 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0079089620000000003 2024-09-12T22:32:17.841 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.841 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.841 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:17.841 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.414850+0000", 2024-09-12T22:32:17.841 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.000108713 2024-09-12T22:32:17.841 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:17.841 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:17.842 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:17.842 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.842 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.842 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:6 3.10 e19/17 3:0d82a743:::600.00000000:head v 19'1, mlcod=0'0)", 2024-09-12T22:32:17.842 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.406692+0000", 2024-09-12T22:32:17.842 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 40.365547528999997, 2024-09-12T22:32:17.842 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0093004430000000003, 2024-09-12T22:32:17.842 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:17.842 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:17.842 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:17.842 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:17.842 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.842 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:17.842 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406692+0000", 2024-09-12T22:32:17.843 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:17.843 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.843 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.843 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:17.843 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406692+0000", 2024-09-12T22:32:17.843 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:17.843 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.843 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.843 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:17.843 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406693+0000", 2024-09-12T22:32:17.843 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.6300000000000001e-07 2024-09-12T22:32:17.843 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.843 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.843 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:17.844 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406702+0000", 2024-09-12T22:32:17.844 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 9.5589999999999994e-06 2024-09-12T22:32:17.844 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.844 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.844 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:17.844 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406725+0000", 2024-09-12T22:32:17.844 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.2977999999999999e-05 2024-09-12T22:32:17.844 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.844 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.844 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:17.844 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406732+0000", 2024-09-12T22:32:17.844 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.8430000000000004e-06 2024-09-12T22:32:17.844 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.844 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.845 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:17.845 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406979+0000", 2024-09-12T22:32:17.845 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00024729199999999998 2024-09-12T22:32:17.845 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.845 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.845 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:17.845 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407000+0000", 2024-09-12T22:32:17.845 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.0573000000000001e-05 2024-09-12T22:32:17.845 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.845 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.845 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:17.845 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415928+0000", 2024-09-12T22:32:17.845 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0089286179999999993 2024-09-12T22:32:17.845 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.846 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.846 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:17.846 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415993+0000", 2024-09-12T22:32:17.846 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.4216999999999999e-05 2024-09-12T22:32:17.846 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:17.846 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:17.846 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:17.846 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.846 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.846 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:2 3.f e19/17 3:f1f69726:::400.00000000:head v 19'1, mlcod=0'0)", 2024-09-12T22:32:17.846 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.406942+0000", 2024-09-12T22:32:17.846 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 40.365297841999997, 2024-09-12T22:32:17.846 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0098433259999999995, 2024-09-12T22:32:17.847 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:17.847 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:17.847 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:17.847 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:17.847 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.847 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:17.847 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406942+0000", 2024-09-12T22:32:17.847 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:17.847 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.847 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.847 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:17.847 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406942+0000", 2024-09-12T22:32:17.847 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:17.847 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.848 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.848 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:17.848 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406943+0000", 2024-09-12T22:32:17.848 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.8800000000000002e-07 2024-09-12T22:32:17.848 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.848 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.848 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:17.848 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406949+0000", 2024-09-12T22:32:17.848 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.5869999999999998e-06 2024-09-12T22:32:17.848 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.848 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.848 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:17.848 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406960+0000", 2024-09-12T22:32:17.848 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.0873000000000001e-05 2024-09-12T22:32:17.849 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.849 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.849 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:17.849 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406970+0000", 2024-09-12T22:32:17.849 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 9.9119999999999993e-06 2024-09-12T22:32:17.849 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.849 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.849 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:17.849 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407535+0000", 2024-09-12T22:32:17.849 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00056508899999999996 2024-09-12T22:32:17.849 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.849 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.849 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:17.849 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407556+0000", 2024-09-12T22:32:17.850 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.1348999999999998e-05 2024-09-12T22:32:17.850 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.850 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.850 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:17.850 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416751+0000", 2024-09-12T22:32:17.850 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0091950109999999995 2024-09-12T22:32:17.850 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.850 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.850 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:17.850 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416785+0000", 2024-09-12T22:32:17.850 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.3917000000000001e-05 2024-09-12T22:32:17.850 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:17.850 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:17.851 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:17.851 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.851 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.851 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:19 3.14 e19/17 3:2f55791f:::606.00000000:head v 19'2, mlcod=0'0)", 2024-09-12T22:32:17.851 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.406983+0000", 2024-09-12T22:32:17.851 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 40.365256862999999, 2024-09-12T22:32:17.851 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0080362149999999993, 2024-09-12T22:32:17.851 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:17.851 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:17.851 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:17.851 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:17.851 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.851 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:17.852 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406983+0000", 2024-09-12T22:32:17.852 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:17.852 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.852 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.852 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:17.852 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406983+0000", 2024-09-12T22:32:17.852 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:17.852 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.852 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.852 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:17.852 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406983+0000", 2024-09-12T22:32:17.852 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.8200000000000001e-07 2024-09-12T22:32:17.852 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.853 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.853 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:17.853 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406999+0000", 2024-09-12T22:32:17.853 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.5747999999999999e-05 2024-09-12T22:32:17.853 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.853 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.853 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:17.853 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407006+0000", 2024-09-12T22:32:17.853 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 7.2609999999999996e-06 2024-09-12T22:32:17.853 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.853 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.853 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:17.853 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407035+0000", 2024-09-12T22:32:17.853 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.8214000000000001e-05 2024-09-12T22:32:17.854 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.854 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.854 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:17.854 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407092+0000", 2024-09-12T22:32:17.854 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.7027000000000001e-05 2024-09-12T22:32:17.854 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.854 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.854 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:17.854 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407126+0000", 2024-09-12T22:32:17.854 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.4082000000000003e-05 2024-09-12T22:32:17.854 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.854 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.854 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:17.854 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.414985+0000", 2024-09-12T22:32:17.854 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0078597319999999995 2024-09-12T22:32:17.855 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.855 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.855 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:17.855 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415019+0000", 2024-09-12T22:32:17.855 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.3769000000000001e-05 2024-09-12T22:32:17.855 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:17.855 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:17.855 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:17.855 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.855 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.855 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:7 3.10 e19/17 3:0d82a743:::600.00000000:head v 19'2, mlcod=0'0)", 2024-09-12T22:32:17.855 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.407048+0000", 2024-09-12T22:32:17.855 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 40.365191324999998, 2024-09-12T22:32:17.855 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.008979931, 2024-09-12T22:32:17.856 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:17.856 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:17.856 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:17.856 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:17.856 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.856 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:17.856 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407048+0000", 2024-09-12T22:32:17.856 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:17.856 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.856 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.856 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:17.856 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407048+0000", 2024-09-12T22:32:17.856 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:17.857 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.857 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.857 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:17.857 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407049+0000", 2024-09-12T22:32:17.857 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.9099999999999999e-07 2024-09-12T22:32:17.857 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.857 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.857 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:17.857 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407054+0000", 2024-09-12T22:32:17.857 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.1850000000000003e-06 2024-09-12T22:32:17.857 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.857 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.857 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:17.857 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407061+0000", 2024-09-12T22:32:17.858 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 7.0809999999999996e-06 2024-09-12T22:32:17.858 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.858 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.858 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:17.858 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407067+0000", 2024-09-12T22:32:17.858 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.9540000000000001e-06 2024-09-12T22:32:17.858 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.858 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.858 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:17.858 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407299+0000", 2024-09-12T22:32:17.858 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.000232122 2024-09-12T22:32:17.858 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.858 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.858 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:17.859 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407317+0000", 2024-09-12T22:32:17.859 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.7447000000000001e-05 2024-09-12T22:32:17.859 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.859 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.859 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:17.859 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415996+0000", 2024-09-12T22:32:17.859 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0086791799999999999 2024-09-12T22:32:17.859 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.859 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.859 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:17.859 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416028+0000", 2024-09-12T22:32:17.859 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.2570999999999997e-05 2024-09-12T22:32:17.859 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:17.859 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:17.860 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:17.860 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.860 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.860 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:8 3.10 e19/17 3:09401a81:::601.00000000:head v 19'3, mlcod=0'0)", 2024-09-12T22:32:17.860 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.407081+0000", 2024-09-12T22:32:17.860 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 40.365158635, 2024-09-12T22:32:17.860 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0089807270000000008, 2024-09-12T22:32:17.860 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:17.860 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:17.860 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:17.860 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:17.860 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.860 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:17.860 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407081+0000", 2024-09-12T22:32:17.860 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:17.861 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.861 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.861 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:17.861 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407081+0000", 2024-09-12T22:32:17.861 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:17.861 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.861 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.861 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:17.861 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407082+0000", 2024-09-12T22:32:17.861 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.7899999999999999e-07 2024-09-12T22:32:17.861 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.861 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.861 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:17.861 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407086+0000", 2024-09-12T22:32:17.862 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.7679999999999999e-06 2024-09-12T22:32:17.862 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.862 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.862 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:17.862 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407094+0000", 2024-09-12T22:32:17.862 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 8.1470000000000001e-06 2024-09-12T22:32:17.862 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.862 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.862 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:17.862 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407100+0000", 2024-09-12T22:32:17.862 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.4539999999999998e-06 2024-09-12T22:32:17.862 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.862 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.862 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:17.863 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407540+0000", 2024-09-12T22:32:17.863 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00043973699999999999 2024-09-12T22:32:17.863 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.863 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.863 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:17.863 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407553+0000", 2024-09-12T22:32:17.863 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.3368e-05 2024-09-12T22:32:17.863 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.863 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.863 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:17.863 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416032+0000", 2024-09-12T22:32:17.863 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0084793790000000004 2024-09-12T22:32:17.863 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.863 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.864 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:17.864 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416062+0000", 2024-09-12T22:32:17.864 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.9495000000000001e-05 2024-09-12T22:32:17.864 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:17.864 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:17.864 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:17.864 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.864 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.864 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:31 3.d e19/17 3:b50e409b:::mds_snaptable:head v 19'1, mlcod=0'0)", 2024-09-12T22:32:17.864 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.408508+0000", 2024-09-12T22:32:17.864 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 40.363732118999998, 2024-09-12T22:32:17.864 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0080056620000000002, 2024-09-12T22:32:17.864 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:17.864 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:17.865 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:17.865 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:17.865 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.865 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:17.865 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408508+0000", 2024-09-12T22:32:17.865 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:17.865 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.865 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.865 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:17.866 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408508+0000", 2024-09-12T22:32:17.866 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:17.866 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.866 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.866 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:17.866 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408508+0000", 2024-09-12T22:32:17.866 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.7e-07 2024-09-12T22:32:17.866 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.866 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.866 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:17.866 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408515+0000", 2024-09-12T22:32:17.866 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.4439999999999996e-06 2024-09-12T22:32:17.867 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.867 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.867 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:17.867 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408521+0000", 2024-09-12T22:32:17.867 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.2729999999999999e-06 2024-09-12T22:32:17.867 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.867 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.867 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:17.867 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408526+0000", 2024-09-12T22:32:17.867 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.3299999999999998e-06 2024-09-12T22:32:17.867 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.867 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.868 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:17.868 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.410190+0000", 2024-09-12T22:32:17.868 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.001663615 2024-09-12T22:32:17.868 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.868 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.868 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:17.868 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.410258+0000", 2024-09-12T22:32:17.868 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.8146999999999997e-05 2024-09-12T22:32:17.868 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.868 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.868 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:17.868 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416477+0000", 2024-09-12T22:32:17.868 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0062187329999999997 2024-09-12T22:32:17.868 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.869 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.869 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:17.869 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416513+0000", 2024-09-12T22:32:17.869 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.6650000000000003e-05 2024-09-12T22:32:17.869 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:17.869 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:17.869 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:17.869 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.869 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.869 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:9 3.10 e19/17 3:09401a81:::601.00000000:head v 19'4, mlcod=0'0)", 2024-09-12T22:32:17.869 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.408991+0000", 2024-09-12T22:32:17.869 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 40.363248368999997, 2024-09-12T22:32:17.870 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0080459209999999993, 2024-09-12T22:32:17.870 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:17.870 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:17.870 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:17.870 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:17.870 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.870 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:17.870 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408991+0000", 2024-09-12T22:32:17.870 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:17.870 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.870 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.870 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:17.870 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408991+0000", 2024-09-12T22:32:17.870 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:17.871 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.871 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.871 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:17.871 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408992+0000", 2024-09-12T22:32:17.871 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.1799999999999995e-07 2024-09-12T22:32:17.871 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.871 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.871 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:17.871 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409005+0000", 2024-09-12T22:32:17.871 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.261e-05 2024-09-12T22:32:17.871 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.871 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.871 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:17.871 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409015+0000", 2024-09-12T22:32:17.872 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.0001e-05 2024-09-12T22:32:17.872 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.872 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.872 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:17.872 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409023+0000", 2024-09-12T22:32:17.872 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 8.7569999999999993e-06 2024-09-12T22:32:17.872 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.872 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.872 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:17.872 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.411355+0000", 2024-09-12T22:32:17.872 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0023313520000000001 2024-09-12T22:32:17.872 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.872 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.872 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:17.873 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.411374+0000", 2024-09-12T22:32:17.873 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.8810000000000001e-05 2024-09-12T22:32:17.873 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.873 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.873 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:17.873 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416994+0000", 2024-09-12T22:32:17.873 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.005620524 2024-09-12T22:32:17.873 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.873 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.873 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:17.873 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417037+0000", 2024-09-12T22:32:17.873 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.3248999999999999e-05 2024-09-12T22:32:17.873 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:17.873 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:17.873 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:17.874 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.874 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.874 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:10 3.10 e19/17 3:0bd6d154:::602.00000000:head v 19'5, mlcod=0'0)", 2024-09-12T22:32:17.874 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.409038+0000", 2024-09-12T22:32:17.874 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 40.363201693999997, 2024-09-12T22:32:17.874 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0080541689999999999, 2024-09-12T22:32:17.874 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:17.874 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:17.874 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:17.874 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:17.874 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.874 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:17.874 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409038+0000", 2024-09-12T22:32:17.874 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:17.875 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.875 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.875 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:17.875 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409038+0000", 2024-09-12T22:32:17.875 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:17.875 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.875 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.875 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:17.875 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409038+0000", 2024-09-12T22:32:17.875 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.7899999999999999e-07 2024-09-12T22:32:17.875 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.875 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.875 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:17.875 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409043+0000", 2024-09-12T22:32:17.876 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.6589999999999998e-06 2024-09-12T22:32:17.876 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.876 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.876 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:17.876 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409050+0000", 2024-09-12T22:32:17.876 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 7.0829999999999998e-06 2024-09-12T22:32:17.876 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.876 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.876 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:17.876 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409058+0000", 2024-09-12T22:32:17.876 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 7.7309999999999993e-06 2024-09-12T22:32:17.876 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.876 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.876 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:17.877 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.411654+0000", 2024-09-12T22:32:17.877 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0025961650000000001 2024-09-12T22:32:17.877 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.877 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.877 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:17.877 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.411671+0000", 2024-09-12T22:32:17.877 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.7356000000000001e-05 2024-09-12T22:32:17.877 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.877 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.877 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:17.877 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417040+0000", 2024-09-12T22:32:17.877 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0053681889999999998 2024-09-12T22:32:17.877 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.877 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.878 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:17.878 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417092+0000", 2024-09-12T22:32:17.878 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.2607e-05 2024-09-12T22:32:17.878 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:17.878 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:17.878 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:17.878 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.878 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.878 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:11 3.10 e19/17 3:0bd6d154:::602.00000000:head v 19'6, mlcod=0'0)", 2024-09-12T22:32:17.878 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.409768+0000", 2024-09-12T22:32:17.878 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 40.362472253, 2024-09-12T22:32:17.878 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0074442759999999997, 2024-09-12T22:32:17.879 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:17.879 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:17.879 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:17.879 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:17.879 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.879 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:17.879 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409768+0000", 2024-09-12T22:32:17.879 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:17.879 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.879 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.879 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:17.879 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409768+0000", 2024-09-12T22:32:17.879 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:17.879 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.879 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.880 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:17.880 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409768+0000", 2024-09-12T22:32:17.880 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.37e-07 2024-09-12T22:32:17.880 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.880 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.880 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:17.880 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409775+0000", 2024-09-12T22:32:17.880 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.4670000000000001e-06 2024-09-12T22:32:17.880 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.880 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.880 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:17.881 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409793+0000", 2024-09-12T22:32:17.881 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.8162e-05 2024-09-12T22:32:17.881 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.881 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.881 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:17.881 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409954+0000", 2024-09-12T22:32:17.881 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00016072999999999999 2024-09-12T22:32:17.881 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.881 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.881 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:17.881 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.411943+0000", 2024-09-12T22:32:17.881 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0019897069999999998 2024-09-12T22:32:17.881 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.881 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.882 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:17.882 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.412069+0000", 2024-09-12T22:32:17.882 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00012546200000000001 2024-09-12T22:32:17.882 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.882 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.882 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:17.882 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417114+0000", 2024-09-12T22:32:17.882 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.005045023 2024-09-12T22:32:17.882 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:17.882 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:17.882 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:17.882 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417212+0000", 2024-09-12T22:32:17.882 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 9.8088e-05 2024-09-12T22:32:17.882 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:17.882 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:17.883 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:17.883 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:17.883 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:17.883 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-09-12T22:32:17.884 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0: {} 2024-09-12T22:32:17.884 INFO:teuthology.orchestra.run.smithi019.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T22:32:17.885 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T22:32:17.885 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:32:17.885 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:32:17.886 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:32:17.883+0000 7fddec6a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30331) UID: 0 2024-09-12T22:32:17.886 INFO:teuthology.orchestra.run.smithi019.stdout:osd.2: {} 2024-09-12T22:32:17.887 INFO:teuthology.orchestra.run.smithi019.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T22:32:17.985 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:17.983+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:18.001 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:18.001 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:18.011 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:32:18.086 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:18.085+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:18.116 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:18.116 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:18.124 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:32:18.187 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:32:18.186+0000 7fddec6a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30331) UID: 0 2024-09-12T22:32:18.266 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:18.267 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:18.275 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:32:18.288 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:32:18.288+0000 7fddec6a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30331) UID: 0 2024-09-12T22:32:18.389 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:32:18.388+0000 7fddec6a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30331) UID: 0 2024-09-12T22:32:18.391 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:18.391 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:18.401 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:32:18.490 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:18.489+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:18.504 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:18.505 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:18.513 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:32:18.591 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:32:18.590+0000 7fddec6a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30331) UID: 0 2024-09-12T22:32:18.615 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:18.616 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:18.624 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:32:18.692 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:32:18.691+0000 7fddec6a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30331) UID: 0 2024-09-12T22:32:18.743 INFO:teuthology.orchestra.run.smithi076.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:18.743 INFO:teuthology.orchestra.run.smithi076.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:18.754 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:32:18.795 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:32:18.794+0000 7fddec6a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30331) UID: 0 2024-09-12T22:32:18.894 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:32:18.893+0000 7fddec6a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30331) UID: 0 2024-09-12T22:32:18.903 INFO:teuthology.orchestra.run.smithi076.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:18.903 INFO:teuthology.orchestra.run.smithi076.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:18.912 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:32:18.996 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:32:18.995+0000 7fddec6a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30331) UID: 0 2024-09-12T22:32:19.055 INFO:teuthology.orchestra.run.smithi076.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:19.056 INFO:teuthology.orchestra.run.smithi076.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:19.065 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:32:19.106 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:32:19.104+0000 7fddec6a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30331) UID: 0 2024-09-12T22:32:19.172 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:19.172 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:19.181 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:32:19.196 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:32:19.195+0000 7fddec6a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30331) UID: 0 2024-09-12T22:32:19.283 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:19.283 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:19.292 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:32:19.297 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:32:19.295+0000 7fddec6a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30331) UID: 0 2024-09-12T22:32:19.355 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T22:32:19.396 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:19.396 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:19.398 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:19.397+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:19.405 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:32:19.499 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:32:19.498+0000 7fddec6a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30331) UID: 0 2024-09-12T22:32:19.514 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:19.514 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:19.522 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:32:19.600 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:19.599+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:19.626 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:19.626 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:19.634 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:32:19.701 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:19.700+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:19.779 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:19.779 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:19.787 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:32:19.802 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:19.801+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:19.888 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T22:32:19.901 INFO:teuthology.orchestra.run.smithi076.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:19.901 INFO:teuthology.orchestra.run.smithi076.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:19.903 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:19.902+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:19.910 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:32:20.004 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:20.003+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:20.013 INFO:teuthology.orchestra.run.smithi076.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:20.013 INFO:teuthology.orchestra.run.smithi076.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:20.022 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:32:20.026 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0: {} 2024-09-12T22:32:20.027 INFO:teuthology.orchestra.run.smithi019.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T22:32:20.045 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T22:32:20.045 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:32:20.062 INFO:teuthology.orchestra.run.smithi019.stdout:osd.2: {} 2024-09-12T22:32:20.063 INFO:teuthology.orchestra.run.smithi019.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T22:32:20.105 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:32:20.103+0000 7fddec6a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30331) UID: 0 2024-09-12T22:32:20.127 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-09-12T22:32:20.127 INFO:teuthology.orchestra.run.smithi076.stdout: "size": 20, 2024-09-12T22:32:20.127 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 600, 2024-09-12T22:32:20.127 INFO:teuthology.orchestra.run.smithi076.stdout: "ops": [ 2024-09-12T22:32:20.127 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.127 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:20.127 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.400604+0000", 2024-09-12T22:32:20.127 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 42.724619709000002, 2024-09-12T22:32:20.127 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.017278814, 2024-09-12T22:32:20.128 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:20.128 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:20.128 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:20.128 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:20.128 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.128 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:20.128 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400604+0000", 2024-09-12T22:32:20.128 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:20.128 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.128 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.128 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:20.128 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400604+0000", 2024-09-12T22:32:20.128 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:20.129 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.129 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.129 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:20.129 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400617+0000", 2024-09-12T22:32:20.129 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.3076e-05 2024-09-12T22:32:20.129 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.129 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.129 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:20.129 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400623+0000", 2024-09-12T22:32:20.129 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.5780000000000004e-06 2024-09-12T22:32:20.129 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.129 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.129 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:20.130 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400641+0000", 2024-09-12T22:32:20.130 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.8218000000000001e-05 2024-09-12T22:32:20.130 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.130 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.130 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:20.130 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400652+0000", 2024-09-12T22:32:20.130 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.0421999999999999e-05 2024-09-12T22:32:20.130 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.130 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.130 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:20.130 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400707+0000", 2024-09-12T22:32:20.130 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.4666000000000001e-05 2024-09-12T22:32:20.130 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.130 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.131 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op must wait for map", 2024-09-12T22:32:20.131 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400711+0000", 2024-09-12T22:32:20.131 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.5340000000000001e-06 2024-09-12T22:32:20.131 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.131 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.131 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:20.131 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.412066+0000", 2024-09-12T22:32:20.131 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.011354797999999999 2024-09-12T22:32:20.131 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.131 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.131 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:20.131 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.412672+0000", 2024-09-12T22:32:20.131 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00060620499999999996 2024-09-12T22:32:20.132 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.132 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.132 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:20.132 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.413032+0000", 2024-09-12T22:32:20.132 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00035955999999999998 2024-09-12T22:32:20.132 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.132 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.132 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op_commit", 2024-09-12T22:32:20.132 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417252+0000", 2024-09-12T22:32:20.132 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.004219899 2024-09-12T22:32:20.132 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.132 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.132 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:20.133 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417812+0000", 2024-09-12T22:32:20.133 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.000560182 2024-09-12T22:32:20.133 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.133 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.133 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:20.133 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417851+0000", 2024-09-12T22:32:20.133 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.9057999999999998e-05 2024-09-12T22:32:20.133 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.133 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.133 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:20.133 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417882+0000", 2024-09-12T22:32:20.133 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.1618000000000001e-05 2024-09-12T22:32:20.133 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:20.134 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:20.134 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:20.134 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.134 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.134 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:20.134 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.400674+0000", 2024-09-12T22:32:20.134 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 42.724548990999999, 2024-09-12T22:32:20.134 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.017348971000000001, 2024-09-12T22:32:20.134 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:20.134 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:20.134 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:20.134 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:20.134 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.135 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:20.135 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400674+0000", 2024-09-12T22:32:20.135 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:20.135 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.135 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.135 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:20.135 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400674+0000", 2024-09-12T22:32:20.135 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:20.135 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.135 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.135 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:20.135 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400675+0000", 2024-09-12T22:32:20.135 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.37e-07 2024-09-12T22:32:20.135 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.136 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.136 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:20.136 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400678+0000", 2024-09-12T22:32:20.136 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.303e-06 2024-09-12T22:32:20.136 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.136 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.136 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:20.136 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400684+0000", 2024-09-12T22:32:20.136 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.0290000000000002e-06 2024-09-12T22:32:20.136 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.136 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.136 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:20.136 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400688+0000", 2024-09-12T22:32:20.137 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.0890000000000002e-06 2024-09-12T22:32:20.137 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.137 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.137 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:20.137 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400806+0000", 2024-09-12T22:32:20.137 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00011814700000000001 2024-09-12T22:32:20.137 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.137 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.137 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:32:20.137 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400811+0000", 2024-09-12T22:32:20.137 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.0479999999999998e-06 2024-09-12T22:32:20.137 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.137 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.137 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:20.138 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.413877+0000", 2024-09-12T22:32:20.138 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.013065561 2024-09-12T22:32:20.138 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.138 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.138 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:20.138 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.413984+0000", 2024-09-12T22:32:20.138 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.000106566 2024-09-12T22:32:20.138 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.138 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.138 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:20.138 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.414264+0000", 2024-09-12T22:32:20.138 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00028067199999999999 2024-09-12T22:32:20.138 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.139 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.139 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op_commit", 2024-09-12T22:32:20.139 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417614+0000", 2024-09-12T22:32:20.139 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0033500729999999999 2024-09-12T22:32:20.139 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.139 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.139 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:20.139 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417946+0000", 2024-09-12T22:32:20.139 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00033209199999999998 2024-09-12T22:32:20.139 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.139 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.139 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:20.139 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417995+0000", 2024-09-12T22:32:20.140 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.808e-05 2024-09-12T22:32:20.140 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.140 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.140 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:20.140 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.418023+0000", 2024-09-12T22:32:20.140 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.8773999999999999e-05 2024-09-12T22:32:20.140 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:20.140 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:20.140 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:20.140 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.140 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.140 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:20.140 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.400694+0000", 2024-09-12T22:32:20.141 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 42.724529361999998, 2024-09-12T22:32:20.141 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.022845628, 2024-09-12T22:32:20.141 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:20.141 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:20.141 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:20.141 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:20.141 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.141 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:20.141 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400694+0000", 2024-09-12T22:32:20.141 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:20.141 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.141 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.141 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:20.142 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400694+0000", 2024-09-12T22:32:20.142 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:20.142 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.142 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.142 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:20.142 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400694+0000", 2024-09-12T22:32:20.142 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.48e-07 2024-09-12T22:32:20.142 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.142 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.142 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:20.142 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400709+0000", 2024-09-12T22:32:20.142 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.4888999999999999e-05 2024-09-12T22:32:20.143 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.143 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.143 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:20.143 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400722+0000", 2024-09-12T22:32:20.143 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.2882e-05 2024-09-12T22:32:20.143 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.143 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.143 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:20.143 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400732+0000", 2024-09-12T22:32:20.143 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.0299000000000001e-05 2024-09-12T22:32:20.143 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.143 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.143 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:20.143 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400793+0000", 2024-09-12T22:32:20.144 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.0253000000000001e-05 2024-09-12T22:32:20.144 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.144 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.144 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op must wait for map", 2024-09-12T22:32:20.144 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400798+0000", 2024-09-12T22:32:20.144 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.1569999999999999e-06 2024-09-12T22:32:20.144 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.144 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.144 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:20.144 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415059+0000", 2024-09-12T22:32:20.144 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.014260907 2024-09-12T22:32:20.144 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.144 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.144 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:20.145 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415396+0000", 2024-09-12T22:32:20.145 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00033720799999999997 2024-09-12T22:32:20.145 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.145 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.145 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:20.145 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415685+0000", 2024-09-12T22:32:20.145 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00028939900000000003 2024-09-12T22:32:20.145 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.145 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.145 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op_commit", 2024-09-12T22:32:20.145 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.418302+0000", 2024-09-12T22:32:20.145 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0026168039999999999 2024-09-12T22:32:20.145 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.145 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.146 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:20.146 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.423445+0000", 2024-09-12T22:32:20.146 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0051428150000000002 2024-09-12T22:32:20.146 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.146 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.146 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:20.146 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.423499+0000", 2024-09-12T22:32:20.146 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.3953000000000003e-05 2024-09-12T22:32:20.146 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.146 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.146 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:20.146 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.423540+0000", 2024-09-12T22:32:20.146 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.0813999999999999e-05 2024-09-12T22:32:20.147 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:20.147 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:20.147 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:20.147 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.147 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.147 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:20.147 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.400740+0000", 2024-09-12T22:32:20.147 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 42.724483638999999, 2024-09-12T22:32:20.147 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.022927528999999999, 2024-09-12T22:32:20.147 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:20.147 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:20.147 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:20.147 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:20.148 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.148 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:20.148 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400740+0000", 2024-09-12T22:32:20.148 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:20.148 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.148 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.148 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:20.148 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400740+0000", 2024-09-12T22:32:20.148 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:20.148 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.148 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.148 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:20.148 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400740+0000", 2024-09-12T22:32:20.149 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.3000000000000001e-07 2024-09-12T22:32:20.149 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.149 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.149 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:20.149 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400743+0000", 2024-09-12T22:32:20.149 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.5840000000000002e-06 2024-09-12T22:32:20.149 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.149 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.149 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:20.149 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400757+0000", 2024-09-12T22:32:20.149 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.3988999999999999e-05 2024-09-12T22:32:20.149 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.149 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.150 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:20.150 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400763+0000", 2024-09-12T22:32:20.150 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.686e-06 2024-09-12T22:32:20.150 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.150 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.150 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:20.150 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400818+0000", 2024-09-12T22:32:20.150 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.4941000000000001e-05 2024-09-12T22:32:20.150 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.150 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.150 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:32:20.150 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400824+0000", 2024-09-12T22:32:20.150 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.4600000000000002e-06 2024-09-12T22:32:20.151 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.151 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.151 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:20.151 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416227+0000", 2024-09-12T22:32:20.151 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.015403604 2024-09-12T22:32:20.151 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.151 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.151 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:20.151 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416306+0000", 2024-09-12T22:32:20.151 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 7.9126000000000001e-05 2024-09-12T22:32:20.151 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.151 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.151 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:20.152 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416678+0000", 2024-09-12T22:32:20.152 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00037105500000000002 2024-09-12T22:32:20.152 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.152 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.152 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op_commit", 2024-09-12T22:32:20.152 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.418363+0000", 2024-09-12T22:32:20.152 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.001685095 2024-09-12T22:32:20.152 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.152 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.152 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:20.152 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.423591+0000", 2024-09-12T22:32:20.152 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0052283980000000004 2024-09-12T22:32:20.152 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.153 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.153 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:20.153 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.423624+0000", 2024-09-12T22:32:20.153 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.3024000000000001e-05 2024-09-12T22:32:20.153 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.153 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.153 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:20.153 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.423667+0000", 2024-09-12T22:32:20.153 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.3136999999999997e-05 2024-09-12T22:32:20.153 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:20.153 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:20.153 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:20.154 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.154 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.154 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:20.154 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.400783+0000", 2024-09-12T22:32:20.154 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 42.724440107, 2024-09-12T22:32:20.154 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.016563729999999999, 2024-09-12T22:32:20.154 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:20.154 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:20.154 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:20.154 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:20.154 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.154 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:20.154 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400783+0000", 2024-09-12T22:32:20.155 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:20.155 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.155 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.155 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:20.155 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400783+0000", 2024-09-12T22:32:20.155 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:20.155 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.155 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.155 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:20.155 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400784+0000", 2024-09-12T22:32:20.155 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.5900000000000002e-07 2024-09-12T22:32:20.155 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.155 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.155 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:20.156 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400787+0000", 2024-09-12T22:32:20.156 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.1690000000000001e-06 2024-09-12T22:32:20.156 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.156 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.156 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:20.156 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400794+0000", 2024-09-12T22:32:20.156 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 7.058e-06 2024-09-12T22:32:20.156 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.156 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.156 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:20.156 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400798+0000", 2024-09-12T22:32:20.156 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.335e-06 2024-09-12T22:32:20.156 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.157 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.157 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:20.157 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400841+0000", 2024-09-12T22:32:20.157 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.2369e-05 2024-09-12T22:32:20.157 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.157 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.157 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op must wait for map", 2024-09-12T22:32:20.157 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400844+0000", 2024-09-12T22:32:20.157 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.128e-06 2024-09-12T22:32:20.157 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.157 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.157 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:20.157 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.410479+0000", 2024-09-12T22:32:20.158 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0096354189999999992 2024-09-12T22:32:20.158 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.158 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.158 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:20.158 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.410597+0000", 2024-09-12T22:32:20.158 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.000118305 2024-09-12T22:32:20.158 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.158 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.158 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:20.158 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.410838+0000", 2024-09-12T22:32:20.158 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.000240967 2024-09-12T22:32:20.158 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.158 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.159 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op_commit", 2024-09-12T22:32:20.159 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416489+0000", 2024-09-12T22:32:20.159 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0056507989999999998 2024-09-12T22:32:20.159 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.159 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.159 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:20.159 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417255+0000", 2024-09-12T22:32:20.159 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00076626199999999998 2024-09-12T22:32:20.159 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.159 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.159 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:20.159 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417306+0000", 2024-09-12T22:32:20.159 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.0319999999999999e-05 2024-09-12T22:32:20.159 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.159 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.160 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:20.160 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417347+0000", 2024-09-12T22:32:20.160 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.1140000000000003e-05 2024-09-12T22:32:20.160 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:20.160 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:20.160 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:20.160 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.160 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.160 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:20.160 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.400811+0000", 2024-09-12T22:32:20.160 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 42.724412037999997, 2024-09-12T22:32:20.160 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.017061263, 2024-09-12T22:32:20.160 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:20.161 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:20.161 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:20.161 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:20.161 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.161 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:20.161 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400811+0000", 2024-09-12T22:32:20.161 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:20.161 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.161 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.161 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:20.161 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400811+0000", 2024-09-12T22:32:20.161 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:20.161 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.162 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.162 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:20.162 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400812+0000", 2024-09-12T22:32:20.162 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.27e-07 2024-09-12T22:32:20.162 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.162 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.162 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:20.162 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400814+0000", 2024-09-12T22:32:20.162 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.553e-06 2024-09-12T22:32:20.162 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.162 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.162 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:20.162 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400819+0000", 2024-09-12T22:32:20.162 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.3569999999999997e-06 2024-09-12T22:32:20.162 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.163 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.163 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:20.163 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400824+0000", 2024-09-12T22:32:20.163 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.6820000000000002e-06 2024-09-12T22:32:20.163 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.163 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.163 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:20.163 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400871+0000", 2024-09-12T22:32:20.163 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.7311000000000002e-05 2024-09-12T22:32:20.163 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.163 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.163 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:32:20.163 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400875+0000", 2024-09-12T22:32:20.164 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.0960000000000001e-06 2024-09-12T22:32:20.164 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.164 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.164 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:20.164 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.412071+0000", 2024-09-12T22:32:20.164 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.011195999999999999 2024-09-12T22:32:20.164 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.164 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.164 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:20.164 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.412520+0000", 2024-09-12T22:32:20.164 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.000449522 2024-09-12T22:32:20.164 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.164 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.165 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:20.165 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.412655+0000", 2024-09-12T22:32:20.165 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00013487899999999999 2024-09-12T22:32:20.165 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.165 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.165 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op_commit", 2024-09-12T22:32:20.165 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417096+0000", 2024-09-12T22:32:20.165 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.004441113 2024-09-12T22:32:20.165 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.165 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.165 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:20.165 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417768+0000", 2024-09-12T22:32:20.165 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00067161100000000002 2024-09-12T22:32:20.166 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.166 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.166 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:20.166 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417834+0000", 2024-09-12T22:32:20.166 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.6058999999999999e-05 2024-09-12T22:32:20.166 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.166 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.166 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:20.166 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417873+0000", 2024-09-12T22:32:20.166 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.8753e-05 2024-09-12T22:32:20.166 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:20.166 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:20.166 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:20.167 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.167 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.167 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:20.167 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.400842+0000", 2024-09-12T22:32:20.167 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 42.724381331000004, 2024-09-12T22:32:20.167 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.022846262999999999, 2024-09-12T22:32:20.167 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:20.167 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:20.167 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:20.167 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:20.167 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.167 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:20.167 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400842+0000", 2024-09-12T22:32:20.168 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:20.168 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.168 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.168 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:20.168 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400842+0000", 2024-09-12T22:32:20.168 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:20.168 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.168 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.168 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:20.168 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400842+0000", 2024-09-12T22:32:20.168 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.9900000000000002e-07 2024-09-12T22:32:20.168 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.168 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.169 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:20.169 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400845+0000", 2024-09-12T22:32:20.169 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.8609999999999998e-06 2024-09-12T22:32:20.169 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.169 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.169 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:20.169 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400850+0000", 2024-09-12T22:32:20.169 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.634e-06 2024-09-12T22:32:20.169 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.169 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.169 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:20.169 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400855+0000", 2024-09-12T22:32:20.169 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.8339999999999998e-06 2024-09-12T22:32:20.169 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.170 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.170 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:20.170 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400886+0000", 2024-09-12T22:32:20.170 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.1393999999999998e-05 2024-09-12T22:32:20.170 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.170 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.170 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:32:20.170 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400888+0000", 2024-09-12T22:32:20.170 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.3470000000000001e-06 2024-09-12T22:32:20.170 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.170 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.170 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:20.170 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415640+0000", 2024-09-12T22:32:20.171 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.014751965000000001 2024-09-12T22:32:20.171 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.171 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.171 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:20.171 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415821+0000", 2024-09-12T22:32:20.171 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00018064399999999999 2024-09-12T22:32:20.171 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.171 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.171 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:20.171 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415949+0000", 2024-09-12T22:32:20.171 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00012816699999999999 2024-09-12T22:32:20.171 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.171 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.171 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op_commit", 2024-09-12T22:32:20.172 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.418337+0000", 2024-09-12T22:32:20.172 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0023878469999999998 2024-09-12T22:32:20.172 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.172 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.172 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:20.172 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.423588+0000", 2024-09-12T22:32:20.172 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0052509849999999997 2024-09-12T22:32:20.172 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.172 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.172 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:20.172 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.423650+0000", 2024-09-12T22:32:20.172 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.2026999999999994e-05 2024-09-12T22:32:20.172 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.173 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.173 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:20.173 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.423688+0000", 2024-09-12T22:32:20.173 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.8259000000000001e-05 2024-09-12T22:32:20.173 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:20.173 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:20.173 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:20.173 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.173 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.173 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:20.173 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.400862+0000", 2024-09-12T22:32:20.173 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 42.724361356999999, 2024-09-12T22:32:20.173 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.016404294, 2024-09-12T22:32:20.173 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:20.174 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:20.174 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "started", 2024-09-12T22:32:20.174 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:20.174 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.174 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:20.174 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400862+0000", 2024-09-12T22:32:20.174 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:20.174 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.174 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.174 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:20.174 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400862+0000", 2024-09-12T22:32:20.174 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:20.174 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.175 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.175 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:20.175 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400862+0000", 2024-09-12T22:32:20.175 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.8099999999999999e-07 2024-09-12T22:32:20.175 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.175 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.175 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:20.175 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400870+0000", 2024-09-12T22:32:20.175 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 8.1349999999999992e-06 2024-09-12T22:32:20.175 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.175 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.175 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:20.175 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400876+0000", 2024-09-12T22:32:20.176 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.2039999999999996e-06 2024-09-12T22:32:20.176 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.176 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.176 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:20.176 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400879+0000", 2024-09-12T22:32:20.176 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.529e-06 2024-09-12T22:32:20.176 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.176 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.176 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:20.176 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400912+0000", 2024-09-12T22:32:20.176 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.2653000000000001e-05 2024-09-12T22:32:20.176 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.176 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.177 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op must wait for map", 2024-09-12T22:32:20.177 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400915+0000", 2024-09-12T22:32:20.177 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.1099999999999999e-06 2024-09-12T22:32:20.177 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.177 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.177 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:20.177 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408727+0000", 2024-09-12T22:32:20.177 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0078123869999999996 2024-09-12T22:32:20.177 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.177 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.177 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:20.177 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408838+0000", 2024-09-12T22:32:20.177 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00011042700000000001 2024-09-12T22:32:20.178 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.178 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.178 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:20.178 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417266+0000", 2024-09-12T22:32:20.178 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0084285680000000009 2024-09-12T22:32:20.178 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:20.178 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:20.178 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:20.178 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.178 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.178 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:20.178 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.400889+0000", 2024-09-12T22:32:20.179 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 42.724334104, 2024-09-12T22:32:20.179 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.014929550999999999, 2024-09-12T22:32:20.179 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:20.179 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:20.179 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "started", 2024-09-12T22:32:20.179 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:20.179 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.179 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:20.179 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400889+0000", 2024-09-12T22:32:20.179 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:20.179 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.179 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.179 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:20.179 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400889+0000", 2024-09-12T22:32:20.180 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:20.180 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.180 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.180 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:20.180 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400890+0000", 2024-09-12T22:32:20.180 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.8699999999999995e-07 2024-09-12T22:32:20.180 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.180 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.180 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:20.180 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400893+0000", 2024-09-12T22:32:20.180 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.9569999999999998e-06 2024-09-12T22:32:20.180 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.180 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.181 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:20.181 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400899+0000", 2024-09-12T22:32:20.181 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.4189999999999999e-06 2024-09-12T22:32:20.181 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.181 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.181 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:20.181 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400905+0000", 2024-09-12T22:32:20.181 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.7880000000000003e-06 2024-09-12T22:32:20.181 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.181 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.181 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:20.181 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400943+0000", 2024-09-12T22:32:20.181 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.7852999999999998e-05 2024-09-12T22:32:20.182 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.182 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.182 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op must wait for map", 2024-09-12T22:32:20.182 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400945+0000", 2024-09-12T22:32:20.182 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.627e-06 2024-09-12T22:32:20.182 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.182 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.182 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:20.182 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408398+0000", 2024-09-12T22:32:20.182 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0074525879999999996 2024-09-12T22:32:20.182 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.182 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.182 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:20.183 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408581+0000", 2024-09-12T22:32:20.183 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00018321900000000001 2024-09-12T22:32:20.183 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.183 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.183 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:20.183 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415819+0000", 2024-09-12T22:32:20.183 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0072376130000000004 2024-09-12T22:32:20.183 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:20.183 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:20.183 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:20.183 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.183 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.183 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:25 3.7 e19/17 3:e0b41d06:::609.00000000:head v 19'2, mlcod=0'0)", 2024-09-12T22:32:20.183 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.402511+0000", 2024-09-12T22:32:20.184 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 42.722711961000002, 2024-09-12T22:32:20.184 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0089735260000000008, 2024-09-12T22:32:20.184 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:20.184 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:20.184 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:20.184 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:20.184 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.184 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:20.184 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.402511+0000", 2024-09-12T22:32:20.184 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:20.184 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.184 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.185 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:20.185 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.402511+0000", 2024-09-12T22:32:20.185 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:20.185 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.185 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.185 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:20.185 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.402512+0000", 2024-09-12T22:32:20.185 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 8.71e-07 2024-09-12T22:32:20.185 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.185 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.185 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:20.185 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.402520+0000", 2024-09-12T22:32:20.185 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 7.8529999999999992e-06 2024-09-12T22:32:20.185 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.186 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.186 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:20.186 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.402530+0000", 2024-09-12T22:32:20.186 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 9.859e-06 2024-09-12T22:32:20.186 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.186 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.186 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:20.186 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.402555+0000", 2024-09-12T22:32:20.186 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.4822000000000001e-05 2024-09-12T22:32:20.186 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.186 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.186 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:20.186 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.403173+0000", 2024-09-12T22:32:20.187 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00061813199999999997 2024-09-12T22:32:20.187 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.187 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.187 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:20.187 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.403195+0000", 2024-09-12T22:32:20.187 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.2286e-05 2024-09-12T22:32:20.187 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.187 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.187 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:20.187 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.411436+0000", 2024-09-12T22:32:20.187 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0082410539999999994 2024-09-12T22:32:20.187 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.187 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.187 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:20.188 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.411485+0000", 2024-09-12T22:32:20.188 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.8649000000000001e-05 2024-09-12T22:32:20.188 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:20.188 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:20.188 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:20.188 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.188 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.188 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:18 3.14 e19/17 3:2f55791f:::606.00000000:head v 19'1, mlcod=0'0)", 2024-09-12T22:32:20.188 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.406646+0000", 2024-09-12T22:32:20.188 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 42.718576808999998, 2024-09-12T22:32:20.188 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0082036980000000006, 2024-09-12T22:32:20.188 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:20.188 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:20.189 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:20.189 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:20.189 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.189 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:20.189 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406646+0000", 2024-09-12T22:32:20.189 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:20.189 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.189 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.189 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:20.189 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406646+0000", 2024-09-12T22:32:20.189 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:20.189 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.190 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.190 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:20.190 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406647+0000", 2024-09-12T22:32:20.190 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.4499999999999998e-07 2024-09-12T22:32:20.190 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.190 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.190 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:20.190 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406651+0000", 2024-09-12T22:32:20.190 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.0300000000000004e-06 2024-09-12T22:32:20.190 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.190 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.190 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:20.190 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406657+0000", 2024-09-12T22:32:20.190 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.1330000000000004e-06 2024-09-12T22:32:20.191 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.191 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.191 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:20.191 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406665+0000", 2024-09-12T22:32:20.191 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 8.3650000000000004e-06 2024-09-12T22:32:20.191 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.191 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.191 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:20.191 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406804+0000", 2024-09-12T22:32:20.191 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00013900699999999999 2024-09-12T22:32:20.191 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.191 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.191 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:20.192 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406833+0000", 2024-09-12T22:32:20.192 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.8243e-05 2024-09-12T22:32:20.192 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.192 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.192 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:20.192 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.414741+0000", 2024-09-12T22:32:20.192 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0079089620000000003 2024-09-12T22:32:20.192 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.192 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.192 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:20.192 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.414850+0000", 2024-09-12T22:32:20.192 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.000108713 2024-09-12T22:32:20.192 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:20.194 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:20.194 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:20.194 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.194 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.194 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:6 3.10 e19/17 3:0d82a743:::600.00000000:head v 19'1, mlcod=0'0)", 2024-09-12T22:32:20.194 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.406692+0000", 2024-09-12T22:32:20.194 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 42.718531042000002, 2024-09-12T22:32:20.194 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0093004430000000003, 2024-09-12T22:32:20.194 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:20.195 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:20.195 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:20.195 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:20.195 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.195 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:20.195 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406692+0000", 2024-09-12T22:32:20.195 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:20.195 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.195 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.195 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:20.195 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406692+0000", 2024-09-12T22:32:20.195 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:20.196 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.196 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.196 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:20.196 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406693+0000", 2024-09-12T22:32:20.196 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.6300000000000001e-07 2024-09-12T22:32:20.196 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.196 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.196 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:20.196 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406702+0000", 2024-09-12T22:32:20.196 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 9.5589999999999994e-06 2024-09-12T22:32:20.196 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.196 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.196 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:20.197 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406725+0000", 2024-09-12T22:32:20.197 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.2977999999999999e-05 2024-09-12T22:32:20.197 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.197 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.197 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:20.197 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406732+0000", 2024-09-12T22:32:20.197 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.8430000000000004e-06 2024-09-12T22:32:20.197 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.197 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.197 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:20.197 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406979+0000", 2024-09-12T22:32:20.197 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00024729199999999998 2024-09-12T22:32:20.197 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.197 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.198 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:20.198 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407000+0000", 2024-09-12T22:32:20.198 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.0573000000000001e-05 2024-09-12T22:32:20.198 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.198 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.198 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:20.198 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415928+0000", 2024-09-12T22:32:20.198 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0089286179999999993 2024-09-12T22:32:20.198 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.198 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.198 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:20.198 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415993+0000", 2024-09-12T22:32:20.198 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.4216999999999999e-05 2024-09-12T22:32:20.198 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:20.199 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:20.199 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:20.199 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.199 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.199 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:2 3.f e19/17 3:f1f69726:::400.00000000:head v 19'1, mlcod=0'0)", 2024-09-12T22:32:20.199 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.406942+0000", 2024-09-12T22:32:20.199 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 42.718281355000002, 2024-09-12T22:32:20.199 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0098433259999999995, 2024-09-12T22:32:20.199 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:20.199 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:20.199 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:20.199 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:20.199 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.199 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:20.200 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406942+0000", 2024-09-12T22:32:20.200 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:20.200 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.200 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.200 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:20.200 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406942+0000", 2024-09-12T22:32:20.200 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:20.200 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.200 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.200 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:20.200 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406943+0000", 2024-09-12T22:32:20.200 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.8800000000000002e-07 2024-09-12T22:32:20.200 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.201 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.201 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:20.201 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406949+0000", 2024-09-12T22:32:20.201 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.5869999999999998e-06 2024-09-12T22:32:20.201 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.201 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.201 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:20.201 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406960+0000", 2024-09-12T22:32:20.201 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.0873000000000001e-05 2024-09-12T22:32:20.201 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.201 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.201 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:20.201 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406970+0000", 2024-09-12T22:32:20.202 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 9.9119999999999993e-06 2024-09-12T22:32:20.202 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.202 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.202 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:20.202 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407535+0000", 2024-09-12T22:32:20.202 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00056508899999999996 2024-09-12T22:32:20.202 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.202 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.202 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:20.202 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407556+0000", 2024-09-12T22:32:20.202 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.1348999999999998e-05 2024-09-12T22:32:20.202 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.202 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.202 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:20.203 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416751+0000", 2024-09-12T22:32:20.203 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0091950109999999995 2024-09-12T22:32:20.203 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.203 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.203 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:20.203 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416785+0000", 2024-09-12T22:32:20.203 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.3917000000000001e-05 2024-09-12T22:32:20.203 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:20.203 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:20.203 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:20.203 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.203 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.203 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:19 3.14 e19/17 3:2f55791f:::606.00000000:head v 19'2, mlcod=0'0)", 2024-09-12T22:32:20.203 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.406983+0000", 2024-09-12T22:32:20.204 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 42.718240375999997, 2024-09-12T22:32:20.204 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0080362149999999993, 2024-09-12T22:32:20.204 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:20.204 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:20.204 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:20.204 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:20.204 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.204 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:20.204 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406983+0000", 2024-09-12T22:32:20.204 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:20.204 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.204 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.205 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:20.205 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406983+0000", 2024-09-12T22:32:20.205 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:20.205 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.205 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.205 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:20.205 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406983+0000", 2024-09-12T22:32:20.205 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.8200000000000001e-07 2024-09-12T22:32:20.205 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.205 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.205 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:20.205 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406999+0000", 2024-09-12T22:32:20.205 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.5747999999999999e-05 2024-09-12T22:32:20.206 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.206 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.206 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:20.206 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407006+0000", 2024-09-12T22:32:20.206 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 7.2609999999999996e-06 2024-09-12T22:32:20.206 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.206 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.206 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:20.206 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407035+0000", 2024-09-12T22:32:20.206 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.8214000000000001e-05 2024-09-12T22:32:20.206 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.206 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.206 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:20.207 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407092+0000", 2024-09-12T22:32:20.207 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.7027000000000001e-05 2024-09-12T22:32:20.207 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.207 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.207 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:20.207 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407126+0000", 2024-09-12T22:32:20.207 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.4082000000000003e-05 2024-09-12T22:32:20.207 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.207 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.207 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:20.207 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.414985+0000", 2024-09-12T22:32:20.207 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0078597319999999995 2024-09-12T22:32:20.207 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.208 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.208 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:20.208 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415019+0000", 2024-09-12T22:32:20.208 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.3769000000000001e-05 2024-09-12T22:32:20.208 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:20.208 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:20.208 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:20.208 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.208 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.208 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:7 3.10 e19/17 3:0d82a743:::600.00000000:head v 19'2, mlcod=0'0)", 2024-09-12T22:32:20.208 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.407048+0000", 2024-09-12T22:32:20.208 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 42.718174838000003, 2024-09-12T22:32:20.208 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.008979931, 2024-09-12T22:32:20.208 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:20.209 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:20.209 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:20.209 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:20.209 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.209 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:20.209 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407048+0000", 2024-09-12T22:32:20.209 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:20.209 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.209 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.209 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:20.209 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407048+0000", 2024-09-12T22:32:20.209 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:20.209 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.209 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.210 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:20.210 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407049+0000", 2024-09-12T22:32:20.210 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.9099999999999999e-07 2024-09-12T22:32:20.210 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.210 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.210 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:20.210 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407054+0000", 2024-09-12T22:32:20.210 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.1850000000000003e-06 2024-09-12T22:32:20.210 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.210 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.210 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:20.210 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407061+0000", 2024-09-12T22:32:20.210 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 7.0809999999999996e-06 2024-09-12T22:32:20.211 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.211 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.211 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:20.211 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407067+0000", 2024-09-12T22:32:20.211 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.9540000000000001e-06 2024-09-12T22:32:20.211 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.211 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.211 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:20.211 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407299+0000", 2024-09-12T22:32:20.211 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.000232122 2024-09-12T22:32:20.211 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.211 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.211 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:20.212 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407317+0000", 2024-09-12T22:32:20.212 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.7447000000000001e-05 2024-09-12T22:32:20.212 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.212 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.212 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:20.212 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415996+0000", 2024-09-12T22:32:20.212 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0086791799999999999 2024-09-12T22:32:20.212 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.212 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.212 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:20.212 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416028+0000", 2024-09-12T22:32:20.212 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.2570999999999997e-05 2024-09-12T22:32:20.212 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:20.212 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:20.213 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:20.213 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.213 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.213 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:8 3.10 e19/17 3:09401a81:::601.00000000:head v 19'3, mlcod=0'0)", 2024-09-12T22:32:20.213 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.407081+0000", 2024-09-12T22:32:20.213 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 42.718142147999998, 2024-09-12T22:32:20.213 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0089807270000000008, 2024-09-12T22:32:20.213 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:20.213 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:20.213 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:20.213 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:20.213 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.213 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:20.214 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407081+0000", 2024-09-12T22:32:20.214 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:20.214 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.214 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.214 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:20.214 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407081+0000", 2024-09-12T22:32:20.214 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:20.214 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.214 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.214 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:20.214 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407082+0000", 2024-09-12T22:32:20.214 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.7899999999999999e-07 2024-09-12T22:32:20.214 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.214 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.215 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:20.215 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407086+0000", 2024-09-12T22:32:20.215 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.7679999999999999e-06 2024-09-12T22:32:20.215 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.215 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.215 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:20.215 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407094+0000", 2024-09-12T22:32:20.215 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 8.1470000000000001e-06 2024-09-12T22:32:20.215 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.215 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.215 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:20.215 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407100+0000", 2024-09-12T22:32:20.215 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.4539999999999998e-06 2024-09-12T22:32:20.216 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.216 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.216 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:20.216 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407540+0000", 2024-09-12T22:32:20.216 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00043973699999999999 2024-09-12T22:32:20.216 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.216 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.216 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:20.216 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407553+0000", 2024-09-12T22:32:20.216 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.3368e-05 2024-09-12T22:32:20.216 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.216 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.216 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:20.217 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416032+0000", 2024-09-12T22:32:20.217 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0084793790000000004 2024-09-12T22:32:20.217 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.217 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.217 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:20.217 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416062+0000", 2024-09-12T22:32:20.217 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.9495000000000001e-05 2024-09-12T22:32:20.217 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:20.217 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:20.217 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:20.217 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.217 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.217 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:31 3.d e19/17 3:b50e409b:::mds_snaptable:head v 19'1, mlcod=0'0)", 2024-09-12T22:32:20.218 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.408508+0000", 2024-09-12T22:32:20.218 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 42.716715632000003, 2024-09-12T22:32:20.218 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0080056620000000002, 2024-09-12T22:32:20.218 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:20.218 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:20.218 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:20.218 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:20.218 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.218 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:20.218 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408508+0000", 2024-09-12T22:32:20.218 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:20.218 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.218 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.218 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:20.219 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408508+0000", 2024-09-12T22:32:20.219 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:20.219 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.219 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.219 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:20.219 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408508+0000", 2024-09-12T22:32:20.219 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.7e-07 2024-09-12T22:32:20.219 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.219 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.219 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:20.219 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408515+0000", 2024-09-12T22:32:20.219 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.4439999999999996e-06 2024-09-12T22:32:20.219 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.219 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.220 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:20.220 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408521+0000", 2024-09-12T22:32:20.220 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.2729999999999999e-06 2024-09-12T22:32:20.220 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.220 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.220 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:20.220 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408526+0000", 2024-09-12T22:32:20.220 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.3299999999999998e-06 2024-09-12T22:32:20.220 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.220 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.220 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:20.220 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.410190+0000", 2024-09-12T22:32:20.220 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.001663615 2024-09-12T22:32:20.221 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.221 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.221 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:20.221 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.410258+0000", 2024-09-12T22:32:20.221 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.8146999999999997e-05 2024-09-12T22:32:20.221 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.221 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.221 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:20.221 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416477+0000", 2024-09-12T22:32:20.221 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0062187329999999997 2024-09-12T22:32:20.221 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.221 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.221 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:20.222 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416513+0000", 2024-09-12T22:32:20.222 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.6650000000000003e-05 2024-09-12T22:32:20.222 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:20.222 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:20.222 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:20.222 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.222 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.222 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:9 3.10 e19/17 3:09401a81:::601.00000000:head v 19'4, mlcod=0'0)", 2024-09-12T22:32:20.222 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.408991+0000", 2024-09-12T22:32:20.222 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 42.716231882000002, 2024-09-12T22:32:20.222 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0080459209999999993, 2024-09-12T22:32:20.222 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:20.223 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:20.223 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:20.223 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:20.223 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.223 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:20.223 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408991+0000", 2024-09-12T22:32:20.223 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:20.223 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.223 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.223 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:20.223 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408991+0000", 2024-09-12T22:32:20.223 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:20.223 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.224 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.224 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:20.224 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408992+0000", 2024-09-12T22:32:20.224 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.1799999999999995e-07 2024-09-12T22:32:20.224 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.224 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.224 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:20.224 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409005+0000", 2024-09-12T22:32:20.224 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.261e-05 2024-09-12T22:32:20.224 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.224 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.224 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:20.224 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409015+0000", 2024-09-12T22:32:20.225 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.0001e-05 2024-09-12T22:32:20.225 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.225 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.225 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:20.225 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409023+0000", 2024-09-12T22:32:20.225 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 8.7569999999999993e-06 2024-09-12T22:32:20.225 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.225 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.225 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:20.225 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.411355+0000", 2024-09-12T22:32:20.225 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0023313520000000001 2024-09-12T22:32:20.225 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.225 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.225 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:20.226 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.411374+0000", 2024-09-12T22:32:20.226 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.8810000000000001e-05 2024-09-12T22:32:20.226 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.226 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.226 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:20.226 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416994+0000", 2024-09-12T22:32:20.226 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.005620524 2024-09-12T22:32:20.226 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.226 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.226 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:20.226 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417037+0000", 2024-09-12T22:32:20.226 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.3248999999999999e-05 2024-09-12T22:32:20.226 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:20.226 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:20.227 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:20.227 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.227 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.227 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:10 3.10 e19/17 3:0bd6d154:::602.00000000:head v 19'5, mlcod=0'0)", 2024-09-12T22:32:20.227 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.409038+0000", 2024-09-12T22:32:20.227 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 42.716185207000002, 2024-09-12T22:32:20.227 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0080541689999999999, 2024-09-12T22:32:20.227 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:20.227 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:20.227 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:20.227 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:20.227 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.227 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:20.228 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409038+0000", 2024-09-12T22:32:20.228 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:20.228 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.228 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.228 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:20.228 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409038+0000", 2024-09-12T22:32:20.228 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:20.228 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.228 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.228 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:20.228 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409038+0000", 2024-09-12T22:32:20.228 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.7899999999999999e-07 2024-09-12T22:32:20.228 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.228 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.229 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:20.229 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409043+0000", 2024-09-12T22:32:20.229 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.6589999999999998e-06 2024-09-12T22:32:20.229 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.229 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.229 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:20.229 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409050+0000", 2024-09-12T22:32:20.229 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 7.0829999999999998e-06 2024-09-12T22:32:20.229 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.229 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.229 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:20.229 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409058+0000", 2024-09-12T22:32:20.229 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 7.7309999999999993e-06 2024-09-12T22:32:20.229 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.230 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.230 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:20.230 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.411654+0000", 2024-09-12T22:32:20.230 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0025961650000000001 2024-09-12T22:32:20.230 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.230 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.230 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:20.230 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.411671+0000", 2024-09-12T22:32:20.230 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.7356000000000001e-05 2024-09-12T22:32:20.230 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.230 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.230 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:20.230 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417040+0000", 2024-09-12T22:32:20.230 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0053681889999999998 2024-09-12T22:32:20.231 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.231 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.231 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:20.231 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417092+0000", 2024-09-12T22:32:20.231 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.2607e-05 2024-09-12T22:32:20.231 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:20.231 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:20.231 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:20.231 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.231 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.231 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:11 3.10 e19/17 3:0bd6d154:::602.00000000:head v 19'6, mlcod=0'0)", 2024-09-12T22:32:20.231 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.409768+0000", 2024-09-12T22:32:20.231 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 42.715455765999998, 2024-09-12T22:32:20.231 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0074442759999999997, 2024-09-12T22:32:20.232 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:20.232 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:20.232 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:20.232 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:20.232 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.232 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:20.232 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409768+0000", 2024-09-12T22:32:20.232 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:20.232 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.232 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.232 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:20.232 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409768+0000", 2024-09-12T22:32:20.232 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:20.233 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.233 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.233 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:20.233 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409768+0000", 2024-09-12T22:32:20.233 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.37e-07 2024-09-12T22:32:20.233 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.233 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.233 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:20.233 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409775+0000", 2024-09-12T22:32:20.233 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.4670000000000001e-06 2024-09-12T22:32:20.233 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.233 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.233 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:20.233 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409793+0000", 2024-09-12T22:32:20.234 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.8162e-05 2024-09-12T22:32:20.234 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.234 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.234 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:20.234 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409954+0000", 2024-09-12T22:32:20.234 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00016072999999999999 2024-09-12T22:32:20.234 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.234 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.234 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:20.234 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.411943+0000", 2024-09-12T22:32:20.234 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0019897069999999998 2024-09-12T22:32:20.234 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.234 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.234 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:20.235 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.412069+0000", 2024-09-12T22:32:20.235 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00012546200000000001 2024-09-12T22:32:20.235 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.236 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.236 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:20.236 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417114+0000", 2024-09-12T22:32:20.236 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.005045023 2024-09-12T22:32:20.236 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:20.236 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:20.236 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:20.236 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417212+0000", 2024-09-12T22:32:20.236 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 9.8088e-05 2024-09-12T22:32:20.237 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:20.237 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:20.237 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:20.237 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:20.237 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:20.237 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-09-12T22:32:20.239 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:20.238+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:20.239 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:32:20.296 INFO:teuthology.orchestra.run.smithi019.stderr:noscrub is set 2024-09-12T22:32:20.339 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:20.338+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:20.356 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:32:20.356 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:32:20.357 INFO:teuthology.orchestra.run.smithi148.stdout: "num_ops": 0 2024-09-12T22:32:20.357 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:32:20.366 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:32:20.450 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:20.449+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:20.509 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:32:20.510 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:32:20.510 INFO:teuthology.orchestra.run.smithi148.stdout: "complaint_time": 30, 2024-09-12T22:32:20.510 INFO:teuthology.orchestra.run.smithi148.stdout: "num_blocked_ops": 0 2024-09-12T22:32:20.510 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:32:20.518 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:32:20.541 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:20.540+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:20.642 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:20.641+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:20.663 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:32:20.663 INFO:teuthology.orchestra.run.smithi148.stdout: "size": 20, 2024-09-12T22:32:20.663 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 600, 2024-09-12T22:32:20.663 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [ 2024-09-12T22:32:20.663 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.663 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:20.663 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.400880+0000", 2024-09-12T22:32:20.663 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 43.260036163999999, 2024-09-12T22:32:20.664 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0095133660000000005, 2024-09-12T22:32:20.664 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:20.664 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:20.664 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:20.664 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:20.664 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.664 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:20.664 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400880+0000", 2024-09-12T22:32:20.664 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:20.664 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.664 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.665 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:20.665 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400880+0000", 2024-09-12T22:32:20.665 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:20.665 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.665 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.665 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:20.665 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400892+0000", 2024-09-12T22:32:20.665 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1941e-05 2024-09-12T22:32:20.665 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.666 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.666 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:20.666 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400900+0000", 2024-09-12T22:32:20.666 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0080000000000002e-06 2024-09-12T22:32:20.666 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.666 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.666 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:20.666 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400911+0000", 2024-09-12T22:32:20.666 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1452e-05 2024-09-12T22:32:20.666 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.666 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.666 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:20.667 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400922+0000", 2024-09-12T22:32:20.667 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0772e-05 2024-09-12T22:32:20.667 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.667 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.667 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:20.667 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401009+0000", 2024-09-12T22:32:20.667 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.7206000000000005e-05 2024-09-12T22:32:20.667 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.667 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.667 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:20.667 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401157+0000", 2024-09-12T22:32:20.667 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014831499999999999 2024-09-12T22:32:20.667 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.668 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.668 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:20.668 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401312+0000", 2024-09-12T22:32:20.668 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00015495600000000001 2024-09-12T22:32:20.668 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.668 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.668 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:20.668 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.403060+0000", 2024-09-12T22:32:20.668 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0017475220000000001 2024-09-12T22:32:20.668 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.668 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.668 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:20.668 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410300+0000", 2024-09-12T22:32:20.669 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0072403260000000001 2024-09-12T22:32:20.669 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.669 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.669 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:20.669 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410350+0000", 2024-09-12T22:32:20.669 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9814000000000001e-05 2024-09-12T22:32:20.669 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.669 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.669 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:20.669 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410393+0000", 2024-09-12T22:32:20.669 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3053999999999998e-05 2024-09-12T22:32:20.669 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:20.669 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:20.670 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:20.670 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.670 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.670 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:20.670 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.400952+0000", 2024-09-12T22:32:20.670 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 43.259964011999998, 2024-09-12T22:32:20.670 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0096045620000000005, 2024-09-12T22:32:20.670 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:20.670 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:20.670 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:20.670 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:20.670 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.670 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:20.671 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400952+0000", 2024-09-12T22:32:20.671 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:20.671 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.671 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.671 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:20.671 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400952+0000", 2024-09-12T22:32:20.671 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:20.671 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.671 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.671 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:20.671 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400953+0000", 2024-09-12T22:32:20.671 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.8000000000000005e-07 2024-09-12T22:32:20.672 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.672 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.672 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:20.672 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400957+0000", 2024-09-12T22:32:20.672 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.33e-06 2024-09-12T22:32:20.672 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.672 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.672 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:20.672 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400966+0000", 2024-09-12T22:32:20.672 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1989999999999995e-06 2024-09-12T22:32:20.672 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.672 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.672 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:20.673 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400973+0000", 2024-09-12T22:32:20.673 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2779999999999999e-06 2024-09-12T22:32:20.673 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.673 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.673 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:20.673 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401696+0000", 2024-09-12T22:32:20.673 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00072363500000000003 2024-09-12T22:32:20.673 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.673 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.673 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:20.673 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401788+0000", 2024-09-12T22:32:20.673 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1862999999999998e-05 2024-09-12T22:32:20.673 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.674 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.674 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:20.674 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401929+0000", 2024-09-12T22:32:20.674 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014096000000000001 2024-09-12T22:32:20.674 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.674 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.674 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:20.674 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.403542+0000", 2024-09-12T22:32:20.674 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001612963 2024-09-12T22:32:20.674 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.674 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.674 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:20.674 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410460+0000", 2024-09-12T22:32:20.675 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0069180500000000002 2024-09-12T22:32:20.675 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.675 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.675 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:20.675 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410515+0000", 2024-09-12T22:32:20.675 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5009000000000001e-05 2024-09-12T22:32:20.675 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.675 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.675 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:20.675 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410557+0000", 2024-09-12T22:32:20.675 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1495000000000002e-05 2024-09-12T22:32:20.675 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:20.675 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:20.676 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:20.676 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.676 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.676 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:20.676 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.400984+0000", 2024-09-12T22:32:20.676 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 43.259931516999998, 2024-09-12T22:32:20.676 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0073703950000000001, 2024-09-12T22:32:20.676 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:20.676 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:20.676 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:20.676 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:20.677 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.677 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:20.677 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400984+0000", 2024-09-12T22:32:20.677 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:20.677 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.677 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.677 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:20.677 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400984+0000", 2024-09-12T22:32:20.677 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:20.677 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.677 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.677 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:20.678 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400985+0000", 2024-09-12T22:32:20.678 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3200000000000005e-07 2024-09-12T22:32:20.678 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.678 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.678 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:20.678 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400998+0000", 2024-09-12T22:32:20.678 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2726e-05 2024-09-12T22:32:20.678 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.678 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.678 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:20.678 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401006+0000", 2024-09-12T22:32:20.679 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.3110000000000006e-06 2024-09-12T22:32:20.679 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.679 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.679 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:20.679 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401022+0000", 2024-09-12T22:32:20.679 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6249e-05 2024-09-12T22:32:20.679 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.679 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.679 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:20.679 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401700+0000", 2024-09-12T22:32:20.680 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00067811100000000001 2024-09-12T22:32:20.680 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.680 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.680 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:20.680 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401839+0000", 2024-09-12T22:32:20.680 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013865399999999999 2024-09-12T22:32:20.681 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.681 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.681 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:20.681 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401962+0000", 2024-09-12T22:32:20.681 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000123266 2024-09-12T22:32:20.681 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.681 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.681 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:20.681 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.403589+0000", 2024-09-12T22:32:20.681 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001626932 2024-09-12T22:32:20.681 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.682 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.682 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:20.682 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.408274+0000", 2024-09-12T22:32:20.682 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0046848100000000002 2024-09-12T22:32:20.682 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.682 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.682 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:20.682 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.408324+0000", 2024-09-12T22:32:20.682 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9784000000000003e-05 2024-09-12T22:32:20.682 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.682 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.683 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:20.683 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.408355+0000", 2024-09-12T22:32:20.683 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.1019999999999998e-05 2024-09-12T22:32:20.683 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:20.683 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:20.683 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:20.683 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.683 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.683 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:20.683 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401034+0000", 2024-09-12T22:32:20.683 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 43.259882077, 2024-09-12T22:32:20.684 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011063051000000001, 2024-09-12T22:32:20.684 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:20.684 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:20.684 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:20.684 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:20.684 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.684 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:20.684 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401034+0000", 2024-09-12T22:32:20.684 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:20.684 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.685 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.685 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:20.685 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401034+0000", 2024-09-12T22:32:20.685 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:20.685 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.685 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.685 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:20.685 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401034+0000", 2024-09-12T22:32:20.685 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8899999999999999e-07 2024-09-12T22:32:20.685 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.685 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.685 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:20.686 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401038+0000", 2024-09-12T22:32:20.686 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.523e-06 2024-09-12T22:32:20.686 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.686 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.686 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:20.686 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401046+0000", 2024-09-12T22:32:20.686 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0479999999999999e-06 2024-09-12T22:32:20.686 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.686 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.686 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:20.687 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401051+0000", 2024-09-12T22:32:20.687 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2619999999999998e-06 2024-09-12T22:32:20.687 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.687 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.687 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:20.687 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402270+0000", 2024-09-12T22:32:20.687 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012182429999999999 2024-09-12T22:32:20.687 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.687 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.687 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:20.687 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402325+0000", 2024-09-12T22:32:20.688 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5526999999999999e-05 2024-09-12T22:32:20.688 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.688 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.688 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:20.688 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402403+0000", 2024-09-12T22:32:20.688 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.7559999999999996e-05 2024-09-12T22:32:20.688 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.688 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.688 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:20.688 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.403655+0000", 2024-09-12T22:32:20.688 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012521489999999999 2024-09-12T22:32:20.689 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.689 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.689 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:20.689 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411979+0000", 2024-09-12T22:32:20.689 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0083240420000000002 2024-09-12T22:32:20.689 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.689 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.689 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:20.689 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.412036+0000", 2024-09-12T22:32:20.689 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7639000000000002e-05 2024-09-12T22:32:20.689 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.690 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.690 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:20.690 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.412097+0000", 2024-09-12T22:32:20.690 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0469e-05 2024-09-12T22:32:20.690 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:20.690 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:20.690 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:20.690 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.690 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.690 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:20.690 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401060+0000", 2024-09-12T22:32:20.690 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 43.259856325000001, 2024-09-12T22:32:20.690 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.010030172, 2024-09-12T22:32:20.690 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:20.691 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:20.691 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:20.691 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:20.691 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.691 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:20.691 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401060+0000", 2024-09-12T22:32:20.691 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:20.691 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.691 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.691 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:20.691 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401060+0000", 2024-09-12T22:32:20.692 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:20.692 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.692 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.692 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:20.692 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401060+0000", 2024-09-12T22:32:20.692 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2500000000000001e-07 2024-09-12T22:32:20.692 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.692 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.692 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:20.692 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401063+0000", 2024-09-12T22:32:20.693 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0910000000000001e-06 2024-09-12T22:32:20.693 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.693 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.693 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:20.693 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401070+0000", 2024-09-12T22:32:20.693 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1210000000000001e-06 2024-09-12T22:32:20.693 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.693 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.693 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:20.693 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401076+0000", 2024-09-12T22:32:20.693 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2830000000000001e-06 2024-09-12T22:32:20.694 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.694 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.694 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:20.694 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402288+0000", 2024-09-12T22:32:20.694 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012123699999999999 2024-09-12T22:32:20.694 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.694 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.694 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:20.694 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402359+0000", 2024-09-12T22:32:20.695 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.0988000000000005e-05 2024-09-12T22:32:20.695 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.695 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.695 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:20.695 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402457+0000", 2024-09-12T22:32:20.695 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.7857999999999997e-05 2024-09-12T22:32:20.695 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.695 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.695 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:20.695 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.404395+0000", 2024-09-12T22:32:20.695 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0019380160000000001 2024-09-12T22:32:20.695 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.695 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.696 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:20.696 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410603+0000", 2024-09-12T22:32:20.696 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.006208061 2024-09-12T22:32:20.696 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.696 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.696 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:20.696 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410687+0000", 2024-09-12T22:32:20.696 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.4623000000000006e-05 2024-09-12T22:32:20.696 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.696 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.696 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:20.696 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411090+0000", 2024-09-12T22:32:20.696 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00040233599999999999 2024-09-12T22:32:20.697 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:20.697 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:20.697 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:20.697 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.697 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.697 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:20.697 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401083+0000", 2024-09-12T22:32:20.697 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 43.259832908999996, 2024-09-12T22:32:20.697 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0097591850000000001, 2024-09-12T22:32:20.697 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:20.697 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:20.697 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:20.697 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:20.698 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.698 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:20.698 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401083+0000", 2024-09-12T22:32:20.698 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:20.698 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.698 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.698 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:20.698 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401083+0000", 2024-09-12T22:32:20.698 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:20.698 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.698 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.698 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:20.698 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401084+0000", 2024-09-12T22:32:20.698 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4799999999999999e-07 2024-09-12T22:32:20.699 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.699 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.699 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:20.699 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401088+0000", 2024-09-12T22:32:20.699 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6419999999999998e-06 2024-09-12T22:32:20.699 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.699 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.699 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:20.699 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401094+0000", 2024-09-12T22:32:20.699 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0090000000000004e-06 2024-09-12T22:32:20.699 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.699 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.699 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:20.700 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401108+0000", 2024-09-12T22:32:20.700 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3884e-05 2024-09-12T22:32:20.700 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.700 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.700 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:20.700 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401165+0000", 2024-09-12T22:32:20.700 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.6499000000000002e-05 2024-09-12T22:32:20.700 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.700 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.700 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:20.700 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401261+0000", 2024-09-12T22:32:20.700 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.6872000000000004e-05 2024-09-12T22:32:20.700 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.701 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.701 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:20.701 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401376+0000", 2024-09-12T22:32:20.701 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000114508 2024-09-12T22:32:20.701 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.701 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.701 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:20.701 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402666+0000", 2024-09-12T22:32:20.701 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012901659999999999 2024-09-12T22:32:20.701 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.701 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.701 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:20.701 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410572+0000", 2024-09-12T22:32:20.702 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0079055489999999996 2024-09-12T22:32:20.702 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.702 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.702 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:20.702 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410661+0000", 2024-09-12T22:32:20.702 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.9578000000000002e-05 2024-09-12T22:32:20.702 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.702 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.702 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:20.702 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410842+0000", 2024-09-12T22:32:20.702 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00018102999999999999 2024-09-12T22:32:20.702 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:20.702 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:20.702 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:20.703 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.703 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.703 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:20.703 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401122+0000", 2024-09-12T22:32:20.703 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 43.259793877, 2024-09-12T22:32:20.703 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0099122080000000005, 2024-09-12T22:32:20.703 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:20.703 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:20.703 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:32:20.703 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:20.703 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.703 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:20.704 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401122+0000", 2024-09-12T22:32:20.704 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:20.704 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.704 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.704 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:20.704 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401122+0000", 2024-09-12T22:32:20.704 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:20.704 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.704 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.704 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:20.704 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401123+0000", 2024-09-12T22:32:20.704 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2600000000000002e-07 2024-09-12T22:32:20.704 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.705 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.705 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:20.705 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401126+0000", 2024-09-12T22:32:20.705 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.6449999999999998e-06 2024-09-12T22:32:20.705 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.705 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.705 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:20.705 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401133+0000", 2024-09-12T22:32:20.705 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.9890000000000003e-06 2024-09-12T22:32:20.705 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.705 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.705 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:20.705 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401138+0000", 2024-09-12T22:32:20.706 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8060000000000002e-06 2024-09-12T22:32:20.706 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.706 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.706 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:20.706 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401703+0000", 2024-09-12T22:32:20.706 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00056509099999999999 2024-09-12T22:32:20.706 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.706 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.706 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:20.707 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401837+0000", 2024-09-12T22:32:20.707 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013338799999999999 2024-09-12T22:32:20.707 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.707 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.707 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:20.707 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411034+0000", 2024-09-12T22:32:20.707 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.009197663 2024-09-12T22:32:20.707 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:20.707 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:20.707 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:20.707 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.707 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.708 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:20.708 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401158+0000", 2024-09-12T22:32:20.708 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 43.259758097999999, 2024-09-12T22:32:20.708 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.010292437999999999, 2024-09-12T22:32:20.708 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:20.708 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:20.708 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:32:20.708 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:20.708 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.708 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:20.709 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401158+0000", 2024-09-12T22:32:20.709 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:20.709 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.709 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.709 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:20.709 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401158+0000", 2024-09-12T22:32:20.709 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:20.709 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.709 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.709 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:20.709 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401158+0000", 2024-09-12T22:32:20.709 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9699999999999996e-07 2024-09-12T22:32:20.710 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.710 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.710 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:20.710 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401161+0000", 2024-09-12T22:32:20.710 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.7410000000000001e-06 2024-09-12T22:32:20.710 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.710 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.710 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:20.710 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401168+0000", 2024-09-12T22:32:20.710 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.844e-06 2024-09-12T22:32:20.711 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.711 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.711 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:20.711 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401174+0000", 2024-09-12T22:32:20.711 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4700000000000001e-06 2024-09-12T22:32:20.711 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.711 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.711 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:20.711 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402799+0000", 2024-09-12T22:32:20.711 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0016256409999999999 2024-09-12T22:32:20.711 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.712 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.712 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:20.712 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402893+0000", 2024-09-12T22:32:20.712 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.3807999999999994e-05 2024-09-12T22:32:20.712 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.712 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.712 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:20.712 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411450+0000", 2024-09-12T22:32:20.712 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0085573369999999999 2024-09-12T22:32:20.712 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:20.712 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:20.713 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:20.713 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.713 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.713 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:20.713 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401183+0000", 2024-09-12T22:32:20.713 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 43.259733246000003, 2024-09-12T22:32:20.713 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0068597830000000004, 2024-09-12T22:32:20.713 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:20.713 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:20.713 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:32:20.713 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:20.714 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.714 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:20.714 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401183+0000", 2024-09-12T22:32:20.714 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:20.714 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.714 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.714 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:20.714 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401183+0000", 2024-09-12T22:32:20.714 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:20.714 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.715 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.715 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:20.715 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401183+0000", 2024-09-12T22:32:20.715 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.6700000000000003e-07 2024-09-12T22:32:20.715 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.715 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.715 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:20.715 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401186+0000", 2024-09-12T22:32:20.715 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4679999999999999e-06 2024-09-12T22:32:20.715 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.715 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.716 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:20.716 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401192+0000", 2024-09-12T22:32:20.716 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.1519999999999997e-06 2024-09-12T22:32:20.716 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.716 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.716 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:20.716 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401197+0000", 2024-09-12T22:32:20.716 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4669999999999998e-06 2024-09-12T22:32:20.716 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.716 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.716 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:20.717 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401253+0000", 2024-09-12T22:32:20.717 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.6211000000000001e-05 2024-09-12T22:32:20.717 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.717 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.717 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:20.717 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401413+0000", 2024-09-12T22:32:20.717 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00016021399999999999 2024-09-12T22:32:20.717 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.717 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.717 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:20.718 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.408043+0000", 2024-09-12T22:32:20.718 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0066295039999999996 2024-09-12T22:32:20.718 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:20.718 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:20.718 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:20.718 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.718 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.718 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:20 3.1c e19/17 3:3ed09add:::607.00000000:head v 19'1, mlcod=0'0)", 2024-09-12T22:32:20.718 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.409642+0000", 2024-09-12T22:32:20.718 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 43.251273787000002, 2024-09-12T22:32:20.718 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0038816269999999999, 2024-09-12T22:32:20.719 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:20.719 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:20.719 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:20.719 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:20.719 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.719 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:20.719 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409642+0000", 2024-09-12T22:32:20.719 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:20.719 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.719 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.719 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:20.720 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409642+0000", 2024-09-12T22:32:20.720 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:20.720 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.720 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.720 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:20.720 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409642+0000", 2024-09-12T22:32:20.720 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.6899999999999999e-07 2024-09-12T22:32:20.720 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.720 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.720 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:20.720 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409648+0000", 2024-09-12T22:32:20.721 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.49e-06 2024-09-12T22:32:20.721 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.721 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.721 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:20.721 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409656+0000", 2024-09-12T22:32:20.721 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.2949999999999994e-06 2024-09-12T22:32:20.721 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.721 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.721 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:20.721 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409664+0000", 2024-09-12T22:32:20.721 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.1219999999999995e-06 2024-09-12T22:32:20.722 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.722 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.722 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:20.722 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409707+0000", 2024-09-12T22:32:20.722 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2222000000000003e-05 2024-09-12T22:32:20.722 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.722 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.722 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:20.722 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409724+0000", 2024-09-12T22:32:20.722 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7496999999999999e-05 2024-09-12T22:32:20.722 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.722 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.723 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:20.723 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413439+0000", 2024-09-12T22:32:20.723 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00371448 2024-09-12T22:32:20.723 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.723 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.723 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:20.723 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413524+0000", 2024-09-12T22:32:20.723 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.5252000000000003e-05 2024-09-12T22:32:20.723 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:20.723 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:20.723 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:20.724 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.724 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.724 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:28 3.13 e19/17 3:cd5a64a3:::100.00000000:head v 19'1, mlcod=0'0)", 2024-09-12T22:32:20.724 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.409681+0000", 2024-09-12T22:32:20.724 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 43.251235303999998, 2024-09-12T22:32:20.724 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0038708710000000001, 2024-09-12T22:32:20.724 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:20.724 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:20.724 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:20.724 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:20.724 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.725 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:20.725 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409681+0000", 2024-09-12T22:32:20.725 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:20.725 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.725 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.725 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:20.725 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409681+0000", 2024-09-12T22:32:20.725 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:20.725 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.725 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.725 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:20.725 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409681+0000", 2024-09-12T22:32:20.726 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3000000000000002e-07 2024-09-12T22:32:20.726 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.726 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.726 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:20.726 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409695+0000", 2024-09-12T22:32:20.726 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4313e-05 2024-09-12T22:32:20.726 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.726 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.726 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:20.726 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409703+0000", 2024-09-12T22:32:20.726 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4000000000000003e-06 2024-09-12T22:32:20.726 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.726 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.726 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:20.727 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409708+0000", 2024-09-12T22:32:20.727 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3190000000000002e-06 2024-09-12T22:32:20.727 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.727 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.727 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:20.727 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409875+0000", 2024-09-12T22:32:20.727 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000167329 2024-09-12T22:32:20.727 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.727 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.727 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:20.727 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409892+0000", 2024-09-12T22:32:20.727 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6957999999999999e-05 2024-09-12T22:32:20.727 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.728 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.728 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:20.728 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413457+0000", 2024-09-12T22:32:20.728 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0035651279999999999 2024-09-12T22:32:20.728 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.728 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.728 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:20.728 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413552+0000", 2024-09-12T22:32:20.728 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.4093999999999997e-05 2024-09-12T22:32:20.728 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:20.728 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:20.728 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:20.728 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.729 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.729 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:21 3.1c e19/17 3:3ed09add:::607.00000000:head v 19'2, mlcod=0'0)", 2024-09-12T22:32:20.729 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.409718+0000", 2024-09-12T22:32:20.729 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 43.251197638999997, 2024-09-12T22:32:20.729 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003851883, 2024-09-12T22:32:20.729 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:20.729 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:20.729 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:20.729 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:20.729 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.729 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:20.729 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409718+0000", 2024-09-12T22:32:20.729 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:20.730 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.730 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.730 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:20.730 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409718+0000", 2024-09-12T22:32:20.730 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:20.730 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.730 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.730 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:20.730 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409719+0000", 2024-09-12T22:32:20.730 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.16e-07 2024-09-12T22:32:20.730 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.730 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.730 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:20.731 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409722+0000", 2024-09-12T22:32:20.731 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.692e-06 2024-09-12T22:32:20.731 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.731 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.731 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:20.731 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409729+0000", 2024-09-12T22:32:20.731 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.516e-06 2024-09-12T22:32:20.731 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.731 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.731 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:20.731 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409750+0000", 2024-09-12T22:32:20.731 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1151000000000001e-05 2024-09-12T22:32:20.731 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.731 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.732 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:20.732 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410015+0000", 2024-09-12T22:32:20.732 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00026477599999999999 2024-09-12T22:32:20.732 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.732 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.732 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:20.732 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410104+0000", 2024-09-12T22:32:20.732 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.9586000000000006e-05 2024-09-12T22:32:20.732 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.732 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.732 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:20.732 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413528+0000", 2024-09-12T22:32:20.732 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0034237880000000001 2024-09-12T22:32:20.733 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.733 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.733 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:20.733 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413570+0000", 2024-09-12T22:32:20.733 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2157999999999999e-05 2024-09-12T22:32:20.733 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:20.733 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:20.733 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:20.733 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.733 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.733 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:27 3.13 e19/17 3:c91d4a1d:::mds0_inotable:head v 19'2, mlcod=0'0)", 2024-09-12T22:32:20.733 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.409760+0000", 2024-09-12T22:32:20.733 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 43.251156123000001, 2024-09-12T22:32:20.734 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0039301910000000004, 2024-09-12T22:32:20.734 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:20.734 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:20.734 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:20.734 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:20.734 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.734 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:20.734 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409760+0000", 2024-09-12T22:32:20.734 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:20.734 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.734 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.734 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:20.734 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409760+0000", 2024-09-12T22:32:20.735 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:20.735 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.735 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.735 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:20.735 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409760+0000", 2024-09-12T22:32:20.735 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.39e-07 2024-09-12T22:32:20.735 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.735 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.735 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:20.735 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409765+0000", 2024-09-12T22:32:20.735 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4449999999999998e-06 2024-09-12T22:32:20.736 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.736 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.736 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:20.736 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409771+0000", 2024-09-12T22:32:20.736 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7159999999999997e-06 2024-09-12T22:32:20.736 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.736 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.736 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:20.736 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409778+0000", 2024-09-12T22:32:20.736 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.331e-06 2024-09-12T22:32:20.736 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.736 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.737 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:20.737 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410191+0000", 2024-09-12T22:32:20.737 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00041348300000000003 2024-09-12T22:32:20.737 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.737 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.737 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:20.737 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410211+0000", 2024-09-12T22:32:20.737 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9933999999999999e-05 2024-09-12T22:32:20.737 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.737 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.737 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:20.738 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413638+0000", 2024-09-12T22:32:20.738 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003426854 2024-09-12T22:32:20.738 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.738 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.738 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:20.738 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413690+0000", 2024-09-12T22:32:20.738 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2089000000000002e-05 2024-09-12T22:32:20.738 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:20.738 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:20.738 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:20.738 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.739 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.739 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "pg_update_log_missing_reply(3.b epoch 19/17 rep_tid 4 lcod 19'2)", 2024-09-12T22:32:20.739 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.410060+0000", 2024-09-12T22:32:20.739 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 43.250856458000001, 2024-09-12T22:32:20.739 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00098016500000000007, 2024-09-12T22:32:20.739 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:20.739 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:20.739 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "reached pg", 2024-09-12T22:32:20.739 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:20.739 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.739 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:20.740 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410060+0000", 2024-09-12T22:32:20.740 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:20.740 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.740 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.740 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:20.740 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410060+0000", 2024-09-12T22:32:20.740 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:20.740 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.740 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.740 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:20.741 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410060+0000", 2024-09-12T22:32:20.741 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.8299999999999998e-07 2024-09-12T22:32:20.741 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.741 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.741 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:20.741 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410062+0000", 2024-09-12T22:32:20.741 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5749999999999999e-06 2024-09-12T22:32:20.741 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.741 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.741 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:20.741 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410070+0000", 2024-09-12T22:32:20.741 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.909e-06 2024-09-12T22:32:20.742 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.742 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.742 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:20.742 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410076+0000", 2024-09-12T22:32:20.742 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7049999999999996e-06 2024-09-12T22:32:20.742 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.742 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.742 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:20.742 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410943+0000", 2024-09-12T22:32:20.742 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00086681900000000001 2024-09-12T22:32:20.743 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.743 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.743 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:20.743 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411040+0000", 2024-09-12T22:32:20.743 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.6774000000000006e-05 2024-09-12T22:32:20.743 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:20.743 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:20.743 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:20.743 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.743 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.743 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e19/17 ondisk, result = 0)", 2024-09-12T22:32:20.744 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.410113+0000", 2024-09-12T22:32:20.744 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 43.250803191000003, 2024-09-12T22:32:20.744 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00098911599999999995, 2024-09-12T22:32:20.744 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:20.744 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:20.744 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:32:20.744 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:20.744 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.744 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:20.744 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410113+0000", 2024-09-12T22:32:20.744 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:20.745 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.745 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.745 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:20.745 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410113+0000", 2024-09-12T22:32:20.745 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:20.745 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.745 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.745 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:20.745 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410113+0000", 2024-09-12T22:32:20.745 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.99e-07 2024-09-12T22:32:20.746 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.746 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.746 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:20.746 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410115+0000", 2024-09-12T22:32:20.746 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.046e-06 2024-09-12T22:32:20.746 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.746 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.746 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:20.746 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410121+0000", 2024-09-12T22:32:20.746 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0050000000000001e-06 2024-09-12T22:32:20.746 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.747 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.747 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:20.747 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410126+0000", 2024-09-12T22:32:20.747 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8339999999999998e-06 2024-09-12T22:32:20.747 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.747 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.747 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:20.747 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410587+0000", 2024-09-12T22:32:20.747 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00046095499999999998 2024-09-12T22:32:20.748 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.748 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.748 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:20.748 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410595+0000", 2024-09-12T22:32:20.748 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.9419999999999995e-06 2024-09-12T22:32:20.748 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.748 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.748 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:20.748 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411102+0000", 2024-09-12T22:32:20.748 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00050713500000000003 2024-09-12T22:32:20.749 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:20.749 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:20.749 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:20.749 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.749 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.749 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 19/17 rep_tid 8 lcod 19'4)", 2024-09-12T22:32:20.749 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.410133+0000", 2024-09-12T22:32:20.750 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 43.250783263000002, 2024-09-12T22:32:20.750 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0013504000000000001, 2024-09-12T22:32:20.750 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:20.750 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:20.750 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "reached pg", 2024-09-12T22:32:20.750 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:20.750 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.750 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:20.750 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410133+0000", 2024-09-12T22:32:20.750 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:20.750 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.751 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.751 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:20.751 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410133+0000", 2024-09-12T22:32:20.751 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:20.751 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.751 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.751 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:20.751 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410133+0000", 2024-09-12T22:32:20.751 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.0599999999999999e-07 2024-09-12T22:32:20.751 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.751 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.752 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:20.752 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410135+0000", 2024-09-12T22:32:20.752 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7770000000000001e-06 2024-09-12T22:32:20.752 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.752 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.752 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:20.752 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410140+0000", 2024-09-12T22:32:20.752 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9960000000000001e-06 2024-09-12T22:32:20.752 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.752 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.752 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:20.752 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410144+0000", 2024-09-12T22:32:20.752 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9500000000000003e-06 2024-09-12T22:32:20.753 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.753 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.753 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:20.753 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411310+0000", 2024-09-12T22:32:20.753 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001166311 2024-09-12T22:32:20.753 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.753 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.753 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:20.753 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411483+0000", 2024-09-12T22:32:20.753 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00017316 2024-09-12T22:32:20.753 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:20.753 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:20.753 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:20.754 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.754 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.754 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "pg_update_log_missing(3.1a epoch 19/17 rep_tid 0 entries 19'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T22:32:20.754 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.410617+0000", 2024-09-12T22:32:20.754 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 43.250298868000002, 2024-09-12T22:32:20.754 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0030439709999999999, 2024-09-12T22:32:20.754 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:20.754 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:20.754 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "reached pg", 2024-09-12T22:32:20.754 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:20.754 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.754 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:20.754 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410617+0000", 2024-09-12T22:32:20.755 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:20.755 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.755 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.755 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:20.755 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410617+0000", 2024-09-12T22:32:20.755 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:20.755 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.755 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.755 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:20.755 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410617+0000", 2024-09-12T22:32:20.755 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3599999999999999e-07 2024-09-12T22:32:20.755 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.756 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.756 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:20.756 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410625+0000", 2024-09-12T22:32:20.756 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5410000000000003e-06 2024-09-12T22:32:20.756 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.756 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.756 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:20.756 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410638+0000", 2024-09-12T22:32:20.756 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3261999999999999e-05 2024-09-12T22:32:20.756 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.756 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.756 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:20.756 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410653+0000", 2024-09-12T22:32:20.757 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4844000000000001e-05 2024-09-12T22:32:20.757 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.757 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.757 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:20.757 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410814+0000", 2024-09-12T22:32:20.757 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00016119999999999999 2024-09-12T22:32:20.757 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.757 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.757 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:20.757 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413661+0000", 2024-09-12T22:32:20.757 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0028467879999999998 2024-09-12T22:32:20.757 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:20.757 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:20.758 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:20.758 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.758 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.758 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-09-12T22:32:20.758 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:39.398875+0000", 2024-09-12T22:32:20.758 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 41.262040587999998, 2024-09-12T22:32:20.758 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0015679069999999999, 2024-09-12T22:32:20.758 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:20.758 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:20.758 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:20.758 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:20.758 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.758 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:20.759 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398875+0000", 2024-09-12T22:32:20.759 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:20.759 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.759 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.759 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:20.759 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398875+0000", 2024-09-12T22:32:20.759 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:20.759 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.759 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.759 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:20.759 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398878+0000", 2024-09-12T22:32:20.759 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1679999999999998e-06 2024-09-12T22:32:20.759 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.760 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.760 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:20.760 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398888+0000", 2024-09-12T22:32:20.760 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.084e-05 2024-09-12T22:32:20.760 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.760 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.760 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:20.760 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398906+0000", 2024-09-12T22:32:20.760 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7518000000000001e-05 2024-09-12T22:32:20.760 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.760 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.760 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:20.760 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398914+0000", 2024-09-12T22:32:20.760 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5989999999999996e-06 2024-09-12T22:32:20.761 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.761 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.761 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:20.761 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398974+0000", 2024-09-12T22:32:20.761 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0988e-05 2024-09-12T22:32:20.761 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.761 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.761 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:20.761 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.399078+0000", 2024-09-12T22:32:20.761 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000103133 2024-09-12T22:32:20.761 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.761 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.761 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:20.762 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.399166+0000", 2024-09-12T22:32:20.762 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.8183999999999995e-05 2024-09-12T22:32:20.762 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.762 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.762 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:20.762 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.399747+0000", 2024-09-12T22:32:20.762 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00058110599999999996 2024-09-12T22:32:20.762 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.762 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.762 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:20.762 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.400377+0000", 2024-09-12T22:32:20.762 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000630157 2024-09-12T22:32:20.762 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.763 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.763 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:20.763 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.400415+0000", 2024-09-12T22:32:20.763 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7814000000000001e-05 2024-09-12T22:32:20.763 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.763 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.763 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:20.763 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.400443+0000", 2024-09-12T22:32:20.763 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8399999999999999e-05 2024-09-12T22:32:20.763 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:20.763 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:20.763 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:20.763 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.763 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.764 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e23)", 2024-09-12T22:32:20.764 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:58.400966+0000", 2024-09-12T22:32:20.764 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 22.259949679999998, 2024-09-12T22:32:20.764 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001468876, 2024-09-12T22:32:20.764 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:20.764 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:20.764 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:20.764 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:20.764 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.764 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:20.764 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400966+0000", 2024-09-12T22:32:20.764 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:20.764 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.765 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.765 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:20.765 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400966+0000", 2024-09-12T22:32:20.765 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:20.765 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.765 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.765 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:20.765 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400967+0000", 2024-09-12T22:32:20.765 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.046e-06 2024-09-12T22:32:20.765 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.765 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.765 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:20.765 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400974+0000", 2024-09-12T22:32:20.766 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2310000000000001e-06 2024-09-12T22:32:20.766 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.766 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.766 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:20.766 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400988+0000", 2024-09-12T22:32:20.766 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4482e-05 2024-09-12T22:32:20.766 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.766 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.766 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:20.766 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400997+0000", 2024-09-12T22:32:20.766 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.0189999999999995e-06 2024-09-12T22:32:20.767 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.767 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.767 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:20.767 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.401068+0000", 2024-09-12T22:32:20.767 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1426000000000004e-05 2024-09-12T22:32:20.767 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.767 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.767 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:20.767 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.401174+0000", 2024-09-12T22:32:20.767 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000105769 2024-09-12T22:32:20.767 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.767 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.767 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:20.768 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.401335+0000", 2024-09-12T22:32:20.768 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000161225 2024-09-12T22:32:20.768 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.768 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.768 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:20.768 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.402110+0000", 2024-09-12T22:32:20.768 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00077428800000000004 2024-09-12T22:32:20.768 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.768 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.768 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:20.768 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.402333+0000", 2024-09-12T22:32:20.769 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000223723 2024-09-12T22:32:20.769 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.769 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.769 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:20.769 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.402388+0000", 2024-09-12T22:32:20.769 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4700999999999997e-05 2024-09-12T22:32:20.769 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.769 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.769 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:20.769 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.402435+0000", 2024-09-12T22:32:20.769 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6965999999999997e-05 2024-09-12T22:32:20.770 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:20.770 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:20.770 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:20.770 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.770 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.770 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:45 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e27)", 2024-09-12T22:32:20.770 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:32:04.401614+0000", 2024-09-12T22:32:20.770 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 16.259302251000001, 2024-09-12T22:32:20.770 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0014279749999999999, 2024-09-12T22:32:20.770 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:20.771 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:20.771 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:20.771 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:20.771 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.771 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:20.771 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401614+0000", 2024-09-12T22:32:20.771 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:20.771 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.771 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.771 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:20.771 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401614+0000", 2024-09-12T22:32:20.771 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:20.772 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.772 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.772 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:20.772 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401615+0000", 2024-09-12T22:32:20.772 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.161e-06 2024-09-12T22:32:20.772 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.772 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.772 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:20.772 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401621+0000", 2024-09-12T22:32:20.772 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8730000000000004e-06 2024-09-12T22:32:20.772 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.772 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.773 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:20.773 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401633+0000", 2024-09-12T22:32:20.773 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1800000000000001e-05 2024-09-12T22:32:20.773 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.773 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.773 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:20.773 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401656+0000", 2024-09-12T22:32:20.773 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.3521999999999999e-05 2024-09-12T22:32:20.773 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.773 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.774 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:20.774 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401713+0000", 2024-09-12T22:32:20.774 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7259000000000002e-05 2024-09-12T22:32:20.774 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.774 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.774 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:20.774 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401849+0000", 2024-09-12T22:32:20.774 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013613500000000001 2024-09-12T22:32:20.774 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.774 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.774 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:20.774 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.402009+0000", 2024-09-12T22:32:20.775 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00015947199999999999 2024-09-12T22:32:20.775 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.775 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.775 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:20.775 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.402629+0000", 2024-09-12T22:32:20.775 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00061962200000000001 2024-09-12T22:32:20.775 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.775 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.775 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:20.775 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.402983+0000", 2024-09-12T22:32:20.775 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00035447499999999998 2024-09-12T22:32:20.775 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.776 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.776 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:20.776 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.403016+0000", 2024-09-12T22:32:20.776 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3108999999999998e-05 2024-09-12T22:32:20.776 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:20.776 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:20.776 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:20.776 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.403042+0000", 2024-09-12T22:32:20.776 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5547000000000001e-05 2024-09-12T22:32:20.776 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:20.776 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:20.777 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:20.777 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:20.777 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:20.777 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:32:20.779 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:32:20.779 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:20.777+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:20.879 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:20.878+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:20.895 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-09-12T22:32:20.895 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-09-12T22:32:20.895 INFO:teuthology.orchestra.run.smithi163.stdout: "num_ops": 0 2024-09-12T22:32:20.896 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-09-12T22:32:20.904 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:32:20.980 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:32:20.978+0000 7fddec6a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30331) UID: 0 2024-09-12T22:32:21.008 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-09-12T22:32:21.008 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-09-12T22:32:21.008 INFO:teuthology.orchestra.run.smithi163.stdout: "complaint_time": 30, 2024-09-12T22:32:21.008 INFO:teuthology.orchestra.run.smithi163.stdout: "num_blocked_ops": 0 2024-09-12T22:32:21.008 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-09-12T22:32:21.017 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:32:21.080 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:21.079+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:21.121 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-09-12T22:32:21.121 INFO:teuthology.orchestra.run.smithi163.stdout: "size": 20, 2024-09-12T22:32:21.121 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 600, 2024-09-12T22:32:21.121 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2024-09-12T22:32:21.121 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.122 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-09-12T22:32:21.122 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:27.254459+0000", 2024-09-12T22:32:21.122 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 53.864607321999998, 2024-09-12T22:32:21.122 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.37816283899999997, 2024-09-12T22:32:21.122 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:21.122 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:21.122 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:21.122 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:21.122 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:21.122 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:21.122 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 1 2024-09-12T22:32:21.122 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.122 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:21.123 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.123 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:21.123 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254459+0000", 2024-09-12T22:32:21.123 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:21.123 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.123 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.123 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:21.123 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254459+0000", 2024-09-12T22:32:21.123 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:21.123 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.123 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.123 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:21.123 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254460+0000", 2024-09-12T22:32:21.124 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1739999999999999e-06 2024-09-12T22:32:21.124 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.124 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.124 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:21.124 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254472+0000", 2024-09-12T22:32:21.124 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2207e-05 2024-09-12T22:32:21.124 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.124 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.124 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:21.124 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254483+0000", 2024-09-12T22:32:21.124 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0631999999999999e-05 2024-09-12T22:32:21.124 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.124 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.125 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:21.125 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254492+0000", 2024-09-12T22:32:21.125 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3670000000000003e-06 2024-09-12T22:32:21.125 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.125 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.125 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:21.125 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254551+0000", 2024-09-12T22:32:21.125 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8687999999999998e-05 2024-09-12T22:32:21.125 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.125 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.125 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for peered", 2024-09-12T22:32:21.125 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254562+0000", 2024-09-12T22:32:21.125 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1249e-05 2024-09-12T22:32:21.125 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.126 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.126 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:21.126 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.631211+0000", 2024-09-12T22:32:21.126 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.376649018 2024-09-12T22:32:21.126 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.126 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.126 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:21.126 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.631345+0000", 2024-09-12T22:32:21.126 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013378700000000001 2024-09-12T22:32:21.126 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.126 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.126 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:21.126 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.631479+0000", 2024-09-12T22:32:21.126 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013352399999999999 2024-09-12T22:32:21.127 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.127 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.127 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:21.127 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632324+0000", 2024-09-12T22:32:21.127 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00084508100000000002 2024-09-12T22:32:21.127 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.127 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.127 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:21.127 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632548+0000", 2024-09-12T22:32:21.127 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000224329 2024-09-12T22:32:21.127 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.127 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.127 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:21.128 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632591+0000", 2024-09-12T22:32:21.128 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2564000000000001e-05 2024-09-12T22:32:21.128 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.128 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.128 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:21.128 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632622+0000", 2024-09-12T22:32:21.128 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1219e-05 2024-09-12T22:32:21.128 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:21.128 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:21.128 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:21.128 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.128 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.128 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:185 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:32:21.129 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394355+0000", 2024-09-12T22:32:21.129 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 52.724711225, 2024-09-12T22:32:21.129 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011302394, 2024-09-12T22:32:21.129 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:21.129 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:21.129 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:21.129 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:21.129 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:21.129 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:21.129 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 185 2024-09-12T22:32:21.129 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.129 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:21.129 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.130 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:21.130 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394355+0000", 2024-09-12T22:32:21.130 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:21.130 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.130 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.130 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:21.130 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394355+0000", 2024-09-12T22:32:21.130 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:21.130 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.130 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.130 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:21.130 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394355+0000", 2024-09-12T22:32:21.130 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9099999999999999e-07 2024-09-12T22:32:21.130 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.131 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.131 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:21.131 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394385+0000", 2024-09-12T22:32:21.131 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9963000000000001e-05 2024-09-12T22:32:21.131 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.131 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.131 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:21.131 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394390+0000", 2024-09-12T22:32:21.131 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8420000000000004e-06 2024-09-12T22:32:21.131 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.131 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.131 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:21.131 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394393+0000", 2024-09-12T22:32:21.131 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1e-06 2024-09-12T22:32:21.132 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.132 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.132 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:21.132 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.400546+0000", 2024-09-12T22:32:21.132 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0061523309999999996 2024-09-12T22:32:21.132 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.132 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.132 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:21.132 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.400588+0000", 2024-09-12T22:32:21.132 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1835000000000002e-05 2024-09-12T22:32:21.132 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.132 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.132 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:21.133 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.400677+0000", 2024-09-12T22:32:21.133 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9195000000000002e-05 2024-09-12T22:32:21.133 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.133 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.133 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:21.133 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405378+0000", 2024-09-12T22:32:21.133 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0047008659999999997 2024-09-12T22:32:21.133 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.133 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.133 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:21.133 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405569+0000", 2024-09-12T22:32:21.133 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00019148599999999999 2024-09-12T22:32:21.133 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.134 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.134 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:21.134 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405620+0000", 2024-09-12T22:32:21.134 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1416999999999999e-05 2024-09-12T22:32:21.134 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.134 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.134 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:21.134 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405657+0000", 2024-09-12T22:32:21.134 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6968000000000002e-05 2024-09-12T22:32:21.134 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:21.134 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:21.134 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:21.134 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.134 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.135 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:32:21.135 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394399+0000", 2024-09-12T22:32:21.135 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 52.724667013999998, 2024-09-12T22:32:21.135 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011336601999999999, 2024-09-12T22:32:21.135 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:21.135 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:21.135 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:21.135 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:21.135 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:21.135 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:21.135 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 186 2024-09-12T22:32:21.135 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.135 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:21.136 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.136 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:21.136 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394399+0000", 2024-09-12T22:32:21.136 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:21.136 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.136 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.136 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:21.136 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394399+0000", 2024-09-12T22:32:21.136 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:21.136 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.136 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.136 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:21.137 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394400+0000", 2024-09-12T22:32:21.137 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4499999999999998e-07 2024-09-12T22:32:21.137 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.137 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.137 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:21.137 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394402+0000", 2024-09-12T22:32:21.137 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.875e-06 2024-09-12T22:32:21.137 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.137 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.137 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:21.137 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394405+0000", 2024-09-12T22:32:21.137 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6799999999999999e-06 2024-09-12T22:32:21.137 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.138 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.138 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:21.138 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394408+0000", 2024-09-12T22:32:21.138 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.667e-06 2024-09-12T22:32:21.138 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.138 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.138 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:21.138 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401395+0000", 2024-09-12T22:32:21.138 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0069867230000000002 2024-09-12T22:32:21.138 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.138 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.138 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:21.138 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401438+0000", 2024-09-12T22:32:21.138 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3554999999999999e-05 2024-09-12T22:32:21.139 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.139 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.139 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:21.139 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401509+0000", 2024-09-12T22:32:21.139 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0631999999999997e-05 2024-09-12T22:32:21.139 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.139 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.139 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:21.139 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405392+0000", 2024-09-12T22:32:21.139 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0038830449999999999 2024-09-12T22:32:21.139 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.139 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.139 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:21.140 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405690+0000", 2024-09-12T22:32:21.140 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000298435 2024-09-12T22:32:21.140 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.140 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.140 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:21.140 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405716+0000", 2024-09-12T22:32:21.140 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5435999999999998e-05 2024-09-12T22:32:21.140 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.140 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.140 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:21.140 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405736+0000", 2024-09-12T22:32:21.140 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0208999999999999e-05 2024-09-12T22:32:21.140 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:21.141 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:21.141 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:21.141 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.141 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.141 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:32:21.141 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394411+0000", 2024-09-12T22:32:21.141 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 52.724654888000003, 2024-09-12T22:32:21.141 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011400117, 2024-09-12T22:32:21.141 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:21.141 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:21.141 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:21.141 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:21.142 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:21.142 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:21.142 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 187 2024-09-12T22:32:21.142 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.142 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:21.142 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.142 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:21.142 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394411+0000", 2024-09-12T22:32:21.142 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:21.142 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.142 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.142 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:21.142 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394411+0000", 2024-09-12T22:32:21.142 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:21.143 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.143 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.143 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:21.143 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394412+0000", 2024-09-12T22:32:21.143 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.4999999999999999e-07 2024-09-12T22:32:21.143 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.143 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.143 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:21.143 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394414+0000", 2024-09-12T22:32:21.143 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.984e-06 2024-09-12T22:32:21.143 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.143 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.144 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:21.144 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394418+0000", 2024-09-12T22:32:21.144 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0840000000000002e-06 2024-09-12T22:32:21.144 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.144 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.144 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:21.144 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394431+0000", 2024-09-12T22:32:21.144 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.361e-05 2024-09-12T22:32:21.144 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.144 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.144 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:21.145 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401778+0000", 2024-09-12T22:32:21.145 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0073462659999999997 2024-09-12T22:32:21.145 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.145 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.145 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:21.145 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401853+0000", 2024-09-12T22:32:21.145 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5797000000000006e-05 2024-09-12T22:32:21.145 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.145 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.145 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:21.145 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401990+0000", 2024-09-12T22:32:21.145 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013651399999999999 2024-09-12T22:32:21.145 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.145 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.146 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:21.146 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405402+0000", 2024-09-12T22:32:21.146 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0034116070000000001 2024-09-12T22:32:21.146 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.146 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.146 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:21.146 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405764+0000", 2024-09-12T22:32:21.146 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00036234899999999998 2024-09-12T22:32:21.146 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.146 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.146 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:21.146 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405791+0000", 2024-09-12T22:32:21.146 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7029000000000002e-05 2024-09-12T22:32:21.147 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.147 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.147 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:21.147 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405812+0000", 2024-09-12T22:32:21.147 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0627000000000001e-05 2024-09-12T22:32:21.147 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:21.147 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:21.147 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:21.147 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.147 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.147 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:32:21.147 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394447+0000", 2024-09-12T22:32:21.147 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 52.724619736999998, 2024-09-12T22:32:21.148 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011759588, 2024-09-12T22:32:21.148 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:21.148 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:21.148 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:21.148 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:21.148 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:21.148 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:21.148 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 188 2024-09-12T22:32:21.148 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.148 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:21.148 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.148 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:21.148 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394447+0000", 2024-09-12T22:32:21.148 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:21.149 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.149 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.149 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:21.149 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394447+0000", 2024-09-12T22:32:21.149 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:21.149 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.149 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.149 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:21.149 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394447+0000", 2024-09-12T22:32:21.149 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.15e-07 2024-09-12T22:32:21.149 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.149 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.149 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:21.149 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394512+0000", 2024-09-12T22:32:21.150 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4580999999999997e-05 2024-09-12T22:32:21.150 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.150 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.150 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:21.150 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394518+0000", 2024-09-12T22:32:21.150 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.3380000000000001e-06 2024-09-12T22:32:21.150 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.150 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.150 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:21.150 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394521+0000", 2024-09-12T22:32:21.150 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3340000000000002e-06 2024-09-12T22:32:21.150 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.150 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.151 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:21.151 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.402628+0000", 2024-09-12T22:32:21.151 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.008106996 2024-09-12T22:32:21.151 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.151 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.151 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:21.151 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.402670+0000", 2024-09-12T22:32:21.151 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1983000000000001e-05 2024-09-12T22:32:21.151 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.151 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.151 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:21.151 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.402738+0000", 2024-09-12T22:32:21.151 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.8114999999999994e-05 2024-09-12T22:32:21.152 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.152 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.152 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:21.152 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405668+0000", 2024-09-12T22:32:21.152 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.002929545 2024-09-12T22:32:21.152 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.152 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.152 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:21.152 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406162+0000", 2024-09-12T22:32:21.152 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000494408 2024-09-12T22:32:21.152 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.152 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.152 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:21.152 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406188+0000", 2024-09-12T22:32:21.153 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5766e-05 2024-09-12T22:32:21.153 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.153 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.153 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:21.153 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406206+0000", 2024-09-12T22:32:21.153 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.8107000000000001e-05 2024-09-12T22:32:21.153 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:21.153 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:21.153 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:21.153 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.153 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.153 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:32:21.153 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394528+0000", 2024-09-12T22:32:21.154 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 52.724538068000001, 2024-09-12T22:32:21.154 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.01195536, 2024-09-12T22:32:21.154 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:21.154 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:21.154 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:21.154 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:21.154 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:21.154 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:21.154 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 189 2024-09-12T22:32:21.154 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.154 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:21.154 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.155 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:21.155 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394528+0000", 2024-09-12T22:32:21.155 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:21.155 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.155 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.155 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:21.155 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394528+0000", 2024-09-12T22:32:21.155 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:21.155 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.155 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.155 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:21.156 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394529+0000", 2024-09-12T22:32:21.156 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4900000000000001e-07 2024-09-12T22:32:21.156 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.156 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.156 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:21.156 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394531+0000", 2024-09-12T22:32:21.156 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.458e-06 2024-09-12T22:32:21.156 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.156 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.156 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:21.156 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394535+0000", 2024-09-12T22:32:21.156 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7900000000000001e-06 2024-09-12T22:32:21.156 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.157 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.157 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:21.157 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394537+0000", 2024-09-12T22:32:21.157 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.632e-06 2024-09-12T22:32:21.157 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.157 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.157 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:21.157 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.404932+0000", 2024-09-12T22:32:21.157 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010394158000000001 2024-09-12T22:32:21.157 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.157 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.157 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:21.157 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405017+0000", 2024-09-12T22:32:21.158 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5525000000000005e-05 2024-09-12T22:32:21.158 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.158 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.158 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:21.158 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405114+0000", 2024-09-12T22:32:21.158 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.6527000000000006e-05 2024-09-12T22:32:21.158 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.158 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.158 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:21.158 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405818+0000", 2024-09-12T22:32:21.158 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00070412800000000005 2024-09-12T22:32:21.158 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.158 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.158 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:21.159 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406437+0000", 2024-09-12T22:32:21.159 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00061898900000000002 2024-09-12T22:32:21.159 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.159 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.159 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:21.159 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406463+0000", 2024-09-12T22:32:21.159 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6268e-05 2024-09-12T22:32:21.159 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.159 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.159 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:21.159 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406484+0000", 2024-09-12T22:32:21.159 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0536000000000001e-05 2024-09-12T22:32:21.159 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:21.159 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:21.160 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:21.160 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.160 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.160 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:21.160 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.401422+0000", 2024-09-12T22:32:21.160 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 43.717644163000003, 2024-09-12T22:32:21.160 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016896452999999999, 2024-09-12T22:32:21.160 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:21.160 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:21.160 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:21.160 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:21.160 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.161 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:21.161 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401422+0000", 2024-09-12T22:32:21.161 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:21.161 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.161 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.161 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:21.161 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401422+0000", 2024-09-12T22:32:21.161 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:21.161 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.161 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.161 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:21.161 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401424+0000", 2024-09-12T22:32:21.161 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9e-06 2024-09-12T22:32:21.161 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.162 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.162 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:21.162 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401437+0000", 2024-09-12T22:32:21.162 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2831e-05 2024-09-12T22:32:21.162 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.162 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.162 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:21.162 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401471+0000", 2024-09-12T22:32:21.162 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4010000000000001e-05 2024-09-12T22:32:21.162 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.162 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.162 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:21.162 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401484+0000", 2024-09-12T22:32:21.162 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2711000000000001e-05 2024-09-12T22:32:21.163 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.163 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.163 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:21.163 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405410+0000", 2024-09-12T22:32:21.163 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0039259170000000001 2024-09-12T22:32:21.163 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.163 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.163 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:21.163 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405529+0000", 2024-09-12T22:32:21.163 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000119778 2024-09-12T22:32:21.163 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.163 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.164 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:21.164 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405655+0000", 2024-09-12T22:32:21.164 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012556700000000001 2024-09-12T22:32:21.164 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.164 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.164 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:21.164 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410456+0000", 2024-09-12T22:32:21.164 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0048008269999999997 2024-09-12T22:32:21.164 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.164 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.165 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:21.165 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418226+0000", 2024-09-12T22:32:21.165 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0077707729999999999 2024-09-12T22:32:21.165 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.165 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.165 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:21.165 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418277+0000", 2024-09-12T22:32:21.165 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0476000000000003e-05 2024-09-12T22:32:21.165 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.165 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.165 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:21.165 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418319+0000", 2024-09-12T22:32:21.166 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1662999999999997e-05 2024-09-12T22:32:21.166 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:21.166 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:21.166 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:21.166 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.166 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.166 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:21.166 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.401505+0000", 2024-09-12T22:32:21.166 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 43.717561498999999, 2024-09-12T22:32:21.166 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016987904000000002, 2024-09-12T22:32:21.166 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:21.166 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:21.166 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:21.166 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:21.167 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.167 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:21.167 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401505+0000", 2024-09-12T22:32:21.167 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:21.167 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.167 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.167 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:21.167 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401505+0000", 2024-09-12T22:32:21.167 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:21.167 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.167 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.167 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:21.167 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401506+0000", 2024-09-12T22:32:21.167 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4700000000000001e-07 2024-09-12T22:32:21.168 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.168 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.168 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:21.168 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401510+0000", 2024-09-12T22:32:21.168 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6609999999999999e-06 2024-09-12T22:32:21.168 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.168 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.168 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:21.168 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401771+0000", 2024-09-12T22:32:21.168 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00026110700000000001 2024-09-12T22:32:21.168 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.168 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.168 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:21.169 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401921+0000", 2024-09-12T22:32:21.169 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014939099999999999 2024-09-12T22:32:21.169 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.169 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.169 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:21.169 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405944+0000", 2024-09-12T22:32:21.169 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0040235449999999999 2024-09-12T22:32:21.169 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.169 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.169 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:21.169 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406018+0000", 2024-09-12T22:32:21.169 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3373000000000004e-05 2024-09-12T22:32:21.169 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.169 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.170 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:21.170 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406172+0000", 2024-09-12T22:32:21.170 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00015435399999999999 2024-09-12T22:32:21.170 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.170 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.170 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:21.170 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410461+0000", 2024-09-12T22:32:21.170 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0042888609999999997 2024-09-12T22:32:21.170 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.170 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.170 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:21.170 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418371+0000", 2024-09-12T22:32:21.170 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0079098380000000006 2024-09-12T22:32:21.171 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.171 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.171 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:21.171 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418443+0000", 2024-09-12T22:32:21.171 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2705000000000003e-05 2024-09-12T22:32:21.171 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.171 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.171 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:21.171 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418493+0000", 2024-09-12T22:32:21.171 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9322e-05 2024-09-12T22:32:21.171 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:21.171 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:21.171 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:21.172 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.172 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.172 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:21.172 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.401939+0000", 2024-09-12T22:32:21.172 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 43.717127763000001, 2024-09-12T22:32:21.172 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016722292999999999, 2024-09-12T22:32:21.172 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:21.172 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:21.172 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:21.172 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:21.172 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.172 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:21.172 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401939+0000", 2024-09-12T22:32:21.172 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:21.173 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.173 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.173 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:21.173 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401939+0000", 2024-09-12T22:32:21.173 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:21.173 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.173 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.173 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:21.173 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401940+0000", 2024-09-12T22:32:21.173 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1990000000000001e-06 2024-09-12T22:32:21.173 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.173 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.173 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:21.174 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401956+0000", 2024-09-12T22:32:21.174 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.6344000000000001e-05 2024-09-12T22:32:21.174 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.174 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.174 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:21.174 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401974+0000", 2024-09-12T22:32:21.174 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7730000000000001e-05 2024-09-12T22:32:21.174 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.174 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.174 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:21.174 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401982+0000", 2024-09-12T22:32:21.174 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.7800000000000001e-06 2024-09-12T22:32:21.174 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.175 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.175 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:21.175 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406557+0000", 2024-09-12T22:32:21.175 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0045758489999999999 2024-09-12T22:32:21.175 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.175 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.175 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:21.175 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406697+0000", 2024-09-12T22:32:21.175 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013925100000000001 2024-09-12T22:32:21.175 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.175 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.175 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:21.175 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406830+0000", 2024-09-12T22:32:21.175 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013293499999999999 2024-09-12T22:32:21.176 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.176 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.176 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:21.176 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410465+0000", 2024-09-12T22:32:21.176 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0036352680000000001 2024-09-12T22:32:21.176 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.176 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.176 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:21.176 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418564+0000", 2024-09-12T22:32:21.176 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0080992140000000004 2024-09-12T22:32:21.176 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.176 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.176 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:21.177 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418621+0000", 2024-09-12T22:32:21.177 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7167999999999999e-05 2024-09-12T22:32:21.177 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.177 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.177 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:21.177 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418661+0000", 2024-09-12T22:32:21.177 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9555000000000003e-05 2024-09-12T22:32:21.177 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:21.177 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:21.177 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:21.177 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.177 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.177 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:21.177 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.401994+0000", 2024-09-12T22:32:21.178 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 43.717071891000003, 2024-09-12T22:32:21.178 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016804109000000001, 2024-09-12T22:32:21.178 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:21.178 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:21.178 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:21.178 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:21.178 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.178 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:21.178 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401994+0000", 2024-09-12T22:32:21.178 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:21.178 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.178 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.178 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:21.179 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401994+0000", 2024-09-12T22:32:21.179 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:21.179 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.179 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.179 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:21.179 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401995+0000", 2024-09-12T22:32:21.179 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.8899999999999998e-07 2024-09-12T22:32:21.179 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.179 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.179 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:21.179 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402000+0000", 2024-09-12T22:32:21.179 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.498e-06 2024-09-12T22:32:21.179 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.180 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.180 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:21.180 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402007+0000", 2024-09-12T22:32:21.180 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.554e-06 2024-09-12T22:32:21.180 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.180 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.180 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:21.180 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402046+0000", 2024-09-12T22:32:21.180 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9156000000000003e-05 2024-09-12T22:32:21.180 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.180 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.180 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:21.180 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407342+0000", 2024-09-12T22:32:21.181 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052957610000000004 2024-09-12T22:32:21.181 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.181 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.181 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:21.181 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407521+0000", 2024-09-12T22:32:21.181 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00017878100000000001 2024-09-12T22:32:21.181 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.181 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.181 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:21.181 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407641+0000", 2024-09-12T22:32:21.181 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012013 2024-09-12T22:32:21.181 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.181 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.181 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:21.182 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410472+0000", 2024-09-12T22:32:21.182 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.002830455 2024-09-12T22:32:21.182 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.182 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.182 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:21.182 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418714+0000", 2024-09-12T22:32:21.182 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0082422789999999999 2024-09-12T22:32:21.182 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.182 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.182 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:21.182 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418761+0000", 2024-09-12T22:32:21.182 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6956999999999998e-05 2024-09-12T22:32:21.182 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.183 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.183 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:21.183 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418799+0000", 2024-09-12T22:32:21.183 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7749000000000001e-05 2024-09-12T22:32:21.183 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:21.183 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:21.183 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:21.183 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.183 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.183 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:21.183 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.402060+0000", 2024-09-12T22:32:21.183 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 43.717006447000003, 2024-09-12T22:32:21.183 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016885686, 2024-09-12T22:32:21.183 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:21.184 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:21.184 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:21.184 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:21.184 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.184 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:21.184 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402060+0000", 2024-09-12T22:32:21.184 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:21.184 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.184 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.184 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:21.184 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402060+0000", 2024-09-12T22:32:21.184 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:21.184 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.185 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.185 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:21.185 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402061+0000", 2024-09-12T22:32:21.185 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4399999999999999e-07 2024-09-12T22:32:21.185 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.185 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.185 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:21.185 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402066+0000", 2024-09-12T22:32:21.185 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8649999999999998e-06 2024-09-12T22:32:21.185 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.185 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.185 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:21.185 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402146+0000", 2024-09-12T22:32:21.185 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9054000000000006e-05 2024-09-12T22:32:21.186 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.186 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.186 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:21.186 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402287+0000", 2024-09-12T22:32:21.186 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014108600000000001 2024-09-12T22:32:21.186 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.186 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.186 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:21.186 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408185+0000", 2024-09-12T22:32:21.186 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0058983919999999997 2024-09-12T22:32:21.186 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.186 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.186 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:21.187 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408299+0000", 2024-09-12T22:32:21.187 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114102 2024-09-12T22:32:21.187 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.187 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.187 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:21.187 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408420+0000", 2024-09-12T22:32:21.187 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000120492 2024-09-12T22:32:21.187 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.187 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.187 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:21.187 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410867+0000", 2024-09-12T22:32:21.187 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0024476430000000002 2024-09-12T22:32:21.187 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.187 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.188 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:21.188 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418851+0000", 2024-09-12T22:32:21.188 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0079841489999999994 2024-09-12T22:32:21.188 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.188 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.188 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:21.188 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418894+0000", 2024-09-12T22:32:21.188 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3090000000000002e-05 2024-09-12T22:32:21.188 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.188 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.188 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:21.188 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418946+0000", 2024-09-12T22:32:21.188 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1069000000000002e-05 2024-09-12T22:32:21.189 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:21.189 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:21.189 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:21.189 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.189 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.189 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:21.189 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.402375+0000", 2024-09-12T22:32:21.189 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 43.716691382, 2024-09-12T22:32:21.189 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016768531999999999, 2024-09-12T22:32:21.189 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:21.189 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:21.189 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:21.189 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:21.190 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.190 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:21.190 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402375+0000", 2024-09-12T22:32:21.190 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:21.190 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.190 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.190 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:21.190 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402375+0000", 2024-09-12T22:32:21.190 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:21.190 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.190 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.190 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:21.190 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402375+0000", 2024-09-12T22:32:21.190 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4099999999999999e-07 2024-09-12T22:32:21.191 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.191 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.191 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:21.191 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402379+0000", 2024-09-12T22:32:21.191 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9870000000000001e-06 2024-09-12T22:32:21.191 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.191 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.191 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:21.191 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402389+0000", 2024-09-12T22:32:21.191 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0000000000000001e-05 2024-09-12T22:32:21.191 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.191 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.191 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:21.191 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402401+0000", 2024-09-12T22:32:21.192 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.148e-05 2024-09-12T22:32:21.192 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.192 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.192 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:21.192 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409108+0000", 2024-09-12T22:32:21.192 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0067068429999999997 2024-09-12T22:32:21.192 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.192 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.192 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:21.192 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409189+0000", 2024-09-12T22:32:21.192 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0815999999999993e-05 2024-09-12T22:32:21.192 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.192 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.193 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:21.193 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409320+0000", 2024-09-12T22:32:21.193 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000131586 2024-09-12T22:32:21.193 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.193 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.193 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:21.193 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410872+0000", 2024-09-12T22:32:21.193 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0015521599999999999 2024-09-12T22:32:21.193 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.193 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.193 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:21.193 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419049+0000", 2024-09-12T22:32:21.193 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0081763719999999995 2024-09-12T22:32:21.193 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.194 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.194 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:21.194 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419107+0000", 2024-09-12T22:32:21.194 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7899000000000002e-05 2024-09-12T22:32:21.194 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.194 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.194 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:21.194 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419143+0000", 2024-09-12T22:32:21.194 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6847999999999997e-05 2024-09-12T22:32:21.194 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:21.194 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:21.194 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:21.195 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.195 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.195 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:21.195 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.402903+0000", 2024-09-12T22:32:21.195 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 43.716162969999999, 2024-09-12T22:32:21.195 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016378428, 2024-09-12T22:32:21.195 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:21.195 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:21.195 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:21.195 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:21.195 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.195 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:21.195 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402903+0000", 2024-09-12T22:32:21.195 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:21.196 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.196 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.196 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:21.196 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402903+0000", 2024-09-12T22:32:21.196 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:21.196 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.196 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.196 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:21.196 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402904+0000", 2024-09-12T22:32:21.197 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9500000000000001e-07 2024-09-12T22:32:21.197 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.197 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.197 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:21.197 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402944+0000", 2024-09-12T22:32:21.197 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0265000000000002e-05 2024-09-12T22:32:21.197 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.197 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.197 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:21.197 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402979+0000", 2024-09-12T22:32:21.197 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4378000000000002e-05 2024-09-12T22:32:21.197 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.197 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.197 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:21.198 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402987+0000", 2024-09-12T22:32:21.198 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3559999999999993e-06 2024-09-12T22:32:21.198 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.198 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.198 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:21.198 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409577+0000", 2024-09-12T22:32:21.198 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0065901709999999997 2024-09-12T22:32:21.198 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.198 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.198 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:21.198 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409653+0000", 2024-09-12T22:32:21.198 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5819e-05 2024-09-12T22:32:21.198 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.199 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.199 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:21.199 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409725+0000", 2024-09-12T22:32:21.199 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2200000000000007e-05 2024-09-12T22:32:21.199 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.199 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.199 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:21.199 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.411234+0000", 2024-09-12T22:32:21.199 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001508225 2024-09-12T22:32:21.199 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.199 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.199 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:21.199 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419212+0000", 2024-09-12T22:32:21.199 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0079783400000000004 2024-09-12T22:32:21.200 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.200 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.200 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:21.200 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419244+0000", 2024-09-12T22:32:21.200 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2384e-05 2024-09-12T22:32:21.200 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.200 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.200 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:21.200 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419282+0000", 2024-09-12T22:32:21.200 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7394999999999997e-05 2024-09-12T22:32:21.200 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:21.200 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:21.200 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:21.200 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.201 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.201 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:21.201 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.403135+0000", 2024-09-12T22:32:21.201 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 43.715931099999999, 2024-09-12T22:32:21.201 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016294211999999999, 2024-09-12T22:32:21.201 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:21.201 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:21.201 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:21.201 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:21.201 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.201 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:21.201 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403135+0000", 2024-09-12T22:32:21.201 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:21.202 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.202 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.202 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:21.202 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403135+0000", 2024-09-12T22:32:21.202 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:21.202 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.202 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.202 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:21.202 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403136+0000", 2024-09-12T22:32:21.202 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.4e-07 2024-09-12T22:32:21.202 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.202 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.202 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:21.202 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403149+0000", 2024-09-12T22:32:21.203 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2723e-05 2024-09-12T22:32:21.203 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.203 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.203 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:21.203 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403158+0000", 2024-09-12T22:32:21.203 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3919999999999992e-06 2024-09-12T22:32:21.203 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.203 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.203 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:21.203 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403166+0000", 2024-09-12T22:32:21.203 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.2309999999999996e-06 2024-09-12T22:32:21.203 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.203 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.203 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:21.204 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409944+0000", 2024-09-12T22:32:21.204 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0067775309999999998 2024-09-12T22:32:21.204 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.204 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.204 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:21.204 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410032+0000", 2024-09-12T22:32:21.204 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.7906999999999997e-05 2024-09-12T22:32:21.204 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.204 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.204 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:21.204 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410152+0000", 2024-09-12T22:32:21.204 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012037800000000001 2024-09-12T22:32:21.204 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.205 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.205 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:21.205 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.411945+0000", 2024-09-12T22:32:21.205 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0017931850000000001 2024-09-12T22:32:21.205 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.205 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.205 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:21.205 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419319+0000", 2024-09-12T22:32:21.205 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0073731780000000002 2024-09-12T22:32:21.205 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.205 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.205 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:21.205 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419376+0000", 2024-09-12T22:32:21.206 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7728e-05 2024-09-12T22:32:21.206 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.206 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.206 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:21.206 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419429+0000", 2024-09-12T22:32:21.206 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3019000000000002e-05 2024-09-12T22:32:21.206 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:21.206 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:21.206 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:21.206 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.206 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.206 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:21.206 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.403185+0000", 2024-09-12T22:32:21.207 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 43.715881219000003, 2024-09-12T22:32:21.207 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.014902164000000001, 2024-09-12T22:32:21.207 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:21.207 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:21.207 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:21.207 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:21.207 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.207 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:21.207 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403185+0000", 2024-09-12T22:32:21.207 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:21.207 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.207 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.207 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:21.207 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403185+0000", 2024-09-12T22:32:21.208 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:21.208 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.208 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.208 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:21.208 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403186+0000", 2024-09-12T22:32:21.208 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9400000000000005e-07 2024-09-12T22:32:21.208 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.208 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.208 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:21.208 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403191+0000", 2024-09-12T22:32:21.208 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6980000000000003e-06 2024-09-12T22:32:21.208 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.208 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.209 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:21.209 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403199+0000", 2024-09-12T22:32:21.209 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2520000000000002e-06 2024-09-12T22:32:21.209 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.209 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.209 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:21.209 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403205+0000", 2024-09-12T22:32:21.209 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.908e-06 2024-09-12T22:32:21.209 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.209 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.209 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:21.209 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403359+0000", 2024-09-12T22:32:21.209 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000154544 2024-09-12T22:32:21.209 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.210 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.210 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:21.210 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403528+0000", 2024-09-12T22:32:21.210 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000168455 2024-09-12T22:32:21.210 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.210 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.210 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:21.210 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403763+0000", 2024-09-12T22:32:21.210 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00023539599999999999 2024-09-12T22:32:21.210 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.210 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.210 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:21.210 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409378+0000", 2024-09-12T22:32:21.210 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056150000000000002 2024-09-12T22:32:21.211 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.211 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.211 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:21.211 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418012+0000", 2024-09-12T22:32:21.211 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0086339559999999999 2024-09-12T22:32:21.211 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.211 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.211 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:21.211 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418046+0000", 2024-09-12T22:32:21.211 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4267999999999998e-05 2024-09-12T22:32:21.211 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.211 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.211 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:21.211 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418087+0000", 2024-09-12T22:32:21.212 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0992999999999999e-05 2024-09-12T22:32:21.212 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:21.212 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:21.212 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:21.212 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.212 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.212 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:21.212 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.403273+0000", 2024-09-12T22:32:21.212 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 43.715793267999999, 2024-09-12T22:32:21.212 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.014934866, 2024-09-12T22:32:21.212 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:21.212 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:21.212 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:21.213 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:21.213 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.213 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:21.213 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403273+0000", 2024-09-12T22:32:21.213 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:21.213 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.213 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.213 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:21.213 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403273+0000", 2024-09-12T22:32:21.213 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:21.213 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.213 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.213 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:21.214 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403274+0000", 2024-09-12T22:32:21.214 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.297e-06 2024-09-12T22:32:21.214 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.214 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.214 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:21.214 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403282+0000", 2024-09-12T22:32:21.214 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6340000000000001e-06 2024-09-12T22:32:21.214 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.214 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.214 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:21.214 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403305+0000", 2024-09-12T22:32:21.214 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3149000000000001e-05 2024-09-12T22:32:21.214 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.214 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.215 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:21.215 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403320+0000", 2024-09-12T22:32:21.215 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4527e-05 2024-09-12T22:32:21.215 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.215 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.215 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:21.215 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.404928+0000", 2024-09-12T22:32:21.215 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001608459 2024-09-12T22:32:21.215 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.215 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.215 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:21.215 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405218+0000", 2024-09-12T22:32:21.215 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00028982900000000002 2024-09-12T22:32:21.215 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.216 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.216 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:21.216 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405829+0000", 2024-09-12T22:32:21.216 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00061127900000000005 2024-09-12T22:32:21.216 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.216 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.216 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:21.216 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409403+0000", 2024-09-12T22:32:21.216 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.003573597 2024-09-12T22:32:21.216 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.216 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.216 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:21.216 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418138+0000", 2024-09-12T22:32:21.217 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0087349969999999996 2024-09-12T22:32:21.217 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.217 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.217 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:21.217 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418178+0000", 2024-09-12T22:32:21.217 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0649999999999999e-05 2024-09-12T22:32:21.217 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.217 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.217 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:21.217 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418208+0000", 2024-09-12T22:32:21.217 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9448e-05 2024-09-12T22:32:21.217 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:21.217 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:21.217 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:21.218 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.218 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.218 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:21.218 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.405456+0000", 2024-09-12T22:32:21.218 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 43.713610123000002, 2024-09-12T22:32:21.218 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012888389, 2024-09-12T22:32:21.218 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:21.218 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:21.218 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:21.218 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:21.218 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.218 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:21.218 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405456+0000", 2024-09-12T22:32:21.218 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:21.219 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.219 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.219 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:21.219 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405456+0000", 2024-09-12T22:32:21.219 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:21.219 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.219 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.219 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:21.219 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405457+0000", 2024-09-12T22:32:21.219 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.6599999999999994e-07 2024-09-12T22:32:21.219 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.219 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.219 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:21.220 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405463+0000", 2024-09-12T22:32:21.220 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4739999999999996e-06 2024-09-12T22:32:21.220 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.220 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.220 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:21.220 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405474+0000", 2024-09-12T22:32:21.220 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1095e-05 2024-09-12T22:32:21.220 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.220 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.220 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:21.220 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405482+0000", 2024-09-12T22:32:21.220 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3610000000000001e-06 2024-09-12T22:32:21.220 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.220 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.221 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:21.221 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407051+0000", 2024-09-12T22:32:21.221 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0015688970000000001 2024-09-12T22:32:21.221 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.221 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.221 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:21.221 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407259+0000", 2024-09-12T22:32:21.221 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00020778300000000001 2024-09-12T22:32:21.221 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.221 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.221 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:21.221 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407622+0000", 2024-09-12T22:32:21.221 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000363066 2024-09-12T22:32:21.222 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.222 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.222 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:21.222 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409438+0000", 2024-09-12T22:32:21.222 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001816319 2024-09-12T22:32:21.222 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.222 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.222 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:21.222 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418257+0000", 2024-09-12T22:32:21.222 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0088187720000000008 2024-09-12T22:32:21.222 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.222 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.222 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:21.222 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418308+0000", 2024-09-12T22:32:21.223 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1180000000000001e-05 2024-09-12T22:32:21.223 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.223 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.223 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:21.223 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418345+0000", 2024-09-12T22:32:21.223 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6476000000000001e-05 2024-09-12T22:32:21.223 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:21.223 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:21.223 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:21.223 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.223 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.223 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:21.223 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.405496+0000", 2024-09-12T22:32:21.223 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 43.713570765999997, 2024-09-12T22:32:21.224 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013016012, 2024-09-12T22:32:21.224 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:21.224 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:21.224 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:21.224 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:21.224 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.224 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:21.224 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405496+0000", 2024-09-12T22:32:21.224 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:21.224 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.224 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.224 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:21.224 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405496+0000", 2024-09-12T22:32:21.225 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:21.225 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.225 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.225 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:21.225 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405496+0000", 2024-09-12T22:32:21.225 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7999999999999995e-07 2024-09-12T22:32:21.225 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.225 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.225 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:21.225 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405501+0000", 2024-09-12T22:32:21.225 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8359999999999999e-06 2024-09-12T22:32:21.225 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.225 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.225 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:21.226 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405514+0000", 2024-09-12T22:32:21.226 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2522e-05 2024-09-12T22:32:21.226 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.226 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.226 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:21.226 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405521+0000", 2024-09-12T22:32:21.226 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5020000000000003e-06 2024-09-12T22:32:21.226 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.226 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.226 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:21.226 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405575+0000", 2024-09-12T22:32:21.226 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4169999999999998e-05 2024-09-12T22:32:21.226 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.226 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.227 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:21.227 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405697+0000", 2024-09-12T22:32:21.227 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000121301 2024-09-12T22:32:21.227 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.227 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.227 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:21.227 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405829+0000", 2024-09-12T22:32:21.227 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000132662 2024-09-12T22:32:21.227 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.227 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.227 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:21.227 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409155+0000", 2024-09-12T22:32:21.227 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0033259050000000001 2024-09-12T22:32:21.228 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.228 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.228 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:21.228 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418425+0000", 2024-09-12T22:32:21.228 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0092696319999999999 2024-09-12T22:32:21.228 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.228 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.228 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:21.228 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418471+0000", 2024-09-12T22:32:21.228 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6213e-05 2024-09-12T22:32:21.228 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.228 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.228 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:21.228 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418512+0000", 2024-09-12T22:32:21.229 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0589000000000001e-05 2024-09-12T22:32:21.229 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:21.229 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:21.229 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:21.229 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.229 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.229 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:21.229 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.406108+0000", 2024-09-12T22:32:21.229 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 43.712958368999999, 2024-09-12T22:32:21.229 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012458175, 2024-09-12T22:32:21.229 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:21.229 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:21.229 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:21.230 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:21.230 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.230 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:21.230 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406108+0000", 2024-09-12T22:32:21.230 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:21.230 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.230 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.230 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:21.230 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406108+0000", 2024-09-12T22:32:21.230 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:21.230 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.230 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.230 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:21.230 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406109+0000", 2024-09-12T22:32:21.231 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9899999999999999e-07 2024-09-12T22:32:21.231 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.231 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.231 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:21.231 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406115+0000", 2024-09-12T22:32:21.231 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9030000000000001e-06 2024-09-12T22:32:21.231 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.231 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.231 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:21.231 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406141+0000", 2024-09-12T22:32:21.231 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5999e-05 2024-09-12T22:32:21.231 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.231 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.231 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:21.232 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406150+0000", 2024-09-12T22:32:21.232 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.6050000000000004e-06 2024-09-12T22:32:21.232 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.232 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.232 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:21.232 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408163+0000", 2024-09-12T22:32:21.232 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0020122769999999998 2024-09-12T22:32:21.232 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.232 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.232 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:21.232 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408309+0000", 2024-09-12T22:32:21.232 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014606999999999999 2024-09-12T22:32:21.232 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.233 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.233 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:21.233 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408433+0000", 2024-09-12T22:32:21.233 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012460300000000001 2024-09-12T22:32:21.233 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.233 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.233 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:21.233 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409903+0000", 2024-09-12T22:32:21.233 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001469499 2024-09-12T22:32:21.233 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.233 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.233 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:21.233 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418427+0000", 2024-09-12T22:32:21.233 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0085241139999999993 2024-09-12T22:32:21.234 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.234 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.234 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:21.234 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418471+0000", 2024-09-12T22:32:21.234 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4474000000000001e-05 2024-09-12T22:32:21.234 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.234 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.234 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:21.234 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418566+0000", 2024-09-12T22:32:21.234 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.4732e-05 2024-09-12T22:32:21.234 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:21.234 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:21.234 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:21.234 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.235 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.235 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:21.235 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.407266+0000", 2024-09-12T22:32:21.235 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 43.711800513, 2024-09-12T22:32:21.235 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011442905, 2024-09-12T22:32:21.235 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:21.235 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:21.235 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2024-09-12T22:32:21.235 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:21.235 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.235 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:21.235 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407266+0000", 2024-09-12T22:32:21.235 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:21.235 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.236 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.236 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:21.236 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407266+0000", 2024-09-12T22:32:21.236 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:21.236 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.236 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.236 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:21.236 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407266+0000", 2024-09-12T22:32:21.236 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7899999999999998e-07 2024-09-12T22:32:21.236 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.236 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.236 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:21.236 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407269+0000", 2024-09-12T22:32:21.237 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9210000000000001e-06 2024-09-12T22:32:21.237 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.237 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.237 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:21.237 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407331+0000", 2024-09-12T22:32:21.237 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1376000000000003e-05 2024-09-12T22:32:21.237 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.237 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.237 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:21.237 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407337+0000", 2024-09-12T22:32:21.237 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1929999999999998e-06 2024-09-12T22:32:21.237 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.237 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.237 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:21.238 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408974+0000", 2024-09-12T22:32:21.238 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0016367109999999999 2024-09-12T22:32:21.238 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.238 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.238 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:21.238 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409112+0000", 2024-09-12T22:32:21.238 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000137952 2024-09-12T22:32:21.238 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:21.238 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:21.238 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:21.238 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418709+0000", 2024-09-12T22:32:21.238 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0095971730000000005 2024-09-12T22:32:21.238 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:21.238 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:21.239 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:21.239 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:21.239 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:21.239 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-09-12T22:32:21.240 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:32:21.238+0000 7fddec6a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30331) UID: 0 2024-09-12T22:32:21.241 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:32:21.340 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:32:21.338+0000 7fddec6a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30331) UID: 0 2024-09-12T22:32:21.355 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-09-12T22:32:21.355 INFO:teuthology.orchestra.run.smithi076.stdout: "ops": [], 2024-09-12T22:32:21.355 INFO:teuthology.orchestra.run.smithi076.stdout: "num_ops": 0 2024-09-12T22:32:21.355 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-09-12T22:32:21.364 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:32:21.441 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:21.440+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:21.507 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-09-12T22:32:21.508 INFO:teuthology.orchestra.run.smithi076.stdout: "ops": [], 2024-09-12T22:32:21.508 INFO:teuthology.orchestra.run.smithi076.stdout: "complaint_time": 30, 2024-09-12T22:32:21.508 INFO:teuthology.orchestra.run.smithi076.stdout: "num_blocked_ops": 0 2024-09-12T22:32:21.508 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-09-12T22:32:21.516 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:32:21.561 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:32:21.559+0000 7fddec6a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30331) UID: 0 2024-09-12T22:32:21.620 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-09-12T22:32:21.620 INFO:teuthology.orchestra.run.smithi076.stdout: "size": 20, 2024-09-12T22:32:21.620 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 600, 2024-09-12T22:32:21.620 INFO:teuthology.orchestra.run.smithi076.stdout: "ops": [ 2024-09-12T22:32:21.620 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.620 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:21.620 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.400604+0000", 2024-09-12T22:32:21.620 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 44.217231863000002, 2024-09-12T22:32:21.620 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.017278814, 2024-09-12T22:32:21.621 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:21.621 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:21.621 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:21.621 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:21.621 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.621 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:21.621 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400604+0000", 2024-09-12T22:32:21.621 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:21.621 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.621 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.621 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:21.621 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400604+0000", 2024-09-12T22:32:21.621 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:21.622 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.622 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.622 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:21.622 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400617+0000", 2024-09-12T22:32:21.622 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.3076e-05 2024-09-12T22:32:21.622 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.622 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.622 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:21.622 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400623+0000", 2024-09-12T22:32:21.622 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.5780000000000004e-06 2024-09-12T22:32:21.622 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.622 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.622 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:21.623 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400641+0000", 2024-09-12T22:32:21.623 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.8218000000000001e-05 2024-09-12T22:32:21.623 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.623 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.623 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:21.623 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400652+0000", 2024-09-12T22:32:21.623 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.0421999999999999e-05 2024-09-12T22:32:21.623 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.623 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.623 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:21.623 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400707+0000", 2024-09-12T22:32:21.623 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.4666000000000001e-05 2024-09-12T22:32:21.623 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.623 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.624 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op must wait for map", 2024-09-12T22:32:21.624 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400711+0000", 2024-09-12T22:32:21.624 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.5340000000000001e-06 2024-09-12T22:32:21.624 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.624 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.624 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:21.624 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.412066+0000", 2024-09-12T22:32:21.624 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.011354797999999999 2024-09-12T22:32:21.624 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.624 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.624 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:21.624 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.412672+0000", 2024-09-12T22:32:21.624 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00060620499999999996 2024-09-12T22:32:21.625 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.625 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.625 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:21.625 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.413032+0000", 2024-09-12T22:32:21.625 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00035955999999999998 2024-09-12T22:32:21.625 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.625 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.625 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op_commit", 2024-09-12T22:32:21.625 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417252+0000", 2024-09-12T22:32:21.625 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.004219899 2024-09-12T22:32:21.625 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.625 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.625 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:21.626 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417812+0000", 2024-09-12T22:32:21.626 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.000560182 2024-09-12T22:32:21.626 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.626 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.626 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:21.626 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417851+0000", 2024-09-12T22:32:21.626 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.9057999999999998e-05 2024-09-12T22:32:21.626 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.626 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.626 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:21.626 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417882+0000", 2024-09-12T22:32:21.626 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.1618000000000001e-05 2024-09-12T22:32:21.627 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:21.627 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:21.628 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:21.628 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.628 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.628 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:21.628 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.400674+0000", 2024-09-12T22:32:21.628 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 44.217161144999999, 2024-09-12T22:32:21.628 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.017348971000000001, 2024-09-12T22:32:21.628 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:21.628 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:21.628 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:21.628 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:21.628 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.629 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:21.629 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400674+0000", 2024-09-12T22:32:21.629 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:21.629 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.629 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.629 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:21.629 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400674+0000", 2024-09-12T22:32:21.629 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:21.629 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.629 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.629 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:21.629 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400675+0000", 2024-09-12T22:32:21.629 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.37e-07 2024-09-12T22:32:21.630 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.630 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.630 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:21.630 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400678+0000", 2024-09-12T22:32:21.630 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.303e-06 2024-09-12T22:32:21.630 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.630 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.630 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:21.630 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400684+0000", 2024-09-12T22:32:21.630 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.0290000000000002e-06 2024-09-12T22:32:21.630 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.630 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.630 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:21.631 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400688+0000", 2024-09-12T22:32:21.631 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.0890000000000002e-06 2024-09-12T22:32:21.631 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.631 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.631 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:21.631 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400806+0000", 2024-09-12T22:32:21.631 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00011814700000000001 2024-09-12T22:32:21.631 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.631 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.631 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:32:21.631 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400811+0000", 2024-09-12T22:32:21.631 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.0479999999999998e-06 2024-09-12T22:32:21.631 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.632 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.632 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:21.632 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.413877+0000", 2024-09-12T22:32:21.632 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.013065561 2024-09-12T22:32:21.632 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.632 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.632 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:21.632 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.413984+0000", 2024-09-12T22:32:21.632 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.000106566 2024-09-12T22:32:21.632 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.632 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.632 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:21.633 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.414264+0000", 2024-09-12T22:32:21.633 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00028067199999999999 2024-09-12T22:32:21.633 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.633 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.633 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op_commit", 2024-09-12T22:32:21.633 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417614+0000", 2024-09-12T22:32:21.633 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0033500729999999999 2024-09-12T22:32:21.633 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.633 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.633 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:21.633 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417946+0000", 2024-09-12T22:32:21.633 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00033209199999999998 2024-09-12T22:32:21.633 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.633 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.634 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:21.634 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417995+0000", 2024-09-12T22:32:21.634 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.808e-05 2024-09-12T22:32:21.634 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.634 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.634 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:21.634 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.418023+0000", 2024-09-12T22:32:21.634 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.8773999999999999e-05 2024-09-12T22:32:21.634 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:21.634 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:21.634 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:21.634 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.634 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.635 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:21.635 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.400694+0000", 2024-09-12T22:32:21.635 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 44.217141515999998, 2024-09-12T22:32:21.635 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.022845628, 2024-09-12T22:32:21.637 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:21.637 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:21.637 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:21.637 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:21.637 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.637 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:21.637 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400694+0000", 2024-09-12T22:32:21.638 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:21.638 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.638 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.638 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:21.638 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400694+0000", 2024-09-12T22:32:21.638 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:21.638 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.638 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.638 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:21.638 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400694+0000", 2024-09-12T22:32:21.639 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.48e-07 2024-09-12T22:32:21.639 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.639 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.639 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:21.639 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400709+0000", 2024-09-12T22:32:21.639 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.4888999999999999e-05 2024-09-12T22:32:21.639 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.639 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.639 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:21.639 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400722+0000", 2024-09-12T22:32:21.640 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.2882e-05 2024-09-12T22:32:21.640 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.640 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.640 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:21.640 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400732+0000", 2024-09-12T22:32:21.640 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.0299000000000001e-05 2024-09-12T22:32:21.640 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.640 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.640 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:21.640 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400793+0000", 2024-09-12T22:32:21.640 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.0253000000000001e-05 2024-09-12T22:32:21.640 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.640 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.641 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op must wait for map", 2024-09-12T22:32:21.641 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400798+0000", 2024-09-12T22:32:21.641 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.1569999999999999e-06 2024-09-12T22:32:21.641 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.641 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.641 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:21.641 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415059+0000", 2024-09-12T22:32:21.641 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.014260907 2024-09-12T22:32:21.641 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.641 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.641 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:21.641 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415396+0000", 2024-09-12T22:32:21.642 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00033720799999999997 2024-09-12T22:32:21.642 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.642 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.642 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:21.642 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415685+0000", 2024-09-12T22:32:21.642 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00028939900000000003 2024-09-12T22:32:21.642 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.642 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.642 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op_commit", 2024-09-12T22:32:21.642 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.418302+0000", 2024-09-12T22:32:21.642 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0026168039999999999 2024-09-12T22:32:21.642 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.642 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.643 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:21.643 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.423445+0000", 2024-09-12T22:32:21.643 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0051428150000000002 2024-09-12T22:32:21.643 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.643 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.643 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:21.643 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.423499+0000", 2024-09-12T22:32:21.643 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.3953000000000003e-05 2024-09-12T22:32:21.643 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.643 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.643 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:21.643 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.423540+0000", 2024-09-12T22:32:21.643 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.0813999999999999e-05 2024-09-12T22:32:21.644 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:21.644 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:21.644 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:21.644 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.644 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.644 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:21.644 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.400740+0000", 2024-09-12T22:32:21.644 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 44.217095792999999, 2024-09-12T22:32:21.644 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.022927528999999999, 2024-09-12T22:32:21.644 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:21.644 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:21.644 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:21.644 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:21.644 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.645 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:21.645 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400740+0000", 2024-09-12T22:32:21.645 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:21.645 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.645 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.645 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:21.645 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400740+0000", 2024-09-12T22:32:21.645 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:21.645 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.645 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.645 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:21.645 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400740+0000", 2024-09-12T22:32:21.645 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.3000000000000001e-07 2024-09-12T22:32:21.646 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.646 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.646 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:21.646 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400743+0000", 2024-09-12T22:32:21.646 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.5840000000000002e-06 2024-09-12T22:32:21.646 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.646 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.646 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:21.646 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400757+0000", 2024-09-12T22:32:21.646 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.3988999999999999e-05 2024-09-12T22:32:21.646 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.646 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.646 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:21.646 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400763+0000", 2024-09-12T22:32:21.647 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.686e-06 2024-09-12T22:32:21.647 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.647 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.647 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:21.647 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400818+0000", 2024-09-12T22:32:21.647 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.4941000000000001e-05 2024-09-12T22:32:21.647 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.647 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.647 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:32:21.647 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400824+0000", 2024-09-12T22:32:21.647 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.4600000000000002e-06 2024-09-12T22:32:21.647 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.647 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.647 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:21.647 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416227+0000", 2024-09-12T22:32:21.648 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.015403604 2024-09-12T22:32:21.648 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.648 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.648 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:21.648 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416306+0000", 2024-09-12T22:32:21.648 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 7.9126000000000001e-05 2024-09-12T22:32:21.648 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.648 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.648 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:21.648 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416678+0000", 2024-09-12T22:32:21.648 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00037105500000000002 2024-09-12T22:32:21.648 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.648 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.649 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op_commit", 2024-09-12T22:32:21.649 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.418363+0000", 2024-09-12T22:32:21.649 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.001685095 2024-09-12T22:32:21.649 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.649 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.649 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:21.649 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.423591+0000", 2024-09-12T22:32:21.649 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0052283980000000004 2024-09-12T22:32:21.649 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.649 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.649 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:21.649 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.423624+0000", 2024-09-12T22:32:21.649 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.3024000000000001e-05 2024-09-12T22:32:21.650 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.650 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.650 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:21.650 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.423667+0000", 2024-09-12T22:32:21.650 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.3136999999999997e-05 2024-09-12T22:32:21.650 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:21.650 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:21.650 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:21.650 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.650 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.650 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:21.650 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.400783+0000", 2024-09-12T22:32:21.650 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 44.217052260999999, 2024-09-12T22:32:21.651 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.016563729999999999, 2024-09-12T22:32:21.651 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:21.651 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:21.651 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:21.651 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:21.651 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.651 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:21.651 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400783+0000", 2024-09-12T22:32:21.651 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:21.651 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.651 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.651 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:21.651 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400783+0000", 2024-09-12T22:32:21.651 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:21.652 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.652 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.652 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:21.652 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400784+0000", 2024-09-12T22:32:21.652 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.5900000000000002e-07 2024-09-12T22:32:21.652 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.652 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.652 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:21.652 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400787+0000", 2024-09-12T22:32:21.652 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.1690000000000001e-06 2024-09-12T22:32:21.652 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.652 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.652 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:21.653 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400794+0000", 2024-09-12T22:32:21.653 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 7.058e-06 2024-09-12T22:32:21.653 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.653 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.653 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:21.653 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400798+0000", 2024-09-12T22:32:21.653 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.335e-06 2024-09-12T22:32:21.653 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.653 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.653 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:21.653 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400841+0000", 2024-09-12T22:32:21.653 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.2369e-05 2024-09-12T22:32:21.653 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.654 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.654 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op must wait for map", 2024-09-12T22:32:21.654 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400844+0000", 2024-09-12T22:32:21.654 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.128e-06 2024-09-12T22:32:21.654 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.654 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.654 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:21.654 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.410479+0000", 2024-09-12T22:32:21.654 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0096354189999999992 2024-09-12T22:32:21.654 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.654 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.654 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:21.654 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.410597+0000", 2024-09-12T22:32:21.654 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.000118305 2024-09-12T22:32:21.655 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.655 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.655 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:21.655 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.410838+0000", 2024-09-12T22:32:21.655 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.000240967 2024-09-12T22:32:21.655 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.655 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.655 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op_commit", 2024-09-12T22:32:21.655 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416489+0000", 2024-09-12T22:32:21.655 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0056507989999999998 2024-09-12T22:32:21.655 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.655 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.655 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:21.655 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417255+0000", 2024-09-12T22:32:21.656 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00076626199999999998 2024-09-12T22:32:21.656 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.656 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.656 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:21.656 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417306+0000", 2024-09-12T22:32:21.656 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.0319999999999999e-05 2024-09-12T22:32:21.656 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.656 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.656 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:21.656 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417347+0000", 2024-09-12T22:32:21.656 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.1140000000000003e-05 2024-09-12T22:32:21.656 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:21.657 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:21.657 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:21.657 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.657 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.657 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:21.657 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.400811+0000", 2024-09-12T22:32:21.657 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 44.217024191999997, 2024-09-12T22:32:21.657 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.017061263, 2024-09-12T22:32:21.657 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:21.657 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:21.657 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:21.657 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:21.657 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.657 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:21.658 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400811+0000", 2024-09-12T22:32:21.658 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:21.658 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.658 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.658 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:21.658 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400811+0000", 2024-09-12T22:32:21.658 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:21.658 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.658 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.658 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:21.658 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400812+0000", 2024-09-12T22:32:21.658 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.27e-07 2024-09-12T22:32:21.658 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.658 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.659 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:21.659 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400814+0000", 2024-09-12T22:32:21.659 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.553e-06 2024-09-12T22:32:21.659 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.659 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.659 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:21.659 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400819+0000", 2024-09-12T22:32:21.659 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.3569999999999997e-06 2024-09-12T22:32:21.659 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.660 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.660 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:21.660 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400824+0000", 2024-09-12T22:32:21.660 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.6820000000000002e-06 2024-09-12T22:32:21.660 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.660 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.660 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:21.660 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400871+0000", 2024-09-12T22:32:21.660 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.7311000000000002e-05 2024-09-12T22:32:21.660 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.660 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.660 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:32:21.660 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400875+0000", 2024-09-12T22:32:21.660 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.0960000000000001e-06 2024-09-12T22:32:21.661 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.661 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.661 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:21.661 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.412071+0000", 2024-09-12T22:32:21.661 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.011195999999999999 2024-09-12T22:32:21.661 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.661 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.661 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:21.661 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.412520+0000", 2024-09-12T22:32:21.661 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.000449522 2024-09-12T22:32:21.661 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.661 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.661 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:21.662 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.412655+0000", 2024-09-12T22:32:21.662 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00013487899999999999 2024-09-12T22:32:21.662 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.662 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.662 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op_commit", 2024-09-12T22:32:21.662 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417096+0000", 2024-09-12T22:32:21.662 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.004441113 2024-09-12T22:32:21.662 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.662 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.662 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:21.662 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417768+0000", 2024-09-12T22:32:21.662 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00067161100000000002 2024-09-12T22:32:21.662 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.663 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.663 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:21.663 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417834+0000", 2024-09-12T22:32:21.663 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.6058999999999999e-05 2024-09-12T22:32:21.663 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.663 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.663 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:21.663 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417873+0000", 2024-09-12T22:32:21.663 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.8753e-05 2024-09-12T22:32:21.663 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:21.663 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:21.663 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:21.663 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.663 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.664 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:21.664 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.400842+0000", 2024-09-12T22:32:21.664 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 44.216993485000003, 2024-09-12T22:32:21.664 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.022846262999999999, 2024-09-12T22:32:21.664 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:21.664 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:21.664 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:21.664 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:21.664 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.664 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:21.664 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400842+0000", 2024-09-12T22:32:21.664 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:21.664 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.665 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.665 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:21.665 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400842+0000", 2024-09-12T22:32:21.665 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:21.665 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.665 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.665 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:21.665 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400842+0000", 2024-09-12T22:32:21.665 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.9900000000000002e-07 2024-09-12T22:32:21.666 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.666 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.666 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:21.666 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400845+0000", 2024-09-12T22:32:21.666 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.8609999999999998e-06 2024-09-12T22:32:21.666 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.666 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.666 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:21.666 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400850+0000", 2024-09-12T22:32:21.666 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.634e-06 2024-09-12T22:32:21.666 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.666 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.666 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:21.667 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400855+0000", 2024-09-12T22:32:21.667 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.8339999999999998e-06 2024-09-12T22:32:21.667 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.667 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.667 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:21.667 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400886+0000", 2024-09-12T22:32:21.667 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.1393999999999998e-05 2024-09-12T22:32:21.667 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.667 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.667 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:32:21.667 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400888+0000", 2024-09-12T22:32:21.667 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.3470000000000001e-06 2024-09-12T22:32:21.667 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.668 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.668 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:21.668 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415640+0000", 2024-09-12T22:32:21.668 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.014751965000000001 2024-09-12T22:32:21.668 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.668 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.668 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:21.668 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415821+0000", 2024-09-12T22:32:21.668 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00018064399999999999 2024-09-12T22:32:21.668 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.668 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.668 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:21.669 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415949+0000", 2024-09-12T22:32:21.669 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00012816699999999999 2024-09-12T22:32:21.669 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.669 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.669 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op_commit", 2024-09-12T22:32:21.669 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.418337+0000", 2024-09-12T22:32:21.669 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0023878469999999998 2024-09-12T22:32:21.669 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.669 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.669 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:21.669 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.423588+0000", 2024-09-12T22:32:21.669 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0052509849999999997 2024-09-12T22:32:21.669 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.670 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.670 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:21.670 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.423650+0000", 2024-09-12T22:32:21.670 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.2026999999999994e-05 2024-09-12T22:32:21.670 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.670 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.670 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:21.670 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.423688+0000", 2024-09-12T22:32:21.670 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.8259000000000001e-05 2024-09-12T22:32:21.670 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:21.670 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:21.670 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:21.670 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.670 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.671 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:21.671 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.400862+0000", 2024-09-12T22:32:21.671 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 44.216973510999999, 2024-09-12T22:32:21.671 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.016404294, 2024-09-12T22:32:21.671 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:21.671 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:21.671 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "started", 2024-09-12T22:32:21.671 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:21.671 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.671 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:21.671 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400862+0000", 2024-09-12T22:32:21.671 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:21.671 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.672 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.672 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:21.672 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400862+0000", 2024-09-12T22:32:21.672 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:21.672 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.672 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.672 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:21.672 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400862+0000", 2024-09-12T22:32:21.672 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.8099999999999999e-07 2024-09-12T22:32:21.672 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.672 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.672 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:21.673 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400870+0000", 2024-09-12T22:32:21.673 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 8.1349999999999992e-06 2024-09-12T22:32:21.673 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.673 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.673 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:21.673 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400876+0000", 2024-09-12T22:32:21.673 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.2039999999999996e-06 2024-09-12T22:32:21.673 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.673 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.673 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:21.673 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400879+0000", 2024-09-12T22:32:21.673 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.529e-06 2024-09-12T22:32:21.673 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.674 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.674 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:21.674 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400912+0000", 2024-09-12T22:32:21.674 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.2653000000000001e-05 2024-09-12T22:32:21.674 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.674 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.674 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op must wait for map", 2024-09-12T22:32:21.674 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400915+0000", 2024-09-12T22:32:21.674 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.1099999999999999e-06 2024-09-12T22:32:21.674 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.675 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.675 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:21.675 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408727+0000", 2024-09-12T22:32:21.675 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0078123869999999996 2024-09-12T22:32:21.675 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.675 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.675 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:21.675 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408838+0000", 2024-09-12T22:32:21.675 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00011042700000000001 2024-09-12T22:32:21.675 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.675 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.675 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:21.675 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417266+0000", 2024-09-12T22:32:21.676 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0084285680000000009 2024-09-12T22:32:21.676 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:21.676 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:21.676 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:21.676 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.676 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.676 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:21.676 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.400889+0000", 2024-09-12T22:32:21.676 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 44.216946258, 2024-09-12T22:32:21.676 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.014929550999999999, 2024-09-12T22:32:21.676 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:21.676 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:21.677 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "started", 2024-09-12T22:32:21.677 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:21.677 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.677 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:21.677 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400889+0000", 2024-09-12T22:32:21.677 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:21.677 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.677 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.677 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:21.677 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400889+0000", 2024-09-12T22:32:21.677 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:21.677 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.677 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.678 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:21.678 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400890+0000", 2024-09-12T22:32:21.678 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.8699999999999995e-07 2024-09-12T22:32:21.678 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.678 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.678 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:21.678 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400893+0000", 2024-09-12T22:32:21.678 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.9569999999999998e-06 2024-09-12T22:32:21.678 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.678 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.678 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:21.678 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400899+0000", 2024-09-12T22:32:21.678 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.4189999999999999e-06 2024-09-12T22:32:21.678 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.679 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.679 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:21.679 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400905+0000", 2024-09-12T22:32:21.679 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.7880000000000003e-06 2024-09-12T22:32:21.679 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.679 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.679 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:21.679 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400943+0000", 2024-09-12T22:32:21.679 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.7852999999999998e-05 2024-09-12T22:32:21.679 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.680 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.680 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op must wait for map", 2024-09-12T22:32:21.680 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400945+0000", 2024-09-12T22:32:21.680 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.627e-06 2024-09-12T22:32:21.680 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.680 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.680 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:21.680 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408398+0000", 2024-09-12T22:32:21.680 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0074525879999999996 2024-09-12T22:32:21.680 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.680 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.680 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:21.680 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408581+0000", 2024-09-12T22:32:21.681 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00018321900000000001 2024-09-12T22:32:21.681 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.681 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.681 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:21.681 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415819+0000", 2024-09-12T22:32:21.681 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0072376130000000004 2024-09-12T22:32:21.681 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:21.681 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:21.681 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:21.681 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.681 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.681 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:25 3.7 e19/17 3:e0b41d06:::609.00000000:head v 19'2, mlcod=0'0)", 2024-09-12T22:32:21.681 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.402511+0000", 2024-09-12T22:32:21.681 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 44.215324115000001, 2024-09-12T22:32:21.682 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0089735260000000008, 2024-09-12T22:32:21.682 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:21.682 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:21.682 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:21.682 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:21.682 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.682 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:21.682 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.402511+0000", 2024-09-12T22:32:21.682 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:21.682 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.682 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.682 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:21.682 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.402511+0000", 2024-09-12T22:32:21.683 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:21.683 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.683 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.683 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:21.683 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.402512+0000", 2024-09-12T22:32:21.683 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 8.71e-07 2024-09-12T22:32:21.683 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.683 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.683 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:21.683 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.402520+0000", 2024-09-12T22:32:21.683 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 7.8529999999999992e-06 2024-09-12T22:32:21.683 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.683 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.683 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:21.684 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.402530+0000", 2024-09-12T22:32:21.684 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 9.859e-06 2024-09-12T22:32:21.684 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.684 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.684 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:21.684 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.402555+0000", 2024-09-12T22:32:21.684 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.4822000000000001e-05 2024-09-12T22:32:21.684 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.684 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.684 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:21.684 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.403173+0000", 2024-09-12T22:32:21.684 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00061813199999999997 2024-09-12T22:32:21.685 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.685 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.685 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:21.685 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.403195+0000", 2024-09-12T22:32:21.685 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.2286e-05 2024-09-12T22:32:21.685 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.685 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.685 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:21.686 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.411436+0000", 2024-09-12T22:32:21.686 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0082410539999999994 2024-09-12T22:32:21.686 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.686 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.686 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:21.686 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.411485+0000", 2024-09-12T22:32:21.686 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.8649000000000001e-05 2024-09-12T22:32:21.686 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:21.686 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:21.686 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:21.686 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.686 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.686 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:18 3.14 e19/17 3:2f55791f:::606.00000000:head v 19'1, mlcod=0'0)", 2024-09-12T22:32:21.686 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.406646+0000", 2024-09-12T22:32:21.687 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 44.211188962999998, 2024-09-12T22:32:21.687 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0082036980000000006, 2024-09-12T22:32:21.687 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:21.687 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:21.687 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:21.687 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:21.687 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.687 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:21.687 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406646+0000", 2024-09-12T22:32:21.687 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:21.687 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.687 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.687 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:21.688 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406646+0000", 2024-09-12T22:32:21.688 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:21.688 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.688 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.688 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:21.688 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406647+0000", 2024-09-12T22:32:21.688 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.4499999999999998e-07 2024-09-12T22:32:21.688 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.688 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.688 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:21.688 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406651+0000", 2024-09-12T22:32:21.688 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.0300000000000004e-06 2024-09-12T22:32:21.688 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.688 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.689 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:21.689 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406657+0000", 2024-09-12T22:32:21.689 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.1330000000000004e-06 2024-09-12T22:32:21.689 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.689 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.689 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:21.689 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406665+0000", 2024-09-12T22:32:21.689 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 8.3650000000000004e-06 2024-09-12T22:32:21.689 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.689 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.689 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:21.689 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406804+0000", 2024-09-12T22:32:21.689 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00013900699999999999 2024-09-12T22:32:21.689 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.690 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.690 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:21.690 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406833+0000", 2024-09-12T22:32:21.690 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.8243e-05 2024-09-12T22:32:21.690 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.690 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.690 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:21.690 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.414741+0000", 2024-09-12T22:32:21.690 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0079089620000000003 2024-09-12T22:32:21.690 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.690 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.690 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:21.690 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.414850+0000", 2024-09-12T22:32:21.690 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.000108713 2024-09-12T22:32:21.691 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:21.691 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:21.691 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:21.691 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.691 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.691 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:6 3.10 e19/17 3:0d82a743:::600.00000000:head v 19'1, mlcod=0'0)", 2024-09-12T22:32:21.691 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.406692+0000", 2024-09-12T22:32:21.691 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 44.211143196000002, 2024-09-12T22:32:21.691 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0093004430000000003, 2024-09-12T22:32:21.691 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:21.691 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:21.691 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:21.691 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:21.691 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.692 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:21.692 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406692+0000", 2024-09-12T22:32:21.692 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:21.692 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.692 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.692 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:21.692 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406692+0000", 2024-09-12T22:32:21.692 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:21.692 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.692 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.692 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:21.692 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406693+0000", 2024-09-12T22:32:21.693 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.6300000000000001e-07 2024-09-12T22:32:21.693 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.693 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.693 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:21.693 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406702+0000", 2024-09-12T22:32:21.693 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 9.5589999999999994e-06 2024-09-12T22:32:21.693 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.693 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.693 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:21.693 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406725+0000", 2024-09-12T22:32:21.693 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.2977999999999999e-05 2024-09-12T22:32:21.693 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.693 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.693 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:21.694 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406732+0000", 2024-09-12T22:32:21.694 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.8430000000000004e-06 2024-09-12T22:32:21.694 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.694 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.694 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:21.694 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406979+0000", 2024-09-12T22:32:21.694 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00024729199999999998 2024-09-12T22:32:21.694 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.694 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.694 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:21.694 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407000+0000", 2024-09-12T22:32:21.694 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.0573000000000001e-05 2024-09-12T22:32:21.694 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.694 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.695 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:21.695 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415928+0000", 2024-09-12T22:32:21.695 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0089286179999999993 2024-09-12T22:32:21.695 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.695 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.695 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:21.695 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415993+0000", 2024-09-12T22:32:21.695 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.4216999999999999e-05 2024-09-12T22:32:21.695 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:21.695 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:21.695 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:21.695 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.695 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.696 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:2 3.f e19/17 3:f1f69726:::400.00000000:head v 19'1, mlcod=0'0)", 2024-09-12T22:32:21.696 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.406942+0000", 2024-09-12T22:32:21.696 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 44.210893509000002, 2024-09-12T22:32:21.696 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0098433259999999995, 2024-09-12T22:32:21.696 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:21.696 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:21.696 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:21.696 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:21.696 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.696 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:21.696 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406942+0000", 2024-09-12T22:32:21.696 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:21.696 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.697 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.697 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:21.697 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406942+0000", 2024-09-12T22:32:21.697 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:21.697 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.697 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.697 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:21.697 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406943+0000", 2024-09-12T22:32:21.697 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.8800000000000002e-07 2024-09-12T22:32:21.697 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.697 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.697 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:21.697 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406949+0000", 2024-09-12T22:32:21.698 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.5869999999999998e-06 2024-09-12T22:32:21.698 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.698 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.698 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:21.698 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406960+0000", 2024-09-12T22:32:21.698 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.0873000000000001e-05 2024-09-12T22:32:21.698 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.698 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.698 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:21.698 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406970+0000", 2024-09-12T22:32:21.698 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 9.9119999999999993e-06 2024-09-12T22:32:21.698 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.698 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.699 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:21.699 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407535+0000", 2024-09-12T22:32:21.699 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00056508899999999996 2024-09-12T22:32:21.699 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.699 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.699 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:21.699 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407556+0000", 2024-09-12T22:32:21.699 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.1348999999999998e-05 2024-09-12T22:32:21.699 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.699 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.699 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:21.699 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416751+0000", 2024-09-12T22:32:21.699 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0091950109999999995 2024-09-12T22:32:21.699 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.700 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.700 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:21.700 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416785+0000", 2024-09-12T22:32:21.700 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.3917000000000001e-05 2024-09-12T22:32:21.700 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:21.700 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:21.700 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:21.700 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.700 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.700 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:19 3.14 e19/17 3:2f55791f:::606.00000000:head v 19'2, mlcod=0'0)", 2024-09-12T22:32:21.700 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.406983+0000", 2024-09-12T22:32:21.700 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 44.210852529999997, 2024-09-12T22:32:21.700 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0080362149999999993, 2024-09-12T22:32:21.700 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:21.701 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:21.701 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:21.701 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:21.701 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.701 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:21.701 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406983+0000", 2024-09-12T22:32:21.701 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:21.701 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.701 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.701 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:21.701 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406983+0000", 2024-09-12T22:32:21.701 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:21.701 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.701 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.702 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:21.702 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406983+0000", 2024-09-12T22:32:21.702 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.8200000000000001e-07 2024-09-12T22:32:21.702 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.702 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.702 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:21.702 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406999+0000", 2024-09-12T22:32:21.702 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.5747999999999999e-05 2024-09-12T22:32:21.702 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.702 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.702 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:21.702 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407006+0000", 2024-09-12T22:32:21.702 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 7.2609999999999996e-06 2024-09-12T22:32:21.703 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.703 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.703 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:21.703 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407035+0000", 2024-09-12T22:32:21.703 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.8214000000000001e-05 2024-09-12T22:32:21.703 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.703 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.703 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:21.703 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407092+0000", 2024-09-12T22:32:21.703 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.7027000000000001e-05 2024-09-12T22:32:21.703 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.703 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.703 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:21.704 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407126+0000", 2024-09-12T22:32:21.704 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.4082000000000003e-05 2024-09-12T22:32:21.704 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.704 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.704 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:21.704 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.414985+0000", 2024-09-12T22:32:21.704 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0078597319999999995 2024-09-12T22:32:21.704 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.704 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.704 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:21.704 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415019+0000", 2024-09-12T22:32:21.704 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.3769000000000001e-05 2024-09-12T22:32:21.704 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:21.704 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:21.705 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:21.705 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.705 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.705 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:7 3.10 e19/17 3:0d82a743:::600.00000000:head v 19'2, mlcod=0'0)", 2024-09-12T22:32:21.705 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.407048+0000", 2024-09-12T22:32:21.705 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 44.210786992000003, 2024-09-12T22:32:21.705 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.008979931, 2024-09-12T22:32:21.705 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:21.705 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:21.705 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:21.705 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:21.705 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.705 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:21.705 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407048+0000", 2024-09-12T22:32:21.706 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:21.706 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.706 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.706 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:21.706 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407048+0000", 2024-09-12T22:32:21.706 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:21.706 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.706 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.706 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:21.706 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407049+0000", 2024-09-12T22:32:21.706 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.9099999999999999e-07 2024-09-12T22:32:21.706 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.706 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.707 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:21.707 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407054+0000", 2024-09-12T22:32:21.707 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.1850000000000003e-06 2024-09-12T22:32:21.707 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.707 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.707 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:21.707 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407061+0000", 2024-09-12T22:32:21.707 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 7.0809999999999996e-06 2024-09-12T22:32:21.707 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.707 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.707 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:21.707 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407067+0000", 2024-09-12T22:32:21.707 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.9540000000000001e-06 2024-09-12T22:32:21.708 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.708 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.708 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:21.708 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407299+0000", 2024-09-12T22:32:21.708 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.000232122 2024-09-12T22:32:21.708 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.708 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.708 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:21.708 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407317+0000", 2024-09-12T22:32:21.708 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.7447000000000001e-05 2024-09-12T22:32:21.708 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.708 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.708 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:21.708 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415996+0000", 2024-09-12T22:32:21.709 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0086791799999999999 2024-09-12T22:32:21.709 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.709 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.709 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:21.709 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416028+0000", 2024-09-12T22:32:21.709 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.2570999999999997e-05 2024-09-12T22:32:21.709 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:21.709 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:21.709 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:21.709 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.709 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.709 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:8 3.10 e19/17 3:09401a81:::601.00000000:head v 19'3, mlcod=0'0)", 2024-09-12T22:32:21.709 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.407081+0000", 2024-09-12T22:32:21.710 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 44.210754301999998, 2024-09-12T22:32:21.710 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0089807270000000008, 2024-09-12T22:32:21.710 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:21.710 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:21.710 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:21.710 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:21.710 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.710 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:21.710 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407081+0000", 2024-09-12T22:32:21.710 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:21.710 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.710 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.710 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:21.710 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407081+0000", 2024-09-12T22:32:21.711 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:21.711 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.711 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.711 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:21.711 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407082+0000", 2024-09-12T22:32:21.711 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.7899999999999999e-07 2024-09-12T22:32:21.711 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.711 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.711 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:21.711 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407086+0000", 2024-09-12T22:32:21.711 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.7679999999999999e-06 2024-09-12T22:32:21.711 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.711 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.711 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:21.712 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407094+0000", 2024-09-12T22:32:21.712 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 8.1470000000000001e-06 2024-09-12T22:32:21.712 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.712 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.712 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:21.712 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407100+0000", 2024-09-12T22:32:21.712 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.4539999999999998e-06 2024-09-12T22:32:21.712 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.712 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.712 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:21.712 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407540+0000", 2024-09-12T22:32:21.712 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00043973699999999999 2024-09-12T22:32:21.713 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.713 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.713 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:21.713 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407553+0000", 2024-09-12T22:32:21.713 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.3368e-05 2024-09-12T22:32:21.713 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.713 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.713 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:21.713 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416032+0000", 2024-09-12T22:32:21.713 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0084793790000000004 2024-09-12T22:32:21.713 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.713 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.713 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:21.714 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416062+0000", 2024-09-12T22:32:21.714 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.9495000000000001e-05 2024-09-12T22:32:21.714 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:21.714 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:21.714 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:21.714 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.714 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.714 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:31 3.d e19/17 3:b50e409b:::mds_snaptable:head v 19'1, mlcod=0'0)", 2024-09-12T22:32:21.714 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.408508+0000", 2024-09-12T22:32:21.714 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 44.209327786000003, 2024-09-12T22:32:21.714 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0080056620000000002, 2024-09-12T22:32:21.714 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:21.714 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:21.715 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:21.715 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:21.715 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.715 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:21.715 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408508+0000", 2024-09-12T22:32:21.715 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:21.715 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.715 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.715 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:21.715 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408508+0000", 2024-09-12T22:32:21.715 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:21.715 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.715 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.716 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:21.716 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408508+0000", 2024-09-12T22:32:21.716 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.7e-07 2024-09-12T22:32:21.716 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.716 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.716 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:21.716 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408515+0000", 2024-09-12T22:32:21.716 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.4439999999999996e-06 2024-09-12T22:32:21.716 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.716 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.716 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:21.716 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408521+0000", 2024-09-12T22:32:21.716 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.2729999999999999e-06 2024-09-12T22:32:21.716 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.717 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.717 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:21.717 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408526+0000", 2024-09-12T22:32:21.717 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.3299999999999998e-06 2024-09-12T22:32:21.717 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.717 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.717 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:21.717 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.410190+0000", 2024-09-12T22:32:21.717 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.001663615 2024-09-12T22:32:21.717 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.717 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.717 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:21.717 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.410258+0000", 2024-09-12T22:32:21.718 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.8146999999999997e-05 2024-09-12T22:32:21.718 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.718 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.718 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:21.718 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416477+0000", 2024-09-12T22:32:21.718 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0062187329999999997 2024-09-12T22:32:21.718 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.718 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.718 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:21.718 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416513+0000", 2024-09-12T22:32:21.718 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.6650000000000003e-05 2024-09-12T22:32:21.718 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:21.718 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:21.718 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:21.719 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.719 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.719 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:9 3.10 e19/17 3:09401a81:::601.00000000:head v 19'4, mlcod=0'0)", 2024-09-12T22:32:21.719 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.408991+0000", 2024-09-12T22:32:21.719 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 44.208844036000002, 2024-09-12T22:32:21.719 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0080459209999999993, 2024-09-12T22:32:21.719 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:21.719 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:21.719 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:21.719 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:21.719 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.719 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:21.719 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408991+0000", 2024-09-12T22:32:21.719 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:21.720 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.720 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.720 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:21.720 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408991+0000", 2024-09-12T22:32:21.720 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:21.720 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.720 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.720 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:21.720 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408992+0000", 2024-09-12T22:32:21.720 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.1799999999999995e-07 2024-09-12T22:32:21.720 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.720 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.720 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:21.721 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409005+0000", 2024-09-12T22:32:21.721 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.261e-05 2024-09-12T22:32:21.721 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.721 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.721 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:21.721 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409015+0000", 2024-09-12T22:32:21.721 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.0001e-05 2024-09-12T22:32:21.721 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.721 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.721 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:21.721 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409023+0000", 2024-09-12T22:32:21.721 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 8.7569999999999993e-06 2024-09-12T22:32:21.721 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.721 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.721 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:21.722 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.411355+0000", 2024-09-12T22:32:21.722 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0023313520000000001 2024-09-12T22:32:21.722 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.722 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.722 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:21.722 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.411374+0000", 2024-09-12T22:32:21.722 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.8810000000000001e-05 2024-09-12T22:32:21.722 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.722 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.722 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:21.722 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416994+0000", 2024-09-12T22:32:21.722 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.005620524 2024-09-12T22:32:21.722 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.722 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.723 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:21.723 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417037+0000", 2024-09-12T22:32:21.723 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.3248999999999999e-05 2024-09-12T22:32:21.723 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:21.723 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:21.723 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:21.723 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.723 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.723 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:10 3.10 e19/17 3:0bd6d154:::602.00000000:head v 19'5, mlcod=0'0)", 2024-09-12T22:32:21.723 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.409038+0000", 2024-09-12T22:32:21.723 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 44.208797361000002, 2024-09-12T22:32:21.723 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0080541689999999999, 2024-09-12T22:32:21.723 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:21.723 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:21.724 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:21.724 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:21.724 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.724 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:21.724 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409038+0000", 2024-09-12T22:32:21.724 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:21.724 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.724 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.724 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:21.724 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409038+0000", 2024-09-12T22:32:21.724 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:21.724 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.724 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.724 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:21.725 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409038+0000", 2024-09-12T22:32:21.725 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.7899999999999999e-07 2024-09-12T22:32:21.725 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.725 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.725 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:21.725 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409043+0000", 2024-09-12T22:32:21.725 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.6589999999999998e-06 2024-09-12T22:32:21.725 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.725 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.725 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:21.726 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409050+0000", 2024-09-12T22:32:21.726 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 7.0829999999999998e-06 2024-09-12T22:32:21.726 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.726 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.726 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:21.726 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409058+0000", 2024-09-12T22:32:21.726 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 7.7309999999999993e-06 2024-09-12T22:32:21.726 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.726 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.726 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:21.726 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.411654+0000", 2024-09-12T22:32:21.726 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0025961650000000001 2024-09-12T22:32:21.726 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.727 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.727 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:21.727 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.411671+0000", 2024-09-12T22:32:21.727 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.7356000000000001e-05 2024-09-12T22:32:21.727 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.727 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.727 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:21.727 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417040+0000", 2024-09-12T22:32:21.727 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0053681889999999998 2024-09-12T22:32:21.727 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.727 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.727 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:21.727 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417092+0000", 2024-09-12T22:32:21.727 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.2607e-05 2024-09-12T22:32:21.728 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:21.728 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:21.728 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:21.728 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.728 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.728 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:11 3.10 e19/17 3:0bd6d154:::602.00000000:head v 19'6, mlcod=0'0)", 2024-09-12T22:32:21.728 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.409768+0000", 2024-09-12T22:32:21.728 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 44.208067919999998, 2024-09-12T22:32:21.728 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0074442759999999997, 2024-09-12T22:32:21.728 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:21.728 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:21.728 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:21.729 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:21.729 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.729 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:21.729 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409768+0000", 2024-09-12T22:32:21.729 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:21.729 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.729 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.729 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:21.729 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409768+0000", 2024-09-12T22:32:21.729 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:21.729 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.729 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.729 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:21.730 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409768+0000", 2024-09-12T22:32:21.730 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.37e-07 2024-09-12T22:32:21.730 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.730 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.730 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:21.730 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409775+0000", 2024-09-12T22:32:21.730 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.4670000000000001e-06 2024-09-12T22:32:21.730 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.730 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.730 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:21.730 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409793+0000", 2024-09-12T22:32:21.730 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.8162e-05 2024-09-12T22:32:21.730 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.730 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.731 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:21.731 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409954+0000", 2024-09-12T22:32:21.731 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00016072999999999999 2024-09-12T22:32:21.731 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.731 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.731 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:21.731 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.411943+0000", 2024-09-12T22:32:21.731 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0019897069999999998 2024-09-12T22:32:21.731 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.731 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.731 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:21.731 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.412069+0000", 2024-09-12T22:32:21.731 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00012546200000000001 2024-09-12T22:32:21.731 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.732 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.732 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:21.732 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417114+0000", 2024-09-12T22:32:21.732 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.005045023 2024-09-12T22:32:21.732 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:21.732 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:21.732 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:21.732 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417212+0000", 2024-09-12T22:32:21.732 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 9.8088e-05 2024-09-12T22:32:21.732 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:21.732 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:21.732 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:21.732 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:21.733 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:21.733 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-09-12T22:32:21.734 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:21.733+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:21.734 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:32:21.834 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:32:21.833+0000 7fddec6a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30331) UID: 0 2024-09-12T22:32:21.849 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:32:21.850 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:32:21.850 INFO:teuthology.orchestra.run.smithi148.stdout: "num_ops": 0 2024-09-12T22:32:21.850 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:32:21.859 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:32:21.935 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:32:21.934+0000 7fddec6a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30331) UID: 0 2024-09-12T22:32:21.961 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:32:21.961 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:32:21.961 INFO:teuthology.orchestra.run.smithi148.stdout: "complaint_time": 30, 2024-09-12T22:32:21.961 INFO:teuthology.orchestra.run.smithi148.stdout: "num_blocked_ops": 0 2024-09-12T22:32:21.961 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:32:21.970 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:32:22.036 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:32:22.035+0000 7fddec6a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30331) UID: 0 2024-09-12T22:32:22.077 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T22:32:22.078 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:32:22.079 INFO:teuthology.orchestra.run.smithi148.stdout: "size": 20, 2024-09-12T22:32:22.079 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 600, 2024-09-12T22:32:22.079 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [ 2024-09-12T22:32:22.080 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.080 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:22.080 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.400880+0000", 2024-09-12T22:32:22.080 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 44.673039447000001, 2024-09-12T22:32:22.080 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0095133660000000005, 2024-09-12T22:32:22.080 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:22.080 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:22.080 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:22.080 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:22.081 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.081 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:22.081 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400880+0000", 2024-09-12T22:32:22.081 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:22.081 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.081 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.081 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:22.081 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400880+0000", 2024-09-12T22:32:22.081 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:22.081 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.082 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.082 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:22.082 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400892+0000", 2024-09-12T22:32:22.082 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1941e-05 2024-09-12T22:32:22.082 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.082 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.082 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:22.082 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400900+0000", 2024-09-12T22:32:22.082 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0080000000000002e-06 2024-09-12T22:32:22.082 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.082 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.083 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:22.083 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400911+0000", 2024-09-12T22:32:22.083 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1452e-05 2024-09-12T22:32:22.083 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.083 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.083 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:22.083 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400922+0000", 2024-09-12T22:32:22.083 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0772e-05 2024-09-12T22:32:22.083 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.083 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.083 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:22.084 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401009+0000", 2024-09-12T22:32:22.084 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.7206000000000005e-05 2024-09-12T22:32:22.084 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.084 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.084 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:22.084 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401157+0000", 2024-09-12T22:32:22.084 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014831499999999999 2024-09-12T22:32:22.084 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.084 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.085 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:22.085 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401312+0000", 2024-09-12T22:32:22.085 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00015495600000000001 2024-09-12T22:32:22.085 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.085 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.085 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:22.085 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.403060+0000", 2024-09-12T22:32:22.085 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0017475220000000001 2024-09-12T22:32:22.085 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.085 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.085 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:22.086 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410300+0000", 2024-09-12T22:32:22.086 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0072403260000000001 2024-09-12T22:32:22.086 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.086 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.086 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:22.086 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410350+0000", 2024-09-12T22:32:22.086 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9814000000000001e-05 2024-09-12T22:32:22.086 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.086 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.086 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:22.086 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410393+0000", 2024-09-12T22:32:22.087 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3053999999999998e-05 2024-09-12T22:32:22.087 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:22.087 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:22.087 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:22.087 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.087 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.087 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:22.087 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.400952+0000", 2024-09-12T22:32:22.087 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 44.672967294999999, 2024-09-12T22:32:22.087 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0096045620000000005, 2024-09-12T22:32:22.087 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:22.088 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:22.088 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:22.088 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:22.088 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.088 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:22.088 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400952+0000", 2024-09-12T22:32:22.088 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:22.088 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.088 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.088 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:22.088 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400952+0000", 2024-09-12T22:32:22.089 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:22.089 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.089 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.089 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:22.089 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400953+0000", 2024-09-12T22:32:22.089 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.8000000000000005e-07 2024-09-12T22:32:22.089 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.089 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.089 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:22.089 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400957+0000", 2024-09-12T22:32:22.089 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.33e-06 2024-09-12T22:32:22.090 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.090 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.090 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:22.090 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400966+0000", 2024-09-12T22:32:22.090 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1989999999999995e-06 2024-09-12T22:32:22.090 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.090 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.090 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:22.090 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400973+0000", 2024-09-12T22:32:22.090 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2779999999999999e-06 2024-09-12T22:32:22.090 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.091 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.091 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:22.091 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401696+0000", 2024-09-12T22:32:22.091 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00072363500000000003 2024-09-12T22:32:22.091 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.091 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.091 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:22.091 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401788+0000", 2024-09-12T22:32:22.091 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1862999999999998e-05 2024-09-12T22:32:22.091 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.091 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.091 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:22.091 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401929+0000", 2024-09-12T22:32:22.092 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014096000000000001 2024-09-12T22:32:22.092 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.092 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.092 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:22.092 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.403542+0000", 2024-09-12T22:32:22.092 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001612963 2024-09-12T22:32:22.092 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.092 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.092 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:22.092 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410460+0000", 2024-09-12T22:32:22.092 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0069180500000000002 2024-09-12T22:32:22.092 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.092 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.093 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:22.093 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410515+0000", 2024-09-12T22:32:22.093 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5009000000000001e-05 2024-09-12T22:32:22.093 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.093 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.093 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:22.093 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410557+0000", 2024-09-12T22:32:22.093 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1495000000000002e-05 2024-09-12T22:32:22.093 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:22.093 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:22.093 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:22.093 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.093 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.093 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:22.094 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.400984+0000", 2024-09-12T22:32:22.094 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 44.6729348, 2024-09-12T22:32:22.094 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0073703950000000001, 2024-09-12T22:32:22.094 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:22.094 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:22.094 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:22.094 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:22.095 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.095 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:22.095 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400984+0000", 2024-09-12T22:32:22.095 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:22.095 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.095 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.096 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:22.096 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400984+0000", 2024-09-12T22:32:22.096 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:22.096 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.096 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.097 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:22.097 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400985+0000", 2024-09-12T22:32:22.097 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3200000000000005e-07 2024-09-12T22:32:22.097 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.097 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.098 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:22.098 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400998+0000", 2024-09-12T22:32:22.098 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2726e-05 2024-09-12T22:32:22.098 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.098 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.099 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:22.099 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401006+0000", 2024-09-12T22:32:22.099 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.3110000000000006e-06 2024-09-12T22:32:22.099 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.100 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.100 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:22.100 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401022+0000", 2024-09-12T22:32:22.100 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6249e-05 2024-09-12T22:32:22.101 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.101 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.101 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:22.101 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401700+0000", 2024-09-12T22:32:22.102 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00067811100000000001 2024-09-12T22:32:22.102 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.102 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.102 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:22.102 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401839+0000", 2024-09-12T22:32:22.103 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013865399999999999 2024-09-12T22:32:22.103 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.103 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.103 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:22.104 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401962+0000", 2024-09-12T22:32:22.104 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000123266 2024-09-12T22:32:22.104 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.104 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.105 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:22.105 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.403589+0000", 2024-09-12T22:32:22.105 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001626932 2024-09-12T22:32:22.105 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.105 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.106 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:22.106 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.408274+0000", 2024-09-12T22:32:22.106 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0046848100000000002 2024-09-12T22:32:22.106 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.107 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.107 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:22.107 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.408324+0000", 2024-09-12T22:32:22.107 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9784000000000003e-05 2024-09-12T22:32:22.107 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.108 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.108 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:22.108 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.408355+0000", 2024-09-12T22:32:22.108 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.1019999999999998e-05 2024-09-12T22:32:22.108 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:22.109 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:22.109 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:22.109 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.109 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.109 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:22.110 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401034+0000", 2024-09-12T22:32:22.110 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 44.672885360000002, 2024-09-12T22:32:22.110 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011063051000000001, 2024-09-12T22:32:22.110 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:22.111 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:22.111 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:22.111 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:22.111 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.111 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:22.112 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401034+0000", 2024-09-12T22:32:22.112 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:22.112 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.112 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.113 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:22.113 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401034+0000", 2024-09-12T22:32:22.113 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:22.113 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.114 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.114 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:22.114 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401034+0000", 2024-09-12T22:32:22.114 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8899999999999999e-07 2024-09-12T22:32:22.114 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.115 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.115 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:22.115 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401038+0000", 2024-09-12T22:32:22.115 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.523e-06 2024-09-12T22:32:22.115 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.116 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.116 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:22.116 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401046+0000", 2024-09-12T22:32:22.116 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0479999999999999e-06 2024-09-12T22:32:22.117 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.117 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.117 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:22.117 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401051+0000", 2024-09-12T22:32:22.117 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2619999999999998e-06 2024-09-12T22:32:22.118 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.118 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.118 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:22.118 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402270+0000", 2024-09-12T22:32:22.118 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012182429999999999 2024-09-12T22:32:22.118 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.119 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.119 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:22.119 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402325+0000", 2024-09-12T22:32:22.119 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5526999999999999e-05 2024-09-12T22:32:22.119 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.120 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.120 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:22.120 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402403+0000", 2024-09-12T22:32:22.120 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.7559999999999996e-05 2024-09-12T22:32:22.120 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.120 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.121 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:22.121 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.403655+0000", 2024-09-12T22:32:22.121 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012521489999999999 2024-09-12T22:32:22.121 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.121 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.122 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:22.122 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411979+0000", 2024-09-12T22:32:22.122 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0083240420000000002 2024-09-12T22:32:22.122 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.122 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.122 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:22.123 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.412036+0000", 2024-09-12T22:32:22.123 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7639000000000002e-05 2024-09-12T22:32:22.123 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.123 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.123 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:22.123 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.412097+0000", 2024-09-12T22:32:22.124 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0469e-05 2024-09-12T22:32:22.124 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:22.124 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:22.124 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:22.124 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.125 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.125 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:22.125 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401060+0000", 2024-09-12T22:32:22.125 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 44.672859608000003, 2024-09-12T22:32:22.125 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.010030172, 2024-09-12T22:32:22.126 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:22.126 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:22.126 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:22.126 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:22.126 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.126 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:22.126 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401060+0000", 2024-09-12T22:32:22.126 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:22.126 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.126 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.126 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:22.126 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401060+0000", 2024-09-12T22:32:22.127 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:22.127 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.127 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.127 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:22.127 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401060+0000", 2024-09-12T22:32:22.127 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2500000000000001e-07 2024-09-12T22:32:22.127 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.127 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.127 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:22.127 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401063+0000", 2024-09-12T22:32:22.127 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0910000000000001e-06 2024-09-12T22:32:22.127 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.127 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.127 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:22.128 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401070+0000", 2024-09-12T22:32:22.128 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1210000000000001e-06 2024-09-12T22:32:22.128 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.128 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.128 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:22.128 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401076+0000", 2024-09-12T22:32:22.128 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2830000000000001e-06 2024-09-12T22:32:22.128 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.128 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.128 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:22.128 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402288+0000", 2024-09-12T22:32:22.129 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012123699999999999 2024-09-12T22:32:22.129 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.129 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.129 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:22.129 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402359+0000", 2024-09-12T22:32:22.129 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.0988000000000005e-05 2024-09-12T22:32:22.129 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.129 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.129 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:22.129 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402457+0000", 2024-09-12T22:32:22.129 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.7857999999999997e-05 2024-09-12T22:32:22.129 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.130 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.130 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:22.130 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.404395+0000", 2024-09-12T22:32:22.130 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0019380160000000001 2024-09-12T22:32:22.130 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.130 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.130 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:22.130 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410603+0000", 2024-09-12T22:32:22.130 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.006208061 2024-09-12T22:32:22.130 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.130 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.130 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:22.131 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410687+0000", 2024-09-12T22:32:22.131 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.4623000000000006e-05 2024-09-12T22:32:22.131 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.131 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.131 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:22.131 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411090+0000", 2024-09-12T22:32:22.131 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00040233599999999999 2024-09-12T22:32:22.131 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:22.131 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:22.131 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:22.132 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.132 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.132 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:22.132 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401083+0000", 2024-09-12T22:32:22.132 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 44.672836191999998, 2024-09-12T22:32:22.132 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0097591850000000001, 2024-09-12T22:32:22.132 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:22.132 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:22.132 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:22.132 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:22.132 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.133 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:22.133 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401083+0000", 2024-09-12T22:32:22.133 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:22.133 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.133 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.133 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:22.133 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401083+0000", 2024-09-12T22:32:22.133 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:22.133 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.133 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.133 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:22.134 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401084+0000", 2024-09-12T22:32:22.134 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4799999999999999e-07 2024-09-12T22:32:22.134 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.134 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.134 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:22.134 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401088+0000", 2024-09-12T22:32:22.134 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6419999999999998e-06 2024-09-12T22:32:22.134 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.134 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.134 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:22.134 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401094+0000", 2024-09-12T22:32:22.135 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0090000000000004e-06 2024-09-12T22:32:22.135 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.135 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.135 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:22.135 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401108+0000", 2024-09-12T22:32:22.135 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3884e-05 2024-09-12T22:32:22.135 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.135 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.135 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:22.135 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401165+0000", 2024-09-12T22:32:22.135 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.6499000000000002e-05 2024-09-12T22:32:22.135 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.136 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.136 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:22.136 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401261+0000", 2024-09-12T22:32:22.136 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.6872000000000004e-05 2024-09-12T22:32:22.136 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.136 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.136 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:22.136 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401376+0000", 2024-09-12T22:32:22.136 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000114508 2024-09-12T22:32:22.136 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.136 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.137 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:22.137 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402666+0000", 2024-09-12T22:32:22.137 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012901659999999999 2024-09-12T22:32:22.137 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.137 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.137 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:22.137 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410572+0000", 2024-09-12T22:32:22.137 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0079055489999999996 2024-09-12T22:32:22.137 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.137 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.137 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:22.138 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410661+0000", 2024-09-12T22:32:22.138 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.9578000000000002e-05 2024-09-12T22:32:22.138 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.138 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.138 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:22.138 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410842+0000", 2024-09-12T22:32:22.138 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00018102999999999999 2024-09-12T22:32:22.138 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:22.138 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:22.138 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:22.138 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.139 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.139 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:22.139 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401122+0000", 2024-09-12T22:32:22.139 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 44.672797160000002, 2024-09-12T22:32:22.139 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0099122080000000005, 2024-09-12T22:32:22.139 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:22.139 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:22.139 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:32:22.139 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:22.139 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.139 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:22.140 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401122+0000", 2024-09-12T22:32:22.140 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:22.140 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.140 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.140 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:22.140 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401122+0000", 2024-09-12T22:32:22.140 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:22.140 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.140 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.140 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:22.140 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401123+0000", 2024-09-12T22:32:22.141 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2600000000000002e-07 2024-09-12T22:32:22.141 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.141 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.141 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:22.141 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401126+0000", 2024-09-12T22:32:22.141 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.6449999999999998e-06 2024-09-12T22:32:22.141 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.141 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.141 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:22.141 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401133+0000", 2024-09-12T22:32:22.141 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.9890000000000003e-06 2024-09-12T22:32:22.142 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.142 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.142 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:22.142 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401138+0000", 2024-09-12T22:32:22.142 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8060000000000002e-06 2024-09-12T22:32:22.142 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.142 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.142 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:22.142 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401703+0000", 2024-09-12T22:32:22.142 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00056509099999999999 2024-09-12T22:32:22.142 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.142 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.143 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:22.143 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401837+0000", 2024-09-12T22:32:22.143 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013338799999999999 2024-09-12T22:32:22.143 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.143 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.143 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:22.143 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411034+0000", 2024-09-12T22:32:22.143 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.009197663 2024-09-12T22:32:22.143 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:22.143 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:22.143 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:22.143 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.144 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.144 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:22.144 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401158+0000", 2024-09-12T22:32:22.144 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 44.672761381000001, 2024-09-12T22:32:22.144 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.010292437999999999, 2024-09-12T22:32:22.144 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:22.144 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:22.144 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:32:22.144 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:22.144 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.144 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:22.145 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401158+0000", 2024-09-12T22:32:22.145 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:22.145 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.145 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.145 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:22.145 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401158+0000", 2024-09-12T22:32:22.145 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:22.145 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.145 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.145 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:22.145 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401158+0000", 2024-09-12T22:32:22.146 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9699999999999996e-07 2024-09-12T22:32:22.146 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.146 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.146 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:22.146 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401161+0000", 2024-09-12T22:32:22.146 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.7410000000000001e-06 2024-09-12T22:32:22.146 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.146 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.146 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:22.146 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401168+0000", 2024-09-12T22:32:22.146 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.844e-06 2024-09-12T22:32:22.147 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.147 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.147 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:22.147 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401174+0000", 2024-09-12T22:32:22.147 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4700000000000001e-06 2024-09-12T22:32:22.147 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.147 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.147 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:22.147 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402799+0000", 2024-09-12T22:32:22.147 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0016256409999999999 2024-09-12T22:32:22.147 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.147 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.147 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:22.147 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402893+0000", 2024-09-12T22:32:22.148 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.3807999999999994e-05 2024-09-12T22:32:22.148 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.148 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.148 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:22.148 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411450+0000", 2024-09-12T22:32:22.148 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0085573369999999999 2024-09-12T22:32:22.148 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:22.148 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:22.148 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:22.148 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.148 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.148 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:22.148 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401183+0000", 2024-09-12T22:32:22.149 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 44.672736528999998, 2024-09-12T22:32:22.149 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0068597830000000004, 2024-09-12T22:32:22.149 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:22.149 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:22.149 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:32:22.149 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:22.149 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.149 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:22.149 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401183+0000", 2024-09-12T22:32:22.149 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:22.149 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.149 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.149 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:22.150 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401183+0000", 2024-09-12T22:32:22.150 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:22.150 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.150 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.150 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:22.150 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401183+0000", 2024-09-12T22:32:22.150 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.6700000000000003e-07 2024-09-12T22:32:22.150 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.150 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.150 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:22.150 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401186+0000", 2024-09-12T22:32:22.150 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4679999999999999e-06 2024-09-12T22:32:22.150 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.150 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.151 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:22.151 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401192+0000", 2024-09-12T22:32:22.151 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.1519999999999997e-06 2024-09-12T22:32:22.151 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.151 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.151 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:22.151 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401197+0000", 2024-09-12T22:32:22.151 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4669999999999998e-06 2024-09-12T22:32:22.151 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.151 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.151 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:22.151 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401253+0000", 2024-09-12T22:32:22.151 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.6211000000000001e-05 2024-09-12T22:32:22.151 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.152 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.152 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:22.152 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401413+0000", 2024-09-12T22:32:22.152 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00016021399999999999 2024-09-12T22:32:22.152 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.152 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.152 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:22.152 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.408043+0000", 2024-09-12T22:32:22.152 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0066295039999999996 2024-09-12T22:32:22.152 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:22.152 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:22.152 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:22.152 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.152 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.153 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:20 3.1c e19/17 3:3ed09add:::607.00000000:head v 19'1, mlcod=0'0)", 2024-09-12T22:32:22.153 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.409642+0000", 2024-09-12T22:32:22.153 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 44.664277069999997, 2024-09-12T22:32:22.153 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0038816269999999999, 2024-09-12T22:32:22.153 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:22.153 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:22.153 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:22.153 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:22.153 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.153 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:22.153 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409642+0000", 2024-09-12T22:32:22.153 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:22.153 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.154 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.154 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:22.154 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409642+0000", 2024-09-12T22:32:22.154 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:22.154 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.154 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.154 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:22.154 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409642+0000", 2024-09-12T22:32:22.154 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.6899999999999999e-07 2024-09-12T22:32:22.154 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.154 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.154 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:22.154 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409648+0000", 2024-09-12T22:32:22.154 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.49e-06 2024-09-12T22:32:22.155 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.155 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.155 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:22.155 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409656+0000", 2024-09-12T22:32:22.155 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.2949999999999994e-06 2024-09-12T22:32:22.155 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.155 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.155 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:22.155 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409664+0000", 2024-09-12T22:32:22.155 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.1219999999999995e-06 2024-09-12T22:32:22.155 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.155 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.156 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:22.156 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409707+0000", 2024-09-12T22:32:22.156 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2222000000000003e-05 2024-09-12T22:32:22.156 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.156 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.156 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:22.156 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409724+0000", 2024-09-12T22:32:22.156 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7496999999999999e-05 2024-09-12T22:32:22.156 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.156 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.156 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:22.157 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413439+0000", 2024-09-12T22:32:22.157 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00371448 2024-09-12T22:32:22.157 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.157 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.157 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:22.157 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413524+0000", 2024-09-12T22:32:22.157 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.5252000000000003e-05 2024-09-12T22:32:22.157 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:22.157 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:22.157 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:22.157 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.158 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.158 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:28 3.13 e19/17 3:cd5a64a3:::100.00000000:head v 19'1, mlcod=0'0)", 2024-09-12T22:32:22.158 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.409681+0000", 2024-09-12T22:32:22.158 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 44.664238587, 2024-09-12T22:32:22.158 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0038708710000000001, 2024-09-12T22:32:22.158 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:22.158 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:22.158 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:22.158 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:22.159 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.159 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:22.159 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409681+0000", 2024-09-12T22:32:22.159 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:22.159 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.159 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.159 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:22.159 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409681+0000", 2024-09-12T22:32:22.159 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:22.159 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.159 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.160 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:22.160 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409681+0000", 2024-09-12T22:32:22.160 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3000000000000002e-07 2024-09-12T22:32:22.160 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.160 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.160 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:22.160 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409695+0000", 2024-09-12T22:32:22.160 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4313e-05 2024-09-12T22:32:22.160 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.160 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.160 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:22.161 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409703+0000", 2024-09-12T22:32:22.161 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4000000000000003e-06 2024-09-12T22:32:22.161 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.161 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.161 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:22.161 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409708+0000", 2024-09-12T22:32:22.161 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3190000000000002e-06 2024-09-12T22:32:22.161 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.161 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.161 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:22.161 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409875+0000", 2024-09-12T22:32:22.162 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000167329 2024-09-12T22:32:22.162 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.162 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.162 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:22.162 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409892+0000", 2024-09-12T22:32:22.162 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6957999999999999e-05 2024-09-12T22:32:22.162 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.162 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.162 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:22.162 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413457+0000", 2024-09-12T22:32:22.162 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0035651279999999999 2024-09-12T22:32:22.163 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.163 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.163 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:22.163 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413552+0000", 2024-09-12T22:32:22.163 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.4093999999999997e-05 2024-09-12T22:32:22.163 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:22.163 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:22.163 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:22.163 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.163 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.163 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:21 3.1c e19/17 3:3ed09add:::607.00000000:head v 19'2, mlcod=0'0)", 2024-09-12T22:32:22.163 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.409718+0000", 2024-09-12T22:32:22.164 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 44.664200921999999, 2024-09-12T22:32:22.164 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003851883, 2024-09-12T22:32:22.164 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:22.164 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:22.164 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:22.164 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:22.164 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.164 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:22.164 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409718+0000", 2024-09-12T22:32:22.164 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:22.164 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.165 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.165 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:22.165 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409718+0000", 2024-09-12T22:32:22.165 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:22.165 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.165 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.165 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:22.165 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409719+0000", 2024-09-12T22:32:22.165 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.16e-07 2024-09-12T22:32:22.165 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.165 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.166 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:22.166 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409722+0000", 2024-09-12T22:32:22.166 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.692e-06 2024-09-12T22:32:22.166 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.166 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.166 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:22.166 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409729+0000", 2024-09-12T22:32:22.166 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.516e-06 2024-09-12T22:32:22.166 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.166 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.166 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:22.166 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409750+0000", 2024-09-12T22:32:22.167 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1151000000000001e-05 2024-09-12T22:32:22.167 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.167 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.167 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:22.167 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410015+0000", 2024-09-12T22:32:22.167 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00026477599999999999 2024-09-12T22:32:22.167 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.167 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.167 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:22.167 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410104+0000", 2024-09-12T22:32:22.167 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.9586000000000006e-05 2024-09-12T22:32:22.167 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.167 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.168 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:22.168 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413528+0000", 2024-09-12T22:32:22.168 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0034237880000000001 2024-09-12T22:32:22.168 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.168 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.168 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:22.168 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413570+0000", 2024-09-12T22:32:22.168 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2157999999999999e-05 2024-09-12T22:32:22.168 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:22.168 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:22.168 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:22.168 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.168 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.169 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:27 3.13 e19/17 3:c91d4a1d:::mds0_inotable:head v 19'2, mlcod=0'0)", 2024-09-12T22:32:22.169 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.409760+0000", 2024-09-12T22:32:22.169 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 44.664159406000003, 2024-09-12T22:32:22.169 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0039301910000000004, 2024-09-12T22:32:22.169 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:22.169 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:22.169 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:22.169 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:22.169 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.169 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:22.169 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409760+0000", 2024-09-12T22:32:22.170 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:22.170 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.170 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.170 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:22.170 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409760+0000", 2024-09-12T22:32:22.170 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:22.170 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.170 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.170 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:22.170 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409760+0000", 2024-09-12T22:32:22.170 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.39e-07 2024-09-12T22:32:22.171 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.171 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.171 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:22.171 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409765+0000", 2024-09-12T22:32:22.171 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4449999999999998e-06 2024-09-12T22:32:22.171 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.171 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.171 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:22.171 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409771+0000", 2024-09-12T22:32:22.171 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7159999999999997e-06 2024-09-12T22:32:22.171 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.172 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.172 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:22.172 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409778+0000", 2024-09-12T22:32:22.172 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.331e-06 2024-09-12T22:32:22.172 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.172 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.172 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:22.172 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410191+0000", 2024-09-12T22:32:22.172 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00041348300000000003 2024-09-12T22:32:22.172 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.172 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.173 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:22.173 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410211+0000", 2024-09-12T22:32:22.173 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9933999999999999e-05 2024-09-12T22:32:22.173 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.173 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.173 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:22.173 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413638+0000", 2024-09-12T22:32:22.173 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003426854 2024-09-12T22:32:22.173 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.173 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.173 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:22.173 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413690+0000", 2024-09-12T22:32:22.173 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2089000000000002e-05 2024-09-12T22:32:22.173 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:22.174 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:22.174 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:22.174 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.174 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.174 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "pg_update_log_missing_reply(3.b epoch 19/17 rep_tid 4 lcod 19'2)", 2024-09-12T22:32:22.174 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.410060+0000", 2024-09-12T22:32:22.174 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 44.663859741000003, 2024-09-12T22:32:22.174 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00098016500000000007, 2024-09-12T22:32:22.174 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:22.174 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:22.174 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "reached pg", 2024-09-12T22:32:22.174 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:22.174 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.175 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:22.175 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410060+0000", 2024-09-12T22:32:22.175 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:22.175 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.175 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.175 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:22.175 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410060+0000", 2024-09-12T22:32:22.175 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:22.175 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.175 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.175 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:22.175 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410060+0000", 2024-09-12T22:32:22.175 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.8299999999999998e-07 2024-09-12T22:32:22.176 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.176 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.176 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:22.176 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410062+0000", 2024-09-12T22:32:22.176 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5749999999999999e-06 2024-09-12T22:32:22.176 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.176 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.176 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:22.176 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410070+0000", 2024-09-12T22:32:22.176 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.909e-06 2024-09-12T22:32:22.176 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.176 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.176 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:22.176 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410076+0000", 2024-09-12T22:32:22.177 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7049999999999996e-06 2024-09-12T22:32:22.177 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.177 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.177 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:22.177 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410943+0000", 2024-09-12T22:32:22.177 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00086681900000000001 2024-09-12T22:32:22.177 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.177 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.177 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:22.177 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411040+0000", 2024-09-12T22:32:22.177 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.6774000000000006e-05 2024-09-12T22:32:22.177 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:22.177 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:22.178 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:22.178 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.178 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.178 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e19/17 ondisk, result = 0)", 2024-09-12T22:32:22.178 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.410113+0000", 2024-09-12T22:32:22.178 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 44.663806473999998, 2024-09-12T22:32:22.178 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00098911599999999995, 2024-09-12T22:32:22.178 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:22.178 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:22.178 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:32:22.178 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:22.178 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.178 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:22.178 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410113+0000", 2024-09-12T22:32:22.179 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:22.179 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.179 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.179 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:22.179 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410113+0000", 2024-09-12T22:32:22.179 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:22.179 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.179 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.179 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:22.179 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410113+0000", 2024-09-12T22:32:22.179 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.99e-07 2024-09-12T22:32:22.179 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.179 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.179 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:22.180 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410115+0000", 2024-09-12T22:32:22.180 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.046e-06 2024-09-12T22:32:22.180 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.180 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.180 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:22.180 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410121+0000", 2024-09-12T22:32:22.180 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0050000000000001e-06 2024-09-12T22:32:22.180 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.180 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.180 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:22.180 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410126+0000", 2024-09-12T22:32:22.180 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8339999999999998e-06 2024-09-12T22:32:22.180 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.181 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.181 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:22.181 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410587+0000", 2024-09-12T22:32:22.181 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00046095499999999998 2024-09-12T22:32:22.181 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.181 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.181 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:22.181 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410595+0000", 2024-09-12T22:32:22.181 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.9419999999999995e-06 2024-09-12T22:32:22.181 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.181 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.181 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:22.181 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411102+0000", 2024-09-12T22:32:22.181 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00050713500000000003 2024-09-12T22:32:22.182 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:22.182 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:22.182 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:22.182 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.182 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.182 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 19/17 rep_tid 8 lcod 19'4)", 2024-09-12T22:32:22.182 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.410133+0000", 2024-09-12T22:32:22.182 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 44.663786545999997, 2024-09-12T22:32:22.182 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0013504000000000001, 2024-09-12T22:32:22.182 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:22.182 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:22.182 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "reached pg", 2024-09-12T22:32:22.182 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:22.183 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.183 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:22.183 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410133+0000", 2024-09-12T22:32:22.183 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:22.183 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.183 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.183 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:22.183 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410133+0000", 2024-09-12T22:32:22.183 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:22.183 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.183 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.183 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:22.183 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410133+0000", 2024-09-12T22:32:22.183 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.0599999999999999e-07 2024-09-12T22:32:22.184 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.184 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.184 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:22.184 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410135+0000", 2024-09-12T22:32:22.184 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7770000000000001e-06 2024-09-12T22:32:22.184 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.184 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.184 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:22.184 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410140+0000", 2024-09-12T22:32:22.184 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9960000000000001e-06 2024-09-12T22:32:22.184 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.184 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.184 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:22.185 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410144+0000", 2024-09-12T22:32:22.185 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9500000000000003e-06 2024-09-12T22:32:22.185 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.185 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.185 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:22.185 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411310+0000", 2024-09-12T22:32:22.185 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001166311 2024-09-12T22:32:22.185 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.185 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.185 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:22.185 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411483+0000", 2024-09-12T22:32:22.185 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00017316 2024-09-12T22:32:22.185 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:22.186 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:22.186 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:22.186 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.186 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.186 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "pg_update_log_missing(3.1a epoch 19/17 rep_tid 0 entries 19'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T22:32:22.186 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.410617+0000", 2024-09-12T22:32:22.186 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 44.663302151000003, 2024-09-12T22:32:22.186 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0030439709999999999, 2024-09-12T22:32:22.186 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:22.186 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:22.186 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "reached pg", 2024-09-12T22:32:22.187 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:22.187 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.187 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:22.187 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410617+0000", 2024-09-12T22:32:22.187 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:22.187 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.187 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.187 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:22.187 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410617+0000", 2024-09-12T22:32:22.187 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:22.187 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.188 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.188 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:22.188 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410617+0000", 2024-09-12T22:32:22.188 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3599999999999999e-07 2024-09-12T22:32:22.188 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.188 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.188 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:22.188 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410625+0000", 2024-09-12T22:32:22.188 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5410000000000003e-06 2024-09-12T22:32:22.188 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.189 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.189 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:22.189 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410638+0000", 2024-09-12T22:32:22.189 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3261999999999999e-05 2024-09-12T22:32:22.189 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.189 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.189 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:22.189 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410653+0000", 2024-09-12T22:32:22.189 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4844000000000001e-05 2024-09-12T22:32:22.189 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.189 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.189 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:22.190 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410814+0000", 2024-09-12T22:32:22.190 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00016119999999999999 2024-09-12T22:32:22.190 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.190 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.190 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:22.190 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413661+0000", 2024-09-12T22:32:22.190 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0028467879999999998 2024-09-12T22:32:22.190 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:22.190 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:22.190 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:22.190 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.191 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.191 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-09-12T22:32:22.191 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:39.398875+0000", 2024-09-12T22:32:22.191 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 42.675043871, 2024-09-12T22:32:22.191 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0015679069999999999, 2024-09-12T22:32:22.191 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:22.191 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:22.191 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:22.191 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:22.191 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.191 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:22.192 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398875+0000", 2024-09-12T22:32:22.192 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:22.192 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.192 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.192 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:22.192 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398875+0000", 2024-09-12T22:32:22.192 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:22.192 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.192 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.192 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:22.193 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398878+0000", 2024-09-12T22:32:22.193 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1679999999999998e-06 2024-09-12T22:32:22.193 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.193 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.193 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:22.193 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398888+0000", 2024-09-12T22:32:22.193 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.084e-05 2024-09-12T22:32:22.193 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.193 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.193 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:22.193 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398906+0000", 2024-09-12T22:32:22.193 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7518000000000001e-05 2024-09-12T22:32:22.194 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.194 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.194 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:22.194 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398914+0000", 2024-09-12T22:32:22.194 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5989999999999996e-06 2024-09-12T22:32:22.194 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.194 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.194 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:22.194 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398974+0000", 2024-09-12T22:32:22.194 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0988e-05 2024-09-12T22:32:22.194 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.195 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.195 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:22.195 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.399078+0000", 2024-09-12T22:32:22.195 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000103133 2024-09-12T22:32:22.195 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.195 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.195 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:22.195 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.399166+0000", 2024-09-12T22:32:22.195 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.8183999999999995e-05 2024-09-12T22:32:22.195 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.196 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.196 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:22.196 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.399747+0000", 2024-09-12T22:32:22.196 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00058110599999999996 2024-09-12T22:32:22.196 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.196 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.196 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:22.196 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.400377+0000", 2024-09-12T22:32:22.196 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000630157 2024-09-12T22:32:22.196 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.196 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.197 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:22.197 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.400415+0000", 2024-09-12T22:32:22.197 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7814000000000001e-05 2024-09-12T22:32:22.197 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.197 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.197 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:22.197 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.400443+0000", 2024-09-12T22:32:22.197 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8399999999999999e-05 2024-09-12T22:32:22.197 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:22.197 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:22.197 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:22.198 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.198 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.198 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e23)", 2024-09-12T22:32:22.198 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:58.400966+0000", 2024-09-12T22:32:22.198 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 23.672952963, 2024-09-12T22:32:22.198 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001468876, 2024-09-12T22:32:22.198 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:22.198 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:22.198 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:22.198 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:22.198 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.199 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:22.199 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400966+0000", 2024-09-12T22:32:22.199 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:22.199 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.199 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.199 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:22.199 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400966+0000", 2024-09-12T22:32:22.199 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:22.199 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.199 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.199 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:22.199 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400967+0000", 2024-09-12T22:32:22.200 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.046e-06 2024-09-12T22:32:22.200 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.200 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.200 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:22.200 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400974+0000", 2024-09-12T22:32:22.200 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2310000000000001e-06 2024-09-12T22:32:22.200 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.200 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.200 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:22.200 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400988+0000", 2024-09-12T22:32:22.201 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4482e-05 2024-09-12T22:32:22.201 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.201 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.201 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:22.201 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400997+0000", 2024-09-12T22:32:22.201 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.0189999999999995e-06 2024-09-12T22:32:22.201 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.201 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.201 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:22.201 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.401068+0000", 2024-09-12T22:32:22.201 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1426000000000004e-05 2024-09-12T22:32:22.201 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.202 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.202 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:22.202 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.401174+0000", 2024-09-12T22:32:22.202 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000105769 2024-09-12T22:32:22.202 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.202 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.202 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:22.202 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.401335+0000", 2024-09-12T22:32:22.202 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000161225 2024-09-12T22:32:22.202 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.202 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.203 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:22.203 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.402110+0000", 2024-09-12T22:32:22.203 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00077428800000000004 2024-09-12T22:32:22.203 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.203 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.203 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:22.203 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.402333+0000", 2024-09-12T22:32:22.203 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000223723 2024-09-12T22:32:22.203 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.203 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.203 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:22.203 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.402388+0000", 2024-09-12T22:32:22.203 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4700999999999997e-05 2024-09-12T22:32:22.204 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.204 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.204 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:22.204 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.402435+0000", 2024-09-12T22:32:22.204 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6965999999999997e-05 2024-09-12T22:32:22.204 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:22.204 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:22.204 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:22.204 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.204 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.204 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:45 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e27)", 2024-09-12T22:32:22.204 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:32:04.401614+0000", 2024-09-12T22:32:22.205 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 17.672305533999999, 2024-09-12T22:32:22.205 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0014279749999999999, 2024-09-12T22:32:22.205 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:22.205 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:22.205 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:22.205 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:22.205 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.205 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:22.205 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401614+0000", 2024-09-12T22:32:22.205 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:22.205 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.205 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.205 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:22.206 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401614+0000", 2024-09-12T22:32:22.206 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:22.206 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.206 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.206 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:22.206 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401615+0000", 2024-09-12T22:32:22.206 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.161e-06 2024-09-12T22:32:22.206 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.206 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.206 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:22.206 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401621+0000", 2024-09-12T22:32:22.206 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8730000000000004e-06 2024-09-12T22:32:22.206 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.207 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.207 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:22.207 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401633+0000", 2024-09-12T22:32:22.207 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1800000000000001e-05 2024-09-12T22:32:22.207 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.207 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.207 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:22.207 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401656+0000", 2024-09-12T22:32:22.207 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.3521999999999999e-05 2024-09-12T22:32:22.207 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.207 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.207 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:22.207 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401713+0000", 2024-09-12T22:32:22.207 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7259000000000002e-05 2024-09-12T22:32:22.208 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.208 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.208 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:22.208 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401849+0000", 2024-09-12T22:32:22.208 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013613500000000001 2024-09-12T22:32:22.208 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.208 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.208 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:22.208 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.402009+0000", 2024-09-12T22:32:22.208 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00015947199999999999 2024-09-12T22:32:22.208 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.208 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.208 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:22.209 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.402629+0000", 2024-09-12T22:32:22.209 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00061962200000000001 2024-09-12T22:32:22.209 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.209 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.209 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:22.209 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.402983+0000", 2024-09-12T22:32:22.209 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00035447499999999998 2024-09-12T22:32:22.209 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.209 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.209 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:22.209 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.403016+0000", 2024-09-12T22:32:22.209 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3108999999999998e-05 2024-09-12T22:32:22.209 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:22.209 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:22.210 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:22.210 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.403042+0000", 2024-09-12T22:32:22.210 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5547000000000001e-05 2024-09-12T22:32:22.210 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:22.210 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:22.210 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:22.210 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:22.210 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:22.210 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:32:22.211 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-09-12T22:32:22.211 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-12T22:32:22.211 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-09-12T22:32:22.211 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-12T22:32:22.213 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:32:22.209+0000 7fddec6a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30331) UID: 0 2024-09-12T22:32:22.213 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:32:22.310 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T22:32:22.312 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:22.310+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:22.330 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-09-12T22:32:22.330 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-09-12T22:32:22.330 INFO:teuthology.orchestra.run.smithi163.stdout: "num_ops": 0 2024-09-12T22:32:22.330 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-09-12T22:32:22.339 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:32:22.348 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0: {} 2024-09-12T22:32:22.349 INFO:teuthology.orchestra.run.smithi019.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T22:32:22.366 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T22:32:22.367 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:32:22.385 INFO:teuthology.orchestra.run.smithi019.stdout:osd.2: {} 2024-09-12T22:32:22.385 INFO:teuthology.orchestra.run.smithi019.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T22:32:22.413 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:32:22.411+0000 7fddec6a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30331) UID: 0 2024-09-12T22:32:22.444 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:22.444 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:22.452 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:32:22.514 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:22.513+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:22.556 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:22.556 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:22.564 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:32:22.564 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T22:32:22.564 INFO:teuthology.orchestra.run.smithi019.stdout: "epoch": 33, 2024-09-12T22:32:22.564 INFO:teuthology.orchestra.run.smithi019.stdout: "fsid": "957ce235-19cb-4350-8fee-febd6e3f2199", 2024-09-12T22:32:22.564 INFO:teuthology.orchestra.run.smithi019.stdout: "created": "2024-09-12T22:31:15.903133+0000", 2024-09-12T22:32:22.564 INFO:teuthology.orchestra.run.smithi019.stdout: "modified": "2024-09-12T22:32:20.282192+0000", 2024-09-12T22:32:22.564 INFO:teuthology.orchestra.run.smithi019.stdout: "last_up_change": "2024-09-12T22:31:25.209056+0000", 2024-09-12T22:32:22.564 INFO:teuthology.orchestra.run.smithi019.stdout: "last_in_change": "2024-09-12T22:31:16.757598+0000", 2024-09-12T22:32:22.564 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": "noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-12T22:32:22.564 INFO:teuthology.orchestra.run.smithi019.stdout: "flags_num": 5801984, 2024-09-12T22:32:22.565 INFO:teuthology.orchestra.run.smithi019.stdout: "flags_set": [ 2024-09-12T22:32:22.565 INFO:teuthology.orchestra.run.smithi019.stdout: "noscrub", 2024-09-12T22:32:22.565 INFO:teuthology.orchestra.run.smithi019.stdout: "pglog_hardlimit", 2024-09-12T22:32:22.565 INFO:teuthology.orchestra.run.smithi019.stdout: "purged_snapdirs", 2024-09-12T22:32:22.565 INFO:teuthology.orchestra.run.smithi019.stdout: "recovery_deletes", 2024-09-12T22:32:22.565 INFO:teuthology.orchestra.run.smithi019.stdout: "sortbitwise" 2024-09-12T22:32:22.565 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-12T22:32:22.565 INFO:teuthology.orchestra.run.smithi019.stdout: "crush_version": 5, 2024-09-12T22:32:22.565 INFO:teuthology.orchestra.run.smithi019.stdout: "full_ratio": 0.94999998807907104, 2024-09-12T22:32:22.565 INFO:teuthology.orchestra.run.smithi019.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-12T22:32:22.565 INFO:teuthology.orchestra.run.smithi019.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-12T22:32:22.565 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster_snapshot": "", 2024-09-12T22:32:22.566 INFO:teuthology.orchestra.run.smithi019.stdout: "pool_max": 4, 2024-09-12T22:32:22.566 INFO:teuthology.orchestra.run.smithi019.stdout: "max_osd": 3, 2024-09-12T22:32:22.566 INFO:teuthology.orchestra.run.smithi019.stdout: "require_min_compat_client": "luminous", 2024-09-12T22:32:22.566 INFO:teuthology.orchestra.run.smithi019.stdout: "min_compat_client": "jewel", 2024-09-12T22:32:22.566 INFO:teuthology.orchestra.run.smithi019.stdout: "require_osd_release": "squid", 2024-09-12T22:32:22.566 INFO:teuthology.orchestra.run.smithi019.stdout: "allow_crimson": false, 2024-09-12T22:32:22.566 INFO:teuthology.orchestra.run.smithi019.stdout: "pools": [ 2024-09-12T22:32:22.566 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:32:22.566 INFO:teuthology.orchestra.run.smithi019.stdout: "pool": 1, 2024-09-12T22:32:22.566 INFO:teuthology.orchestra.run.smithi019.stdout: "pool_name": ".mgr", 2024-09-12T22:32:22.566 INFO:teuthology.orchestra.run.smithi019.stdout: "create_time": "2024-09-12T22:31:26.228956+0000", 2024-09-12T22:32:22.566 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-12T22:32:22.566 INFO:teuthology.orchestra.run.smithi019.stdout: "flags_names": "hashpspool", 2024-09-12T22:32:22.567 INFO:teuthology.orchestra.run.smithi019.stdout: "type": 1, 2024-09-12T22:32:22.567 INFO:teuthology.orchestra.run.smithi019.stdout: "size": 2, 2024-09-12T22:32:22.567 INFO:teuthology.orchestra.run.smithi019.stdout: "min_size": 1, 2024-09-12T22:32:22.567 INFO:teuthology.orchestra.run.smithi019.stdout: "crush_rule": 0, 2024-09-12T22:32:22.567 INFO:teuthology.orchestra.run.smithi019.stdout: "peering_crush_bucket_count": 0, 2024-09-12T22:32:22.567 INFO:teuthology.orchestra.run.smithi019.stdout: "peering_crush_bucket_target": 0, 2024-09-12T22:32:22.567 INFO:teuthology.orchestra.run.smithi019.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T22:32:22.567 INFO:teuthology.orchestra.run.smithi019.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T22:32:22.567 INFO:teuthology.orchestra.run.smithi019.stdout: "is_stretch_pool": false, 2024-09-12T22:32:22.567 INFO:teuthology.orchestra.run.smithi019.stdout: "object_hash": 2, 2024-09-12T22:32:22.567 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_autoscale_mode": "off", 2024-09-12T22:32:22.568 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_num": 1, 2024-09-12T22:32:22.568 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_placement_num": 1, 2024-09-12T22:32:22.568 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_placement_num_target": 1, 2024-09-12T22:32:22.568 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_num_target": 1, 2024-09-12T22:32:22.568 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_num_pending": 1, 2024-09-12T22:32:22.568 INFO:teuthology.orchestra.run.smithi019.stdout: "last_pg_merge_meta": { 2024-09-12T22:32:22.568 INFO:teuthology.orchestra.run.smithi019.stdout: "source_pgid": "0.0", 2024-09-12T22:32:22.568 INFO:teuthology.orchestra.run.smithi019.stdout: "ready_epoch": 0, 2024-09-12T22:32:22.568 INFO:teuthology.orchestra.run.smithi019.stdout: "last_epoch_started": 0, 2024-09-12T22:32:22.568 INFO:teuthology.orchestra.run.smithi019.stdout: "last_epoch_clean": 0, 2024-09-12T22:32:22.569 INFO:teuthology.orchestra.run.smithi019.stdout: "source_version": "0'0", 2024-09-12T22:32:22.569 INFO:teuthology.orchestra.run.smithi019.stdout: "target_version": "0'0" 2024-09-12T22:32:22.569 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:32:22.569 INFO:teuthology.orchestra.run.smithi019.stdout: "last_change": "12", 2024-09-12T22:32:22.569 INFO:teuthology.orchestra.run.smithi019.stdout: "last_force_op_resend": "0", 2024-09-12T22:32:22.569 INFO:teuthology.orchestra.run.smithi019.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T22:32:22.569 INFO:teuthology.orchestra.run.smithi019.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T22:32:22.569 INFO:teuthology.orchestra.run.smithi019.stdout: "auid": 0, 2024-09-12T22:32:22.569 INFO:teuthology.orchestra.run.smithi019.stdout: "snap_mode": "selfmanaged", 2024-09-12T22:32:22.569 INFO:teuthology.orchestra.run.smithi019.stdout: "snap_seq": 0, 2024-09-12T22:32:22.569 INFO:teuthology.orchestra.run.smithi019.stdout: "snap_epoch": 0, 2024-09-12T22:32:22.570 INFO:teuthology.orchestra.run.smithi019.stdout: "pool_snaps": [], 2024-09-12T22:32:22.570 INFO:teuthology.orchestra.run.smithi019.stdout: "removed_snaps": "[]", 2024-09-12T22:32:22.571 INFO:teuthology.orchestra.run.smithi019.stdout: "quota_max_bytes": 0, 2024-09-12T22:32:22.571 INFO:teuthology.orchestra.run.smithi019.stdout: "quota_max_objects": 0, 2024-09-12T22:32:22.571 INFO:teuthology.orchestra.run.smithi019.stdout: "tiers": [], 2024-09-12T22:32:22.571 INFO:teuthology.orchestra.run.smithi019.stdout: "tier_of": -1, 2024-09-12T22:32:22.571 INFO:teuthology.orchestra.run.smithi019.stdout: "read_tier": -1, 2024-09-12T22:32:22.571 INFO:teuthology.orchestra.run.smithi019.stdout: "write_tier": -1, 2024-09-12T22:32:22.571 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_mode": "none", 2024-09-12T22:32:22.571 INFO:teuthology.orchestra.run.smithi019.stdout: "target_max_bytes": 0, 2024-09-12T22:32:22.571 INFO:teuthology.orchestra.run.smithi019.stdout: "target_max_objects": 0, 2024-09-12T22:32:22.571 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T22:32:22.572 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T22:32:22.572 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T22:32:22.572 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_min_flush_age": 0, 2024-09-12T22:32:22.572 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_min_evict_age": 0, 2024-09-12T22:32:22.572 INFO:teuthology.orchestra.run.smithi019.stdout: "erasure_code_profile": "", 2024-09-12T22:32:22.572 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_params": { 2024-09-12T22:32:22.572 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "none" 2024-09-12T22:32:22.572 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:32:22.572 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_period": 0, 2024-09-12T22:32:22.572 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_count": 0, 2024-09-12T22:32:22.573 INFO:teuthology.orchestra.run.smithi019.stdout: "use_gmt_hitset": true, 2024-09-12T22:32:22.573 INFO:teuthology.orchestra.run.smithi019.stdout: "min_read_recency_for_promote": 0, 2024-09-12T22:32:22.573 INFO:teuthology.orchestra.run.smithi019.stdout: "min_write_recency_for_promote": 0, 2024-09-12T22:32:22.573 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T22:32:22.573 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_search_last_n": 0, 2024-09-12T22:32:22.573 INFO:teuthology.orchestra.run.smithi019.stdout: "grade_table": [], 2024-09-12T22:32:22.573 INFO:teuthology.orchestra.run.smithi019.stdout: "stripe_width": 0, 2024-09-12T22:32:22.573 INFO:teuthology.orchestra.run.smithi019.stdout: "expected_num_objects": 0, 2024-09-12T22:32:22.573 INFO:teuthology.orchestra.run.smithi019.stdout: "fast_read": false, 2024-09-12T22:32:22.573 INFO:teuthology.orchestra.run.smithi019.stdout: "options": { 2024-09-12T22:32:22.573 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_num_max": 32, 2024-09-12T22:32:22.574 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_num_min": 1 2024-09-12T22:32:22.574 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:32:22.574 INFO:teuthology.orchestra.run.smithi019.stdout: "application_metadata": { 2024-09-12T22:32:22.574 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": {} 2024-09-12T22:32:22.574 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:32:22.574 INFO:teuthology.orchestra.run.smithi019.stdout: "read_balance": { 2024-09-12T22:32:22.574 INFO:teuthology.orchestra.run.smithi019.stdout: "score_type": "Fair distribution", 2024-09-12T22:32:22.574 INFO:teuthology.orchestra.run.smithi019.stdout: "score_acting": 2.9900000095367432, 2024-09-12T22:32:22.574 INFO:teuthology.orchestra.run.smithi019.stdout: "score_stable": 2.9900000095367432, 2024-09-12T22:32:22.575 INFO:teuthology.orchestra.run.smithi019.stdout: "optimal_score": 0.67000001668930054, 2024-09-12T22:32:22.575 INFO:teuthology.orchestra.run.smithi019.stdout: "raw_score_acting": 2, 2024-09-12T22:32:22.575 INFO:teuthology.orchestra.run.smithi019.stdout: "raw_score_stable": 2, 2024-09-12T22:32:22.575 INFO:teuthology.orchestra.run.smithi019.stdout: "primary_affinity_weighted": 0.84509789943695068, 2024-09-12T22:32:22.575 INFO:teuthology.orchestra.run.smithi019.stdout: "average_primary_affinity": 0.85000002384185791, 2024-09-12T22:32:22.575 INFO:teuthology.orchestra.run.smithi019.stdout: "average_primary_affinity_weighted": 0.85000002384185791 2024-09-12T22:32:22.575 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T22:32:22.575 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:32:22.575 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:32:22.575 INFO:teuthology.orchestra.run.smithi019.stdout: "pool": 2, 2024-09-12T22:32:22.575 INFO:teuthology.orchestra.run.smithi019.stdout: "pool_name": "rbd", 2024-09-12T22:32:22.576 INFO:teuthology.orchestra.run.smithi019.stdout: "create_time": "2024-09-12T22:31:30.975989+0000", 2024-09-12T22:32:22.576 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 8193, 2024-09-12T22:32:22.576 INFO:teuthology.orchestra.run.smithi019.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-12T22:32:22.576 INFO:teuthology.orchestra.run.smithi019.stdout: "type": 1, 2024-09-12T22:32:22.576 INFO:teuthology.orchestra.run.smithi019.stdout: "size": 2, 2024-09-12T22:32:22.576 INFO:teuthology.orchestra.run.smithi019.stdout: "min_size": 1, 2024-09-12T22:32:22.576 INFO:teuthology.orchestra.run.smithi019.stdout: "crush_rule": 0, 2024-09-12T22:32:22.577 INFO:teuthology.orchestra.run.smithi019.stdout: "peering_crush_bucket_count": 0, 2024-09-12T22:32:22.577 INFO:teuthology.orchestra.run.smithi019.stdout: "peering_crush_bucket_target": 0, 2024-09-12T22:32:22.577 INFO:teuthology.orchestra.run.smithi019.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T22:32:22.577 INFO:teuthology.orchestra.run.smithi019.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T22:32:22.577 INFO:teuthology.orchestra.run.smithi019.stdout: "is_stretch_pool": false, 2024-09-12T22:32:22.577 INFO:teuthology.orchestra.run.smithi019.stdout: "object_hash": 2, 2024-09-12T22:32:22.577 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_autoscale_mode": "off", 2024-09-12T22:32:22.577 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_num": 8, 2024-09-12T22:32:22.577 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_placement_num": 8, 2024-09-12T22:32:22.578 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_placement_num_target": 8, 2024-09-12T22:32:22.578 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_num_target": 8, 2024-09-12T22:32:22.578 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_num_pending": 8, 2024-09-12T22:32:22.578 INFO:teuthology.orchestra.run.smithi019.stdout: "last_pg_merge_meta": { 2024-09-12T22:32:22.578 INFO:teuthology.orchestra.run.smithi019.stdout: "source_pgid": "0.0", 2024-09-12T22:32:22.578 INFO:teuthology.orchestra.run.smithi019.stdout: "ready_epoch": 0, 2024-09-12T22:32:22.578 INFO:teuthology.orchestra.run.smithi019.stdout: "last_epoch_started": 0, 2024-09-12T22:32:22.578 INFO:teuthology.orchestra.run.smithi019.stdout: "last_epoch_clean": 0, 2024-09-12T22:32:22.578 INFO:teuthology.orchestra.run.smithi019.stdout: "source_version": "0'0", 2024-09-12T22:32:22.578 INFO:teuthology.orchestra.run.smithi019.stdout: "target_version": "0'0" 2024-09-12T22:32:22.578 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:32:22.578 INFO:teuthology.orchestra.run.smithi019.stdout: "last_change": "16", 2024-09-12T22:32:22.578 INFO:teuthology.orchestra.run.smithi019.stdout: "last_force_op_resend": "0", 2024-09-12T22:32:22.579 INFO:teuthology.orchestra.run.smithi019.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T22:32:22.579 INFO:teuthology.orchestra.run.smithi019.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T22:32:22.579 INFO:teuthology.orchestra.run.smithi019.stdout: "auid": 0, 2024-09-12T22:32:22.579 INFO:teuthology.orchestra.run.smithi019.stdout: "snap_mode": "selfmanaged", 2024-09-12T22:32:22.579 INFO:teuthology.orchestra.run.smithi019.stdout: "snap_seq": 2, 2024-09-12T22:32:22.579 INFO:teuthology.orchestra.run.smithi019.stdout: "snap_epoch": 16, 2024-09-12T22:32:22.579 INFO:teuthology.orchestra.run.smithi019.stdout: "pool_snaps": [], 2024-09-12T22:32:22.579 INFO:teuthology.orchestra.run.smithi019.stdout: "removed_snaps": "[]", 2024-09-12T22:32:22.579 INFO:teuthology.orchestra.run.smithi019.stdout: "quota_max_bytes": 0, 2024-09-12T22:32:22.579 INFO:teuthology.orchestra.run.smithi019.stdout: "quota_max_objects": 0, 2024-09-12T22:32:22.579 INFO:teuthology.orchestra.run.smithi019.stdout: "tiers": [], 2024-09-12T22:32:22.579 INFO:teuthology.orchestra.run.smithi019.stdout: "tier_of": -1, 2024-09-12T22:32:22.579 INFO:teuthology.orchestra.run.smithi019.stdout: "read_tier": -1, 2024-09-12T22:32:22.580 INFO:teuthology.orchestra.run.smithi019.stdout: "write_tier": -1, 2024-09-12T22:32:22.580 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_mode": "none", 2024-09-12T22:32:22.580 INFO:teuthology.orchestra.run.smithi019.stdout: "target_max_bytes": 0, 2024-09-12T22:32:22.580 INFO:teuthology.orchestra.run.smithi019.stdout: "target_max_objects": 0, 2024-09-12T22:32:22.580 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T22:32:22.580 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T22:32:22.580 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T22:32:22.580 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_min_flush_age": 0, 2024-09-12T22:32:22.580 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_min_evict_age": 0, 2024-09-12T22:32:22.580 INFO:teuthology.orchestra.run.smithi019.stdout: "erasure_code_profile": "", 2024-09-12T22:32:22.580 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_params": { 2024-09-12T22:32:22.580 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "none" 2024-09-12T22:32:22.580 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:32:22.581 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_period": 0, 2024-09-12T22:32:22.581 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_count": 0, 2024-09-12T22:32:22.581 INFO:teuthology.orchestra.run.smithi019.stdout: "use_gmt_hitset": true, 2024-09-12T22:32:22.581 INFO:teuthology.orchestra.run.smithi019.stdout: "min_read_recency_for_promote": 0, 2024-09-12T22:32:22.581 INFO:teuthology.orchestra.run.smithi019.stdout: "min_write_recency_for_promote": 0, 2024-09-12T22:32:22.581 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T22:32:22.581 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_search_last_n": 0, 2024-09-12T22:32:22.581 INFO:teuthology.orchestra.run.smithi019.stdout: "grade_table": [], 2024-09-12T22:32:22.581 INFO:teuthology.orchestra.run.smithi019.stdout: "stripe_width": 0, 2024-09-12T22:32:22.581 INFO:teuthology.orchestra.run.smithi019.stdout: "expected_num_objects": 0, 2024-09-12T22:32:22.581 INFO:teuthology.orchestra.run.smithi019.stdout: "fast_read": false, 2024-09-12T22:32:22.581 INFO:teuthology.orchestra.run.smithi019.stdout: "options": {}, 2024-09-12T22:32:22.581 INFO:teuthology.orchestra.run.smithi019.stdout: "application_metadata": { 2024-09-12T22:32:22.581 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd": {} 2024-09-12T22:32:22.582 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:32:22.582 INFO:teuthology.orchestra.run.smithi019.stdout: "read_balance": { 2024-09-12T22:32:22.582 INFO:teuthology.orchestra.run.smithi019.stdout: "score_type": "Fair distribution", 2024-09-12T22:32:22.582 INFO:teuthology.orchestra.run.smithi019.stdout: "score_acting": 1.5, 2024-09-12T22:32:22.582 INFO:teuthology.orchestra.run.smithi019.stdout: "score_stable": 1.5, 2024-09-12T22:32:22.582 INFO:teuthology.orchestra.run.smithi019.stdout: "optimal_score": 1, 2024-09-12T22:32:22.582 INFO:teuthology.orchestra.run.smithi019.stdout: "raw_score_acting": 1.5, 2024-09-12T22:32:22.582 INFO:teuthology.orchestra.run.smithi019.stdout: "raw_score_stable": 1.5, 2024-09-12T22:32:22.582 INFO:teuthology.orchestra.run.smithi019.stdout: "primary_affinity_weighted": 0.84509789943695068, 2024-09-12T22:32:22.582 INFO:teuthology.orchestra.run.smithi019.stdout: "average_primary_affinity": 0.85000002384185791, 2024-09-12T22:32:22.582 INFO:teuthology.orchestra.run.smithi019.stdout: "average_primary_affinity_weighted": 0.85000002384185791 2024-09-12T22:32:22.582 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T22:32:22.582 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:32:22.583 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:32:22.583 INFO:teuthology.orchestra.run.smithi019.stdout: "pool": 3, 2024-09-12T22:32:22.583 INFO:teuthology.orchestra.run.smithi019.stdout: "pool_name": "cephfs_metadata", 2024-09-12T22:32:22.583 INFO:teuthology.orchestra.run.smithi019.stdout: "create_time": "2024-09-12T22:31:35.267679+0000", 2024-09-12T22:32:22.583 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-12T22:32:22.583 INFO:teuthology.orchestra.run.smithi019.stdout: "flags_names": "hashpspool", 2024-09-12T22:32:22.583 INFO:teuthology.orchestra.run.smithi019.stdout: "type": 1, 2024-09-12T22:32:22.583 INFO:teuthology.orchestra.run.smithi019.stdout: "size": 2, 2024-09-12T22:32:22.583 INFO:teuthology.orchestra.run.smithi019.stdout: "min_size": 1, 2024-09-12T22:32:22.583 INFO:teuthology.orchestra.run.smithi019.stdout: "crush_rule": 0, 2024-09-12T22:32:22.583 INFO:teuthology.orchestra.run.smithi019.stdout: "peering_crush_bucket_count": 0, 2024-09-12T22:32:22.583 INFO:teuthology.orchestra.run.smithi019.stdout: "peering_crush_bucket_target": 0, 2024-09-12T22:32:22.583 INFO:teuthology.orchestra.run.smithi019.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T22:32:22.584 INFO:teuthology.orchestra.run.smithi019.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T22:32:22.584 INFO:teuthology.orchestra.run.smithi019.stdout: "is_stretch_pool": false, 2024-09-12T22:32:22.584 INFO:teuthology.orchestra.run.smithi019.stdout: "object_hash": 2, 2024-09-12T22:32:22.584 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_autoscale_mode": "off", 2024-09-12T22:32:22.584 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_num": 32, 2024-09-12T22:32:22.584 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_placement_num": 32, 2024-09-12T22:32:22.584 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_placement_num_target": 32, 2024-09-12T22:32:22.584 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_num_target": 32, 2024-09-12T22:32:22.584 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_num_pending": 32, 2024-09-12T22:32:22.584 INFO:teuthology.orchestra.run.smithi019.stdout: "last_pg_merge_meta": { 2024-09-12T22:32:22.584 INFO:teuthology.orchestra.run.smithi019.stdout: "source_pgid": "0.0", 2024-09-12T22:32:22.584 INFO:teuthology.orchestra.run.smithi019.stdout: "ready_epoch": 0, 2024-09-12T22:32:22.584 INFO:teuthology.orchestra.run.smithi019.stdout: "last_epoch_started": 0, 2024-09-12T22:32:22.585 INFO:teuthology.orchestra.run.smithi019.stdout: "last_epoch_clean": 0, 2024-09-12T22:32:22.585 INFO:teuthology.orchestra.run.smithi019.stdout: "source_version": "0'0", 2024-09-12T22:32:22.585 INFO:teuthology.orchestra.run.smithi019.stdout: "target_version": "0'0" 2024-09-12T22:32:22.585 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:32:22.585 INFO:teuthology.orchestra.run.smithi019.stdout: "last_change": "19", 2024-09-12T22:32:22.585 INFO:teuthology.orchestra.run.smithi019.stdout: "last_force_op_resend": "0", 2024-09-12T22:32:22.585 INFO:teuthology.orchestra.run.smithi019.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T22:32:22.585 INFO:teuthology.orchestra.run.smithi019.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T22:32:22.585 INFO:teuthology.orchestra.run.smithi019.stdout: "auid": 0, 2024-09-12T22:32:22.585 INFO:teuthology.orchestra.run.smithi019.stdout: "snap_mode": "selfmanaged", 2024-09-12T22:32:22.585 INFO:teuthology.orchestra.run.smithi019.stdout: "snap_seq": 0, 2024-09-12T22:32:22.585 INFO:teuthology.orchestra.run.smithi019.stdout: "snap_epoch": 0, 2024-09-12T22:32:22.585 INFO:teuthology.orchestra.run.smithi019.stdout: "pool_snaps": [], 2024-09-12T22:32:22.586 INFO:teuthology.orchestra.run.smithi019.stdout: "removed_snaps": "[]", 2024-09-12T22:32:22.586 INFO:teuthology.orchestra.run.smithi019.stdout: "quota_max_bytes": 0, 2024-09-12T22:32:22.586 INFO:teuthology.orchestra.run.smithi019.stdout: "quota_max_objects": 0, 2024-09-12T22:32:22.586 INFO:teuthology.orchestra.run.smithi019.stdout: "tiers": [], 2024-09-12T22:32:22.586 INFO:teuthology.orchestra.run.smithi019.stdout: "tier_of": -1, 2024-09-12T22:32:22.586 INFO:teuthology.orchestra.run.smithi019.stdout: "read_tier": -1, 2024-09-12T22:32:22.586 INFO:teuthology.orchestra.run.smithi019.stdout: "write_tier": -1, 2024-09-12T22:32:22.586 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_mode": "none", 2024-09-12T22:32:22.586 INFO:teuthology.orchestra.run.smithi019.stdout: "target_max_bytes": 0, 2024-09-12T22:32:22.586 INFO:teuthology.orchestra.run.smithi019.stdout: "target_max_objects": 0, 2024-09-12T22:32:22.586 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T22:32:22.586 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T22:32:22.586 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T22:32:22.587 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_min_flush_age": 0, 2024-09-12T22:32:22.587 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_min_evict_age": 0, 2024-09-12T22:32:22.587 INFO:teuthology.orchestra.run.smithi019.stdout: "erasure_code_profile": "", 2024-09-12T22:32:22.587 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_params": { 2024-09-12T22:32:22.587 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "none" 2024-09-12T22:32:22.587 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:32:22.587 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_period": 0, 2024-09-12T22:32:22.587 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_count": 0, 2024-09-12T22:32:22.587 INFO:teuthology.orchestra.run.smithi019.stdout: "use_gmt_hitset": true, 2024-09-12T22:32:22.587 INFO:teuthology.orchestra.run.smithi019.stdout: "min_read_recency_for_promote": 0, 2024-09-12T22:32:22.587 INFO:teuthology.orchestra.run.smithi019.stdout: "min_write_recency_for_promote": 0, 2024-09-12T22:32:22.587 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T22:32:22.587 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_search_last_n": 0, 2024-09-12T22:32:22.587 INFO:teuthology.orchestra.run.smithi019.stdout: "grade_table": [], 2024-09-12T22:32:22.588 INFO:teuthology.orchestra.run.smithi019.stdout: "stripe_width": 0, 2024-09-12T22:32:22.588 INFO:teuthology.orchestra.run.smithi019.stdout: "expected_num_objects": 0, 2024-09-12T22:32:22.588 INFO:teuthology.orchestra.run.smithi019.stdout: "fast_read": false, 2024-09-12T22:32:22.588 INFO:teuthology.orchestra.run.smithi019.stdout: "options": { 2024-09-12T22:32:22.588 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_autoscale_bias": 4, 2024-09-12T22:32:22.588 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_num_min": 16, 2024-09-12T22:32:22.588 INFO:teuthology.orchestra.run.smithi019.stdout: "recovery_priority": 5 2024-09-12T22:32:22.588 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:32:22.588 INFO:teuthology.orchestra.run.smithi019.stdout: "application_metadata": { 2024-09-12T22:32:22.588 INFO:teuthology.orchestra.run.smithi019.stdout: "cephfs": { 2024-09-12T22:32:22.588 INFO:teuthology.orchestra.run.smithi019.stdout: "metadata": "cephfs" 2024-09-12T22:32:22.588 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T22:32:22.588 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:32:22.589 INFO:teuthology.orchestra.run.smithi019.stdout: "read_balance": { 2024-09-12T22:32:22.589 INFO:teuthology.orchestra.run.smithi019.stdout: "score_type": "Fair distribution", 2024-09-12T22:32:22.589 INFO:teuthology.orchestra.run.smithi019.stdout: "score_acting": 1.309999942779541, 2024-09-12T22:32:22.589 INFO:teuthology.orchestra.run.smithi019.stdout: "score_stable": 1.309999942779541, 2024-09-12T22:32:22.589 INFO:teuthology.orchestra.run.smithi019.stdout: "optimal_score": 1, 2024-09-12T22:32:22.589 INFO:teuthology.orchestra.run.smithi019.stdout: "raw_score_acting": 1.309999942779541, 2024-09-12T22:32:22.589 INFO:teuthology.orchestra.run.smithi019.stdout: "raw_score_stable": 1.309999942779541, 2024-09-12T22:32:22.589 INFO:teuthology.orchestra.run.smithi019.stdout: "primary_affinity_weighted": 0.84509789943695068, 2024-09-12T22:32:22.589 INFO:teuthology.orchestra.run.smithi019.stdout: "average_primary_affinity": 0.85000002384185791, 2024-09-12T22:32:22.589 INFO:teuthology.orchestra.run.smithi019.stdout: "average_primary_affinity_weighted": 0.85000002384185791 2024-09-12T22:32:22.589 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T22:32:22.589 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:32:22.589 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:32:22.590 INFO:teuthology.orchestra.run.smithi019.stdout: "pool": 4, 2024-09-12T22:32:22.590 INFO:teuthology.orchestra.run.smithi019.stdout: "pool_name": "cephfs_data", 2024-09-12T22:32:22.590 INFO:teuthology.orchestra.run.smithi019.stdout: "create_time": "2024-09-12T22:31:35.724475+0000", 2024-09-12T22:32:22.590 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-12T22:32:22.590 INFO:teuthology.orchestra.run.smithi019.stdout: "flags_names": "hashpspool", 2024-09-12T22:32:22.590 INFO:teuthology.orchestra.run.smithi019.stdout: "type": 1, 2024-09-12T22:32:22.590 INFO:teuthology.orchestra.run.smithi019.stdout: "size": 2, 2024-09-12T22:32:22.590 INFO:teuthology.orchestra.run.smithi019.stdout: "min_size": 1, 2024-09-12T22:32:22.590 INFO:teuthology.orchestra.run.smithi019.stdout: "crush_rule": 0, 2024-09-12T22:32:22.590 INFO:teuthology.orchestra.run.smithi019.stdout: "peering_crush_bucket_count": 0, 2024-09-12T22:32:22.590 INFO:teuthology.orchestra.run.smithi019.stdout: "peering_crush_bucket_target": 0, 2024-09-12T22:32:22.590 INFO:teuthology.orchestra.run.smithi019.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T22:32:22.590 INFO:teuthology.orchestra.run.smithi019.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T22:32:22.590 INFO:teuthology.orchestra.run.smithi019.stdout: "is_stretch_pool": false, 2024-09-12T22:32:22.591 INFO:teuthology.orchestra.run.smithi019.stdout: "object_hash": 2, 2024-09-12T22:32:22.591 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_autoscale_mode": "off", 2024-09-12T22:32:22.591 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_num": 64, 2024-09-12T22:32:22.591 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_placement_num": 64, 2024-09-12T22:32:22.591 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_placement_num_target": 64, 2024-09-12T22:32:22.591 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_num_target": 64, 2024-09-12T22:32:22.591 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_num_pending": 64, 2024-09-12T22:32:22.591 INFO:teuthology.orchestra.run.smithi019.stdout: "last_pg_merge_meta": { 2024-09-12T22:32:22.591 INFO:teuthology.orchestra.run.smithi019.stdout: "source_pgid": "0.0", 2024-09-12T22:32:22.591 INFO:teuthology.orchestra.run.smithi019.stdout: "ready_epoch": 0, 2024-09-12T22:32:22.591 INFO:teuthology.orchestra.run.smithi019.stdout: "last_epoch_started": 0, 2024-09-12T22:32:22.591 INFO:teuthology.orchestra.run.smithi019.stdout: "last_epoch_clean": 0, 2024-09-12T22:32:22.591 INFO:teuthology.orchestra.run.smithi019.stdout: "source_version": "0'0", 2024-09-12T22:32:22.592 INFO:teuthology.orchestra.run.smithi019.stdout: "target_version": "0'0" 2024-09-12T22:32:22.592 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:32:22.592 INFO:teuthology.orchestra.run.smithi019.stdout: "last_change": "20", 2024-09-12T22:32:22.592 INFO:teuthology.orchestra.run.smithi019.stdout: "last_force_op_resend": "0", 2024-09-12T22:32:22.592 INFO:teuthology.orchestra.run.smithi019.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T22:32:22.592 INFO:teuthology.orchestra.run.smithi019.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T22:32:22.592 INFO:teuthology.orchestra.run.smithi019.stdout: "auid": 0, 2024-09-12T22:32:22.592 INFO:teuthology.orchestra.run.smithi019.stdout: "snap_mode": "selfmanaged", 2024-09-12T22:32:22.592 INFO:teuthology.orchestra.run.smithi019.stdout: "snap_seq": 0, 2024-09-12T22:32:22.592 INFO:teuthology.orchestra.run.smithi019.stdout: "snap_epoch": 0, 2024-09-12T22:32:22.592 INFO:teuthology.orchestra.run.smithi019.stdout: "pool_snaps": [], 2024-09-12T22:32:22.592 INFO:teuthology.orchestra.run.smithi019.stdout: "removed_snaps": "[]", 2024-09-12T22:32:22.592 INFO:teuthology.orchestra.run.smithi019.stdout: "quota_max_bytes": 0, 2024-09-12T22:32:22.592 INFO:teuthology.orchestra.run.smithi019.stdout: "quota_max_objects": 0, 2024-09-12T22:32:22.593 INFO:teuthology.orchestra.run.smithi019.stdout: "tiers": [], 2024-09-12T22:32:22.593 INFO:teuthology.orchestra.run.smithi019.stdout: "tier_of": -1, 2024-09-12T22:32:22.593 INFO:teuthology.orchestra.run.smithi019.stdout: "read_tier": -1, 2024-09-12T22:32:22.593 INFO:teuthology.orchestra.run.smithi019.stdout: "write_tier": -1, 2024-09-12T22:32:22.593 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_mode": "none", 2024-09-12T22:32:22.593 INFO:teuthology.orchestra.run.smithi019.stdout: "target_max_bytes": 0, 2024-09-12T22:32:22.593 INFO:teuthology.orchestra.run.smithi019.stdout: "target_max_objects": 0, 2024-09-12T22:32:22.593 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T22:32:22.593 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T22:32:22.593 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T22:32:22.593 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_min_flush_age": 0, 2024-09-12T22:32:22.593 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_min_evict_age": 0, 2024-09-12T22:32:22.593 INFO:teuthology.orchestra.run.smithi019.stdout: "erasure_code_profile": "", 2024-09-12T22:32:22.594 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_params": { 2024-09-12T22:32:22.594 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "none" 2024-09-12T22:32:22.594 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:32:22.594 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_period": 0, 2024-09-12T22:32:22.594 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_count": 0, 2024-09-12T22:32:22.594 INFO:teuthology.orchestra.run.smithi019.stdout: "use_gmt_hitset": true, 2024-09-12T22:32:22.594 INFO:teuthology.orchestra.run.smithi019.stdout: "min_read_recency_for_promote": 0, 2024-09-12T22:32:22.594 INFO:teuthology.orchestra.run.smithi019.stdout: "min_write_recency_for_promote": 0, 2024-09-12T22:32:22.594 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T22:32:22.594 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_search_last_n": 0, 2024-09-12T22:32:22.594 INFO:teuthology.orchestra.run.smithi019.stdout: "grade_table": [], 2024-09-12T22:32:22.595 INFO:teuthology.orchestra.run.smithi019.stdout: "stripe_width": 0, 2024-09-12T22:32:22.595 INFO:teuthology.orchestra.run.smithi019.stdout: "expected_num_objects": 0, 2024-09-12T22:32:22.595 INFO:teuthology.orchestra.run.smithi019.stdout: "fast_read": false, 2024-09-12T22:32:22.595 INFO:teuthology.orchestra.run.smithi019.stdout: "options": { 2024-09-12T22:32:22.595 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_num_min": 64, 2024-09-12T22:32:22.595 INFO:teuthology.orchestra.run.smithi019.stdout: "target_size_ratio": 0.89999997615814209 2024-09-12T22:32:22.596 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:32:22.596 INFO:teuthology.orchestra.run.smithi019.stdout: "application_metadata": { 2024-09-12T22:32:22.596 INFO:teuthology.orchestra.run.smithi019.stdout: "cephfs": { 2024-09-12T22:32:22.596 INFO:teuthology.orchestra.run.smithi019.stdout: "data": "cephfs" 2024-09-12T22:32:22.596 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T22:32:22.596 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:32:22.596 INFO:teuthology.orchestra.run.smithi019.stdout: "read_balance": { 2024-09-12T22:32:22.596 INFO:teuthology.orchestra.run.smithi019.stdout: "score_type": "Fair distribution", 2024-09-12T22:32:22.596 INFO:teuthology.orchestra.run.smithi019.stdout: "score_acting": 1.1699999570846558, 2024-09-12T22:32:22.596 INFO:teuthology.orchestra.run.smithi019.stdout: "score_stable": 1.1699999570846558, 2024-09-12T22:32:22.596 INFO:teuthology.orchestra.run.smithi019.stdout: "optimal_score": 1, 2024-09-12T22:32:22.596 INFO:teuthology.orchestra.run.smithi019.stdout: "raw_score_acting": 1.1699999570846558, 2024-09-12T22:32:22.596 INFO:teuthology.orchestra.run.smithi019.stdout: "raw_score_stable": 1.1699999570846558, 2024-09-12T22:32:22.597 INFO:teuthology.orchestra.run.smithi019.stdout: "primary_affinity_weighted": 0.84509789943695068, 2024-09-12T22:32:22.597 INFO:teuthology.orchestra.run.smithi019.stdout: "average_primary_affinity": 0.85000002384185791, 2024-09-12T22:32:22.597 INFO:teuthology.orchestra.run.smithi019.stdout: "average_primary_affinity_weighted": 0.85000002384185791 2024-09-12T22:32:22.597 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T22:32:22.597 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T22:32:22.597 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-12T22:32:22.597 INFO:teuthology.orchestra.run.smithi019.stdout: "osds": [ 2024-09-12T22:32:22.597 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:32:22.597 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": 0, 2024-09-12T22:32:22.597 INFO:teuthology.orchestra.run.smithi019.stdout: "uuid": "73b96314-15d5-4058-9993-ac103e997b27", 2024-09-12T22:32:22.597 INFO:teuthology.orchestra.run.smithi019.stdout: "up": 1, 2024-09-12T22:32:22.597 INFO:teuthology.orchestra.run.smithi019.stdout: "in": 1, 2024-09-12T22:32:22.597 INFO:teuthology.orchestra.run.smithi019.stdout: "weight": 1, 2024-09-12T22:32:22.598 INFO:teuthology.orchestra.run.smithi019.stdout: "primary_affinity": 0.5352935791015625, 2024-09-12T22:32:22.598 INFO:teuthology.orchestra.run.smithi019.stdout: "last_clean_begin": 0, 2024-09-12T22:32:22.598 INFO:teuthology.orchestra.run.smithi019.stdout: "last_clean_end": 0, 2024-09-12T22:32:22.598 INFO:teuthology.orchestra.run.smithi019.stdout: "up_from": 9, 2024-09-12T22:32:22.598 INFO:teuthology.orchestra.run.smithi019.stdout: "up_thru": 18, 2024-09-12T22:32:22.598 INFO:teuthology.orchestra.run.smithi019.stdout: "down_at": 0, 2024-09-12T22:32:22.598 INFO:teuthology.orchestra.run.smithi019.stdout: "lost_at": 0, 2024-09-12T22:32:22.598 INFO:teuthology.orchestra.run.smithi019.stdout: "public_addrs": { 2024-09-12T22:32:22.598 INFO:teuthology.orchestra.run.smithi019.stdout: "addrvec": [ 2024-09-12T22:32:22.598 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:32:22.598 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v2", 2024-09-12T22:32:22.598 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.76:6800", 2024-09-12T22:32:22.598 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 1343093884 2024-09-12T22:32:22.599 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:32:22.599 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:32:22.599 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2024-09-12T22:32:22.599 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.76:6801", 2024-09-12T22:32:22.599 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 1343093884 2024-09-12T22:32:22.599 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T22:32:22.599 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T22:32:22.599 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:32:22.599 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster_addrs": { 2024-09-12T22:32:22.599 INFO:teuthology.orchestra.run.smithi019.stdout: "addrvec": [ 2024-09-12T22:32:22.599 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:32:22.599 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v2", 2024-09-12T22:32:22.599 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.76:6802", 2024-09-12T22:32:22.600 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 1343093884 2024-09-12T22:32:22.600 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:32:22.600 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:32:22.600 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2024-09-12T22:32:22.600 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.76:6803", 2024-09-12T22:32:22.600 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 1343093884 2024-09-12T22:32:22.600 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T22:32:22.600 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T22:32:22.600 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:32:22.600 INFO:teuthology.orchestra.run.smithi019.stdout: "heartbeat_back_addrs": { 2024-09-12T22:32:22.600 INFO:teuthology.orchestra.run.smithi019.stdout: "addrvec": [ 2024-09-12T22:32:22.600 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:32:22.600 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v2", 2024-09-12T22:32:22.601 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.76:6806", 2024-09-12T22:32:22.601 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 1343093884 2024-09-12T22:32:22.601 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:32:22.601 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:32:22.601 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2024-09-12T22:32:22.601 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.76:6807", 2024-09-12T22:32:22.601 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 1343093884 2024-09-12T22:32:22.601 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T22:32:22.601 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T22:32:22.601 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:32:22.601 INFO:teuthology.orchestra.run.smithi019.stdout: "heartbeat_front_addrs": { 2024-09-12T22:32:22.601 INFO:teuthology.orchestra.run.smithi019.stdout: "addrvec": [ 2024-09-12T22:32:22.601 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:32:22.602 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v2", 2024-09-12T22:32:22.602 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.76:6804", 2024-09-12T22:32:22.602 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 1343093884 2024-09-12T22:32:22.602 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:32:22.602 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:32:22.602 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2024-09-12T22:32:22.602 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.76:6805", 2024-09-12T22:32:22.602 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 1343093884 2024-09-12T22:32:22.602 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T22:32:22.602 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T22:32:22.602 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:32:22.602 INFO:teuthology.orchestra.run.smithi019.stdout: "public_addr": "172.21.15.76:6801/1343093884", 2024-09-12T22:32:22.602 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster_addr": "172.21.15.76:6803/1343093884", 2024-09-12T22:32:22.603 INFO:teuthology.orchestra.run.smithi019.stdout: "heartbeat_back_addr": "172.21.15.76:6807/1343093884", 2024-09-12T22:32:22.603 INFO:teuthology.orchestra.run.smithi019.stdout: "heartbeat_front_addr": "172.21.15.76:6805/1343093884", 2024-09-12T22:32:22.603 INFO:teuthology.orchestra.run.smithi019.stdout: "state": [ 2024-09-12T22:32:22.603 INFO:teuthology.orchestra.run.smithi019.stdout: "exists", 2024-09-12T22:32:22.603 INFO:teuthology.orchestra.run.smithi019.stdout: "up" 2024-09-12T22:32:22.603 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T22:32:22.603 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:32:22.603 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:32:22.603 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": 1, 2024-09-12T22:32:22.603 INFO:teuthology.orchestra.run.smithi019.stdout: "uuid": "f82ad621-e9cf-41cb-b9c0-43470cf7ddb1", 2024-09-12T22:32:22.603 INFO:teuthology.orchestra.run.smithi019.stdout: "up": 1, 2024-09-12T22:32:22.603 INFO:teuthology.orchestra.run.smithi019.stdout: "in": 1, 2024-09-12T22:32:22.604 INFO:teuthology.orchestra.run.smithi019.stdout: "weight": 1, 2024-09-12T22:32:22.604 INFO:teuthology.orchestra.run.smithi019.stdout: "primary_affinity": 1, 2024-09-12T22:32:22.604 INFO:teuthology.orchestra.run.smithi019.stdout: "last_clean_begin": 0, 2024-09-12T22:32:22.604 INFO:teuthology.orchestra.run.smithi019.stdout: "last_clean_end": 0, 2024-09-12T22:32:22.604 INFO:teuthology.orchestra.run.smithi019.stdout: "up_from": 8, 2024-09-12T22:32:22.604 INFO:teuthology.orchestra.run.smithi019.stdout: "up_thru": 22, 2024-09-12T22:32:22.604 INFO:teuthology.orchestra.run.smithi019.stdout: "down_at": 0, 2024-09-12T22:32:22.604 INFO:teuthology.orchestra.run.smithi019.stdout: "lost_at": 0, 2024-09-12T22:32:22.604 INFO:teuthology.orchestra.run.smithi019.stdout: "public_addrs": { 2024-09-12T22:32:22.604 INFO:teuthology.orchestra.run.smithi019.stdout: "addrvec": [ 2024-09-12T22:32:22.604 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:32:22.604 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v2", 2024-09-12T22:32:22.604 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.148:6800", 2024-09-12T22:32:22.605 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 616952176 2024-09-12T22:32:22.605 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:32:22.605 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:32:22.605 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2024-09-12T22:32:22.605 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.148:6801", 2024-09-12T22:32:22.605 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 616952176 2024-09-12T22:32:22.605 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T22:32:22.605 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T22:32:22.605 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:32:22.605 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster_addrs": { 2024-09-12T22:32:22.605 INFO:teuthology.orchestra.run.smithi019.stdout: "addrvec": [ 2024-09-12T22:32:22.605 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:32:22.605 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v2", 2024-09-12T22:32:22.606 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.148:6802", 2024-09-12T22:32:22.606 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 616952176 2024-09-12T22:32:22.606 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:32:22.606 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:32:22.606 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2024-09-12T22:32:22.606 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.148:6803", 2024-09-12T22:32:22.606 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 616952176 2024-09-12T22:32:22.606 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T22:32:22.606 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T22:32:22.606 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:32:22.606 INFO:teuthology.orchestra.run.smithi019.stdout: "heartbeat_back_addrs": { 2024-09-12T22:32:22.606 INFO:teuthology.orchestra.run.smithi019.stdout: "addrvec": [ 2024-09-12T22:32:22.606 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:32:22.607 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v2", 2024-09-12T22:32:22.607 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.148:6806", 2024-09-12T22:32:22.607 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 616952176 2024-09-12T22:32:22.607 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:32:22.607 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:32:22.607 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2024-09-12T22:32:22.607 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.148:6807", 2024-09-12T22:32:22.607 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 616952176 2024-09-12T22:32:22.607 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T22:32:22.607 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T22:32:22.607 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:32:22.607 INFO:teuthology.orchestra.run.smithi019.stdout: "heartbeat_front_addrs": { 2024-09-12T22:32:22.607 INFO:teuthology.orchestra.run.smithi019.stdout: "addrvec": [ 2024-09-12T22:32:22.608 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:32:22.608 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v2", 2024-09-12T22:32:22.608 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.148:6804", 2024-09-12T22:32:22.608 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 616952176 2024-09-12T22:32:22.608 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:32:22.608 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:32:22.608 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2024-09-12T22:32:22.608 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.148:6805", 2024-09-12T22:32:22.608 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 616952176 2024-09-12T22:32:22.608 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T22:32:22.608 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T22:32:22.608 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:32:22.608 INFO:teuthology.orchestra.run.smithi019.stdout: "public_addr": "172.21.15.148:6801/616952176", 2024-09-12T22:32:22.609 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster_addr": "172.21.15.148:6803/616952176", 2024-09-12T22:32:22.609 INFO:teuthology.orchestra.run.smithi019.stdout: "heartbeat_back_addr": "172.21.15.148:6807/616952176", 2024-09-12T22:32:22.609 INFO:teuthology.orchestra.run.smithi019.stdout: "heartbeat_front_addr": "172.21.15.148:6805/616952176", 2024-09-12T22:32:22.609 INFO:teuthology.orchestra.run.smithi019.stdout: "state": [ 2024-09-12T22:32:22.609 INFO:teuthology.orchestra.run.smithi019.stdout: "exists", 2024-09-12T22:32:22.609 INFO:teuthology.orchestra.run.smithi019.stdout: "up" 2024-09-12T22:32:22.609 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T22:32:22.609 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:32:22.609 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:32:22.609 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": 2, 2024-09-12T22:32:22.609 INFO:teuthology.orchestra.run.smithi019.stdout: "uuid": "f30dda36-a84c-4a01-a81a-afbfb88c0aed", 2024-09-12T22:32:22.609 INFO:teuthology.orchestra.run.smithi019.stdout: "up": 1, 2024-09-12T22:32:22.609 INFO:teuthology.orchestra.run.smithi019.stdout: "in": 1, 2024-09-12T22:32:22.610 INFO:teuthology.orchestra.run.smithi019.stdout: "weight": 1, 2024-09-12T22:32:22.610 INFO:teuthology.orchestra.run.smithi019.stdout: "primary_affinity": 1, 2024-09-12T22:32:22.610 INFO:teuthology.orchestra.run.smithi019.stdout: "last_clean_begin": 0, 2024-09-12T22:32:22.610 INFO:teuthology.orchestra.run.smithi019.stdout: "last_clean_end": 0, 2024-09-12T22:32:22.610 INFO:teuthology.orchestra.run.smithi019.stdout: "up_from": 9, 2024-09-12T22:32:22.610 INFO:teuthology.orchestra.run.smithi019.stdout: "up_thru": 22, 2024-09-12T22:32:22.610 INFO:teuthology.orchestra.run.smithi019.stdout: "down_at": 0, 2024-09-12T22:32:22.610 INFO:teuthology.orchestra.run.smithi019.stdout: "lost_at": 0, 2024-09-12T22:32:22.610 INFO:teuthology.orchestra.run.smithi019.stdout: "public_addrs": { 2024-09-12T22:32:22.610 INFO:teuthology.orchestra.run.smithi019.stdout: "addrvec": [ 2024-09-12T22:32:22.610 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:32:22.610 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v2", 2024-09-12T22:32:22.610 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.163:6800", 2024-09-12T22:32:22.611 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 533442754 2024-09-12T22:32:22.611 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:32:22.611 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:32:22.611 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2024-09-12T22:32:22.611 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.163:6801", 2024-09-12T22:32:22.611 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 533442754 2024-09-12T22:32:22.611 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T22:32:22.611 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T22:32:22.611 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:32:22.611 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster_addrs": { 2024-09-12T22:32:22.611 INFO:teuthology.orchestra.run.smithi019.stdout: "addrvec": [ 2024-09-12T22:32:22.611 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:32:22.611 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v2", 2024-09-12T22:32:22.611 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.163:6802", 2024-09-12T22:32:22.612 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 533442754 2024-09-12T22:32:22.612 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:32:22.612 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:32:22.612 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2024-09-12T22:32:22.612 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.163:6803", 2024-09-12T22:32:22.612 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 533442754 2024-09-12T22:32:22.612 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T22:32:22.612 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T22:32:22.612 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:32:22.612 INFO:teuthology.orchestra.run.smithi019.stdout: "heartbeat_back_addrs": { 2024-09-12T22:32:22.612 INFO:teuthology.orchestra.run.smithi019.stdout: "addrvec": [ 2024-09-12T22:32:22.612 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:32:22.612 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v2", 2024-09-12T22:32:22.613 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.163:6806", 2024-09-12T22:32:22.613 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 533442754 2024-09-12T22:32:22.613 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:32:22.613 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:32:22.613 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2024-09-12T22:32:22.613 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.163:6807", 2024-09-12T22:32:22.613 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 533442754 2024-09-12T22:32:22.613 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T22:32:22.613 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T22:32:22.613 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:32:22.613 INFO:teuthology.orchestra.run.smithi019.stdout: "heartbeat_front_addrs": { 2024-09-12T22:32:22.613 INFO:teuthology.orchestra.run.smithi019.stdout: "addrvec": [ 2024-09-12T22:32:22.613 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:32:22.614 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v2", 2024-09-12T22:32:22.614 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.163:6804", 2024-09-12T22:32:22.614 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 533442754 2024-09-12T22:32:22.614 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:32:22.614 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:32:22.614 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2024-09-12T22:32:22.614 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.163:6805", 2024-09-12T22:32:22.614 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 533442754 2024-09-12T22:32:22.614 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T22:32:22.614 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T22:32:22.614 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:32:22.614 INFO:teuthology.orchestra.run.smithi019.stdout: "public_addr": "172.21.15.163:6801/533442754", 2024-09-12T22:32:22.615 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster_addr": "172.21.15.163:6803/533442754", 2024-09-12T22:32:22.615 INFO:teuthology.orchestra.run.smithi019.stdout: "heartbeat_back_addr": "172.21.15.163:6807/533442754", 2024-09-12T22:32:22.615 INFO:teuthology.orchestra.run.smithi019.stdout: "heartbeat_front_addr": "172.21.15.163:6805/533442754", 2024-09-12T22:32:22.615 INFO:teuthology.orchestra.run.smithi019.stdout: "state": [ 2024-09-12T22:32:22.615 INFO:teuthology.orchestra.run.smithi019.stdout: "exists", 2024-09-12T22:32:22.615 INFO:teuthology.orchestra.run.smithi019.stdout: "up" 2024-09-12T22:32:22.615 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T22:32:22.615 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T22:32:22.615 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-12T22:32:22.615 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_xinfo": [ 2024-09-12T22:32:22.615 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:32:22.615 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": 0, 2024-09-12T22:32:22.615 INFO:teuthology.orchestra.run.smithi019.stdout: "down_stamp": "0.000000", 2024-09-12T22:32:22.616 INFO:teuthology.orchestra.run.smithi019.stdout: "laggy_probability": 0, 2024-09-12T22:32:22.616 INFO:teuthology.orchestra.run.smithi019.stdout: "laggy_interval": 0, 2024-09-12T22:32:22.616 INFO:teuthology.orchestra.run.smithi019.stdout: "features": 4540701547738038271, 2024-09-12T22:32:22.616 INFO:teuthology.orchestra.run.smithi019.stdout: "old_weight": 0, 2024-09-12T22:32:22.616 INFO:teuthology.orchestra.run.smithi019.stdout: "last_purged_snaps_scrub": "2024-09-12T22:31:23.899591+0000", 2024-09-12T22:32:22.616 INFO:teuthology.orchestra.run.smithi019.stdout: "dead_epoch": 0 2024-09-12T22:32:22.616 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:32:22.616 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:32:22.616 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": 1, 2024-09-12T22:32:22.616 INFO:teuthology.orchestra.run.smithi019.stdout: "down_stamp": "0.000000", 2024-09-12T22:32:22.616 INFO:teuthology.orchestra.run.smithi019.stdout: "laggy_probability": 0, 2024-09-12T22:32:22.616 INFO:teuthology.orchestra.run.smithi019.stdout: "laggy_interval": 0, 2024-09-12T22:32:22.616 INFO:teuthology.orchestra.run.smithi019.stdout: "features": 4540701547738038271, 2024-09-12T22:32:22.616 INFO:teuthology.orchestra.run.smithi019.stdout: "old_weight": 0, 2024-09-12T22:32:22.617 INFO:teuthology.orchestra.run.smithi019.stdout: "last_purged_snaps_scrub": "2024-09-12T22:31:22.988274+0000", 2024-09-12T22:32:22.617 INFO:teuthology.orchestra.run.smithi019.stdout: "dead_epoch": 0 2024-09-12T22:32:22.617 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:32:22.617 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:32:22.617 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": 2, 2024-09-12T22:32:22.617 INFO:teuthology.orchestra.run.smithi019.stdout: "down_stamp": "0.000000", 2024-09-12T22:32:22.617 INFO:teuthology.orchestra.run.smithi019.stdout: "laggy_probability": 0, 2024-09-12T22:32:22.617 INFO:teuthology.orchestra.run.smithi019.stdout: "laggy_interval": 0, 2024-09-12T22:32:22.617 INFO:teuthology.orchestra.run.smithi019.stdout: "features": 4540701547738038271, 2024-09-12T22:32:22.617 INFO:teuthology.orchestra.run.smithi019.stdout: "old_weight": 0, 2024-09-12T22:32:22.617 INFO:teuthology.orchestra.run.smithi019.stdout: "last_purged_snaps_scrub": "2024-09-12T22:31:23.932109+0000", 2024-09-12T22:32:22.617 INFO:teuthology.orchestra.run.smithi019.stdout: "dead_epoch": 0 2024-09-12T22:32:22.617 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T22:32:22.618 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-12T22:32:22.618 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_upmap": [], 2024-09-12T22:32:22.618 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_upmap_items": [], 2024-09-12T22:32:22.618 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_upmap_primaries": [], 2024-09-12T22:32:22.618 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_temp": [], 2024-09-12T22:32:22.618 INFO:teuthology.orchestra.run.smithi019.stdout: "primary_temp": [], 2024-09-12T22:32:22.618 INFO:teuthology.orchestra.run.smithi019.stdout: "blocklist": {}, 2024-09-12T22:32:22.618 INFO:teuthology.orchestra.run.smithi019.stdout: "range_blocklist": {}, 2024-09-12T22:32:22.618 INFO:teuthology.orchestra.run.smithi019.stdout: "erasure_code_profiles": { 2024-09-12T22:32:22.618 INFO:teuthology.orchestra.run.smithi019.stdout: "default": { 2024-09-12T22:32:22.618 INFO:teuthology.orchestra.run.smithi019.stdout: "crush-failure-domain": "osd", 2024-09-12T22:32:22.619 INFO:teuthology.orchestra.run.smithi019.stdout: "k": "2", 2024-09-12T22:32:22.619 INFO:teuthology.orchestra.run.smithi019.stdout: "m": "1", 2024-09-12T22:32:22.619 INFO:teuthology.orchestra.run.smithi019.stdout: "plugin": "jerasure", 2024-09-12T22:32:22.619 INFO:teuthology.orchestra.run.smithi019.stdout: "technique": "reed_sol_van" 2024-09-12T22:32:22.619 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T22:32:22.619 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:32:22.619 INFO:teuthology.orchestra.run.smithi019.stdout: "removed_snaps_queue": [], 2024-09-12T22:32:22.619 INFO:teuthology.orchestra.run.smithi019.stdout: "new_removed_snaps": [], 2024-09-12T22:32:22.619 INFO:teuthology.orchestra.run.smithi019.stdout: "new_purged_snaps": [], 2024-09-12T22:32:22.619 INFO:teuthology.orchestra.run.smithi019.stdout: "crush_node_flags": {}, 2024-09-12T22:32:22.619 INFO:teuthology.orchestra.run.smithi019.stdout: "device_class_flags": {}, 2024-09-12T22:32:22.620 INFO:teuthology.orchestra.run.smithi019.stdout: "stretch_mode": { 2024-09-12T22:32:22.620 INFO:teuthology.orchestra.run.smithi019.stdout: "stretch_mode_enabled": false, 2024-09-12T22:32:22.620 INFO:teuthology.orchestra.run.smithi019.stdout: "stretch_bucket_count": 0, 2024-09-12T22:32:22.620 INFO:teuthology.orchestra.run.smithi019.stdout: "degraded_stretch_mode": 0, 2024-09-12T22:32:22.620 INFO:teuthology.orchestra.run.smithi019.stdout: "recovering_stretch_mode": 0, 2024-09-12T22:32:22.620 INFO:teuthology.orchestra.run.smithi019.stdout: "stretch_mode_bucket": 0 2024-09-12T22:32:22.620 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T22:32:22.620 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T22:32:22.622 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:22.620+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:22.623 INFO:tasks.thrashosds.thrasher:j is {'epoch': 33, 'fsid': '957ce235-19cb-4350-8fee-febd6e3f2199', 'created': '2024-09-12T22:31:15.903133+0000', 'modified': '2024-09-12T22:32:20.282192+0000', 'last_up_change': '2024-09-12T22:31:25.209056+0000', 'last_in_change': '2024-09-12T22:31:16.757598+0000', 'flags': 'noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5801984, 'flags_set': ['noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 5, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 4, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-12T22:31:26.228956+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.8450978994369507, 'average_primary_affinity': 0.8500000238418579, 'average_primary_affinity_weighted': 0.8500000238418579}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-12T22:31:30.975989+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 16, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.8450978994369507, 'average_primary_affinity': 0.8500000238418579, 'average_primary_affinity_weighted': 0.8500000238418579}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-12T22:31:35.267679+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.309999942779541, 'score_stable': 1.309999942779541, 'optimal_score': 1, 'raw_score_acting': 1.309999942779541, 'raw_score_stable': 1.309999942779541, 'primary_affinity_weighted': 0.8450978994369507, 'average_primary_affinity': 0.8500000238418579, 'average_primary_affinity_weighted': 0.8500000238418579}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-09-12T22:31:35.724475+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1699999570846558, 'score_stable': 1.1699999570846558, 'optimal_score': 1, 'raw_score_acting': 1.1699999570846558, 'raw_score_stable': 1.1699999570846558, 'primary_affinity_weighted': 0.8450978994369507, 'average_primary_affinity': 0.8500000238418579, 'average_primary_affinity_weighted': 0.8500000238418579}}], 'osds': [{'osd': 0, 'uuid': '73b96314-15d5-4058-9993-ac103e997b27', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.5352935791015625, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 9, 'up_thru': 18, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.76:6800', 'nonce': 1343093884}, {'type': 'v1', 'addr': '172.21.15.76:6801', 'nonce': 1343093884}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.76:6802', 'nonce': 1343093884}, {'type': 'v1', 'addr': '172.21.15.76:6803', 'nonce': 1343093884}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.76:6806', 'nonce': 1343093884}, {'type': 'v1', 'addr': '172.21.15.76:6807', 'nonce': 1343093884}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.76:6804', 'nonce': 1343093884}, {'type': 'v1', 'addr': '172.21.15.76:6805', 'nonce': 1343093884}]}, 'public_addr': '172.21.15.76:6801/1343093884', 'cluster_addr': '172.21.15.76:6803/1343093884', 'heartbeat_back_addr': '172.21.15.76:6807/1343093884', 'heartbeat_front_addr': '172.21.15.76:6805/1343093884', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': 'f82ad621-e9cf-41cb-b9c0-43470cf7ddb1', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 22, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.148:6800', 'nonce': 616952176}, {'type': 'v1', 'addr': '172.21.15.148:6801', 'nonce': 616952176}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.148:6802', 'nonce': 616952176}, {'type': 'v1', 'addr': '172.21.15.148:6803', 'nonce': 616952176}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.148:6806', 'nonce': 616952176}, {'type': 'v1', 'addr': '172.21.15.148:6807', 'nonce': 616952176}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.148:6804', 'nonce': 616952176}, {'type': 'v1', 'addr': '172.21.15.148:6805', 'nonce': 616952176}]}, 'public_addr': '172.21.15.148:6801/616952176', 'cluster_addr': '172.21.15.148:6803/616952176', 'heartbeat_back_addr': '172.21.15.148:6807/616952176', 'heartbeat_front_addr': '172.21.15.148:6805/616952176', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': 'f30dda36-a84c-4a01-a81a-afbfb88c0aed', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 9, 'up_thru': 22, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.163:6800', 'nonce': 533442754}, {'type': 'v1', 'addr': '172.21.15.163:6801', 'nonce': 533442754}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.163:6802', 'nonce': 533442754}, {'type': 'v1', 'addr': '172.21.15.163:6803', 'nonce': 533442754}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.163:6806', 'nonce': 533442754}, {'type': 'v1', 'addr': '172.21.15.163:6807', 'nonce': 533442754}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.163:6804', 'nonce': 533442754}, {'type': 'v1', 'addr': '172.21.15.163:6805', 'nonce': 533442754}]}, 'public_addr': '172.21.15.163:6801/533442754', 'cluster_addr': '172.21.15.163:6803/533442754', 'heartbeat_back_addr': '172.21.15.163:6807/533442754', 'heartbeat_front_addr': '172.21.15.163:6805/533442754', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T22:31:23.899591+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T22:31:22.988274+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T22:31:23.932109+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-12T22:32:22.623 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T22:32:22.624 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:32:22.722 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:22.720+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:22.735 INFO:teuthology.orchestra.run.smithi076.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:22.736 INFO:teuthology.orchestra.run.smithi076.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:22.745 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:32:22.823 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:22.822+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:22.847 INFO:teuthology.orchestra.run.smithi076.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:22.847 INFO:teuthology.orchestra.run.smithi076.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:22.856 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:32:22.924 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:22.924+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:22.932 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:32:22.934 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-12T22:32:22.943 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":60,"stamp":"2024-09-12T22:32:22.196427+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597740,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":258,"num_write_kb":3485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":205,"ondisk_log_size":205,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":91444,"kb_used_data":2040,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283024076,"statfs":{"total":289910292480,"available":289816653824,"internally_reserved":0,"allocated":2088960,"data_stored":1536094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":91483471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.930903"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T22:32:17.948219+0000","last_change":"2024-09-12T22:31:37.416383+0000","last_active":"2024-09-12T22:32:17.948219+0000","last_peered":"2024-09-12T22:32:17.948219+0000","last_clean":"2024-09-12T22:32:17.948219+0000","last_became_active":"2024-09-12T22:31:37.415457+0000","last_became_peered":"2024-09-12T22:31:37.415457+0000","last_unstale":"2024-09-12T22:32:17.948219+0000","last_undegraded":"2024-09-12T22:32:17.948219+0000","last_fullsized":"2024-09-12T22:32:17.948219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:08:29.199832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T22:32:17.285316+0000","last_change":"2024-09-12T22:31:57.100705+0000","last_active":"2024-09-12T22:32:17.285316+0000","last_peered":"2024-09-12T22:32:17.285316+0000","last_clean":"2024-09-12T22:32:17.285316+0000","last_became_active":"2024-09-12T22:31:57.100396+0000","last_became_peered":"2024-09-12T22:31:57.100396+0000","last_unstale":"2024-09-12T22:32:17.285316+0000","last_undegraded":"2024-09-12T22:32:17.285316+0000","last_fullsized":"2024-09-12T22:32:17.285316+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:47:33.283161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T22:32:20.295915+0000","last_change":"2024-09-12T22:31:37.419916+0000","last_active":"2024-09-12T22:32:20.295915+0000","last_peered":"2024-09-12T22:32:20.295915+0000","last_clean":"2024-09-12T22:32:20.295915+0000","last_became_active":"2024-09-12T22:31:37.418790+0000","last_became_peered":"2024-09-12T22:31:37.418790+0000","last_unstale":"2024-09-12T22:32:20.295915+0000","last_undegraded":"2024-09-12T22:32:20.295915+0000","last_fullsized":"2024-09-12T22:32:20.295915+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:05:00.440878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T22:32:20.295973+0000","last_change":"2024-09-12T22:31:37.413094+0000","last_active":"2024-09-12T22:32:20.295973+0000","last_peered":"2024-09-12T22:32:20.295973+0000","last_clean":"2024-09-12T22:32:20.295973+0000","last_became_active":"2024-09-12T22:31:37.412746+0000","last_became_peered":"2024-09-12T22:31:37.412746+0000","last_unstale":"2024-09-12T22:32:20.295973+0000","last_undegraded":"2024-09-12T22:32:20.295973+0000","last_fullsized":"2024-09-12T22:32:20.295973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:32:14.415120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T22:32:17.947759+0000","last_change":"2024-09-12T22:31:37.411276+0000","last_active":"2024-09-12T22:32:17.947759+0000","last_peered":"2024-09-12T22:32:17.947759+0000","last_clean":"2024-09-12T22:32:17.947759+0000","last_became_active":"2024-09-12T22:31:37.410380+0000","last_became_peered":"2024-09-12T22:31:37.410380+0000","last_unstale":"2024-09-12T22:32:17.947759+0000","last_undegraded":"2024-09-12T22:32:17.947759+0000","last_fullsized":"2024-09-12T22:32:17.947759+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:12:50.090880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T22:32:20.295601+0000","last_change":"2024-09-12T22:31:37.409177+0000","last_active":"2024-09-12T22:32:20.295601+0000","last_peered":"2024-09-12T22:32:20.295601+0000","last_clean":"2024-09-12T22:32:20.295601+0000","last_became_active":"2024-09-12T22:31:37.408811+0000","last_became_peered":"2024-09-12T22:31:37.408811+0000","last_unstale":"2024-09-12T22:32:20.295601+0000","last_undegraded":"2024-09-12T22:32:20.295601+0000","last_fullsized":"2024-09-12T22:32:20.295601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:17:21.695079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T22:32:20.295660+0000","last_change":"2024-09-12T22:31:37.413023+0000","last_active":"2024-09-12T22:32:20.295660+0000","last_peered":"2024-09-12T22:32:20.295660+0000","last_clean":"2024-09-12T22:32:20.295660+0000","last_became_active":"2024-09-12T22:31:37.412691+0000","last_became_peered":"2024-09-12T22:31:37.412691+0000","last_unstale":"2024-09-12T22:32:20.295660+0000","last_undegraded":"2024-09-12T22:32:20.295660+0000","last_fullsized":"2024-09-12T22:32:20.295660+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:02:36.454134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T22:32:20.295532+0000","last_change":"2024-09-12T22:31:37.411074+0000","last_active":"2024-09-12T22:32:20.295532+0000","last_peered":"2024-09-12T22:32:20.295532+0000","last_clean":"2024-09-12T22:32:20.295532+0000","last_became_active":"2024-09-12T22:31:37.410633+0000","last_became_peered":"2024-09-12T22:31:37.410633+0000","last_unstale":"2024-09-12T22:32:20.295532+0000","last_undegraded":"2024-09-12T22:32:20.295532+0000","last_fullsized":"2024-09-12T22:32:20.295532+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:39:20.383152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T22:32:17.285335+0000","last_change":"2024-09-12T22:31:37.417800+0000","last_active":"2024-09-12T22:32:17.285335+0000","last_peered":"2024-09-12T22:32:17.285335+0000","last_clean":"2024-09-12T22:32:17.285335+0000","last_became_active":"2024-09-12T22:31:37.417355+0000","last_became_peered":"2024-09-12T22:31:37.417355+0000","last_unstale":"2024-09-12T22:32:17.285335+0000","last_undegraded":"2024-09-12T22:32:17.285335+0000","last_fullsized":"2024-09-12T22:32:17.285335+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:10:17.326263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T22:32:17.947988+0000","last_change":"2024-09-12T22:31:37.415967+0000","last_active":"2024-09-12T22:32:17.947988+0000","last_peered":"2024-09-12T22:32:17.947988+0000","last_clean":"2024-09-12T22:32:17.947988+0000","last_became_active":"2024-09-12T22:31:37.415003+0000","last_became_peered":"2024-09-12T22:31:37.415003+0000","last_unstale":"2024-09-12T22:32:17.947988+0000","last_undegraded":"2024-09-12T22:32:17.947988+0000","last_fullsized":"2024-09-12T22:32:17.947988+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:42:32.307876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T22:32:20.296185+0000","last_change":"2024-09-12T22:31:37.414469+0000","last_active":"2024-09-12T22:32:20.296185+0000","last_peered":"2024-09-12T22:32:20.296185+0000","last_clean":"2024-09-12T22:32:20.296185+0000","last_became_active":"2024-09-12T22:31:37.414165+0000","last_became_peered":"2024-09-12T22:31:37.414165+0000","last_unstale":"2024-09-12T22:32:20.296185+0000","last_undegraded":"2024-09-12T22:32:20.296185+0000","last_fullsized":"2024-09-12T22:32:20.296185+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:25:38.148636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T22:32:20.295777+0000","last_change":"2024-09-12T22:31:57.100971+0000","last_active":"2024-09-12T22:32:20.295777+0000","last_peered":"2024-09-12T22:32:20.295777+0000","last_clean":"2024-09-12T22:32:20.295777+0000","last_became_active":"2024-09-12T22:31:57.100610+0000","last_became_peered":"2024-09-12T22:31:57.100610+0000","last_unstale":"2024-09-12T22:32:20.295777+0000","last_undegraded":"2024-09-12T22:32:20.295777+0000","last_fullsized":"2024-09-12T22:32:20.295777+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:07:30.449320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T22:32:17.284944+0000","last_change":"2024-09-12T22:31:57.092903+0000","last_active":"2024-09-12T22:32:17.284944+0000","last_peered":"2024-09-12T22:32:17.284944+0000","last_clean":"2024-09-12T22:32:17.284944+0000","last_became_active":"2024-09-12T22:31:57.092579+0000","last_became_peered":"2024-09-12T22:31:57.092579+0000","last_unstale":"2024-09-12T22:32:17.284944+0000","last_undegraded":"2024-09-12T22:32:17.284944+0000","last_fullsized":"2024-09-12T22:32:17.284944+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:54:35.308603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T22:32:20.295645+0000","last_change":"2024-09-12T22:31:37.414084+0000","last_active":"2024-09-12T22:32:20.295645+0000","last_peered":"2024-09-12T22:32:20.295645+0000","last_clean":"2024-09-12T22:32:20.295645+0000","last_became_active":"2024-09-12T22:31:37.413671+0000","last_became_peered":"2024-09-12T22:31:37.413671+0000","last_unstale":"2024-09-12T22:32:20.295645+0000","last_undegraded":"2024-09-12T22:32:20.295645+0000","last_fullsized":"2024-09-12T22:32:20.295645+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:08:29.199832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T22:32:20.295721+0000","last_change":"2024-09-12T22:31:37.413482+0000","last_active":"2024-09-12T22:32:20.295721+0000","last_peered":"2024-09-12T22:32:20.295721+0000","last_clean":"2024-09-12T22:32:20.295721+0000","last_became_active":"2024-09-12T22:31:37.413195+0000","last_became_peered":"2024-09-12T22:31:37.413195+0000","last_unstale":"2024-09-12T22:32:20.295721+0000","last_undegraded":"2024-09-12T22:32:20.295721+0000","last_fullsized":"2024-09-12T22:32:20.295721+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:22:40.226076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T22:32:20.295533+0000","last_change":"2024-09-12T22:31:37.411006+0000","last_active":"2024-09-12T22:32:20.295533+0000","last_peered":"2024-09-12T22:32:20.295533+0000","last_clean":"2024-09-12T22:32:20.295533+0000","last_became_active":"2024-09-12T22:31:37.410557+0000","last_became_peered":"2024-09-12T22:31:37.410557+0000","last_unstale":"2024-09-12T22:32:20.295533+0000","last_undegraded":"2024-09-12T22:32:20.295533+0000","last_fullsized":"2024-09-12T22:32:20.295533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:08:21.709770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T22:32:17.285669+0000","last_change":"2024-09-12T22:31:37.412450+0000","last_active":"2024-09-12T22:32:17.285669+0000","last_peered":"2024-09-12T22:32:17.285669+0000","last_clean":"2024-09-12T22:32:17.285669+0000","last_became_active":"2024-09-12T22:31:37.412234+0000","last_became_peered":"2024-09-12T22:31:37.412234+0000","last_unstale":"2024-09-12T22:32:17.285669+0000","last_undegraded":"2024-09-12T22:32:17.285669+0000","last_fullsized":"2024-09-12T22:32:17.285669+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:15:59.559809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T22:32:17.285653+0000","last_change":"2024-09-12T22:31:57.100568+0000","last_active":"2024-09-12T22:32:17.285653+0000","last_peered":"2024-09-12T22:32:17.285653+0000","last_clean":"2024-09-12T22:32:17.285653+0000","last_became_active":"2024-09-12T22:31:57.100330+0000","last_became_peered":"2024-09-12T22:31:57.100330+0000","last_unstale":"2024-09-12T22:32:17.285653+0000","last_undegraded":"2024-09-12T22:32:17.285653+0000","last_fullsized":"2024-09-12T22:32:17.285653+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:57:20.571864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T22:32:17.285276+0000","last_change":"2024-09-12T22:31:37.417442+0000","last_active":"2024-09-12T22:32:17.285276+0000","last_peered":"2024-09-12T22:32:17.285276+0000","last_clean":"2024-09-12T22:32:17.285276+0000","last_became_active":"2024-09-12T22:31:37.417133+0000","last_became_peered":"2024-09-12T22:31:37.417133+0000","last_unstale":"2024-09-12T22:32:17.285276+0000","last_undegraded":"2024-09-12T22:32:17.285276+0000","last_fullsized":"2024-09-12T22:32:17.285276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:36.458145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T22:32:20.296004+0000","last_change":"2024-09-12T22:31:37.414235+0000","last_active":"2024-09-12T22:32:20.296004+0000","last_peered":"2024-09-12T22:32:20.296004+0000","last_clean":"2024-09-12T22:32:20.296004+0000","last_became_active":"2024-09-12T22:31:37.413786+0000","last_became_peered":"2024-09-12T22:31:37.413786+0000","last_unstale":"2024-09-12T22:32:20.296004+0000","last_undegraded":"2024-09-12T22:32:20.296004+0000","last_fullsized":"2024-09-12T22:32:20.296004+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:21:11.866973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T22:32:20.296371+0000","last_change":"2024-09-12T22:31:37.415382+0000","last_active":"2024-09-12T22:32:20.296371+0000","last_peered":"2024-09-12T22:32:20.296371+0000","last_clean":"2024-09-12T22:32:20.296371+0000","last_became_active":"2024-09-12T22:31:37.414319+0000","last_became_peered":"2024-09-12T22:31:37.414319+0000","last_unstale":"2024-09-12T22:32:20.296371+0000","last_undegraded":"2024-09-12T22:32:20.296371+0000","last_fullsized":"2024-09-12T22:32:20.296371+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:26:25.578693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T22:32:17.947936+0000","last_change":"2024-09-12T22:31:37.412046+0000","last_active":"2024-09-12T22:32:17.947936+0000","last_peered":"2024-09-12T22:32:17.947936+0000","last_clean":"2024-09-12T22:32:17.947936+0000","last_became_active":"2024-09-12T22:31:37.411623+0000","last_became_peered":"2024-09-12T22:31:37.411623+0000","last_unstale":"2024-09-12T22:32:17.947936+0000","last_undegraded":"2024-09-12T22:32:17.947936+0000","last_fullsized":"2024-09-12T22:32:17.947936+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:24:15.504358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T22:32:17.284671+0000","last_change":"2024-09-12T22:31:37.410364+0000","last_active":"2024-09-12T22:32:17.284671+0000","last_peered":"2024-09-12T22:32:17.284671+0000","last_clean":"2024-09-12T22:32:17.284671+0000","last_became_active":"2024-09-12T22:31:37.409951+0000","last_became_peered":"2024-09-12T22:31:37.409951+0000","last_unstale":"2024-09-12T22:32:17.284671+0000","last_undegraded":"2024-09-12T22:32:17.284671+0000","last_fullsized":"2024-09-12T22:32:17.284671+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:39:17.785755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T22:32:17.284679+0000","last_change":"2024-09-12T22:31:57.092823+0000","last_active":"2024-09-12T22:32:17.284679+0000","last_peered":"2024-09-12T22:32:17.284679+0000","last_clean":"2024-09-12T22:32:17.284679+0000","last_became_active":"2024-09-12T22:31:57.092557+0000","last_became_peered":"2024-09-12T22:31:57.092557+0000","last_unstale":"2024-09-12T22:32:17.284679+0000","last_undegraded":"2024-09-12T22:32:17.284679+0000","last_fullsized":"2024-09-12T22:32:17.284679+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:30:13.033427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T22:32:17.948107+0000","last_change":"2024-09-12T22:31:37.415309+0000","last_active":"2024-09-12T22:32:17.948107+0000","last_peered":"2024-09-12T22:32:17.948107+0000","last_clean":"2024-09-12T22:32:17.948107+0000","last_became_active":"2024-09-12T22:31:37.414792+0000","last_became_peered":"2024-09-12T22:31:37.414792+0000","last_unstale":"2024-09-12T22:32:17.948107+0000","last_undegraded":"2024-09-12T22:32:17.948107+0000","last_fullsized":"2024-09-12T22:32:17.948107+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:08:07.115355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T22:32:17.285589+0000","last_change":"2024-09-12T22:31:37.411880+0000","last_active":"2024-09-12T22:32:17.285589+0000","last_peered":"2024-09-12T22:32:17.285589+0000","last_clean":"2024-09-12T22:32:17.285589+0000","last_became_active":"2024-09-12T22:31:37.410563+0000","last_became_peered":"2024-09-12T22:31:37.410563+0000","last_unstale":"2024-09-12T22:32:17.285589+0000","last_undegraded":"2024-09-12T22:32:17.285589+0000","last_fullsized":"2024-09-12T22:32:17.285589+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:47:52.560533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T22:32:20.296150+0000","last_change":"2024-09-12T22:31:37.419603+0000","last_active":"2024-09-12T22:32:20.296150+0000","last_peered":"2024-09-12T22:32:20.296150+0000","last_clean":"2024-09-12T22:32:20.296150+0000","last_became_active":"2024-09-12T22:31:37.418725+0000","last_became_peered":"2024-09-12T22:31:37.418725+0000","last_unstale":"2024-09-12T22:32:20.296150+0000","last_undegraded":"2024-09-12T22:32:20.296150+0000","last_fullsized":"2024-09-12T22:32:20.296150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:02:44.183545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T22:32:20.295826+0000","last_change":"2024-09-12T22:31:57.100810+0000","last_active":"2024-09-12T22:32:20.295826+0000","last_peered":"2024-09-12T22:32:20.295826+0000","last_clean":"2024-09-12T22:32:20.295826+0000","last_became_active":"2024-09-12T22:31:57.100516+0000","last_became_peered":"2024-09-12T22:31:57.100516+0000","last_unstale":"2024-09-12T22:32:20.295826+0000","last_undegraded":"2024-09-12T22:32:20.295826+0000","last_fullsized":"2024-09-12T22:32:20.295826+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:21:45.140557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T22:32:17.285100+0000","last_change":"2024-09-12T22:31:37.414918+0000","last_active":"2024-09-12T22:32:17.285100+0000","last_peered":"2024-09-12T22:32:17.285100+0000","last_clean":"2024-09-12T22:32:17.285100+0000","last_became_active":"2024-09-12T22:31:37.414225+0000","last_became_peered":"2024-09-12T22:31:37.414225+0000","last_unstale":"2024-09-12T22:32:17.285100+0000","last_undegraded":"2024-09-12T22:32:17.285100+0000","last_fullsized":"2024-09-12T22:32:17.285100+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:56:14.649228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T22:32:17.947756+0000","last_change":"2024-09-12T22:31:37.411569+0000","last_active":"2024-09-12T22:32:17.947756+0000","last_peered":"2024-09-12T22:32:17.947756+0000","last_clean":"2024-09-12T22:32:17.947756+0000","last_became_active":"2024-09-12T22:31:37.410619+0000","last_became_peered":"2024-09-12T22:31:37.410619+0000","last_unstale":"2024-09-12T22:32:17.947756+0000","last_undegraded":"2024-09-12T22:32:17.947756+0000","last_fullsized":"2024-09-12T22:32:17.947756+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:30:01.012271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T22:32:17.284725+0000","last_change":"2024-09-12T22:31:37.415589+0000","last_active":"2024-09-12T22:32:17.284725+0000","last_peered":"2024-09-12T22:32:17.284725+0000","last_clean":"2024-09-12T22:32:17.284725+0000","last_became_active":"2024-09-12T22:31:37.415285+0000","last_became_peered":"2024-09-12T22:31:37.415285+0000","last_unstale":"2024-09-12T22:32:17.284725+0000","last_undegraded":"2024-09-12T22:32:17.284725+0000","last_fullsized":"2024-09-12T22:32:17.284725+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:06:25.913810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T22:32:20.295676+0000","last_change":"2024-09-12T22:31:37.415190+0000","last_active":"2024-09-12T22:32:20.295676+0000","last_peered":"2024-09-12T22:32:20.295676+0000","last_clean":"2024-09-12T22:32:20.295676+0000","last_became_active":"2024-09-12T22:31:37.414265+0000","last_became_peered":"2024-09-12T22:31:37.414265+0000","last_unstale":"2024-09-12T22:32:20.295676+0000","last_undegraded":"2024-09-12T22:32:20.295676+0000","last_fullsized":"2024-09-12T22:32:20.295676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:07:02.173590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T22:32:17.285152+0000","last_change":"2024-09-12T22:31:57.100582+0000","last_active":"2024-09-12T22:32:17.285152+0000","last_peered":"2024-09-12T22:32:17.285152+0000","last_clean":"2024-09-12T22:32:17.285152+0000","last_became_active":"2024-09-12T22:31:57.100321+0000","last_became_peered":"2024-09-12T22:31:57.100321+0000","last_unstale":"2024-09-12T22:32:17.285152+0000","last_undegraded":"2024-09-12T22:32:17.285152+0000","last_fullsized":"2024-09-12T22:32:17.285152+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:59:36.843984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"19'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T22:32:20.296282+0000","last_change":"2024-09-12T22:31:36.412082+0000","last_active":"2024-09-12T22:32:20.296282+0000","last_peered":"2024-09-12T22:32:20.296282+0000","last_clean":"2024-09-12T22:32:20.296282+0000","last_became_active":"2024-09-12T22:31:36.410871+0000","last_became_peered":"2024-09-12T22:31:36.410871+0000","last_unstale":"2024-09-12T22:32:20.296282+0000","last_undegraded":"2024-09-12T22:32:20.296282+0000","last_fullsized":"2024-09-12T22:32:20.296282+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:30:49.127253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T22:32:17.948204+0000","last_change":"2024-09-12T22:31:37.411790+0000","last_active":"2024-09-12T22:32:17.948204+0000","last_peered":"2024-09-12T22:32:17.948204+0000","last_clean":"2024-09-12T22:32:17.948204+0000","last_became_active":"2024-09-12T22:31:37.411414+0000","last_became_peered":"2024-09-12T22:31:37.411414+0000","last_unstale":"2024-09-12T22:32:17.948204+0000","last_undegraded":"2024-09-12T22:32:17.948204+0000","last_fullsized":"2024-09-12T22:32:17.948204+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:22:40.226076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T22:32:17.284938+0000","last_change":"2024-09-12T22:31:36.408563+0000","last_active":"2024-09-12T22:32:17.284938+0000","last_peered":"2024-09-12T22:32:17.284938+0000","last_clean":"2024-09-12T22:32:17.284938+0000","last_became_active":"2024-09-12T22:31:36.407447+0000","last_became_peered":"2024-09-12T22:31:36.407447+0000","last_unstale":"2024-09-12T22:32:17.284938+0000","last_undegraded":"2024-09-12T22:32:17.284938+0000","last_fullsized":"2024-09-12T22:32:17.284938+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:29:37.933109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T22:32:17.285733+0000","last_change":"2024-09-12T22:31:37.411680+0000","last_active":"2024-09-12T22:32:17.285733+0000","last_peered":"2024-09-12T22:32:17.285733+0000","last_clean":"2024-09-12T22:32:17.285733+0000","last_became_active":"2024-09-12T22:31:37.411168+0000","last_became_peered":"2024-09-12T22:31:37.411168+0000","last_unstale":"2024-09-12T22:32:17.285733+0000","last_undegraded":"2024-09-12T22:32:17.285733+0000","last_fullsized":"2024-09-12T22:32:17.285733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:27.706282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T22:32:17.948504+0000","last_change":"2024-09-12T22:31:36.411271+0000","last_active":"2024-09-12T22:32:17.948504+0000","last_peered":"2024-09-12T22:32:17.948504+0000","last_clean":"2024-09-12T22:32:17.948504+0000","last_became_active":"2024-09-12T22:31:36.410706+0000","last_became_peered":"2024-09-12T22:31:36.410706+0000","last_unstale":"2024-09-12T22:32:17.948504+0000","last_undegraded":"2024-09-12T22:32:17.948504+0000","last_fullsized":"2024-09-12T22:32:17.948504+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:43:22.805855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T22:32:17.285511+0000","last_change":"2024-09-12T22:31:37.411218+0000","last_active":"2024-09-12T22:32:17.285511+0000","last_peered":"2024-09-12T22:32:17.285511+0000","last_clean":"2024-09-12T22:32:17.285511+0000","last_became_active":"2024-09-12T22:31:37.409666+0000","last_became_peered":"2024-09-12T22:31:37.409666+0000","last_unstale":"2024-09-12T22:32:17.285511+0000","last_undegraded":"2024-09-12T22:32:17.285511+0000","last_fullsized":"2024-09-12T22:32:17.285511+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:45:34.230090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"19'8","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T22:32:20.295785+0000","last_change":"2024-09-12T22:31:36.411811+0000","last_active":"2024-09-12T22:32:20.295785+0000","last_peered":"2024-09-12T22:32:20.295785+0000","last_clean":"2024-09-12T22:32:20.295785+0000","last_became_active":"2024-09-12T22:31:36.410101+0000","last_became_peered":"2024-09-12T22:31:36.410101+0000","last_unstale":"2024-09-12T22:32:20.295785+0000","last_undegraded":"2024-09-12T22:32:20.295785+0000","last_fullsized":"2024-09-12T22:32:20.295785+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:33:02.410148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"19'1","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T22:32:20.296430+0000","last_change":"2024-09-12T22:31:36.410970+0000","last_active":"2024-09-12T22:32:20.296430+0000","last_peered":"2024-09-12T22:32:20.296430+0000","last_clean":"2024-09-12T22:32:20.296430+0000","last_became_active":"2024-09-12T22:31:36.409754+0000","last_became_peered":"2024-09-12T22:31:36.409754+0000","last_unstale":"2024-09-12T22:32:20.296430+0000","last_undegraded":"2024-09-12T22:32:20.296430+0000","last_fullsized":"2024-09-12T22:32:20.296430+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:30:07.724418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T22:32:17.947700+0000","last_change":"2024-09-12T22:31:37.415050+0000","last_active":"2024-09-12T22:32:17.947700+0000","last_peered":"2024-09-12T22:32:17.947700+0000","last_clean":"2024-09-12T22:32:17.947700+0000","last_became_active":"2024-09-12T22:31:37.414290+0000","last_became_peered":"2024-09-12T22:31:37.414290+0000","last_unstale":"2024-09-12T22:32:17.947700+0000","last_undegraded":"2024-09-12T22:32:17.947700+0000","last_fullsized":"2024-09-12T22:32:17.947700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:47:15.502575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"19'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T22:32:17.949077+0000","last_change":"2024-09-12T22:31:36.411725+0000","last_active":"2024-09-12T22:32:17.949077+0000","last_peered":"2024-09-12T22:32:17.949077+0000","last_clean":"2024-09-12T22:32:17.949077+0000","last_became_active":"2024-09-12T22:31:36.411407+0000","last_became_peered":"2024-09-12T22:31:36.411407+0000","last_unstale":"2024-09-12T22:32:17.949077+0000","last_undegraded":"2024-09-12T22:32:17.949077+0000","last_fullsized":"2024-09-12T22:32:17.949077+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:30:07.724418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T22:32:17.284857+0000","last_change":"2024-09-12T22:31:57.092727+0000","last_active":"2024-09-12T22:32:17.284857+0000","last_peered":"2024-09-12T22:32:17.284857+0000","last_clean":"2024-09-12T22:32:17.284857+0000","last_became_active":"2024-09-12T22:31:57.092446+0000","last_became_peered":"2024-09-12T22:31:57.092446+0000","last_unstale":"2024-09-12T22:32:17.284857+0000","last_undegraded":"2024-09-12T22:32:17.284857+0000","last_fullsized":"2024-09-12T22:32:17.284857+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:09:14.524447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"19'1","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T22:32:20.296443+0000","last_change":"2024-09-12T22:31:36.411320+0000","last_active":"2024-09-12T22:32:20.296443+0000","last_peered":"2024-09-12T22:32:20.296443+0000","last_clean":"2024-09-12T22:32:20.296443+0000","last_became_active":"2024-09-12T22:31:36.409837+0000","last_became_peered":"2024-09-12T22:31:36.409837+0000","last_unstale":"2024-09-12T22:32:20.296443+0000","last_undegraded":"2024-09-12T22:32:20.296443+0000","last_fullsized":"2024-09-12T22:32:20.296443+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:36:53.914922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T22:32:20.295707+0000","last_change":"2024-09-12T22:31:37.414809+0000","last_active":"2024-09-12T22:32:20.295707+0000","last_peered":"2024-09-12T22:32:20.295707+0000","last_clean":"2024-09-12T22:32:20.295707+0000","last_became_active":"2024-09-12T22:31:37.414492+0000","last_became_peered":"2024-09-12T22:31:37.414492+0000","last_unstale":"2024-09-12T22:32:20.295707+0000","last_undegraded":"2024-09-12T22:32:20.295707+0000","last_fullsized":"2024-09-12T22:32:20.295707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:50:48.426898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T22:32:20.296299+0000","last_change":"2024-09-12T22:31:36.412068+0000","last_active":"2024-09-12T22:32:20.296299+0000","last_peered":"2024-09-12T22:32:20.296299+0000","last_clean":"2024-09-12T22:32:20.296299+0000","last_became_active":"2024-09-12T22:31:36.411366+0000","last_became_peered":"2024-09-12T22:31:36.411366+0000","last_unstale":"2024-09-12T22:32:20.296299+0000","last_undegraded":"2024-09-12T22:32:20.296299+0000","last_fullsized":"2024-09-12T22:32:20.296299+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:35:51.647051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T22:32:17.285159+0000","last_change":"2024-09-12T22:31:37.410303+0000","last_active":"2024-09-12T22:32:17.285159+0000","last_peered":"2024-09-12T22:32:17.285159+0000","last_clean":"2024-09-12T22:32:17.285159+0000","last_became_active":"2024-09-12T22:31:37.409607+0000","last_became_peered":"2024-09-12T22:31:37.409607+0000","last_unstale":"2024-09-12T22:32:17.285159+0000","last_undegraded":"2024-09-12T22:32:17.285159+0000","last_fullsized":"2024-09-12T22:32:17.285159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:53:42.732654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"19'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T22:32:17.285320+0000","last_change":"2024-09-12T22:31:36.407974+0000","last_active":"2024-09-12T22:32:17.285320+0000","last_peered":"2024-09-12T22:32:17.285320+0000","last_clean":"2024-09-12T22:32:17.285320+0000","last_became_active":"2024-09-12T22:31:36.406955+0000","last_became_peered":"2024-09-12T22:31:36.406955+0000","last_unstale":"2024-09-12T22:32:17.285320+0000","last_undegraded":"2024-09-12T22:32:17.285320+0000","last_fullsized":"2024-09-12T22:32:17.285320+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:07:34.831264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T22:32:20.296070+0000","last_change":"2024-09-12T22:31:37.415285+0000","last_active":"2024-09-12T22:32:20.296070+0000","last_peered":"2024-09-12T22:32:20.296070+0000","last_clean":"2024-09-12T22:32:20.296070+0000","last_became_active":"2024-09-12T22:31:37.414890+0000","last_became_peered":"2024-09-12T22:31:37.414890+0000","last_unstale":"2024-09-12T22:32:20.296070+0000","last_undegraded":"2024-09-12T22:32:20.296070+0000","last_fullsized":"2024-09-12T22:32:20.296070+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:38:16.956786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T22:32:20.295817+0000","last_change":"2024-09-12T22:31:36.412147+0000","last_active":"2024-09-12T22:32:20.295817+0000","last_peered":"2024-09-12T22:32:20.295817+0000","last_clean":"2024-09-12T22:32:20.295817+0000","last_became_active":"2024-09-12T22:31:36.411382+0000","last_became_peered":"2024-09-12T22:31:36.411382+0000","last_unstale":"2024-09-12T22:32:20.295817+0000","last_undegraded":"2024-09-12T22:32:20.295817+0000","last_fullsized":"2024-09-12T22:32:20.295817+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:54:51.454867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T22:32:20.296325+0000","last_change":"2024-09-12T22:31:37.420209+0000","last_active":"2024-09-12T22:32:20.296325+0000","last_peered":"2024-09-12T22:32:20.296325+0000","last_clean":"2024-09-12T22:32:20.296325+0000","last_became_active":"2024-09-12T22:31:37.419267+0000","last_became_peered":"2024-09-12T22:31:37.419267+0000","last_unstale":"2024-09-12T22:32:20.296325+0000","last_undegraded":"2024-09-12T22:32:20.296325+0000","last_fullsized":"2024-09-12T22:32:20.296325+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:36.790111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T22:32:17.948537+0000","last_change":"2024-09-12T22:31:36.411190+0000","last_active":"2024-09-12T22:32:17.948537+0000","last_peered":"2024-09-12T22:32:17.948537+0000","last_clean":"2024-09-12T22:32:17.948537+0000","last_became_active":"2024-09-12T22:31:36.410548+0000","last_became_peered":"2024-09-12T22:31:36.410548+0000","last_unstale":"2024-09-12T22:32:17.948537+0000","last_undegraded":"2024-09-12T22:32:17.948537+0000","last_fullsized":"2024-09-12T22:32:17.948537+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:10:20.300894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T22:32:20.296244+0000","last_change":"2024-09-12T22:31:37.418749+0000","last_active":"2024-09-12T22:32:20.296244+0000","last_peered":"2024-09-12T22:32:20.296244+0000","last_clean":"2024-09-12T22:32:20.296244+0000","last_became_active":"2024-09-12T22:31:37.418360+0000","last_became_peered":"2024-09-12T22:31:37.418360+0000","last_unstale":"2024-09-12T22:32:20.296244+0000","last_undegraded":"2024-09-12T22:32:20.296244+0000","last_fullsized":"2024-09-12T22:32:20.296244+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:50:08.152699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T22:32:17.948503+0000","last_change":"2024-09-12T22:31:36.412187+0000","last_active":"2024-09-12T22:32:17.948503+0000","last_peered":"2024-09-12T22:32:17.948503+0000","last_clean":"2024-09-12T22:32:17.948503+0000","last_became_active":"2024-09-12T22:31:36.411935+0000","last_became_peered":"2024-09-12T22:31:36.411935+0000","last_unstale":"2024-09-12T22:32:17.948503+0000","last_undegraded":"2024-09-12T22:32:17.948503+0000","last_fullsized":"2024-09-12T22:32:17.948503+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:41:04.029445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T22:32:17.285532+0000","last_change":"2024-09-12T22:31:37.417881+0000","last_active":"2024-09-12T22:32:17.285532+0000","last_peered":"2024-09-12T22:32:17.285532+0000","last_clean":"2024-09-12T22:32:17.285532+0000","last_became_active":"2024-09-12T22:31:37.417572+0000","last_became_peered":"2024-09-12T22:31:37.417572+0000","last_unstale":"2024-09-12T22:32:17.285532+0000","last_undegraded":"2024-09-12T22:32:17.285532+0000","last_fullsized":"2024-09-12T22:32:17.285532+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:19:16.367589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":250,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T22:32:20.296047+0000","last_change":"2024-09-12T22:31:27.631847+0000","last_active":"2024-09-12T22:32:20.296047+0000","last_peered":"2024-09-12T22:32:20.296047+0000","last_clean":"2024-09-12T22:32:20.296047+0000","last_became_active":"2024-09-12T22:31:27.631027+0000","last_became_peered":"2024-09-12T22:31:27.631027+0000","last_unstale":"2024-09-12T22:32:20.296047+0000","last_undegraded":"2024-09-12T22:32:20.296047+0000","last_fullsized":"2024-09-12T22:32:20.296047+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:26.229539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:26.229539+0000","last_clean_scrub_stamp":"2024-09-12T22:31:26.229539+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:59:24.181319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T22:32:20.296471+0000","last_change":"2024-09-12T22:31:34.286952+0000","last_active":"2024-09-12T22:32:20.296471+0000","last_peered":"2024-09-12T22:32:20.296471+0000","last_clean":"2024-09-12T22:32:20.296471+0000","last_became_active":"2024-09-12T22:31:32.283661+0000","last_became_peered":"2024-09-12T22:31:32.283661+0000","last_unstale":"2024-09-12T22:32:20.296471+0000","last_undegraded":"2024-09-12T22:32:20.296471+0000","last_fullsized":"2024-09-12T22:32:20.296471+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:21.681390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000621274,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T22:32:17.285068+0000","last_change":"2024-09-12T22:31:36.411275+0000","last_active":"2024-09-12T22:32:17.285068+0000","last_peered":"2024-09-12T22:32:17.285068+0000","last_clean":"2024-09-12T22:32:17.285068+0000","last_became_active":"2024-09-12T22:31:36.410595+0000","last_became_peered":"2024-09-12T22:31:36.410595+0000","last_unstale":"2024-09-12T22:32:17.285068+0000","last_undegraded":"2024-09-12T22:32:17.285068+0000","last_fullsized":"2024-09-12T22:32:17.285068+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:38:14.895625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T22:32:20.296410+0000","last_change":"2024-09-12T22:31:37.419976+0000","last_active":"2024-09-12T22:32:20.296410+0000","last_peered":"2024-09-12T22:32:20.296410+0000","last_clean":"2024-09-12T22:32:20.296410+0000","last_became_active":"2024-09-12T22:31:37.419161+0000","last_became_peered":"2024-09-12T22:31:37.419161+0000","last_unstale":"2024-09-12T22:32:20.296410+0000","last_undegraded":"2024-09-12T22:32:20.296410+0000","last_fullsized":"2024-09-12T22:32:20.296410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:07:26.070097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T22:32:20.295981+0000","last_change":"2024-09-12T22:31:34.286642+0000","last_active":"2024-09-12T22:32:20.295981+0000","last_peered":"2024-09-12T22:32:20.295981+0000","last_clean":"2024-09-12T22:32:20.295981+0000","last_became_active":"2024-09-12T22:31:32.283601+0000","last_became_peered":"2024-09-12T22:31:32.283601+0000","last_unstale":"2024-09-12T22:32:20.295981+0000","last_undegraded":"2024-09-12T22:32:20.295981+0000","last_fullsized":"2024-09-12T22:32:20.295981+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:40:06.769540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037858999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T22:32:17.285148+0000","last_change":"2024-09-12T22:31:36.407395+0000","last_active":"2024-09-12T22:32:17.285148+0000","last_peered":"2024-09-12T22:32:17.285148+0000","last_clean":"2024-09-12T22:32:17.285148+0000","last_became_active":"2024-09-12T22:31:36.406770+0000","last_became_peered":"2024-09-12T22:31:36.406770+0000","last_unstale":"2024-09-12T22:32:17.285148+0000","last_undegraded":"2024-09-12T22:32:17.285148+0000","last_fullsized":"2024-09-12T22:32:17.285148+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:49:26.547848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T22:32:17.947982+0000","last_change":"2024-09-12T22:31:37.414075+0000","last_active":"2024-09-12T22:32:17.947982+0000","last_peered":"2024-09-12T22:32:17.947982+0000","last_clean":"2024-09-12T22:32:17.947982+0000","last_became_active":"2024-09-12T22:31:37.413491+0000","last_became_peered":"2024-09-12T22:31:37.413491+0000","last_unstale":"2024-09-12T22:32:17.947982+0000","last_undegraded":"2024-09-12T22:32:17.947982+0000","last_fullsized":"2024-09-12T22:32:17.947982+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:26:25.578693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T22:32:17.285327+0000","last_change":"2024-09-12T22:31:34.286394+0000","last_active":"2024-09-12T22:32:17.285327+0000","last_peered":"2024-09-12T22:32:17.285327+0000","last_clean":"2024-09-12T22:32:17.285327+0000","last_became_active":"2024-09-12T22:31:32.280062+0000","last_became_peered":"2024-09-12T22:31:32.280062+0000","last_unstale":"2024-09-12T22:32:17.285327+0000","last_undegraded":"2024-09-12T22:32:17.285327+0000","last_fullsized":"2024-09-12T22:32:17.285327+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:20:23.663838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039540700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T22:32:20.295392+0000","last_change":"2024-09-12T22:31:57.100816+0000","last_active":"2024-09-12T22:32:20.295392+0000","last_peered":"2024-09-12T22:32:20.295392+0000","last_clean":"2024-09-12T22:32:20.295392+0000","last_became_active":"2024-09-12T22:31:57.100392+0000","last_became_peered":"2024-09-12T22:31:57.100392+0000","last_unstale":"2024-09-12T22:32:20.295392+0000","last_undegraded":"2024-09-12T22:32:20.295392+0000","last_fullsized":"2024-09-12T22:32:20.295392+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:06:12.881182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T22:32:17.285563+0000","last_change":"2024-09-12T22:31:37.417636+0000","last_active":"2024-09-12T22:32:17.285563+0000","last_peered":"2024-09-12T22:32:17.285563+0000","last_clean":"2024-09-12T22:32:17.285563+0000","last_became_active":"2024-09-12T22:31:37.417230+0000","last_became_peered":"2024-09-12T22:31:37.417230+0000","last_unstale":"2024-09-12T22:32:17.285563+0000","last_undegraded":"2024-09-12T22:32:17.285563+0000","last_fullsized":"2024-09-12T22:32:17.285563+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:44:29.729122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T22:32:20.295922+0000","last_change":"2024-09-12T22:31:34.286938+0000","last_active":"2024-09-12T22:32:20.295922+0000","last_peered":"2024-09-12T22:32:20.295922+0000","last_clean":"2024-09-12T22:32:20.295922+0000","last_became_active":"2024-09-12T22:31:32.282230+0000","last_became_peered":"2024-09-12T22:31:32.282230+0000","last_unstale":"2024-09-12T22:32:20.295922+0000","last_undegraded":"2024-09-12T22:32:20.295922+0000","last_fullsized":"2024-09-12T22:32:20.295922+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:11:05.988384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000615758,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T22:32:20.296418+0000","last_change":"2024-09-12T22:31:36.410694+0000","last_active":"2024-09-12T22:32:20.296418+0000","last_peered":"2024-09-12T22:32:20.296418+0000","last_clean":"2024-09-12T22:32:20.296418+0000","last_became_active":"2024-09-12T22:31:36.409816+0000","last_became_peered":"2024-09-12T22:31:36.409816+0000","last_unstale":"2024-09-12T22:32:20.296418+0000","last_undegraded":"2024-09-12T22:32:20.296418+0000","last_fullsized":"2024-09-12T22:32:20.296418+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:40:35.369213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T22:32:17.285384+0000","last_change":"2024-09-12T22:31:37.414608+0000","last_active":"2024-09-12T22:32:17.285384+0000","last_peered":"2024-09-12T22:32:17.285384+0000","last_clean":"2024-09-12T22:32:17.285384+0000","last_became_active":"2024-09-12T22:31:37.414307+0000","last_became_peered":"2024-09-12T22:31:37.414307+0000","last_unstale":"2024-09-12T22:32:17.285384+0000","last_undegraded":"2024-09-12T22:32:17.285384+0000","last_fullsized":"2024-09-12T22:32:17.285384+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:41:21.231511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T22:32:20.296535+0000","last_change":"2024-09-12T22:31:36.411355+0000","last_active":"2024-09-12T22:32:20.296535+0000","last_peered":"2024-09-12T22:32:20.296535+0000","last_clean":"2024-09-12T22:32:20.296535+0000","last_became_active":"2024-09-12T22:31:36.410529+0000","last_became_peered":"2024-09-12T22:31:36.410529+0000","last_unstale":"2024-09-12T22:32:20.296535+0000","last_undegraded":"2024-09-12T22:32:20.296535+0000","last_fullsized":"2024-09-12T22:32:20.296535+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:19:47.356688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T22:32:17.285480+0000","last_change":"2024-09-12T22:31:34.286457+0000","last_active":"2024-09-12T22:32:17.285480+0000","last_peered":"2024-09-12T22:32:17.285480+0000","last_clean":"2024-09-12T22:32:17.285480+0000","last_became_active":"2024-09-12T22:31:32.280007+0000","last_became_peered":"2024-09-12T22:31:32.280007+0000","last_unstale":"2024-09-12T22:32:17.285480+0000","last_undegraded":"2024-09-12T22:32:17.285480+0000","last_fullsized":"2024-09-12T22:32:17.285480+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:09.068038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041972500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T22:32:17.947739+0000","last_change":"2024-09-12T22:31:37.410386+0000","last_active":"2024-09-12T22:32:17.947739+0000","last_peered":"2024-09-12T22:32:17.947739+0000","last_clean":"2024-09-12T22:32:17.947739+0000","last_became_active":"2024-09-12T22:31:37.409928+0000","last_became_peered":"2024-09-12T22:31:37.409928+0000","last_unstale":"2024-09-12T22:32:17.947739+0000","last_undegraded":"2024-09-12T22:32:17.947739+0000","last_fullsized":"2024-09-12T22:32:17.947739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:02:36.454134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T22:32:17.285428+0000","last_change":"2024-09-12T22:31:36.410324+0000","last_active":"2024-09-12T22:32:17.285428+0000","last_peered":"2024-09-12T22:32:17.285428+0000","last_clean":"2024-09-12T22:32:17.285428+0000","last_became_active":"2024-09-12T22:31:36.409199+0000","last_became_peered":"2024-09-12T22:31:36.409199+0000","last_unstale":"2024-09-12T22:32:17.285428+0000","last_undegraded":"2024-09-12T22:32:17.285428+0000","last_fullsized":"2024-09-12T22:32:17.285428+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:06:54.608936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T22:32:17.948996+0000","last_change":"2024-09-12T22:31:34.839044+0000","last_active":"2024-09-12T22:32:17.948996+0000","last_peered":"2024-09-12T22:32:17.948996+0000","last_clean":"2024-09-12T22:32:17.948996+0000","last_became_active":"2024-09-12T22:31:32.279671+0000","last_became_peered":"2024-09-12T22:31:32.279671+0000","last_unstale":"2024-09-12T22:32:17.948996+0000","last_undegraded":"2024-09-12T22:32:17.948996+0000","last_fullsized":"2024-09-12T22:32:17.948996+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:27:49.809935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036776499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T22:32:20.295668+0000","last_change":"2024-09-12T22:31:57.100721+0000","last_active":"2024-09-12T22:32:20.295668+0000","last_peered":"2024-09-12T22:32:20.295668+0000","last_clean":"2024-09-12T22:32:20.295668+0000","last_became_active":"2024-09-12T22:31:57.100426+0000","last_became_peered":"2024-09-12T22:31:57.100426+0000","last_unstale":"2024-09-12T22:32:20.295668+0000","last_undegraded":"2024-09-12T22:32:20.295668+0000","last_fullsized":"2024-09-12T22:32:20.295668+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:14:31.890006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"19'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T22:32:17.285722+0000","last_change":"2024-09-12T22:31:36.409397+0000","last_active":"2024-09-12T22:32:17.285722+0000","last_peered":"2024-09-12T22:32:17.285722+0000","last_clean":"2024-09-12T22:32:17.285722+0000","last_became_active":"2024-09-12T22:31:36.408787+0000","last_became_peered":"2024-09-12T22:31:36.408787+0000","last_unstale":"2024-09-12T22:32:17.285722+0000","last_undegraded":"2024-09-12T22:32:17.285722+0000","last_fullsized":"2024-09-12T22:32:17.285722+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:29:03.467352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T22:32:17.285828+0000","last_change":"2024-09-12T22:31:34.286639+0000","last_active":"2024-09-12T22:32:17.285828+0000","last_peered":"2024-09-12T22:32:17.285828+0000","last_clean":"2024-09-12T22:32:17.285828+0000","last_became_active":"2024-09-12T22:31:32.280092+0000","last_became_peered":"2024-09-12T22:31:32.280092+0000","last_unstale":"2024-09-12T22:32:17.285828+0000","last_undegraded":"2024-09-12T22:32:17.285828+0000","last_fullsized":"2024-09-12T22:32:17.285828+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:02:40.821530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058589999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T22:32:17.284958+0000","last_change":"2024-09-12T22:31:37.411152+0000","last_active":"2024-09-12T22:32:17.284958+0000","last_peered":"2024-09-12T22:32:17.284958+0000","last_clean":"2024-09-12T22:32:17.284958+0000","last_became_active":"2024-09-12T22:31:37.410558+0000","last_became_peered":"2024-09-12T22:31:37.410558+0000","last_unstale":"2024-09-12T22:32:17.284958+0000","last_undegraded":"2024-09-12T22:32:17.284958+0000","last_fullsized":"2024-09-12T22:32:17.284958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:14:29.892478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"27'3","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T22:32:17.285771+0000","last_change":"2024-09-12T22:31:36.407460+0000","last_active":"2024-09-12T22:32:17.285771+0000","last_peered":"2024-09-12T22:32:17.285771+0000","last_clean":"2024-09-12T22:32:17.285771+0000","last_became_active":"2024-09-12T22:31:36.406729+0000","last_became_peered":"2024-09-12T22:31:36.406729+0000","last_unstale":"2024-09-12T22:32:17.285771+0000","last_undegraded":"2024-09-12T22:32:17.285771+0000","last_fullsized":"2024-09-12T22:32:17.285771+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:27:58.012573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T22:32:20.296500+0000","last_change":"2024-09-12T22:31:34.286699+0000","last_active":"2024-09-12T22:32:20.296500+0000","last_peered":"2024-09-12T22:32:20.296500+0000","last_clean":"2024-09-12T22:32:20.296500+0000","last_became_active":"2024-09-12T22:31:32.283606+0000","last_became_peered":"2024-09-12T22:31:32.283606+0000","last_unstale":"2024-09-12T22:32:20.296500+0000","last_undegraded":"2024-09-12T22:32:20.296500+0000","last_fullsized":"2024-09-12T22:32:20.296500+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:09:32.050798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000382109,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T22:32:17.947735+0000","last_change":"2024-09-12T22:31:37.410011+0000","last_active":"2024-09-12T22:32:17.947735+0000","last_peered":"2024-09-12T22:32:17.947735+0000","last_clean":"2024-09-12T22:32:17.947735+0000","last_became_active":"2024-09-12T22:31:37.409320+0000","last_became_peered":"2024-09-12T22:31:37.409320+0000","last_unstale":"2024-09-12T22:32:17.947735+0000","last_undegraded":"2024-09-12T22:32:17.947735+0000","last_fullsized":"2024-09-12T22:32:17.947735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:27:23.661444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T22:32:20.296065+0000","last_change":"2024-09-12T22:31:37.415670+0000","last_active":"2024-09-12T22:32:20.296065+0000","last_peered":"2024-09-12T22:32:20.296065+0000","last_clean":"2024-09-12T22:32:20.296065+0000","last_became_active":"2024-09-12T22:31:37.415007+0000","last_became_peered":"2024-09-12T22:31:37.415007+0000","last_unstale":"2024-09-12T22:32:20.296065+0000","last_undegraded":"2024-09-12T22:32:20.296065+0000","last_fullsized":"2024-09-12T22:32:20.296065+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:42:51.694128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"27'10","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T22:32:20.296179+0000","last_change":"2024-09-12T22:31:36.409878+0000","last_active":"2024-09-12T22:32:20.296179+0000","last_peered":"2024-09-12T22:32:20.296179+0000","last_clean":"2024-09-12T22:32:20.296179+0000","last_became_active":"2024-09-12T22:31:36.409132+0000","last_became_peered":"2024-09-12T22:31:36.409132+0000","last_unstale":"2024-09-12T22:32:20.296179+0000","last_undegraded":"2024-09-12T22:32:20.296179+0000","last_fullsized":"2024-09-12T22:32:20.296179+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:09:56.081385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6555,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T22:32:17.284806+0000","last_change":"2024-09-12T22:31:37.414914+0000","last_active":"2024-09-12T22:32:17.284806+0000","last_peered":"2024-09-12T22:32:17.284806+0000","last_clean":"2024-09-12T22:32:17.284806+0000","last_became_active":"2024-09-12T22:31:37.414535+0000","last_became_peered":"2024-09-12T22:31:37.414535+0000","last_unstale":"2024-09-12T22:32:17.284806+0000","last_undegraded":"2024-09-12T22:32:17.284806+0000","last_fullsized":"2024-09-12T22:32:17.284806+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:14:37.010786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"19'3","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T22:32:20.296279+0000","last_change":"2024-09-12T22:31:57.101007+0000","last_active":"2024-09-12T22:32:20.296279+0000","last_peered":"2024-09-12T22:32:20.296279+0000","last_clean":"2024-09-12T22:32:20.296279+0000","last_became_active":"2024-09-12T22:31:57.100640+0000","last_became_peered":"2024-09-12T22:31:57.100640+0000","last_unstale":"2024-09-12T22:32:20.296279+0000","last_undegraded":"2024-09-12T22:32:20.296279+0000","last_fullsized":"2024-09-12T22:32:20.296279+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:37:12.949001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T22:32:20.296365+0000","last_change":"2024-09-12T22:31:36.411549+0000","last_active":"2024-09-12T22:32:20.296365+0000","last_peered":"2024-09-12T22:32:20.296365+0000","last_clean":"2024-09-12T22:32:20.296365+0000","last_became_active":"2024-09-12T22:31:36.410674+0000","last_became_peered":"2024-09-12T22:31:36.410674+0000","last_unstale":"2024-09-12T22:32:20.296365+0000","last_undegraded":"2024-09-12T22:32:20.296365+0000","last_fullsized":"2024-09-12T22:32:20.296365+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:58:05.676197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T22:32:17.285362+0000","last_change":"2024-09-12T22:31:37.411254+0000","last_active":"2024-09-12T22:32:17.285362+0000","last_peered":"2024-09-12T22:32:17.285362+0000","last_clean":"2024-09-12T22:32:17.285362+0000","last_became_active":"2024-09-12T22:31:37.410404+0000","last_became_peered":"2024-09-12T22:31:37.410404+0000","last_unstale":"2024-09-12T22:32:17.285362+0000","last_undegraded":"2024-09-12T22:32:17.285362+0000","last_fullsized":"2024-09-12T22:32:17.285362+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:42:00.856616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T22:32:17.285665+0000","last_change":"2024-09-12T22:31:36.408390+0000","last_active":"2024-09-12T22:32:17.285665+0000","last_peered":"2024-09-12T22:32:17.285665+0000","last_clean":"2024-09-12T22:32:17.285665+0000","last_became_active":"2024-09-12T22:31:36.407062+0000","last_became_peered":"2024-09-12T22:31:36.407062+0000","last_unstale":"2024-09-12T22:32:17.285665+0000","last_undegraded":"2024-09-12T22:32:17.285665+0000","last_fullsized":"2024-09-12T22:32:17.285665+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:09:10.618195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T22:32:17.284827+0000","last_change":"2024-09-12T22:31:37.416629+0000","last_active":"2024-09-12T22:32:17.284827+0000","last_peered":"2024-09-12T22:32:17.284827+0000","last_clean":"2024-09-12T22:32:17.284827+0000","last_became_active":"2024-09-12T22:31:37.416387+0000","last_became_peered":"2024-09-12T22:31:37.416387+0000","last_unstale":"2024-09-12T22:32:17.284827+0000","last_undegraded":"2024-09-12T22:32:17.284827+0000","last_fullsized":"2024-09-12T22:32:17.284827+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:59:52.020560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T22:32:17.948194+0000","last_change":"2024-09-12T22:31:37.413777+0000","last_active":"2024-09-12T22:32:17.948194+0000","last_peered":"2024-09-12T22:32:17.948194+0000","last_clean":"2024-09-12T22:32:17.948194+0000","last_became_active":"2024-09-12T22:31:37.412669+0000","last_became_peered":"2024-09-12T22:31:37.412669+0000","last_unstale":"2024-09-12T22:32:17.948194+0000","last_undegraded":"2024-09-12T22:32:17.948194+0000","last_fullsized":"2024-09-12T22:32:17.948194+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:42:17.728844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T22:32:17.284993+0000","last_change":"2024-09-12T22:31:36.409466+0000","last_active":"2024-09-12T22:32:17.284993+0000","last_peered":"2024-09-12T22:32:17.284993+0000","last_clean":"2024-09-12T22:32:17.284993+0000","last_became_active":"2024-09-12T22:31:36.408796+0000","last_became_peered":"2024-09-12T22:31:36.408796+0000","last_unstale":"2024-09-12T22:32:17.284993+0000","last_undegraded":"2024-09-12T22:32:17.284993+0000","last_fullsized":"2024-09-12T22:32:17.284993+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:03:39.648159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T22:32:17.285641+0000","last_change":"2024-09-12T22:31:37.411183+0000","last_active":"2024-09-12T22:32:17.285641+0000","last_peered":"2024-09-12T22:32:17.285641+0000","last_clean":"2024-09-12T22:32:17.285641+0000","last_became_active":"2024-09-12T22:31:37.409796+0000","last_became_peered":"2024-09-12T22:31:37.409796+0000","last_unstale":"2024-09-12T22:32:17.285641+0000","last_undegraded":"2024-09-12T22:32:17.285641+0000","last_fullsized":"2024-09-12T22:32:17.285641+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:20:35.779810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T22:32:17.285022+0000","last_change":"2024-09-12T22:31:36.407402+0000","last_active":"2024-09-12T22:32:17.285022+0000","last_peered":"2024-09-12T22:32:17.285022+0000","last_clean":"2024-09-12T22:32:17.285022+0000","last_became_active":"2024-09-12T22:31:36.406681+0000","last_became_peered":"2024-09-12T22:31:36.406681+0000","last_unstale":"2024-09-12T22:32:17.285022+0000","last_undegraded":"2024-09-12T22:32:17.285022+0000","last_fullsized":"2024-09-12T22:32:17.285022+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:39:39.362573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T22:32:17.948340+0000","last_change":"2024-09-12T22:31:37.412817+0000","last_active":"2024-09-12T22:32:17.948340+0000","last_peered":"2024-09-12T22:32:17.948340+0000","last_clean":"2024-09-12T22:32:17.948340+0000","last_became_active":"2024-09-12T22:31:37.411999+0000","last_became_peered":"2024-09-12T22:31:37.411999+0000","last_unstale":"2024-09-12T22:32:17.948340+0000","last_undegraded":"2024-09-12T22:32:17.948340+0000","last_fullsized":"2024-09-12T22:32:17.948340+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:07:02.173590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T22:32:17.284831+0000","last_change":"2024-09-12T22:31:57.095289+0000","last_active":"2024-09-12T22:32:17.284831+0000","last_peered":"2024-09-12T22:32:17.284831+0000","last_clean":"2024-09-12T22:32:17.284831+0000","last_became_active":"2024-09-12T22:31:57.095039+0000","last_became_peered":"2024-09-12T22:31:57.095039+0000","last_unstale":"2024-09-12T22:32:17.284831+0000","last_undegraded":"2024-09-12T22:32:17.284831+0000","last_fullsized":"2024-09-12T22:32:17.284831+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:39:50.881312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T22:32:17.285058+0000","last_change":"2024-09-12T22:31:57.095260+0000","last_active":"2024-09-12T22:32:17.285058+0000","last_peered":"2024-09-12T22:32:17.285058+0000","last_clean":"2024-09-12T22:32:17.285058+0000","last_became_active":"2024-09-12T22:31:57.095035+0000","last_became_peered":"2024-09-12T22:31:57.095035+0000","last_unstale":"2024-09-12T22:32:17.285058+0000","last_undegraded":"2024-09-12T22:32:17.285058+0000","last_fullsized":"2024-09-12T22:32:17.285058+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:55:51.885364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"19'1","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T22:32:17.948774+0000","last_change":"2024-09-12T22:31:36.412289+0000","last_active":"2024-09-12T22:32:17.948774+0000","last_peered":"2024-09-12T22:32:17.948774+0000","last_clean":"2024-09-12T22:32:17.948774+0000","last_became_active":"2024-09-12T22:31:36.411985+0000","last_became_peered":"2024-09-12T22:31:36.411985+0000","last_unstale":"2024-09-12T22:32:17.948774+0000","last_undegraded":"2024-09-12T22:32:17.948774+0000","last_fullsized":"2024-09-12T22:32:17.948774+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:30:09.410370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T22:32:20.295993+0000","last_change":"2024-09-12T22:31:37.415365+0000","last_active":"2024-09-12T22:32:20.295993+0000","last_peered":"2024-09-12T22:32:20.295993+0000","last_clean":"2024-09-12T22:32:20.295993+0000","last_became_active":"2024-09-12T22:31:37.413933+0000","last_became_peered":"2024-09-12T22:31:37.413933+0000","last_unstale":"2024-09-12T22:32:20.295993+0000","last_undegraded":"2024-09-12T22:32:20.295993+0000","last_fullsized":"2024-09-12T22:32:20.295993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:08:07.115355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"19'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T22:32:20.296175+0000","last_change":"2024-09-12T22:31:36.411665+0000","last_active":"2024-09-12T22:32:20.296175+0000","last_peered":"2024-09-12T22:32:20.296175+0000","last_clean":"2024-09-12T22:32:20.296175+0000","last_became_active":"2024-09-12T22:31:36.410182+0000","last_became_peered":"2024-09-12T22:31:36.410182+0000","last_unstale":"2024-09-12T22:32:20.296175+0000","last_undegraded":"2024-09-12T22:32:20.296175+0000","last_fullsized":"2024-09-12T22:32:20.296175+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:37:20.891838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T22:32:20.295897+0000","last_change":"2024-09-12T22:31:37.415172+0000","last_active":"2024-09-12T22:32:20.295897+0000","last_peered":"2024-09-12T22:32:20.295897+0000","last_clean":"2024-09-12T22:32:20.295897+0000","last_became_active":"2024-09-12T22:31:37.414776+0000","last_became_peered":"2024-09-12T22:31:37.414776+0000","last_unstale":"2024-09-12T22:32:20.295897+0000","last_undegraded":"2024-09-12T22:32:20.295897+0000","last_fullsized":"2024-09-12T22:32:20.295897+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:42:32.307876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"19'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T22:32:20.295852+0000","last_change":"2024-09-12T22:31:57.100908+0000","last_active":"2024-09-12T22:32:20.295852+0000","last_peered":"2024-09-12T22:32:20.295852+0000","last_clean":"2024-09-12T22:32:20.295852+0000","last_became_active":"2024-09-12T22:31:57.100579+0000","last_became_peered":"2024-09-12T22:31:57.100579+0000","last_unstale":"2024-09-12T22:32:20.295852+0000","last_undegraded":"2024-09-12T22:32:20.295852+0000","last_fullsized":"2024-09-12T22:32:20.295852+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:49:56.674930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T22:32:17.947737+0000","last_change":"2024-09-12T22:31:37.409214+0000","last_active":"2024-09-12T22:32:17.947737+0000","last_peered":"2024-09-12T22:32:17.947737+0000","last_clean":"2024-09-12T22:32:17.947737+0000","last_became_active":"2024-09-12T22:31:37.408849+0000","last_became_peered":"2024-09-12T22:31:37.408849+0000","last_unstale":"2024-09-12T22:32:17.947737+0000","last_undegraded":"2024-09-12T22:32:17.947737+0000","last_fullsized":"2024-09-12T22:32:17.947737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:39:20.383152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"19'1","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T22:32:17.285711+0000","last_change":"2024-09-12T22:31:36.410371+0000","last_active":"2024-09-12T22:32:17.285711+0000","last_peered":"2024-09-12T22:32:17.285711+0000","last_clean":"2024-09-12T22:32:17.285711+0000","last_became_active":"2024-09-12T22:31:36.409428+0000","last_became_peered":"2024-09-12T22:31:36.409428+0000","last_unstale":"2024-09-12T22:32:17.285711+0000","last_undegraded":"2024-09-12T22:32:17.285711+0000","last_fullsized":"2024-09-12T22:32:17.285711+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:27:22.817690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-12T22:32:20.295779+0000","last_change":"2024-09-12T22:31:37.415390+0000","last_active":"2024-09-12T22:32:20.295779+0000","last_peered":"2024-09-12T22:32:20.295779+0000","last_clean":"2024-09-12T22:32:20.295779+0000","last_became_active":"2024-09-12T22:31:37.414781+0000","last_became_peered":"2024-09-12T22:31:37.414781+0000","last_unstale":"2024-09-12T22:32:20.295779+0000","last_undegraded":"2024-09-12T22:32:20.295779+0000","last_fullsized":"2024-09-12T22:32:20.295779+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:42:17.728844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"19'4","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-12T22:32:17.285598+0000","last_change":"2024-09-12T22:31:36.407945+0000","last_active":"2024-09-12T22:32:17.285598+0000","last_peered":"2024-09-12T22:32:17.285598+0000","last_clean":"2024-09-12T22:32:17.285598+0000","last_became_active":"2024-09-12T22:31:36.406959+0000","last_became_peered":"2024-09-12T22:31:36.406959+0000","last_unstale":"2024-09-12T22:32:17.285598+0000","last_undegraded":"2024-09-12T22:32:17.285598+0000","last_fullsized":"2024-09-12T22:32:17.285598+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:26:33.155850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":7353,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":14706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705679,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32080,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339760,"statfs":{"total":96636764160,"available":96603914240,"internally_reserved":0,"allocated":913408,"data_stored":714094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705679,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32060,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339780,"statfs":{"total":96636764160,"available":96603934720,"internally_reserved":0,"allocated":892928,"data_stored":709235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738383,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":282624,"data_stored":112765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":6737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":7353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T22:32:22.947 INFO:tasks.thrashosds.thrasher:Setting 3.5 to [0, 1] 2024-09-12T22:32:22.948 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap', '3.5', '0', '1'] 2024-09-12T22:32:22.948 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap 3.5 0 1 2024-09-12T22:32:22.959 INFO:teuthology.orchestra.run.smithi076.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:22.959 INFO:teuthology.orchestra.run.smithi076.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:22.968 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:32:23.026 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:23.025+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:23.075 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:23.075 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:23.083 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:32:23.127 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:32:23.126+0000 7fddec6a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30331) UID: 0 2024-09-12T22:32:23.186 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:23.186 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:23.195 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:32:23.228 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:23.227+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:23.297 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:23.297 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:23.300 INFO:teuthology.orchestra.run.smithi019.stderr:nodeep-scrub is set 2024-09-12T22:32:23.307 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:32:23.351 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:23.350+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:23.414 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:23.414 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:23.423 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:32:23.464 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:23.463+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:23.532 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:32:23.530+0000 7fddec6a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30331) UID: 0 2024-09-12T22:32:23.566 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:23.566 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:23.575 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:32:23.633 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:32:23.631+0000 7fddec6a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30331) UID: 0 2024-09-12T22:32:23.677 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:23.678 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:23.686 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:32:23.734 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:23.733+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:23.799 INFO:teuthology.orchestra.run.smithi076.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:23.799 INFO:teuthology.orchestra.run.smithi076.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:23.808 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:32:23.835 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:23.834+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:23.911 INFO:teuthology.orchestra.run.smithi076.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:23.912 INFO:teuthology.orchestra.run.smithi076.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:23.921 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:32:23.966 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:32:23.964+0000 7fddec6a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30331) UID: 0 2024-09-12T22:32:24.024 INFO:teuthology.orchestra.run.smithi076.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:24.024 INFO:teuthology.orchestra.run.smithi076.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:24.032 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:32:24.076 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:24.074+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:24.137 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:32:24.135+0000 7fddec6a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30331) UID: 0 2024-09-12T22:32:24.140 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:24.140 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:24.149 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:32:24.238 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:24.237+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:24.292 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:24.292 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:24.301 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:32:24.307 INFO:teuthology.orchestra.run.smithi019.stderr:set 3.5 pg_upmap mapping to [0,1] 2024-09-12T22:32:24.339 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:32:24.337+0000 7fddec6a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30331) UID: 0 2024-09-12T22:32:24.397 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T22:32:24.403 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:24.403 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:24.412 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:32:24.456 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:24.455+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:24.522 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:24.522 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:24.528 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0: {} 2024-09-12T22:32:24.529 INFO:teuthology.orchestra.run.smithi019.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T22:32:24.530 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:32:24.543 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T22:32:24.544 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:32:24.562 INFO:teuthology.orchestra.run.smithi019.stdout:osd.2: {} 2024-09-12T22:32:24.562 INFO:teuthology.orchestra.run.smithi019.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T22:32:24.571 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:24.570+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:24.642 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:24.640+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:24.673 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-09-12T22:32:24.674 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-09-12T22:32:24.674 INFO:teuthology.orchestra.run.smithi163.stdout: "complaint_time": 30, 2024-09-12T22:32:24.674 INFO:teuthology.orchestra.run.smithi163.stdout: "num_blocked_ops": 0 2024-09-12T22:32:24.674 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-09-12T22:32:24.682 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:32:24.743 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:24.741+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:24.827 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-09-12T22:32:24.827 INFO:teuthology.orchestra.run.smithi163.stdout: "size": 20, 2024-09-12T22:32:24.827 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 600, 2024-09-12T22:32:24.827 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2024-09-12T22:32:24.827 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.827 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-09-12T22:32:24.828 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:27.254459+0000", 2024-09-12T22:32:24.828 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 57.570567093000001, 2024-09-12T22:32:24.828 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.37816283899999997, 2024-09-12T22:32:24.828 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:24.828 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:24.828 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:24.828 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:24.828 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:24.828 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:24.828 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 1 2024-09-12T22:32:24.828 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.828 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:24.828 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.829 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:24.829 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254459+0000", 2024-09-12T22:32:24.829 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:24.829 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.829 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.829 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:24.829 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254459+0000", 2024-09-12T22:32:24.829 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:24.829 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.829 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.829 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:24.829 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254460+0000", 2024-09-12T22:32:24.829 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1739999999999999e-06 2024-09-12T22:32:24.829 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.830 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.830 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:24.830 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254472+0000", 2024-09-12T22:32:24.830 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2207e-05 2024-09-12T22:32:24.830 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.830 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.830 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:24.830 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254483+0000", 2024-09-12T22:32:24.830 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0631999999999999e-05 2024-09-12T22:32:24.830 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.830 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.830 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:24.830 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254492+0000", 2024-09-12T22:32:24.831 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3670000000000003e-06 2024-09-12T22:32:24.831 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.831 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.831 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:24.831 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254551+0000", 2024-09-12T22:32:24.831 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8687999999999998e-05 2024-09-12T22:32:24.831 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.831 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.831 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for peered", 2024-09-12T22:32:24.831 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254562+0000", 2024-09-12T22:32:24.831 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1249e-05 2024-09-12T22:32:24.831 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.831 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.832 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:24.832 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.631211+0000", 2024-09-12T22:32:24.832 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.376649018 2024-09-12T22:32:24.832 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.832 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.832 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:24.832 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.631345+0000", 2024-09-12T22:32:24.832 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013378700000000001 2024-09-12T22:32:24.832 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.832 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.832 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:24.832 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.631479+0000", 2024-09-12T22:32:24.832 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013352399999999999 2024-09-12T22:32:24.832 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.833 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.833 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:24.833 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632324+0000", 2024-09-12T22:32:24.833 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00084508100000000002 2024-09-12T22:32:24.833 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.833 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.833 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:24.833 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632548+0000", 2024-09-12T22:32:24.833 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000224329 2024-09-12T22:32:24.833 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.833 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.833 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:24.833 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632591+0000", 2024-09-12T22:32:24.834 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2564000000000001e-05 2024-09-12T22:32:24.834 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.834 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.834 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:24.834 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632622+0000", 2024-09-12T22:32:24.834 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1219e-05 2024-09-12T22:32:24.834 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:24.834 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:24.834 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:24.834 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.834 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.834 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:185 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:32:24.834 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394355+0000", 2024-09-12T22:32:24.834 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 56.430670996000003, 2024-09-12T22:32:24.835 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011302394, 2024-09-12T22:32:24.835 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:24.835 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:24.835 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:24.835 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:24.835 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:24.835 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:24.835 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 185 2024-09-12T22:32:24.835 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.835 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:24.835 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.835 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:24.835 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394355+0000", 2024-09-12T22:32:24.836 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:24.836 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.836 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.836 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:24.836 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394355+0000", 2024-09-12T22:32:24.836 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:24.836 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.836 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.836 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:24.836 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394355+0000", 2024-09-12T22:32:24.836 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9099999999999999e-07 2024-09-12T22:32:24.836 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.836 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.836 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:24.837 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394385+0000", 2024-09-12T22:32:24.837 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9963000000000001e-05 2024-09-12T22:32:24.837 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.837 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.837 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:24.837 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394390+0000", 2024-09-12T22:32:24.837 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8420000000000004e-06 2024-09-12T22:32:24.837 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.837 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.837 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:24.837 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394393+0000", 2024-09-12T22:32:24.837 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1e-06 2024-09-12T22:32:24.838 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.838 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.838 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:24.838 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.400546+0000", 2024-09-12T22:32:24.838 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0061523309999999996 2024-09-12T22:32:24.838 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.838 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.838 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:24.838 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.400588+0000", 2024-09-12T22:32:24.838 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1835000000000002e-05 2024-09-12T22:32:24.838 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.838 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.838 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:24.839 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.400677+0000", 2024-09-12T22:32:24.839 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9195000000000002e-05 2024-09-12T22:32:24.839 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.839 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.839 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:24.839 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405378+0000", 2024-09-12T22:32:24.839 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0047008659999999997 2024-09-12T22:32:24.839 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.839 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.839 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:24.839 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405569+0000", 2024-09-12T22:32:24.839 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00019148599999999999 2024-09-12T22:32:24.839 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.839 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.840 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:24.840 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405620+0000", 2024-09-12T22:32:24.840 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1416999999999999e-05 2024-09-12T22:32:24.840 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.840 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.840 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:24.840 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405657+0000", 2024-09-12T22:32:24.840 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6968000000000002e-05 2024-09-12T22:32:24.840 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:24.840 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:24.840 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:24.840 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.840 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.840 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:32:24.841 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394399+0000", 2024-09-12T22:32:24.841 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 56.430626785000001, 2024-09-12T22:32:24.841 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011336601999999999, 2024-09-12T22:32:24.841 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:24.841 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:24.841 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:24.841 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:24.841 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:24.841 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:24.841 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 186 2024-09-12T22:32:24.841 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.841 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:24.842 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.842 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:24.842 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394399+0000", 2024-09-12T22:32:24.842 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:24.842 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.842 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.842 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:24.842 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394399+0000", 2024-09-12T22:32:24.842 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:24.842 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.842 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.842 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:24.842 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394400+0000", 2024-09-12T22:32:24.842 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4499999999999998e-07 2024-09-12T22:32:24.843 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.843 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.843 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:24.843 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394402+0000", 2024-09-12T22:32:24.843 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.875e-06 2024-09-12T22:32:24.843 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.843 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.843 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:24.843 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394405+0000", 2024-09-12T22:32:24.843 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6799999999999999e-06 2024-09-12T22:32:24.843 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.843 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.843 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:24.844 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394408+0000", 2024-09-12T22:32:24.844 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.667e-06 2024-09-12T22:32:24.844 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.844 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.844 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:24.844 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401395+0000", 2024-09-12T22:32:24.844 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0069867230000000002 2024-09-12T22:32:24.844 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.844 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.844 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:24.845 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401438+0000", 2024-09-12T22:32:24.845 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3554999999999999e-05 2024-09-12T22:32:24.845 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.845 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.845 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:24.845 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401509+0000", 2024-09-12T22:32:24.845 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0631999999999997e-05 2024-09-12T22:32:24.845 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.845 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.845 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:24.845 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405392+0000", 2024-09-12T22:32:24.845 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0038830449999999999 2024-09-12T22:32:24.845 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.845 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.846 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:24.846 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405690+0000", 2024-09-12T22:32:24.846 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000298435 2024-09-12T22:32:24.846 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.846 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.846 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:24.846 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405716+0000", 2024-09-12T22:32:24.846 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5435999999999998e-05 2024-09-12T22:32:24.846 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.846 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.846 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:24.846 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405736+0000", 2024-09-12T22:32:24.846 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0208999999999999e-05 2024-09-12T22:32:24.847 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:24.847 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:24.847 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:24.847 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.847 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.847 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:32:24.847 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394411+0000", 2024-09-12T22:32:24.847 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 56.430614659, 2024-09-12T22:32:24.847 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011400117, 2024-09-12T22:32:24.847 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:24.847 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:24.847 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:24.847 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:24.847 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:24.848 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:24.848 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 187 2024-09-12T22:32:24.848 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.848 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:24.848 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.848 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:24.848 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394411+0000", 2024-09-12T22:32:24.848 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:24.848 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.848 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.848 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:24.848 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394411+0000", 2024-09-12T22:32:24.849 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:24.849 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.849 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.849 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:24.849 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394412+0000", 2024-09-12T22:32:24.849 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.4999999999999999e-07 2024-09-12T22:32:24.849 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.849 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.849 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:24.849 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394414+0000", 2024-09-12T22:32:24.849 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.984e-06 2024-09-12T22:32:24.850 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.850 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.850 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:24.850 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394418+0000", 2024-09-12T22:32:24.850 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0840000000000002e-06 2024-09-12T22:32:24.850 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.850 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.850 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:24.850 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394431+0000", 2024-09-12T22:32:24.850 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.361e-05 2024-09-12T22:32:24.850 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.850 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.850 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:24.851 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401778+0000", 2024-09-12T22:32:24.851 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0073462659999999997 2024-09-12T22:32:24.851 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.851 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.851 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:24.851 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401853+0000", 2024-09-12T22:32:24.851 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5797000000000006e-05 2024-09-12T22:32:24.851 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.851 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.851 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:24.851 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401990+0000", 2024-09-12T22:32:24.851 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013651399999999999 2024-09-12T22:32:24.851 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.851 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.852 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:24.852 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405402+0000", 2024-09-12T22:32:24.852 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0034116070000000001 2024-09-12T22:32:24.852 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.852 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.852 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:24.852 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405764+0000", 2024-09-12T22:32:24.852 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00036234899999999998 2024-09-12T22:32:24.852 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.852 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.852 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:24.852 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405791+0000", 2024-09-12T22:32:24.852 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7029000000000002e-05 2024-09-12T22:32:24.853 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.853 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.853 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:24.853 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405812+0000", 2024-09-12T22:32:24.853 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0627000000000001e-05 2024-09-12T22:32:24.853 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:24.853 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:24.853 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:24.853 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.853 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.853 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:32:24.853 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394447+0000", 2024-09-12T22:32:24.853 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 56.430579508000001, 2024-09-12T22:32:24.854 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011759588, 2024-09-12T22:32:24.854 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:24.854 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:24.854 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:24.854 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:24.854 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:24.854 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:24.854 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 188 2024-09-12T22:32:24.854 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.854 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:24.854 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.854 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:24.854 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394447+0000", 2024-09-12T22:32:24.854 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:24.855 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.855 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.855 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:24.855 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394447+0000", 2024-09-12T22:32:24.855 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:24.855 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.855 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.855 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:24.855 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394447+0000", 2024-09-12T22:32:24.855 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.15e-07 2024-09-12T22:32:24.855 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.855 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.855 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:24.856 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394512+0000", 2024-09-12T22:32:24.856 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4580999999999997e-05 2024-09-12T22:32:24.856 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.856 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.856 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:24.856 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394518+0000", 2024-09-12T22:32:24.856 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.3380000000000001e-06 2024-09-12T22:32:24.856 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.856 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.856 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:24.856 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394521+0000", 2024-09-12T22:32:24.857 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3340000000000002e-06 2024-09-12T22:32:24.857 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.857 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.857 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:24.857 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.402628+0000", 2024-09-12T22:32:24.857 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.008106996 2024-09-12T22:32:24.857 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.857 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.857 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:24.857 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.402670+0000", 2024-09-12T22:32:24.857 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1983000000000001e-05 2024-09-12T22:32:24.858 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.858 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.858 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:24.858 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.402738+0000", 2024-09-12T22:32:24.859 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.8114999999999994e-05 2024-09-12T22:32:24.859 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.859 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.859 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:24.859 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405668+0000", 2024-09-12T22:32:24.859 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.002929545 2024-09-12T22:32:24.859 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.859 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.859 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:24.859 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406162+0000", 2024-09-12T22:32:24.859 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000494408 2024-09-12T22:32:24.859 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.859 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.859 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:24.860 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406188+0000", 2024-09-12T22:32:24.860 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5766e-05 2024-09-12T22:32:24.860 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.860 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.860 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:24.860 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406206+0000", 2024-09-12T22:32:24.860 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.8107000000000001e-05 2024-09-12T22:32:24.860 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:24.860 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:24.860 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:24.860 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.860 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.860 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:32:24.861 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394528+0000", 2024-09-12T22:32:24.861 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 56.430497838999997, 2024-09-12T22:32:24.861 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.01195536, 2024-09-12T22:32:24.861 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:24.861 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:24.861 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:24.861 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:24.861 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:24.861 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:24.861 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 189 2024-09-12T22:32:24.861 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.861 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:24.861 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.861 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:24.862 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394528+0000", 2024-09-12T22:32:24.862 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:24.862 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.862 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.862 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:24.862 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394528+0000", 2024-09-12T22:32:24.862 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:24.862 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.862 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.862 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:24.862 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394529+0000", 2024-09-12T22:32:24.862 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4900000000000001e-07 2024-09-12T22:32:24.862 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.863 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.863 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:24.863 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394531+0000", 2024-09-12T22:32:24.863 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.458e-06 2024-09-12T22:32:24.863 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.863 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.863 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:24.863 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394535+0000", 2024-09-12T22:32:24.863 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7900000000000001e-06 2024-09-12T22:32:24.863 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.863 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.863 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:24.863 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394537+0000", 2024-09-12T22:32:24.863 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.632e-06 2024-09-12T22:32:24.864 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.864 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.864 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:24.864 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.404932+0000", 2024-09-12T22:32:24.864 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010394158000000001 2024-09-12T22:32:24.864 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.864 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.865 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:24.865 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405017+0000", 2024-09-12T22:32:24.865 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5525000000000005e-05 2024-09-12T22:32:24.865 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.865 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.865 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:24.865 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405114+0000", 2024-09-12T22:32:24.865 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.6527000000000006e-05 2024-09-12T22:32:24.865 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.865 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.865 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:24.865 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405818+0000", 2024-09-12T22:32:24.866 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00070412800000000005 2024-09-12T22:32:24.866 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.866 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.866 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:24.866 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406437+0000", 2024-09-12T22:32:24.866 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00061898900000000002 2024-09-12T22:32:24.866 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.866 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.866 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:24.866 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406463+0000", 2024-09-12T22:32:24.866 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6268e-05 2024-09-12T22:32:24.866 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.866 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.866 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:24.867 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406484+0000", 2024-09-12T22:32:24.867 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0536000000000001e-05 2024-09-12T22:32:24.867 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:24.867 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:24.867 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:24.867 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.867 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.867 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:24.867 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.401422+0000", 2024-09-12T22:32:24.867 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 47.423603933999999, 2024-09-12T22:32:24.868 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016896452999999999, 2024-09-12T22:32:24.868 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:24.868 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:24.868 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:24.868 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:24.868 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.868 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:24.868 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401422+0000", 2024-09-12T22:32:24.868 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:24.868 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.868 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.868 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:24.868 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401422+0000", 2024-09-12T22:32:24.869 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:24.869 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.869 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.869 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:24.869 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401424+0000", 2024-09-12T22:32:24.869 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9e-06 2024-09-12T22:32:24.869 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.869 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.869 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:24.869 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401437+0000", 2024-09-12T22:32:24.869 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2831e-05 2024-09-12T22:32:24.869 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.869 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.869 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:24.870 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401471+0000", 2024-09-12T22:32:24.870 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4010000000000001e-05 2024-09-12T22:32:24.870 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.870 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.870 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:24.870 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401484+0000", 2024-09-12T22:32:24.870 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2711000000000001e-05 2024-09-12T22:32:24.870 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.870 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.870 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:24.871 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405410+0000", 2024-09-12T22:32:24.871 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0039259170000000001 2024-09-12T22:32:24.871 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.871 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.871 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:24.871 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405529+0000", 2024-09-12T22:32:24.871 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000119778 2024-09-12T22:32:24.871 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.871 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.871 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:24.872 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405655+0000", 2024-09-12T22:32:24.872 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012556700000000001 2024-09-12T22:32:24.872 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.872 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.872 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:24.872 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410456+0000", 2024-09-12T22:32:24.872 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0048008269999999997 2024-09-12T22:32:24.872 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.872 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.872 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:24.872 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418226+0000", 2024-09-12T22:32:24.872 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0077707729999999999 2024-09-12T22:32:24.873 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.873 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.873 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:24.873 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418277+0000", 2024-09-12T22:32:24.873 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0476000000000003e-05 2024-09-12T22:32:24.873 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.873 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.873 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:24.873 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418319+0000", 2024-09-12T22:32:24.873 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1662999999999997e-05 2024-09-12T22:32:24.873 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:24.873 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:24.873 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:24.874 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.874 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.874 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:24.874 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.401505+0000", 2024-09-12T22:32:24.874 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 47.423521270000002, 2024-09-12T22:32:24.874 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016987904000000002, 2024-09-12T22:32:24.874 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:24.874 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:24.874 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:24.874 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:24.874 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.874 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:24.874 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401505+0000", 2024-09-12T22:32:24.874 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:24.875 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.875 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.875 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:24.875 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401505+0000", 2024-09-12T22:32:24.875 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:24.875 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.875 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.875 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:24.875 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401506+0000", 2024-09-12T22:32:24.875 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4700000000000001e-07 2024-09-12T22:32:24.875 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.875 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.875 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:24.875 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401510+0000", 2024-09-12T22:32:24.876 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6609999999999999e-06 2024-09-12T22:32:24.876 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.876 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.876 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:24.876 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401771+0000", 2024-09-12T22:32:24.876 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00026110700000000001 2024-09-12T22:32:24.876 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.876 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.876 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:24.876 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401921+0000", 2024-09-12T22:32:24.877 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014939099999999999 2024-09-12T22:32:24.877 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.877 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.877 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:24.877 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405944+0000", 2024-09-12T22:32:24.877 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0040235449999999999 2024-09-12T22:32:24.877 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.877 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.877 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:24.877 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406018+0000", 2024-09-12T22:32:24.878 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3373000000000004e-05 2024-09-12T22:32:24.878 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.878 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.878 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:24.878 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406172+0000", 2024-09-12T22:32:24.878 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00015435399999999999 2024-09-12T22:32:24.878 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.878 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.878 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:24.878 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410461+0000", 2024-09-12T22:32:24.878 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0042888609999999997 2024-09-12T22:32:24.878 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.878 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.878 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:24.879 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418371+0000", 2024-09-12T22:32:24.879 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0079098380000000006 2024-09-12T22:32:24.879 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.879 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.879 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:24.879 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418443+0000", 2024-09-12T22:32:24.879 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2705000000000003e-05 2024-09-12T22:32:24.879 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.879 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.879 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:24.879 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418493+0000", 2024-09-12T22:32:24.879 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9322e-05 2024-09-12T22:32:24.879 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:24.879 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:24.880 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:24.880 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.880 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.880 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:24.880 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.401939+0000", 2024-09-12T22:32:24.880 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 47.423087533999997, 2024-09-12T22:32:24.880 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016722292999999999, 2024-09-12T22:32:24.880 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:24.880 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:24.880 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:24.880 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:24.880 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.880 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:24.881 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401939+0000", 2024-09-12T22:32:24.881 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:24.881 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.881 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.881 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:24.881 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401939+0000", 2024-09-12T22:32:24.881 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:24.881 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.881 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.881 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:24.881 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401940+0000", 2024-09-12T22:32:24.881 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1990000000000001e-06 2024-09-12T22:32:24.881 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.881 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.882 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:24.882 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401956+0000", 2024-09-12T22:32:24.882 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.6344000000000001e-05 2024-09-12T22:32:24.882 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.882 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.882 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:24.882 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401974+0000", 2024-09-12T22:32:24.882 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7730000000000001e-05 2024-09-12T22:32:24.882 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.882 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.882 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:24.882 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401982+0000", 2024-09-12T22:32:24.882 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.7800000000000001e-06 2024-09-12T22:32:24.883 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.883 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.883 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:24.883 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406557+0000", 2024-09-12T22:32:24.883 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0045758489999999999 2024-09-12T22:32:24.883 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.883 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.883 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:24.883 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406697+0000", 2024-09-12T22:32:24.884 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013925100000000001 2024-09-12T22:32:24.884 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.884 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.884 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:24.884 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406830+0000", 2024-09-12T22:32:24.884 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013293499999999999 2024-09-12T22:32:24.884 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.884 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.884 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:24.884 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410465+0000", 2024-09-12T22:32:24.884 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0036352680000000001 2024-09-12T22:32:24.884 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.884 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.884 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:24.885 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418564+0000", 2024-09-12T22:32:24.885 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0080992140000000004 2024-09-12T22:32:24.885 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.885 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.885 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:24.885 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418621+0000", 2024-09-12T22:32:24.885 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7167999999999999e-05 2024-09-12T22:32:24.885 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.885 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.885 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:24.885 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418661+0000", 2024-09-12T22:32:24.885 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9555000000000003e-05 2024-09-12T22:32:24.885 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:24.885 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:24.886 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:24.886 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.886 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.886 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:24.886 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.401994+0000", 2024-09-12T22:32:24.886 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 47.423031662, 2024-09-12T22:32:24.886 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016804109000000001, 2024-09-12T22:32:24.886 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:24.886 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:24.886 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:24.886 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:24.887 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.887 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:24.887 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401994+0000", 2024-09-12T22:32:24.887 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:24.887 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.887 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.887 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:24.887 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401994+0000", 2024-09-12T22:32:24.887 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:24.887 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.887 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.887 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:24.887 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401995+0000", 2024-09-12T22:32:24.888 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.8899999999999998e-07 2024-09-12T22:32:24.888 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.888 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.888 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:24.888 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402000+0000", 2024-09-12T22:32:24.888 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.498e-06 2024-09-12T22:32:24.888 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.888 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.888 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:24.888 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402007+0000", 2024-09-12T22:32:24.888 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.554e-06 2024-09-12T22:32:24.888 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.888 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.888 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:24.889 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402046+0000", 2024-09-12T22:32:24.889 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9156000000000003e-05 2024-09-12T22:32:24.889 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.889 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.889 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:24.889 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407342+0000", 2024-09-12T22:32:24.889 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052957610000000004 2024-09-12T22:32:24.889 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.889 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.889 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:24.889 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407521+0000", 2024-09-12T22:32:24.889 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00017878100000000001 2024-09-12T22:32:24.889 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.890 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.890 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:24.890 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407641+0000", 2024-09-12T22:32:24.890 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012013 2024-09-12T22:32:24.890 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.890 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.890 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:24.890 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410472+0000", 2024-09-12T22:32:24.890 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.002830455 2024-09-12T22:32:24.890 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.890 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.890 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:24.890 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418714+0000", 2024-09-12T22:32:24.890 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0082422789999999999 2024-09-12T22:32:24.891 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.891 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.891 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:24.891 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418761+0000", 2024-09-12T22:32:24.891 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6956999999999998e-05 2024-09-12T22:32:24.891 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.891 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.891 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:24.891 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418799+0000", 2024-09-12T22:32:24.891 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7749000000000001e-05 2024-09-12T22:32:24.891 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:24.891 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:24.891 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:24.891 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.892 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.892 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:24.892 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.402060+0000", 2024-09-12T22:32:24.892 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 47.422966217999999, 2024-09-12T22:32:24.892 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016885686, 2024-09-12T22:32:24.892 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:24.892 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:24.892 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:24.892 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:24.892 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.892 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:24.892 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402060+0000", 2024-09-12T22:32:24.892 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:24.893 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.893 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.893 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:24.893 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402060+0000", 2024-09-12T22:32:24.893 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:24.893 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.893 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.893 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:24.893 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402061+0000", 2024-09-12T22:32:24.893 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4399999999999999e-07 2024-09-12T22:32:24.893 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.894 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.894 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:24.894 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402066+0000", 2024-09-12T22:32:24.894 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8649999999999998e-06 2024-09-12T22:32:24.894 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.894 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.894 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:24.894 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402146+0000", 2024-09-12T22:32:24.894 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9054000000000006e-05 2024-09-12T22:32:24.894 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.894 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.894 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:24.894 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402287+0000", 2024-09-12T22:32:24.894 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014108600000000001 2024-09-12T22:32:24.895 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.895 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.895 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:24.895 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408185+0000", 2024-09-12T22:32:24.895 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0058983919999999997 2024-09-12T22:32:24.895 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.895 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.895 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:24.895 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408299+0000", 2024-09-12T22:32:24.895 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114102 2024-09-12T22:32:24.895 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.895 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.895 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:24.895 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408420+0000", 2024-09-12T22:32:24.896 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000120492 2024-09-12T22:32:24.896 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.896 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.896 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:24.896 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410867+0000", 2024-09-12T22:32:24.896 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0024476430000000002 2024-09-12T22:32:24.896 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.896 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.896 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:24.896 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418851+0000", 2024-09-12T22:32:24.896 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0079841489999999994 2024-09-12T22:32:24.896 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.896 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.897 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:24.897 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418894+0000", 2024-09-12T22:32:24.897 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3090000000000002e-05 2024-09-12T22:32:24.897 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.897 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.897 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:24.897 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418946+0000", 2024-09-12T22:32:24.897 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1069000000000002e-05 2024-09-12T22:32:24.897 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:24.897 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:24.897 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:24.897 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.897 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.898 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:24.898 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.402375+0000", 2024-09-12T22:32:24.898 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 47.422651152999997, 2024-09-12T22:32:24.898 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016768531999999999, 2024-09-12T22:32:24.898 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:24.898 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:24.898 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:24.898 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:24.898 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.898 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:24.898 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402375+0000", 2024-09-12T22:32:24.898 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:24.898 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.898 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.899 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:24.899 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402375+0000", 2024-09-12T22:32:24.899 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:24.899 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.899 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.899 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:24.899 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402375+0000", 2024-09-12T22:32:24.899 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4099999999999999e-07 2024-09-12T22:32:24.899 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.899 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.899 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:24.899 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402379+0000", 2024-09-12T22:32:24.899 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9870000000000001e-06 2024-09-12T22:32:24.899 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.900 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.900 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:24.900 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402389+0000", 2024-09-12T22:32:24.900 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0000000000000001e-05 2024-09-12T22:32:24.900 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.900 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.900 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:24.900 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402401+0000", 2024-09-12T22:32:24.900 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.148e-05 2024-09-12T22:32:24.900 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.900 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.900 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:24.900 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409108+0000", 2024-09-12T22:32:24.901 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0067068429999999997 2024-09-12T22:32:24.901 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.901 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.901 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:24.901 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409189+0000", 2024-09-12T22:32:24.901 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0815999999999993e-05 2024-09-12T22:32:24.901 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.901 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.901 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:24.901 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409320+0000", 2024-09-12T22:32:24.901 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000131586 2024-09-12T22:32:24.901 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.901 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.901 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:24.902 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410872+0000", 2024-09-12T22:32:24.902 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0015521599999999999 2024-09-12T22:32:24.902 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.902 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.902 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:24.902 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419049+0000", 2024-09-12T22:32:24.902 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0081763719999999995 2024-09-12T22:32:24.902 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.902 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.902 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:24.902 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419107+0000", 2024-09-12T22:32:24.902 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7899000000000002e-05 2024-09-12T22:32:24.902 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.902 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.903 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:24.903 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419143+0000", 2024-09-12T22:32:24.903 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6847999999999997e-05 2024-09-12T22:32:24.903 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:24.903 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:24.903 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:24.903 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.903 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.903 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:24.903 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.402903+0000", 2024-09-12T22:32:24.903 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 47.422122741000003, 2024-09-12T22:32:24.903 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016378428, 2024-09-12T22:32:24.903 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:24.903 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:24.904 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:24.904 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:24.904 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.904 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:24.904 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402903+0000", 2024-09-12T22:32:24.904 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:24.904 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.904 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.904 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:24.904 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402903+0000", 2024-09-12T22:32:24.904 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:24.904 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.904 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.904 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:24.905 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402904+0000", 2024-09-12T22:32:24.905 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9500000000000001e-07 2024-09-12T22:32:24.905 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.905 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.905 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:24.905 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402944+0000", 2024-09-12T22:32:24.905 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0265000000000002e-05 2024-09-12T22:32:24.905 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.905 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.905 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:24.905 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402979+0000", 2024-09-12T22:32:24.905 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4378000000000002e-05 2024-09-12T22:32:24.905 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.905 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.906 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:24.906 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402987+0000", 2024-09-12T22:32:24.906 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3559999999999993e-06 2024-09-12T22:32:24.906 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.906 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.906 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:24.906 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409577+0000", 2024-09-12T22:32:24.906 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0065901709999999997 2024-09-12T22:32:24.906 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.906 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.906 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:24.906 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409653+0000", 2024-09-12T22:32:24.906 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5819e-05 2024-09-12T22:32:24.906 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.907 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.907 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:24.907 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409725+0000", 2024-09-12T22:32:24.907 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2200000000000007e-05 2024-09-12T22:32:24.907 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.907 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.907 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:24.907 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.411234+0000", 2024-09-12T22:32:24.907 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001508225 2024-09-12T22:32:24.907 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.907 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.907 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:24.907 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419212+0000", 2024-09-12T22:32:24.908 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0079783400000000004 2024-09-12T22:32:24.908 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.908 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.908 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:24.908 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419244+0000", 2024-09-12T22:32:24.908 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2384e-05 2024-09-12T22:32:24.908 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.908 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.908 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:24.908 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419282+0000", 2024-09-12T22:32:24.908 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7394999999999997e-05 2024-09-12T22:32:24.908 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:24.908 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:24.908 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:24.909 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.909 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.909 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:24.909 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.403135+0000", 2024-09-12T22:32:24.909 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 47.421890871000002, 2024-09-12T22:32:24.909 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016294211999999999, 2024-09-12T22:32:24.909 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:24.909 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:24.909 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:24.909 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:24.909 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.909 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:24.909 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403135+0000", 2024-09-12T22:32:24.910 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:24.910 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.910 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.910 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:24.910 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403135+0000", 2024-09-12T22:32:24.910 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:24.910 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.910 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.910 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:24.910 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403136+0000", 2024-09-12T22:32:24.910 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.4e-07 2024-09-12T22:32:24.910 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.910 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.910 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:24.911 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403149+0000", 2024-09-12T22:32:24.911 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2723e-05 2024-09-12T22:32:24.911 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.911 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.911 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:24.911 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403158+0000", 2024-09-12T22:32:24.911 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3919999999999992e-06 2024-09-12T22:32:24.911 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.911 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.911 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:24.911 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403166+0000", 2024-09-12T22:32:24.911 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.2309999999999996e-06 2024-09-12T22:32:24.911 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.911 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.912 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:24.912 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409944+0000", 2024-09-12T22:32:24.912 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0067775309999999998 2024-09-12T22:32:24.912 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.912 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.912 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:24.912 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410032+0000", 2024-09-12T22:32:24.912 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.7906999999999997e-05 2024-09-12T22:32:24.912 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.912 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.912 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:24.912 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410152+0000", 2024-09-12T22:32:24.912 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012037800000000001 2024-09-12T22:32:24.912 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.913 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.913 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:24.913 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.411945+0000", 2024-09-12T22:32:24.913 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0017931850000000001 2024-09-12T22:32:24.913 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.913 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.913 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:24.913 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419319+0000", 2024-09-12T22:32:24.913 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0073731780000000002 2024-09-12T22:32:24.913 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.913 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.913 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:24.914 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419376+0000", 2024-09-12T22:32:24.914 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7728e-05 2024-09-12T22:32:24.914 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.914 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.914 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:24.914 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419429+0000", 2024-09-12T22:32:24.914 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3019000000000002e-05 2024-09-12T22:32:24.914 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:24.914 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:24.914 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:24.914 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.914 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.914 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:24.914 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.403185+0000", 2024-09-12T22:32:24.915 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 47.42184099, 2024-09-12T22:32:24.915 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.014902164000000001, 2024-09-12T22:32:24.915 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:24.915 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:24.915 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:24.915 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:24.915 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.915 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:24.915 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403185+0000", 2024-09-12T22:32:24.915 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:24.915 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.915 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.915 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:24.915 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403185+0000", 2024-09-12T22:32:24.916 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:24.916 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.916 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.916 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:24.916 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403186+0000", 2024-09-12T22:32:24.916 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9400000000000005e-07 2024-09-12T22:32:24.916 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.916 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.916 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:24.916 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403191+0000", 2024-09-12T22:32:24.916 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6980000000000003e-06 2024-09-12T22:32:24.916 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.916 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.917 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:24.917 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403199+0000", 2024-09-12T22:32:24.917 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2520000000000002e-06 2024-09-12T22:32:24.917 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.917 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.917 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:24.917 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403205+0000", 2024-09-12T22:32:24.917 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.908e-06 2024-09-12T22:32:24.917 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.917 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.917 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:24.917 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403359+0000", 2024-09-12T22:32:24.917 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000154544 2024-09-12T22:32:24.917 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.918 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.918 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:24.918 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403528+0000", 2024-09-12T22:32:24.918 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000168455 2024-09-12T22:32:24.918 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.918 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.918 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:24.918 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403763+0000", 2024-09-12T22:32:24.918 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00023539599999999999 2024-09-12T22:32:24.918 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.918 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.918 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:24.918 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409378+0000", 2024-09-12T22:32:24.918 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056150000000000002 2024-09-12T22:32:24.919 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.919 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.919 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:24.919 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418012+0000", 2024-09-12T22:32:24.919 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0086339559999999999 2024-09-12T22:32:24.919 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.919 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.919 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:24.919 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418046+0000", 2024-09-12T22:32:24.919 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4267999999999998e-05 2024-09-12T22:32:24.919 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.919 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.919 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:24.919 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418087+0000", 2024-09-12T22:32:24.920 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0992999999999999e-05 2024-09-12T22:32:24.920 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:24.920 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:24.920 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:24.920 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.920 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.920 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:24.920 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.403273+0000", 2024-09-12T22:32:24.920 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 47.421753039000002, 2024-09-12T22:32:24.920 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.014934866, 2024-09-12T22:32:24.920 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:24.920 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:24.920 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:24.921 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:24.921 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.921 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:24.921 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403273+0000", 2024-09-12T22:32:24.921 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:24.921 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.921 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.921 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:24.921 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403273+0000", 2024-09-12T22:32:24.921 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:24.921 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.921 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.921 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:24.921 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403274+0000", 2024-09-12T22:32:24.922 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.297e-06 2024-09-12T22:32:24.922 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.922 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.922 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:24.922 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403282+0000", 2024-09-12T22:32:24.922 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6340000000000001e-06 2024-09-12T22:32:24.922 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.922 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.922 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:24.922 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403305+0000", 2024-09-12T22:32:24.922 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3149000000000001e-05 2024-09-12T22:32:24.922 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.922 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.922 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:24.923 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403320+0000", 2024-09-12T22:32:24.923 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4527e-05 2024-09-12T22:32:24.923 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.923 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.923 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:24.923 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.404928+0000", 2024-09-12T22:32:24.923 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001608459 2024-09-12T22:32:24.923 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.923 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.923 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:24.923 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405218+0000", 2024-09-12T22:32:24.923 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00028982900000000002 2024-09-12T22:32:24.923 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.923 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.924 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:24.924 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405829+0000", 2024-09-12T22:32:24.924 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00061127900000000005 2024-09-12T22:32:24.924 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.924 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.924 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:24.924 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409403+0000", 2024-09-12T22:32:24.924 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.003573597 2024-09-12T22:32:24.924 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.924 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.924 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:24.924 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418138+0000", 2024-09-12T22:32:24.924 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0087349969999999996 2024-09-12T22:32:24.925 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.925 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.925 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:24.925 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418178+0000", 2024-09-12T22:32:24.925 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0649999999999999e-05 2024-09-12T22:32:24.925 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.925 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.925 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:24.925 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418208+0000", 2024-09-12T22:32:24.925 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9448e-05 2024-09-12T22:32:24.925 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:24.925 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:24.925 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:24.925 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.926 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.926 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:24.926 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.405456+0000", 2024-09-12T22:32:24.926 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 47.419569893999999, 2024-09-12T22:32:24.926 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012888389, 2024-09-12T22:32:24.926 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:24.926 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:24.926 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:24.926 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:24.926 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.926 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:24.926 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405456+0000", 2024-09-12T22:32:24.926 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:24.926 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.927 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.927 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:24.927 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405456+0000", 2024-09-12T22:32:24.927 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:24.927 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.927 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.927 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:24.927 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405457+0000", 2024-09-12T22:32:24.927 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.6599999999999994e-07 2024-09-12T22:32:24.927 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.927 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.927 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:24.927 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405463+0000", 2024-09-12T22:32:24.927 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4739999999999996e-06 2024-09-12T22:32:24.928 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.928 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.928 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:24.928 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405474+0000", 2024-09-12T22:32:24.928 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1095e-05 2024-09-12T22:32:24.928 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.928 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.928 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:24.928 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405482+0000", 2024-09-12T22:32:24.928 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3610000000000001e-06 2024-09-12T22:32:24.928 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.928 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.928 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:24.928 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407051+0000", 2024-09-12T22:32:24.929 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0015688970000000001 2024-09-12T22:32:24.929 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.929 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.929 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:24.929 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407259+0000", 2024-09-12T22:32:24.929 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00020778300000000001 2024-09-12T22:32:24.929 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.929 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.929 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:24.929 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407622+0000", 2024-09-12T22:32:24.929 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000363066 2024-09-12T22:32:24.929 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.929 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.929 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:24.930 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409438+0000", 2024-09-12T22:32:24.930 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001816319 2024-09-12T22:32:24.930 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.930 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.930 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:24.930 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418257+0000", 2024-09-12T22:32:24.930 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0088187720000000008 2024-09-12T22:32:24.930 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.930 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.930 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:24.930 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418308+0000", 2024-09-12T22:32:24.930 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1180000000000001e-05 2024-09-12T22:32:24.930 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.930 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.931 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:24.931 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418345+0000", 2024-09-12T22:32:24.931 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6476000000000001e-05 2024-09-12T22:32:24.931 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:24.931 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:24.931 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:24.931 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.931 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.931 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:24.931 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.405496+0000", 2024-09-12T22:32:24.931 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 47.419530537, 2024-09-12T22:32:24.931 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013016012, 2024-09-12T22:32:24.931 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:24.931 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:24.932 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:24.932 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:24.932 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.932 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:24.932 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405496+0000", 2024-09-12T22:32:24.932 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:24.932 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.932 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.932 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:24.932 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405496+0000", 2024-09-12T22:32:24.932 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:24.932 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.932 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.933 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:24.933 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405496+0000", 2024-09-12T22:32:24.933 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7999999999999995e-07 2024-09-12T22:32:24.933 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.933 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.933 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:24.933 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405501+0000", 2024-09-12T22:32:24.933 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8359999999999999e-06 2024-09-12T22:32:24.933 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.933 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.933 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:24.933 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405514+0000", 2024-09-12T22:32:24.933 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2522e-05 2024-09-12T22:32:24.933 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.934 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.934 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:24.934 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405521+0000", 2024-09-12T22:32:24.934 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5020000000000003e-06 2024-09-12T22:32:24.934 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.934 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.934 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:24.934 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405575+0000", 2024-09-12T22:32:24.934 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4169999999999998e-05 2024-09-12T22:32:24.934 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.934 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.934 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:24.934 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405697+0000", 2024-09-12T22:32:24.934 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000121301 2024-09-12T22:32:24.935 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.935 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.935 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:24.935 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405829+0000", 2024-09-12T22:32:24.935 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000132662 2024-09-12T22:32:24.935 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.935 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.935 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:24.935 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409155+0000", 2024-09-12T22:32:24.935 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0033259050000000001 2024-09-12T22:32:24.935 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.935 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.935 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:24.935 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418425+0000", 2024-09-12T22:32:24.936 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0092696319999999999 2024-09-12T22:32:24.936 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.936 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.936 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:24.936 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418471+0000", 2024-09-12T22:32:24.936 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6213e-05 2024-09-12T22:32:24.936 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.936 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.936 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:24.936 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418512+0000", 2024-09-12T22:32:24.936 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0589000000000001e-05 2024-09-12T22:32:24.936 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:24.936 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:24.937 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:24.937 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.937 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.937 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:24.937 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.406108+0000", 2024-09-12T22:32:24.937 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 47.418918140000002, 2024-09-12T22:32:24.937 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012458175, 2024-09-12T22:32:24.937 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:24.937 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:24.937 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:24.937 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:24.937 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.937 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:24.937 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406108+0000", 2024-09-12T22:32:24.938 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:24.938 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.938 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.938 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:24.938 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406108+0000", 2024-09-12T22:32:24.938 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:24.938 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.938 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.938 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:24.938 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406109+0000", 2024-09-12T22:32:24.938 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9899999999999999e-07 2024-09-12T22:32:24.938 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.938 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.938 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:24.939 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406115+0000", 2024-09-12T22:32:24.939 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9030000000000001e-06 2024-09-12T22:32:24.939 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.939 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.939 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:24.939 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406141+0000", 2024-09-12T22:32:24.939 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5999e-05 2024-09-12T22:32:24.939 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.939 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.939 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:24.939 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406150+0000", 2024-09-12T22:32:24.939 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.6050000000000004e-06 2024-09-12T22:32:24.939 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.939 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.940 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:24.940 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408163+0000", 2024-09-12T22:32:24.940 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0020122769999999998 2024-09-12T22:32:24.940 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.940 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.940 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:24.940 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408309+0000", 2024-09-12T22:32:24.940 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014606999999999999 2024-09-12T22:32:24.940 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.940 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.940 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:24.940 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408433+0000", 2024-09-12T22:32:24.940 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012460300000000001 2024-09-12T22:32:24.940 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.941 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.941 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:24.941 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409903+0000", 2024-09-12T22:32:24.941 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001469499 2024-09-12T22:32:24.941 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.941 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.941 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:24.941 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418427+0000", 2024-09-12T22:32:24.941 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0085241139999999993 2024-09-12T22:32:24.941 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.941 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.941 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:24.941 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418471+0000", 2024-09-12T22:32:24.942 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4474000000000001e-05 2024-09-12T22:32:24.942 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.942 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.942 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:24.942 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418566+0000", 2024-09-12T22:32:24.942 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.4732e-05 2024-09-12T22:32:24.942 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:24.942 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:24.942 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:24.942 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.942 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.942 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:24.942 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.407266+0000", 2024-09-12T22:32:24.942 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 47.417760284000003, 2024-09-12T22:32:24.943 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011442905, 2024-09-12T22:32:24.943 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:24.943 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:24.943 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2024-09-12T22:32:24.943 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:24.943 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.943 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:24.943 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407266+0000", 2024-09-12T22:32:24.943 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:24.943 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.943 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.943 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:24.943 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407266+0000", 2024-09-12T22:32:24.943 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:24.944 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.944 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.944 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:24.944 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407266+0000", 2024-09-12T22:32:24.944 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7899999999999998e-07 2024-09-12T22:32:24.944 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.944 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.944 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:24.944 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407269+0000", 2024-09-12T22:32:24.944 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9210000000000001e-06 2024-09-12T22:32:24.944 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.944 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.944 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:24.944 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407331+0000", 2024-09-12T22:32:24.945 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1376000000000003e-05 2024-09-12T22:32:24.945 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.945 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.945 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:24.945 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407337+0000", 2024-09-12T22:32:24.945 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1929999999999998e-06 2024-09-12T22:32:24.945 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.945 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.945 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:24.945 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408974+0000", 2024-09-12T22:32:24.945 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0016367109999999999 2024-09-12T22:32:24.945 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.945 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.945 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:24.946 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409112+0000", 2024-09-12T22:32:24.946 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000137952 2024-09-12T22:32:24.946 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:24.946 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:24.946 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:24.946 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418709+0000", 2024-09-12T22:32:24.946 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0095971730000000005 2024-09-12T22:32:24.946 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:24.946 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:24.946 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:24.946 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:24.946 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:24.946 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-09-12T22:32:24.948 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:32:24.948 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:24.946+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:25.049 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:32:25.047+0000 7fddec6a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30331) UID: 0 2024-09-12T22:32:25.067 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-09-12T22:32:25.067 INFO:teuthology.orchestra.run.smithi076.stdout: "ops": [], 2024-09-12T22:32:25.067 INFO:teuthology.orchestra.run.smithi076.stdout: "num_ops": 0 2024-09-12T22:32:25.067 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-09-12T22:32:25.078 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:32:25.150 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:25.149+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:25.224 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-09-12T22:32:25.224 INFO:teuthology.orchestra.run.smithi076.stdout: "ops": [], 2024-09-12T22:32:25.224 INFO:teuthology.orchestra.run.smithi076.stdout: "complaint_time": 30, 2024-09-12T22:32:25.224 INFO:teuthology.orchestra.run.smithi076.stdout: "num_blocked_ops": 0 2024-09-12T22:32:25.224 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-09-12T22:32:25.233 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:32:25.277 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:32:25.275+0000 7fddec6a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30331) UID: 0 2024-09-12T22:32:25.313 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T22:32:25.339 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-09-12T22:32:25.339 INFO:teuthology.orchestra.run.smithi076.stdout: "size": 20, 2024-09-12T22:32:25.339 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 600, 2024-09-12T22:32:25.339 INFO:teuthology.orchestra.run.smithi076.stdout: "ops": [ 2024-09-12T22:32:25.339 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.339 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:25.340 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.400604+0000", 2024-09-12T22:32:25.340 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 47.936508146999998, 2024-09-12T22:32:25.340 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.017278814, 2024-09-12T22:32:25.340 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:25.340 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:25.340 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:25.340 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:25.340 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.340 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:25.340 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400604+0000", 2024-09-12T22:32:25.340 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:25.341 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.341 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.341 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:25.341 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400604+0000", 2024-09-12T22:32:25.341 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:25.341 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.341 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.341 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:25.341 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400617+0000", 2024-09-12T22:32:25.341 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.3076e-05 2024-09-12T22:32:25.341 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.341 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.344 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:25.344 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400623+0000", 2024-09-12T22:32:25.344 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.5780000000000004e-06 2024-09-12T22:32:25.344 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.344 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.345 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:25.345 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400641+0000", 2024-09-12T22:32:25.345 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.8218000000000001e-05 2024-09-12T22:32:25.345 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.345 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.345 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:25.345 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400652+0000", 2024-09-12T22:32:25.345 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.0421999999999999e-05 2024-09-12T22:32:25.345 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.345 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.345 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:25.346 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400707+0000", 2024-09-12T22:32:25.346 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.4666000000000001e-05 2024-09-12T22:32:25.346 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.346 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.346 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op must wait for map", 2024-09-12T22:32:25.346 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400711+0000", 2024-09-12T22:32:25.346 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.5340000000000001e-06 2024-09-12T22:32:25.346 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.346 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.346 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:25.347 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.412066+0000", 2024-09-12T22:32:25.347 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.011354797999999999 2024-09-12T22:32:25.347 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.347 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.347 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:25.347 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.412672+0000", 2024-09-12T22:32:25.347 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00060620499999999996 2024-09-12T22:32:25.347 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.347 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.347 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:25.348 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.413032+0000", 2024-09-12T22:32:25.348 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00035955999999999998 2024-09-12T22:32:25.348 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.348 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.348 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op_commit", 2024-09-12T22:32:25.348 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417252+0000", 2024-09-12T22:32:25.348 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.004219899 2024-09-12T22:32:25.348 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.348 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.348 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:25.348 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417812+0000", 2024-09-12T22:32:25.349 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.000560182 2024-09-12T22:32:25.349 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.349 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.349 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:25.349 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417851+0000", 2024-09-12T22:32:25.349 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.9057999999999998e-05 2024-09-12T22:32:25.349 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.349 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.349 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:25.349 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417882+0000", 2024-09-12T22:32:25.350 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.1618000000000001e-05 2024-09-12T22:32:25.350 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:25.350 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:25.350 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:25.350 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.350 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.350 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:25.350 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.400674+0000", 2024-09-12T22:32:25.350 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 47.936437429000001, 2024-09-12T22:32:25.350 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.017348971000000001, 2024-09-12T22:32:25.350 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:25.350 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:25.350 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:25.351 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:25.351 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.351 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:25.351 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400674+0000", 2024-09-12T22:32:25.351 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:25.351 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.351 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.351 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:25.351 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400674+0000", 2024-09-12T22:32:25.351 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:25.351 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.351 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.351 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:25.351 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400675+0000", 2024-09-12T22:32:25.352 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.37e-07 2024-09-12T22:32:25.352 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.352 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.352 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:25.352 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400678+0000", 2024-09-12T22:32:25.352 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.303e-06 2024-09-12T22:32:25.352 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.352 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.352 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:25.352 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400684+0000", 2024-09-12T22:32:25.352 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.0290000000000002e-06 2024-09-12T22:32:25.352 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.352 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.353 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:25.353 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400688+0000", 2024-09-12T22:32:25.353 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.0890000000000002e-06 2024-09-12T22:32:25.353 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.353 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.353 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:25.353 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400806+0000", 2024-09-12T22:32:25.353 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00011814700000000001 2024-09-12T22:32:25.353 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.353 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.353 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:32:25.353 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400811+0000", 2024-09-12T22:32:25.353 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.0479999999999998e-06 2024-09-12T22:32:25.353 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.354 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.354 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:25.354 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.413877+0000", 2024-09-12T22:32:25.354 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.013065561 2024-09-12T22:32:25.354 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.354 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.354 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:25.354 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.413984+0000", 2024-09-12T22:32:25.354 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.000106566 2024-09-12T22:32:25.354 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.354 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.354 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:25.354 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.414264+0000", 2024-09-12T22:32:25.355 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00028067199999999999 2024-09-12T22:32:25.355 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.355 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.355 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op_commit", 2024-09-12T22:32:25.355 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417614+0000", 2024-09-12T22:32:25.355 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0033500729999999999 2024-09-12T22:32:25.355 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.355 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.355 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:25.355 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417946+0000", 2024-09-12T22:32:25.356 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00033209199999999998 2024-09-12T22:32:25.356 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.356 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.356 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:25.356 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417995+0000", 2024-09-12T22:32:25.356 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.808e-05 2024-09-12T22:32:25.356 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.356 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.356 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:25.356 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.418023+0000", 2024-09-12T22:32:25.356 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.8773999999999999e-05 2024-09-12T22:32:25.356 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:25.356 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:25.357 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:25.357 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.357 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.357 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:25.357 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.400694+0000", 2024-09-12T22:32:25.357 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 47.936417800000001, 2024-09-12T22:32:25.357 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.022845628, 2024-09-12T22:32:25.357 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:25.357 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:25.357 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:25.357 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:25.357 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.358 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:25.358 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400694+0000", 2024-09-12T22:32:25.358 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:25.358 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.358 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.358 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:25.358 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400694+0000", 2024-09-12T22:32:25.358 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:25.358 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.358 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.358 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:25.358 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400694+0000", 2024-09-12T22:32:25.359 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.48e-07 2024-09-12T22:32:25.359 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.359 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.359 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:25.359 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400709+0000", 2024-09-12T22:32:25.359 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.4888999999999999e-05 2024-09-12T22:32:25.359 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.359 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.359 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:25.359 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400722+0000", 2024-09-12T22:32:25.359 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.2882e-05 2024-09-12T22:32:25.359 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.359 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.360 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:25.360 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400732+0000", 2024-09-12T22:32:25.360 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.0299000000000001e-05 2024-09-12T22:32:25.360 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.360 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.360 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:25.360 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400793+0000", 2024-09-12T22:32:25.360 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.0253000000000001e-05 2024-09-12T22:32:25.360 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.360 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.360 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op must wait for map", 2024-09-12T22:32:25.360 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400798+0000", 2024-09-12T22:32:25.361 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.1569999999999999e-06 2024-09-12T22:32:25.361 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.361 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.361 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:25.361 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415059+0000", 2024-09-12T22:32:25.361 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.014260907 2024-09-12T22:32:25.361 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.361 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.361 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:25.361 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415396+0000", 2024-09-12T22:32:25.361 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00033720799999999997 2024-09-12T22:32:25.361 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.361 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.362 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:25.362 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415685+0000", 2024-09-12T22:32:25.362 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00028939900000000003 2024-09-12T22:32:25.362 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.362 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.362 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op_commit", 2024-09-12T22:32:25.362 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.418302+0000", 2024-09-12T22:32:25.362 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0026168039999999999 2024-09-12T22:32:25.362 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.362 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.362 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:25.362 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.423445+0000", 2024-09-12T22:32:25.362 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0051428150000000002 2024-09-12T22:32:25.363 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.363 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.363 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:25.363 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.423499+0000", 2024-09-12T22:32:25.363 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.3953000000000003e-05 2024-09-12T22:32:25.363 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.363 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.363 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:25.363 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.423540+0000", 2024-09-12T22:32:25.363 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.0813999999999999e-05 2024-09-12T22:32:25.363 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:25.363 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:25.363 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:25.364 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.364 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.364 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:25.364 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.400740+0000", 2024-09-12T22:32:25.364 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 47.936372077000001, 2024-09-12T22:32:25.364 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.022927528999999999, 2024-09-12T22:32:25.364 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:25.364 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:25.364 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:25.364 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:25.364 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.364 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:25.364 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400740+0000", 2024-09-12T22:32:25.365 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:25.365 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.365 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.365 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:25.365 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400740+0000", 2024-09-12T22:32:25.365 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:25.365 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.365 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.365 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:25.365 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400740+0000", 2024-09-12T22:32:25.365 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.3000000000000001e-07 2024-09-12T22:32:25.365 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.365 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.365 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:25.366 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400743+0000", 2024-09-12T22:32:25.366 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.5840000000000002e-06 2024-09-12T22:32:25.366 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.366 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.366 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:25.366 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400757+0000", 2024-09-12T22:32:25.366 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.3988999999999999e-05 2024-09-12T22:32:25.366 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.366 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.366 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:25.367 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400763+0000", 2024-09-12T22:32:25.367 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.686e-06 2024-09-12T22:32:25.367 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.367 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.367 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:25.367 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400818+0000", 2024-09-12T22:32:25.367 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.4941000000000001e-05 2024-09-12T22:32:25.367 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.367 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.367 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:32:25.367 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400824+0000", 2024-09-12T22:32:25.367 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.4600000000000002e-06 2024-09-12T22:32:25.367 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.367 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.368 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:25.368 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416227+0000", 2024-09-12T22:32:25.368 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.015403604 2024-09-12T22:32:25.368 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.368 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.368 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:25.368 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416306+0000", 2024-09-12T22:32:25.368 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 7.9126000000000001e-05 2024-09-12T22:32:25.368 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.368 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.368 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:25.368 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416678+0000", 2024-09-12T22:32:25.369 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00037105500000000002 2024-09-12T22:32:25.369 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.369 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.369 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op_commit", 2024-09-12T22:32:25.369 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.418363+0000", 2024-09-12T22:32:25.369 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.001685095 2024-09-12T22:32:25.369 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.369 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.369 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:25.369 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.423591+0000", 2024-09-12T22:32:25.369 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0052283980000000004 2024-09-12T22:32:25.369 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.369 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.369 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:25.370 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.423624+0000", 2024-09-12T22:32:25.370 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.3024000000000001e-05 2024-09-12T22:32:25.370 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.370 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.370 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:25.370 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.423667+0000", 2024-09-12T22:32:25.370 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.3136999999999997e-05 2024-09-12T22:32:25.370 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:25.370 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:25.370 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:25.370 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.370 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.370 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:25.370 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.400783+0000", 2024-09-12T22:32:25.371 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 47.936328545000002, 2024-09-12T22:32:25.371 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.016563729999999999, 2024-09-12T22:32:25.371 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:25.371 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:25.371 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:25.371 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:25.371 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.371 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:25.371 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400783+0000", 2024-09-12T22:32:25.371 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:25.371 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.371 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.371 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:25.371 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400783+0000", 2024-09-12T22:32:25.372 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:25.372 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.372 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.372 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:25.372 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400784+0000", 2024-09-12T22:32:25.372 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.5900000000000002e-07 2024-09-12T22:32:25.372 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.372 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.372 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:25.372 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400787+0000", 2024-09-12T22:32:25.372 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.1690000000000001e-06 2024-09-12T22:32:25.372 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.372 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.373 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:25.373 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400794+0000", 2024-09-12T22:32:25.373 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 7.058e-06 2024-09-12T22:32:25.373 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.373 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.373 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:25.373 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400798+0000", 2024-09-12T22:32:25.373 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.335e-06 2024-09-12T22:32:25.373 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.373 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.373 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:25.373 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400841+0000", 2024-09-12T22:32:25.373 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.2369e-05 2024-09-12T22:32:25.373 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.374 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.374 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op must wait for map", 2024-09-12T22:32:25.374 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400844+0000", 2024-09-12T22:32:25.374 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.128e-06 2024-09-12T22:32:25.374 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.374 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.374 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:25.374 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.410479+0000", 2024-09-12T22:32:25.374 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0096354189999999992 2024-09-12T22:32:25.374 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.374 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.374 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:25.374 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.410597+0000", 2024-09-12T22:32:25.375 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.000118305 2024-09-12T22:32:25.375 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.375 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.375 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:25.375 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.410838+0000", 2024-09-12T22:32:25.375 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.000240967 2024-09-12T22:32:25.375 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.375 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.375 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op_commit", 2024-09-12T22:32:25.375 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416489+0000", 2024-09-12T22:32:25.375 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0056507989999999998 2024-09-12T22:32:25.375 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.375 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.375 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:25.375 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417255+0000", 2024-09-12T22:32:25.376 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00076626199999999998 2024-09-12T22:32:25.376 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.376 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.376 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:25.376 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417306+0000", 2024-09-12T22:32:25.376 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.0319999999999999e-05 2024-09-12T22:32:25.376 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.376 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.376 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:25.376 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417347+0000", 2024-09-12T22:32:25.376 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.1140000000000003e-05 2024-09-12T22:32:25.376 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:25.376 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:25.377 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:25.377 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.377 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.377 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:25.377 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.400811+0000", 2024-09-12T22:32:25.377 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 47.936300476, 2024-09-12T22:32:25.377 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.017061263, 2024-09-12T22:32:25.377 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:25.377 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:25.377 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:25.377 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:25.377 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.377 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:25.377 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400811+0000", 2024-09-12T22:32:25.378 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:25.378 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.378 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.378 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:25.378 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400811+0000", 2024-09-12T22:32:25.378 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:25.378 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.378 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.378 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:25.378 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400812+0000", 2024-09-12T22:32:25.378 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.27e-07 2024-09-12T22:32:25.378 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.378 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.379 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:25.379 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400814+0000", 2024-09-12T22:32:25.379 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.553e-06 2024-09-12T22:32:25.379 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.379 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.379 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:25.379 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400819+0000", 2024-09-12T22:32:25.379 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.3569999999999997e-06 2024-09-12T22:32:25.379 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.379 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.379 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:25.379 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400824+0000", 2024-09-12T22:32:25.379 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.6820000000000002e-06 2024-09-12T22:32:25.380 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.380 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.380 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:25.380 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400871+0000", 2024-09-12T22:32:25.380 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.7311000000000002e-05 2024-09-12T22:32:25.380 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.380 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.380 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:32:25.380 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400875+0000", 2024-09-12T22:32:25.380 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.0960000000000001e-06 2024-09-12T22:32:25.380 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.380 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.381 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:25.381 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.412071+0000", 2024-09-12T22:32:25.381 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.011195999999999999 2024-09-12T22:32:25.381 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.381 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.381 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:25.381 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.412520+0000", 2024-09-12T22:32:25.381 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.000449522 2024-09-12T22:32:25.381 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.381 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.381 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:25.381 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.412655+0000", 2024-09-12T22:32:25.381 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00013487899999999999 2024-09-12T22:32:25.381 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.382 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.382 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op_commit", 2024-09-12T22:32:25.382 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417096+0000", 2024-09-12T22:32:25.382 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.004441113 2024-09-12T22:32:25.382 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.382 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.382 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:25.382 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417768+0000", 2024-09-12T22:32:25.382 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00067161100000000002 2024-09-12T22:32:25.382 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.382 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.382 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:25.382 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417834+0000", 2024-09-12T22:32:25.382 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.6058999999999999e-05 2024-09-12T22:32:25.383 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.383 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.383 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:25.383 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417873+0000", 2024-09-12T22:32:25.383 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.8753e-05 2024-09-12T22:32:25.383 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:25.383 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:25.383 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:25.383 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.383 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.383 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:25.383 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.400842+0000", 2024-09-12T22:32:25.383 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 47.936269768999999, 2024-09-12T22:32:25.383 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.022846262999999999, 2024-09-12T22:32:25.384 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:25.384 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:25.384 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:25.384 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:25.384 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.384 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:25.384 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400842+0000", 2024-09-12T22:32:25.384 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:25.384 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.384 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.384 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:25.384 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400842+0000", 2024-09-12T22:32:25.384 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:25.385 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.385 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.385 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:25.385 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400842+0000", 2024-09-12T22:32:25.385 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.9900000000000002e-07 2024-09-12T22:32:25.385 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.385 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.385 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:25.385 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400845+0000", 2024-09-12T22:32:25.385 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.8609999999999998e-06 2024-09-12T22:32:25.385 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.385 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.385 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:25.386 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400850+0000", 2024-09-12T22:32:25.386 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.634e-06 2024-09-12T22:32:25.386 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.386 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.386 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:25.386 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400855+0000", 2024-09-12T22:32:25.386 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.8339999999999998e-06 2024-09-12T22:32:25.386 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.386 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.386 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:25.386 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400886+0000", 2024-09-12T22:32:25.386 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.1393999999999998e-05 2024-09-12T22:32:25.386 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.386 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.387 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:32:25.387 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400888+0000", 2024-09-12T22:32:25.387 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.3470000000000001e-06 2024-09-12T22:32:25.387 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.387 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.387 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:25.387 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415640+0000", 2024-09-12T22:32:25.387 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.014751965000000001 2024-09-12T22:32:25.387 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.387 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.387 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:25.387 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415821+0000", 2024-09-12T22:32:25.387 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00018064399999999999 2024-09-12T22:32:25.388 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.388 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.388 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:25.388 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415949+0000", 2024-09-12T22:32:25.388 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00012816699999999999 2024-09-12T22:32:25.388 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.388 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.388 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op_commit", 2024-09-12T22:32:25.388 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.418337+0000", 2024-09-12T22:32:25.388 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0023878469999999998 2024-09-12T22:32:25.388 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.388 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.388 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:25.389 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.423588+0000", 2024-09-12T22:32:25.389 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0052509849999999997 2024-09-12T22:32:25.389 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.389 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.389 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:25.389 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.423650+0000", 2024-09-12T22:32:25.389 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.2026999999999994e-05 2024-09-12T22:32:25.389 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.389 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.389 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:25.389 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.423688+0000", 2024-09-12T22:32:25.389 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.8259000000000001e-05 2024-09-12T22:32:25.389 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:25.389 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:25.390 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:25.390 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.390 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.390 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:25.390 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.400862+0000", 2024-09-12T22:32:25.390 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 47.936249795000002, 2024-09-12T22:32:25.390 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.016404294, 2024-09-12T22:32:25.390 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:25.390 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:25.390 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "started", 2024-09-12T22:32:25.390 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:25.390 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.390 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:25.391 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400862+0000", 2024-09-12T22:32:25.391 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:25.391 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.391 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.391 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:25.391 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400862+0000", 2024-09-12T22:32:25.391 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:25.391 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.391 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.391 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:25.391 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400862+0000", 2024-09-12T22:32:25.391 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.8099999999999999e-07 2024-09-12T22:32:25.391 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.391 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.392 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:25.392 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400870+0000", 2024-09-12T22:32:25.392 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 8.1349999999999992e-06 2024-09-12T22:32:25.392 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.392 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.392 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:25.392 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400876+0000", 2024-09-12T22:32:25.392 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.2039999999999996e-06 2024-09-12T22:32:25.392 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.392 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.392 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:25.392 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400879+0000", 2024-09-12T22:32:25.392 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.529e-06 2024-09-12T22:32:25.393 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.393 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.393 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:25.393 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400912+0000", 2024-09-12T22:32:25.393 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.2653000000000001e-05 2024-09-12T22:32:25.393 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.393 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.393 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op must wait for map", 2024-09-12T22:32:25.393 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400915+0000", 2024-09-12T22:32:25.393 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.1099999999999999e-06 2024-09-12T22:32:25.393 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.393 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.393 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:25.393 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408727+0000", 2024-09-12T22:32:25.394 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0078123869999999996 2024-09-12T22:32:25.394 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.394 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.394 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:25.394 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408838+0000", 2024-09-12T22:32:25.394 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00011042700000000001 2024-09-12T22:32:25.394 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.394 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.394 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:25.394 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417266+0000", 2024-09-12T22:32:25.394 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0084285680000000009 2024-09-12T22:32:25.394 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:25.394 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:25.394 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:25.395 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.395 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.395 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:25.395 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.400889+0000", 2024-09-12T22:32:25.395 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 47.936222542000003, 2024-09-12T22:32:25.395 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.014929550999999999, 2024-09-12T22:32:25.395 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:25.395 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:25.395 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "started", 2024-09-12T22:32:25.395 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:25.395 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.395 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:25.395 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400889+0000", 2024-09-12T22:32:25.395 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:25.396 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.396 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.396 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:25.396 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400889+0000", 2024-09-12T22:32:25.396 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:25.396 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.396 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.396 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:25.396 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400890+0000", 2024-09-12T22:32:25.396 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.8699999999999995e-07 2024-09-12T22:32:25.396 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.396 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.396 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:25.396 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400893+0000", 2024-09-12T22:32:25.397 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.9569999999999998e-06 2024-09-12T22:32:25.397 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.397 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.397 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:25.397 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400899+0000", 2024-09-12T22:32:25.397 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.4189999999999999e-06 2024-09-12T22:32:25.397 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.397 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.397 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:25.397 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400905+0000", 2024-09-12T22:32:25.397 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.7880000000000003e-06 2024-09-12T22:32:25.397 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.397 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.397 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:25.398 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400943+0000", 2024-09-12T22:32:25.398 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.7852999999999998e-05 2024-09-12T22:32:25.398 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.398 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.398 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op must wait for map", 2024-09-12T22:32:25.398 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400945+0000", 2024-09-12T22:32:25.398 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.627e-06 2024-09-12T22:32:25.398 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.398 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.398 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:25.398 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408398+0000", 2024-09-12T22:32:25.398 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0074525879999999996 2024-09-12T22:32:25.398 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.398 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.399 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:25.399 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408581+0000", 2024-09-12T22:32:25.399 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00018321900000000001 2024-09-12T22:32:25.399 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.399 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.399 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:25.399 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415819+0000", 2024-09-12T22:32:25.399 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0072376130000000004 2024-09-12T22:32:25.399 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:25.399 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:25.399 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:25.399 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.399 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.400 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:25 3.7 e19/17 3:e0b41d06:::609.00000000:head v 19'2, mlcod=0'0)", 2024-09-12T22:32:25.400 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.402511+0000", 2024-09-12T22:32:25.400 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 47.934600398999997, 2024-09-12T22:32:25.400 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0089735260000000008, 2024-09-12T22:32:25.400 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:25.400 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:25.400 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:25.400 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:25.400 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.400 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:25.400 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.402511+0000", 2024-09-12T22:32:25.400 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:25.400 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.400 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.401 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:25.401 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.402511+0000", 2024-09-12T22:32:25.401 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:25.401 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.401 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.401 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:25.401 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.402512+0000", 2024-09-12T22:32:25.401 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 8.71e-07 2024-09-12T22:32:25.401 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.401 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.401 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:25.401 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.402520+0000", 2024-09-12T22:32:25.401 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 7.8529999999999992e-06 2024-09-12T22:32:25.402 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.402 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.402 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:25.402 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.402530+0000", 2024-09-12T22:32:25.402 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 9.859e-06 2024-09-12T22:32:25.402 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.402 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.402 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:25.402 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.402555+0000", 2024-09-12T22:32:25.402 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.4822000000000001e-05 2024-09-12T22:32:25.402 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.402 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.402 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:25.402 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.403173+0000", 2024-09-12T22:32:25.403 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00061813199999999997 2024-09-12T22:32:25.403 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.403 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.403 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:25.403 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.403195+0000", 2024-09-12T22:32:25.403 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.2286e-05 2024-09-12T22:32:25.403 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.403 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.403 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:25.403 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.411436+0000", 2024-09-12T22:32:25.403 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0082410539999999994 2024-09-12T22:32:25.403 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.403 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.403 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:25.404 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.411485+0000", 2024-09-12T22:32:25.404 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.8649000000000001e-05 2024-09-12T22:32:25.404 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:25.404 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:25.404 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:25.404 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.404 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.404 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:18 3.14 e19/17 3:2f55791f:::606.00000000:head v 19'1, mlcod=0'0)", 2024-09-12T22:32:25.404 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.406646+0000", 2024-09-12T22:32:25.404 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 47.930465247000001, 2024-09-12T22:32:25.404 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0082036980000000006, 2024-09-12T22:32:25.404 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:25.404 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:25.405 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:25.405 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:25.405 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.405 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:25.405 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406646+0000", 2024-09-12T22:32:25.405 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:25.405 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.405 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.405 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:25.405 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406646+0000", 2024-09-12T22:32:25.405 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:25.405 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.405 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.405 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:25.406 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406647+0000", 2024-09-12T22:32:25.406 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.4499999999999998e-07 2024-09-12T22:32:25.406 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.406 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.406 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:25.406 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406651+0000", 2024-09-12T22:32:25.406 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.0300000000000004e-06 2024-09-12T22:32:25.406 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.406 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.406 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:25.406 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406657+0000", 2024-09-12T22:32:25.406 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.1330000000000004e-06 2024-09-12T22:32:25.406 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.406 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.407 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:25.407 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406665+0000", 2024-09-12T22:32:25.407 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 8.3650000000000004e-06 2024-09-12T22:32:25.407 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.407 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.407 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:25.407 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406804+0000", 2024-09-12T22:32:25.407 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00013900699999999999 2024-09-12T22:32:25.407 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.407 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.407 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:25.407 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406833+0000", 2024-09-12T22:32:25.407 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.8243e-05 2024-09-12T22:32:25.407 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.408 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.408 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:25.408 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.414741+0000", 2024-09-12T22:32:25.408 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0079089620000000003 2024-09-12T22:32:25.408 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.408 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.408 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:25.408 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.414850+0000", 2024-09-12T22:32:25.408 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.000108713 2024-09-12T22:32:25.408 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:25.408 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:25.408 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:25.408 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.409 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.409 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:6 3.10 e19/17 3:0d82a743:::600.00000000:head v 19'1, mlcod=0'0)", 2024-09-12T22:32:25.409 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.406692+0000", 2024-09-12T22:32:25.409 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 47.930419479999998, 2024-09-12T22:32:25.409 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0093004430000000003, 2024-09-12T22:32:25.409 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:25.409 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:25.409 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:25.409 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:25.409 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.409 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:25.409 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406692+0000", 2024-09-12T22:32:25.409 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:25.409 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.410 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.410 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:25.410 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406692+0000", 2024-09-12T22:32:25.410 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:25.410 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.410 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.410 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:25.410 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406693+0000", 2024-09-12T22:32:25.410 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.6300000000000001e-07 2024-09-12T22:32:25.410 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.410 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.410 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:25.410 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406702+0000", 2024-09-12T22:32:25.411 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 9.5589999999999994e-06 2024-09-12T22:32:25.411 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.411 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.411 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:25.411 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406725+0000", 2024-09-12T22:32:25.411 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.2977999999999999e-05 2024-09-12T22:32:25.411 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.411 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.411 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:25.411 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406732+0000", 2024-09-12T22:32:25.411 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.8430000000000004e-06 2024-09-12T22:32:25.411 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.411 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.411 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:25.412 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406979+0000", 2024-09-12T22:32:25.412 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00024729199999999998 2024-09-12T22:32:25.412 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.412 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.412 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:25.412 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407000+0000", 2024-09-12T22:32:25.412 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.0573000000000001e-05 2024-09-12T22:32:25.412 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.412 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.412 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:25.412 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415928+0000", 2024-09-12T22:32:25.412 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0089286179999999993 2024-09-12T22:32:25.412 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.413 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.413 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:25.413 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415993+0000", 2024-09-12T22:32:25.413 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.4216999999999999e-05 2024-09-12T22:32:25.413 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:25.413 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:25.413 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:25.413 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.413 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.413 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:2 3.f e19/17 3:f1f69726:::400.00000000:head v 19'1, mlcod=0'0)", 2024-09-12T22:32:25.413 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.406942+0000", 2024-09-12T22:32:25.413 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 47.930169792999997, 2024-09-12T22:32:25.413 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0098433259999999995, 2024-09-12T22:32:25.413 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:25.414 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:25.414 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:25.414 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:25.414 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.414 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:25.414 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406942+0000", 2024-09-12T22:32:25.414 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:25.414 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.414 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.414 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:25.414 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406942+0000", 2024-09-12T22:32:25.414 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:25.414 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.415 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.415 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:25.415 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406943+0000", 2024-09-12T22:32:25.415 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.8800000000000002e-07 2024-09-12T22:32:25.415 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.415 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.415 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:25.415 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406949+0000", 2024-09-12T22:32:25.415 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.5869999999999998e-06 2024-09-12T22:32:25.415 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.415 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.415 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:25.416 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406960+0000", 2024-09-12T22:32:25.416 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.0873000000000001e-05 2024-09-12T22:32:25.416 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.416 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.416 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:25.416 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406970+0000", 2024-09-12T22:32:25.416 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 9.9119999999999993e-06 2024-09-12T22:32:25.416 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.416 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.416 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:25.416 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407535+0000", 2024-09-12T22:32:25.416 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00056508899999999996 2024-09-12T22:32:25.416 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.416 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.417 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:25.417 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407556+0000", 2024-09-12T22:32:25.417 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.1348999999999998e-05 2024-09-12T22:32:25.417 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.417 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.417 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:25.417 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416751+0000", 2024-09-12T22:32:25.417 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0091950109999999995 2024-09-12T22:32:25.417 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.417 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.417 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:25.417 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416785+0000", 2024-09-12T22:32:25.418 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.3917000000000001e-05 2024-09-12T22:32:25.418 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:25.418 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:25.418 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:25.418 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.418 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.418 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:19 3.14 e19/17 3:2f55791f:::606.00000000:head v 19'2, mlcod=0'0)", 2024-09-12T22:32:25.418 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.406983+0000", 2024-09-12T22:32:25.418 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 47.930128814, 2024-09-12T22:32:25.418 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0080362149999999993, 2024-09-12T22:32:25.418 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:25.418 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:25.418 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:25.419 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:25.419 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.419 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:25.419 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406983+0000", 2024-09-12T22:32:25.419 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:25.419 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.419 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.419 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:25.419 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406983+0000", 2024-09-12T22:32:25.419 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:25.419 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.419 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.419 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:25.419 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406983+0000", 2024-09-12T22:32:25.420 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.8200000000000001e-07 2024-09-12T22:32:25.420 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.420 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.420 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:25.420 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406999+0000", 2024-09-12T22:32:25.420 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.5747999999999999e-05 2024-09-12T22:32:25.420 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.420 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.420 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:25.420 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407006+0000", 2024-09-12T22:32:25.420 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 7.2609999999999996e-06 2024-09-12T22:32:25.420 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.420 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.421 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:25.421 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407035+0000", 2024-09-12T22:32:25.421 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.8214000000000001e-05 2024-09-12T22:32:25.421 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.421 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.421 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:25.421 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407092+0000", 2024-09-12T22:32:25.421 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.7027000000000001e-05 2024-09-12T22:32:25.421 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.421 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.421 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:25.421 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407126+0000", 2024-09-12T22:32:25.421 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.4082000000000003e-05 2024-09-12T22:32:25.422 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.422 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.422 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:25.422 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.414985+0000", 2024-09-12T22:32:25.422 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0078597319999999995 2024-09-12T22:32:25.422 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.422 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.422 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:25.422 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415019+0000", 2024-09-12T22:32:25.422 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.3769000000000001e-05 2024-09-12T22:32:25.422 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:25.422 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:25.422 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:25.422 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.423 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.423 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:7 3.10 e19/17 3:0d82a743:::600.00000000:head v 19'2, mlcod=0'0)", 2024-09-12T22:32:25.423 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.407048+0000", 2024-09-12T22:32:25.423 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 47.930063275999998, 2024-09-12T22:32:25.423 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.008979931, 2024-09-12T22:32:25.423 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:25.423 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:25.423 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:25.423 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:25.423 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.423 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:25.423 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407048+0000", 2024-09-12T22:32:25.424 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:25.424 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.424 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.424 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:25.424 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407048+0000", 2024-09-12T22:32:25.424 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:25.424 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.424 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.424 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:25.424 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407049+0000", 2024-09-12T22:32:25.424 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.9099999999999999e-07 2024-09-12T22:32:25.424 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.424 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.424 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:25.425 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407054+0000", 2024-09-12T22:32:25.425 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.1850000000000003e-06 2024-09-12T22:32:25.425 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.425 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.425 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:25.425 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407061+0000", 2024-09-12T22:32:25.425 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 7.0809999999999996e-06 2024-09-12T22:32:25.425 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.425 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.425 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:25.425 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407067+0000", 2024-09-12T22:32:25.425 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.9540000000000001e-06 2024-09-12T22:32:25.425 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.425 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.426 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:25.426 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407299+0000", 2024-09-12T22:32:25.426 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.000232122 2024-09-12T22:32:25.426 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.426 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.426 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:25.426 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407317+0000", 2024-09-12T22:32:25.426 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.7447000000000001e-05 2024-09-12T22:32:25.426 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.426 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.426 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:25.426 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415996+0000", 2024-09-12T22:32:25.426 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0086791799999999999 2024-09-12T22:32:25.426 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.427 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.427 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:25.427 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416028+0000", 2024-09-12T22:32:25.427 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.2570999999999997e-05 2024-09-12T22:32:25.427 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:25.427 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:25.427 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:25.427 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.427 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.427 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:8 3.10 e19/17 3:09401a81:::601.00000000:head v 19'3, mlcod=0'0)", 2024-09-12T22:32:25.427 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.407081+0000", 2024-09-12T22:32:25.427 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 47.930030586000001, 2024-09-12T22:32:25.427 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0089807270000000008, 2024-09-12T22:32:25.428 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:25.428 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:25.428 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:25.428 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:25.428 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.428 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:25.428 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407081+0000", 2024-09-12T22:32:25.428 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:25.428 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.428 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.428 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:25.428 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407081+0000", 2024-09-12T22:32:25.428 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:25.428 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.429 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.429 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:25.429 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407082+0000", 2024-09-12T22:32:25.429 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.7899999999999999e-07 2024-09-12T22:32:25.429 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.429 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.429 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:25.429 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407086+0000", 2024-09-12T22:32:25.429 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.7679999999999999e-06 2024-09-12T22:32:25.429 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.429 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.429 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:25.429 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407094+0000", 2024-09-12T22:32:25.430 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 8.1470000000000001e-06 2024-09-12T22:32:25.430 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.430 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.430 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:25.430 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407100+0000", 2024-09-12T22:32:25.430 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.4539999999999998e-06 2024-09-12T22:32:25.430 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.430 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.430 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:25.430 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407540+0000", 2024-09-12T22:32:25.430 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00043973699999999999 2024-09-12T22:32:25.430 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.430 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.430 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:25.431 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407553+0000", 2024-09-12T22:32:25.431 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.3368e-05 2024-09-12T22:32:25.431 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.431 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.431 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:25.431 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416032+0000", 2024-09-12T22:32:25.431 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0084793790000000004 2024-09-12T22:32:25.431 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.431 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.431 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:25.431 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416062+0000", 2024-09-12T22:32:25.431 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.9495000000000001e-05 2024-09-12T22:32:25.431 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:25.431 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:25.432 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:25.432 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.432 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.432 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:31 3.d e19/17 3:b50e409b:::mds_snaptable:head v 19'1, mlcod=0'0)", 2024-09-12T22:32:25.432 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.408508+0000", 2024-09-12T22:32:25.432 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 47.928604069999999, 2024-09-12T22:32:25.432 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0080056620000000002, 2024-09-12T22:32:25.432 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:25.432 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:25.432 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:25.432 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:25.432 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.432 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:25.432 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408508+0000", 2024-09-12T22:32:25.433 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:25.433 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.433 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.433 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:25.433 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408508+0000", 2024-09-12T22:32:25.433 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:25.433 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.433 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.433 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:25.433 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408508+0000", 2024-09-12T22:32:25.433 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.7e-07 2024-09-12T22:32:25.433 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.433 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.433 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:25.434 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408515+0000", 2024-09-12T22:32:25.434 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.4439999999999996e-06 2024-09-12T22:32:25.434 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.434 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.434 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:25.434 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408521+0000", 2024-09-12T22:32:25.434 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.2729999999999999e-06 2024-09-12T22:32:25.434 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.434 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.434 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:25.434 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408526+0000", 2024-09-12T22:32:25.434 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.3299999999999998e-06 2024-09-12T22:32:25.434 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.435 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.435 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:25.435 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.410190+0000", 2024-09-12T22:32:25.435 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.001663615 2024-09-12T22:32:25.435 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.435 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.435 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:25.435 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.410258+0000", 2024-09-12T22:32:25.435 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.8146999999999997e-05 2024-09-12T22:32:25.435 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.435 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.435 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:25.436 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416477+0000", 2024-09-12T22:32:25.436 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0062187329999999997 2024-09-12T22:32:25.436 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.436 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.436 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:25.436 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416513+0000", 2024-09-12T22:32:25.436 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.6650000000000003e-05 2024-09-12T22:32:25.436 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:25.436 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:25.436 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:25.436 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.436 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.436 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:9 3.10 e19/17 3:09401a81:::601.00000000:head v 19'4, mlcod=0'0)", 2024-09-12T22:32:25.436 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.408991+0000", 2024-09-12T22:32:25.437 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 47.928120319999998, 2024-09-12T22:32:25.437 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0080459209999999993, 2024-09-12T22:32:25.437 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:25.437 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:25.437 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:25.437 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:25.437 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.437 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:25.437 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408991+0000", 2024-09-12T22:32:25.437 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:25.437 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.437 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.437 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:25.437 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408991+0000", 2024-09-12T22:32:25.438 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:25.438 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.438 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.438 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:25.438 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408992+0000", 2024-09-12T22:32:25.438 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.1799999999999995e-07 2024-09-12T22:32:25.438 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.438 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.438 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:25.438 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409005+0000", 2024-09-12T22:32:25.438 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.261e-05 2024-09-12T22:32:25.438 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.438 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.438 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:25.439 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409015+0000", 2024-09-12T22:32:25.439 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.0001e-05 2024-09-12T22:32:25.439 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.439 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.439 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:25.439 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409023+0000", 2024-09-12T22:32:25.439 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 8.7569999999999993e-06 2024-09-12T22:32:25.439 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.439 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.439 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:25.439 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.411355+0000", 2024-09-12T22:32:25.439 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0023313520000000001 2024-09-12T22:32:25.439 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.440 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.440 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:25.440 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.411374+0000", 2024-09-12T22:32:25.440 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.8810000000000001e-05 2024-09-12T22:32:25.440 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.440 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.440 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:25.440 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416994+0000", 2024-09-12T22:32:25.440 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.005620524 2024-09-12T22:32:25.440 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.440 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.440 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:25.440 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417037+0000", 2024-09-12T22:32:25.440 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.3248999999999999e-05 2024-09-12T22:32:25.441 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:25.441 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:25.441 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:25.441 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.441 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.441 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:10 3.10 e19/17 3:0bd6d154:::602.00000000:head v 19'5, mlcod=0'0)", 2024-09-12T22:32:25.441 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.409038+0000", 2024-09-12T22:32:25.441 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 47.928073644999998, 2024-09-12T22:32:25.441 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0080541689999999999, 2024-09-12T22:32:25.441 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:25.441 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:25.441 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:25.441 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:25.441 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.442 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:25.442 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409038+0000", 2024-09-12T22:32:25.442 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:25.442 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.442 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.442 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:25.442 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409038+0000", 2024-09-12T22:32:25.442 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:25.442 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.442 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.442 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:25.442 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409038+0000", 2024-09-12T22:32:25.442 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.7899999999999999e-07 2024-09-12T22:32:25.442 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.443 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.443 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:25.443 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409043+0000", 2024-09-12T22:32:25.443 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.6589999999999998e-06 2024-09-12T22:32:25.443 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.443 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.443 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:25.443 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409050+0000", 2024-09-12T22:32:25.443 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 7.0829999999999998e-06 2024-09-12T22:32:25.443 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.443 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.443 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:25.443 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409058+0000", 2024-09-12T22:32:25.444 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 7.7309999999999993e-06 2024-09-12T22:32:25.444 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.444 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.444 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:25.444 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.411654+0000", 2024-09-12T22:32:25.444 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0025961650000000001 2024-09-12T22:32:25.444 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.444 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.444 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:25.444 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.411671+0000", 2024-09-12T22:32:25.444 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.7356000000000001e-05 2024-09-12T22:32:25.444 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.444 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.444 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:25.445 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417040+0000", 2024-09-12T22:32:25.445 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0053681889999999998 2024-09-12T22:32:25.445 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.445 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.445 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:25.445 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417092+0000", 2024-09-12T22:32:25.445 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.2607e-05 2024-09-12T22:32:25.445 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:25.445 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:25.445 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:25.445 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.445 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.445 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:11 3.10 e19/17 3:0bd6d154:::602.00000000:head v 19'6, mlcod=0'0)", 2024-09-12T22:32:25.446 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.409768+0000", 2024-09-12T22:32:25.446 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 47.927344204000001, 2024-09-12T22:32:25.446 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0074442759999999997, 2024-09-12T22:32:25.446 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:25.446 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:25.446 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:25.446 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:25.446 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.446 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:25.446 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409768+0000", 2024-09-12T22:32:25.446 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:25.446 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.446 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.446 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:25.447 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409768+0000", 2024-09-12T22:32:25.447 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:25.447 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.447 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.447 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:25.447 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409768+0000", 2024-09-12T22:32:25.447 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.37e-07 2024-09-12T22:32:25.447 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.447 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.447 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:25.447 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409775+0000", 2024-09-12T22:32:25.447 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.4670000000000001e-06 2024-09-12T22:32:25.447 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.448 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.448 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:25.448 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409793+0000", 2024-09-12T22:32:25.448 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.8162e-05 2024-09-12T22:32:25.448 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.448 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.448 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:25.448 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409954+0000", 2024-09-12T22:32:25.448 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00016072999999999999 2024-09-12T22:32:25.448 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.448 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.448 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:25.448 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.411943+0000", 2024-09-12T22:32:25.449 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0019897069999999998 2024-09-12T22:32:25.449 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.449 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.449 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:25.449 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.412069+0000", 2024-09-12T22:32:25.449 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00012546200000000001 2024-09-12T22:32:25.449 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.449 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.449 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:25.449 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417114+0000", 2024-09-12T22:32:25.449 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.005045023 2024-09-12T22:32:25.449 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:25.449 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:25.450 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:25.450 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417212+0000", 2024-09-12T22:32:25.450 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 9.8088e-05 2024-09-12T22:32:25.450 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:25.450 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:25.450 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:25.450 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:25.450 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:25.450 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-09-12T22:32:25.452 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:32:25.452 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:32:25.450+0000 7fddec6a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30331) UID: 0 2024-09-12T22:32:25.553 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:32:25.552+0000 7fddec6a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30331) UID: 0 2024-09-12T22:32:25.563 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:32:25.563 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:32:25.563 INFO:teuthology.orchestra.run.smithi148.stdout: "num_ops": 0 2024-09-12T22:32:25.563 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:32:25.572 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:32:25.654 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:25.653+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:25.675 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:32:25.675 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:32:25.675 INFO:teuthology.orchestra.run.smithi148.stdout: "complaint_time": 30, 2024-09-12T22:32:25.675 INFO:teuthology.orchestra.run.smithi148.stdout: "num_blocked_ops": 0 2024-09-12T22:32:25.675 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:32:25.683 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:32:25.757 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:25.755+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:25.789 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:32:25.789 INFO:teuthology.orchestra.run.smithi148.stdout: "size": 20, 2024-09-12T22:32:25.789 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 600, 2024-09-12T22:32:25.789 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [ 2024-09-12T22:32:25.789 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.789 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:25.790 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.400880+0000", 2024-09-12T22:32:25.790 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 48.386396187000003, 2024-09-12T22:32:25.790 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0095133660000000005, 2024-09-12T22:32:25.790 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:25.790 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:25.790 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:25.790 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:25.790 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.790 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:25.790 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400880+0000", 2024-09-12T22:32:25.790 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:25.790 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.790 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.791 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:25.791 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400880+0000", 2024-09-12T22:32:25.791 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:25.791 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.791 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.791 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:25.791 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400892+0000", 2024-09-12T22:32:25.791 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1941e-05 2024-09-12T22:32:25.791 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.791 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.791 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:25.791 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400900+0000", 2024-09-12T22:32:25.792 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0080000000000002e-06 2024-09-12T22:32:25.792 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.792 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.792 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:25.792 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400911+0000", 2024-09-12T22:32:25.792 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1452e-05 2024-09-12T22:32:25.792 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.792 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.792 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:25.792 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400922+0000", 2024-09-12T22:32:25.792 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0772e-05 2024-09-12T22:32:25.793 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.793 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.793 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:25.793 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401009+0000", 2024-09-12T22:32:25.793 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.7206000000000005e-05 2024-09-12T22:32:25.793 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.793 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.793 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:25.793 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401157+0000", 2024-09-12T22:32:25.793 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014831499999999999 2024-09-12T22:32:25.793 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.794 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.794 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:25.794 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401312+0000", 2024-09-12T22:32:25.794 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00015495600000000001 2024-09-12T22:32:25.794 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.794 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.794 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:25.794 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.403060+0000", 2024-09-12T22:32:25.794 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0017475220000000001 2024-09-12T22:32:25.794 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.794 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.795 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:25.795 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410300+0000", 2024-09-12T22:32:25.795 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0072403260000000001 2024-09-12T22:32:25.795 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.795 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.795 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:25.795 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410350+0000", 2024-09-12T22:32:25.795 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9814000000000001e-05 2024-09-12T22:32:25.795 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.795 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.796 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:25.796 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410393+0000", 2024-09-12T22:32:25.796 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3053999999999998e-05 2024-09-12T22:32:25.796 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:25.796 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:25.796 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:25.796 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.796 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.796 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:25.796 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.400952+0000", 2024-09-12T22:32:25.796 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 48.386324035000001, 2024-09-12T22:32:25.797 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0096045620000000005, 2024-09-12T22:32:25.797 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:25.797 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:25.797 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:25.797 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:25.797 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.797 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:25.797 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400952+0000", 2024-09-12T22:32:25.797 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:25.797 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.798 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.798 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:25.798 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400952+0000", 2024-09-12T22:32:25.798 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:25.798 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.798 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.798 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:25.798 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400953+0000", 2024-09-12T22:32:25.798 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.8000000000000005e-07 2024-09-12T22:32:25.798 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.798 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.798 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:25.799 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400957+0000", 2024-09-12T22:32:25.799 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.33e-06 2024-09-12T22:32:25.799 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.799 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.799 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:25.799 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400966+0000", 2024-09-12T22:32:25.799 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1989999999999995e-06 2024-09-12T22:32:25.799 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.799 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.799 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:25.799 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400973+0000", 2024-09-12T22:32:25.799 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2779999999999999e-06 2024-09-12T22:32:25.799 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.800 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.800 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:25.800 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401696+0000", 2024-09-12T22:32:25.800 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00072363500000000003 2024-09-12T22:32:25.800 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.800 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.800 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:25.800 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401788+0000", 2024-09-12T22:32:25.800 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1862999999999998e-05 2024-09-12T22:32:25.800 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.800 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.800 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:25.800 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401929+0000", 2024-09-12T22:32:25.801 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014096000000000001 2024-09-12T22:32:25.801 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.801 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.801 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:25.801 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.403542+0000", 2024-09-12T22:32:25.801 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001612963 2024-09-12T22:32:25.801 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.801 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.801 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:25.801 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410460+0000", 2024-09-12T22:32:25.801 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0069180500000000002 2024-09-12T22:32:25.801 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.801 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.802 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:25.802 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410515+0000", 2024-09-12T22:32:25.802 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5009000000000001e-05 2024-09-12T22:32:25.802 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.802 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.802 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:25.802 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410557+0000", 2024-09-12T22:32:25.802 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1495000000000002e-05 2024-09-12T22:32:25.802 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:25.802 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:25.802 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:25.802 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.802 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.803 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:25.803 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.400984+0000", 2024-09-12T22:32:25.803 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 48.386291540000002, 2024-09-12T22:32:25.803 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0073703950000000001, 2024-09-12T22:32:25.803 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:25.803 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:25.803 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:25.803 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:25.803 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.803 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:25.803 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400984+0000", 2024-09-12T22:32:25.804 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:25.804 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.804 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.804 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:25.804 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400984+0000", 2024-09-12T22:32:25.804 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:25.804 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.804 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.804 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:25.805 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400985+0000", 2024-09-12T22:32:25.805 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3200000000000005e-07 2024-09-12T22:32:25.805 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.805 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.805 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:25.805 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400998+0000", 2024-09-12T22:32:25.805 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2726e-05 2024-09-12T22:32:25.805 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.805 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.805 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:25.806 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401006+0000", 2024-09-12T22:32:25.806 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.3110000000000006e-06 2024-09-12T22:32:25.806 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.806 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.806 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:25.806 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401022+0000", 2024-09-12T22:32:25.806 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6249e-05 2024-09-12T22:32:25.806 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.806 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.806 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:25.806 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401700+0000", 2024-09-12T22:32:25.807 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00067811100000000001 2024-09-12T22:32:25.807 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.807 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.807 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:25.807 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401839+0000", 2024-09-12T22:32:25.807 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013865399999999999 2024-09-12T22:32:25.807 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.807 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.807 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:25.807 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401962+0000", 2024-09-12T22:32:25.807 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000123266 2024-09-12T22:32:25.807 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.807 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.807 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:25.808 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.403589+0000", 2024-09-12T22:32:25.808 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001626932 2024-09-12T22:32:25.808 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.808 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.808 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:25.808 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.408274+0000", 2024-09-12T22:32:25.808 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0046848100000000002 2024-09-12T22:32:25.808 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.808 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.808 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:25.808 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.408324+0000", 2024-09-12T22:32:25.808 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9784000000000003e-05 2024-09-12T22:32:25.808 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.809 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.809 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:25.809 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.408355+0000", 2024-09-12T22:32:25.809 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.1019999999999998e-05 2024-09-12T22:32:25.809 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:25.809 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:25.809 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:25.809 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.809 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.809 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:25.809 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401034+0000", 2024-09-12T22:32:25.809 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 48.386242099999997, 2024-09-12T22:32:25.809 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011063051000000001, 2024-09-12T22:32:25.809 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:25.810 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:25.810 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:25.810 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:25.810 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.810 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:25.810 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401034+0000", 2024-09-12T22:32:25.810 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:25.810 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.810 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.810 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:25.810 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401034+0000", 2024-09-12T22:32:25.810 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:25.810 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.810 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.811 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:25.811 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401034+0000", 2024-09-12T22:32:25.811 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8899999999999999e-07 2024-09-12T22:32:25.811 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.811 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.811 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:25.811 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401038+0000", 2024-09-12T22:32:25.811 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.523e-06 2024-09-12T22:32:25.811 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.811 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.811 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:25.811 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401046+0000", 2024-09-12T22:32:25.811 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0479999999999999e-06 2024-09-12T22:32:25.812 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.812 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.812 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:25.812 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401051+0000", 2024-09-12T22:32:25.812 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2619999999999998e-06 2024-09-12T22:32:25.812 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.812 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.812 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:25.812 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402270+0000", 2024-09-12T22:32:25.812 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012182429999999999 2024-09-12T22:32:25.812 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.812 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.812 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:25.812 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402325+0000", 2024-09-12T22:32:25.813 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5526999999999999e-05 2024-09-12T22:32:25.813 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.813 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.813 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:25.813 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402403+0000", 2024-09-12T22:32:25.813 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.7559999999999996e-05 2024-09-12T22:32:25.813 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.813 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.813 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:25.813 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.403655+0000", 2024-09-12T22:32:25.813 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012521489999999999 2024-09-12T22:32:25.813 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.813 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.814 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:25.814 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411979+0000", 2024-09-12T22:32:25.814 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0083240420000000002 2024-09-12T22:32:25.814 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.814 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.814 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:25.814 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.412036+0000", 2024-09-12T22:32:25.814 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7639000000000002e-05 2024-09-12T22:32:25.814 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.814 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.814 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:25.814 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.412097+0000", 2024-09-12T22:32:25.814 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0469e-05 2024-09-12T22:32:25.814 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:25.815 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:25.815 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:25.815 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.815 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.815 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:25.815 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401060+0000", 2024-09-12T22:32:25.815 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 48.386216347999998, 2024-09-12T22:32:25.815 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.010030172, 2024-09-12T22:32:25.815 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:25.815 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:25.815 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:25.815 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:25.815 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.815 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:25.816 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401060+0000", 2024-09-12T22:32:25.816 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:25.816 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.816 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.816 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:25.816 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401060+0000", 2024-09-12T22:32:25.816 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:25.816 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.816 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.817 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:25.817 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401060+0000", 2024-09-12T22:32:25.817 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2500000000000001e-07 2024-09-12T22:32:25.817 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.817 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.817 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:25.817 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401063+0000", 2024-09-12T22:32:25.817 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0910000000000001e-06 2024-09-12T22:32:25.817 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.817 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.817 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:25.817 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401070+0000", 2024-09-12T22:32:25.817 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1210000000000001e-06 2024-09-12T22:32:25.818 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.818 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.818 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:25.818 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401076+0000", 2024-09-12T22:32:25.818 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2830000000000001e-06 2024-09-12T22:32:25.818 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.818 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.818 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:25.818 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402288+0000", 2024-09-12T22:32:25.818 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012123699999999999 2024-09-12T22:32:25.818 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.818 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.818 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:25.818 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402359+0000", 2024-09-12T22:32:25.819 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.0988000000000005e-05 2024-09-12T22:32:25.819 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.819 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.819 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:25.819 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402457+0000", 2024-09-12T22:32:25.819 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.7857999999999997e-05 2024-09-12T22:32:25.819 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.819 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.819 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:25.819 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.404395+0000", 2024-09-12T22:32:25.819 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0019380160000000001 2024-09-12T22:32:25.819 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.819 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.820 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:25.820 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410603+0000", 2024-09-12T22:32:25.820 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.006208061 2024-09-12T22:32:25.820 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.820 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.820 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:25.820 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410687+0000", 2024-09-12T22:32:25.820 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.4623000000000006e-05 2024-09-12T22:32:25.820 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.820 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.820 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:25.820 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411090+0000", 2024-09-12T22:32:25.820 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00040233599999999999 2024-09-12T22:32:25.820 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:25.821 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:25.821 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:25.821 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.821 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.821 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:25.821 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401083+0000", 2024-09-12T22:32:25.821 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 48.386192932, 2024-09-12T22:32:25.821 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0097591850000000001, 2024-09-12T22:32:25.821 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:25.821 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:25.821 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:25.821 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:25.821 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.822 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:25.822 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401083+0000", 2024-09-12T22:32:25.822 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:25.822 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.822 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.822 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:25.822 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401083+0000", 2024-09-12T22:32:25.822 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:25.822 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.822 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.822 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:25.822 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401084+0000", 2024-09-12T22:32:25.822 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4799999999999999e-07 2024-09-12T22:32:25.822 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.823 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.823 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:25.823 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401088+0000", 2024-09-12T22:32:25.823 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6419999999999998e-06 2024-09-12T22:32:25.823 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.823 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.823 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:25.823 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401094+0000", 2024-09-12T22:32:25.823 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0090000000000004e-06 2024-09-12T22:32:25.823 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.823 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.823 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:25.823 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401108+0000", 2024-09-12T22:32:25.824 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3884e-05 2024-09-12T22:32:25.824 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.824 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.824 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:25.824 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401165+0000", 2024-09-12T22:32:25.824 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.6499000000000002e-05 2024-09-12T22:32:25.824 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.824 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.824 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:25.824 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401261+0000", 2024-09-12T22:32:25.824 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.6872000000000004e-05 2024-09-12T22:32:25.824 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.824 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.824 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:25.825 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401376+0000", 2024-09-12T22:32:25.825 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000114508 2024-09-12T22:32:25.825 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.825 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.825 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:25.825 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402666+0000", 2024-09-12T22:32:25.825 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012901659999999999 2024-09-12T22:32:25.825 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.825 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.825 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:25.825 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410572+0000", 2024-09-12T22:32:25.825 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0079055489999999996 2024-09-12T22:32:25.825 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.826 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.826 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:25.826 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410661+0000", 2024-09-12T22:32:25.826 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.9578000000000002e-05 2024-09-12T22:32:25.826 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.826 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.826 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:25.826 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410842+0000", 2024-09-12T22:32:25.826 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00018102999999999999 2024-09-12T22:32:25.826 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:25.826 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:25.826 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:25.826 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.826 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.827 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:25.827 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401122+0000", 2024-09-12T22:32:25.827 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 48.386153899999996, 2024-09-12T22:32:25.827 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0099122080000000005, 2024-09-12T22:32:25.827 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:25.827 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:25.827 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:32:25.827 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:25.827 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.827 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:25.827 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401122+0000", 2024-09-12T22:32:25.827 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:25.827 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.828 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.828 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:25.828 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401122+0000", 2024-09-12T22:32:25.828 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:25.828 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.828 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.828 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:25.828 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401123+0000", 2024-09-12T22:32:25.828 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2600000000000002e-07 2024-09-12T22:32:25.828 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.828 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.828 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:25.828 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401126+0000", 2024-09-12T22:32:25.828 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.6449999999999998e-06 2024-09-12T22:32:25.829 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.829 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.829 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:25.829 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401133+0000", 2024-09-12T22:32:25.829 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.9890000000000003e-06 2024-09-12T22:32:25.829 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.829 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.829 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:25.829 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401138+0000", 2024-09-12T22:32:25.829 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8060000000000002e-06 2024-09-12T22:32:25.829 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.829 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.829 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:25.830 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401703+0000", 2024-09-12T22:32:25.830 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00056509099999999999 2024-09-12T22:32:25.830 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.830 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.830 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:25.830 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401837+0000", 2024-09-12T22:32:25.830 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013338799999999999 2024-09-12T22:32:25.830 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.830 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.830 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:25.830 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411034+0000", 2024-09-12T22:32:25.830 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.009197663 2024-09-12T22:32:25.830 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:25.831 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:25.831 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:25.831 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.831 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.831 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:25.831 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401158+0000", 2024-09-12T22:32:25.831 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 48.386118121000003, 2024-09-12T22:32:25.831 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.010292437999999999, 2024-09-12T22:32:25.831 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:25.831 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:25.831 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:32:25.831 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:25.831 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.832 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:25.832 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401158+0000", 2024-09-12T22:32:25.832 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:25.832 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.832 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.832 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:25.832 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401158+0000", 2024-09-12T22:32:25.832 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:25.832 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.832 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.832 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:25.832 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401158+0000", 2024-09-12T22:32:25.832 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9699999999999996e-07 2024-09-12T22:32:25.833 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.833 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.833 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:25.833 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401161+0000", 2024-09-12T22:32:25.833 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.7410000000000001e-06 2024-09-12T22:32:25.833 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.833 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.833 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:25.833 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401168+0000", 2024-09-12T22:32:25.833 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.844e-06 2024-09-12T22:32:25.833 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.833 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.833 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:25.834 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401174+0000", 2024-09-12T22:32:25.834 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4700000000000001e-06 2024-09-12T22:32:25.834 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.834 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.834 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:25.834 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402799+0000", 2024-09-12T22:32:25.834 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0016256409999999999 2024-09-12T22:32:25.834 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.834 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.834 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:25.834 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402893+0000", 2024-09-12T22:32:25.834 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.3807999999999994e-05 2024-09-12T22:32:25.834 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.835 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.835 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:25.835 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411450+0000", 2024-09-12T22:32:25.835 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0085573369999999999 2024-09-12T22:32:25.835 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:25.835 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:25.835 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:25.835 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.835 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.835 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:25.835 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401183+0000", 2024-09-12T22:32:25.835 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 48.386093269, 2024-09-12T22:32:25.835 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0068597830000000004, 2024-09-12T22:32:25.835 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:25.836 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:25.836 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:32:25.836 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:25.836 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.836 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:25.836 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401183+0000", 2024-09-12T22:32:25.836 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:25.836 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.836 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.836 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:25.836 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401183+0000", 2024-09-12T22:32:25.836 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:25.836 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.837 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.837 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:25.837 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401183+0000", 2024-09-12T22:32:25.837 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.6700000000000003e-07 2024-09-12T22:32:25.837 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.837 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.837 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:25.837 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401186+0000", 2024-09-12T22:32:25.837 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4679999999999999e-06 2024-09-12T22:32:25.837 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.837 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.837 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:25.837 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401192+0000", 2024-09-12T22:32:25.837 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.1519999999999997e-06 2024-09-12T22:32:25.838 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.838 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.838 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:25.838 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401197+0000", 2024-09-12T22:32:25.838 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4669999999999998e-06 2024-09-12T22:32:25.838 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.838 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.838 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:25.838 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401253+0000", 2024-09-12T22:32:25.838 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.6211000000000001e-05 2024-09-12T22:32:25.838 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.838 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.838 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:25.838 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401413+0000", 2024-09-12T22:32:25.839 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00016021399999999999 2024-09-12T22:32:25.839 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.839 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.839 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:25.839 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.408043+0000", 2024-09-12T22:32:25.839 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0066295039999999996 2024-09-12T22:32:25.839 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:25.839 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:25.839 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:25.839 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.839 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.839 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:20 3.1c e19/17 3:3ed09add:::607.00000000:head v 19'1, mlcod=0'0)", 2024-09-12T22:32:25.839 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.409642+0000", 2024-09-12T22:32:25.839 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 48.377633809999999, 2024-09-12T22:32:25.840 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0038816269999999999, 2024-09-12T22:32:25.840 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:25.840 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:25.840 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:25.840 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:25.840 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.840 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:25.840 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409642+0000", 2024-09-12T22:32:25.840 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:25.840 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.840 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.840 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:25.840 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409642+0000", 2024-09-12T22:32:25.841 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:25.841 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.841 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.841 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:25.841 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409642+0000", 2024-09-12T22:32:25.841 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.6899999999999999e-07 2024-09-12T22:32:25.841 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.841 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.841 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:25.841 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409648+0000", 2024-09-12T22:32:25.841 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.49e-06 2024-09-12T22:32:25.841 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.841 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.842 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:25.842 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409656+0000", 2024-09-12T22:32:25.842 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.2949999999999994e-06 2024-09-12T22:32:25.842 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.842 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.842 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:25.842 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409664+0000", 2024-09-12T22:32:25.842 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.1219999999999995e-06 2024-09-12T22:32:25.842 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.842 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.842 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:25.842 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409707+0000", 2024-09-12T22:32:25.842 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2222000000000003e-05 2024-09-12T22:32:25.842 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.842 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.843 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:25.843 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409724+0000", 2024-09-12T22:32:25.843 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7496999999999999e-05 2024-09-12T22:32:25.843 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.843 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.843 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:25.843 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413439+0000", 2024-09-12T22:32:25.843 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00371448 2024-09-12T22:32:25.843 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.843 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.843 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:25.843 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413524+0000", 2024-09-12T22:32:25.843 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.5252000000000003e-05 2024-09-12T22:32:25.844 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:25.844 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:25.844 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:25.844 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.844 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.844 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:28 3.13 e19/17 3:cd5a64a3:::100.00000000:head v 19'1, mlcod=0'0)", 2024-09-12T22:32:25.844 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.409681+0000", 2024-09-12T22:32:25.844 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 48.377595327000002, 2024-09-12T22:32:25.844 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0038708710000000001, 2024-09-12T22:32:25.844 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:25.844 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:25.844 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:25.844 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:25.844 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.845 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:25.845 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409681+0000", 2024-09-12T22:32:25.845 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:25.845 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.845 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.845 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:25.845 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409681+0000", 2024-09-12T22:32:25.845 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:25.845 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.845 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.845 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:25.845 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409681+0000", 2024-09-12T22:32:25.845 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3000000000000002e-07 2024-09-12T22:32:25.845 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.846 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.846 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:25.846 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409695+0000", 2024-09-12T22:32:25.846 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4313e-05 2024-09-12T22:32:25.846 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.846 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.846 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:25.846 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409703+0000", 2024-09-12T22:32:25.846 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4000000000000003e-06 2024-09-12T22:32:25.846 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.846 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.846 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:25.846 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409708+0000", 2024-09-12T22:32:25.846 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3190000000000002e-06 2024-09-12T22:32:25.847 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.847 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.847 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:25.847 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409875+0000", 2024-09-12T22:32:25.847 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000167329 2024-09-12T22:32:25.847 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.847 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.847 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:25.847 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409892+0000", 2024-09-12T22:32:25.847 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6957999999999999e-05 2024-09-12T22:32:25.847 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.847 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.847 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:25.848 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413457+0000", 2024-09-12T22:32:25.848 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0035651279999999999 2024-09-12T22:32:25.848 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.848 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.848 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:25.848 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413552+0000", 2024-09-12T22:32:25.848 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.4093999999999997e-05 2024-09-12T22:32:25.848 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:25.848 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:25.848 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:25.848 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.848 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.848 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:21 3.1c e19/17 3:3ed09add:::607.00000000:head v 19'2, mlcod=0'0)", 2024-09-12T22:32:25.848 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.409718+0000", 2024-09-12T22:32:25.849 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 48.377557662000001, 2024-09-12T22:32:25.849 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003851883, 2024-09-12T22:32:25.849 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:25.849 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:25.849 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:25.849 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:25.849 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.849 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:25.849 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409718+0000", 2024-09-12T22:32:25.849 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:25.849 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.849 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.849 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:25.850 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409718+0000", 2024-09-12T22:32:25.850 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:25.850 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.850 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.850 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:25.850 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409719+0000", 2024-09-12T22:32:25.850 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.16e-07 2024-09-12T22:32:25.850 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.850 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.850 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:25.850 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409722+0000", 2024-09-12T22:32:25.850 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.692e-06 2024-09-12T22:32:25.850 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.850 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.851 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:25.851 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409729+0000", 2024-09-12T22:32:25.851 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.516e-06 2024-09-12T22:32:25.851 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.851 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.851 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:25.851 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409750+0000", 2024-09-12T22:32:25.851 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1151000000000001e-05 2024-09-12T22:32:25.851 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.851 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.851 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:25.851 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410015+0000", 2024-09-12T22:32:25.851 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00026477599999999999 2024-09-12T22:32:25.851 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.852 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.852 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:25.852 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410104+0000", 2024-09-12T22:32:25.852 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.9586000000000006e-05 2024-09-12T22:32:25.852 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.852 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.852 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:25.852 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413528+0000", 2024-09-12T22:32:25.852 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0034237880000000001 2024-09-12T22:32:25.852 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.852 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.852 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:25.852 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413570+0000", 2024-09-12T22:32:25.853 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2157999999999999e-05 2024-09-12T22:32:25.853 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:25.853 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:25.853 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:25.853 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.853 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.853 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:27 3.13 e19/17 3:c91d4a1d:::mds0_inotable:head v 19'2, mlcod=0'0)", 2024-09-12T22:32:25.853 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.409760+0000", 2024-09-12T22:32:25.853 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 48.377516145999998, 2024-09-12T22:32:25.853 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0039301910000000004, 2024-09-12T22:32:25.853 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:25.853 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:25.853 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:25.854 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:25.854 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.854 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:25.854 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409760+0000", 2024-09-12T22:32:25.854 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:25.854 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.854 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.854 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:25.854 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409760+0000", 2024-09-12T22:32:25.854 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:25.854 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.854 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.854 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:25.854 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409760+0000", 2024-09-12T22:32:25.855 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.39e-07 2024-09-12T22:32:25.855 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.855 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.855 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:25.855 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409765+0000", 2024-09-12T22:32:25.855 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4449999999999998e-06 2024-09-12T22:32:25.855 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.855 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.855 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:25.855 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409771+0000", 2024-09-12T22:32:25.855 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7159999999999997e-06 2024-09-12T22:32:25.855 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.855 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.856 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:25.856 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409778+0000", 2024-09-12T22:32:25.856 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.331e-06 2024-09-12T22:32:25.856 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.856 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.856 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:25.856 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410191+0000", 2024-09-12T22:32:25.856 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00041348300000000003 2024-09-12T22:32:25.856 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.856 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.856 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:25.856 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410211+0000", 2024-09-12T22:32:25.856 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9933999999999999e-05 2024-09-12T22:32:25.856 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.857 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.857 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:25.857 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413638+0000", 2024-09-12T22:32:25.857 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003426854 2024-09-12T22:32:25.857 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.857 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.857 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:25.857 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413690+0000", 2024-09-12T22:32:25.857 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2089000000000002e-05 2024-09-12T22:32:25.857 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:25.857 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:25.857 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:25.857 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.858 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.858 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "pg_update_log_missing_reply(3.b epoch 19/17 rep_tid 4 lcod 19'2)", 2024-09-12T22:32:25.858 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.410060+0000", 2024-09-12T22:32:25.858 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 48.377216480999998, 2024-09-12T22:32:25.858 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00098016500000000007, 2024-09-12T22:32:25.858 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:25.858 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:25.858 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "reached pg", 2024-09-12T22:32:25.858 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:25.858 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.858 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:25.858 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410060+0000", 2024-09-12T22:32:25.858 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:25.858 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.859 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.859 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:25.859 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410060+0000", 2024-09-12T22:32:25.859 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:25.859 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.859 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.859 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:25.859 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410060+0000", 2024-09-12T22:32:25.859 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.8299999999999998e-07 2024-09-12T22:32:25.859 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.859 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.859 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:25.859 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410062+0000", 2024-09-12T22:32:25.859 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5749999999999999e-06 2024-09-12T22:32:25.860 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.860 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.860 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:25.860 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410070+0000", 2024-09-12T22:32:25.860 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.909e-06 2024-09-12T22:32:25.860 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.860 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.860 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:25.860 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410076+0000", 2024-09-12T22:32:25.860 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7049999999999996e-06 2024-09-12T22:32:25.860 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.860 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.860 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:25.861 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410943+0000", 2024-09-12T22:32:25.861 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00086681900000000001 2024-09-12T22:32:25.861 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.861 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.861 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:25.861 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411040+0000", 2024-09-12T22:32:25.861 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.6774000000000006e-05 2024-09-12T22:32:25.861 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:25.861 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:25.861 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:25.861 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.861 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.861 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e19/17 ondisk, result = 0)", 2024-09-12T22:32:25.862 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.410113+0000", 2024-09-12T22:32:25.862 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 48.377163213999999, 2024-09-12T22:32:25.862 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00098911599999999995, 2024-09-12T22:32:25.862 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:25.862 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:25.862 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:32:25.862 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:25.862 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.862 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:25.862 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410113+0000", 2024-09-12T22:32:25.862 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:25.862 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.862 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.862 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:25.863 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410113+0000", 2024-09-12T22:32:25.863 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:25.863 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.863 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.863 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:25.863 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410113+0000", 2024-09-12T22:32:25.863 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.99e-07 2024-09-12T22:32:25.863 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.863 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.863 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:25.863 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410115+0000", 2024-09-12T22:32:25.863 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.046e-06 2024-09-12T22:32:25.863 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.864 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.864 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:25.864 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410121+0000", 2024-09-12T22:32:25.864 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0050000000000001e-06 2024-09-12T22:32:25.864 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.864 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.864 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:25.864 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410126+0000", 2024-09-12T22:32:25.864 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8339999999999998e-06 2024-09-12T22:32:25.864 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.864 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.864 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:25.864 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410587+0000", 2024-09-12T22:32:25.865 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00046095499999999998 2024-09-12T22:32:25.865 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.865 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.865 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:25.865 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410595+0000", 2024-09-12T22:32:25.865 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.9419999999999995e-06 2024-09-12T22:32:25.865 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.865 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.865 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:25.865 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411102+0000", 2024-09-12T22:32:25.865 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00050713500000000003 2024-09-12T22:32:25.865 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:25.865 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:25.865 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:25.866 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.866 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.866 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 19/17 rep_tid 8 lcod 19'4)", 2024-09-12T22:32:25.866 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.410133+0000", 2024-09-12T22:32:25.866 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 48.377143285999999, 2024-09-12T22:32:25.866 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0013504000000000001, 2024-09-12T22:32:25.866 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:25.866 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:25.866 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "reached pg", 2024-09-12T22:32:25.866 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:25.866 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.866 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:25.866 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410133+0000", 2024-09-12T22:32:25.867 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:25.867 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.867 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.867 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:25.867 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410133+0000", 2024-09-12T22:32:25.867 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:25.867 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.867 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.867 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:25.867 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410133+0000", 2024-09-12T22:32:25.867 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.0599999999999999e-07 2024-09-12T22:32:25.867 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.867 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.867 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:25.868 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410135+0000", 2024-09-12T22:32:25.868 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7770000000000001e-06 2024-09-12T22:32:25.868 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.868 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.868 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:25.868 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410140+0000", 2024-09-12T22:32:25.868 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9960000000000001e-06 2024-09-12T22:32:25.868 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.869 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.869 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:25.869 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410144+0000", 2024-09-12T22:32:25.869 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9500000000000003e-06 2024-09-12T22:32:25.869 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.869 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.869 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:25.869 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411310+0000", 2024-09-12T22:32:25.869 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001166311 2024-09-12T22:32:25.869 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.869 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.869 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:25.869 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411483+0000", 2024-09-12T22:32:25.869 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00017316 2024-09-12T22:32:25.870 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:25.870 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:25.870 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:25.870 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.870 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.870 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "pg_update_log_missing(3.1a epoch 19/17 rep_tid 0 entries 19'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T22:32:25.870 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.410617+0000", 2024-09-12T22:32:25.870 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 48.376658890999998, 2024-09-12T22:32:25.870 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0030439709999999999, 2024-09-12T22:32:25.870 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:25.870 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:25.870 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "reached pg", 2024-09-12T22:32:25.870 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:25.871 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.871 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:25.871 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410617+0000", 2024-09-12T22:32:25.871 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:25.871 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.871 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.871 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:25.871 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410617+0000", 2024-09-12T22:32:25.871 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:25.871 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.871 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.871 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:25.871 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410617+0000", 2024-09-12T22:32:25.871 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3599999999999999e-07 2024-09-12T22:32:25.872 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.872 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.872 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:25.872 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410625+0000", 2024-09-12T22:32:25.872 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5410000000000003e-06 2024-09-12T22:32:25.872 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.872 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.872 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:25.872 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410638+0000", 2024-09-12T22:32:25.872 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3261999999999999e-05 2024-09-12T22:32:25.872 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.872 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.872 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:25.873 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410653+0000", 2024-09-12T22:32:25.873 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4844000000000001e-05 2024-09-12T22:32:25.873 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.873 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.873 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:25.873 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410814+0000", 2024-09-12T22:32:25.873 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00016119999999999999 2024-09-12T22:32:25.873 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.873 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.873 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:25.873 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413661+0000", 2024-09-12T22:32:25.873 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0028467879999999998 2024-09-12T22:32:25.873 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:25.874 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:25.874 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:25.874 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.874 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.874 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-09-12T22:32:25.874 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:39.398875+0000", 2024-09-12T22:32:25.874 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 46.388400611000002, 2024-09-12T22:32:25.874 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0015679069999999999, 2024-09-12T22:32:25.874 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:25.874 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:25.874 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:25.874 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:25.874 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.874 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:25.875 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398875+0000", 2024-09-12T22:32:25.875 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:25.875 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.875 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.875 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:25.875 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398875+0000", 2024-09-12T22:32:25.875 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:25.875 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.875 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.875 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:25.875 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398878+0000", 2024-09-12T22:32:25.875 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1679999999999998e-06 2024-09-12T22:32:25.875 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.876 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.876 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:25.876 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398888+0000", 2024-09-12T22:32:25.876 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.084e-05 2024-09-12T22:32:25.876 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.876 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.876 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:25.876 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398906+0000", 2024-09-12T22:32:25.876 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7518000000000001e-05 2024-09-12T22:32:25.876 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.876 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.876 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:25.876 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398914+0000", 2024-09-12T22:32:25.877 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5989999999999996e-06 2024-09-12T22:32:25.877 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.877 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.877 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:25.877 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398974+0000", 2024-09-12T22:32:25.877 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0988e-05 2024-09-12T22:32:25.877 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.877 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.877 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:25.877 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.399078+0000", 2024-09-12T22:32:25.877 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000103133 2024-09-12T22:32:25.877 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.877 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.877 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:25.878 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.399166+0000", 2024-09-12T22:32:25.878 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.8183999999999995e-05 2024-09-12T22:32:25.878 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.878 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.878 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:25.878 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.399747+0000", 2024-09-12T22:32:25.878 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00058110599999999996 2024-09-12T22:32:25.878 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.878 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.878 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:25.878 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.400377+0000", 2024-09-12T22:32:25.878 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000630157 2024-09-12T22:32:25.878 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.878 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.879 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:25.879 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.400415+0000", 2024-09-12T22:32:25.879 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7814000000000001e-05 2024-09-12T22:32:25.879 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.879 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.879 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:25.879 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.400443+0000", 2024-09-12T22:32:25.879 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8399999999999999e-05 2024-09-12T22:32:25.879 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:25.879 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:25.879 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:25.879 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.879 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.880 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e23)", 2024-09-12T22:32:25.880 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:58.400966+0000", 2024-09-12T22:32:25.880 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 27.386309702999998, 2024-09-12T22:32:25.880 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001468876, 2024-09-12T22:32:25.880 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:25.880 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:25.880 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:25.880 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:25.880 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.880 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:25.880 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400966+0000", 2024-09-12T22:32:25.880 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:25.880 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.880 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.881 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:25.881 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400966+0000", 2024-09-12T22:32:25.881 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:25.881 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.881 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.881 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:25.881 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400967+0000", 2024-09-12T22:32:25.881 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.046e-06 2024-09-12T22:32:25.881 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.881 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.881 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:25.881 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400974+0000", 2024-09-12T22:32:25.881 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2310000000000001e-06 2024-09-12T22:32:25.881 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.882 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.882 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:25.882 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400988+0000", 2024-09-12T22:32:25.882 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4482e-05 2024-09-12T22:32:25.882 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.882 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.882 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:25.882 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400997+0000", 2024-09-12T22:32:25.882 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.0189999999999995e-06 2024-09-12T22:32:25.882 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.882 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.882 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:25.882 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.401068+0000", 2024-09-12T22:32:25.883 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1426000000000004e-05 2024-09-12T22:32:25.883 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.883 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.883 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:25.883 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.401174+0000", 2024-09-12T22:32:25.883 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000105769 2024-09-12T22:32:25.883 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.883 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.883 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:25.883 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.401335+0000", 2024-09-12T22:32:25.883 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000161225 2024-09-12T22:32:25.883 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.883 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.884 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:25.884 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.402110+0000", 2024-09-12T22:32:25.884 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00077428800000000004 2024-09-12T22:32:25.884 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.884 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.884 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:25.884 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.402333+0000", 2024-09-12T22:32:25.884 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000223723 2024-09-12T22:32:25.884 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.884 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.884 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:25.884 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.402388+0000", 2024-09-12T22:32:25.884 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4700999999999997e-05 2024-09-12T22:32:25.884 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.885 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.885 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:25.885 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.402435+0000", 2024-09-12T22:32:25.885 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6965999999999997e-05 2024-09-12T22:32:25.885 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:25.885 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:25.885 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:25.885 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.885 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.885 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:45 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e27)", 2024-09-12T22:32:25.885 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:32:04.401614+0000", 2024-09-12T22:32:25.885 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 21.385662274000001, 2024-09-12T22:32:25.885 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0014279749999999999, 2024-09-12T22:32:25.886 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:25.886 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:25.886 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:25.886 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:25.886 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.886 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:25.886 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401614+0000", 2024-09-12T22:32:25.886 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:25.886 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.886 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.886 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:25.886 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401614+0000", 2024-09-12T22:32:25.886 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:25.886 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.887 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.887 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:25.887 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401615+0000", 2024-09-12T22:32:25.887 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.161e-06 2024-09-12T22:32:25.887 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.887 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.887 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:25.887 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401621+0000", 2024-09-12T22:32:25.887 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8730000000000004e-06 2024-09-12T22:32:25.887 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.887 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.887 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:25.887 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401633+0000", 2024-09-12T22:32:25.887 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1800000000000001e-05 2024-09-12T22:32:25.888 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.888 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.888 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:25.888 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401656+0000", 2024-09-12T22:32:25.888 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.3521999999999999e-05 2024-09-12T22:32:25.888 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.888 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.888 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:25.888 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401713+0000", 2024-09-12T22:32:25.888 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7259000000000002e-05 2024-09-12T22:32:25.888 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.888 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.888 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:25.889 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401849+0000", 2024-09-12T22:32:25.889 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013613500000000001 2024-09-12T22:32:25.889 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.889 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.889 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:25.889 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.402009+0000", 2024-09-12T22:32:25.889 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00015947199999999999 2024-09-12T22:32:25.889 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.889 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.889 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:25.889 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.402629+0000", 2024-09-12T22:32:25.889 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00061962200000000001 2024-09-12T22:32:25.889 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.890 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.890 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:25.890 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.402983+0000", 2024-09-12T22:32:25.890 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00035447499999999998 2024-09-12T22:32:25.890 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.890 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.890 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:25.890 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.403016+0000", 2024-09-12T22:32:25.890 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3108999999999998e-05 2024-09-12T22:32:25.890 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:25.890 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:25.890 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:25.890 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.403042+0000", 2024-09-12T22:32:25.891 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5547000000000001e-05 2024-09-12T22:32:25.891 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:25.891 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:25.891 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:25.891 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:25.891 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:25.891 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:32:25.893 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:32:25.893 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:32:25.891+0000 7fddec6a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30331) UID: 0 2024-09-12T22:32:25.993 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:25.992+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:26.006 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-09-12T22:32:26.007 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-09-12T22:32:26.007 INFO:teuthology.orchestra.run.smithi163.stdout: "num_ops": 0 2024-09-12T22:32:26.007 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-09-12T22:32:26.016 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:32:26.094 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:26.092+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:26.165 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-09-12T22:32:26.165 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-09-12T22:32:26.165 INFO:teuthology.orchestra.run.smithi163.stdout: "complaint_time": 30, 2024-09-12T22:32:26.165 INFO:teuthology.orchestra.run.smithi163.stdout: "num_blocked_ops": 0 2024-09-12T22:32:26.165 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-09-12T22:32:26.170 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:32:26.215 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:26.214+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:26.276 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-09-12T22:32:26.276 INFO:teuthology.orchestra.run.smithi163.stdout: "size": 20, 2024-09-12T22:32:26.276 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 600, 2024-09-12T22:32:26.276 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2024-09-12T22:32:26.276 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.277 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-09-12T22:32:26.277 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:27.254459+0000", 2024-09-12T22:32:26.277 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 59.019333656000001, 2024-09-12T22:32:26.277 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.37816283899999997, 2024-09-12T22:32:26.277 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:26.277 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:26.277 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:26.277 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:26.277 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:26.277 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:26.277 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 1 2024-09-12T22:32:26.277 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.277 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:26.278 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.278 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:26.278 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254459+0000", 2024-09-12T22:32:26.278 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:26.278 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.278 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.278 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:26.278 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254459+0000", 2024-09-12T22:32:26.278 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:26.278 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.278 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.278 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:26.279 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254460+0000", 2024-09-12T22:32:26.279 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1739999999999999e-06 2024-09-12T22:32:26.279 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.279 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.279 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:26.279 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254472+0000", 2024-09-12T22:32:26.279 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2207e-05 2024-09-12T22:32:26.279 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.279 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.279 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:26.279 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254483+0000", 2024-09-12T22:32:26.279 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0631999999999999e-05 2024-09-12T22:32:26.279 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.280 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.280 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:26.280 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254492+0000", 2024-09-12T22:32:26.280 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3670000000000003e-06 2024-09-12T22:32:26.280 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.280 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.280 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:26.280 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254551+0000", 2024-09-12T22:32:26.280 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8687999999999998e-05 2024-09-12T22:32:26.280 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.280 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.280 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for peered", 2024-09-12T22:32:26.280 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254562+0000", 2024-09-12T22:32:26.281 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1249e-05 2024-09-12T22:32:26.281 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.281 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.281 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:26.281 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.631211+0000", 2024-09-12T22:32:26.281 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.376649018 2024-09-12T22:32:26.281 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.281 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.281 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:26.281 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.631345+0000", 2024-09-12T22:32:26.281 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013378700000000001 2024-09-12T22:32:26.281 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.282 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.282 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:26.282 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.631479+0000", 2024-09-12T22:32:26.282 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013352399999999999 2024-09-12T22:32:26.282 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.282 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.282 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:26.282 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632324+0000", 2024-09-12T22:32:26.282 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00084508100000000002 2024-09-12T22:32:26.282 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.282 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.283 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:26.283 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632548+0000", 2024-09-12T22:32:26.283 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000224329 2024-09-12T22:32:26.283 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.283 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.283 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:26.283 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632591+0000", 2024-09-12T22:32:26.283 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2564000000000001e-05 2024-09-12T22:32:26.283 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.283 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.283 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:26.283 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632622+0000", 2024-09-12T22:32:26.283 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1219e-05 2024-09-12T22:32:26.283 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:26.284 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:26.284 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:26.284 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.284 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.284 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:185 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:32:26.284 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394355+0000", 2024-09-12T22:32:26.284 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 57.879437559000003, 2024-09-12T22:32:26.284 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011302394, 2024-09-12T22:32:26.284 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:26.284 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:26.284 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:26.284 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:26.285 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:26.285 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:26.285 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 185 2024-09-12T22:32:26.285 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.285 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:26.285 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.285 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:26.285 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394355+0000", 2024-09-12T22:32:26.285 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:26.285 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.285 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.285 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:26.286 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394355+0000", 2024-09-12T22:32:26.286 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:26.286 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.286 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.286 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:26.286 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394355+0000", 2024-09-12T22:32:26.286 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9099999999999999e-07 2024-09-12T22:32:26.286 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.286 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.286 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:26.286 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394385+0000", 2024-09-12T22:32:26.286 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9963000000000001e-05 2024-09-12T22:32:26.287 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.287 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.287 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:26.287 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394390+0000", 2024-09-12T22:32:26.287 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8420000000000004e-06 2024-09-12T22:32:26.287 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.287 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.287 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:26.287 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394393+0000", 2024-09-12T22:32:26.287 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1e-06 2024-09-12T22:32:26.287 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.287 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.288 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:26.288 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.400546+0000", 2024-09-12T22:32:26.288 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0061523309999999996 2024-09-12T22:32:26.288 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.288 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.288 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:26.288 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.400588+0000", 2024-09-12T22:32:26.288 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1835000000000002e-05 2024-09-12T22:32:26.288 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.288 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.288 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:26.289 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.400677+0000", 2024-09-12T22:32:26.289 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9195000000000002e-05 2024-09-12T22:32:26.289 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.289 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.289 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:26.289 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405378+0000", 2024-09-12T22:32:26.289 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0047008659999999997 2024-09-12T22:32:26.289 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.289 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.289 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:26.289 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405569+0000", 2024-09-12T22:32:26.289 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00019148599999999999 2024-09-12T22:32:26.289 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.290 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.290 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:26.290 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405620+0000", 2024-09-12T22:32:26.290 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1416999999999999e-05 2024-09-12T22:32:26.290 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.290 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.290 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:26.290 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405657+0000", 2024-09-12T22:32:26.290 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6968000000000002e-05 2024-09-12T22:32:26.290 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:26.290 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:26.290 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:26.290 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.291 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.291 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:32:26.291 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394399+0000", 2024-09-12T22:32:26.291 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 57.879393348000001, 2024-09-12T22:32:26.291 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011336601999999999, 2024-09-12T22:32:26.291 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:26.291 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:26.291 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:26.291 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:26.291 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:26.291 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:26.291 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 186 2024-09-12T22:32:26.291 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.292 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:26.292 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.292 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:26.292 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394399+0000", 2024-09-12T22:32:26.292 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:26.292 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.292 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.292 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:26.292 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394399+0000", 2024-09-12T22:32:26.292 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:26.292 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.292 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.293 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:26.293 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394400+0000", 2024-09-12T22:32:26.293 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4499999999999998e-07 2024-09-12T22:32:26.293 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.293 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.293 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:26.293 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394402+0000", 2024-09-12T22:32:26.293 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.875e-06 2024-09-12T22:32:26.293 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.293 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.293 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:26.293 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394405+0000", 2024-09-12T22:32:26.294 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6799999999999999e-06 2024-09-12T22:32:26.294 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.294 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.294 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:26.294 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394408+0000", 2024-09-12T22:32:26.294 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.667e-06 2024-09-12T22:32:26.294 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.294 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.294 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:26.294 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401395+0000", 2024-09-12T22:32:26.294 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0069867230000000002 2024-09-12T22:32:26.295 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.295 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.295 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:26.295 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401438+0000", 2024-09-12T22:32:26.295 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3554999999999999e-05 2024-09-12T22:32:26.295 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.295 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.295 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:26.295 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401509+0000", 2024-09-12T22:32:26.295 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0631999999999997e-05 2024-09-12T22:32:26.295 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.296 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.296 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:26.296 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405392+0000", 2024-09-12T22:32:26.296 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0038830449999999999 2024-09-12T22:32:26.296 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.296 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.296 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:26.296 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405690+0000", 2024-09-12T22:32:26.296 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000298435 2024-09-12T22:32:26.296 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.296 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.296 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:26.296 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405716+0000", 2024-09-12T22:32:26.297 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5435999999999998e-05 2024-09-12T22:32:26.297 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.297 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.297 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:26.297 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405736+0000", 2024-09-12T22:32:26.297 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0208999999999999e-05 2024-09-12T22:32:26.297 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:26.298 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:26.298 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:26.298 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.298 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.298 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:32:26.298 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394411+0000", 2024-09-12T22:32:26.298 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 57.879381221999999, 2024-09-12T22:32:26.298 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011400117, 2024-09-12T22:32:26.299 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:26.299 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:26.299 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:26.299 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:26.299 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:26.299 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:26.299 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 187 2024-09-12T22:32:26.299 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.299 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:26.299 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.299 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:26.299 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394411+0000", 2024-09-12T22:32:26.299 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:26.299 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.300 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.300 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:26.300 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394411+0000", 2024-09-12T22:32:26.300 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:26.300 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.300 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.300 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:26.300 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394412+0000", 2024-09-12T22:32:26.300 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.4999999999999999e-07 2024-09-12T22:32:26.300 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.300 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.300 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:26.300 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394414+0000", 2024-09-12T22:32:26.301 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.984e-06 2024-09-12T22:32:26.301 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.301 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.301 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:26.301 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394418+0000", 2024-09-12T22:32:26.301 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0840000000000002e-06 2024-09-12T22:32:26.301 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.301 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.301 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:26.301 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394431+0000", 2024-09-12T22:32:26.301 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.361e-05 2024-09-12T22:32:26.301 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.301 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.302 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:26.302 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401778+0000", 2024-09-12T22:32:26.302 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0073462659999999997 2024-09-12T22:32:26.302 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.302 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.302 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:26.302 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401853+0000", 2024-09-12T22:32:26.302 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5797000000000006e-05 2024-09-12T22:32:26.302 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.302 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.302 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:26.302 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401990+0000", 2024-09-12T22:32:26.302 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013651399999999999 2024-09-12T22:32:26.302 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.303 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.303 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:26.303 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405402+0000", 2024-09-12T22:32:26.303 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0034116070000000001 2024-09-12T22:32:26.303 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.303 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.303 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:26.303 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405764+0000", 2024-09-12T22:32:26.303 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00036234899999999998 2024-09-12T22:32:26.303 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.303 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.303 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:26.303 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405791+0000", 2024-09-12T22:32:26.304 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7029000000000002e-05 2024-09-12T22:32:26.304 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.304 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.304 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:26.304 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405812+0000", 2024-09-12T22:32:26.304 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0627000000000001e-05 2024-09-12T22:32:26.304 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:26.304 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:26.304 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:26.305 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.305 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.305 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:32:26.305 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394447+0000", 2024-09-12T22:32:26.305 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 57.879346071000001, 2024-09-12T22:32:26.305 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011759588, 2024-09-12T22:32:26.305 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:26.305 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:26.305 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:26.306 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:26.306 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:26.306 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:26.306 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 188 2024-09-12T22:32:26.306 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.306 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:26.306 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.306 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:26.306 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394447+0000", 2024-09-12T22:32:26.306 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:26.307 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.307 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.307 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:26.307 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394447+0000", 2024-09-12T22:32:26.307 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:26.307 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.307 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.307 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:26.307 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394447+0000", 2024-09-12T22:32:26.307 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.15e-07 2024-09-12T22:32:26.307 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.307 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.307 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:26.307 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394512+0000", 2024-09-12T22:32:26.308 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4580999999999997e-05 2024-09-12T22:32:26.308 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.308 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.308 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:26.308 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394518+0000", 2024-09-12T22:32:26.308 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.3380000000000001e-06 2024-09-12T22:32:26.308 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.308 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.308 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:26.308 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394521+0000", 2024-09-12T22:32:26.308 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3340000000000002e-06 2024-09-12T22:32:26.308 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.309 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.309 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:26.309 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.402628+0000", 2024-09-12T22:32:26.309 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.008106996 2024-09-12T22:32:26.309 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.309 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.309 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:26.309 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.402670+0000", 2024-09-12T22:32:26.309 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1983000000000001e-05 2024-09-12T22:32:26.309 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.309 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.310 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:26.310 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.402738+0000", 2024-09-12T22:32:26.310 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.8114999999999994e-05 2024-09-12T22:32:26.310 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.310 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.310 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:26.310 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405668+0000", 2024-09-12T22:32:26.310 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.002929545 2024-09-12T22:32:26.310 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.310 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.310 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:26.310 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406162+0000", 2024-09-12T22:32:26.310 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000494408 2024-09-12T22:32:26.311 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.311 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.311 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:26.311 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406188+0000", 2024-09-12T22:32:26.311 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5766e-05 2024-09-12T22:32:26.311 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.311 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.311 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:26.311 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406206+0000", 2024-09-12T22:32:26.311 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.8107000000000001e-05 2024-09-12T22:32:26.311 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:26.311 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:26.311 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:26.312 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.312 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.312 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:32:26.312 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394528+0000", 2024-09-12T22:32:26.312 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 57.879264401999997, 2024-09-12T22:32:26.312 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.01195536, 2024-09-12T22:32:26.312 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:26.312 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:26.312 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:26.312 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:26.312 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:26.312 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:26.312 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 189 2024-09-12T22:32:26.312 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.313 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:26.313 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.313 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:26.313 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394528+0000", 2024-09-12T22:32:26.313 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:26.313 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.313 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.313 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:26.313 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394528+0000", 2024-09-12T22:32:26.313 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:26.313 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.313 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.313 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:26.314 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394529+0000", 2024-09-12T22:32:26.314 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4900000000000001e-07 2024-09-12T22:32:26.314 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.314 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.314 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:26.314 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394531+0000", 2024-09-12T22:32:26.314 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.458e-06 2024-09-12T22:32:26.314 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.314 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.314 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:26.314 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394535+0000", 2024-09-12T22:32:26.314 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7900000000000001e-06 2024-09-12T22:32:26.314 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.314 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.315 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:26.315 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394537+0000", 2024-09-12T22:32:26.315 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.632e-06 2024-09-12T22:32:26.315 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.315 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.315 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:26.315 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.404932+0000", 2024-09-12T22:32:26.315 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010394158000000001 2024-09-12T22:32:26.315 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.315 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.316 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:26.316 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405017+0000", 2024-09-12T22:32:26.316 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5525000000000005e-05 2024-09-12T22:32:26.316 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.316 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.316 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:26.316 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405114+0000", 2024-09-12T22:32:26.316 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.6527000000000006e-05 2024-09-12T22:32:26.316 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.316 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.316 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:26.316 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405818+0000", 2024-09-12T22:32:26.316 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00070412800000000005 2024-09-12T22:32:26.317 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.317 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.317 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:26.317 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406437+0000", 2024-09-12T22:32:26.317 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00061898900000000002 2024-09-12T22:32:26.317 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.317 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.317 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:26.317 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406463+0000", 2024-09-12T22:32:26.317 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6268e-05 2024-09-12T22:32:26.317 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.317 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.317 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:26.317 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406484+0000", 2024-09-12T22:32:26.318 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0536000000000001e-05 2024-09-12T22:32:26.318 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:26.318 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:26.318 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:26.318 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.318 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.318 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:26.318 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.401422+0000", 2024-09-12T22:32:26.318 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 48.872370496999999, 2024-09-12T22:32:26.318 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016896452999999999, 2024-09-12T22:32:26.319 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:26.319 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:26.319 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:26.319 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:26.319 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.319 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:26.319 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401422+0000", 2024-09-12T22:32:26.319 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:26.319 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.319 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.319 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:26.319 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401422+0000", 2024-09-12T22:32:26.319 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:26.319 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.320 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.320 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:26.320 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401424+0000", 2024-09-12T22:32:26.320 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9e-06 2024-09-12T22:32:26.320 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.320 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.320 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:26.320 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401437+0000", 2024-09-12T22:32:26.320 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2831e-05 2024-09-12T22:32:26.320 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.320 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.320 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:26.320 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401471+0000", 2024-09-12T22:32:26.321 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4010000000000001e-05 2024-09-12T22:32:26.321 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.321 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.321 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:26.321 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401484+0000", 2024-09-12T22:32:26.321 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2711000000000001e-05 2024-09-12T22:32:26.321 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.321 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.321 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:26.321 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405410+0000", 2024-09-12T22:32:26.321 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0039259170000000001 2024-09-12T22:32:26.321 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.321 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.321 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:26.322 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405529+0000", 2024-09-12T22:32:26.322 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000119778 2024-09-12T22:32:26.322 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.322 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.322 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:26.322 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405655+0000", 2024-09-12T22:32:26.322 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012556700000000001 2024-09-12T22:32:26.322 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.322 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.322 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:26.322 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410456+0000", 2024-09-12T22:32:26.322 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0048008269999999997 2024-09-12T22:32:26.322 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.322 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.323 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:26.323 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418226+0000", 2024-09-12T22:32:26.323 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0077707729999999999 2024-09-12T22:32:26.323 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.323 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.323 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:26.323 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418277+0000", 2024-09-12T22:32:26.323 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0476000000000003e-05 2024-09-12T22:32:26.323 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.323 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.323 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:26.323 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418319+0000", 2024-09-12T22:32:26.324 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1662999999999997e-05 2024-09-12T22:32:26.324 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:26.324 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:26.324 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:26.324 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.324 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.324 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:26.324 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.401505+0000", 2024-09-12T22:32:26.324 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 48.872287833000001, 2024-09-12T22:32:26.324 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016987904000000002, 2024-09-12T22:32:26.324 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:26.324 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:26.324 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:26.324 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:26.325 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.325 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:26.325 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401505+0000", 2024-09-12T22:32:26.325 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:26.325 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.325 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.325 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:26.325 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401505+0000", 2024-09-12T22:32:26.325 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:26.325 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.325 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.325 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:26.325 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401506+0000", 2024-09-12T22:32:26.326 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4700000000000001e-07 2024-09-12T22:32:26.326 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.326 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.326 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:26.326 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401510+0000", 2024-09-12T22:32:26.326 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6609999999999999e-06 2024-09-12T22:32:26.326 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.326 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.326 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:26.326 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401771+0000", 2024-09-12T22:32:26.326 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00026110700000000001 2024-09-12T22:32:26.326 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.326 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.327 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:26.327 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401921+0000", 2024-09-12T22:32:26.327 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014939099999999999 2024-09-12T22:32:26.327 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.327 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.327 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:26.327 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405944+0000", 2024-09-12T22:32:26.327 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0040235449999999999 2024-09-12T22:32:26.327 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.327 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.328 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:26.328 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406018+0000", 2024-09-12T22:32:26.328 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3373000000000004e-05 2024-09-12T22:32:26.328 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.328 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.328 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:26.329 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406172+0000", 2024-09-12T22:32:26.329 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00015435399999999999 2024-09-12T22:32:26.329 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.329 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.329 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:26.330 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410461+0000", 2024-09-12T22:32:26.330 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0042888609999999997 2024-09-12T22:32:26.330 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.330 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.331 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:26.331 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418371+0000", 2024-09-12T22:32:26.331 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0079098380000000006 2024-09-12T22:32:26.331 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.331 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.331 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:26.332 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418443+0000", 2024-09-12T22:32:26.332 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2705000000000003e-05 2024-09-12T22:32:26.332 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.332 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.332 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:26.333 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418493+0000", 2024-09-12T22:32:26.333 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9322e-05 2024-09-12T22:32:26.333 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:26.333 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:26.333 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:26.333 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.333 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.333 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:26.334 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.401939+0000", 2024-09-12T22:32:26.334 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 48.871854097000003, 2024-09-12T22:32:26.334 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016722292999999999, 2024-09-12T22:32:26.334 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:26.334 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:26.334 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:26.334 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:26.334 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.334 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:26.334 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401939+0000", 2024-09-12T22:32:26.335 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:26.335 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.335 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.335 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:26.335 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401939+0000", 2024-09-12T22:32:26.335 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:26.335 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.336 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.336 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:26.336 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401940+0000", 2024-09-12T22:32:26.336 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1990000000000001e-06 2024-09-12T22:32:26.336 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.336 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.336 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:26.336 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401956+0000", 2024-09-12T22:32:26.336 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.6344000000000001e-05 2024-09-12T22:32:26.336 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.336 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.336 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:26.336 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401974+0000", 2024-09-12T22:32:26.337 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7730000000000001e-05 2024-09-12T22:32:26.337 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.337 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.337 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:26.337 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401982+0000", 2024-09-12T22:32:26.337 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.7800000000000001e-06 2024-09-12T22:32:26.337 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.337 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.337 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:26.338 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406557+0000", 2024-09-12T22:32:26.338 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0045758489999999999 2024-09-12T22:32:26.338 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.338 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.338 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:26.339 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406697+0000", 2024-09-12T22:32:26.339 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013925100000000001 2024-09-12T22:32:26.339 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.339 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.339 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:26.339 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406830+0000", 2024-09-12T22:32:26.339 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013293499999999999 2024-09-12T22:32:26.339 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.340 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.340 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:26.340 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410465+0000", 2024-09-12T22:32:26.340 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0036352680000000001 2024-09-12T22:32:26.340 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.340 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.340 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:26.340 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418564+0000", 2024-09-12T22:32:26.340 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0080992140000000004 2024-09-12T22:32:26.340 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.340 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.340 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:26.340 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418621+0000", 2024-09-12T22:32:26.341 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7167999999999999e-05 2024-09-12T22:32:26.341 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.341 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.341 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:26.341 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418661+0000", 2024-09-12T22:32:26.341 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9555000000000003e-05 2024-09-12T22:32:26.341 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:26.341 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:26.341 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:26.341 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.341 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.341 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:26.341 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.401994+0000", 2024-09-12T22:32:26.341 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 48.871798224999999, 2024-09-12T22:32:26.342 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016804109000000001, 2024-09-12T22:32:26.342 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:26.342 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:26.342 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:26.342 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:26.342 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.342 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:26.342 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401994+0000", 2024-09-12T22:32:26.342 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:26.342 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.342 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.342 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:26.342 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401994+0000", 2024-09-12T22:32:26.342 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:26.343 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.343 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.343 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:26.343 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401995+0000", 2024-09-12T22:32:26.343 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.8899999999999998e-07 2024-09-12T22:32:26.343 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.343 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.343 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:26.343 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402000+0000", 2024-09-12T22:32:26.344 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.498e-06 2024-09-12T22:32:26.344 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.344 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.344 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:26.344 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402007+0000", 2024-09-12T22:32:26.344 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.554e-06 2024-09-12T22:32:26.344 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.345 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.345 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:26.345 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402046+0000", 2024-09-12T22:32:26.345 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9156000000000003e-05 2024-09-12T22:32:26.345 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.345 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.345 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:26.345 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407342+0000", 2024-09-12T22:32:26.345 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052957610000000004 2024-09-12T22:32:26.345 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.345 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.345 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:26.345 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407521+0000", 2024-09-12T22:32:26.346 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00017878100000000001 2024-09-12T22:32:26.346 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.346 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.346 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:26.346 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407641+0000", 2024-09-12T22:32:26.346 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012013 2024-09-12T22:32:26.346 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.346 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.346 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:26.346 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410472+0000", 2024-09-12T22:32:26.346 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.002830455 2024-09-12T22:32:26.346 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.346 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.347 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:26.347 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418714+0000", 2024-09-12T22:32:26.347 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0082422789999999999 2024-09-12T22:32:26.347 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.347 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.347 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:26.347 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418761+0000", 2024-09-12T22:32:26.347 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6956999999999998e-05 2024-09-12T22:32:26.347 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.347 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.347 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:26.347 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418799+0000", 2024-09-12T22:32:26.347 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7749000000000001e-05 2024-09-12T22:32:26.348 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:26.348 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:26.348 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:26.348 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.348 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.348 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:26.348 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.402060+0000", 2024-09-12T22:32:26.348 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 48.871732780999999, 2024-09-12T22:32:26.348 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016885686, 2024-09-12T22:32:26.349 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:26.349 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:26.349 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:26.349 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:26.349 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.349 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:26.349 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402060+0000", 2024-09-12T22:32:26.349 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:26.349 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.349 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.349 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:26.349 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402060+0000", 2024-09-12T22:32:26.349 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:26.349 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.350 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.350 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:26.350 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402061+0000", 2024-09-12T22:32:26.350 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4399999999999999e-07 2024-09-12T22:32:26.350 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.350 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.350 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:26.350 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402066+0000", 2024-09-12T22:32:26.350 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8649999999999998e-06 2024-09-12T22:32:26.350 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.350 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.350 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:26.350 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402146+0000", 2024-09-12T22:32:26.351 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9054000000000006e-05 2024-09-12T22:32:26.351 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.351 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.351 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:26.351 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402287+0000", 2024-09-12T22:32:26.351 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014108600000000001 2024-09-12T22:32:26.351 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.351 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.351 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:26.351 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408185+0000", 2024-09-12T22:32:26.351 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0058983919999999997 2024-09-12T22:32:26.351 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.352 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.352 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:26.352 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408299+0000", 2024-09-12T22:32:26.352 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114102 2024-09-12T22:32:26.352 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.353 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.353 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:26.353 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408420+0000", 2024-09-12T22:32:26.353 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000120492 2024-09-12T22:32:26.353 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.353 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.354 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:26.354 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410867+0000", 2024-09-12T22:32:26.354 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0024476430000000002 2024-09-12T22:32:26.354 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.354 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.354 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:26.354 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418851+0000", 2024-09-12T22:32:26.354 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0079841489999999994 2024-09-12T22:32:26.355 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.355 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.355 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:26.355 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418894+0000", 2024-09-12T22:32:26.355 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3090000000000002e-05 2024-09-12T22:32:26.355 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.355 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.356 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:26.356 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418946+0000", 2024-09-12T22:32:26.356 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1069000000000002e-05 2024-09-12T22:32:26.356 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:26.356 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:26.357 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:26.357 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.357 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.357 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:26.357 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.402375+0000", 2024-09-12T22:32:26.357 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 48.871417716000003, 2024-09-12T22:32:26.357 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016768531999999999, 2024-09-12T22:32:26.357 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:26.357 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:26.357 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:26.357 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:26.357 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.357 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:26.358 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402375+0000", 2024-09-12T22:32:26.358 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:26.358 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.358 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.358 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:26.358 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402375+0000", 2024-09-12T22:32:26.358 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:26.358 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.358 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.358 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:26.358 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402375+0000", 2024-09-12T22:32:26.358 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4099999999999999e-07 2024-09-12T22:32:26.358 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.358 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.359 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:26.359 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402379+0000", 2024-09-12T22:32:26.359 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9870000000000001e-06 2024-09-12T22:32:26.359 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.359 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.359 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:26.359 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402389+0000", 2024-09-12T22:32:26.359 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0000000000000001e-05 2024-09-12T22:32:26.359 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.359 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.359 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:26.359 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402401+0000", 2024-09-12T22:32:26.359 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.148e-05 2024-09-12T22:32:26.359 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.360 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.360 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:26.360 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409108+0000", 2024-09-12T22:32:26.360 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0067068429999999997 2024-09-12T22:32:26.360 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.360 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.360 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:26.360 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409189+0000", 2024-09-12T22:32:26.360 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0815999999999993e-05 2024-09-12T22:32:26.360 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.360 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.360 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:26.360 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409320+0000", 2024-09-12T22:32:26.361 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000131586 2024-09-12T22:32:26.361 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.361 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.361 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:26.361 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410872+0000", 2024-09-12T22:32:26.361 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0015521599999999999 2024-09-12T22:32:26.361 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.361 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.361 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:26.361 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419049+0000", 2024-09-12T22:32:26.361 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0081763719999999995 2024-09-12T22:32:26.361 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.361 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.362 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:26.362 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419107+0000", 2024-09-12T22:32:26.362 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7899000000000002e-05 2024-09-12T22:32:26.362 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.362 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.362 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:26.362 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419143+0000", 2024-09-12T22:32:26.362 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6847999999999997e-05 2024-09-12T22:32:26.362 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:26.362 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:26.362 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:26.362 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.362 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.363 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:26.363 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.402903+0000", 2024-09-12T22:32:26.363 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 48.870889304000002, 2024-09-12T22:32:26.363 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016378428, 2024-09-12T22:32:26.363 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:26.363 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:26.363 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:26.363 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:26.363 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.363 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:26.363 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402903+0000", 2024-09-12T22:32:26.363 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:26.363 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.363 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.364 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:26.364 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402903+0000", 2024-09-12T22:32:26.364 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:26.364 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.364 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.364 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:26.364 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402904+0000", 2024-09-12T22:32:26.364 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9500000000000001e-07 2024-09-12T22:32:26.364 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.364 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.364 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:26.364 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402944+0000", 2024-09-12T22:32:26.365 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0265000000000002e-05 2024-09-12T22:32:26.365 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.365 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.365 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:26.365 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402979+0000", 2024-09-12T22:32:26.365 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4378000000000002e-05 2024-09-12T22:32:26.365 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.365 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.365 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:26.365 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402987+0000", 2024-09-12T22:32:26.365 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3559999999999993e-06 2024-09-12T22:32:26.365 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.365 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.366 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:26.366 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409577+0000", 2024-09-12T22:32:26.366 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0065901709999999997 2024-09-12T22:32:26.366 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.366 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.366 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:26.366 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409653+0000", 2024-09-12T22:32:26.366 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5819e-05 2024-09-12T22:32:26.366 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.366 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.366 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:26.366 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409725+0000", 2024-09-12T22:32:26.366 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2200000000000007e-05 2024-09-12T22:32:26.366 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.367 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.368 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:26.368 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.411234+0000", 2024-09-12T22:32:26.368 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001508225 2024-09-12T22:32:26.368 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.368 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.369 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:26.369 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419212+0000", 2024-09-12T22:32:26.369 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0079783400000000004 2024-09-12T22:32:26.369 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.369 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.369 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:26.369 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419244+0000", 2024-09-12T22:32:26.369 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2384e-05 2024-09-12T22:32:26.369 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.369 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.369 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:26.369 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419282+0000", 2024-09-12T22:32:26.369 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7394999999999997e-05 2024-09-12T22:32:26.370 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:26.370 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:26.370 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:26.370 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.370 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.370 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:26.370 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.403135+0000", 2024-09-12T22:32:26.371 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 48.870657434000002, 2024-09-12T22:32:26.371 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016294211999999999, 2024-09-12T22:32:26.371 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:26.371 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:26.371 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:26.371 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:26.371 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.371 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:26.371 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403135+0000", 2024-09-12T22:32:26.371 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:26.371 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.371 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.372 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:26.372 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403135+0000", 2024-09-12T22:32:26.372 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:26.372 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.372 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.372 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:26.372 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403136+0000", 2024-09-12T22:32:26.372 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.4e-07 2024-09-12T22:32:26.372 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.372 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.372 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:26.372 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403149+0000", 2024-09-12T22:32:26.373 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2723e-05 2024-09-12T22:32:26.373 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.373 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.373 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:26.373 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403158+0000", 2024-09-12T22:32:26.373 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3919999999999992e-06 2024-09-12T22:32:26.373 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.373 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.373 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:26.373 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403166+0000", 2024-09-12T22:32:26.373 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.2309999999999996e-06 2024-09-12T22:32:26.373 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.374 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.374 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:26.374 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409944+0000", 2024-09-12T22:32:26.374 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0067775309999999998 2024-09-12T22:32:26.374 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.374 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.374 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:26.374 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410032+0000", 2024-09-12T22:32:26.374 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.7906999999999997e-05 2024-09-12T22:32:26.374 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.375 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.375 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:26.375 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410152+0000", 2024-09-12T22:32:26.375 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012037800000000001 2024-09-12T22:32:26.375 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.375 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.375 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:26.375 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.411945+0000", 2024-09-12T22:32:26.375 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0017931850000000001 2024-09-12T22:32:26.375 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.375 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.375 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:26.375 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419319+0000", 2024-09-12T22:32:26.375 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0073731780000000002 2024-09-12T22:32:26.376 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.376 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.376 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:26.376 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419376+0000", 2024-09-12T22:32:26.376 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7728e-05 2024-09-12T22:32:26.376 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.376 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.376 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:26.376 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419429+0000", 2024-09-12T22:32:26.376 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3019000000000002e-05 2024-09-12T22:32:26.376 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:26.377 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:26.377 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:26.377 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.377 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.377 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:26.377 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.403185+0000", 2024-09-12T22:32:26.377 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 48.870607552999999, 2024-09-12T22:32:26.377 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.014902164000000001, 2024-09-12T22:32:26.377 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:26.377 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:26.377 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:26.377 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:26.377 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.377 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:26.378 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403185+0000", 2024-09-12T22:32:26.378 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:26.378 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.378 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.378 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:26.378 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403185+0000", 2024-09-12T22:32:26.378 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:26.378 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.378 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.378 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:26.378 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403186+0000", 2024-09-12T22:32:26.378 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9400000000000005e-07 2024-09-12T22:32:26.378 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.379 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.379 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:26.379 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403191+0000", 2024-09-12T22:32:26.379 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6980000000000003e-06 2024-09-12T22:32:26.379 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.379 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.379 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:26.379 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403199+0000", 2024-09-12T22:32:26.379 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2520000000000002e-06 2024-09-12T22:32:26.379 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.379 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.379 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:26.380 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403205+0000", 2024-09-12T22:32:26.380 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.908e-06 2024-09-12T22:32:26.380 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.380 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.380 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:26.380 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403359+0000", 2024-09-12T22:32:26.380 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000154544 2024-09-12T22:32:26.380 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.380 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.380 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:26.380 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403528+0000", 2024-09-12T22:32:26.380 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000168455 2024-09-12T22:32:26.380 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.381 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.381 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:26.381 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403763+0000", 2024-09-12T22:32:26.381 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00023539599999999999 2024-09-12T22:32:26.381 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.381 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.381 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:26.381 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409378+0000", 2024-09-12T22:32:26.381 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056150000000000002 2024-09-12T22:32:26.381 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.381 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.381 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:26.381 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418012+0000", 2024-09-12T22:32:26.382 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0086339559999999999 2024-09-12T22:32:26.382 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.382 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.382 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:26.382 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418046+0000", 2024-09-12T22:32:26.382 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4267999999999998e-05 2024-09-12T22:32:26.382 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.382 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.383 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:26.383 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418087+0000", 2024-09-12T22:32:26.383 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0992999999999999e-05 2024-09-12T22:32:26.383 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:26.383 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:26.383 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:26.383 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.383 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.383 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:26.383 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.403273+0000", 2024-09-12T22:32:26.383 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 48.870519602000002, 2024-09-12T22:32:26.383 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.014934866, 2024-09-12T22:32:26.383 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:26.383 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:26.384 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:26.384 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:26.384 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.384 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:26.384 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403273+0000", 2024-09-12T22:32:26.384 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:26.384 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.384 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.384 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:26.384 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403273+0000", 2024-09-12T22:32:26.384 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:26.384 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.384 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.385 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:26.385 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403274+0000", 2024-09-12T22:32:26.385 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.297e-06 2024-09-12T22:32:26.385 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.385 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.385 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:26.385 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403282+0000", 2024-09-12T22:32:26.385 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6340000000000001e-06 2024-09-12T22:32:26.385 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.385 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.385 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:26.385 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403305+0000", 2024-09-12T22:32:26.385 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3149000000000001e-05 2024-09-12T22:32:26.386 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.386 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.386 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:26.386 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403320+0000", 2024-09-12T22:32:26.386 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4527e-05 2024-09-12T22:32:26.386 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.386 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.386 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:26.386 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.404928+0000", 2024-09-12T22:32:26.386 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001608459 2024-09-12T22:32:26.386 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.387 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.387 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:26.387 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405218+0000", 2024-09-12T22:32:26.387 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00028982900000000002 2024-09-12T22:32:26.387 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.387 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.387 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:26.387 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405829+0000", 2024-09-12T22:32:26.387 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00061127900000000005 2024-09-12T22:32:26.387 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.387 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.387 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:26.388 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409403+0000", 2024-09-12T22:32:26.388 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.003573597 2024-09-12T22:32:26.388 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.388 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.388 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:26.388 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418138+0000", 2024-09-12T22:32:26.388 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0087349969999999996 2024-09-12T22:32:26.388 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.388 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.388 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:26.389 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418178+0000", 2024-09-12T22:32:26.389 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0649999999999999e-05 2024-09-12T22:32:26.389 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.389 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.389 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:26.389 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418208+0000", 2024-09-12T22:32:26.390 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9448e-05 2024-09-12T22:32:26.390 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:26.390 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:26.390 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:26.390 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.390 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.391 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:26.391 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.405456+0000", 2024-09-12T22:32:26.391 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 48.868336456999998, 2024-09-12T22:32:26.391 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012888389, 2024-09-12T22:32:26.391 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:26.391 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:26.391 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:26.391 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:26.391 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.391 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:26.391 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405456+0000", 2024-09-12T22:32:26.392 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:26.392 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.392 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.392 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:26.392 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405456+0000", 2024-09-12T22:32:26.392 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:26.392 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.392 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.392 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:26.392 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405457+0000", 2024-09-12T22:32:26.392 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.6599999999999994e-07 2024-09-12T22:32:26.393 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.393 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.393 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:26.393 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405463+0000", 2024-09-12T22:32:26.393 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4739999999999996e-06 2024-09-12T22:32:26.393 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.393 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.393 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:26.393 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405474+0000", 2024-09-12T22:32:26.393 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1095e-05 2024-09-12T22:32:26.393 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.393 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.393 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:26.394 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405482+0000", 2024-09-12T22:32:26.394 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3610000000000001e-06 2024-09-12T22:32:26.394 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.394 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.394 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:26.394 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407051+0000", 2024-09-12T22:32:26.394 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0015688970000000001 2024-09-12T22:32:26.394 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.394 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.394 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:26.395 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407259+0000", 2024-09-12T22:32:26.395 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00020778300000000001 2024-09-12T22:32:26.395 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.395 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.395 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:26.395 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407622+0000", 2024-09-12T22:32:26.395 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000363066 2024-09-12T22:32:26.395 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.395 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.395 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:26.396 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409438+0000", 2024-09-12T22:32:26.396 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001816319 2024-09-12T22:32:26.396 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.396 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.396 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:26.396 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418257+0000", 2024-09-12T22:32:26.396 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0088187720000000008 2024-09-12T22:32:26.396 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.396 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.396 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:26.396 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418308+0000", 2024-09-12T22:32:26.396 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1180000000000001e-05 2024-09-12T22:32:26.397 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.397 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.397 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:26.397 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418345+0000", 2024-09-12T22:32:26.397 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6476000000000001e-05 2024-09-12T22:32:26.397 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:26.397 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:26.397 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:26.397 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.398 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.398 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:26.398 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.405496+0000", 2024-09-12T22:32:26.398 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 48.868297099999999, 2024-09-12T22:32:26.398 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013016012, 2024-09-12T22:32:26.398 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:26.398 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:26.398 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:26.398 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:26.398 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.398 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:26.399 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405496+0000", 2024-09-12T22:32:26.399 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:26.399 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.399 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.399 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:26.399 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405496+0000", 2024-09-12T22:32:26.399 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:26.399 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.400 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.400 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:26.400 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405496+0000", 2024-09-12T22:32:26.400 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7999999999999995e-07 2024-09-12T22:32:26.400 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.400 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.400 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:26.400 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405501+0000", 2024-09-12T22:32:26.401 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8359999999999999e-06 2024-09-12T22:32:26.401 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.401 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.401 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:26.401 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405514+0000", 2024-09-12T22:32:26.401 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2522e-05 2024-09-12T22:32:26.401 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.401 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.401 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:26.401 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405521+0000", 2024-09-12T22:32:26.401 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5020000000000003e-06 2024-09-12T22:32:26.401 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.401 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.402 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:26.402 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405575+0000", 2024-09-12T22:32:26.402 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4169999999999998e-05 2024-09-12T22:32:26.402 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.402 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.402 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:26.402 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405697+0000", 2024-09-12T22:32:26.402 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000121301 2024-09-12T22:32:26.402 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.402 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.403 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:26.403 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405829+0000", 2024-09-12T22:32:26.403 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000132662 2024-09-12T22:32:26.403 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.403 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.403 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:26.403 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409155+0000", 2024-09-12T22:32:26.403 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0033259050000000001 2024-09-12T22:32:26.403 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.403 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.403 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:26.403 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418425+0000", 2024-09-12T22:32:26.403 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0092696319999999999 2024-09-12T22:32:26.404 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.404 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.404 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:26.404 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418471+0000", 2024-09-12T22:32:26.404 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6213e-05 2024-09-12T22:32:26.404 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.404 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.404 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:26.404 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418512+0000", 2024-09-12T22:32:26.404 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0589000000000001e-05 2024-09-12T22:32:26.405 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:26.405 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:26.405 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:26.405 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.405 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.405 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:26.405 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.406108+0000", 2024-09-12T22:32:26.405 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 48.867684703000002, 2024-09-12T22:32:26.405 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012458175, 2024-09-12T22:32:26.405 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:26.406 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:26.406 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:26.406 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:26.406 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.406 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:26.406 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406108+0000", 2024-09-12T22:32:26.406 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:26.406 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.406 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.406 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:26.406 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406108+0000", 2024-09-12T22:32:26.407 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:26.407 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.407 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.407 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:26.407 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406109+0000", 2024-09-12T22:32:26.407 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9899999999999999e-07 2024-09-12T22:32:26.407 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.407 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.407 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:26.407 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406115+0000", 2024-09-12T22:32:26.407 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9030000000000001e-06 2024-09-12T22:32:26.407 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.407 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.408 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:26.408 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406141+0000", 2024-09-12T22:32:26.408 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5999e-05 2024-09-12T22:32:26.408 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.408 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.408 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:26.408 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406150+0000", 2024-09-12T22:32:26.408 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.6050000000000004e-06 2024-09-12T22:32:26.408 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.408 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.408 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:26.408 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408163+0000", 2024-09-12T22:32:26.408 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0020122769999999998 2024-09-12T22:32:26.409 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.409 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.409 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:26.409 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408309+0000", 2024-09-12T22:32:26.409 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014606999999999999 2024-09-12T22:32:26.409 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.409 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.409 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:26.409 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408433+0000", 2024-09-12T22:32:26.409 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012460300000000001 2024-09-12T22:32:26.409 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.409 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.409 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:26.410 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409903+0000", 2024-09-12T22:32:26.410 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001469499 2024-09-12T22:32:26.410 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.410 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.410 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:26.410 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418427+0000", 2024-09-12T22:32:26.410 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0085241139999999993 2024-09-12T22:32:26.410 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.410 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.410 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:26.410 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418471+0000", 2024-09-12T22:32:26.410 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4474000000000001e-05 2024-09-12T22:32:26.411 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.411 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.411 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:26.411 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418566+0000", 2024-09-12T22:32:26.411 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.4732e-05 2024-09-12T22:32:26.411 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:26.411 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:26.411 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:26.411 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.411 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.411 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:26.411 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.407266+0000", 2024-09-12T22:32:26.411 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 48.866526847000003, 2024-09-12T22:32:26.412 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011442905, 2024-09-12T22:32:26.412 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:26.412 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:26.412 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2024-09-12T22:32:26.412 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:26.412 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.412 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:26.412 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407266+0000", 2024-09-12T22:32:26.412 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:26.412 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.412 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.412 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:26.412 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407266+0000", 2024-09-12T22:32:26.413 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:26.413 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.413 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.413 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:26.413 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407266+0000", 2024-09-12T22:32:26.413 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7899999999999998e-07 2024-09-12T22:32:26.413 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.413 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.413 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:26.413 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407269+0000", 2024-09-12T22:32:26.413 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9210000000000001e-06 2024-09-12T22:32:26.413 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.413 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.413 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:26.414 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407331+0000", 2024-09-12T22:32:26.414 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1376000000000003e-05 2024-09-12T22:32:26.414 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.414 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.414 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:26.414 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407337+0000", 2024-09-12T22:32:26.414 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1929999999999998e-06 2024-09-12T22:32:26.414 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.414 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.414 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:26.414 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408974+0000", 2024-09-12T22:32:26.414 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0016367109999999999 2024-09-12T22:32:26.414 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.414 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.415 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:26.415 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409112+0000", 2024-09-12T22:32:26.415 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000137952 2024-09-12T22:32:26.415 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:26.415 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:26.415 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:26.415 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418709+0000", 2024-09-12T22:32:26.415 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0095971730000000005 2024-09-12T22:32:26.415 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:26.415 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:26.415 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:26.415 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:26.416 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:26.416 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-09-12T22:32:26.418 INFO:teuthology.orchestra.run.smithi019.stderr:noscrub is unset 2024-09-12T22:32:26.418 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:26.416+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:26.418 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:32:26.518 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:26.517+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:26.532 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-09-12T22:32:26.532 INFO:teuthology.orchestra.run.smithi076.stdout: "ops": [], 2024-09-12T22:32:26.532 INFO:teuthology.orchestra.run.smithi076.stdout: "num_ops": 0 2024-09-12T22:32:26.532 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-09-12T22:32:26.541 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:32:26.574 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T22:32:26.619 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:32:26.617+0000 7fddec6a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30331) UID: 0 2024-09-12T22:32:26.646 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-09-12T22:32:26.646 INFO:teuthology.orchestra.run.smithi076.stdout: "ops": [], 2024-09-12T22:32:26.646 INFO:teuthology.orchestra.run.smithi076.stdout: "complaint_time": 30, 2024-09-12T22:32:26.646 INFO:teuthology.orchestra.run.smithi076.stdout: "num_blocked_ops": 0 2024-09-12T22:32:26.646 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-09-12T22:32:26.654 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:32:26.701 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0: {} 2024-09-12T22:32:26.701 INFO:teuthology.orchestra.run.smithi019.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T22:32:26.719 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T22:32:26.720 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:32:26.736 INFO:teuthology.orchestra.run.smithi019.stdout:osd.2: {} 2024-09-12T22:32:26.736 INFO:teuthology.orchestra.run.smithi019.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T22:32:26.739 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:32:26.737+0000 7fddec6a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30331) UID: 0 2024-09-12T22:32:26.799 INFO:teuthology.orchestra.run.smithi076.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:26.799 INFO:teuthology.orchestra.run.smithi076.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:26.808 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:32:26.849 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:32:26.848+0000 7fddec6a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30331) UID: 0 2024-09-12T22:32:26.921 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:32:26.920+0000 7fddec6a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30331) UID: 0 2024-09-12T22:32:26.923 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:26.923 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:26.933 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:32:27.022 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:27.021+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:27.037 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:27.037 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:27.046 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:32:27.123 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:32:27.122+0000 7fddec6a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30331) UID: 0 2024-09-12T22:32:27.149 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:27.149 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:27.157 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:32:27.224 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:27.223+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:27.273 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:27.273 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:27.282 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:32:27.325 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:27.324+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:27.426 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:27.426 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:27.426 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:27.425+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:27.435 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:32:27.527 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:32:27.526+0000 7fddec6a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30331) UID: 0 2024-09-12T22:32:27.578 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:27.579 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:27.588 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:32:27.628 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:27.627+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:27.699 INFO:teuthology.orchestra.run.smithi076.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:27.699 INFO:teuthology.orchestra.run.smithi076.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:27.708 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:32:27.729 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:27.728+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:27.811 INFO:teuthology.orchestra.run.smithi076.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:27.811 INFO:teuthology.orchestra.run.smithi076.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:27.820 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:32:27.831 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:27.829+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:27.923 INFO:teuthology.orchestra.run.smithi076.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:27.923 INFO:teuthology.orchestra.run.smithi076.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:27.931 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:27.930+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:27.933 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:32:28.033 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:28.031+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:28.043 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:28.043 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:28.052 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:32:28.134 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:28.133+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:28.196 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:28.196 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:28.206 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:32:28.234 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:28.233+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:28.310 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:28.311 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:28.319 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:32:28.336 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:32:28.335+0000 7fddec6a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30331) UID: 0 2024-09-12T22:32:28.419 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T22:32:28.426 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:28.426 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:28.435 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:32:28.436 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:28.435+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:28.537 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:28.536+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:28.538 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:28.538 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:28.547 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:32:28.638 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:28.637+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:28.690 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:28.691 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:28.699 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:32:28.744 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:32:28.743+0000 7fddec6a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30331) UID: 0 2024-09-12T22:32:28.748 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T22:32:28.810 INFO:teuthology.orchestra.run.smithi076.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:28.811 INFO:teuthology.orchestra.run.smithi076.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:28.819 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:32:28.839 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:28.838+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:28.889 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0: {} 2024-09-12T22:32:28.889 INFO:teuthology.orchestra.run.smithi019.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T22:32:28.916 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T22:32:28.916 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:32:28.933 INFO:teuthology.orchestra.run.smithi019.stdout:osd.2: {} 2024-09-12T22:32:28.933 INFO:teuthology.orchestra.run.smithi019.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T22:32:28.939 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:28.938+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:28.964 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-09-12T22:32:28.964 INFO:teuthology.orchestra.run.smithi076.stdout: "ops": [], 2024-09-12T22:32:28.964 INFO:teuthology.orchestra.run.smithi076.stdout: "complaint_time": 30, 2024-09-12T22:32:28.965 INFO:teuthology.orchestra.run.smithi076.stdout: "num_blocked_ops": 0 2024-09-12T22:32:28.965 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-09-12T22:32:28.973 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:32:29.042 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:29.040+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:29.078 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-09-12T22:32:29.078 INFO:teuthology.orchestra.run.smithi076.stdout: "size": 20, 2024-09-12T22:32:29.078 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 600, 2024-09-12T22:32:29.079 INFO:teuthology.orchestra.run.smithi076.stdout: "ops": [ 2024-09-12T22:32:29.079 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.079 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:29.079 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.400604+0000", 2024-09-12T22:32:29.079 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 51.675471135999999, 2024-09-12T22:32:29.079 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.017278814, 2024-09-12T22:32:29.079 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:29.079 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:29.079 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:29.079 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:29.079 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.079 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:29.080 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400604+0000", 2024-09-12T22:32:29.080 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:29.080 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.080 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.080 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:29.080 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400604+0000", 2024-09-12T22:32:29.080 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:29.080 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.081 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.081 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:29.081 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400617+0000", 2024-09-12T22:32:29.081 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.3076e-05 2024-09-12T22:32:29.081 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.081 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.081 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:29.081 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400623+0000", 2024-09-12T22:32:29.082 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.5780000000000004e-06 2024-09-12T22:32:29.082 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.082 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.082 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:29.082 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400641+0000", 2024-09-12T22:32:29.082 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.8218000000000001e-05 2024-09-12T22:32:29.082 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.082 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.082 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:29.082 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400652+0000", 2024-09-12T22:32:29.082 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.0421999999999999e-05 2024-09-12T22:32:29.082 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.082 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.083 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:29.083 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400707+0000", 2024-09-12T22:32:29.083 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.4666000000000001e-05 2024-09-12T22:32:29.083 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.083 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.083 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op must wait for map", 2024-09-12T22:32:29.083 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400711+0000", 2024-09-12T22:32:29.083 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.5340000000000001e-06 2024-09-12T22:32:29.083 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.083 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.083 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:29.083 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.412066+0000", 2024-09-12T22:32:29.083 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.011354797999999999 2024-09-12T22:32:29.084 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.084 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.084 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:29.084 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.412672+0000", 2024-09-12T22:32:29.084 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00060620499999999996 2024-09-12T22:32:29.084 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.084 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.084 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:29.084 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.413032+0000", 2024-09-12T22:32:29.084 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00035955999999999998 2024-09-12T22:32:29.084 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.084 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.085 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op_commit", 2024-09-12T22:32:29.085 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417252+0000", 2024-09-12T22:32:29.085 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.004219899 2024-09-12T22:32:29.085 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.085 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.085 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:29.085 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417812+0000", 2024-09-12T22:32:29.085 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.000560182 2024-09-12T22:32:29.085 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.085 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.085 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:29.085 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417851+0000", 2024-09-12T22:32:29.085 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.9057999999999998e-05 2024-09-12T22:32:29.086 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.086 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.086 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:29.086 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417882+0000", 2024-09-12T22:32:29.086 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.1618000000000001e-05 2024-09-12T22:32:29.086 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:29.086 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:29.086 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:29.086 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.086 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.086 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:29.086 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.400674+0000", 2024-09-12T22:32:29.087 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 51.675400418000002, 2024-09-12T22:32:29.087 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.017348971000000001, 2024-09-12T22:32:29.087 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:29.087 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:29.087 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:29.087 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:29.087 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.087 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:29.087 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400674+0000", 2024-09-12T22:32:29.087 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:29.087 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.087 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.087 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:29.088 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400674+0000", 2024-09-12T22:32:29.088 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:29.088 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.088 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.088 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:29.088 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400675+0000", 2024-09-12T22:32:29.088 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.37e-07 2024-09-12T22:32:29.088 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.088 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.088 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:29.088 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400678+0000", 2024-09-12T22:32:29.088 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.303e-06 2024-09-12T22:32:29.088 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.088 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.089 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:29.089 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400684+0000", 2024-09-12T22:32:29.089 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.0290000000000002e-06 2024-09-12T22:32:29.089 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.089 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.089 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:29.089 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400688+0000", 2024-09-12T22:32:29.089 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.0890000000000002e-06 2024-09-12T22:32:29.090 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.090 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.090 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:29.090 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400806+0000", 2024-09-12T22:32:29.090 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00011814700000000001 2024-09-12T22:32:29.090 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.090 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.090 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:32:29.090 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400811+0000", 2024-09-12T22:32:29.090 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.0479999999999998e-06 2024-09-12T22:32:29.090 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.090 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.090 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:29.091 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.413877+0000", 2024-09-12T22:32:29.091 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.013065561 2024-09-12T22:32:29.091 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.091 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.091 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:29.091 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.413984+0000", 2024-09-12T22:32:29.091 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.000106566 2024-09-12T22:32:29.091 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.091 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.091 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:29.091 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.414264+0000", 2024-09-12T22:32:29.091 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00028067199999999999 2024-09-12T22:32:29.091 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.092 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.092 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op_commit", 2024-09-12T22:32:29.092 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417614+0000", 2024-09-12T22:32:29.092 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0033500729999999999 2024-09-12T22:32:29.093 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.093 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.093 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:29.093 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417946+0000", 2024-09-12T22:32:29.093 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00033209199999999998 2024-09-12T22:32:29.093 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.093 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.093 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:29.093 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417995+0000", 2024-09-12T22:32:29.093 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.808e-05 2024-09-12T22:32:29.093 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.093 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.093 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:29.094 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.418023+0000", 2024-09-12T22:32:29.094 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.8773999999999999e-05 2024-09-12T22:32:29.094 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:29.094 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:29.094 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:29.094 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.094 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.094 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:29.094 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.400694+0000", 2024-09-12T22:32:29.094 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 51.675380789000002, 2024-09-12T22:32:29.094 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.022845628, 2024-09-12T22:32:29.094 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:29.094 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:29.095 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:29.095 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:29.095 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.095 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:29.095 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400694+0000", 2024-09-12T22:32:29.095 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:29.095 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.095 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.095 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:29.095 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400694+0000", 2024-09-12T22:32:29.095 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:29.095 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.096 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.096 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:29.096 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400694+0000", 2024-09-12T22:32:29.096 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.48e-07 2024-09-12T22:32:29.096 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.096 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.097 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:29.097 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400709+0000", 2024-09-12T22:32:29.097 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.4888999999999999e-05 2024-09-12T22:32:29.097 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.097 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.097 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:29.097 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400722+0000", 2024-09-12T22:32:29.098 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.2882e-05 2024-09-12T22:32:29.098 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.098 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.098 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:29.098 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400732+0000", 2024-09-12T22:32:29.099 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.0299000000000001e-05 2024-09-12T22:32:29.099 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.099 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.099 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:29.099 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400793+0000", 2024-09-12T22:32:29.099 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.0253000000000001e-05 2024-09-12T22:32:29.100 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.100 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.100 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op must wait for map", 2024-09-12T22:32:29.101 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400798+0000", 2024-09-12T22:32:29.101 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.1569999999999999e-06 2024-09-12T22:32:29.101 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.101 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.101 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:29.101 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415059+0000", 2024-09-12T22:32:29.101 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.014260907 2024-09-12T22:32:29.102 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.102 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.102 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:29.102 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415396+0000", 2024-09-12T22:32:29.102 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00033720799999999997 2024-09-12T22:32:29.102 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.102 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.103 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:29.103 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415685+0000", 2024-09-12T22:32:29.103 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00028939900000000003 2024-09-12T22:32:29.103 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.103 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.103 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op_commit", 2024-09-12T22:32:29.104 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.418302+0000", 2024-09-12T22:32:29.104 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0026168039999999999 2024-09-12T22:32:29.104 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.104 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.105 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:29.105 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.423445+0000", 2024-09-12T22:32:29.105 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0051428150000000002 2024-09-12T22:32:29.105 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.105 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.105 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:29.105 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.423499+0000", 2024-09-12T22:32:29.105 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.3953000000000003e-05 2024-09-12T22:32:29.106 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.106 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.106 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:29.106 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.423540+0000", 2024-09-12T22:32:29.106 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.0813999999999999e-05 2024-09-12T22:32:29.106 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:29.106 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:29.107 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:29.107 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.107 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.107 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:29.107 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.400740+0000", 2024-09-12T22:32:29.108 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 51.675335066000002, 2024-09-12T22:32:29.108 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.022927528999999999, 2024-09-12T22:32:29.108 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:29.109 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:29.109 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:29.109 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:29.109 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.109 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:29.109 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400740+0000", 2024-09-12T22:32:29.109 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:29.110 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.110 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.110 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:29.110 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400740+0000", 2024-09-12T22:32:29.110 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:29.110 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.110 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.110 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:29.111 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400740+0000", 2024-09-12T22:32:29.111 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.3000000000000001e-07 2024-09-12T22:32:29.111 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.112 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.112 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:29.112 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400743+0000", 2024-09-12T22:32:29.112 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.5840000000000002e-06 2024-09-12T22:32:29.112 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.113 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.113 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:29.113 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400757+0000", 2024-09-12T22:32:29.113 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.3988999999999999e-05 2024-09-12T22:32:29.113 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.113 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.114 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:29.114 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400763+0000", 2024-09-12T22:32:29.114 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.686e-06 2024-09-12T22:32:29.114 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.114 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.115 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:29.115 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400818+0000", 2024-09-12T22:32:29.115 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.4941000000000001e-05 2024-09-12T22:32:29.115 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.115 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.115 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:32:29.115 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400824+0000", 2024-09-12T22:32:29.116 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.4600000000000002e-06 2024-09-12T22:32:29.116 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.116 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.116 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:29.116 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416227+0000", 2024-09-12T22:32:29.116 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.015403604 2024-09-12T22:32:29.116 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.117 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.117 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:29.117 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416306+0000", 2024-09-12T22:32:29.117 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 7.9126000000000001e-05 2024-09-12T22:32:29.117 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.117 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.117 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:29.118 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416678+0000", 2024-09-12T22:32:29.118 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00037105500000000002 2024-09-12T22:32:29.118 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.118 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.118 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op_commit", 2024-09-12T22:32:29.118 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.418363+0000", 2024-09-12T22:32:29.118 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.001685095 2024-09-12T22:32:29.118 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.119 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.119 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:29.119 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.423591+0000", 2024-09-12T22:32:29.119 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0052283980000000004 2024-09-12T22:32:29.119 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.119 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.120 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:29.120 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.423624+0000", 2024-09-12T22:32:29.120 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.3024000000000001e-05 2024-09-12T22:32:29.120 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.120 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.120 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:29.120 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.423667+0000", 2024-09-12T22:32:29.121 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.3136999999999997e-05 2024-09-12T22:32:29.121 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:29.121 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:29.121 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:29.121 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.121 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.121 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:29.122 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.400783+0000", 2024-09-12T22:32:29.122 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 51.675291534000003, 2024-09-12T22:32:29.122 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.016563729999999999, 2024-09-12T22:32:29.122 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:29.122 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:29.122 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:29.122 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:29.122 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.123 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:29.123 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400783+0000", 2024-09-12T22:32:29.123 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:29.123 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.123 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.123 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:29.123 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400783+0000", 2024-09-12T22:32:29.124 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:29.124 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.124 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.124 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:29.124 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400784+0000", 2024-09-12T22:32:29.124 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.5900000000000002e-07 2024-09-12T22:32:29.124 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.125 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.125 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:29.125 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400787+0000", 2024-09-12T22:32:29.125 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.1690000000000001e-06 2024-09-12T22:32:29.125 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.125 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.125 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:29.126 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400794+0000", 2024-09-12T22:32:29.126 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 7.058e-06 2024-09-12T22:32:29.126 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.126 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.126 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:29.126 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400798+0000", 2024-09-12T22:32:29.126 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.335e-06 2024-09-12T22:32:29.127 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.127 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.127 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:29.127 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400841+0000", 2024-09-12T22:32:29.127 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.2369e-05 2024-09-12T22:32:29.127 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.127 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.128 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op must wait for map", 2024-09-12T22:32:29.128 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400844+0000", 2024-09-12T22:32:29.128 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.128e-06 2024-09-12T22:32:29.128 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.128 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.128 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:29.128 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.410479+0000", 2024-09-12T22:32:29.129 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0096354189999999992 2024-09-12T22:32:29.129 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.129 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.129 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:29.129 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.410597+0000", 2024-09-12T22:32:29.129 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.000118305 2024-09-12T22:32:29.129 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.130 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.130 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:29.130 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.410838+0000", 2024-09-12T22:32:29.130 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.000240967 2024-09-12T22:32:29.130 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.131 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.131 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op_commit", 2024-09-12T22:32:29.131 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416489+0000", 2024-09-12T22:32:29.131 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0056507989999999998 2024-09-12T22:32:29.131 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.131 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.131 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:29.132 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417255+0000", 2024-09-12T22:32:29.132 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00076626199999999998 2024-09-12T22:32:29.132 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.132 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.132 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:29.132 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417306+0000", 2024-09-12T22:32:29.132 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.0319999999999999e-05 2024-09-12T22:32:29.132 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.132 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.132 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:29.132 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417347+0000", 2024-09-12T22:32:29.132 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.1140000000000003e-05 2024-09-12T22:32:29.132 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:29.133 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:29.133 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:29.133 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.133 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.133 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:29.133 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.400811+0000", 2024-09-12T22:32:29.133 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 51.675263465, 2024-09-12T22:32:29.133 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.017061263, 2024-09-12T22:32:29.133 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:29.133 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:29.133 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:29.133 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:29.133 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.134 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:29.134 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400811+0000", 2024-09-12T22:32:29.134 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:29.134 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.134 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.134 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:29.134 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400811+0000", 2024-09-12T22:32:29.134 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:29.134 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.134 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.134 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:29.134 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400812+0000", 2024-09-12T22:32:29.134 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.27e-07 2024-09-12T22:32:29.134 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.135 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.135 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:29.135 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400814+0000", 2024-09-12T22:32:29.135 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.553e-06 2024-09-12T22:32:29.135 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.135 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.135 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:29.135 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400819+0000", 2024-09-12T22:32:29.135 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.3569999999999997e-06 2024-09-12T22:32:29.135 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.135 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.135 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:29.135 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400824+0000", 2024-09-12T22:32:29.136 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.6820000000000002e-06 2024-09-12T22:32:29.136 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.136 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.136 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:29.136 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400871+0000", 2024-09-12T22:32:29.136 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.7311000000000002e-05 2024-09-12T22:32:29.136 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.136 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.136 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:32:29.136 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400875+0000", 2024-09-12T22:32:29.136 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.0960000000000001e-06 2024-09-12T22:32:29.136 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.136 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.137 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:29.137 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.412071+0000", 2024-09-12T22:32:29.137 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.011195999999999999 2024-09-12T22:32:29.137 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.137 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.137 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:29.137 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.412520+0000", 2024-09-12T22:32:29.137 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.000449522 2024-09-12T22:32:29.137 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.137 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.137 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:29.137 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.412655+0000", 2024-09-12T22:32:29.137 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00013487899999999999 2024-09-12T22:32:29.138 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.138 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.138 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op_commit", 2024-09-12T22:32:29.138 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417096+0000", 2024-09-12T22:32:29.138 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.004441113 2024-09-12T22:32:29.138 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.138 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.138 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:29.138 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417768+0000", 2024-09-12T22:32:29.138 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00067161100000000002 2024-09-12T22:32:29.138 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.138 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.138 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:29.138 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417834+0000", 2024-09-12T22:32:29.139 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.6058999999999999e-05 2024-09-12T22:32:29.139 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.139 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.139 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:29.139 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417873+0000", 2024-09-12T22:32:29.139 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.8753e-05 2024-09-12T22:32:29.139 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:29.139 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:29.139 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:29.139 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.139 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.139 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:29.139 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.400842+0000", 2024-09-12T22:32:29.139 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 51.675232758, 2024-09-12T22:32:29.140 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.022846262999999999, 2024-09-12T22:32:29.140 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:29.140 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:29.140 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:29.140 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:29.140 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.140 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:29.140 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400842+0000", 2024-09-12T22:32:29.140 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:29.140 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.140 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.140 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:29.140 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400842+0000", 2024-09-12T22:32:29.141 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:29.141 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.141 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.141 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:29.141 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400842+0000", 2024-09-12T22:32:29.141 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.9900000000000002e-07 2024-09-12T22:32:29.141 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.141 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.141 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:29.141 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400845+0000", 2024-09-12T22:32:29.141 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.8609999999999998e-06 2024-09-12T22:32:29.141 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.141 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.142 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:29.142 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400850+0000", 2024-09-12T22:32:29.142 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.634e-06 2024-09-12T22:32:29.142 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.142 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.142 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:29.142 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400855+0000", 2024-09-12T22:32:29.142 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.8339999999999998e-06 2024-09-12T22:32:29.142 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.142 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.142 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:29.142 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400886+0000", 2024-09-12T22:32:29.142 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.1393999999999998e-05 2024-09-12T22:32:29.142 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.143 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.143 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:32:29.143 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400888+0000", 2024-09-12T22:32:29.143 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.3470000000000001e-06 2024-09-12T22:32:29.143 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.143 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.143 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:29.143 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415640+0000", 2024-09-12T22:32:29.143 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.014751965000000001 2024-09-12T22:32:29.143 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.143 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.143 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:29.143 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415821+0000", 2024-09-12T22:32:29.144 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00018064399999999999 2024-09-12T22:32:29.144 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.144 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.144 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:29.144 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415949+0000", 2024-09-12T22:32:29.144 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00012816699999999999 2024-09-12T22:32:29.144 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.144 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.144 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op_commit", 2024-09-12T22:32:29.144 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.418337+0000", 2024-09-12T22:32:29.144 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0023878469999999998 2024-09-12T22:32:29.144 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.144 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.145 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:29.145 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.423588+0000", 2024-09-12T22:32:29.145 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0052509849999999997 2024-09-12T22:32:29.145 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.145 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.145 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:29.145 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.423650+0000", 2024-09-12T22:32:29.145 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.2026999999999994e-05 2024-09-12T22:32:29.145 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.145 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.145 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:29.145 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.423688+0000", 2024-09-12T22:32:29.145 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.8259000000000001e-05 2024-09-12T22:32:29.145 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:29.146 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:29.146 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:29.146 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.146 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.146 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:29.146 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.400862+0000", 2024-09-12T22:32:29.146 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 51.675212784000003, 2024-09-12T22:32:29.146 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.016404294, 2024-09-12T22:32:29.146 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:29.146 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:29.146 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "started", 2024-09-12T22:32:29.146 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:29.147 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.147 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:29.147 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400862+0000", 2024-09-12T22:32:29.147 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:29.147 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.147 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.147 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:29.147 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400862+0000", 2024-09-12T22:32:29.147 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:29.147 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.147 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.147 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:29.147 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400862+0000", 2024-09-12T22:32:29.147 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.8099999999999999e-07 2024-09-12T22:32:29.148 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.148 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.148 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:29.148 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400870+0000", 2024-09-12T22:32:29.148 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 8.1349999999999992e-06 2024-09-12T22:32:29.148 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.148 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.148 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:29.148 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400876+0000", 2024-09-12T22:32:29.148 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.2039999999999996e-06 2024-09-12T22:32:29.148 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.148 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.148 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:29.148 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400879+0000", 2024-09-12T22:32:29.149 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.529e-06 2024-09-12T22:32:29.149 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.149 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.149 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:29.149 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400912+0000", 2024-09-12T22:32:29.149 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.2653000000000001e-05 2024-09-12T22:32:29.149 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.149 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.149 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op must wait for map", 2024-09-12T22:32:29.149 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400915+0000", 2024-09-12T22:32:29.149 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.1099999999999999e-06 2024-09-12T22:32:29.149 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.149 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.149 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:29.150 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408727+0000", 2024-09-12T22:32:29.150 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0078123869999999996 2024-09-12T22:32:29.150 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.150 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.150 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:29.150 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408838+0000", 2024-09-12T22:32:29.150 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00011042700000000001 2024-09-12T22:32:29.150 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.150 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.150 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:29.150 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417266+0000", 2024-09-12T22:32:29.150 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0084285680000000009 2024-09-12T22:32:29.150 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:29.151 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:29.151 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:29.151 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.151 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.151 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:29.151 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.400889+0000", 2024-09-12T22:32:29.151 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 51.675185530999997, 2024-09-12T22:32:29.151 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.014929550999999999, 2024-09-12T22:32:29.151 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:29.151 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:29.151 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "started", 2024-09-12T22:32:29.151 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:29.151 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.152 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:29.152 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400889+0000", 2024-09-12T22:32:29.152 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:29.152 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.152 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.152 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:29.152 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400889+0000", 2024-09-12T22:32:29.152 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:29.152 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.152 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.152 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:29.152 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400890+0000", 2024-09-12T22:32:29.152 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.8699999999999995e-07 2024-09-12T22:32:29.153 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.153 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.153 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:29.153 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400893+0000", 2024-09-12T22:32:29.153 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.9569999999999998e-06 2024-09-12T22:32:29.153 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.153 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.153 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:29.153 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400899+0000", 2024-09-12T22:32:29.153 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.4189999999999999e-06 2024-09-12T22:32:29.153 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.153 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.153 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:29.153 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400905+0000", 2024-09-12T22:32:29.154 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.7880000000000003e-06 2024-09-12T22:32:29.154 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.154 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.154 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:29.154 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400943+0000", 2024-09-12T22:32:29.154 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.7852999999999998e-05 2024-09-12T22:32:29.154 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.154 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.154 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op must wait for map", 2024-09-12T22:32:29.154 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400945+0000", 2024-09-12T22:32:29.154 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.627e-06 2024-09-12T22:32:29.154 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.154 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.155 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:29.155 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408398+0000", 2024-09-12T22:32:29.155 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0074525879999999996 2024-09-12T22:32:29.155 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.155 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.155 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:29.155 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408581+0000", 2024-09-12T22:32:29.155 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00018321900000000001 2024-09-12T22:32:29.155 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.155 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.155 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:29.155 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415819+0000", 2024-09-12T22:32:29.155 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0072376130000000004 2024-09-12T22:32:29.156 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:29.156 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:29.156 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:29.156 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.156 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.156 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:25 3.7 e19/17 3:e0b41d06:::609.00000000:head v 19'2, mlcod=0'0)", 2024-09-12T22:32:29.156 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.402511+0000", 2024-09-12T22:32:29.156 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 51.673563387999998, 2024-09-12T22:32:29.156 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0089735260000000008, 2024-09-12T22:32:29.156 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:29.156 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:29.156 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:29.156 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:29.156 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.157 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:29.157 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.402511+0000", 2024-09-12T22:32:29.157 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:29.157 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.157 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.157 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:29.157 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.402511+0000", 2024-09-12T22:32:29.157 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:29.157 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.157 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.157 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:29.157 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.402512+0000", 2024-09-12T22:32:29.157 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 8.71e-07 2024-09-12T22:32:29.158 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.158 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.158 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:29.158 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.402520+0000", 2024-09-12T22:32:29.158 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 7.8529999999999992e-06 2024-09-12T22:32:29.158 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.158 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.158 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:29.158 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.402530+0000", 2024-09-12T22:32:29.158 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 9.859e-06 2024-09-12T22:32:29.158 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.158 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.158 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:29.159 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.402555+0000", 2024-09-12T22:32:29.159 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.4822000000000001e-05 2024-09-12T22:32:29.159 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.159 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.159 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:29.159 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.403173+0000", 2024-09-12T22:32:29.159 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00061813199999999997 2024-09-12T22:32:29.159 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.159 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.159 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:29.159 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.403195+0000", 2024-09-12T22:32:29.159 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.2286e-05 2024-09-12T22:32:29.159 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.159 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.160 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:29.160 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.411436+0000", 2024-09-12T22:32:29.160 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0082410539999999994 2024-09-12T22:32:29.160 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.160 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.160 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:29.160 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.411485+0000", 2024-09-12T22:32:29.160 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.8649000000000001e-05 2024-09-12T22:32:29.160 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:29.160 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:29.160 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:29.160 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.160 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.160 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:18 3.14 e19/17 3:2f55791f:::606.00000000:head v 19'1, mlcod=0'0)", 2024-09-12T22:32:29.161 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.406646+0000", 2024-09-12T22:32:29.161 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 51.669428236000002, 2024-09-12T22:32:29.161 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0082036980000000006, 2024-09-12T22:32:29.161 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:29.161 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:29.161 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:29.161 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:29.161 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.161 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:29.161 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406646+0000", 2024-09-12T22:32:29.161 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:29.161 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.161 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.161 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:29.162 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406646+0000", 2024-09-12T22:32:29.162 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:29.162 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.162 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.162 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:29.162 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406647+0000", 2024-09-12T22:32:29.162 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.4499999999999998e-07 2024-09-12T22:32:29.162 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.162 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.162 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:29.162 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406651+0000", 2024-09-12T22:32:29.162 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.0300000000000004e-06 2024-09-12T22:32:29.163 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.163 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.163 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:29.163 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406657+0000", 2024-09-12T22:32:29.163 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.1330000000000004e-06 2024-09-12T22:32:29.163 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.163 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.163 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:29.163 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406665+0000", 2024-09-12T22:32:29.163 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 8.3650000000000004e-06 2024-09-12T22:32:29.163 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.163 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.164 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:29.164 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406804+0000", 2024-09-12T22:32:29.164 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00013900699999999999 2024-09-12T22:32:29.164 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.164 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.164 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:29.164 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406833+0000", 2024-09-12T22:32:29.164 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.8243e-05 2024-09-12T22:32:29.164 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.164 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.165 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:29.165 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.414741+0000", 2024-09-12T22:32:29.165 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0079089620000000003 2024-09-12T22:32:29.165 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.165 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.165 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:29.165 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.414850+0000", 2024-09-12T22:32:29.165 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.000108713 2024-09-12T22:32:29.165 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:29.165 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:29.165 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:29.165 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.165 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.165 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:6 3.10 e19/17 3:0d82a743:::600.00000000:head v 19'1, mlcod=0'0)", 2024-09-12T22:32:29.166 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.406692+0000", 2024-09-12T22:32:29.166 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 51.669382468999999, 2024-09-12T22:32:29.166 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0093004430000000003, 2024-09-12T22:32:29.166 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:29.166 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:29.166 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:29.166 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:29.166 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.166 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:29.166 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406692+0000", 2024-09-12T22:32:29.166 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:29.166 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.166 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.167 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:29.167 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406692+0000", 2024-09-12T22:32:29.167 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:29.167 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.167 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.167 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:29.167 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406693+0000", 2024-09-12T22:32:29.167 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.6300000000000001e-07 2024-09-12T22:32:29.167 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.167 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.167 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:29.167 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406702+0000", 2024-09-12T22:32:29.168 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 9.5589999999999994e-06 2024-09-12T22:32:29.168 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.168 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.168 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:29.168 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406725+0000", 2024-09-12T22:32:29.168 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.2977999999999999e-05 2024-09-12T22:32:29.168 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.168 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.168 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:29.168 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406732+0000", 2024-09-12T22:32:29.168 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.8430000000000004e-06 2024-09-12T22:32:29.168 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.168 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.168 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:29.169 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406979+0000", 2024-09-12T22:32:29.169 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00024729199999999998 2024-09-12T22:32:29.169 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.169 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.169 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:29.169 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407000+0000", 2024-09-12T22:32:29.169 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.0573000000000001e-05 2024-09-12T22:32:29.169 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.169 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.169 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:29.169 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415928+0000", 2024-09-12T22:32:29.169 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0089286179999999993 2024-09-12T22:32:29.169 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.170 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.170 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:29.170 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415993+0000", 2024-09-12T22:32:29.170 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.4216999999999999e-05 2024-09-12T22:32:29.170 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:29.170 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:29.170 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:29.170 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.170 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.170 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:2 3.f e19/17 3:f1f69726:::400.00000000:head v 19'1, mlcod=0'0)", 2024-09-12T22:32:29.170 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.406942+0000", 2024-09-12T22:32:29.170 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 51.669132781999998, 2024-09-12T22:32:29.170 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0098433259999999995, 2024-09-12T22:32:29.170 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:29.171 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:29.171 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:29.171 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:29.171 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.171 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:29.171 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406942+0000", 2024-09-12T22:32:29.171 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:29.171 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.171 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.171 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:29.171 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406942+0000", 2024-09-12T22:32:29.171 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:29.171 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.172 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.172 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:29.172 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406943+0000", 2024-09-12T22:32:29.172 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.8800000000000002e-07 2024-09-12T22:32:29.172 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.172 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.172 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:29.172 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406949+0000", 2024-09-12T22:32:29.172 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.5869999999999998e-06 2024-09-12T22:32:29.172 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.172 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.172 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:29.172 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406960+0000", 2024-09-12T22:32:29.172 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.0873000000000001e-05 2024-09-12T22:32:29.173 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.173 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.173 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:29.173 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406970+0000", 2024-09-12T22:32:29.173 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 9.9119999999999993e-06 2024-09-12T22:32:29.173 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.173 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.173 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:29.173 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407535+0000", 2024-09-12T22:32:29.173 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00056508899999999996 2024-09-12T22:32:29.173 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.173 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.174 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:29.174 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407556+0000", 2024-09-12T22:32:29.174 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.1348999999999998e-05 2024-09-12T22:32:29.174 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.174 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.174 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:29.174 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416751+0000", 2024-09-12T22:32:29.174 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0091950109999999995 2024-09-12T22:32:29.174 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.174 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.174 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:29.174 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416785+0000", 2024-09-12T22:32:29.175 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.3917000000000001e-05 2024-09-12T22:32:29.175 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:29.175 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:29.175 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:29.175 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.175 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.175 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:19 3.14 e19/17 3:2f55791f:::606.00000000:head v 19'2, mlcod=0'0)", 2024-09-12T22:32:29.175 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.406983+0000", 2024-09-12T22:32:29.175 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 51.669091803000001, 2024-09-12T22:32:29.176 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0080362149999999993, 2024-09-12T22:32:29.176 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:29.176 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:29.176 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:29.176 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:29.176 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.176 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:29.176 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406983+0000", 2024-09-12T22:32:29.176 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:29.176 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.176 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.176 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:29.177 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406983+0000", 2024-09-12T22:32:29.177 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:29.177 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.177 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.177 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:29.177 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406983+0000", 2024-09-12T22:32:29.177 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.8200000000000001e-07 2024-09-12T22:32:29.177 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.177 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.177 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:29.177 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406999+0000", 2024-09-12T22:32:29.178 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.5747999999999999e-05 2024-09-12T22:32:29.178 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.178 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.178 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:29.178 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407006+0000", 2024-09-12T22:32:29.178 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 7.2609999999999996e-06 2024-09-12T22:32:29.178 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.178 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.178 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:29.178 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407035+0000", 2024-09-12T22:32:29.178 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.8214000000000001e-05 2024-09-12T22:32:29.178 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.179 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.179 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:29.179 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407092+0000", 2024-09-12T22:32:29.179 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.7027000000000001e-05 2024-09-12T22:32:29.179 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.179 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.179 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:29.179 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407126+0000", 2024-09-12T22:32:29.179 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.4082000000000003e-05 2024-09-12T22:32:29.179 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.179 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.179 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:29.180 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.414985+0000", 2024-09-12T22:32:29.180 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0078597319999999995 2024-09-12T22:32:29.180 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.180 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.180 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:29.180 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415019+0000", 2024-09-12T22:32:29.180 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.3769000000000001e-05 2024-09-12T22:32:29.180 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:29.180 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:29.180 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:29.180 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.180 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.181 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:7 3.10 e19/17 3:0d82a743:::600.00000000:head v 19'2, mlcod=0'0)", 2024-09-12T22:32:29.181 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.407048+0000", 2024-09-12T22:32:29.181 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 51.669026264999999, 2024-09-12T22:32:29.181 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.008979931, 2024-09-12T22:32:29.181 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:29.181 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:29.181 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:29.181 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:29.181 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.181 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:29.181 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407048+0000", 2024-09-12T22:32:29.181 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:29.182 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.182 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.182 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:29.182 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407048+0000", 2024-09-12T22:32:29.182 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:29.182 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.182 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.182 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:29.182 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407049+0000", 2024-09-12T22:32:29.182 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.9099999999999999e-07 2024-09-12T22:32:29.183 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.183 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.183 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:29.183 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407054+0000", 2024-09-12T22:32:29.183 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.1850000000000003e-06 2024-09-12T22:32:29.183 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.183 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.183 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:29.183 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407061+0000", 2024-09-12T22:32:29.183 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 7.0809999999999996e-06 2024-09-12T22:32:29.183 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.183 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.184 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:29.184 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407067+0000", 2024-09-12T22:32:29.184 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.9540000000000001e-06 2024-09-12T22:32:29.184 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.184 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.184 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:29.184 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407299+0000", 2024-09-12T22:32:29.184 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.000232122 2024-09-12T22:32:29.184 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.184 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.184 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:29.185 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407317+0000", 2024-09-12T22:32:29.185 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.7447000000000001e-05 2024-09-12T22:32:29.185 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.185 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.185 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:29.185 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415996+0000", 2024-09-12T22:32:29.185 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0086791799999999999 2024-09-12T22:32:29.185 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.185 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.185 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:29.185 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416028+0000", 2024-09-12T22:32:29.186 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.2570999999999997e-05 2024-09-12T22:32:29.186 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:29.186 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:29.186 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:29.186 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.186 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.186 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:8 3.10 e19/17 3:09401a81:::601.00000000:head v 19'3, mlcod=0'0)", 2024-09-12T22:32:29.186 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.407081+0000", 2024-09-12T22:32:29.186 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 51.668993575000002, 2024-09-12T22:32:29.186 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0089807270000000008, 2024-09-12T22:32:29.186 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:29.187 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:29.187 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:29.187 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:29.187 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.187 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:29.187 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407081+0000", 2024-09-12T22:32:29.187 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:29.187 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.187 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.187 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:29.187 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407081+0000", 2024-09-12T22:32:29.188 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:29.188 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.188 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.188 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:29.188 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407082+0000", 2024-09-12T22:32:29.188 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.7899999999999999e-07 2024-09-12T22:32:29.188 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.188 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.188 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:29.188 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407086+0000", 2024-09-12T22:32:29.189 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.7679999999999999e-06 2024-09-12T22:32:29.189 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.189 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.189 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:29.189 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407094+0000", 2024-09-12T22:32:29.189 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 8.1470000000000001e-06 2024-09-12T22:32:29.189 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.189 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.190 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:29.190 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407100+0000", 2024-09-12T22:32:29.190 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.4539999999999998e-06 2024-09-12T22:32:29.190 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.190 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.190 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:29.190 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407540+0000", 2024-09-12T22:32:29.190 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00043973699999999999 2024-09-12T22:32:29.190 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.190 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.190 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:29.191 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407553+0000", 2024-09-12T22:32:29.191 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.3368e-05 2024-09-12T22:32:29.191 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.191 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.191 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:29.191 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416032+0000", 2024-09-12T22:32:29.191 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0084793790000000004 2024-09-12T22:32:29.191 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.191 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.191 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:29.191 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416062+0000", 2024-09-12T22:32:29.191 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.9495000000000001e-05 2024-09-12T22:32:29.192 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:29.192 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:29.192 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:29.192 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.192 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.192 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:31 3.d e19/17 3:b50e409b:::mds_snaptable:head v 19'1, mlcod=0'0)", 2024-09-12T22:32:29.192 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.408508+0000", 2024-09-12T22:32:29.192 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 51.667567059, 2024-09-12T22:32:29.192 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0080056620000000002, 2024-09-12T22:32:29.192 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:29.192 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:29.192 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:29.192 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:29.193 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.193 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:29.193 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408508+0000", 2024-09-12T22:32:29.193 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:29.193 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.193 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.193 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:29.193 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408508+0000", 2024-09-12T22:32:29.193 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:29.193 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.193 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.193 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:29.193 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408508+0000", 2024-09-12T22:32:29.194 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.7e-07 2024-09-12T22:32:29.194 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.194 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.194 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:29.194 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408515+0000", 2024-09-12T22:32:29.194 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.4439999999999996e-06 2024-09-12T22:32:29.194 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.194 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.194 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:29.194 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408521+0000", 2024-09-12T22:32:29.194 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.2729999999999999e-06 2024-09-12T22:32:29.195 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.195 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.195 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:29.195 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408526+0000", 2024-09-12T22:32:29.195 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.3299999999999998e-06 2024-09-12T22:32:29.195 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.195 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.195 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:29.195 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.410190+0000", 2024-09-12T22:32:29.196 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.001663615 2024-09-12T22:32:29.196 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.196 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.196 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:29.196 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.410258+0000", 2024-09-12T22:32:29.196 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.8146999999999997e-05 2024-09-12T22:32:29.196 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.196 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.196 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:29.196 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416477+0000", 2024-09-12T22:32:29.196 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0062187329999999997 2024-09-12T22:32:29.196 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.196 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.196 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:29.197 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416513+0000", 2024-09-12T22:32:29.197 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.6650000000000003e-05 2024-09-12T22:32:29.197 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:29.197 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:29.197 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:29.197 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.197 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.197 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:9 3.10 e19/17 3:09401a81:::601.00000000:head v 19'4, mlcod=0'0)", 2024-09-12T22:32:29.197 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.408991+0000", 2024-09-12T22:32:29.197 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 51.667083308999999, 2024-09-12T22:32:29.197 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0080459209999999993, 2024-09-12T22:32:29.197 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:29.197 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:29.198 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:29.198 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:29.198 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.198 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:29.198 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408991+0000", 2024-09-12T22:32:29.198 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:29.198 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.198 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.198 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:29.198 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408991+0000", 2024-09-12T22:32:29.198 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:29.198 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.198 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.198 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:29.199 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408992+0000", 2024-09-12T22:32:29.199 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.1799999999999995e-07 2024-09-12T22:32:29.199 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.199 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.199 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:29.199 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409005+0000", 2024-09-12T22:32:29.199 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.261e-05 2024-09-12T22:32:29.199 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.199 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.199 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:29.199 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409015+0000", 2024-09-12T22:32:29.199 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.0001e-05 2024-09-12T22:32:29.199 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.200 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.200 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:29.200 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409023+0000", 2024-09-12T22:32:29.200 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 8.7569999999999993e-06 2024-09-12T22:32:29.200 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.200 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.200 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:29.200 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.411355+0000", 2024-09-12T22:32:29.200 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0023313520000000001 2024-09-12T22:32:29.200 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.200 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.200 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:29.200 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.411374+0000", 2024-09-12T22:32:29.201 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.8810000000000001e-05 2024-09-12T22:32:29.201 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.201 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.201 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:29.201 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416994+0000", 2024-09-12T22:32:29.201 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.005620524 2024-09-12T22:32:29.201 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.201 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.201 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:29.201 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417037+0000", 2024-09-12T22:32:29.201 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.3248999999999999e-05 2024-09-12T22:32:29.201 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:29.201 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:29.201 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:29.202 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.202 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.202 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:10 3.10 e19/17 3:0bd6d154:::602.00000000:head v 19'5, mlcod=0'0)", 2024-09-12T22:32:29.202 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.409038+0000", 2024-09-12T22:32:29.202 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 51.667036633999999, 2024-09-12T22:32:29.202 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0080541689999999999, 2024-09-12T22:32:29.202 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:29.202 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:29.202 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:29.202 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:29.202 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.202 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:29.202 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409038+0000", 2024-09-12T22:32:29.203 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:29.203 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.203 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.203 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:29.203 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409038+0000", 2024-09-12T22:32:29.203 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:29.203 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.203 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.204 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:29.204 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409038+0000", 2024-09-12T22:32:29.204 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.7899999999999999e-07 2024-09-12T22:32:29.204 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.204 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.204 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:29.205 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409043+0000", 2024-09-12T22:32:29.205 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.6589999999999998e-06 2024-09-12T22:32:29.205 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.205 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.205 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:29.205 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409050+0000", 2024-09-12T22:32:29.205 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 7.0829999999999998e-06 2024-09-12T22:32:29.205 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.205 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.205 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:29.205 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409058+0000", 2024-09-12T22:32:29.205 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 7.7309999999999993e-06 2024-09-12T22:32:29.205 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.205 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.206 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:29.206 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.411654+0000", 2024-09-12T22:32:29.206 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0025961650000000001 2024-09-12T22:32:29.206 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.206 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.206 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:29.206 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.411671+0000", 2024-09-12T22:32:29.206 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.7356000000000001e-05 2024-09-12T22:32:29.206 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.206 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.207 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:29.207 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417040+0000", 2024-09-12T22:32:29.207 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0053681889999999998 2024-09-12T22:32:29.207 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.207 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.207 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:29.207 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417092+0000", 2024-09-12T22:32:29.207 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.2607e-05 2024-09-12T22:32:29.207 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:29.207 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:29.207 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:29.207 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.207 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.208 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:11 3.10 e19/17 3:0bd6d154:::602.00000000:head v 19'6, mlcod=0'0)", 2024-09-12T22:32:29.208 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.409768+0000", 2024-09-12T22:32:29.208 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 51.666307193000002, 2024-09-12T22:32:29.208 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0074442759999999997, 2024-09-12T22:32:29.208 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:29.208 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:29.208 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:29.208 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:29.208 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.208 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:29.208 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409768+0000", 2024-09-12T22:32:29.208 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:29.208 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.208 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.209 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:29.209 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409768+0000", 2024-09-12T22:32:29.209 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:29.209 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.209 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.209 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:29.209 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409768+0000", 2024-09-12T22:32:29.209 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.37e-07 2024-09-12T22:32:29.209 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.209 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.209 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:29.209 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409775+0000", 2024-09-12T22:32:29.209 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.4670000000000001e-06 2024-09-12T22:32:29.210 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.210 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.210 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:29.210 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409793+0000", 2024-09-12T22:32:29.210 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.8162e-05 2024-09-12T22:32:29.210 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.210 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.210 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:29.210 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409954+0000", 2024-09-12T22:32:29.210 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00016072999999999999 2024-09-12T22:32:29.210 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.211 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.211 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:29.211 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.411943+0000", 2024-09-12T22:32:29.211 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0019897069999999998 2024-09-12T22:32:29.211 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.211 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.211 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:29.211 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.412069+0000", 2024-09-12T22:32:29.211 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00012546200000000001 2024-09-12T22:32:29.211 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.211 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.211 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:29.211 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417114+0000", 2024-09-12T22:32:29.211 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.005045023 2024-09-12T22:32:29.212 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:29.212 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:29.212 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:29.212 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417212+0000", 2024-09-12T22:32:29.212 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 9.8088e-05 2024-09-12T22:32:29.212 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:29.212 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:29.212 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:29.212 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:29.212 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:29.212 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-09-12T22:32:29.214 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:32:29.214 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:29.212+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:29.315 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:29.314+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:29.326 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-09-12T22:32:29.326 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-12T22:32:29.326 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-09-12T22:32:29.326 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-12T22:32:29.327 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:32:29.327 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:32:29.327 INFO:teuthology.orchestra.run.smithi148.stdout: "num_ops": 0 2024-09-12T22:32:29.327 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:32:29.330 INFO:teuthology.orchestra.run.smithi019.stderr:nodeep-scrub is unset 2024-09-12T22:32:29.334 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:32:29.417 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:32:29.416+0000 7fddec6a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30331) UID: 0 2024-09-12T22:32:29.483 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:32:29.483 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:32:29.483 INFO:teuthology.orchestra.run.smithi148.stdout: "complaint_time": 30, 2024-09-12T22:32:29.483 INFO:teuthology.orchestra.run.smithi148.stdout: "num_blocked_ops": 0 2024-09-12T22:32:29.483 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:32:29.491 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:32:29.517 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:32:29.516+0000 7fddec6a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30331) UID: 0 2024-09-12T22:32:29.596 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:32:29.597 INFO:teuthology.orchestra.run.smithi148.stdout: "size": 20, 2024-09-12T22:32:29.597 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 600, 2024-09-12T22:32:29.597 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [ 2024-09-12T22:32:29.597 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.597 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:29.597 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.400880+0000", 2024-09-12T22:32:29.597 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 52.193182211, 2024-09-12T22:32:29.597 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0095133660000000005, 2024-09-12T22:32:29.597 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:29.597 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:29.598 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:29.598 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:29.598 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.598 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:29.598 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400880+0000", 2024-09-12T22:32:29.598 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:29.598 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.598 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.598 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:29.598 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400880+0000", 2024-09-12T22:32:29.598 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:29.599 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.599 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.599 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:29.599 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400892+0000", 2024-09-12T22:32:29.599 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1941e-05 2024-09-12T22:32:29.599 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.599 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.599 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:29.599 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400900+0000", 2024-09-12T22:32:29.599 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0080000000000002e-06 2024-09-12T22:32:29.599 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.599 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.600 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:29.600 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400911+0000", 2024-09-12T22:32:29.600 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1452e-05 2024-09-12T22:32:29.601 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.601 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.601 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:29.601 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400922+0000", 2024-09-12T22:32:29.601 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0772e-05 2024-09-12T22:32:29.601 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.601 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.601 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:29.601 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401009+0000", 2024-09-12T22:32:29.602 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.7206000000000005e-05 2024-09-12T22:32:29.602 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.602 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.602 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:29.602 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401157+0000", 2024-09-12T22:32:29.602 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014831499999999999 2024-09-12T22:32:29.602 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.602 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.602 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:29.602 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401312+0000", 2024-09-12T22:32:29.602 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00015495600000000001 2024-09-12T22:32:29.602 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.603 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.603 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:29.603 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.403060+0000", 2024-09-12T22:32:29.603 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0017475220000000001 2024-09-12T22:32:29.603 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.603 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.603 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:29.603 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410300+0000", 2024-09-12T22:32:29.604 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0072403260000000001 2024-09-12T22:32:29.604 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.604 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.604 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:29.604 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410350+0000", 2024-09-12T22:32:29.604 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9814000000000001e-05 2024-09-12T22:32:29.604 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.604 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.604 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:29.604 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410393+0000", 2024-09-12T22:32:29.604 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3053999999999998e-05 2024-09-12T22:32:29.605 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:29.605 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:29.605 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:29.605 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.605 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.605 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:29.605 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.400952+0000", 2024-09-12T22:32:29.605 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 52.193110058999999, 2024-09-12T22:32:29.605 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0096045620000000005, 2024-09-12T22:32:29.605 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:29.605 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:29.605 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:29.605 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:29.606 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.606 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:29.606 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400952+0000", 2024-09-12T22:32:29.606 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:29.606 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.606 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.606 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:29.606 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400952+0000", 2024-09-12T22:32:29.606 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:29.606 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.606 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.606 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:29.606 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400953+0000", 2024-09-12T22:32:29.606 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.8000000000000005e-07 2024-09-12T22:32:29.607 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.607 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.607 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:29.607 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400957+0000", 2024-09-12T22:32:29.607 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.33e-06 2024-09-12T22:32:29.607 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.607 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.607 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:29.607 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400966+0000", 2024-09-12T22:32:29.607 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1989999999999995e-06 2024-09-12T22:32:29.607 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.607 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.608 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:29.608 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400973+0000", 2024-09-12T22:32:29.608 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2779999999999999e-06 2024-09-12T22:32:29.608 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.608 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.608 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:29.608 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401696+0000", 2024-09-12T22:32:29.608 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00072363500000000003 2024-09-12T22:32:29.608 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.608 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.608 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:29.608 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401788+0000", 2024-09-12T22:32:29.608 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1862999999999998e-05 2024-09-12T22:32:29.609 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.609 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.610 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:29.610 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401929+0000", 2024-09-12T22:32:29.610 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014096000000000001 2024-09-12T22:32:29.610 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.610 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.610 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:29.610 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.403542+0000", 2024-09-12T22:32:29.610 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001612963 2024-09-12T22:32:29.610 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.610 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.610 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:29.610 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410460+0000", 2024-09-12T22:32:29.611 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0069180500000000002 2024-09-12T22:32:29.611 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.611 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.611 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:29.612 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410515+0000", 2024-09-12T22:32:29.612 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5009000000000001e-05 2024-09-12T22:32:29.612 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.612 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.612 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:29.612 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410557+0000", 2024-09-12T22:32:29.612 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1495000000000002e-05 2024-09-12T22:32:29.612 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:29.612 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:29.612 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:29.612 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.612 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.612 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:29.613 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.400984+0000", 2024-09-12T22:32:29.613 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 52.193077563999999, 2024-09-12T22:32:29.613 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0073703950000000001, 2024-09-12T22:32:29.613 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:29.613 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:29.613 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:29.613 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:29.613 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.613 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:29.613 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400984+0000", 2024-09-12T22:32:29.613 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:29.613 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.614 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.614 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:29.614 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400984+0000", 2024-09-12T22:32:29.614 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:29.614 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.614 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.614 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:29.614 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400985+0000", 2024-09-12T22:32:29.614 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3200000000000005e-07 2024-09-12T22:32:29.614 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.614 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.614 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:29.614 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400998+0000", 2024-09-12T22:32:29.615 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2726e-05 2024-09-12T22:32:29.615 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.615 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.615 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:29.615 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401006+0000", 2024-09-12T22:32:29.615 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.3110000000000006e-06 2024-09-12T22:32:29.615 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.615 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.615 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:29.615 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401022+0000", 2024-09-12T22:32:29.615 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6249e-05 2024-09-12T22:32:29.615 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.615 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.616 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:29.616 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401700+0000", 2024-09-12T22:32:29.616 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00067811100000000001 2024-09-12T22:32:29.616 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.616 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.616 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:29.616 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401839+0000", 2024-09-12T22:32:29.616 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013865399999999999 2024-09-12T22:32:29.616 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.616 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.616 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:29.616 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401962+0000", 2024-09-12T22:32:29.616 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000123266 2024-09-12T22:32:29.617 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.617 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.617 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:29.617 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.403589+0000", 2024-09-12T22:32:29.617 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001626932 2024-09-12T22:32:29.617 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.617 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.617 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:29.617 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.408274+0000", 2024-09-12T22:32:29.617 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0046848100000000002 2024-09-12T22:32:29.617 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.617 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.617 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:29.617 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.408324+0000", 2024-09-12T22:32:29.618 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9784000000000003e-05 2024-09-12T22:32:29.618 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.618 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.618 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:29.618 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.408355+0000", 2024-09-12T22:32:29.618 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.1019999999999998e-05 2024-09-12T22:32:29.618 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:29.618 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:29.618 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:29.618 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.618 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.618 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:29.618 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401034+0000", 2024-09-12T22:32:29.619 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 52.193028124000001, 2024-09-12T22:32:29.619 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011063051000000001, 2024-09-12T22:32:29.619 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:29.619 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:29.619 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:29.619 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:29.619 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.619 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:29.619 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401034+0000", 2024-09-12T22:32:29.619 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:29.619 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.619 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.619 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:29.620 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401034+0000", 2024-09-12T22:32:29.620 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:29.620 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.620 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.620 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:29.620 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401034+0000", 2024-09-12T22:32:29.620 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8899999999999999e-07 2024-09-12T22:32:29.620 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.620 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.620 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:29.620 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401038+0000", 2024-09-12T22:32:29.620 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.523e-06 2024-09-12T22:32:29.621 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.621 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.621 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:29.621 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401046+0000", 2024-09-12T22:32:29.621 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0479999999999999e-06 2024-09-12T22:32:29.621 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.621 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.621 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:29.621 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401051+0000", 2024-09-12T22:32:29.621 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2619999999999998e-06 2024-09-12T22:32:29.622 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.622 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.622 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:29.622 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402270+0000", 2024-09-12T22:32:29.622 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012182429999999999 2024-09-12T22:32:29.622 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.622 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.622 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:29.622 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402325+0000", 2024-09-12T22:32:29.623 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5526999999999999e-05 2024-09-12T22:32:29.623 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.623 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.623 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:29.623 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402403+0000", 2024-09-12T22:32:29.623 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.7559999999999996e-05 2024-09-12T22:32:29.623 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.623 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.623 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:29.623 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.403655+0000", 2024-09-12T22:32:29.623 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012521489999999999 2024-09-12T22:32:29.623 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.624 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.624 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:29.624 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411979+0000", 2024-09-12T22:32:29.624 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0083240420000000002 2024-09-12T22:32:29.624 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.624 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.624 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:29.624 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.412036+0000", 2024-09-12T22:32:29.624 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7639000000000002e-05 2024-09-12T22:32:29.624 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.624 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.624 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:29.624 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.412097+0000", 2024-09-12T22:32:29.625 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0469e-05 2024-09-12T22:32:29.625 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:29.625 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:29.625 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:29.625 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.625 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.625 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:29.625 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401060+0000", 2024-09-12T22:32:29.625 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 52.193002372000002, 2024-09-12T22:32:29.625 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.010030172, 2024-09-12T22:32:29.625 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:29.625 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:29.625 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:29.626 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:29.626 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.626 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:29.626 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401060+0000", 2024-09-12T22:32:29.626 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:29.626 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.626 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.626 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:29.626 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401060+0000", 2024-09-12T22:32:29.626 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:29.626 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.626 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.627 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:29.627 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401060+0000", 2024-09-12T22:32:29.627 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2500000000000001e-07 2024-09-12T22:32:29.627 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.627 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.627 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:29.627 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401063+0000", 2024-09-12T22:32:29.627 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0910000000000001e-06 2024-09-12T22:32:29.627 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.627 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.627 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:29.627 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401070+0000", 2024-09-12T22:32:29.627 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1210000000000001e-06 2024-09-12T22:32:29.628 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.628 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.628 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:29.628 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401076+0000", 2024-09-12T22:32:29.628 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2830000000000001e-06 2024-09-12T22:32:29.628 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.628 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.628 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:29.628 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402288+0000", 2024-09-12T22:32:29.628 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012123699999999999 2024-09-12T22:32:29.628 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.628 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.628 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:29.629 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402359+0000", 2024-09-12T22:32:29.629 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.0988000000000005e-05 2024-09-12T22:32:29.629 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.629 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.629 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:29.629 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402457+0000", 2024-09-12T22:32:29.629 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.7857999999999997e-05 2024-09-12T22:32:29.629 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.629 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.629 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:29.629 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.404395+0000", 2024-09-12T22:32:29.629 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0019380160000000001 2024-09-12T22:32:29.630 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.630 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.630 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:29.630 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410603+0000", 2024-09-12T22:32:29.630 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.006208061 2024-09-12T22:32:29.630 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.630 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.630 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:29.630 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410687+0000", 2024-09-12T22:32:29.630 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.4623000000000006e-05 2024-09-12T22:32:29.630 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.630 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.630 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:29.631 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411090+0000", 2024-09-12T22:32:29.631 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00040233599999999999 2024-09-12T22:32:29.631 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:29.631 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:29.631 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:29.631 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.631 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.631 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:29.631 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401083+0000", 2024-09-12T22:32:29.631 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 52.192978955999997, 2024-09-12T22:32:29.631 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0097591850000000001, 2024-09-12T22:32:29.631 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:29.631 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:29.631 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:29.632 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:29.632 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.632 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:29.632 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401083+0000", 2024-09-12T22:32:29.632 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:29.632 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.632 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.632 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:29.632 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401083+0000", 2024-09-12T22:32:29.632 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:29.632 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.632 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.632 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:29.633 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401084+0000", 2024-09-12T22:32:29.633 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4799999999999999e-07 2024-09-12T22:32:29.633 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.633 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.633 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:29.633 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401088+0000", 2024-09-12T22:32:29.633 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6419999999999998e-06 2024-09-12T22:32:29.633 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.633 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.633 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:29.633 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401094+0000", 2024-09-12T22:32:29.633 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0090000000000004e-06 2024-09-12T22:32:29.633 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.634 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.634 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:29.634 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401108+0000", 2024-09-12T22:32:29.634 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3884e-05 2024-09-12T22:32:29.634 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.634 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.634 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:29.634 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401165+0000", 2024-09-12T22:32:29.634 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.6499000000000002e-05 2024-09-12T22:32:29.634 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.634 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.634 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:29.634 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401261+0000", 2024-09-12T22:32:29.635 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.6872000000000004e-05 2024-09-12T22:32:29.635 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.635 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.635 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:29.635 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401376+0000", 2024-09-12T22:32:29.635 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000114508 2024-09-12T22:32:29.635 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.635 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.635 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:29.635 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402666+0000", 2024-09-12T22:32:29.635 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012901659999999999 2024-09-12T22:32:29.635 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.635 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.635 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:29.636 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410572+0000", 2024-09-12T22:32:29.636 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0079055489999999996 2024-09-12T22:32:29.636 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.636 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.636 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:29.636 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410661+0000", 2024-09-12T22:32:29.636 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.9578000000000002e-05 2024-09-12T22:32:29.636 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.636 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.637 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:29.637 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410842+0000", 2024-09-12T22:32:29.637 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00018102999999999999 2024-09-12T22:32:29.637 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:29.637 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:29.637 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:29.637 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.637 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.637 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:29.637 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401122+0000", 2024-09-12T22:32:29.637 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 52.192939924000001, 2024-09-12T22:32:29.637 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0099122080000000005, 2024-09-12T22:32:29.637 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:29.638 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:29.638 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:32:29.638 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:29.638 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.638 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:29.638 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401122+0000", 2024-09-12T22:32:29.638 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:29.638 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.638 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.638 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:29.638 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401122+0000", 2024-09-12T22:32:29.638 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:29.638 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.638 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.639 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:29.639 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401123+0000", 2024-09-12T22:32:29.639 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2600000000000002e-07 2024-09-12T22:32:29.639 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.639 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.639 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:29.639 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401126+0000", 2024-09-12T22:32:29.639 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.6449999999999998e-06 2024-09-12T22:32:29.639 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.639 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.639 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:29.639 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401133+0000", 2024-09-12T22:32:29.639 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.9890000000000003e-06 2024-09-12T22:32:29.640 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.640 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.640 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:29.640 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401138+0000", 2024-09-12T22:32:29.640 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8060000000000002e-06 2024-09-12T22:32:29.640 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.640 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.640 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:29.640 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401703+0000", 2024-09-12T22:32:29.640 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00056509099999999999 2024-09-12T22:32:29.640 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.640 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.640 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:29.641 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401837+0000", 2024-09-12T22:32:29.641 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013338799999999999 2024-09-12T22:32:29.641 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.641 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.641 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:29.641 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411034+0000", 2024-09-12T22:32:29.641 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.009197663 2024-09-12T22:32:29.641 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:29.641 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:29.641 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:29.641 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.641 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.641 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:29.641 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401158+0000", 2024-09-12T22:32:29.642 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 52.192904145, 2024-09-12T22:32:29.642 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.010292437999999999, 2024-09-12T22:32:29.642 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:29.642 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:29.642 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:32:29.642 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:29.642 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.642 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:29.642 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401158+0000", 2024-09-12T22:32:29.642 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:29.642 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.642 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.642 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:29.643 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401158+0000", 2024-09-12T22:32:29.643 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:29.643 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.643 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.643 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:29.643 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401158+0000", 2024-09-12T22:32:29.643 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9699999999999996e-07 2024-09-12T22:32:29.643 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.643 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.643 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:29.643 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401161+0000", 2024-09-12T22:32:29.643 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.7410000000000001e-06 2024-09-12T22:32:29.643 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.643 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.644 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:29.644 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401168+0000", 2024-09-12T22:32:29.644 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.844e-06 2024-09-12T22:32:29.644 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.644 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.644 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:29.644 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401174+0000", 2024-09-12T22:32:29.644 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4700000000000001e-06 2024-09-12T22:32:29.644 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.645 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.645 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:29.645 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402799+0000", 2024-09-12T22:32:29.645 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0016256409999999999 2024-09-12T22:32:29.645 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.645 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.645 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:29.645 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402893+0000", 2024-09-12T22:32:29.645 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.3807999999999994e-05 2024-09-12T22:32:29.645 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.645 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.645 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:29.645 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411450+0000", 2024-09-12T22:32:29.646 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0085573369999999999 2024-09-12T22:32:29.646 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:29.646 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:29.646 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:29.646 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.646 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.646 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:29.646 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401183+0000", 2024-09-12T22:32:29.646 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 52.192879292999997, 2024-09-12T22:32:29.646 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0068597830000000004, 2024-09-12T22:32:29.646 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:29.646 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:29.646 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:32:29.647 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:29.647 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.647 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:29.647 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401183+0000", 2024-09-12T22:32:29.647 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:29.647 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.647 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.647 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:29.647 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401183+0000", 2024-09-12T22:32:29.647 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:29.647 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.647 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.647 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:29.647 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401183+0000", 2024-09-12T22:32:29.648 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.6700000000000003e-07 2024-09-12T22:32:29.648 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.648 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.648 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:29.648 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401186+0000", 2024-09-12T22:32:29.648 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4679999999999999e-06 2024-09-12T22:32:29.648 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.648 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.648 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:29.648 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401192+0000", 2024-09-12T22:32:29.648 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.1519999999999997e-06 2024-09-12T22:32:29.648 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.648 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.649 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:29.649 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401197+0000", 2024-09-12T22:32:29.649 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4669999999999998e-06 2024-09-12T22:32:29.649 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.649 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.649 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:29.649 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401253+0000", 2024-09-12T22:32:29.649 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.6211000000000001e-05 2024-09-12T22:32:29.649 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.649 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.649 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:29.649 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401413+0000", 2024-09-12T22:32:29.649 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00016021399999999999 2024-09-12T22:32:29.649 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.650 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.650 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:29.650 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.408043+0000", 2024-09-12T22:32:29.650 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0066295039999999996 2024-09-12T22:32:29.650 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:29.650 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:29.650 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:29.650 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.650 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.650 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:20 3.1c e19/17 3:3ed09add:::607.00000000:head v 19'1, mlcod=0'0)", 2024-09-12T22:32:29.650 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.409642+0000", 2024-09-12T22:32:29.650 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 52.184419834000003, 2024-09-12T22:32:29.650 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0038816269999999999, 2024-09-12T22:32:29.651 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:29.651 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:29.651 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:29.651 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:29.651 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.651 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:29.651 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409642+0000", 2024-09-12T22:32:29.651 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:29.651 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.651 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.651 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:29.651 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409642+0000", 2024-09-12T22:32:29.651 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:29.652 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.652 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.652 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:29.652 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409642+0000", 2024-09-12T22:32:29.652 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.6899999999999999e-07 2024-09-12T22:32:29.652 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.652 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.652 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:29.652 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409648+0000", 2024-09-12T22:32:29.652 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.49e-06 2024-09-12T22:32:29.652 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.652 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.652 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:29.653 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409656+0000", 2024-09-12T22:32:29.653 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.2949999999999994e-06 2024-09-12T22:32:29.653 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.653 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.653 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:29.653 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409664+0000", 2024-09-12T22:32:29.653 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.1219999999999995e-06 2024-09-12T22:32:29.653 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.653 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.653 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:29.653 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409707+0000", 2024-09-12T22:32:29.653 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2222000000000003e-05 2024-09-12T22:32:29.653 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.654 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.654 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:29.654 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409724+0000", 2024-09-12T22:32:29.654 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7496999999999999e-05 2024-09-12T22:32:29.654 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.654 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.654 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:29.654 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413439+0000", 2024-09-12T22:32:29.654 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00371448 2024-09-12T22:32:29.654 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.654 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.654 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:29.654 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413524+0000", 2024-09-12T22:32:29.655 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.5252000000000003e-05 2024-09-12T22:32:29.655 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:29.655 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:29.655 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:29.655 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.655 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.655 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:28 3.13 e19/17 3:cd5a64a3:::100.00000000:head v 19'1, mlcod=0'0)", 2024-09-12T22:32:29.655 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.409681+0000", 2024-09-12T22:32:29.655 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 52.184381350999999, 2024-09-12T22:32:29.655 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0038708710000000001, 2024-09-12T22:32:29.655 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:29.655 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:29.655 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:29.655 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:29.656 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.656 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:29.656 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409681+0000", 2024-09-12T22:32:29.656 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:29.656 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.656 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.656 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:29.656 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409681+0000", 2024-09-12T22:32:29.656 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:29.656 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.656 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.656 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:29.656 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409681+0000", 2024-09-12T22:32:29.657 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3000000000000002e-07 2024-09-12T22:32:29.657 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.657 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.657 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:29.657 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409695+0000", 2024-09-12T22:32:29.657 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4313e-05 2024-09-12T22:32:29.657 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.657 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.657 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:29.657 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409703+0000", 2024-09-12T22:32:29.657 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4000000000000003e-06 2024-09-12T22:32:29.657 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.657 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.658 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:29.658 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409708+0000", 2024-09-12T22:32:29.658 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3190000000000002e-06 2024-09-12T22:32:29.658 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.658 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.658 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:29.658 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409875+0000", 2024-09-12T22:32:29.658 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000167329 2024-09-12T22:32:29.658 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.658 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.658 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:29.658 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409892+0000", 2024-09-12T22:32:29.658 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6957999999999999e-05 2024-09-12T22:32:29.658 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.659 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.659 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:29.659 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413457+0000", 2024-09-12T22:32:29.659 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0035651279999999999 2024-09-12T22:32:29.659 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.659 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.659 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:29.659 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413552+0000", 2024-09-12T22:32:29.659 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.4093999999999997e-05 2024-09-12T22:32:29.659 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:29.659 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:29.659 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:29.659 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.659 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.660 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:21 3.1c e19/17 3:3ed09add:::607.00000000:head v 19'2, mlcod=0'0)", 2024-09-12T22:32:29.660 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.409718+0000", 2024-09-12T22:32:29.660 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 52.184343685999998, 2024-09-12T22:32:29.660 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003851883, 2024-09-12T22:32:29.660 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:29.660 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:29.660 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:29.660 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:29.660 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.660 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:29.660 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409718+0000", 2024-09-12T22:32:29.660 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:29.661 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.661 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.661 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:29.661 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409718+0000", 2024-09-12T22:32:29.661 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:29.661 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.661 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.661 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:29.661 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409719+0000", 2024-09-12T22:32:29.661 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.16e-07 2024-09-12T22:32:29.661 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.661 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.661 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:29.661 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409722+0000", 2024-09-12T22:32:29.662 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.692e-06 2024-09-12T22:32:29.662 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.662 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.662 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:29.662 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409729+0000", 2024-09-12T22:32:29.662 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.516e-06 2024-09-12T22:32:29.662 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.662 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.662 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:29.662 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409750+0000", 2024-09-12T22:32:29.662 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1151000000000001e-05 2024-09-12T22:32:29.662 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.662 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.663 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:29.663 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410015+0000", 2024-09-12T22:32:29.663 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00026477599999999999 2024-09-12T22:32:29.663 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.663 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.663 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:29.663 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410104+0000", 2024-09-12T22:32:29.663 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.9586000000000006e-05 2024-09-12T22:32:29.663 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.663 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.663 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:29.663 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413528+0000", 2024-09-12T22:32:29.663 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0034237880000000001 2024-09-12T22:32:29.663 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.664 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.664 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:29.664 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413570+0000", 2024-09-12T22:32:29.664 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2157999999999999e-05 2024-09-12T22:32:29.664 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:29.664 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:29.664 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:29.664 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.664 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.664 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:27 3.13 e19/17 3:c91d4a1d:::mds0_inotable:head v 19'2, mlcod=0'0)", 2024-09-12T22:32:29.664 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.409760+0000", 2024-09-12T22:32:29.664 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 52.184302170000002, 2024-09-12T22:32:29.664 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0039301910000000004, 2024-09-12T22:32:29.665 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:29.665 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:29.665 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:29.665 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:29.665 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.665 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:29.665 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409760+0000", 2024-09-12T22:32:29.665 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:29.665 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.665 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.665 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:29.665 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409760+0000", 2024-09-12T22:32:29.665 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:29.666 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.666 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.666 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:29.666 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409760+0000", 2024-09-12T22:32:29.666 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.39e-07 2024-09-12T22:32:29.666 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.666 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.666 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:29.666 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409765+0000", 2024-09-12T22:32:29.666 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4449999999999998e-06 2024-09-12T22:32:29.666 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.666 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.666 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:29.666 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409771+0000", 2024-09-12T22:32:29.667 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7159999999999997e-06 2024-09-12T22:32:29.667 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.667 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.667 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:29.667 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409778+0000", 2024-09-12T22:32:29.667 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.331e-06 2024-09-12T22:32:29.667 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.667 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.667 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:29.668 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410191+0000", 2024-09-12T22:32:29.668 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00041348300000000003 2024-09-12T22:32:29.668 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.668 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.668 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:29.668 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410211+0000", 2024-09-12T22:32:29.668 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9933999999999999e-05 2024-09-12T22:32:29.668 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.668 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.668 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:29.668 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413638+0000", 2024-09-12T22:32:29.669 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003426854 2024-09-12T22:32:29.669 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.669 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.669 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:29.669 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413690+0000", 2024-09-12T22:32:29.669 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2089000000000002e-05 2024-09-12T22:32:29.669 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:29.669 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:29.669 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:29.669 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.669 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.669 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "pg_update_log_missing_reply(3.b epoch 19/17 rep_tid 4 lcod 19'2)", 2024-09-12T22:32:29.670 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.410060+0000", 2024-09-12T22:32:29.670 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 52.184002505000002, 2024-09-12T22:32:29.670 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00098016500000000007, 2024-09-12T22:32:29.670 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:29.670 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:29.670 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "reached pg", 2024-09-12T22:32:29.670 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:29.670 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.670 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:29.670 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410060+0000", 2024-09-12T22:32:29.670 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:29.670 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.670 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.671 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:29.671 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410060+0000", 2024-09-12T22:32:29.671 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:29.671 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.671 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.671 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:29.671 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410060+0000", 2024-09-12T22:32:29.671 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.8299999999999998e-07 2024-09-12T22:32:29.671 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.671 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.671 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:29.671 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410062+0000", 2024-09-12T22:32:29.671 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5749999999999999e-06 2024-09-12T22:32:29.672 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.672 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.672 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:29.672 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410070+0000", 2024-09-12T22:32:29.672 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.909e-06 2024-09-12T22:32:29.672 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.672 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.672 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:29.672 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410076+0000", 2024-09-12T22:32:29.672 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7049999999999996e-06 2024-09-12T22:32:29.672 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.672 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.672 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:29.672 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410943+0000", 2024-09-12T22:32:29.673 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00086681900000000001 2024-09-12T22:32:29.673 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.673 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.673 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:29.673 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411040+0000", 2024-09-12T22:32:29.673 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.6774000000000006e-05 2024-09-12T22:32:29.673 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:29.673 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:29.673 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:29.673 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.673 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.673 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e19/17 ondisk, result = 0)", 2024-09-12T22:32:29.673 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.410113+0000", 2024-09-12T22:32:29.674 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 52.183949237999997, 2024-09-12T22:32:29.674 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00098911599999999995, 2024-09-12T22:32:29.674 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:29.674 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:29.674 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:32:29.674 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:29.674 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.674 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:29.674 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410113+0000", 2024-09-12T22:32:29.674 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:29.674 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.674 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.674 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:29.674 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410113+0000", 2024-09-12T22:32:29.675 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:29.675 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.675 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.675 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:29.675 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410113+0000", 2024-09-12T22:32:29.675 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.99e-07 2024-09-12T22:32:29.675 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.675 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.675 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:29.675 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410115+0000", 2024-09-12T22:32:29.675 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.046e-06 2024-09-12T22:32:29.675 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.675 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.675 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:29.676 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410121+0000", 2024-09-12T22:32:29.676 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0050000000000001e-06 2024-09-12T22:32:29.676 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.676 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.676 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:29.676 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410126+0000", 2024-09-12T22:32:29.676 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8339999999999998e-06 2024-09-12T22:32:29.676 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.676 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.676 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:29.677 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410587+0000", 2024-09-12T22:32:29.677 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00046095499999999998 2024-09-12T22:32:29.677 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.677 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.677 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:29.677 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410595+0000", 2024-09-12T22:32:29.677 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.9419999999999995e-06 2024-09-12T22:32:29.677 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.677 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.677 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:29.677 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411102+0000", 2024-09-12T22:32:29.678 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00050713500000000003 2024-09-12T22:32:29.678 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:29.678 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:29.678 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:29.678 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.678 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.678 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 19/17 rep_tid 8 lcod 19'4)", 2024-09-12T22:32:29.678 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.410133+0000", 2024-09-12T22:32:29.678 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 52.183929310000003, 2024-09-12T22:32:29.678 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0013504000000000001, 2024-09-12T22:32:29.678 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:29.678 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:29.678 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "reached pg", 2024-09-12T22:32:29.679 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:29.679 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.679 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:29.679 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410133+0000", 2024-09-12T22:32:29.679 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:29.679 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.679 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.679 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:29.679 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410133+0000", 2024-09-12T22:32:29.679 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:29.679 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.679 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.679 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:29.680 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410133+0000", 2024-09-12T22:32:29.680 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.0599999999999999e-07 2024-09-12T22:32:29.680 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.680 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.680 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:29.680 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410135+0000", 2024-09-12T22:32:29.680 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7770000000000001e-06 2024-09-12T22:32:29.680 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.680 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.680 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:29.680 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410140+0000", 2024-09-12T22:32:29.680 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9960000000000001e-06 2024-09-12T22:32:29.680 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.681 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.681 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:29.681 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410144+0000", 2024-09-12T22:32:29.681 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9500000000000003e-06 2024-09-12T22:32:29.681 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.681 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.681 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:29.681 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411310+0000", 2024-09-12T22:32:29.681 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001166311 2024-09-12T22:32:29.681 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.681 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.682 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:29.682 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411483+0000", 2024-09-12T22:32:29.682 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00017316 2024-09-12T22:32:29.682 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:29.682 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:29.682 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:29.683 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.683 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.683 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "pg_update_log_missing(3.1a epoch 19/17 rep_tid 0 entries 19'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T22:32:29.683 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.410617+0000", 2024-09-12T22:32:29.683 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 52.183444915000003, 2024-09-12T22:32:29.683 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0030439709999999999, 2024-09-12T22:32:29.683 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:29.683 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:29.683 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "reached pg", 2024-09-12T22:32:29.683 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:29.683 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.683 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:29.684 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410617+0000", 2024-09-12T22:32:29.684 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:29.684 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.684 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.684 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:29.684 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410617+0000", 2024-09-12T22:32:29.684 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:29.684 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.684 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.684 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:29.684 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410617+0000", 2024-09-12T22:32:29.684 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3599999999999999e-07 2024-09-12T22:32:29.684 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.685 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.685 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:29.685 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410625+0000", 2024-09-12T22:32:29.685 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5410000000000003e-06 2024-09-12T22:32:29.685 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.685 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.685 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:29.685 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410638+0000", 2024-09-12T22:32:29.685 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3261999999999999e-05 2024-09-12T22:32:29.685 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.685 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.685 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:29.685 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410653+0000", 2024-09-12T22:32:29.685 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4844000000000001e-05 2024-09-12T22:32:29.686 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.686 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.686 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:29.686 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410814+0000", 2024-09-12T22:32:29.686 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00016119999999999999 2024-09-12T22:32:29.686 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.686 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.686 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:29.686 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413661+0000", 2024-09-12T22:32:29.686 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0028467879999999998 2024-09-12T22:32:29.686 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:29.686 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:29.687 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:29.687 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.687 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.687 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-09-12T22:32:29.687 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:39.398875+0000", 2024-09-12T22:32:29.687 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 50.195186634999999, 2024-09-12T22:32:29.687 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0015679069999999999, 2024-09-12T22:32:29.687 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:29.687 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:29.687 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:29.687 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:29.688 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.688 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:29.688 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398875+0000", 2024-09-12T22:32:29.688 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:29.688 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.688 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.688 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:29.688 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398875+0000", 2024-09-12T22:32:29.688 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:29.688 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.688 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.688 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:29.688 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398878+0000", 2024-09-12T22:32:29.688 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1679999999999998e-06 2024-09-12T22:32:29.689 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.689 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.689 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:29.689 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398888+0000", 2024-09-12T22:32:29.689 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.084e-05 2024-09-12T22:32:29.689 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.689 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.689 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:29.689 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398906+0000", 2024-09-12T22:32:29.689 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7518000000000001e-05 2024-09-12T22:32:29.689 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.689 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.689 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:29.690 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398914+0000", 2024-09-12T22:32:29.690 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5989999999999996e-06 2024-09-12T22:32:29.690 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.690 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.690 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:29.690 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398974+0000", 2024-09-12T22:32:29.690 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0988e-05 2024-09-12T22:32:29.691 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.691 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.691 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:29.691 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.399078+0000", 2024-09-12T22:32:29.691 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000103133 2024-09-12T22:32:29.691 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.691 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.692 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:29.692 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.399166+0000", 2024-09-12T22:32:29.692 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.8183999999999995e-05 2024-09-12T22:32:29.692 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.692 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.692 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:29.692 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.399747+0000", 2024-09-12T22:32:29.692 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00058110599999999996 2024-09-12T22:32:29.692 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.692 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.692 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:29.693 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.400377+0000", 2024-09-12T22:32:29.693 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000630157 2024-09-12T22:32:29.693 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.693 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.693 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:29.693 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.400415+0000", 2024-09-12T22:32:29.693 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7814000000000001e-05 2024-09-12T22:32:29.693 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.693 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.693 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:29.693 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.400443+0000", 2024-09-12T22:32:29.693 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8399999999999999e-05 2024-09-12T22:32:29.694 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:29.694 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:29.694 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:29.694 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.694 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.694 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e23)", 2024-09-12T22:32:29.694 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:58.400966+0000", 2024-09-12T22:32:29.694 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 31.193095726999999, 2024-09-12T22:32:29.694 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001468876, 2024-09-12T22:32:29.694 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:29.694 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:29.694 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:29.694 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:29.694 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.695 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:29.695 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400966+0000", 2024-09-12T22:32:29.695 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:29.695 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.695 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.695 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:29.695 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400966+0000", 2024-09-12T22:32:29.695 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:29.695 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.695 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.695 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:29.695 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400967+0000", 2024-09-12T22:32:29.695 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.046e-06 2024-09-12T22:32:29.695 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.696 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.696 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:29.696 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400974+0000", 2024-09-12T22:32:29.696 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2310000000000001e-06 2024-09-12T22:32:29.696 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.696 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.696 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:29.696 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400988+0000", 2024-09-12T22:32:29.696 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4482e-05 2024-09-12T22:32:29.696 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.696 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.696 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:29.696 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400997+0000", 2024-09-12T22:32:29.697 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.0189999999999995e-06 2024-09-12T22:32:29.697 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.697 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.697 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:29.697 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.401068+0000", 2024-09-12T22:32:29.697 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1426000000000004e-05 2024-09-12T22:32:29.697 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.697 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.697 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:29.697 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.401174+0000", 2024-09-12T22:32:29.698 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000105769 2024-09-12T22:32:29.698 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.698 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.698 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:29.698 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.401335+0000", 2024-09-12T22:32:29.698 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000161225 2024-09-12T22:32:29.698 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.698 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.698 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:29.698 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.402110+0000", 2024-09-12T22:32:29.698 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00077428800000000004 2024-09-12T22:32:29.698 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.698 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.699 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:29.699 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.402333+0000", 2024-09-12T22:32:29.699 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000223723 2024-09-12T22:32:29.699 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.699 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.699 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:29.699 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.402388+0000", 2024-09-12T22:32:29.699 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4700999999999997e-05 2024-09-12T22:32:29.699 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.699 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.699 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:29.699 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.402435+0000", 2024-09-12T22:32:29.699 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6965999999999997e-05 2024-09-12T22:32:29.699 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:29.700 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:29.700 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:29.700 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.700 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.700 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:45 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e27)", 2024-09-12T22:32:29.700 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:32:04.401614+0000", 2024-09-12T22:32:29.700 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 25.192448297999999, 2024-09-12T22:32:29.700 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0014279749999999999, 2024-09-12T22:32:29.700 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:29.700 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:29.700 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:29.700 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:29.700 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.701 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:29.701 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401614+0000", 2024-09-12T22:32:29.701 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:29.701 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.701 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.701 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:29.701 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401614+0000", 2024-09-12T22:32:29.701 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:29.701 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.701 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.701 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:29.701 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401615+0000", 2024-09-12T22:32:29.701 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.161e-06 2024-09-12T22:32:29.701 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.702 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.702 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:29.702 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401621+0000", 2024-09-12T22:32:29.702 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8730000000000004e-06 2024-09-12T22:32:29.702 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.702 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.702 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:29.702 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401633+0000", 2024-09-12T22:32:29.702 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1800000000000001e-05 2024-09-12T22:32:29.702 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.702 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.702 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:29.702 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401656+0000", 2024-09-12T22:32:29.703 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.3521999999999999e-05 2024-09-12T22:32:29.703 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.703 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.703 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:29.703 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401713+0000", 2024-09-12T22:32:29.703 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7259000000000002e-05 2024-09-12T22:32:29.703 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.703 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.703 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:29.703 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401849+0000", 2024-09-12T22:32:29.703 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013613500000000001 2024-09-12T22:32:29.703 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.703 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.703 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:29.704 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.402009+0000", 2024-09-12T22:32:29.704 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00015947199999999999 2024-09-12T22:32:29.704 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.704 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.704 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:29.704 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.402629+0000", 2024-09-12T22:32:29.704 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00061962200000000001 2024-09-12T22:32:29.704 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.704 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.704 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:29.705 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.402983+0000", 2024-09-12T22:32:29.705 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00035447499999999998 2024-09-12T22:32:29.705 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.705 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.705 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:29.705 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.403016+0000", 2024-09-12T22:32:29.705 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3108999999999998e-05 2024-09-12T22:32:29.705 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:29.705 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:29.705 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:29.705 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.403042+0000", 2024-09-12T22:32:29.705 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5547000000000001e-05 2024-09-12T22:32:29.705 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:29.705 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:29.706 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:29.706 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:29.706 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:29.706 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:32:29.707 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:32:29.708 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:29.706+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:29.739 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:32:29.740 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T22:32:29.740 INFO:teuthology.orchestra.run.smithi019.stdout: "epoch": 38, 2024-09-12T22:32:29.740 INFO:teuthology.orchestra.run.smithi019.stdout: "fsid": "957ce235-19cb-4350-8fee-febd6e3f2199", 2024-09-12T22:32:29.740 INFO:teuthology.orchestra.run.smithi019.stdout: "created": "2024-09-12T22:31:15.903133+0000", 2024-09-12T22:32:29.740 INFO:teuthology.orchestra.run.smithi019.stdout: "modified": "2024-09-12T22:32:29.321182+0000", 2024-09-12T22:32:29.740 INFO:teuthology.orchestra.run.smithi019.stdout: "last_up_change": "2024-09-12T22:31:25.209056+0000", 2024-09-12T22:32:29.740 INFO:teuthology.orchestra.run.smithi019.stdout: "last_in_change": "2024-09-12T22:31:16.757598+0000", 2024-09-12T22:32:29.740 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-12T22:32:29.740 INFO:teuthology.orchestra.run.smithi019.stdout: "flags_num": 5799936, 2024-09-12T22:32:29.741 INFO:teuthology.orchestra.run.smithi019.stdout: "flags_set": [ 2024-09-12T22:32:29.741 INFO:teuthology.orchestra.run.smithi019.stdout: "pglog_hardlimit", 2024-09-12T22:32:29.741 INFO:teuthology.orchestra.run.smithi019.stdout: "purged_snapdirs", 2024-09-12T22:32:29.741 INFO:teuthology.orchestra.run.smithi019.stdout: "recovery_deletes", 2024-09-12T22:32:29.741 INFO:teuthology.orchestra.run.smithi019.stdout: "sortbitwise" 2024-09-12T22:32:29.741 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-12T22:32:29.741 INFO:teuthology.orchestra.run.smithi019.stdout: "crush_version": 5, 2024-09-12T22:32:29.741 INFO:teuthology.orchestra.run.smithi019.stdout: "full_ratio": 0.94999998807907104, 2024-09-12T22:32:29.742 INFO:teuthology.orchestra.run.smithi019.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-12T22:32:29.742 INFO:teuthology.orchestra.run.smithi019.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-12T22:32:29.742 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster_snapshot": "", 2024-09-12T22:32:29.742 INFO:teuthology.orchestra.run.smithi019.stdout: "pool_max": 4, 2024-09-12T22:32:29.742 INFO:teuthology.orchestra.run.smithi019.stdout: "max_osd": 3, 2024-09-12T22:32:29.742 INFO:teuthology.orchestra.run.smithi019.stdout: "require_min_compat_client": "luminous", 2024-09-12T22:32:29.742 INFO:teuthology.orchestra.run.smithi019.stdout: "min_compat_client": "luminous", 2024-09-12T22:32:29.742 INFO:teuthology.orchestra.run.smithi019.stdout: "require_osd_release": "squid", 2024-09-12T22:32:29.742 INFO:teuthology.orchestra.run.smithi019.stdout: "allow_crimson": false, 2024-09-12T22:32:29.742 INFO:teuthology.orchestra.run.smithi019.stdout: "pools": [ 2024-09-12T22:32:29.743 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:32:29.743 INFO:teuthology.orchestra.run.smithi019.stdout: "pool": 1, 2024-09-12T22:32:29.743 INFO:teuthology.orchestra.run.smithi019.stdout: "pool_name": ".mgr", 2024-09-12T22:32:29.743 INFO:teuthology.orchestra.run.smithi019.stdout: "create_time": "2024-09-12T22:31:26.228956+0000", 2024-09-12T22:32:29.743 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-12T22:32:29.743 INFO:teuthology.orchestra.run.smithi019.stdout: "flags_names": "hashpspool", 2024-09-12T22:32:29.743 INFO:teuthology.orchestra.run.smithi019.stdout: "type": 1, 2024-09-12T22:32:29.743 INFO:teuthology.orchestra.run.smithi019.stdout: "size": 2, 2024-09-12T22:32:29.743 INFO:teuthology.orchestra.run.smithi019.stdout: "min_size": 1, 2024-09-12T22:32:29.743 INFO:teuthology.orchestra.run.smithi019.stdout: "crush_rule": 0, 2024-09-12T22:32:29.743 INFO:teuthology.orchestra.run.smithi019.stdout: "peering_crush_bucket_count": 0, 2024-09-12T22:32:29.744 INFO:teuthology.orchestra.run.smithi019.stdout: "peering_crush_bucket_target": 0, 2024-09-12T22:32:29.744 INFO:teuthology.orchestra.run.smithi019.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T22:32:29.744 INFO:teuthology.orchestra.run.smithi019.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T22:32:29.744 INFO:teuthology.orchestra.run.smithi019.stdout: "is_stretch_pool": false, 2024-09-12T22:32:29.744 INFO:teuthology.orchestra.run.smithi019.stdout: "object_hash": 2, 2024-09-12T22:32:29.744 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_autoscale_mode": "off", 2024-09-12T22:32:29.744 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_num": 1, 2024-09-12T22:32:29.744 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_placement_num": 1, 2024-09-12T22:32:29.744 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_placement_num_target": 1, 2024-09-12T22:32:29.745 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_num_target": 1, 2024-09-12T22:32:29.745 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_num_pending": 1, 2024-09-12T22:32:29.745 INFO:teuthology.orchestra.run.smithi019.stdout: "last_pg_merge_meta": { 2024-09-12T22:32:29.745 INFO:teuthology.orchestra.run.smithi019.stdout: "source_pgid": "0.0", 2024-09-12T22:32:29.745 INFO:teuthology.orchestra.run.smithi019.stdout: "ready_epoch": 0, 2024-09-12T22:32:29.745 INFO:teuthology.orchestra.run.smithi019.stdout: "last_epoch_started": 0, 2024-09-12T22:32:29.745 INFO:teuthology.orchestra.run.smithi019.stdout: "last_epoch_clean": 0, 2024-09-12T22:32:29.745 INFO:teuthology.orchestra.run.smithi019.stdout: "source_version": "0'0", 2024-09-12T22:32:29.745 INFO:teuthology.orchestra.run.smithi019.stdout: "target_version": "0'0" 2024-09-12T22:32:29.746 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:32:29.746 INFO:teuthology.orchestra.run.smithi019.stdout: "last_change": "12", 2024-09-12T22:32:29.746 INFO:teuthology.orchestra.run.smithi019.stdout: "last_force_op_resend": "0", 2024-09-12T22:32:29.746 INFO:teuthology.orchestra.run.smithi019.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T22:32:29.746 INFO:teuthology.orchestra.run.smithi019.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T22:32:29.746 INFO:teuthology.orchestra.run.smithi019.stdout: "auid": 0, 2024-09-12T22:32:29.746 INFO:teuthology.orchestra.run.smithi019.stdout: "snap_mode": "selfmanaged", 2024-09-12T22:32:29.746 INFO:teuthology.orchestra.run.smithi019.stdout: "snap_seq": 0, 2024-09-12T22:32:29.746 INFO:teuthology.orchestra.run.smithi019.stdout: "snap_epoch": 0, 2024-09-12T22:32:29.746 INFO:teuthology.orchestra.run.smithi019.stdout: "pool_snaps": [], 2024-09-12T22:32:29.747 INFO:teuthology.orchestra.run.smithi019.stdout: "removed_snaps": "[]", 2024-09-12T22:32:29.747 INFO:teuthology.orchestra.run.smithi019.stdout: "quota_max_bytes": 0, 2024-09-12T22:32:29.747 INFO:teuthology.orchestra.run.smithi019.stdout: "quota_max_objects": 0, 2024-09-12T22:32:29.747 INFO:teuthology.orchestra.run.smithi019.stdout: "tiers": [], 2024-09-12T22:32:29.747 INFO:teuthology.orchestra.run.smithi019.stdout: "tier_of": -1, 2024-09-12T22:32:29.747 INFO:teuthology.orchestra.run.smithi019.stdout: "read_tier": -1, 2024-09-12T22:32:29.747 INFO:teuthology.orchestra.run.smithi019.stdout: "write_tier": -1, 2024-09-12T22:32:29.747 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_mode": "none", 2024-09-12T22:32:29.747 INFO:teuthology.orchestra.run.smithi019.stdout: "target_max_bytes": 0, 2024-09-12T22:32:29.747 INFO:teuthology.orchestra.run.smithi019.stdout: "target_max_objects": 0, 2024-09-12T22:32:29.747 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T22:32:29.747 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T22:32:29.748 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T22:32:29.748 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_min_flush_age": 0, 2024-09-12T22:32:29.748 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_min_evict_age": 0, 2024-09-12T22:32:29.748 INFO:teuthology.orchestra.run.smithi019.stdout: "erasure_code_profile": "", 2024-09-12T22:32:29.748 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_params": { 2024-09-12T22:32:29.748 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "none" 2024-09-12T22:32:29.748 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:32:29.748 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_period": 0, 2024-09-12T22:32:29.748 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_count": 0, 2024-09-12T22:32:29.748 INFO:teuthology.orchestra.run.smithi019.stdout: "use_gmt_hitset": true, 2024-09-12T22:32:29.749 INFO:teuthology.orchestra.run.smithi019.stdout: "min_read_recency_for_promote": 0, 2024-09-12T22:32:29.749 INFO:teuthology.orchestra.run.smithi019.stdout: "min_write_recency_for_promote": 0, 2024-09-12T22:32:29.749 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T22:32:29.749 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_search_last_n": 0, 2024-09-12T22:32:29.749 INFO:teuthology.orchestra.run.smithi019.stdout: "grade_table": [], 2024-09-12T22:32:29.749 INFO:teuthology.orchestra.run.smithi019.stdout: "stripe_width": 0, 2024-09-12T22:32:29.749 INFO:teuthology.orchestra.run.smithi019.stdout: "expected_num_objects": 0, 2024-09-12T22:32:29.749 INFO:teuthology.orchestra.run.smithi019.stdout: "fast_read": false, 2024-09-12T22:32:29.749 INFO:teuthology.orchestra.run.smithi019.stdout: "options": { 2024-09-12T22:32:29.749 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_num_max": 32, 2024-09-12T22:32:29.749 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_num_min": 1 2024-09-12T22:32:29.749 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:32:29.750 INFO:teuthology.orchestra.run.smithi019.stdout: "application_metadata": { 2024-09-12T22:32:29.750 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": {} 2024-09-12T22:32:29.750 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:32:29.750 INFO:teuthology.orchestra.run.smithi019.stdout: "read_balance": { 2024-09-12T22:32:29.750 INFO:teuthology.orchestra.run.smithi019.stdout: "score_type": "Fair distribution", 2024-09-12T22:32:29.750 INFO:teuthology.orchestra.run.smithi019.stdout: "score_acting": 2.9900000095367432, 2024-09-12T22:32:29.750 INFO:teuthology.orchestra.run.smithi019.stdout: "score_stable": 2.9900000095367432, 2024-09-12T22:32:29.750 INFO:teuthology.orchestra.run.smithi019.stdout: "optimal_score": 0.67000001668930054, 2024-09-12T22:32:29.750 INFO:teuthology.orchestra.run.smithi019.stdout: "raw_score_acting": 2, 2024-09-12T22:32:29.750 INFO:teuthology.orchestra.run.smithi019.stdout: "raw_score_stable": 2, 2024-09-12T22:32:29.751 INFO:teuthology.orchestra.run.smithi019.stdout: "primary_affinity_weighted": 0.84509789943695068, 2024-09-12T22:32:29.751 INFO:teuthology.orchestra.run.smithi019.stdout: "average_primary_affinity": 0.85000002384185791, 2024-09-12T22:32:29.751 INFO:teuthology.orchestra.run.smithi019.stdout: "average_primary_affinity_weighted": 0.85000002384185791 2024-09-12T22:32:29.751 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T22:32:29.751 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:32:29.751 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:32:29.751 INFO:teuthology.orchestra.run.smithi019.stdout: "pool": 2, 2024-09-12T22:32:29.751 INFO:teuthology.orchestra.run.smithi019.stdout: "pool_name": "rbd", 2024-09-12T22:32:29.751 INFO:teuthology.orchestra.run.smithi019.stdout: "create_time": "2024-09-12T22:31:30.975989+0000", 2024-09-12T22:32:29.751 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 8193, 2024-09-12T22:32:29.751 INFO:teuthology.orchestra.run.smithi019.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-12T22:32:29.751 INFO:teuthology.orchestra.run.smithi019.stdout: "type": 1, 2024-09-12T22:32:29.751 INFO:teuthology.orchestra.run.smithi019.stdout: "size": 2, 2024-09-12T22:32:29.752 INFO:teuthology.orchestra.run.smithi019.stdout: "min_size": 1, 2024-09-12T22:32:29.752 INFO:teuthology.orchestra.run.smithi019.stdout: "crush_rule": 0, 2024-09-12T22:32:29.752 INFO:teuthology.orchestra.run.smithi019.stdout: "peering_crush_bucket_count": 0, 2024-09-12T22:32:29.752 INFO:teuthology.orchestra.run.smithi019.stdout: "peering_crush_bucket_target": 0, 2024-09-12T22:32:29.752 INFO:teuthology.orchestra.run.smithi019.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T22:32:29.752 INFO:teuthology.orchestra.run.smithi019.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T22:32:29.752 INFO:teuthology.orchestra.run.smithi019.stdout: "is_stretch_pool": false, 2024-09-12T22:32:29.752 INFO:teuthology.orchestra.run.smithi019.stdout: "object_hash": 2, 2024-09-12T22:32:29.752 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_autoscale_mode": "off", 2024-09-12T22:32:29.752 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_num": 8, 2024-09-12T22:32:29.752 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_placement_num": 8, 2024-09-12T22:32:29.752 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_placement_num_target": 8, 2024-09-12T22:32:29.752 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_num_target": 8, 2024-09-12T22:32:29.753 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_num_pending": 8, 2024-09-12T22:32:29.753 INFO:teuthology.orchestra.run.smithi019.stdout: "last_pg_merge_meta": { 2024-09-12T22:32:29.753 INFO:teuthology.orchestra.run.smithi019.stdout: "source_pgid": "0.0", 2024-09-12T22:32:29.753 INFO:teuthology.orchestra.run.smithi019.stdout: "ready_epoch": 0, 2024-09-12T22:32:29.753 INFO:teuthology.orchestra.run.smithi019.stdout: "last_epoch_started": 0, 2024-09-12T22:32:29.753 INFO:teuthology.orchestra.run.smithi019.stdout: "last_epoch_clean": 0, 2024-09-12T22:32:29.753 INFO:teuthology.orchestra.run.smithi019.stdout: "source_version": "0'0", 2024-09-12T22:32:29.753 INFO:teuthology.orchestra.run.smithi019.stdout: "target_version": "0'0" 2024-09-12T22:32:29.753 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:32:29.753 INFO:teuthology.orchestra.run.smithi019.stdout: "last_change": "16", 2024-09-12T22:32:29.753 INFO:teuthology.orchestra.run.smithi019.stdout: "last_force_op_resend": "0", 2024-09-12T22:32:29.753 INFO:teuthology.orchestra.run.smithi019.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T22:32:29.753 INFO:teuthology.orchestra.run.smithi019.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T22:32:29.754 INFO:teuthology.orchestra.run.smithi019.stdout: "auid": 0, 2024-09-12T22:32:29.754 INFO:teuthology.orchestra.run.smithi019.stdout: "snap_mode": "selfmanaged", 2024-09-12T22:32:29.754 INFO:teuthology.orchestra.run.smithi019.stdout: "snap_seq": 2, 2024-09-12T22:32:29.754 INFO:teuthology.orchestra.run.smithi019.stdout: "snap_epoch": 16, 2024-09-12T22:32:29.754 INFO:teuthology.orchestra.run.smithi019.stdout: "pool_snaps": [], 2024-09-12T22:32:29.754 INFO:teuthology.orchestra.run.smithi019.stdout: "removed_snaps": "[]", 2024-09-12T22:32:29.754 INFO:teuthology.orchestra.run.smithi019.stdout: "quota_max_bytes": 0, 2024-09-12T22:32:29.754 INFO:teuthology.orchestra.run.smithi019.stdout: "quota_max_objects": 0, 2024-09-12T22:32:29.754 INFO:teuthology.orchestra.run.smithi019.stdout: "tiers": [], 2024-09-12T22:32:29.754 INFO:teuthology.orchestra.run.smithi019.stdout: "tier_of": -1, 2024-09-12T22:32:29.754 INFO:teuthology.orchestra.run.smithi019.stdout: "read_tier": -1, 2024-09-12T22:32:29.754 INFO:teuthology.orchestra.run.smithi019.stdout: "write_tier": -1, 2024-09-12T22:32:29.754 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_mode": "none", 2024-09-12T22:32:29.754 INFO:teuthology.orchestra.run.smithi019.stdout: "target_max_bytes": 0, 2024-09-12T22:32:29.755 INFO:teuthology.orchestra.run.smithi019.stdout: "target_max_objects": 0, 2024-09-12T22:32:29.755 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T22:32:29.755 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T22:32:29.755 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T22:32:29.755 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_min_flush_age": 0, 2024-09-12T22:32:29.755 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_min_evict_age": 0, 2024-09-12T22:32:29.755 INFO:teuthology.orchestra.run.smithi019.stdout: "erasure_code_profile": "", 2024-09-12T22:32:29.755 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_params": { 2024-09-12T22:32:29.755 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "none" 2024-09-12T22:32:29.755 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:32:29.755 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_period": 0, 2024-09-12T22:32:29.755 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_count": 0, 2024-09-12T22:32:29.756 INFO:teuthology.orchestra.run.smithi019.stdout: "use_gmt_hitset": true, 2024-09-12T22:32:29.756 INFO:teuthology.orchestra.run.smithi019.stdout: "min_read_recency_for_promote": 0, 2024-09-12T22:32:29.756 INFO:teuthology.orchestra.run.smithi019.stdout: "min_write_recency_for_promote": 0, 2024-09-12T22:32:29.756 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T22:32:29.756 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_search_last_n": 0, 2024-09-12T22:32:29.756 INFO:teuthology.orchestra.run.smithi019.stdout: "grade_table": [], 2024-09-12T22:32:29.756 INFO:teuthology.orchestra.run.smithi019.stdout: "stripe_width": 0, 2024-09-12T22:32:29.756 INFO:teuthology.orchestra.run.smithi019.stdout: "expected_num_objects": 0, 2024-09-12T22:32:29.756 INFO:teuthology.orchestra.run.smithi019.stdout: "fast_read": false, 2024-09-12T22:32:29.756 INFO:teuthology.orchestra.run.smithi019.stdout: "options": {}, 2024-09-12T22:32:29.756 INFO:teuthology.orchestra.run.smithi019.stdout: "application_metadata": { 2024-09-12T22:32:29.757 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd": {} 2024-09-12T22:32:29.757 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:32:29.757 INFO:teuthology.orchestra.run.smithi019.stdout: "read_balance": { 2024-09-12T22:32:29.757 INFO:teuthology.orchestra.run.smithi019.stdout: "score_type": "Fair distribution", 2024-09-12T22:32:29.757 INFO:teuthology.orchestra.run.smithi019.stdout: "score_acting": 1.5, 2024-09-12T22:32:29.757 INFO:teuthology.orchestra.run.smithi019.stdout: "score_stable": 1.5, 2024-09-12T22:32:29.757 INFO:teuthology.orchestra.run.smithi019.stdout: "optimal_score": 1, 2024-09-12T22:32:29.757 INFO:teuthology.orchestra.run.smithi019.stdout: "raw_score_acting": 1.5, 2024-09-12T22:32:29.757 INFO:teuthology.orchestra.run.smithi019.stdout: "raw_score_stable": 1.5, 2024-09-12T22:32:29.757 INFO:teuthology.orchestra.run.smithi019.stdout: "primary_affinity_weighted": 0.84509789943695068, 2024-09-12T22:32:29.757 INFO:teuthology.orchestra.run.smithi019.stdout: "average_primary_affinity": 0.85000002384185791, 2024-09-12T22:32:29.757 INFO:teuthology.orchestra.run.smithi019.stdout: "average_primary_affinity_weighted": 0.85000002384185791 2024-09-12T22:32:29.757 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T22:32:29.758 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:32:29.758 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:32:29.758 INFO:teuthology.orchestra.run.smithi019.stdout: "pool": 3, 2024-09-12T22:32:29.758 INFO:teuthology.orchestra.run.smithi019.stdout: "pool_name": "cephfs_metadata", 2024-09-12T22:32:29.758 INFO:teuthology.orchestra.run.smithi019.stdout: "create_time": "2024-09-12T22:31:35.267679+0000", 2024-09-12T22:32:29.758 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-12T22:32:29.758 INFO:teuthology.orchestra.run.smithi019.stdout: "flags_names": "hashpspool", 2024-09-12T22:32:29.758 INFO:teuthology.orchestra.run.smithi019.stdout: "type": 1, 2024-09-12T22:32:29.758 INFO:teuthology.orchestra.run.smithi019.stdout: "size": 2, 2024-09-12T22:32:29.758 INFO:teuthology.orchestra.run.smithi019.stdout: "min_size": 1, 2024-09-12T22:32:29.758 INFO:teuthology.orchestra.run.smithi019.stdout: "crush_rule": 0, 2024-09-12T22:32:29.758 INFO:teuthology.orchestra.run.smithi019.stdout: "peering_crush_bucket_count": 0, 2024-09-12T22:32:29.758 INFO:teuthology.orchestra.run.smithi019.stdout: "peering_crush_bucket_target": 0, 2024-09-12T22:32:29.758 INFO:teuthology.orchestra.run.smithi019.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T22:32:29.759 INFO:teuthology.orchestra.run.smithi019.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T22:32:29.759 INFO:teuthology.orchestra.run.smithi019.stdout: "is_stretch_pool": false, 2024-09-12T22:32:29.759 INFO:teuthology.orchestra.run.smithi019.stdout: "object_hash": 2, 2024-09-12T22:32:29.759 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_autoscale_mode": "off", 2024-09-12T22:32:29.759 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_num": 32, 2024-09-12T22:32:29.759 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_placement_num": 32, 2024-09-12T22:32:29.759 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_placement_num_target": 32, 2024-09-12T22:32:29.759 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_num_target": 32, 2024-09-12T22:32:29.759 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_num_pending": 32, 2024-09-12T22:32:29.759 INFO:teuthology.orchestra.run.smithi019.stdout: "last_pg_merge_meta": { 2024-09-12T22:32:29.759 INFO:teuthology.orchestra.run.smithi019.stdout: "source_pgid": "0.0", 2024-09-12T22:32:29.760 INFO:teuthology.orchestra.run.smithi019.stdout: "ready_epoch": 0, 2024-09-12T22:32:29.760 INFO:teuthology.orchestra.run.smithi019.stdout: "last_epoch_started": 0, 2024-09-12T22:32:29.760 INFO:teuthology.orchestra.run.smithi019.stdout: "last_epoch_clean": 0, 2024-09-12T22:32:29.760 INFO:teuthology.orchestra.run.smithi019.stdout: "source_version": "0'0", 2024-09-12T22:32:29.760 INFO:teuthology.orchestra.run.smithi019.stdout: "target_version": "0'0" 2024-09-12T22:32:29.760 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:32:29.760 INFO:teuthology.orchestra.run.smithi019.stdout: "last_change": "19", 2024-09-12T22:32:29.760 INFO:teuthology.orchestra.run.smithi019.stdout: "last_force_op_resend": "0", 2024-09-12T22:32:29.760 INFO:teuthology.orchestra.run.smithi019.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T22:32:29.760 INFO:teuthology.orchestra.run.smithi019.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T22:32:29.760 INFO:teuthology.orchestra.run.smithi019.stdout: "auid": 0, 2024-09-12T22:32:29.760 INFO:teuthology.orchestra.run.smithi019.stdout: "snap_mode": "selfmanaged", 2024-09-12T22:32:29.761 INFO:teuthology.orchestra.run.smithi019.stdout: "snap_seq": 0, 2024-09-12T22:32:29.761 INFO:teuthology.orchestra.run.smithi019.stdout: "snap_epoch": 0, 2024-09-12T22:32:29.761 INFO:teuthology.orchestra.run.smithi019.stdout: "pool_snaps": [], 2024-09-12T22:32:29.761 INFO:teuthology.orchestra.run.smithi019.stdout: "removed_snaps": "[]", 2024-09-12T22:32:29.761 INFO:teuthology.orchestra.run.smithi019.stdout: "quota_max_bytes": 0, 2024-09-12T22:32:29.761 INFO:teuthology.orchestra.run.smithi019.stdout: "quota_max_objects": 0, 2024-09-12T22:32:29.761 INFO:teuthology.orchestra.run.smithi019.stdout: "tiers": [], 2024-09-12T22:32:29.761 INFO:teuthology.orchestra.run.smithi019.stdout: "tier_of": -1, 2024-09-12T22:32:29.761 INFO:teuthology.orchestra.run.smithi019.stdout: "read_tier": -1, 2024-09-12T22:32:29.761 INFO:teuthology.orchestra.run.smithi019.stdout: "write_tier": -1, 2024-09-12T22:32:29.761 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_mode": "none", 2024-09-12T22:32:29.761 INFO:teuthology.orchestra.run.smithi019.stdout: "target_max_bytes": 0, 2024-09-12T22:32:29.761 INFO:teuthology.orchestra.run.smithi019.stdout: "target_max_objects": 0, 2024-09-12T22:32:29.761 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T22:32:29.762 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T22:32:29.762 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T22:32:29.762 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_min_flush_age": 0, 2024-09-12T22:32:29.762 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_min_evict_age": 0, 2024-09-12T22:32:29.762 INFO:teuthology.orchestra.run.smithi019.stdout: "erasure_code_profile": "", 2024-09-12T22:32:29.762 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_params": { 2024-09-12T22:32:29.762 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "none" 2024-09-12T22:32:29.762 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:32:29.762 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_period": 0, 2024-09-12T22:32:29.762 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_count": 0, 2024-09-12T22:32:29.763 INFO:teuthology.orchestra.run.smithi019.stdout: "use_gmt_hitset": true, 2024-09-12T22:32:29.763 INFO:teuthology.orchestra.run.smithi019.stdout: "min_read_recency_for_promote": 0, 2024-09-12T22:32:29.763 INFO:teuthology.orchestra.run.smithi019.stdout: "min_write_recency_for_promote": 0, 2024-09-12T22:32:29.763 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T22:32:29.763 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_search_last_n": 0, 2024-09-12T22:32:29.763 INFO:teuthology.orchestra.run.smithi019.stdout: "grade_table": [], 2024-09-12T22:32:29.763 INFO:teuthology.orchestra.run.smithi019.stdout: "stripe_width": 0, 2024-09-12T22:32:29.763 INFO:teuthology.orchestra.run.smithi019.stdout: "expected_num_objects": 0, 2024-09-12T22:32:29.763 INFO:teuthology.orchestra.run.smithi019.stdout: "fast_read": false, 2024-09-12T22:32:29.763 INFO:teuthology.orchestra.run.smithi019.stdout: "options": { 2024-09-12T22:32:29.763 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_autoscale_bias": 4, 2024-09-12T22:32:29.763 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_num_min": 16, 2024-09-12T22:32:29.764 INFO:teuthology.orchestra.run.smithi019.stdout: "recovery_priority": 5 2024-09-12T22:32:29.764 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:32:29.764 INFO:teuthology.orchestra.run.smithi019.stdout: "application_metadata": { 2024-09-12T22:32:29.764 INFO:teuthology.orchestra.run.smithi019.stdout: "cephfs": { 2024-09-12T22:32:29.764 INFO:teuthology.orchestra.run.smithi019.stdout: "metadata": "cephfs" 2024-09-12T22:32:29.764 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T22:32:29.764 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:32:29.764 INFO:teuthology.orchestra.run.smithi019.stdout: "read_balance": { 2024-09-12T22:32:29.764 INFO:teuthology.orchestra.run.smithi019.stdout: "score_type": "Fair distribution", 2024-09-12T22:32:29.764 INFO:teuthology.orchestra.run.smithi019.stdout: "score_acting": 1.2200000286102295, 2024-09-12T22:32:29.764 INFO:teuthology.orchestra.run.smithi019.stdout: "score_stable": 1.2200000286102295, 2024-09-12T22:32:29.764 INFO:teuthology.orchestra.run.smithi019.stdout: "optimal_score": 1, 2024-09-12T22:32:29.764 INFO:teuthology.orchestra.run.smithi019.stdout: "raw_score_acting": 1.2200000286102295, 2024-09-12T22:32:29.765 INFO:teuthology.orchestra.run.smithi019.stdout: "raw_score_stable": 1.2200000286102295, 2024-09-12T22:32:29.765 INFO:teuthology.orchestra.run.smithi019.stdout: "primary_affinity_weighted": 0.84509789943695068, 2024-09-12T22:32:29.765 INFO:teuthology.orchestra.run.smithi019.stdout: "average_primary_affinity": 0.85000002384185791, 2024-09-12T22:32:29.765 INFO:teuthology.orchestra.run.smithi019.stdout: "average_primary_affinity_weighted": 0.85000002384185791 2024-09-12T22:32:29.765 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T22:32:29.765 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:32:29.765 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:32:29.765 INFO:teuthology.orchestra.run.smithi019.stdout: "pool": 4, 2024-09-12T22:32:29.765 INFO:teuthology.orchestra.run.smithi019.stdout: "pool_name": "cephfs_data", 2024-09-12T22:32:29.765 INFO:teuthology.orchestra.run.smithi019.stdout: "create_time": "2024-09-12T22:31:35.724475+0000", 2024-09-12T22:32:29.765 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-12T22:32:29.765 INFO:teuthology.orchestra.run.smithi019.stdout: "flags_names": "hashpspool", 2024-09-12T22:32:29.765 INFO:teuthology.orchestra.run.smithi019.stdout: "type": 1, 2024-09-12T22:32:29.766 INFO:teuthology.orchestra.run.smithi019.stdout: "size": 2, 2024-09-12T22:32:29.766 INFO:teuthology.orchestra.run.smithi019.stdout: "min_size": 1, 2024-09-12T22:32:29.766 INFO:teuthology.orchestra.run.smithi019.stdout: "crush_rule": 0, 2024-09-12T22:32:29.766 INFO:teuthology.orchestra.run.smithi019.stdout: "peering_crush_bucket_count": 0, 2024-09-12T22:32:29.766 INFO:teuthology.orchestra.run.smithi019.stdout: "peering_crush_bucket_target": 0, 2024-09-12T22:32:29.766 INFO:teuthology.orchestra.run.smithi019.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T22:32:29.766 INFO:teuthology.orchestra.run.smithi019.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T22:32:29.766 INFO:teuthology.orchestra.run.smithi019.stdout: "is_stretch_pool": false, 2024-09-12T22:32:29.767 INFO:teuthology.orchestra.run.smithi019.stdout: "object_hash": 2, 2024-09-12T22:32:29.767 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_autoscale_mode": "off", 2024-09-12T22:32:29.767 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_num": 64, 2024-09-12T22:32:29.767 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_placement_num": 64, 2024-09-12T22:32:29.767 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_placement_num_target": 64, 2024-09-12T22:32:29.767 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_num_target": 64, 2024-09-12T22:32:29.767 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_num_pending": 64, 2024-09-12T22:32:29.767 INFO:teuthology.orchestra.run.smithi019.stdout: "last_pg_merge_meta": { 2024-09-12T22:32:29.768 INFO:teuthology.orchestra.run.smithi019.stdout: "source_pgid": "0.0", 2024-09-12T22:32:29.768 INFO:teuthology.orchestra.run.smithi019.stdout: "ready_epoch": 0, 2024-09-12T22:32:29.768 INFO:teuthology.orchestra.run.smithi019.stdout: "last_epoch_started": 0, 2024-09-12T22:32:29.768 INFO:teuthology.orchestra.run.smithi019.stdout: "last_epoch_clean": 0, 2024-09-12T22:32:29.768 INFO:teuthology.orchestra.run.smithi019.stdout: "source_version": "0'0", 2024-09-12T22:32:29.768 INFO:teuthology.orchestra.run.smithi019.stdout: "target_version": "0'0" 2024-09-12T22:32:29.768 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:32:29.768 INFO:teuthology.orchestra.run.smithi019.stdout: "last_change": "20", 2024-09-12T22:32:29.768 INFO:teuthology.orchestra.run.smithi019.stdout: "last_force_op_resend": "0", 2024-09-12T22:32:29.768 INFO:teuthology.orchestra.run.smithi019.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T22:32:29.768 INFO:teuthology.orchestra.run.smithi019.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T22:32:29.768 INFO:teuthology.orchestra.run.smithi019.stdout: "auid": 0, 2024-09-12T22:32:29.769 INFO:teuthology.orchestra.run.smithi019.stdout: "snap_mode": "selfmanaged", 2024-09-12T22:32:29.769 INFO:teuthology.orchestra.run.smithi019.stdout: "snap_seq": 0, 2024-09-12T22:32:29.769 INFO:teuthology.orchestra.run.smithi019.stdout: "snap_epoch": 0, 2024-09-12T22:32:29.769 INFO:teuthology.orchestra.run.smithi019.stdout: "pool_snaps": [], 2024-09-12T22:32:29.769 INFO:teuthology.orchestra.run.smithi019.stdout: "removed_snaps": "[]", 2024-09-12T22:32:29.769 INFO:teuthology.orchestra.run.smithi019.stdout: "quota_max_bytes": 0, 2024-09-12T22:32:29.769 INFO:teuthology.orchestra.run.smithi019.stdout: "quota_max_objects": 0, 2024-09-12T22:32:29.769 INFO:teuthology.orchestra.run.smithi019.stdout: "tiers": [], 2024-09-12T22:32:29.769 INFO:teuthology.orchestra.run.smithi019.stdout: "tier_of": -1, 2024-09-12T22:32:29.769 INFO:teuthology.orchestra.run.smithi019.stdout: "read_tier": -1, 2024-09-12T22:32:29.769 INFO:teuthology.orchestra.run.smithi019.stdout: "write_tier": -1, 2024-09-12T22:32:29.769 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_mode": "none", 2024-09-12T22:32:29.770 INFO:teuthology.orchestra.run.smithi019.stdout: "target_max_bytes": 0, 2024-09-12T22:32:29.770 INFO:teuthology.orchestra.run.smithi019.stdout: "target_max_objects": 0, 2024-09-12T22:32:29.770 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T22:32:29.770 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T22:32:29.770 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T22:32:29.770 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_min_flush_age": 0, 2024-09-12T22:32:29.770 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_min_evict_age": 0, 2024-09-12T22:32:29.770 INFO:teuthology.orchestra.run.smithi019.stdout: "erasure_code_profile": "", 2024-09-12T22:32:29.770 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_params": { 2024-09-12T22:32:29.771 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "none" 2024-09-12T22:32:29.771 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:32:29.771 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_period": 0, 2024-09-12T22:32:29.771 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_count": 0, 2024-09-12T22:32:29.771 INFO:teuthology.orchestra.run.smithi019.stdout: "use_gmt_hitset": true, 2024-09-12T22:32:29.771 INFO:teuthology.orchestra.run.smithi019.stdout: "min_read_recency_for_promote": 0, 2024-09-12T22:32:29.771 INFO:teuthology.orchestra.run.smithi019.stdout: "min_write_recency_for_promote": 0, 2024-09-12T22:32:29.771 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T22:32:29.772 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_search_last_n": 0, 2024-09-12T22:32:29.772 INFO:teuthology.orchestra.run.smithi019.stdout: "grade_table": [], 2024-09-12T22:32:29.772 INFO:teuthology.orchestra.run.smithi019.stdout: "stripe_width": 0, 2024-09-12T22:32:29.772 INFO:teuthology.orchestra.run.smithi019.stdout: "expected_num_objects": 0, 2024-09-12T22:32:29.772 INFO:teuthology.orchestra.run.smithi019.stdout: "fast_read": false, 2024-09-12T22:32:29.772 INFO:teuthology.orchestra.run.smithi019.stdout: "options": { 2024-09-12T22:32:29.772 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_num_min": 64, 2024-09-12T22:32:29.772 INFO:teuthology.orchestra.run.smithi019.stdout: "target_size_ratio": 0.89999997615814209 2024-09-12T22:32:29.772 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:32:29.772 INFO:teuthology.orchestra.run.smithi019.stdout: "application_metadata": { 2024-09-12T22:32:29.773 INFO:teuthology.orchestra.run.smithi019.stdout: "cephfs": { 2024-09-12T22:32:29.773 INFO:teuthology.orchestra.run.smithi019.stdout: "data": "cephfs" 2024-09-12T22:32:29.773 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T22:32:29.773 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:32:29.773 INFO:teuthology.orchestra.run.smithi019.stdout: "read_balance": { 2024-09-12T22:32:29.773 INFO:teuthology.orchestra.run.smithi019.stdout: "score_type": "Fair distribution", 2024-09-12T22:32:29.773 INFO:teuthology.orchestra.run.smithi019.stdout: "score_acting": 1.1699999570846558, 2024-09-12T22:32:29.773 INFO:teuthology.orchestra.run.smithi019.stdout: "score_stable": 1.1699999570846558, 2024-09-12T22:32:29.773 INFO:teuthology.orchestra.run.smithi019.stdout: "optimal_score": 1, 2024-09-12T22:32:29.773 INFO:teuthology.orchestra.run.smithi019.stdout: "raw_score_acting": 1.1699999570846558, 2024-09-12T22:32:29.773 INFO:teuthology.orchestra.run.smithi019.stdout: "raw_score_stable": 1.1699999570846558, 2024-09-12T22:32:29.773 INFO:teuthology.orchestra.run.smithi019.stdout: "primary_affinity_weighted": 0.84509789943695068, 2024-09-12T22:32:29.773 INFO:teuthology.orchestra.run.smithi019.stdout: "average_primary_affinity": 0.85000002384185791, 2024-09-12T22:32:29.774 INFO:teuthology.orchestra.run.smithi019.stdout: "average_primary_affinity_weighted": 0.85000002384185791 2024-09-12T22:32:29.774 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T22:32:29.774 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T22:32:29.774 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-12T22:32:29.774 INFO:teuthology.orchestra.run.smithi019.stdout: "osds": [ 2024-09-12T22:32:29.774 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:32:29.774 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": 0, 2024-09-12T22:32:29.774 INFO:teuthology.orchestra.run.smithi019.stdout: "uuid": "73b96314-15d5-4058-9993-ac103e997b27", 2024-09-12T22:32:29.774 INFO:teuthology.orchestra.run.smithi019.stdout: "up": 1, 2024-09-12T22:32:29.774 INFO:teuthology.orchestra.run.smithi019.stdout: "in": 1, 2024-09-12T22:32:29.774 INFO:teuthology.orchestra.run.smithi019.stdout: "weight": 1, 2024-09-12T22:32:29.774 INFO:teuthology.orchestra.run.smithi019.stdout: "primary_affinity": 0.5352935791015625, 2024-09-12T22:32:29.774 INFO:teuthology.orchestra.run.smithi019.stdout: "last_clean_begin": 0, 2024-09-12T22:32:29.775 INFO:teuthology.orchestra.run.smithi019.stdout: "last_clean_end": 0, 2024-09-12T22:32:29.775 INFO:teuthology.orchestra.run.smithi019.stdout: "up_from": 9, 2024-09-12T22:32:29.775 INFO:teuthology.orchestra.run.smithi019.stdout: "up_thru": 35, 2024-09-12T22:32:29.775 INFO:teuthology.orchestra.run.smithi019.stdout: "down_at": 0, 2024-09-12T22:32:29.775 INFO:teuthology.orchestra.run.smithi019.stdout: "lost_at": 0, 2024-09-12T22:32:29.775 INFO:teuthology.orchestra.run.smithi019.stdout: "public_addrs": { 2024-09-12T22:32:29.775 INFO:teuthology.orchestra.run.smithi019.stdout: "addrvec": [ 2024-09-12T22:32:29.775 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:32:29.775 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v2", 2024-09-12T22:32:29.775 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.76:6800", 2024-09-12T22:32:29.776 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 1343093884 2024-09-12T22:32:29.776 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:32:29.776 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:32:29.776 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2024-09-12T22:32:29.776 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.76:6801", 2024-09-12T22:32:29.776 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 1343093884 2024-09-12T22:32:29.776 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T22:32:29.776 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T22:32:29.777 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:32:29.777 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster_addrs": { 2024-09-12T22:32:29.777 INFO:teuthology.orchestra.run.smithi019.stdout: "addrvec": [ 2024-09-12T22:32:29.777 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:32:29.777 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v2", 2024-09-12T22:32:29.777 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.76:6802", 2024-09-12T22:32:29.777 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 1343093884 2024-09-12T22:32:29.778 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:32:29.778 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:32:29.778 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2024-09-12T22:32:29.778 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.76:6803", 2024-09-12T22:32:29.778 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 1343093884 2024-09-12T22:32:29.778 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T22:32:29.778 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T22:32:29.778 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:32:29.778 INFO:teuthology.orchestra.run.smithi019.stdout: "heartbeat_back_addrs": { 2024-09-12T22:32:29.779 INFO:teuthology.orchestra.run.smithi019.stdout: "addrvec": [ 2024-09-12T22:32:29.779 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:32:29.779 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v2", 2024-09-12T22:32:29.779 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.76:6806", 2024-09-12T22:32:29.779 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 1343093884 2024-09-12T22:32:29.779 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:32:29.779 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:32:29.779 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2024-09-12T22:32:29.779 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.76:6807", 2024-09-12T22:32:29.779 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 1343093884 2024-09-12T22:32:29.779 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T22:32:29.779 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T22:32:29.780 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:32:29.780 INFO:teuthology.orchestra.run.smithi019.stdout: "heartbeat_front_addrs": { 2024-09-12T22:32:29.780 INFO:teuthology.orchestra.run.smithi019.stdout: "addrvec": [ 2024-09-12T22:32:29.780 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:32:29.780 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v2", 2024-09-12T22:32:29.780 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.76:6804", 2024-09-12T22:32:29.780 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 1343093884 2024-09-12T22:32:29.780 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:32:29.780 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:32:29.780 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2024-09-12T22:32:29.781 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.76:6805", 2024-09-12T22:32:29.781 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 1343093884 2024-09-12T22:32:29.781 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T22:32:29.781 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T22:32:29.781 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:32:29.781 INFO:teuthology.orchestra.run.smithi019.stdout: "public_addr": "172.21.15.76:6801/1343093884", 2024-09-12T22:32:29.781 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster_addr": "172.21.15.76:6803/1343093884", 2024-09-12T22:32:29.781 INFO:teuthology.orchestra.run.smithi019.stdout: "heartbeat_back_addr": "172.21.15.76:6807/1343093884", 2024-09-12T22:32:29.781 INFO:teuthology.orchestra.run.smithi019.stdout: "heartbeat_front_addr": "172.21.15.76:6805/1343093884", 2024-09-12T22:32:29.781 INFO:teuthology.orchestra.run.smithi019.stdout: "state": [ 2024-09-12T22:32:29.781 INFO:teuthology.orchestra.run.smithi019.stdout: "exists", 2024-09-12T22:32:29.781 INFO:teuthology.orchestra.run.smithi019.stdout: "up" 2024-09-12T22:32:29.782 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T22:32:29.782 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:32:29.782 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:32:29.782 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": 1, 2024-09-12T22:32:29.782 INFO:teuthology.orchestra.run.smithi019.stdout: "uuid": "f82ad621-e9cf-41cb-b9c0-43470cf7ddb1", 2024-09-12T22:32:29.782 INFO:teuthology.orchestra.run.smithi019.stdout: "up": 1, 2024-09-12T22:32:29.782 INFO:teuthology.orchestra.run.smithi019.stdout: "in": 1, 2024-09-12T22:32:29.782 INFO:teuthology.orchestra.run.smithi019.stdout: "weight": 1, 2024-09-12T22:32:29.782 INFO:teuthology.orchestra.run.smithi019.stdout: "primary_affinity": 1, 2024-09-12T22:32:29.782 INFO:teuthology.orchestra.run.smithi019.stdout: "last_clean_begin": 0, 2024-09-12T22:32:29.782 INFO:teuthology.orchestra.run.smithi019.stdout: "last_clean_end": 0, 2024-09-12T22:32:29.782 INFO:teuthology.orchestra.run.smithi019.stdout: "up_from": 8, 2024-09-12T22:32:29.783 INFO:teuthology.orchestra.run.smithi019.stdout: "up_thru": 22, 2024-09-12T22:32:29.783 INFO:teuthology.orchestra.run.smithi019.stdout: "down_at": 0, 2024-09-12T22:32:29.783 INFO:teuthology.orchestra.run.smithi019.stdout: "lost_at": 0, 2024-09-12T22:32:29.783 INFO:teuthology.orchestra.run.smithi019.stdout: "public_addrs": { 2024-09-12T22:32:29.783 INFO:teuthology.orchestra.run.smithi019.stdout: "addrvec": [ 2024-09-12T22:32:29.783 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:32:29.783 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v2", 2024-09-12T22:32:29.783 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.148:6800", 2024-09-12T22:32:29.783 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 616952176 2024-09-12T22:32:29.783 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:32:29.784 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:32:29.784 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2024-09-12T22:32:29.784 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.148:6801", 2024-09-12T22:32:29.784 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 616952176 2024-09-12T22:32:29.784 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T22:32:29.784 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T22:32:29.784 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:32:29.784 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster_addrs": { 2024-09-12T22:32:29.784 INFO:teuthology.orchestra.run.smithi019.stdout: "addrvec": [ 2024-09-12T22:32:29.784 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:32:29.785 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v2", 2024-09-12T22:32:29.785 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.148:6802", 2024-09-12T22:32:29.785 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 616952176 2024-09-12T22:32:29.785 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:32:29.785 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:32:29.785 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2024-09-12T22:32:29.785 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.148:6803", 2024-09-12T22:32:29.785 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 616952176 2024-09-12T22:32:29.785 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T22:32:29.785 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T22:32:29.785 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:32:29.786 INFO:teuthology.orchestra.run.smithi019.stdout: "heartbeat_back_addrs": { 2024-09-12T22:32:29.786 INFO:teuthology.orchestra.run.smithi019.stdout: "addrvec": [ 2024-09-12T22:32:29.786 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:32:29.786 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v2", 2024-09-12T22:32:29.786 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.148:6806", 2024-09-12T22:32:29.786 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 616952176 2024-09-12T22:32:29.786 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:32:29.786 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:32:29.786 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2024-09-12T22:32:29.786 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.148:6807", 2024-09-12T22:32:29.786 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 616952176 2024-09-12T22:32:29.786 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T22:32:29.786 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T22:32:29.787 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:32:29.787 INFO:teuthology.orchestra.run.smithi019.stdout: "heartbeat_front_addrs": { 2024-09-12T22:32:29.787 INFO:teuthology.orchestra.run.smithi019.stdout: "addrvec": [ 2024-09-12T22:32:29.787 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:32:29.787 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v2", 2024-09-12T22:32:29.787 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.148:6804", 2024-09-12T22:32:29.787 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 616952176 2024-09-12T22:32:29.787 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:32:29.787 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:32:29.787 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2024-09-12T22:32:29.788 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.148:6805", 2024-09-12T22:32:29.788 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 616952176 2024-09-12T22:32:29.788 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T22:32:29.788 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T22:32:29.788 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:32:29.788 INFO:teuthology.orchestra.run.smithi019.stdout: "public_addr": "172.21.15.148:6801/616952176", 2024-09-12T22:32:29.788 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster_addr": "172.21.15.148:6803/616952176", 2024-09-12T22:32:29.788 INFO:teuthology.orchestra.run.smithi019.stdout: "heartbeat_back_addr": "172.21.15.148:6807/616952176", 2024-09-12T22:32:29.789 INFO:teuthology.orchestra.run.smithi019.stdout: "heartbeat_front_addr": "172.21.15.148:6805/616952176", 2024-09-12T22:32:29.789 INFO:teuthology.orchestra.run.smithi019.stdout: "state": [ 2024-09-12T22:32:29.789 INFO:teuthology.orchestra.run.smithi019.stdout: "exists", 2024-09-12T22:32:29.789 INFO:teuthology.orchestra.run.smithi019.stdout: "up" 2024-09-12T22:32:29.789 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T22:32:29.789 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:32:29.789 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:32:29.789 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": 2, 2024-09-12T22:32:29.789 INFO:teuthology.orchestra.run.smithi019.stdout: "uuid": "f30dda36-a84c-4a01-a81a-afbfb88c0aed", 2024-09-12T22:32:29.789 INFO:teuthology.orchestra.run.smithi019.stdout: "up": 1, 2024-09-12T22:32:29.789 INFO:teuthology.orchestra.run.smithi019.stdout: "in": 1, 2024-09-12T22:32:29.789 INFO:teuthology.orchestra.run.smithi019.stdout: "weight": 1, 2024-09-12T22:32:29.790 INFO:teuthology.orchestra.run.smithi019.stdout: "primary_affinity": 1, 2024-09-12T22:32:29.790 INFO:teuthology.orchestra.run.smithi019.stdout: "last_clean_begin": 0, 2024-09-12T22:32:29.790 INFO:teuthology.orchestra.run.smithi019.stdout: "last_clean_end": 0, 2024-09-12T22:32:29.790 INFO:teuthology.orchestra.run.smithi019.stdout: "up_from": 9, 2024-09-12T22:32:29.790 INFO:teuthology.orchestra.run.smithi019.stdout: "up_thru": 22, 2024-09-12T22:32:29.790 INFO:teuthology.orchestra.run.smithi019.stdout: "down_at": 0, 2024-09-12T22:32:29.790 INFO:teuthology.orchestra.run.smithi019.stdout: "lost_at": 0, 2024-09-12T22:32:29.790 INFO:teuthology.orchestra.run.smithi019.stdout: "public_addrs": { 2024-09-12T22:32:29.791 INFO:teuthology.orchestra.run.smithi019.stdout: "addrvec": [ 2024-09-12T22:32:29.791 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:32:29.791 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v2", 2024-09-12T22:32:29.791 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.163:6800", 2024-09-12T22:32:29.791 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 533442754 2024-09-12T22:32:29.791 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:32:29.791 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:32:29.791 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2024-09-12T22:32:29.791 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.163:6801", 2024-09-12T22:32:29.792 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 533442754 2024-09-12T22:32:29.792 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T22:32:29.792 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T22:32:29.792 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:32:29.792 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster_addrs": { 2024-09-12T22:32:29.792 INFO:teuthology.orchestra.run.smithi019.stdout: "addrvec": [ 2024-09-12T22:32:29.792 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:32:29.792 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v2", 2024-09-12T22:32:29.792 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.163:6802", 2024-09-12T22:32:29.792 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 533442754 2024-09-12T22:32:29.792 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:32:29.793 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:32:29.793 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2024-09-12T22:32:29.793 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.163:6803", 2024-09-12T22:32:29.793 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 533442754 2024-09-12T22:32:29.793 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T22:32:29.793 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T22:32:29.793 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:32:29.794 INFO:teuthology.orchestra.run.smithi019.stdout: "heartbeat_back_addrs": { 2024-09-12T22:32:29.794 INFO:teuthology.orchestra.run.smithi019.stdout: "addrvec": [ 2024-09-12T22:32:29.794 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:32:29.794 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v2", 2024-09-12T22:32:29.794 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.163:6806", 2024-09-12T22:32:29.794 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 533442754 2024-09-12T22:32:29.794 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:32:29.794 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:32:29.795 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2024-09-12T22:32:29.795 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.163:6807", 2024-09-12T22:32:29.795 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 533442754 2024-09-12T22:32:29.795 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T22:32:29.795 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T22:32:29.795 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:32:29.795 INFO:teuthology.orchestra.run.smithi019.stdout: "heartbeat_front_addrs": { 2024-09-12T22:32:29.795 INFO:teuthology.orchestra.run.smithi019.stdout: "addrvec": [ 2024-09-12T22:32:29.795 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:32:29.795 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v2", 2024-09-12T22:32:29.796 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.163:6804", 2024-09-12T22:32:29.796 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 533442754 2024-09-12T22:32:29.796 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:32:29.796 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:32:29.796 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2024-09-12T22:32:29.796 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.163:6805", 2024-09-12T22:32:29.796 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 533442754 2024-09-12T22:32:29.796 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T22:32:29.796 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T22:32:29.796 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:32:29.796 INFO:teuthology.orchestra.run.smithi019.stdout: "public_addr": "172.21.15.163:6801/533442754", 2024-09-12T22:32:29.797 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster_addr": "172.21.15.163:6803/533442754", 2024-09-12T22:32:29.797 INFO:teuthology.orchestra.run.smithi019.stdout: "heartbeat_back_addr": "172.21.15.163:6807/533442754", 2024-09-12T22:32:29.797 INFO:teuthology.orchestra.run.smithi019.stdout: "heartbeat_front_addr": "172.21.15.163:6805/533442754", 2024-09-12T22:32:29.797 INFO:teuthology.orchestra.run.smithi019.stdout: "state": [ 2024-09-12T22:32:29.797 INFO:teuthology.orchestra.run.smithi019.stdout: "exists", 2024-09-12T22:32:29.797 INFO:teuthology.orchestra.run.smithi019.stdout: "up" 2024-09-12T22:32:29.797 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T22:32:29.797 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T22:32:29.797 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-12T22:32:29.797 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_xinfo": [ 2024-09-12T22:32:29.797 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:32:29.797 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": 0, 2024-09-12T22:32:29.797 INFO:teuthology.orchestra.run.smithi019.stdout: "down_stamp": "0.000000", 2024-09-12T22:32:29.798 INFO:teuthology.orchestra.run.smithi019.stdout: "laggy_probability": 0, 2024-09-12T22:32:29.798 INFO:teuthology.orchestra.run.smithi019.stdout: "laggy_interval": 0, 2024-09-12T22:32:29.798 INFO:teuthology.orchestra.run.smithi019.stdout: "features": 4540701547738038271, 2024-09-12T22:32:29.798 INFO:teuthology.orchestra.run.smithi019.stdout: "old_weight": 0, 2024-09-12T22:32:29.798 INFO:teuthology.orchestra.run.smithi019.stdout: "last_purged_snaps_scrub": "2024-09-12T22:31:23.899591+0000", 2024-09-12T22:32:29.798 INFO:teuthology.orchestra.run.smithi019.stdout: "dead_epoch": 0 2024-09-12T22:32:29.798 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:32:29.798 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:32:29.798 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": 1, 2024-09-12T22:32:29.798 INFO:teuthology.orchestra.run.smithi019.stdout: "down_stamp": "0.000000", 2024-09-12T22:32:29.798 INFO:teuthology.orchestra.run.smithi019.stdout: "laggy_probability": 0, 2024-09-12T22:32:29.798 INFO:teuthology.orchestra.run.smithi019.stdout: "laggy_interval": 0, 2024-09-12T22:32:29.798 INFO:teuthology.orchestra.run.smithi019.stdout: "features": 4540701547738038271, 2024-09-12T22:32:29.798 INFO:teuthology.orchestra.run.smithi019.stdout: "old_weight": 0, 2024-09-12T22:32:29.799 INFO:teuthology.orchestra.run.smithi019.stdout: "last_purged_snaps_scrub": "2024-09-12T22:31:22.988274+0000", 2024-09-12T22:32:29.799 INFO:teuthology.orchestra.run.smithi019.stdout: "dead_epoch": 0 2024-09-12T22:32:29.799 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:32:29.799 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:32:29.799 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": 2, 2024-09-12T22:32:29.799 INFO:teuthology.orchestra.run.smithi019.stdout: "down_stamp": "0.000000", 2024-09-12T22:32:29.799 INFO:teuthology.orchestra.run.smithi019.stdout: "laggy_probability": 0, 2024-09-12T22:32:29.799 INFO:teuthology.orchestra.run.smithi019.stdout: "laggy_interval": 0, 2024-09-12T22:32:29.799 INFO:teuthology.orchestra.run.smithi019.stdout: "features": 4540701547738038271, 2024-09-12T22:32:29.799 INFO:teuthology.orchestra.run.smithi019.stdout: "old_weight": 0, 2024-09-12T22:32:29.799 INFO:teuthology.orchestra.run.smithi019.stdout: "last_purged_snaps_scrub": "2024-09-12T22:31:23.932109+0000", 2024-09-12T22:32:29.799 INFO:teuthology.orchestra.run.smithi019.stdout: "dead_epoch": 0 2024-09-12T22:32:29.799 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T22:32:29.800 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-12T22:32:29.800 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_upmap": [ 2024-09-12T22:32:29.800 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T22:32:29.800 INFO:teuthology.orchestra.run.smithi019.stdout: "pgid": "3.5", 2024-09-12T22:32:29.800 INFO:teuthology.orchestra.run.smithi019.stdout: "osds": [ 2024-09-12T22:32:29.800 INFO:teuthology.orchestra.run.smithi019.stdout: 0, 2024-09-12T22:32:29.800 INFO:teuthology.orchestra.run.smithi019.stdout: 1 2024-09-12T22:32:29.801 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-12T22:32:29.801 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T22:32:29.801 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-12T22:32:29.801 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_upmap_items": [], 2024-09-12T22:32:29.801 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_upmap_primaries": [], 2024-09-12T22:32:29.801 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_temp": [], 2024-09-12T22:32:29.801 INFO:teuthology.orchestra.run.smithi019.stdout: "primary_temp": [], 2024-09-12T22:32:29.801 INFO:teuthology.orchestra.run.smithi019.stdout: "blocklist": {}, 2024-09-12T22:32:29.801 INFO:teuthology.orchestra.run.smithi019.stdout: "range_blocklist": {}, 2024-09-12T22:32:29.801 INFO:teuthology.orchestra.run.smithi019.stdout: "erasure_code_profiles": { 2024-09-12T22:32:29.802 INFO:teuthology.orchestra.run.smithi019.stdout: "default": { 2024-09-12T22:32:29.802 INFO:teuthology.orchestra.run.smithi019.stdout: "crush-failure-domain": "osd", 2024-09-12T22:32:29.802 INFO:teuthology.orchestra.run.smithi019.stdout: "k": "2", 2024-09-12T22:32:29.802 INFO:teuthology.orchestra.run.smithi019.stdout: "m": "1", 2024-09-12T22:32:29.802 INFO:teuthology.orchestra.run.smithi019.stdout: "plugin": "jerasure", 2024-09-12T22:32:29.802 INFO:teuthology.orchestra.run.smithi019.stdout: "technique": "reed_sol_van" 2024-09-12T22:32:29.802 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T22:32:29.802 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T22:32:29.802 INFO:teuthology.orchestra.run.smithi019.stdout: "removed_snaps_queue": [], 2024-09-12T22:32:29.802 INFO:teuthology.orchestra.run.smithi019.stdout: "new_removed_snaps": [], 2024-09-12T22:32:29.802 INFO:teuthology.orchestra.run.smithi019.stdout: "new_purged_snaps": [], 2024-09-12T22:32:29.802 INFO:teuthology.orchestra.run.smithi019.stdout: "crush_node_flags": {}, 2024-09-12T22:32:29.802 INFO:teuthology.orchestra.run.smithi019.stdout: "device_class_flags": {}, 2024-09-12T22:32:29.803 INFO:teuthology.orchestra.run.smithi019.stdout: "stretch_mode": { 2024-09-12T22:32:29.803 INFO:teuthology.orchestra.run.smithi019.stdout: "stretch_mode_enabled": false, 2024-09-12T22:32:29.803 INFO:teuthology.orchestra.run.smithi019.stdout: "stretch_bucket_count": 0, 2024-09-12T22:32:29.803 INFO:teuthology.orchestra.run.smithi019.stdout: "degraded_stretch_mode": 0, 2024-09-12T22:32:29.803 INFO:teuthology.orchestra.run.smithi019.stdout: "recovering_stretch_mode": 0, 2024-09-12T22:32:29.803 INFO:teuthology.orchestra.run.smithi019.stdout: "stretch_mode_bucket": 0 2024-09-12T22:32:29.803 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T22:32:29.803 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T22:32:29.805 INFO:tasks.thrashosds.thrasher:j is {'epoch': 38, 'fsid': '957ce235-19cb-4350-8fee-febd6e3f2199', 'created': '2024-09-12T22:31:15.903133+0000', 'modified': '2024-09-12T22:32:29.321182+0000', 'last_up_change': '2024-09-12T22:31:25.209056+0000', 'last_in_change': '2024-09-12T22:31:16.757598+0000', 'flags': 'sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5799936, 'flags_set': ['pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 5, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 4, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-12T22:31:26.228956+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.8450978994369507, 'average_primary_affinity': 0.8500000238418579, 'average_primary_affinity_weighted': 0.8500000238418579}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-12T22:31:30.975989+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 16, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.8450978994369507, 'average_primary_affinity': 0.8500000238418579, 'average_primary_affinity_weighted': 0.8500000238418579}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-12T22:31:35.267679+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.2200000286102295, 'score_stable': 1.2200000286102295, 'optimal_score': 1, 'raw_score_acting': 1.2200000286102295, 'raw_score_stable': 1.2200000286102295, 'primary_affinity_weighted': 0.8450978994369507, 'average_primary_affinity': 0.8500000238418579, 'average_primary_affinity_weighted': 0.8500000238418579}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-09-12T22:31:35.724475+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1699999570846558, 'score_stable': 1.1699999570846558, 'optimal_score': 1, 'raw_score_acting': 1.1699999570846558, 'raw_score_stable': 1.1699999570846558, 'primary_affinity_weighted': 0.8450978994369507, 'average_primary_affinity': 0.8500000238418579, 'average_primary_affinity_weighted': 0.8500000238418579}}], 'osds': [{'osd': 0, 'uuid': '73b96314-15d5-4058-9993-ac103e997b27', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.5352935791015625, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 9, 'up_thru': 35, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.76:6800', 'nonce': 1343093884}, {'type': 'v1', 'addr': '172.21.15.76:6801', 'nonce': 1343093884}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.76:6802', 'nonce': 1343093884}, {'type': 'v1', 'addr': '172.21.15.76:6803', 'nonce': 1343093884}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.76:6806', 'nonce': 1343093884}, {'type': 'v1', 'addr': '172.21.15.76:6807', 'nonce': 1343093884}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.76:6804', 'nonce': 1343093884}, {'type': 'v1', 'addr': '172.21.15.76:6805', 'nonce': 1343093884}]}, 'public_addr': '172.21.15.76:6801/1343093884', 'cluster_addr': '172.21.15.76:6803/1343093884', 'heartbeat_back_addr': '172.21.15.76:6807/1343093884', 'heartbeat_front_addr': '172.21.15.76:6805/1343093884', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': 'f82ad621-e9cf-41cb-b9c0-43470cf7ddb1', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 22, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.148:6800', 'nonce': 616952176}, {'type': 'v1', 'addr': '172.21.15.148:6801', 'nonce': 616952176}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.148:6802', 'nonce': 616952176}, {'type': 'v1', 'addr': '172.21.15.148:6803', 'nonce': 616952176}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.148:6806', 'nonce': 616952176}, {'type': 'v1', 'addr': '172.21.15.148:6807', 'nonce': 616952176}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.148:6804', 'nonce': 616952176}, {'type': 'v1', 'addr': '172.21.15.148:6805', 'nonce': 616952176}]}, 'public_addr': '172.21.15.148:6801/616952176', 'cluster_addr': '172.21.15.148:6803/616952176', 'heartbeat_back_addr': '172.21.15.148:6807/616952176', 'heartbeat_front_addr': '172.21.15.148:6805/616952176', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': 'f30dda36-a84c-4a01-a81a-afbfb88c0aed', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 9, 'up_thru': 22, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.163:6800', 'nonce': 533442754}, {'type': 'v1', 'addr': '172.21.15.163:6801', 'nonce': 533442754}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.163:6802', 'nonce': 533442754}, {'type': 'v1', 'addr': '172.21.15.163:6803', 'nonce': 533442754}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.163:6806', 'nonce': 533442754}, {'type': 'v1', 'addr': '172.21.15.163:6807', 'nonce': 533442754}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.163:6804', 'nonce': 533442754}, {'type': 'v1', 'addr': '172.21.15.163:6805', 'nonce': 533442754}]}, 'public_addr': '172.21.15.163:6801/533442754', 'cluster_addr': '172.21.15.163:6803/533442754', 'heartbeat_back_addr': '172.21.15.163:6807/533442754', 'heartbeat_front_addr': '172.21.15.163:6805/533442754', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T22:31:23.899591+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T22:31:22.988274+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T22:31:23.932109+0000', 'dead_epoch': 0}], 'pg_upmap': [{'pgid': '3.5', 'osds': [0, 1]}], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-12T22:32:29.805 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T22:32:29.808 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:29.807+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:29.823 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-09-12T22:32:29.823 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-09-12T22:32:29.823 INFO:teuthology.orchestra.run.smithi163.stdout: "num_ops": 0 2024-09-12T22:32:29.823 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-09-12T22:32:29.837 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:32:29.909 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:32:29.908+0000 7fddec6a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30331) UID: 0 2024-09-12T22:32:29.941 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-09-12T22:32:29.941 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-09-12T22:32:29.941 INFO:teuthology.orchestra.run.smithi163.stdout: "complaint_time": 30, 2024-09-12T22:32:29.941 INFO:teuthology.orchestra.run.smithi163.stdout: "num_blocked_ops": 0 2024-09-12T22:32:29.942 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-09-12T22:32:29.950 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:32:30.010 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:30.009+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:30.056 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-09-12T22:32:30.057 INFO:teuthology.orchestra.run.smithi163.stdout: "size": 20, 2024-09-12T22:32:30.057 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 600, 2024-09-12T22:32:30.057 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2024-09-12T22:32:30.057 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.057 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-09-12T22:32:30.057 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:27.254459+0000", 2024-09-12T22:32:30.057 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 62.799754681000003, 2024-09-12T22:32:30.057 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.37816283899999997, 2024-09-12T22:32:30.057 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:30.057 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:30.057 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:30.057 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:30.057 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:30.058 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:30.058 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 1 2024-09-12T22:32:30.058 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.058 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:30.058 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.058 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:30.058 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254459+0000", 2024-09-12T22:32:30.058 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:30.058 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.058 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.058 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:30.058 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254459+0000", 2024-09-12T22:32:30.058 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:30.058 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.059 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.059 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:30.059 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254460+0000", 2024-09-12T22:32:30.059 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1739999999999999e-06 2024-09-12T22:32:30.059 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.059 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.059 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:30.059 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254472+0000", 2024-09-12T22:32:30.059 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2207e-05 2024-09-12T22:32:30.059 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.059 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.059 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:30.059 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254483+0000", 2024-09-12T22:32:30.060 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0631999999999999e-05 2024-09-12T22:32:30.060 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.060 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.060 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:30.060 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254492+0000", 2024-09-12T22:32:30.060 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3670000000000003e-06 2024-09-12T22:32:30.060 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.060 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.060 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:30.060 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254551+0000", 2024-09-12T22:32:30.060 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8687999999999998e-05 2024-09-12T22:32:30.060 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.060 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.061 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for peered", 2024-09-12T22:32:30.061 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254562+0000", 2024-09-12T22:32:30.061 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1249e-05 2024-09-12T22:32:30.061 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.061 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.061 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:30.061 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.631211+0000", 2024-09-12T22:32:30.061 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.376649018 2024-09-12T22:32:30.061 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.061 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.061 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:30.061 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.631345+0000", 2024-09-12T22:32:30.061 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013378700000000001 2024-09-12T22:32:30.062 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.062 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.062 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:30.062 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.631479+0000", 2024-09-12T22:32:30.062 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013352399999999999 2024-09-12T22:32:30.062 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.062 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.062 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:30.062 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632324+0000", 2024-09-12T22:32:30.062 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00084508100000000002 2024-09-12T22:32:30.062 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.062 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.062 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:30.062 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632548+0000", 2024-09-12T22:32:30.063 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000224329 2024-09-12T22:32:30.063 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.063 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.063 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:30.063 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632591+0000", 2024-09-12T22:32:30.063 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2564000000000001e-05 2024-09-12T22:32:30.063 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.063 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.063 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:30.063 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632622+0000", 2024-09-12T22:32:30.063 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1219e-05 2024-09-12T22:32:30.063 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:30.063 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:30.063 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:30.064 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.064 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.064 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:185 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:32:30.064 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394355+0000", 2024-09-12T22:32:30.064 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 61.659858583999998, 2024-09-12T22:32:30.064 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011302394, 2024-09-12T22:32:30.064 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:30.064 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:30.064 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:30.064 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:30.064 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:30.064 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:30.064 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 185 2024-09-12T22:32:30.065 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.065 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:30.065 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.065 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:30.065 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394355+0000", 2024-09-12T22:32:30.065 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:30.065 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.065 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.065 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:30.065 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394355+0000", 2024-09-12T22:32:30.065 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:30.065 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.065 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.065 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:30.066 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394355+0000", 2024-09-12T22:32:30.066 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9099999999999999e-07 2024-09-12T22:32:30.066 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.066 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.066 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:30.066 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394385+0000", 2024-09-12T22:32:30.066 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9963000000000001e-05 2024-09-12T22:32:30.066 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.066 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.066 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:30.066 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394390+0000", 2024-09-12T22:32:30.066 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8420000000000004e-06 2024-09-12T22:32:30.066 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.067 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.067 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:30.067 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394393+0000", 2024-09-12T22:32:30.067 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1e-06 2024-09-12T22:32:30.067 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.067 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.067 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:30.067 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.400546+0000", 2024-09-12T22:32:30.067 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0061523309999999996 2024-09-12T22:32:30.067 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.067 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.067 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:30.067 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.400588+0000", 2024-09-12T22:32:30.067 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1835000000000002e-05 2024-09-12T22:32:30.068 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.068 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.068 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:30.068 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.400677+0000", 2024-09-12T22:32:30.068 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9195000000000002e-05 2024-09-12T22:32:30.068 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.068 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.068 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:30.068 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405378+0000", 2024-09-12T22:32:30.068 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0047008659999999997 2024-09-12T22:32:30.068 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.068 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.068 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:30.068 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405569+0000", 2024-09-12T22:32:30.069 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00019148599999999999 2024-09-12T22:32:30.069 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.069 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.069 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:30.069 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405620+0000", 2024-09-12T22:32:30.069 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1416999999999999e-05 2024-09-12T22:32:30.069 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.069 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.069 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:30.069 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405657+0000", 2024-09-12T22:32:30.069 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6968000000000002e-05 2024-09-12T22:32:30.069 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:30.069 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:30.069 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:30.070 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.070 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.070 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:32:30.070 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394399+0000", 2024-09-12T22:32:30.070 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 61.659814373000003, 2024-09-12T22:32:30.070 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011336601999999999, 2024-09-12T22:32:30.070 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:30.070 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:30.070 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:30.070 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:30.070 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:30.070 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:30.071 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 186 2024-09-12T22:32:30.071 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.071 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:30.071 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.071 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:30.071 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394399+0000", 2024-09-12T22:32:30.071 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:30.071 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.071 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.071 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:30.071 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394399+0000", 2024-09-12T22:32:30.071 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:30.071 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.072 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.072 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:30.072 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394400+0000", 2024-09-12T22:32:30.072 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4499999999999998e-07 2024-09-12T22:32:30.072 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.072 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.072 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:30.072 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394402+0000", 2024-09-12T22:32:30.072 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.875e-06 2024-09-12T22:32:30.072 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.072 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.072 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:30.072 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394405+0000", 2024-09-12T22:32:30.072 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6799999999999999e-06 2024-09-12T22:32:30.073 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.073 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.073 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:30.073 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394408+0000", 2024-09-12T22:32:30.073 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.667e-06 2024-09-12T22:32:30.073 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.073 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.073 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:30.073 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401395+0000", 2024-09-12T22:32:30.073 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0069867230000000002 2024-09-12T22:32:30.073 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.073 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.073 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:30.073 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401438+0000", 2024-09-12T22:32:30.074 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3554999999999999e-05 2024-09-12T22:32:30.074 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.074 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.074 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:30.074 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401509+0000", 2024-09-12T22:32:30.074 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0631999999999997e-05 2024-09-12T22:32:30.074 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.074 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.074 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:30.074 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405392+0000", 2024-09-12T22:32:30.074 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0038830449999999999 2024-09-12T22:32:30.074 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.074 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.075 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:30.075 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405690+0000", 2024-09-12T22:32:30.075 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000298435 2024-09-12T22:32:30.075 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.075 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.075 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:30.075 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405716+0000", 2024-09-12T22:32:30.075 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5435999999999998e-05 2024-09-12T22:32:30.075 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.075 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.075 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:30.075 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405736+0000", 2024-09-12T22:32:30.075 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0208999999999999e-05 2024-09-12T22:32:30.075 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:30.076 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:30.076 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:30.076 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.076 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.076 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:32:30.076 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394411+0000", 2024-09-12T22:32:30.076 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 61.659802247000002, 2024-09-12T22:32:30.076 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011400117, 2024-09-12T22:32:30.076 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:30.076 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:30.076 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:30.076 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:30.076 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:30.077 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:30.077 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 187 2024-09-12T22:32:30.077 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.077 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:30.077 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.077 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:30.077 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394411+0000", 2024-09-12T22:32:30.077 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:30.077 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.077 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.077 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:30.077 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394411+0000", 2024-09-12T22:32:30.077 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:30.077 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.078 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.078 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:30.078 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394412+0000", 2024-09-12T22:32:30.078 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.4999999999999999e-07 2024-09-12T22:32:30.078 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.078 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.078 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:30.078 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394414+0000", 2024-09-12T22:32:30.078 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.984e-06 2024-09-12T22:32:30.078 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.078 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.078 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:30.078 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394418+0000", 2024-09-12T22:32:30.079 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0840000000000002e-06 2024-09-12T22:32:30.079 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.079 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.079 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:30.079 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394431+0000", 2024-09-12T22:32:30.079 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.361e-05 2024-09-12T22:32:30.079 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.079 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.079 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:30.079 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401778+0000", 2024-09-12T22:32:30.079 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0073462659999999997 2024-09-12T22:32:30.079 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.079 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.079 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:30.080 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401853+0000", 2024-09-12T22:32:30.080 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5797000000000006e-05 2024-09-12T22:32:30.080 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.080 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.080 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:30.080 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401990+0000", 2024-09-12T22:32:30.080 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013651399999999999 2024-09-12T22:32:30.080 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.080 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.080 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:30.080 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405402+0000", 2024-09-12T22:32:30.080 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0034116070000000001 2024-09-12T22:32:30.080 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.081 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.081 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:30.081 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405764+0000", 2024-09-12T22:32:30.081 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00036234899999999998 2024-09-12T22:32:30.081 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.081 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.081 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:30.081 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405791+0000", 2024-09-12T22:32:30.081 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7029000000000002e-05 2024-09-12T22:32:30.081 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.081 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.081 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:30.081 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405812+0000", 2024-09-12T22:32:30.081 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0627000000000001e-05 2024-09-12T22:32:30.082 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:30.082 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:30.082 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:30.082 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.082 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.082 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:32:30.082 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394447+0000", 2024-09-12T22:32:30.082 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 61.659767096000003, 2024-09-12T22:32:30.082 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011759588, 2024-09-12T22:32:30.082 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:30.082 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:30.082 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:30.082 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:30.083 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:30.083 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:30.083 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 188 2024-09-12T22:32:30.083 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.083 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:30.083 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.083 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:30.083 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394447+0000", 2024-09-12T22:32:30.083 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:30.083 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.083 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.083 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:30.083 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394447+0000", 2024-09-12T22:32:30.083 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:30.084 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.084 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.084 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:30.084 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394447+0000", 2024-09-12T22:32:30.084 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.15e-07 2024-09-12T22:32:30.084 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.084 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.084 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:30.084 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394512+0000", 2024-09-12T22:32:30.084 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4580999999999997e-05 2024-09-12T22:32:30.084 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.084 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.084 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:30.085 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394518+0000", 2024-09-12T22:32:30.085 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.3380000000000001e-06 2024-09-12T22:32:30.085 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.085 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.085 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:30.085 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394521+0000", 2024-09-12T22:32:30.085 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3340000000000002e-06 2024-09-12T22:32:30.085 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.085 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.085 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:30.085 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.402628+0000", 2024-09-12T22:32:30.085 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.008106996 2024-09-12T22:32:30.085 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.085 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.086 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:30.086 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.402670+0000", 2024-09-12T22:32:30.086 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1983000000000001e-05 2024-09-12T22:32:30.086 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.086 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.086 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:30.086 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.402738+0000", 2024-09-12T22:32:30.086 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.8114999999999994e-05 2024-09-12T22:32:30.086 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.086 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.086 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:30.086 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405668+0000", 2024-09-12T22:32:30.086 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.002929545 2024-09-12T22:32:30.086 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.087 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.087 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:30.087 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406162+0000", 2024-09-12T22:32:30.087 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000494408 2024-09-12T22:32:30.087 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.087 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.087 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:30.087 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406188+0000", 2024-09-12T22:32:30.087 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5766e-05 2024-09-12T22:32:30.087 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.087 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.087 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:30.087 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406206+0000", 2024-09-12T22:32:30.088 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.8107000000000001e-05 2024-09-12T22:32:30.088 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:30.088 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:30.088 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:30.088 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.088 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.088 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:32:30.088 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394528+0000", 2024-09-12T22:32:30.088 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 61.659685426999999, 2024-09-12T22:32:30.088 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.01195536, 2024-09-12T22:32:30.088 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:30.088 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:30.088 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:30.088 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:30.089 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:30.089 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:30.089 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 189 2024-09-12T22:32:30.089 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.089 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:30.089 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.089 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:30.089 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394528+0000", 2024-09-12T22:32:30.089 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:30.089 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.089 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.089 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:30.089 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394528+0000", 2024-09-12T22:32:30.090 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:30.090 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.090 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.090 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:30.090 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394529+0000", 2024-09-12T22:32:30.090 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4900000000000001e-07 2024-09-12T22:32:30.090 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.090 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.090 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:30.090 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394531+0000", 2024-09-12T22:32:30.090 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.458e-06 2024-09-12T22:32:30.090 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.090 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.090 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:30.091 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394535+0000", 2024-09-12T22:32:30.091 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7900000000000001e-06 2024-09-12T22:32:30.091 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.091 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.091 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:30.091 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394537+0000", 2024-09-12T22:32:30.091 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.632e-06 2024-09-12T22:32:30.091 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.091 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.092 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:30.092 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.404932+0000", 2024-09-12T22:32:30.092 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010394158000000001 2024-09-12T22:32:30.092 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.092 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.092 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:30.092 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405017+0000", 2024-09-12T22:32:30.092 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5525000000000005e-05 2024-09-12T22:32:30.092 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.092 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.092 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:30.092 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405114+0000", 2024-09-12T22:32:30.092 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.6527000000000006e-05 2024-09-12T22:32:30.092 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.093 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.093 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:30.093 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405818+0000", 2024-09-12T22:32:30.093 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00070412800000000005 2024-09-12T22:32:30.093 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.093 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.093 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:30.093 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406437+0000", 2024-09-12T22:32:30.093 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00061898900000000002 2024-09-12T22:32:30.093 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.093 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.093 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:30.093 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406463+0000", 2024-09-12T22:32:30.094 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6268e-05 2024-09-12T22:32:30.094 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.094 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.094 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:30.094 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406484+0000", 2024-09-12T22:32:30.094 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0536000000000001e-05 2024-09-12T22:32:30.094 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:30.094 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:30.094 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:30.095 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.095 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.095 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:30.095 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.401422+0000", 2024-09-12T22:32:30.095 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 52.652791522000001, 2024-09-12T22:32:30.095 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016896452999999999, 2024-09-12T22:32:30.095 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:30.095 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:30.095 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:30.095 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:30.095 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.095 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:30.095 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401422+0000", 2024-09-12T22:32:30.096 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:30.096 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.096 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.096 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:30.096 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401422+0000", 2024-09-12T22:32:30.096 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:30.096 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.096 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.096 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:30.096 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401424+0000", 2024-09-12T22:32:30.096 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9e-06 2024-09-12T22:32:30.096 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.096 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.096 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:30.097 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401437+0000", 2024-09-12T22:32:30.097 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2831e-05 2024-09-12T22:32:30.097 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.097 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.097 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:30.097 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401471+0000", 2024-09-12T22:32:30.097 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4010000000000001e-05 2024-09-12T22:32:30.097 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.097 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.097 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:30.097 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401484+0000", 2024-09-12T22:32:30.097 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2711000000000001e-05 2024-09-12T22:32:30.097 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.097 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.098 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:30.098 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405410+0000", 2024-09-12T22:32:30.098 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0039259170000000001 2024-09-12T22:32:30.098 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.098 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.098 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:30.098 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405529+0000", 2024-09-12T22:32:30.098 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000119778 2024-09-12T22:32:30.098 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.098 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.098 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:30.098 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405655+0000", 2024-09-12T22:32:30.098 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012556700000000001 2024-09-12T22:32:30.098 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.099 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.099 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:30.099 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410456+0000", 2024-09-12T22:32:30.099 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0048008269999999997 2024-09-12T22:32:30.099 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.099 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.099 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:30.099 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418226+0000", 2024-09-12T22:32:30.099 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0077707729999999999 2024-09-12T22:32:30.099 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.099 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.099 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:30.099 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418277+0000", 2024-09-12T22:32:30.100 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0476000000000003e-05 2024-09-12T22:32:30.100 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.100 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.100 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:30.100 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418319+0000", 2024-09-12T22:32:30.100 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1662999999999997e-05 2024-09-12T22:32:30.100 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:30.100 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:30.100 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:30.100 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.100 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.100 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:30.100 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.401505+0000", 2024-09-12T22:32:30.101 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 52.652708857999997, 2024-09-12T22:32:30.101 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016987904000000002, 2024-09-12T22:32:30.101 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:30.101 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:30.101 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:30.101 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:30.101 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.101 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:30.101 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401505+0000", 2024-09-12T22:32:30.101 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:30.101 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.101 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.101 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:30.101 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401505+0000", 2024-09-12T22:32:30.102 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:30.102 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.102 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.102 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:30.102 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401506+0000", 2024-09-12T22:32:30.102 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4700000000000001e-07 2024-09-12T22:32:30.102 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.102 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.102 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:30.102 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401510+0000", 2024-09-12T22:32:30.102 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6609999999999999e-06 2024-09-12T22:32:30.102 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.102 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.102 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:30.103 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401771+0000", 2024-09-12T22:32:30.103 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00026110700000000001 2024-09-12T22:32:30.103 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.103 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.103 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:30.103 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401921+0000", 2024-09-12T22:32:30.103 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014939099999999999 2024-09-12T22:32:30.103 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.103 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.103 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:30.103 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405944+0000", 2024-09-12T22:32:30.103 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0040235449999999999 2024-09-12T22:32:30.103 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.104 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.104 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:30.104 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406018+0000", 2024-09-12T22:32:30.104 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3373000000000004e-05 2024-09-12T22:32:30.104 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.104 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.104 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:30.104 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406172+0000", 2024-09-12T22:32:30.104 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00015435399999999999 2024-09-12T22:32:30.104 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.104 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.104 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:30.104 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410461+0000", 2024-09-12T22:32:30.105 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0042888609999999997 2024-09-12T22:32:30.105 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.105 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.105 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:30.105 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418371+0000", 2024-09-12T22:32:30.105 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0079098380000000006 2024-09-12T22:32:30.105 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.105 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.105 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:30.105 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418443+0000", 2024-09-12T22:32:30.105 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2705000000000003e-05 2024-09-12T22:32:30.105 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.105 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.106 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:30.106 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418493+0000", 2024-09-12T22:32:30.106 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9322e-05 2024-09-12T22:32:30.106 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:30.106 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:30.106 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:30.106 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.106 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.106 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:30.106 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.401939+0000", 2024-09-12T22:32:30.106 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 52.652275121999999, 2024-09-12T22:32:30.106 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016722292999999999, 2024-09-12T22:32:30.106 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:30.106 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:30.107 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:30.107 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:30.107 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.107 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:30.107 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401939+0000", 2024-09-12T22:32:30.107 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:30.107 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.107 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.107 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:30.107 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401939+0000", 2024-09-12T22:32:30.107 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:30.107 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.107 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.108 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:30.108 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401940+0000", 2024-09-12T22:32:30.108 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1990000000000001e-06 2024-09-12T22:32:30.108 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.108 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.108 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:30.108 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401956+0000", 2024-09-12T22:32:30.108 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.6344000000000001e-05 2024-09-12T22:32:30.108 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.108 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.108 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:30.108 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401974+0000", 2024-09-12T22:32:30.108 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7730000000000001e-05 2024-09-12T22:32:30.109 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.109 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.109 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:30.109 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401982+0000", 2024-09-12T22:32:30.109 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.7800000000000001e-06 2024-09-12T22:32:30.109 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.109 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.109 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:30.109 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406557+0000", 2024-09-12T22:32:30.109 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0045758489999999999 2024-09-12T22:32:30.109 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.109 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.109 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:30.109 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406697+0000", 2024-09-12T22:32:30.110 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013925100000000001 2024-09-12T22:32:30.110 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.110 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.110 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:30.110 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406830+0000", 2024-09-12T22:32:30.110 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013293499999999999 2024-09-12T22:32:30.110 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.110 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.110 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:30.110 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410465+0000", 2024-09-12T22:32:30.110 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0036352680000000001 2024-09-12T22:32:30.110 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.110 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.110 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:30.111 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418564+0000", 2024-09-12T22:32:30.111 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0080992140000000004 2024-09-12T22:32:30.111 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.111 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.111 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:30.111 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418621+0000", 2024-09-12T22:32:30.111 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7167999999999999e-05 2024-09-12T22:32:30.111 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.111 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.111 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:30.111 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418661+0000", 2024-09-12T22:32:30.111 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9555000000000003e-05 2024-09-12T22:32:30.111 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:30.112 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:30.112 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:30.112 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.112 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.112 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:30.112 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.401994+0000", 2024-09-12T22:32:30.112 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 52.652219250000002, 2024-09-12T22:32:30.112 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016804109000000001, 2024-09-12T22:32:30.112 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:30.112 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:30.112 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:30.112 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:30.112 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.113 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:30.113 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401994+0000", 2024-09-12T22:32:30.113 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:30.113 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.113 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.113 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:30.113 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401994+0000", 2024-09-12T22:32:30.113 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:30.113 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.113 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.113 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:30.113 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401995+0000", 2024-09-12T22:32:30.113 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.8899999999999998e-07 2024-09-12T22:32:30.114 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.114 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.114 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:30.114 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402000+0000", 2024-09-12T22:32:30.114 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.498e-06 2024-09-12T22:32:30.114 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.114 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.114 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:30.114 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402007+0000", 2024-09-12T22:32:30.114 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.554e-06 2024-09-12T22:32:30.114 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.114 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.114 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:30.114 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402046+0000", 2024-09-12T22:32:30.115 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9156000000000003e-05 2024-09-12T22:32:30.115 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.115 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.115 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:30.115 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407342+0000", 2024-09-12T22:32:30.115 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052957610000000004 2024-09-12T22:32:30.115 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.115 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.115 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:30.115 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407521+0000", 2024-09-12T22:32:30.115 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00017878100000000001 2024-09-12T22:32:30.115 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.115 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.115 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:30.116 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407641+0000", 2024-09-12T22:32:30.116 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012013 2024-09-12T22:32:30.116 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.116 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.116 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:30.116 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410472+0000", 2024-09-12T22:32:30.116 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.002830455 2024-09-12T22:32:30.116 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.116 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.116 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:30.116 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418714+0000", 2024-09-12T22:32:30.116 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0082422789999999999 2024-09-12T22:32:30.116 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.117 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.117 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:30.117 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418761+0000", 2024-09-12T22:32:30.117 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6956999999999998e-05 2024-09-12T22:32:30.117 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.117 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.117 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:30.117 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418799+0000", 2024-09-12T22:32:30.117 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7749000000000001e-05 2024-09-12T22:32:30.117 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:30.117 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:30.117 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:30.117 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.117 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.118 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:30.118 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.402060+0000", 2024-09-12T22:32:30.118 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 52.652153806000001, 2024-09-12T22:32:30.118 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016885686, 2024-09-12T22:32:30.118 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:30.118 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:30.118 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:30.118 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:30.118 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.118 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:30.118 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402060+0000", 2024-09-12T22:32:30.118 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:30.118 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.118 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.119 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:30.119 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402060+0000", 2024-09-12T22:32:30.119 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:30.119 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.119 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.119 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:30.119 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402061+0000", 2024-09-12T22:32:30.119 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4399999999999999e-07 2024-09-12T22:32:30.119 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.119 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.119 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:30.119 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402066+0000", 2024-09-12T22:32:30.119 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8649999999999998e-06 2024-09-12T22:32:30.120 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.120 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.120 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:30.120 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402146+0000", 2024-09-12T22:32:30.120 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9054000000000006e-05 2024-09-12T22:32:30.120 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.120 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.120 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:30.120 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402287+0000", 2024-09-12T22:32:30.120 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014108600000000001 2024-09-12T22:32:30.120 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.120 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.120 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:30.121 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408185+0000", 2024-09-12T22:32:30.121 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0058983919999999997 2024-09-12T22:32:30.121 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.121 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.121 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:30.121 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408299+0000", 2024-09-12T22:32:30.121 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114102 2024-09-12T22:32:30.121 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.121 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.121 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:30.121 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408420+0000", 2024-09-12T22:32:30.121 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000120492 2024-09-12T22:32:30.121 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.121 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.122 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:30.122 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410867+0000", 2024-09-12T22:32:30.122 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0024476430000000002 2024-09-12T22:32:30.122 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.122 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.122 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:30.122 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418851+0000", 2024-09-12T22:32:30.122 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0079841489999999994 2024-09-12T22:32:30.122 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.122 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.122 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:30.122 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418894+0000", 2024-09-12T22:32:30.122 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3090000000000002e-05 2024-09-12T22:32:30.123 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.123 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.123 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:30.123 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418946+0000", 2024-09-12T22:32:30.123 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1069000000000002e-05 2024-09-12T22:32:30.123 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:30.123 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:30.123 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:30.123 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.123 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.123 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:30.123 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.402375+0000", 2024-09-12T22:32:30.123 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 52.651838740999999, 2024-09-12T22:32:30.124 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016768531999999999, 2024-09-12T22:32:30.124 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:30.124 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:30.124 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:30.124 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:30.124 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.124 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:30.124 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402375+0000", 2024-09-12T22:32:30.124 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:30.124 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.124 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.124 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:30.124 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402375+0000", 2024-09-12T22:32:30.125 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:30.125 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.125 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.125 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:30.125 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402375+0000", 2024-09-12T22:32:30.125 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4099999999999999e-07 2024-09-12T22:32:30.125 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.125 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.125 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:30.125 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402379+0000", 2024-09-12T22:32:30.125 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9870000000000001e-06 2024-09-12T22:32:30.125 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.125 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.125 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:30.126 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402389+0000", 2024-09-12T22:32:30.126 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0000000000000001e-05 2024-09-12T22:32:30.126 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.126 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.126 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:30.126 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402401+0000", 2024-09-12T22:32:30.126 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.148e-05 2024-09-12T22:32:30.126 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.126 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.126 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:30.126 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409108+0000", 2024-09-12T22:32:30.126 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0067068429999999997 2024-09-12T22:32:30.126 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.126 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.127 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:30.127 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409189+0000", 2024-09-12T22:32:30.127 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0815999999999993e-05 2024-09-12T22:32:30.127 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.127 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.127 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:30.127 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409320+0000", 2024-09-12T22:32:30.127 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000131586 2024-09-12T22:32:30.127 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.127 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.127 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:30.127 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410872+0000", 2024-09-12T22:32:30.127 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0015521599999999999 2024-09-12T22:32:30.128 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.128 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.128 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:30.128 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419049+0000", 2024-09-12T22:32:30.128 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0081763719999999995 2024-09-12T22:32:30.128 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.128 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.128 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:30.128 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419107+0000", 2024-09-12T22:32:30.128 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7899000000000002e-05 2024-09-12T22:32:30.128 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.128 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.128 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:30.129 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419143+0000", 2024-09-12T22:32:30.129 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6847999999999997e-05 2024-09-12T22:32:30.129 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:30.129 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:30.129 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:30.129 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.129 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.129 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:30.129 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.402903+0000", 2024-09-12T22:32:30.129 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 52.651310328999998, 2024-09-12T22:32:30.129 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016378428, 2024-09-12T22:32:30.129 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:30.129 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:30.130 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:30.130 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:30.130 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.130 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:30.130 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402903+0000", 2024-09-12T22:32:30.130 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:30.130 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.130 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.130 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:30.130 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402903+0000", 2024-09-12T22:32:30.130 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:30.130 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.130 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.130 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:30.131 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402904+0000", 2024-09-12T22:32:30.131 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9500000000000001e-07 2024-09-12T22:32:30.131 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.131 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.131 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:30.131 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402944+0000", 2024-09-12T22:32:30.131 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0265000000000002e-05 2024-09-12T22:32:30.131 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.131 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.131 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:30.131 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402979+0000", 2024-09-12T22:32:30.131 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4378000000000002e-05 2024-09-12T22:32:30.131 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.132 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.132 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:30.132 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402987+0000", 2024-09-12T22:32:30.132 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3559999999999993e-06 2024-09-12T22:32:30.132 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.132 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.132 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:30.132 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409577+0000", 2024-09-12T22:32:30.132 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0065901709999999997 2024-09-12T22:32:30.133 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.133 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.133 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:30.133 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409653+0000", 2024-09-12T22:32:30.133 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5819e-05 2024-09-12T22:32:30.133 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.133 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.133 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:30.133 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409725+0000", 2024-09-12T22:32:30.133 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2200000000000007e-05 2024-09-12T22:32:30.133 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.133 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.133 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:30.133 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.411234+0000", 2024-09-12T22:32:30.134 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001508225 2024-09-12T22:32:30.134 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.134 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.134 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:30.134 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419212+0000", 2024-09-12T22:32:30.134 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0079783400000000004 2024-09-12T22:32:30.134 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.134 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.134 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:30.134 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419244+0000", 2024-09-12T22:32:30.134 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2384e-05 2024-09-12T22:32:30.134 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.134 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.135 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:30.135 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419282+0000", 2024-09-12T22:32:30.135 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7394999999999997e-05 2024-09-12T22:32:30.135 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:30.135 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:30.135 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:30.135 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.135 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.135 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:30.135 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.403135+0000", 2024-09-12T22:32:30.135 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 52.651078458999997, 2024-09-12T22:32:30.135 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016294211999999999, 2024-09-12T22:32:30.135 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:30.135 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:30.136 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:30.136 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:30.136 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.136 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:30.136 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403135+0000", 2024-09-12T22:32:30.136 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:30.136 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.136 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.136 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:30.136 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403135+0000", 2024-09-12T22:32:30.136 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:30.136 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.136 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.137 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:30.137 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403136+0000", 2024-09-12T22:32:30.137 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.4e-07 2024-09-12T22:32:30.137 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.137 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.137 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:30.137 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403149+0000", 2024-09-12T22:32:30.137 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2723e-05 2024-09-12T22:32:30.137 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.137 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.137 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:30.137 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403158+0000", 2024-09-12T22:32:30.137 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3919999999999992e-06 2024-09-12T22:32:30.137 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.138 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.138 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:30.138 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403166+0000", 2024-09-12T22:32:30.138 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.2309999999999996e-06 2024-09-12T22:32:30.138 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.138 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.138 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:30.138 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409944+0000", 2024-09-12T22:32:30.138 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0067775309999999998 2024-09-12T22:32:30.138 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.138 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.138 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:30.139 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410032+0000", 2024-09-12T22:32:30.139 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.7906999999999997e-05 2024-09-12T22:32:30.139 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.139 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.139 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:30.139 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410152+0000", 2024-09-12T22:32:30.139 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012037800000000001 2024-09-12T22:32:30.139 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.139 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.139 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:30.139 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.411945+0000", 2024-09-12T22:32:30.139 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0017931850000000001 2024-09-12T22:32:30.139 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.139 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.140 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:30.140 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419319+0000", 2024-09-12T22:32:30.140 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0073731780000000002 2024-09-12T22:32:30.140 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.140 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.140 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:30.140 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419376+0000", 2024-09-12T22:32:30.140 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7728e-05 2024-09-12T22:32:30.140 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.140 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.140 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:30.140 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419429+0000", 2024-09-12T22:32:30.140 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3019000000000002e-05 2024-09-12T22:32:30.141 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:30.141 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:30.141 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:30.141 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.141 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.141 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:30.141 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.403185+0000", 2024-09-12T22:32:30.141 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 52.651028578000002, 2024-09-12T22:32:30.141 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.014902164000000001, 2024-09-12T22:32:30.141 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:30.141 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:30.141 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:30.141 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:30.141 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.142 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:30.142 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403185+0000", 2024-09-12T22:32:30.142 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:30.142 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.142 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.142 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:30.142 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403185+0000", 2024-09-12T22:32:30.142 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:30.142 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.142 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.142 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:30.142 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403186+0000", 2024-09-12T22:32:30.142 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9400000000000005e-07 2024-09-12T22:32:30.143 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.143 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.143 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:30.143 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403191+0000", 2024-09-12T22:32:30.143 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6980000000000003e-06 2024-09-12T22:32:30.143 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.143 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.143 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:30.143 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403199+0000", 2024-09-12T22:32:30.143 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2520000000000002e-06 2024-09-12T22:32:30.143 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.143 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.143 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:30.143 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403205+0000", 2024-09-12T22:32:30.144 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.908e-06 2024-09-12T22:32:30.144 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.144 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.144 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:30.144 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403359+0000", 2024-09-12T22:32:30.144 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000154544 2024-09-12T22:32:30.144 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.144 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.144 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:30.144 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403528+0000", 2024-09-12T22:32:30.144 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000168455 2024-09-12T22:32:30.144 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.144 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.144 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:30.145 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403763+0000", 2024-09-12T22:32:30.145 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00023539599999999999 2024-09-12T22:32:30.145 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.145 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.145 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:30.145 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409378+0000", 2024-09-12T22:32:30.145 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056150000000000002 2024-09-12T22:32:30.145 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.145 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.145 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:30.145 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418012+0000", 2024-09-12T22:32:30.145 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0086339559999999999 2024-09-12T22:32:30.145 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.145 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.146 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:30.146 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418046+0000", 2024-09-12T22:32:30.146 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4267999999999998e-05 2024-09-12T22:32:30.146 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.146 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.146 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:30.146 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418087+0000", 2024-09-12T22:32:30.146 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0992999999999999e-05 2024-09-12T22:32:30.146 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:30.146 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:30.146 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:30.146 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.146 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.146 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:30.147 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.403273+0000", 2024-09-12T22:32:30.147 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 52.650940626999997, 2024-09-12T22:32:30.147 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.014934866, 2024-09-12T22:32:30.147 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:30.147 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:30.147 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:30.147 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:30.147 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.147 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:30.147 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403273+0000", 2024-09-12T22:32:30.147 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:30.147 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.147 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.148 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:30.148 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403273+0000", 2024-09-12T22:32:30.148 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:30.148 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.148 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.148 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:30.148 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403274+0000", 2024-09-12T22:32:30.148 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.297e-06 2024-09-12T22:32:30.148 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.148 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.148 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:30.148 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403282+0000", 2024-09-12T22:32:30.148 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6340000000000001e-06 2024-09-12T22:32:30.149 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.149 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.149 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:30.149 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403305+0000", 2024-09-12T22:32:30.149 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3149000000000001e-05 2024-09-12T22:32:30.149 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.149 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.149 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:30.149 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403320+0000", 2024-09-12T22:32:30.149 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4527e-05 2024-09-12T22:32:30.149 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.149 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.149 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:30.149 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.404928+0000", 2024-09-12T22:32:30.150 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001608459 2024-09-12T22:32:30.150 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.150 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.150 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:30.150 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405218+0000", 2024-09-12T22:32:30.150 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00028982900000000002 2024-09-12T22:32:30.150 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.150 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.150 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:30.150 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405829+0000", 2024-09-12T22:32:30.150 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00061127900000000005 2024-09-12T22:32:30.150 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.150 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.150 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:30.151 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409403+0000", 2024-09-12T22:32:30.151 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.003573597 2024-09-12T22:32:30.151 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.151 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.151 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:30.151 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418138+0000", 2024-09-12T22:32:30.151 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0087349969999999996 2024-09-12T22:32:30.151 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.151 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.151 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:30.151 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418178+0000", 2024-09-12T22:32:30.151 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0649999999999999e-05 2024-09-12T22:32:30.151 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.151 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.152 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:30.152 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418208+0000", 2024-09-12T22:32:30.152 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9448e-05 2024-09-12T22:32:30.152 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:30.152 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:30.152 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:30.152 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.152 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.152 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:30.152 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.405456+0000", 2024-09-12T22:32:30.152 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 52.648757482000001, 2024-09-12T22:32:30.152 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012888389, 2024-09-12T22:32:30.152 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:30.153 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:30.153 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:30.153 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:30.153 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.153 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:30.153 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405456+0000", 2024-09-12T22:32:30.153 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:30.153 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.153 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.153 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:30.153 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405456+0000", 2024-09-12T22:32:30.153 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:30.153 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.153 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.154 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:30.154 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405457+0000", 2024-09-12T22:32:30.154 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.6599999999999994e-07 2024-09-12T22:32:30.154 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.154 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.154 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:30.154 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405463+0000", 2024-09-12T22:32:30.154 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4739999999999996e-06 2024-09-12T22:32:30.154 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.154 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.154 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:30.154 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405474+0000", 2024-09-12T22:32:30.154 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1095e-05 2024-09-12T22:32:30.154 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.155 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.155 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:30.155 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405482+0000", 2024-09-12T22:32:30.155 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3610000000000001e-06 2024-09-12T22:32:30.155 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.155 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.155 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:30.155 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407051+0000", 2024-09-12T22:32:30.155 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0015688970000000001 2024-09-12T22:32:30.155 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.155 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.155 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:30.155 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407259+0000", 2024-09-12T22:32:30.155 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00020778300000000001 2024-09-12T22:32:30.156 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.156 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.156 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:30.156 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407622+0000", 2024-09-12T22:32:30.156 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000363066 2024-09-12T22:32:30.156 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.156 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.156 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:30.156 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409438+0000", 2024-09-12T22:32:30.156 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001816319 2024-09-12T22:32:30.156 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.156 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.156 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:30.157 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418257+0000", 2024-09-12T22:32:30.157 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0088187720000000008 2024-09-12T22:32:30.157 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.157 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.157 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:30.157 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418308+0000", 2024-09-12T22:32:30.157 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1180000000000001e-05 2024-09-12T22:32:30.157 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.157 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.157 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:30.157 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418345+0000", 2024-09-12T22:32:30.157 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6476000000000001e-05 2024-09-12T22:32:30.157 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:30.157 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:30.158 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:30.158 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.158 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.158 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:30.158 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.405496+0000", 2024-09-12T22:32:30.158 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 52.648718125000002, 2024-09-12T22:32:30.158 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013016012, 2024-09-12T22:32:30.158 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:30.158 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:30.158 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:30.158 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:30.158 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.158 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:30.159 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405496+0000", 2024-09-12T22:32:30.159 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:30.159 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.159 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.159 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:30.159 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405496+0000", 2024-09-12T22:32:30.159 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:30.159 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.159 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.159 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:30.159 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405496+0000", 2024-09-12T22:32:30.159 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7999999999999995e-07 2024-09-12T22:32:30.159 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.159 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.160 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:30.160 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405501+0000", 2024-09-12T22:32:30.160 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8359999999999999e-06 2024-09-12T22:32:30.160 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.160 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.160 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:30.160 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405514+0000", 2024-09-12T22:32:30.160 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2522e-05 2024-09-12T22:32:30.160 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.160 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.160 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:30.160 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405521+0000", 2024-09-12T22:32:30.160 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5020000000000003e-06 2024-09-12T22:32:30.161 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.161 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.161 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:30.161 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405575+0000", 2024-09-12T22:32:30.161 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4169999999999998e-05 2024-09-12T22:32:30.161 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.161 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.161 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:30.161 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405697+0000", 2024-09-12T22:32:30.161 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000121301 2024-09-12T22:32:30.161 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.161 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.161 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:30.161 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405829+0000", 2024-09-12T22:32:30.162 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000132662 2024-09-12T22:32:30.162 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.162 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.162 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:30.162 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409155+0000", 2024-09-12T22:32:30.162 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0033259050000000001 2024-09-12T22:32:30.162 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.162 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.162 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:30.162 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418425+0000", 2024-09-12T22:32:30.162 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0092696319999999999 2024-09-12T22:32:30.162 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.162 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.162 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:30.163 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418471+0000", 2024-09-12T22:32:30.163 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6213e-05 2024-09-12T22:32:30.163 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.163 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.163 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:30.163 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418512+0000", 2024-09-12T22:32:30.163 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0589000000000001e-05 2024-09-12T22:32:30.163 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:30.163 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:30.163 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:30.163 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.163 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.163 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:30.163 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.406108+0000", 2024-09-12T22:32:30.164 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 52.648105727999997, 2024-09-12T22:32:30.164 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012458175, 2024-09-12T22:32:30.164 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:30.164 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:30.164 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:30.164 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:30.164 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.164 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:30.164 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406108+0000", 2024-09-12T22:32:30.164 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:30.164 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.164 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.164 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:30.165 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406108+0000", 2024-09-12T22:32:30.165 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:30.165 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.165 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.165 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:30.165 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406109+0000", 2024-09-12T22:32:30.165 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9899999999999999e-07 2024-09-12T22:32:30.165 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.165 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.165 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:30.165 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406115+0000", 2024-09-12T22:32:30.165 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9030000000000001e-06 2024-09-12T22:32:30.165 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.165 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.166 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:30.166 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406141+0000", 2024-09-12T22:32:30.166 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5999e-05 2024-09-12T22:32:30.166 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.166 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.166 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:30.166 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406150+0000", 2024-09-12T22:32:30.166 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.6050000000000004e-06 2024-09-12T22:32:30.166 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.166 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.166 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:30.166 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408163+0000", 2024-09-12T22:32:30.166 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0020122769999999998 2024-09-12T22:32:30.167 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.167 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.167 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:30.167 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408309+0000", 2024-09-12T22:32:30.167 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014606999999999999 2024-09-12T22:32:30.167 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.167 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.167 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:30.167 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408433+0000", 2024-09-12T22:32:30.167 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012460300000000001 2024-09-12T22:32:30.167 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.167 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.167 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:30.167 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409903+0000", 2024-09-12T22:32:30.168 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001469499 2024-09-12T22:32:30.168 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.168 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.168 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:30.168 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418427+0000", 2024-09-12T22:32:30.168 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0085241139999999993 2024-09-12T22:32:30.168 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.168 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.168 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:30.168 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418471+0000", 2024-09-12T22:32:30.168 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4474000000000001e-05 2024-09-12T22:32:30.168 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.168 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.168 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:30.169 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418566+0000", 2024-09-12T22:32:30.169 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.4732e-05 2024-09-12T22:32:30.169 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:30.169 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:30.169 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:30.169 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.169 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.169 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:30.169 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.407266+0000", 2024-09-12T22:32:30.169 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 52.646947871999998, 2024-09-12T22:32:30.169 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011442905, 2024-09-12T22:32:30.169 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:30.169 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:30.170 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2024-09-12T22:32:30.170 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:30.170 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.170 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:30.170 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407266+0000", 2024-09-12T22:32:30.170 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:30.170 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.170 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.170 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:30.170 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407266+0000", 2024-09-12T22:32:30.170 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:30.170 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.170 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.170 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:30.171 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407266+0000", 2024-09-12T22:32:30.171 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7899999999999998e-07 2024-09-12T22:32:30.171 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.171 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.171 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:30.171 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407269+0000", 2024-09-12T22:32:30.171 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9210000000000001e-06 2024-09-12T22:32:30.171 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.171 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.171 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:30.171 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407331+0000", 2024-09-12T22:32:30.171 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1376000000000003e-05 2024-09-12T22:32:30.171 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.172 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.172 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:30.172 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407337+0000", 2024-09-12T22:32:30.172 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1929999999999998e-06 2024-09-12T22:32:30.172 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.172 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.172 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:30.172 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408974+0000", 2024-09-12T22:32:30.172 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0016367109999999999 2024-09-12T22:32:30.172 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.172 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.172 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:30.172 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409112+0000", 2024-09-12T22:32:30.172 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000137952 2024-09-12T22:32:30.173 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:30.173 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:30.173 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:30.173 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418709+0000", 2024-09-12T22:32:30.173 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0095971730000000005 2024-09-12T22:32:30.173 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:30.173 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:30.173 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:30.173 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:30.173 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:30.173 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-09-12T22:32:30.175 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:30.173+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:30.177 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:32:30.178 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:32:30.180 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-12T22:32:30.181 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":68,"stamp":"2024-09-12T22:32:29.327470+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597740,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":258,"num_write_kb":3485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":205,"ondisk_log_size":205,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":95700,"kb_used_data":2120,"kb_used_omap":4,"kb_used_meta":93499,"kb_avail":283019820,"statfs":{"total":289910292480,"available":289812295680,"internally_reserved":0,"allocated":2170880,"data_stored":1578582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":95743311},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.130563"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T22:32:25.310831+0000","last_change":"2024-09-12T22:31:37.416383+0000","last_active":"2024-09-12T22:32:25.310831+0000","last_peered":"2024-09-12T22:32:25.310831+0000","last_clean":"2024-09-12T22:32:25.310831+0000","last_became_active":"2024-09-12T22:31:37.415457+0000","last_became_peered":"2024-09-12T22:31:37.415457+0000","last_unstale":"2024-09-12T22:32:25.310831+0000","last_undegraded":"2024-09-12T22:32:25.310831+0000","last_fullsized":"2024-09-12T22:32:25.310831+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:08:29.199832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T22:32:24.304247+0000","last_change":"2024-09-12T22:31:57.100705+0000","last_active":"2024-09-12T22:32:24.304247+0000","last_peered":"2024-09-12T22:32:24.304247+0000","last_clean":"2024-09-12T22:32:24.304247+0000","last_became_active":"2024-09-12T22:31:57.100396+0000","last_became_peered":"2024-09-12T22:31:57.100396+0000","last_unstale":"2024-09-12T22:32:24.304247+0000","last_undegraded":"2024-09-12T22:32:24.304247+0000","last_fullsized":"2024-09-12T22:32:24.304247+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:47:33.283161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T22:32:25.307913+0000","last_change":"2024-09-12T22:31:37.419916+0000","last_active":"2024-09-12T22:32:25.307913+0000","last_peered":"2024-09-12T22:32:25.307913+0000","last_clean":"2024-09-12T22:32:25.307913+0000","last_became_active":"2024-09-12T22:31:37.418790+0000","last_became_peered":"2024-09-12T22:31:37.418790+0000","last_unstale":"2024-09-12T22:32:25.307913+0000","last_undegraded":"2024-09-12T22:32:25.307913+0000","last_fullsized":"2024-09-12T22:32:25.307913+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:05:00.440878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T22:32:25.307674+0000","last_change":"2024-09-12T22:31:37.413094+0000","last_active":"2024-09-12T22:32:25.307674+0000","last_peered":"2024-09-12T22:32:25.307674+0000","last_clean":"2024-09-12T22:32:25.307674+0000","last_became_active":"2024-09-12T22:31:37.412746+0000","last_became_peered":"2024-09-12T22:31:37.412746+0000","last_unstale":"2024-09-12T22:32:25.307674+0000","last_undegraded":"2024-09-12T22:32:25.307674+0000","last_fullsized":"2024-09-12T22:32:25.307674+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:32:14.415120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T22:32:25.310381+0000","last_change":"2024-09-12T22:31:37.411276+0000","last_active":"2024-09-12T22:32:25.310381+0000","last_peered":"2024-09-12T22:32:25.310381+0000","last_clean":"2024-09-12T22:32:25.310381+0000","last_became_active":"2024-09-12T22:31:37.410380+0000","last_became_peered":"2024-09-12T22:31:37.410380+0000","last_unstale":"2024-09-12T22:32:25.310381+0000","last_undegraded":"2024-09-12T22:32:25.310381+0000","last_fullsized":"2024-09-12T22:32:25.310381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:12:50.090880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T22:32:25.307385+0000","last_change":"2024-09-12T22:31:37.409177+0000","last_active":"2024-09-12T22:32:25.307385+0000","last_peered":"2024-09-12T22:32:25.307385+0000","last_clean":"2024-09-12T22:32:25.307385+0000","last_became_active":"2024-09-12T22:31:37.408811+0000","last_became_peered":"2024-09-12T22:31:37.408811+0000","last_unstale":"2024-09-12T22:32:25.307385+0000","last_undegraded":"2024-09-12T22:32:25.307385+0000","last_fullsized":"2024-09-12T22:32:25.307385+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:17:21.695079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T22:32:25.307487+0000","last_change":"2024-09-12T22:31:37.413023+0000","last_active":"2024-09-12T22:32:25.307487+0000","last_peered":"2024-09-12T22:32:25.307487+0000","last_clean":"2024-09-12T22:32:25.307487+0000","last_became_active":"2024-09-12T22:31:37.412691+0000","last_became_peered":"2024-09-12T22:31:37.412691+0000","last_unstale":"2024-09-12T22:32:25.307487+0000","last_undegraded":"2024-09-12T22:32:25.307487+0000","last_fullsized":"2024-09-12T22:32:25.307487+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:02:36.454134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T22:32:25.307278+0000","last_change":"2024-09-12T22:31:37.411074+0000","last_active":"2024-09-12T22:32:25.307278+0000","last_peered":"2024-09-12T22:32:25.307278+0000","last_clean":"2024-09-12T22:32:25.307278+0000","last_became_active":"2024-09-12T22:31:37.410633+0000","last_became_peered":"2024-09-12T22:31:37.410633+0000","last_unstale":"2024-09-12T22:32:25.307278+0000","last_undegraded":"2024-09-12T22:32:25.307278+0000","last_fullsized":"2024-09-12T22:32:25.307278+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:39:20.383152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T22:32:24.303923+0000","last_change":"2024-09-12T22:31:37.417800+0000","last_active":"2024-09-12T22:32:24.303923+0000","last_peered":"2024-09-12T22:32:24.303923+0000","last_clean":"2024-09-12T22:32:24.303923+0000","last_became_active":"2024-09-12T22:31:37.417355+0000","last_became_peered":"2024-09-12T22:31:37.417355+0000","last_unstale":"2024-09-12T22:32:24.303923+0000","last_undegraded":"2024-09-12T22:32:24.303923+0000","last_fullsized":"2024-09-12T22:32:24.303923+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:10:17.326263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T22:32:25.310590+0000","last_change":"2024-09-12T22:31:37.415967+0000","last_active":"2024-09-12T22:32:25.310590+0000","last_peered":"2024-09-12T22:32:25.310590+0000","last_clean":"2024-09-12T22:32:25.310590+0000","last_became_active":"2024-09-12T22:31:37.415003+0000","last_became_peered":"2024-09-12T22:31:37.415003+0000","last_unstale":"2024-09-12T22:32:25.310590+0000","last_undegraded":"2024-09-12T22:32:25.310590+0000","last_fullsized":"2024-09-12T22:32:25.310590+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:42:32.307876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T22:32:25.308018+0000","last_change":"2024-09-12T22:31:37.414469+0000","last_active":"2024-09-12T22:32:25.308018+0000","last_peered":"2024-09-12T22:32:25.308018+0000","last_clean":"2024-09-12T22:32:25.308018+0000","last_became_active":"2024-09-12T22:31:37.414165+0000","last_became_peered":"2024-09-12T22:31:37.414165+0000","last_unstale":"2024-09-12T22:32:25.308018+0000","last_undegraded":"2024-09-12T22:32:25.308018+0000","last_fullsized":"2024-09-12T22:32:25.308018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:25:38.148636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T22:32:25.307585+0000","last_change":"2024-09-12T22:31:57.100971+0000","last_active":"2024-09-12T22:32:25.307585+0000","last_peered":"2024-09-12T22:32:25.307585+0000","last_clean":"2024-09-12T22:32:25.307585+0000","last_became_active":"2024-09-12T22:31:57.100610+0000","last_became_peered":"2024-09-12T22:31:57.100610+0000","last_unstale":"2024-09-12T22:32:25.307585+0000","last_undegraded":"2024-09-12T22:32:25.307585+0000","last_fullsized":"2024-09-12T22:32:25.307585+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:07:30.449320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T22:32:24.303443+0000","last_change":"2024-09-12T22:31:57.092903+0000","last_active":"2024-09-12T22:32:24.303443+0000","last_peered":"2024-09-12T22:32:24.303443+0000","last_clean":"2024-09-12T22:32:24.303443+0000","last_became_active":"2024-09-12T22:31:57.092579+0000","last_became_peered":"2024-09-12T22:31:57.092579+0000","last_unstale":"2024-09-12T22:32:24.303443+0000","last_undegraded":"2024-09-12T22:32:24.303443+0000","last_fullsized":"2024-09-12T22:32:24.303443+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:54:35.308603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T22:32:25.307403+0000","last_change":"2024-09-12T22:31:37.414084+0000","last_active":"2024-09-12T22:32:25.307403+0000","last_peered":"2024-09-12T22:32:25.307403+0000","last_clean":"2024-09-12T22:32:25.307403+0000","last_became_active":"2024-09-12T22:31:37.413671+0000","last_became_peered":"2024-09-12T22:31:37.413671+0000","last_unstale":"2024-09-12T22:32:25.307403+0000","last_undegraded":"2024-09-12T22:32:25.307403+0000","last_fullsized":"2024-09-12T22:32:25.307403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:08:29.199832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T22:32:25.307493+0000","last_change":"2024-09-12T22:31:37.413482+0000","last_active":"2024-09-12T22:32:25.307493+0000","last_peered":"2024-09-12T22:32:25.307493+0000","last_clean":"2024-09-12T22:32:25.307493+0000","last_became_active":"2024-09-12T22:31:37.413195+0000","last_became_peered":"2024-09-12T22:31:37.413195+0000","last_unstale":"2024-09-12T22:32:25.307493+0000","last_undegraded":"2024-09-12T22:32:25.307493+0000","last_fullsized":"2024-09-12T22:32:25.307493+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:22:40.226076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T22:32:25.307286+0000","last_change":"2024-09-12T22:31:37.411006+0000","last_active":"2024-09-12T22:32:25.307286+0000","last_peered":"2024-09-12T22:32:25.307286+0000","last_clean":"2024-09-12T22:32:25.307286+0000","last_became_active":"2024-09-12T22:31:37.410557+0000","last_became_peered":"2024-09-12T22:31:37.410557+0000","last_unstale":"2024-09-12T22:32:25.307286+0000","last_undegraded":"2024-09-12T22:32:25.307286+0000","last_fullsized":"2024-09-12T22:32:25.307286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:08:21.709770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T22:32:24.304215+0000","last_change":"2024-09-12T22:31:37.412450+0000","last_active":"2024-09-12T22:32:24.304215+0000","last_peered":"2024-09-12T22:32:24.304215+0000","last_clean":"2024-09-12T22:32:24.304215+0000","last_became_active":"2024-09-12T22:31:37.412234+0000","last_became_peered":"2024-09-12T22:31:37.412234+0000","last_unstale":"2024-09-12T22:32:24.304215+0000","last_undegraded":"2024-09-12T22:32:24.304215+0000","last_fullsized":"2024-09-12T22:32:24.304215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:15:59.559809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T22:32:24.304409+0000","last_change":"2024-09-12T22:31:57.100568+0000","last_active":"2024-09-12T22:32:24.304409+0000","last_peered":"2024-09-12T22:32:24.304409+0000","last_clean":"2024-09-12T22:32:24.304409+0000","last_became_active":"2024-09-12T22:31:57.100330+0000","last_became_peered":"2024-09-12T22:31:57.100330+0000","last_unstale":"2024-09-12T22:32:24.304409+0000","last_undegraded":"2024-09-12T22:32:24.304409+0000","last_fullsized":"2024-09-12T22:32:24.304409+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:57:20.571864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T22:32:24.303718+0000","last_change":"2024-09-12T22:31:37.417442+0000","last_active":"2024-09-12T22:32:24.303718+0000","last_peered":"2024-09-12T22:32:24.303718+0000","last_clean":"2024-09-12T22:32:24.303718+0000","last_became_active":"2024-09-12T22:31:37.417133+0000","last_became_peered":"2024-09-12T22:31:37.417133+0000","last_unstale":"2024-09-12T22:32:24.303718+0000","last_undegraded":"2024-09-12T22:32:24.303718+0000","last_fullsized":"2024-09-12T22:32:24.303718+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:36.458145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T22:32:25.307709+0000","last_change":"2024-09-12T22:31:37.414235+0000","last_active":"2024-09-12T22:32:25.307709+0000","last_peered":"2024-09-12T22:32:25.307709+0000","last_clean":"2024-09-12T22:32:25.307709+0000","last_became_active":"2024-09-12T22:31:37.413786+0000","last_became_peered":"2024-09-12T22:31:37.413786+0000","last_unstale":"2024-09-12T22:32:25.307709+0000","last_undegraded":"2024-09-12T22:32:25.307709+0000","last_fullsized":"2024-09-12T22:32:25.307709+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:21:11.866973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T22:32:25.307869+0000","last_change":"2024-09-12T22:31:37.415382+0000","last_active":"2024-09-12T22:32:25.307869+0000","last_peered":"2024-09-12T22:32:25.307869+0000","last_clean":"2024-09-12T22:32:25.307869+0000","last_became_active":"2024-09-12T22:31:37.414319+0000","last_became_peered":"2024-09-12T22:31:37.414319+0000","last_unstale":"2024-09-12T22:32:25.307869+0000","last_undegraded":"2024-09-12T22:32:25.307869+0000","last_fullsized":"2024-09-12T22:32:25.307869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:26:25.578693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T22:32:25.310016+0000","last_change":"2024-09-12T22:31:37.412046+0000","last_active":"2024-09-12T22:32:25.310016+0000","last_peered":"2024-09-12T22:32:25.310016+0000","last_clean":"2024-09-12T22:32:25.310016+0000","last_became_active":"2024-09-12T22:31:37.411623+0000","last_became_peered":"2024-09-12T22:31:37.411623+0000","last_unstale":"2024-09-12T22:32:25.310016+0000","last_undegraded":"2024-09-12T22:32:25.310016+0000","last_fullsized":"2024-09-12T22:32:25.310016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:24:15.504358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T22:32:24.303207+0000","last_change":"2024-09-12T22:31:37.410364+0000","last_active":"2024-09-12T22:32:24.303207+0000","last_peered":"2024-09-12T22:32:24.303207+0000","last_clean":"2024-09-12T22:32:24.303207+0000","last_became_active":"2024-09-12T22:31:37.409951+0000","last_became_peered":"2024-09-12T22:31:37.409951+0000","last_unstale":"2024-09-12T22:32:24.303207+0000","last_undegraded":"2024-09-12T22:32:24.303207+0000","last_fullsized":"2024-09-12T22:32:24.303207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:39:17.785755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T22:32:24.303157+0000","last_change":"2024-09-12T22:31:57.092823+0000","last_active":"2024-09-12T22:32:24.303157+0000","last_peered":"2024-09-12T22:32:24.303157+0000","last_clean":"2024-09-12T22:32:24.303157+0000","last_became_active":"2024-09-12T22:31:57.092557+0000","last_became_peered":"2024-09-12T22:31:57.092557+0000","last_unstale":"2024-09-12T22:32:24.303157+0000","last_undegraded":"2024-09-12T22:32:24.303157+0000","last_fullsized":"2024-09-12T22:32:24.303157+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:30:13.033427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T22:32:25.310858+0000","last_change":"2024-09-12T22:31:37.415309+0000","last_active":"2024-09-12T22:32:25.310858+0000","last_peered":"2024-09-12T22:32:25.310858+0000","last_clean":"2024-09-12T22:32:25.310858+0000","last_became_active":"2024-09-12T22:31:37.414792+0000","last_became_peered":"2024-09-12T22:31:37.414792+0000","last_unstale":"2024-09-12T22:32:25.310858+0000","last_undegraded":"2024-09-12T22:32:25.310858+0000","last_fullsized":"2024-09-12T22:32:25.310858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:08:07.115355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T22:32:24.304363+0000","last_change":"2024-09-12T22:31:37.411880+0000","last_active":"2024-09-12T22:32:24.304363+0000","last_peered":"2024-09-12T22:32:24.304363+0000","last_clean":"2024-09-12T22:32:24.304363+0000","last_became_active":"2024-09-12T22:31:37.410563+0000","last_became_peered":"2024-09-12T22:31:37.410563+0000","last_unstale":"2024-09-12T22:32:24.304363+0000","last_undegraded":"2024-09-12T22:32:24.304363+0000","last_fullsized":"2024-09-12T22:32:24.304363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:47:52.560533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T22:32:25.308054+0000","last_change":"2024-09-12T22:31:37.419603+0000","last_active":"2024-09-12T22:32:25.308054+0000","last_peered":"2024-09-12T22:32:25.308054+0000","last_clean":"2024-09-12T22:32:25.308054+0000","last_became_active":"2024-09-12T22:31:37.418725+0000","last_became_peered":"2024-09-12T22:31:37.418725+0000","last_unstale":"2024-09-12T22:32:25.308054+0000","last_undegraded":"2024-09-12T22:32:25.308054+0000","last_fullsized":"2024-09-12T22:32:25.308054+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:02:44.183545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T22:32:25.307611+0000","last_change":"2024-09-12T22:31:57.100810+0000","last_active":"2024-09-12T22:32:25.307611+0000","last_peered":"2024-09-12T22:32:25.307611+0000","last_clean":"2024-09-12T22:32:25.307611+0000","last_became_active":"2024-09-12T22:31:57.100516+0000","last_became_peered":"2024-09-12T22:31:57.100516+0000","last_unstale":"2024-09-12T22:32:25.307611+0000","last_undegraded":"2024-09-12T22:32:25.307611+0000","last_fullsized":"2024-09-12T22:32:25.307611+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:21:45.140557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T22:32:24.303554+0000","last_change":"2024-09-12T22:31:37.414918+0000","last_active":"2024-09-12T22:32:24.303554+0000","last_peered":"2024-09-12T22:32:24.303554+0000","last_clean":"2024-09-12T22:32:24.303554+0000","last_became_active":"2024-09-12T22:31:37.414225+0000","last_became_peered":"2024-09-12T22:31:37.414225+0000","last_unstale":"2024-09-12T22:32:24.303554+0000","last_undegraded":"2024-09-12T22:32:24.303554+0000","last_fullsized":"2024-09-12T22:32:24.303554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:56:14.649228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T22:32:25.310180+0000","last_change":"2024-09-12T22:31:37.411569+0000","last_active":"2024-09-12T22:32:25.310180+0000","last_peered":"2024-09-12T22:32:25.310180+0000","last_clean":"2024-09-12T22:32:25.310180+0000","last_became_active":"2024-09-12T22:31:37.410619+0000","last_became_peered":"2024-09-12T22:31:37.410619+0000","last_unstale":"2024-09-12T22:32:25.310180+0000","last_undegraded":"2024-09-12T22:32:25.310180+0000","last_fullsized":"2024-09-12T22:32:25.310180+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:30:01.012271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T22:32:24.303276+0000","last_change":"2024-09-12T22:31:37.415589+0000","last_active":"2024-09-12T22:32:24.303276+0000","last_peered":"2024-09-12T22:32:24.303276+0000","last_clean":"2024-09-12T22:32:24.303276+0000","last_became_active":"2024-09-12T22:31:37.415285+0000","last_became_peered":"2024-09-12T22:31:37.415285+0000","last_unstale":"2024-09-12T22:32:24.303276+0000","last_undegraded":"2024-09-12T22:32:24.303276+0000","last_fullsized":"2024-09-12T22:32:24.303276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:06:25.913810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T22:32:25.307386+0000","last_change":"2024-09-12T22:31:37.415190+0000","last_active":"2024-09-12T22:32:25.307386+0000","last_peered":"2024-09-12T22:32:25.307386+0000","last_clean":"2024-09-12T22:32:25.307386+0000","last_became_active":"2024-09-12T22:31:37.414265+0000","last_became_peered":"2024-09-12T22:31:37.414265+0000","last_unstale":"2024-09-12T22:32:25.307386+0000","last_undegraded":"2024-09-12T22:32:25.307386+0000","last_fullsized":"2024-09-12T22:32:25.307386+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:07:02.173590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T22:32:24.303779+0000","last_change":"2024-09-12T22:31:57.100582+0000","last_active":"2024-09-12T22:32:24.303779+0000","last_peered":"2024-09-12T22:32:24.303779+0000","last_clean":"2024-09-12T22:32:24.303779+0000","last_became_active":"2024-09-12T22:31:57.100321+0000","last_became_peered":"2024-09-12T22:31:57.100321+0000","last_unstale":"2024-09-12T22:32:24.303779+0000","last_undegraded":"2024-09-12T22:32:24.303779+0000","last_fullsized":"2024-09-12T22:32:24.303779+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:59:36.843984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"19'2","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T22:32:25.307863+0000","last_change":"2024-09-12T22:31:36.412082+0000","last_active":"2024-09-12T22:32:25.307863+0000","last_peered":"2024-09-12T22:32:25.307863+0000","last_clean":"2024-09-12T22:32:25.307863+0000","last_became_active":"2024-09-12T22:31:36.410871+0000","last_became_peered":"2024-09-12T22:31:36.410871+0000","last_unstale":"2024-09-12T22:32:25.307863+0000","last_undegraded":"2024-09-12T22:32:25.307863+0000","last_fullsized":"2024-09-12T22:32:25.307863+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:30:49.127253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T22:32:25.310595+0000","last_change":"2024-09-12T22:31:37.411790+0000","last_active":"2024-09-12T22:32:25.310595+0000","last_peered":"2024-09-12T22:32:25.310595+0000","last_clean":"2024-09-12T22:32:25.310595+0000","last_became_active":"2024-09-12T22:31:37.411414+0000","last_became_peered":"2024-09-12T22:31:37.411414+0000","last_unstale":"2024-09-12T22:32:25.310595+0000","last_undegraded":"2024-09-12T22:32:25.310595+0000","last_fullsized":"2024-09-12T22:32:25.310595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:22:40.226076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T22:32:24.303511+0000","last_change":"2024-09-12T22:31:36.408563+0000","last_active":"2024-09-12T22:32:24.303511+0000","last_peered":"2024-09-12T22:32:24.303511+0000","last_clean":"2024-09-12T22:32:24.303511+0000","last_became_active":"2024-09-12T22:31:36.407447+0000","last_became_peered":"2024-09-12T22:31:36.407447+0000","last_unstale":"2024-09-12T22:32:24.303511+0000","last_undegraded":"2024-09-12T22:32:24.303511+0000","last_fullsized":"2024-09-12T22:32:24.303511+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:29:37.933109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T22:32:24.304486+0000","last_change":"2024-09-12T22:31:37.411680+0000","last_active":"2024-09-12T22:32:24.304486+0000","last_peered":"2024-09-12T22:32:24.304486+0000","last_clean":"2024-09-12T22:32:24.304486+0000","last_became_active":"2024-09-12T22:31:37.411168+0000","last_became_peered":"2024-09-12T22:31:37.411168+0000","last_unstale":"2024-09-12T22:32:24.304486+0000","last_undegraded":"2024-09-12T22:32:24.304486+0000","last_fullsized":"2024-09-12T22:32:24.304486+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:27.706282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T22:32:25.309957+0000","last_change":"2024-09-12T22:31:36.411271+0000","last_active":"2024-09-12T22:32:25.309957+0000","last_peered":"2024-09-12T22:32:25.309957+0000","last_clean":"2024-09-12T22:32:25.309957+0000","last_became_active":"2024-09-12T22:31:36.410706+0000","last_became_peered":"2024-09-12T22:31:36.410706+0000","last_unstale":"2024-09-12T22:32:25.309957+0000","last_undegraded":"2024-09-12T22:32:25.309957+0000","last_fullsized":"2024-09-12T22:32:25.309957+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:43:22.805855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T22:32:24.303994+0000","last_change":"2024-09-12T22:31:37.411218+0000","last_active":"2024-09-12T22:32:24.303994+0000","last_peered":"2024-09-12T22:32:24.303994+0000","last_clean":"2024-09-12T22:32:24.303994+0000","last_became_active":"2024-09-12T22:31:37.409666+0000","last_became_peered":"2024-09-12T22:31:37.409666+0000","last_unstale":"2024-09-12T22:32:24.303994+0000","last_undegraded":"2024-09-12T22:32:24.303994+0000","last_fullsized":"2024-09-12T22:32:24.303994+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:45:34.230090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"19'8","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T22:32:25.307392+0000","last_change":"2024-09-12T22:31:36.411811+0000","last_active":"2024-09-12T22:32:25.307392+0000","last_peered":"2024-09-12T22:32:25.307392+0000","last_clean":"2024-09-12T22:32:25.307392+0000","last_became_active":"2024-09-12T22:31:36.410101+0000","last_became_peered":"2024-09-12T22:31:36.410101+0000","last_unstale":"2024-09-12T22:32:25.307392+0000","last_undegraded":"2024-09-12T22:32:25.307392+0000","last_fullsized":"2024-09-12T22:32:25.307392+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:33:02.410148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"19'1","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T22:32:25.308196+0000","last_change":"2024-09-12T22:31:36.410970+0000","last_active":"2024-09-12T22:32:25.308196+0000","last_peered":"2024-09-12T22:32:25.308196+0000","last_clean":"2024-09-12T22:32:25.308196+0000","last_became_active":"2024-09-12T22:31:36.409754+0000","last_became_peered":"2024-09-12T22:31:36.409754+0000","last_unstale":"2024-09-12T22:32:25.308196+0000","last_undegraded":"2024-09-12T22:32:25.308196+0000","last_fullsized":"2024-09-12T22:32:25.308196+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:30:07.724418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T22:32:25.309819+0000","last_change":"2024-09-12T22:31:37.415050+0000","last_active":"2024-09-12T22:32:25.309819+0000","last_peered":"2024-09-12T22:32:25.309819+0000","last_clean":"2024-09-12T22:32:25.309819+0000","last_became_active":"2024-09-12T22:31:37.414290+0000","last_became_peered":"2024-09-12T22:31:37.414290+0000","last_unstale":"2024-09-12T22:32:25.309819+0000","last_undegraded":"2024-09-12T22:32:25.309819+0000","last_fullsized":"2024-09-12T22:32:25.309819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:47:15.502575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"19'2","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T22:32:25.310783+0000","last_change":"2024-09-12T22:31:36.411725+0000","last_active":"2024-09-12T22:32:25.310783+0000","last_peered":"2024-09-12T22:32:25.310783+0000","last_clean":"2024-09-12T22:32:25.310783+0000","last_became_active":"2024-09-12T22:31:36.411407+0000","last_became_peered":"2024-09-12T22:31:36.411407+0000","last_unstale":"2024-09-12T22:32:25.310783+0000","last_undegraded":"2024-09-12T22:32:25.310783+0000","last_fullsized":"2024-09-12T22:32:25.310783+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:30:07.724418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T22:32:24.303471+0000","last_change":"2024-09-12T22:31:57.092727+0000","last_active":"2024-09-12T22:32:24.303471+0000","last_peered":"2024-09-12T22:32:24.303471+0000","last_clean":"2024-09-12T22:32:24.303471+0000","last_became_active":"2024-09-12T22:31:57.092446+0000","last_became_peered":"2024-09-12T22:31:57.092446+0000","last_unstale":"2024-09-12T22:32:24.303471+0000","last_undegraded":"2024-09-12T22:32:24.303471+0000","last_fullsized":"2024-09-12T22:32:24.303471+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:09:14.524447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"19'1","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T22:32:25.308241+0000","last_change":"2024-09-12T22:31:36.411320+0000","last_active":"2024-09-12T22:32:25.308241+0000","last_peered":"2024-09-12T22:32:25.308241+0000","last_clean":"2024-09-12T22:32:25.308241+0000","last_became_active":"2024-09-12T22:31:36.409837+0000","last_became_peered":"2024-09-12T22:31:36.409837+0000","last_unstale":"2024-09-12T22:32:25.308241+0000","last_undegraded":"2024-09-12T22:32:25.308241+0000","last_fullsized":"2024-09-12T22:32:25.308241+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:36:53.914922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T22:32:25.307512+0000","last_change":"2024-09-12T22:31:37.414809+0000","last_active":"2024-09-12T22:32:25.307512+0000","last_peered":"2024-09-12T22:32:25.307512+0000","last_clean":"2024-09-12T22:32:25.307512+0000","last_became_active":"2024-09-12T22:31:37.414492+0000","last_became_peered":"2024-09-12T22:31:37.414492+0000","last_unstale":"2024-09-12T22:32:25.307512+0000","last_undegraded":"2024-09-12T22:32:25.307512+0000","last_fullsized":"2024-09-12T22:32:25.307512+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:50:48.426898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T22:32:25.307884+0000","last_change":"2024-09-12T22:31:36.412068+0000","last_active":"2024-09-12T22:32:25.307884+0000","last_peered":"2024-09-12T22:32:25.307884+0000","last_clean":"2024-09-12T22:32:25.307884+0000","last_became_active":"2024-09-12T22:31:36.411366+0000","last_became_peered":"2024-09-12T22:31:36.411366+0000","last_unstale":"2024-09-12T22:32:25.307884+0000","last_undegraded":"2024-09-12T22:32:25.307884+0000","last_fullsized":"2024-09-12T22:32:25.307884+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:35:51.647051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T22:32:24.303626+0000","last_change":"2024-09-12T22:31:37.410303+0000","last_active":"2024-09-12T22:32:24.303626+0000","last_peered":"2024-09-12T22:32:24.303626+0000","last_clean":"2024-09-12T22:32:24.303626+0000","last_became_active":"2024-09-12T22:31:37.409607+0000","last_became_peered":"2024-09-12T22:31:37.409607+0000","last_unstale":"2024-09-12T22:32:24.303626+0000","last_undegraded":"2024-09-12T22:32:24.303626+0000","last_fullsized":"2024-09-12T22:32:24.303626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:53:42.732654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"19'2","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T22:32:24.303789+0000","last_change":"2024-09-12T22:31:36.407974+0000","last_active":"2024-09-12T22:32:24.303789+0000","last_peered":"2024-09-12T22:32:24.303789+0000","last_clean":"2024-09-12T22:32:24.303789+0000","last_became_active":"2024-09-12T22:31:36.406955+0000","last_became_peered":"2024-09-12T22:31:36.406955+0000","last_unstale":"2024-09-12T22:32:24.303789+0000","last_undegraded":"2024-09-12T22:32:24.303789+0000","last_fullsized":"2024-09-12T22:32:24.303789+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:07:34.831264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T22:32:25.307748+0000","last_change":"2024-09-12T22:31:37.415285+0000","last_active":"2024-09-12T22:32:25.307748+0000","last_peered":"2024-09-12T22:32:25.307748+0000","last_clean":"2024-09-12T22:32:25.307748+0000","last_became_active":"2024-09-12T22:31:37.414890+0000","last_became_peered":"2024-09-12T22:31:37.414890+0000","last_unstale":"2024-09-12T22:32:25.307748+0000","last_undegraded":"2024-09-12T22:32:25.307748+0000","last_fullsized":"2024-09-12T22:32:25.307748+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:38:16.956786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T22:32:25.307609+0000","last_change":"2024-09-12T22:31:36.412147+0000","last_active":"2024-09-12T22:32:25.307609+0000","last_peered":"2024-09-12T22:32:25.307609+0000","last_clean":"2024-09-12T22:32:25.307609+0000","last_became_active":"2024-09-12T22:31:36.411382+0000","last_became_peered":"2024-09-12T22:31:36.411382+0000","last_unstale":"2024-09-12T22:32:25.307609+0000","last_undegraded":"2024-09-12T22:32:25.307609+0000","last_fullsized":"2024-09-12T22:32:25.307609+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:54:51.454867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T22:32:25.308151+0000","last_change":"2024-09-12T22:31:37.420209+0000","last_active":"2024-09-12T22:32:25.308151+0000","last_peered":"2024-09-12T22:32:25.308151+0000","last_clean":"2024-09-12T22:32:25.308151+0000","last_became_active":"2024-09-12T22:31:37.419267+0000","last_became_peered":"2024-09-12T22:31:37.419267+0000","last_unstale":"2024-09-12T22:32:25.308151+0000","last_undegraded":"2024-09-12T22:32:25.308151+0000","last_fullsized":"2024-09-12T22:32:25.308151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:36.790111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T22:32:25.309974+0000","last_change":"2024-09-12T22:31:36.411190+0000","last_active":"2024-09-12T22:32:25.309974+0000","last_peered":"2024-09-12T22:32:25.309974+0000","last_clean":"2024-09-12T22:32:25.309974+0000","last_became_active":"2024-09-12T22:31:36.410548+0000","last_became_peered":"2024-09-12T22:31:36.410548+0000","last_unstale":"2024-09-12T22:32:25.309974+0000","last_undegraded":"2024-09-12T22:32:25.309974+0000","last_fullsized":"2024-09-12T22:32:25.309974+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:10:20.300894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T22:32:25.308147+0000","last_change":"2024-09-12T22:31:37.418749+0000","last_active":"2024-09-12T22:32:25.308147+0000","last_peered":"2024-09-12T22:32:25.308147+0000","last_clean":"2024-09-12T22:32:25.308147+0000","last_became_active":"2024-09-12T22:31:37.418360+0000","last_became_peered":"2024-09-12T22:31:37.418360+0000","last_unstale":"2024-09-12T22:32:25.308147+0000","last_undegraded":"2024-09-12T22:32:25.308147+0000","last_fullsized":"2024-09-12T22:32:25.308147+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:50:08.152699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T22:32:25.309856+0000","last_change":"2024-09-12T22:31:36.412187+0000","last_active":"2024-09-12T22:32:25.309856+0000","last_peered":"2024-09-12T22:32:25.309856+0000","last_clean":"2024-09-12T22:32:25.309856+0000","last_became_active":"2024-09-12T22:31:36.411935+0000","last_became_peered":"2024-09-12T22:31:36.411935+0000","last_unstale":"2024-09-12T22:32:25.309856+0000","last_undegraded":"2024-09-12T22:32:25.309856+0000","last_fullsized":"2024-09-12T22:32:25.309856+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:41:04.029445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T22:32:24.304014+0000","last_change":"2024-09-12T22:31:37.417881+0000","last_active":"2024-09-12T22:32:24.304014+0000","last_peered":"2024-09-12T22:32:24.304014+0000","last_clean":"2024-09-12T22:32:24.304014+0000","last_became_active":"2024-09-12T22:31:37.417572+0000","last_became_peered":"2024-09-12T22:31:37.417572+0000","last_unstale":"2024-09-12T22:32:24.304014+0000","last_undegraded":"2024-09-12T22:32:24.304014+0000","last_fullsized":"2024-09-12T22:32:24.304014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:19:16.367589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":256,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T22:32:25.307615+0000","last_change":"2024-09-12T22:31:27.631847+0000","last_active":"2024-09-12T22:32:25.307615+0000","last_peered":"2024-09-12T22:32:25.307615+0000","last_clean":"2024-09-12T22:32:25.307615+0000","last_became_active":"2024-09-12T22:31:27.631027+0000","last_became_peered":"2024-09-12T22:31:27.631027+0000","last_unstale":"2024-09-12T22:32:25.307615+0000","last_undegraded":"2024-09-12T22:32:25.307615+0000","last_fullsized":"2024-09-12T22:32:25.307615+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:26.229539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:26.229539+0000","last_clean_scrub_stamp":"2024-09-12T22:31:26.229539+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:59:24.181319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":60,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T22:32:25.307979+0000","last_change":"2024-09-12T22:31:34.286952+0000","last_active":"2024-09-12T22:32:25.307979+0000","last_peered":"2024-09-12T22:32:25.307979+0000","last_clean":"2024-09-12T22:32:25.307979+0000","last_became_active":"2024-09-12T22:31:32.283661+0000","last_became_peered":"2024-09-12T22:31:32.283661+0000","last_unstale":"2024-09-12T22:32:25.307979+0000","last_undegraded":"2024-09-12T22:32:25.307979+0000","last_fullsized":"2024-09-12T22:32:25.307979+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:21.681390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000621274,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T22:32:24.303608+0000","last_change":"2024-09-12T22:31:36.411275+0000","last_active":"2024-09-12T22:32:24.303608+0000","last_peered":"2024-09-12T22:32:24.303608+0000","last_clean":"2024-09-12T22:32:24.303608+0000","last_became_active":"2024-09-12T22:31:36.410595+0000","last_became_peered":"2024-09-12T22:31:36.410595+0000","last_unstale":"2024-09-12T22:32:24.303608+0000","last_undegraded":"2024-09-12T22:32:24.303608+0000","last_fullsized":"2024-09-12T22:32:24.303608+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:38:14.895625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T22:32:25.308228+0000","last_change":"2024-09-12T22:31:37.419976+0000","last_active":"2024-09-12T22:32:25.308228+0000","last_peered":"2024-09-12T22:32:25.308228+0000","last_clean":"2024-09-12T22:32:25.308228+0000","last_became_active":"2024-09-12T22:31:37.419161+0000","last_became_peered":"2024-09-12T22:31:37.419161+0000","last_unstale":"2024-09-12T22:32:25.308228+0000","last_undegraded":"2024-09-12T22:32:25.308228+0000","last_fullsized":"2024-09-12T22:32:25.308228+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:07:26.070097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":59,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T22:32:25.307517+0000","last_change":"2024-09-12T22:31:34.286642+0000","last_active":"2024-09-12T22:32:25.307517+0000","last_peered":"2024-09-12T22:32:25.307517+0000","last_clean":"2024-09-12T22:32:25.307517+0000","last_became_active":"2024-09-12T22:31:32.283601+0000","last_became_peered":"2024-09-12T22:31:32.283601+0000","last_unstale":"2024-09-12T22:32:25.307517+0000","last_undegraded":"2024-09-12T22:32:25.307517+0000","last_fullsized":"2024-09-12T22:32:25.307517+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:40:06.769540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037858999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T22:32:24.303557+0000","last_change":"2024-09-12T22:31:36.407395+0000","last_active":"2024-09-12T22:32:24.303557+0000","last_peered":"2024-09-12T22:32:24.303557+0000","last_clean":"2024-09-12T22:32:24.303557+0000","last_became_active":"2024-09-12T22:31:36.406770+0000","last_became_peered":"2024-09-12T22:31:36.406770+0000","last_unstale":"2024-09-12T22:32:24.303557+0000","last_undegraded":"2024-09-12T22:32:24.303557+0000","last_fullsized":"2024-09-12T22:32:24.303557+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:49:26.547848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T22:32:25.310623+0000","last_change":"2024-09-12T22:31:37.414075+0000","last_active":"2024-09-12T22:32:25.310623+0000","last_peered":"2024-09-12T22:32:25.310623+0000","last_clean":"2024-09-12T22:32:25.310623+0000","last_became_active":"2024-09-12T22:31:37.413491+0000","last_became_peered":"2024-09-12T22:31:37.413491+0000","last_unstale":"2024-09-12T22:32:25.310623+0000","last_undegraded":"2024-09-12T22:32:25.310623+0000","last_fullsized":"2024-09-12T22:32:25.310623+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:26:25.578693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":57,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T22:32:24.303726+0000","last_change":"2024-09-12T22:31:34.286394+0000","last_active":"2024-09-12T22:32:24.303726+0000","last_peered":"2024-09-12T22:32:24.303726+0000","last_clean":"2024-09-12T22:32:24.303726+0000","last_became_active":"2024-09-12T22:31:32.280062+0000","last_became_peered":"2024-09-12T22:31:32.280062+0000","last_unstale":"2024-09-12T22:32:24.303726+0000","last_undegraded":"2024-09-12T22:32:24.303726+0000","last_fullsized":"2024-09-12T22:32:24.303726+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:20:23.663838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039540700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T22:32:25.307156+0000","last_change":"2024-09-12T22:31:57.100816+0000","last_active":"2024-09-12T22:32:25.307156+0000","last_peered":"2024-09-12T22:32:25.307156+0000","last_clean":"2024-09-12T22:32:25.307156+0000","last_became_active":"2024-09-12T22:31:57.100392+0000","last_became_peered":"2024-09-12T22:31:57.100392+0000","last_unstale":"2024-09-12T22:32:25.307156+0000","last_undegraded":"2024-09-12T22:32:25.307156+0000","last_fullsized":"2024-09-12T22:32:25.307156+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:06:12.881182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T22:32:24.304077+0000","last_change":"2024-09-12T22:31:37.417636+0000","last_active":"2024-09-12T22:32:24.304077+0000","last_peered":"2024-09-12T22:32:24.304077+0000","last_clean":"2024-09-12T22:32:24.304077+0000","last_became_active":"2024-09-12T22:31:37.417230+0000","last_became_peered":"2024-09-12T22:31:37.417230+0000","last_unstale":"2024-09-12T22:32:24.304077+0000","last_undegraded":"2024-09-12T22:32:24.304077+0000","last_fullsized":"2024-09-12T22:32:24.304077+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:44:29.729122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":61,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T22:32:25.307710+0000","last_change":"2024-09-12T22:31:34.286938+0000","last_active":"2024-09-12T22:32:25.307710+0000","last_peered":"2024-09-12T22:32:25.307710+0000","last_clean":"2024-09-12T22:32:25.307710+0000","last_became_active":"2024-09-12T22:31:32.282230+0000","last_became_peered":"2024-09-12T22:31:32.282230+0000","last_unstale":"2024-09-12T22:32:25.307710+0000","last_undegraded":"2024-09-12T22:32:25.307710+0000","last_fullsized":"2024-09-12T22:32:25.307710+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:11:05.988384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000615758,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T22:32:25.307977+0000","last_change":"2024-09-12T22:31:36.410694+0000","last_active":"2024-09-12T22:32:25.307977+0000","last_peered":"2024-09-12T22:32:25.307977+0000","last_clean":"2024-09-12T22:32:25.307977+0000","last_became_active":"2024-09-12T22:31:36.409816+0000","last_became_peered":"2024-09-12T22:31:36.409816+0000","last_unstale":"2024-09-12T22:32:25.307977+0000","last_undegraded":"2024-09-12T22:32:25.307977+0000","last_fullsized":"2024-09-12T22:32:25.307977+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:40:35.369213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T22:32:24.303948+0000","last_change":"2024-09-12T22:31:37.414608+0000","last_active":"2024-09-12T22:32:24.303948+0000","last_peered":"2024-09-12T22:32:24.303948+0000","last_clean":"2024-09-12T22:32:24.303948+0000","last_became_active":"2024-09-12T22:31:37.414307+0000","last_became_peered":"2024-09-12T22:31:37.414307+0000","last_unstale":"2024-09-12T22:32:24.303948+0000","last_undegraded":"2024-09-12T22:32:24.303948+0000","last_fullsized":"2024-09-12T22:32:24.303948+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:41:21.231511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T22:32:25.312917+0000","last_change":"2024-09-12T22:32:25.311220+0000","last_active":"2024-09-12T22:32:25.312917+0000","last_peered":"2024-09-12T22:32:25.312917+0000","last_clean":"2024-09-12T22:32:25.312917+0000","last_became_active":"2024-09-12T22:32:25.310966+0000","last_became_peered":"2024-09-12T22:32:25.310966+0000","last_unstale":"2024-09-12T22:32:25.312917+0000","last_undegraded":"2024-09-12T22:32:25.312917+0000","last_fullsized":"2024-09-12T22:32:25.312917+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:21:44.138166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":57,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T22:32:24.304117+0000","last_change":"2024-09-12T22:31:34.286457+0000","last_active":"2024-09-12T22:32:24.304117+0000","last_peered":"2024-09-12T22:32:24.304117+0000","last_clean":"2024-09-12T22:32:24.304117+0000","last_became_active":"2024-09-12T22:31:32.280007+0000","last_became_peered":"2024-09-12T22:31:32.280007+0000","last_unstale":"2024-09-12T22:32:24.304117+0000","last_undegraded":"2024-09-12T22:32:24.304117+0000","last_fullsized":"2024-09-12T22:32:24.304117+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:09.068038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041972500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T22:32:25.310113+0000","last_change":"2024-09-12T22:31:37.410386+0000","last_active":"2024-09-12T22:32:25.310113+0000","last_peered":"2024-09-12T22:32:25.310113+0000","last_clean":"2024-09-12T22:32:25.310113+0000","last_became_active":"2024-09-12T22:31:37.409928+0000","last_became_peered":"2024-09-12T22:31:37.409928+0000","last_unstale":"2024-09-12T22:32:25.310113+0000","last_undegraded":"2024-09-12T22:32:25.310113+0000","last_fullsized":"2024-09-12T22:32:25.310113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:02:36.454134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T22:32:24.304032+0000","last_change":"2024-09-12T22:31:36.410324+0000","last_active":"2024-09-12T22:32:24.304032+0000","last_peered":"2024-09-12T22:32:24.304032+0000","last_clean":"2024-09-12T22:32:24.304032+0000","last_became_active":"2024-09-12T22:31:36.409199+0000","last_became_peered":"2024-09-12T22:31:36.409199+0000","last_unstale":"2024-09-12T22:32:24.304032+0000","last_undegraded":"2024-09-12T22:32:24.304032+0000","last_fullsized":"2024-09-12T22:32:24.304032+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:06:54.608936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":59,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T22:32:25.310792+0000","last_change":"2024-09-12T22:31:34.839044+0000","last_active":"2024-09-12T22:32:25.310792+0000","last_peered":"2024-09-12T22:32:25.310792+0000","last_clean":"2024-09-12T22:32:25.310792+0000","last_became_active":"2024-09-12T22:31:32.279671+0000","last_became_peered":"2024-09-12T22:31:32.279671+0000","last_unstale":"2024-09-12T22:32:25.310792+0000","last_undegraded":"2024-09-12T22:32:25.310792+0000","last_fullsized":"2024-09-12T22:32:25.310792+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:27:49.809935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036776499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T22:32:25.307683+0000","last_change":"2024-09-12T22:31:57.100721+0000","last_active":"2024-09-12T22:32:25.307683+0000","last_peered":"2024-09-12T22:32:25.307683+0000","last_clean":"2024-09-12T22:32:25.307683+0000","last_became_active":"2024-09-12T22:31:57.100426+0000","last_became_peered":"2024-09-12T22:31:57.100426+0000","last_unstale":"2024-09-12T22:32:25.307683+0000","last_undegraded":"2024-09-12T22:32:25.307683+0000","last_fullsized":"2024-09-12T22:32:25.307683+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:14:31.890006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"19'2","reported_seq":46,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T22:32:24.304287+0000","last_change":"2024-09-12T22:31:36.409397+0000","last_active":"2024-09-12T22:32:24.304287+0000","last_peered":"2024-09-12T22:32:24.304287+0000","last_clean":"2024-09-12T22:32:24.304287+0000","last_became_active":"2024-09-12T22:31:36.408787+0000","last_became_peered":"2024-09-12T22:31:36.408787+0000","last_unstale":"2024-09-12T22:32:24.304287+0000","last_undegraded":"2024-09-12T22:32:24.304287+0000","last_fullsized":"2024-09-12T22:32:24.304287+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:29:03.467352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":57,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T22:32:24.304566+0000","last_change":"2024-09-12T22:31:34.286639+0000","last_active":"2024-09-12T22:32:24.304566+0000","last_peered":"2024-09-12T22:32:24.304566+0000","last_clean":"2024-09-12T22:32:24.304566+0000","last_became_active":"2024-09-12T22:31:32.280092+0000","last_became_peered":"2024-09-12T22:31:32.280092+0000","last_unstale":"2024-09-12T22:32:24.304566+0000","last_undegraded":"2024-09-12T22:32:24.304566+0000","last_fullsized":"2024-09-12T22:32:24.304566+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:02:40.821530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058589999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T22:32:24.303285+0000","last_change":"2024-09-12T22:31:37.411152+0000","last_active":"2024-09-12T22:32:24.303285+0000","last_peered":"2024-09-12T22:32:24.303285+0000","last_clean":"2024-09-12T22:32:24.303285+0000","last_became_active":"2024-09-12T22:31:37.410558+0000","last_became_peered":"2024-09-12T22:31:37.410558+0000","last_unstale":"2024-09-12T22:32:24.303285+0000","last_undegraded":"2024-09-12T22:32:24.303285+0000","last_fullsized":"2024-09-12T22:32:24.303285+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:14:29.892478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"27'3","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T22:32:24.304533+0000","last_change":"2024-09-12T22:31:36.407460+0000","last_active":"2024-09-12T22:32:24.304533+0000","last_peered":"2024-09-12T22:32:24.304533+0000","last_clean":"2024-09-12T22:32:24.304533+0000","last_became_active":"2024-09-12T22:31:36.406729+0000","last_became_peered":"2024-09-12T22:31:36.406729+0000","last_unstale":"2024-09-12T22:32:24.304533+0000","last_undegraded":"2024-09-12T22:32:24.304533+0000","last_fullsized":"2024-09-12T22:32:24.304533+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:27:58.012573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":59,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T22:32:25.308261+0000","last_change":"2024-09-12T22:31:34.286699+0000","last_active":"2024-09-12T22:32:25.308261+0000","last_peered":"2024-09-12T22:32:25.308261+0000","last_clean":"2024-09-12T22:32:25.308261+0000","last_became_active":"2024-09-12T22:31:32.283606+0000","last_became_peered":"2024-09-12T22:31:32.283606+0000","last_unstale":"2024-09-12T22:32:25.308261+0000","last_undegraded":"2024-09-12T22:32:25.308261+0000","last_fullsized":"2024-09-12T22:32:25.308261+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:09:32.050798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000382109,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T22:32:25.309874+0000","last_change":"2024-09-12T22:31:37.410011+0000","last_active":"2024-09-12T22:32:25.309874+0000","last_peered":"2024-09-12T22:32:25.309874+0000","last_clean":"2024-09-12T22:32:25.309874+0000","last_became_active":"2024-09-12T22:31:37.409320+0000","last_became_peered":"2024-09-12T22:31:37.409320+0000","last_unstale":"2024-09-12T22:32:25.309874+0000","last_undegraded":"2024-09-12T22:32:25.309874+0000","last_fullsized":"2024-09-12T22:32:25.309874+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:27:23.661444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T22:32:25.307766+0000","last_change":"2024-09-12T22:31:37.415670+0000","last_active":"2024-09-12T22:32:25.307766+0000","last_peered":"2024-09-12T22:32:25.307766+0000","last_clean":"2024-09-12T22:32:25.307766+0000","last_became_active":"2024-09-12T22:31:37.415007+0000","last_became_peered":"2024-09-12T22:31:37.415007+0000","last_unstale":"2024-09-12T22:32:25.307766+0000","last_undegraded":"2024-09-12T22:32:25.307766+0000","last_fullsized":"2024-09-12T22:32:25.307766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:42:51.694128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"27'10","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T22:32:25.307817+0000","last_change":"2024-09-12T22:31:36.409878+0000","last_active":"2024-09-12T22:32:25.307817+0000","last_peered":"2024-09-12T22:32:25.307817+0000","last_clean":"2024-09-12T22:32:25.307817+0000","last_became_active":"2024-09-12T22:31:36.409132+0000","last_became_peered":"2024-09-12T22:31:36.409132+0000","last_unstale":"2024-09-12T22:32:25.307817+0000","last_undegraded":"2024-09-12T22:32:25.307817+0000","last_fullsized":"2024-09-12T22:32:25.307817+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:09:56.081385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6555,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T22:32:24.303340+0000","last_change":"2024-09-12T22:31:37.414914+0000","last_active":"2024-09-12T22:32:24.303340+0000","last_peered":"2024-09-12T22:32:24.303340+0000","last_clean":"2024-09-12T22:32:24.303340+0000","last_became_active":"2024-09-12T22:31:37.414535+0000","last_became_peered":"2024-09-12T22:31:37.414535+0000","last_unstale":"2024-09-12T22:32:24.303340+0000","last_undegraded":"2024-09-12T22:32:24.303340+0000","last_fullsized":"2024-09-12T22:32:24.303340+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:14:37.010786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"19'3","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T22:32:25.308118+0000","last_change":"2024-09-12T22:31:57.101007+0000","last_active":"2024-09-12T22:32:25.308118+0000","last_peered":"2024-09-12T22:32:25.308118+0000","last_clean":"2024-09-12T22:32:25.308118+0000","last_became_active":"2024-09-12T22:31:57.100640+0000","last_became_peered":"2024-09-12T22:31:57.100640+0000","last_unstale":"2024-09-12T22:32:25.308118+0000","last_undegraded":"2024-09-12T22:32:25.308118+0000","last_fullsized":"2024-09-12T22:32:25.308118+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:37:12.949001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T22:32:25.308242+0000","last_change":"2024-09-12T22:31:36.411549+0000","last_active":"2024-09-12T22:32:25.308242+0000","last_peered":"2024-09-12T22:32:25.308242+0000","last_clean":"2024-09-12T22:32:25.308242+0000","last_became_active":"2024-09-12T22:31:36.410674+0000","last_became_peered":"2024-09-12T22:31:36.410674+0000","last_unstale":"2024-09-12T22:32:25.308242+0000","last_undegraded":"2024-09-12T22:32:25.308242+0000","last_fullsized":"2024-09-12T22:32:25.308242+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:58:05.676197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T22:32:24.303372+0000","last_change":"2024-09-12T22:31:37.411254+0000","last_active":"2024-09-12T22:32:24.303372+0000","last_peered":"2024-09-12T22:32:24.303372+0000","last_clean":"2024-09-12T22:32:24.303372+0000","last_became_active":"2024-09-12T22:31:37.410404+0000","last_became_peered":"2024-09-12T22:31:37.410404+0000","last_unstale":"2024-09-12T22:32:24.303372+0000","last_undegraded":"2024-09-12T22:32:24.303372+0000","last_fullsized":"2024-09-12T22:32:24.303372+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:42:00.856616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T22:32:24.304183+0000","last_change":"2024-09-12T22:31:36.408390+0000","last_active":"2024-09-12T22:32:24.304183+0000","last_peered":"2024-09-12T22:32:24.304183+0000","last_clean":"2024-09-12T22:32:24.304183+0000","last_became_active":"2024-09-12T22:31:36.407062+0000","last_became_peered":"2024-09-12T22:31:36.407062+0000","last_unstale":"2024-09-12T22:32:24.304183+0000","last_undegraded":"2024-09-12T22:32:24.304183+0000","last_fullsized":"2024-09-12T22:32:24.304183+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:09:10.618195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T22:32:24.303281+0000","last_change":"2024-09-12T22:31:37.416629+0000","last_active":"2024-09-12T22:32:24.303281+0000","last_peered":"2024-09-12T22:32:24.303281+0000","last_clean":"2024-09-12T22:32:24.303281+0000","last_became_active":"2024-09-12T22:31:37.416387+0000","last_became_peered":"2024-09-12T22:31:37.416387+0000","last_unstale":"2024-09-12T22:32:24.303281+0000","last_undegraded":"2024-09-12T22:32:24.303281+0000","last_fullsized":"2024-09-12T22:32:24.303281+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:59:52.020560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T22:32:25.310932+0000","last_change":"2024-09-12T22:31:37.413777+0000","last_active":"2024-09-12T22:32:25.310932+0000","last_peered":"2024-09-12T22:32:25.310932+0000","last_clean":"2024-09-12T22:32:25.310932+0000","last_became_active":"2024-09-12T22:31:37.412669+0000","last_became_peered":"2024-09-12T22:31:37.412669+0000","last_unstale":"2024-09-12T22:32:25.310932+0000","last_undegraded":"2024-09-12T22:32:25.310932+0000","last_fullsized":"2024-09-12T22:32:25.310932+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:42:17.728844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T22:32:24.303401+0000","last_change":"2024-09-12T22:31:36.409466+0000","last_active":"2024-09-12T22:32:24.303401+0000","last_peered":"2024-09-12T22:32:24.303401+0000","last_clean":"2024-09-12T22:32:24.303401+0000","last_became_active":"2024-09-12T22:31:36.408796+0000","last_became_peered":"2024-09-12T22:31:36.408796+0000","last_unstale":"2024-09-12T22:32:24.303401+0000","last_undegraded":"2024-09-12T22:32:24.303401+0000","last_fullsized":"2024-09-12T22:32:24.303401+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:03:39.648159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":42,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T22:32:24.304387+0000","last_change":"2024-09-12T22:31:37.411183+0000","last_active":"2024-09-12T22:32:24.304387+0000","last_peered":"2024-09-12T22:32:24.304387+0000","last_clean":"2024-09-12T22:32:24.304387+0000","last_became_active":"2024-09-12T22:31:37.409796+0000","last_became_peered":"2024-09-12T22:31:37.409796+0000","last_unstale":"2024-09-12T22:32:24.304387+0000","last_undegraded":"2024-09-12T22:32:24.304387+0000","last_fullsized":"2024-09-12T22:32:24.304387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:20:35.779810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":44,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T22:32:24.303797+0000","last_change":"2024-09-12T22:31:36.407402+0000","last_active":"2024-09-12T22:32:24.303797+0000","last_peered":"2024-09-12T22:32:24.303797+0000","last_clean":"2024-09-12T22:32:24.303797+0000","last_became_active":"2024-09-12T22:31:36.406681+0000","last_became_peered":"2024-09-12T22:31:36.406681+0000","last_unstale":"2024-09-12T22:32:24.303797+0000","last_undegraded":"2024-09-12T22:32:24.303797+0000","last_fullsized":"2024-09-12T22:32:24.303797+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:39:39.362573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T22:32:25.310495+0000","last_change":"2024-09-12T22:31:37.412817+0000","last_active":"2024-09-12T22:32:25.310495+0000","last_peered":"2024-09-12T22:32:25.310495+0000","last_clean":"2024-09-12T22:32:25.310495+0000","last_became_active":"2024-09-12T22:31:37.411999+0000","last_became_peered":"2024-09-12T22:31:37.411999+0000","last_unstale":"2024-09-12T22:32:25.310495+0000","last_undegraded":"2024-09-12T22:32:25.310495+0000","last_fullsized":"2024-09-12T22:32:25.310495+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:07:02.173590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1","reported_seq":36,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T22:32:24.303377+0000","last_change":"2024-09-12T22:31:57.095289+0000","last_active":"2024-09-12T22:32:24.303377+0000","last_peered":"2024-09-12T22:32:24.303377+0000","last_clean":"2024-09-12T22:32:24.303377+0000","last_became_active":"2024-09-12T22:31:57.095039+0000","last_became_peered":"2024-09-12T22:31:57.095039+0000","last_unstale":"2024-09-12T22:32:24.303377+0000","last_undegraded":"2024-09-12T22:32:24.303377+0000","last_fullsized":"2024-09-12T22:32:24.303377+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:39:50.881312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T22:32:24.303676+0000","last_change":"2024-09-12T22:31:57.095260+0000","last_active":"2024-09-12T22:32:24.303676+0000","last_peered":"2024-09-12T22:32:24.303676+0000","last_clean":"2024-09-12T22:32:24.303676+0000","last_became_active":"2024-09-12T22:31:57.095035+0000","last_became_peered":"2024-09-12T22:31:57.095035+0000","last_unstale":"2024-09-12T22:32:24.303676+0000","last_undegraded":"2024-09-12T22:32:24.303676+0000","last_fullsized":"2024-09-12T22:32:24.303676+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:55:51.885364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"19'1","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T22:32:25.310389+0000","last_change":"2024-09-12T22:31:36.412289+0000","last_active":"2024-09-12T22:32:25.310389+0000","last_peered":"2024-09-12T22:32:25.310389+0000","last_clean":"2024-09-12T22:32:25.310389+0000","last_became_active":"2024-09-12T22:31:36.411985+0000","last_became_peered":"2024-09-12T22:31:36.411985+0000","last_unstale":"2024-09-12T22:32:25.310389+0000","last_undegraded":"2024-09-12T22:32:25.310389+0000","last_fullsized":"2024-09-12T22:32:25.310389+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:30:09.410370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T22:32:25.307743+0000","last_change":"2024-09-12T22:31:37.415365+0000","last_active":"2024-09-12T22:32:25.307743+0000","last_peered":"2024-09-12T22:32:25.307743+0000","last_clean":"2024-09-12T22:32:25.307743+0000","last_became_active":"2024-09-12T22:31:37.413933+0000","last_became_peered":"2024-09-12T22:31:37.413933+0000","last_unstale":"2024-09-12T22:32:25.307743+0000","last_undegraded":"2024-09-12T22:32:25.307743+0000","last_fullsized":"2024-09-12T22:32:25.307743+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:08:07.115355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"19'2","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T22:32:25.307792+0000","last_change":"2024-09-12T22:31:36.411665+0000","last_active":"2024-09-12T22:32:25.307792+0000","last_peered":"2024-09-12T22:32:25.307792+0000","last_clean":"2024-09-12T22:32:25.307792+0000","last_became_active":"2024-09-12T22:31:36.410182+0000","last_became_peered":"2024-09-12T22:31:36.410182+0000","last_unstale":"2024-09-12T22:32:25.307792+0000","last_undegraded":"2024-09-12T22:32:25.307792+0000","last_fullsized":"2024-09-12T22:32:25.307792+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:37:20.891838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T22:32:25.307604+0000","last_change":"2024-09-12T22:31:37.415172+0000","last_active":"2024-09-12T22:32:25.307604+0000","last_peered":"2024-09-12T22:32:25.307604+0000","last_clean":"2024-09-12T22:32:25.307604+0000","last_became_active":"2024-09-12T22:31:37.414776+0000","last_became_peered":"2024-09-12T22:31:37.414776+0000","last_unstale":"2024-09-12T22:32:25.307604+0000","last_undegraded":"2024-09-12T22:32:25.307604+0000","last_fullsized":"2024-09-12T22:32:25.307604+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:42:32.307876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"19'2","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T22:32:25.307909+0000","last_change":"2024-09-12T22:31:57.100908+0000","last_active":"2024-09-12T22:32:25.307909+0000","last_peered":"2024-09-12T22:32:25.307909+0000","last_clean":"2024-09-12T22:32:25.307909+0000","last_became_active":"2024-09-12T22:31:57.100579+0000","last_became_peered":"2024-09-12T22:31:57.100579+0000","last_unstale":"2024-09-12T22:32:25.307909+0000","last_undegraded":"2024-09-12T22:32:25.307909+0000","last_fullsized":"2024-09-12T22:32:25.307909+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:49:56.674930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T22:32:25.310059+0000","last_change":"2024-09-12T22:31:37.409214+0000","last_active":"2024-09-12T22:32:25.310059+0000","last_peered":"2024-09-12T22:32:25.310059+0000","last_clean":"2024-09-12T22:32:25.310059+0000","last_became_active":"2024-09-12T22:31:37.408849+0000","last_became_peered":"2024-09-12T22:31:37.408849+0000","last_unstale":"2024-09-12T22:32:25.310059+0000","last_undegraded":"2024-09-12T22:32:25.310059+0000","last_fullsized":"2024-09-12T22:32:25.310059+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:39:20.383152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"19'1","reported_seq":45,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T22:32:24.304477+0000","last_change":"2024-09-12T22:31:36.410371+0000","last_active":"2024-09-12T22:32:24.304477+0000","last_peered":"2024-09-12T22:32:24.304477+0000","last_clean":"2024-09-12T22:32:24.304477+0000","last_became_active":"2024-09-12T22:31:36.409428+0000","last_became_peered":"2024-09-12T22:31:36.409428+0000","last_unstale":"2024-09-12T22:32:24.304477+0000","last_undegraded":"2024-09-12T22:32:24.304477+0000","last_fullsized":"2024-09-12T22:32:24.304477+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:27:22.817690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T22:32:25.307510+0000","last_change":"2024-09-12T22:31:37.415390+0000","last_active":"2024-09-12T22:32:25.307510+0000","last_peered":"2024-09-12T22:32:25.307510+0000","last_clean":"2024-09-12T22:32:25.307510+0000","last_became_active":"2024-09-12T22:31:37.414781+0000","last_became_peered":"2024-09-12T22:31:37.414781+0000","last_unstale":"2024-09-12T22:32:25.307510+0000","last_undegraded":"2024-09-12T22:32:25.307510+0000","last_fullsized":"2024-09-12T22:32:25.307510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:42:17.728844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"19'4","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T22:32:24.304096+0000","last_change":"2024-09-12T22:31:36.407945+0000","last_active":"2024-09-12T22:32:24.304096+0000","last_peered":"2024-09-12T22:32:24.304096+0000","last_clean":"2024-09-12T22:32:24.304096+0000","last_became_active":"2024-09-12T22:31:36.406959+0000","last_became_peered":"2024-09-12T22:31:36.406959+0000","last_unstale":"2024-09-12T22:32:24.304096+0000","last_undegraded":"2024-09-12T22:32:24.304096+0000","last_fullsized":"2024-09-12T22:32:24.304096+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:26:33.155850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":7353,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":14706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705680,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32112,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339728,"statfs":{"total":96636764160,"available":96603881472,"internally_reserved":0,"allocated":937984,"data_stored":726861,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705680,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32100,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339740,"statfs":{"total":96636764160,"available":96603893760,"internally_reserved":0,"allocated":925696,"data_stored":726226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738384,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31488,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340352,"statfs":{"total":96636764160,"available":96604520448,"internally_reserved":0,"allocated":307200,"data_stored":125495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":6737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":7353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T22:32:30.185 INFO:tasks.thrashosds.thrasher:Setting 4.19 to [2, 0] 2024-09-12T22:32:30.185 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap', '4.19', '2', '0'] 2024-09-12T22:32:30.186 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap 4.19 2 0 2024-09-12T22:32:30.276 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:32:30.275+0000 7fddec6a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30331) UID: 0 2024-09-12T22:32:30.303 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-09-12T22:32:30.303 INFO:teuthology.orchestra.run.smithi076.stdout: "ops": [], 2024-09-12T22:32:30.303 INFO:teuthology.orchestra.run.smithi076.stdout: "num_ops": 0 2024-09-12T22:32:30.303 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-09-12T22:32:30.314 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:32:30.400 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:32:30.399+0000 7fddec6a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30331) UID: 0 2024-09-12T22:32:30.471 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-09-12T22:32:30.471 INFO:teuthology.orchestra.run.smithi076.stdout: "ops": [], 2024-09-12T22:32:30.471 INFO:teuthology.orchestra.run.smithi076.stdout: "complaint_time": 30, 2024-09-12T22:32:30.472 INFO:teuthology.orchestra.run.smithi076.stdout: "num_blocked_ops": 0 2024-09-12T22:32:30.472 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-09-12T22:32:30.477 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:32:30.476+0000 7fddec6a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30331) UID: 0 2024-09-12T22:32:30.481 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:32:30.578 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:32:30.577+0000 7fddec6a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30331) UID: 0 2024-09-12T22:32:30.628 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-09-12T22:32:30.628 INFO:teuthology.orchestra.run.smithi076.stdout: "size": 20, 2024-09-12T22:32:30.628 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 600, 2024-09-12T22:32:30.628 INFO:teuthology.orchestra.run.smithi076.stdout: "ops": [ 2024-09-12T22:32:30.628 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.629 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:30.629 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.400604+0000", 2024-09-12T22:32:30.629 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 53.226256917000001, 2024-09-12T22:32:30.629 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.017278814, 2024-09-12T22:32:30.629 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:30.629 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:30.629 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:30.629 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:30.629 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.629 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:30.629 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400604+0000", 2024-09-12T22:32:30.630 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:30.630 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.630 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.630 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:30.630 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400604+0000", 2024-09-12T22:32:30.630 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:30.630 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.630 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.630 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:30.630 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400617+0000", 2024-09-12T22:32:30.630 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.3076e-05 2024-09-12T22:32:30.630 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.631 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.631 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:30.631 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400623+0000", 2024-09-12T22:32:30.631 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.5780000000000004e-06 2024-09-12T22:32:30.631 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.631 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.632 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:30.632 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400641+0000", 2024-09-12T22:32:30.632 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.8218000000000001e-05 2024-09-12T22:32:30.632 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.633 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.633 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:30.633 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400652+0000", 2024-09-12T22:32:30.633 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.0421999999999999e-05 2024-09-12T22:32:30.633 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.633 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.633 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:30.633 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400707+0000", 2024-09-12T22:32:30.633 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.4666000000000001e-05 2024-09-12T22:32:30.633 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.633 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.634 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op must wait for map", 2024-09-12T22:32:30.634 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400711+0000", 2024-09-12T22:32:30.634 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.5340000000000001e-06 2024-09-12T22:32:30.634 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.634 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.635 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:30.635 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.412066+0000", 2024-09-12T22:32:30.635 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.011354797999999999 2024-09-12T22:32:30.635 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.635 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.635 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:30.635 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.412672+0000", 2024-09-12T22:32:30.635 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00060620499999999996 2024-09-12T22:32:30.635 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.635 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.636 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:30.636 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.413032+0000", 2024-09-12T22:32:30.636 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00035955999999999998 2024-09-12T22:32:30.636 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.637 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.637 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op_commit", 2024-09-12T22:32:30.637 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417252+0000", 2024-09-12T22:32:30.637 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.004219899 2024-09-12T22:32:30.637 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.637 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.637 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:30.637 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417812+0000", 2024-09-12T22:32:30.637 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.000560182 2024-09-12T22:32:30.637 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.637 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.637 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:30.638 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417851+0000", 2024-09-12T22:32:30.638 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.9057999999999998e-05 2024-09-12T22:32:30.638 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.638 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.638 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:30.638 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417882+0000", 2024-09-12T22:32:30.638 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.1618000000000001e-05 2024-09-12T22:32:30.638 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:30.638 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:30.638 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:30.638 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.638 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.638 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:30.638 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.400674+0000", 2024-09-12T22:32:30.639 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 53.226186198999997, 2024-09-12T22:32:30.639 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.017348971000000001, 2024-09-12T22:32:30.639 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:30.639 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:30.639 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:30.639 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:30.639 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.639 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:30.639 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400674+0000", 2024-09-12T22:32:30.639 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:30.639 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.639 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.639 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:30.640 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400674+0000", 2024-09-12T22:32:30.640 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:30.640 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.640 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.640 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:30.640 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400675+0000", 2024-09-12T22:32:30.640 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.37e-07 2024-09-12T22:32:30.640 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.640 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.640 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:30.640 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400678+0000", 2024-09-12T22:32:30.640 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.303e-06 2024-09-12T22:32:30.640 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.640 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.641 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:30.641 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400684+0000", 2024-09-12T22:32:30.641 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.0290000000000002e-06 2024-09-12T22:32:30.641 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.641 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.641 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:30.641 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400688+0000", 2024-09-12T22:32:30.641 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.0890000000000002e-06 2024-09-12T22:32:30.641 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.641 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.641 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:30.641 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400806+0000", 2024-09-12T22:32:30.641 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00011814700000000001 2024-09-12T22:32:30.642 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.642 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.642 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:32:30.642 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400811+0000", 2024-09-12T22:32:30.642 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.0479999999999998e-06 2024-09-12T22:32:30.642 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.642 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.642 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:30.642 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.413877+0000", 2024-09-12T22:32:30.642 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.013065561 2024-09-12T22:32:30.642 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.642 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.642 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:30.642 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.413984+0000", 2024-09-12T22:32:30.643 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.000106566 2024-09-12T22:32:30.643 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.643 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.643 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:30.643 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.414264+0000", 2024-09-12T22:32:30.643 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00028067199999999999 2024-09-12T22:32:30.643 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.643 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.643 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op_commit", 2024-09-12T22:32:30.643 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417614+0000", 2024-09-12T22:32:30.643 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0033500729999999999 2024-09-12T22:32:30.643 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.643 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.643 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:30.644 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417946+0000", 2024-09-12T22:32:30.644 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00033209199999999998 2024-09-12T22:32:30.644 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.644 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.644 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:30.644 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417995+0000", 2024-09-12T22:32:30.644 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.808e-05 2024-09-12T22:32:30.644 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.644 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.644 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:30.644 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.418023+0000", 2024-09-12T22:32:30.644 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.8773999999999999e-05 2024-09-12T22:32:30.644 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:30.645 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:30.645 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:30.645 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.645 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.645 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:30.645 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.400694+0000", 2024-09-12T22:32:30.645 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 53.226166569999997, 2024-09-12T22:32:30.645 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.022845628, 2024-09-12T22:32:30.645 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:30.645 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:30.645 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:30.645 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:30.645 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.646 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:30.646 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400694+0000", 2024-09-12T22:32:30.646 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:30.646 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.646 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.646 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:30.646 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400694+0000", 2024-09-12T22:32:30.646 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:30.646 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.646 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.646 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:30.646 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400694+0000", 2024-09-12T22:32:30.646 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.48e-07 2024-09-12T22:32:30.647 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.647 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.647 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:30.647 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400709+0000", 2024-09-12T22:32:30.647 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.4888999999999999e-05 2024-09-12T22:32:30.647 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.647 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.647 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:30.647 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400722+0000", 2024-09-12T22:32:30.647 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.2882e-05 2024-09-12T22:32:30.647 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.647 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.647 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:30.647 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400732+0000", 2024-09-12T22:32:30.648 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.0299000000000001e-05 2024-09-12T22:32:30.648 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.648 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.648 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:30.648 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400793+0000", 2024-09-12T22:32:30.648 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.0253000000000001e-05 2024-09-12T22:32:30.648 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.648 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.648 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op must wait for map", 2024-09-12T22:32:30.648 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400798+0000", 2024-09-12T22:32:30.648 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.1569999999999999e-06 2024-09-12T22:32:30.648 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.648 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.649 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:30.649 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415059+0000", 2024-09-12T22:32:30.649 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.014260907 2024-09-12T22:32:30.649 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.649 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.649 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:30.649 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415396+0000", 2024-09-12T22:32:30.649 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00033720799999999997 2024-09-12T22:32:30.649 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.649 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.649 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:30.649 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415685+0000", 2024-09-12T22:32:30.649 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00028939900000000003 2024-09-12T22:32:30.650 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.650 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.650 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op_commit", 2024-09-12T22:32:30.650 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.418302+0000", 2024-09-12T22:32:30.650 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0026168039999999999 2024-09-12T22:32:30.650 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.650 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.650 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:30.650 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.423445+0000", 2024-09-12T22:32:30.650 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0051428150000000002 2024-09-12T22:32:30.650 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.650 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.650 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:30.650 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.423499+0000", 2024-09-12T22:32:30.651 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.3953000000000003e-05 2024-09-12T22:32:30.651 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.651 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.651 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:30.651 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.423540+0000", 2024-09-12T22:32:30.651 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.0813999999999999e-05 2024-09-12T22:32:30.651 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:30.651 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:30.651 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:30.651 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.651 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.651 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:30.651 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.400740+0000", 2024-09-12T22:32:30.651 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 53.226120846999997, 2024-09-12T22:32:30.652 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.022927528999999999, 2024-09-12T22:32:30.652 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:30.652 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:30.652 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:30.652 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:30.652 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.652 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:30.652 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400740+0000", 2024-09-12T22:32:30.652 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:30.652 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.652 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.652 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:30.652 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400740+0000", 2024-09-12T22:32:30.653 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:30.653 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.653 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.653 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:30.653 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400740+0000", 2024-09-12T22:32:30.653 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.3000000000000001e-07 2024-09-12T22:32:30.653 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.656 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.656 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:30.656 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400743+0000", 2024-09-12T22:32:30.657 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.5840000000000002e-06 2024-09-12T22:32:30.657 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.657 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.657 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:30.657 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400757+0000", 2024-09-12T22:32:30.657 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.3988999999999999e-05 2024-09-12T22:32:30.657 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.657 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.657 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:30.657 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400763+0000", 2024-09-12T22:32:30.657 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.686e-06 2024-09-12T22:32:30.657 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.657 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.658 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:30.658 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400818+0000", 2024-09-12T22:32:30.658 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.4941000000000001e-05 2024-09-12T22:32:30.658 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.658 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.658 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:32:30.658 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400824+0000", 2024-09-12T22:32:30.658 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.4600000000000002e-06 2024-09-12T22:32:30.658 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.658 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.658 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:30.658 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416227+0000", 2024-09-12T22:32:30.658 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.015403604 2024-09-12T22:32:30.658 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.659 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.659 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:30.659 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416306+0000", 2024-09-12T22:32:30.659 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 7.9126000000000001e-05 2024-09-12T22:32:30.659 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.659 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.659 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:30.659 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416678+0000", 2024-09-12T22:32:30.659 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00037105500000000002 2024-09-12T22:32:30.659 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.659 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.659 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op_commit", 2024-09-12T22:32:30.659 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.418363+0000", 2024-09-12T22:32:30.660 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.001685095 2024-09-12T22:32:30.660 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.660 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.660 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:30.660 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.423591+0000", 2024-09-12T22:32:30.660 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0052283980000000004 2024-09-12T22:32:30.660 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.660 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.660 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:30.660 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.423624+0000", 2024-09-12T22:32:30.660 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.3024000000000001e-05 2024-09-12T22:32:30.660 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.660 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.660 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:30.661 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.423667+0000", 2024-09-12T22:32:30.661 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.3136999999999997e-05 2024-09-12T22:32:30.661 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:30.661 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:30.661 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:30.661 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.661 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.661 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:30.661 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.400783+0000", 2024-09-12T22:32:30.661 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 53.226077314999998, 2024-09-12T22:32:30.661 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.016563729999999999, 2024-09-12T22:32:30.661 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:30.661 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:30.662 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:30.662 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:30.662 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.662 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:30.662 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400783+0000", 2024-09-12T22:32:30.662 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:30.662 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.662 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.662 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:30.662 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400783+0000", 2024-09-12T22:32:30.662 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:30.662 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.662 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.662 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:30.663 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400784+0000", 2024-09-12T22:32:30.663 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.5900000000000002e-07 2024-09-12T22:32:30.663 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.663 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.663 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:30.663 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400787+0000", 2024-09-12T22:32:30.663 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.1690000000000001e-06 2024-09-12T22:32:30.664 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.665 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.665 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:30.665 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400794+0000", 2024-09-12T22:32:30.665 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 7.058e-06 2024-09-12T22:32:30.665 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.665 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.665 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:30.665 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400798+0000", 2024-09-12T22:32:30.665 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.335e-06 2024-09-12T22:32:30.665 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.665 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.665 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:30.665 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400841+0000", 2024-09-12T22:32:30.666 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.2369e-05 2024-09-12T22:32:30.666 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.666 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.666 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op must wait for map", 2024-09-12T22:32:30.666 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400844+0000", 2024-09-12T22:32:30.666 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.128e-06 2024-09-12T22:32:30.666 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.666 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.666 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:30.666 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.410479+0000", 2024-09-12T22:32:30.666 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0096354189999999992 2024-09-12T22:32:30.666 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.666 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.666 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:30.667 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.410597+0000", 2024-09-12T22:32:30.667 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.000118305 2024-09-12T22:32:30.667 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.667 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.667 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:30.667 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.410838+0000", 2024-09-12T22:32:30.667 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.000240967 2024-09-12T22:32:30.667 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.667 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.667 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op_commit", 2024-09-12T22:32:30.667 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416489+0000", 2024-09-12T22:32:30.667 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0056507989999999998 2024-09-12T22:32:30.667 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.667 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.668 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:30.668 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417255+0000", 2024-09-12T22:32:30.668 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00076626199999999998 2024-09-12T22:32:30.668 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.668 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.668 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:30.668 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417306+0000", 2024-09-12T22:32:30.668 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.0319999999999999e-05 2024-09-12T22:32:30.668 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.668 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.668 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:30.668 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417347+0000", 2024-09-12T22:32:30.668 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.1140000000000003e-05 2024-09-12T22:32:30.669 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:30.669 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:30.669 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:30.669 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.669 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.669 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:30.669 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.400811+0000", 2024-09-12T22:32:30.669 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 53.226049246000002, 2024-09-12T22:32:30.669 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.017061263, 2024-09-12T22:32:30.669 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:30.669 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:30.669 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:30.669 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:30.669 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.670 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:30.670 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400811+0000", 2024-09-12T22:32:30.670 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:30.670 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.670 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.670 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:30.670 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400811+0000", 2024-09-12T22:32:30.670 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:30.670 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.670 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.670 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:30.670 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400812+0000", 2024-09-12T22:32:30.670 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.27e-07 2024-09-12T22:32:30.670 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.671 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.671 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:30.671 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400814+0000", 2024-09-12T22:32:30.671 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.553e-06 2024-09-12T22:32:30.671 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.671 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.671 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:30.671 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400819+0000", 2024-09-12T22:32:30.671 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.3569999999999997e-06 2024-09-12T22:32:30.671 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.671 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.671 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:30.671 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400824+0000", 2024-09-12T22:32:30.672 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.6820000000000002e-06 2024-09-12T22:32:30.672 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.672 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.672 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:30.672 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400871+0000", 2024-09-12T22:32:30.672 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.7311000000000002e-05 2024-09-12T22:32:30.672 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.672 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.672 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:32:30.672 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400875+0000", 2024-09-12T22:32:30.672 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.0960000000000001e-06 2024-09-12T22:32:30.672 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.672 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.672 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:30.673 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.412071+0000", 2024-09-12T22:32:30.673 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.011195999999999999 2024-09-12T22:32:30.673 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.673 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.673 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:30.673 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.412520+0000", 2024-09-12T22:32:30.673 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.000449522 2024-09-12T22:32:30.673 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.673 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.673 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:30.673 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.412655+0000", 2024-09-12T22:32:30.673 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00013487899999999999 2024-09-12T22:32:30.673 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.673 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.674 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op_commit", 2024-09-12T22:32:30.674 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417096+0000", 2024-09-12T22:32:30.674 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.004441113 2024-09-12T22:32:30.674 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.674 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.674 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:30.674 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417768+0000", 2024-09-12T22:32:30.674 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00067161100000000002 2024-09-12T22:32:30.674 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.674 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.674 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:30.674 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417834+0000", 2024-09-12T22:32:30.674 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.6058999999999999e-05 2024-09-12T22:32:30.675 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.675 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.675 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:30.675 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417873+0000", 2024-09-12T22:32:30.675 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.8753e-05 2024-09-12T22:32:30.675 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:30.675 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:30.675 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:30.675 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.675 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.675 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:30.675 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.400842+0000", 2024-09-12T22:32:30.675 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 53.226018539000002, 2024-09-12T22:32:30.675 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.022846262999999999, 2024-09-12T22:32:30.676 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:30.676 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:30.676 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:30.676 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:30.676 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.676 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:30.676 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400842+0000", 2024-09-12T22:32:30.676 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:30.676 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.676 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.676 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:30.676 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400842+0000", 2024-09-12T22:32:30.676 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:30.676 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.677 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.677 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:30.677 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400842+0000", 2024-09-12T22:32:30.677 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.9900000000000002e-07 2024-09-12T22:32:30.677 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.677 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.677 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:30.677 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400845+0000", 2024-09-12T22:32:30.677 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.8609999999999998e-06 2024-09-12T22:32:30.677 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.677 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.677 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:30.677 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400850+0000", 2024-09-12T22:32:30.678 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.634e-06 2024-09-12T22:32:30.678 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.678 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.678 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:30.678 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400855+0000", 2024-09-12T22:32:30.678 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.8339999999999998e-06 2024-09-12T22:32:30.678 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.678 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.678 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:30.678 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400886+0000", 2024-09-12T22:32:30.678 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.1393999999999998e-05 2024-09-12T22:32:30.678 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.678 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.678 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:32:30.679 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400888+0000", 2024-09-12T22:32:30.679 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.3470000000000001e-06 2024-09-12T22:32:30.679 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.679 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.679 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:30.679 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415640+0000", 2024-09-12T22:32:30.679 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.014751965000000001 2024-09-12T22:32:30.679 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.679 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.679 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:30.679 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415821+0000", 2024-09-12T22:32:30.679 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00018064399999999999 2024-09-12T22:32:30.679 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.679 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.680 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:30.680 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415949+0000", 2024-09-12T22:32:30.680 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00012816699999999999 2024-09-12T22:32:30.680 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.680 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.680 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op_commit", 2024-09-12T22:32:30.680 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.418337+0000", 2024-09-12T22:32:30.680 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0023878469999999998 2024-09-12T22:32:30.680 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.680 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.680 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:30.680 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.423588+0000", 2024-09-12T22:32:30.680 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0052509849999999997 2024-09-12T22:32:30.681 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.681 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.681 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:30.681 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.423650+0000", 2024-09-12T22:32:30.681 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.2026999999999994e-05 2024-09-12T22:32:30.681 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.681 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.681 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:30.681 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.423688+0000", 2024-09-12T22:32:30.681 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.8259000000000001e-05 2024-09-12T22:32:30.681 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:30.681 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:30.681 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:30.681 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.682 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.682 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:30.682 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.400862+0000", 2024-09-12T22:32:30.682 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 53.225998564999998, 2024-09-12T22:32:30.682 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.016404294, 2024-09-12T22:32:30.682 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:30.682 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:30.682 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "started", 2024-09-12T22:32:30.682 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:30.682 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.682 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:30.682 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400862+0000", 2024-09-12T22:32:30.682 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:30.682 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.683 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.683 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:30.683 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400862+0000", 2024-09-12T22:32:30.683 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:30.683 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.683 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.683 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:30.683 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400862+0000", 2024-09-12T22:32:30.683 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.8099999999999999e-07 2024-09-12T22:32:30.683 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.683 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.683 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:30.683 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400870+0000", 2024-09-12T22:32:30.684 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 8.1349999999999992e-06 2024-09-12T22:32:30.684 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.684 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.684 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:30.684 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400876+0000", 2024-09-12T22:32:30.684 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.2039999999999996e-06 2024-09-12T22:32:30.684 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.684 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.684 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:30.684 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400879+0000", 2024-09-12T22:32:30.684 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.529e-06 2024-09-12T22:32:30.684 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.684 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.684 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:30.685 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400912+0000", 2024-09-12T22:32:30.685 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.2653000000000001e-05 2024-09-12T22:32:30.685 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.685 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.685 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op must wait for map", 2024-09-12T22:32:30.685 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400915+0000", 2024-09-12T22:32:30.685 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.1099999999999999e-06 2024-09-12T22:32:30.685 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.685 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.685 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:30.685 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408727+0000", 2024-09-12T22:32:30.685 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0078123869999999996 2024-09-12T22:32:30.685 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.685 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.686 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:30.686 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408838+0000", 2024-09-12T22:32:30.686 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00011042700000000001 2024-09-12T22:32:30.686 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.686 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.686 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:30.686 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417266+0000", 2024-09-12T22:32:30.686 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0084285680000000009 2024-09-12T22:32:30.686 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:30.686 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:30.686 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:30.686 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.686 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.687 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:30.687 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.400889+0000", 2024-09-12T22:32:30.687 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 53.225971311999999, 2024-09-12T22:32:30.687 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.014929550999999999, 2024-09-12T22:32:30.687 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:30.687 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:30.687 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "started", 2024-09-12T22:32:30.687 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:30.687 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.687 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:30.687 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400889+0000", 2024-09-12T22:32:30.687 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:30.687 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.687 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.688 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:30.688 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400889+0000", 2024-09-12T22:32:30.688 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:30.688 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.688 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.688 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:30.688 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400890+0000", 2024-09-12T22:32:30.688 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.8699999999999995e-07 2024-09-12T22:32:30.688 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.689 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.689 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:30.689 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400893+0000", 2024-09-12T22:32:30.689 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.9569999999999998e-06 2024-09-12T22:32:30.689 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.689 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.689 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:30.689 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400899+0000", 2024-09-12T22:32:30.689 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.4189999999999999e-06 2024-09-12T22:32:30.689 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.689 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.690 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:30.690 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400905+0000", 2024-09-12T22:32:30.690 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.7880000000000003e-06 2024-09-12T22:32:30.690 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.690 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.690 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:30.690 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400943+0000", 2024-09-12T22:32:30.690 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.7852999999999998e-05 2024-09-12T22:32:30.690 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.690 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.690 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op must wait for map", 2024-09-12T22:32:30.690 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400945+0000", 2024-09-12T22:32:30.690 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.627e-06 2024-09-12T22:32:30.691 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.691 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.691 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:30.691 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408398+0000", 2024-09-12T22:32:30.691 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0074525879999999996 2024-09-12T22:32:30.691 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.691 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.691 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:30.691 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408581+0000", 2024-09-12T22:32:30.691 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00018321900000000001 2024-09-12T22:32:30.691 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.691 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.691 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:30.691 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415819+0000", 2024-09-12T22:32:30.692 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0072376130000000004 2024-09-12T22:32:30.692 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:30.692 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:30.692 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:30.692 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.692 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.692 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:25 3.7 e19/17 3:e0b41d06:::609.00000000:head v 19'2, mlcod=0'0)", 2024-09-12T22:32:30.693 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.402511+0000", 2024-09-12T22:32:30.693 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 53.224349169, 2024-09-12T22:32:30.693 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0089735260000000008, 2024-09-12T22:32:30.693 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:30.693 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:30.693 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:30.693 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:30.693 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.693 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:30.693 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.402511+0000", 2024-09-12T22:32:30.693 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:30.693 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.693 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.694 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:30.694 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.402511+0000", 2024-09-12T22:32:30.694 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:30.694 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.694 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.694 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:30.694 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.402512+0000", 2024-09-12T22:32:30.694 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 8.71e-07 2024-09-12T22:32:30.694 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.694 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.694 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:30.694 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.402520+0000", 2024-09-12T22:32:30.694 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 7.8529999999999992e-06 2024-09-12T22:32:30.694 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.695 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.695 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:30.695 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.402530+0000", 2024-09-12T22:32:30.695 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 9.859e-06 2024-09-12T22:32:30.695 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.695 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.695 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:30.695 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.402555+0000", 2024-09-12T22:32:30.695 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.4822000000000001e-05 2024-09-12T22:32:30.695 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.695 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.695 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:30.695 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.403173+0000", 2024-09-12T22:32:30.695 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00061813199999999997 2024-09-12T22:32:30.696 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.696 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.696 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:30.696 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.403195+0000", 2024-09-12T22:32:30.696 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.2286e-05 2024-09-12T22:32:30.696 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.696 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.697 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:30.697 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.411436+0000", 2024-09-12T22:32:30.697 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0082410539999999994 2024-09-12T22:32:30.697 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.697 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.697 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:30.697 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.411485+0000", 2024-09-12T22:32:30.697 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.8649000000000001e-05 2024-09-12T22:32:30.697 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:30.698 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:30.698 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:30.698 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.698 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.698 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:18 3.14 e19/17 3:2f55791f:::606.00000000:head v 19'1, mlcod=0'0)", 2024-09-12T22:32:30.698 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.406646+0000", 2024-09-12T22:32:30.698 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 53.220214017000004, 2024-09-12T22:32:30.698 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0082036980000000006, 2024-09-12T22:32:30.698 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:30.698 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:30.698 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:30.698 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:30.698 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.698 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:30.699 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406646+0000", 2024-09-12T22:32:30.699 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:30.699 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.699 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.699 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:30.699 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406646+0000", 2024-09-12T22:32:30.699 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:30.699 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.699 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.699 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:30.699 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406647+0000", 2024-09-12T22:32:30.699 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.4499999999999998e-07 2024-09-12T22:32:30.700 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.700 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.700 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:30.700 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406651+0000", 2024-09-12T22:32:30.700 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.0300000000000004e-06 2024-09-12T22:32:30.700 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.700 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.700 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:30.700 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406657+0000", 2024-09-12T22:32:30.700 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.1330000000000004e-06 2024-09-12T22:32:30.700 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.700 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.700 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:30.701 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406665+0000", 2024-09-12T22:32:30.701 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 8.3650000000000004e-06 2024-09-12T22:32:30.701 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.701 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.701 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:30.701 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406804+0000", 2024-09-12T22:32:30.701 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00013900699999999999 2024-09-12T22:32:30.701 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.701 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.701 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:30.701 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406833+0000", 2024-09-12T22:32:30.701 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.8243e-05 2024-09-12T22:32:30.701 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.701 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.702 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:30.702 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.414741+0000", 2024-09-12T22:32:30.702 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0079089620000000003 2024-09-12T22:32:30.702 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.702 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.702 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:30.702 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.414850+0000", 2024-09-12T22:32:30.702 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.000108713 2024-09-12T22:32:30.702 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:30.702 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:30.702 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:30.702 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.702 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.702 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:6 3.10 e19/17 3:0d82a743:::600.00000000:head v 19'1, mlcod=0'0)", 2024-09-12T22:32:30.703 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.406692+0000", 2024-09-12T22:32:30.703 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 53.22016825, 2024-09-12T22:32:30.703 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0093004430000000003, 2024-09-12T22:32:30.703 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:30.703 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:30.703 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:30.703 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:30.703 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.703 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:30.703 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406692+0000", 2024-09-12T22:32:30.703 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:30.703 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.703 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.703 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:30.704 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406692+0000", 2024-09-12T22:32:30.704 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:30.704 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.704 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.704 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:30.704 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406693+0000", 2024-09-12T22:32:30.704 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.6300000000000001e-07 2024-09-12T22:32:30.704 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.704 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.704 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:30.705 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406702+0000", 2024-09-12T22:32:30.705 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 9.5589999999999994e-06 2024-09-12T22:32:30.705 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.705 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.705 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:30.705 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406725+0000", 2024-09-12T22:32:30.705 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.2977999999999999e-05 2024-09-12T22:32:30.705 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.705 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.705 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:30.705 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406732+0000", 2024-09-12T22:32:30.705 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.8430000000000004e-06 2024-09-12T22:32:30.706 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.706 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.706 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:30.706 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406979+0000", 2024-09-12T22:32:30.706 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00024729199999999998 2024-09-12T22:32:30.706 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.706 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.706 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:30.706 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407000+0000", 2024-09-12T22:32:30.706 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.0573000000000001e-05 2024-09-12T22:32:30.706 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.706 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.706 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:30.706 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415928+0000", 2024-09-12T22:32:30.707 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0089286179999999993 2024-09-12T22:32:30.707 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.707 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.707 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:30.707 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415993+0000", 2024-09-12T22:32:30.707 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.4216999999999999e-05 2024-09-12T22:32:30.707 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:30.707 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:30.707 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:30.707 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.707 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.707 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:2 3.f e19/17 3:f1f69726:::400.00000000:head v 19'1, mlcod=0'0)", 2024-09-12T22:32:30.707 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.406942+0000", 2024-09-12T22:32:30.707 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 53.219918563, 2024-09-12T22:32:30.708 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0098433259999999995, 2024-09-12T22:32:30.708 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:30.708 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:30.708 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:30.708 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:30.708 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.708 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:30.708 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406942+0000", 2024-09-12T22:32:30.708 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:30.709 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.709 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.709 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:30.709 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406942+0000", 2024-09-12T22:32:30.709 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:30.709 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.709 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.709 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:30.709 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406943+0000", 2024-09-12T22:32:30.709 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.8800000000000002e-07 2024-09-12T22:32:30.709 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.709 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.709 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:30.710 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406949+0000", 2024-09-12T22:32:30.710 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.5869999999999998e-06 2024-09-12T22:32:30.710 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.710 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.710 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:30.710 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406960+0000", 2024-09-12T22:32:30.710 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.0873000000000001e-05 2024-09-12T22:32:30.710 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.710 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.710 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:30.710 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406970+0000", 2024-09-12T22:32:30.710 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 9.9119999999999993e-06 2024-09-12T22:32:30.710 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.711 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.711 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:30.711 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407535+0000", 2024-09-12T22:32:30.711 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00056508899999999996 2024-09-12T22:32:30.711 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.711 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.711 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:30.711 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407556+0000", 2024-09-12T22:32:30.711 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.1348999999999998e-05 2024-09-12T22:32:30.711 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.711 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.711 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:30.711 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416751+0000", 2024-09-12T22:32:30.711 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0091950109999999995 2024-09-12T22:32:30.712 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.712 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.712 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:30.712 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416785+0000", 2024-09-12T22:32:30.712 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.3917000000000001e-05 2024-09-12T22:32:30.712 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:30.712 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:30.712 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:30.712 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.712 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.712 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:19 3.14 e19/17 3:2f55791f:::606.00000000:head v 19'2, mlcod=0'0)", 2024-09-12T22:32:30.712 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.406983+0000", 2024-09-12T22:32:30.712 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 53.219877584000002, 2024-09-12T22:32:30.713 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0080362149999999993, 2024-09-12T22:32:30.713 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:30.713 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:30.713 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:30.713 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:30.713 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.713 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:30.713 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406983+0000", 2024-09-12T22:32:30.713 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:30.713 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.713 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.713 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:30.714 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406983+0000", 2024-09-12T22:32:30.714 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:30.714 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.714 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.714 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:30.714 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406983+0000", 2024-09-12T22:32:30.715 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.8200000000000001e-07 2024-09-12T22:32:30.715 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.715 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.715 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:30.715 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406999+0000", 2024-09-12T22:32:30.715 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.5747999999999999e-05 2024-09-12T22:32:30.715 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.715 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.715 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:30.715 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407006+0000", 2024-09-12T22:32:30.715 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 7.2609999999999996e-06 2024-09-12T22:32:30.715 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.715 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.715 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:30.716 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407035+0000", 2024-09-12T22:32:30.716 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.8214000000000001e-05 2024-09-12T22:32:30.716 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.716 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.716 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:30.716 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407092+0000", 2024-09-12T22:32:30.716 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.7027000000000001e-05 2024-09-12T22:32:30.716 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.716 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.716 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:30.716 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407126+0000", 2024-09-12T22:32:30.716 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.4082000000000003e-05 2024-09-12T22:32:30.716 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.717 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.717 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:30.717 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.414985+0000", 2024-09-12T22:32:30.717 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0078597319999999995 2024-09-12T22:32:30.717 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.717 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.717 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:30.717 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415019+0000", 2024-09-12T22:32:30.717 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.3769000000000001e-05 2024-09-12T22:32:30.717 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:30.717 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:30.717 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:30.717 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.717 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.718 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:7 3.10 e19/17 3:0d82a743:::600.00000000:head v 19'2, mlcod=0'0)", 2024-09-12T22:32:30.718 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.407048+0000", 2024-09-12T22:32:30.718 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 53.219812046000001, 2024-09-12T22:32:30.718 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.008979931, 2024-09-12T22:32:30.718 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:30.718 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:30.718 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:30.718 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:30.718 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.718 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:30.718 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407048+0000", 2024-09-12T22:32:30.718 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:30.718 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.718 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.719 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:30.719 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407048+0000", 2024-09-12T22:32:30.719 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:30.719 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.719 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.719 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:30.719 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407049+0000", 2024-09-12T22:32:30.719 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.9099999999999999e-07 2024-09-12T22:32:30.719 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.719 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.719 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:30.719 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407054+0000", 2024-09-12T22:32:30.719 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.1850000000000003e-06 2024-09-12T22:32:30.719 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.720 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.720 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:30.720 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407061+0000", 2024-09-12T22:32:30.720 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 7.0809999999999996e-06 2024-09-12T22:32:30.720 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.720 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.720 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:30.720 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407067+0000", 2024-09-12T22:32:30.720 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.9540000000000001e-06 2024-09-12T22:32:30.720 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.720 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.720 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:30.720 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407299+0000", 2024-09-12T22:32:30.720 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.000232122 2024-09-12T22:32:30.721 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.721 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.721 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:30.721 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407317+0000", 2024-09-12T22:32:30.721 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.7447000000000001e-05 2024-09-12T22:32:30.721 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.721 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.721 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:30.721 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415996+0000", 2024-09-12T22:32:30.721 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0086791799999999999 2024-09-12T22:32:30.721 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.721 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.721 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:30.722 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416028+0000", 2024-09-12T22:32:30.722 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.2570999999999997e-05 2024-09-12T22:32:30.722 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:30.722 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:30.722 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:30.722 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.722 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.722 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:8 3.10 e19/17 3:09401a81:::601.00000000:head v 19'3, mlcod=0'0)", 2024-09-12T22:32:30.722 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.407081+0000", 2024-09-12T22:32:30.722 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 53.219779355999997, 2024-09-12T22:32:30.722 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0089807270000000008, 2024-09-12T22:32:30.722 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:30.722 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:30.722 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:30.723 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:30.723 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.723 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:30.723 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407081+0000", 2024-09-12T22:32:30.723 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:30.723 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.723 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.723 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:30.723 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407081+0000", 2024-09-12T22:32:30.723 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:30.723 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.723 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.723 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:30.723 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407082+0000", 2024-09-12T22:32:30.724 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.7899999999999999e-07 2024-09-12T22:32:30.724 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.724 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.724 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:30.724 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407086+0000", 2024-09-12T22:32:30.724 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.7679999999999999e-06 2024-09-12T22:32:30.724 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.724 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.724 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:30.724 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407094+0000", 2024-09-12T22:32:30.724 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 8.1470000000000001e-06 2024-09-12T22:32:30.724 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.724 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.725 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:30.725 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407100+0000", 2024-09-12T22:32:30.725 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.4539999999999998e-06 2024-09-12T22:32:30.725 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.725 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.725 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:30.725 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407540+0000", 2024-09-12T22:32:30.725 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00043973699999999999 2024-09-12T22:32:30.725 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.725 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.725 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:30.725 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407553+0000", 2024-09-12T22:32:30.725 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.3368e-05 2024-09-12T22:32:30.726 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.726 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.726 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:30.726 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416032+0000", 2024-09-12T22:32:30.726 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0084793790000000004 2024-09-12T22:32:30.726 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.726 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.726 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:30.726 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416062+0000", 2024-09-12T22:32:30.726 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.9495000000000001e-05 2024-09-12T22:32:30.726 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:30.726 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:30.726 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:30.726 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.727 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.727 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:31 3.d e19/17 3:b50e409b:::mds_snaptable:head v 19'1, mlcod=0'0)", 2024-09-12T22:32:30.727 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.408508+0000", 2024-09-12T22:32:30.727 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 53.218352840000001, 2024-09-12T22:32:30.727 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0080056620000000002, 2024-09-12T22:32:30.727 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:30.727 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:30.727 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:30.727 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:30.727 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.727 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:30.727 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408508+0000", 2024-09-12T22:32:30.727 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:30.727 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.728 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.728 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:30.728 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408508+0000", 2024-09-12T22:32:30.728 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:30.728 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.728 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.728 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:30.728 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408508+0000", 2024-09-12T22:32:30.728 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.7e-07 2024-09-12T22:32:30.728 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.728 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.728 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:30.728 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408515+0000", 2024-09-12T22:32:30.729 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.4439999999999996e-06 2024-09-12T22:32:30.729 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.729 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.729 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:30.729 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408521+0000", 2024-09-12T22:32:30.729 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.2729999999999999e-06 2024-09-12T22:32:30.729 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.729 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.729 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:30.729 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408526+0000", 2024-09-12T22:32:30.729 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.3299999999999998e-06 2024-09-12T22:32:30.729 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.729 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.729 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:30.730 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.410190+0000", 2024-09-12T22:32:30.730 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.001663615 2024-09-12T22:32:30.730 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.730 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.730 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:30.730 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.410258+0000", 2024-09-12T22:32:30.730 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.8146999999999997e-05 2024-09-12T22:32:30.730 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.730 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.730 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:30.730 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416477+0000", 2024-09-12T22:32:30.730 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0062187329999999997 2024-09-12T22:32:30.730 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.730 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.731 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:30.731 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416513+0000", 2024-09-12T22:32:30.731 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.6650000000000003e-05 2024-09-12T22:32:30.731 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:30.731 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:30.731 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:30.731 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.731 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.731 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:9 3.10 e19/17 3:09401a81:::601.00000000:head v 19'4, mlcod=0'0)", 2024-09-12T22:32:30.731 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.408991+0000", 2024-09-12T22:32:30.731 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 53.217869090000001, 2024-09-12T22:32:30.731 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0080459209999999993, 2024-09-12T22:32:30.731 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:30.732 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:30.732 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:30.732 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:30.732 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.732 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:30.732 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408991+0000", 2024-09-12T22:32:30.732 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:30.732 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.732 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.732 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:30.732 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408991+0000", 2024-09-12T22:32:30.732 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:30.732 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.732 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.733 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:30.733 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408992+0000", 2024-09-12T22:32:30.733 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.1799999999999995e-07 2024-09-12T22:32:30.733 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.733 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.733 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:30.733 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409005+0000", 2024-09-12T22:32:30.733 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.261e-05 2024-09-12T22:32:30.733 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.733 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.733 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:30.733 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409015+0000", 2024-09-12T22:32:30.733 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.0001e-05 2024-09-12T22:32:30.734 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.734 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.734 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:30.734 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409023+0000", 2024-09-12T22:32:30.734 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 8.7569999999999993e-06 2024-09-12T22:32:30.734 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.734 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.734 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:30.734 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.411355+0000", 2024-09-12T22:32:30.734 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0023313520000000001 2024-09-12T22:32:30.734 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.734 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.734 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:30.734 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.411374+0000", 2024-09-12T22:32:30.735 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.8810000000000001e-05 2024-09-12T22:32:30.735 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.735 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.735 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:30.735 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416994+0000", 2024-09-12T22:32:30.735 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.005620524 2024-09-12T22:32:30.735 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.735 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.735 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:30.735 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417037+0000", 2024-09-12T22:32:30.735 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.3248999999999999e-05 2024-09-12T22:32:30.735 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:30.735 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:30.735 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:30.736 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.736 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.736 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:10 3.10 e19/17 3:0bd6d154:::602.00000000:head v 19'5, mlcod=0'0)", 2024-09-12T22:32:30.736 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.409038+0000", 2024-09-12T22:32:30.736 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 53.217822415000001, 2024-09-12T22:32:30.736 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0080541689999999999, 2024-09-12T22:32:30.736 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:30.736 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:30.736 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:30.736 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:30.736 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.736 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:30.737 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409038+0000", 2024-09-12T22:32:30.737 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:30.737 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.737 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.737 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:30.737 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409038+0000", 2024-09-12T22:32:30.737 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:30.737 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.737 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.737 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:30.737 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409038+0000", 2024-09-12T22:32:30.737 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.7899999999999999e-07 2024-09-12T22:32:30.737 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.737 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.738 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:30.738 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409043+0000", 2024-09-12T22:32:30.738 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.6589999999999998e-06 2024-09-12T22:32:30.738 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.738 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.738 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:30.738 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409050+0000", 2024-09-12T22:32:30.738 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 7.0829999999999998e-06 2024-09-12T22:32:30.738 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.738 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.738 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:30.738 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409058+0000", 2024-09-12T22:32:30.738 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 7.7309999999999993e-06 2024-09-12T22:32:30.738 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.739 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.739 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:30.739 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.411654+0000", 2024-09-12T22:32:30.739 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0025961650000000001 2024-09-12T22:32:30.739 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.739 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.739 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:30.739 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.411671+0000", 2024-09-12T22:32:30.739 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.7356000000000001e-05 2024-09-12T22:32:30.739 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.739 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.739 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:30.739 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417040+0000", 2024-09-12T22:32:30.740 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0053681889999999998 2024-09-12T22:32:30.740 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.740 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.740 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:30.740 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417092+0000", 2024-09-12T22:32:30.740 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.2607e-05 2024-09-12T22:32:30.740 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:30.740 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:30.740 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:30.740 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.740 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.740 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:11 3.10 e19/17 3:0bd6d154:::602.00000000:head v 19'6, mlcod=0'0)", 2024-09-12T22:32:30.740 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.409768+0000", 2024-09-12T22:32:30.740 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 53.217092974000003, 2024-09-12T22:32:30.741 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0074442759999999997, 2024-09-12T22:32:30.741 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:30.741 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:30.741 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:30.741 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:30.741 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.741 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:30.741 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409768+0000", 2024-09-12T22:32:30.741 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:30.741 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.741 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.741 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:30.741 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409768+0000", 2024-09-12T22:32:30.742 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:30.742 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.742 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.742 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:30.742 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409768+0000", 2024-09-12T22:32:30.742 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.37e-07 2024-09-12T22:32:30.742 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.742 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.742 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:30.742 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409775+0000", 2024-09-12T22:32:30.742 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.4670000000000001e-06 2024-09-12T22:32:30.742 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.742 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.742 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:30.743 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409793+0000", 2024-09-12T22:32:30.743 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.8162e-05 2024-09-12T22:32:30.743 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.743 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.743 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:30.743 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409954+0000", 2024-09-12T22:32:30.743 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00016072999999999999 2024-09-12T22:32:30.743 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.743 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.743 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:30.743 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.411943+0000", 2024-09-12T22:32:30.743 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0019897069999999998 2024-09-12T22:32:30.743 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.743 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.744 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:30.744 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.412069+0000", 2024-09-12T22:32:30.744 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00012546200000000001 2024-09-12T22:32:30.744 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.744 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.744 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:30.744 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417114+0000", 2024-09-12T22:32:30.744 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.005045023 2024-09-12T22:32:30.744 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:30.744 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:30.744 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:30.744 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417212+0000", 2024-09-12T22:32:30.744 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 9.8088e-05 2024-09-12T22:32:30.745 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:30.745 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:30.745 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:30.745 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:30.745 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:30.745 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-09-12T22:32:30.745 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:32:30.747 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:32:30.746+0000 7fddec6a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30331) UID: 0 2024-09-12T22:32:30.848 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:30.847+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:30.863 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:32:30.863 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:32:30.863 INFO:teuthology.orchestra.run.smithi148.stdout: "num_ops": 0 2024-09-12T22:32:30.864 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:32:30.872 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:32:30.944 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T22:32:30.957 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:30.956+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:31.017 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:32:31.018 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:32:31.018 INFO:teuthology.orchestra.run.smithi148.stdout: "complaint_time": 30, 2024-09-12T22:32:31.018 INFO:teuthology.orchestra.run.smithi148.stdout: "num_blocked_ops": 0 2024-09-12T22:32:31.018 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:32:31.026 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:32:31.067 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:31.066+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:31.071 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0: {} 2024-09-12T22:32:31.071 INFO:teuthology.orchestra.run.smithi019.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T22:32:31.089 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T22:32:31.089 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:32:31.106 INFO:teuthology.orchestra.run.smithi019.stdout:osd.2: {} 2024-09-12T22:32:31.106 INFO:teuthology.orchestra.run.smithi019.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T22:32:31.149 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:31.148+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:31.170 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:31.170 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:31.178 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:32:31.249 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:31.248+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:31.294 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:31.294 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:31.304 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:32:31.339 INFO:teuthology.orchestra.run.smithi019.stderr:set 4.19 pg_upmap mapping to [2,0] 2024-09-12T22:32:31.346 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T22:32:31.350 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:31.349+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:31.446 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:31.447 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:31.451 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:31.449+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:31.455 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:32:31.552 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:31.551+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:31.598 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:31.598 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:31.607 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:32:31.653 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:32:31.652+0000 7fddec6a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30331) UID: 0 2024-09-12T22:32:31.726 INFO:teuthology.orchestra.run.smithi076.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:31.726 INFO:teuthology.orchestra.run.smithi076.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:31.736 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:32:31.754 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:31.753+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:31.855 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:31.855+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:31.885 INFO:teuthology.orchestra.run.smithi076.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:31.885 INFO:teuthology.orchestra.run.smithi076.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:31.892 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:32:31.956 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:32:31.955+0000 7fddec6a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30331) UID: 0 2024-09-12T22:32:31.995 INFO:teuthology.orchestra.run.smithi076.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:31.996 INFO:teuthology.orchestra.run.smithi076.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:32.004 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:32:32.057 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:32.056+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:32.119 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:32.120 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:32.128 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:32:32.158 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:32:32.157+0000 7fddec6a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30331) UID: 0 2024-09-12T22:32:32.259 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:32.258+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:32.272 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:32.272 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:32.281 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:32:32.342 INFO:teuthology.orchestra.run.smithi019.stderr:noscrub is set 2024-09-12T22:32:32.360 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:32.359+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:32.425 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:32.425 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:32.434 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:32:32.461 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:32.460+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:32.549 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:32.549 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:32.558 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:32:32.602 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:32.601+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:32.663 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:32.663 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:32.664 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:32:32.662+0000 7fddec6a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30331) UID: 0 2024-09-12T22:32:32.670 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:32:32.764 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:32:32.763+0000 7fddec6a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30331) UID: 0 2024-09-12T22:32:32.813 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:32.814 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:32.822 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:32:32.865 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:32.864+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:32.928 INFO:teuthology.orchestra.run.smithi076.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:32.928 INFO:teuthology.orchestra.run.smithi076.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:32.936 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:32:32.966 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:32.965+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:33.039 INFO:teuthology.orchestra.run.smithi076.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:33.039 INFO:teuthology.orchestra.run.smithi076.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:33.048 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:32:33.092 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:32:33.091+0000 7fddec6a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30331) UID: 0 2024-09-12T22:32:33.122 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T22:32:33.151 INFO:teuthology.orchestra.run.smithi076.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:33.152 INFO:teuthology.orchestra.run.smithi076.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:33.161 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:32:33.202 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:32:33.201+0000 7fddec6a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30331) UID: 0 2024-09-12T22:32:33.266 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0: {} 2024-09-12T22:32:33.266 INFO:teuthology.orchestra.run.smithi019.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T22:32:33.268 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:33.268+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:33.270 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:33.270 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:33.279 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:32:33.297 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T22:32:33.298 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:32:33.328 INFO:teuthology.orchestra.run.smithi019.stdout:osd.2: {} 2024-09-12T22:32:33.329 INFO:teuthology.orchestra.run.smithi019.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T22:32:33.370 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:33.369+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:33.384 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:32:33.384 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:32:33.384 INFO:teuthology.orchestra.run.smithi148.stdout: "complaint_time": 30, 2024-09-12T22:32:33.384 INFO:teuthology.orchestra.run.smithi148.stdout: "num_blocked_ops": 0 2024-09-12T22:32:33.384 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:32:33.393 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:32:33.470 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:33.470+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:33.498 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:32:33.499 INFO:teuthology.orchestra.run.smithi148.stdout: "size": 20, 2024-09-12T22:32:33.499 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 600, 2024-09-12T22:32:33.499 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [ 2024-09-12T22:32:33.499 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.499 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:33.499 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.400880+0000", 2024-09-12T22:32:33.499 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 56.095868467999999, 2024-09-12T22:32:33.499 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0095133660000000005, 2024-09-12T22:32:33.499 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:33.499 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:33.499 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:33.500 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:33.500 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.500 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:33.500 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400880+0000", 2024-09-12T22:32:33.500 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:33.500 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.500 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.500 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:33.500 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400880+0000", 2024-09-12T22:32:33.500 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:33.500 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.500 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.500 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:33.501 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400892+0000", 2024-09-12T22:32:33.501 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1941e-05 2024-09-12T22:32:33.501 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.501 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.501 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:33.501 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400900+0000", 2024-09-12T22:32:33.501 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0080000000000002e-06 2024-09-12T22:32:33.501 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.501 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.501 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:33.501 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400911+0000", 2024-09-12T22:32:33.501 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1452e-05 2024-09-12T22:32:33.501 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.501 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.502 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:33.502 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400922+0000", 2024-09-12T22:32:33.502 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0772e-05 2024-09-12T22:32:33.502 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.502 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.502 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:33.502 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401009+0000", 2024-09-12T22:32:33.502 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.7206000000000005e-05 2024-09-12T22:32:33.502 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.502 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.502 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:33.502 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401157+0000", 2024-09-12T22:32:33.502 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014831499999999999 2024-09-12T22:32:33.503 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.503 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.503 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:33.503 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401312+0000", 2024-09-12T22:32:33.503 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00015495600000000001 2024-09-12T22:32:33.503 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.503 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.503 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:33.503 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.403060+0000", 2024-09-12T22:32:33.503 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0017475220000000001 2024-09-12T22:32:33.503 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.503 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.503 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:33.503 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410300+0000", 2024-09-12T22:32:33.504 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0072403260000000001 2024-09-12T22:32:33.504 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.504 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.504 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:33.504 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410350+0000", 2024-09-12T22:32:33.504 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9814000000000001e-05 2024-09-12T22:32:33.504 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.504 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.504 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:33.505 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410393+0000", 2024-09-12T22:32:33.505 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3053999999999998e-05 2024-09-12T22:32:33.505 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:33.505 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:33.505 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:33.505 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.505 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.505 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:33.505 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.400952+0000", 2024-09-12T22:32:33.505 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 56.095796315999998, 2024-09-12T22:32:33.505 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0096045620000000005, 2024-09-12T22:32:33.505 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:33.505 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:33.506 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:33.506 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:33.506 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.506 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:33.506 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400952+0000", 2024-09-12T22:32:33.506 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:33.506 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.506 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.506 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:33.506 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400952+0000", 2024-09-12T22:32:33.506 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:33.506 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.507 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.508 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:33.508 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400953+0000", 2024-09-12T22:32:33.508 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.8000000000000005e-07 2024-09-12T22:32:33.508 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.508 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.508 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:33.508 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400957+0000", 2024-09-12T22:32:33.508 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.33e-06 2024-09-12T22:32:33.508 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.508 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.508 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:33.509 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400966+0000", 2024-09-12T22:32:33.509 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1989999999999995e-06 2024-09-12T22:32:33.509 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.509 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.509 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:33.509 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400973+0000", 2024-09-12T22:32:33.509 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2779999999999999e-06 2024-09-12T22:32:33.509 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.509 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.509 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:33.509 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401696+0000", 2024-09-12T22:32:33.509 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00072363500000000003 2024-09-12T22:32:33.509 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.510 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.510 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:33.510 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401788+0000", 2024-09-12T22:32:33.510 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1862999999999998e-05 2024-09-12T22:32:33.510 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.510 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.510 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:33.510 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401929+0000", 2024-09-12T22:32:33.510 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014096000000000001 2024-09-12T22:32:33.510 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.510 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.510 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:33.510 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.403542+0000", 2024-09-12T22:32:33.510 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001612963 2024-09-12T22:32:33.511 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.511 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.511 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:33.511 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410460+0000", 2024-09-12T22:32:33.511 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0069180500000000002 2024-09-12T22:32:33.511 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.511 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.511 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:33.511 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410515+0000", 2024-09-12T22:32:33.511 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5009000000000001e-05 2024-09-12T22:32:33.511 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.511 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.511 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:33.512 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410557+0000", 2024-09-12T22:32:33.512 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1495000000000002e-05 2024-09-12T22:32:33.512 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:33.512 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:33.512 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:33.512 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.512 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.512 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:33.512 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.400984+0000", 2024-09-12T22:32:33.512 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 56.095763820999998, 2024-09-12T22:32:33.512 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0073703950000000001, 2024-09-12T22:32:33.512 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:33.512 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:33.513 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:33.513 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:33.513 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.513 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:33.513 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400984+0000", 2024-09-12T22:32:33.514 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:33.514 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.514 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.514 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:33.514 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400984+0000", 2024-09-12T22:32:33.514 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:33.514 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.514 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.515 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:33.515 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400985+0000", 2024-09-12T22:32:33.515 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3200000000000005e-07 2024-09-12T22:32:33.515 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.515 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.515 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:33.515 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400998+0000", 2024-09-12T22:32:33.515 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2726e-05 2024-09-12T22:32:33.515 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.515 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.515 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:33.515 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401006+0000", 2024-09-12T22:32:33.515 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.3110000000000006e-06 2024-09-12T22:32:33.516 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.516 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.516 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:33.516 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401022+0000", 2024-09-12T22:32:33.516 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6249e-05 2024-09-12T22:32:33.516 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.516 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.516 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:33.516 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401700+0000", 2024-09-12T22:32:33.516 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00067811100000000001 2024-09-12T22:32:33.516 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.516 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.517 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:33.517 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401839+0000", 2024-09-12T22:32:33.517 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013865399999999999 2024-09-12T22:32:33.517 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.517 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.517 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:33.517 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401962+0000", 2024-09-12T22:32:33.517 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000123266 2024-09-12T22:32:33.517 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.517 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.517 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:33.517 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.403589+0000", 2024-09-12T22:32:33.517 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001626932 2024-09-12T22:32:33.517 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.518 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.518 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:33.518 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.408274+0000", 2024-09-12T22:32:33.518 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0046848100000000002 2024-09-12T22:32:33.518 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.518 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.518 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:33.518 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.408324+0000", 2024-09-12T22:32:33.518 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9784000000000003e-05 2024-09-12T22:32:33.518 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.518 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.518 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:33.518 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.408355+0000", 2024-09-12T22:32:33.519 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.1019999999999998e-05 2024-09-12T22:32:33.519 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:33.519 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:33.519 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:33.519 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.519 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.519 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:33.519 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401034+0000", 2024-09-12T22:32:33.519 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 56.095714381000001, 2024-09-12T22:32:33.519 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011063051000000001, 2024-09-12T22:32:33.519 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:33.519 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:33.519 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:33.520 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:33.520 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.520 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:33.520 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401034+0000", 2024-09-12T22:32:33.520 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:33.520 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.520 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.520 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:33.520 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401034+0000", 2024-09-12T22:32:33.520 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:33.520 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.520 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.521 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:33.521 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401034+0000", 2024-09-12T22:32:33.521 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8899999999999999e-07 2024-09-12T22:32:33.521 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.521 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.521 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:33.521 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401038+0000", 2024-09-12T22:32:33.521 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.523e-06 2024-09-12T22:32:33.521 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.521 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.521 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:33.521 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401046+0000", 2024-09-12T22:32:33.521 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0479999999999999e-06 2024-09-12T22:32:33.522 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.522 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.522 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:33.522 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401051+0000", 2024-09-12T22:32:33.522 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2619999999999998e-06 2024-09-12T22:32:33.522 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.522 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.522 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:33.522 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402270+0000", 2024-09-12T22:32:33.522 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012182429999999999 2024-09-12T22:32:33.522 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.522 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.522 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:33.523 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402325+0000", 2024-09-12T22:32:33.523 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5526999999999999e-05 2024-09-12T22:32:33.523 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.523 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.523 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:33.523 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402403+0000", 2024-09-12T22:32:33.523 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.7559999999999996e-05 2024-09-12T22:32:33.523 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.523 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.523 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:33.523 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.403655+0000", 2024-09-12T22:32:33.523 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012521489999999999 2024-09-12T22:32:33.523 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.523 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.524 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:33.524 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411979+0000", 2024-09-12T22:32:33.524 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0083240420000000002 2024-09-12T22:32:33.524 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.524 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.524 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:33.524 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.412036+0000", 2024-09-12T22:32:33.524 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7639000000000002e-05 2024-09-12T22:32:33.524 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.524 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.524 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:33.524 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.412097+0000", 2024-09-12T22:32:33.524 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0469e-05 2024-09-12T22:32:33.525 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:33.525 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:33.525 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:33.525 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.525 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.525 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:33.525 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401060+0000", 2024-09-12T22:32:33.525 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 56.095688629000001, 2024-09-12T22:32:33.525 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.010030172, 2024-09-12T22:32:33.525 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:33.525 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:33.525 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:33.525 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:33.525 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.526 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:33.526 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401060+0000", 2024-09-12T22:32:33.526 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:33.526 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.526 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.526 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:33.526 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401060+0000", 2024-09-12T22:32:33.526 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:33.526 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.526 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.526 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:33.526 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401060+0000", 2024-09-12T22:32:33.526 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2500000000000001e-07 2024-09-12T22:32:33.527 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.527 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.527 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:33.527 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401063+0000", 2024-09-12T22:32:33.527 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0910000000000001e-06 2024-09-12T22:32:33.527 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.527 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.527 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:33.527 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401070+0000", 2024-09-12T22:32:33.527 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1210000000000001e-06 2024-09-12T22:32:33.527 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.527 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.527 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:33.528 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401076+0000", 2024-09-12T22:32:33.528 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2830000000000001e-06 2024-09-12T22:32:33.528 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.528 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.528 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:33.528 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402288+0000", 2024-09-12T22:32:33.528 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012123699999999999 2024-09-12T22:32:33.528 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.528 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.528 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:33.528 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402359+0000", 2024-09-12T22:32:33.528 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.0988000000000005e-05 2024-09-12T22:32:33.528 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.528 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.529 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:33.529 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402457+0000", 2024-09-12T22:32:33.529 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.7857999999999997e-05 2024-09-12T22:32:33.529 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.529 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.529 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:33.529 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.404395+0000", 2024-09-12T22:32:33.529 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0019380160000000001 2024-09-12T22:32:33.529 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.529 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.529 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:33.529 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410603+0000", 2024-09-12T22:32:33.530 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.006208061 2024-09-12T22:32:33.530 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.530 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.530 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:33.530 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410687+0000", 2024-09-12T22:32:33.530 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.4623000000000006e-05 2024-09-12T22:32:33.530 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.530 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.530 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:33.530 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411090+0000", 2024-09-12T22:32:33.530 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00040233599999999999 2024-09-12T22:32:33.530 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:33.530 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:33.531 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:33.531 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.531 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.531 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:33.531 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401083+0000", 2024-09-12T22:32:33.531 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 56.095665212999997, 2024-09-12T22:32:33.531 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0097591850000000001, 2024-09-12T22:32:33.531 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:33.531 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:33.531 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:33.531 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:33.531 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.531 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:33.531 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401083+0000", 2024-09-12T22:32:33.532 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:33.532 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.532 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.532 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:33.532 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401083+0000", 2024-09-12T22:32:33.532 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:33.532 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.532 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.532 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:33.532 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401084+0000", 2024-09-12T22:32:33.532 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4799999999999999e-07 2024-09-12T22:32:33.532 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.532 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.533 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:33.533 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401088+0000", 2024-09-12T22:32:33.533 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6419999999999998e-06 2024-09-12T22:32:33.533 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.533 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.533 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:33.533 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401094+0000", 2024-09-12T22:32:33.533 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0090000000000004e-06 2024-09-12T22:32:33.533 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.533 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.533 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:33.534 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401108+0000", 2024-09-12T22:32:33.534 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3884e-05 2024-09-12T22:32:33.534 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.534 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.534 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:33.534 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401165+0000", 2024-09-12T22:32:33.534 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.6499000000000002e-05 2024-09-12T22:32:33.534 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.534 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.534 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:33.534 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401261+0000", 2024-09-12T22:32:33.535 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.6872000000000004e-05 2024-09-12T22:32:33.535 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.535 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.535 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:33.535 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401376+0000", 2024-09-12T22:32:33.535 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000114508 2024-09-12T22:32:33.535 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.535 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.535 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:33.535 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402666+0000", 2024-09-12T22:32:33.535 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012901659999999999 2024-09-12T22:32:33.535 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.535 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.536 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:33.536 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410572+0000", 2024-09-12T22:32:33.536 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0079055489999999996 2024-09-12T22:32:33.536 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.536 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.536 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:33.536 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410661+0000", 2024-09-12T22:32:33.536 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.9578000000000002e-05 2024-09-12T22:32:33.536 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.536 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.536 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:33.536 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410842+0000", 2024-09-12T22:32:33.536 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00018102999999999999 2024-09-12T22:32:33.536 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:33.537 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:33.537 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:33.537 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.537 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.537 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:33.537 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401122+0000", 2024-09-12T22:32:33.537 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 56.095626181, 2024-09-12T22:32:33.537 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0099122080000000005, 2024-09-12T22:32:33.537 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:33.537 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:33.537 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:32:33.537 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:33.537 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.538 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:33.538 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401122+0000", 2024-09-12T22:32:33.538 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:33.538 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.538 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.538 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:33.538 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401122+0000", 2024-09-12T22:32:33.538 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:33.538 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.538 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.538 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:33.538 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401123+0000", 2024-09-12T22:32:33.538 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2600000000000002e-07 2024-09-12T22:32:33.538 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.539 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.539 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:33.539 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401126+0000", 2024-09-12T22:32:33.539 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.6449999999999998e-06 2024-09-12T22:32:33.539 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.539 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.539 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:33.539 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401133+0000", 2024-09-12T22:32:33.539 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.9890000000000003e-06 2024-09-12T22:32:33.539 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.539 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.539 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:33.539 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401138+0000", 2024-09-12T22:32:33.539 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8060000000000002e-06 2024-09-12T22:32:33.540 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.540 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.540 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:33.540 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401703+0000", 2024-09-12T22:32:33.540 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00056509099999999999 2024-09-12T22:32:33.540 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.541 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.541 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:33.541 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401837+0000", 2024-09-12T22:32:33.541 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013338799999999999 2024-09-12T22:32:33.541 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.541 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.541 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:33.541 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411034+0000", 2024-09-12T22:32:33.542 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.009197663 2024-09-12T22:32:33.542 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:33.542 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:33.542 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:33.542 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.542 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.542 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:33.542 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401158+0000", 2024-09-12T22:32:33.542 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 56.095590401999999, 2024-09-12T22:32:33.542 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.010292437999999999, 2024-09-12T22:32:33.542 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:33.542 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:33.542 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:32:33.543 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:33.543 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.543 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:33.543 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401158+0000", 2024-09-12T22:32:33.543 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:33.543 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.544 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.544 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:33.544 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401158+0000", 2024-09-12T22:32:33.544 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:33.545 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.545 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.545 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:33.545 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401158+0000", 2024-09-12T22:32:33.545 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9699999999999996e-07 2024-09-12T22:32:33.545 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.545 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.545 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:33.545 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401161+0000", 2024-09-12T22:32:33.545 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.7410000000000001e-06 2024-09-12T22:32:33.545 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.545 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.546 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:33.546 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401168+0000", 2024-09-12T22:32:33.546 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.844e-06 2024-09-12T22:32:33.546 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.546 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.546 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:33.546 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401174+0000", 2024-09-12T22:32:33.546 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4700000000000001e-06 2024-09-12T22:32:33.546 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.546 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.546 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:33.546 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402799+0000", 2024-09-12T22:32:33.546 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0016256409999999999 2024-09-12T22:32:33.547 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.547 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.547 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:33.547 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402893+0000", 2024-09-12T22:32:33.547 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.3807999999999994e-05 2024-09-12T22:32:33.547 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.547 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.547 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:33.547 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411450+0000", 2024-09-12T22:32:33.547 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0085573369999999999 2024-09-12T22:32:33.547 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:33.547 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:33.547 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:33.548 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.548 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.548 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:33.548 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401183+0000", 2024-09-12T22:32:33.548 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 56.095565550000003, 2024-09-12T22:32:33.548 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0068597830000000004, 2024-09-12T22:32:33.548 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:33.548 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:33.548 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:32:33.548 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:33.548 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.548 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:33.548 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401183+0000", 2024-09-12T22:32:33.549 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:33.549 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.549 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.549 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:33.549 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401183+0000", 2024-09-12T22:32:33.549 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:33.549 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.549 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.549 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:33.549 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401183+0000", 2024-09-12T22:32:33.549 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.6700000000000003e-07 2024-09-12T22:32:33.549 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.549 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.550 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:33.550 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401186+0000", 2024-09-12T22:32:33.550 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4679999999999999e-06 2024-09-12T22:32:33.550 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.550 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.550 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:33.550 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401192+0000", 2024-09-12T22:32:33.550 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.1519999999999997e-06 2024-09-12T22:32:33.550 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.550 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.550 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:33.550 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401197+0000", 2024-09-12T22:32:33.550 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4669999999999998e-06 2024-09-12T22:32:33.550 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.551 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.551 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:33.551 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401253+0000", 2024-09-12T22:32:33.551 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.6211000000000001e-05 2024-09-12T22:32:33.551 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.551 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.551 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:33.551 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401413+0000", 2024-09-12T22:32:33.551 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00016021399999999999 2024-09-12T22:32:33.551 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.551 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.551 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:33.551 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.408043+0000", 2024-09-12T22:32:33.551 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0066295039999999996 2024-09-12T22:32:33.552 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:33.552 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:33.552 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:33.552 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.552 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.552 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:20 3.1c e19/17 3:3ed09add:::607.00000000:head v 19'1, mlcod=0'0)", 2024-09-12T22:32:33.552 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.409642+0000", 2024-09-12T22:32:33.552 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 56.087106091000003, 2024-09-12T22:32:33.552 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0038816269999999999, 2024-09-12T22:32:33.552 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:33.552 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:33.552 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:33.552 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:33.553 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.553 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:33.553 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409642+0000", 2024-09-12T22:32:33.553 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:33.553 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.553 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.553 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:33.553 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409642+0000", 2024-09-12T22:32:33.553 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:33.553 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.553 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.553 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:33.553 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409642+0000", 2024-09-12T22:32:33.553 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.6899999999999999e-07 2024-09-12T22:32:33.554 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.554 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.554 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:33.554 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409648+0000", 2024-09-12T22:32:33.554 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.49e-06 2024-09-12T22:32:33.554 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.554 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.554 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:33.554 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409656+0000", 2024-09-12T22:32:33.554 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.2949999999999994e-06 2024-09-12T22:32:33.554 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.554 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.554 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:33.555 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409664+0000", 2024-09-12T22:32:33.555 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.1219999999999995e-06 2024-09-12T22:32:33.555 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.555 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.555 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:33.555 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409707+0000", 2024-09-12T22:32:33.555 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2222000000000003e-05 2024-09-12T22:32:33.555 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.555 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.555 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:33.555 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409724+0000", 2024-09-12T22:32:33.555 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7496999999999999e-05 2024-09-12T22:32:33.555 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.555 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.556 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:33.556 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413439+0000", 2024-09-12T22:32:33.556 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00371448 2024-09-12T22:32:33.556 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.556 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.556 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:33.556 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413524+0000", 2024-09-12T22:32:33.556 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.5252000000000003e-05 2024-09-12T22:32:33.556 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:33.556 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:33.556 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:33.556 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.556 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.557 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:28 3.13 e19/17 3:cd5a64a3:::100.00000000:head v 19'1, mlcod=0'0)", 2024-09-12T22:32:33.557 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.409681+0000", 2024-09-12T22:32:33.557 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 56.087067607999998, 2024-09-12T22:32:33.557 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0038708710000000001, 2024-09-12T22:32:33.557 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:33.557 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:33.557 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:33.557 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:33.557 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.557 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:33.557 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409681+0000", 2024-09-12T22:32:33.557 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:33.557 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.557 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.558 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:33.558 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409681+0000", 2024-09-12T22:32:33.558 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:33.558 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.558 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.558 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:33.558 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409681+0000", 2024-09-12T22:32:33.558 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3000000000000002e-07 2024-09-12T22:32:33.558 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.558 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.558 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:33.558 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409695+0000", 2024-09-12T22:32:33.558 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4313e-05 2024-09-12T22:32:33.558 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.559 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.559 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:33.559 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409703+0000", 2024-09-12T22:32:33.559 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4000000000000003e-06 2024-09-12T22:32:33.559 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.559 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.559 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:33.559 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409708+0000", 2024-09-12T22:32:33.559 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3190000000000002e-06 2024-09-12T22:32:33.559 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.559 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.559 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:33.559 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409875+0000", 2024-09-12T22:32:33.560 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000167329 2024-09-12T22:32:33.560 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.560 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.560 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:33.560 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409892+0000", 2024-09-12T22:32:33.560 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6957999999999999e-05 2024-09-12T22:32:33.560 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.560 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.560 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:33.560 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413457+0000", 2024-09-12T22:32:33.561 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0035651279999999999 2024-09-12T22:32:33.561 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.561 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.561 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:33.561 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413552+0000", 2024-09-12T22:32:33.561 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.4093999999999997e-05 2024-09-12T22:32:33.561 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:33.561 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:33.561 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:33.561 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.561 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.561 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:21 3.1c e19/17 3:3ed09add:::607.00000000:head v 19'2, mlcod=0'0)", 2024-09-12T22:32:33.561 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.409718+0000", 2024-09-12T22:32:33.562 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 56.087029942999997, 2024-09-12T22:32:33.562 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003851883, 2024-09-12T22:32:33.562 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:33.562 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:33.562 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:33.562 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:33.562 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.562 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:33.562 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409718+0000", 2024-09-12T22:32:33.562 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:33.562 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.562 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.562 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:33.563 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409718+0000", 2024-09-12T22:32:33.563 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:33.563 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.563 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.563 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:33.563 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409719+0000", 2024-09-12T22:32:33.563 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.16e-07 2024-09-12T22:32:33.563 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.563 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.563 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:33.563 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409722+0000", 2024-09-12T22:32:33.563 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.692e-06 2024-09-12T22:32:33.563 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.563 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.564 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:33.564 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409729+0000", 2024-09-12T22:32:33.564 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.516e-06 2024-09-12T22:32:33.564 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.564 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.564 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:33.564 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409750+0000", 2024-09-12T22:32:33.564 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1151000000000001e-05 2024-09-12T22:32:33.564 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.564 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.564 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:33.564 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410015+0000", 2024-09-12T22:32:33.564 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00026477599999999999 2024-09-12T22:32:33.564 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.565 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.565 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:33.565 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410104+0000", 2024-09-12T22:32:33.565 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.9586000000000006e-05 2024-09-12T22:32:33.565 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.565 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.565 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:33.565 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413528+0000", 2024-09-12T22:32:33.565 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0034237880000000001 2024-09-12T22:32:33.565 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.565 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.565 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:33.566 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413570+0000", 2024-09-12T22:32:33.566 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2157999999999999e-05 2024-09-12T22:32:33.566 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:33.566 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:33.566 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:33.566 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.566 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.566 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:27 3.13 e19/17 3:c91d4a1d:::mds0_inotable:head v 19'2, mlcod=0'0)", 2024-09-12T22:32:33.566 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.409760+0000", 2024-09-12T22:32:33.566 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 56.086988427000001, 2024-09-12T22:32:33.567 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0039301910000000004, 2024-09-12T22:32:33.567 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:33.567 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:33.567 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:33.567 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:33.567 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.567 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:33.567 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409760+0000", 2024-09-12T22:32:33.567 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:33.567 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.567 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.567 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:33.567 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409760+0000", 2024-09-12T22:32:33.568 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:33.568 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.568 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.568 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:33.568 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409760+0000", 2024-09-12T22:32:33.568 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.39e-07 2024-09-12T22:32:33.568 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.568 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.568 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:33.568 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409765+0000", 2024-09-12T22:32:33.568 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4449999999999998e-06 2024-09-12T22:32:33.568 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.568 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.569 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:33.569 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409771+0000", 2024-09-12T22:32:33.569 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7159999999999997e-06 2024-09-12T22:32:33.569 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.569 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.569 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:33.569 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409778+0000", 2024-09-12T22:32:33.569 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.331e-06 2024-09-12T22:32:33.569 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.569 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.570 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:33.570 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410191+0000", 2024-09-12T22:32:33.570 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00041348300000000003 2024-09-12T22:32:33.570 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.570 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.570 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:33.570 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410211+0000", 2024-09-12T22:32:33.570 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9933999999999999e-05 2024-09-12T22:32:33.570 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.570 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.570 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:33.570 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413638+0000", 2024-09-12T22:32:33.570 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003426854 2024-09-12T22:32:33.570 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.571 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.571 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:33.571 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413690+0000", 2024-09-12T22:32:33.571 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2089000000000002e-05 2024-09-12T22:32:33.571 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:33.571 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:33.571 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:33.571 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.571 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.571 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "pg_update_log_missing_reply(3.b epoch 19/17 rep_tid 4 lcod 19'2)", 2024-09-12T22:32:33.571 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.410060+0000", 2024-09-12T22:32:33.571 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 56.086688762000001, 2024-09-12T22:32:33.571 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00098016500000000007, 2024-09-12T22:32:33.572 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:33.572 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:33.572 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "reached pg", 2024-09-12T22:32:33.572 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:33.572 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.572 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:33.572 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410060+0000", 2024-09-12T22:32:33.572 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:33.572 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.572 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.572 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:33.572 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410060+0000", 2024-09-12T22:32:33.572 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:33.572 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.573 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.573 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:33.573 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410060+0000", 2024-09-12T22:32:33.573 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.8299999999999998e-07 2024-09-12T22:32:33.573 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.573 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.573 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:33.573 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410062+0000", 2024-09-12T22:32:33.573 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5749999999999999e-06 2024-09-12T22:32:33.573 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.573 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.573 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:33.573 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410070+0000", 2024-09-12T22:32:33.574 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.909e-06 2024-09-12T22:32:33.574 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.574 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.574 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:33.574 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410076+0000", 2024-09-12T22:32:33.574 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7049999999999996e-06 2024-09-12T22:32:33.574 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.574 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.574 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:33.574 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410943+0000", 2024-09-12T22:32:33.574 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00086681900000000001 2024-09-12T22:32:33.574 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.574 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.575 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:33.575 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411040+0000", 2024-09-12T22:32:33.575 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.6774000000000006e-05 2024-09-12T22:32:33.575 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:33.575 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:33.575 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:33.575 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.575 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.575 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e19/17 ondisk, result = 0)", 2024-09-12T22:32:33.575 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.410113+0000", 2024-09-12T22:32:33.575 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 56.086635495000003, 2024-09-12T22:32:33.575 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00098911599999999995, 2024-09-12T22:32:33.575 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:33.576 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:33.576 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:32:33.576 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:33.576 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.576 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:33.576 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410113+0000", 2024-09-12T22:32:33.576 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:33.576 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.576 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.576 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:33.576 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410113+0000", 2024-09-12T22:32:33.576 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:33.576 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.576 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.577 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:33.577 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410113+0000", 2024-09-12T22:32:33.577 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.99e-07 2024-09-12T22:32:33.577 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.577 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.577 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:33.577 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410115+0000", 2024-09-12T22:32:33.577 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.046e-06 2024-09-12T22:32:33.577 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.577 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.577 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:33.577 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410121+0000", 2024-09-12T22:32:33.577 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0050000000000001e-06 2024-09-12T22:32:33.578 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.578 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.578 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:33.578 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410126+0000", 2024-09-12T22:32:33.578 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8339999999999998e-06 2024-09-12T22:32:33.578 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.578 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.578 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:33.578 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410587+0000", 2024-09-12T22:32:33.578 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00046095499999999998 2024-09-12T22:32:33.578 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.578 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.578 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:33.579 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410595+0000", 2024-09-12T22:32:33.579 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.9419999999999995e-06 2024-09-12T22:32:33.579 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.579 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.579 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:33.579 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411102+0000", 2024-09-12T22:32:33.579 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00050713500000000003 2024-09-12T22:32:33.579 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:33.579 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:33.579 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:33.579 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.579 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.579 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 19/17 rep_tid 8 lcod 19'4)", 2024-09-12T22:32:33.579 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.410133+0000", 2024-09-12T22:32:33.580 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 56.086615567000003, 2024-09-12T22:32:33.580 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0013504000000000001, 2024-09-12T22:32:33.580 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:33.580 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:33.580 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "reached pg", 2024-09-12T22:32:33.580 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:33.580 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.580 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:33.580 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410133+0000", 2024-09-12T22:32:33.580 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:33.580 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.580 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.580 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:33.581 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410133+0000", 2024-09-12T22:32:33.581 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:33.581 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.581 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.581 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:33.581 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410133+0000", 2024-09-12T22:32:33.581 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.0599999999999999e-07 2024-09-12T22:32:33.581 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.581 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.581 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:33.581 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410135+0000", 2024-09-12T22:32:33.581 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7770000000000001e-06 2024-09-12T22:32:33.581 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.581 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.582 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:33.582 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410140+0000", 2024-09-12T22:32:33.582 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9960000000000001e-06 2024-09-12T22:32:33.582 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.582 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.582 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:33.582 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410144+0000", 2024-09-12T22:32:33.582 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9500000000000003e-06 2024-09-12T22:32:33.582 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.582 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.582 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:33.582 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411310+0000", 2024-09-12T22:32:33.582 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001166311 2024-09-12T22:32:33.583 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.583 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.583 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:33.583 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411483+0000", 2024-09-12T22:32:33.583 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00017316 2024-09-12T22:32:33.583 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:33.583 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:33.583 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:33.583 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.583 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.583 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "pg_update_log_missing(3.1a epoch 19/17 rep_tid 0 entries 19'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T22:32:33.583 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.410617+0000", 2024-09-12T22:32:33.583 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 56.086131172000002, 2024-09-12T22:32:33.583 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0030439709999999999, 2024-09-12T22:32:33.584 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:33.584 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:33.584 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "reached pg", 2024-09-12T22:32:33.584 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:33.584 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.584 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:33.584 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410617+0000", 2024-09-12T22:32:33.584 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:33.584 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.584 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.584 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:33.584 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410617+0000", 2024-09-12T22:32:33.584 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:33.585 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.585 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.585 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:33.585 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410617+0000", 2024-09-12T22:32:33.585 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3599999999999999e-07 2024-09-12T22:32:33.585 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.585 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.585 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:33.585 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410625+0000", 2024-09-12T22:32:33.585 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5410000000000003e-06 2024-09-12T22:32:33.585 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.585 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.585 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:33.586 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410638+0000", 2024-09-12T22:32:33.586 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3261999999999999e-05 2024-09-12T22:32:33.586 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.586 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.586 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:33.586 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410653+0000", 2024-09-12T22:32:33.586 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4844000000000001e-05 2024-09-12T22:32:33.586 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.586 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.586 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:33.586 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410814+0000", 2024-09-12T22:32:33.586 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00016119999999999999 2024-09-12T22:32:33.586 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.586 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.587 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:33.587 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413661+0000", 2024-09-12T22:32:33.587 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0028467879999999998 2024-09-12T22:32:33.587 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:33.587 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:33.587 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:33.587 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.587 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.587 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-09-12T22:32:33.587 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:39.398875+0000", 2024-09-12T22:32:33.587 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 54.097872891999998, 2024-09-12T22:32:33.587 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0015679069999999999, 2024-09-12T22:32:33.587 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:33.588 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:33.588 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:33.588 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:33.588 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.588 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:33.588 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398875+0000", 2024-09-12T22:32:33.588 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:33.588 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.588 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.588 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:33.588 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398875+0000", 2024-09-12T22:32:33.588 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:33.588 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.589 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.589 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:33.589 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398878+0000", 2024-09-12T22:32:33.589 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1679999999999998e-06 2024-09-12T22:32:33.589 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.589 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.589 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:33.589 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398888+0000", 2024-09-12T22:32:33.589 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.084e-05 2024-09-12T22:32:33.589 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.589 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.589 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:33.589 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398906+0000", 2024-09-12T22:32:33.589 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7518000000000001e-05 2024-09-12T22:32:33.590 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.590 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.590 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:33.590 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398914+0000", 2024-09-12T22:32:33.590 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5989999999999996e-06 2024-09-12T22:32:33.590 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.590 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.590 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:33.590 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398974+0000", 2024-09-12T22:32:33.590 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0988e-05 2024-09-12T22:32:33.590 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.590 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.590 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:33.591 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.399078+0000", 2024-09-12T22:32:33.591 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000103133 2024-09-12T22:32:33.591 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.591 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.591 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:33.591 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.399166+0000", 2024-09-12T22:32:33.591 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.8183999999999995e-05 2024-09-12T22:32:33.591 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.591 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.591 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:33.591 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.399747+0000", 2024-09-12T22:32:33.591 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00058110599999999996 2024-09-12T22:32:33.591 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.592 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.592 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:33.592 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.400377+0000", 2024-09-12T22:32:33.592 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000630157 2024-09-12T22:32:33.592 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.592 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.592 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:33.592 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.400415+0000", 2024-09-12T22:32:33.592 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7814000000000001e-05 2024-09-12T22:32:33.592 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.592 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.592 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:33.592 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.400443+0000", 2024-09-12T22:32:33.593 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8399999999999999e-05 2024-09-12T22:32:33.593 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:33.593 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:33.593 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:33.593 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.593 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.593 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e23)", 2024-09-12T22:32:33.593 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:58.400966+0000", 2024-09-12T22:32:33.593 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 35.095781983999998, 2024-09-12T22:32:33.593 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001468876, 2024-09-12T22:32:33.593 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:33.593 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:33.593 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:33.594 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:33.594 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.594 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:33.594 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400966+0000", 2024-09-12T22:32:33.594 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:33.594 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.594 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.594 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:33.594 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400966+0000", 2024-09-12T22:32:33.594 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:33.594 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.594 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.594 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:33.594 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400967+0000", 2024-09-12T22:32:33.595 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.046e-06 2024-09-12T22:32:33.595 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.595 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.595 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:33.595 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400974+0000", 2024-09-12T22:32:33.595 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2310000000000001e-06 2024-09-12T22:32:33.595 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.595 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.595 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:33.595 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400988+0000", 2024-09-12T22:32:33.595 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4482e-05 2024-09-12T22:32:33.595 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.595 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.596 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:33.596 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400997+0000", 2024-09-12T22:32:33.596 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.0189999999999995e-06 2024-09-12T22:32:33.596 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.596 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.596 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:33.596 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.401068+0000", 2024-09-12T22:32:33.596 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1426000000000004e-05 2024-09-12T22:32:33.596 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.596 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.596 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:33.596 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.401174+0000", 2024-09-12T22:32:33.596 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000105769 2024-09-12T22:32:33.597 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.597 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.597 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:33.597 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.401335+0000", 2024-09-12T22:32:33.597 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000161225 2024-09-12T22:32:33.597 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.597 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.597 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:33.597 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.402110+0000", 2024-09-12T22:32:33.597 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00077428800000000004 2024-09-12T22:32:33.597 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.597 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.597 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:33.597 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.402333+0000", 2024-09-12T22:32:33.598 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000223723 2024-09-12T22:32:33.598 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.598 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.598 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:33.598 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.402388+0000", 2024-09-12T22:32:33.598 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4700999999999997e-05 2024-09-12T22:32:33.598 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.598 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.598 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:33.598 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.402435+0000", 2024-09-12T22:32:33.598 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6965999999999997e-05 2024-09-12T22:32:33.598 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:33.598 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:33.599 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:33.599 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.599 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.599 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:45 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e27)", 2024-09-12T22:32:33.599 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:32:04.401614+0000", 2024-09-12T22:32:33.599 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 29.095134555000001, 2024-09-12T22:32:33.599 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0014279749999999999, 2024-09-12T22:32:33.599 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:33.599 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:33.599 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:33.599 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:33.599 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.599 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:33.599 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401614+0000", 2024-09-12T22:32:33.600 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:33.600 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.600 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.600 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:33.600 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401614+0000", 2024-09-12T22:32:33.600 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:33.600 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.600 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.600 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:33.600 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401615+0000", 2024-09-12T22:32:33.600 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.161e-06 2024-09-12T22:32:33.600 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.600 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.601 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:33.601 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401621+0000", 2024-09-12T22:32:33.601 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8730000000000004e-06 2024-09-12T22:32:33.601 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.601 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.601 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:33.601 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401633+0000", 2024-09-12T22:32:33.601 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1800000000000001e-05 2024-09-12T22:32:33.601 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.601 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.601 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:33.601 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401656+0000", 2024-09-12T22:32:33.601 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.3521999999999999e-05 2024-09-12T22:32:33.601 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.602 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.602 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:33.602 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401713+0000", 2024-09-12T22:32:33.602 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7259000000000002e-05 2024-09-12T22:32:33.602 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.602 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.602 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:33.602 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401849+0000", 2024-09-12T22:32:33.602 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013613500000000001 2024-09-12T22:32:33.602 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.603 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.603 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:33.603 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.402009+0000", 2024-09-12T22:32:33.603 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00015947199999999999 2024-09-12T22:32:33.603 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.603 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.603 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:33.603 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.402629+0000", 2024-09-12T22:32:33.603 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00061962200000000001 2024-09-12T22:32:33.603 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.603 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.603 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:33.603 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.402983+0000", 2024-09-12T22:32:33.603 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00035447499999999998 2024-09-12T22:32:33.604 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.604 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.604 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:33.604 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.403016+0000", 2024-09-12T22:32:33.604 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3108999999999998e-05 2024-09-12T22:32:33.604 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:33.604 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:33.604 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:33.604 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.403042+0000", 2024-09-12T22:32:33.604 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5547000000000001e-05 2024-09-12T22:32:33.604 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:33.604 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:33.604 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:33.605 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:33.605 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:33.605 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:32:33.606 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:33.605+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:33.607 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:32:33.706 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:33.705+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:33.716 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-09-12T22:32:33.716 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-09-12T22:32:33.716 INFO:teuthology.orchestra.run.smithi163.stdout: "num_ops": 0 2024-09-12T22:32:33.716 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-09-12T22:32:33.725 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:32:33.807 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:33.806+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:33.828 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-09-12T22:32:33.828 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-09-12T22:32:33.828 INFO:teuthology.orchestra.run.smithi163.stdout: "complaint_time": 30, 2024-09-12T22:32:33.828 INFO:teuthology.orchestra.run.smithi163.stdout: "num_blocked_ops": 0 2024-09-12T22:32:33.828 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-09-12T22:32:33.837 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:32:33.908 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:32:33.907+0000 7fddec6a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30331) UID: 0 2024-09-12T22:32:33.941 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-09-12T22:32:33.941 INFO:teuthology.orchestra.run.smithi163.stdout: "size": 20, 2024-09-12T22:32:33.941 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 600, 2024-09-12T22:32:33.941 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2024-09-12T22:32:33.941 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.941 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-09-12T22:32:33.941 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:27.254459+0000", 2024-09-12T22:32:33.942 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 66.684361987000003, 2024-09-12T22:32:33.942 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.37816283899999997, 2024-09-12T22:32:33.942 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:33.942 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:33.942 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:33.942 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:33.942 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:33.942 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:33.942 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 1 2024-09-12T22:32:33.942 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:33.942 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:33.942 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.942 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:33.942 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254459+0000", 2024-09-12T22:32:33.943 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:33.943 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:33.943 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.943 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:33.943 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254459+0000", 2024-09-12T22:32:33.943 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:33.943 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:33.943 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.943 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:33.943 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254460+0000", 2024-09-12T22:32:33.943 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1739999999999999e-06 2024-09-12T22:32:33.943 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:33.943 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.943 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:33.944 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254472+0000", 2024-09-12T22:32:33.944 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2207e-05 2024-09-12T22:32:33.944 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:33.944 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.944 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:33.944 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254483+0000", 2024-09-12T22:32:33.944 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0631999999999999e-05 2024-09-12T22:32:33.944 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:33.944 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.944 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:33.944 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254492+0000", 2024-09-12T22:32:33.944 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3670000000000003e-06 2024-09-12T22:32:33.944 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:33.945 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.945 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:33.945 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254551+0000", 2024-09-12T22:32:33.945 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8687999999999998e-05 2024-09-12T22:32:33.945 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:33.945 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.945 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for peered", 2024-09-12T22:32:33.945 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254562+0000", 2024-09-12T22:32:33.945 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1249e-05 2024-09-12T22:32:33.945 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:33.945 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.945 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:33.945 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.631211+0000", 2024-09-12T22:32:33.945 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.376649018 2024-09-12T22:32:33.946 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:33.946 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.946 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:33.946 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.631345+0000", 2024-09-12T22:32:33.946 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013378700000000001 2024-09-12T22:32:33.946 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:33.946 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.946 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:33.946 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.631479+0000", 2024-09-12T22:32:33.947 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013352399999999999 2024-09-12T22:32:33.947 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:33.947 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.947 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:33.947 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632324+0000", 2024-09-12T22:32:33.947 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00084508100000000002 2024-09-12T22:32:33.947 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:33.947 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.947 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:33.947 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632548+0000", 2024-09-12T22:32:33.947 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000224329 2024-09-12T22:32:33.947 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:33.947 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.947 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:33.948 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632591+0000", 2024-09-12T22:32:33.948 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2564000000000001e-05 2024-09-12T22:32:33.948 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:33.948 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.948 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:33.948 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632622+0000", 2024-09-12T22:32:33.948 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1219e-05 2024-09-12T22:32:33.948 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:33.948 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:33.948 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:33.948 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:33.948 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.948 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:185 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:32:33.949 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394355+0000", 2024-09-12T22:32:33.949 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 65.544465889999998, 2024-09-12T22:32:33.949 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011302394, 2024-09-12T22:32:33.949 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:33.949 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:33.949 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:33.949 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:33.949 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:33.949 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:33.949 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 185 2024-09-12T22:32:33.949 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:33.949 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:33.949 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.949 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:33.950 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394355+0000", 2024-09-12T22:32:33.950 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:33.950 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:33.950 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.950 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:33.950 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394355+0000", 2024-09-12T22:32:33.950 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:33.950 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:33.950 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.950 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:33.950 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394355+0000", 2024-09-12T22:32:33.950 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9099999999999999e-07 2024-09-12T22:32:33.950 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:33.950 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.951 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:33.951 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394385+0000", 2024-09-12T22:32:33.951 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9963000000000001e-05 2024-09-12T22:32:33.951 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:33.951 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.951 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:33.951 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394390+0000", 2024-09-12T22:32:33.951 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8420000000000004e-06 2024-09-12T22:32:33.951 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:33.951 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.951 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:33.951 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394393+0000", 2024-09-12T22:32:33.951 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1e-06 2024-09-12T22:32:33.952 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:33.952 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.952 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:33.952 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.400546+0000", 2024-09-12T22:32:33.952 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0061523309999999996 2024-09-12T22:32:33.952 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:33.952 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.952 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:33.952 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.400588+0000", 2024-09-12T22:32:33.952 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1835000000000002e-05 2024-09-12T22:32:33.952 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:33.952 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.952 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:33.952 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.400677+0000", 2024-09-12T22:32:33.953 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9195000000000002e-05 2024-09-12T22:32:33.953 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:33.953 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.953 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:33.953 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405378+0000", 2024-09-12T22:32:33.953 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0047008659999999997 2024-09-12T22:32:33.953 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:33.953 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.953 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:33.953 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405569+0000", 2024-09-12T22:32:33.953 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00019148599999999999 2024-09-12T22:32:33.953 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:33.953 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.954 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:33.954 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405620+0000", 2024-09-12T22:32:33.954 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1416999999999999e-05 2024-09-12T22:32:33.954 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:33.954 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.954 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:33.954 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405657+0000", 2024-09-12T22:32:33.954 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6968000000000002e-05 2024-09-12T22:32:33.954 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:33.954 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:33.954 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:33.954 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:33.954 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.955 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:32:33.955 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394399+0000", 2024-09-12T22:32:33.955 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 65.544421678999996, 2024-09-12T22:32:33.955 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011336601999999999, 2024-09-12T22:32:33.955 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:33.955 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:33.955 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:33.955 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:33.955 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:33.955 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:33.955 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 186 2024-09-12T22:32:33.955 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:33.955 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:33.956 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.956 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:33.956 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394399+0000", 2024-09-12T22:32:33.956 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:33.956 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:33.956 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.956 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:33.956 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394399+0000", 2024-09-12T22:32:33.956 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:33.956 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:33.956 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.956 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:33.956 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394400+0000", 2024-09-12T22:32:33.956 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4499999999999998e-07 2024-09-12T22:32:33.957 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:33.957 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.957 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:33.957 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394402+0000", 2024-09-12T22:32:33.957 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.875e-06 2024-09-12T22:32:33.957 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:33.957 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.957 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:33.957 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394405+0000", 2024-09-12T22:32:33.957 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6799999999999999e-06 2024-09-12T22:32:33.957 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:33.957 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.957 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:33.957 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394408+0000", 2024-09-12T22:32:33.958 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.667e-06 2024-09-12T22:32:33.958 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:33.958 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.958 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:33.958 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401395+0000", 2024-09-12T22:32:33.958 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0069867230000000002 2024-09-12T22:32:33.958 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:33.958 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.958 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:33.958 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401438+0000", 2024-09-12T22:32:33.958 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3554999999999999e-05 2024-09-12T22:32:33.958 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:33.958 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.958 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:33.959 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401509+0000", 2024-09-12T22:32:33.959 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0631999999999997e-05 2024-09-12T22:32:33.959 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:33.959 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.959 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:33.959 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405392+0000", 2024-09-12T22:32:33.959 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0038830449999999999 2024-09-12T22:32:33.959 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:33.959 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.959 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:33.959 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405690+0000", 2024-09-12T22:32:33.959 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000298435 2024-09-12T22:32:33.959 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:33.959 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.960 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:33.960 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405716+0000", 2024-09-12T22:32:33.960 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5435999999999998e-05 2024-09-12T22:32:33.960 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:33.960 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.960 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:33.960 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405736+0000", 2024-09-12T22:32:33.960 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0208999999999999e-05 2024-09-12T22:32:33.960 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:33.960 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:33.960 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:33.960 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:33.960 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.960 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:32:33.961 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394411+0000", 2024-09-12T22:32:33.961 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 65.544409552999994, 2024-09-12T22:32:33.961 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011400117, 2024-09-12T22:32:33.961 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:33.961 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:33.961 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:33.961 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:33.961 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:33.961 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:33.961 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 187 2024-09-12T22:32:33.961 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:33.961 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:33.961 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.961 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:33.962 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394411+0000", 2024-09-12T22:32:33.962 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:33.962 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:33.962 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.962 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:33.962 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394411+0000", 2024-09-12T22:32:33.962 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:33.962 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:33.962 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.962 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:33.962 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394412+0000", 2024-09-12T22:32:33.962 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.4999999999999999e-07 2024-09-12T22:32:33.962 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:33.962 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.963 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:33.963 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394414+0000", 2024-09-12T22:32:33.963 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.984e-06 2024-09-12T22:32:33.963 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:33.963 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.963 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:33.963 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394418+0000", 2024-09-12T22:32:33.963 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0840000000000002e-06 2024-09-12T22:32:33.963 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:33.963 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.963 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:33.963 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394431+0000", 2024-09-12T22:32:33.963 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.361e-05 2024-09-12T22:32:33.964 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:33.964 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.964 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:33.964 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401778+0000", 2024-09-12T22:32:33.964 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0073462659999999997 2024-09-12T22:32:33.964 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:33.964 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.964 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:33.964 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401853+0000", 2024-09-12T22:32:33.964 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5797000000000006e-05 2024-09-12T22:32:33.964 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:33.964 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.964 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:33.964 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401990+0000", 2024-09-12T22:32:33.965 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013651399999999999 2024-09-12T22:32:33.965 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:33.965 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.965 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:33.965 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405402+0000", 2024-09-12T22:32:33.965 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0034116070000000001 2024-09-12T22:32:33.965 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:33.965 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.965 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:33.965 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405764+0000", 2024-09-12T22:32:33.965 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00036234899999999998 2024-09-12T22:32:33.965 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:33.965 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.966 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:33.966 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405791+0000", 2024-09-12T22:32:33.966 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7029000000000002e-05 2024-09-12T22:32:33.966 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:33.966 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.966 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:33.966 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405812+0000", 2024-09-12T22:32:33.966 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0627000000000001e-05 2024-09-12T22:32:33.966 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:33.966 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:33.966 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:33.966 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:33.966 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.966 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:32:33.967 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394447+0000", 2024-09-12T22:32:33.967 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 65.544374402000003, 2024-09-12T22:32:33.967 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011759588, 2024-09-12T22:32:33.967 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:33.967 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:33.967 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:33.967 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:33.967 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:33.967 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:33.967 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 188 2024-09-12T22:32:33.967 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:33.967 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:33.967 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.968 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:33.968 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394447+0000", 2024-09-12T22:32:33.968 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:33.968 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:33.968 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.968 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:33.968 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394447+0000", 2024-09-12T22:32:33.968 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:33.968 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:33.968 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.968 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:33.968 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394447+0000", 2024-09-12T22:32:33.968 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.15e-07 2024-09-12T22:32:33.969 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:33.969 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.969 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:33.969 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394512+0000", 2024-09-12T22:32:33.969 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4580999999999997e-05 2024-09-12T22:32:33.969 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:33.969 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.969 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:33.969 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394518+0000", 2024-09-12T22:32:33.969 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.3380000000000001e-06 2024-09-12T22:32:33.969 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:33.969 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.969 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:33.969 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394521+0000", 2024-09-12T22:32:33.970 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3340000000000002e-06 2024-09-12T22:32:33.970 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:33.970 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.970 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:33.970 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.402628+0000", 2024-09-12T22:32:33.970 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.008106996 2024-09-12T22:32:33.970 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:33.970 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.970 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:33.970 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.402670+0000", 2024-09-12T22:32:33.970 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1983000000000001e-05 2024-09-12T22:32:33.970 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:33.970 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.970 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:33.971 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.402738+0000", 2024-09-12T22:32:33.971 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.8114999999999994e-05 2024-09-12T22:32:33.971 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:33.971 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.971 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:33.971 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405668+0000", 2024-09-12T22:32:33.971 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.002929545 2024-09-12T22:32:33.971 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:33.971 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.971 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:33.971 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406162+0000", 2024-09-12T22:32:33.971 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000494408 2024-09-12T22:32:33.971 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:33.971 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.972 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:33.972 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406188+0000", 2024-09-12T22:32:33.972 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5766e-05 2024-09-12T22:32:33.972 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:33.972 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.972 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:33.972 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406206+0000", 2024-09-12T22:32:33.972 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.8107000000000001e-05 2024-09-12T22:32:33.972 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:33.972 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:33.972 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:33.972 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:33.972 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.972 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:32:33.973 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394528+0000", 2024-09-12T22:32:33.973 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 65.544292733000006, 2024-09-12T22:32:33.973 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.01195536, 2024-09-12T22:32:33.973 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:33.973 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:33.973 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:33.973 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:33.973 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:33.973 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:33.973 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 189 2024-09-12T22:32:33.973 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:33.973 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:33.973 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.974 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:33.974 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394528+0000", 2024-09-12T22:32:33.974 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:33.974 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:33.974 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.974 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:33.974 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394528+0000", 2024-09-12T22:32:33.974 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:33.974 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:33.974 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.974 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:33.974 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394529+0000", 2024-09-12T22:32:33.974 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4900000000000001e-07 2024-09-12T22:32:33.974 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:33.974 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.975 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:33.975 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394531+0000", 2024-09-12T22:32:33.975 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.458e-06 2024-09-12T22:32:33.975 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:33.975 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.975 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:33.975 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394535+0000", 2024-09-12T22:32:33.975 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7900000000000001e-06 2024-09-12T22:32:33.975 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:33.975 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.975 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:33.975 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394537+0000", 2024-09-12T22:32:33.975 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.632e-06 2024-09-12T22:32:33.976 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:33.976 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.976 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:33.976 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.404932+0000", 2024-09-12T22:32:33.976 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010394158000000001 2024-09-12T22:32:33.976 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:33.976 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.976 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:33.976 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405017+0000", 2024-09-12T22:32:33.976 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5525000000000005e-05 2024-09-12T22:32:33.976 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:33.976 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.976 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:33.976 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405114+0000", 2024-09-12T22:32:33.977 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.6527000000000006e-05 2024-09-12T22:32:33.977 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:33.977 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.977 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:33.977 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405818+0000", 2024-09-12T22:32:33.977 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00070412800000000005 2024-09-12T22:32:33.977 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:33.977 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.977 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:33.977 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406437+0000", 2024-09-12T22:32:33.977 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00061898900000000002 2024-09-12T22:32:33.977 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:33.977 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.977 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:33.978 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406463+0000", 2024-09-12T22:32:33.978 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6268e-05 2024-09-12T22:32:33.978 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:33.978 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.978 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:33.978 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406484+0000", 2024-09-12T22:32:33.978 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0536000000000001e-05 2024-09-12T22:32:33.978 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:33.978 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:33.978 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:33.978 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:33.978 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.978 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:33.978 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.401422+0000", 2024-09-12T22:32:33.979 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 56.537398828000001, 2024-09-12T22:32:33.979 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016896452999999999, 2024-09-12T22:32:33.979 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:33.979 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:33.979 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:33.979 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:33.979 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.979 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:33.979 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401422+0000", 2024-09-12T22:32:33.979 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:33.979 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:33.979 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.979 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:33.979 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401422+0000", 2024-09-12T22:32:33.980 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:33.980 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:33.980 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.980 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:33.980 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401424+0000", 2024-09-12T22:32:33.980 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9e-06 2024-09-12T22:32:33.980 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:33.980 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.980 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:33.980 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401437+0000", 2024-09-12T22:32:33.980 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2831e-05 2024-09-12T22:32:33.980 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:33.980 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.980 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:33.981 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401471+0000", 2024-09-12T22:32:33.981 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4010000000000001e-05 2024-09-12T22:32:33.981 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:33.981 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.981 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:33.981 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401484+0000", 2024-09-12T22:32:33.981 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2711000000000001e-05 2024-09-12T22:32:33.981 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:33.981 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.981 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:33.981 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405410+0000", 2024-09-12T22:32:33.981 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0039259170000000001 2024-09-12T22:32:33.981 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:33.982 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.982 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:33.982 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405529+0000", 2024-09-12T22:32:33.982 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000119778 2024-09-12T22:32:33.982 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:33.982 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.982 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:33.982 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405655+0000", 2024-09-12T22:32:33.982 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012556700000000001 2024-09-12T22:32:33.982 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:33.982 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.982 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:33.982 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410456+0000", 2024-09-12T22:32:33.982 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0048008269999999997 2024-09-12T22:32:33.983 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:33.983 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.983 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:33.983 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418226+0000", 2024-09-12T22:32:33.983 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0077707729999999999 2024-09-12T22:32:33.983 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:33.983 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.983 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:33.983 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418277+0000", 2024-09-12T22:32:33.983 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0476000000000003e-05 2024-09-12T22:32:33.983 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:33.983 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.983 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:33.984 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418319+0000", 2024-09-12T22:32:33.984 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1662999999999997e-05 2024-09-12T22:32:33.984 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:33.984 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:33.984 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:33.984 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:33.984 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.984 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:33.984 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.401505+0000", 2024-09-12T22:32:33.984 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 56.537316164000003, 2024-09-12T22:32:33.984 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016987904000000002, 2024-09-12T22:32:33.984 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:33.984 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:33.985 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:33.985 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:33.985 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.985 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:33.985 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401505+0000", 2024-09-12T22:32:33.985 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:33.985 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:33.985 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.985 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:33.985 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401505+0000", 2024-09-12T22:32:33.985 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:33.985 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:33.985 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.985 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:33.986 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401506+0000", 2024-09-12T22:32:33.986 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4700000000000001e-07 2024-09-12T22:32:33.986 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:33.986 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.986 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:33.986 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401510+0000", 2024-09-12T22:32:33.986 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6609999999999999e-06 2024-09-12T22:32:33.986 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:33.986 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.986 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:33.986 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401771+0000", 2024-09-12T22:32:33.986 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00026110700000000001 2024-09-12T22:32:33.986 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:33.987 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.987 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:33.987 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401921+0000", 2024-09-12T22:32:33.987 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014939099999999999 2024-09-12T22:32:33.987 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:33.987 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.987 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:33.987 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405944+0000", 2024-09-12T22:32:33.987 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0040235449999999999 2024-09-12T22:32:33.987 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:33.987 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.987 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:33.987 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406018+0000", 2024-09-12T22:32:33.987 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3373000000000004e-05 2024-09-12T22:32:33.988 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:33.988 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.988 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:33.988 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406172+0000", 2024-09-12T22:32:33.988 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00015435399999999999 2024-09-12T22:32:33.988 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:33.988 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.988 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:33.988 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410461+0000", 2024-09-12T22:32:33.988 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0042888609999999997 2024-09-12T22:32:33.988 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:33.988 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.988 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:33.988 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418371+0000", 2024-09-12T22:32:33.989 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0079098380000000006 2024-09-12T22:32:33.989 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:33.989 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.989 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:33.989 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418443+0000", 2024-09-12T22:32:33.989 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2705000000000003e-05 2024-09-12T22:32:33.989 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:33.989 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.989 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:33.989 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418493+0000", 2024-09-12T22:32:33.989 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9322e-05 2024-09-12T22:32:33.989 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:33.990 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:33.990 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:33.990 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:33.990 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.990 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:33.990 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.401939+0000", 2024-09-12T22:32:33.990 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 56.536882427999998, 2024-09-12T22:32:33.990 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016722292999999999, 2024-09-12T22:32:33.990 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:33.990 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:33.990 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:33.990 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:33.990 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.990 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:33.991 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401939+0000", 2024-09-12T22:32:33.991 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:33.991 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:33.991 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.991 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:33.991 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401939+0000", 2024-09-12T22:32:33.991 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:33.991 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:33.991 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.991 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:33.991 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401940+0000", 2024-09-12T22:32:33.991 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1990000000000001e-06 2024-09-12T22:32:33.991 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:33.992 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.992 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:33.992 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401956+0000", 2024-09-12T22:32:33.992 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.6344000000000001e-05 2024-09-12T22:32:33.992 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:33.992 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.992 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:33.992 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401974+0000", 2024-09-12T22:32:33.992 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7730000000000001e-05 2024-09-12T22:32:33.992 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:33.992 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.992 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:33.992 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401982+0000", 2024-09-12T22:32:33.992 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.7800000000000001e-06 2024-09-12T22:32:33.993 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:33.993 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.993 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:33.993 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406557+0000", 2024-09-12T22:32:33.993 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0045758489999999999 2024-09-12T22:32:33.993 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:33.993 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.993 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:33.993 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406697+0000", 2024-09-12T22:32:33.993 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013925100000000001 2024-09-12T22:32:33.993 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:33.993 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.993 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:33.993 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406830+0000", 2024-09-12T22:32:33.994 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013293499999999999 2024-09-12T22:32:33.994 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:33.994 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.994 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:33.994 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410465+0000", 2024-09-12T22:32:33.994 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0036352680000000001 2024-09-12T22:32:33.994 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:33.994 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.994 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:33.994 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418564+0000", 2024-09-12T22:32:33.994 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0080992140000000004 2024-09-12T22:32:33.994 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:33.994 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.994 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:33.995 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418621+0000", 2024-09-12T22:32:33.995 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7167999999999999e-05 2024-09-12T22:32:33.995 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:33.995 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.995 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:33.995 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418661+0000", 2024-09-12T22:32:33.995 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9555000000000003e-05 2024-09-12T22:32:33.995 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:33.995 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:33.995 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:33.995 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:33.995 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.995 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:33.995 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.401994+0000", 2024-09-12T22:32:33.996 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 56.536826556000001, 2024-09-12T22:32:33.996 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016804109000000001, 2024-09-12T22:32:33.996 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:33.996 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:33.996 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:33.996 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:33.996 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.996 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:33.996 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401994+0000", 2024-09-12T22:32:33.996 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:33.996 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:33.996 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.996 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:33.997 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401994+0000", 2024-09-12T22:32:33.997 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:33.997 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:33.997 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.997 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:33.997 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401995+0000", 2024-09-12T22:32:33.997 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.8899999999999998e-07 2024-09-12T22:32:33.997 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:33.997 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.997 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:33.997 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402000+0000", 2024-09-12T22:32:33.997 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.498e-06 2024-09-12T22:32:33.997 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:33.998 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.998 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:33.998 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402007+0000", 2024-09-12T22:32:33.998 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.554e-06 2024-09-12T22:32:33.998 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:33.998 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.998 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:33.998 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402046+0000", 2024-09-12T22:32:33.998 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9156000000000003e-05 2024-09-12T22:32:33.998 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:33.998 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.998 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:33.998 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407342+0000", 2024-09-12T22:32:33.998 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052957610000000004 2024-09-12T22:32:33.998 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:33.999 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.999 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:33.999 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407521+0000", 2024-09-12T22:32:33.999 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00017878100000000001 2024-09-12T22:32:33.999 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:33.999 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.999 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:33.999 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407641+0000", 2024-09-12T22:32:33.999 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012013 2024-09-12T22:32:33.999 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:33.999 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:33.999 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:33.999 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410472+0000", 2024-09-12T22:32:33.999 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.002830455 2024-09-12T22:32:34.000 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:34.000 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.000 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:34.000 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418714+0000", 2024-09-12T22:32:34.000 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0082422789999999999 2024-09-12T22:32:34.000 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:34.000 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.000 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:34.000 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418761+0000", 2024-09-12T22:32:34.000 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6956999999999998e-05 2024-09-12T22:32:34.000 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:34.000 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.000 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:34.000 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418799+0000", 2024-09-12T22:32:34.001 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7749000000000001e-05 2024-09-12T22:32:34.001 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:34.001 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:34.001 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:34.001 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:34.001 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.001 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:34.001 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.402060+0000", 2024-09-12T22:32:34.001 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 56.536761112000001, 2024-09-12T22:32:34.001 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016885686, 2024-09-12T22:32:34.001 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:34.001 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:34.001 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:34.002 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:34.002 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.002 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:34.002 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402060+0000", 2024-09-12T22:32:34.002 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:34.002 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:34.002 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.002 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:34.002 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402060+0000", 2024-09-12T22:32:34.002 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:34.002 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:34.002 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.002 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:34.002 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402061+0000", 2024-09-12T22:32:34.003 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4399999999999999e-07 2024-09-12T22:32:34.003 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:34.003 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.003 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:34.003 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402066+0000", 2024-09-12T22:32:34.003 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8649999999999998e-06 2024-09-12T22:32:34.003 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:34.003 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.003 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:34.003 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402146+0000", 2024-09-12T22:32:34.003 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9054000000000006e-05 2024-09-12T22:32:34.003 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:34.003 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.003 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:34.004 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402287+0000", 2024-09-12T22:32:34.004 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014108600000000001 2024-09-12T22:32:34.004 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:34.004 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.004 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:34.004 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408185+0000", 2024-09-12T22:32:34.004 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0058983919999999997 2024-09-12T22:32:34.004 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:34.004 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.004 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:34.004 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408299+0000", 2024-09-12T22:32:34.004 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114102 2024-09-12T22:32:34.004 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:34.004 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.005 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:34.005 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408420+0000", 2024-09-12T22:32:34.005 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000120492 2024-09-12T22:32:34.005 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:34.005 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.005 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:34.005 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410867+0000", 2024-09-12T22:32:34.005 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0024476430000000002 2024-09-12T22:32:34.005 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:34.005 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.005 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:34.005 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418851+0000", 2024-09-12T22:32:34.005 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0079841489999999994 2024-09-12T22:32:34.005 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:34.006 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.006 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:34.006 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418894+0000", 2024-09-12T22:32:34.006 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3090000000000002e-05 2024-09-12T22:32:34.006 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:34.006 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.006 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:34.006 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418946+0000", 2024-09-12T22:32:34.006 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1069000000000002e-05 2024-09-12T22:32:34.006 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:34.006 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:34.006 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:34.006 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:34.006 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.007 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:34.007 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.402375+0000", 2024-09-12T22:32:34.007 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 56.536446046999998, 2024-09-12T22:32:34.007 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016768531999999999, 2024-09-12T22:32:34.007 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:34.007 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:34.007 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:34.007 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:34.007 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.007 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:34.007 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402375+0000", 2024-09-12T22:32:34.007 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:34.007 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:34.007 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.008 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:34.008 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402375+0000", 2024-09-12T22:32:34.008 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:34.008 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:34.008 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.008 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:34.008 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402375+0000", 2024-09-12T22:32:34.008 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4099999999999999e-07 2024-09-12T22:32:34.008 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:34.008 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.008 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:34.008 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402379+0000", 2024-09-12T22:32:34.008 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9870000000000001e-06 2024-09-12T22:32:34.008 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:34.009 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.009 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:34.009 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402389+0000", 2024-09-12T22:32:34.009 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0000000000000001e-05 2024-09-12T22:32:34.009 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:34.009 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.009 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:34.009 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402401+0000", 2024-09-12T22:32:34.009 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.148e-05 2024-09-12T22:32:34.009 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:34.009 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.009 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:34.009 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409108+0000", 2024-09-12T22:32:34.009 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0067068429999999997 2024-09-12T22:32:34.009 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:34.010 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.010 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:34.010 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409189+0000", 2024-09-12T22:32:34.010 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0815999999999993e-05 2024-09-12T22:32:34.010 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:34.010 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.010 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:34.010 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409320+0000", 2024-09-12T22:32:34.010 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000131586 2024-09-12T22:32:34.010 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:34.010 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.010 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:34.010 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410872+0000", 2024-09-12T22:32:34.011 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0015521599999999999 2024-09-12T22:32:34.011 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:34.011 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.011 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:34.011 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419049+0000", 2024-09-12T22:32:34.011 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0081763719999999995 2024-09-12T22:32:34.011 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:34.011 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.011 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:34.011 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419107+0000", 2024-09-12T22:32:34.011 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7899000000000002e-05 2024-09-12T22:32:34.011 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:34.011 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.011 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:34.012 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419143+0000", 2024-09-12T22:32:34.012 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6847999999999997e-05 2024-09-12T22:32:34.012 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:34.012 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:34.012 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:34.012 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:34.012 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.012 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:34.012 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.402903+0000", 2024-09-12T22:32:34.012 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 56.535917634999997, 2024-09-12T22:32:34.012 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016378428, 2024-09-12T22:32:34.012 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:34.012 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:34.012 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:34.013 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:34.013 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.013 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:34.013 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402903+0000", 2024-09-12T22:32:34.013 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:34.013 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:34.013 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.013 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:34.013 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402903+0000", 2024-09-12T22:32:34.013 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:34.013 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:34.013 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.013 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:34.013 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402904+0000", 2024-09-12T22:32:34.014 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9500000000000001e-07 2024-09-12T22:32:34.014 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:34.014 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.014 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:34.014 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402944+0000", 2024-09-12T22:32:34.014 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0265000000000002e-05 2024-09-12T22:32:34.014 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:34.014 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.014 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:34.014 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402979+0000", 2024-09-12T22:32:34.014 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4378000000000002e-05 2024-09-12T22:32:34.015 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:34.015 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.015 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:34.015 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402987+0000", 2024-09-12T22:32:34.015 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3559999999999993e-06 2024-09-12T22:32:34.015 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:34.015 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.015 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:34.015 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409577+0000", 2024-09-12T22:32:34.015 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0065901709999999997 2024-09-12T22:32:34.015 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:34.015 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.015 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:34.015 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409653+0000", 2024-09-12T22:32:34.016 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5819e-05 2024-09-12T22:32:34.016 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:34.016 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.016 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:34.016 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409725+0000", 2024-09-12T22:32:34.016 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2200000000000007e-05 2024-09-12T22:32:34.016 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:34.016 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.016 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:34.016 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.411234+0000", 2024-09-12T22:32:34.016 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001508225 2024-09-12T22:32:34.016 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:34.016 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.016 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:34.017 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419212+0000", 2024-09-12T22:32:34.017 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0079783400000000004 2024-09-12T22:32:34.017 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:34.017 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.017 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:34.017 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419244+0000", 2024-09-12T22:32:34.017 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2384e-05 2024-09-12T22:32:34.017 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:34.017 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.017 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:34.017 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419282+0000", 2024-09-12T22:32:34.017 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7394999999999997e-05 2024-09-12T22:32:34.017 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:34.017 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:34.018 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:34.018 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:34.018 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.018 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:34.018 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.403135+0000", 2024-09-12T22:32:34.018 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 56.535685764999997, 2024-09-12T22:32:34.018 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016294211999999999, 2024-09-12T22:32:34.018 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:34.018 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:34.018 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:34.018 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:34.018 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.018 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:34.018 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403135+0000", 2024-09-12T22:32:34.019 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:34.019 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:34.019 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.019 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:34.019 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403135+0000", 2024-09-12T22:32:34.019 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:34.019 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:34.019 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.019 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:34.019 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403136+0000", 2024-09-12T22:32:34.019 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.4e-07 2024-09-12T22:32:34.019 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:34.019 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.019 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:34.020 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403149+0000", 2024-09-12T22:32:34.020 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2723e-05 2024-09-12T22:32:34.020 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:34.020 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.020 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:34.020 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403158+0000", 2024-09-12T22:32:34.020 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3919999999999992e-06 2024-09-12T22:32:34.020 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:34.020 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.020 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:34.020 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403166+0000", 2024-09-12T22:32:34.020 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.2309999999999996e-06 2024-09-12T22:32:34.020 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:34.021 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.021 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:34.021 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409944+0000", 2024-09-12T22:32:34.021 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0067775309999999998 2024-09-12T22:32:34.021 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:34.021 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.021 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:34.021 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410032+0000", 2024-09-12T22:32:34.021 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.7906999999999997e-05 2024-09-12T22:32:34.021 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:34.021 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.021 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:34.021 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410152+0000", 2024-09-12T22:32:34.021 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012037800000000001 2024-09-12T22:32:34.022 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:34.022 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.022 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:34.022 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.411945+0000", 2024-09-12T22:32:34.022 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0017931850000000001 2024-09-12T22:32:34.022 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:34.022 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.022 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:34.022 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419319+0000", 2024-09-12T22:32:34.022 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0073731780000000002 2024-09-12T22:32:34.022 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:34.022 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.022 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:34.022 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419376+0000", 2024-09-12T22:32:34.023 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7728e-05 2024-09-12T22:32:34.023 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:34.023 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.023 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:34.023 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419429+0000", 2024-09-12T22:32:34.023 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3019000000000002e-05 2024-09-12T22:32:34.023 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:34.023 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:34.023 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:34.023 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:34.023 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.023 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:34.023 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.403185+0000", 2024-09-12T22:32:34.023 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 56.535635884000001, 2024-09-12T22:32:34.024 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.014902164000000001, 2024-09-12T22:32:34.024 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:34.024 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:34.024 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:34.024 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:34.024 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.024 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:34.024 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403185+0000", 2024-09-12T22:32:34.024 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:34.024 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:34.024 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.025 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:34.025 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403185+0000", 2024-09-12T22:32:34.025 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:34.025 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:34.025 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.025 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:34.025 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403186+0000", 2024-09-12T22:32:34.025 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9400000000000005e-07 2024-09-12T22:32:34.025 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:34.025 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.026 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:34.026 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403191+0000", 2024-09-12T22:32:34.026 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6980000000000003e-06 2024-09-12T22:32:34.026 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:34.026 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.026 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:34.026 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403199+0000", 2024-09-12T22:32:34.026 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2520000000000002e-06 2024-09-12T22:32:34.026 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:34.026 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.027 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:34.027 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403205+0000", 2024-09-12T22:32:34.027 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.908e-06 2024-09-12T22:32:34.027 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:34.027 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.027 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:34.027 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403359+0000", 2024-09-12T22:32:34.027 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000154544 2024-09-12T22:32:34.027 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:34.027 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.028 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:34.028 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403528+0000", 2024-09-12T22:32:34.028 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000168455 2024-09-12T22:32:34.028 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:34.028 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.028 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:34.028 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403763+0000", 2024-09-12T22:32:34.028 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00023539599999999999 2024-09-12T22:32:34.028 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:34.028 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.028 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:34.028 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409378+0000", 2024-09-12T22:32:34.028 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056150000000000002 2024-09-12T22:32:34.029 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:34.029 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.029 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:34.029 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418012+0000", 2024-09-12T22:32:34.029 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0086339559999999999 2024-09-12T22:32:34.029 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:34.029 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.029 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:34.029 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418046+0000", 2024-09-12T22:32:34.029 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4267999999999998e-05 2024-09-12T22:32:34.029 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:34.029 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.029 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:34.029 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418087+0000", 2024-09-12T22:32:34.030 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0992999999999999e-05 2024-09-12T22:32:34.030 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:34.030 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:34.030 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:34.030 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:34.030 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.030 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:34.030 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.403273+0000", 2024-09-12T22:32:34.030 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 56.535547932999997, 2024-09-12T22:32:34.030 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.014934866, 2024-09-12T22:32:34.030 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:34.030 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:34.030 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:34.030 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:34.031 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.031 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:34.031 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403273+0000", 2024-09-12T22:32:34.031 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:34.031 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:34.031 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.031 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:34.031 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403273+0000", 2024-09-12T22:32:34.031 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:34.031 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:34.031 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.031 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:34.031 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403274+0000", 2024-09-12T22:32:34.032 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.297e-06 2024-09-12T22:32:34.032 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:34.032 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.032 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:34.032 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403282+0000", 2024-09-12T22:32:34.032 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6340000000000001e-06 2024-09-12T22:32:34.032 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:34.032 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.032 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:34.032 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403305+0000", 2024-09-12T22:32:34.032 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3149000000000001e-05 2024-09-12T22:32:34.032 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:34.032 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.032 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:34.033 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403320+0000", 2024-09-12T22:32:34.033 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4527e-05 2024-09-12T22:32:34.033 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:34.033 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.033 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:34.033 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.404928+0000", 2024-09-12T22:32:34.033 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001608459 2024-09-12T22:32:34.033 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:34.033 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.033 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:34.033 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405218+0000", 2024-09-12T22:32:34.033 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00028982900000000002 2024-09-12T22:32:34.033 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:34.033 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.034 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:34.034 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405829+0000", 2024-09-12T22:32:34.034 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00061127900000000005 2024-09-12T22:32:34.034 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:34.034 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.034 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:34.034 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409403+0000", 2024-09-12T22:32:34.034 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.003573597 2024-09-12T22:32:34.034 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:34.034 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.034 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:34.034 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418138+0000", 2024-09-12T22:32:34.034 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0087349969999999996 2024-09-12T22:32:34.035 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:34.035 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.035 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:34.035 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418178+0000", 2024-09-12T22:32:34.035 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0649999999999999e-05 2024-09-12T22:32:34.035 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:34.035 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.035 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:34.035 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418208+0000", 2024-09-12T22:32:34.035 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9448e-05 2024-09-12T22:32:34.035 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:34.035 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:34.035 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:34.035 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:34.036 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.036 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:34.036 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.405456+0000", 2024-09-12T22:32:34.036 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 56.533364788, 2024-09-12T22:32:34.036 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012888389, 2024-09-12T22:32:34.036 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:34.036 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:34.036 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:34.036 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:34.036 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.036 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:34.036 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405456+0000", 2024-09-12T22:32:34.036 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:34.036 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:34.037 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.037 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:34.037 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405456+0000", 2024-09-12T22:32:34.037 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:34.037 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:34.037 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.037 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:34.037 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405457+0000", 2024-09-12T22:32:34.037 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.6599999999999994e-07 2024-09-12T22:32:34.037 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:34.037 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.037 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:34.037 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405463+0000", 2024-09-12T22:32:34.037 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4739999999999996e-06 2024-09-12T22:32:34.038 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:34.038 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.038 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:34.038 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405474+0000", 2024-09-12T22:32:34.038 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1095e-05 2024-09-12T22:32:34.038 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:34.038 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.038 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:34.038 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405482+0000", 2024-09-12T22:32:34.038 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3610000000000001e-06 2024-09-12T22:32:34.038 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:34.038 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.038 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:34.038 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407051+0000", 2024-09-12T22:32:34.039 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0015688970000000001 2024-09-12T22:32:34.039 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:34.039 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.039 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:34.039 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407259+0000", 2024-09-12T22:32:34.039 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00020778300000000001 2024-09-12T22:32:34.039 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:34.039 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.039 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:34.039 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407622+0000", 2024-09-12T22:32:34.039 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000363066 2024-09-12T22:32:34.039 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:34.039 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.039 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:34.040 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409438+0000", 2024-09-12T22:32:34.040 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001816319 2024-09-12T22:32:34.040 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:34.040 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.040 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:34.040 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418257+0000", 2024-09-12T22:32:34.040 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0088187720000000008 2024-09-12T22:32:34.040 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:34.040 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.040 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:34.040 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418308+0000", 2024-09-12T22:32:34.040 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1180000000000001e-05 2024-09-12T22:32:34.040 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:34.040 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.041 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:34.041 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418345+0000", 2024-09-12T22:32:34.041 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6476000000000001e-05 2024-09-12T22:32:34.041 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:34.041 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:34.041 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:34.041 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:34.041 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.041 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:34.041 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.405496+0000", 2024-09-12T22:32:34.041 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 56.533325431000002, 2024-09-12T22:32:34.041 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013016012, 2024-09-12T22:32:34.041 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:34.042 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:34.042 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:34.042 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:34.042 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.042 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:34.042 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405496+0000", 2024-09-12T22:32:34.042 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:34.042 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:34.042 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.042 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:34.042 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405496+0000", 2024-09-12T22:32:34.042 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:34.042 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:34.042 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.043 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:34.043 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405496+0000", 2024-09-12T22:32:34.043 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7999999999999995e-07 2024-09-12T22:32:34.043 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:34.043 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.043 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:34.043 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405501+0000", 2024-09-12T22:32:34.043 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8359999999999999e-06 2024-09-12T22:32:34.043 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:34.043 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.043 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:34.043 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405514+0000", 2024-09-12T22:32:34.043 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2522e-05 2024-09-12T22:32:34.043 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:34.044 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.044 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:34.044 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405521+0000", 2024-09-12T22:32:34.044 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5020000000000003e-06 2024-09-12T22:32:34.044 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:34.044 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.044 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:34.044 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405575+0000", 2024-09-12T22:32:34.044 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4169999999999998e-05 2024-09-12T22:32:34.044 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:34.044 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.044 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:34.044 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405697+0000", 2024-09-12T22:32:34.044 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000121301 2024-09-12T22:32:34.045 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:34.045 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.045 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:34.045 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405829+0000", 2024-09-12T22:32:34.045 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000132662 2024-09-12T22:32:34.045 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:34.045 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.045 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:34.045 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409155+0000", 2024-09-12T22:32:34.045 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0033259050000000001 2024-09-12T22:32:34.045 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:34.045 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.045 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:34.045 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418425+0000", 2024-09-12T22:32:34.046 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0092696319999999999 2024-09-12T22:32:34.046 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:34.046 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.046 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:34.046 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418471+0000", 2024-09-12T22:32:34.046 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6213e-05 2024-09-12T22:32:34.046 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:34.046 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.046 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:34.046 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418512+0000", 2024-09-12T22:32:34.047 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0589000000000001e-05 2024-09-12T22:32:34.047 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:34.047 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:34.047 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:34.047 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:34.047 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.047 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:34.047 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.406108+0000", 2024-09-12T22:32:34.047 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 56.532713033999997, 2024-09-12T22:32:34.047 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012458175, 2024-09-12T22:32:34.047 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:34.047 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:34.047 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:34.047 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:34.048 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.048 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:34.048 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406108+0000", 2024-09-12T22:32:34.048 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:34.048 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:34.048 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.048 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:34.048 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406108+0000", 2024-09-12T22:32:34.048 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:34.048 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:34.048 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.048 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:34.048 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406109+0000", 2024-09-12T22:32:34.049 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9899999999999999e-07 2024-09-12T22:32:34.049 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:34.049 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.049 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:34.049 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406115+0000", 2024-09-12T22:32:34.049 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9030000000000001e-06 2024-09-12T22:32:34.049 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:34.049 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.049 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:34.049 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406141+0000", 2024-09-12T22:32:34.049 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5999e-05 2024-09-12T22:32:34.049 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:34.049 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.049 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:34.050 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406150+0000", 2024-09-12T22:32:34.050 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.6050000000000004e-06 2024-09-12T22:32:34.050 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:34.050 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.050 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:34.050 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408163+0000", 2024-09-12T22:32:34.050 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0020122769999999998 2024-09-12T22:32:34.050 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:34.050 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.050 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:34.050 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408309+0000", 2024-09-12T22:32:34.050 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014606999999999999 2024-09-12T22:32:34.050 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:34.050 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.051 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:34.051 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408433+0000", 2024-09-12T22:32:34.051 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012460300000000001 2024-09-12T22:32:34.051 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:34.051 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.051 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:34.051 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409903+0000", 2024-09-12T22:32:34.051 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001469499 2024-09-12T22:32:34.051 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:34.051 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.051 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:34.051 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418427+0000", 2024-09-12T22:32:34.051 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0085241139999999993 2024-09-12T22:32:34.051 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:34.051 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.052 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:34.052 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418471+0000", 2024-09-12T22:32:34.052 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4474000000000001e-05 2024-09-12T22:32:34.052 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:34.052 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.052 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:34.052 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418566+0000", 2024-09-12T22:32:34.052 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.4732e-05 2024-09-12T22:32:34.052 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:34.052 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:34.052 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:34.052 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:34.052 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.052 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:34.053 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.407266+0000", 2024-09-12T22:32:34.053 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 56.531555177999998, 2024-09-12T22:32:34.053 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011442905, 2024-09-12T22:32:34.053 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:34.053 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:34.053 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2024-09-12T22:32:34.053 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:34.053 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.053 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:34.053 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407266+0000", 2024-09-12T22:32:34.053 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:34.053 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:34.053 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.054 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:34.054 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407266+0000", 2024-09-12T22:32:34.054 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:34.054 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:34.054 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.054 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:34.054 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407266+0000", 2024-09-12T22:32:34.054 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7899999999999998e-07 2024-09-12T22:32:34.054 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:34.054 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.054 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:34.054 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407269+0000", 2024-09-12T22:32:34.054 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9210000000000001e-06 2024-09-12T22:32:34.054 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:34.055 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.055 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:34.055 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407331+0000", 2024-09-12T22:32:34.055 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1376000000000003e-05 2024-09-12T22:32:34.055 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:34.055 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.055 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:34.055 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407337+0000", 2024-09-12T22:32:34.055 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1929999999999998e-06 2024-09-12T22:32:34.055 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:34.055 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.055 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:34.055 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408974+0000", 2024-09-12T22:32:34.055 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0016367109999999999 2024-09-12T22:32:34.056 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:34.056 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.056 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:34.056 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409112+0000", 2024-09-12T22:32:34.056 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000137952 2024-09-12T22:32:34.056 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:34.056 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:34.056 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:34.056 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418709+0000", 2024-09-12T22:32:34.056 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0095971730000000005 2024-09-12T22:32:34.056 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:34.056 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:34.056 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:34.057 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:34.057 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:34.057 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-09-12T22:32:34.058 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:32:34.059 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:34.057+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:34.159 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:32:34.158+0000 7fddec6a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30331) UID: 0 2024-09-12T22:32:34.163 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-09-12T22:32:34.163 INFO:teuthology.orchestra.run.smithi076.stdout: "ops": [], 2024-09-12T22:32:34.164 INFO:teuthology.orchestra.run.smithi076.stdout: "num_ops": 0 2024-09-12T22:32:34.164 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-09-12T22:32:34.172 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:32:34.260 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:34.258+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:34.315 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-09-12T22:32:34.316 INFO:teuthology.orchestra.run.smithi076.stdout: "ops": [], 2024-09-12T22:32:34.316 INFO:teuthology.orchestra.run.smithi076.stdout: "complaint_time": 30, 2024-09-12T22:32:34.316 INFO:teuthology.orchestra.run.smithi076.stdout: "num_blocked_ops": 0 2024-09-12T22:32:34.316 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-09-12T22:32:34.324 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:32:34.360 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:34.360+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:34.362 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T22:32:34.429 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-09-12T22:32:34.430 INFO:teuthology.orchestra.run.smithi076.stdout: "size": 20, 2024-09-12T22:32:34.430 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 600, 2024-09-12T22:32:34.430 INFO:teuthology.orchestra.run.smithi076.stdout: "ops": [ 2024-09-12T22:32:34.430 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.430 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:34.430 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.400604+0000", 2024-09-12T22:32:34.430 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 57.026806092999998, 2024-09-12T22:32:34.430 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.017278814, 2024-09-12T22:32:34.430 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:34.430 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:34.430 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:34.430 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:34.431 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.431 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:34.431 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400604+0000", 2024-09-12T22:32:34.431 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:34.431 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.431 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.431 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:34.431 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400604+0000", 2024-09-12T22:32:34.431 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:34.431 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.431 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.431 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:34.431 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400617+0000", 2024-09-12T22:32:34.432 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.3076e-05 2024-09-12T22:32:34.432 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.432 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.432 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:34.432 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400623+0000", 2024-09-12T22:32:34.432 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.5780000000000004e-06 2024-09-12T22:32:34.432 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.432 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.432 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:34.432 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400641+0000", 2024-09-12T22:32:34.432 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.8218000000000001e-05 2024-09-12T22:32:34.432 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.433 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.433 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:34.433 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400652+0000", 2024-09-12T22:32:34.433 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.0421999999999999e-05 2024-09-12T22:32:34.433 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.433 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.433 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:34.433 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400707+0000", 2024-09-12T22:32:34.433 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.4666000000000001e-05 2024-09-12T22:32:34.433 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.433 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.433 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op must wait for map", 2024-09-12T22:32:34.433 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400711+0000", 2024-09-12T22:32:34.434 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.5340000000000001e-06 2024-09-12T22:32:34.434 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.434 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.434 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:34.434 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.412066+0000", 2024-09-12T22:32:34.434 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.011354797999999999 2024-09-12T22:32:34.434 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.434 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.434 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:34.434 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.412672+0000", 2024-09-12T22:32:34.434 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00060620499999999996 2024-09-12T22:32:34.434 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.434 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.434 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:34.435 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.413032+0000", 2024-09-12T22:32:34.435 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00035955999999999998 2024-09-12T22:32:34.435 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.435 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.435 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op_commit", 2024-09-12T22:32:34.435 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417252+0000", 2024-09-12T22:32:34.435 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.004219899 2024-09-12T22:32:34.435 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.435 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.435 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:34.435 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417812+0000", 2024-09-12T22:32:34.435 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.000560182 2024-09-12T22:32:34.435 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.436 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.436 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:34.436 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417851+0000", 2024-09-12T22:32:34.436 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.9057999999999998e-05 2024-09-12T22:32:34.436 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.436 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.436 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:34.436 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417882+0000", 2024-09-12T22:32:34.436 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.1618000000000001e-05 2024-09-12T22:32:34.436 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:34.436 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:34.436 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:34.436 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.436 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.437 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:34.437 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.400674+0000", 2024-09-12T22:32:34.437 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 57.026735375000001, 2024-09-12T22:32:34.437 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.017348971000000001, 2024-09-12T22:32:34.437 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:34.437 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:34.437 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:34.437 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:34.437 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.437 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:34.437 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400674+0000", 2024-09-12T22:32:34.437 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:34.437 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.438 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.438 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:34.438 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400674+0000", 2024-09-12T22:32:34.438 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:34.438 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.438 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.438 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:34.438 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400675+0000", 2024-09-12T22:32:34.438 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.37e-07 2024-09-12T22:32:34.438 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.438 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.438 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:34.438 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400678+0000", 2024-09-12T22:32:34.439 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.303e-06 2024-09-12T22:32:34.439 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.439 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.439 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:34.439 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400684+0000", 2024-09-12T22:32:34.439 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.0290000000000002e-06 2024-09-12T22:32:34.439 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.439 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.439 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:34.439 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400688+0000", 2024-09-12T22:32:34.439 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.0890000000000002e-06 2024-09-12T22:32:34.439 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.439 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.440 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:34.440 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400806+0000", 2024-09-12T22:32:34.440 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00011814700000000001 2024-09-12T22:32:34.440 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.440 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.440 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:32:34.440 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400811+0000", 2024-09-12T22:32:34.440 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.0479999999999998e-06 2024-09-12T22:32:34.440 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.440 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.440 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:34.441 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.413877+0000", 2024-09-12T22:32:34.441 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.013065561 2024-09-12T22:32:34.441 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.441 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.441 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:34.441 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.413984+0000", 2024-09-12T22:32:34.441 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.000106566 2024-09-12T22:32:34.441 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.441 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.441 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:34.441 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.414264+0000", 2024-09-12T22:32:34.441 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00028067199999999999 2024-09-12T22:32:34.442 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.442 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.442 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op_commit", 2024-09-12T22:32:34.442 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417614+0000", 2024-09-12T22:32:34.442 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0033500729999999999 2024-09-12T22:32:34.442 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.442 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.442 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:34.442 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417946+0000", 2024-09-12T22:32:34.442 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00033209199999999998 2024-09-12T22:32:34.442 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.443 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.443 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:34.443 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417995+0000", 2024-09-12T22:32:34.443 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.808e-05 2024-09-12T22:32:34.443 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.443 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.443 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:34.443 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.418023+0000", 2024-09-12T22:32:34.443 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.8773999999999999e-05 2024-09-12T22:32:34.443 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:34.443 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:34.444 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:34.444 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.444 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.444 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:34.444 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.400694+0000", 2024-09-12T22:32:34.444 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 57.026715746000001, 2024-09-12T22:32:34.444 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.022845628, 2024-09-12T22:32:34.444 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:34.444 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:34.444 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:34.444 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:34.445 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.445 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:34.445 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400694+0000", 2024-09-12T22:32:34.445 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:34.445 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.445 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.445 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:34.445 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400694+0000", 2024-09-12T22:32:34.445 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:34.445 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.446 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.446 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:34.446 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400694+0000", 2024-09-12T22:32:34.446 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.48e-07 2024-09-12T22:32:34.446 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.446 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.446 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:34.446 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400709+0000", 2024-09-12T22:32:34.446 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.4888999999999999e-05 2024-09-12T22:32:34.446 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.446 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.447 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:34.447 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400722+0000", 2024-09-12T22:32:34.447 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.2882e-05 2024-09-12T22:32:34.447 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.447 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.447 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:34.447 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400732+0000", 2024-09-12T22:32:34.447 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.0299000000000001e-05 2024-09-12T22:32:34.447 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.447 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.448 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:34.448 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400793+0000", 2024-09-12T22:32:34.448 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.0253000000000001e-05 2024-09-12T22:32:34.448 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.448 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.448 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op must wait for map", 2024-09-12T22:32:34.448 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400798+0000", 2024-09-12T22:32:34.448 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.1569999999999999e-06 2024-09-12T22:32:34.448 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.448 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.449 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:34.449 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415059+0000", 2024-09-12T22:32:34.449 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.014260907 2024-09-12T22:32:34.449 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.449 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.449 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:34.449 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415396+0000", 2024-09-12T22:32:34.449 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00033720799999999997 2024-09-12T22:32:34.449 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.449 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.449 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:34.450 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415685+0000", 2024-09-12T22:32:34.450 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00028939900000000003 2024-09-12T22:32:34.450 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.450 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.450 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op_commit", 2024-09-12T22:32:34.450 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.418302+0000", 2024-09-12T22:32:34.450 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0026168039999999999 2024-09-12T22:32:34.450 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.450 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.450 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:34.450 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.423445+0000", 2024-09-12T22:32:34.451 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0051428150000000002 2024-09-12T22:32:34.451 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.451 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.451 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:34.451 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.423499+0000", 2024-09-12T22:32:34.451 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.3953000000000003e-05 2024-09-12T22:32:34.451 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.451 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.451 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:34.451 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.423540+0000", 2024-09-12T22:32:34.451 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.0813999999999999e-05 2024-09-12T22:32:34.451 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:34.451 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:34.452 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:34.452 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.452 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.452 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:34.452 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.400740+0000", 2024-09-12T22:32:34.452 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 57.026670023000001, 2024-09-12T22:32:34.452 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.022927528999999999, 2024-09-12T22:32:34.452 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:34.452 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:34.452 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:34.452 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:34.453 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.453 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:34.453 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400740+0000", 2024-09-12T22:32:34.453 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:34.453 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.453 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.453 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:34.453 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400740+0000", 2024-09-12T22:32:34.453 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:34.453 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.453 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.454 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:34.454 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400740+0000", 2024-09-12T22:32:34.454 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.3000000000000001e-07 2024-09-12T22:32:34.454 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.454 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.454 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:34.454 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400743+0000", 2024-09-12T22:32:34.454 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.5840000000000002e-06 2024-09-12T22:32:34.455 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.455 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.455 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:34.455 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400757+0000", 2024-09-12T22:32:34.455 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.3988999999999999e-05 2024-09-12T22:32:34.455 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.455 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.455 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:34.455 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400763+0000", 2024-09-12T22:32:34.455 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.686e-06 2024-09-12T22:32:34.455 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.455 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.456 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:34.456 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400818+0000", 2024-09-12T22:32:34.456 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.4941000000000001e-05 2024-09-12T22:32:34.456 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.456 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.456 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:32:34.456 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400824+0000", 2024-09-12T22:32:34.456 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.4600000000000002e-06 2024-09-12T22:32:34.456 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.456 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.456 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:34.456 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416227+0000", 2024-09-12T22:32:34.457 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.015403604 2024-09-12T22:32:34.457 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.457 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.457 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:34.457 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416306+0000", 2024-09-12T22:32:34.457 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 7.9126000000000001e-05 2024-09-12T22:32:34.457 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.457 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.457 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:34.458 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416678+0000", 2024-09-12T22:32:34.458 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00037105500000000002 2024-09-12T22:32:34.458 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.458 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.458 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op_commit", 2024-09-12T22:32:34.458 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.418363+0000", 2024-09-12T22:32:34.458 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.001685095 2024-09-12T22:32:34.458 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.458 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.458 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:34.458 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.423591+0000", 2024-09-12T22:32:34.458 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0052283980000000004 2024-09-12T22:32:34.459 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.459 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.459 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:34.459 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.423624+0000", 2024-09-12T22:32:34.459 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.3024000000000001e-05 2024-09-12T22:32:34.459 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.459 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.459 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:34.459 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.423667+0000", 2024-09-12T22:32:34.459 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.3136999999999997e-05 2024-09-12T22:32:34.459 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:34.459 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:34.459 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:34.459 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.460 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.460 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:34.460 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.400783+0000", 2024-09-12T22:32:34.460 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 57.026626491000002, 2024-09-12T22:32:34.460 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.016563729999999999, 2024-09-12T22:32:34.460 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:34.460 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:34.460 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:34.460 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:34.460 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.460 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:34.460 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400783+0000", 2024-09-12T22:32:34.460 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:34.460 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.461 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.461 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:34.461 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400783+0000", 2024-09-12T22:32:34.461 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:34.461 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.461 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.461 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:34.461 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400784+0000", 2024-09-12T22:32:34.461 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.5900000000000002e-07 2024-09-12T22:32:34.461 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.461 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.461 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:34.461 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400787+0000", 2024-09-12T22:32:34.461 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.1690000000000001e-06 2024-09-12T22:32:34.462 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.462 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.462 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:34.462 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400794+0000", 2024-09-12T22:32:34.462 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 7.058e-06 2024-09-12T22:32:34.462 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.462 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.462 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:34.462 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400798+0000", 2024-09-12T22:32:34.462 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.335e-06 2024-09-12T22:32:34.462 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.462 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.462 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:34.463 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400841+0000", 2024-09-12T22:32:34.463 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.2369e-05 2024-09-12T22:32:34.463 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.463 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.463 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op must wait for map", 2024-09-12T22:32:34.463 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400844+0000", 2024-09-12T22:32:34.463 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.128e-06 2024-09-12T22:32:34.463 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.463 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.463 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:34.463 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.410479+0000", 2024-09-12T22:32:34.463 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0096354189999999992 2024-09-12T22:32:34.463 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.463 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.464 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:34.464 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.410597+0000", 2024-09-12T22:32:34.464 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.000118305 2024-09-12T22:32:34.464 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.464 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.464 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:34.464 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.410838+0000", 2024-09-12T22:32:34.464 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.000240967 2024-09-12T22:32:34.464 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.464 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.464 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op_commit", 2024-09-12T22:32:34.464 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416489+0000", 2024-09-12T22:32:34.464 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0056507989999999998 2024-09-12T22:32:34.465 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.465 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.465 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:34.465 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417255+0000", 2024-09-12T22:32:34.465 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00076626199999999998 2024-09-12T22:32:34.465 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.465 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.465 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:34.465 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417306+0000", 2024-09-12T22:32:34.465 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.0319999999999999e-05 2024-09-12T22:32:34.465 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.465 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.465 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:34.465 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417347+0000", 2024-09-12T22:32:34.466 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.1140000000000003e-05 2024-09-12T22:32:34.466 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:34.466 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:34.466 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:34.466 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.466 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.466 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:34.466 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.400811+0000", 2024-09-12T22:32:34.466 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 57.026598421999999, 2024-09-12T22:32:34.466 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.017061263, 2024-09-12T22:32:34.466 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:34.466 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:34.466 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:34.466 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:34.467 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.467 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:34.467 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400811+0000", 2024-09-12T22:32:34.467 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:34.467 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.467 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.467 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:34.467 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400811+0000", 2024-09-12T22:32:34.467 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:34.467 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.467 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.467 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:34.467 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400812+0000", 2024-09-12T22:32:34.467 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.27e-07 2024-09-12T22:32:34.468 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.468 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.468 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:34.468 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400814+0000", 2024-09-12T22:32:34.468 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.553e-06 2024-09-12T22:32:34.468 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.468 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.468 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:34.468 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400819+0000", 2024-09-12T22:32:34.468 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.3569999999999997e-06 2024-09-12T22:32:34.468 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.468 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.468 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:34.469 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400824+0000", 2024-09-12T22:32:34.469 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.6820000000000002e-06 2024-09-12T22:32:34.469 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.469 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.469 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:34.469 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400871+0000", 2024-09-12T22:32:34.469 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.7311000000000002e-05 2024-09-12T22:32:34.469 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.469 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.469 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:32:34.469 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400875+0000", 2024-09-12T22:32:34.469 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.0960000000000001e-06 2024-09-12T22:32:34.469 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.469 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.470 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:34.470 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.412071+0000", 2024-09-12T22:32:34.470 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.011195999999999999 2024-09-12T22:32:34.470 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.470 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.470 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:34.470 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.412520+0000", 2024-09-12T22:32:34.470 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.000449522 2024-09-12T22:32:34.470 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.470 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.470 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:34.470 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.412655+0000", 2024-09-12T22:32:34.470 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00013487899999999999 2024-09-12T22:32:34.471 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.471 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.471 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op_commit", 2024-09-12T22:32:34.471 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417096+0000", 2024-09-12T22:32:34.471 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.004441113 2024-09-12T22:32:34.471 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.471 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.471 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:34.471 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417768+0000", 2024-09-12T22:32:34.471 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00067161100000000002 2024-09-12T22:32:34.471 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.471 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.471 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:34.471 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417834+0000", 2024-09-12T22:32:34.472 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.6058999999999999e-05 2024-09-12T22:32:34.472 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.472 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.472 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:34.472 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417873+0000", 2024-09-12T22:32:34.472 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.8753e-05 2024-09-12T22:32:34.472 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:34.472 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:34.472 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:34.472 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.473 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.473 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:34.473 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.400842+0000", 2024-09-12T22:32:34.473 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 57.026567714999999, 2024-09-12T22:32:34.473 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.022846262999999999, 2024-09-12T22:32:34.473 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:34.473 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:34.473 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:34.473 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:34.473 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.473 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:34.473 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400842+0000", 2024-09-12T22:32:34.473 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:34.474 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.474 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.474 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:34.474 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400842+0000", 2024-09-12T22:32:34.474 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:34.474 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.474 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.474 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:34.474 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400842+0000", 2024-09-12T22:32:34.474 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.9900000000000002e-07 2024-09-12T22:32:34.474 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.474 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.474 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:34.474 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400845+0000", 2024-09-12T22:32:34.475 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.8609999999999998e-06 2024-09-12T22:32:34.475 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.475 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.475 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:34.475 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400850+0000", 2024-09-12T22:32:34.475 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.634e-06 2024-09-12T22:32:34.475 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.475 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.475 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:34.475 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400855+0000", 2024-09-12T22:32:34.475 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.8339999999999998e-06 2024-09-12T22:32:34.475 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.475 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.475 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:34.476 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400886+0000", 2024-09-12T22:32:34.476 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.1393999999999998e-05 2024-09-12T22:32:34.476 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.476 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.476 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting_for_map not empty", 2024-09-12T22:32:34.476 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400888+0000", 2024-09-12T22:32:34.476 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.3470000000000001e-06 2024-09-12T22:32:34.476 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.476 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.476 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:34.476 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415640+0000", 2024-09-12T22:32:34.476 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.014751965000000001 2024-09-12T22:32:34.477 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.477 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.477 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:34.477 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415821+0000", 2024-09-12T22:32:34.477 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00018064399999999999 2024-09-12T22:32:34.477 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.477 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.477 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:34.477 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415949+0000", 2024-09-12T22:32:34.477 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00012816699999999999 2024-09-12T22:32:34.477 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.477 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.477 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op_commit", 2024-09-12T22:32:34.477 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.418337+0000", 2024-09-12T22:32:34.478 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0023878469999999998 2024-09-12T22:32:34.478 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.478 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.478 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:34.478 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.423588+0000", 2024-09-12T22:32:34.478 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0052509849999999997 2024-09-12T22:32:34.478 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.478 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.478 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:34.478 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.423650+0000", 2024-09-12T22:32:34.478 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.2026999999999994e-05 2024-09-12T22:32:34.478 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.478 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.479 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:34.479 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.423688+0000", 2024-09-12T22:32:34.479 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.8259000000000001e-05 2024-09-12T22:32:34.479 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:34.479 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:34.479 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:34.479 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.479 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.479 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:34.479 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.400862+0000", 2024-09-12T22:32:34.479 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 57.026547741000002, 2024-09-12T22:32:34.479 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.016404294, 2024-09-12T22:32:34.479 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:34.479 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:34.480 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "started", 2024-09-12T22:32:34.480 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:34.480 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.480 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:34.480 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400862+0000", 2024-09-12T22:32:34.480 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:34.480 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.480 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.480 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:34.480 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400862+0000", 2024-09-12T22:32:34.480 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:34.480 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.480 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.481 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:34.481 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400862+0000", 2024-09-12T22:32:34.481 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.8099999999999999e-07 2024-09-12T22:32:34.481 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.481 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.481 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:34.481 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400870+0000", 2024-09-12T22:32:34.481 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 8.1349999999999992e-06 2024-09-12T22:32:34.481 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.481 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.481 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:34.481 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400876+0000", 2024-09-12T22:32:34.481 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.2039999999999996e-06 2024-09-12T22:32:34.482 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.482 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.482 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:34.482 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400879+0000", 2024-09-12T22:32:34.482 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.529e-06 2024-09-12T22:32:34.482 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.482 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.482 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:34.482 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400912+0000", 2024-09-12T22:32:34.482 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.2653000000000001e-05 2024-09-12T22:32:34.482 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.482 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.482 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op must wait for map", 2024-09-12T22:32:34.483 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400915+0000", 2024-09-12T22:32:34.483 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.1099999999999999e-06 2024-09-12T22:32:34.483 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.483 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.483 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:34.483 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408727+0000", 2024-09-12T22:32:34.483 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0078123869999999996 2024-09-12T22:32:34.483 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.483 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.483 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:34.483 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408838+0000", 2024-09-12T22:32:34.483 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00011042700000000001 2024-09-12T22:32:34.483 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.484 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.484 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:34.484 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417266+0000", 2024-09-12T22:32:34.484 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0084285680000000009 2024-09-12T22:32:34.484 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:34.484 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:34.484 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:34.484 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.484 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.484 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:34.484 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.400889+0000", 2024-09-12T22:32:34.484 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 57.026520488000003, 2024-09-12T22:32:34.484 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.014929550999999999, 2024-09-12T22:32:34.485 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:34.485 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:34.485 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "started", 2024-09-12T22:32:34.485 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:34.485 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.485 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:34.485 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400889+0000", 2024-09-12T22:32:34.485 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:34.485 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.485 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.485 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:34.485 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400889+0000", 2024-09-12T22:32:34.486 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:34.486 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.486 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.486 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:34.486 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400890+0000", 2024-09-12T22:32:34.486 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.8699999999999995e-07 2024-09-12T22:32:34.486 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.486 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.486 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:34.486 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400893+0000", 2024-09-12T22:32:34.486 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.9569999999999998e-06 2024-09-12T22:32:34.486 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.487 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.487 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:34.487 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400899+0000", 2024-09-12T22:32:34.487 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.4189999999999999e-06 2024-09-12T22:32:34.487 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.487 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.487 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:34.487 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400905+0000", 2024-09-12T22:32:34.487 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.7880000000000003e-06 2024-09-12T22:32:34.487 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.487 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.487 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:34.487 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400943+0000", 2024-09-12T22:32:34.488 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.7852999999999998e-05 2024-09-12T22:32:34.488 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.488 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.488 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "op must wait for map", 2024-09-12T22:32:34.488 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.400945+0000", 2024-09-12T22:32:34.488 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.627e-06 2024-09-12T22:32:34.488 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.488 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.488 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:34.488 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408398+0000", 2024-09-12T22:32:34.488 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0074525879999999996 2024-09-12T22:32:34.488 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.488 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.489 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:34.489 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408581+0000", 2024-09-12T22:32:34.489 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00018321900000000001 2024-09-12T22:32:34.489 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.489 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.489 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:34.489 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415819+0000", 2024-09-12T22:32:34.489 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0072376130000000004 2024-09-12T22:32:34.489 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:34.489 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:34.489 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:34.489 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.489 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.489 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:25 3.7 e19/17 3:e0b41d06:::609.00000000:head v 19'2, mlcod=0'0)", 2024-09-12T22:32:34.490 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.402511+0000", 2024-09-12T22:32:34.490 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 57.024898344999997, 2024-09-12T22:32:34.490 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0089735260000000008, 2024-09-12T22:32:34.490 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:34.490 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:34.490 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:34.490 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:34.490 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.490 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:34.490 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.402511+0000", 2024-09-12T22:32:34.490 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:34.490 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.490 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.491 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:34.491 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.402511+0000", 2024-09-12T22:32:34.491 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:34.491 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.491 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.491 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:34.491 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.402512+0000", 2024-09-12T22:32:34.491 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 8.71e-07 2024-09-12T22:32:34.491 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.491 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.491 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:34.491 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.402520+0000", 2024-09-12T22:32:34.491 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 7.8529999999999992e-06 2024-09-12T22:32:34.492 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.492 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.492 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:34.492 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.402530+0000", 2024-09-12T22:32:34.492 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 9.859e-06 2024-09-12T22:32:34.492 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.492 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.492 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:34.492 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.402555+0000", 2024-09-12T22:32:34.492 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.4822000000000001e-05 2024-09-12T22:32:34.492 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.492 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.493 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:34.493 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.403173+0000", 2024-09-12T22:32:34.493 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00061813199999999997 2024-09-12T22:32:34.493 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.493 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.493 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:34.493 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.403195+0000", 2024-09-12T22:32:34.493 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.2286e-05 2024-09-12T22:32:34.493 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.493 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.493 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:34.493 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.411436+0000", 2024-09-12T22:32:34.493 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0082410539999999994 2024-09-12T22:32:34.494 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.494 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.494 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:34.494 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.411485+0000", 2024-09-12T22:32:34.494 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.8649000000000001e-05 2024-09-12T22:32:34.494 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:34.494 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:34.494 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:34.494 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.495 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.495 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:18 3.14 e19/17 3:2f55791f:::606.00000000:head v 19'1, mlcod=0'0)", 2024-09-12T22:32:34.495 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.406646+0000", 2024-09-12T22:32:34.495 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 57.020763193000001, 2024-09-12T22:32:34.495 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0082036980000000006, 2024-09-12T22:32:34.495 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:34.495 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:34.495 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:34.495 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:34.495 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.495 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:34.495 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406646+0000", 2024-09-12T22:32:34.495 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:34.496 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.496 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.496 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:34.496 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406646+0000", 2024-09-12T22:32:34.496 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:34.496 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.496 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.496 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:34.496 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406647+0000", 2024-09-12T22:32:34.496 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.4499999999999998e-07 2024-09-12T22:32:34.496 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.496 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.497 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:34.497 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406651+0000", 2024-09-12T22:32:34.497 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.0300000000000004e-06 2024-09-12T22:32:34.497 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.497 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.497 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:34.497 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406657+0000", 2024-09-12T22:32:34.497 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.1330000000000004e-06 2024-09-12T22:32:34.497 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.497 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.497 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:34.498 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406665+0000", 2024-09-12T22:32:34.498 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 8.3650000000000004e-06 2024-09-12T22:32:34.498 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.498 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.498 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:34.498 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406804+0000", 2024-09-12T22:32:34.498 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00013900699999999999 2024-09-12T22:32:34.498 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.498 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.498 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:34.498 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406833+0000", 2024-09-12T22:32:34.499 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.8243e-05 2024-09-12T22:32:34.499 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.499 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.499 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:34.499 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.414741+0000", 2024-09-12T22:32:34.499 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0079089620000000003 2024-09-12T22:32:34.499 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.499 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.499 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:34.499 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.414850+0000", 2024-09-12T22:32:34.499 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.000108713 2024-09-12T22:32:34.500 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:34.500 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:34.500 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:34.500 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.500 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.500 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:6 3.10 e19/17 3:0d82a743:::600.00000000:head v 19'1, mlcod=0'0)", 2024-09-12T22:32:34.500 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.406692+0000", 2024-09-12T22:32:34.500 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 57.020717425999997, 2024-09-12T22:32:34.500 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0093004430000000003, 2024-09-12T22:32:34.500 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:34.500 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:34.501 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:34.501 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:34.501 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.501 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:34.501 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406692+0000", 2024-09-12T22:32:34.501 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:34.501 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.501 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.501 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:34.501 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406692+0000", 2024-09-12T22:32:34.501 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:34.502 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.502 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.502 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:34.502 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406693+0000", 2024-09-12T22:32:34.502 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.6300000000000001e-07 2024-09-12T22:32:34.502 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.502 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.502 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:34.502 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406702+0000", 2024-09-12T22:32:34.502 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 9.5589999999999994e-06 2024-09-12T22:32:34.503 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.503 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.503 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:34.503 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406725+0000", 2024-09-12T22:32:34.503 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.2977999999999999e-05 2024-09-12T22:32:34.503 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.503 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.503 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:34.503 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406732+0000", 2024-09-12T22:32:34.503 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.8430000000000004e-06 2024-09-12T22:32:34.503 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.504 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.504 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:34.504 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406979+0000", 2024-09-12T22:32:34.504 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00024729199999999998 2024-09-12T22:32:34.504 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.504 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.504 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:34.504 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407000+0000", 2024-09-12T22:32:34.504 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.0573000000000001e-05 2024-09-12T22:32:34.504 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.504 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.505 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:34.505 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415928+0000", 2024-09-12T22:32:34.505 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0089286179999999993 2024-09-12T22:32:34.505 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.505 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.505 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:34.505 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415993+0000", 2024-09-12T22:32:34.505 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.4216999999999999e-05 2024-09-12T22:32:34.505 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:34.505 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:34.505 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:34.506 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.506 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.506 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:2 3.f e19/17 3:f1f69726:::400.00000000:head v 19'1, mlcod=0'0)", 2024-09-12T22:32:34.506 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.406942+0000", 2024-09-12T22:32:34.506 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 57.020467738999997, 2024-09-12T22:32:34.506 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0098433259999999995, 2024-09-12T22:32:34.506 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:34.506 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:34.506 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:34.506 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:34.506 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.506 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:34.506 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406942+0000", 2024-09-12T22:32:34.507 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:34.507 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.507 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.507 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:34.507 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406942+0000", 2024-09-12T22:32:34.507 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:34.507 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.507 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.507 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:34.507 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406943+0000", 2024-09-12T22:32:34.507 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.8800000000000002e-07 2024-09-12T22:32:34.507 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.507 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.507 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:34.508 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406949+0000", 2024-09-12T22:32:34.508 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.5869999999999998e-06 2024-09-12T22:32:34.508 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.508 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.508 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:34.508 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406960+0000", 2024-09-12T22:32:34.508 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.0873000000000001e-05 2024-09-12T22:32:34.508 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.508 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.508 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:34.508 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406970+0000", 2024-09-12T22:32:34.508 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 9.9119999999999993e-06 2024-09-12T22:32:34.508 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.509 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.509 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:34.509 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407535+0000", 2024-09-12T22:32:34.509 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00056508899999999996 2024-09-12T22:32:34.509 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.509 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.509 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:34.509 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407556+0000", 2024-09-12T22:32:34.509 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.1348999999999998e-05 2024-09-12T22:32:34.509 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.509 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.509 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:34.509 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416751+0000", 2024-09-12T22:32:34.510 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0091950109999999995 2024-09-12T22:32:34.510 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.510 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.510 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:34.510 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416785+0000", 2024-09-12T22:32:34.510 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.3917000000000001e-05 2024-09-12T22:32:34.510 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:34.510 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:34.510 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:34.510 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.510 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.510 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:19 3.14 e19/17 3:2f55791f:::606.00000000:head v 19'2, mlcod=0'0)", 2024-09-12T22:32:34.510 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.406983+0000", 2024-09-12T22:32:34.510 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 57.020426759999999, 2024-09-12T22:32:34.511 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0080362149999999993, 2024-09-12T22:32:34.511 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:34.511 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:34.511 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:34.511 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:34.511 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.511 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:34.511 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406983+0000", 2024-09-12T22:32:34.511 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:34.511 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.511 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.511 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:34.511 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406983+0000", 2024-09-12T22:32:34.512 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:34.512 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.512 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.512 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:34.512 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406983+0000", 2024-09-12T22:32:34.512 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.8200000000000001e-07 2024-09-12T22:32:34.512 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.512 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.512 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:34.512 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.406999+0000", 2024-09-12T22:32:34.512 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.5747999999999999e-05 2024-09-12T22:32:34.512 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.512 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.513 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:34.513 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407006+0000", 2024-09-12T22:32:34.513 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 7.2609999999999996e-06 2024-09-12T22:32:34.513 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.513 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.513 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:34.513 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407035+0000", 2024-09-12T22:32:34.513 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.8214000000000001e-05 2024-09-12T22:32:34.513 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.513 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.513 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:34.513 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407092+0000", 2024-09-12T22:32:34.513 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.7027000000000001e-05 2024-09-12T22:32:34.513 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.514 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.514 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:34.514 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407126+0000", 2024-09-12T22:32:34.514 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.4082000000000003e-05 2024-09-12T22:32:34.514 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.514 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.514 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:34.514 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.414985+0000", 2024-09-12T22:32:34.514 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0078597319999999995 2024-09-12T22:32:34.514 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.514 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.514 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:34.514 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415019+0000", 2024-09-12T22:32:34.514 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.3769000000000001e-05 2024-09-12T22:32:34.515 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:34.515 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:34.515 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:34.515 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.515 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.515 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:7 3.10 e19/17 3:0d82a743:::600.00000000:head v 19'2, mlcod=0'0)", 2024-09-12T22:32:34.515 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.407048+0000", 2024-09-12T22:32:34.515 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 57.020361221999998, 2024-09-12T22:32:34.515 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.008979931, 2024-09-12T22:32:34.515 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:34.515 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:34.515 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:34.515 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:34.516 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.516 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:34.516 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407048+0000", 2024-09-12T22:32:34.516 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:34.516 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.516 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.516 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:34.516 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407048+0000", 2024-09-12T22:32:34.516 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:34.516 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.516 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.516 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:34.516 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407049+0000", 2024-09-12T22:32:34.517 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.9099999999999999e-07 2024-09-12T22:32:34.517 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.517 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.517 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:34.517 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407054+0000", 2024-09-12T22:32:34.517 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.1850000000000003e-06 2024-09-12T22:32:34.517 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.517 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.517 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:34.517 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407061+0000", 2024-09-12T22:32:34.517 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 7.0809999999999996e-06 2024-09-12T22:32:34.517 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.517 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.518 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:34.518 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407067+0000", 2024-09-12T22:32:34.518 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.9540000000000001e-06 2024-09-12T22:32:34.518 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.518 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.518 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:34.518 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407299+0000", 2024-09-12T22:32:34.518 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.000232122 2024-09-12T22:32:34.518 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.518 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.518 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:34.518 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407317+0000", 2024-09-12T22:32:34.518 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.7447000000000001e-05 2024-09-12T22:32:34.518 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.519 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.519 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:34.519 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.415996+0000", 2024-09-12T22:32:34.519 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0086791799999999999 2024-09-12T22:32:34.519 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.519 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.519 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:34.519 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416028+0000", 2024-09-12T22:32:34.519 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.2570999999999997e-05 2024-09-12T22:32:34.519 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:34.519 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:34.519 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:34.519 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.520 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.520 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:8 3.10 e19/17 3:09401a81:::601.00000000:head v 19'3, mlcod=0'0)", 2024-09-12T22:32:34.520 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.407081+0000", 2024-09-12T22:32:34.520 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 57.020328532000001, 2024-09-12T22:32:34.520 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0089807270000000008, 2024-09-12T22:32:34.520 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:34.520 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:34.520 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:34.520 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:34.520 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.520 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:34.520 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407081+0000", 2024-09-12T22:32:34.520 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:34.521 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.521 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.521 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:34.521 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407081+0000", 2024-09-12T22:32:34.521 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:34.521 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.521 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.521 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:34.521 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407082+0000", 2024-09-12T22:32:34.521 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.7899999999999999e-07 2024-09-12T22:32:34.521 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.521 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.521 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:34.521 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407086+0000", 2024-09-12T22:32:34.522 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.7679999999999999e-06 2024-09-12T22:32:34.522 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.522 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.522 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:34.522 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407094+0000", 2024-09-12T22:32:34.522 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 8.1470000000000001e-06 2024-09-12T22:32:34.522 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.522 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.522 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:34.522 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407100+0000", 2024-09-12T22:32:34.522 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.4539999999999998e-06 2024-09-12T22:32:34.522 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.522 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.523 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:34.523 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407540+0000", 2024-09-12T22:32:34.523 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00043973699999999999 2024-09-12T22:32:34.523 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.523 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.523 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:34.523 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.407553+0000", 2024-09-12T22:32:34.523 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.3368e-05 2024-09-12T22:32:34.523 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.523 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.523 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:34.524 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416032+0000", 2024-09-12T22:32:34.524 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0084793790000000004 2024-09-12T22:32:34.524 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.524 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.524 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:34.524 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416062+0000", 2024-09-12T22:32:34.524 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 2.9495000000000001e-05 2024-09-12T22:32:34.524 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:34.524 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:34.524 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:34.524 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.524 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.525 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:31 3.d e19/17 3:b50e409b:::mds_snaptable:head v 19'1, mlcod=0'0)", 2024-09-12T22:32:34.525 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.408508+0000", 2024-09-12T22:32:34.525 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 57.018902015999998, 2024-09-12T22:32:34.525 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0080056620000000002, 2024-09-12T22:32:34.525 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:34.525 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:34.525 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:34.525 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:34.525 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.525 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:34.525 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408508+0000", 2024-09-12T22:32:34.525 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:34.525 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.526 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.526 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:34.526 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408508+0000", 2024-09-12T22:32:34.526 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:34.526 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.526 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.526 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:34.526 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408508+0000", 2024-09-12T22:32:34.526 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.7e-07 2024-09-12T22:32:34.526 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.526 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.526 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:34.526 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408515+0000", 2024-09-12T22:32:34.527 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.4439999999999996e-06 2024-09-12T22:32:34.527 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.527 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.527 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:34.527 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408521+0000", 2024-09-12T22:32:34.527 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.2729999999999999e-06 2024-09-12T22:32:34.527 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.527 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.527 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:34.527 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408526+0000", 2024-09-12T22:32:34.527 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.3299999999999998e-06 2024-09-12T22:32:34.527 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.528 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.528 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:34.528 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.410190+0000", 2024-09-12T22:32:34.528 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.001663615 2024-09-12T22:32:34.528 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.528 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.528 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:34.528 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.410258+0000", 2024-09-12T22:32:34.528 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.8146999999999997e-05 2024-09-12T22:32:34.528 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.528 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.528 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:34.528 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416477+0000", 2024-09-12T22:32:34.529 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0062187329999999997 2024-09-12T22:32:34.529 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.529 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.529 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:34.529 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416513+0000", 2024-09-12T22:32:34.529 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.6650000000000003e-05 2024-09-12T22:32:34.529 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:34.529 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:34.529 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:34.529 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.529 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.529 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:9 3.10 e19/17 3:09401a81:::601.00000000:head v 19'4, mlcod=0'0)", 2024-09-12T22:32:34.529 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.408991+0000", 2024-09-12T22:32:34.529 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 57.018418265999998, 2024-09-12T22:32:34.530 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0080459209999999993, 2024-09-12T22:32:34.530 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:34.530 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:34.530 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:34.530 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:34.530 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.530 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:34.530 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408991+0000", 2024-09-12T22:32:34.530 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:34.530 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.530 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.530 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:34.530 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408991+0000", 2024-09-12T22:32:34.531 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:34.531 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.531 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.531 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:34.531 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.408992+0000", 2024-09-12T22:32:34.531 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.1799999999999995e-07 2024-09-12T22:32:34.531 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.531 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.531 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:34.531 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409005+0000", 2024-09-12T22:32:34.531 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.261e-05 2024-09-12T22:32:34.531 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.531 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.532 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:34.532 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409015+0000", 2024-09-12T22:32:34.532 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.0001e-05 2024-09-12T22:32:34.532 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.532 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.532 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:34.532 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409023+0000", 2024-09-12T22:32:34.532 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 8.7569999999999993e-06 2024-09-12T22:32:34.532 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.532 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.532 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:34.532 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.411355+0000", 2024-09-12T22:32:34.533 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0023313520000000001 2024-09-12T22:32:34.533 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.533 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.533 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:34.533 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.411374+0000", 2024-09-12T22:32:34.533 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.8810000000000001e-05 2024-09-12T22:32:34.533 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.533 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.533 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:34.533 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.416994+0000", 2024-09-12T22:32:34.533 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.005620524 2024-09-12T22:32:34.533 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.534 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.534 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:34.534 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417037+0000", 2024-09-12T22:32:34.534 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.3248999999999999e-05 2024-09-12T22:32:34.534 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:34.534 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:34.534 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:34.534 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.534 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.534 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:10 3.10 e19/17 3:0bd6d154:::602.00000000:head v 19'5, mlcod=0'0)", 2024-09-12T22:32:34.534 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.409038+0000", 2024-09-12T22:32:34.534 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 57.018371590999998, 2024-09-12T22:32:34.535 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0080541689999999999, 2024-09-12T22:32:34.535 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:34.535 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:34.535 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:34.535 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:34.535 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.535 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:34.535 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409038+0000", 2024-09-12T22:32:34.535 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:34.535 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.535 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.535 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:34.535 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409038+0000", 2024-09-12T22:32:34.536 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:34.536 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.536 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.536 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:34.536 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409038+0000", 2024-09-12T22:32:34.536 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 3.7899999999999999e-07 2024-09-12T22:32:34.536 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.536 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.536 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:34.536 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409043+0000", 2024-09-12T22:32:34.536 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 4.6589999999999998e-06 2024-09-12T22:32:34.536 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.536 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.537 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:34.537 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409050+0000", 2024-09-12T22:32:34.537 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 7.0829999999999998e-06 2024-09-12T22:32:34.537 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.537 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.537 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:34.537 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409058+0000", 2024-09-12T22:32:34.540 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 7.7309999999999993e-06 2024-09-12T22:32:34.541 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.541 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.541 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:34.541 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.411654+0000", 2024-09-12T22:32:34.541 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0025961650000000001 2024-09-12T22:32:34.541 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.541 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.541 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:34.541 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.411671+0000", 2024-09-12T22:32:34.541 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.7356000000000001e-05 2024-09-12T22:32:34.541 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.542 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.542 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:34.542 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417040+0000", 2024-09-12T22:32:34.542 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0053681889999999998 2024-09-12T22:32:34.542 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.542 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.542 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:34.542 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417092+0000", 2024-09-12T22:32:34.543 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 5.2607e-05 2024-09-12T22:32:34.543 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:34.543 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:34.543 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:34.543 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.543 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.543 INFO:teuthology.orchestra.run.smithi076.stdout: "description": "osd_repop(mds.0.3:11 3.10 e19/17 3:0bd6d154:::602.00000000:head v 19'6, mlcod=0'0)", 2024-09-12T22:32:34.543 INFO:teuthology.orchestra.run.smithi076.stdout: "initiated_at": "2024-09-12T22:31:37.409768+0000", 2024-09-12T22:32:34.543 INFO:teuthology.orchestra.run.smithi076.stdout: "age": 57.01764215, 2024-09-12T22:32:34.543 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0074442759999999997, 2024-09-12T22:32:34.543 INFO:teuthology.orchestra.run.smithi076.stdout: "continuous": false, 2024-09-12T22:32:34.543 INFO:teuthology.orchestra.run.smithi076.stdout: "type_data": { 2024-09-12T22:32:34.543 INFO:teuthology.orchestra.run.smithi076.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:34.544 INFO:teuthology.orchestra.run.smithi076.stdout: "events": [ 2024-09-12T22:32:34.544 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.544 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "initiated", 2024-09-12T22:32:34.544 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409768+0000", 2024-09-12T22:32:34.544 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:34.544 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.544 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.544 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "header_read", 2024-09-12T22:32:34.544 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409768+0000", 2024-09-12T22:32:34.544 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0 2024-09-12T22:32:34.544 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.544 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.545 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "throttled", 2024-09-12T22:32:34.545 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409768+0000", 2024-09-12T22:32:34.545 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.37e-07 2024-09-12T22:32:34.545 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.545 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.545 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "all_read", 2024-09-12T22:32:34.545 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409775+0000", 2024-09-12T22:32:34.545 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 6.4670000000000001e-06 2024-09-12T22:32:34.545 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.545 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.545 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "dispatched", 2024-09-12T22:32:34.545 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409793+0000", 2024-09-12T22:32:34.545 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 1.8162e-05 2024-09-12T22:32:34.545 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.546 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.546 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "queued_for_pg", 2024-09-12T22:32:34.546 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.409954+0000", 2024-09-12T22:32:34.546 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00016072999999999999 2024-09-12T22:32:34.546 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.546 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.546 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "reached_pg", 2024-09-12T22:32:34.546 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.411943+0000", 2024-09-12T22:32:34.546 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.0019897069999999998 2024-09-12T22:32:34.546 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.546 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.546 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "started", 2024-09-12T22:32:34.546 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.412069+0000", 2024-09-12T22:32:34.547 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.00012546200000000001 2024-09-12T22:32:34.547 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.547 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.547 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "commit_sent", 2024-09-12T22:32:34.547 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417114+0000", 2024-09-12T22:32:34.547 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 0.005045023 2024-09-12T22:32:34.547 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-09-12T22:32:34.547 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-09-12T22:32:34.547 INFO:teuthology.orchestra.run.smithi076.stdout: "event": "done", 2024-09-12T22:32:34.547 INFO:teuthology.orchestra.run.smithi076.stdout: "time": "2024-09-12T22:31:37.417212+0000", 2024-09-12T22:32:34.547 INFO:teuthology.orchestra.run.smithi076.stdout: "duration": 9.8088e-05 2024-09-12T22:32:34.547 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:34.547 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:34.548 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:34.548 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-09-12T22:32:34.548 INFO:teuthology.orchestra.run.smithi076.stdout: ] 2024-09-12T22:32:34.548 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-09-12T22:32:34.549 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:34.548+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:34.550 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:32:34.650 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:32:34.649+0000 7fddec6a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30331) UID: 0 2024-09-12T22:32:34.665 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:32:34.665 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:32:34.666 INFO:teuthology.orchestra.run.smithi148.stdout: "num_ops": 0 2024-09-12T22:32:34.666 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:32:34.675 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:32:34.752 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:34.750+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:34.778 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:32:34.778 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:32:34.778 INFO:teuthology.orchestra.run.smithi148.stdout: "complaint_time": 30, 2024-09-12T22:32:34.778 INFO:teuthology.orchestra.run.smithi148.stdout: "num_blocked_ops": 0 2024-09-12T22:32:34.778 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:32:34.787 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:32:34.853 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:34.852+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:34.892 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:32:34.892 INFO:teuthology.orchestra.run.smithi148.stdout: "size": 20, 2024-09-12T22:32:34.892 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 600, 2024-09-12T22:32:34.892 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [ 2024-09-12T22:32:34.892 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.892 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:34.892 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.400880+0000", 2024-09-12T22:32:34.892 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 57.489188360999997, 2024-09-12T22:32:34.892 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0095133660000000005, 2024-09-12T22:32:34.893 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:34.893 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:34.893 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:34.893 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:34.893 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.893 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:34.893 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400880+0000", 2024-09-12T22:32:34.893 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:34.893 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.893 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.893 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:34.893 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400880+0000", 2024-09-12T22:32:34.893 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:34.893 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.894 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.894 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:34.894 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400892+0000", 2024-09-12T22:32:34.894 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1941e-05 2024-09-12T22:32:34.894 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.894 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.894 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:34.894 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400900+0000", 2024-09-12T22:32:34.894 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0080000000000002e-06 2024-09-12T22:32:34.894 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.894 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.894 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:34.894 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400911+0000", 2024-09-12T22:32:34.894 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1452e-05 2024-09-12T22:32:34.895 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.895 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.895 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:34.895 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400922+0000", 2024-09-12T22:32:34.895 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0772e-05 2024-09-12T22:32:34.895 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.895 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.895 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:34.895 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401009+0000", 2024-09-12T22:32:34.895 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.7206000000000005e-05 2024-09-12T22:32:34.895 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.895 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.895 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:34.895 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401157+0000", 2024-09-12T22:32:34.896 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014831499999999999 2024-09-12T22:32:34.896 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.896 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.896 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:34.896 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401312+0000", 2024-09-12T22:32:34.896 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00015495600000000001 2024-09-12T22:32:34.896 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.896 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.896 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:34.896 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.403060+0000", 2024-09-12T22:32:34.896 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0017475220000000001 2024-09-12T22:32:34.896 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.896 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.896 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:34.897 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410300+0000", 2024-09-12T22:32:34.897 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0072403260000000001 2024-09-12T22:32:34.897 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.897 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.897 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:34.897 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410350+0000", 2024-09-12T22:32:34.897 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9814000000000001e-05 2024-09-12T22:32:34.897 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.897 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.897 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:34.897 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410393+0000", 2024-09-12T22:32:34.897 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3053999999999998e-05 2024-09-12T22:32:34.897 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:34.897 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:34.898 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:34.898 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.898 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.898 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:34.898 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.400952+0000", 2024-09-12T22:32:34.898 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 57.489116209000002, 2024-09-12T22:32:34.898 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0096045620000000005, 2024-09-12T22:32:34.898 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:34.898 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:34.898 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:34.898 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:34.898 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.898 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:34.898 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400952+0000", 2024-09-12T22:32:34.899 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:34.899 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.899 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.899 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:34.899 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400952+0000", 2024-09-12T22:32:34.899 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:34.899 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.899 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.899 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:34.899 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400953+0000", 2024-09-12T22:32:34.899 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.8000000000000005e-07 2024-09-12T22:32:34.899 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.899 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.900 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:34.900 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400957+0000", 2024-09-12T22:32:34.900 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.33e-06 2024-09-12T22:32:34.900 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.900 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.900 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:34.900 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400966+0000", 2024-09-12T22:32:34.900 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1989999999999995e-06 2024-09-12T22:32:34.900 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.900 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.900 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:34.900 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400973+0000", 2024-09-12T22:32:34.900 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2779999999999999e-06 2024-09-12T22:32:34.900 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.901 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.901 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:34.901 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401696+0000", 2024-09-12T22:32:34.901 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00072363500000000003 2024-09-12T22:32:34.901 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.901 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.901 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:34.901 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401788+0000", 2024-09-12T22:32:34.901 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1862999999999998e-05 2024-09-12T22:32:34.902 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.902 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.902 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:34.902 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401929+0000", 2024-09-12T22:32:34.902 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014096000000000001 2024-09-12T22:32:34.902 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.902 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.902 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:34.902 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.403542+0000", 2024-09-12T22:32:34.902 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001612963 2024-09-12T22:32:34.902 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.902 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.902 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:34.902 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410460+0000", 2024-09-12T22:32:34.903 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0069180500000000002 2024-09-12T22:32:34.903 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.903 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.903 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:34.903 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410515+0000", 2024-09-12T22:32:34.903 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5009000000000001e-05 2024-09-12T22:32:34.903 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.903 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.903 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:34.903 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410557+0000", 2024-09-12T22:32:34.903 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1495000000000002e-05 2024-09-12T22:32:34.903 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:34.903 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:34.903 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:34.904 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.904 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.904 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:34.904 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.400984+0000", 2024-09-12T22:32:34.904 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 57.489083714000003, 2024-09-12T22:32:34.904 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0073703950000000001, 2024-09-12T22:32:34.904 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:34.904 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:34.904 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:34.904 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:34.904 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.904 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:34.904 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400984+0000", 2024-09-12T22:32:34.904 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:34.905 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.905 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.905 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:34.905 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400984+0000", 2024-09-12T22:32:34.905 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:34.905 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.905 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.905 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:34.905 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400985+0000", 2024-09-12T22:32:34.905 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3200000000000005e-07 2024-09-12T22:32:34.905 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.905 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.905 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:34.905 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400998+0000", 2024-09-12T22:32:34.906 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2726e-05 2024-09-12T22:32:34.906 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.906 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.906 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:34.906 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401006+0000", 2024-09-12T22:32:34.906 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.3110000000000006e-06 2024-09-12T22:32:34.906 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.906 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.906 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:34.906 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401022+0000", 2024-09-12T22:32:34.906 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6249e-05 2024-09-12T22:32:34.906 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.906 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.906 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:34.907 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401700+0000", 2024-09-12T22:32:34.907 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00067811100000000001 2024-09-12T22:32:34.907 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.907 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.907 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:34.907 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401839+0000", 2024-09-12T22:32:34.907 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013865399999999999 2024-09-12T22:32:34.907 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.907 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.907 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:34.907 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401962+0000", 2024-09-12T22:32:34.907 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000123266 2024-09-12T22:32:34.907 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.907 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.908 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:34.908 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.403589+0000", 2024-09-12T22:32:34.908 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001626932 2024-09-12T22:32:34.908 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.908 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.908 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:34.908 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.408274+0000", 2024-09-12T22:32:34.908 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0046848100000000002 2024-09-12T22:32:34.908 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.908 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.908 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:34.908 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.408324+0000", 2024-09-12T22:32:34.908 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9784000000000003e-05 2024-09-12T22:32:34.908 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.909 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.909 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:34.909 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.408355+0000", 2024-09-12T22:32:34.909 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.1019999999999998e-05 2024-09-12T22:32:34.909 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:34.909 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:34.909 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:34.910 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.910 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.910 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:34.910 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401034+0000", 2024-09-12T22:32:34.910 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 57.489034273999998, 2024-09-12T22:32:34.910 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011063051000000001, 2024-09-12T22:32:34.910 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:34.910 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:34.910 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:34.910 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:34.911 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.911 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:34.911 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401034+0000", 2024-09-12T22:32:34.911 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:34.911 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.911 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.911 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:34.911 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401034+0000", 2024-09-12T22:32:34.911 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:34.911 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.911 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.911 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:34.911 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401034+0000", 2024-09-12T22:32:34.912 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8899999999999999e-07 2024-09-12T22:32:34.912 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.912 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.912 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:34.912 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401038+0000", 2024-09-12T22:32:34.912 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.523e-06 2024-09-12T22:32:34.912 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.912 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.912 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:34.912 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401046+0000", 2024-09-12T22:32:34.912 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0479999999999999e-06 2024-09-12T22:32:34.912 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.912 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.913 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:34.913 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401051+0000", 2024-09-12T22:32:34.913 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2619999999999998e-06 2024-09-12T22:32:34.913 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.913 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.913 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:34.913 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402270+0000", 2024-09-12T22:32:34.913 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012182429999999999 2024-09-12T22:32:34.913 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.913 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.913 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:34.913 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402325+0000", 2024-09-12T22:32:34.913 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5526999999999999e-05 2024-09-12T22:32:34.913 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.914 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.914 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:34.914 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402403+0000", 2024-09-12T22:32:34.914 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.7559999999999996e-05 2024-09-12T22:32:34.914 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.914 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.914 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:34.914 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.403655+0000", 2024-09-12T22:32:34.914 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012521489999999999 2024-09-12T22:32:34.914 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.914 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.914 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:34.914 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411979+0000", 2024-09-12T22:32:34.914 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0083240420000000002 2024-09-12T22:32:34.915 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.915 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.915 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:34.915 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.412036+0000", 2024-09-12T22:32:34.915 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7639000000000002e-05 2024-09-12T22:32:34.915 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.915 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.915 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:34.915 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.412097+0000", 2024-09-12T22:32:34.915 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0469e-05 2024-09-12T22:32:34.915 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:34.915 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:34.915 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:34.915 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.916 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.916 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:34.916 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401060+0000", 2024-09-12T22:32:34.916 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 57.489008521999999, 2024-09-12T22:32:34.916 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.010030172, 2024-09-12T22:32:34.916 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:34.916 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:34.916 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:34.916 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:34.916 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.916 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:34.916 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401060+0000", 2024-09-12T22:32:34.916 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:34.916 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.917 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.917 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:34.917 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401060+0000", 2024-09-12T22:32:34.917 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:34.917 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.917 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.917 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:34.917 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401060+0000", 2024-09-12T22:32:34.917 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2500000000000001e-07 2024-09-12T22:32:34.917 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.917 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.917 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:34.918 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401063+0000", 2024-09-12T22:32:34.918 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0910000000000001e-06 2024-09-12T22:32:34.918 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.918 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.918 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:34.918 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401070+0000", 2024-09-12T22:32:34.918 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1210000000000001e-06 2024-09-12T22:32:34.918 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.918 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.918 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:34.918 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401076+0000", 2024-09-12T22:32:34.918 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2830000000000001e-06 2024-09-12T22:32:34.918 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.918 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.919 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:34.919 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402288+0000", 2024-09-12T22:32:34.919 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012123699999999999 2024-09-12T22:32:34.919 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.919 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.919 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:34.919 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402359+0000", 2024-09-12T22:32:34.919 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.0988000000000005e-05 2024-09-12T22:32:34.919 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.919 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.919 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:34.919 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402457+0000", 2024-09-12T22:32:34.919 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.7857999999999997e-05 2024-09-12T22:32:34.919 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.920 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.920 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:34.920 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.404395+0000", 2024-09-12T22:32:34.920 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0019380160000000001 2024-09-12T22:32:34.920 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.920 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.920 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:34.920 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410603+0000", 2024-09-12T22:32:34.920 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.006208061 2024-09-12T22:32:34.920 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.920 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.920 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:34.920 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410687+0000", 2024-09-12T22:32:34.921 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.4623000000000006e-05 2024-09-12T22:32:34.921 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.921 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.921 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:34.921 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411090+0000", 2024-09-12T22:32:34.921 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00040233599999999999 2024-09-12T22:32:34.921 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:34.921 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:34.921 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:34.921 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.921 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.921 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:34.921 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401083+0000", 2024-09-12T22:32:34.921 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 57.488985106000001, 2024-09-12T22:32:34.922 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0097591850000000001, 2024-09-12T22:32:34.922 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:34.922 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:34.922 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:34.922 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:34.922 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.922 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:34.922 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401083+0000", 2024-09-12T22:32:34.922 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:34.922 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.922 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.922 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:34.922 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401083+0000", 2024-09-12T22:32:34.922 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:34.923 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.923 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.923 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:34.923 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401084+0000", 2024-09-12T22:32:34.923 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4799999999999999e-07 2024-09-12T22:32:34.923 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.923 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.923 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:34.923 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401088+0000", 2024-09-12T22:32:34.923 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6419999999999998e-06 2024-09-12T22:32:34.923 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.923 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.923 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:34.924 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401094+0000", 2024-09-12T22:32:34.924 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0090000000000004e-06 2024-09-12T22:32:34.924 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.924 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.924 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:34.924 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401108+0000", 2024-09-12T22:32:34.924 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3884e-05 2024-09-12T22:32:34.924 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.924 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.924 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:34.924 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401165+0000", 2024-09-12T22:32:34.924 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.6499000000000002e-05 2024-09-12T22:32:34.924 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.925 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.925 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:34.925 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401261+0000", 2024-09-12T22:32:34.925 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.6872000000000004e-05 2024-09-12T22:32:34.925 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.925 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.925 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:34.925 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401376+0000", 2024-09-12T22:32:34.925 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000114508 2024-09-12T22:32:34.925 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.925 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.925 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:34.925 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402666+0000", 2024-09-12T22:32:34.926 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012901659999999999 2024-09-12T22:32:34.926 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.926 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.926 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:34.926 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410572+0000", 2024-09-12T22:32:34.926 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0079055489999999996 2024-09-12T22:32:34.926 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.926 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.926 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:34.926 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410661+0000", 2024-09-12T22:32:34.926 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.9578000000000002e-05 2024-09-12T22:32:34.926 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.926 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.927 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:34.927 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410842+0000", 2024-09-12T22:32:34.927 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00018102999999999999 2024-09-12T22:32:34.927 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:34.927 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:34.927 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:34.927 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.927 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.927 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:34.927 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401122+0000", 2024-09-12T22:32:34.927 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 57.488946073999998, 2024-09-12T22:32:34.927 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0099122080000000005, 2024-09-12T22:32:34.927 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:34.927 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:34.928 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:32:34.928 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:34.928 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.928 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:34.928 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401122+0000", 2024-09-12T22:32:34.928 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:34.928 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.928 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.928 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:34.928 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401122+0000", 2024-09-12T22:32:34.928 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:34.929 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.929 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.929 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:34.929 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401123+0000", 2024-09-12T22:32:34.929 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2600000000000002e-07 2024-09-12T22:32:34.929 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.929 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.929 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:34.929 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401126+0000", 2024-09-12T22:32:34.929 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.6449999999999998e-06 2024-09-12T22:32:34.929 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.929 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.930 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:34.930 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401133+0000", 2024-09-12T22:32:34.930 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.9890000000000003e-06 2024-09-12T22:32:34.930 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.930 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.930 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:34.930 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401138+0000", 2024-09-12T22:32:34.930 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8060000000000002e-06 2024-09-12T22:32:34.930 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.930 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.930 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:34.930 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401703+0000", 2024-09-12T22:32:34.930 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00056509099999999999 2024-09-12T22:32:34.931 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.931 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.931 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:34.931 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401837+0000", 2024-09-12T22:32:34.931 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013338799999999999 2024-09-12T22:32:34.931 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.931 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.931 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:34.931 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411034+0000", 2024-09-12T22:32:34.931 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.009197663 2024-09-12T22:32:34.932 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:34.932 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:34.932 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:34.932 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.932 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.932 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:34.932 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401158+0000", 2024-09-12T22:32:34.932 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 57.488910294999997, 2024-09-12T22:32:34.932 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.010292437999999999, 2024-09-12T22:32:34.932 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:34.932 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:34.932 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:32:34.932 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:34.933 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.933 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:34.933 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401158+0000", 2024-09-12T22:32:34.933 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:34.933 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.933 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.933 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:34.933 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401158+0000", 2024-09-12T22:32:34.933 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:34.933 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.933 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.934 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:34.934 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401158+0000", 2024-09-12T22:32:34.934 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9699999999999996e-07 2024-09-12T22:32:34.934 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.934 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.934 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:34.934 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401161+0000", 2024-09-12T22:32:34.934 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.7410000000000001e-06 2024-09-12T22:32:34.934 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.934 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.934 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:34.934 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401168+0000", 2024-09-12T22:32:34.934 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.844e-06 2024-09-12T22:32:34.935 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.935 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.935 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:34.935 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401174+0000", 2024-09-12T22:32:34.935 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4700000000000001e-06 2024-09-12T22:32:34.935 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.935 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.935 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:34.935 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402799+0000", 2024-09-12T22:32:34.935 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0016256409999999999 2024-09-12T22:32:34.936 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.936 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.936 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:34.936 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402893+0000", 2024-09-12T22:32:34.936 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.3807999999999994e-05 2024-09-12T22:32:34.936 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.936 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.936 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:34.936 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411450+0000", 2024-09-12T22:32:34.936 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0085573369999999999 2024-09-12T22:32:34.936 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:34.937 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:34.937 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:34.937 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.937 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.937 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:34.937 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401183+0000", 2024-09-12T22:32:34.937 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 57.488885443000001, 2024-09-12T22:32:34.937 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0068597830000000004, 2024-09-12T22:32:34.937 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:34.937 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:34.937 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:32:34.937 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:34.938 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.938 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:34.938 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401183+0000", 2024-09-12T22:32:34.938 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:34.938 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.938 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.938 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:34.938 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401183+0000", 2024-09-12T22:32:34.938 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:34.939 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.939 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.939 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:34.939 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401183+0000", 2024-09-12T22:32:34.939 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.6700000000000003e-07 2024-09-12T22:32:34.939 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.939 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.939 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:34.939 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401186+0000", 2024-09-12T22:32:34.939 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4679999999999999e-06 2024-09-12T22:32:34.940 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.940 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.940 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:34.940 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401192+0000", 2024-09-12T22:32:34.940 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.1519999999999997e-06 2024-09-12T22:32:34.940 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.940 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.940 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:34.940 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401197+0000", 2024-09-12T22:32:34.940 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4669999999999998e-06 2024-09-12T22:32:34.941 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.941 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.941 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:34.941 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401253+0000", 2024-09-12T22:32:34.941 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.6211000000000001e-05 2024-09-12T22:32:34.941 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.941 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.941 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:34.941 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401413+0000", 2024-09-12T22:32:34.941 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00016021399999999999 2024-09-12T22:32:34.941 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.942 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.942 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:34.942 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.408043+0000", 2024-09-12T22:32:34.942 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0066295039999999996 2024-09-12T22:32:34.942 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:34.942 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:34.942 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:34.942 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.942 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.942 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:20 3.1c e19/17 3:3ed09add:::607.00000000:head v 19'1, mlcod=0'0)", 2024-09-12T22:32:34.942 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.409642+0000", 2024-09-12T22:32:34.942 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 57.480425984, 2024-09-12T22:32:34.942 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0038816269999999999, 2024-09-12T22:32:34.942 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:34.943 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:34.943 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:34.943 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:34.943 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.943 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:34.943 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409642+0000", 2024-09-12T22:32:34.943 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:34.943 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.943 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.943 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:34.943 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409642+0000", 2024-09-12T22:32:34.943 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:34.943 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.944 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.944 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:34.944 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409642+0000", 2024-09-12T22:32:34.944 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.6899999999999999e-07 2024-09-12T22:32:34.944 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.944 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.944 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:34.944 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409648+0000", 2024-09-12T22:32:34.944 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.49e-06 2024-09-12T22:32:34.944 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.944 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.944 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:34.944 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409656+0000", 2024-09-12T22:32:34.945 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.2949999999999994e-06 2024-09-12T22:32:34.945 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.945 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.945 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:34.945 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409664+0000", 2024-09-12T22:32:34.945 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.1219999999999995e-06 2024-09-12T22:32:34.945 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.945 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.949 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:34.949 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409707+0000", 2024-09-12T22:32:34.949 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2222000000000003e-05 2024-09-12T22:32:34.949 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.949 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.949 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:34.949 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409724+0000", 2024-09-12T22:32:34.949 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7496999999999999e-05 2024-09-12T22:32:34.949 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.949 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.949 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:34.950 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413439+0000", 2024-09-12T22:32:34.950 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00371448 2024-09-12T22:32:34.950 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.950 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.950 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:34.950 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413524+0000", 2024-09-12T22:32:34.950 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.5252000000000003e-05 2024-09-12T22:32:34.950 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:34.950 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:34.950 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:34.950 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.950 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.951 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:28 3.13 e19/17 3:cd5a64a3:::100.00000000:head v 19'1, mlcod=0'0)", 2024-09-12T22:32:34.951 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.409681+0000", 2024-09-12T22:32:34.951 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 57.480387501000003, 2024-09-12T22:32:34.951 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0038708710000000001, 2024-09-12T22:32:34.951 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:34.951 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:34.951 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:34.951 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:34.951 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.951 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:34.951 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409681+0000", 2024-09-12T22:32:34.951 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:34.951 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.951 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.952 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:34.952 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409681+0000", 2024-09-12T22:32:34.952 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:34.952 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.952 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.952 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:34.952 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409681+0000", 2024-09-12T22:32:34.952 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3000000000000002e-07 2024-09-12T22:32:34.952 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.952 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.952 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:34.952 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409695+0000", 2024-09-12T22:32:34.952 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4313e-05 2024-09-12T22:32:34.953 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.953 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.953 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:34.953 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409703+0000", 2024-09-12T22:32:34.953 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4000000000000003e-06 2024-09-12T22:32:34.953 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.953 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.953 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:34.953 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409708+0000", 2024-09-12T22:32:34.953 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3190000000000002e-06 2024-09-12T22:32:34.953 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.953 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.953 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:34.953 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409875+0000", 2024-09-12T22:32:34.954 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000167329 2024-09-12T22:32:34.954 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.954 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.954 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:34.954 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409892+0000", 2024-09-12T22:32:34.954 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6957999999999999e-05 2024-09-12T22:32:34.954 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.954 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.954 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:34.954 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413457+0000", 2024-09-12T22:32:34.954 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0035651279999999999 2024-09-12T22:32:34.954 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.954 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.955 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:34.955 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413552+0000", 2024-09-12T22:32:34.955 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.4093999999999997e-05 2024-09-12T22:32:34.955 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:34.955 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:34.955 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:34.955 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.955 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.955 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:21 3.1c e19/17 3:3ed09add:::607.00000000:head v 19'2, mlcod=0'0)", 2024-09-12T22:32:34.955 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.409718+0000", 2024-09-12T22:32:34.955 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 57.480349836000002, 2024-09-12T22:32:34.955 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003851883, 2024-09-12T22:32:34.955 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:34.955 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:34.955 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:34.956 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:34.956 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.956 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:34.956 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409718+0000", 2024-09-12T22:32:34.956 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:34.956 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.956 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.956 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:34.956 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409718+0000", 2024-09-12T22:32:34.956 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:34.956 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.956 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.957 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:34.957 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409719+0000", 2024-09-12T22:32:34.957 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.16e-07 2024-09-12T22:32:34.957 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.957 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.957 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:34.957 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409722+0000", 2024-09-12T22:32:34.957 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.692e-06 2024-09-12T22:32:34.957 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.957 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.957 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:34.957 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409729+0000", 2024-09-12T22:32:34.957 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.516e-06 2024-09-12T22:32:34.957 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.958 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.958 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:34.958 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409750+0000", 2024-09-12T22:32:34.958 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1151000000000001e-05 2024-09-12T22:32:34.958 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.958 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.958 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:34.958 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410015+0000", 2024-09-12T22:32:34.958 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00026477599999999999 2024-09-12T22:32:34.958 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.958 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.958 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:34.958 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410104+0000", 2024-09-12T22:32:34.958 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.9586000000000006e-05 2024-09-12T22:32:34.959 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.959 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.959 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:34.959 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413528+0000", 2024-09-12T22:32:34.959 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0034237880000000001 2024-09-12T22:32:34.959 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.959 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.959 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:34.959 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413570+0000", 2024-09-12T22:32:34.959 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2157999999999999e-05 2024-09-12T22:32:34.959 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:34.959 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:34.959 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:34.959 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.960 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.960 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:27 3.13 e19/17 3:c91d4a1d:::mds0_inotable:head v 19'2, mlcod=0'0)", 2024-09-12T22:32:34.960 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.409760+0000", 2024-09-12T22:32:34.960 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 57.480308319999999, 2024-09-12T22:32:34.960 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0039301910000000004, 2024-09-12T22:32:34.960 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:34.960 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:34.960 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:34.960 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:34.960 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.960 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:34.960 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409760+0000", 2024-09-12T22:32:34.960 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:34.960 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.961 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.961 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:34.961 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409760+0000", 2024-09-12T22:32:34.961 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:34.961 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.961 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.961 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:34.961 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409760+0000", 2024-09-12T22:32:34.961 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.39e-07 2024-09-12T22:32:34.961 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.961 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.961 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:34.961 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409765+0000", 2024-09-12T22:32:34.962 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4449999999999998e-06 2024-09-12T22:32:34.962 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.962 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.962 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:34.962 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409771+0000", 2024-09-12T22:32:34.962 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7159999999999997e-06 2024-09-12T22:32:34.962 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.962 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.962 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:34.962 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409778+0000", 2024-09-12T22:32:34.962 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.331e-06 2024-09-12T22:32:34.962 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.962 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.962 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:34.963 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410191+0000", 2024-09-12T22:32:34.963 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00041348300000000003 2024-09-12T22:32:34.963 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.963 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.963 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:34.963 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410211+0000", 2024-09-12T22:32:34.963 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9933999999999999e-05 2024-09-12T22:32:34.963 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.963 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.963 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:34.963 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413638+0000", 2024-09-12T22:32:34.963 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003426854 2024-09-12T22:32:34.963 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.963 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.964 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:34.964 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413690+0000", 2024-09-12T22:32:34.964 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2089000000000002e-05 2024-09-12T22:32:34.964 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:34.964 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:34.964 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:34.964 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.964 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.964 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "pg_update_log_missing_reply(3.b epoch 19/17 rep_tid 4 lcod 19'2)", 2024-09-12T22:32:34.964 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.410060+0000", 2024-09-12T22:32:34.964 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 57.480008654999999, 2024-09-12T22:32:34.964 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00098016500000000007, 2024-09-12T22:32:34.965 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:34.965 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:34.965 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "reached pg", 2024-09-12T22:32:34.965 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:34.965 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.965 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:34.965 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410060+0000", 2024-09-12T22:32:34.965 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:34.965 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.965 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.965 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:34.965 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410060+0000", 2024-09-12T22:32:34.965 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:34.966 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.966 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.966 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:34.966 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410060+0000", 2024-09-12T22:32:34.966 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.8299999999999998e-07 2024-09-12T22:32:34.966 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.966 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.966 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:34.966 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410062+0000", 2024-09-12T22:32:34.966 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5749999999999999e-06 2024-09-12T22:32:34.966 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.966 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.966 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:34.966 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410070+0000", 2024-09-12T22:32:34.967 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.909e-06 2024-09-12T22:32:34.967 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.967 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.967 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:34.967 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410076+0000", 2024-09-12T22:32:34.967 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7049999999999996e-06 2024-09-12T22:32:34.967 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.967 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.967 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:34.967 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410943+0000", 2024-09-12T22:32:34.968 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00086681900000000001 2024-09-12T22:32:34.968 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.968 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.968 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:34.968 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411040+0000", 2024-09-12T22:32:34.968 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.6774000000000006e-05 2024-09-12T22:32:34.968 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:34.968 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:34.968 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:34.968 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.968 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.968 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e19/17 ondisk, result = 0)", 2024-09-12T22:32:34.968 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.410113+0000", 2024-09-12T22:32:34.969 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 57.479955388, 2024-09-12T22:32:34.969 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00098911599999999995, 2024-09-12T22:32:34.969 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:34.969 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:34.969 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:32:34.969 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:34.969 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.969 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:34.969 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410113+0000", 2024-09-12T22:32:34.969 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:34.969 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.970 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.970 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:34.970 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410113+0000", 2024-09-12T22:32:34.970 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:34.970 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.970 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.970 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:34.970 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410113+0000", 2024-09-12T22:32:34.970 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.99e-07 2024-09-12T22:32:34.970 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.970 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.971 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:34.971 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410115+0000", 2024-09-12T22:32:34.971 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.046e-06 2024-09-12T22:32:34.971 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.971 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.971 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:34.971 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410121+0000", 2024-09-12T22:32:34.971 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0050000000000001e-06 2024-09-12T22:32:34.971 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.971 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.971 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:34.971 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410126+0000", 2024-09-12T22:32:34.972 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8339999999999998e-06 2024-09-12T22:32:34.972 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.972 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.972 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:34.972 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410587+0000", 2024-09-12T22:32:34.972 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00046095499999999998 2024-09-12T22:32:34.972 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.972 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.972 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:34.972 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410595+0000", 2024-09-12T22:32:34.973 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.9419999999999995e-06 2024-09-12T22:32:34.973 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.973 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.973 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:34.973 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411102+0000", 2024-09-12T22:32:34.973 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00050713500000000003 2024-09-12T22:32:34.973 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:34.973 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:34.973 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:34.973 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.973 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.973 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 19/17 rep_tid 8 lcod 19'4)", 2024-09-12T22:32:34.974 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.410133+0000", 2024-09-12T22:32:34.974 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 57.47993546, 2024-09-12T22:32:34.974 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0013504000000000001, 2024-09-12T22:32:34.974 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:34.974 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:34.974 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "reached pg", 2024-09-12T22:32:34.974 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:34.974 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.974 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:34.974 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410133+0000", 2024-09-12T22:32:34.974 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:34.974 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.974 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.975 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:34.975 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410133+0000", 2024-09-12T22:32:34.975 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:34.975 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.975 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.975 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:34.975 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410133+0000", 2024-09-12T22:32:34.975 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.0599999999999999e-07 2024-09-12T22:32:34.975 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.976 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.976 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:34.976 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410135+0000", 2024-09-12T22:32:34.976 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7770000000000001e-06 2024-09-12T22:32:34.976 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.976 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.976 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:34.976 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410140+0000", 2024-09-12T22:32:34.976 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9960000000000001e-06 2024-09-12T22:32:34.976 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.976 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.977 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:34.977 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410144+0000", 2024-09-12T22:32:34.977 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9500000000000003e-06 2024-09-12T22:32:34.977 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.977 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.977 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:34.977 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411310+0000", 2024-09-12T22:32:34.977 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001166311 2024-09-12T22:32:34.977 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.977 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.977 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:34.977 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411483+0000", 2024-09-12T22:32:34.978 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00017316 2024-09-12T22:32:34.978 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:34.978 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:34.978 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:34.978 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.978 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.978 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "pg_update_log_missing(3.1a epoch 19/17 rep_tid 0 entries 19'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T22:32:34.978 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.410617+0000", 2024-09-12T22:32:34.978 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 57.479451064999999, 2024-09-12T22:32:34.978 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0030439709999999999, 2024-09-12T22:32:34.979 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:34.979 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:34.979 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "reached pg", 2024-09-12T22:32:34.979 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:34.979 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.979 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:34.979 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410617+0000", 2024-09-12T22:32:34.979 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:34.979 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.979 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.979 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:34.979 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410617+0000", 2024-09-12T22:32:34.980 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:34.980 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.980 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.980 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:34.980 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410617+0000", 2024-09-12T22:32:34.980 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3599999999999999e-07 2024-09-12T22:32:34.980 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.980 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.980 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:34.980 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410625+0000", 2024-09-12T22:32:34.980 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5410000000000003e-06 2024-09-12T22:32:34.980 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.980 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.981 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:34.981 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410638+0000", 2024-09-12T22:32:34.981 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3261999999999999e-05 2024-09-12T22:32:34.981 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.981 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.981 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:34.981 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410653+0000", 2024-09-12T22:32:34.981 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4844000000000001e-05 2024-09-12T22:32:34.981 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.981 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.981 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:34.981 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410814+0000", 2024-09-12T22:32:34.981 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00016119999999999999 2024-09-12T22:32:34.982 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.982 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.982 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:34.982 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413661+0000", 2024-09-12T22:32:34.982 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0028467879999999998 2024-09-12T22:32:34.982 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:34.982 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:34.982 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:34.982 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.982 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.983 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-09-12T22:32:34.983 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:39.398875+0000", 2024-09-12T22:32:34.983 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 55.491192785000003, 2024-09-12T22:32:34.983 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0015679069999999999, 2024-09-12T22:32:34.983 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:34.983 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:34.983 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:34.983 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:34.983 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.983 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:34.983 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398875+0000", 2024-09-12T22:32:34.983 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:34.983 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.984 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.984 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:34.984 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398875+0000", 2024-09-12T22:32:34.984 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:34.984 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.984 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.984 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:34.984 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398878+0000", 2024-09-12T22:32:34.984 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1679999999999998e-06 2024-09-12T22:32:34.984 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.984 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.984 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:34.984 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398888+0000", 2024-09-12T22:32:34.984 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.084e-05 2024-09-12T22:32:34.985 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.985 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.985 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:34.985 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398906+0000", 2024-09-12T22:32:34.985 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7518000000000001e-05 2024-09-12T22:32:34.985 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.985 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.985 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:34.985 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398914+0000", 2024-09-12T22:32:34.985 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5989999999999996e-06 2024-09-12T22:32:34.985 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.985 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.985 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:34.985 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398974+0000", 2024-09-12T22:32:34.986 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0988e-05 2024-09-12T22:32:34.986 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.986 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.986 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:34.986 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.399078+0000", 2024-09-12T22:32:34.986 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000103133 2024-09-12T22:32:34.986 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.986 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.986 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:34.986 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.399166+0000", 2024-09-12T22:32:34.986 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.8183999999999995e-05 2024-09-12T22:32:34.986 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.986 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.986 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:34.987 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.399747+0000", 2024-09-12T22:32:34.987 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00058110599999999996 2024-09-12T22:32:34.987 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.987 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.987 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:34.987 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.400377+0000", 2024-09-12T22:32:34.987 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000630157 2024-09-12T22:32:34.987 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.987 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.987 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:34.987 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.400415+0000", 2024-09-12T22:32:34.987 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7814000000000001e-05 2024-09-12T22:32:34.987 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.987 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.988 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:34.988 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.400443+0000", 2024-09-12T22:32:34.988 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8399999999999999e-05 2024-09-12T22:32:34.988 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:34.988 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:34.988 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:34.988 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.988 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.988 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e23)", 2024-09-12T22:32:34.988 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:58.400966+0000", 2024-09-12T22:32:34.988 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 36.489101877000003, 2024-09-12T22:32:34.988 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001468876, 2024-09-12T22:32:34.988 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:34.989 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:34.989 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:34.989 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:34.989 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.989 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:34.989 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400966+0000", 2024-09-12T22:32:34.989 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:34.989 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.989 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.989 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:34.989 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400966+0000", 2024-09-12T22:32:34.989 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:34.989 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.990 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.990 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:34.990 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400967+0000", 2024-09-12T22:32:34.990 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.046e-06 2024-09-12T22:32:34.990 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.990 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.990 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:34.990 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400974+0000", 2024-09-12T22:32:34.990 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2310000000000001e-06 2024-09-12T22:32:34.990 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.990 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.990 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:34.990 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400988+0000", 2024-09-12T22:32:34.991 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4482e-05 2024-09-12T22:32:34.991 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.991 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.991 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:34.991 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400997+0000", 2024-09-12T22:32:34.991 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.0189999999999995e-06 2024-09-12T22:32:34.991 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.991 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.991 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:34.991 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.401068+0000", 2024-09-12T22:32:34.991 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1426000000000004e-05 2024-09-12T22:32:34.991 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.992 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.992 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:34.992 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.401174+0000", 2024-09-12T22:32:34.992 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000105769 2024-09-12T22:32:34.992 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.992 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.992 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:34.992 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.401335+0000", 2024-09-12T22:32:34.992 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000161225 2024-09-12T22:32:34.992 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.992 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.993 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:34.993 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.402110+0000", 2024-09-12T22:32:34.993 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00077428800000000004 2024-09-12T22:32:34.993 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.993 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.993 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:34.993 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.402333+0000", 2024-09-12T22:32:34.993 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000223723 2024-09-12T22:32:34.993 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.993 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.993 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:34.993 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.402388+0000", 2024-09-12T22:32:34.993 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4700999999999997e-05 2024-09-12T22:32:34.994 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.994 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.994 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:34.994 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.402435+0000", 2024-09-12T22:32:34.994 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6965999999999997e-05 2024-09-12T22:32:34.994 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:34.994 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:34.994 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:34.994 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.994 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.994 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:45 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e27)", 2024-09-12T22:32:34.994 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:32:04.401614+0000", 2024-09-12T22:32:34.995 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 30.488454447999999, 2024-09-12T22:32:34.995 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0014279749999999999, 2024-09-12T22:32:34.995 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:34.995 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:34.995 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:34.995 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:34.995 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.995 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:34.995 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401614+0000", 2024-09-12T22:32:34.995 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:34.995 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.995 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.995 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:34.996 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401614+0000", 2024-09-12T22:32:34.996 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:34.996 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.996 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.996 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:34.996 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401615+0000", 2024-09-12T22:32:34.996 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.161e-06 2024-09-12T22:32:34.996 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.996 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.996 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:34.996 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401621+0000", 2024-09-12T22:32:34.996 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8730000000000004e-06 2024-09-12T22:32:34.996 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.997 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.997 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:34.997 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401633+0000", 2024-09-12T22:32:34.997 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1800000000000001e-05 2024-09-12T22:32:34.997 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.997 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.997 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:34.997 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401656+0000", 2024-09-12T22:32:34.997 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.3521999999999999e-05 2024-09-12T22:32:34.997 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.997 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.997 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:34.997 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401713+0000", 2024-09-12T22:32:34.997 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7259000000000002e-05 2024-09-12T22:32:34.998 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.998 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.998 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:34.998 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401849+0000", 2024-09-12T22:32:34.998 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013613500000000001 2024-09-12T22:32:34.998 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.998 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.998 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:34.998 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.402009+0000", 2024-09-12T22:32:34.998 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00015947199999999999 2024-09-12T22:32:34.998 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.998 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.998 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:34.998 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.402629+0000", 2024-09-12T22:32:34.999 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00061962200000000001 2024-09-12T22:32:34.999 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.999 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.999 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:34.999 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.402983+0000", 2024-09-12T22:32:34.999 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00035447499999999998 2024-09-12T22:32:34.999 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.999 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.999 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:34.999 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.403016+0000", 2024-09-12T22:32:34.999 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3108999999999998e-05 2024-09-12T22:32:34.999 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:34.999 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:34.999 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:35.000 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.403042+0000", 2024-09-12T22:32:35.000 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5547000000000001e-05 2024-09-12T22:32:35.000 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:35.000 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:35.000 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:35.000 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:35.000 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:35.000 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:32:35.001 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:32:35.000+0000 7fddec6a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30331) UID: 0 2024-09-12T22:32:35.002 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:32:35.102 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:35.101+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:35.117 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-09-12T22:32:35.117 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-09-12T22:32:35.117 INFO:teuthology.orchestra.run.smithi163.stdout: "num_ops": 0 2024-09-12T22:32:35.118 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-09-12T22:32:35.126 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:32:35.203 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:32:35.202+0000 7fddec6a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30331) UID: 0 2024-09-12T22:32:35.230 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-09-12T22:32:35.230 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-09-12T22:32:35.230 INFO:teuthology.orchestra.run.smithi163.stdout: "complaint_time": 30, 2024-09-12T22:32:35.230 INFO:teuthology.orchestra.run.smithi163.stdout: "num_blocked_ops": 0 2024-09-12T22:32:35.230 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-09-12T22:32:35.238 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:32:35.304 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:35.303+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:35.344 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-09-12T22:32:35.344 INFO:teuthology.orchestra.run.smithi163.stdout: "size": 20, 2024-09-12T22:32:35.344 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 600, 2024-09-12T22:32:35.344 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2024-09-12T22:32:35.344 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.344 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-09-12T22:32:35.344 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:27.254459+0000", 2024-09-12T22:32:35.344 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 68.086913480000007, 2024-09-12T22:32:35.344 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.37816283899999997, 2024-09-12T22:32:35.344 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:35.344 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:35.345 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:35.345 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:35.345 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:35.345 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:35.345 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 1 2024-09-12T22:32:35.345 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.345 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:35.345 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.345 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:35.345 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254459+0000", 2024-09-12T22:32:35.345 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:35.345 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.345 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.346 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:35.346 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254459+0000", 2024-09-12T22:32:35.346 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:35.346 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.346 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.346 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:35.346 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254460+0000", 2024-09-12T22:32:35.346 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1739999999999999e-06 2024-09-12T22:32:35.346 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.346 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.346 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:35.346 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254472+0000", 2024-09-12T22:32:35.346 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2207e-05 2024-09-12T22:32:35.346 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.346 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.347 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:35.347 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254483+0000", 2024-09-12T22:32:35.347 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0631999999999999e-05 2024-09-12T22:32:35.347 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.347 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.347 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:35.347 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254492+0000", 2024-09-12T22:32:35.347 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3670000000000003e-06 2024-09-12T22:32:35.347 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.347 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.347 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:35.347 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254551+0000", 2024-09-12T22:32:35.347 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8687999999999998e-05 2024-09-12T22:32:35.348 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.348 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.348 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for peered", 2024-09-12T22:32:35.348 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254562+0000", 2024-09-12T22:32:35.348 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1249e-05 2024-09-12T22:32:35.348 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.348 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.348 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:35.348 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.631211+0000", 2024-09-12T22:32:35.348 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.376649018 2024-09-12T22:32:35.348 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.348 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.348 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:35.348 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.631345+0000", 2024-09-12T22:32:35.349 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013378700000000001 2024-09-12T22:32:35.349 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.349 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.349 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:35.349 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.631479+0000", 2024-09-12T22:32:35.349 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013352399999999999 2024-09-12T22:32:35.349 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.349 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.349 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:35.349 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632324+0000", 2024-09-12T22:32:35.349 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00084508100000000002 2024-09-12T22:32:35.349 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.349 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.349 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:35.350 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632548+0000", 2024-09-12T22:32:35.350 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000224329 2024-09-12T22:32:35.350 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.350 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.350 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:35.350 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632591+0000", 2024-09-12T22:32:35.350 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2564000000000001e-05 2024-09-12T22:32:35.350 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.350 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.350 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:35.350 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632622+0000", 2024-09-12T22:32:35.350 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1219e-05 2024-09-12T22:32:35.350 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:35.351 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:35.351 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:35.351 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.351 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.351 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:185 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:32:35.351 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394355+0000", 2024-09-12T22:32:35.351 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 66.947017383000002, 2024-09-12T22:32:35.351 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011302394, 2024-09-12T22:32:35.351 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:35.351 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:35.351 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:35.351 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:35.351 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:35.351 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:35.352 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 185 2024-09-12T22:32:35.352 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.352 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:35.352 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.352 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:35.352 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394355+0000", 2024-09-12T22:32:35.352 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:35.352 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.352 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.352 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:35.352 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394355+0000", 2024-09-12T22:32:35.352 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:35.352 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.353 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.353 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:35.353 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394355+0000", 2024-09-12T22:32:35.353 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9099999999999999e-07 2024-09-12T22:32:35.353 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.353 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.353 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:35.353 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394385+0000", 2024-09-12T22:32:35.353 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9963000000000001e-05 2024-09-12T22:32:35.357 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.357 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.357 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:35.357 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394390+0000", 2024-09-12T22:32:35.357 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8420000000000004e-06 2024-09-12T22:32:35.358 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.358 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.358 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:35.358 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394393+0000", 2024-09-12T22:32:35.358 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1e-06 2024-09-12T22:32:35.358 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.358 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.358 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:35.358 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.400546+0000", 2024-09-12T22:32:35.358 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0061523309999999996 2024-09-12T22:32:35.358 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.358 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.358 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:35.359 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.400588+0000", 2024-09-12T22:32:35.359 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1835000000000002e-05 2024-09-12T22:32:35.359 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.359 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.359 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:35.359 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.400677+0000", 2024-09-12T22:32:35.359 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9195000000000002e-05 2024-09-12T22:32:35.359 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.359 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.359 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:35.359 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405378+0000", 2024-09-12T22:32:35.359 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0047008659999999997 2024-09-12T22:32:35.359 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.359 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.360 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:35.360 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405569+0000", 2024-09-12T22:32:35.360 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00019148599999999999 2024-09-12T22:32:35.360 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.360 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.360 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:35.360 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405620+0000", 2024-09-12T22:32:35.360 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1416999999999999e-05 2024-09-12T22:32:35.360 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.360 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.360 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:35.360 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405657+0000", 2024-09-12T22:32:35.360 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6968000000000002e-05 2024-09-12T22:32:35.361 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:35.361 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:35.361 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:35.361 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.361 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.361 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:32:35.361 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394399+0000", 2024-09-12T22:32:35.361 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 66.946973172, 2024-09-12T22:32:35.361 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011336601999999999, 2024-09-12T22:32:35.361 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:35.361 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:35.361 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:35.362 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:35.362 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:35.362 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:35.362 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 186 2024-09-12T22:32:35.362 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.362 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:35.362 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.362 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:35.362 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394399+0000", 2024-09-12T22:32:35.362 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:35.362 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.362 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.362 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:35.362 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394399+0000", 2024-09-12T22:32:35.363 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:35.363 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.363 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.363 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:35.363 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394400+0000", 2024-09-12T22:32:35.363 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4499999999999998e-07 2024-09-12T22:32:35.363 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.363 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.363 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:35.363 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394402+0000", 2024-09-12T22:32:35.363 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.875e-06 2024-09-12T22:32:35.363 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.363 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.364 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:35.364 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394405+0000", 2024-09-12T22:32:35.364 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6799999999999999e-06 2024-09-12T22:32:35.364 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.364 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.364 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:35.364 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394408+0000", 2024-09-12T22:32:35.364 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.667e-06 2024-09-12T22:32:35.364 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.364 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.364 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:35.364 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401395+0000", 2024-09-12T22:32:35.364 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0069867230000000002 2024-09-12T22:32:35.365 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.365 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.365 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:35.365 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401438+0000", 2024-09-12T22:32:35.365 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3554999999999999e-05 2024-09-12T22:32:35.365 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.365 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.365 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:35.365 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401509+0000", 2024-09-12T22:32:35.365 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0631999999999997e-05 2024-09-12T22:32:35.365 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.365 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.365 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:35.366 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405392+0000", 2024-09-12T22:32:35.366 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0038830449999999999 2024-09-12T22:32:35.366 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.366 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.366 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:35.366 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405690+0000", 2024-09-12T22:32:35.366 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000298435 2024-09-12T22:32:35.366 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.366 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.366 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:35.366 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405716+0000", 2024-09-12T22:32:35.366 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5435999999999998e-05 2024-09-12T22:32:35.366 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.366 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.367 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:35.367 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405736+0000", 2024-09-12T22:32:35.367 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0208999999999999e-05 2024-09-12T22:32:35.367 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:35.367 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:35.367 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:35.367 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.367 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.367 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:32:35.367 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394411+0000", 2024-09-12T22:32:35.367 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 66.946961045999998, 2024-09-12T22:32:35.367 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011400117, 2024-09-12T22:32:35.367 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:35.368 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:35.368 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:35.368 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:35.368 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:35.368 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:35.368 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 187 2024-09-12T22:32:35.368 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.368 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:35.368 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.368 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:35.368 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394411+0000", 2024-09-12T22:32:35.368 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:35.368 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.368 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.369 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:35.369 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394411+0000", 2024-09-12T22:32:35.369 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:35.369 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.369 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.369 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:35.369 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394412+0000", 2024-09-12T22:32:35.369 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.4999999999999999e-07 2024-09-12T22:32:35.369 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.369 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.369 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:35.369 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394414+0000", 2024-09-12T22:32:35.369 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.984e-06 2024-09-12T22:32:35.370 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.370 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.370 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:35.370 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394418+0000", 2024-09-12T22:32:35.370 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0840000000000002e-06 2024-09-12T22:32:35.370 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.370 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.370 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:35.370 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394431+0000", 2024-09-12T22:32:35.370 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.361e-05 2024-09-12T22:32:35.370 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.370 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.370 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:35.371 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401778+0000", 2024-09-12T22:32:35.371 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0073462659999999997 2024-09-12T22:32:35.371 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.371 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.371 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:35.371 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401853+0000", 2024-09-12T22:32:35.371 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5797000000000006e-05 2024-09-12T22:32:35.371 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.371 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.371 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:35.371 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401990+0000", 2024-09-12T22:32:35.371 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013651399999999999 2024-09-12T22:32:35.371 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.372 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.372 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:35.372 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405402+0000", 2024-09-12T22:32:35.372 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0034116070000000001 2024-09-12T22:32:35.372 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.372 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.372 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:35.372 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405764+0000", 2024-09-12T22:32:35.372 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00036234899999999998 2024-09-12T22:32:35.372 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.372 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.372 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:35.372 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405791+0000", 2024-09-12T22:32:35.373 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7029000000000002e-05 2024-09-12T22:32:35.373 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.373 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.373 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:35.373 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405812+0000", 2024-09-12T22:32:35.373 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0627000000000001e-05 2024-09-12T22:32:35.373 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:35.373 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:35.373 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:35.373 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.373 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.373 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:32:35.373 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394447+0000", 2024-09-12T22:32:35.374 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 66.946925895000007, 2024-09-12T22:32:35.374 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011759588, 2024-09-12T22:32:35.374 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:35.374 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:35.374 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:35.374 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:35.374 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:35.374 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:35.374 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 188 2024-09-12T22:32:35.374 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.374 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:35.374 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.374 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:35.374 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394447+0000", 2024-09-12T22:32:35.375 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:35.375 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.375 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.375 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:35.375 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394447+0000", 2024-09-12T22:32:35.375 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:35.375 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.375 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.375 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:35.375 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394447+0000", 2024-09-12T22:32:35.375 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.15e-07 2024-09-12T22:32:35.375 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.375 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.375 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:35.376 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394512+0000", 2024-09-12T22:32:35.376 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4580999999999997e-05 2024-09-12T22:32:35.376 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.376 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.376 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:35.376 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394518+0000", 2024-09-12T22:32:35.376 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.3380000000000001e-06 2024-09-12T22:32:35.376 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.376 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.376 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:35.376 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394521+0000", 2024-09-12T22:32:35.376 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3340000000000002e-06 2024-09-12T22:32:35.376 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.377 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.377 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:35.377 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.402628+0000", 2024-09-12T22:32:35.377 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.008106996 2024-09-12T22:32:35.377 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.377 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.377 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:35.377 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.402670+0000", 2024-09-12T22:32:35.377 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1983000000000001e-05 2024-09-12T22:32:35.377 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.377 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.377 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:35.377 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.402738+0000", 2024-09-12T22:32:35.378 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.8114999999999994e-05 2024-09-12T22:32:35.378 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.378 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.378 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:35.378 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405668+0000", 2024-09-12T22:32:35.378 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.002929545 2024-09-12T22:32:35.378 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.378 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.378 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:35.378 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406162+0000", 2024-09-12T22:32:35.378 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000494408 2024-09-12T22:32:35.378 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.378 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.378 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:35.379 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406188+0000", 2024-09-12T22:32:35.379 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5766e-05 2024-09-12T22:32:35.379 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.379 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.379 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:35.379 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406206+0000", 2024-09-12T22:32:35.379 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.8107000000000001e-05 2024-09-12T22:32:35.379 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:35.379 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:35.379 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:35.379 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.379 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.379 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:32:35.379 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394528+0000", 2024-09-12T22:32:35.380 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 66.946844225999996, 2024-09-12T22:32:35.380 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.01195536, 2024-09-12T22:32:35.380 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:35.380 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:35.380 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:35.380 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:35.380 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:35.380 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:35.380 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 189 2024-09-12T22:32:35.380 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.380 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:35.380 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.380 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:35.381 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394528+0000", 2024-09-12T22:32:35.381 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:35.381 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.381 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.381 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:35.381 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394528+0000", 2024-09-12T22:32:35.381 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:35.381 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.381 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.381 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:35.381 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394529+0000", 2024-09-12T22:32:35.381 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4900000000000001e-07 2024-09-12T22:32:35.381 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.381 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.382 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:35.382 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394531+0000", 2024-09-12T22:32:35.382 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.458e-06 2024-09-12T22:32:35.382 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.382 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.382 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:35.382 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394535+0000", 2024-09-12T22:32:35.382 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7900000000000001e-06 2024-09-12T22:32:35.382 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.382 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.382 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:35.382 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394537+0000", 2024-09-12T22:32:35.382 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.632e-06 2024-09-12T22:32:35.383 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.383 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.383 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:35.383 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.404932+0000", 2024-09-12T22:32:35.383 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010394158000000001 2024-09-12T22:32:35.383 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.383 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.383 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:35.383 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405017+0000", 2024-09-12T22:32:35.383 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5525000000000005e-05 2024-09-12T22:32:35.383 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.383 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.383 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:35.384 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405114+0000", 2024-09-12T22:32:35.384 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.6527000000000006e-05 2024-09-12T22:32:35.384 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.384 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.384 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:35.384 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405818+0000", 2024-09-12T22:32:35.384 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00070412800000000005 2024-09-12T22:32:35.384 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.384 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.384 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:35.384 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406437+0000", 2024-09-12T22:32:35.384 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00061898900000000002 2024-09-12T22:32:35.384 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.385 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.385 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:35.385 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406463+0000", 2024-09-12T22:32:35.385 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6268e-05 2024-09-12T22:32:35.385 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.385 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.385 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:35.385 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406484+0000", 2024-09-12T22:32:35.385 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0536000000000001e-05 2024-09-12T22:32:35.385 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:35.385 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:35.385 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:35.385 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.386 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.386 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:35.386 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.401422+0000", 2024-09-12T22:32:35.386 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 57.939950320999998, 2024-09-12T22:32:35.386 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016896452999999999, 2024-09-12T22:32:35.386 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:35.386 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:35.386 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:35.386 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:35.386 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.386 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:35.386 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401422+0000", 2024-09-12T22:32:35.386 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:35.386 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.387 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.387 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:35.387 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401422+0000", 2024-09-12T22:32:35.387 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:35.387 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.387 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.387 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:35.387 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401424+0000", 2024-09-12T22:32:35.387 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9e-06 2024-09-12T22:32:35.387 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.387 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.387 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:35.387 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401437+0000", 2024-09-12T22:32:35.387 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2831e-05 2024-09-12T22:32:35.388 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.388 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.388 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:35.388 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401471+0000", 2024-09-12T22:32:35.388 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4010000000000001e-05 2024-09-12T22:32:35.388 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.388 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.388 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:35.388 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401484+0000", 2024-09-12T22:32:35.388 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2711000000000001e-05 2024-09-12T22:32:35.388 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.388 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.388 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:35.389 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405410+0000", 2024-09-12T22:32:35.389 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0039259170000000001 2024-09-12T22:32:35.389 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.389 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.389 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:35.389 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405529+0000", 2024-09-12T22:32:35.389 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000119778 2024-09-12T22:32:35.389 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.389 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.389 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:35.389 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405655+0000", 2024-09-12T22:32:35.389 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012556700000000001 2024-09-12T22:32:35.389 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.390 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.390 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:35.390 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410456+0000", 2024-09-12T22:32:35.390 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0048008269999999997 2024-09-12T22:32:35.390 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.390 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.390 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:35.390 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418226+0000", 2024-09-12T22:32:35.390 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0077707729999999999 2024-09-12T22:32:35.390 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.390 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.390 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:35.390 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418277+0000", 2024-09-12T22:32:35.391 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0476000000000003e-05 2024-09-12T22:32:35.391 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.391 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.391 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:35.391 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418319+0000", 2024-09-12T22:32:35.391 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1662999999999997e-05 2024-09-12T22:32:35.391 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:35.391 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:35.391 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:35.391 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.391 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.391 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:35.391 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.401505+0000", 2024-09-12T22:32:35.391 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 57.939867657000001, 2024-09-12T22:32:35.392 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016987904000000002, 2024-09-12T22:32:35.392 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:35.392 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:35.392 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:35.392 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:35.392 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.392 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:35.392 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401505+0000", 2024-09-12T22:32:35.392 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:35.392 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.392 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.392 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:35.392 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401505+0000", 2024-09-12T22:32:35.393 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:35.393 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.393 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.393 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:35.393 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401506+0000", 2024-09-12T22:32:35.393 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4700000000000001e-07 2024-09-12T22:32:35.393 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.393 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.393 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:35.393 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401510+0000", 2024-09-12T22:32:35.393 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6609999999999999e-06 2024-09-12T22:32:35.393 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.393 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.394 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:35.394 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401771+0000", 2024-09-12T22:32:35.394 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00026110700000000001 2024-09-12T22:32:35.394 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.394 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.394 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:35.394 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401921+0000", 2024-09-12T22:32:35.394 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014939099999999999 2024-09-12T22:32:35.394 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.394 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.394 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:35.394 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405944+0000", 2024-09-12T22:32:35.394 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0040235449999999999 2024-09-12T22:32:35.395 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.395 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.395 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:35.395 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406018+0000", 2024-09-12T22:32:35.395 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3373000000000004e-05 2024-09-12T22:32:35.395 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.395 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.395 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:35.395 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406172+0000", 2024-09-12T22:32:35.395 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00015435399999999999 2024-09-12T22:32:35.395 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.395 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.395 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:35.395 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410461+0000", 2024-09-12T22:32:35.396 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0042888609999999997 2024-09-12T22:32:35.396 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.396 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.396 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:35.396 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418371+0000", 2024-09-12T22:32:35.396 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0079098380000000006 2024-09-12T22:32:35.396 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.396 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.396 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:35.396 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418443+0000", 2024-09-12T22:32:35.396 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2705000000000003e-05 2024-09-12T22:32:35.396 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.396 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.397 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:35.397 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418493+0000", 2024-09-12T22:32:35.397 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9322e-05 2024-09-12T22:32:35.397 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:35.397 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:35.397 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:35.397 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.397 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.397 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:35.397 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.401939+0000", 2024-09-12T22:32:35.397 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 57.939433921000003, 2024-09-12T22:32:35.397 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016722292999999999, 2024-09-12T22:32:35.397 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:35.398 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:35.398 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:35.398 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:35.398 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.398 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:35.398 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401939+0000", 2024-09-12T22:32:35.398 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:35.398 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.398 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.398 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:35.398 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401939+0000", 2024-09-12T22:32:35.398 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:35.398 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.398 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.399 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:35.399 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401940+0000", 2024-09-12T22:32:35.399 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1990000000000001e-06 2024-09-12T22:32:35.399 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.399 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.399 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:35.399 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401956+0000", 2024-09-12T22:32:35.399 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.6344000000000001e-05 2024-09-12T22:32:35.399 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.399 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.399 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:35.399 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401974+0000", 2024-09-12T22:32:35.399 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7730000000000001e-05 2024-09-12T22:32:35.399 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.400 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.400 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:35.400 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401982+0000", 2024-09-12T22:32:35.400 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.7800000000000001e-06 2024-09-12T22:32:35.400 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.400 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.400 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:35.400 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406557+0000", 2024-09-12T22:32:35.400 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0045758489999999999 2024-09-12T22:32:35.400 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.400 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.400 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:35.401 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406697+0000", 2024-09-12T22:32:35.401 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013925100000000001 2024-09-12T22:32:35.401 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.401 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.401 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:35.401 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406830+0000", 2024-09-12T22:32:35.401 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013293499999999999 2024-09-12T22:32:35.401 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.401 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.401 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:35.401 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410465+0000", 2024-09-12T22:32:35.401 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0036352680000000001 2024-09-12T22:32:35.401 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.401 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.402 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:35.402 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418564+0000", 2024-09-12T22:32:35.402 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0080992140000000004 2024-09-12T22:32:35.402 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.402 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.402 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:35.402 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418621+0000", 2024-09-12T22:32:35.402 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7167999999999999e-05 2024-09-12T22:32:35.402 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.402 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.402 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:35.402 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418661+0000", 2024-09-12T22:32:35.403 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9555000000000003e-05 2024-09-12T22:32:35.403 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:35.403 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:35.403 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:35.403 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.403 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.403 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:35.403 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.401994+0000", 2024-09-12T22:32:35.403 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 57.939378048999998, 2024-09-12T22:32:35.403 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016804109000000001, 2024-09-12T22:32:35.403 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:35.403 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:35.403 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:35.403 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:35.404 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.404 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:35.404 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401994+0000", 2024-09-12T22:32:35.404 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:35.404 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.404 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.404 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:35.404 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401994+0000", 2024-09-12T22:32:35.404 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:35.404 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.404 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.404 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:35.404 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401995+0000", 2024-09-12T22:32:35.405 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.8899999999999998e-07 2024-09-12T22:32:35.405 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.405 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.405 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:35.405 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402000+0000", 2024-09-12T22:32:35.405 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.498e-06 2024-09-12T22:32:35.405 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.405 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.405 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:35.405 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402007+0000", 2024-09-12T22:32:35.405 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.554e-06 2024-09-12T22:32:35.405 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.405 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.406 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:35.406 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402046+0000", 2024-09-12T22:32:35.406 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9156000000000003e-05 2024-09-12T22:32:35.406 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.406 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.406 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:35.406 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407342+0000", 2024-09-12T22:32:35.406 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052957610000000004 2024-09-12T22:32:35.406 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.406 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.406 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:35.406 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407521+0000", 2024-09-12T22:32:35.406 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00017878100000000001 2024-09-12T22:32:35.406 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.407 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.407 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:35.407 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407641+0000", 2024-09-12T22:32:35.407 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012013 2024-09-12T22:32:35.407 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.407 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.407 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:35.407 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410472+0000", 2024-09-12T22:32:35.407 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.002830455 2024-09-12T22:32:35.407 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.407 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.407 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:35.407 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418714+0000", 2024-09-12T22:32:35.407 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0082422789999999999 2024-09-12T22:32:35.408 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.408 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.408 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:35.408 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418761+0000", 2024-09-12T22:32:35.408 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6956999999999998e-05 2024-09-12T22:32:35.408 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.408 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.408 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:35.408 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418799+0000", 2024-09-12T22:32:35.408 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7749000000000001e-05 2024-09-12T22:32:35.408 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:35.408 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:35.408 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:35.409 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.409 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.409 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:35.409 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.402060+0000", 2024-09-12T22:32:35.409 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 57.939312604999998, 2024-09-12T22:32:35.409 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016885686, 2024-09-12T22:32:35.409 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:35.409 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:35.409 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:35.409 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:35.409 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.409 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:35.409 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402060+0000", 2024-09-12T22:32:35.410 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:35.410 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.410 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.410 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:35.410 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402060+0000", 2024-09-12T22:32:35.410 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:35.410 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.410 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.410 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:35.410 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402061+0000", 2024-09-12T22:32:35.410 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4399999999999999e-07 2024-09-12T22:32:35.410 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.410 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.411 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:35.411 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402066+0000", 2024-09-12T22:32:35.411 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8649999999999998e-06 2024-09-12T22:32:35.411 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.411 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.411 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:35.411 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402146+0000", 2024-09-12T22:32:35.411 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9054000000000006e-05 2024-09-12T22:32:35.411 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.411 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.411 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:35.411 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402287+0000", 2024-09-12T22:32:35.412 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014108600000000001 2024-09-12T22:32:35.412 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.412 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.412 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:35.412 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408185+0000", 2024-09-12T22:32:35.412 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0058983919999999997 2024-09-12T22:32:35.412 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.412 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.412 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:35.412 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408299+0000", 2024-09-12T22:32:35.412 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114102 2024-09-12T22:32:35.412 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.412 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.413 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:35.413 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408420+0000", 2024-09-12T22:32:35.413 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000120492 2024-09-12T22:32:35.413 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.413 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.413 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:35.413 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410867+0000", 2024-09-12T22:32:35.413 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0024476430000000002 2024-09-12T22:32:35.413 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.413 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.413 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:35.413 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418851+0000", 2024-09-12T22:32:35.413 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0079841489999999994 2024-09-12T22:32:35.414 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.414 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.414 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:35.414 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418894+0000", 2024-09-12T22:32:35.414 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3090000000000002e-05 2024-09-12T22:32:35.414 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.414 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.414 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:35.414 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418946+0000", 2024-09-12T22:32:35.414 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1069000000000002e-05 2024-09-12T22:32:35.414 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:35.414 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:35.415 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:35.415 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.415 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.415 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:35.415 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.402375+0000", 2024-09-12T22:32:35.415 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 57.938997540000003, 2024-09-12T22:32:35.415 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016768531999999999, 2024-09-12T22:32:35.415 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:35.415 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:35.415 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:35.415 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:35.415 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.415 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:35.415 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402375+0000", 2024-09-12T22:32:35.416 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:35.416 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.416 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.416 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:35.416 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402375+0000", 2024-09-12T22:32:35.416 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:35.416 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.416 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.416 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:35.416 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402375+0000", 2024-09-12T22:32:35.416 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4099999999999999e-07 2024-09-12T22:32:35.416 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.416 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.417 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:35.417 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402379+0000", 2024-09-12T22:32:35.417 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9870000000000001e-06 2024-09-12T22:32:35.417 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.417 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.417 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:35.417 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402389+0000", 2024-09-12T22:32:35.417 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0000000000000001e-05 2024-09-12T22:32:35.417 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.417 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.417 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:35.417 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402401+0000", 2024-09-12T22:32:35.417 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.148e-05 2024-09-12T22:32:35.417 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.418 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.418 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:35.418 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409108+0000", 2024-09-12T22:32:35.418 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0067068429999999997 2024-09-12T22:32:35.418 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.418 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.418 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:35.418 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409189+0000", 2024-09-12T22:32:35.418 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0815999999999993e-05 2024-09-12T22:32:35.418 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.418 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.418 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:35.418 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409320+0000", 2024-09-12T22:32:35.418 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000131586 2024-09-12T22:32:35.419 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.419 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.419 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:35.419 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410872+0000", 2024-09-12T22:32:35.419 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0015521599999999999 2024-09-12T22:32:35.419 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.419 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.419 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:35.419 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419049+0000", 2024-09-12T22:32:35.419 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0081763719999999995 2024-09-12T22:32:35.419 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.419 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.419 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:35.420 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419107+0000", 2024-09-12T22:32:35.420 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7899000000000002e-05 2024-09-12T22:32:35.420 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.420 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.420 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:35.420 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419143+0000", 2024-09-12T22:32:35.420 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6847999999999997e-05 2024-09-12T22:32:35.420 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:35.420 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:35.420 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:35.420 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.420 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.420 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:35.421 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.402903+0000", 2024-09-12T22:32:35.421 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 57.938469128000001, 2024-09-12T22:32:35.421 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016378428, 2024-09-12T22:32:35.421 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:35.421 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:35.421 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:35.421 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:35.421 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.421 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:35.421 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402903+0000", 2024-09-12T22:32:35.421 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:35.421 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.421 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.421 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:35.422 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402903+0000", 2024-09-12T22:32:35.422 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:35.422 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.422 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.422 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:35.422 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402904+0000", 2024-09-12T22:32:35.422 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9500000000000001e-07 2024-09-12T22:32:35.422 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.422 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.422 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:35.422 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402944+0000", 2024-09-12T22:32:35.422 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0265000000000002e-05 2024-09-12T22:32:35.422 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.422 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.423 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:35.423 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402979+0000", 2024-09-12T22:32:35.423 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4378000000000002e-05 2024-09-12T22:32:35.423 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.423 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.423 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:35.423 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402987+0000", 2024-09-12T22:32:35.423 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3559999999999993e-06 2024-09-12T22:32:35.423 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.423 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.423 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:35.423 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409577+0000", 2024-09-12T22:32:35.423 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0065901709999999997 2024-09-12T22:32:35.424 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.424 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.424 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:35.424 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409653+0000", 2024-09-12T22:32:35.424 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5819e-05 2024-09-12T22:32:35.424 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.424 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.424 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:35.424 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409725+0000", 2024-09-12T22:32:35.424 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2200000000000007e-05 2024-09-12T22:32:35.424 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.424 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.424 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:35.425 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.411234+0000", 2024-09-12T22:32:35.425 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001508225 2024-09-12T22:32:35.425 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.425 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.425 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:35.425 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419212+0000", 2024-09-12T22:32:35.425 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0079783400000000004 2024-09-12T22:32:35.425 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.425 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.425 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:35.425 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419244+0000", 2024-09-12T22:32:35.425 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2384e-05 2024-09-12T22:32:35.425 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.425 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.426 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:35.426 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419282+0000", 2024-09-12T22:32:35.426 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7394999999999997e-05 2024-09-12T22:32:35.426 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:35.426 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:35.426 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:35.426 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.426 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.426 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:35.426 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.403135+0000", 2024-09-12T22:32:35.426 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 57.938237258000001, 2024-09-12T22:32:35.426 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016294211999999999, 2024-09-12T22:32:35.426 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:35.426 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:35.427 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:35.427 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:35.427 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.427 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:35.427 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403135+0000", 2024-09-12T22:32:35.427 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:35.427 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.427 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.427 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:35.427 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403135+0000", 2024-09-12T22:32:35.427 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:35.427 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.427 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.428 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:35.428 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403136+0000", 2024-09-12T22:32:35.428 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.4e-07 2024-09-12T22:32:35.428 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.428 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.428 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:35.428 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403149+0000", 2024-09-12T22:32:35.428 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2723e-05 2024-09-12T22:32:35.428 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.428 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.428 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:35.428 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403158+0000", 2024-09-12T22:32:35.428 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3919999999999992e-06 2024-09-12T22:32:35.428 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.429 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.429 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:35.429 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403166+0000", 2024-09-12T22:32:35.429 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.2309999999999996e-06 2024-09-12T22:32:35.429 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.429 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.429 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:35.429 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409944+0000", 2024-09-12T22:32:35.429 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0067775309999999998 2024-09-12T22:32:35.429 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.429 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.429 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:35.429 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410032+0000", 2024-09-12T22:32:35.430 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.7906999999999997e-05 2024-09-12T22:32:35.430 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.430 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.430 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:35.430 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410152+0000", 2024-09-12T22:32:35.430 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012037800000000001 2024-09-12T22:32:35.430 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.430 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.430 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:35.430 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.411945+0000", 2024-09-12T22:32:35.431 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0017931850000000001 2024-09-12T22:32:35.431 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.431 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.431 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:35.431 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419319+0000", 2024-09-12T22:32:35.431 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0073731780000000002 2024-09-12T22:32:35.431 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.431 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.431 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:35.431 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419376+0000", 2024-09-12T22:32:35.431 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7728e-05 2024-09-12T22:32:35.431 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.431 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.432 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:35.432 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419429+0000", 2024-09-12T22:32:35.432 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3019000000000002e-05 2024-09-12T22:32:35.432 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:35.432 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:35.432 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:35.432 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.432 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.432 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:35.432 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.403185+0000", 2024-09-12T22:32:35.432 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 57.938187376999998, 2024-09-12T22:32:35.432 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.014902164000000001, 2024-09-12T22:32:35.432 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:35.433 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:35.433 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:35.433 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:35.433 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.433 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:35.433 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403185+0000", 2024-09-12T22:32:35.433 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:35.433 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.433 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.433 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:35.433 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403185+0000", 2024-09-12T22:32:35.433 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:35.433 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.433 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.434 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:35.434 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403186+0000", 2024-09-12T22:32:35.434 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9400000000000005e-07 2024-09-12T22:32:35.434 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.434 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.434 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:35.434 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403191+0000", 2024-09-12T22:32:35.434 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6980000000000003e-06 2024-09-12T22:32:35.434 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.434 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.434 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:35.434 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403199+0000", 2024-09-12T22:32:35.434 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2520000000000002e-06 2024-09-12T22:32:35.435 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.435 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.435 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:35.435 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403205+0000", 2024-09-12T22:32:35.435 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.908e-06 2024-09-12T22:32:35.435 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.435 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.435 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:35.435 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403359+0000", 2024-09-12T22:32:35.435 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000154544 2024-09-12T22:32:35.435 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.435 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.435 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:35.435 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403528+0000", 2024-09-12T22:32:35.436 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000168455 2024-09-12T22:32:35.436 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.436 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.436 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:35.436 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403763+0000", 2024-09-12T22:32:35.436 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00023539599999999999 2024-09-12T22:32:35.436 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.436 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.436 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:35.436 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409378+0000", 2024-09-12T22:32:35.436 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056150000000000002 2024-09-12T22:32:35.436 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.436 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.437 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:35.437 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418012+0000", 2024-09-12T22:32:35.437 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0086339559999999999 2024-09-12T22:32:35.437 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.437 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.437 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:35.437 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418046+0000", 2024-09-12T22:32:35.437 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4267999999999998e-05 2024-09-12T22:32:35.437 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.437 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.437 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:35.437 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418087+0000", 2024-09-12T22:32:35.437 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0992999999999999e-05 2024-09-12T22:32:35.437 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:35.438 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:35.438 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:35.438 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.438 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.438 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:35.438 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.403273+0000", 2024-09-12T22:32:35.438 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 57.938099426000001, 2024-09-12T22:32:35.438 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.014934866, 2024-09-12T22:32:35.438 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:35.438 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:35.438 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:35.438 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:35.438 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.439 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:35.439 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403273+0000", 2024-09-12T22:32:35.439 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:35.439 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.439 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.439 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:35.439 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403273+0000", 2024-09-12T22:32:35.439 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:35.439 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.439 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.439 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:35.439 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403274+0000", 2024-09-12T22:32:35.439 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.297e-06 2024-09-12T22:32:35.439 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.440 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.440 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:35.440 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403282+0000", 2024-09-12T22:32:35.440 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6340000000000001e-06 2024-09-12T22:32:35.440 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.440 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.440 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:35.440 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403305+0000", 2024-09-12T22:32:35.440 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3149000000000001e-05 2024-09-12T22:32:35.440 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.440 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.440 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:35.440 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403320+0000", 2024-09-12T22:32:35.441 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4527e-05 2024-09-12T22:32:35.441 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.441 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.441 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:35.441 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.404928+0000", 2024-09-12T22:32:35.441 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001608459 2024-09-12T22:32:35.441 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.441 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.441 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:35.441 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405218+0000", 2024-09-12T22:32:35.441 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00028982900000000002 2024-09-12T22:32:35.441 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.441 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.441 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:35.442 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405829+0000", 2024-09-12T22:32:35.442 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00061127900000000005 2024-09-12T22:32:35.442 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.442 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.442 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:35.442 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409403+0000", 2024-09-12T22:32:35.442 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.003573597 2024-09-12T22:32:35.442 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.442 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.442 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:35.442 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418138+0000", 2024-09-12T22:32:35.442 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0087349969999999996 2024-09-12T22:32:35.442 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.442 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.443 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:35.443 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418178+0000", 2024-09-12T22:32:35.443 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0649999999999999e-05 2024-09-12T22:32:35.443 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.443 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.443 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:35.443 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418208+0000", 2024-09-12T22:32:35.443 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9448e-05 2024-09-12T22:32:35.443 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:35.443 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:35.443 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:35.443 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.443 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.444 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:35.444 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.405456+0000", 2024-09-12T22:32:35.444 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 57.935916280999997, 2024-09-12T22:32:35.444 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012888389, 2024-09-12T22:32:35.444 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:35.444 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:35.444 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:35.444 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:35.444 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.444 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:35.444 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405456+0000", 2024-09-12T22:32:35.444 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:35.444 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.445 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.445 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:35.445 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405456+0000", 2024-09-12T22:32:35.445 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:35.445 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.445 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.445 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:35.445 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405457+0000", 2024-09-12T22:32:35.445 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.6599999999999994e-07 2024-09-12T22:32:35.445 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.445 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.445 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:35.445 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405463+0000", 2024-09-12T22:32:35.445 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4739999999999996e-06 2024-09-12T22:32:35.446 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.446 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.446 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:35.446 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405474+0000", 2024-09-12T22:32:35.446 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1095e-05 2024-09-12T22:32:35.446 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.446 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.446 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:35.446 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405482+0000", 2024-09-12T22:32:35.446 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3610000000000001e-06 2024-09-12T22:32:35.446 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.446 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.446 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:35.446 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407051+0000", 2024-09-12T22:32:35.447 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0015688970000000001 2024-09-12T22:32:35.447 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.447 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.447 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:35.447 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407259+0000", 2024-09-12T22:32:35.447 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00020778300000000001 2024-09-12T22:32:35.447 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.447 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.447 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:35.447 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407622+0000", 2024-09-12T22:32:35.447 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000363066 2024-09-12T22:32:35.447 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.447 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.448 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:35.448 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409438+0000", 2024-09-12T22:32:35.448 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001816319 2024-09-12T22:32:35.448 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.448 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.448 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:35.448 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418257+0000", 2024-09-12T22:32:35.448 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0088187720000000008 2024-09-12T22:32:35.448 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.448 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.448 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:35.448 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418308+0000", 2024-09-12T22:32:35.448 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1180000000000001e-05 2024-09-12T22:32:35.448 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.449 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.449 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:35.449 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418345+0000", 2024-09-12T22:32:35.449 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6476000000000001e-05 2024-09-12T22:32:35.449 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:35.449 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:35.449 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:35.449 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.449 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.449 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:35.449 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.405496+0000", 2024-09-12T22:32:35.449 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 57.935876923999999, 2024-09-12T22:32:35.449 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013016012, 2024-09-12T22:32:35.450 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:35.450 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:35.450 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:35.450 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:35.450 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.450 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:35.450 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405496+0000", 2024-09-12T22:32:35.450 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:35.450 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.450 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.450 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:35.450 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405496+0000", 2024-09-12T22:32:35.450 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:35.450 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.451 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.451 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:35.451 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405496+0000", 2024-09-12T22:32:35.451 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7999999999999995e-07 2024-09-12T22:32:35.451 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.451 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.451 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:35.451 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405501+0000", 2024-09-12T22:32:35.451 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8359999999999999e-06 2024-09-12T22:32:35.451 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.451 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.451 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:35.451 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405514+0000", 2024-09-12T22:32:35.451 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2522e-05 2024-09-12T22:32:35.452 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.452 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.452 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:35.452 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405521+0000", 2024-09-12T22:32:35.452 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5020000000000003e-06 2024-09-12T22:32:35.452 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.452 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.452 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:35.452 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405575+0000", 2024-09-12T22:32:35.452 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4169999999999998e-05 2024-09-12T22:32:35.452 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.452 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.452 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:35.453 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405697+0000", 2024-09-12T22:32:35.453 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000121301 2024-09-12T22:32:35.453 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.453 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.453 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:35.453 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405829+0000", 2024-09-12T22:32:35.456 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000132662 2024-09-12T22:32:35.457 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.457 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.457 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:35.457 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409155+0000", 2024-09-12T22:32:35.457 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0033259050000000001 2024-09-12T22:32:35.457 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.457 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.458 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:35.458 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418425+0000", 2024-09-12T22:32:35.458 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0092696319999999999 2024-09-12T22:32:35.458 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.458 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.458 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:35.458 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418471+0000", 2024-09-12T22:32:35.458 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6213e-05 2024-09-12T22:32:35.458 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.458 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.458 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:35.458 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418512+0000", 2024-09-12T22:32:35.458 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0589000000000001e-05 2024-09-12T22:32:35.459 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:35.459 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:35.459 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:35.459 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.459 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.459 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:35.459 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.406108+0000", 2024-09-12T22:32:35.459 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 57.935264527000001, 2024-09-12T22:32:35.459 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012458175, 2024-09-12T22:32:35.459 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:35.459 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:35.459 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:35.459 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:35.459 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.460 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:35.460 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406108+0000", 2024-09-12T22:32:35.460 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:35.460 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.460 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.460 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:35.460 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406108+0000", 2024-09-12T22:32:35.460 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:35.460 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.460 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.460 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:35.460 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406109+0000", 2024-09-12T22:32:35.460 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9899999999999999e-07 2024-09-12T22:32:35.461 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.461 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.461 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:35.461 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406115+0000", 2024-09-12T22:32:35.461 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9030000000000001e-06 2024-09-12T22:32:35.461 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.461 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.461 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:35.461 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406141+0000", 2024-09-12T22:32:35.461 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5999e-05 2024-09-12T22:32:35.461 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.461 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.461 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:35.461 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406150+0000", 2024-09-12T22:32:35.462 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.6050000000000004e-06 2024-09-12T22:32:35.462 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.462 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.462 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:35.462 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408163+0000", 2024-09-12T22:32:35.462 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0020122769999999998 2024-09-12T22:32:35.462 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.462 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.462 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:35.462 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408309+0000", 2024-09-12T22:32:35.462 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014606999999999999 2024-09-12T22:32:35.462 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.462 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.463 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:35.463 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408433+0000", 2024-09-12T22:32:35.463 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012460300000000001 2024-09-12T22:32:35.463 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.463 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.463 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:35.463 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409903+0000", 2024-09-12T22:32:35.463 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001469499 2024-09-12T22:32:35.463 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.463 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.463 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:35.463 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418427+0000", 2024-09-12T22:32:35.463 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0085241139999999993 2024-09-12T22:32:35.463 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.464 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.464 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:35.464 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418471+0000", 2024-09-12T22:32:35.464 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4474000000000001e-05 2024-09-12T22:32:35.464 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.464 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.464 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:35.464 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418566+0000", 2024-09-12T22:32:35.464 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.4732e-05 2024-09-12T22:32:35.464 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:35.464 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:35.464 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:35.464 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.464 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.465 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:35.465 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.407266+0000", 2024-09-12T22:32:35.465 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 57.934106671000002, 2024-09-12T22:32:35.465 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011442905, 2024-09-12T22:32:35.465 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:35.465 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:35.465 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2024-09-12T22:32:35.465 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:35.465 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.465 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:35.465 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407266+0000", 2024-09-12T22:32:35.465 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:35.465 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.466 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.466 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:35.466 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407266+0000", 2024-09-12T22:32:35.466 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:35.466 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.466 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.466 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:35.466 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407266+0000", 2024-09-12T22:32:35.466 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7899999999999998e-07 2024-09-12T22:32:35.466 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.466 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.466 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:35.466 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407269+0000", 2024-09-12T22:32:35.466 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9210000000000001e-06 2024-09-12T22:32:35.467 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.467 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.467 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:35.467 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407331+0000", 2024-09-12T22:32:35.467 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1376000000000003e-05 2024-09-12T22:32:35.467 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.467 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.467 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:35.467 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407337+0000", 2024-09-12T22:32:35.467 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1929999999999998e-06 2024-09-12T22:32:35.467 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.467 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.467 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:35.467 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408974+0000", 2024-09-12T22:32:35.468 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0016367109999999999 2024-09-12T22:32:35.468 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.468 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.468 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:35.468 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409112+0000", 2024-09-12T22:32:35.468 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000137952 2024-09-12T22:32:35.468 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:35.468 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:35.468 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:35.468 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418709+0000", 2024-09-12T22:32:35.468 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0095971730000000005 2024-09-12T22:32:35.468 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:35.468 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:35.469 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:35.469 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:35.469 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:35.469 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-09-12T22:32:35.469 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T22:32:35.471 INFO:teuthology.orchestra.run.smithi019.stderr:nodeep-scrub is set 2024-09-12T22:32:35.472 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:32:35.472 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:32:35.470+0000 7fddec6a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30331) UID: 0 2024-09-12T22:32:35.571 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:32:35.570+0000 7fddec6a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30331) UID: 0 2024-09-12T22:32:35.590 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-09-12T22:32:35.591 INFO:teuthology.orchestra.run.smithi076.stdout: "ops": [], 2024-09-12T22:32:35.591 INFO:teuthology.orchestra.run.smithi076.stdout: "num_ops": 0 2024-09-12T22:32:35.591 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-09-12T22:32:35.600 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T22:32:35.673 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:35.672+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:35.691 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0: {} 2024-09-12T22:32:35.692 INFO:teuthology.orchestra.run.smithi019.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T22:32:35.711 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T22:32:35.711 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:32:35.728 INFO:teuthology.orchestra.run.smithi019.stdout:osd.2: {} 2024-09-12T22:32:35.729 INFO:teuthology.orchestra.run.smithi019.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T22:32:35.745 INFO:teuthology.orchestra.run.smithi076.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:35.745 INFO:teuthology.orchestra.run.smithi076.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:35.754 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T22:32:35.799 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:32:35.798+0000 7fddec6a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30331) UID: 0 2024-09-12T22:32:35.857 INFO:teuthology.orchestra.run.smithi076.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:35.857 INFO:teuthology.orchestra.run.smithi076.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:35.865 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:32:35.910 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:35.909+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:35.975 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:32:35.974+0000 7fddec6a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30331) UID: 0 2024-09-12T22:32:35.980 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:35.980 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:35.990 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:32:36.076 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:36.076+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:36.134 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:36.134 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:36.143 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:32:36.179 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:32:36.178+0000 7fddec6a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 30331) UID: 0 2024-09-12T22:32:36.245 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:36.245 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:36.254 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:32:36.280 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:36.279+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:36.355 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-09-12T22:32:36.355 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-12T22:32:36.355 INFO:tasks.thrashosds.thrasher:Killing osd 0, live_osds are [0, 1, 2] 2024-09-12T22:32:36.356 INFO:tasks.ceph.ceph_manager.ceph:kill_osd on osd.0 doing powercycle of ubuntu@smithi076.front.sepia.ceph.com 2024-09-12T22:32:36.356 INFO:teuthology.orchestra.console.smithi076:Power off 2024-09-12T22:32:36.356 DEBUG:teuthology.orchestra.console.smithi076:pexpect command: ipmitool -H smithi076.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-09-12T22:32:36.372 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:36.372 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:36.383 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:36.382+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:36.384 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:32:36.390 DEBUG:teuthology.orchestra.console.smithi076:power off output: Chassis Power Control: Down/Off 2024-09-12T22:32:36.484 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:36.483+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:36.489 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:36.489 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:36.498 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:32:36.586 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:36.585+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:36.602 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:36.602 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:36.612 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:32:36.687 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:36.686+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:36.718 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:36.718 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:36.727 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:32:36.812 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:36.811+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:36.869 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:36.869 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:36.878 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:32:36.919 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:36.918+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:36.991 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:36.991+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:37.023 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:37.023 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:37.032 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:32:37.093 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:37.092+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:37.139 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:37.139 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:37.148 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:32:37.194 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:37.193+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:37.250 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:37.251 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:37.260 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:32:37.303 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:37.302+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:37.362 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:37.362 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:37.371 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:32:37.415 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:37.414+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:37.473 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T22:32:37.475 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:37.475 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:37.482 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:32:37.524 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:37.522+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:37.597 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:37.596+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:37.628 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:37.628 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:37.638 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:32:37.698 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:37.697+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:37.741 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T22:32:37.742 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:37.742 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:37.750 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:32:37.800 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:37.799+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:37.857 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:37.857 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:37.867 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:32:37.901 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:37.900+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:37.940 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0: {} 2024-09-12T22:32:37.940 INFO:teuthology.orchestra.run.smithi019.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T22:32:37.970 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:37.971 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:37.972 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T22:32:37.973 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:32:37.979 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:32:37.989 INFO:teuthology.orchestra.run.smithi019.stdout:osd.2: {} 2024-09-12T22:32:37.990 INFO:teuthology.orchestra.run.smithi019.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T22:32:38.023 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:38.022+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:38.082 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-09-12T22:32:38.083 INFO:teuthology.orchestra.run.smithi163.stdout: "size": 20, 2024-09-12T22:32:38.083 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 600, 2024-09-12T22:32:38.083 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2024-09-12T22:32:38.083 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.083 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-09-12T22:32:38.083 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:27.254459+0000", 2024-09-12T22:32:38.083 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 70.825633572000001, 2024-09-12T22:32:38.083 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.37816283899999997, 2024-09-12T22:32:38.083 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:38.083 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:38.083 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:38.083 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:38.083 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:38.084 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:38.084 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 1 2024-09-12T22:32:38.084 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.084 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:38.084 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.084 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:38.084 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254459+0000", 2024-09-12T22:32:38.084 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:38.084 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.084 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.084 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:38.084 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254459+0000", 2024-09-12T22:32:38.084 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:38.085 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.085 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.085 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:38.085 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254460+0000", 2024-09-12T22:32:38.085 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1739999999999999e-06 2024-09-12T22:32:38.085 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.085 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.085 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:38.085 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254472+0000", 2024-09-12T22:32:38.085 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2207e-05 2024-09-12T22:32:38.085 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.085 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.085 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:38.086 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254483+0000", 2024-09-12T22:32:38.086 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0631999999999999e-05 2024-09-12T22:32:38.086 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.086 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.086 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:38.086 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254492+0000", 2024-09-12T22:32:38.086 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3670000000000003e-06 2024-09-12T22:32:38.086 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.086 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.086 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:38.086 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254551+0000", 2024-09-12T22:32:38.086 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8687999999999998e-05 2024-09-12T22:32:38.086 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.087 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.087 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for peered", 2024-09-12T22:32:38.087 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254562+0000", 2024-09-12T22:32:38.087 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1249e-05 2024-09-12T22:32:38.087 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.087 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.087 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:38.087 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.631211+0000", 2024-09-12T22:32:38.087 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.376649018 2024-09-12T22:32:38.087 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.087 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.087 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:38.088 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.631345+0000", 2024-09-12T22:32:38.088 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013378700000000001 2024-09-12T22:32:38.088 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.088 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.088 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:38.088 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.631479+0000", 2024-09-12T22:32:38.088 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013352399999999999 2024-09-12T22:32:38.088 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.088 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.088 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:38.088 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632324+0000", 2024-09-12T22:32:38.088 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00084508100000000002 2024-09-12T22:32:38.088 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.088 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.089 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:38.089 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632548+0000", 2024-09-12T22:32:38.089 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000224329 2024-09-12T22:32:38.089 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.089 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.089 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:38.089 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632591+0000", 2024-09-12T22:32:38.089 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2564000000000001e-05 2024-09-12T22:32:38.089 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.089 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.089 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:38.089 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632622+0000", 2024-09-12T22:32:38.089 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1219e-05 2024-09-12T22:32:38.090 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:38.090 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:38.090 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:38.090 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.090 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.090 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:185 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:32:38.090 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394355+0000", 2024-09-12T22:32:38.090 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 69.685737474999996, 2024-09-12T22:32:38.090 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011302394, 2024-09-12T22:32:38.090 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:38.091 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:38.091 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:38.091 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:38.091 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:38.091 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:38.091 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 185 2024-09-12T22:32:38.091 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.091 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:38.091 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.091 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:38.091 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394355+0000", 2024-09-12T22:32:38.091 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:38.091 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.091 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.092 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:38.092 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394355+0000", 2024-09-12T22:32:38.092 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:38.092 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.092 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.092 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:38.092 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394355+0000", 2024-09-12T22:32:38.092 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9099999999999999e-07 2024-09-12T22:32:38.092 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.092 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.092 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:38.092 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394385+0000", 2024-09-12T22:32:38.092 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9963000000000001e-05 2024-09-12T22:32:38.093 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.093 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.093 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:38.093 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394390+0000", 2024-09-12T22:32:38.093 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8420000000000004e-06 2024-09-12T22:32:38.093 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.093 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.093 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:38.093 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394393+0000", 2024-09-12T22:32:38.093 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1e-06 2024-09-12T22:32:38.093 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.093 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.093 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:38.093 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.400546+0000", 2024-09-12T22:32:38.094 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0061523309999999996 2024-09-12T22:32:38.094 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.094 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.094 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:38.094 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.400588+0000", 2024-09-12T22:32:38.094 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1835000000000002e-05 2024-09-12T22:32:38.094 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.094 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.094 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:38.094 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.400677+0000", 2024-09-12T22:32:38.094 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9195000000000002e-05 2024-09-12T22:32:38.094 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.094 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.094 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:38.095 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405378+0000", 2024-09-12T22:32:38.095 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0047008659999999997 2024-09-12T22:32:38.095 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.095 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.095 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:38.095 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405569+0000", 2024-09-12T22:32:38.095 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00019148599999999999 2024-09-12T22:32:38.095 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.095 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.095 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:38.095 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405620+0000", 2024-09-12T22:32:38.095 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1416999999999999e-05 2024-09-12T22:32:38.095 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.095 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.096 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:38.096 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405657+0000", 2024-09-12T22:32:38.096 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6968000000000002e-05 2024-09-12T22:32:38.096 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:38.096 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:38.096 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:38.096 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.096 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.096 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:32:38.096 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394399+0000", 2024-09-12T22:32:38.096 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 69.685693263999994, 2024-09-12T22:32:38.097 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011336601999999999, 2024-09-12T22:32:38.097 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:38.097 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:38.097 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:38.097 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:38.097 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:38.097 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:38.098 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 186 2024-09-12T22:32:38.098 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.098 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:38.098 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.098 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:38.098 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394399+0000", 2024-09-12T22:32:38.098 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:38.098 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.098 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.098 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:38.098 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394399+0000", 2024-09-12T22:32:38.098 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:38.099 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.099 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.099 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:38.099 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394400+0000", 2024-09-12T22:32:38.099 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4499999999999998e-07 2024-09-12T22:32:38.099 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.099 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.099 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:38.099 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394402+0000", 2024-09-12T22:32:38.099 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.875e-06 2024-09-12T22:32:38.100 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.100 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.100 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:38.100 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394405+0000", 2024-09-12T22:32:38.100 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6799999999999999e-06 2024-09-12T22:32:38.100 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.100 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.100 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:38.100 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394408+0000", 2024-09-12T22:32:38.100 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.667e-06 2024-09-12T22:32:38.100 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.100 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.101 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:38.101 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401395+0000", 2024-09-12T22:32:38.101 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0069867230000000002 2024-09-12T22:32:38.101 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.101 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.101 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:38.101 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401438+0000", 2024-09-12T22:32:38.101 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3554999999999999e-05 2024-09-12T22:32:38.101 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.101 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.101 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:38.102 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401509+0000", 2024-09-12T22:32:38.102 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0631999999999997e-05 2024-09-12T22:32:38.102 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.102 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.102 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:38.102 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405392+0000", 2024-09-12T22:32:38.102 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0038830449999999999 2024-09-12T22:32:38.102 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.102 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.102 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:38.102 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405690+0000", 2024-09-12T22:32:38.102 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000298435 2024-09-12T22:32:38.103 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.103 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.103 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:38.103 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405716+0000", 2024-09-12T22:32:38.103 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5435999999999998e-05 2024-09-12T22:32:38.103 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.103 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.103 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:38.104 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405736+0000", 2024-09-12T22:32:38.104 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0208999999999999e-05 2024-09-12T22:32:38.104 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:38.104 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:38.104 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:38.104 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.104 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.104 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:32:38.104 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394411+0000", 2024-09-12T22:32:38.104 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 69.685681138000007, 2024-09-12T22:32:38.104 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011400117, 2024-09-12T22:32:38.104 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:38.104 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:38.105 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:38.105 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:38.105 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:38.105 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:38.105 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 187 2024-09-12T22:32:38.105 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.105 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:38.105 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.105 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:38.105 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394411+0000", 2024-09-12T22:32:38.105 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:38.105 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.105 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.105 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:38.106 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394411+0000", 2024-09-12T22:32:38.106 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:38.106 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.106 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.106 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:38.106 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394412+0000", 2024-09-12T22:32:38.106 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.4999999999999999e-07 2024-09-12T22:32:38.106 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.106 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.106 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:38.106 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394414+0000", 2024-09-12T22:32:38.106 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.984e-06 2024-09-12T22:32:38.106 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.107 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.107 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:38.107 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394418+0000", 2024-09-12T22:32:38.107 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0840000000000002e-06 2024-09-12T22:32:38.107 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.107 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.107 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:38.107 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394431+0000", 2024-09-12T22:32:38.107 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.361e-05 2024-09-12T22:32:38.107 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.107 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.107 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:38.107 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401778+0000", 2024-09-12T22:32:38.108 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0073462659999999997 2024-09-12T22:32:38.108 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.108 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.108 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:38.108 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401853+0000", 2024-09-12T22:32:38.108 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5797000000000006e-05 2024-09-12T22:32:38.108 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.108 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.108 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:38.108 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401990+0000", 2024-09-12T22:32:38.108 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013651399999999999 2024-09-12T22:32:38.108 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.108 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.109 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:38.109 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405402+0000", 2024-09-12T22:32:38.109 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0034116070000000001 2024-09-12T22:32:38.109 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.109 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.109 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:38.109 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405764+0000", 2024-09-12T22:32:38.109 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00036234899999999998 2024-09-12T22:32:38.109 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.109 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.109 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:38.109 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405791+0000", 2024-09-12T22:32:38.109 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7029000000000002e-05 2024-09-12T22:32:38.109 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.110 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.110 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:38.110 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405812+0000", 2024-09-12T22:32:38.110 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0627000000000001e-05 2024-09-12T22:32:38.110 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:38.110 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:38.110 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:38.110 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.110 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.110 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:32:38.110 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394447+0000", 2024-09-12T22:32:38.110 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 69.685645987000001, 2024-09-12T22:32:38.110 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011759588, 2024-09-12T22:32:38.110 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:38.111 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:38.111 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:38.111 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:38.111 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:38.111 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:38.111 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 188 2024-09-12T22:32:38.111 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.111 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:38.111 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.111 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:38.111 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394447+0000", 2024-09-12T22:32:38.111 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:38.111 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.112 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.112 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:38.112 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394447+0000", 2024-09-12T22:32:38.112 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:38.112 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.112 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.112 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:38.112 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394447+0000", 2024-09-12T22:32:38.112 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.15e-07 2024-09-12T22:32:38.112 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.112 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.112 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:38.112 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394512+0000", 2024-09-12T22:32:38.112 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4580999999999997e-05 2024-09-12T22:32:38.113 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.113 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.113 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:38.113 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394518+0000", 2024-09-12T22:32:38.113 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.3380000000000001e-06 2024-09-12T22:32:38.113 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.113 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.113 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:38.113 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394521+0000", 2024-09-12T22:32:38.113 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3340000000000002e-06 2024-09-12T22:32:38.113 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.114 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.114 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:38.114 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.402628+0000", 2024-09-12T22:32:38.114 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.008106996 2024-09-12T22:32:38.114 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.114 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.114 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:38.114 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.402670+0000", 2024-09-12T22:32:38.114 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1983000000000001e-05 2024-09-12T22:32:38.114 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.114 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.115 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:38.115 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.402738+0000", 2024-09-12T22:32:38.115 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.8114999999999994e-05 2024-09-12T22:32:38.115 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.115 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.115 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:38.115 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405668+0000", 2024-09-12T22:32:38.115 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.002929545 2024-09-12T22:32:38.115 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.115 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.115 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:38.115 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406162+0000", 2024-09-12T22:32:38.116 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000494408 2024-09-12T22:32:38.116 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.116 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.116 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:38.116 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406188+0000", 2024-09-12T22:32:38.116 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5766e-05 2024-09-12T22:32:38.116 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.116 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.116 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:38.116 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406206+0000", 2024-09-12T22:32:38.117 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.8107000000000001e-05 2024-09-12T22:32:38.117 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:38.117 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:38.117 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:38.117 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.117 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.117 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:32:38.117 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394528+0000", 2024-09-12T22:32:38.117 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 69.685564318000004, 2024-09-12T22:32:38.117 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.01195536, 2024-09-12T22:32:38.117 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:38.118 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:38.118 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:38.118 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:38.118 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:38.118 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:38.118 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 189 2024-09-12T22:32:38.118 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.118 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:38.118 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.118 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:38.118 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394528+0000", 2024-09-12T22:32:38.119 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:38.119 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.119 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.119 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:38.119 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394528+0000", 2024-09-12T22:32:38.119 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:38.119 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.119 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.119 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:38.119 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394529+0000", 2024-09-12T22:32:38.119 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4900000000000001e-07 2024-09-12T22:32:38.120 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.120 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.120 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:38.120 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394531+0000", 2024-09-12T22:32:38.120 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.458e-06 2024-09-12T22:32:38.120 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.120 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.120 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:38.120 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394535+0000", 2024-09-12T22:32:38.120 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7900000000000001e-06 2024-09-12T22:32:38.120 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.121 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.121 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:38.121 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394537+0000", 2024-09-12T22:32:38.121 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.632e-06 2024-09-12T22:32:38.121 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.121 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.121 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:38.121 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.404932+0000", 2024-09-12T22:32:38.121 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010394158000000001 2024-09-12T22:32:38.121 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.121 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.122 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:38.122 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405017+0000", 2024-09-12T22:32:38.122 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5525000000000005e-05 2024-09-12T22:32:38.122 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.122 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.122 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:38.122 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405114+0000", 2024-09-12T22:32:38.122 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.6527000000000006e-05 2024-09-12T22:32:38.122 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.122 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.122 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:38.123 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405818+0000", 2024-09-12T22:32:38.123 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00070412800000000005 2024-09-12T22:32:38.123 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.123 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.123 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:38.123 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406437+0000", 2024-09-12T22:32:38.123 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00061898900000000002 2024-09-12T22:32:38.123 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.123 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.123 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:38.123 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406463+0000", 2024-09-12T22:32:38.124 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6268e-05 2024-09-12T22:32:38.124 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.124 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.124 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:38.124 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406484+0000", 2024-09-12T22:32:38.124 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0536000000000001e-05 2024-09-12T22:32:38.125 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:38.125 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:38.125 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:38.125 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.125 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.125 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:38.125 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.401422+0000", 2024-09-12T22:32:38.125 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 60.678670412999999, 2024-09-12T22:32:38.126 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016896452999999999, 2024-09-12T22:32:38.126 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:38.126 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:38.126 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:38.126 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:38.126 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.126 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:38.126 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401422+0000", 2024-09-12T22:32:38.126 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:38.126 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.126 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.127 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:38.127 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401422+0000", 2024-09-12T22:32:38.127 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:38.127 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.127 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.127 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:38.127 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401424+0000", 2024-09-12T22:32:38.127 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9e-06 2024-09-12T22:32:38.127 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.127 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.127 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:38.127 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401437+0000", 2024-09-12T22:32:38.128 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2831e-05 2024-09-12T22:32:38.128 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.128 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.128 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:38.128 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401471+0000", 2024-09-12T22:32:38.128 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4010000000000001e-05 2024-09-12T22:32:38.128 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.129 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.129 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:38.129 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401484+0000", 2024-09-12T22:32:38.129 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2711000000000001e-05 2024-09-12T22:32:38.129 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.129 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.129 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:38.129 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405410+0000", 2024-09-12T22:32:38.129 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0039259170000000001 2024-09-12T22:32:38.129 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.129 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.130 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:38.130 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405529+0000", 2024-09-12T22:32:38.130 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000119778 2024-09-12T22:32:38.130 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.130 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.130 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:38.130 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405655+0000", 2024-09-12T22:32:38.130 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012556700000000001 2024-09-12T22:32:38.130 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.131 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.131 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:38.131 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410456+0000", 2024-09-12T22:32:38.131 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0048008269999999997 2024-09-12T22:32:38.131 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.131 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.131 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:38.131 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418226+0000", 2024-09-12T22:32:38.131 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0077707729999999999 2024-09-12T22:32:38.131 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.131 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.131 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:38.132 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418277+0000", 2024-09-12T22:32:38.132 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0476000000000003e-05 2024-09-12T22:32:38.132 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.132 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.132 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:38.132 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418319+0000", 2024-09-12T22:32:38.132 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1662999999999997e-05 2024-09-12T22:32:38.132 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:38.132 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:38.133 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:38.133 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.133 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.133 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:38.133 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.401505+0000", 2024-09-12T22:32:38.133 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 60.678587749000002, 2024-09-12T22:32:38.133 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016987904000000002, 2024-09-12T22:32:38.133 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:38.133 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:38.133 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:38.133 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:38.133 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.133 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:38.133 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401505+0000", 2024-09-12T22:32:38.134 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:38.134 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.134 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.134 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:38.134 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401505+0000", 2024-09-12T22:32:38.134 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:38.134 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.134 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.134 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:38.134 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401506+0000", 2024-09-12T22:32:38.134 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4700000000000001e-07 2024-09-12T22:32:38.134 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.134 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.135 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:38.135 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401510+0000", 2024-09-12T22:32:38.135 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6609999999999999e-06 2024-09-12T22:32:38.135 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.135 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.135 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:38.135 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401771+0000", 2024-09-12T22:32:38.135 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00026110700000000001 2024-09-12T22:32:38.135 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.135 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.135 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:38.135 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401921+0000", 2024-09-12T22:32:38.135 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014939099999999999 2024-09-12T22:32:38.136 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.136 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.136 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:38.136 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405944+0000", 2024-09-12T22:32:38.136 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0040235449999999999 2024-09-12T22:32:38.136 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.136 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.136 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:38.136 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406018+0000", 2024-09-12T22:32:38.136 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3373000000000004e-05 2024-09-12T22:32:38.136 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.136 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.136 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:38.137 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406172+0000", 2024-09-12T22:32:38.137 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00015435399999999999 2024-09-12T22:32:38.137 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.137 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.137 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:38.137 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410461+0000", 2024-09-12T22:32:38.137 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0042888609999999997 2024-09-12T22:32:38.137 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.137 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.138 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:38.138 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418371+0000", 2024-09-12T22:32:38.138 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0079098380000000006 2024-09-12T22:32:38.138 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.138 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.138 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:38.138 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418443+0000", 2024-09-12T22:32:38.138 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2705000000000003e-05 2024-09-12T22:32:38.138 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.138 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.138 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:38.138 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418493+0000", 2024-09-12T22:32:38.138 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9322e-05 2024-09-12T22:32:38.138 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:38.139 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:38.139 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:38.139 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.139 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.139 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:38.139 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.401939+0000", 2024-09-12T22:32:38.139 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 60.678154012999997, 2024-09-12T22:32:38.139 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016722292999999999, 2024-09-12T22:32:38.139 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:38.139 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:38.139 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:38.139 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:38.139 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.140 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:38.140 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401939+0000", 2024-09-12T22:32:38.140 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:38.140 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.140 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.140 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:38.140 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401939+0000", 2024-09-12T22:32:38.140 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:38.140 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.140 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.140 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:38.140 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401940+0000", 2024-09-12T22:32:38.140 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1990000000000001e-06 2024-09-12T22:32:38.140 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.141 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.141 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:38.141 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401956+0000", 2024-09-12T22:32:38.141 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.6344000000000001e-05 2024-09-12T22:32:38.141 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.141 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.141 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:38.141 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401974+0000", 2024-09-12T22:32:38.141 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7730000000000001e-05 2024-09-12T22:32:38.141 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.141 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.141 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:38.142 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401982+0000", 2024-09-12T22:32:38.142 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.7800000000000001e-06 2024-09-12T22:32:38.142 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.142 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.142 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:38.142 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406557+0000", 2024-09-12T22:32:38.142 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0045758489999999999 2024-09-12T22:32:38.142 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.142 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.142 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:38.142 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406697+0000", 2024-09-12T22:32:38.143 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013925100000000001 2024-09-12T22:32:38.143 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.143 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.143 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:38.143 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406830+0000", 2024-09-12T22:32:38.143 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013293499999999999 2024-09-12T22:32:38.143 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.143 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.143 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:38.143 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410465+0000", 2024-09-12T22:32:38.143 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0036352680000000001 2024-09-12T22:32:38.143 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.143 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.144 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:38.144 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418564+0000", 2024-09-12T22:32:38.144 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0080992140000000004 2024-09-12T22:32:38.144 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.144 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.144 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:38.144 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418621+0000", 2024-09-12T22:32:38.144 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7167999999999999e-05 2024-09-12T22:32:38.144 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.144 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.144 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:38.144 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418661+0000", 2024-09-12T22:32:38.144 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9555000000000003e-05 2024-09-12T22:32:38.145 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:38.145 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:38.145 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:38.145 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.145 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.145 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:38.145 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.401994+0000", 2024-09-12T22:32:38.145 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 60.678098141, 2024-09-12T22:32:38.145 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016804109000000001, 2024-09-12T22:32:38.145 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:38.145 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:38.145 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:38.145 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:38.146 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.146 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:38.146 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401994+0000", 2024-09-12T22:32:38.146 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:38.146 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.146 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.146 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:38.146 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401994+0000", 2024-09-12T22:32:38.146 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:38.146 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.146 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.146 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:38.146 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401995+0000", 2024-09-12T22:32:38.147 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.8899999999999998e-07 2024-09-12T22:32:38.147 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.147 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.147 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:38.147 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402000+0000", 2024-09-12T22:32:38.147 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.498e-06 2024-09-12T22:32:38.147 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.147 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.147 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:38.147 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402007+0000", 2024-09-12T22:32:38.147 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.554e-06 2024-09-12T22:32:38.147 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.148 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.148 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:38.148 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402046+0000", 2024-09-12T22:32:38.148 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9156000000000003e-05 2024-09-12T22:32:38.148 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.148 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.148 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:38.148 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407342+0000", 2024-09-12T22:32:38.148 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052957610000000004 2024-09-12T22:32:38.148 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.148 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.148 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:38.149 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407521+0000", 2024-09-12T22:32:38.149 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00017878100000000001 2024-09-12T22:32:38.149 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.149 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.149 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:38.149 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407641+0000", 2024-09-12T22:32:38.149 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012013 2024-09-12T22:32:38.149 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.149 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.149 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:38.150 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410472+0000", 2024-09-12T22:32:38.150 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.002830455 2024-09-12T22:32:38.150 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.150 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.150 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:38.150 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418714+0000", 2024-09-12T22:32:38.150 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0082422789999999999 2024-09-12T22:32:38.150 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.150 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.150 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:38.150 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418761+0000", 2024-09-12T22:32:38.150 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6956999999999998e-05 2024-09-12T22:32:38.151 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.151 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.151 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:38.151 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418799+0000", 2024-09-12T22:32:38.151 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7749000000000001e-05 2024-09-12T22:32:38.151 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:38.151 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:38.151 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:38.151 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.151 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.151 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:38.152 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.402060+0000", 2024-09-12T22:32:38.152 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 60.678032696999999, 2024-09-12T22:32:38.152 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016885686, 2024-09-12T22:32:38.152 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:38.152 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:38.152 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:38.152 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:38.152 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.152 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:38.152 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402060+0000", 2024-09-12T22:32:38.153 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:38.153 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.153 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.153 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:38.153 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402060+0000", 2024-09-12T22:32:38.153 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:38.153 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.153 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.153 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:38.153 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402061+0000", 2024-09-12T22:32:38.153 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4399999999999999e-07 2024-09-12T22:32:38.153 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.154 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.154 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:38.154 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402066+0000", 2024-09-12T22:32:38.154 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8649999999999998e-06 2024-09-12T22:32:38.154 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.154 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.154 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:38.154 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402146+0000", 2024-09-12T22:32:38.154 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9054000000000006e-05 2024-09-12T22:32:38.154 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.155 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.155 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:38.155 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402287+0000", 2024-09-12T22:32:38.155 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014108600000000001 2024-09-12T22:32:38.155 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.155 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.155 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:38.155 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408185+0000", 2024-09-12T22:32:38.155 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0058983919999999997 2024-09-12T22:32:38.155 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.155 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.156 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:38.156 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408299+0000", 2024-09-12T22:32:38.156 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114102 2024-09-12T22:32:38.156 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.156 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.156 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:38.156 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408420+0000", 2024-09-12T22:32:38.156 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000120492 2024-09-12T22:32:38.156 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.156 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.156 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:38.157 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410867+0000", 2024-09-12T22:32:38.157 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0024476430000000002 2024-09-12T22:32:38.157 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.157 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.157 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:38.157 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418851+0000", 2024-09-12T22:32:38.157 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0079841489999999994 2024-09-12T22:32:38.157 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.157 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.157 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:38.158 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418894+0000", 2024-09-12T22:32:38.158 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3090000000000002e-05 2024-09-12T22:32:38.158 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.158 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.158 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:38.158 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418946+0000", 2024-09-12T22:32:38.158 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1069000000000002e-05 2024-09-12T22:32:38.158 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:38.158 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:38.158 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:38.158 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.158 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.159 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:38.159 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.402375+0000", 2024-09-12T22:32:38.159 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 60.677717631999997, 2024-09-12T22:32:38.159 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016768531999999999, 2024-09-12T22:32:38.159 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:38.159 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:38.159 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:38.159 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:38.159 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.159 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:38.159 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402375+0000", 2024-09-12T22:32:38.160 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:38.160 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.160 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.160 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:38.160 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402375+0000", 2024-09-12T22:32:38.160 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:38.160 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.160 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.160 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:38.160 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402375+0000", 2024-09-12T22:32:38.161 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4099999999999999e-07 2024-09-12T22:32:38.161 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.161 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.161 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:38.161 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402379+0000", 2024-09-12T22:32:38.161 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9870000000000001e-06 2024-09-12T22:32:38.161 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.161 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.161 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:38.161 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402389+0000", 2024-09-12T22:32:38.161 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0000000000000001e-05 2024-09-12T22:32:38.161 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.162 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.162 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:38.162 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402401+0000", 2024-09-12T22:32:38.162 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.148e-05 2024-09-12T22:32:38.162 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.162 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.162 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:38.162 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409108+0000", 2024-09-12T22:32:38.162 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0067068429999999997 2024-09-12T22:32:38.162 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.163 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.163 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:38.163 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409189+0000", 2024-09-12T22:32:38.163 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0815999999999993e-05 2024-09-12T22:32:38.163 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.163 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.163 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:38.163 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409320+0000", 2024-09-12T22:32:38.163 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000131586 2024-09-12T22:32:38.163 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.163 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.164 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:38.164 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410872+0000", 2024-09-12T22:32:38.164 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0015521599999999999 2024-09-12T22:32:38.164 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.164 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.164 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:38.164 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419049+0000", 2024-09-12T22:32:38.164 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0081763719999999995 2024-09-12T22:32:38.164 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.164 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.164 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:38.164 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419107+0000", 2024-09-12T22:32:38.164 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7899000000000002e-05 2024-09-12T22:32:38.165 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.165 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.165 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:38.165 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419143+0000", 2024-09-12T22:32:38.165 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6847999999999997e-05 2024-09-12T22:32:38.165 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:38.165 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:38.165 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:38.165 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.165 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.165 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:38.165 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.402903+0000", 2024-09-12T22:32:38.165 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 60.677189220000002, 2024-09-12T22:32:38.166 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016378428, 2024-09-12T22:32:38.166 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:38.166 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:38.166 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:38.166 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:38.166 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.166 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:38.166 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402903+0000", 2024-09-12T22:32:38.166 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:38.166 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.166 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.166 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:38.166 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402903+0000", 2024-09-12T22:32:38.167 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:38.167 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.167 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.167 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:38.167 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402904+0000", 2024-09-12T22:32:38.167 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9500000000000001e-07 2024-09-12T22:32:38.167 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.167 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.167 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:38.167 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402944+0000", 2024-09-12T22:32:38.167 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0265000000000002e-05 2024-09-12T22:32:38.167 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.168 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.168 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:38.168 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402979+0000", 2024-09-12T22:32:38.168 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4378000000000002e-05 2024-09-12T22:32:38.168 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.168 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.168 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:38.168 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402987+0000", 2024-09-12T22:32:38.169 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3559999999999993e-06 2024-09-12T22:32:38.169 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.169 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.169 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:38.169 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409577+0000", 2024-09-12T22:32:38.169 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0065901709999999997 2024-09-12T22:32:38.169 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.169 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.169 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:38.169 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409653+0000", 2024-09-12T22:32:38.169 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5819e-05 2024-09-12T22:32:38.169 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.169 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.169 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:38.170 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409725+0000", 2024-09-12T22:32:38.170 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2200000000000007e-05 2024-09-12T22:32:38.170 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.170 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.170 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:38.170 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.411234+0000", 2024-09-12T22:32:38.170 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001508225 2024-09-12T22:32:38.170 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.170 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.170 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:38.170 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419212+0000", 2024-09-12T22:32:38.170 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0079783400000000004 2024-09-12T22:32:38.170 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.171 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.171 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:38.171 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419244+0000", 2024-09-12T22:32:38.171 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2384e-05 2024-09-12T22:32:38.171 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.171 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.171 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:38.171 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419282+0000", 2024-09-12T22:32:38.171 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7394999999999997e-05 2024-09-12T22:32:38.171 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:38.171 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:38.171 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:38.171 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.171 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.172 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:38.172 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.403135+0000", 2024-09-12T22:32:38.172 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 60.676957350000002, 2024-09-12T22:32:38.172 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016294211999999999, 2024-09-12T22:32:38.172 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:38.172 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:38.172 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:38.172 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:38.172 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.172 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:38.172 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403135+0000", 2024-09-12T22:32:38.172 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:38.172 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.172 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.173 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:38.173 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403135+0000", 2024-09-12T22:32:38.173 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:38.173 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.173 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.173 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:38.173 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403136+0000", 2024-09-12T22:32:38.173 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.4e-07 2024-09-12T22:32:38.173 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.173 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.173 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:38.173 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403149+0000", 2024-09-12T22:32:38.173 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2723e-05 2024-09-12T22:32:38.174 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.174 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.174 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:38.174 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403158+0000", 2024-09-12T22:32:38.174 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3919999999999992e-06 2024-09-12T22:32:38.174 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.174 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.174 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:38.174 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403166+0000", 2024-09-12T22:32:38.174 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.2309999999999996e-06 2024-09-12T22:32:38.174 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.174 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.174 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:38.174 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409944+0000", 2024-09-12T22:32:38.175 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0067775309999999998 2024-09-12T22:32:38.175 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.175 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.175 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:38.175 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410032+0000", 2024-09-12T22:32:38.175 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.7906999999999997e-05 2024-09-12T22:32:38.175 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.175 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.175 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:38.175 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410152+0000", 2024-09-12T22:32:38.175 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012037800000000001 2024-09-12T22:32:38.175 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.175 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.176 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:38.176 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.411945+0000", 2024-09-12T22:32:38.176 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0017931850000000001 2024-09-12T22:32:38.176 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.176 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.176 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:38.176 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419319+0000", 2024-09-12T22:32:38.176 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0073731780000000002 2024-09-12T22:32:38.176 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.176 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.176 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:38.176 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419376+0000", 2024-09-12T22:32:38.176 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7728e-05 2024-09-12T22:32:38.177 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.177 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.177 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:38.177 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419429+0000", 2024-09-12T22:32:38.177 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3019000000000002e-05 2024-09-12T22:32:38.177 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:38.177 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:38.177 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:38.177 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.177 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.177 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:38.177 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.403185+0000", 2024-09-12T22:32:38.177 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 60.676907469, 2024-09-12T22:32:38.178 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.014902164000000001, 2024-09-12T22:32:38.178 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:38.178 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:38.178 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:38.178 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:38.178 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.178 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:38.178 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403185+0000", 2024-09-12T22:32:38.178 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:38.178 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.178 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.178 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:38.178 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403185+0000", 2024-09-12T22:32:38.179 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:38.179 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.179 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.179 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:38.179 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403186+0000", 2024-09-12T22:32:38.179 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9400000000000005e-07 2024-09-12T22:32:38.179 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.179 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.179 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:38.179 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403191+0000", 2024-09-12T22:32:38.179 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6980000000000003e-06 2024-09-12T22:32:38.179 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.179 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.180 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:38.180 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403199+0000", 2024-09-12T22:32:38.180 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2520000000000002e-06 2024-09-12T22:32:38.180 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.180 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.180 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:38.180 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403205+0000", 2024-09-12T22:32:38.180 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.908e-06 2024-09-12T22:32:38.180 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.180 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.180 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:38.180 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403359+0000", 2024-09-12T22:32:38.180 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000154544 2024-09-12T22:32:38.181 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.181 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.181 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:38.181 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403528+0000", 2024-09-12T22:32:38.181 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000168455 2024-09-12T22:32:38.181 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.181 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.181 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:38.181 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403763+0000", 2024-09-12T22:32:38.181 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00023539599999999999 2024-09-12T22:32:38.181 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.181 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.181 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:38.182 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409378+0000", 2024-09-12T22:32:38.182 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056150000000000002 2024-09-12T22:32:38.182 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.182 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.182 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:38.182 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418012+0000", 2024-09-12T22:32:38.182 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0086339559999999999 2024-09-12T22:32:38.182 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.182 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.182 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:38.182 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418046+0000", 2024-09-12T22:32:38.182 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4267999999999998e-05 2024-09-12T22:32:38.182 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.183 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.183 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:38.183 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418087+0000", 2024-09-12T22:32:38.183 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0992999999999999e-05 2024-09-12T22:32:38.183 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:38.183 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:38.183 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:38.183 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.183 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.183 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:38.183 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.403273+0000", 2024-09-12T22:32:38.183 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 60.676819518000002, 2024-09-12T22:32:38.183 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.014934866, 2024-09-12T22:32:38.184 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:38.184 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:38.184 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:38.184 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:38.184 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.184 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:38.184 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403273+0000", 2024-09-12T22:32:38.184 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:38.184 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.184 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.184 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:38.184 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403273+0000", 2024-09-12T22:32:38.184 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:38.184 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.185 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.185 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:38.185 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403274+0000", 2024-09-12T22:32:38.185 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.297e-06 2024-09-12T22:32:38.185 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.185 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.185 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:38.185 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403282+0000", 2024-09-12T22:32:38.185 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6340000000000001e-06 2024-09-12T22:32:38.185 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.185 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.185 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:38.185 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403305+0000", 2024-09-12T22:32:38.185 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3149000000000001e-05 2024-09-12T22:32:38.186 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.186 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.186 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:38.186 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403320+0000", 2024-09-12T22:32:38.186 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4527e-05 2024-09-12T22:32:38.186 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.186 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.186 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:38.186 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.404928+0000", 2024-09-12T22:32:38.186 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001608459 2024-09-12T22:32:38.186 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.186 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.186 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:38.186 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405218+0000", 2024-09-12T22:32:38.187 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00028982900000000002 2024-09-12T22:32:38.187 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.187 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.187 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:38.187 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405829+0000", 2024-09-12T22:32:38.187 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00061127900000000005 2024-09-12T22:32:38.187 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.187 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.187 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:38.187 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409403+0000", 2024-09-12T22:32:38.187 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.003573597 2024-09-12T22:32:38.187 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.187 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.187 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:38.188 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418138+0000", 2024-09-12T22:32:38.188 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0087349969999999996 2024-09-12T22:32:38.188 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.188 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.188 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:38.188 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418178+0000", 2024-09-12T22:32:38.188 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0649999999999999e-05 2024-09-12T22:32:38.188 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.188 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.188 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:38.188 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418208+0000", 2024-09-12T22:32:38.188 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9448e-05 2024-09-12T22:32:38.188 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:38.188 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:38.189 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:38.189 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.189 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.189 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:38.189 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.405456+0000", 2024-09-12T22:32:38.189 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 60.674636372999998, 2024-09-12T22:32:38.189 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012888389, 2024-09-12T22:32:38.189 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:38.189 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:38.189 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:38.189 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:38.189 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.189 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:38.190 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405456+0000", 2024-09-12T22:32:38.190 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:38.190 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.190 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.190 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:38.190 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405456+0000", 2024-09-12T22:32:38.190 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:38.190 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.190 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.190 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:38.190 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405457+0000", 2024-09-12T22:32:38.190 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.6599999999999994e-07 2024-09-12T22:32:38.190 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.190 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.191 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:38.191 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405463+0000", 2024-09-12T22:32:38.191 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4739999999999996e-06 2024-09-12T22:32:38.191 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.191 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.191 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:38.191 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405474+0000", 2024-09-12T22:32:38.191 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1095e-05 2024-09-12T22:32:38.191 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.191 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.191 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:38.191 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405482+0000", 2024-09-12T22:32:38.191 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3610000000000001e-06 2024-09-12T22:32:38.192 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.192 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.192 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:38.192 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407051+0000", 2024-09-12T22:32:38.192 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0015688970000000001 2024-09-12T22:32:38.192 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.192 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.192 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:38.192 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407259+0000", 2024-09-12T22:32:38.192 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00020778300000000001 2024-09-12T22:32:38.192 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.192 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.192 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:38.192 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407622+0000", 2024-09-12T22:32:38.193 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000363066 2024-09-12T22:32:38.193 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.193 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.193 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:38.193 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409438+0000", 2024-09-12T22:32:38.193 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001816319 2024-09-12T22:32:38.193 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.193 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.193 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:38.193 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418257+0000", 2024-09-12T22:32:38.193 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0088187720000000008 2024-09-12T22:32:38.193 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.193 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.194 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:38.194 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418308+0000", 2024-09-12T22:32:38.194 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1180000000000001e-05 2024-09-12T22:32:38.194 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.194 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.194 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:38.194 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418345+0000", 2024-09-12T22:32:38.194 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6476000000000001e-05 2024-09-12T22:32:38.194 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:38.194 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:38.194 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:38.194 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.194 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.194 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:38.195 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.405496+0000", 2024-09-12T22:32:38.195 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 60.674597016, 2024-09-12T22:32:38.195 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013016012, 2024-09-12T22:32:38.195 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:38.195 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:38.195 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:38.195 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:38.195 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.195 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:38.195 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405496+0000", 2024-09-12T22:32:38.195 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:38.195 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.195 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.195 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:38.196 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405496+0000", 2024-09-12T22:32:38.196 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:38.196 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.196 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.196 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:38.196 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405496+0000", 2024-09-12T22:32:38.196 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7999999999999995e-07 2024-09-12T22:32:38.196 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.196 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.196 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:38.196 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405501+0000", 2024-09-12T22:32:38.196 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8359999999999999e-06 2024-09-12T22:32:38.196 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.196 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.197 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:38.197 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405514+0000", 2024-09-12T22:32:38.197 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2522e-05 2024-09-12T22:32:38.197 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.197 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.197 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:38.197 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405521+0000", 2024-09-12T22:32:38.197 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5020000000000003e-06 2024-09-12T22:32:38.197 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.197 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.197 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:38.197 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405575+0000", 2024-09-12T22:32:38.197 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4169999999999998e-05 2024-09-12T22:32:38.198 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.198 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.198 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:38.198 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405697+0000", 2024-09-12T22:32:38.198 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000121301 2024-09-12T22:32:38.198 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.198 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.198 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:38.198 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405829+0000", 2024-09-12T22:32:38.198 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000132662 2024-09-12T22:32:38.198 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.198 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.198 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:38.198 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409155+0000", 2024-09-12T22:32:38.199 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0033259050000000001 2024-09-12T22:32:38.199 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.199 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.199 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:38.199 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418425+0000", 2024-09-12T22:32:38.199 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0092696319999999999 2024-09-12T22:32:38.199 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.199 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.199 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:38.199 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418471+0000", 2024-09-12T22:32:38.199 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6213e-05 2024-09-12T22:32:38.199 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.199 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.199 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:38.200 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418512+0000", 2024-09-12T22:32:38.200 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0589000000000001e-05 2024-09-12T22:32:38.200 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:38.200 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:38.200 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:38.200 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.200 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.200 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:38.200 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.406108+0000", 2024-09-12T22:32:38.200 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 60.673984619000002, 2024-09-12T22:32:38.200 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012458175, 2024-09-12T22:32:38.200 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:38.200 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:38.200 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:38.201 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:38.201 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.201 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:38.201 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406108+0000", 2024-09-12T22:32:38.201 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:38.201 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.201 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.201 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:38.201 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406108+0000", 2024-09-12T22:32:38.201 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:38.201 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.201 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.201 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:38.201 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406109+0000", 2024-09-12T22:32:38.202 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9899999999999999e-07 2024-09-12T22:32:38.202 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.202 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.202 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:38.202 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406115+0000", 2024-09-12T22:32:38.202 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9030000000000001e-06 2024-09-12T22:32:38.202 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.202 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.202 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:38.202 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406141+0000", 2024-09-12T22:32:38.202 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5999e-05 2024-09-12T22:32:38.202 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.202 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.202 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:38.203 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406150+0000", 2024-09-12T22:32:38.203 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.6050000000000004e-06 2024-09-12T22:32:38.203 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.203 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.203 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:38.203 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408163+0000", 2024-09-12T22:32:38.203 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0020122769999999998 2024-09-12T22:32:38.203 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.203 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.203 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:38.203 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408309+0000", 2024-09-12T22:32:38.203 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014606999999999999 2024-09-12T22:32:38.203 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.204 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.204 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:38.204 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408433+0000", 2024-09-12T22:32:38.204 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012460300000000001 2024-09-12T22:32:38.204 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.204 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.204 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:38.204 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409903+0000", 2024-09-12T22:32:38.204 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001469499 2024-09-12T22:32:38.204 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.204 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.204 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:38.204 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418427+0000", 2024-09-12T22:32:38.204 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0085241139999999993 2024-09-12T22:32:38.205 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.205 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.205 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:38.205 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418471+0000", 2024-09-12T22:32:38.205 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4474000000000001e-05 2024-09-12T22:32:38.205 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.205 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.205 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:38.205 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418566+0000", 2024-09-12T22:32:38.205 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.4732e-05 2024-09-12T22:32:38.205 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:38.205 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:38.205 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:38.205 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.206 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.206 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:38.206 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.407266+0000", 2024-09-12T22:32:38.206 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 60.672826763000003, 2024-09-12T22:32:38.206 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011442905, 2024-09-12T22:32:38.206 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:38.206 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:38.206 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2024-09-12T22:32:38.206 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:38.206 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.206 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:38.206 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407266+0000", 2024-09-12T22:32:38.206 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:38.206 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.207 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.207 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:38.207 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407266+0000", 2024-09-12T22:32:38.207 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:38.207 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.207 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.207 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:38.207 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407266+0000", 2024-09-12T22:32:38.207 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7899999999999998e-07 2024-09-12T22:32:38.207 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.207 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.207 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:38.207 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407269+0000", 2024-09-12T22:32:38.207 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9210000000000001e-06 2024-09-12T22:32:38.208 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.208 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.208 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:38.208 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407331+0000", 2024-09-12T22:32:38.208 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1376000000000003e-05 2024-09-12T22:32:38.208 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.208 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.208 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:38.208 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407337+0000", 2024-09-12T22:32:38.208 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1929999999999998e-06 2024-09-12T22:32:38.208 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.208 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.208 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:38.208 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408974+0000", 2024-09-12T22:32:38.209 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0016367109999999999 2024-09-12T22:32:38.209 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.209 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.209 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:38.209 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409112+0000", 2024-09-12T22:32:38.209 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000137952 2024-09-12T22:32:38.209 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:38.209 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:38.209 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:38.209 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418709+0000", 2024-09-12T22:32:38.209 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0095971730000000005 2024-09-12T22:32:38.209 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:38.209 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:38.210 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:38.210 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:38.210 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:38.210 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-09-12T22:32:38.211 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:32:38.212 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:38.210+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:38.312 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:38.311+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:38.318 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:32:38.318 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:32:38.318 INFO:teuthology.orchestra.run.smithi148.stdout: "num_ops": 0 2024-09-12T22:32:38.318 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:32:38.328 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:32:38.365 INFO:teuthology.orchestra.run.smithi019.stderr:noscrub is unset 2024-09-12T22:32:38.413 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:38.411+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:38.471 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:32:38.472 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:32:38.472 INFO:teuthology.orchestra.run.smithi148.stdout: "complaint_time": 30, 2024-09-12T22:32:38.472 INFO:teuthology.orchestra.run.smithi148.stdout: "num_blocked_ops": 0 2024-09-12T22:32:38.472 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:32:38.480 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:32:38.524 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:38.523+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:38.585 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:32:38.586 INFO:teuthology.orchestra.run.smithi148.stdout: "size": 20, 2024-09-12T22:32:38.586 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 600, 2024-09-12T22:32:38.586 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [ 2024-09-12T22:32:38.586 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.586 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:38.586 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.400880+0000", 2024-09-12T22:32:38.586 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 61.182387552000002, 2024-09-12T22:32:38.586 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0095133660000000005, 2024-09-12T22:32:38.586 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:38.586 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:38.586 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:38.586 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:38.587 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.587 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:38.587 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400880+0000", 2024-09-12T22:32:38.587 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:38.587 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.587 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.587 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:38.587 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400880+0000", 2024-09-12T22:32:38.587 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:38.587 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.587 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.587 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:38.587 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400892+0000", 2024-09-12T22:32:38.587 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1941e-05 2024-09-12T22:32:38.588 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.588 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.588 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:38.588 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400900+0000", 2024-09-12T22:32:38.588 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0080000000000002e-06 2024-09-12T22:32:38.588 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.588 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.588 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:38.588 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400911+0000", 2024-09-12T22:32:38.588 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1452e-05 2024-09-12T22:32:38.588 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.588 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.588 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:38.589 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400922+0000", 2024-09-12T22:32:38.589 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0772e-05 2024-09-12T22:32:38.589 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.589 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.589 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:38.589 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401009+0000", 2024-09-12T22:32:38.589 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.7206000000000005e-05 2024-09-12T22:32:38.589 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.589 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.589 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:38.589 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401157+0000", 2024-09-12T22:32:38.589 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014831499999999999 2024-09-12T22:32:38.589 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.590 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.590 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:38.590 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401312+0000", 2024-09-12T22:32:38.590 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00015495600000000001 2024-09-12T22:32:38.590 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.590 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.590 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:38.590 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.403060+0000", 2024-09-12T22:32:38.590 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0017475220000000001 2024-09-12T22:32:38.590 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.590 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.590 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:38.590 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410300+0000", 2024-09-12T22:32:38.590 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0072403260000000001 2024-09-12T22:32:38.591 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.591 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.591 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:38.591 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410350+0000", 2024-09-12T22:32:38.591 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9814000000000001e-05 2024-09-12T22:32:38.591 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.591 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.591 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:38.591 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410393+0000", 2024-09-12T22:32:38.591 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3053999999999998e-05 2024-09-12T22:32:38.591 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:38.591 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:38.591 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:38.591 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.592 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.592 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:38.592 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.400952+0000", 2024-09-12T22:32:38.592 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 61.1823154, 2024-09-12T22:32:38.592 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0096045620000000005, 2024-09-12T22:32:38.592 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:38.592 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:38.592 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:38.592 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:38.592 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.592 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:38.592 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400952+0000", 2024-09-12T22:32:38.592 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:38.593 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.593 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.593 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:38.593 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400952+0000", 2024-09-12T22:32:38.593 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:38.593 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.593 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.593 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:38.593 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400953+0000", 2024-09-12T22:32:38.593 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.8000000000000005e-07 2024-09-12T22:32:38.593 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.593 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.593 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:38.594 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400957+0000", 2024-09-12T22:32:38.594 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.33e-06 2024-09-12T22:32:38.594 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.594 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.594 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:38.594 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400966+0000", 2024-09-12T22:32:38.594 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1989999999999995e-06 2024-09-12T22:32:38.594 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.594 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.594 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:38.594 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400973+0000", 2024-09-12T22:32:38.594 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2779999999999999e-06 2024-09-12T22:32:38.594 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.595 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.595 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:38.595 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401696+0000", 2024-09-12T22:32:38.595 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00072363500000000003 2024-09-12T22:32:38.595 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.595 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.595 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:38.595 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401788+0000", 2024-09-12T22:32:38.595 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1862999999999998e-05 2024-09-12T22:32:38.595 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.595 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.595 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:38.595 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401929+0000", 2024-09-12T22:32:38.596 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014096000000000001 2024-09-12T22:32:38.596 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.596 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.596 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:38.596 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.403542+0000", 2024-09-12T22:32:38.596 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001612963 2024-09-12T22:32:38.596 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.596 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.596 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:38.596 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410460+0000", 2024-09-12T22:32:38.596 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0069180500000000002 2024-09-12T22:32:38.596 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.596 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.597 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:38.597 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410515+0000", 2024-09-12T22:32:38.597 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5009000000000001e-05 2024-09-12T22:32:38.597 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.597 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.597 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:38.597 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410557+0000", 2024-09-12T22:32:38.597 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1495000000000002e-05 2024-09-12T22:32:38.597 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:38.597 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:38.597 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:38.597 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.597 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.597 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:38.598 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.400984+0000", 2024-09-12T22:32:38.598 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 61.182282905000001, 2024-09-12T22:32:38.598 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0073703950000000001, 2024-09-12T22:32:38.598 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:38.598 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:38.598 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:38.598 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:38.598 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.598 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:38.598 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400984+0000", 2024-09-12T22:32:38.598 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:38.598 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.599 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.599 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:38.599 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400984+0000", 2024-09-12T22:32:38.599 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:38.599 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.599 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.599 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:38.599 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400985+0000", 2024-09-12T22:32:38.599 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3200000000000005e-07 2024-09-12T22:32:38.599 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.599 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.599 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:38.599 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400998+0000", 2024-09-12T22:32:38.599 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2726e-05 2024-09-12T22:32:38.600 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.600 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.600 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:38.600 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401006+0000", 2024-09-12T22:32:38.600 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.3110000000000006e-06 2024-09-12T22:32:38.600 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.600 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.600 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:38.600 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401022+0000", 2024-09-12T22:32:38.600 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6249e-05 2024-09-12T22:32:38.600 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.600 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.601 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:38.601 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401700+0000", 2024-09-12T22:32:38.601 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00067811100000000001 2024-09-12T22:32:38.601 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.601 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.601 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:38.601 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401839+0000", 2024-09-12T22:32:38.601 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013865399999999999 2024-09-12T22:32:38.601 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.601 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.601 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:38.601 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401962+0000", 2024-09-12T22:32:38.601 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000123266 2024-09-12T22:32:38.601 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.602 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.602 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:38.602 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.403589+0000", 2024-09-12T22:32:38.602 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001626932 2024-09-12T22:32:38.602 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.602 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.602 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:38.602 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.408274+0000", 2024-09-12T22:32:38.602 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0046848100000000002 2024-09-12T22:32:38.602 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.602 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.602 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:38.602 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.408324+0000", 2024-09-12T22:32:38.603 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9784000000000003e-05 2024-09-12T22:32:38.603 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.603 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.603 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:38.603 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.408355+0000", 2024-09-12T22:32:38.603 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.1019999999999998e-05 2024-09-12T22:32:38.603 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:38.603 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:38.603 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:38.603 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.603 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.603 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:38.603 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401034+0000", 2024-09-12T22:32:38.603 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 61.182233465000003, 2024-09-12T22:32:38.604 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011063051000000001, 2024-09-12T22:32:38.604 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:38.604 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:38.604 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:38.604 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:38.604 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.604 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:38.604 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401034+0000", 2024-09-12T22:32:38.604 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:38.604 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.604 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.604 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:38.604 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401034+0000", 2024-09-12T22:32:38.605 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:38.605 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.605 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.605 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:38.605 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401034+0000", 2024-09-12T22:32:38.605 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8899999999999999e-07 2024-09-12T22:32:38.605 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.605 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.605 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:38.605 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401038+0000", 2024-09-12T22:32:38.605 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.523e-06 2024-09-12T22:32:38.605 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.605 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.605 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:38.606 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401046+0000", 2024-09-12T22:32:38.606 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0479999999999999e-06 2024-09-12T22:32:38.606 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.606 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.606 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:38.606 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401051+0000", 2024-09-12T22:32:38.606 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2619999999999998e-06 2024-09-12T22:32:38.606 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.606 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.606 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:38.606 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402270+0000", 2024-09-12T22:32:38.606 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012182429999999999 2024-09-12T22:32:38.606 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.606 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.607 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:38.607 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402325+0000", 2024-09-12T22:32:38.607 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5526999999999999e-05 2024-09-12T22:32:38.607 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.607 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.607 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:38.607 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402403+0000", 2024-09-12T22:32:38.607 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.7559999999999996e-05 2024-09-12T22:32:38.607 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.607 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.607 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:38.607 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.403655+0000", 2024-09-12T22:32:38.607 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012521489999999999 2024-09-12T22:32:38.607 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.608 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.608 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:38.608 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411979+0000", 2024-09-12T22:32:38.608 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0083240420000000002 2024-09-12T22:32:38.608 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.608 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.608 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:38.608 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.412036+0000", 2024-09-12T22:32:38.608 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7639000000000002e-05 2024-09-12T22:32:38.608 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.608 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.608 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:38.608 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.412097+0000", 2024-09-12T22:32:38.609 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0469e-05 2024-09-12T22:32:38.609 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:38.609 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:38.609 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:38.609 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.609 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.609 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:38.609 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401060+0000", 2024-09-12T22:32:38.609 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 61.182207712999997, 2024-09-12T22:32:38.609 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.010030172, 2024-09-12T22:32:38.609 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:38.609 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:38.609 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:38.609 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:38.610 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.610 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:38.610 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401060+0000", 2024-09-12T22:32:38.610 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:38.610 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.610 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.610 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:38.610 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401060+0000", 2024-09-12T22:32:38.610 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:38.610 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.610 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.610 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:38.610 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401060+0000", 2024-09-12T22:32:38.610 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2500000000000001e-07 2024-09-12T22:32:38.611 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.611 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.611 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:38.611 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401063+0000", 2024-09-12T22:32:38.611 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0910000000000001e-06 2024-09-12T22:32:38.611 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.611 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.611 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:38.611 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401070+0000", 2024-09-12T22:32:38.611 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1210000000000001e-06 2024-09-12T22:32:38.611 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.611 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.611 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:38.611 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401076+0000", 2024-09-12T22:32:38.612 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2830000000000001e-06 2024-09-12T22:32:38.612 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.612 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.612 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:38.612 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402288+0000", 2024-09-12T22:32:38.612 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012123699999999999 2024-09-12T22:32:38.612 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.612 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.612 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:38.612 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402359+0000", 2024-09-12T22:32:38.612 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.0988000000000005e-05 2024-09-12T22:32:38.612 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.612 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.612 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:38.613 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402457+0000", 2024-09-12T22:32:38.613 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.7857999999999997e-05 2024-09-12T22:32:38.613 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.613 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.613 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:38.613 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.404395+0000", 2024-09-12T22:32:38.613 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0019380160000000001 2024-09-12T22:32:38.613 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.613 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.613 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:38.613 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410603+0000", 2024-09-12T22:32:38.613 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.006208061 2024-09-12T22:32:38.613 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.613 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.614 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:38.614 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410687+0000", 2024-09-12T22:32:38.614 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.4623000000000006e-05 2024-09-12T22:32:38.614 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.614 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.614 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:38.614 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411090+0000", 2024-09-12T22:32:38.614 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00040233599999999999 2024-09-12T22:32:38.614 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:38.614 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:38.614 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:38.614 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.614 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.615 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:38.615 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401083+0000", 2024-09-12T22:32:38.615 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 61.182184296999999, 2024-09-12T22:32:38.615 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0097591850000000001, 2024-09-12T22:32:38.615 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:38.615 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:38.615 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:38.615 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:38.615 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.615 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:38.615 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401083+0000", 2024-09-12T22:32:38.615 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:38.615 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.616 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.616 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:38.616 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401083+0000", 2024-09-12T22:32:38.616 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:38.616 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.616 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.616 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:38.616 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401084+0000", 2024-09-12T22:32:38.616 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4799999999999999e-07 2024-09-12T22:32:38.616 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.616 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.616 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:38.616 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401088+0000", 2024-09-12T22:32:38.617 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6419999999999998e-06 2024-09-12T22:32:38.617 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.617 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.617 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:38.617 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401094+0000", 2024-09-12T22:32:38.617 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0090000000000004e-06 2024-09-12T22:32:38.617 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.617 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.617 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:38.617 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401108+0000", 2024-09-12T22:32:38.617 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3884e-05 2024-09-12T22:32:38.617 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.617 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.617 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:38.618 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401165+0000", 2024-09-12T22:32:38.618 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.6499000000000002e-05 2024-09-12T22:32:38.618 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.618 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.618 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:38.618 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401261+0000", 2024-09-12T22:32:38.618 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.6872000000000004e-05 2024-09-12T22:32:38.618 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.618 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.618 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:38.618 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401376+0000", 2024-09-12T22:32:38.618 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000114508 2024-09-12T22:32:38.618 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.618 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.619 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:38.619 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402666+0000", 2024-09-12T22:32:38.619 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012901659999999999 2024-09-12T22:32:38.619 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.619 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.619 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:38.619 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410572+0000", 2024-09-12T22:32:38.619 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0079055489999999996 2024-09-12T22:32:38.619 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.619 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.619 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:38.619 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410661+0000", 2024-09-12T22:32:38.619 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.9578000000000002e-05 2024-09-12T22:32:38.619 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.620 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.620 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:38.620 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410842+0000", 2024-09-12T22:32:38.620 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00018102999999999999 2024-09-12T22:32:38.620 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:38.620 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:38.620 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:38.620 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.620 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.620 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:38.620 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401122+0000", 2024-09-12T22:32:38.620 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 61.182145265000003, 2024-09-12T22:32:38.620 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0099122080000000005, 2024-09-12T22:32:38.621 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:38.621 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:38.621 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:32:38.621 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:38.621 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.621 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:38.621 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401122+0000", 2024-09-12T22:32:38.621 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:38.621 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.621 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.621 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:38.621 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401122+0000", 2024-09-12T22:32:38.621 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:38.621 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.622 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.622 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:38.622 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401123+0000", 2024-09-12T22:32:38.622 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2600000000000002e-07 2024-09-12T22:32:38.622 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.622 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.622 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:38.622 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401126+0000", 2024-09-12T22:32:38.622 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.6449999999999998e-06 2024-09-12T22:32:38.622 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.622 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.622 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:38.622 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401133+0000", 2024-09-12T22:32:38.622 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.9890000000000003e-06 2024-09-12T22:32:38.623 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.623 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.623 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:38.623 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401138+0000", 2024-09-12T22:32:38.623 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8060000000000002e-06 2024-09-12T22:32:38.623 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.623 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.623 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:38.623 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401703+0000", 2024-09-12T22:32:38.623 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00056509099999999999 2024-09-12T22:32:38.623 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.623 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.623 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:38.623 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401837+0000", 2024-09-12T22:32:38.624 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013338799999999999 2024-09-12T22:32:38.624 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.624 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.624 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:38.624 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411034+0000", 2024-09-12T22:32:38.624 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.009197663 2024-09-12T22:32:38.624 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:38.624 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:38.624 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:38.624 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.624 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.624 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:38.624 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401158+0000", 2024-09-12T22:32:38.625 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 61.182109486000002, 2024-09-12T22:32:38.625 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.010292437999999999, 2024-09-12T22:32:38.625 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:38.625 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:38.625 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:32:38.625 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:38.625 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.625 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:38.625 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401158+0000", 2024-09-12T22:32:38.625 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:38.625 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.625 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.625 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:38.625 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401158+0000", 2024-09-12T22:32:38.626 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:38.626 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.626 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.626 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:38.626 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401158+0000", 2024-09-12T22:32:38.626 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9699999999999996e-07 2024-09-12T22:32:38.626 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.626 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.626 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:38.626 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401161+0000", 2024-09-12T22:32:38.626 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.7410000000000001e-06 2024-09-12T22:32:38.626 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.626 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.626 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:38.627 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401168+0000", 2024-09-12T22:32:38.627 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.844e-06 2024-09-12T22:32:38.627 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.627 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.627 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:38.627 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401174+0000", 2024-09-12T22:32:38.627 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4700000000000001e-06 2024-09-12T22:32:38.627 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.627 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.627 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:38.627 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402799+0000", 2024-09-12T22:32:38.627 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0016256409999999999 2024-09-12T22:32:38.627 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.627 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.628 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:38.628 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402893+0000", 2024-09-12T22:32:38.628 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.3807999999999994e-05 2024-09-12T22:32:38.628 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.628 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.628 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:38.628 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411450+0000", 2024-09-12T22:32:38.628 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0085573369999999999 2024-09-12T22:32:38.628 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:38.628 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:38.628 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:38.628 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.628 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.629 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:38.629 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401183+0000", 2024-09-12T22:32:38.629 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 61.182084633999999, 2024-09-12T22:32:38.629 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0068597830000000004, 2024-09-12T22:32:38.629 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:38.629 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:38.629 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:32:38.629 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:38.629 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.629 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:38.629 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401183+0000", 2024-09-12T22:32:38.629 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:38.629 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.630 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.630 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:38.630 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401183+0000", 2024-09-12T22:32:38.630 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:38.630 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.630 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.630 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:38.630 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401183+0000", 2024-09-12T22:32:38.630 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.6700000000000003e-07 2024-09-12T22:32:38.630 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.630 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.630 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:38.630 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401186+0000", 2024-09-12T22:32:38.630 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4679999999999999e-06 2024-09-12T22:32:38.631 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.631 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.631 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:38.631 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401192+0000", 2024-09-12T22:32:38.631 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.1519999999999997e-06 2024-09-12T22:32:38.631 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.631 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.631 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:38.631 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401197+0000", 2024-09-12T22:32:38.631 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4669999999999998e-06 2024-09-12T22:32:38.631 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.631 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.631 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:38.631 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401253+0000", 2024-09-12T22:32:38.632 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.6211000000000001e-05 2024-09-12T22:32:38.632 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.632 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.632 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:38.632 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401413+0000", 2024-09-12T22:32:38.632 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00016021399999999999 2024-09-12T22:32:38.632 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.632 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.632 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:38.632 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.408043+0000", 2024-09-12T22:32:38.632 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0066295039999999996 2024-09-12T22:32:38.632 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:38.632 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:38.633 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:38.633 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.633 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.633 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:20 3.1c e19/17 3:3ed09add:::607.00000000:head v 19'1, mlcod=0'0)", 2024-09-12T22:32:38.633 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.409642+0000", 2024-09-12T22:32:38.633 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 61.173625174999998, 2024-09-12T22:32:38.633 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0038816269999999999, 2024-09-12T22:32:38.633 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:38.633 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:38.633 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:38.633 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:38.633 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.633 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:38.634 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409642+0000", 2024-09-12T22:32:38.634 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:38.634 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.634 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.634 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:38.634 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409642+0000", 2024-09-12T22:32:38.634 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:38.634 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.634 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.634 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:38.635 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409642+0000", 2024-09-12T22:32:38.635 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.6899999999999999e-07 2024-09-12T22:32:38.635 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.635 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.635 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:38.635 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409648+0000", 2024-09-12T22:32:38.635 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.49e-06 2024-09-12T22:32:38.635 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.635 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.635 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:38.636 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409656+0000", 2024-09-12T22:32:38.636 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.2949999999999994e-06 2024-09-12T22:32:38.636 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.636 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.636 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:38.636 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409664+0000", 2024-09-12T22:32:38.636 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.1219999999999995e-06 2024-09-12T22:32:38.636 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.636 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.636 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:38.636 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409707+0000", 2024-09-12T22:32:38.637 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2222000000000003e-05 2024-09-12T22:32:38.637 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.637 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.637 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:38.637 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409724+0000", 2024-09-12T22:32:38.637 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7496999999999999e-05 2024-09-12T22:32:38.637 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.637 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.637 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:38.637 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413439+0000", 2024-09-12T22:32:38.637 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00371448 2024-09-12T22:32:38.637 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.637 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.638 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:38.638 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413524+0000", 2024-09-12T22:32:38.638 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.5252000000000003e-05 2024-09-12T22:32:38.638 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:38.638 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:38.638 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:38.638 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.638 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.638 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:28 3.13 e19/17 3:cd5a64a3:::100.00000000:head v 19'1, mlcod=0'0)", 2024-09-12T22:32:38.638 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.409681+0000", 2024-09-12T22:32:38.638 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 61.173586692000001, 2024-09-12T22:32:38.638 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0038708710000000001, 2024-09-12T22:32:38.638 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:38.638 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:38.639 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:38.639 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:38.639 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.639 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:38.639 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409681+0000", 2024-09-12T22:32:38.639 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:38.639 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.639 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.639 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:38.639 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409681+0000", 2024-09-12T22:32:38.639 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:38.639 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.639 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.640 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:38.640 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409681+0000", 2024-09-12T22:32:38.640 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3000000000000002e-07 2024-09-12T22:32:38.640 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.640 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.640 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:38.640 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409695+0000", 2024-09-12T22:32:38.640 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4313e-05 2024-09-12T22:32:38.640 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.640 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.640 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:38.640 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409703+0000", 2024-09-12T22:32:38.640 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4000000000000003e-06 2024-09-12T22:32:38.641 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.641 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.641 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:38.641 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409708+0000", 2024-09-12T22:32:38.641 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3190000000000002e-06 2024-09-12T22:32:38.641 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.641 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.641 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:38.641 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409875+0000", 2024-09-12T22:32:38.641 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000167329 2024-09-12T22:32:38.641 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.641 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.641 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:38.642 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409892+0000", 2024-09-12T22:32:38.642 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6957999999999999e-05 2024-09-12T22:32:38.642 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.642 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.642 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:38.642 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413457+0000", 2024-09-12T22:32:38.642 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0035651279999999999 2024-09-12T22:32:38.642 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.642 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.642 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:38.642 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413552+0000", 2024-09-12T22:32:38.642 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.4093999999999997e-05 2024-09-12T22:32:38.642 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:38.642 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:38.643 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:38.643 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.643 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.643 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:21 3.1c e19/17 3:3ed09add:::607.00000000:head v 19'2, mlcod=0'0)", 2024-09-12T22:32:38.643 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.409718+0000", 2024-09-12T22:32:38.643 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 61.173549027, 2024-09-12T22:32:38.643 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003851883, 2024-09-12T22:32:38.643 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:38.643 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:38.643 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:38.643 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:38.643 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.644 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:38.644 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409718+0000", 2024-09-12T22:32:38.644 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:38.644 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.644 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.644 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:38.644 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409718+0000", 2024-09-12T22:32:38.644 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:38.644 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.644 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.644 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:38.644 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409719+0000", 2024-09-12T22:32:38.645 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.16e-07 2024-09-12T22:32:38.645 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.645 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.645 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:38.645 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409722+0000", 2024-09-12T22:32:38.645 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.692e-06 2024-09-12T22:32:38.645 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.645 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.645 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:38.645 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409729+0000", 2024-09-12T22:32:38.645 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.516e-06 2024-09-12T22:32:38.645 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.645 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.646 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:38.646 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409750+0000", 2024-09-12T22:32:38.646 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1151000000000001e-05 2024-09-12T22:32:38.646 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.646 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.646 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:38.646 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410015+0000", 2024-09-12T22:32:38.646 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00026477599999999999 2024-09-12T22:32:38.646 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.646 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.646 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:38.646 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410104+0000", 2024-09-12T22:32:38.646 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.9586000000000006e-05 2024-09-12T22:32:38.647 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.647 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.647 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:38.647 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413528+0000", 2024-09-12T22:32:38.647 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0034237880000000001 2024-09-12T22:32:38.647 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.647 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.647 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:38.647 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413570+0000", 2024-09-12T22:32:38.647 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2157999999999999e-05 2024-09-12T22:32:38.647 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:38.647 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:38.647 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:38.648 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.648 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.648 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:27 3.13 e19/17 3:c91d4a1d:::mds0_inotable:head v 19'2, mlcod=0'0)", 2024-09-12T22:32:38.648 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.409760+0000", 2024-09-12T22:32:38.648 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 61.173507510999997, 2024-09-12T22:32:38.648 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0039301910000000004, 2024-09-12T22:32:38.648 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:38.648 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:38.648 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:38.648 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:38.648 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.648 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:38.648 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409760+0000", 2024-09-12T22:32:38.648 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:38.649 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.649 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.649 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:38.649 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409760+0000", 2024-09-12T22:32:38.649 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:38.649 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.649 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.649 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:38.649 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409760+0000", 2024-09-12T22:32:38.649 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.39e-07 2024-09-12T22:32:38.649 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.649 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.649 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:38.650 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409765+0000", 2024-09-12T22:32:38.650 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4449999999999998e-06 2024-09-12T22:32:38.650 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.650 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.650 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:38.650 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409771+0000", 2024-09-12T22:32:38.650 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7159999999999997e-06 2024-09-12T22:32:38.650 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.650 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.650 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:38.650 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409778+0000", 2024-09-12T22:32:38.650 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.331e-06 2024-09-12T22:32:38.650 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.650 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.651 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:38.651 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410191+0000", 2024-09-12T22:32:38.651 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00041348300000000003 2024-09-12T22:32:38.651 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.651 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.651 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:38.651 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410211+0000", 2024-09-12T22:32:38.651 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9933999999999999e-05 2024-09-12T22:32:38.651 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.651 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.651 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:38.651 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413638+0000", 2024-09-12T22:32:38.651 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003426854 2024-09-12T22:32:38.651 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.652 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.652 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:38.652 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413690+0000", 2024-09-12T22:32:38.652 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2089000000000002e-05 2024-09-12T22:32:38.652 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:38.652 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:38.652 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:38.652 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.652 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.652 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "pg_update_log_missing_reply(3.b epoch 19/17 rep_tid 4 lcod 19'2)", 2024-09-12T22:32:38.652 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.410060+0000", 2024-09-12T22:32:38.652 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 61.173207845999997, 2024-09-12T22:32:38.652 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00098016500000000007, 2024-09-12T22:32:38.653 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:38.653 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:38.653 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "reached pg", 2024-09-12T22:32:38.653 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:38.653 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.653 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:38.653 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410060+0000", 2024-09-12T22:32:38.653 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:38.653 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.653 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.653 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:38.653 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410060+0000", 2024-09-12T22:32:38.653 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:38.653 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.654 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.654 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:38.654 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410060+0000", 2024-09-12T22:32:38.654 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.8299999999999998e-07 2024-09-12T22:32:38.654 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.654 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.654 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:38.654 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410062+0000", 2024-09-12T22:32:38.654 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5749999999999999e-06 2024-09-12T22:32:38.654 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.654 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.654 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:38.654 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410070+0000", 2024-09-12T22:32:38.654 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.909e-06 2024-09-12T22:32:38.655 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.655 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.655 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:38.655 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410076+0000", 2024-09-12T22:32:38.655 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7049999999999996e-06 2024-09-12T22:32:38.655 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.655 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.655 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:38.655 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410943+0000", 2024-09-12T22:32:38.655 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00086681900000000001 2024-09-12T22:32:38.655 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.655 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.655 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:38.655 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411040+0000", 2024-09-12T22:32:38.656 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.6774000000000006e-05 2024-09-12T22:32:38.656 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:38.656 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:38.656 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:38.656 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.656 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.656 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e19/17 ondisk, result = 0)", 2024-09-12T22:32:38.656 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.410113+0000", 2024-09-12T22:32:38.656 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 61.173154578999998, 2024-09-12T22:32:38.656 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00098911599999999995, 2024-09-12T22:32:38.656 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:38.656 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:38.656 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:32:38.656 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:38.657 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.657 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:38.657 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410113+0000", 2024-09-12T22:32:38.657 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:38.657 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.657 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.657 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:38.657 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410113+0000", 2024-09-12T22:32:38.657 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:38.657 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.657 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.657 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:38.657 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410113+0000", 2024-09-12T22:32:38.657 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.99e-07 2024-09-12T22:32:38.658 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.658 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.658 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:38.658 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410115+0000", 2024-09-12T22:32:38.658 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.046e-06 2024-09-12T22:32:38.658 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.658 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.658 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:38.658 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410121+0000", 2024-09-12T22:32:38.658 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0050000000000001e-06 2024-09-12T22:32:38.658 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.658 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.658 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:38.659 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410126+0000", 2024-09-12T22:32:38.659 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8339999999999998e-06 2024-09-12T22:32:38.659 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.659 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.659 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:38.659 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410587+0000", 2024-09-12T22:32:38.659 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00046095499999999998 2024-09-12T22:32:38.659 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.659 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.659 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:38.659 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410595+0000", 2024-09-12T22:32:38.659 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.9419999999999995e-06 2024-09-12T22:32:38.659 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.659 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.660 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:38.660 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411102+0000", 2024-09-12T22:32:38.660 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00050713500000000003 2024-09-12T22:32:38.660 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:38.660 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:38.660 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:38.660 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.660 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.660 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 19/17 rep_tid 8 lcod 19'4)", 2024-09-12T22:32:38.660 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.410133+0000", 2024-09-12T22:32:38.660 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 61.173134650999998, 2024-09-12T22:32:38.660 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0013504000000000001, 2024-09-12T22:32:38.660 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:38.661 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:38.661 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "reached pg", 2024-09-12T22:32:38.661 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:38.661 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.661 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:38.661 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410133+0000", 2024-09-12T22:32:38.661 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:38.661 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.661 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.661 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:38.661 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410133+0000", 2024-09-12T22:32:38.661 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:38.661 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.662 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.662 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:38.662 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410133+0000", 2024-09-12T22:32:38.662 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.0599999999999999e-07 2024-09-12T22:32:38.662 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.662 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.662 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:38.662 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410135+0000", 2024-09-12T22:32:38.662 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7770000000000001e-06 2024-09-12T22:32:38.662 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.662 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.662 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:38.662 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410140+0000", 2024-09-12T22:32:38.662 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9960000000000001e-06 2024-09-12T22:32:38.663 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.663 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.663 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:38.663 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410144+0000", 2024-09-12T22:32:38.663 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9500000000000003e-06 2024-09-12T22:32:38.663 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.663 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.663 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:38.663 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411310+0000", 2024-09-12T22:32:38.663 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001166311 2024-09-12T22:32:38.663 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.663 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.663 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:38.663 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411483+0000", 2024-09-12T22:32:38.664 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00017316 2024-09-12T22:32:38.664 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:38.664 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:38.664 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:38.664 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.664 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.664 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "pg_update_log_missing(3.1a epoch 19/17 rep_tid 0 entries 19'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T22:32:38.664 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.410617+0000", 2024-09-12T22:32:38.664 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 61.172650255999997, 2024-09-12T22:32:38.664 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0030439709999999999, 2024-09-12T22:32:38.664 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:38.664 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:38.664 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "reached pg", 2024-09-12T22:32:38.665 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:38.665 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.665 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:38.665 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410617+0000", 2024-09-12T22:32:38.665 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:38.665 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.665 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.665 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:38.665 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410617+0000", 2024-09-12T22:32:38.665 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:38.665 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.665 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.665 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:38.665 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410617+0000", 2024-09-12T22:32:38.666 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3599999999999999e-07 2024-09-12T22:32:38.666 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.666 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.666 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:38.666 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410625+0000", 2024-09-12T22:32:38.666 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5410000000000003e-06 2024-09-12T22:32:38.666 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.666 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.666 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:38.666 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410638+0000", 2024-09-12T22:32:38.666 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3261999999999999e-05 2024-09-12T22:32:38.666 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.666 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.667 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:38.667 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410653+0000", 2024-09-12T22:32:38.667 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4844000000000001e-05 2024-09-12T22:32:38.667 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.667 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.667 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:38.667 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410814+0000", 2024-09-12T22:32:38.667 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00016119999999999999 2024-09-12T22:32:38.667 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.667 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.667 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:38.667 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413661+0000", 2024-09-12T22:32:38.667 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0028467879999999998 2024-09-12T22:32:38.667 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:38.668 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:38.668 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:38.668 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.668 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.668 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-09-12T22:32:38.668 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:39.398875+0000", 2024-09-12T22:32:38.668 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 59.184391976000001, 2024-09-12T22:32:38.668 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0015679069999999999, 2024-09-12T22:32:38.668 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:38.668 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:38.668 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:38.668 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:38.668 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.669 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:38.669 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398875+0000", 2024-09-12T22:32:38.669 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:38.669 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.669 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.669 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:38.669 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398875+0000", 2024-09-12T22:32:38.669 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:38.669 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.669 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.669 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:38.669 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398878+0000", 2024-09-12T22:32:38.669 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1679999999999998e-06 2024-09-12T22:32:38.670 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.670 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.670 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:38.670 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398888+0000", 2024-09-12T22:32:38.670 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.084e-05 2024-09-12T22:32:38.670 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.670 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.670 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:38.670 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398906+0000", 2024-09-12T22:32:38.670 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7518000000000001e-05 2024-09-12T22:32:38.670 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.670 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.670 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:38.670 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398914+0000", 2024-09-12T22:32:38.671 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5989999999999996e-06 2024-09-12T22:32:38.671 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.671 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.671 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:38.671 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398974+0000", 2024-09-12T22:32:38.671 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0988e-05 2024-09-12T22:32:38.671 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.671 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.671 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:38.671 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.399078+0000", 2024-09-12T22:32:38.671 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000103133 2024-09-12T22:32:38.671 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.671 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.671 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:38.672 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.399166+0000", 2024-09-12T22:32:38.672 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.8183999999999995e-05 2024-09-12T22:32:38.672 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.672 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.672 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:38.672 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.399747+0000", 2024-09-12T22:32:38.672 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00058110599999999996 2024-09-12T22:32:38.672 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.672 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.672 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:38.672 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.400377+0000", 2024-09-12T22:32:38.672 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000630157 2024-09-12T22:32:38.672 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.673 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.673 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:38.673 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.400415+0000", 2024-09-12T22:32:38.673 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7814000000000001e-05 2024-09-12T22:32:38.673 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.673 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.673 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:38.673 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.400443+0000", 2024-09-12T22:32:38.673 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8399999999999999e-05 2024-09-12T22:32:38.673 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:38.673 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:38.673 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:38.673 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.674 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.674 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e23)", 2024-09-12T22:32:38.674 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:58.400966+0000", 2024-09-12T22:32:38.674 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 40.182301068000001, 2024-09-12T22:32:38.674 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001468876, 2024-09-12T22:32:38.674 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:38.674 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:38.674 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:38.674 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:38.674 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.674 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:38.674 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400966+0000", 2024-09-12T22:32:38.674 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:38.675 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.675 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.675 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:38.675 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400966+0000", 2024-09-12T22:32:38.675 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:38.675 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.675 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.675 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:38.675 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400967+0000", 2024-09-12T22:32:38.675 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.046e-06 2024-09-12T22:32:38.675 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.675 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.675 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:38.675 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400974+0000", 2024-09-12T22:32:38.676 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2310000000000001e-06 2024-09-12T22:32:38.676 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.676 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.676 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:38.676 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400988+0000", 2024-09-12T22:32:38.676 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4482e-05 2024-09-12T22:32:38.676 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.676 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.676 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:38.676 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400997+0000", 2024-09-12T22:32:38.676 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.0189999999999995e-06 2024-09-12T22:32:38.676 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.676 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.677 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:38.677 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.401068+0000", 2024-09-12T22:32:38.677 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1426000000000004e-05 2024-09-12T22:32:38.677 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.677 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.677 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:38.677 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.401174+0000", 2024-09-12T22:32:38.677 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000105769 2024-09-12T22:32:38.677 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.677 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.677 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:38.677 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.401335+0000", 2024-09-12T22:32:38.677 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000161225 2024-09-12T22:32:38.677 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.678 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.678 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:38.678 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.402110+0000", 2024-09-12T22:32:38.678 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00077428800000000004 2024-09-12T22:32:38.678 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.678 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.678 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:38.678 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.402333+0000", 2024-09-12T22:32:38.678 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000223723 2024-09-12T22:32:38.678 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.678 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.678 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:38.678 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.402388+0000", 2024-09-12T22:32:38.678 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4700999999999997e-05 2024-09-12T22:32:38.679 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.679 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.679 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:38.679 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.402435+0000", 2024-09-12T22:32:38.679 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6965999999999997e-05 2024-09-12T22:32:38.679 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:38.679 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:38.679 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:38.679 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.679 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.679 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:45 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e27)", 2024-09-12T22:32:38.679 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:32:04.401614+0000", 2024-09-12T22:32:38.679 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 34.181653638999997, 2024-09-12T22:32:38.680 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0014279749999999999, 2024-09-12T22:32:38.680 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:38.680 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:38.680 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:38.680 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:38.680 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.680 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:38.680 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401614+0000", 2024-09-12T22:32:38.680 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:38.680 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.680 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.680 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:38.680 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401614+0000", 2024-09-12T22:32:38.680 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:38.681 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.681 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.681 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:38.681 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401615+0000", 2024-09-12T22:32:38.681 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.161e-06 2024-09-12T22:32:38.681 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.681 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.681 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:38.681 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401621+0000", 2024-09-12T22:32:38.681 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8730000000000004e-06 2024-09-12T22:32:38.681 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.681 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.681 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:38.681 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401633+0000", 2024-09-12T22:32:38.682 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1800000000000001e-05 2024-09-12T22:32:38.682 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.682 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.682 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:38.682 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401656+0000", 2024-09-12T22:32:38.682 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.3521999999999999e-05 2024-09-12T22:32:38.682 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.682 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.682 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:38.682 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401713+0000", 2024-09-12T22:32:38.682 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7259000000000002e-05 2024-09-12T22:32:38.682 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.682 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.682 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:38.683 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401849+0000", 2024-09-12T22:32:38.683 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013613500000000001 2024-09-12T22:32:38.683 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.683 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.683 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:38.683 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.402009+0000", 2024-09-12T22:32:38.683 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00015947199999999999 2024-09-12T22:32:38.683 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.683 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.683 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:38.683 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.402629+0000", 2024-09-12T22:32:38.683 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00061962200000000001 2024-09-12T22:32:38.683 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.683 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.684 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:38.684 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.402983+0000", 2024-09-12T22:32:38.684 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00035447499999999998 2024-09-12T22:32:38.684 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.684 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.684 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:38.684 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.403016+0000", 2024-09-12T22:32:38.684 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3108999999999998e-05 2024-09-12T22:32:38.684 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:38.684 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:38.684 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:38.684 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.403042+0000", 2024-09-12T22:32:38.684 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5547000000000001e-05 2024-09-12T22:32:38.685 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:38.685 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:38.685 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:38.685 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:38.685 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:38.685 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:32:38.686 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:32:38.687 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:38.685+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:38.787 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:38.786+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:38.793 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-09-12T22:32:38.793 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-09-12T22:32:38.793 INFO:teuthology.orchestra.run.smithi163.stdout: "num_ops": 0 2024-09-12T22:32:38.793 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-09-12T22:32:38.802 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:32:38.888 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:38.887+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:38.904 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-09-12T22:32:38.904 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-09-12T22:32:38.904 INFO:teuthology.orchestra.run.smithi163.stdout: "complaint_time": 30, 2024-09-12T22:32:38.904 INFO:teuthology.orchestra.run.smithi163.stdout: "num_blocked_ops": 0 2024-09-12T22:32:38.904 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-09-12T22:32:38.912 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:32:38.989 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:38.988+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:39.017 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-09-12T22:32:39.017 INFO:teuthology.orchestra.run.smithi163.stdout: "size": 20, 2024-09-12T22:32:39.017 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 600, 2024-09-12T22:32:39.017 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2024-09-12T22:32:39.017 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.018 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-09-12T22:32:39.018 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:27.254459+0000", 2024-09-12T22:32:39.018 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 71.760534845999999, 2024-09-12T22:32:39.018 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.37816283899999997, 2024-09-12T22:32:39.018 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:39.018 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:39.018 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:39.018 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:39.018 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:39.018 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:39.018 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 1 2024-09-12T22:32:39.018 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.018 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:39.019 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.019 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:39.019 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254459+0000", 2024-09-12T22:32:39.019 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:39.019 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.019 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.019 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:39.019 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254459+0000", 2024-09-12T22:32:39.019 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:39.019 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.019 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.019 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:39.020 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254460+0000", 2024-09-12T22:32:39.020 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1739999999999999e-06 2024-09-12T22:32:39.020 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.020 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.020 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:39.020 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254472+0000", 2024-09-12T22:32:39.020 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2207e-05 2024-09-12T22:32:39.020 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.020 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.020 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:39.020 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254483+0000", 2024-09-12T22:32:39.020 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0631999999999999e-05 2024-09-12T22:32:39.020 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.021 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.021 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:39.021 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254492+0000", 2024-09-12T22:32:39.021 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3670000000000003e-06 2024-09-12T22:32:39.021 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.021 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.021 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:39.021 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254551+0000", 2024-09-12T22:32:39.021 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8687999999999998e-05 2024-09-12T22:32:39.021 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.021 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.021 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for peered", 2024-09-12T22:32:39.021 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254562+0000", 2024-09-12T22:32:39.021 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1249e-05 2024-09-12T22:32:39.022 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.022 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.022 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:39.022 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.631211+0000", 2024-09-12T22:32:39.022 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.376649018 2024-09-12T22:32:39.022 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.022 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.022 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:39.022 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.631345+0000", 2024-09-12T22:32:39.022 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013378700000000001 2024-09-12T22:32:39.022 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.022 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.022 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:39.023 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.631479+0000", 2024-09-12T22:32:39.023 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013352399999999999 2024-09-12T22:32:39.023 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.023 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.023 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:39.023 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632324+0000", 2024-09-12T22:32:39.023 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00084508100000000002 2024-09-12T22:32:39.023 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.023 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.023 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:39.023 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632548+0000", 2024-09-12T22:32:39.023 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000224329 2024-09-12T22:32:39.023 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.024 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.024 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:39.024 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632591+0000", 2024-09-12T22:32:39.024 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2564000000000001e-05 2024-09-12T22:32:39.024 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.024 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.024 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:39.024 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632622+0000", 2024-09-12T22:32:39.024 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1219e-05 2024-09-12T22:32:39.024 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:39.024 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:39.024 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:39.024 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.024 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.025 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:185 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:32:39.025 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394355+0000", 2024-09-12T22:32:39.025 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 70.620638748999994, 2024-09-12T22:32:39.025 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011302394, 2024-09-12T22:32:39.025 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:39.025 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:39.025 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:39.025 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:39.025 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:39.025 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:39.025 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 185 2024-09-12T22:32:39.025 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.025 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:39.026 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.026 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:39.026 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394355+0000", 2024-09-12T22:32:39.026 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:39.026 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.026 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.026 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:39.026 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394355+0000", 2024-09-12T22:32:39.026 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:39.026 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.026 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.026 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:39.026 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394355+0000", 2024-09-12T22:32:39.026 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9099999999999999e-07 2024-09-12T22:32:39.027 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.027 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.027 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:39.027 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394385+0000", 2024-09-12T22:32:39.027 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9963000000000001e-05 2024-09-12T22:32:39.027 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.027 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.027 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:39.027 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394390+0000", 2024-09-12T22:32:39.027 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8420000000000004e-06 2024-09-12T22:32:39.027 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.027 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.027 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:39.027 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394393+0000", 2024-09-12T22:32:39.028 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1e-06 2024-09-12T22:32:39.028 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.028 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.028 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:39.028 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.400546+0000", 2024-09-12T22:32:39.028 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0061523309999999996 2024-09-12T22:32:39.028 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.028 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.028 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:39.028 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.400588+0000", 2024-09-12T22:32:39.028 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1835000000000002e-05 2024-09-12T22:32:39.028 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.028 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.029 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:39.029 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.400677+0000", 2024-09-12T22:32:39.029 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9195000000000002e-05 2024-09-12T22:32:39.029 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.029 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.029 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:39.029 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405378+0000", 2024-09-12T22:32:39.029 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0047008659999999997 2024-09-12T22:32:39.029 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.029 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.029 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:39.029 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405569+0000", 2024-09-12T22:32:39.029 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00019148599999999999 2024-09-12T22:32:39.029 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.030 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.030 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:39.030 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405620+0000", 2024-09-12T22:32:39.030 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1416999999999999e-05 2024-09-12T22:32:39.030 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.030 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.030 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:39.030 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405657+0000", 2024-09-12T22:32:39.030 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6968000000000002e-05 2024-09-12T22:32:39.030 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:39.030 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:39.030 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:39.030 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.031 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.031 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:32:39.031 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394399+0000", 2024-09-12T22:32:39.031 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 70.620594538000006, 2024-09-12T22:32:39.031 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011336601999999999, 2024-09-12T22:32:39.031 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:39.031 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:39.031 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:39.031 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:39.031 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:39.031 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:39.031 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 186 2024-09-12T22:32:39.031 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.032 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:39.032 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.032 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:39.032 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394399+0000", 2024-09-12T22:32:39.032 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:39.032 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.032 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.032 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:39.032 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394399+0000", 2024-09-12T22:32:39.032 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:39.032 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.032 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.032 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:39.032 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394400+0000", 2024-09-12T22:32:39.033 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4499999999999998e-07 2024-09-12T22:32:39.033 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.033 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.033 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:39.033 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394402+0000", 2024-09-12T22:32:39.033 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.875e-06 2024-09-12T22:32:39.033 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.033 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.033 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:39.033 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394405+0000", 2024-09-12T22:32:39.033 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6799999999999999e-06 2024-09-12T22:32:39.033 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.033 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.034 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:39.034 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394408+0000", 2024-09-12T22:32:39.034 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.667e-06 2024-09-12T22:32:39.034 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.034 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.034 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:39.034 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401395+0000", 2024-09-12T22:32:39.034 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0069867230000000002 2024-09-12T22:32:39.034 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.034 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.034 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:39.034 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401438+0000", 2024-09-12T22:32:39.034 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3554999999999999e-05 2024-09-12T22:32:39.034 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.035 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.035 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:39.035 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401509+0000", 2024-09-12T22:32:39.035 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0631999999999997e-05 2024-09-12T22:32:39.035 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.035 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.035 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:39.035 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405392+0000", 2024-09-12T22:32:39.035 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0038830449999999999 2024-09-12T22:32:39.036 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.036 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.036 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:39.036 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405690+0000", 2024-09-12T22:32:39.036 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000298435 2024-09-12T22:32:39.036 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.036 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.036 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:39.036 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405716+0000", 2024-09-12T22:32:39.036 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5435999999999998e-05 2024-09-12T22:32:39.036 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.036 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.036 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:39.037 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405736+0000", 2024-09-12T22:32:39.037 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0208999999999999e-05 2024-09-12T22:32:39.037 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:39.037 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:39.037 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:39.037 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.037 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.037 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:32:39.037 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394411+0000", 2024-09-12T22:32:39.037 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 70.620582412000005, 2024-09-12T22:32:39.038 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011400117, 2024-09-12T22:32:39.038 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:39.038 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:39.038 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:39.038 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:39.038 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:39.038 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:39.038 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 187 2024-09-12T22:32:39.038 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.038 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:39.038 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.039 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:39.039 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394411+0000", 2024-09-12T22:32:39.039 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:39.039 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.039 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.039 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:39.039 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394411+0000", 2024-09-12T22:32:39.039 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:39.039 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.039 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.039 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:39.039 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394412+0000", 2024-09-12T22:32:39.039 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.4999999999999999e-07 2024-09-12T22:32:39.039 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.040 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.040 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:39.040 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394414+0000", 2024-09-12T22:32:39.040 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.984e-06 2024-09-12T22:32:39.040 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.040 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.040 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:39.040 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394418+0000", 2024-09-12T22:32:39.040 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0840000000000002e-06 2024-09-12T22:32:39.040 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.040 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.040 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:39.040 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394431+0000", 2024-09-12T22:32:39.041 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.361e-05 2024-09-12T22:32:39.041 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.041 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.041 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:39.041 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401778+0000", 2024-09-12T22:32:39.041 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0073462659999999997 2024-09-12T22:32:39.041 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.041 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.041 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:39.041 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401853+0000", 2024-09-12T22:32:39.041 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5797000000000006e-05 2024-09-12T22:32:39.041 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.041 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.042 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:39.042 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401990+0000", 2024-09-12T22:32:39.042 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013651399999999999 2024-09-12T22:32:39.042 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.042 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.042 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:39.042 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405402+0000", 2024-09-12T22:32:39.042 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0034116070000000001 2024-09-12T22:32:39.042 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.042 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.042 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:39.042 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405764+0000", 2024-09-12T22:32:39.042 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00036234899999999998 2024-09-12T22:32:39.042 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.043 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.043 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:39.043 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405791+0000", 2024-09-12T22:32:39.043 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7029000000000002e-05 2024-09-12T22:32:39.043 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.043 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.043 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:39.043 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405812+0000", 2024-09-12T22:32:39.043 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0627000000000001e-05 2024-09-12T22:32:39.043 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:39.043 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:39.044 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:39.044 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.044 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.044 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:32:39.044 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394447+0000", 2024-09-12T22:32:39.044 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 70.620547260999999, 2024-09-12T22:32:39.044 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011759588, 2024-09-12T22:32:39.044 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:39.044 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:39.044 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:39.044 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:39.044 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:39.044 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:39.045 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 188 2024-09-12T22:32:39.045 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.045 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:39.045 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.045 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:39.045 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394447+0000", 2024-09-12T22:32:39.045 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:39.045 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.045 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.045 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:39.045 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394447+0000", 2024-09-12T22:32:39.045 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:39.045 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.046 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.046 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:39.046 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394447+0000", 2024-09-12T22:32:39.046 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.15e-07 2024-09-12T22:32:39.046 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.046 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.046 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:39.046 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394512+0000", 2024-09-12T22:32:39.046 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4580999999999997e-05 2024-09-12T22:32:39.046 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.046 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.046 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:39.046 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394518+0000", 2024-09-12T22:32:39.047 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.3380000000000001e-06 2024-09-12T22:32:39.047 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.047 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.047 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:39.047 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394521+0000", 2024-09-12T22:32:39.047 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3340000000000002e-06 2024-09-12T22:32:39.047 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.047 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.047 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:39.047 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.402628+0000", 2024-09-12T22:32:39.047 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.008106996 2024-09-12T22:32:39.047 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.047 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.047 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:39.048 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.402670+0000", 2024-09-12T22:32:39.048 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1983000000000001e-05 2024-09-12T22:32:39.048 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.048 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.048 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:39.048 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.402738+0000", 2024-09-12T22:32:39.048 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.8114999999999994e-05 2024-09-12T22:32:39.048 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.048 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.048 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:39.048 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405668+0000", 2024-09-12T22:32:39.048 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.002929545 2024-09-12T22:32:39.048 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.049 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.049 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:39.049 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406162+0000", 2024-09-12T22:32:39.049 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000494408 2024-09-12T22:32:39.049 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.049 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.049 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:39.049 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406188+0000", 2024-09-12T22:32:39.049 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5766e-05 2024-09-12T22:32:39.049 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.049 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.049 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:39.049 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406206+0000", 2024-09-12T22:32:39.049 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.8107000000000001e-05 2024-09-12T22:32:39.050 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:39.050 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:39.050 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:39.050 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.050 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.050 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:32:39.050 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394528+0000", 2024-09-12T22:32:39.050 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 70.620465592000002, 2024-09-12T22:32:39.050 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.01195536, 2024-09-12T22:32:39.050 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:39.050 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:39.050 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:39.050 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:39.050 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:39.051 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:39.051 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 189 2024-09-12T22:32:39.051 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.051 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:39.051 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.051 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:39.051 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394528+0000", 2024-09-12T22:32:39.051 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:39.051 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.051 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.051 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:39.051 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394528+0000", 2024-09-12T22:32:39.051 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:39.051 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.052 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.052 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:39.052 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394529+0000", 2024-09-12T22:32:39.052 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4900000000000001e-07 2024-09-12T22:32:39.052 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.052 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.052 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:39.052 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394531+0000", 2024-09-12T22:32:39.052 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.458e-06 2024-09-12T22:32:39.052 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.052 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.052 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:39.052 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394535+0000", 2024-09-12T22:32:39.053 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7900000000000001e-06 2024-09-12T22:32:39.053 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.053 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.053 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:39.053 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394537+0000", 2024-09-12T22:32:39.053 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.632e-06 2024-09-12T22:32:39.053 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.053 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.053 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:39.053 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.404932+0000", 2024-09-12T22:32:39.053 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010394158000000001 2024-09-12T22:32:39.053 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.053 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.053 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:39.054 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405017+0000", 2024-09-12T22:32:39.054 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5525000000000005e-05 2024-09-12T22:32:39.054 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.054 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.054 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:39.054 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405114+0000", 2024-09-12T22:32:39.054 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.6527000000000006e-05 2024-09-12T22:32:39.054 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.054 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.054 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:39.054 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405818+0000", 2024-09-12T22:32:39.054 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00070412800000000005 2024-09-12T22:32:39.054 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.054 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.055 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:39.055 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406437+0000", 2024-09-12T22:32:39.055 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00061898900000000002 2024-09-12T22:32:39.055 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.055 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.055 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:39.055 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406463+0000", 2024-09-12T22:32:39.055 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6268e-05 2024-09-12T22:32:39.055 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.055 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.055 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:39.055 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406484+0000", 2024-09-12T22:32:39.055 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0536000000000001e-05 2024-09-12T22:32:39.056 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:39.056 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:39.056 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:39.056 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.056 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.056 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:39.056 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.401422+0000", 2024-09-12T22:32:39.056 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 61.613571686999997, 2024-09-12T22:32:39.056 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016896452999999999, 2024-09-12T22:32:39.056 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:39.056 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:39.056 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:39.056 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:39.056 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.057 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:39.057 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401422+0000", 2024-09-12T22:32:39.057 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:39.057 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.057 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.057 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:39.057 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401422+0000", 2024-09-12T22:32:39.057 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:39.057 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.057 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.057 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:39.057 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401424+0000", 2024-09-12T22:32:39.057 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9e-06 2024-09-12T22:32:39.058 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.058 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.058 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:39.058 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401437+0000", 2024-09-12T22:32:39.058 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2831e-05 2024-09-12T22:32:39.058 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.058 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.058 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:39.058 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401471+0000", 2024-09-12T22:32:39.058 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4010000000000001e-05 2024-09-12T22:32:39.058 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.058 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.058 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:39.058 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401484+0000", 2024-09-12T22:32:39.059 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2711000000000001e-05 2024-09-12T22:32:39.059 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.059 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.059 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:39.059 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405410+0000", 2024-09-12T22:32:39.059 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0039259170000000001 2024-09-12T22:32:39.059 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.059 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.059 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:39.059 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405529+0000", 2024-09-12T22:32:39.059 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000119778 2024-09-12T22:32:39.059 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.059 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.059 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:39.060 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405655+0000", 2024-09-12T22:32:39.060 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012556700000000001 2024-09-12T22:32:39.060 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.060 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.060 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:39.060 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410456+0000", 2024-09-12T22:32:39.060 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0048008269999999997 2024-09-12T22:32:39.060 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.060 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.060 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:39.060 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418226+0000", 2024-09-12T22:32:39.060 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0077707729999999999 2024-09-12T22:32:39.061 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.061 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.061 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:39.061 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418277+0000", 2024-09-12T22:32:39.061 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0476000000000003e-05 2024-09-12T22:32:39.061 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.061 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.061 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:39.061 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418319+0000", 2024-09-12T22:32:39.061 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1662999999999997e-05 2024-09-12T22:32:39.061 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:39.061 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:39.061 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:39.061 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.062 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.062 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:39.062 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.401505+0000", 2024-09-12T22:32:39.062 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 61.613489023, 2024-09-12T22:32:39.062 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016987904000000002, 2024-09-12T22:32:39.062 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:39.062 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:39.062 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:39.062 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:39.062 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.062 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:39.062 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401505+0000", 2024-09-12T22:32:39.062 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:39.063 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.063 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.063 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:39.063 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401505+0000", 2024-09-12T22:32:39.063 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:39.063 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.063 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.063 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:39.063 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401506+0000", 2024-09-12T22:32:39.063 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4700000000000001e-07 2024-09-12T22:32:39.063 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.063 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.063 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:39.063 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401510+0000", 2024-09-12T22:32:39.064 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6609999999999999e-06 2024-09-12T22:32:39.064 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.064 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.064 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:39.064 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401771+0000", 2024-09-12T22:32:39.064 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00026110700000000001 2024-09-12T22:32:39.064 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.064 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.064 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:39.064 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401921+0000", 2024-09-12T22:32:39.064 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014939099999999999 2024-09-12T22:32:39.065 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.065 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.065 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:39.065 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405944+0000", 2024-09-12T22:32:39.065 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0040235449999999999 2024-09-12T22:32:39.065 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.065 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.065 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:39.065 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406018+0000", 2024-09-12T22:32:39.065 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3373000000000004e-05 2024-09-12T22:32:39.065 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.065 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.066 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:39.066 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406172+0000", 2024-09-12T22:32:39.066 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00015435399999999999 2024-09-12T22:32:39.066 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.066 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.066 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:39.066 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410461+0000", 2024-09-12T22:32:39.066 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0042888609999999997 2024-09-12T22:32:39.066 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.066 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.066 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:39.066 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418371+0000", 2024-09-12T22:32:39.066 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0079098380000000006 2024-09-12T22:32:39.067 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.067 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.067 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:39.067 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418443+0000", 2024-09-12T22:32:39.067 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2705000000000003e-05 2024-09-12T22:32:39.067 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.067 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.067 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:39.067 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418493+0000", 2024-09-12T22:32:39.067 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9322e-05 2024-09-12T22:32:39.068 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:39.068 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:39.068 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:39.068 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.068 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.068 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:39.068 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.401939+0000", 2024-09-12T22:32:39.068 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 61.613055287000002, 2024-09-12T22:32:39.068 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016722292999999999, 2024-09-12T22:32:39.068 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:39.068 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:39.068 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:39.068 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:39.069 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.069 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:39.069 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401939+0000", 2024-09-12T22:32:39.069 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:39.069 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.069 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.069 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:39.069 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401939+0000", 2024-09-12T22:32:39.069 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:39.070 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.070 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.070 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:39.070 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401940+0000", 2024-09-12T22:32:39.070 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1990000000000001e-06 2024-09-12T22:32:39.070 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.070 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.070 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:39.070 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401956+0000", 2024-09-12T22:32:39.070 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.6344000000000001e-05 2024-09-12T22:32:39.070 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.071 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.071 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:39.071 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401974+0000", 2024-09-12T22:32:39.071 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7730000000000001e-05 2024-09-12T22:32:39.071 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.071 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.071 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:39.071 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401982+0000", 2024-09-12T22:32:39.071 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.7800000000000001e-06 2024-09-12T22:32:39.071 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.071 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.072 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:39.072 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406557+0000", 2024-09-12T22:32:39.072 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0045758489999999999 2024-09-12T22:32:39.072 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.072 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.072 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:39.072 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406697+0000", 2024-09-12T22:32:39.072 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013925100000000001 2024-09-12T22:32:39.072 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.072 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.073 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:39.073 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406830+0000", 2024-09-12T22:32:39.073 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013293499999999999 2024-09-12T22:32:39.073 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.073 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.073 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:39.073 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410465+0000", 2024-09-12T22:32:39.073 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0036352680000000001 2024-09-12T22:32:39.073 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.073 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.073 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:39.073 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418564+0000", 2024-09-12T22:32:39.073 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0080992140000000004 2024-09-12T22:32:39.074 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.074 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.074 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:39.074 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418621+0000", 2024-09-12T22:32:39.074 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7167999999999999e-05 2024-09-12T22:32:39.074 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.074 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.074 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:39.074 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418661+0000", 2024-09-12T22:32:39.074 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9555000000000003e-05 2024-09-12T22:32:39.074 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:39.074 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:39.074 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:39.075 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.075 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.075 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:39.075 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.401994+0000", 2024-09-12T22:32:39.075 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 61.612999414999997, 2024-09-12T22:32:39.075 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016804109000000001, 2024-09-12T22:32:39.075 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:39.075 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:39.075 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:39.075 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:39.075 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.075 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:39.075 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401994+0000", 2024-09-12T22:32:39.075 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:39.076 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.076 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.076 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:39.076 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401994+0000", 2024-09-12T22:32:39.076 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:39.076 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.076 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.076 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:39.076 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401995+0000", 2024-09-12T22:32:39.076 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.8899999999999998e-07 2024-09-12T22:32:39.076 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.077 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.077 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:39.077 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402000+0000", 2024-09-12T22:32:39.077 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.498e-06 2024-09-12T22:32:39.077 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.077 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.077 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:39.077 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402007+0000", 2024-09-12T22:32:39.078 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.554e-06 2024-09-12T22:32:39.078 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.078 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.078 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:39.078 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402046+0000", 2024-09-12T22:32:39.078 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9156000000000003e-05 2024-09-12T22:32:39.078 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.078 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.078 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:39.078 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407342+0000", 2024-09-12T22:32:39.079 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052957610000000004 2024-09-12T22:32:39.079 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.079 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.079 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:39.079 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407521+0000", 2024-09-12T22:32:39.079 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00017878100000000001 2024-09-12T22:32:39.079 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.079 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.079 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:39.079 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407641+0000", 2024-09-12T22:32:39.080 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012013 2024-09-12T22:32:39.080 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.080 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.080 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:39.080 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410472+0000", 2024-09-12T22:32:39.080 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.002830455 2024-09-12T22:32:39.080 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.080 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.080 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:39.080 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418714+0000", 2024-09-12T22:32:39.080 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0082422789999999999 2024-09-12T22:32:39.080 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.080 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.081 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:39.081 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418761+0000", 2024-09-12T22:32:39.081 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6956999999999998e-05 2024-09-12T22:32:39.081 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.081 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.081 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:39.081 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418799+0000", 2024-09-12T22:32:39.081 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7749000000000001e-05 2024-09-12T22:32:39.081 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:39.081 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:39.081 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:39.081 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.081 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.081 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:39.082 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.402060+0000", 2024-09-12T22:32:39.082 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 61.612933970999997, 2024-09-12T22:32:39.082 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016885686, 2024-09-12T22:32:39.082 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:39.082 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:39.082 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:39.082 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:39.082 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.082 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:39.082 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402060+0000", 2024-09-12T22:32:39.082 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:39.082 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.082 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.083 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:39.083 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402060+0000", 2024-09-12T22:32:39.083 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:39.083 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.083 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.083 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:39.083 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402061+0000", 2024-09-12T22:32:39.083 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4399999999999999e-07 2024-09-12T22:32:39.083 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.083 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.083 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:39.083 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402066+0000", 2024-09-12T22:32:39.083 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8649999999999998e-06 2024-09-12T22:32:39.083 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.084 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.084 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:39.084 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402146+0000", 2024-09-12T22:32:39.084 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9054000000000006e-05 2024-09-12T22:32:39.084 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.084 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.084 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:39.084 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402287+0000", 2024-09-12T22:32:39.084 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014108600000000001 2024-09-12T22:32:39.084 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.084 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.084 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:39.084 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408185+0000", 2024-09-12T22:32:39.085 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0058983919999999997 2024-09-12T22:32:39.085 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.085 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.085 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:39.085 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408299+0000", 2024-09-12T22:32:39.085 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114102 2024-09-12T22:32:39.085 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.085 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.085 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:39.085 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408420+0000", 2024-09-12T22:32:39.085 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000120492 2024-09-12T22:32:39.085 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.085 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.086 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:39.086 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410867+0000", 2024-09-12T22:32:39.086 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0024476430000000002 2024-09-12T22:32:39.086 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.086 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.086 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:39.086 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418851+0000", 2024-09-12T22:32:39.086 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0079841489999999994 2024-09-12T22:32:39.086 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.086 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.086 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:39.086 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418894+0000", 2024-09-12T22:32:39.086 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3090000000000002e-05 2024-09-12T22:32:39.086 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.087 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.087 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:39.087 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418946+0000", 2024-09-12T22:32:39.087 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1069000000000002e-05 2024-09-12T22:32:39.087 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:39.087 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:39.087 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:39.087 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.087 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.087 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:39.087 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.402375+0000", 2024-09-12T22:32:39.087 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 61.612618906000002, 2024-09-12T22:32:39.087 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016768531999999999, 2024-09-12T22:32:39.087 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:39.088 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:39.088 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:39.088 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:39.088 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.088 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:39.088 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402375+0000", 2024-09-12T22:32:39.088 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:39.088 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.088 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.088 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:39.088 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402375+0000", 2024-09-12T22:32:39.088 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:39.088 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.089 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.089 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:39.089 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402375+0000", 2024-09-12T22:32:39.089 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4099999999999999e-07 2024-09-12T22:32:39.089 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.089 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.089 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:39.089 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402379+0000", 2024-09-12T22:32:39.089 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9870000000000001e-06 2024-09-12T22:32:39.089 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.089 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.089 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:39.089 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402389+0000", 2024-09-12T22:32:39.089 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0000000000000001e-05 2024-09-12T22:32:39.090 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.090 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.090 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:39.090 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402401+0000", 2024-09-12T22:32:39.090 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.148e-05 2024-09-12T22:32:39.090 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.090 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.090 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:39.090 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409108+0000", 2024-09-12T22:32:39.090 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0067068429999999997 2024-09-12T22:32:39.090 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.090 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.090 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:39.091 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409189+0000", 2024-09-12T22:32:39.091 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0815999999999993e-05 2024-09-12T22:32:39.091 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.091 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.091 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:39.091 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409320+0000", 2024-09-12T22:32:39.091 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000131586 2024-09-12T22:32:39.091 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.091 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.091 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:39.091 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410872+0000", 2024-09-12T22:32:39.091 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0015521599999999999 2024-09-12T22:32:39.091 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.091 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.092 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:39.092 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419049+0000", 2024-09-12T22:32:39.092 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0081763719999999995 2024-09-12T22:32:39.092 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.092 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.092 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:39.092 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419107+0000", 2024-09-12T22:32:39.092 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7899000000000002e-05 2024-09-12T22:32:39.092 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.092 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.092 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:39.092 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419143+0000", 2024-09-12T22:32:39.092 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6847999999999997e-05 2024-09-12T22:32:39.093 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:39.093 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:39.093 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:39.093 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.093 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.093 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:39.093 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.402903+0000", 2024-09-12T22:32:39.093 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 61.612090494, 2024-09-12T22:32:39.093 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016378428, 2024-09-12T22:32:39.093 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:39.093 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:39.093 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:39.093 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:39.093 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.094 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:39.094 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402903+0000", 2024-09-12T22:32:39.094 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:39.094 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.094 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.094 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:39.094 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402903+0000", 2024-09-12T22:32:39.094 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:39.094 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.094 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.094 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:39.094 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402904+0000", 2024-09-12T22:32:39.094 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9500000000000001e-07 2024-09-12T22:32:39.095 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.095 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.095 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:39.095 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402944+0000", 2024-09-12T22:32:39.095 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0265000000000002e-05 2024-09-12T22:32:39.095 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.095 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.095 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:39.095 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402979+0000", 2024-09-12T22:32:39.095 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4378000000000002e-05 2024-09-12T22:32:39.095 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.095 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.095 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:39.096 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402987+0000", 2024-09-12T22:32:39.096 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3559999999999993e-06 2024-09-12T22:32:39.096 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.096 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.096 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:39.096 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409577+0000", 2024-09-12T22:32:39.096 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0065901709999999997 2024-09-12T22:32:39.096 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.096 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.096 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:39.096 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409653+0000", 2024-09-12T22:32:39.096 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5819e-05 2024-09-12T22:32:39.097 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.097 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.097 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:39.097 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409725+0000", 2024-09-12T22:32:39.097 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2200000000000007e-05 2024-09-12T22:32:39.097 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.097 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.097 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:39.097 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.411234+0000", 2024-09-12T22:32:39.097 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001508225 2024-09-12T22:32:39.097 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.097 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.097 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:39.097 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419212+0000", 2024-09-12T22:32:39.098 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0079783400000000004 2024-09-12T22:32:39.098 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.098 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.098 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:39.098 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419244+0000", 2024-09-12T22:32:39.098 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2384e-05 2024-09-12T22:32:39.098 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.098 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.098 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:39.098 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419282+0000", 2024-09-12T22:32:39.098 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7394999999999997e-05 2024-09-12T22:32:39.098 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:39.098 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:39.098 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:39.099 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.099 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.099 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:39.099 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.403135+0000", 2024-09-12T22:32:39.099 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 61.611858624, 2024-09-12T22:32:39.099 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016294211999999999, 2024-09-12T22:32:39.099 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:39.099 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:39.099 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:39.099 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:39.099 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.099 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:39.099 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403135+0000", 2024-09-12T22:32:39.100 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:39.100 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.100 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.100 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:39.100 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403135+0000", 2024-09-12T22:32:39.100 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:39.100 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.100 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.100 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:39.101 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403136+0000", 2024-09-12T22:32:39.101 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.4e-07 2024-09-12T22:32:39.101 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.101 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.101 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:39.101 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403149+0000", 2024-09-12T22:32:39.101 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2723e-05 2024-09-12T22:32:39.101 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.101 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.101 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:39.101 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403158+0000", 2024-09-12T22:32:39.101 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3919999999999992e-06 2024-09-12T22:32:39.101 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.102 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.102 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:39.102 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403166+0000", 2024-09-12T22:32:39.102 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.2309999999999996e-06 2024-09-12T22:32:39.102 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.102 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.102 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:39.102 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409944+0000", 2024-09-12T22:32:39.102 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0067775309999999998 2024-09-12T22:32:39.102 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.102 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.103 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:39.103 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410032+0000", 2024-09-12T22:32:39.103 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.7906999999999997e-05 2024-09-12T22:32:39.103 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.103 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.103 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:39.103 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410152+0000", 2024-09-12T22:32:39.103 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012037800000000001 2024-09-12T22:32:39.103 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.103 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.103 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:39.103 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.411945+0000", 2024-09-12T22:32:39.104 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0017931850000000001 2024-09-12T22:32:39.104 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.104 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.104 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:39.104 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419319+0000", 2024-09-12T22:32:39.104 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0073731780000000002 2024-09-12T22:32:39.104 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.104 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.104 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:39.104 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419376+0000", 2024-09-12T22:32:39.105 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7728e-05 2024-09-12T22:32:39.105 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.105 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.105 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:39.105 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419429+0000", 2024-09-12T22:32:39.105 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3019000000000002e-05 2024-09-12T22:32:39.105 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:39.105 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:39.105 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:39.105 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.105 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.106 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:39.106 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.403185+0000", 2024-09-12T22:32:39.106 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 61.611808742999997, 2024-09-12T22:32:39.106 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.014902164000000001, 2024-09-12T22:32:39.106 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:39.106 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:39.106 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:39.106 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:39.106 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.106 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:39.107 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403185+0000", 2024-09-12T22:32:39.107 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:39.107 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.107 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.107 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:39.107 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403185+0000", 2024-09-12T22:32:39.107 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:39.107 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.107 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.107 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:39.107 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403186+0000", 2024-09-12T22:32:39.107 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9400000000000005e-07 2024-09-12T22:32:39.108 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.108 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.108 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:39.108 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403191+0000", 2024-09-12T22:32:39.108 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6980000000000003e-06 2024-09-12T22:32:39.108 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.108 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.108 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:39.108 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403199+0000", 2024-09-12T22:32:39.109 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2520000000000002e-06 2024-09-12T22:32:39.109 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.109 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.109 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:39.109 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403205+0000", 2024-09-12T22:32:39.109 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.908e-06 2024-09-12T22:32:39.109 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.109 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.109 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:39.109 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403359+0000", 2024-09-12T22:32:39.110 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000154544 2024-09-12T22:32:39.110 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.110 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.110 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:39.110 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403528+0000", 2024-09-12T22:32:39.110 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000168455 2024-09-12T22:32:39.110 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.110 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.110 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:39.110 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403763+0000", 2024-09-12T22:32:39.110 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00023539599999999999 2024-09-12T22:32:39.111 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.111 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.111 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:39.111 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409378+0000", 2024-09-12T22:32:39.111 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056150000000000002 2024-09-12T22:32:39.111 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.111 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.111 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:39.112 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418012+0000", 2024-09-12T22:32:39.112 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0086339559999999999 2024-09-12T22:32:39.112 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.112 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.112 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:39.112 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418046+0000", 2024-09-12T22:32:39.112 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4267999999999998e-05 2024-09-12T22:32:39.112 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.112 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.113 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:39.113 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418087+0000", 2024-09-12T22:32:39.113 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0992999999999999e-05 2024-09-12T22:32:39.113 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:39.113 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:39.113 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:39.113 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.113 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.113 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:39.113 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.403273+0000", 2024-09-12T22:32:39.113 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 61.611720792, 2024-09-12T22:32:39.113 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.014934866, 2024-09-12T22:32:39.113 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:39.114 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:39.114 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:39.114 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:39.114 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.114 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:39.114 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403273+0000", 2024-09-12T22:32:39.114 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:39.114 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.114 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.114 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:39.114 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403273+0000", 2024-09-12T22:32:39.114 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:39.114 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.114 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.115 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:39.115 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403274+0000", 2024-09-12T22:32:39.115 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.297e-06 2024-09-12T22:32:39.115 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.115 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.115 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:39.115 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403282+0000", 2024-09-12T22:32:39.115 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6340000000000001e-06 2024-09-12T22:32:39.115 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.115 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.115 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:39.115 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403305+0000", 2024-09-12T22:32:39.115 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3149000000000001e-05 2024-09-12T22:32:39.115 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.116 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.116 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:39.116 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403320+0000", 2024-09-12T22:32:39.116 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4527e-05 2024-09-12T22:32:39.116 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.116 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.116 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:39.116 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.404928+0000", 2024-09-12T22:32:39.116 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001608459 2024-09-12T22:32:39.116 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.116 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.116 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:39.117 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405218+0000", 2024-09-12T22:32:39.117 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00028982900000000002 2024-09-12T22:32:39.117 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.117 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.117 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:39.117 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405829+0000", 2024-09-12T22:32:39.117 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00061127900000000005 2024-09-12T22:32:39.117 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.117 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.117 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:39.117 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409403+0000", 2024-09-12T22:32:39.117 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.003573597 2024-09-12T22:32:39.117 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.117 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.118 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:39.118 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418138+0000", 2024-09-12T22:32:39.118 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0087349969999999996 2024-09-12T22:32:39.118 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.118 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.118 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:39.118 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418178+0000", 2024-09-12T22:32:39.118 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0649999999999999e-05 2024-09-12T22:32:39.118 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.118 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.118 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:39.118 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418208+0000", 2024-09-12T22:32:39.118 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9448e-05 2024-09-12T22:32:39.118 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:39.119 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:39.119 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:39.119 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.119 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.119 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:39.119 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.405456+0000", 2024-09-12T22:32:39.119 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 61.609537647000003, 2024-09-12T22:32:39.119 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012888389, 2024-09-12T22:32:39.119 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:39.119 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:39.119 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:39.119 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:39.119 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.119 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:39.120 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405456+0000", 2024-09-12T22:32:39.120 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:39.120 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.120 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.120 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:39.120 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405456+0000", 2024-09-12T22:32:39.120 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:39.120 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.120 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.120 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:39.120 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405457+0000", 2024-09-12T22:32:39.120 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.6599999999999994e-07 2024-09-12T22:32:39.120 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.121 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.121 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:39.121 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405463+0000", 2024-09-12T22:32:39.121 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4739999999999996e-06 2024-09-12T22:32:39.121 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.121 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.121 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:39.121 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405474+0000", 2024-09-12T22:32:39.121 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1095e-05 2024-09-12T22:32:39.121 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.121 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.121 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:39.121 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405482+0000", 2024-09-12T22:32:39.121 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3610000000000001e-06 2024-09-12T22:32:39.122 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.122 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.122 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:39.122 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407051+0000", 2024-09-12T22:32:39.122 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0015688970000000001 2024-09-12T22:32:39.122 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.122 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.122 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:39.122 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407259+0000", 2024-09-12T22:32:39.122 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00020778300000000001 2024-09-12T22:32:39.122 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.122 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.122 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:39.122 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407622+0000", 2024-09-12T22:32:39.123 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000363066 2024-09-12T22:32:39.123 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.123 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.123 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:39.123 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409438+0000", 2024-09-12T22:32:39.123 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001816319 2024-09-12T22:32:39.123 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.123 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.123 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:39.123 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418257+0000", 2024-09-12T22:32:39.123 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0088187720000000008 2024-09-12T22:32:39.123 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.123 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.124 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:39.124 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418308+0000", 2024-09-12T22:32:39.124 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1180000000000001e-05 2024-09-12T22:32:39.124 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.124 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.124 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:39.124 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418345+0000", 2024-09-12T22:32:39.124 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6476000000000001e-05 2024-09-12T22:32:39.124 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:39.124 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:39.124 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:39.124 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.124 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.124 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:39.125 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.405496+0000", 2024-09-12T22:32:39.125 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 61.609498289999998, 2024-09-12T22:32:39.125 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013016012, 2024-09-12T22:32:39.125 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:39.125 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:39.125 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:39.125 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:39.125 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.125 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:39.125 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405496+0000", 2024-09-12T22:32:39.125 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:39.125 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.125 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.126 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:39.126 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405496+0000", 2024-09-12T22:32:39.126 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:39.126 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.126 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.126 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:39.126 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405496+0000", 2024-09-12T22:32:39.126 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7999999999999995e-07 2024-09-12T22:32:39.126 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.126 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.126 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:39.126 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405501+0000", 2024-09-12T22:32:39.126 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8359999999999999e-06 2024-09-12T22:32:39.126 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.127 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.127 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:39.127 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405514+0000", 2024-09-12T22:32:39.127 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2522e-05 2024-09-12T22:32:39.127 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.127 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.127 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:39.127 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405521+0000", 2024-09-12T22:32:39.127 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5020000000000003e-06 2024-09-12T22:32:39.127 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.127 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.127 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:39.127 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405575+0000", 2024-09-12T22:32:39.127 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4169999999999998e-05 2024-09-12T22:32:39.128 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.128 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.128 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:39.128 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405697+0000", 2024-09-12T22:32:39.128 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000121301 2024-09-12T22:32:39.128 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.128 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.128 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:39.128 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405829+0000", 2024-09-12T22:32:39.128 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000132662 2024-09-12T22:32:39.128 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.128 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.128 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:39.128 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409155+0000", 2024-09-12T22:32:39.129 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0033259050000000001 2024-09-12T22:32:39.129 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.129 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.129 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:39.129 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418425+0000", 2024-09-12T22:32:39.129 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0092696319999999999 2024-09-12T22:32:39.129 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.129 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.129 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:39.129 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418471+0000", 2024-09-12T22:32:39.129 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6213e-05 2024-09-12T22:32:39.129 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.129 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.129 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:39.130 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418512+0000", 2024-09-12T22:32:39.130 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0589000000000001e-05 2024-09-12T22:32:39.130 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:39.130 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:39.130 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:39.130 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.130 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.130 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:39.130 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.406108+0000", 2024-09-12T22:32:39.130 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 61.608885893, 2024-09-12T22:32:39.130 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012458175, 2024-09-12T22:32:39.130 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:39.130 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:39.131 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:39.131 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:39.131 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.131 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:39.131 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406108+0000", 2024-09-12T22:32:39.131 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:39.131 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.131 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.131 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:39.131 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406108+0000", 2024-09-12T22:32:39.131 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:39.131 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.131 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.131 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:39.132 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406109+0000", 2024-09-12T22:32:39.132 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9899999999999999e-07 2024-09-12T22:32:39.132 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.132 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.132 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:39.132 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406115+0000", 2024-09-12T22:32:39.132 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9030000000000001e-06 2024-09-12T22:32:39.132 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.132 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.132 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:39.132 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406141+0000", 2024-09-12T22:32:39.132 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5999e-05 2024-09-12T22:32:39.132 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.132 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.133 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:39.133 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406150+0000", 2024-09-12T22:32:39.133 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.6050000000000004e-06 2024-09-12T22:32:39.133 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.133 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.133 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:39.133 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408163+0000", 2024-09-12T22:32:39.133 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0020122769999999998 2024-09-12T22:32:39.133 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.134 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.134 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:39.134 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408309+0000", 2024-09-12T22:32:39.134 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014606999999999999 2024-09-12T22:32:39.134 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.134 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.134 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:39.134 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408433+0000", 2024-09-12T22:32:39.134 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012460300000000001 2024-09-12T22:32:39.134 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.134 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.134 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:39.134 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409903+0000", 2024-09-12T22:32:39.134 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001469499 2024-09-12T22:32:39.135 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.135 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.135 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:39.135 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418427+0000", 2024-09-12T22:32:39.135 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0085241139999999993 2024-09-12T22:32:39.135 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.135 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.135 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:39.135 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418471+0000", 2024-09-12T22:32:39.135 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4474000000000001e-05 2024-09-12T22:32:39.135 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.135 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.135 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:39.136 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418566+0000", 2024-09-12T22:32:39.136 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.4732e-05 2024-09-12T22:32:39.136 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:39.136 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:39.136 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:39.136 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.136 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.136 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:39.136 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.407266+0000", 2024-09-12T22:32:39.137 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 61.607728037000001, 2024-09-12T22:32:39.137 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011442905, 2024-09-12T22:32:39.137 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:39.137 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:39.137 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2024-09-12T22:32:39.137 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:39.137 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.137 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:39.137 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407266+0000", 2024-09-12T22:32:39.137 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:39.137 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.137 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.137 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:39.138 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407266+0000", 2024-09-12T22:32:39.138 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:39.138 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.138 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.138 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:39.138 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407266+0000", 2024-09-12T22:32:39.138 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7899999999999998e-07 2024-09-12T22:32:39.138 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.138 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.138 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:39.138 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407269+0000", 2024-09-12T22:32:39.138 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9210000000000001e-06 2024-09-12T22:32:39.138 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.138 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.138 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:39.139 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407331+0000", 2024-09-12T22:32:39.139 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1376000000000003e-05 2024-09-12T22:32:39.139 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.139 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.139 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:39.139 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407337+0000", 2024-09-12T22:32:39.139 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1929999999999998e-06 2024-09-12T22:32:39.139 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.139 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.139 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:39.139 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408974+0000", 2024-09-12T22:32:39.139 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0016367109999999999 2024-09-12T22:32:39.139 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.139 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.140 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:39.140 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409112+0000", 2024-09-12T22:32:39.140 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000137952 2024-09-12T22:32:39.140 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:39.140 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:39.140 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:39.140 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418709+0000", 2024-09-12T22:32:39.140 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0095971730000000005 2024-09-12T22:32:39.140 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:39.140 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:39.140 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:39.140 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:39.140 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:39.141 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-09-12T22:32:39.142 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:32:39.143 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:39.141+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:39.242 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:39.241+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:39.258 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:32:39.258 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:32:39.258 INFO:teuthology.orchestra.run.smithi148.stdout: "num_ops": 0 2024-09-12T22:32:39.258 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:32:39.267 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:32:39.343 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:39.342+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:39.371 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:32:39.371 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:32:39.371 INFO:teuthology.orchestra.run.smithi148.stdout: "complaint_time": 30, 2024-09-12T22:32:39.371 INFO:teuthology.orchestra.run.smithi148.stdout: "num_blocked_ops": 0 2024-09-12T22:32:39.371 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:32:39.379 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:32:39.444 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:39.443+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:39.524 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:32:39.524 INFO:teuthology.orchestra.run.smithi148.stdout: "size": 20, 2024-09-12T22:32:39.524 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 600, 2024-09-12T22:32:39.524 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [ 2024-09-12T22:32:39.525 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.525 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:39.525 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.400880+0000", 2024-09-12T22:32:39.525 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 62.121442983999998, 2024-09-12T22:32:39.525 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0095133660000000005, 2024-09-12T22:32:39.525 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:39.525 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:39.525 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:39.525 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:39.525 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.525 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:39.525 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400880+0000", 2024-09-12T22:32:39.525 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:39.526 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.526 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.526 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:39.526 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400880+0000", 2024-09-12T22:32:39.526 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:39.526 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.526 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.526 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:39.526 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400892+0000", 2024-09-12T22:32:39.526 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1941e-05 2024-09-12T22:32:39.526 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.526 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.526 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:39.526 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400900+0000", 2024-09-12T22:32:39.527 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0080000000000002e-06 2024-09-12T22:32:39.527 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.527 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.527 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:39.527 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400911+0000", 2024-09-12T22:32:39.527 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1452e-05 2024-09-12T22:32:39.527 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.527 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.527 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:39.527 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400922+0000", 2024-09-12T22:32:39.527 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0772e-05 2024-09-12T22:32:39.527 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.527 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.527 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:39.528 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401009+0000", 2024-09-12T22:32:39.528 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.7206000000000005e-05 2024-09-12T22:32:39.528 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.528 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.528 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:39.528 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401157+0000", 2024-09-12T22:32:39.528 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014831499999999999 2024-09-12T22:32:39.528 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.528 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.528 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:39.528 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401312+0000", 2024-09-12T22:32:39.528 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00015495600000000001 2024-09-12T22:32:39.529 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.529 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.529 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:39.529 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.403060+0000", 2024-09-12T22:32:39.529 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0017475220000000001 2024-09-12T22:32:39.529 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.529 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.529 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:39.529 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410300+0000", 2024-09-12T22:32:39.529 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0072403260000000001 2024-09-12T22:32:39.529 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.529 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.530 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:39.530 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410350+0000", 2024-09-12T22:32:39.530 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9814000000000001e-05 2024-09-12T22:32:39.530 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.530 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.530 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:39.530 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410393+0000", 2024-09-12T22:32:39.530 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3053999999999998e-05 2024-09-12T22:32:39.530 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:39.530 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:39.530 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:39.530 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.531 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.531 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:39.531 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.400952+0000", 2024-09-12T22:32:39.531 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 62.121370831999997, 2024-09-12T22:32:39.531 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0096045620000000005, 2024-09-12T22:32:39.531 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:39.531 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:39.531 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:39.531 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:39.531 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.531 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:39.532 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400952+0000", 2024-09-12T22:32:39.532 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:39.532 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.532 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.532 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:39.532 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400952+0000", 2024-09-12T22:32:39.532 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:39.532 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.532 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.532 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:39.532 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400953+0000", 2024-09-12T22:32:39.532 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.8000000000000005e-07 2024-09-12T22:32:39.532 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.533 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.533 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:39.533 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400957+0000", 2024-09-12T22:32:39.533 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.33e-06 2024-09-12T22:32:39.533 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.533 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.533 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:39.533 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400966+0000", 2024-09-12T22:32:39.533 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1989999999999995e-06 2024-09-12T22:32:39.533 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.533 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.533 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:39.533 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400973+0000", 2024-09-12T22:32:39.534 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2779999999999999e-06 2024-09-12T22:32:39.534 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.534 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.534 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:39.534 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401696+0000", 2024-09-12T22:32:39.534 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00072363500000000003 2024-09-12T22:32:39.534 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.534 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.534 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:39.534 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401788+0000", 2024-09-12T22:32:39.534 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1862999999999998e-05 2024-09-12T22:32:39.534 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.534 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.534 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:39.535 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401929+0000", 2024-09-12T22:32:39.535 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014096000000000001 2024-09-12T22:32:39.535 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.535 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.535 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:39.535 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.403542+0000", 2024-09-12T22:32:39.535 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001612963 2024-09-12T22:32:39.535 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.535 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.535 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:39.535 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410460+0000", 2024-09-12T22:32:39.535 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0069180500000000002 2024-09-12T22:32:39.535 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.535 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.536 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:39.536 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410515+0000", 2024-09-12T22:32:39.536 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5009000000000001e-05 2024-09-12T22:32:39.536 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.536 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.536 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:39.536 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410557+0000", 2024-09-12T22:32:39.536 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1495000000000002e-05 2024-09-12T22:32:39.536 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:39.536 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:39.536 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:39.537 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.537 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.537 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:39.537 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.400984+0000", 2024-09-12T22:32:39.537 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 62.121338336999997, 2024-09-12T22:32:39.537 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0073703950000000001, 2024-09-12T22:32:39.538 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:39.538 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:39.538 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:39.538 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:39.538 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.538 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:39.538 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400984+0000", 2024-09-12T22:32:39.539 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:39.539 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.539 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.539 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:39.539 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400984+0000", 2024-09-12T22:32:39.539 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:39.539 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.539 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.539 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:39.539 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400985+0000", 2024-09-12T22:32:39.539 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3200000000000005e-07 2024-09-12T22:32:39.539 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.539 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.539 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:39.540 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400998+0000", 2024-09-12T22:32:39.540 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2726e-05 2024-09-12T22:32:39.540 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.540 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.540 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:39.540 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401006+0000", 2024-09-12T22:32:39.540 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.3110000000000006e-06 2024-09-12T22:32:39.540 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.540 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.540 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:39.540 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401022+0000", 2024-09-12T22:32:39.540 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6249e-05 2024-09-12T22:32:39.540 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.541 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.541 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:39.541 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401700+0000", 2024-09-12T22:32:39.541 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00067811100000000001 2024-09-12T22:32:39.541 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.541 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.541 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:39.541 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401839+0000", 2024-09-12T22:32:39.541 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013865399999999999 2024-09-12T22:32:39.541 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.541 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.541 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:39.541 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401962+0000", 2024-09-12T22:32:39.542 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000123266 2024-09-12T22:32:39.542 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.542 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.542 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:39.542 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.403589+0000", 2024-09-12T22:32:39.542 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001626932 2024-09-12T22:32:39.542 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.542 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.542 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:39.542 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.408274+0000", 2024-09-12T22:32:39.542 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0046848100000000002 2024-09-12T22:32:39.542 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.542 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.542 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:39.543 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.408324+0000", 2024-09-12T22:32:39.543 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9784000000000003e-05 2024-09-12T22:32:39.543 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.543 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.543 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:39.543 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.408355+0000", 2024-09-12T22:32:39.543 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.1019999999999998e-05 2024-09-12T22:32:39.543 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:39.543 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:39.543 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:39.543 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.544 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.544 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:39.544 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401034+0000", 2024-09-12T22:32:39.544 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 62.121288896999999, 2024-09-12T22:32:39.544 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011063051000000001, 2024-09-12T22:32:39.544 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:39.544 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:39.544 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:39.544 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:39.544 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.544 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:39.544 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401034+0000", 2024-09-12T22:32:39.544 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:39.544 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.545 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.545 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:39.545 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401034+0000", 2024-09-12T22:32:39.545 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:39.545 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.545 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.545 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:39.545 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401034+0000", 2024-09-12T22:32:39.545 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8899999999999999e-07 2024-09-12T22:32:39.545 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.546 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.546 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:39.546 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401038+0000", 2024-09-12T22:32:39.546 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.523e-06 2024-09-12T22:32:39.546 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.546 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.546 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:39.546 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401046+0000", 2024-09-12T22:32:39.546 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0479999999999999e-06 2024-09-12T22:32:39.546 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.546 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.546 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:39.546 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401051+0000", 2024-09-12T22:32:39.547 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2619999999999998e-06 2024-09-12T22:32:39.547 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.547 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.547 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:39.547 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402270+0000", 2024-09-12T22:32:39.547 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012182429999999999 2024-09-12T22:32:39.547 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.547 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.547 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:39.547 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402325+0000", 2024-09-12T22:32:39.548 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5526999999999999e-05 2024-09-12T22:32:39.548 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.548 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.548 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:39.548 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402403+0000", 2024-09-12T22:32:39.548 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.7559999999999996e-05 2024-09-12T22:32:39.548 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.548 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.549 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:39.549 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.403655+0000", 2024-09-12T22:32:39.549 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012521489999999999 2024-09-12T22:32:39.549 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.549 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.549 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:39.549 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411979+0000", 2024-09-12T22:32:39.549 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0083240420000000002 2024-09-12T22:32:39.549 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.549 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.549 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:39.550 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.412036+0000", 2024-09-12T22:32:39.550 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7639000000000002e-05 2024-09-12T22:32:39.550 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.550 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.550 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:39.550 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.412097+0000", 2024-09-12T22:32:39.550 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0469e-05 2024-09-12T22:32:39.550 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:39.550 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:39.550 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:39.551 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.551 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.551 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:39.551 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401060+0000", 2024-09-12T22:32:39.551 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 62.121263145, 2024-09-12T22:32:39.551 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.010030172, 2024-09-12T22:32:39.551 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:39.551 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:39.551 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:39.551 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:39.551 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.552 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:39.552 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401060+0000", 2024-09-12T22:32:39.552 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:39.552 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.552 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.552 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:39.552 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401060+0000", 2024-09-12T22:32:39.552 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:39.552 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.552 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.553 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:39.553 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401060+0000", 2024-09-12T22:32:39.553 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2500000000000001e-07 2024-09-12T22:32:39.553 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.553 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.553 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:39.553 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401063+0000", 2024-09-12T22:32:39.553 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0910000000000001e-06 2024-09-12T22:32:39.553 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.554 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.554 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:39.554 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401070+0000", 2024-09-12T22:32:39.554 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1210000000000001e-06 2024-09-12T22:32:39.554 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.554 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.554 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:39.554 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401076+0000", 2024-09-12T22:32:39.554 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2830000000000001e-06 2024-09-12T22:32:39.554 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.554 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.555 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:39.555 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402288+0000", 2024-09-12T22:32:39.555 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012123699999999999 2024-09-12T22:32:39.555 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.555 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.555 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:39.555 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402359+0000", 2024-09-12T22:32:39.555 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.0988000000000005e-05 2024-09-12T22:32:39.555 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.556 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.556 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:39.556 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402457+0000", 2024-09-12T22:32:39.556 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.7857999999999997e-05 2024-09-12T22:32:39.556 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.556 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.556 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:39.556 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.404395+0000", 2024-09-12T22:32:39.556 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0019380160000000001 2024-09-12T22:32:39.556 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.556 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.557 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:39.557 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410603+0000", 2024-09-12T22:32:39.557 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.006208061 2024-09-12T22:32:39.557 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.557 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.557 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:39.557 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410687+0000", 2024-09-12T22:32:39.557 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.4623000000000006e-05 2024-09-12T22:32:39.558 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.560 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.560 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:39.560 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411090+0000", 2024-09-12T22:32:39.560 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00040233599999999999 2024-09-12T22:32:39.560 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:39.561 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:39.561 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:39.561 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.561 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.561 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:39.561 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401083+0000", 2024-09-12T22:32:39.561 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 62.121239729000003, 2024-09-12T22:32:39.562 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0097591850000000001, 2024-09-12T22:32:39.562 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:39.562 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:39.562 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:39.562 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:39.562 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.562 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:39.562 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401083+0000", 2024-09-12T22:32:39.562 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:39.562 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.562 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.563 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:39.563 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401083+0000", 2024-09-12T22:32:39.563 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:39.563 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.563 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.563 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:39.563 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401084+0000", 2024-09-12T22:32:39.563 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4799999999999999e-07 2024-09-12T22:32:39.563 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.563 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.563 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:39.564 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401088+0000", 2024-09-12T22:32:39.564 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6419999999999998e-06 2024-09-12T22:32:39.564 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.564 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.564 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:39.564 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401094+0000", 2024-09-12T22:32:39.564 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0090000000000004e-06 2024-09-12T22:32:39.564 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.564 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.564 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:39.564 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401108+0000", 2024-09-12T22:32:39.564 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3884e-05 2024-09-12T22:32:39.565 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.565 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.565 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:39.565 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401165+0000", 2024-09-12T22:32:39.565 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.6499000000000002e-05 2024-09-12T22:32:39.565 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.565 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.565 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:39.566 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401261+0000", 2024-09-12T22:32:39.566 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.6872000000000004e-05 2024-09-12T22:32:39.566 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.566 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.566 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:39.566 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401376+0000", 2024-09-12T22:32:39.566 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000114508 2024-09-12T22:32:39.566 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.566 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.566 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:39.566 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402666+0000", 2024-09-12T22:32:39.566 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012901659999999999 2024-09-12T22:32:39.566 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.567 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.567 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:39.567 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410572+0000", 2024-09-12T22:32:39.567 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0079055489999999996 2024-09-12T22:32:39.567 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.567 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.567 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:39.567 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410661+0000", 2024-09-12T22:32:39.567 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.9578000000000002e-05 2024-09-12T22:32:39.567 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.568 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.568 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:39.568 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410842+0000", 2024-09-12T22:32:39.568 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00018102999999999999 2024-09-12T22:32:39.568 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:39.568 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:39.568 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:39.568 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.568 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.569 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:39.569 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401122+0000", 2024-09-12T22:32:39.569 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 62.121200696999999, 2024-09-12T22:32:39.569 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0099122080000000005, 2024-09-12T22:32:39.569 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:39.569 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:39.569 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:32:39.569 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:39.569 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.570 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:39.570 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401122+0000", 2024-09-12T22:32:39.570 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:39.570 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.570 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.570 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:39.570 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401122+0000", 2024-09-12T22:32:39.570 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:39.570 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.570 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.570 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:39.571 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401123+0000", 2024-09-12T22:32:39.571 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2600000000000002e-07 2024-09-12T22:32:39.571 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.571 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.571 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:39.571 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401126+0000", 2024-09-12T22:32:39.571 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.6449999999999998e-06 2024-09-12T22:32:39.571 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.571 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.571 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:39.571 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401133+0000", 2024-09-12T22:32:39.571 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.9890000000000003e-06 2024-09-12T22:32:39.571 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.571 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.572 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:39.572 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401138+0000", 2024-09-12T22:32:39.572 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8060000000000002e-06 2024-09-12T22:32:39.572 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.572 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.572 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:39.572 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401703+0000", 2024-09-12T22:32:39.572 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00056509099999999999 2024-09-12T22:32:39.572 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.572 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.572 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:39.572 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401837+0000", 2024-09-12T22:32:39.572 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013338799999999999 2024-09-12T22:32:39.573 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.573 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.573 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:39.573 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411034+0000", 2024-09-12T22:32:39.573 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.009197663 2024-09-12T22:32:39.573 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:39.573 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:39.574 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:39.574 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.574 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.574 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:39.574 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401158+0000", 2024-09-12T22:32:39.574 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 62.121164917999998, 2024-09-12T22:32:39.574 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.010292437999999999, 2024-09-12T22:32:39.574 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:39.574 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:39.574 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:32:39.574 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:39.575 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.575 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:39.575 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401158+0000", 2024-09-12T22:32:39.575 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:39.575 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.575 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.575 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:39.575 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401158+0000", 2024-09-12T22:32:39.575 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:39.576 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.576 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.576 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:39.576 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401158+0000", 2024-09-12T22:32:39.576 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9699999999999996e-07 2024-09-12T22:32:39.579 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.579 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.579 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:39.579 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401161+0000", 2024-09-12T22:32:39.579 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.7410000000000001e-06 2024-09-12T22:32:39.579 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.579 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.579 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:39.579 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401168+0000", 2024-09-12T22:32:39.580 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.844e-06 2024-09-12T22:32:39.580 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.580 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.580 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:39.580 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401174+0000", 2024-09-12T22:32:39.580 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4700000000000001e-06 2024-09-12T22:32:39.580 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.580 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.580 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:39.580 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402799+0000", 2024-09-12T22:32:39.581 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0016256409999999999 2024-09-12T22:32:39.581 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.581 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.581 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:39.581 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402893+0000", 2024-09-12T22:32:39.581 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.3807999999999994e-05 2024-09-12T22:32:39.581 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.581 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.581 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:39.581 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411450+0000", 2024-09-12T22:32:39.581 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0085573369999999999 2024-09-12T22:32:39.581 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:39.581 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:39.582 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:39.582 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.582 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.582 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:39.582 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401183+0000", 2024-09-12T22:32:39.582 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 62.121140066000002, 2024-09-12T22:32:39.582 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0068597830000000004, 2024-09-12T22:32:39.582 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:39.582 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:39.582 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:32:39.582 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:39.582 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.582 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:39.583 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401183+0000", 2024-09-12T22:32:39.583 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:39.583 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.583 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.583 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:39.583 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401183+0000", 2024-09-12T22:32:39.583 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:39.583 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.583 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.584 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:39.584 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401183+0000", 2024-09-12T22:32:39.584 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.6700000000000003e-07 2024-09-12T22:32:39.584 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.584 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.584 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:39.584 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401186+0000", 2024-09-12T22:32:39.584 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4679999999999999e-06 2024-09-12T22:32:39.584 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.584 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.584 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:39.584 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401192+0000", 2024-09-12T22:32:39.584 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.1519999999999997e-06 2024-09-12T22:32:39.585 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.585 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.585 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:39.585 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401197+0000", 2024-09-12T22:32:39.585 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4669999999999998e-06 2024-09-12T22:32:39.585 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.585 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.585 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:39.585 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401253+0000", 2024-09-12T22:32:39.585 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.6211000000000001e-05 2024-09-12T22:32:39.585 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.585 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.585 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:39.586 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401413+0000", 2024-09-12T22:32:39.586 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00016021399999999999 2024-09-12T22:32:39.586 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.586 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.586 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:39.586 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.408043+0000", 2024-09-12T22:32:39.586 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0066295039999999996 2024-09-12T22:32:39.586 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:39.586 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:39.586 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:39.587 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.587 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.587 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:20 3.1c e19/17 3:3ed09add:::607.00000000:head v 19'1, mlcod=0'0)", 2024-09-12T22:32:39.587 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.409642+0000", 2024-09-12T22:32:39.587 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 62.112680607000001, 2024-09-12T22:32:39.587 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0038816269999999999, 2024-09-12T22:32:39.587 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:39.587 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:39.587 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:39.587 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:39.587 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.588 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:39.588 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409642+0000", 2024-09-12T22:32:39.588 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:39.588 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.588 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.588 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:39.588 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409642+0000", 2024-09-12T22:32:39.588 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:39.588 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.588 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.588 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:39.588 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409642+0000", 2024-09-12T22:32:39.589 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.6899999999999999e-07 2024-09-12T22:32:39.589 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.589 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.589 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:39.589 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409648+0000", 2024-09-12T22:32:39.589 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.49e-06 2024-09-12T22:32:39.589 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.589 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.589 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:39.589 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409656+0000", 2024-09-12T22:32:39.589 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.2949999999999994e-06 2024-09-12T22:32:39.589 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.589 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.590 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:39.590 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409664+0000", 2024-09-12T22:32:39.590 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.1219999999999995e-06 2024-09-12T22:32:39.590 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.590 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.590 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:39.590 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409707+0000", 2024-09-12T22:32:39.590 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2222000000000003e-05 2024-09-12T22:32:39.590 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.590 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.591 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:39.591 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409724+0000", 2024-09-12T22:32:39.591 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7496999999999999e-05 2024-09-12T22:32:39.591 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.591 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.591 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:39.591 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413439+0000", 2024-09-12T22:32:39.591 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00371448 2024-09-12T22:32:39.591 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.591 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.591 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:39.591 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413524+0000", 2024-09-12T22:32:39.591 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.5252000000000003e-05 2024-09-12T22:32:39.592 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:39.592 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:39.592 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:39.592 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.592 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.592 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:28 3.13 e19/17 3:cd5a64a3:::100.00000000:head v 19'1, mlcod=0'0)", 2024-09-12T22:32:39.592 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.409681+0000", 2024-09-12T22:32:39.592 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 62.112642123999997, 2024-09-12T22:32:39.592 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0038708710000000001, 2024-09-12T22:32:39.592 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:39.592 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:39.593 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:39.593 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:39.593 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.593 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:39.593 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409681+0000", 2024-09-12T22:32:39.593 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:39.593 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.593 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.593 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:39.593 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409681+0000", 2024-09-12T22:32:39.593 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:39.593 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.593 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.594 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:39.594 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409681+0000", 2024-09-12T22:32:39.594 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3000000000000002e-07 2024-09-12T22:32:39.594 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.594 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.594 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:39.594 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409695+0000", 2024-09-12T22:32:39.594 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4313e-05 2024-09-12T22:32:39.594 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.594 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.595 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:39.595 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409703+0000", 2024-09-12T22:32:39.595 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4000000000000003e-06 2024-09-12T22:32:39.595 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.595 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.595 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:39.595 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409708+0000", 2024-09-12T22:32:39.595 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3190000000000002e-06 2024-09-12T22:32:39.595 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.595 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.595 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:39.595 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409875+0000", 2024-09-12T22:32:39.595 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000167329 2024-09-12T22:32:39.596 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.596 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.596 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:39.596 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409892+0000", 2024-09-12T22:32:39.596 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6957999999999999e-05 2024-09-12T22:32:39.596 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.596 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.596 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:39.596 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413457+0000", 2024-09-12T22:32:39.596 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0035651279999999999 2024-09-12T22:32:39.596 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.597 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.597 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:39.597 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413552+0000", 2024-09-12T22:32:39.597 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.4093999999999997e-05 2024-09-12T22:32:39.597 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:39.597 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:39.597 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:39.597 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.597 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.597 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:21 3.1c e19/17 3:3ed09add:::607.00000000:head v 19'2, mlcod=0'0)", 2024-09-12T22:32:39.598 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.409718+0000", 2024-09-12T22:32:39.598 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 62.112604459000003, 2024-09-12T22:32:39.598 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003851883, 2024-09-12T22:32:39.598 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:39.598 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:39.598 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:39.598 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:39.598 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.598 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:39.598 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409718+0000", 2024-09-12T22:32:39.598 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:39.598 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.598 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.598 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:39.599 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409718+0000", 2024-09-12T22:32:39.599 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:39.599 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.599 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.599 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:39.599 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409719+0000", 2024-09-12T22:32:39.599 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.16e-07 2024-09-12T22:32:39.599 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.599 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.599 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:39.599 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409722+0000", 2024-09-12T22:32:39.599 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.692e-06 2024-09-12T22:32:39.599 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.600 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.600 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:39.600 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409729+0000", 2024-09-12T22:32:39.600 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.516e-06 2024-09-12T22:32:39.600 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.600 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.600 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:39.600 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409750+0000", 2024-09-12T22:32:39.600 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1151000000000001e-05 2024-09-12T22:32:39.600 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.600 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.600 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:39.601 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410015+0000", 2024-09-12T22:32:39.601 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00026477599999999999 2024-09-12T22:32:39.601 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.601 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.601 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:39.601 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410104+0000", 2024-09-12T22:32:39.601 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.9586000000000006e-05 2024-09-12T22:32:39.601 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.601 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.601 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:39.602 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413528+0000", 2024-09-12T22:32:39.602 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0034237880000000001 2024-09-12T22:32:39.602 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.602 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.602 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:39.602 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413570+0000", 2024-09-12T22:32:39.602 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2157999999999999e-05 2024-09-12T22:32:39.602 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:39.603 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:39.603 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:39.603 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.603 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.603 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:27 3.13 e19/17 3:c91d4a1d:::mds0_inotable:head v 19'2, mlcod=0'0)", 2024-09-12T22:32:39.603 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.409760+0000", 2024-09-12T22:32:39.604 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 62.112562943, 2024-09-12T22:32:39.604 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0039301910000000004, 2024-09-12T22:32:39.604 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:39.604 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:39.604 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:39.605 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:39.605 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.605 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:39.605 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409760+0000", 2024-09-12T22:32:39.605 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:39.605 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.606 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.606 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:39.606 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409760+0000", 2024-09-12T22:32:39.606 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:39.606 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.608 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.608 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:39.608 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409760+0000", 2024-09-12T22:32:39.608 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.39e-07 2024-09-12T22:32:39.608 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.608 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.608 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:39.609 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409765+0000", 2024-09-12T22:32:39.609 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4449999999999998e-06 2024-09-12T22:32:39.609 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.609 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.609 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:39.609 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409771+0000", 2024-09-12T22:32:39.609 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7159999999999997e-06 2024-09-12T22:32:39.609 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.610 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.610 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:39.610 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409778+0000", 2024-09-12T22:32:39.610 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.331e-06 2024-09-12T22:32:39.610 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.610 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.610 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:39.610 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410191+0000", 2024-09-12T22:32:39.610 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00041348300000000003 2024-09-12T22:32:39.610 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.610 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.610 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:39.610 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410211+0000", 2024-09-12T22:32:39.611 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9933999999999999e-05 2024-09-12T22:32:39.611 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.611 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.611 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:39.611 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413638+0000", 2024-09-12T22:32:39.611 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003426854 2024-09-12T22:32:39.611 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.611 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.611 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:39.611 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413690+0000", 2024-09-12T22:32:39.611 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2089000000000002e-05 2024-09-12T22:32:39.611 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:39.611 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:39.612 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:39.612 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.612 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.612 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "pg_update_log_missing_reply(3.b epoch 19/17 rep_tid 4 lcod 19'2)", 2024-09-12T22:32:39.612 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.410060+0000", 2024-09-12T22:32:39.612 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 62.112263278, 2024-09-12T22:32:39.612 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00098016500000000007, 2024-09-12T22:32:39.612 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:39.612 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:39.612 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "reached pg", 2024-09-12T22:32:39.612 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:39.612 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.612 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:39.613 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410060+0000", 2024-09-12T22:32:39.613 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:39.613 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.613 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.613 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:39.613 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410060+0000", 2024-09-12T22:32:39.613 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:39.613 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.613 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.613 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:39.613 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410060+0000", 2024-09-12T22:32:39.614 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.8299999999999998e-07 2024-09-12T22:32:39.614 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.614 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.614 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:39.614 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410062+0000", 2024-09-12T22:32:39.614 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5749999999999999e-06 2024-09-12T22:32:39.614 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.614 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.614 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:39.615 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410070+0000", 2024-09-12T22:32:39.615 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.909e-06 2024-09-12T22:32:39.615 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.615 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.615 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:39.615 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410076+0000", 2024-09-12T22:32:39.615 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7049999999999996e-06 2024-09-12T22:32:39.615 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.615 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.615 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:39.615 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410943+0000", 2024-09-12T22:32:39.615 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00086681900000000001 2024-09-12T22:32:39.616 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.616 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.616 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:39.616 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411040+0000", 2024-09-12T22:32:39.616 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.6774000000000006e-05 2024-09-12T22:32:39.616 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:39.616 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:39.616 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:39.616 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.616 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.616 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e19/17 ondisk, result = 0)", 2024-09-12T22:32:39.617 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.410113+0000", 2024-09-12T22:32:39.617 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 62.112210011000002, 2024-09-12T22:32:39.617 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00098911599999999995, 2024-09-12T22:32:39.617 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:39.617 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:39.617 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:32:39.617 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:39.618 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.618 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:39.618 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410113+0000", 2024-09-12T22:32:39.618 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:39.618 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.618 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.619 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:39.619 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410113+0000", 2024-09-12T22:32:39.619 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:39.619 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.619 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.619 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:39.619 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410113+0000", 2024-09-12T22:32:39.619 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.99e-07 2024-09-12T22:32:39.619 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.619 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.619 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:39.619 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410115+0000", 2024-09-12T22:32:39.620 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.046e-06 2024-09-12T22:32:39.620 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.620 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.620 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:39.620 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410121+0000", 2024-09-12T22:32:39.620 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0050000000000001e-06 2024-09-12T22:32:39.620 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.620 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.620 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:39.620 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410126+0000", 2024-09-12T22:32:39.620 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8339999999999998e-06 2024-09-12T22:32:39.620 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.620 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.621 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:39.621 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410587+0000", 2024-09-12T22:32:39.621 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00046095499999999998 2024-09-12T22:32:39.621 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.621 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.621 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:39.621 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410595+0000", 2024-09-12T22:32:39.621 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.9419999999999995e-06 2024-09-12T22:32:39.622 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.622 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.622 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:39.622 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411102+0000", 2024-09-12T22:32:39.622 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00050713500000000003 2024-09-12T22:32:39.622 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:39.622 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:39.622 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:39.622 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.622 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.623 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 19/17 rep_tid 8 lcod 19'4)", 2024-09-12T22:32:39.623 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.410133+0000", 2024-09-12T22:32:39.623 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 62.112190083000002, 2024-09-12T22:32:39.623 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0013504000000000001, 2024-09-12T22:32:39.623 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:39.623 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:39.623 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "reached pg", 2024-09-12T22:32:39.624 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:39.624 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.624 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:39.624 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410133+0000", 2024-09-12T22:32:39.624 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:39.624 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.624 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.624 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:39.624 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410133+0000", 2024-09-12T22:32:39.624 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:39.624 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.624 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.625 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:39.625 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410133+0000", 2024-09-12T22:32:39.625 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.0599999999999999e-07 2024-09-12T22:32:39.625 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.625 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.625 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:39.625 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410135+0000", 2024-09-12T22:32:39.625 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7770000000000001e-06 2024-09-12T22:32:39.625 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.625 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.625 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:39.626 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410140+0000", 2024-09-12T22:32:39.626 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9960000000000001e-06 2024-09-12T22:32:39.626 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.626 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.626 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:39.626 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410144+0000", 2024-09-12T22:32:39.626 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9500000000000003e-06 2024-09-12T22:32:39.626 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.626 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.626 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:39.626 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411310+0000", 2024-09-12T22:32:39.626 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001166311 2024-09-12T22:32:39.626 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.627 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.627 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:39.627 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411483+0000", 2024-09-12T22:32:39.627 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00017316 2024-09-12T22:32:39.627 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:39.627 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:39.627 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:39.627 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.627 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.627 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "pg_update_log_missing(3.1a epoch 19/17 rep_tid 0 entries 19'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T22:32:39.627 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.410617+0000", 2024-09-12T22:32:39.627 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 62.111705688000001, 2024-09-12T22:32:39.627 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0030439709999999999, 2024-09-12T22:32:39.628 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:39.628 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:39.628 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "reached pg", 2024-09-12T22:32:39.628 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:39.628 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.628 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:39.628 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410617+0000", 2024-09-12T22:32:39.628 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:39.628 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.629 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.629 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:39.629 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410617+0000", 2024-09-12T22:32:39.629 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:39.629 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.629 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.629 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:39.629 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410617+0000", 2024-09-12T22:32:39.629 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3599999999999999e-07 2024-09-12T22:32:39.629 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.629 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.629 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:39.629 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410625+0000", 2024-09-12T22:32:39.629 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5410000000000003e-06 2024-09-12T22:32:39.630 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.630 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.630 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:39.630 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410638+0000", 2024-09-12T22:32:39.630 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3261999999999999e-05 2024-09-12T22:32:39.630 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.630 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.630 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:39.630 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410653+0000", 2024-09-12T22:32:39.630 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4844000000000001e-05 2024-09-12T22:32:39.630 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.630 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.630 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:39.631 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410814+0000", 2024-09-12T22:32:39.631 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00016119999999999999 2024-09-12T22:32:39.631 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.631 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.631 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:39.631 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413661+0000", 2024-09-12T22:32:39.631 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0028467879999999998 2024-09-12T22:32:39.631 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:39.632 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:39.632 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:39.632 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.632 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.632 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-09-12T22:32:39.633 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:39.398875+0000", 2024-09-12T22:32:39.633 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 60.123447407999997, 2024-09-12T22:32:39.633 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0015679069999999999, 2024-09-12T22:32:39.633 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:39.633 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:39.633 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:39.633 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:39.633 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.633 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:39.633 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398875+0000", 2024-09-12T22:32:39.633 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:39.634 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.634 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.634 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:39.634 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398875+0000", 2024-09-12T22:32:39.634 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:39.634 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.634 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.634 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:39.634 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398878+0000", 2024-09-12T22:32:39.634 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1679999999999998e-06 2024-09-12T22:32:39.634 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.634 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.634 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:39.635 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398888+0000", 2024-09-12T22:32:39.635 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.084e-05 2024-09-12T22:32:39.635 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.635 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.635 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:39.635 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398906+0000", 2024-09-12T22:32:39.635 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7518000000000001e-05 2024-09-12T22:32:39.635 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.635 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.635 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:39.635 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398914+0000", 2024-09-12T22:32:39.636 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5989999999999996e-06 2024-09-12T22:32:39.636 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.636 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.636 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:39.636 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398974+0000", 2024-09-12T22:32:39.636 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0988e-05 2024-09-12T22:32:39.636 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.636 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.636 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:39.636 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.399078+0000", 2024-09-12T22:32:39.637 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000103133 2024-09-12T22:32:39.637 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.637 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.637 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:39.637 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.399166+0000", 2024-09-12T22:32:39.638 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.8183999999999995e-05 2024-09-12T22:32:39.638 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.638 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.638 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:39.638 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.399747+0000", 2024-09-12T22:32:39.638 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00058110599999999996 2024-09-12T22:32:39.638 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.639 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.639 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:39.639 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.400377+0000", 2024-09-12T22:32:39.639 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000630157 2024-09-12T22:32:39.639 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.639 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.640 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:39.640 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.400415+0000", 2024-09-12T22:32:39.640 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7814000000000001e-05 2024-09-12T22:32:39.640 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.640 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.640 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:39.640 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.400443+0000", 2024-09-12T22:32:39.640 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8399999999999999e-05 2024-09-12T22:32:39.640 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:39.640 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:39.640 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:39.640 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.640 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.641 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e23)", 2024-09-12T22:32:39.641 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:58.400966+0000", 2024-09-12T22:32:39.641 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 41.121356499999997, 2024-09-12T22:32:39.641 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001468876, 2024-09-12T22:32:39.641 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:39.641 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:39.641 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:39.641 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:39.641 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.641 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:39.641 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400966+0000", 2024-09-12T22:32:39.641 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:39.641 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.642 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.642 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:39.642 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400966+0000", 2024-09-12T22:32:39.642 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:39.642 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.642 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.642 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:39.642 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400967+0000", 2024-09-12T22:32:39.642 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.046e-06 2024-09-12T22:32:39.642 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.642 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.642 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:39.643 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400974+0000", 2024-09-12T22:32:39.643 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2310000000000001e-06 2024-09-12T22:32:39.643 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.643 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.643 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:39.643 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400988+0000", 2024-09-12T22:32:39.643 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4482e-05 2024-09-12T22:32:39.643 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.643 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.643 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:39.643 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400997+0000", 2024-09-12T22:32:39.643 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.0189999999999995e-06 2024-09-12T22:32:39.643 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.644 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.644 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:39.644 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.401068+0000", 2024-09-12T22:32:39.644 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1426000000000004e-05 2024-09-12T22:32:39.644 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.644 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.644 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:39.644 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.401174+0000", 2024-09-12T22:32:39.644 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000105769 2024-09-12T22:32:39.644 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.644 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.644 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:39.644 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.401335+0000", 2024-09-12T22:32:39.645 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000161225 2024-09-12T22:32:39.645 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.645 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.645 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:39.645 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.402110+0000", 2024-09-12T22:32:39.646 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00077428800000000004 2024-09-12T22:32:39.646 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.646 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.646 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:39.647 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.402333+0000", 2024-09-12T22:32:39.647 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000223723 2024-09-12T22:32:39.647 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.647 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.647 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:39.648 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.402388+0000", 2024-09-12T22:32:39.648 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4700999999999997e-05 2024-09-12T22:32:39.648 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.648 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.648 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:39.648 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.402435+0000", 2024-09-12T22:32:39.648 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6965999999999997e-05 2024-09-12T22:32:39.648 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:39.649 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:39.649 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:39.649 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.649 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.649 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:45 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e27)", 2024-09-12T22:32:39.649 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:32:04.401614+0000", 2024-09-12T22:32:39.650 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 35.120709071, 2024-09-12T22:32:39.650 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0014279749999999999, 2024-09-12T22:32:39.650 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:39.650 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:39.650 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:39.650 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:39.650 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.650 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:39.650 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401614+0000", 2024-09-12T22:32:39.650 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:39.650 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.650 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.650 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:39.651 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401614+0000", 2024-09-12T22:32:39.651 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:39.651 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.651 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.651 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:39.651 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401615+0000", 2024-09-12T22:32:39.651 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.161e-06 2024-09-12T22:32:39.651 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.651 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.651 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:39.651 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401621+0000", 2024-09-12T22:32:39.651 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8730000000000004e-06 2024-09-12T22:32:39.651 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.652 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.652 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:39.652 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401633+0000", 2024-09-12T22:32:39.652 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1800000000000001e-05 2024-09-12T22:32:39.652 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.652 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.652 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:39.652 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401656+0000", 2024-09-12T22:32:39.652 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.3521999999999999e-05 2024-09-12T22:32:39.652 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.652 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.652 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:39.652 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401713+0000", 2024-09-12T22:32:39.653 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7259000000000002e-05 2024-09-12T22:32:39.653 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.653 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.653 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:39.653 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401849+0000", 2024-09-12T22:32:39.653 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013613500000000001 2024-09-12T22:32:39.653 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.653 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.653 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:39.653 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.402009+0000", 2024-09-12T22:32:39.654 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00015947199999999999 2024-09-12T22:32:39.654 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.654 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.654 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:39.654 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.402629+0000", 2024-09-12T22:32:39.654 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00061962200000000001 2024-09-12T22:32:39.654 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.654 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.654 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:39.654 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.402983+0000", 2024-09-12T22:32:39.654 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00035447499999999998 2024-09-12T22:32:39.654 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.654 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.655 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:39.655 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.403016+0000", 2024-09-12T22:32:39.655 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3108999999999998e-05 2024-09-12T22:32:39.655 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:39.655 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:39.655 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:39.655 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.403042+0000", 2024-09-12T22:32:39.655 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5547000000000001e-05 2024-09-12T22:32:39.655 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:39.655 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:39.655 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:39.655 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:39.655 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:39.656 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:32:39.657 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:39.656+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:39.658 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:32:39.758 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:39.757+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:39.773 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-09-12T22:32:39.773 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-09-12T22:32:39.773 INFO:teuthology.orchestra.run.smithi163.stdout: "num_ops": 0 2024-09-12T22:32:39.773 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-09-12T22:32:39.782 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:32:39.859 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:39.858+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:39.928 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-09-12T22:32:39.928 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-09-12T22:32:39.929 INFO:teuthology.orchestra.run.smithi163.stdout: "complaint_time": 30, 2024-09-12T22:32:39.929 INFO:teuthology.orchestra.run.smithi163.stdout: "num_blocked_ops": 0 2024-09-12T22:32:39.929 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-09-12T22:32:39.937 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:32:39.983 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:39.982+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:40.003 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T22:32:40.043 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-09-12T22:32:40.043 INFO:teuthology.orchestra.run.smithi163.stdout: "size": 20, 2024-09-12T22:32:40.043 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 600, 2024-09-12T22:32:40.043 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2024-09-12T22:32:40.043 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.044 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-09-12T22:32:40.044 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:27.254459+0000", 2024-09-12T22:32:40.044 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 72.786319387000006, 2024-09-12T22:32:40.044 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.37816283899999997, 2024-09-12T22:32:40.044 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:40.044 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:40.044 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:40.044 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:40.044 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:40.044 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:40.044 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 1 2024-09-12T22:32:40.044 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.045 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:40.045 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.045 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:40.045 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254459+0000", 2024-09-12T22:32:40.045 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:40.045 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.045 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.045 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:40.045 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254459+0000", 2024-09-12T22:32:40.045 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:40.045 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.045 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.045 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:40.046 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254460+0000", 2024-09-12T22:32:40.046 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1739999999999999e-06 2024-09-12T22:32:40.046 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.046 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.046 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:40.046 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254472+0000", 2024-09-12T22:32:40.046 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2207e-05 2024-09-12T22:32:40.046 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.046 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.046 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:40.046 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254483+0000", 2024-09-12T22:32:40.046 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0631999999999999e-05 2024-09-12T22:32:40.046 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.047 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.047 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:40.047 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254492+0000", 2024-09-12T22:32:40.047 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3670000000000003e-06 2024-09-12T22:32:40.047 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.047 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.047 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:40.048 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254551+0000", 2024-09-12T22:32:40.048 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8687999999999998e-05 2024-09-12T22:32:40.048 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.048 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.048 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for peered", 2024-09-12T22:32:40.048 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254562+0000", 2024-09-12T22:32:40.048 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1249e-05 2024-09-12T22:32:40.048 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.048 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.048 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:40.049 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.631211+0000", 2024-09-12T22:32:40.049 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.376649018 2024-09-12T22:32:40.049 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.049 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.049 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:40.049 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.631345+0000", 2024-09-12T22:32:40.049 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013378700000000001 2024-09-12T22:32:40.049 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.049 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.050 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:40.050 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.631479+0000", 2024-09-12T22:32:40.050 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013352399999999999 2024-09-12T22:32:40.050 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.050 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.050 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:40.050 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632324+0000", 2024-09-12T22:32:40.050 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00084508100000000002 2024-09-12T22:32:40.050 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.050 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.050 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:40.050 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632548+0000", 2024-09-12T22:32:40.050 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000224329 2024-09-12T22:32:40.051 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.051 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.051 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:40.051 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632591+0000", 2024-09-12T22:32:40.051 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2564000000000001e-05 2024-09-12T22:32:40.051 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.051 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.051 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:40.051 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632622+0000", 2024-09-12T22:32:40.051 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1219e-05 2024-09-12T22:32:40.052 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:40.052 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:40.052 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:40.052 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.052 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.052 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:185 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:32:40.052 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394355+0000", 2024-09-12T22:32:40.052 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 71.646423290000001, 2024-09-12T22:32:40.052 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011302394, 2024-09-12T22:32:40.052 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:40.052 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:40.052 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:40.052 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:40.053 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:40.053 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:40.053 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 185 2024-09-12T22:32:40.053 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.053 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:40.053 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.053 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:40.053 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394355+0000", 2024-09-12T22:32:40.053 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:40.053 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.053 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.053 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:40.053 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394355+0000", 2024-09-12T22:32:40.054 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:40.054 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.054 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.054 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:40.054 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394355+0000", 2024-09-12T22:32:40.054 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9099999999999999e-07 2024-09-12T22:32:40.054 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.054 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.054 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:40.054 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394385+0000", 2024-09-12T22:32:40.054 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9963000000000001e-05 2024-09-12T22:32:40.054 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.054 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.055 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:40.055 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394390+0000", 2024-09-12T22:32:40.055 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8420000000000004e-06 2024-09-12T22:32:40.055 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.055 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.055 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:40.055 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394393+0000", 2024-09-12T22:32:40.055 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1e-06 2024-09-12T22:32:40.055 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.055 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.055 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:40.055 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.400546+0000", 2024-09-12T22:32:40.055 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0061523309999999996 2024-09-12T22:32:40.055 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.056 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.056 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:40.056 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.400588+0000", 2024-09-12T22:32:40.056 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1835000000000002e-05 2024-09-12T22:32:40.056 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.056 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.056 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:40.056 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.400677+0000", 2024-09-12T22:32:40.056 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9195000000000002e-05 2024-09-12T22:32:40.056 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.056 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.056 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:40.056 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405378+0000", 2024-09-12T22:32:40.057 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0047008659999999997 2024-09-12T22:32:40.057 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.057 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.057 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:40.057 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405569+0000", 2024-09-12T22:32:40.057 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00019148599999999999 2024-09-12T22:32:40.057 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.057 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.057 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:40.057 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405620+0000", 2024-09-12T22:32:40.057 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1416999999999999e-05 2024-09-12T22:32:40.057 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.057 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.058 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:40.058 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405657+0000", 2024-09-12T22:32:40.058 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6968000000000002e-05 2024-09-12T22:32:40.058 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:40.058 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:40.058 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:40.058 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.058 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.058 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:32:40.058 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394399+0000", 2024-09-12T22:32:40.058 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 71.646379078999999, 2024-09-12T22:32:40.058 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011336601999999999, 2024-09-12T22:32:40.058 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:40.059 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:40.059 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:40.060 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:40.060 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:40.060 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:40.060 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 186 2024-09-12T22:32:40.060 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.060 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:40.060 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.060 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:40.060 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394399+0000", 2024-09-12T22:32:40.060 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:40.060 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.060 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.060 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:40.061 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394399+0000", 2024-09-12T22:32:40.061 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:40.061 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.061 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.061 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:40.061 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394400+0000", 2024-09-12T22:32:40.061 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4499999999999998e-07 2024-09-12T22:32:40.061 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.061 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.061 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:40.061 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394402+0000", 2024-09-12T22:32:40.061 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.875e-06 2024-09-12T22:32:40.062 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.062 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.062 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:40.062 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394405+0000", 2024-09-12T22:32:40.062 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6799999999999999e-06 2024-09-12T22:32:40.062 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.062 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.062 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:40.062 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394408+0000", 2024-09-12T22:32:40.062 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.667e-06 2024-09-12T22:32:40.062 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.062 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.062 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:40.062 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401395+0000", 2024-09-12T22:32:40.063 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0069867230000000002 2024-09-12T22:32:40.063 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.063 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.063 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:40.063 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401438+0000", 2024-09-12T22:32:40.063 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3554999999999999e-05 2024-09-12T22:32:40.063 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.063 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.063 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:40.063 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401509+0000", 2024-09-12T22:32:40.063 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0631999999999997e-05 2024-09-12T22:32:40.063 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.063 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.064 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:40.064 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405392+0000", 2024-09-12T22:32:40.064 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0038830449999999999 2024-09-12T22:32:40.064 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.064 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.064 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:40.064 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405690+0000", 2024-09-12T22:32:40.064 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000298435 2024-09-12T22:32:40.064 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.064 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.064 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:40.064 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405716+0000", 2024-09-12T22:32:40.065 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5435999999999998e-05 2024-09-12T22:32:40.065 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.065 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.065 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:40.065 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405736+0000", 2024-09-12T22:32:40.065 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0208999999999999e-05 2024-09-12T22:32:40.065 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:40.065 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:40.065 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:40.065 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.065 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.065 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:32:40.066 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394411+0000", 2024-09-12T22:32:40.066 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 71.646366952999998, 2024-09-12T22:32:40.066 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011400117, 2024-09-12T22:32:40.066 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:40.066 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:40.066 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:40.066 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:40.066 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:40.066 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:40.066 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 187 2024-09-12T22:32:40.066 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.066 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:40.066 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.067 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:40.067 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394411+0000", 2024-09-12T22:32:40.067 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:40.067 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.067 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.067 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:40.067 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394411+0000", 2024-09-12T22:32:40.067 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:40.067 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.067 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.067 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:40.067 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394412+0000", 2024-09-12T22:32:40.067 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.4999999999999999e-07 2024-09-12T22:32:40.067 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.068 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.068 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:40.068 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394414+0000", 2024-09-12T22:32:40.068 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.984e-06 2024-09-12T22:32:40.068 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.068 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.068 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:40.068 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394418+0000", 2024-09-12T22:32:40.068 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0840000000000002e-06 2024-09-12T22:32:40.068 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.069 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.069 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:40.069 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394431+0000", 2024-09-12T22:32:40.069 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.361e-05 2024-09-12T22:32:40.069 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.069 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.069 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:40.069 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401778+0000", 2024-09-12T22:32:40.069 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0073462659999999997 2024-09-12T22:32:40.069 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.069 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.069 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:40.070 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401853+0000", 2024-09-12T22:32:40.070 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5797000000000006e-05 2024-09-12T22:32:40.070 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.070 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.070 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:40.070 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401990+0000", 2024-09-12T22:32:40.070 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013651399999999999 2024-09-12T22:32:40.070 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.070 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.070 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:40.070 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405402+0000", 2024-09-12T22:32:40.070 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0034116070000000001 2024-09-12T22:32:40.070 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.070 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.071 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:40.071 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405764+0000", 2024-09-12T22:32:40.071 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00036234899999999998 2024-09-12T22:32:40.071 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.071 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.071 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:40.071 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405791+0000", 2024-09-12T22:32:40.071 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7029000000000002e-05 2024-09-12T22:32:40.071 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.071 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.071 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:40.071 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405812+0000", 2024-09-12T22:32:40.071 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0627000000000001e-05 2024-09-12T22:32:40.072 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:40.072 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:40.072 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:40.072 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.072 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.072 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:32:40.072 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394447+0000", 2024-09-12T22:32:40.072 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 71.646331802000006, 2024-09-12T22:32:40.072 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011759588, 2024-09-12T22:32:40.072 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:40.072 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:40.072 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:40.072 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:40.073 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:40.073 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:40.073 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 188 2024-09-12T22:32:40.073 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.073 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:40.073 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.073 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:40.073 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394447+0000", 2024-09-12T22:32:40.073 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:40.073 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.073 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.073 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:40.073 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394447+0000", 2024-09-12T22:32:40.074 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:40.074 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.074 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.074 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:40.074 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394447+0000", 2024-09-12T22:32:40.074 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.15e-07 2024-09-12T22:32:40.074 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.074 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.074 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:40.075 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394512+0000", 2024-09-12T22:32:40.075 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4580999999999997e-05 2024-09-12T22:32:40.075 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.075 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.076 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:40.076 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394518+0000", 2024-09-12T22:32:40.076 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.3380000000000001e-06 2024-09-12T22:32:40.076 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.076 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.076 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:40.076 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394521+0000", 2024-09-12T22:32:40.076 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3340000000000002e-06 2024-09-12T22:32:40.076 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.076 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.076 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:40.076 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.402628+0000", 2024-09-12T22:32:40.077 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.008106996 2024-09-12T22:32:40.077 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.077 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.077 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:40.077 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.402670+0000", 2024-09-12T22:32:40.077 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1983000000000001e-05 2024-09-12T22:32:40.077 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.077 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.077 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:40.078 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.402738+0000", 2024-09-12T22:32:40.078 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.8114999999999994e-05 2024-09-12T22:32:40.078 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.078 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.078 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:40.078 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405668+0000", 2024-09-12T22:32:40.079 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.002929545 2024-09-12T22:32:40.079 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.079 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.079 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:40.079 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406162+0000", 2024-09-12T22:32:40.080 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000494408 2024-09-12T22:32:40.080 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.080 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.080 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:40.080 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406188+0000", 2024-09-12T22:32:40.081 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5766e-05 2024-09-12T22:32:40.081 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.081 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.081 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:40.081 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406206+0000", 2024-09-12T22:32:40.081 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.8107000000000001e-05 2024-09-12T22:32:40.082 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:40.082 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:40.082 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:40.082 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.082 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.083 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:32:40.083 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394528+0000", 2024-09-12T22:32:40.083 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 71.646250132999995, 2024-09-12T22:32:40.083 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.01195536, 2024-09-12T22:32:40.083 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:40.083 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:40.083 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:40.083 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:40.083 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:40.083 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:40.083 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 189 2024-09-12T22:32:40.083 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.083 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:40.084 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.084 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:40.084 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394528+0000", 2024-09-12T22:32:40.084 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:40.084 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.084 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.084 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:40.084 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394528+0000", 2024-09-12T22:32:40.084 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:40.084 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.084 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.084 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:40.084 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394529+0000", 2024-09-12T22:32:40.085 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4900000000000001e-07 2024-09-12T22:32:40.085 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.085 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.085 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:40.085 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394531+0000", 2024-09-12T22:32:40.085 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.458e-06 2024-09-12T22:32:40.085 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.085 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.085 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:40.085 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394535+0000", 2024-09-12T22:32:40.085 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7900000000000001e-06 2024-09-12T22:32:40.085 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.085 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.086 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:40.086 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394537+0000", 2024-09-12T22:32:40.086 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.632e-06 2024-09-12T22:32:40.086 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.086 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.086 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:40.086 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.404932+0000", 2024-09-12T22:32:40.086 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010394158000000001 2024-09-12T22:32:40.086 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.086 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.086 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:40.086 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405017+0000", 2024-09-12T22:32:40.086 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5525000000000005e-05 2024-09-12T22:32:40.086 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.087 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.087 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:40.087 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405114+0000", 2024-09-12T22:32:40.087 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.6527000000000006e-05 2024-09-12T22:32:40.087 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.087 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.087 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:40.087 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405818+0000", 2024-09-12T22:32:40.087 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00070412800000000005 2024-09-12T22:32:40.087 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.087 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.087 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:40.087 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406437+0000", 2024-09-12T22:32:40.088 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00061898900000000002 2024-09-12T22:32:40.088 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.088 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.088 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:40.088 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406463+0000", 2024-09-12T22:32:40.088 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6268e-05 2024-09-12T22:32:40.088 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.088 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.088 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:40.088 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406484+0000", 2024-09-12T22:32:40.088 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0536000000000001e-05 2024-09-12T22:32:40.088 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:40.088 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:40.089 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:40.089 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.089 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.089 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:40.089 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.401422+0000", 2024-09-12T22:32:40.089 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 62.639356227999997, 2024-09-12T22:32:40.089 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016896452999999999, 2024-09-12T22:32:40.089 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:40.089 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:40.089 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:40.089 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:40.089 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.089 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:40.090 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401422+0000", 2024-09-12T22:32:40.090 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:40.090 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.090 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.090 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:40.090 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401422+0000", 2024-09-12T22:32:40.090 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:40.090 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.090 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.090 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:40.090 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401424+0000", 2024-09-12T22:32:40.090 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9e-06 2024-09-12T22:32:40.090 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.090 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.091 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:40.091 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401437+0000", 2024-09-12T22:32:40.091 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2831e-05 2024-09-12T22:32:40.091 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.091 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.091 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:40.091 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401471+0000", 2024-09-12T22:32:40.091 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4010000000000001e-05 2024-09-12T22:32:40.091 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.091 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.091 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:40.091 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401484+0000", 2024-09-12T22:32:40.091 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2711000000000001e-05 2024-09-12T22:32:40.092 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.092 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.092 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:40.092 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405410+0000", 2024-09-12T22:32:40.092 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0039259170000000001 2024-09-12T22:32:40.092 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.092 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.092 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:40.092 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405529+0000", 2024-09-12T22:32:40.092 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000119778 2024-09-12T22:32:40.092 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.092 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.092 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:40.092 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405655+0000", 2024-09-12T22:32:40.093 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012556700000000001 2024-09-12T22:32:40.093 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.093 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.093 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:40.093 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410456+0000", 2024-09-12T22:32:40.093 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0048008269999999997 2024-09-12T22:32:40.093 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.093 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.093 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:40.093 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418226+0000", 2024-09-12T22:32:40.093 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0077707729999999999 2024-09-12T22:32:40.093 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.093 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.094 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:40.094 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418277+0000", 2024-09-12T22:32:40.094 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0476000000000003e-05 2024-09-12T22:32:40.094 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.094 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.094 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:40.094 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418319+0000", 2024-09-12T22:32:40.094 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1662999999999997e-05 2024-09-12T22:32:40.094 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:40.094 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:40.094 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:40.094 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.094 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.095 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:40.095 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.401505+0000", 2024-09-12T22:32:40.095 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 62.639273564, 2024-09-12T22:32:40.095 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016987904000000002, 2024-09-12T22:32:40.095 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:40.095 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:40.095 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:40.095 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:40.095 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.095 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:40.095 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401505+0000", 2024-09-12T22:32:40.095 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:40.095 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.096 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.096 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:40.096 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401505+0000", 2024-09-12T22:32:40.096 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:40.096 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.096 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.096 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:40.096 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401506+0000", 2024-09-12T22:32:40.096 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4700000000000001e-07 2024-09-12T22:32:40.096 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.096 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.096 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:40.096 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401510+0000", 2024-09-12T22:32:40.097 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6609999999999999e-06 2024-09-12T22:32:40.097 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.097 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.097 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:40.097 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401771+0000", 2024-09-12T22:32:40.097 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00026110700000000001 2024-09-12T22:32:40.097 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.097 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.097 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:40.097 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401921+0000", 2024-09-12T22:32:40.097 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014939099999999999 2024-09-12T22:32:40.097 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.097 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.097 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:40.098 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405944+0000", 2024-09-12T22:32:40.098 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0040235449999999999 2024-09-12T22:32:40.098 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.098 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.098 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:40.098 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406018+0000", 2024-09-12T22:32:40.098 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3373000000000004e-05 2024-09-12T22:32:40.098 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.098 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.098 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:40.099 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406172+0000", 2024-09-12T22:32:40.099 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00015435399999999999 2024-09-12T22:32:40.099 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.099 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.099 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:40.099 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410461+0000", 2024-09-12T22:32:40.099 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0042888609999999997 2024-09-12T22:32:40.099 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.099 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.099 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:40.099 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418371+0000", 2024-09-12T22:32:40.100 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0079098380000000006 2024-09-12T22:32:40.100 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.100 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.100 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:40.100 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418443+0000", 2024-09-12T22:32:40.100 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2705000000000003e-05 2024-09-12T22:32:40.100 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.100 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.100 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:40.100 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418493+0000", 2024-09-12T22:32:40.100 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9322e-05 2024-09-12T22:32:40.101 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:40.101 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:40.101 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:40.101 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.101 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.101 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:40.101 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.401939+0000", 2024-09-12T22:32:40.101 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 62.638839828000002, 2024-09-12T22:32:40.101 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016722292999999999, 2024-09-12T22:32:40.101 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:40.101 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:40.101 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:40.101 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:40.102 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.102 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:40.102 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401939+0000", 2024-09-12T22:32:40.102 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:40.102 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.102 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.102 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:40.103 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401939+0000", 2024-09-12T22:32:40.103 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:40.103 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.103 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.103 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:40.103 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401940+0000", 2024-09-12T22:32:40.103 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1990000000000001e-06 2024-09-12T22:32:40.103 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.103 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.103 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:40.103 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401956+0000", 2024-09-12T22:32:40.103 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.6344000000000001e-05 2024-09-12T22:32:40.104 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.105 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.105 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:40.105 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401974+0000", 2024-09-12T22:32:40.105 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7730000000000001e-05 2024-09-12T22:32:40.105 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.105 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.106 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:40.106 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401982+0000", 2024-09-12T22:32:40.106 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.7800000000000001e-06 2024-09-12T22:32:40.106 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.106 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.106 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:40.106 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406557+0000", 2024-09-12T22:32:40.106 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0045758489999999999 2024-09-12T22:32:40.106 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.106 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.106 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:40.106 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406697+0000", 2024-09-12T22:32:40.106 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013925100000000001 2024-09-12T22:32:40.107 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.107 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.107 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:40.107 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406830+0000", 2024-09-12T22:32:40.107 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013293499999999999 2024-09-12T22:32:40.107 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.107 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.107 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:40.107 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410465+0000", 2024-09-12T22:32:40.107 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0036352680000000001 2024-09-12T22:32:40.107 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.107 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.107 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:40.108 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418564+0000", 2024-09-12T22:32:40.108 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0080992140000000004 2024-09-12T22:32:40.108 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.108 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.108 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:40.108 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418621+0000", 2024-09-12T22:32:40.108 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7167999999999999e-05 2024-09-12T22:32:40.108 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.108 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.108 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:40.108 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418661+0000", 2024-09-12T22:32:40.108 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9555000000000003e-05 2024-09-12T22:32:40.108 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:40.109 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:40.109 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:40.109 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.109 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.109 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:40.109 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.401994+0000", 2024-09-12T22:32:40.109 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 62.638783955999997, 2024-09-12T22:32:40.109 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016804109000000001, 2024-09-12T22:32:40.109 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:40.109 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:40.109 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:40.109 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:40.109 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.110 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:40.110 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401994+0000", 2024-09-12T22:32:40.110 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:40.110 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.110 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.110 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:40.110 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401994+0000", 2024-09-12T22:32:40.110 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:40.110 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.110 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.110 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:40.110 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401995+0000", 2024-09-12T22:32:40.110 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.8899999999999998e-07 2024-09-12T22:32:40.111 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.111 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.111 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:40.111 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402000+0000", 2024-09-12T22:32:40.111 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.498e-06 2024-09-12T22:32:40.111 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.111 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.111 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:40.111 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402007+0000", 2024-09-12T22:32:40.112 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.554e-06 2024-09-12T22:32:40.112 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.112 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.112 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:40.112 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402046+0000", 2024-09-12T22:32:40.112 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9156000000000003e-05 2024-09-12T22:32:40.112 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.112 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.112 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:40.112 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407342+0000", 2024-09-12T22:32:40.112 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052957610000000004 2024-09-12T22:32:40.112 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.112 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.113 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:40.113 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407521+0000", 2024-09-12T22:32:40.113 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00017878100000000001 2024-09-12T22:32:40.113 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.113 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.113 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:40.113 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407641+0000", 2024-09-12T22:32:40.113 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012013 2024-09-12T22:32:40.113 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.113 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.113 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:40.113 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410472+0000", 2024-09-12T22:32:40.113 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.002830455 2024-09-12T22:32:40.113 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.114 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.114 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:40.114 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418714+0000", 2024-09-12T22:32:40.114 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0082422789999999999 2024-09-12T22:32:40.114 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.114 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.114 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:40.114 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418761+0000", 2024-09-12T22:32:40.114 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6956999999999998e-05 2024-09-12T22:32:40.114 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.114 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.114 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:40.115 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418799+0000", 2024-09-12T22:32:40.115 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7749000000000001e-05 2024-09-12T22:32:40.115 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:40.115 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:40.115 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:40.115 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.115 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.115 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:40.115 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.402060+0000", 2024-09-12T22:32:40.115 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 62.638718511999997, 2024-09-12T22:32:40.115 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016885686, 2024-09-12T22:32:40.115 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:40.115 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:40.116 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:40.116 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:40.116 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.116 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:40.116 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402060+0000", 2024-09-12T22:32:40.116 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:40.116 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.116 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.116 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:40.116 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402060+0000", 2024-09-12T22:32:40.116 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:40.116 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.116 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.117 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:40.117 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402061+0000", 2024-09-12T22:32:40.117 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4399999999999999e-07 2024-09-12T22:32:40.117 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.117 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.117 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:40.117 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402066+0000", 2024-09-12T22:32:40.117 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8649999999999998e-06 2024-09-12T22:32:40.117 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.117 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.117 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:40.117 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402146+0000", 2024-09-12T22:32:40.117 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9054000000000006e-05 2024-09-12T22:32:40.118 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.118 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.118 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:40.118 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402287+0000", 2024-09-12T22:32:40.118 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014108600000000001 2024-09-12T22:32:40.118 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.118 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.118 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:40.118 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408185+0000", 2024-09-12T22:32:40.118 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0058983919999999997 2024-09-12T22:32:40.118 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.119 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.119 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:40.119 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408299+0000", 2024-09-12T22:32:40.119 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114102 2024-09-12T22:32:40.119 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.119 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.119 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:40.119 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408420+0000", 2024-09-12T22:32:40.119 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000120492 2024-09-12T22:32:40.119 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.119 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.120 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:40.120 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410867+0000", 2024-09-12T22:32:40.120 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0024476430000000002 2024-09-12T22:32:40.120 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.120 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.120 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:40.120 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418851+0000", 2024-09-12T22:32:40.120 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0079841489999999994 2024-09-12T22:32:40.121 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.121 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.121 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:40.121 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418894+0000", 2024-09-12T22:32:40.121 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3090000000000002e-05 2024-09-12T22:32:40.121 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.121 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.121 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:40.121 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418946+0000", 2024-09-12T22:32:40.121 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1069000000000002e-05 2024-09-12T22:32:40.121 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:40.121 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:40.121 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:40.121 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.122 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.122 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:40.122 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.402375+0000", 2024-09-12T22:32:40.122 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 62.638403447000002, 2024-09-12T22:32:40.122 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016768531999999999, 2024-09-12T22:32:40.122 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:40.122 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:40.122 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:40.122 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:40.122 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.122 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:40.122 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402375+0000", 2024-09-12T22:32:40.122 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:40.123 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.123 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.123 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:40.123 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402375+0000", 2024-09-12T22:32:40.123 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:40.123 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.123 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.123 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:40.123 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402375+0000", 2024-09-12T22:32:40.123 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4099999999999999e-07 2024-09-12T22:32:40.124 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.124 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.124 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:40.124 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402379+0000", 2024-09-12T22:32:40.124 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9870000000000001e-06 2024-09-12T22:32:40.124 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.124 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.124 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:40.124 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402389+0000", 2024-09-12T22:32:40.124 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0000000000000001e-05 2024-09-12T22:32:40.124 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.124 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.124 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:40.125 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402401+0000", 2024-09-12T22:32:40.125 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.148e-05 2024-09-12T22:32:40.125 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.125 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.125 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:40.125 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409108+0000", 2024-09-12T22:32:40.125 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0067068429999999997 2024-09-12T22:32:40.125 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.125 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.125 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:40.125 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409189+0000", 2024-09-12T22:32:40.125 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0815999999999993e-05 2024-09-12T22:32:40.125 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.126 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.126 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:40.126 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409320+0000", 2024-09-12T22:32:40.126 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000131586 2024-09-12T22:32:40.126 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.126 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.126 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:40.126 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410872+0000", 2024-09-12T22:32:40.126 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0015521599999999999 2024-09-12T22:32:40.126 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.126 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.126 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:40.126 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419049+0000", 2024-09-12T22:32:40.127 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0081763719999999995 2024-09-12T22:32:40.127 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.127 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.127 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:40.127 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419107+0000", 2024-09-12T22:32:40.127 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7899000000000002e-05 2024-09-12T22:32:40.127 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.127 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.127 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:40.128 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419143+0000", 2024-09-12T22:32:40.128 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6847999999999997e-05 2024-09-12T22:32:40.128 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:40.128 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:40.128 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:40.128 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.128 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.128 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:40.128 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.402903+0000", 2024-09-12T22:32:40.128 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 62.637875035, 2024-09-12T22:32:40.128 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016378428, 2024-09-12T22:32:40.128 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:40.128 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:40.129 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:40.129 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:40.129 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.129 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:40.129 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402903+0000", 2024-09-12T22:32:40.129 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:40.129 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.129 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.129 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:40.129 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402903+0000", 2024-09-12T22:32:40.129 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:40.129 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.129 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.130 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:40.130 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402904+0000", 2024-09-12T22:32:40.130 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9500000000000001e-07 2024-09-12T22:32:40.130 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.130 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.130 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:40.130 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402944+0000", 2024-09-12T22:32:40.130 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0265000000000002e-05 2024-09-12T22:32:40.130 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.130 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.130 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:40.130 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402979+0000", 2024-09-12T22:32:40.130 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4378000000000002e-05 2024-09-12T22:32:40.130 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.131 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.131 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:40.131 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402987+0000", 2024-09-12T22:32:40.131 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3559999999999993e-06 2024-09-12T22:32:40.131 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.131 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.131 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:40.131 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409577+0000", 2024-09-12T22:32:40.131 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0065901709999999997 2024-09-12T22:32:40.131 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.131 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.131 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:40.131 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409653+0000", 2024-09-12T22:32:40.132 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5819e-05 2024-09-12T22:32:40.132 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.132 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.132 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:40.132 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409725+0000", 2024-09-12T22:32:40.132 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2200000000000007e-05 2024-09-12T22:32:40.132 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.132 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.132 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:40.132 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.411234+0000", 2024-09-12T22:32:40.132 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001508225 2024-09-12T22:32:40.132 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.132 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.133 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:40.133 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419212+0000", 2024-09-12T22:32:40.133 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0079783400000000004 2024-09-12T22:32:40.133 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.133 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.133 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:40.133 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419244+0000", 2024-09-12T22:32:40.133 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2384e-05 2024-09-12T22:32:40.133 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.133 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.133 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:40.133 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419282+0000", 2024-09-12T22:32:40.133 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7394999999999997e-05 2024-09-12T22:32:40.133 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:40.134 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:40.134 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:40.134 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.134 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.134 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:40.134 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.403135+0000", 2024-09-12T22:32:40.134 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 62.637643165, 2024-09-12T22:32:40.134 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016294211999999999, 2024-09-12T22:32:40.134 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:40.134 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:40.134 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:40.134 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:40.134 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.135 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:40.135 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403135+0000", 2024-09-12T22:32:40.135 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:40.135 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.135 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.135 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:40.135 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403135+0000", 2024-09-12T22:32:40.135 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:40.135 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.135 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.135 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:40.135 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403136+0000", 2024-09-12T22:32:40.135 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.4e-07 2024-09-12T22:32:40.135 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.136 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.136 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:40.136 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403149+0000", 2024-09-12T22:32:40.136 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2723e-05 2024-09-12T22:32:40.136 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.136 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.136 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:40.136 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403158+0000", 2024-09-12T22:32:40.136 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3919999999999992e-06 2024-09-12T22:32:40.136 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.136 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.136 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:40.136 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403166+0000", 2024-09-12T22:32:40.137 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.2309999999999996e-06 2024-09-12T22:32:40.137 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.137 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.137 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:40.137 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409944+0000", 2024-09-12T22:32:40.137 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0067775309999999998 2024-09-12T22:32:40.137 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.137 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.137 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:40.137 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410032+0000", 2024-09-12T22:32:40.137 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.7906999999999997e-05 2024-09-12T22:32:40.137 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.137 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.137 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:40.138 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410152+0000", 2024-09-12T22:32:40.138 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012037800000000001 2024-09-12T22:32:40.138 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.138 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.138 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:40.138 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.411945+0000", 2024-09-12T22:32:40.138 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0017931850000000001 2024-09-12T22:32:40.138 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.138 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.139 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:40.139 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419319+0000", 2024-09-12T22:32:40.139 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0073731780000000002 2024-09-12T22:32:40.139 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.139 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.139 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:40.139 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419376+0000", 2024-09-12T22:32:40.139 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7728e-05 2024-09-12T22:32:40.139 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.140 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.140 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:40.140 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419429+0000", 2024-09-12T22:32:40.140 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3019000000000002e-05 2024-09-12T22:32:40.140 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:40.140 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:40.140 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:40.141 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.141 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.141 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:40.141 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.403185+0000", 2024-09-12T22:32:40.141 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 62.637593283999998, 2024-09-12T22:32:40.141 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.014902164000000001, 2024-09-12T22:32:40.141 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:40.141 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:40.141 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:40.141 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:40.141 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.141 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:40.141 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403185+0000", 2024-09-12T22:32:40.142 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:40.142 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.142 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.142 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:40.142 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403185+0000", 2024-09-12T22:32:40.142 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:40.142 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.142 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.142 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:40.142 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403186+0000", 2024-09-12T22:32:40.142 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9400000000000005e-07 2024-09-12T22:32:40.142 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.142 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.143 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:40.143 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403191+0000", 2024-09-12T22:32:40.143 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6980000000000003e-06 2024-09-12T22:32:40.143 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.143 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.143 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:40.143 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403199+0000", 2024-09-12T22:32:40.143 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2520000000000002e-06 2024-09-12T22:32:40.143 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.143 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.143 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:40.143 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403205+0000", 2024-09-12T22:32:40.143 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.908e-06 2024-09-12T22:32:40.144 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.144 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.144 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:40.144 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403359+0000", 2024-09-12T22:32:40.144 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000154544 2024-09-12T22:32:40.144 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.144 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.144 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:40.144 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403528+0000", 2024-09-12T22:32:40.144 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000168455 2024-09-12T22:32:40.144 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.144 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.144 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:40.145 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403763+0000", 2024-09-12T22:32:40.145 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00023539599999999999 2024-09-12T22:32:40.145 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.145 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.145 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:40.145 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409378+0000", 2024-09-12T22:32:40.145 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056150000000000002 2024-09-12T22:32:40.145 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.145 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.145 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:40.145 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418012+0000", 2024-09-12T22:32:40.145 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0086339559999999999 2024-09-12T22:32:40.145 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.146 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.146 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:40.146 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418046+0000", 2024-09-12T22:32:40.146 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4267999999999998e-05 2024-09-12T22:32:40.146 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.146 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.146 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:40.146 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418087+0000", 2024-09-12T22:32:40.146 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0992999999999999e-05 2024-09-12T22:32:40.146 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:40.146 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:40.146 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:40.146 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.146 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.147 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:40.147 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.403273+0000", 2024-09-12T22:32:40.147 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 62.637505333, 2024-09-12T22:32:40.147 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.014934866, 2024-09-12T22:32:40.147 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:40.147 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:40.147 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:40.147 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:40.147 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.147 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:40.147 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403273+0000", 2024-09-12T22:32:40.147 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:40.147 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.148 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.148 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:40.148 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403273+0000", 2024-09-12T22:32:40.148 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:40.148 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.148 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.148 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:40.148 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403274+0000", 2024-09-12T22:32:40.148 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.297e-06 2024-09-12T22:32:40.149 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.149 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.149 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:40.149 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403282+0000", 2024-09-12T22:32:40.149 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6340000000000001e-06 2024-09-12T22:32:40.149 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.149 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.149 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:40.149 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403305+0000", 2024-09-12T22:32:40.150 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3149000000000001e-05 2024-09-12T22:32:40.150 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.150 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.150 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:40.150 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403320+0000", 2024-09-12T22:32:40.150 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4527e-05 2024-09-12T22:32:40.150 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.150 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.150 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:40.150 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.404928+0000", 2024-09-12T22:32:40.150 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001608459 2024-09-12T22:32:40.150 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.150 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.151 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:40.151 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405218+0000", 2024-09-12T22:32:40.151 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00028982900000000002 2024-09-12T22:32:40.151 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.151 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.151 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:40.151 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405829+0000", 2024-09-12T22:32:40.151 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00061127900000000005 2024-09-12T22:32:40.151 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.151 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.151 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:40.151 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409403+0000", 2024-09-12T22:32:40.151 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.003573597 2024-09-12T22:32:40.151 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.152 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.152 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:40.152 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418138+0000", 2024-09-12T22:32:40.152 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0087349969999999996 2024-09-12T22:32:40.152 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.152 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.152 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:40.152 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418178+0000", 2024-09-12T22:32:40.152 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0649999999999999e-05 2024-09-12T22:32:40.152 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.152 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.152 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:40.152 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418208+0000", 2024-09-12T22:32:40.153 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9448e-05 2024-09-12T22:32:40.153 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:40.153 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:40.153 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:40.153 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.153 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.153 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:40.153 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.405456+0000", 2024-09-12T22:32:40.153 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 62.635322188000004, 2024-09-12T22:32:40.153 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012888389, 2024-09-12T22:32:40.153 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:40.153 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:40.153 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:40.154 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:40.154 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.154 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:40.154 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405456+0000", 2024-09-12T22:32:40.154 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:40.154 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.154 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.154 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:40.154 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405456+0000", 2024-09-12T22:32:40.154 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:40.154 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.154 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.154 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:40.154 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405457+0000", 2024-09-12T22:32:40.155 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.6599999999999994e-07 2024-09-12T22:32:40.155 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.155 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.155 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:40.155 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405463+0000", 2024-09-12T22:32:40.155 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4739999999999996e-06 2024-09-12T22:32:40.155 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.155 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.155 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:40.155 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405474+0000", 2024-09-12T22:32:40.155 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1095e-05 2024-09-12T22:32:40.155 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.155 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.156 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:40.156 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405482+0000", 2024-09-12T22:32:40.156 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3610000000000001e-06 2024-09-12T22:32:40.156 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.156 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.156 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:40.156 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407051+0000", 2024-09-12T22:32:40.156 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0015688970000000001 2024-09-12T22:32:40.156 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.156 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.156 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:40.156 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407259+0000", 2024-09-12T22:32:40.156 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00020778300000000001 2024-09-12T22:32:40.156 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.157 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.157 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:40.157 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407622+0000", 2024-09-12T22:32:40.157 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000363066 2024-09-12T22:32:40.157 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.157 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.157 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:40.157 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409438+0000", 2024-09-12T22:32:40.157 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001816319 2024-09-12T22:32:40.157 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.157 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.157 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:40.158 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418257+0000", 2024-09-12T22:32:40.158 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0088187720000000008 2024-09-12T22:32:40.158 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.158 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.158 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:40.158 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418308+0000", 2024-09-12T22:32:40.158 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1180000000000001e-05 2024-09-12T22:32:40.158 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.158 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.158 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:40.158 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418345+0000", 2024-09-12T22:32:40.158 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6476000000000001e-05 2024-09-12T22:32:40.158 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:40.158 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:40.159 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:40.159 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.159 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.159 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:40.159 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.405496+0000", 2024-09-12T22:32:40.159 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 62.635282830999998, 2024-09-12T22:32:40.159 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013016012, 2024-09-12T22:32:40.159 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:40.159 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:40.159 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:40.159 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:40.159 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.159 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:40.160 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405496+0000", 2024-09-12T22:32:40.160 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:40.160 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.160 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.160 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:40.160 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405496+0000", 2024-09-12T22:32:40.160 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:40.160 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.160 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.160 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:40.160 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405496+0000", 2024-09-12T22:32:40.160 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7999999999999995e-07 2024-09-12T22:32:40.160 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.161 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.161 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:40.161 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405501+0000", 2024-09-12T22:32:40.161 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8359999999999999e-06 2024-09-12T22:32:40.161 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.161 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.161 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:40.161 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405514+0000", 2024-09-12T22:32:40.161 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2522e-05 2024-09-12T22:32:40.161 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.161 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.161 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:40.161 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405521+0000", 2024-09-12T22:32:40.162 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5020000000000003e-06 2024-09-12T22:32:40.162 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.162 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.162 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:40.162 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405575+0000", 2024-09-12T22:32:40.162 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4169999999999998e-05 2024-09-12T22:32:40.162 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.162 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.162 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:40.162 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405697+0000", 2024-09-12T22:32:40.162 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000121301 2024-09-12T22:32:40.162 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.162 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.162 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:40.163 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405829+0000", 2024-09-12T22:32:40.163 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000132662 2024-09-12T22:32:40.163 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.163 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.163 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:40.163 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409155+0000", 2024-09-12T22:32:40.163 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0033259050000000001 2024-09-12T22:32:40.163 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.163 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.163 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:40.163 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418425+0000", 2024-09-12T22:32:40.163 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0092696319999999999 2024-09-12T22:32:40.163 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.164 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.164 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:40.164 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418471+0000", 2024-09-12T22:32:40.164 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6213e-05 2024-09-12T22:32:40.164 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.164 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.164 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:40.164 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418512+0000", 2024-09-12T22:32:40.164 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0589000000000001e-05 2024-09-12T22:32:40.164 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:40.164 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:40.164 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:40.164 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.165 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.165 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:40.165 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.406108+0000", 2024-09-12T22:32:40.165 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 62.634670434, 2024-09-12T22:32:40.165 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012458175, 2024-09-12T22:32:40.165 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:40.165 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:40.165 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:40.165 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:40.165 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.165 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:40.165 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406108+0000", 2024-09-12T22:32:40.165 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:40.166 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.166 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.166 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:40.166 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406108+0000", 2024-09-12T22:32:40.166 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:40.166 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.166 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.166 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:40.166 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406109+0000", 2024-09-12T22:32:40.166 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9899999999999999e-07 2024-09-12T22:32:40.166 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.166 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.166 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:40.167 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406115+0000", 2024-09-12T22:32:40.167 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9030000000000001e-06 2024-09-12T22:32:40.167 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.167 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.167 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:40.167 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406141+0000", 2024-09-12T22:32:40.167 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5999e-05 2024-09-12T22:32:40.167 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.167 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.167 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:40.167 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406150+0000", 2024-09-12T22:32:40.167 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.6050000000000004e-06 2024-09-12T22:32:40.167 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.167 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.168 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:40.168 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408163+0000", 2024-09-12T22:32:40.168 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0020122769999999998 2024-09-12T22:32:40.168 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.168 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.168 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:40.168 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408309+0000", 2024-09-12T22:32:40.168 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014606999999999999 2024-09-12T22:32:40.168 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.168 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.168 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:40.168 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408433+0000", 2024-09-12T22:32:40.168 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012460300000000001 2024-09-12T22:32:40.169 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.169 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.169 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:40.169 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409903+0000", 2024-09-12T22:32:40.169 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001469499 2024-09-12T22:32:40.169 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.169 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.169 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:40.169 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418427+0000", 2024-09-12T22:32:40.169 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0085241139999999993 2024-09-12T22:32:40.169 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.169 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.169 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:40.170 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418471+0000", 2024-09-12T22:32:40.170 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4474000000000001e-05 2024-09-12T22:32:40.170 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.170 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.170 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:40.170 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418566+0000", 2024-09-12T22:32:40.170 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.4732e-05 2024-09-12T22:32:40.170 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:40.170 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:40.170 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:40.170 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.170 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.170 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:40.170 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.407266+0000", 2024-09-12T22:32:40.171 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 62.633512578000001, 2024-09-12T22:32:40.171 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011442905, 2024-09-12T22:32:40.171 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:40.171 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:40.171 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2024-09-12T22:32:40.171 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:40.171 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.171 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:40.171 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407266+0000", 2024-09-12T22:32:40.171 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:40.171 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.171 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.171 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:40.172 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407266+0000", 2024-09-12T22:32:40.172 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:40.172 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.172 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.172 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:40.172 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407266+0000", 2024-09-12T22:32:40.172 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7899999999999998e-07 2024-09-12T22:32:40.172 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.172 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.172 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:40.172 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407269+0000", 2024-09-12T22:32:40.172 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9210000000000001e-06 2024-09-12T22:32:40.172 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.172 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.173 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:40.173 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407331+0000", 2024-09-12T22:32:40.173 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1376000000000003e-05 2024-09-12T22:32:40.173 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.173 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.173 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:40.173 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407337+0000", 2024-09-12T22:32:40.173 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1929999999999998e-06 2024-09-12T22:32:40.173 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.173 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.173 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:40.173 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408974+0000", 2024-09-12T22:32:40.173 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0016367109999999999 2024-09-12T22:32:40.174 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.174 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.174 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:40.174 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409112+0000", 2024-09-12T22:32:40.174 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000137952 2024-09-12T22:32:40.174 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:40.174 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:40.174 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:40.174 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418709+0000", 2024-09-12T22:32:40.174 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0095971730000000005 2024-09-12T22:32:40.174 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:40.174 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:40.174 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:40.174 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:40.175 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:40.175 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-09-12T22:32:40.176 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0: {} 2024-09-12T22:32:40.177 INFO:teuthology.orchestra.run.smithi019.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T22:32:40.177 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T22:32:40.178 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:32:40.178 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:40.175+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:40.178 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:32:40.179 INFO:teuthology.orchestra.run.smithi019.stdout:osd.2: {} 2024-09-12T22:32:40.179 INFO:teuthology.orchestra.run.smithi019.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T22:32:40.277 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:40.276+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:40.293 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:40.293 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:40.303 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:32:40.378 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:40.377+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:40.384 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T22:32:40.390 DEBUG:teuthology.orchestra.console.smithi076:pexpect command: ipmitool -H smithi076.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-09-12T22:32:40.411 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:40.412 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:40.420 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:32:40.478 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:40.477+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:40.503 DEBUG:teuthology.orchestra.console.smithi076:check power output: Chassis Power is on 2024-09-12T22:32:40.525 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:40.525 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:40.533 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:32:40.580 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:40.579+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:40.640 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:40.640 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:40.650 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:32:40.693 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:40.692+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:40.753 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:40.753 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:40.762 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:32:40.804 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:40.802+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:40.883 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:40.882+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:40.906 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:40.906 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:40.916 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:32:40.984 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:40.983+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:41.024 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:41.024 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:41.033 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:32:41.085 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:41.084+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:41.176 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:41.177 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:41.186 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:32:41.187 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:41.184+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:41.287 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:41.286+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:41.527 INFO:teuthology.orchestra.run.smithi019.stderr:nodeep-scrub is unset 2024-09-12T22:32:41.527 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:41.527 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:41.528 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:32:41.528 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:41.525+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:41.627 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:41.626+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:41.635 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:41.635 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:41.644 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:32:41.728 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:41.727+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:41.787 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:41.787 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:41.796 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:32:41.839 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:41.838+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:41.899 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:41.899 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:41.908 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:32:41.952 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:41.951+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:42.013 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:42.014 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:42.023 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:32:42.032 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:42.030+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:42.133 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:42.132+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:42.167 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:42.167 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:42.176 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:32:42.184 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T22:32:42.234 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:42.232+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:42.280 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:42.280 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:42.289 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:32:42.335 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:42.334+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:42.347 INFO:teuthology.orchestra.run.smithi019.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-12T22:32:42.379 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T22:32:42.380 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:32:42.397 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:42.397 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:42.406 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:32:42.411 INFO:teuthology.orchestra.run.smithi019.stdout:osd.2: {} 2024-09-12T22:32:42.411 INFO:teuthology.orchestra.run.smithi019.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T22:32:42.415 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:32:42.416 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:32:42.451 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:42.449+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:42.510 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-09-12T22:32:42.511 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-09-12T22:32:42.511 INFO:teuthology.orchestra.run.smithi163.stdout: "complaint_time": 30, 2024-09-12T22:32:42.511 INFO:teuthology.orchestra.run.smithi163.stdout: "num_blocked_ops": 0 2024-09-12T22:32:42.511 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-09-12T22:32:42.519 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:32:42.561 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:42.559+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:42.637 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:42.636+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:42.664 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-09-12T22:32:42.664 INFO:teuthology.orchestra.run.smithi163.stdout: "size": 20, 2024-09-12T22:32:42.664 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 600, 2024-09-12T22:32:42.664 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2024-09-12T22:32:42.665 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.665 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-09-12T22:32:42.665 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:27.254459+0000", 2024-09-12T22:32:42.665 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 75.407551964000007, 2024-09-12T22:32:42.665 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.37816283899999997, 2024-09-12T22:32:42.665 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:42.665 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:42.665 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:42.665 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:42.665 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:42.665 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:42.665 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 1 2024-09-12T22:32:42.665 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.666 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:42.666 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.666 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:42.666 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254459+0000", 2024-09-12T22:32:42.666 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:42.666 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.666 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.666 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:42.666 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254459+0000", 2024-09-12T22:32:42.666 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:42.666 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.666 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.666 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:42.666 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254460+0000", 2024-09-12T22:32:42.667 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1739999999999999e-06 2024-09-12T22:32:42.667 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.667 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.667 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:42.667 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254472+0000", 2024-09-12T22:32:42.667 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2207e-05 2024-09-12T22:32:42.667 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.667 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.667 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:42.667 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254483+0000", 2024-09-12T22:32:42.667 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0631999999999999e-05 2024-09-12T22:32:42.667 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.667 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.668 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:42.668 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254492+0000", 2024-09-12T22:32:42.668 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3670000000000003e-06 2024-09-12T22:32:42.668 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.668 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.668 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:42.668 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254551+0000", 2024-09-12T22:32:42.668 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8687999999999998e-05 2024-09-12T22:32:42.668 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.668 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.668 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for peered", 2024-09-12T22:32:42.668 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254562+0000", 2024-09-12T22:32:42.669 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1249e-05 2024-09-12T22:32:42.669 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.669 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.669 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:42.669 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.631211+0000", 2024-09-12T22:32:42.669 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.376649018 2024-09-12T22:32:42.669 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.669 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.669 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:42.669 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.631345+0000", 2024-09-12T22:32:42.669 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013378700000000001 2024-09-12T22:32:42.669 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.669 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.669 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:42.670 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.631479+0000", 2024-09-12T22:32:42.670 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013352399999999999 2024-09-12T22:32:42.670 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.670 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.670 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:42.670 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632324+0000", 2024-09-12T22:32:42.670 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00084508100000000002 2024-09-12T22:32:42.670 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.670 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.670 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:42.670 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632548+0000", 2024-09-12T22:32:42.670 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000224329 2024-09-12T22:32:42.670 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.671 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.671 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:42.671 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632591+0000", 2024-09-12T22:32:42.671 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2564000000000001e-05 2024-09-12T22:32:42.671 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.671 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.671 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:42.671 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632622+0000", 2024-09-12T22:32:42.671 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1219e-05 2024-09-12T22:32:42.671 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:42.671 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:42.671 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:42.671 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.672 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.672 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:185 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:32:42.672 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394355+0000", 2024-09-12T22:32:42.672 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 74.267655867000002, 2024-09-12T22:32:42.672 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011302394, 2024-09-12T22:32:42.672 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:42.672 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:42.672 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:42.672 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:42.672 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:42.672 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:42.672 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 185 2024-09-12T22:32:42.673 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.673 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:42.673 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.673 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:42.673 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394355+0000", 2024-09-12T22:32:42.673 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:42.673 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.673 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.673 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:42.673 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394355+0000", 2024-09-12T22:32:42.673 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:42.673 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.673 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.673 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:42.674 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394355+0000", 2024-09-12T22:32:42.674 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9099999999999999e-07 2024-09-12T22:32:42.674 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.674 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.674 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:42.674 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394385+0000", 2024-09-12T22:32:42.674 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9963000000000001e-05 2024-09-12T22:32:42.674 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.674 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.674 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:42.674 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394390+0000", 2024-09-12T22:32:42.674 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8420000000000004e-06 2024-09-12T22:32:42.674 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.675 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.675 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:42.675 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394393+0000", 2024-09-12T22:32:42.675 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1e-06 2024-09-12T22:32:42.675 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.675 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.675 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:42.675 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.400546+0000", 2024-09-12T22:32:42.675 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0061523309999999996 2024-09-12T22:32:42.675 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.675 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.675 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:42.675 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.400588+0000", 2024-09-12T22:32:42.675 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1835000000000002e-05 2024-09-12T22:32:42.676 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.676 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.676 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:42.676 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.400677+0000", 2024-09-12T22:32:42.676 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9195000000000002e-05 2024-09-12T22:32:42.676 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.676 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.676 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:42.676 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405378+0000", 2024-09-12T22:32:42.676 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0047008659999999997 2024-09-12T22:32:42.676 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.676 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.676 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:42.677 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405569+0000", 2024-09-12T22:32:42.677 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00019148599999999999 2024-09-12T22:32:42.677 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.677 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.677 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:42.677 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405620+0000", 2024-09-12T22:32:42.677 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1416999999999999e-05 2024-09-12T22:32:42.677 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.677 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.677 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:42.677 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405657+0000", 2024-09-12T22:32:42.677 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6968000000000002e-05 2024-09-12T22:32:42.677 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:42.677 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:42.678 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:42.678 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.678 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.678 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:32:42.678 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394399+0000", 2024-09-12T22:32:42.678 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 74.267611656, 2024-09-12T22:32:42.678 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011336601999999999, 2024-09-12T22:32:42.678 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:42.678 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:42.678 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:42.678 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:42.678 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:42.678 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:42.679 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 186 2024-09-12T22:32:42.679 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.679 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:42.679 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.679 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:42.679 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394399+0000", 2024-09-12T22:32:42.679 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:42.679 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.679 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.679 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:42.679 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394399+0000", 2024-09-12T22:32:42.679 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:42.679 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.679 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.680 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:42.680 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394400+0000", 2024-09-12T22:32:42.680 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4499999999999998e-07 2024-09-12T22:32:42.680 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.680 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.680 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:42.680 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394402+0000", 2024-09-12T22:32:42.680 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.875e-06 2024-09-12T22:32:42.680 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.680 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.680 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:42.680 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394405+0000", 2024-09-12T22:32:42.680 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6799999999999999e-06 2024-09-12T22:32:42.681 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.681 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.681 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:42.681 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394408+0000", 2024-09-12T22:32:42.681 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.667e-06 2024-09-12T22:32:42.681 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.681 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.681 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:42.681 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401395+0000", 2024-09-12T22:32:42.681 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0069867230000000002 2024-09-12T22:32:42.681 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.681 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.681 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:42.682 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401438+0000", 2024-09-12T22:32:42.682 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3554999999999999e-05 2024-09-12T22:32:42.682 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.682 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.682 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:42.682 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401509+0000", 2024-09-12T22:32:42.682 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0631999999999997e-05 2024-09-12T22:32:42.682 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.682 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.682 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:42.682 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405392+0000", 2024-09-12T22:32:42.682 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0038830449999999999 2024-09-12T22:32:42.682 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.682 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.683 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:42.683 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405690+0000", 2024-09-12T22:32:42.683 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000298435 2024-09-12T22:32:42.683 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.683 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.683 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:42.683 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405716+0000", 2024-09-12T22:32:42.683 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5435999999999998e-05 2024-09-12T22:32:42.683 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.683 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.683 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:42.683 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405736+0000", 2024-09-12T22:32:42.683 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0208999999999999e-05 2024-09-12T22:32:42.683 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:42.684 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:42.684 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:42.684 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.684 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.684 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:32:42.684 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394411+0000", 2024-09-12T22:32:42.684 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 74.267599529999998, 2024-09-12T22:32:42.684 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011400117, 2024-09-12T22:32:42.684 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:42.684 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:42.684 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:42.684 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:42.684 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:42.685 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:42.685 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 187 2024-09-12T22:32:42.685 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.685 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:42.685 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.685 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:42.685 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394411+0000", 2024-09-12T22:32:42.685 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:42.685 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.685 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.685 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:42.685 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394411+0000", 2024-09-12T22:32:42.685 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:42.686 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.686 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.686 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:42.686 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394412+0000", 2024-09-12T22:32:42.686 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.4999999999999999e-07 2024-09-12T22:32:42.686 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.686 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.686 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:42.686 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394414+0000", 2024-09-12T22:32:42.686 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.984e-06 2024-09-12T22:32:42.686 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.686 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.686 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:42.687 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394418+0000", 2024-09-12T22:32:42.687 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0840000000000002e-06 2024-09-12T22:32:42.687 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.687 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.687 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:42.687 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394431+0000", 2024-09-12T22:32:42.687 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.361e-05 2024-09-12T22:32:42.687 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.687 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.687 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:42.687 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401778+0000", 2024-09-12T22:32:42.687 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0073462659999999997 2024-09-12T22:32:42.687 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.687 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.688 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:42.688 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401853+0000", 2024-09-12T22:32:42.688 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5797000000000006e-05 2024-09-12T22:32:42.688 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.688 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.688 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:42.688 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401990+0000", 2024-09-12T22:32:42.688 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013651399999999999 2024-09-12T22:32:42.688 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.688 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.688 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:42.688 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405402+0000", 2024-09-12T22:32:42.688 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0034116070000000001 2024-09-12T22:32:42.688 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.689 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.689 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:42.689 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405764+0000", 2024-09-12T22:32:42.689 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00036234899999999998 2024-09-12T22:32:42.689 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.689 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.689 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:42.689 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405791+0000", 2024-09-12T22:32:42.689 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7029000000000002e-05 2024-09-12T22:32:42.689 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.689 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.689 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:42.689 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405812+0000", 2024-09-12T22:32:42.689 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0627000000000001e-05 2024-09-12T22:32:42.690 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:42.690 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:42.690 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:42.690 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.690 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.690 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:32:42.690 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394447+0000", 2024-09-12T22:32:42.690 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 74.267564379000007, 2024-09-12T22:32:42.690 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011759588, 2024-09-12T22:32:42.690 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:42.690 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:42.690 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:42.690 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:42.691 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:42.691 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:42.691 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 188 2024-09-12T22:32:42.691 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.691 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:42.691 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.691 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:42.691 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394447+0000", 2024-09-12T22:32:42.691 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:42.691 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.691 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.691 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:42.691 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394447+0000", 2024-09-12T22:32:42.691 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:42.692 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.692 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.692 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:42.692 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394447+0000", 2024-09-12T22:32:42.692 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.15e-07 2024-09-12T22:32:42.692 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.692 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.692 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:42.692 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394512+0000", 2024-09-12T22:32:42.692 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4580999999999997e-05 2024-09-12T22:32:42.692 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.692 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.692 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:42.693 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394518+0000", 2024-09-12T22:32:42.693 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.3380000000000001e-06 2024-09-12T22:32:42.693 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.693 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.693 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:42.693 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394521+0000", 2024-09-12T22:32:42.693 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3340000000000002e-06 2024-09-12T22:32:42.693 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.693 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.693 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:42.693 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.402628+0000", 2024-09-12T22:32:42.693 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.008106996 2024-09-12T22:32:42.693 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.693 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.694 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:42.694 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.402670+0000", 2024-09-12T22:32:42.694 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1983000000000001e-05 2024-09-12T22:32:42.694 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.694 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.694 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:42.694 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.402738+0000", 2024-09-12T22:32:42.694 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.8114999999999994e-05 2024-09-12T22:32:42.694 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.694 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.694 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:42.694 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405668+0000", 2024-09-12T22:32:42.694 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.002929545 2024-09-12T22:32:42.694 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.695 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.695 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:42.695 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406162+0000", 2024-09-12T22:32:42.695 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000494408 2024-09-12T22:32:42.695 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.695 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.695 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:42.695 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406188+0000", 2024-09-12T22:32:42.695 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5766e-05 2024-09-12T22:32:42.695 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.695 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.695 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:42.695 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406206+0000", 2024-09-12T22:32:42.695 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.8107000000000001e-05 2024-09-12T22:32:42.696 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:42.696 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:42.696 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:42.696 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.696 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.696 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:32:42.696 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394528+0000", 2024-09-12T22:32:42.696 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 74.267482709999996, 2024-09-12T22:32:42.696 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.01195536, 2024-09-12T22:32:42.696 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:42.696 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:42.696 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:42.696 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:42.697 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:42.697 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:42.697 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 189 2024-09-12T22:32:42.697 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.697 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:42.697 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.697 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:42.697 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394528+0000", 2024-09-12T22:32:42.697 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:42.697 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.697 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.697 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:42.697 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394528+0000", 2024-09-12T22:32:42.698 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:42.698 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.698 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.698 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:42.698 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394529+0000", 2024-09-12T22:32:42.698 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4900000000000001e-07 2024-09-12T22:32:42.698 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.698 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.698 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:42.698 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394531+0000", 2024-09-12T22:32:42.698 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.458e-06 2024-09-12T22:32:42.698 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.698 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.698 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:42.699 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394535+0000", 2024-09-12T22:32:42.699 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7900000000000001e-06 2024-09-12T22:32:42.699 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.699 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.699 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:42.699 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394537+0000", 2024-09-12T22:32:42.699 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.632e-06 2024-09-12T22:32:42.699 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.699 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.699 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:42.699 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.404932+0000", 2024-09-12T22:32:42.699 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010394158000000001 2024-09-12T22:32:42.699 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.699 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.700 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:42.700 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405017+0000", 2024-09-12T22:32:42.700 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5525000000000005e-05 2024-09-12T22:32:42.700 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.700 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.700 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:42.700 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405114+0000", 2024-09-12T22:32:42.700 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.6527000000000006e-05 2024-09-12T22:32:42.700 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.700 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.700 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:42.700 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405818+0000", 2024-09-12T22:32:42.700 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00070412800000000005 2024-09-12T22:32:42.701 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.701 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.701 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:42.701 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406437+0000", 2024-09-12T22:32:42.701 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00061898900000000002 2024-09-12T22:32:42.701 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.701 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.701 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:42.701 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406463+0000", 2024-09-12T22:32:42.701 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6268e-05 2024-09-12T22:32:42.701 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.701 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.701 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:42.702 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406484+0000", 2024-09-12T22:32:42.702 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0536000000000001e-05 2024-09-12T22:32:42.702 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:42.702 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:42.702 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:42.702 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.702 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.702 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:42.702 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.401422+0000", 2024-09-12T22:32:42.702 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 65.260588804999998, 2024-09-12T22:32:42.702 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016896452999999999, 2024-09-12T22:32:42.702 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:42.702 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:42.702 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:42.703 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:42.703 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.703 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:42.703 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401422+0000", 2024-09-12T22:32:42.703 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:42.703 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.703 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.703 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:42.703 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401422+0000", 2024-09-12T22:32:42.703 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:42.703 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.703 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.703 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:42.704 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401424+0000", 2024-09-12T22:32:42.704 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9e-06 2024-09-12T22:32:42.704 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.704 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.704 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:42.704 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401437+0000", 2024-09-12T22:32:42.704 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2831e-05 2024-09-12T22:32:42.704 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.704 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.704 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:42.704 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401471+0000", 2024-09-12T22:32:42.704 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4010000000000001e-05 2024-09-12T22:32:42.704 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.704 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.705 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:42.705 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401484+0000", 2024-09-12T22:32:42.705 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2711000000000001e-05 2024-09-12T22:32:42.705 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.705 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.705 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:42.705 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405410+0000", 2024-09-12T22:32:42.705 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0039259170000000001 2024-09-12T22:32:42.705 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.705 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.705 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:42.705 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405529+0000", 2024-09-12T22:32:42.705 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000119778 2024-09-12T22:32:42.706 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.706 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.706 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:42.706 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405655+0000", 2024-09-12T22:32:42.706 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012556700000000001 2024-09-12T22:32:42.706 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.706 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.706 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:42.706 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410456+0000", 2024-09-12T22:32:42.706 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0048008269999999997 2024-09-12T22:32:42.706 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.706 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.706 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:42.707 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418226+0000", 2024-09-12T22:32:42.707 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0077707729999999999 2024-09-12T22:32:42.707 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.707 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.707 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:42.707 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418277+0000", 2024-09-12T22:32:42.707 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0476000000000003e-05 2024-09-12T22:32:42.707 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.707 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.707 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:42.707 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418319+0000", 2024-09-12T22:32:42.707 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1662999999999997e-05 2024-09-12T22:32:42.707 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:42.708 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:42.708 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:42.708 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.708 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.708 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:42.708 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.401505+0000", 2024-09-12T22:32:42.708 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 65.260506140999993, 2024-09-12T22:32:42.708 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016987904000000002, 2024-09-12T22:32:42.708 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:42.708 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:42.708 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:42.708 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:42.708 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.709 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:42.709 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401505+0000", 2024-09-12T22:32:42.709 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:42.709 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.709 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.709 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:42.709 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401505+0000", 2024-09-12T22:32:42.709 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:42.709 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.709 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.709 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:42.709 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401506+0000", 2024-09-12T22:32:42.709 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4700000000000001e-07 2024-09-12T22:32:42.710 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.710 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.710 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:42.710 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401510+0000", 2024-09-12T22:32:42.710 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6609999999999999e-06 2024-09-12T22:32:42.710 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.710 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.710 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:42.712 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401771+0000", 2024-09-12T22:32:42.712 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00026110700000000001 2024-09-12T22:32:42.712 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.712 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.712 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:42.712 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401921+0000", 2024-09-12T22:32:42.712 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014939099999999999 2024-09-12T22:32:42.712 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.712 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.712 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:42.712 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405944+0000", 2024-09-12T22:32:42.712 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0040235449999999999 2024-09-12T22:32:42.712 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.713 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.713 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:42.713 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406018+0000", 2024-09-12T22:32:42.713 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3373000000000004e-05 2024-09-12T22:32:42.713 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.713 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.713 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:42.713 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406172+0000", 2024-09-12T22:32:42.713 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00015435399999999999 2024-09-12T22:32:42.713 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.713 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.713 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:42.713 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410461+0000", 2024-09-12T22:32:42.714 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0042888609999999997 2024-09-12T22:32:42.714 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.714 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.714 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:42.714 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418371+0000", 2024-09-12T22:32:42.714 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0079098380000000006 2024-09-12T22:32:42.714 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.714 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.714 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:42.714 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418443+0000", 2024-09-12T22:32:42.714 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2705000000000003e-05 2024-09-12T22:32:42.714 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.714 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.714 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:42.715 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418493+0000", 2024-09-12T22:32:42.715 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9322e-05 2024-09-12T22:32:42.715 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:42.715 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:42.715 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:42.715 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.715 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.715 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:42.715 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.401939+0000", 2024-09-12T22:32:42.715 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 65.260072405000003, 2024-09-12T22:32:42.715 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016722292999999999, 2024-09-12T22:32:42.715 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:42.715 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:42.716 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:42.716 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:42.716 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.716 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:42.716 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401939+0000", 2024-09-12T22:32:42.716 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:42.716 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.716 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.716 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:42.716 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401939+0000", 2024-09-12T22:32:42.716 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:42.716 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.716 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.717 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:42.717 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401940+0000", 2024-09-12T22:32:42.717 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1990000000000001e-06 2024-09-12T22:32:42.717 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.717 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.717 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:42.717 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401956+0000", 2024-09-12T22:32:42.717 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.6344000000000001e-05 2024-09-12T22:32:42.717 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.717 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.717 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:42.717 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401974+0000", 2024-09-12T22:32:42.717 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7730000000000001e-05 2024-09-12T22:32:42.717 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.718 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.718 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:42.718 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401982+0000", 2024-09-12T22:32:42.718 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.7800000000000001e-06 2024-09-12T22:32:42.718 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.718 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.718 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:42.718 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406557+0000", 2024-09-12T22:32:42.718 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0045758489999999999 2024-09-12T22:32:42.718 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.718 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.718 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:42.718 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406697+0000", 2024-09-12T22:32:42.719 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013925100000000001 2024-09-12T22:32:42.719 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.719 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.719 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:42.719 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406830+0000", 2024-09-12T22:32:42.719 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013293499999999999 2024-09-12T22:32:42.719 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.719 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.719 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:42.719 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410465+0000", 2024-09-12T22:32:42.719 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0036352680000000001 2024-09-12T22:32:42.719 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.719 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.719 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:42.719 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418564+0000", 2024-09-12T22:32:42.720 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0080992140000000004 2024-09-12T22:32:42.720 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.720 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.720 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:42.720 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418621+0000", 2024-09-12T22:32:42.720 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7167999999999999e-05 2024-09-12T22:32:42.720 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.720 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.720 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:42.720 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418661+0000", 2024-09-12T22:32:42.720 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9555000000000003e-05 2024-09-12T22:32:42.720 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:42.720 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:42.720 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:42.721 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.721 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.721 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:42.721 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.401994+0000", 2024-09-12T22:32:42.721 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 65.260016532999998, 2024-09-12T22:32:42.721 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016804109000000001, 2024-09-12T22:32:42.721 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:42.721 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:42.721 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:42.721 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:42.721 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.721 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:42.721 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401994+0000", 2024-09-12T22:32:42.722 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:42.722 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.722 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.722 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:42.722 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401994+0000", 2024-09-12T22:32:42.722 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:42.722 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.722 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.722 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:42.722 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401995+0000", 2024-09-12T22:32:42.722 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.8899999999999998e-07 2024-09-12T22:32:42.722 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.722 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.722 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:42.723 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402000+0000", 2024-09-12T22:32:42.723 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.498e-06 2024-09-12T22:32:42.723 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.723 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.723 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:42.723 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402007+0000", 2024-09-12T22:32:42.723 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.554e-06 2024-09-12T22:32:42.723 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.723 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.723 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:42.723 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402046+0000", 2024-09-12T22:32:42.723 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9156000000000003e-05 2024-09-12T22:32:42.723 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.723 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.724 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:42.724 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407342+0000", 2024-09-12T22:32:42.724 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052957610000000004 2024-09-12T22:32:42.724 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.724 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.724 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:42.724 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407521+0000", 2024-09-12T22:32:42.724 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00017878100000000001 2024-09-12T22:32:42.724 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.724 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.724 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:42.724 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407641+0000", 2024-09-12T22:32:42.724 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012013 2024-09-12T22:32:42.725 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.725 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.725 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:42.725 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410472+0000", 2024-09-12T22:32:42.725 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.002830455 2024-09-12T22:32:42.725 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.725 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.725 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:42.725 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418714+0000", 2024-09-12T22:32:42.725 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0082422789999999999 2024-09-12T22:32:42.725 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.725 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.725 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:42.725 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418761+0000", 2024-09-12T22:32:42.726 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6956999999999998e-05 2024-09-12T22:32:42.726 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.726 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.726 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:42.726 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418799+0000", 2024-09-12T22:32:42.726 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7749000000000001e-05 2024-09-12T22:32:42.726 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:42.726 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:42.726 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:42.726 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.726 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.726 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:42.726 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.402060+0000", 2024-09-12T22:32:42.726 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 65.259951088999998, 2024-09-12T22:32:42.727 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016885686, 2024-09-12T22:32:42.727 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:42.727 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:42.727 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:42.727 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:42.727 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.727 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:42.727 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402060+0000", 2024-09-12T22:32:42.727 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:42.727 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.727 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.727 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:42.727 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402060+0000", 2024-09-12T22:32:42.727 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:42.728 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.728 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.728 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:42.728 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402061+0000", 2024-09-12T22:32:42.728 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4399999999999999e-07 2024-09-12T22:32:42.728 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.728 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.728 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:42.728 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402066+0000", 2024-09-12T22:32:42.728 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8649999999999998e-06 2024-09-12T22:32:42.728 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.728 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.728 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:42.729 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402146+0000", 2024-09-12T22:32:42.729 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9054000000000006e-05 2024-09-12T22:32:42.729 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.729 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.729 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:42.729 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402287+0000", 2024-09-12T22:32:42.729 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014108600000000001 2024-09-12T22:32:42.729 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.729 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.729 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:42.729 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408185+0000", 2024-09-12T22:32:42.729 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0058983919999999997 2024-09-12T22:32:42.729 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.729 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.730 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:42.730 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408299+0000", 2024-09-12T22:32:42.730 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114102 2024-09-12T22:32:42.730 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.730 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.730 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:42.730 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408420+0000", 2024-09-12T22:32:42.730 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000120492 2024-09-12T22:32:42.730 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.730 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.730 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:42.730 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410867+0000", 2024-09-12T22:32:42.730 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0024476430000000002 2024-09-12T22:32:42.731 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.731 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.731 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:42.731 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418851+0000", 2024-09-12T22:32:42.731 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0079841489999999994 2024-09-12T22:32:42.731 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.731 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.731 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:42.731 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418894+0000", 2024-09-12T22:32:42.731 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3090000000000002e-05 2024-09-12T22:32:42.731 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.731 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.731 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:42.731 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418946+0000", 2024-09-12T22:32:42.732 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1069000000000002e-05 2024-09-12T22:32:42.732 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:42.732 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:42.732 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:42.732 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.732 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.732 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:42.732 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.402375+0000", 2024-09-12T22:32:42.732 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 65.259636024000002, 2024-09-12T22:32:42.732 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016768531999999999, 2024-09-12T22:32:42.732 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:42.732 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:42.732 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:42.732 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:42.733 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.733 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:42.733 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402375+0000", 2024-09-12T22:32:42.733 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:42.733 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.733 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.733 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:42.733 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402375+0000", 2024-09-12T22:32:42.733 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:42.733 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.733 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.733 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:42.733 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402375+0000", 2024-09-12T22:32:42.733 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4099999999999999e-07 2024-09-12T22:32:42.734 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.734 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.734 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:42.734 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402379+0000", 2024-09-12T22:32:42.734 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9870000000000001e-06 2024-09-12T22:32:42.734 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.734 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.734 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:42.734 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402389+0000", 2024-09-12T22:32:42.734 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0000000000000001e-05 2024-09-12T22:32:42.734 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.734 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.734 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:42.735 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402401+0000", 2024-09-12T22:32:42.735 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.148e-05 2024-09-12T22:32:42.735 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.735 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.735 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:42.735 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409108+0000", 2024-09-12T22:32:42.735 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0067068429999999997 2024-09-12T22:32:42.735 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.735 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.735 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:42.735 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409189+0000", 2024-09-12T22:32:42.735 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0815999999999993e-05 2024-09-12T22:32:42.735 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.736 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.736 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:42.736 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409320+0000", 2024-09-12T22:32:42.736 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000131586 2024-09-12T22:32:42.736 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.736 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.736 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:42.736 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410872+0000", 2024-09-12T22:32:42.736 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0015521599999999999 2024-09-12T22:32:42.736 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.736 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.736 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:42.736 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419049+0000", 2024-09-12T22:32:42.737 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0081763719999999995 2024-09-12T22:32:42.737 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.737 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.737 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:42.737 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419107+0000", 2024-09-12T22:32:42.737 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7899000000000002e-05 2024-09-12T22:32:42.737 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.737 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.737 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:42.737 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419143+0000", 2024-09-12T22:32:42.737 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6847999999999997e-05 2024-09-12T22:32:42.737 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:42.737 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:42.737 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:42.738 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.738 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.738 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:42.738 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.402903+0000", 2024-09-12T22:32:42.738 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 65.259107611999994, 2024-09-12T22:32:42.738 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016378428, 2024-09-12T22:32:42.738 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:42.738 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:42.738 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:42.738 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:42.738 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.738 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:42.738 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402903+0000", 2024-09-12T22:32:42.738 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:42.739 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.739 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.739 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:42.739 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402903+0000", 2024-09-12T22:32:42.739 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:42.739 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.739 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.739 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:42.739 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402904+0000", 2024-09-12T22:32:42.739 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9500000000000001e-07 2024-09-12T22:32:42.739 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.739 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.739 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:42.739 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402944+0000", 2024-09-12T22:32:42.740 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0265000000000002e-05 2024-09-12T22:32:42.740 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.740 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.740 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:42.740 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402979+0000", 2024-09-12T22:32:42.740 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4378000000000002e-05 2024-09-12T22:32:42.740 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.740 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.740 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:42.740 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402987+0000", 2024-09-12T22:32:42.740 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3559999999999993e-06 2024-09-12T22:32:42.740 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.740 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.741 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:42.741 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409577+0000", 2024-09-12T22:32:42.741 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0065901709999999997 2024-09-12T22:32:42.741 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.741 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.741 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:42.741 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409653+0000", 2024-09-12T22:32:42.741 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5819e-05 2024-09-12T22:32:42.741 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.741 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.741 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:42.741 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409725+0000", 2024-09-12T22:32:42.741 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2200000000000007e-05 2024-09-12T22:32:42.741 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.742 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.742 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:42.742 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.411234+0000", 2024-09-12T22:32:42.742 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001508225 2024-09-12T22:32:42.742 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.742 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.742 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:42.742 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419212+0000", 2024-09-12T22:32:42.742 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0079783400000000004 2024-09-12T22:32:42.742 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.742 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.742 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:42.742 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419244+0000", 2024-09-12T22:32:42.742 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2384e-05 2024-09-12T22:32:42.743 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.743 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.743 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:42.743 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419282+0000", 2024-09-12T22:32:42.743 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7394999999999997e-05 2024-09-12T22:32:42.743 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:42.743 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:42.743 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:42.743 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.743 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.743 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:42.743 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.403135+0000", 2024-09-12T22:32:42.743 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 65.258875742000001, 2024-09-12T22:32:42.744 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016294211999999999, 2024-09-12T22:32:42.744 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:42.744 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:42.744 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:42.744 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:42.744 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.744 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:42.744 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403135+0000", 2024-09-12T22:32:42.744 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:42.744 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.744 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.744 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:42.744 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403135+0000", 2024-09-12T22:32:42.745 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:42.745 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.745 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.745 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:42.745 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403136+0000", 2024-09-12T22:32:42.745 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.4e-07 2024-09-12T22:32:42.745 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.745 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.745 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:42.745 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403149+0000", 2024-09-12T22:32:42.745 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2723e-05 2024-09-12T22:32:42.745 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.745 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.746 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:42.746 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403158+0000", 2024-09-12T22:32:42.746 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3919999999999992e-06 2024-09-12T22:32:42.746 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.746 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.746 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:42.746 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403166+0000", 2024-09-12T22:32:42.746 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.2309999999999996e-06 2024-09-12T22:32:42.746 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.746 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.746 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:42.746 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409944+0000", 2024-09-12T22:32:42.746 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0067775309999999998 2024-09-12T22:32:42.746 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.747 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.747 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:42.747 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410032+0000", 2024-09-12T22:32:42.747 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.7906999999999997e-05 2024-09-12T22:32:42.747 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.747 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.747 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:42.747 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410152+0000", 2024-09-12T22:32:42.747 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012037800000000001 2024-09-12T22:32:42.747 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.747 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.747 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:42.747 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.411945+0000", 2024-09-12T22:32:42.747 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0017931850000000001 2024-09-12T22:32:42.748 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.748 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.748 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:42.748 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419319+0000", 2024-09-12T22:32:42.748 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0073731780000000002 2024-09-12T22:32:42.748 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.748 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.748 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:42.748 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419376+0000", 2024-09-12T22:32:42.748 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7728e-05 2024-09-12T22:32:42.749 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.749 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.749 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:42.749 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419429+0000", 2024-09-12T22:32:42.749 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3019000000000002e-05 2024-09-12T22:32:42.749 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:42.749 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:42.749 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:42.749 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.749 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.749 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:42.750 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.403185+0000", 2024-09-12T22:32:42.750 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 65.258825861000005, 2024-09-12T22:32:42.750 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.014902164000000001, 2024-09-12T22:32:42.750 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:42.750 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:42.750 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:42.750 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:42.750 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.750 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:42.750 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403185+0000", 2024-09-12T22:32:42.750 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:42.750 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.751 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.751 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:42.751 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403185+0000", 2024-09-12T22:32:42.751 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:42.752 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.752 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.752 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:42.752 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403186+0000", 2024-09-12T22:32:42.752 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9400000000000005e-07 2024-09-12T22:32:42.752 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.752 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.752 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:42.752 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403191+0000", 2024-09-12T22:32:42.752 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6980000000000003e-06 2024-09-12T22:32:42.753 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.753 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.753 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:42.753 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403199+0000", 2024-09-12T22:32:42.753 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2520000000000002e-06 2024-09-12T22:32:42.753 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.753 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.753 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:42.753 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403205+0000", 2024-09-12T22:32:42.753 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.908e-06 2024-09-12T22:32:42.753 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.753 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.753 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:42.753 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403359+0000", 2024-09-12T22:32:42.754 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000154544 2024-09-12T22:32:42.754 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.754 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.754 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:42.754 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403528+0000", 2024-09-12T22:32:42.754 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000168455 2024-09-12T22:32:42.754 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.754 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.754 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:42.754 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403763+0000", 2024-09-12T22:32:42.754 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00023539599999999999 2024-09-12T22:32:42.754 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.754 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.754 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:42.755 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409378+0000", 2024-09-12T22:32:42.755 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056150000000000002 2024-09-12T22:32:42.755 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.755 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.755 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:42.755 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418012+0000", 2024-09-12T22:32:42.755 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0086339559999999999 2024-09-12T22:32:42.755 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.755 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.755 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:42.755 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418046+0000", 2024-09-12T22:32:42.755 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4267999999999998e-05 2024-09-12T22:32:42.755 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.755 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.756 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:42.756 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418087+0000", 2024-09-12T22:32:42.756 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0992999999999999e-05 2024-09-12T22:32:42.756 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:42.756 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:42.756 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:42.756 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.756 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.756 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:42.756 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.403273+0000", 2024-09-12T22:32:42.756 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 65.258737909999994, 2024-09-12T22:32:42.756 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.014934866, 2024-09-12T22:32:42.756 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:42.757 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:42.757 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:42.757 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:42.757 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.757 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:42.757 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403273+0000", 2024-09-12T22:32:42.757 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:42.757 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.757 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.757 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:42.757 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403273+0000", 2024-09-12T22:32:42.757 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:42.757 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.757 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.758 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:42.758 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403274+0000", 2024-09-12T22:32:42.758 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.297e-06 2024-09-12T22:32:42.758 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.758 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.758 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:42.758 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403282+0000", 2024-09-12T22:32:42.758 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6340000000000001e-06 2024-09-12T22:32:42.758 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.758 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.758 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:42.758 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403305+0000", 2024-09-12T22:32:42.758 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3149000000000001e-05 2024-09-12T22:32:42.758 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.759 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.759 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:42.759 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403320+0000", 2024-09-12T22:32:42.759 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4527e-05 2024-09-12T22:32:42.759 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.759 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.759 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:42.759 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.404928+0000", 2024-09-12T22:32:42.759 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001608459 2024-09-12T22:32:42.759 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.759 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.759 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:42.759 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405218+0000", 2024-09-12T22:32:42.759 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00028982900000000002 2024-09-12T22:32:42.760 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.760 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.760 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:42.760 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405829+0000", 2024-09-12T22:32:42.760 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00061127900000000005 2024-09-12T22:32:42.760 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.760 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.760 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:42.760 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409403+0000", 2024-09-12T22:32:42.760 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.003573597 2024-09-12T22:32:42.760 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.760 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.760 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:42.760 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418138+0000", 2024-09-12T22:32:42.761 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0087349969999999996 2024-09-12T22:32:42.761 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.761 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.761 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:42.761 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418178+0000", 2024-09-12T22:32:42.761 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0649999999999999e-05 2024-09-12T22:32:42.761 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.761 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.761 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:42.761 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418208+0000", 2024-09-12T22:32:42.761 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9448e-05 2024-09-12T22:32:42.761 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:42.761 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:42.761 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:42.762 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.762 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.762 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:42.762 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.405456+0000", 2024-09-12T22:32:42.762 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 65.256554765000004, 2024-09-12T22:32:42.762 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012888389, 2024-09-12T22:32:42.762 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:42.762 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:42.762 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:42.762 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:42.762 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.762 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:42.762 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405456+0000", 2024-09-12T22:32:42.763 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:42.763 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.763 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.763 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:42.763 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405456+0000", 2024-09-12T22:32:42.763 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:42.763 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.763 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.763 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:42.763 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405457+0000", 2024-09-12T22:32:42.763 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.6599999999999994e-07 2024-09-12T22:32:42.763 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.763 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.763 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:42.764 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405463+0000", 2024-09-12T22:32:42.764 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4739999999999996e-06 2024-09-12T22:32:42.764 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.764 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.764 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:42.764 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405474+0000", 2024-09-12T22:32:42.764 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1095e-05 2024-09-12T22:32:42.764 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.764 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.764 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:42.764 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405482+0000", 2024-09-12T22:32:42.764 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3610000000000001e-06 2024-09-12T22:32:42.764 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.764 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.765 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:42.765 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407051+0000", 2024-09-12T22:32:42.765 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0015688970000000001 2024-09-12T22:32:42.765 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.765 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.765 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:42.765 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407259+0000", 2024-09-12T22:32:42.765 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00020778300000000001 2024-09-12T22:32:42.765 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.765 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.765 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:42.765 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407622+0000", 2024-09-12T22:32:42.765 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000363066 2024-09-12T22:32:42.766 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.766 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.766 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:42.766 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409438+0000", 2024-09-12T22:32:42.766 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001816319 2024-09-12T22:32:42.766 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.766 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.766 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:42.766 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418257+0000", 2024-09-12T22:32:42.766 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0088187720000000008 2024-09-12T22:32:42.766 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.766 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.766 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:42.766 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418308+0000", 2024-09-12T22:32:42.767 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1180000000000001e-05 2024-09-12T22:32:42.767 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.767 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.767 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:42.767 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418345+0000", 2024-09-12T22:32:42.767 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6476000000000001e-05 2024-09-12T22:32:42.767 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:42.767 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:42.767 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:42.767 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.767 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.767 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:42.767 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.405496+0000", 2024-09-12T22:32:42.767 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 65.256515407999999, 2024-09-12T22:32:42.768 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013016012, 2024-09-12T22:32:42.768 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:42.768 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:42.768 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:42.768 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:42.768 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.768 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:42.768 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405496+0000", 2024-09-12T22:32:42.768 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:42.768 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.768 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.768 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:42.768 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405496+0000", 2024-09-12T22:32:42.769 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:42.769 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.769 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.769 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:42.769 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405496+0000", 2024-09-12T22:32:42.769 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7999999999999995e-07 2024-09-12T22:32:42.769 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.769 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.769 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:42.769 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405501+0000", 2024-09-12T22:32:42.769 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8359999999999999e-06 2024-09-12T22:32:42.769 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.769 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.769 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:42.770 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405514+0000", 2024-09-12T22:32:42.770 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2522e-05 2024-09-12T22:32:42.770 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.770 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.770 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:42.770 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405521+0000", 2024-09-12T22:32:42.770 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5020000000000003e-06 2024-09-12T22:32:42.770 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.770 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.770 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:42.770 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405575+0000", 2024-09-12T22:32:42.770 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4169999999999998e-05 2024-09-12T22:32:42.770 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.771 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.771 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:42.771 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405697+0000", 2024-09-12T22:32:42.771 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000121301 2024-09-12T22:32:42.771 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.771 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.771 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:42.771 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405829+0000", 2024-09-12T22:32:42.771 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000132662 2024-09-12T22:32:42.771 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.771 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.771 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:42.771 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409155+0000", 2024-09-12T22:32:42.771 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0033259050000000001 2024-09-12T22:32:42.772 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.772 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.772 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:42.772 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418425+0000", 2024-09-12T22:32:42.772 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0092696319999999999 2024-09-12T22:32:42.772 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.772 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.772 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:42.772 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418471+0000", 2024-09-12T22:32:42.772 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6213e-05 2024-09-12T22:32:42.772 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.772 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.772 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:42.772 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418512+0000", 2024-09-12T22:32:42.773 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0589000000000001e-05 2024-09-12T22:32:42.773 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:42.773 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:42.773 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:42.773 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.773 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.773 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:42.773 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.406108+0000", 2024-09-12T22:32:42.773 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 65.255903011000001, 2024-09-12T22:32:42.773 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012458175, 2024-09-12T22:32:42.773 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:42.773 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:42.773 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:42.774 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:42.774 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.774 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:42.774 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406108+0000", 2024-09-12T22:32:42.774 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:42.774 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.774 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.774 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:42.774 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406108+0000", 2024-09-12T22:32:42.774 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:42.774 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.774 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.774 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:42.774 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406109+0000", 2024-09-12T22:32:42.775 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9899999999999999e-07 2024-09-12T22:32:42.775 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.775 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.775 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:42.775 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406115+0000", 2024-09-12T22:32:42.775 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9030000000000001e-06 2024-09-12T22:32:42.775 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.775 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.775 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:42.775 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406141+0000", 2024-09-12T22:32:42.775 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5999e-05 2024-09-12T22:32:42.775 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.775 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.776 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:42.776 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406150+0000", 2024-09-12T22:32:42.776 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.6050000000000004e-06 2024-09-12T22:32:42.776 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.776 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.776 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:42.776 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408163+0000", 2024-09-12T22:32:42.776 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0020122769999999998 2024-09-12T22:32:42.776 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.776 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.776 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:42.776 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408309+0000", 2024-09-12T22:32:42.776 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014606999999999999 2024-09-12T22:32:42.776 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.777 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.777 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:42.777 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408433+0000", 2024-09-12T22:32:42.777 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012460300000000001 2024-09-12T22:32:42.777 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.777 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.777 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:42.777 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409903+0000", 2024-09-12T22:32:42.777 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001469499 2024-09-12T22:32:42.777 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.777 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.777 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:42.777 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418427+0000", 2024-09-12T22:32:42.778 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0085241139999999993 2024-09-12T22:32:42.778 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.778 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.778 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:42.778 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418471+0000", 2024-09-12T22:32:42.778 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4474000000000001e-05 2024-09-12T22:32:42.778 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.778 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.778 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:42.778 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418566+0000", 2024-09-12T22:32:42.778 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.4732e-05 2024-09-12T22:32:42.778 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:42.778 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:42.778 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:42.779 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.779 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.779 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:42.779 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.407266+0000", 2024-09-12T22:32:42.779 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 65.254745154999995, 2024-09-12T22:32:42.779 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011442905, 2024-09-12T22:32:42.779 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:42.779 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:42.779 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2024-09-12T22:32:42.779 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:42.779 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.779 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:42.779 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407266+0000", 2024-09-12T22:32:42.780 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:42.780 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.780 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.780 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:42.780 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407266+0000", 2024-09-12T22:32:42.780 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:42.780 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.780 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.780 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:42.780 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407266+0000", 2024-09-12T22:32:42.780 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7899999999999998e-07 2024-09-12T22:32:42.780 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.780 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.781 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:42.781 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407269+0000", 2024-09-12T22:32:42.781 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9210000000000001e-06 2024-09-12T22:32:42.781 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.781 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.781 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:42.781 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407331+0000", 2024-09-12T22:32:42.781 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1376000000000003e-05 2024-09-12T22:32:42.781 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.781 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.781 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:42.781 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407337+0000", 2024-09-12T22:32:42.781 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1929999999999998e-06 2024-09-12T22:32:42.782 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.782 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.782 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:42.782 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408974+0000", 2024-09-12T22:32:42.782 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0016367109999999999 2024-09-12T22:32:42.782 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.782 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.782 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:42.782 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409112+0000", 2024-09-12T22:32:42.782 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000137952 2024-09-12T22:32:42.782 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:42.782 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:42.782 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:42.782 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418709+0000", 2024-09-12T22:32:42.783 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0095971730000000005 2024-09-12T22:32:42.783 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:42.783 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:42.783 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:42.783 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:42.783 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:42.783 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-09-12T22:32:42.784 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:42.783+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:42.785 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:32:42.886 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:42.884+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:42.889 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:32:42.889 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:32:42.889 INFO:teuthology.orchestra.run.smithi148.stdout: "num_ops": 0 2024-09-12T22:32:42.889 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:32:42.899 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:32:42.986 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:42.985+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:43.002 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:32:43.002 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:32:43.002 INFO:teuthology.orchestra.run.smithi148.stdout: "complaint_time": 30, 2024-09-12T22:32:43.002 INFO:teuthology.orchestra.run.smithi148.stdout: "num_blocked_ops": 0 2024-09-12T22:32:43.003 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:32:43.012 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:32:43.088 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:43.087+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:43.156 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:32:43.157 INFO:teuthology.orchestra.run.smithi148.stdout: "size": 20, 2024-09-12T22:32:43.157 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 600, 2024-09-12T22:32:43.157 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [ 2024-09-12T22:32:43.157 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.157 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:43.157 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.400880+0000", 2024-09-12T22:32:43.157 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 65.753711187999997, 2024-09-12T22:32:43.157 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0095133660000000005, 2024-09-12T22:32:43.157 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:43.157 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:43.157 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:43.157 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:43.157 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.157 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:43.158 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400880+0000", 2024-09-12T22:32:43.158 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:43.158 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.158 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.158 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:43.158 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400880+0000", 2024-09-12T22:32:43.158 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:43.158 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.158 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.158 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:43.158 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400892+0000", 2024-09-12T22:32:43.158 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1941e-05 2024-09-12T22:32:43.158 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.159 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.159 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:43.159 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400900+0000", 2024-09-12T22:32:43.159 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0080000000000002e-06 2024-09-12T22:32:43.159 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.159 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.159 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:43.159 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400911+0000", 2024-09-12T22:32:43.159 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1452e-05 2024-09-12T22:32:43.159 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.159 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.159 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:43.159 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400922+0000", 2024-09-12T22:32:43.159 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0772e-05 2024-09-12T22:32:43.160 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.160 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.160 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:43.160 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401009+0000", 2024-09-12T22:32:43.160 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.7206000000000005e-05 2024-09-12T22:32:43.160 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.160 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.160 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:43.160 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401157+0000", 2024-09-12T22:32:43.160 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014831499999999999 2024-09-12T22:32:43.160 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.160 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.160 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:43.160 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401312+0000", 2024-09-12T22:32:43.161 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00015495600000000001 2024-09-12T22:32:43.161 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.161 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.161 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:43.161 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.403060+0000", 2024-09-12T22:32:43.161 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0017475220000000001 2024-09-12T22:32:43.161 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.161 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.161 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:43.161 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410300+0000", 2024-09-12T22:32:43.161 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0072403260000000001 2024-09-12T22:32:43.161 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.161 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.161 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:43.162 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410350+0000", 2024-09-12T22:32:43.162 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9814000000000001e-05 2024-09-12T22:32:43.162 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.162 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.162 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:43.162 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410393+0000", 2024-09-12T22:32:43.162 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3053999999999998e-05 2024-09-12T22:32:43.162 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:43.162 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:43.162 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:43.162 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.162 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.162 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:43.162 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.400952+0000", 2024-09-12T22:32:43.163 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 65.753639035999996, 2024-09-12T22:32:43.163 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0096045620000000005, 2024-09-12T22:32:43.163 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:43.163 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:43.163 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:43.163 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:43.163 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.163 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:43.163 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400952+0000", 2024-09-12T22:32:43.163 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:43.163 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.163 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.163 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:43.163 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400952+0000", 2024-09-12T22:32:43.164 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:43.164 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.164 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.164 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:43.164 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400953+0000", 2024-09-12T22:32:43.164 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.8000000000000005e-07 2024-09-12T22:32:43.164 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.164 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.164 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:43.164 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400957+0000", 2024-09-12T22:32:43.164 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.33e-06 2024-09-12T22:32:43.164 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.164 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.164 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:43.165 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400966+0000", 2024-09-12T22:32:43.165 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1989999999999995e-06 2024-09-12T22:32:43.165 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.165 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.165 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:43.165 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400973+0000", 2024-09-12T22:32:43.165 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2779999999999999e-06 2024-09-12T22:32:43.165 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.165 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.165 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:43.165 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401696+0000", 2024-09-12T22:32:43.165 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00072363500000000003 2024-09-12T22:32:43.165 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.166 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.166 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:43.166 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401788+0000", 2024-09-12T22:32:43.166 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1862999999999998e-05 2024-09-12T22:32:43.166 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.166 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.166 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:43.166 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401929+0000", 2024-09-12T22:32:43.166 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014096000000000001 2024-09-12T22:32:43.166 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.166 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.166 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:43.166 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.403542+0000", 2024-09-12T22:32:43.166 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001612963 2024-09-12T22:32:43.166 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.167 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.167 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:43.167 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410460+0000", 2024-09-12T22:32:43.167 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0069180500000000002 2024-09-12T22:32:43.167 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.167 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.167 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:43.167 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410515+0000", 2024-09-12T22:32:43.167 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5009000000000001e-05 2024-09-12T22:32:43.167 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.167 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.167 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:43.167 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410557+0000", 2024-09-12T22:32:43.167 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1495000000000002e-05 2024-09-12T22:32:43.168 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:43.168 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:43.168 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:43.168 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.168 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.168 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:43.168 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.400984+0000", 2024-09-12T22:32:43.168 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 65.753606540999996, 2024-09-12T22:32:43.168 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0073703950000000001, 2024-09-12T22:32:43.168 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:43.168 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:43.168 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:43.168 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:43.169 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.169 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:43.169 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400984+0000", 2024-09-12T22:32:43.169 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:43.169 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.169 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.169 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:43.169 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400984+0000", 2024-09-12T22:32:43.169 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:43.169 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.169 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.169 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:43.169 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400985+0000", 2024-09-12T22:32:43.169 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3200000000000005e-07 2024-09-12T22:32:43.170 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.170 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.170 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:43.170 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400998+0000", 2024-09-12T22:32:43.170 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2726e-05 2024-09-12T22:32:43.170 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.170 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.170 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:43.170 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401006+0000", 2024-09-12T22:32:43.170 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.3110000000000006e-06 2024-09-12T22:32:43.170 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.170 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.170 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:43.170 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401022+0000", 2024-09-12T22:32:43.171 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6249e-05 2024-09-12T22:32:43.171 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.171 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.171 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:43.171 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401700+0000", 2024-09-12T22:32:43.171 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00067811100000000001 2024-09-12T22:32:43.171 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.171 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.171 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:43.171 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401839+0000", 2024-09-12T22:32:43.171 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013865399999999999 2024-09-12T22:32:43.171 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.171 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.172 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:43.172 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401962+0000", 2024-09-12T22:32:43.172 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000123266 2024-09-12T22:32:43.172 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.172 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.172 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:43.172 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.403589+0000", 2024-09-12T22:32:43.172 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001626932 2024-09-12T22:32:43.172 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.172 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.172 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:43.172 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.408274+0000", 2024-09-12T22:32:43.172 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0046848100000000002 2024-09-12T22:32:43.172 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.173 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.173 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:43.173 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.408324+0000", 2024-09-12T22:32:43.173 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9784000000000003e-05 2024-09-12T22:32:43.173 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.173 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.173 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:43.173 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.408355+0000", 2024-09-12T22:32:43.173 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.1019999999999998e-05 2024-09-12T22:32:43.173 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:43.173 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:43.173 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:43.173 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.173 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.174 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:43.174 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401034+0000", 2024-09-12T22:32:43.174 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 65.753557100999998, 2024-09-12T22:32:43.174 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011063051000000001, 2024-09-12T22:32:43.174 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:43.174 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:43.174 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:43.174 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:43.174 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.174 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:43.174 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401034+0000", 2024-09-12T22:32:43.174 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:43.174 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.174 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.175 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:43.175 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401034+0000", 2024-09-12T22:32:43.175 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:43.175 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.175 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.175 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:43.175 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401034+0000", 2024-09-12T22:32:43.175 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8899999999999999e-07 2024-09-12T22:32:43.175 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.175 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.175 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:43.175 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401038+0000", 2024-09-12T22:32:43.175 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.523e-06 2024-09-12T22:32:43.175 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.176 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.176 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:43.176 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401046+0000", 2024-09-12T22:32:43.176 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0479999999999999e-06 2024-09-12T22:32:43.176 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.176 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.176 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:43.176 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401051+0000", 2024-09-12T22:32:43.176 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2619999999999998e-06 2024-09-12T22:32:43.176 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.176 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.176 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:43.176 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402270+0000", 2024-09-12T22:32:43.176 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012182429999999999 2024-09-12T22:32:43.177 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.177 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.177 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:43.177 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402325+0000", 2024-09-12T22:32:43.177 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5526999999999999e-05 2024-09-12T22:32:43.177 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.177 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.177 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:43.177 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402403+0000", 2024-09-12T22:32:43.177 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.7559999999999996e-05 2024-09-12T22:32:43.177 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.177 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.177 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:43.177 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.403655+0000", 2024-09-12T22:32:43.178 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012521489999999999 2024-09-12T22:32:43.178 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.178 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.178 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:43.178 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411979+0000", 2024-09-12T22:32:43.178 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0083240420000000002 2024-09-12T22:32:43.178 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.178 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.178 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:43.178 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.412036+0000", 2024-09-12T22:32:43.178 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7639000000000002e-05 2024-09-12T22:32:43.178 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.178 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.178 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:43.179 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.412097+0000", 2024-09-12T22:32:43.179 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0469e-05 2024-09-12T22:32:43.179 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:43.179 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:43.179 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:43.179 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.179 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.179 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:43.179 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401060+0000", 2024-09-12T22:32:43.179 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 65.753531348999999, 2024-09-12T22:32:43.179 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.010030172, 2024-09-12T22:32:43.179 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:43.179 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:43.179 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:43.180 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:43.180 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.180 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:43.180 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401060+0000", 2024-09-12T22:32:43.180 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:43.180 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.180 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.180 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:43.180 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401060+0000", 2024-09-12T22:32:43.180 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:43.180 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.180 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.180 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:43.180 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401060+0000", 2024-09-12T22:32:43.181 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2500000000000001e-07 2024-09-12T22:32:43.181 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.181 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.181 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:43.181 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401063+0000", 2024-09-12T22:32:43.181 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0910000000000001e-06 2024-09-12T22:32:43.181 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.181 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.181 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:43.181 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401070+0000", 2024-09-12T22:32:43.181 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1210000000000001e-06 2024-09-12T22:32:43.181 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.181 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.182 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:43.182 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401076+0000", 2024-09-12T22:32:43.182 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2830000000000001e-06 2024-09-12T22:32:43.182 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.182 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.182 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:43.182 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402288+0000", 2024-09-12T22:32:43.182 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012123699999999999 2024-09-12T22:32:43.182 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.182 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.182 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:43.182 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402359+0000", 2024-09-12T22:32:43.182 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.0988000000000005e-05 2024-09-12T22:32:43.182 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.183 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.183 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:43.183 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402457+0000", 2024-09-12T22:32:43.183 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.7857999999999997e-05 2024-09-12T22:32:43.183 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.183 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.183 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:43.183 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.404395+0000", 2024-09-12T22:32:43.183 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0019380160000000001 2024-09-12T22:32:43.183 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.184 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.184 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:43.184 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410603+0000", 2024-09-12T22:32:43.184 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.006208061 2024-09-12T22:32:43.184 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.184 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.184 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:43.184 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410687+0000", 2024-09-12T22:32:43.184 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.4623000000000006e-05 2024-09-12T22:32:43.184 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.184 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.185 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:43.185 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411090+0000", 2024-09-12T22:32:43.185 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00040233599999999999 2024-09-12T22:32:43.185 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:43.185 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:43.185 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:43.185 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.185 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.185 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:43.185 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401083+0000", 2024-09-12T22:32:43.185 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 65.753507932999995, 2024-09-12T22:32:43.185 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0097591850000000001, 2024-09-12T22:32:43.185 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:43.185 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:43.186 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:43.186 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:43.186 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.186 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:43.186 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401083+0000", 2024-09-12T22:32:43.186 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:43.186 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.186 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.186 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:43.186 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401083+0000", 2024-09-12T22:32:43.186 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:43.186 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.186 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.187 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:43.187 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401084+0000", 2024-09-12T22:32:43.187 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4799999999999999e-07 2024-09-12T22:32:43.187 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.187 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.187 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:43.187 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401088+0000", 2024-09-12T22:32:43.187 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6419999999999998e-06 2024-09-12T22:32:43.187 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.187 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.187 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:43.187 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401094+0000", 2024-09-12T22:32:43.187 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0090000000000004e-06 2024-09-12T22:32:43.187 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.188 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.188 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:43.188 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401108+0000", 2024-09-12T22:32:43.188 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3884e-05 2024-09-12T22:32:43.188 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.188 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.188 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:43.188 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401165+0000", 2024-09-12T22:32:43.188 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.6499000000000002e-05 2024-09-12T22:32:43.188 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.188 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.188 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:43.188 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401261+0000", 2024-09-12T22:32:43.189 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.6872000000000004e-05 2024-09-12T22:32:43.189 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.189 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.189 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:43.189 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401376+0000", 2024-09-12T22:32:43.189 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000114508 2024-09-12T22:32:43.189 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.189 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.189 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:43.189 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402666+0000", 2024-09-12T22:32:43.189 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012901659999999999 2024-09-12T22:32:43.189 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.189 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.190 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:43.190 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410572+0000", 2024-09-12T22:32:43.190 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0079055489999999996 2024-09-12T22:32:43.190 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.190 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.190 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:43.190 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410661+0000", 2024-09-12T22:32:43.190 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.9578000000000002e-05 2024-09-12T22:32:43.190 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.190 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.190 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:43.190 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410842+0000", 2024-09-12T22:32:43.190 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00018102999999999999 2024-09-12T22:32:43.190 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:43.191 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:43.191 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:43.191 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.191 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.191 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:43.191 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401122+0000", 2024-09-12T22:32:43.191 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 65.753468901000005, 2024-09-12T22:32:43.191 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0099122080000000005, 2024-09-12T22:32:43.191 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:43.191 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:43.191 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:32:43.191 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:43.191 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.191 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:43.192 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401122+0000", 2024-09-12T22:32:43.192 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:43.192 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.192 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.192 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:43.192 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401122+0000", 2024-09-12T22:32:43.192 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:43.192 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.192 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.192 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:43.192 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401123+0000", 2024-09-12T22:32:43.192 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2600000000000002e-07 2024-09-12T22:32:43.192 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.192 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.193 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:43.193 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401126+0000", 2024-09-12T22:32:43.193 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.6449999999999998e-06 2024-09-12T22:32:43.193 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.193 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.193 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:43.193 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401133+0000", 2024-09-12T22:32:43.193 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.9890000000000003e-06 2024-09-12T22:32:43.193 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.193 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.193 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:43.193 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401138+0000", 2024-09-12T22:32:43.193 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8060000000000002e-06 2024-09-12T22:32:43.193 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.194 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.194 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:43.194 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401703+0000", 2024-09-12T22:32:43.194 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00056509099999999999 2024-09-12T22:32:43.194 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.194 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.194 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:43.194 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401837+0000", 2024-09-12T22:32:43.194 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013338799999999999 2024-09-12T22:32:43.194 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.194 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.194 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:43.194 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411034+0000", 2024-09-12T22:32:43.194 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.009197663 2024-09-12T22:32:43.195 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:43.195 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:43.195 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:43.195 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.195 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.195 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:43.195 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401158+0000", 2024-09-12T22:32:43.195 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 65.753433122000004, 2024-09-12T22:32:43.195 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.010292437999999999, 2024-09-12T22:32:43.195 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:43.195 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:43.195 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:32:43.195 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:43.195 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.196 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:43.196 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401158+0000", 2024-09-12T22:32:43.196 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:43.196 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.196 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.196 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:43.196 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401158+0000", 2024-09-12T22:32:43.196 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:43.196 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.196 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.196 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:43.196 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401158+0000", 2024-09-12T22:32:43.196 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9699999999999996e-07 2024-09-12T22:32:43.196 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.197 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.197 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:43.197 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401161+0000", 2024-09-12T22:32:43.197 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.7410000000000001e-06 2024-09-12T22:32:43.197 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.197 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.197 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:43.197 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401168+0000", 2024-09-12T22:32:43.197 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.844e-06 2024-09-12T22:32:43.197 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.197 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.197 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:43.197 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401174+0000", 2024-09-12T22:32:43.197 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4700000000000001e-06 2024-09-12T22:32:43.198 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.198 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.198 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:43.198 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402799+0000", 2024-09-12T22:32:43.198 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0016256409999999999 2024-09-12T22:32:43.198 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.198 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.198 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:43.198 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402893+0000", 2024-09-12T22:32:43.198 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.3807999999999994e-05 2024-09-12T22:32:43.198 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.198 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.198 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:43.199 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411450+0000", 2024-09-12T22:32:43.199 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0085573369999999999 2024-09-12T22:32:43.199 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:43.199 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:43.199 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:43.199 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.199 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.199 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:43.199 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401183+0000", 2024-09-12T22:32:43.199 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 65.753408269999994, 2024-09-12T22:32:43.199 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0068597830000000004, 2024-09-12T22:32:43.199 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:43.199 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:43.199 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:32:43.200 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:43.200 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.200 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:43.200 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401183+0000", 2024-09-12T22:32:43.200 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:43.200 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.200 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.200 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:43.200 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401183+0000", 2024-09-12T22:32:43.200 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:43.200 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.200 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.200 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:43.201 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401183+0000", 2024-09-12T22:32:43.201 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.6700000000000003e-07 2024-09-12T22:32:43.201 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.201 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.201 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:43.201 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401186+0000", 2024-09-12T22:32:43.201 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4679999999999999e-06 2024-09-12T22:32:43.201 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.201 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.201 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:43.201 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401192+0000", 2024-09-12T22:32:43.201 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.1519999999999997e-06 2024-09-12T22:32:43.201 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.201 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.202 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:43.202 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401197+0000", 2024-09-12T22:32:43.202 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4669999999999998e-06 2024-09-12T22:32:43.202 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.202 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.202 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:43.202 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401253+0000", 2024-09-12T22:32:43.202 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.6211000000000001e-05 2024-09-12T22:32:43.202 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.202 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.202 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:43.202 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401413+0000", 2024-09-12T22:32:43.202 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00016021399999999999 2024-09-12T22:32:43.202 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.203 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.203 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:43.203 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.408043+0000", 2024-09-12T22:32:43.203 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0066295039999999996 2024-09-12T22:32:43.203 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:43.203 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:43.203 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:43.203 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.203 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.203 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:20 3.1c e19/17 3:3ed09add:::607.00000000:head v 19'1, mlcod=0'0)", 2024-09-12T22:32:43.203 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.409642+0000", 2024-09-12T22:32:43.203 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 65.744948811, 2024-09-12T22:32:43.203 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0038816269999999999, 2024-09-12T22:32:43.204 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:43.204 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:43.204 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:43.204 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:43.204 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.204 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:43.204 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409642+0000", 2024-09-12T22:32:43.204 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:43.204 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.204 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.204 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:43.204 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409642+0000", 2024-09-12T22:32:43.204 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:43.204 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.205 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.205 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:43.205 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409642+0000", 2024-09-12T22:32:43.205 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.6899999999999999e-07 2024-09-12T22:32:43.205 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.205 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.205 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:43.205 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409648+0000", 2024-09-12T22:32:43.205 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.49e-06 2024-09-12T22:32:43.205 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.205 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.205 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:43.205 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409656+0000", 2024-09-12T22:32:43.205 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.2949999999999994e-06 2024-09-12T22:32:43.206 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.206 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.206 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:43.206 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409664+0000", 2024-09-12T22:32:43.206 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.1219999999999995e-06 2024-09-12T22:32:43.206 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.206 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.206 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:43.206 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409707+0000", 2024-09-12T22:32:43.206 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2222000000000003e-05 2024-09-12T22:32:43.206 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.206 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.206 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:43.207 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409724+0000", 2024-09-12T22:32:43.207 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7496999999999999e-05 2024-09-12T22:32:43.207 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.207 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.207 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:43.207 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413439+0000", 2024-09-12T22:32:43.207 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00371448 2024-09-12T22:32:43.207 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.207 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.207 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:43.207 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413524+0000", 2024-09-12T22:32:43.207 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.5252000000000003e-05 2024-09-12T22:32:43.207 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:43.207 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:43.208 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:43.208 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.208 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.208 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:28 3.13 e19/17 3:cd5a64a3:::100.00000000:head v 19'1, mlcod=0'0)", 2024-09-12T22:32:43.208 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.409681+0000", 2024-09-12T22:32:43.208 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 65.744910328000003, 2024-09-12T22:32:43.208 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0038708710000000001, 2024-09-12T22:32:43.208 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:43.208 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:43.208 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:43.208 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:43.208 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.208 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:43.208 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409681+0000", 2024-09-12T22:32:43.209 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:43.209 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.209 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.209 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:43.209 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409681+0000", 2024-09-12T22:32:43.209 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:43.209 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.209 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.209 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:43.209 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409681+0000", 2024-09-12T22:32:43.209 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3000000000000002e-07 2024-09-12T22:32:43.209 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.209 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.209 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:43.210 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409695+0000", 2024-09-12T22:32:43.210 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4313e-05 2024-09-12T22:32:43.210 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.210 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.210 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:43.210 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409703+0000", 2024-09-12T22:32:43.210 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4000000000000003e-06 2024-09-12T22:32:43.210 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.210 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.210 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:43.210 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409708+0000", 2024-09-12T22:32:43.210 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3190000000000002e-06 2024-09-12T22:32:43.210 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.210 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.211 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:43.211 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409875+0000", 2024-09-12T22:32:43.211 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000167329 2024-09-12T22:32:43.211 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.211 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.211 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:43.211 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409892+0000", 2024-09-12T22:32:43.211 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6957999999999999e-05 2024-09-12T22:32:43.211 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.211 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.211 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:43.211 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413457+0000", 2024-09-12T22:32:43.211 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0035651279999999999 2024-09-12T22:32:43.211 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.212 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.212 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:43.212 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413552+0000", 2024-09-12T22:32:43.212 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.4093999999999997e-05 2024-09-12T22:32:43.212 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:43.212 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:43.212 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:43.212 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.212 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.212 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:21 3.1c e19/17 3:3ed09add:::607.00000000:head v 19'2, mlcod=0'0)", 2024-09-12T22:32:43.212 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.409718+0000", 2024-09-12T22:32:43.212 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 65.744872662999995, 2024-09-12T22:32:43.212 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003851883, 2024-09-12T22:32:43.212 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:43.213 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:43.213 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:43.213 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:43.213 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.213 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:43.213 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409718+0000", 2024-09-12T22:32:43.213 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:43.213 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.213 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.213 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:43.213 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409718+0000", 2024-09-12T22:32:43.213 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:43.214 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.214 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.214 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:43.214 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409719+0000", 2024-09-12T22:32:43.214 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.16e-07 2024-09-12T22:32:43.214 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.214 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.214 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:43.214 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409722+0000", 2024-09-12T22:32:43.214 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.692e-06 2024-09-12T22:32:43.214 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.214 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.214 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:43.214 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409729+0000", 2024-09-12T22:32:43.215 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.516e-06 2024-09-12T22:32:43.215 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.215 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.215 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:43.215 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409750+0000", 2024-09-12T22:32:43.215 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1151000000000001e-05 2024-09-12T22:32:43.215 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.215 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.215 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:43.215 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410015+0000", 2024-09-12T22:32:43.215 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00026477599999999999 2024-09-12T22:32:43.215 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.215 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.215 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:43.216 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410104+0000", 2024-09-12T22:32:43.216 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.9586000000000006e-05 2024-09-12T22:32:43.216 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.216 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.216 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:43.216 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413528+0000", 2024-09-12T22:32:43.216 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0034237880000000001 2024-09-12T22:32:43.216 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.216 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.216 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:43.216 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413570+0000", 2024-09-12T22:32:43.216 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2157999999999999e-05 2024-09-12T22:32:43.216 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:43.216 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:43.217 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:43.217 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.217 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.217 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:27 3.13 e19/17 3:c91d4a1d:::mds0_inotable:head v 19'2, mlcod=0'0)", 2024-09-12T22:32:43.217 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.409760+0000", 2024-09-12T22:32:43.217 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 65.744831146999999, 2024-09-12T22:32:43.217 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0039301910000000004, 2024-09-12T22:32:43.217 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:43.217 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:43.217 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:43.217 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:43.217 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.217 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:43.217 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409760+0000", 2024-09-12T22:32:43.218 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:43.218 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.218 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.218 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:43.218 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409760+0000", 2024-09-12T22:32:43.218 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:43.218 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.218 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.218 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:43.218 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409760+0000", 2024-09-12T22:32:43.218 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.39e-07 2024-09-12T22:32:43.218 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.218 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.219 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:43.219 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409765+0000", 2024-09-12T22:32:43.219 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4449999999999998e-06 2024-09-12T22:32:43.219 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.219 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.219 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:43.219 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409771+0000", 2024-09-12T22:32:43.219 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7159999999999997e-06 2024-09-12T22:32:43.219 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.219 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.219 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:43.219 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409778+0000", 2024-09-12T22:32:43.219 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.331e-06 2024-09-12T22:32:43.219 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.220 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.220 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:43.220 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410191+0000", 2024-09-12T22:32:43.220 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00041348300000000003 2024-09-12T22:32:43.220 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.220 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.220 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:43.220 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410211+0000", 2024-09-12T22:32:43.220 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9933999999999999e-05 2024-09-12T22:32:43.220 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.220 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.220 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:43.220 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413638+0000", 2024-09-12T22:32:43.220 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003426854 2024-09-12T22:32:43.221 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.221 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.221 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:43.221 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413690+0000", 2024-09-12T22:32:43.221 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2089000000000002e-05 2024-09-12T22:32:43.221 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:43.221 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:43.221 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:43.221 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.221 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.221 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "pg_update_log_missing_reply(3.b epoch 19/17 rep_tid 4 lcod 19'2)", 2024-09-12T22:32:43.221 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.410060+0000", 2024-09-12T22:32:43.221 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 65.744531481999999, 2024-09-12T22:32:43.221 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00098016500000000007, 2024-09-12T22:32:43.222 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:43.222 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:43.222 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "reached pg", 2024-09-12T22:32:43.222 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:43.222 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.222 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:43.222 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410060+0000", 2024-09-12T22:32:43.222 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:43.222 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.222 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.222 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:43.222 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410060+0000", 2024-09-12T22:32:43.222 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:43.222 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.223 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.223 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:43.223 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410060+0000", 2024-09-12T22:32:43.223 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.8299999999999998e-07 2024-09-12T22:32:43.223 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.223 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.223 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:43.223 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410062+0000", 2024-09-12T22:32:43.223 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5749999999999999e-06 2024-09-12T22:32:43.223 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.223 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.223 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:43.223 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410070+0000", 2024-09-12T22:32:43.224 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.909e-06 2024-09-12T22:32:43.224 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.224 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.224 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:43.224 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410076+0000", 2024-09-12T22:32:43.224 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7049999999999996e-06 2024-09-12T22:32:43.224 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.224 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.224 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:43.224 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410943+0000", 2024-09-12T22:32:43.224 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00086681900000000001 2024-09-12T22:32:43.224 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.224 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.224 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:43.225 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411040+0000", 2024-09-12T22:32:43.225 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.6774000000000006e-05 2024-09-12T22:32:43.225 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:43.225 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:43.225 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:43.225 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.225 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.225 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e19/17 ondisk, result = 0)", 2024-09-12T22:32:43.225 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.410113+0000", 2024-09-12T22:32:43.225 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 65.744478215000001, 2024-09-12T22:32:43.225 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00098911599999999995, 2024-09-12T22:32:43.225 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:43.225 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:43.226 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:32:43.226 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:43.226 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.226 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:43.226 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410113+0000", 2024-09-12T22:32:43.226 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:43.226 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.226 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.226 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:43.226 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410113+0000", 2024-09-12T22:32:43.226 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:43.226 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.226 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.226 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:43.227 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410113+0000", 2024-09-12T22:32:43.227 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.99e-07 2024-09-12T22:32:43.227 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.227 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.227 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:43.227 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410115+0000", 2024-09-12T22:32:43.227 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.046e-06 2024-09-12T22:32:43.227 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.227 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.227 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:43.227 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410121+0000", 2024-09-12T22:32:43.227 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0050000000000001e-06 2024-09-12T22:32:43.227 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.227 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.228 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:43.228 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410126+0000", 2024-09-12T22:32:43.228 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8339999999999998e-06 2024-09-12T22:32:43.228 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.228 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.228 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:43.228 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410587+0000", 2024-09-12T22:32:43.228 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00046095499999999998 2024-09-12T22:32:43.228 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.228 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.228 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:43.228 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410595+0000", 2024-09-12T22:32:43.228 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.9419999999999995e-06 2024-09-12T22:32:43.229 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.229 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.229 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:43.229 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411102+0000", 2024-09-12T22:32:43.229 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00050713500000000003 2024-09-12T22:32:43.229 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:43.229 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:43.229 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:43.229 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.229 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.229 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 19/17 rep_tid 8 lcod 19'4)", 2024-09-12T22:32:43.229 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.410133+0000", 2024-09-12T22:32:43.229 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 65.744458287, 2024-09-12T22:32:43.229 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0013504000000000001, 2024-09-12T22:32:43.230 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:43.230 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:43.230 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "reached pg", 2024-09-12T22:32:43.230 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:43.230 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.230 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:43.230 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410133+0000", 2024-09-12T22:32:43.230 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:43.230 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.230 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.230 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:43.230 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410133+0000", 2024-09-12T22:32:43.230 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:43.230 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.231 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.231 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:43.231 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410133+0000", 2024-09-12T22:32:43.231 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.0599999999999999e-07 2024-09-12T22:32:43.231 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.231 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.231 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:43.231 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410135+0000", 2024-09-12T22:32:43.231 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7770000000000001e-06 2024-09-12T22:32:43.231 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.231 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.231 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:43.231 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410140+0000", 2024-09-12T22:32:43.231 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9960000000000001e-06 2024-09-12T22:32:43.232 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.232 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.232 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:43.232 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410144+0000", 2024-09-12T22:32:43.232 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9500000000000003e-06 2024-09-12T22:32:43.232 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.232 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.232 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:43.232 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411310+0000", 2024-09-12T22:32:43.232 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001166311 2024-09-12T22:32:43.232 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.232 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.232 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:43.233 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411483+0000", 2024-09-12T22:32:43.233 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00017316 2024-09-12T22:32:43.233 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:43.233 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:43.233 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:43.233 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.233 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.233 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "pg_update_log_missing(3.1a epoch 19/17 rep_tid 0 entries 19'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T22:32:43.233 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.410617+0000", 2024-09-12T22:32:43.233 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 65.743973892, 2024-09-12T22:32:43.233 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0030439709999999999, 2024-09-12T22:32:43.233 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:43.233 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:43.233 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "reached pg", 2024-09-12T22:32:43.234 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:43.234 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.234 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:43.234 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410617+0000", 2024-09-12T22:32:43.234 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:43.234 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.234 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.234 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:43.234 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410617+0000", 2024-09-12T22:32:43.234 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:43.234 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.234 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.234 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:43.234 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410617+0000", 2024-09-12T22:32:43.235 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3599999999999999e-07 2024-09-12T22:32:43.235 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.235 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.235 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:43.235 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410625+0000", 2024-09-12T22:32:43.235 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5410000000000003e-06 2024-09-12T22:32:43.235 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.235 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.235 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:43.235 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410638+0000", 2024-09-12T22:32:43.235 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3261999999999999e-05 2024-09-12T22:32:43.235 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.235 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.235 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:43.236 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410653+0000", 2024-09-12T22:32:43.236 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4844000000000001e-05 2024-09-12T22:32:43.236 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.236 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.236 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:43.236 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410814+0000", 2024-09-12T22:32:43.236 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00016119999999999999 2024-09-12T22:32:43.236 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.236 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.236 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:43.237 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413661+0000", 2024-09-12T22:32:43.237 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0028467879999999998 2024-09-12T22:32:43.237 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:43.237 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:43.237 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:43.237 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.237 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.237 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-09-12T22:32:43.237 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:39.398875+0000", 2024-09-12T22:32:43.237 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 63.755715612000003, 2024-09-12T22:32:43.237 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0015679069999999999, 2024-09-12T22:32:43.237 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:43.237 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:43.238 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:43.238 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:43.238 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.238 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:43.238 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398875+0000", 2024-09-12T22:32:43.238 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:43.238 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.238 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.238 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:43.238 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398875+0000", 2024-09-12T22:32:43.238 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:43.238 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.238 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.238 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:43.239 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398878+0000", 2024-09-12T22:32:43.239 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1679999999999998e-06 2024-09-12T22:32:43.239 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.239 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.239 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:43.239 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398888+0000", 2024-09-12T22:32:43.239 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.084e-05 2024-09-12T22:32:43.239 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.239 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.239 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:43.239 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398906+0000", 2024-09-12T22:32:43.239 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7518000000000001e-05 2024-09-12T22:32:43.239 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.239 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.239 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:43.240 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398914+0000", 2024-09-12T22:32:43.240 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5989999999999996e-06 2024-09-12T22:32:43.240 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.240 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.240 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:43.240 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398974+0000", 2024-09-12T22:32:43.240 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0988e-05 2024-09-12T22:32:43.240 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.240 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.240 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:43.240 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.399078+0000", 2024-09-12T22:32:43.240 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000103133 2024-09-12T22:32:43.240 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.241 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.241 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:43.241 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.399166+0000", 2024-09-12T22:32:43.241 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.8183999999999995e-05 2024-09-12T22:32:43.241 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.241 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.241 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:43.241 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.399747+0000", 2024-09-12T22:32:43.241 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00058110599999999996 2024-09-12T22:32:43.241 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.241 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.241 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:43.241 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.400377+0000", 2024-09-12T22:32:43.241 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000630157 2024-09-12T22:32:43.242 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.242 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.242 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:43.242 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.400415+0000", 2024-09-12T22:32:43.242 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7814000000000001e-05 2024-09-12T22:32:43.242 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.242 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.242 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:43.242 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.400443+0000", 2024-09-12T22:32:43.242 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8399999999999999e-05 2024-09-12T22:32:43.242 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:43.242 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:43.242 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:43.242 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.243 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.243 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e23)", 2024-09-12T22:32:43.243 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:58.400966+0000", 2024-09-12T22:32:43.243 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 44.753624704000003, 2024-09-12T22:32:43.243 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001468876, 2024-09-12T22:32:43.243 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:43.243 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:43.243 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:43.243 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:43.243 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.243 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:43.243 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400966+0000", 2024-09-12T22:32:43.243 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:43.243 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.244 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.244 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:43.244 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400966+0000", 2024-09-12T22:32:43.244 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:43.244 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.244 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.244 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:43.244 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400967+0000", 2024-09-12T22:32:43.244 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.046e-06 2024-09-12T22:32:43.244 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.244 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.244 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:43.244 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400974+0000", 2024-09-12T22:32:43.245 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2310000000000001e-06 2024-09-12T22:32:43.245 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.245 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.245 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:43.245 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400988+0000", 2024-09-12T22:32:43.245 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4482e-05 2024-09-12T22:32:43.245 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.245 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.245 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:43.245 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400997+0000", 2024-09-12T22:32:43.245 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.0189999999999995e-06 2024-09-12T22:32:43.245 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.245 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.245 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:43.246 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.401068+0000", 2024-09-12T22:32:43.246 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1426000000000004e-05 2024-09-12T22:32:43.246 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.246 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.246 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:43.246 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.401174+0000", 2024-09-12T22:32:43.246 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000105769 2024-09-12T22:32:43.246 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.246 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.246 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:43.246 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.401335+0000", 2024-09-12T22:32:43.246 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000161225 2024-09-12T22:32:43.246 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.246 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.247 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:43.247 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.402110+0000", 2024-09-12T22:32:43.247 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00077428800000000004 2024-09-12T22:32:43.247 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.247 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.247 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:43.247 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.402333+0000", 2024-09-12T22:32:43.247 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000223723 2024-09-12T22:32:43.247 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.247 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.247 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:43.247 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.402388+0000", 2024-09-12T22:32:43.247 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4700999999999997e-05 2024-09-12T22:32:43.247 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.248 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.248 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:43.248 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.402435+0000", 2024-09-12T22:32:43.248 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6965999999999997e-05 2024-09-12T22:32:43.248 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:43.248 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:43.248 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:43.248 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.248 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.248 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:45 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e27)", 2024-09-12T22:32:43.248 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:32:04.401614+0000", 2024-09-12T22:32:43.248 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 38.752977274999999, 2024-09-12T22:32:43.248 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0014279749999999999, 2024-09-12T22:32:43.249 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:43.249 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:43.249 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:43.249 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:43.249 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.249 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:43.249 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401614+0000", 2024-09-12T22:32:43.249 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:43.249 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.249 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.249 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:43.249 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401614+0000", 2024-09-12T22:32:43.249 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:43.250 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.250 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.250 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:43.250 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401615+0000", 2024-09-12T22:32:43.250 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.161e-06 2024-09-12T22:32:43.250 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.250 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.250 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:43.250 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401621+0000", 2024-09-12T22:32:43.250 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8730000000000004e-06 2024-09-12T22:32:43.250 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.250 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.250 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:43.250 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401633+0000", 2024-09-12T22:32:43.251 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1800000000000001e-05 2024-09-12T22:32:43.251 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.251 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.251 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:43.251 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401656+0000", 2024-09-12T22:32:43.251 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.3521999999999999e-05 2024-09-12T22:32:43.251 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.251 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.251 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:43.251 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401713+0000", 2024-09-12T22:32:43.251 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7259000000000002e-05 2024-09-12T22:32:43.251 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.251 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.251 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:43.252 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401849+0000", 2024-09-12T22:32:43.252 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013613500000000001 2024-09-12T22:32:43.252 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.252 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.252 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:43.252 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.402009+0000", 2024-09-12T22:32:43.252 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00015947199999999999 2024-09-12T22:32:43.252 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.252 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.252 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:43.252 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.402629+0000", 2024-09-12T22:32:43.252 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00061962200000000001 2024-09-12T22:32:43.252 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.253 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.253 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:43.253 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.402983+0000", 2024-09-12T22:32:43.253 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00035447499999999998 2024-09-12T22:32:43.253 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.253 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.253 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:43.253 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.403016+0000", 2024-09-12T22:32:43.253 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3108999999999998e-05 2024-09-12T22:32:43.253 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:43.254 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:43.254 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:43.254 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.403042+0000", 2024-09-12T22:32:43.254 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5547000000000001e-05 2024-09-12T22:32:43.254 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:43.254 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:43.254 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:43.254 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:43.254 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:43.254 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:32:43.256 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:32:43.256 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:43.254+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:43.356 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:43.355+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:43.364 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-09-12T22:32:43.364 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-09-12T22:32:43.364 INFO:teuthology.orchestra.run.smithi163.stdout: "num_ops": 0 2024-09-12T22:32:43.364 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-09-12T22:32:43.374 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:32:43.457 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:43.456+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:43.476 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-09-12T22:32:43.476 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-09-12T22:32:43.476 INFO:teuthology.orchestra.run.smithi163.stdout: "complaint_time": 30, 2024-09-12T22:32:43.477 INFO:teuthology.orchestra.run.smithi163.stdout: "num_blocked_ops": 0 2024-09-12T22:32:43.477 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-09-12T22:32:43.485 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:32:43.528 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T22:32:43.557 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:43.556+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:43.591 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-09-12T22:32:43.591 INFO:teuthology.orchestra.run.smithi163.stdout: "size": 20, 2024-09-12T22:32:43.591 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 600, 2024-09-12T22:32:43.591 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2024-09-12T22:32:43.591 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:43.591 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-09-12T22:32:43.592 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:27.254459+0000", 2024-09-12T22:32:43.592 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 76.334467918000001, 2024-09-12T22:32:43.592 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.37816283899999997, 2024-09-12T22:32:43.592 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:43.592 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:43.592 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:43.592 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:43.592 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:43.592 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:43.592 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 1 2024-09-12T22:32:43.592 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:43.592 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:43.592 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:43.592 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:43.593 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254459+0000", 2024-09-12T22:32:43.593 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:43.593 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:43.593 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:43.593 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:43.593 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254459+0000", 2024-09-12T22:32:43.593 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:43.593 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:43.593 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:43.593 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:43.593 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254460+0000", 2024-09-12T22:32:43.593 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1739999999999999e-06 2024-09-12T22:32:43.593 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:43.594 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:43.594 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:43.594 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254472+0000", 2024-09-12T22:32:44.006 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2207e-05 2024-09-12T22:32:44.007 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.007 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.007 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:44.007 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254483+0000", 2024-09-12T22:32:44.007 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0631999999999999e-05 2024-09-12T22:32:44.007 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.007 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.007 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:44.007 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254492+0000", 2024-09-12T22:32:44.007 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3670000000000003e-06 2024-09-12T22:32:44.007 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.007 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.008 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:44.008 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254551+0000", 2024-09-12T22:32:44.008 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8687999999999998e-05 2024-09-12T22:32:44.008 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.008 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.008 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for peered", 2024-09-12T22:32:44.008 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254562+0000", 2024-09-12T22:32:44.008 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1249e-05 2024-09-12T22:32:44.008 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.008 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.008 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:44.008 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.631211+0000", 2024-09-12T22:32:44.008 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.376649018 2024-09-12T22:32:44.009 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.009 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.009 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:44.009 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.631345+0000", 2024-09-12T22:32:44.009 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013378700000000001 2024-09-12T22:32:44.009 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.009 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.009 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:44.009 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.631479+0000", 2024-09-12T22:32:44.009 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013352399999999999 2024-09-12T22:32:44.010 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.010 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.010 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:44.010 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632324+0000", 2024-09-12T22:32:44.010 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00084508100000000002 2024-09-12T22:32:44.010 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.010 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.010 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:44.010 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632548+0000", 2024-09-12T22:32:44.010 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000224329 2024-09-12T22:32:44.010 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.010 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.010 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:44.011 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632591+0000", 2024-09-12T22:32:44.011 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2564000000000001e-05 2024-09-12T22:32:44.011 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.011 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.011 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:44.011 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632622+0000", 2024-09-12T22:32:44.011 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1219e-05 2024-09-12T22:32:44.011 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:44.011 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:44.011 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:44.011 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.011 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.011 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:185 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:32:44.011 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394355+0000", 2024-09-12T22:32:44.012 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 75.194571820999997, 2024-09-12T22:32:44.012 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011302394, 2024-09-12T22:32:44.012 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:44.012 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:44.012 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:44.012 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:44.012 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:44.012 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:44.012 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 185 2024-09-12T22:32:44.012 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.012 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:44.012 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.012 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:44.013 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394355+0000", 2024-09-12T22:32:44.013 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:44.013 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.013 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.013 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:44.013 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394355+0000", 2024-09-12T22:32:44.013 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:44.013 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.013 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.013 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:44.013 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394355+0000", 2024-09-12T22:32:44.013 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9099999999999999e-07 2024-09-12T22:32:44.013 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.014 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.014 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:44.014 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394385+0000", 2024-09-12T22:32:44.014 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9963000000000001e-05 2024-09-12T22:32:44.014 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.014 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.014 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:44.014 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394390+0000", 2024-09-12T22:32:44.014 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8420000000000004e-06 2024-09-12T22:32:44.014 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.014 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.014 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:44.014 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394393+0000", 2024-09-12T22:32:44.014 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1e-06 2024-09-12T22:32:44.015 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.015 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.015 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:44.015 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.400546+0000", 2024-09-12T22:32:44.015 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0061523309999999996 2024-09-12T22:32:44.015 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.015 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.015 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:44.015 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.400588+0000", 2024-09-12T22:32:44.015 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1835000000000002e-05 2024-09-12T22:32:44.015 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.015 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.015 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:44.015 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.400677+0000", 2024-09-12T22:32:44.016 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9195000000000002e-05 2024-09-12T22:32:44.016 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.016 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.016 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:44.016 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405378+0000", 2024-09-12T22:32:44.016 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0047008659999999997 2024-09-12T22:32:44.016 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.016 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.016 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:44.016 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405569+0000", 2024-09-12T22:32:44.016 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00019148599999999999 2024-09-12T22:32:44.016 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.016 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.016 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:44.017 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405620+0000", 2024-09-12T22:32:44.017 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1416999999999999e-05 2024-09-12T22:32:44.017 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.017 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.017 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:44.017 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405657+0000", 2024-09-12T22:32:44.017 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6968000000000002e-05 2024-09-12T22:32:44.017 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:44.017 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:44.017 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:44.017 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.017 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.017 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:32:44.018 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394399+0000", 2024-09-12T22:32:44.018 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 75.194527609999994, 2024-09-12T22:32:44.018 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011336601999999999, 2024-09-12T22:32:44.018 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:44.018 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:44.018 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:44.018 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:44.018 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:44.018 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:44.018 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 186 2024-09-12T22:32:44.018 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.019 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:44.019 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.019 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:44.019 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394399+0000", 2024-09-12T22:32:44.019 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:44.019 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.019 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.019 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:44.019 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394399+0000", 2024-09-12T22:32:44.019 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:44.019 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.019 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.019 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:44.020 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394400+0000", 2024-09-12T22:32:44.020 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4499999999999998e-07 2024-09-12T22:32:44.020 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.020 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.020 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:44.020 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394402+0000", 2024-09-12T22:32:44.020 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.875e-06 2024-09-12T22:32:44.020 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.020 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.020 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:44.020 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394405+0000", 2024-09-12T22:32:44.020 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6799999999999999e-06 2024-09-12T22:32:44.020 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.021 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.021 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:44.021 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394408+0000", 2024-09-12T22:32:44.021 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.667e-06 2024-09-12T22:32:44.021 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.021 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.021 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:44.021 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401395+0000", 2024-09-12T22:32:44.021 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0069867230000000002 2024-09-12T22:32:44.021 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.021 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.021 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:44.021 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401438+0000", 2024-09-12T22:32:44.022 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3554999999999999e-05 2024-09-12T22:32:44.022 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.022 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.022 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:44.022 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401509+0000", 2024-09-12T22:32:44.022 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0631999999999997e-05 2024-09-12T22:32:44.022 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.022 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.022 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:44.022 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405392+0000", 2024-09-12T22:32:44.022 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0038830449999999999 2024-09-12T22:32:44.022 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.022 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.022 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:44.023 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405690+0000", 2024-09-12T22:32:44.023 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000298435 2024-09-12T22:32:44.023 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.023 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.023 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:44.023 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405716+0000", 2024-09-12T22:32:44.023 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5435999999999998e-05 2024-09-12T22:32:44.023 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.023 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.023 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:44.023 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405736+0000", 2024-09-12T22:32:44.023 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0208999999999999e-05 2024-09-12T22:32:44.023 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:44.024 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:44.024 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:44.024 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.024 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.024 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:32:44.024 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394411+0000", 2024-09-12T22:32:44.024 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 75.194515483999993, 2024-09-12T22:32:44.024 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011400117, 2024-09-12T22:32:44.024 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:44.024 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:44.024 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:44.024 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:44.024 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:44.024 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:44.025 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 187 2024-09-12T22:32:44.025 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.025 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:44.025 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.025 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:44.025 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394411+0000", 2024-09-12T22:32:44.025 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:44.025 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.025 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.025 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:44.025 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394411+0000", 2024-09-12T22:32:44.025 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:44.025 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.026 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.026 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:44.026 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394412+0000", 2024-09-12T22:32:44.026 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.4999999999999999e-07 2024-09-12T22:32:44.026 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.026 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.026 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:44.026 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394414+0000", 2024-09-12T22:32:44.026 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.984e-06 2024-09-12T22:32:44.026 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.026 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.026 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:44.026 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394418+0000", 2024-09-12T22:32:44.027 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0840000000000002e-06 2024-09-12T22:32:44.027 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.027 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.027 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:44.027 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394431+0000", 2024-09-12T22:32:44.027 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.361e-05 2024-09-12T22:32:44.027 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.027 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.027 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:44.027 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401778+0000", 2024-09-12T22:32:44.027 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0073462659999999997 2024-09-12T22:32:44.027 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.027 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.028 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:44.028 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401853+0000", 2024-09-12T22:32:44.028 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5797000000000006e-05 2024-09-12T22:32:44.028 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.028 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.028 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:44.028 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401990+0000", 2024-09-12T22:32:44.028 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013651399999999999 2024-09-12T22:32:44.028 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.028 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.028 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:44.029 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405402+0000", 2024-09-12T22:32:44.029 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0034116070000000001 2024-09-12T22:32:44.029 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.029 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.029 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:44.029 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405764+0000", 2024-09-12T22:32:44.029 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00036234899999999998 2024-09-12T22:32:44.029 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.029 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.029 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:44.029 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405791+0000", 2024-09-12T22:32:44.029 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7029000000000002e-05 2024-09-12T22:32:44.029 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.030 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.030 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:44.030 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405812+0000", 2024-09-12T22:32:44.030 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0627000000000001e-05 2024-09-12T22:32:44.030 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:44.030 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:44.030 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:44.030 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.030 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.030 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:32:44.030 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394447+0000", 2024-09-12T22:32:44.030 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 75.194480333000001, 2024-09-12T22:32:44.030 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011759588, 2024-09-12T22:32:44.031 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:44.031 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:44.031 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:44.031 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:44.031 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:44.031 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:44.031 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 188 2024-09-12T22:32:44.031 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.031 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:44.031 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.031 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:44.031 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394447+0000", 2024-09-12T22:32:44.031 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:44.031 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.032 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.032 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:44.032 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394447+0000", 2024-09-12T22:32:44.032 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:44.032 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.032 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.032 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:44.032 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394447+0000", 2024-09-12T22:32:44.032 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.15e-07 2024-09-12T22:32:44.032 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.032 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.032 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:44.032 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394512+0000", 2024-09-12T22:32:44.033 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4580999999999997e-05 2024-09-12T22:32:44.033 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.033 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.033 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:44.033 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394518+0000", 2024-09-12T22:32:44.033 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.3380000000000001e-06 2024-09-12T22:32:44.033 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.033 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.033 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:44.033 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394521+0000", 2024-09-12T22:32:44.033 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3340000000000002e-06 2024-09-12T22:32:44.033 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.033 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.033 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:44.034 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.402628+0000", 2024-09-12T22:32:44.034 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.008106996 2024-09-12T22:32:44.034 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.034 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.034 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:44.034 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.402670+0000", 2024-09-12T22:32:44.034 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1983000000000001e-05 2024-09-12T22:32:44.034 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.034 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.034 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:44.034 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.402738+0000", 2024-09-12T22:32:44.034 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.8114999999999994e-05 2024-09-12T22:32:44.034 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.035 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.035 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:44.035 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405668+0000", 2024-09-12T22:32:44.035 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.002929545 2024-09-12T22:32:44.035 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.035 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.035 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:44.035 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406162+0000", 2024-09-12T22:32:44.035 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000494408 2024-09-12T22:32:44.035 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.035 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.035 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:44.035 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406188+0000", 2024-09-12T22:32:44.035 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5766e-05 2024-09-12T22:32:44.036 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.036 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.036 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:44.036 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406206+0000", 2024-09-12T22:32:44.036 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.8107000000000001e-05 2024-09-12T22:32:44.036 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:44.036 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:44.036 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:44.036 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.036 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.036 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:32:44.036 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394528+0000", 2024-09-12T22:32:44.036 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 75.194398664000005, 2024-09-12T22:32:44.036 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.01195536, 2024-09-12T22:32:44.037 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:44.037 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:44.037 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:44.037 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:44.037 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:44.037 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:44.037 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 189 2024-09-12T22:32:44.037 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.037 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:44.037 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.037 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:44.037 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394528+0000", 2024-09-12T22:32:44.037 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:44.038 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.038 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.038 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:44.038 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394528+0000", 2024-09-12T22:32:44.038 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:44.038 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.038 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.038 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:44.038 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394529+0000", 2024-09-12T22:32:44.038 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4900000000000001e-07 2024-09-12T22:32:44.038 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.038 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.038 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:44.038 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394531+0000", 2024-09-12T22:32:44.039 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.458e-06 2024-09-12T22:32:44.039 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.039 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.039 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:44.039 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394535+0000", 2024-09-12T22:32:44.039 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7900000000000001e-06 2024-09-12T22:32:44.039 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.039 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.039 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:44.039 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394537+0000", 2024-09-12T22:32:44.039 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.632e-06 2024-09-12T22:32:44.039 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.039 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.039 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:44.040 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.404932+0000", 2024-09-12T22:32:44.040 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010394158000000001 2024-09-12T22:32:44.040 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.040 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.040 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:44.040 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405017+0000", 2024-09-12T22:32:44.040 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5525000000000005e-05 2024-09-12T22:32:44.040 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.040 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.040 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:44.040 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405114+0000", 2024-09-12T22:32:44.040 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.6527000000000006e-05 2024-09-12T22:32:44.040 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.041 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.041 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:44.041 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405818+0000", 2024-09-12T22:32:44.041 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00070412800000000005 2024-09-12T22:32:44.041 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.041 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.041 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:44.041 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406437+0000", 2024-09-12T22:32:44.041 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00061898900000000002 2024-09-12T22:32:44.041 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.041 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.041 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:44.041 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406463+0000", 2024-09-12T22:32:44.041 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6268e-05 2024-09-12T22:32:44.042 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.042 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.042 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:44.042 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406484+0000", 2024-09-12T22:32:44.042 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0536000000000001e-05 2024-09-12T22:32:44.042 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:44.042 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:44.042 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:44.042 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.042 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.042 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:44.042 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.401422+0000", 2024-09-12T22:32:44.042 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 66.187504759000007, 2024-09-12T22:32:44.043 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016896452999999999, 2024-09-12T22:32:44.043 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:44.043 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:44.043 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:44.043 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:44.043 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.043 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:44.043 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401422+0000", 2024-09-12T22:32:44.043 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:44.043 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.043 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.043 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:44.043 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401422+0000", 2024-09-12T22:32:44.043 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:44.044 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.044 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.044 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:44.044 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401424+0000", 2024-09-12T22:32:44.044 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9e-06 2024-09-12T22:32:44.044 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.044 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.044 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:44.044 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401437+0000", 2024-09-12T22:32:44.044 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2831e-05 2024-09-12T22:32:44.044 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.044 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.044 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:44.045 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401471+0000", 2024-09-12T22:32:44.045 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4010000000000001e-05 2024-09-12T22:32:44.045 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.045 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.045 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:44.045 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401484+0000", 2024-09-12T22:32:44.045 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2711000000000001e-05 2024-09-12T22:32:44.045 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.045 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.045 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:44.045 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405410+0000", 2024-09-12T22:32:44.045 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0039259170000000001 2024-09-12T22:32:44.045 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.046 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.046 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:44.046 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405529+0000", 2024-09-12T22:32:44.046 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000119778 2024-09-12T22:32:44.046 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.046 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.046 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:44.046 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405655+0000", 2024-09-12T22:32:44.046 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012556700000000001 2024-09-12T22:32:44.046 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.046 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.046 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:44.046 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410456+0000", 2024-09-12T22:32:44.046 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0048008269999999997 2024-09-12T22:32:44.047 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.047 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.047 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:44.047 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418226+0000", 2024-09-12T22:32:44.047 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0077707729999999999 2024-09-12T22:32:44.047 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.047 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.047 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:44.047 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418277+0000", 2024-09-12T22:32:44.047 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0476000000000003e-05 2024-09-12T22:32:44.047 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.047 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.047 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:44.048 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418319+0000", 2024-09-12T22:32:44.048 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1662999999999997e-05 2024-09-12T22:32:44.048 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:44.048 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:44.048 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:44.048 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.048 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.048 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:44.048 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.401505+0000", 2024-09-12T22:32:44.048 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 66.187422095000002, 2024-09-12T22:32:44.048 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016987904000000002, 2024-09-12T22:32:44.048 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:44.048 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:44.049 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:44.049 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:44.049 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.049 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:44.049 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401505+0000", 2024-09-12T22:32:44.049 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:44.049 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.049 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.049 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:44.049 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401505+0000", 2024-09-12T22:32:44.049 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:44.049 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.049 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.049 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:44.050 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401506+0000", 2024-09-12T22:32:44.050 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4700000000000001e-07 2024-09-12T22:32:44.050 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.050 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.050 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:44.050 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401510+0000", 2024-09-12T22:32:44.050 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6609999999999999e-06 2024-09-12T22:32:44.050 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.050 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.050 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:44.050 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401771+0000", 2024-09-12T22:32:44.050 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00026110700000000001 2024-09-12T22:32:44.050 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.051 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.051 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:44.051 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401921+0000", 2024-09-12T22:32:44.051 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014939099999999999 2024-09-12T22:32:44.051 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.051 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.051 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:44.051 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405944+0000", 2024-09-12T22:32:44.051 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0040235449999999999 2024-09-12T22:32:44.051 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.051 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.051 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:44.051 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406018+0000", 2024-09-12T22:32:44.052 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3373000000000004e-05 2024-09-12T22:32:44.052 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.052 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.052 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:44.052 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406172+0000", 2024-09-12T22:32:44.052 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00015435399999999999 2024-09-12T22:32:44.052 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.052 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.052 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:44.053 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410461+0000", 2024-09-12T22:32:44.053 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0042888609999999997 2024-09-12T22:32:44.053 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.053 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.053 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:44.053 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418371+0000", 2024-09-12T22:32:44.053 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0079098380000000006 2024-09-12T22:32:44.053 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.053 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.053 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:44.053 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418443+0000", 2024-09-12T22:32:44.054 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2705000000000003e-05 2024-09-12T22:32:44.054 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.054 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.054 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:44.054 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418493+0000", 2024-09-12T22:32:44.054 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9322e-05 2024-09-12T22:32:44.054 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:44.054 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:44.054 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:44.054 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.054 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.054 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:44.055 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.401939+0000", 2024-09-12T22:32:44.055 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 66.186988358999997, 2024-09-12T22:32:44.055 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016722292999999999, 2024-09-12T22:32:44.055 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:44.055 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:44.055 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:44.055 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:44.055 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.055 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:44.055 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401939+0000", 2024-09-12T22:32:44.055 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:44.056 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.056 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.056 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:44.056 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401939+0000", 2024-09-12T22:32:44.056 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:44.056 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.056 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.056 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:44.056 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401940+0000", 2024-09-12T22:32:44.056 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1990000000000001e-06 2024-09-12T22:32:44.056 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.057 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.057 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:44.057 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401956+0000", 2024-09-12T22:32:44.057 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.6344000000000001e-05 2024-09-12T22:32:44.057 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.057 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.057 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:44.057 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401974+0000", 2024-09-12T22:32:44.057 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7730000000000001e-05 2024-09-12T22:32:44.057 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.057 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.057 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:44.058 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401982+0000", 2024-09-12T22:32:44.058 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.7800000000000001e-06 2024-09-12T22:32:44.058 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.058 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.058 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:44.058 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406557+0000", 2024-09-12T22:32:44.058 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0045758489999999999 2024-09-12T22:32:44.058 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.058 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.058 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:44.058 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406697+0000", 2024-09-12T22:32:44.059 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013925100000000001 2024-09-12T22:32:44.059 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.059 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.059 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:44.059 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406830+0000", 2024-09-12T22:32:44.059 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013293499999999999 2024-09-12T22:32:44.059 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.060 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.060 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:44.060 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410465+0000", 2024-09-12T22:32:44.060 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0036352680000000001 2024-09-12T22:32:44.060 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.060 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.060 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:44.060 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418564+0000", 2024-09-12T22:32:44.060 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0080992140000000004 2024-09-12T22:32:44.060 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.060 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.061 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:44.061 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418621+0000", 2024-09-12T22:32:44.061 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7167999999999999e-05 2024-09-12T22:32:44.061 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.061 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.061 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:44.061 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418661+0000", 2024-09-12T22:32:44.061 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9555000000000003e-05 2024-09-12T22:32:44.061 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:44.061 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:44.061 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:44.061 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.062 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.062 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:44.062 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.401994+0000", 2024-09-12T22:32:44.062 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 66.186932487000007, 2024-09-12T22:32:44.062 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016804109000000001, 2024-09-12T22:32:44.062 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:44.062 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:44.062 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:44.062 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:44.062 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.062 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:44.063 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401994+0000", 2024-09-12T22:32:44.063 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:44.063 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.063 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.063 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:44.063 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401994+0000", 2024-09-12T22:32:44.063 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:44.063 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.063 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.063 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:44.064 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401995+0000", 2024-09-12T22:32:44.064 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.8899999999999998e-07 2024-09-12T22:32:44.064 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.064 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.064 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:44.064 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402000+0000", 2024-09-12T22:32:44.064 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.498e-06 2024-09-12T22:32:44.064 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.064 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.064 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:44.064 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402007+0000", 2024-09-12T22:32:44.065 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.554e-06 2024-09-12T22:32:44.065 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.065 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.065 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:44.065 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402046+0000", 2024-09-12T22:32:44.065 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9156000000000003e-05 2024-09-12T22:32:44.065 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.065 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.065 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:44.065 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407342+0000", 2024-09-12T22:32:44.065 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052957610000000004 2024-09-12T22:32:44.065 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.066 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.066 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:44.066 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407521+0000", 2024-09-12T22:32:44.066 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00017878100000000001 2024-09-12T22:32:44.066 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.066 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.066 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:44.066 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407641+0000", 2024-09-12T22:32:44.066 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012013 2024-09-12T22:32:44.066 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.066 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.066 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:44.067 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410472+0000", 2024-09-12T22:32:44.067 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.002830455 2024-09-12T22:32:44.067 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.067 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.067 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:44.067 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418714+0000", 2024-09-12T22:32:44.067 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0082422789999999999 2024-09-12T22:32:44.067 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.067 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.067 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:44.067 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418761+0000", 2024-09-12T22:32:44.068 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6956999999999998e-05 2024-09-12T22:32:44.068 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.068 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.068 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:44.068 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418799+0000", 2024-09-12T22:32:44.068 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7749000000000001e-05 2024-09-12T22:32:44.068 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:44.068 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:44.068 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:44.068 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.068 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.068 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:44.069 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.402060+0000", 2024-09-12T22:32:44.069 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 66.186867043000007, 2024-09-12T22:32:44.069 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016885686, 2024-09-12T22:32:44.069 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:44.069 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:44.069 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:44.069 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:44.069 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.069 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:44.069 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402060+0000", 2024-09-12T22:32:44.069 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:44.070 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.070 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.070 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:44.070 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402060+0000", 2024-09-12T22:32:44.070 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:44.070 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.070 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.070 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:44.070 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402061+0000", 2024-09-12T22:32:44.070 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4399999999999999e-07 2024-09-12T22:32:44.070 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.070 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.071 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:44.071 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402066+0000", 2024-09-12T22:32:44.071 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8649999999999998e-06 2024-09-12T22:32:44.071 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.071 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.071 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:44.071 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402146+0000", 2024-09-12T22:32:44.071 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9054000000000006e-05 2024-09-12T22:32:44.071 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.071 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.071 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:44.072 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402287+0000", 2024-09-12T22:32:44.072 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014108600000000001 2024-09-12T22:32:44.072 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.072 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.072 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:44.072 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408185+0000", 2024-09-12T22:32:44.072 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0058983919999999997 2024-09-12T22:32:44.072 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.072 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.072 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:44.072 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408299+0000", 2024-09-12T22:32:44.073 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114102 2024-09-12T22:32:44.073 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.073 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.073 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:44.073 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408420+0000", 2024-09-12T22:32:44.073 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000120492 2024-09-12T22:32:44.073 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.073 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.073 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:44.073 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410867+0000", 2024-09-12T22:32:44.073 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0024476430000000002 2024-09-12T22:32:44.073 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.074 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.074 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:44.074 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418851+0000", 2024-09-12T22:32:44.074 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0079841489999999994 2024-09-12T22:32:44.074 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.074 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.074 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:44.074 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418894+0000", 2024-09-12T22:32:44.074 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3090000000000002e-05 2024-09-12T22:32:44.074 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.074 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.075 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:44.075 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418946+0000", 2024-09-12T22:32:44.075 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1069000000000002e-05 2024-09-12T22:32:44.075 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:44.075 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:44.075 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:44.075 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.075 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.075 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:44.075 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.402375+0000", 2024-09-12T22:32:44.075 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 66.186551977999997, 2024-09-12T22:32:44.075 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016768531999999999, 2024-09-12T22:32:44.076 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:44.076 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:44.076 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:44.076 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:44.076 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.076 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:44.076 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402375+0000", 2024-09-12T22:32:44.076 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:44.076 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.076 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.076 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:44.077 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402375+0000", 2024-09-12T22:32:44.077 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:44.077 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.077 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.077 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:44.077 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402375+0000", 2024-09-12T22:32:44.077 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4099999999999999e-07 2024-09-12T22:32:44.077 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.077 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.077 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:44.077 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402379+0000", 2024-09-12T22:32:44.078 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9870000000000001e-06 2024-09-12T22:32:44.078 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.078 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.078 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:44.078 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402389+0000", 2024-09-12T22:32:44.078 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0000000000000001e-05 2024-09-12T22:32:44.078 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.078 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.078 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:44.078 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402401+0000", 2024-09-12T22:32:44.078 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.148e-05 2024-09-12T22:32:44.079 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.079 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.079 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:44.079 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409108+0000", 2024-09-12T22:32:44.079 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0067068429999999997 2024-09-12T22:32:44.079 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.079 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.079 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:44.079 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409189+0000", 2024-09-12T22:32:44.079 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0815999999999993e-05 2024-09-12T22:32:44.079 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.080 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.080 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:44.080 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409320+0000", 2024-09-12T22:32:44.080 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000131586 2024-09-12T22:32:44.080 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.080 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.080 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:44.080 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410872+0000", 2024-09-12T22:32:44.080 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0015521599999999999 2024-09-12T22:32:44.080 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.080 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.081 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:44.081 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419049+0000", 2024-09-12T22:32:44.081 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0081763719999999995 2024-09-12T22:32:44.081 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.081 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.081 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:44.081 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419107+0000", 2024-09-12T22:32:44.081 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7899000000000002e-05 2024-09-12T22:32:44.081 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.081 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.081 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:44.081 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419143+0000", 2024-09-12T22:32:44.082 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6847999999999997e-05 2024-09-12T22:32:44.082 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:44.082 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:44.082 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:44.082 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.082 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.082 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:44.082 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.402903+0000", 2024-09-12T22:32:44.082 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 66.186023566000003, 2024-09-12T22:32:44.082 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016378428, 2024-09-12T22:32:44.082 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:44.083 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:44.083 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:44.083 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:44.083 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.083 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:44.083 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402903+0000", 2024-09-12T22:32:44.083 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:44.083 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.083 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.083 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:44.083 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402903+0000", 2024-09-12T22:32:44.083 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:44.084 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.084 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.084 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:44.084 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402904+0000", 2024-09-12T22:32:44.084 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9500000000000001e-07 2024-09-12T22:32:44.084 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.084 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.084 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:44.084 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402944+0000", 2024-09-12T22:32:44.084 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0265000000000002e-05 2024-09-12T22:32:44.084 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.085 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.085 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:44.085 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402979+0000", 2024-09-12T22:32:44.085 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4378000000000002e-05 2024-09-12T22:32:44.085 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.085 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.085 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:44.085 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402987+0000", 2024-09-12T22:32:44.085 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3559999999999993e-06 2024-09-12T22:32:44.085 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.085 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.085 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:44.086 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409577+0000", 2024-09-12T22:32:44.086 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0065901709999999997 2024-09-12T22:32:44.086 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.086 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.086 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:44.086 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409653+0000", 2024-09-12T22:32:44.086 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5819e-05 2024-09-12T22:32:44.086 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.086 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.086 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:44.086 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409725+0000", 2024-09-12T22:32:44.087 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2200000000000007e-05 2024-09-12T22:32:44.087 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.087 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.087 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:44.087 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.411234+0000", 2024-09-12T22:32:44.087 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001508225 2024-09-12T22:32:44.087 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.087 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.087 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:44.087 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419212+0000", 2024-09-12T22:32:44.088 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0079783400000000004 2024-09-12T22:32:44.088 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.088 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.088 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:44.088 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419244+0000", 2024-09-12T22:32:44.088 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2384e-05 2024-09-12T22:32:44.088 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.088 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.088 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:44.088 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419282+0000", 2024-09-12T22:32:44.088 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7394999999999997e-05 2024-09-12T22:32:44.089 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:44.089 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:44.089 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:44.089 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.089 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.089 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:44.089 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.403135+0000", 2024-09-12T22:32:44.089 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 66.185791695999995, 2024-09-12T22:32:44.089 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016294211999999999, 2024-09-12T22:32:44.089 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:44.090 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:44.090 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:44.090 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:44.090 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.090 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:44.090 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403135+0000", 2024-09-12T22:32:44.090 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:44.090 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.090 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.091 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:44.091 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403135+0000", 2024-09-12T22:32:44.091 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:44.091 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.091 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.091 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:44.091 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403136+0000", 2024-09-12T22:32:44.091 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.4e-07 2024-09-12T22:32:44.091 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.092 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.092 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:44.092 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403149+0000", 2024-09-12T22:32:44.092 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2723e-05 2024-09-12T22:32:44.092 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.092 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.092 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:44.092 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403158+0000", 2024-09-12T22:32:44.092 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3919999999999992e-06 2024-09-12T22:32:44.092 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.092 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.093 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:44.093 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403166+0000", 2024-09-12T22:32:44.093 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.2309999999999996e-06 2024-09-12T22:32:44.093 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.093 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.093 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:44.093 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409944+0000", 2024-09-12T22:32:44.093 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0067775309999999998 2024-09-12T22:32:44.093 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.093 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.094 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:44.094 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410032+0000", 2024-09-12T22:32:44.094 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.7906999999999997e-05 2024-09-12T22:32:44.094 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.094 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.094 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:44.094 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410152+0000", 2024-09-12T22:32:44.094 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012037800000000001 2024-09-12T22:32:44.094 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.094 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.094 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:44.094 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.411945+0000", 2024-09-12T22:32:44.095 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0017931850000000001 2024-09-12T22:32:44.095 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.095 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.095 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:44.095 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419319+0000", 2024-09-12T22:32:44.095 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0073731780000000002 2024-09-12T22:32:44.095 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.095 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.095 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:44.095 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419376+0000", 2024-09-12T22:32:44.095 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7728e-05 2024-09-12T22:32:44.096 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.096 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.096 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:44.096 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419429+0000", 2024-09-12T22:32:44.096 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3019000000000002e-05 2024-09-12T22:32:44.096 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:44.096 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:44.096 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:44.096 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.096 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.097 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:44.097 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.403185+0000", 2024-09-12T22:32:44.097 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 66.185741815, 2024-09-12T22:32:44.097 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.014902164000000001, 2024-09-12T22:32:44.097 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:44.097 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:44.097 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:44.097 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:44.097 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.097 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:44.098 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403185+0000", 2024-09-12T22:32:44.098 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:44.098 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.098 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.098 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:44.098 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403185+0000", 2024-09-12T22:32:44.098 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:44.098 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.098 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.098 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:44.098 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403186+0000", 2024-09-12T22:32:44.098 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9400000000000005e-07 2024-09-12T22:32:44.099 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.099 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.099 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:44.099 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403191+0000", 2024-09-12T22:32:44.099 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6980000000000003e-06 2024-09-12T22:32:44.099 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.099 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.099 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:44.099 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403199+0000", 2024-09-12T22:32:44.099 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2520000000000002e-06 2024-09-12T22:32:44.099 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.100 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.100 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:44.100 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403205+0000", 2024-09-12T22:32:44.100 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.908e-06 2024-09-12T22:32:44.100 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.100 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.100 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:44.100 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403359+0000", 2024-09-12T22:32:44.100 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000154544 2024-09-12T22:32:44.100 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.101 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.101 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:44.101 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403528+0000", 2024-09-12T22:32:44.101 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000168455 2024-09-12T22:32:44.101 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.101 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.101 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:44.101 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403763+0000", 2024-09-12T22:32:44.101 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00023539599999999999 2024-09-12T22:32:44.101 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.101 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.101 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:44.102 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409378+0000", 2024-09-12T22:32:44.102 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056150000000000002 2024-09-12T22:32:44.102 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.102 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.102 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:44.102 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418012+0000", 2024-09-12T22:32:44.102 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0086339559999999999 2024-09-12T22:32:44.102 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.102 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.102 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:44.102 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418046+0000", 2024-09-12T22:32:44.102 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4267999999999998e-05 2024-09-12T22:32:44.103 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.103 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.103 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:44.103 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418087+0000", 2024-09-12T22:32:44.103 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0992999999999999e-05 2024-09-12T22:32:44.103 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:44.103 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:44.103 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:44.103 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.103 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.103 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:44.103 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.403273+0000", 2024-09-12T22:32:44.104 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 66.185653864000002, 2024-09-12T22:32:44.104 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.014934866, 2024-09-12T22:32:44.104 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:44.104 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:44.104 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:44.104 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:44.104 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.104 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:44.104 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403273+0000", 2024-09-12T22:32:44.104 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:44.104 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.105 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.105 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:44.105 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403273+0000", 2024-09-12T22:32:44.105 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:44.105 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.105 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.105 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:44.105 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403274+0000", 2024-09-12T22:32:44.105 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.297e-06 2024-09-12T22:32:44.105 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.105 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.106 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:44.106 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403282+0000", 2024-09-12T22:32:44.106 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6340000000000001e-06 2024-09-12T22:32:44.106 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.106 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.106 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:44.106 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403305+0000", 2024-09-12T22:32:44.106 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3149000000000001e-05 2024-09-12T22:32:44.106 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.106 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.106 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:44.106 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403320+0000", 2024-09-12T22:32:44.107 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4527e-05 2024-09-12T22:32:44.107 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.107 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.107 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:44.107 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.404928+0000", 2024-09-12T22:32:44.107 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001608459 2024-09-12T22:32:44.107 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.107 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.107 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:44.107 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405218+0000", 2024-09-12T22:32:44.107 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00028982900000000002 2024-09-12T22:32:44.107 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.108 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.108 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:44.108 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405829+0000", 2024-09-12T22:32:44.108 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00061127900000000005 2024-09-12T22:32:44.108 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.108 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.108 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:44.108 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409403+0000", 2024-09-12T22:32:44.108 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.003573597 2024-09-12T22:32:44.108 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.109 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.109 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:44.109 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418138+0000", 2024-09-12T22:32:44.109 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0087349969999999996 2024-09-12T22:32:44.109 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.109 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.109 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:44.109 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418178+0000", 2024-09-12T22:32:44.109 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0649999999999999e-05 2024-09-12T22:32:44.109 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.109 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.110 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:44.110 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418208+0000", 2024-09-12T22:32:44.110 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9448e-05 2024-09-12T22:32:44.110 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:44.110 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:44.110 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:44.110 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.110 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.110 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:44.110 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.405456+0000", 2024-09-12T22:32:44.110 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 66.183470718999999, 2024-09-12T22:32:44.110 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012888389, 2024-09-12T22:32:44.111 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:44.111 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:44.111 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:44.111 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:44.111 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.111 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:44.111 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405456+0000", 2024-09-12T22:32:44.111 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:44.111 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.111 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.111 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:44.112 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405456+0000", 2024-09-12T22:32:44.112 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:44.112 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.112 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.112 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:44.112 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405457+0000", 2024-09-12T22:32:44.112 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.6599999999999994e-07 2024-09-12T22:32:44.112 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.112 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.112 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:44.112 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405463+0000", 2024-09-12T22:32:44.112 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4739999999999996e-06 2024-09-12T22:32:44.113 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.113 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.113 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:44.113 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405474+0000", 2024-09-12T22:32:44.113 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1095e-05 2024-09-12T22:32:44.113 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.113 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.113 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:44.113 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405482+0000", 2024-09-12T22:32:44.113 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3610000000000001e-06 2024-09-12T22:32:44.113 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.114 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.114 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:44.114 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407051+0000", 2024-09-12T22:32:44.114 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0015688970000000001 2024-09-12T22:32:44.114 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.114 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.114 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:44.114 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407259+0000", 2024-09-12T22:32:44.114 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00020778300000000001 2024-09-12T22:32:44.114 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.114 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.114 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:44.115 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407622+0000", 2024-09-12T22:32:44.115 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000363066 2024-09-12T22:32:44.115 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.115 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.115 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:44.115 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409438+0000", 2024-09-12T22:32:44.115 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001816319 2024-09-12T22:32:44.115 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.115 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.115 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:44.115 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418257+0000", 2024-09-12T22:32:44.116 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0088187720000000008 2024-09-12T22:32:44.116 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.116 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.116 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:44.116 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418308+0000", 2024-09-12T22:32:44.116 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1180000000000001e-05 2024-09-12T22:32:44.116 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.116 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.116 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:44.116 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418345+0000", 2024-09-12T22:32:44.116 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6476000000000001e-05 2024-09-12T22:32:44.116 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:44.117 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:44.117 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:44.117 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.117 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.117 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:44.117 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.405496+0000", 2024-09-12T22:32:44.117 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 66.183431361999993, 2024-09-12T22:32:44.117 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013016012, 2024-09-12T22:32:44.117 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:44.117 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:44.117 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:44.117 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:44.118 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.118 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:44.118 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405496+0000", 2024-09-12T22:32:44.118 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:44.118 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.118 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.118 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:44.118 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405496+0000", 2024-09-12T22:32:44.118 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:44.118 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.118 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.119 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:44.119 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405496+0000", 2024-09-12T22:32:44.119 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7999999999999995e-07 2024-09-12T22:32:44.119 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.119 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.119 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:44.119 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405501+0000", 2024-09-12T22:32:44.119 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8359999999999999e-06 2024-09-12T22:32:44.119 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.119 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.120 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:44.120 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405514+0000", 2024-09-12T22:32:44.120 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2522e-05 2024-09-12T22:32:44.120 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.120 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.120 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:44.120 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405521+0000", 2024-09-12T22:32:44.120 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5020000000000003e-06 2024-09-12T22:32:44.120 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.120 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.120 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:44.121 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405575+0000", 2024-09-12T22:32:44.121 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4169999999999998e-05 2024-09-12T22:32:44.121 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.121 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.121 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:44.121 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405697+0000", 2024-09-12T22:32:44.121 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000121301 2024-09-12T22:32:44.121 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.121 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.121 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:44.121 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405829+0000", 2024-09-12T22:32:44.122 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000132662 2024-09-12T22:32:44.122 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.122 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.122 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:44.122 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409155+0000", 2024-09-12T22:32:44.122 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0033259050000000001 2024-09-12T22:32:44.122 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.122 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.122 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:44.122 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418425+0000", 2024-09-12T22:32:44.122 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0092696319999999999 2024-09-12T22:32:44.122 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.123 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.123 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:44.123 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418471+0000", 2024-09-12T22:32:44.123 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6213e-05 2024-09-12T22:32:44.123 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.123 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.123 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:44.123 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418512+0000", 2024-09-12T22:32:44.123 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0589000000000001e-05 2024-09-12T22:32:44.123 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:44.123 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:44.123 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:44.124 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.124 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.124 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:44.124 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.406108+0000", 2024-09-12T22:32:44.124 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 66.182818964999996, 2024-09-12T22:32:44.124 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012458175, 2024-09-12T22:32:44.124 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:44.124 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:44.124 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:44.124 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:44.124 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.125 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:44.125 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406108+0000", 2024-09-12T22:32:44.125 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:44.125 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.125 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.125 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:44.125 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406108+0000", 2024-09-12T22:32:44.125 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:44.125 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.125 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.125 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:44.126 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406109+0000", 2024-09-12T22:32:44.126 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9899999999999999e-07 2024-09-12T22:32:44.126 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.126 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.126 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:44.126 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406115+0000", 2024-09-12T22:32:44.126 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9030000000000001e-06 2024-09-12T22:32:44.126 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.126 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.126 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:44.126 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406141+0000", 2024-09-12T22:32:44.127 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5999e-05 2024-09-12T22:32:44.127 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.127 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.127 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:44.127 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406150+0000", 2024-09-12T22:32:44.127 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.6050000000000004e-06 2024-09-12T22:32:44.127 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.127 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.127 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:44.127 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408163+0000", 2024-09-12T22:32:44.127 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0020122769999999998 2024-09-12T22:32:44.128 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.128 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.128 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:44.128 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408309+0000", 2024-09-12T22:32:44.128 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014606999999999999 2024-09-12T22:32:44.128 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.128 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.128 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:44.128 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408433+0000", 2024-09-12T22:32:44.128 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012460300000000001 2024-09-12T22:32:44.129 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.129 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.129 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:44.129 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409903+0000", 2024-09-12T22:32:44.129 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001469499 2024-09-12T22:32:44.129 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.129 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.129 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:44.129 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418427+0000", 2024-09-12T22:32:44.129 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0085241139999999993 2024-09-12T22:32:44.129 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.129 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.130 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:44.130 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418471+0000", 2024-09-12T22:32:44.130 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4474000000000001e-05 2024-09-12T22:32:44.130 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.130 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.130 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:44.130 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418566+0000", 2024-09-12T22:32:44.130 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.4732e-05 2024-09-12T22:32:44.130 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:44.130 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:44.130 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:44.131 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.131 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.131 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:44.131 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.407266+0000", 2024-09-12T22:32:44.131 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 66.181661109000004, 2024-09-12T22:32:44.131 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011442905, 2024-09-12T22:32:44.131 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:44.131 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:44.131 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2024-09-12T22:32:44.131 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:44.131 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.131 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:44.132 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407266+0000", 2024-09-12T22:32:44.132 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:44.132 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.132 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.132 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:44.132 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407266+0000", 2024-09-12T22:32:44.132 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:44.132 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.132 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.132 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:44.133 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407266+0000", 2024-09-12T22:32:44.133 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7899999999999998e-07 2024-09-12T22:32:44.133 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.133 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.133 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:44.133 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407269+0000", 2024-09-12T22:32:44.133 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9210000000000001e-06 2024-09-12T22:32:44.133 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.133 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.133 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:44.133 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407331+0000", 2024-09-12T22:32:44.134 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1376000000000003e-05 2024-09-12T22:32:44.134 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.134 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.134 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:44.134 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407337+0000", 2024-09-12T22:32:44.134 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1929999999999998e-06 2024-09-12T22:32:44.134 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.134 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.134 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:44.134 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408974+0000", 2024-09-12T22:32:44.134 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0016367109999999999 2024-09-12T22:32:44.134 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.135 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.135 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:44.135 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409112+0000", 2024-09-12T22:32:44.135 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000137952 2024-09-12T22:32:44.135 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:44.135 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:44.135 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:44.135 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418709+0000", 2024-09-12T22:32:44.135 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0095971730000000005 2024-09-12T22:32:44.135 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:44.136 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:44.136 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:44.136 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:44.136 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:44.136 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-09-12T22:32:44.137 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:32:44.138 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:44.136+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:44.238 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:44.237+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:44.254 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:32:44.254 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:32:44.254 INFO:teuthology.orchestra.run.smithi148.stdout: "num_ops": 0 2024-09-12T22:32:44.254 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:32:44.264 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:32:44.357 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:44.353+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:44.372 INFO:teuthology.orchestra.run.smithi019.stderr:noscrub is set 2024-09-12T22:32:44.414 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:32:44.414 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:32:44.414 INFO:teuthology.orchestra.run.smithi148.stdout: "complaint_time": 30, 2024-09-12T22:32:44.414 INFO:teuthology.orchestra.run.smithi148.stdout: "num_blocked_ops": 0 2024-09-12T22:32:44.414 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:32:44.417 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T22:32:44.423 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:32:44.440 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:44.439+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:44.505 DEBUG:teuthology.orchestra.console.smithi076:pexpect command: ipmitool -H smithi076.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-09-12T22:32:44.529 INFO:teuthology.orchestra.run.smithi019.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-12T22:32:44.541 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:44.540+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:44.546 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T22:32:44.546 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:32:44.564 INFO:teuthology.orchestra.run.smithi019.stdout:osd.2: {} 2024-09-12T22:32:44.564 INFO:teuthology.orchestra.run.smithi019.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T22:32:44.568 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:32:44.569 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:32:44.569 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:44.569 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:44.577 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:32:44.616 DEBUG:teuthology.orchestra.console.smithi076:check power output: Chassis Power is off 2024-09-12T22:32:44.616 INFO:teuthology.orchestra.console.smithi076:Power off completed 2024-09-12T22:32:44.643 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:44.642+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:44.696 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:44.696 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:44.705 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:32:44.751 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:44.749+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:44.810 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:44.811 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:44.819 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:32:44.862 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:44.860+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:44.945 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:44.944+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:44.963 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:44.963 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:44.972 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:32:45.046 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:45.044+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:45.077 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:45.078 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:45.087 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:32:45.146 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:45.145+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:45.191 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:45.191 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:45.200 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:32:45.247 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:45.246+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:45.306 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:45.306 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:45.314 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:32:45.362 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:45.360+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:45.420 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:45.420 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:45.428 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:32:45.450 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:45.448+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:45.551 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:45.550+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:45.563 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2024-09-12T22:32:45.575 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:45.576 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:45.584 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:32:45.652 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:45.650+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:45.689 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:45.689 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:45.698 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:32:45.753 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:45.752+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:45.808 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:45.808 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:45.817 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:32:45.860 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:45.858+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:45.954 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:45.952+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:45.964 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:45.964 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:45.973 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:32:46.054 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:46.053+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:46.078 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:46.078 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:46.087 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:32:46.157 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:46.156+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:46.192 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:46.192 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:46.201 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:32:46.258 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:46.256+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:46.303 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:46.303 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:46.312 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:32:46.358 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:46.357+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:46.389 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T22:32:46.455 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:46.455 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:46.459 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:46.458+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:46.464 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:32:46.561 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:46.560+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:46.569 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:46.569 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:46.569 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T22:32:46.578 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:32:46.666 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:46.665+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:46.681 INFO:teuthology.orchestra.run.smithi019.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-12T22:32:46.699 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T22:32:46.699 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:32:46.717 INFO:teuthology.orchestra.run.smithi019.stdout:osd.2: {} 2024-09-12T22:32:46.717 INFO:teuthology.orchestra.run.smithi019.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T22:32:46.720 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:32:46.721 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:32:46.724 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:32:46.724 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:32:46.724 INFO:teuthology.orchestra.run.smithi148.stdout: "complaint_time": 30, 2024-09-12T22:32:46.724 INFO:teuthology.orchestra.run.smithi148.stdout: "num_blocked_ops": 0 2024-09-12T22:32:46.724 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:32:46.733 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:32:46.763 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:46.762+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:46.864 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:46.862+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:46.880 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:32:46.880 INFO:teuthology.orchestra.run.smithi148.stdout: "size": 20, 2024-09-12T22:32:46.880 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 600, 2024-09-12T22:32:46.880 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [ 2024-09-12T22:32:46.880 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.880 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:46.881 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.400880+0000", 2024-09-12T22:32:46.881 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 69.477030967000005, 2024-09-12T22:32:46.881 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0095133660000000005, 2024-09-12T22:32:46.881 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:46.881 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:46.881 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:46.881 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:46.881 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.881 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:46.881 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400880+0000", 2024-09-12T22:32:46.881 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:46.881 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.882 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.882 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:46.882 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400880+0000", 2024-09-12T22:32:46.882 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:46.882 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.882 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.882 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:46.882 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400892+0000", 2024-09-12T22:32:46.882 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1941e-05 2024-09-12T22:32:46.882 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.882 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.882 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:46.882 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400900+0000", 2024-09-12T22:32:46.882 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0080000000000002e-06 2024-09-12T22:32:46.883 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.883 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.883 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:46.883 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400911+0000", 2024-09-12T22:32:46.883 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1452e-05 2024-09-12T22:32:46.883 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.883 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.883 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:46.883 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400922+0000", 2024-09-12T22:32:46.883 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0772e-05 2024-09-12T22:32:46.883 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.883 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.883 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:46.884 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401009+0000", 2024-09-12T22:32:46.884 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.7206000000000005e-05 2024-09-12T22:32:46.884 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.884 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.884 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:46.884 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401157+0000", 2024-09-12T22:32:46.884 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014831499999999999 2024-09-12T22:32:46.884 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.884 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.884 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:46.884 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401312+0000", 2024-09-12T22:32:46.884 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00015495600000000001 2024-09-12T22:32:46.884 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.885 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.885 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:46.885 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.403060+0000", 2024-09-12T22:32:46.885 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0017475220000000001 2024-09-12T22:32:46.885 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.885 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.885 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:46.885 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410300+0000", 2024-09-12T22:32:46.885 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0072403260000000001 2024-09-12T22:32:46.885 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.885 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.885 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:46.885 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410350+0000", 2024-09-12T22:32:46.886 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9814000000000001e-05 2024-09-12T22:32:46.886 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.886 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.886 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:46.886 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410393+0000", 2024-09-12T22:32:46.886 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3053999999999998e-05 2024-09-12T22:32:46.886 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:46.886 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:46.886 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:46.886 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.886 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.886 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:46.887 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.400952+0000", 2024-09-12T22:32:46.887 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 69.476958815000003, 2024-09-12T22:32:46.887 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0096045620000000005, 2024-09-12T22:32:46.887 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:46.887 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:46.887 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:46.887 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:46.887 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.887 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:46.887 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400952+0000", 2024-09-12T22:32:46.887 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:46.887 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.887 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.887 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:46.888 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400952+0000", 2024-09-12T22:32:46.888 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:46.888 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.888 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.888 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:46.888 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400953+0000", 2024-09-12T22:32:46.888 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.8000000000000005e-07 2024-09-12T22:32:46.888 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.888 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.888 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:46.888 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400957+0000", 2024-09-12T22:32:46.888 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.33e-06 2024-09-12T22:32:46.889 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.889 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.889 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:46.889 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400966+0000", 2024-09-12T22:32:46.889 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1989999999999995e-06 2024-09-12T22:32:46.889 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.889 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.889 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:46.889 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400973+0000", 2024-09-12T22:32:46.889 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2779999999999999e-06 2024-09-12T22:32:46.889 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.889 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.889 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:46.890 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401696+0000", 2024-09-12T22:32:46.890 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00072363500000000003 2024-09-12T22:32:46.890 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.890 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.890 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:46.890 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401788+0000", 2024-09-12T22:32:46.890 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1862999999999998e-05 2024-09-12T22:32:46.890 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.890 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.890 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:46.890 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401929+0000", 2024-09-12T22:32:46.890 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014096000000000001 2024-09-12T22:32:46.890 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.890 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.891 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:46.891 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.403542+0000", 2024-09-12T22:32:46.891 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001612963 2024-09-12T22:32:46.891 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.891 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.891 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:46.891 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410460+0000", 2024-09-12T22:32:46.891 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0069180500000000002 2024-09-12T22:32:46.891 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.891 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.891 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:46.891 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410515+0000", 2024-09-12T22:32:46.891 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5009000000000001e-05 2024-09-12T22:32:46.892 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.892 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.892 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:46.892 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410557+0000", 2024-09-12T22:32:46.892 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1495000000000002e-05 2024-09-12T22:32:46.892 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:46.892 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:46.892 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:46.892 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.892 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.892 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:46.892 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.400984+0000", 2024-09-12T22:32:46.892 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 69.476926320000004, 2024-09-12T22:32:46.893 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0073703950000000001, 2024-09-12T22:32:46.893 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:46.893 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:46.893 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:46.893 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:46.893 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.893 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:46.893 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400984+0000", 2024-09-12T22:32:46.893 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:46.893 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.893 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.893 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:46.893 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400984+0000", 2024-09-12T22:32:46.894 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:46.894 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.894 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.894 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:46.894 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400985+0000", 2024-09-12T22:32:46.894 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3200000000000005e-07 2024-09-12T22:32:46.894 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.894 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.894 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:46.894 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400998+0000", 2024-09-12T22:32:46.894 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2726e-05 2024-09-12T22:32:46.894 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.894 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.895 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:46.895 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401006+0000", 2024-09-12T22:32:46.895 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.3110000000000006e-06 2024-09-12T22:32:46.895 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.895 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.895 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:46.895 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401022+0000", 2024-09-12T22:32:46.895 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6249e-05 2024-09-12T22:32:46.895 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.895 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.895 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:46.895 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401700+0000", 2024-09-12T22:32:46.895 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00067811100000000001 2024-09-12T22:32:46.896 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.896 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.896 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:46.896 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401839+0000", 2024-09-12T22:32:46.896 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013865399999999999 2024-09-12T22:32:46.896 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.896 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.896 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:46.896 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401962+0000", 2024-09-12T22:32:46.896 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000123266 2024-09-12T22:32:46.896 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.896 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.896 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:46.897 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.403589+0000", 2024-09-12T22:32:46.897 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001626932 2024-09-12T22:32:46.897 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.897 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.897 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:46.897 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.408274+0000", 2024-09-12T22:32:46.897 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0046848100000000002 2024-09-12T22:32:46.897 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.897 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.897 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:46.897 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.408324+0000", 2024-09-12T22:32:46.897 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9784000000000003e-05 2024-09-12T22:32:46.897 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.898 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.898 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:46.898 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.408355+0000", 2024-09-12T22:32:46.898 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.1019999999999998e-05 2024-09-12T22:32:46.898 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:46.898 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:46.898 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:46.898 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.898 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.898 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:46.898 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401034+0000", 2024-09-12T22:32:46.898 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 69.476876880000006, 2024-09-12T22:32:46.898 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011063051000000001, 2024-09-12T22:32:46.899 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:46.899 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:46.899 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:46.899 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:46.899 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.899 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:46.899 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401034+0000", 2024-09-12T22:32:46.899 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:46.899 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.899 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.899 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:46.899 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401034+0000", 2024-09-12T22:32:46.899 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:46.900 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.900 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.900 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:46.900 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401034+0000", 2024-09-12T22:32:46.900 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8899999999999999e-07 2024-09-12T22:32:46.900 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.900 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.900 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:46.900 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401038+0000", 2024-09-12T22:32:46.900 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.523e-06 2024-09-12T22:32:46.900 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.900 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.900 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:46.901 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401046+0000", 2024-09-12T22:32:46.901 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0479999999999999e-06 2024-09-12T22:32:46.901 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.901 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.901 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:46.901 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401051+0000", 2024-09-12T22:32:46.901 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2619999999999998e-06 2024-09-12T22:32:46.901 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.901 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.901 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:46.901 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402270+0000", 2024-09-12T22:32:46.901 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012182429999999999 2024-09-12T22:32:46.901 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.902 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.902 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:46.902 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402325+0000", 2024-09-12T22:32:46.902 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5526999999999999e-05 2024-09-12T22:32:46.902 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.902 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.902 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:46.902 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402403+0000", 2024-09-12T22:32:46.902 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.7559999999999996e-05 2024-09-12T22:32:46.902 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.902 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.902 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:46.902 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.403655+0000", 2024-09-12T22:32:46.903 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012521489999999999 2024-09-12T22:32:46.903 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.903 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.903 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:46.903 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411979+0000", 2024-09-12T22:32:46.903 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0083240420000000002 2024-09-12T22:32:46.903 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.903 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.903 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:46.903 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.412036+0000", 2024-09-12T22:32:46.903 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7639000000000002e-05 2024-09-12T22:32:46.903 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.903 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.903 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:46.904 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.412097+0000", 2024-09-12T22:32:46.904 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0469e-05 2024-09-12T22:32:46.904 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:46.904 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:46.904 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:46.904 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.904 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.904 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:46.904 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401060+0000", 2024-09-12T22:32:46.904 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 69.476851128000007, 2024-09-12T22:32:46.904 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.010030172, 2024-09-12T22:32:46.904 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:46.905 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:46.905 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:46.905 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:46.905 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.905 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:46.905 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401060+0000", 2024-09-12T22:32:46.905 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:46.905 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.905 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.905 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:46.905 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401060+0000", 2024-09-12T22:32:46.905 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:46.905 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.906 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.906 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:46.906 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401060+0000", 2024-09-12T22:32:46.906 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2500000000000001e-07 2024-09-12T22:32:46.906 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.906 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.906 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:46.906 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401063+0000", 2024-09-12T22:32:46.906 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0910000000000001e-06 2024-09-12T22:32:46.906 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.906 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.906 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:46.906 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401070+0000", 2024-09-12T22:32:46.906 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1210000000000001e-06 2024-09-12T22:32:46.907 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.907 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.907 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:46.907 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401076+0000", 2024-09-12T22:32:46.907 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2830000000000001e-06 2024-09-12T22:32:46.907 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.907 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.907 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:46.907 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402288+0000", 2024-09-12T22:32:46.907 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012123699999999999 2024-09-12T22:32:46.907 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.907 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.907 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:46.908 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402359+0000", 2024-09-12T22:32:46.908 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.0988000000000005e-05 2024-09-12T22:32:46.908 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.908 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.908 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:46.908 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402457+0000", 2024-09-12T22:32:46.908 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.7857999999999997e-05 2024-09-12T22:32:46.908 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.908 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.908 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:46.908 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.404395+0000", 2024-09-12T22:32:46.908 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0019380160000000001 2024-09-12T22:32:46.909 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.909 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.909 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:46.909 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410603+0000", 2024-09-12T22:32:46.909 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.006208061 2024-09-12T22:32:46.909 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.909 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.909 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:46.909 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410687+0000", 2024-09-12T22:32:46.909 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.4623000000000006e-05 2024-09-12T22:32:46.909 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.909 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.909 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:46.910 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411090+0000", 2024-09-12T22:32:46.910 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00040233599999999999 2024-09-12T22:32:46.910 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:46.910 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:46.910 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:46.910 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.910 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.910 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:46.910 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401083+0000", 2024-09-12T22:32:46.910 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 69.476827712000002, 2024-09-12T22:32:46.910 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0097591850000000001, 2024-09-12T22:32:46.910 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:46.910 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:46.910 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:46.911 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:46.911 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.911 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:46.911 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401083+0000", 2024-09-12T22:32:46.911 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:46.911 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.911 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.911 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:46.911 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401083+0000", 2024-09-12T22:32:46.911 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:46.911 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.911 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.911 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:46.912 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401084+0000", 2024-09-12T22:32:46.912 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4799999999999999e-07 2024-09-12T22:32:46.912 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.912 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.912 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:46.912 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401088+0000", 2024-09-12T22:32:46.912 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6419999999999998e-06 2024-09-12T22:32:46.912 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.912 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.912 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:46.912 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401094+0000", 2024-09-12T22:32:46.912 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0090000000000004e-06 2024-09-12T22:32:46.912 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.913 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.913 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:46.913 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401108+0000", 2024-09-12T22:32:46.913 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3884e-05 2024-09-12T22:32:46.913 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.913 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.913 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:46.913 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401165+0000", 2024-09-12T22:32:46.913 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.6499000000000002e-05 2024-09-12T22:32:46.913 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.913 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.913 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:46.913 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401261+0000", 2024-09-12T22:32:46.914 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.6872000000000004e-05 2024-09-12T22:32:46.914 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.914 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.914 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:46.914 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401376+0000", 2024-09-12T22:32:46.914 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000114508 2024-09-12T22:32:46.914 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.914 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.914 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:46.914 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402666+0000", 2024-09-12T22:32:46.914 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012901659999999999 2024-09-12T22:32:46.914 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.914 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.915 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:46.915 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410572+0000", 2024-09-12T22:32:46.915 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0079055489999999996 2024-09-12T22:32:46.915 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.915 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.915 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:46.915 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410661+0000", 2024-09-12T22:32:46.915 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.9578000000000002e-05 2024-09-12T22:32:46.915 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.915 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.915 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:46.915 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410842+0000", 2024-09-12T22:32:46.915 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00018102999999999999 2024-09-12T22:32:46.915 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:46.916 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:46.916 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:46.916 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.916 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.916 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:46.916 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401122+0000", 2024-09-12T22:32:46.916 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 69.476788679999999, 2024-09-12T22:32:46.916 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0099122080000000005, 2024-09-12T22:32:46.916 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:46.916 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:46.916 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:32:46.916 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:46.916 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.917 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:46.917 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401122+0000", 2024-09-12T22:32:46.917 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:46.917 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.917 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.917 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:46.917 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401122+0000", 2024-09-12T22:32:46.917 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:46.917 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.917 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.917 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:46.917 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401123+0000", 2024-09-12T22:32:46.917 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2600000000000002e-07 2024-09-12T22:32:46.918 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.918 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.918 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:46.918 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401126+0000", 2024-09-12T22:32:46.918 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.6449999999999998e-06 2024-09-12T22:32:46.918 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.918 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.918 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:46.918 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401133+0000", 2024-09-12T22:32:46.918 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.9890000000000003e-06 2024-09-12T22:32:46.918 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.918 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.918 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:46.919 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401138+0000", 2024-09-12T22:32:46.919 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8060000000000002e-06 2024-09-12T22:32:46.919 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.919 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.919 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:46.919 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401703+0000", 2024-09-12T22:32:46.919 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00056509099999999999 2024-09-12T22:32:46.919 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.919 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.919 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:46.919 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401837+0000", 2024-09-12T22:32:46.919 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013338799999999999 2024-09-12T22:32:46.919 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.919 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.920 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:46.920 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411034+0000", 2024-09-12T22:32:46.920 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.009197663 2024-09-12T22:32:46.920 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:46.920 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:46.920 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:46.920 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.920 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.920 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:46.920 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401158+0000", 2024-09-12T22:32:46.920 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 69.476752900999998, 2024-09-12T22:32:46.920 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.010292437999999999, 2024-09-12T22:32:46.920 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:46.921 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:46.921 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:32:46.921 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:46.921 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.921 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:46.921 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401158+0000", 2024-09-12T22:32:46.921 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:46.921 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.921 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.921 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:46.921 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401158+0000", 2024-09-12T22:32:46.921 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:46.921 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.922 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.922 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:46.922 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401158+0000", 2024-09-12T22:32:46.922 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9699999999999996e-07 2024-09-12T22:32:46.922 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.922 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.922 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:46.922 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401161+0000", 2024-09-12T22:32:46.922 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.7410000000000001e-06 2024-09-12T22:32:46.922 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.922 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.922 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:46.922 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401168+0000", 2024-09-12T22:32:46.922 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.844e-06 2024-09-12T22:32:46.923 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.923 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.923 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:46.923 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401174+0000", 2024-09-12T22:32:46.923 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4700000000000001e-06 2024-09-12T22:32:46.923 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.923 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.923 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:46.923 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402799+0000", 2024-09-12T22:32:46.923 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0016256409999999999 2024-09-12T22:32:46.923 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.923 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.923 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:46.924 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402893+0000", 2024-09-12T22:32:46.924 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.3807999999999994e-05 2024-09-12T22:32:46.924 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.924 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.924 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:46.924 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411450+0000", 2024-09-12T22:32:46.924 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0085573369999999999 2024-09-12T22:32:46.924 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:46.924 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:46.924 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:46.924 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.924 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.924 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:46.925 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401183+0000", 2024-09-12T22:32:46.925 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 69.476728049000002, 2024-09-12T22:32:46.925 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0068597830000000004, 2024-09-12T22:32:46.925 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:46.925 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:46.925 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:32:46.925 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:46.925 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.925 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:46.925 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401183+0000", 2024-09-12T22:32:46.925 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:46.925 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.925 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.926 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:46.926 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401183+0000", 2024-09-12T22:32:46.926 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:46.926 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.926 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.926 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:46.926 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401183+0000", 2024-09-12T22:32:46.926 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.6700000000000003e-07 2024-09-12T22:32:46.926 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.926 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.926 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:46.926 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401186+0000", 2024-09-12T22:32:46.926 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4679999999999999e-06 2024-09-12T22:32:46.926 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.927 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.927 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:46.927 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401192+0000", 2024-09-12T22:32:46.927 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.1519999999999997e-06 2024-09-12T22:32:46.927 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.927 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.927 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:46.927 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401197+0000", 2024-09-12T22:32:46.927 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4669999999999998e-06 2024-09-12T22:32:46.927 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.927 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.927 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:46.927 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401253+0000", 2024-09-12T22:32:46.928 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.6211000000000001e-05 2024-09-12T22:32:46.928 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.928 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.928 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:46.928 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401413+0000", 2024-09-12T22:32:46.928 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00016021399999999999 2024-09-12T22:32:46.928 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.928 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.928 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:46.929 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.408043+0000", 2024-09-12T22:32:46.929 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0066295039999999996 2024-09-12T22:32:46.929 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:46.929 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:46.929 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:46.929 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.929 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.929 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:20 3.1c e19/17 3:3ed09add:::607.00000000:head v 19'1, mlcod=0'0)", 2024-09-12T22:32:46.929 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.409642+0000", 2024-09-12T22:32:46.929 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 69.468268589999994, 2024-09-12T22:32:46.929 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0038816269999999999, 2024-09-12T22:32:46.929 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:46.930 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:46.930 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:46.930 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:46.930 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.930 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:46.930 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409642+0000", 2024-09-12T22:32:46.930 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:46.930 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.930 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.930 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:46.930 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409642+0000", 2024-09-12T22:32:46.930 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:46.930 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.930 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.931 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:46.931 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409642+0000", 2024-09-12T22:32:46.931 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.6899999999999999e-07 2024-09-12T22:32:46.931 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.931 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.931 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:46.931 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409648+0000", 2024-09-12T22:32:46.931 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.49e-06 2024-09-12T22:32:46.931 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.931 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.932 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:46.932 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409656+0000", 2024-09-12T22:32:46.932 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.2949999999999994e-06 2024-09-12T22:32:46.932 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.932 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.932 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:46.932 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409664+0000", 2024-09-12T22:32:46.932 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.1219999999999995e-06 2024-09-12T22:32:46.932 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.932 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.932 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:46.932 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409707+0000", 2024-09-12T22:32:46.932 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2222000000000003e-05 2024-09-12T22:32:46.933 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.933 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.933 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:46.933 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409724+0000", 2024-09-12T22:32:46.933 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7496999999999999e-05 2024-09-12T22:32:46.933 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.933 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.933 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:46.933 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413439+0000", 2024-09-12T22:32:46.933 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00371448 2024-09-12T22:32:46.934 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.934 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.934 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:46.934 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413524+0000", 2024-09-12T22:32:46.934 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.5252000000000003e-05 2024-09-12T22:32:46.934 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:46.934 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:46.934 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:46.934 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.934 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.934 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:28 3.13 e19/17 3:cd5a64a3:::100.00000000:head v 19'1, mlcod=0'0)", 2024-09-12T22:32:46.934 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.409681+0000", 2024-09-12T22:32:46.934 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 69.468230106999997, 2024-09-12T22:32:46.935 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0038708710000000001, 2024-09-12T22:32:46.935 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:46.935 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:46.935 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:46.935 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:46.935 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.935 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:46.935 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409681+0000", 2024-09-12T22:32:46.935 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:46.935 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.935 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.935 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:46.936 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409681+0000", 2024-09-12T22:32:46.936 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:46.936 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.936 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.936 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:46.936 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409681+0000", 2024-09-12T22:32:46.936 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3000000000000002e-07 2024-09-12T22:32:46.936 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.936 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.936 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:46.936 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409695+0000", 2024-09-12T22:32:46.936 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4313e-05 2024-09-12T22:32:46.937 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.937 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.937 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:46.937 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409703+0000", 2024-09-12T22:32:46.937 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4000000000000003e-06 2024-09-12T22:32:46.937 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.937 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.937 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:46.937 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409708+0000", 2024-09-12T22:32:46.937 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3190000000000002e-06 2024-09-12T22:32:46.937 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.937 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.937 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:46.938 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409875+0000", 2024-09-12T22:32:46.938 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000167329 2024-09-12T22:32:46.938 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.938 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.938 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:46.938 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409892+0000", 2024-09-12T22:32:46.938 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6957999999999999e-05 2024-09-12T22:32:46.938 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.938 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.938 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:46.938 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413457+0000", 2024-09-12T22:32:46.938 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0035651279999999999 2024-09-12T22:32:46.938 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.938 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.939 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:46.939 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413552+0000", 2024-09-12T22:32:46.939 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.4093999999999997e-05 2024-09-12T22:32:46.939 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:46.939 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:46.939 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:46.939 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.939 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.939 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:21 3.1c e19/17 3:3ed09add:::607.00000000:head v 19'2, mlcod=0'0)", 2024-09-12T22:32:46.939 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.409718+0000", 2024-09-12T22:32:46.939 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 69.468192442000003, 2024-09-12T22:32:46.939 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003851883, 2024-09-12T22:32:46.939 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:46.940 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:46.940 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:46.940 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:46.940 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.940 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:46.940 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409718+0000", 2024-09-12T22:32:46.940 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:46.940 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.940 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.940 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:46.940 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409718+0000", 2024-09-12T22:32:46.940 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:46.941 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.941 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.941 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:46.941 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409719+0000", 2024-09-12T22:32:46.941 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.16e-07 2024-09-12T22:32:46.941 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.941 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.941 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:46.941 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409722+0000", 2024-09-12T22:32:46.941 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.692e-06 2024-09-12T22:32:46.941 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.941 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.941 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:46.941 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409729+0000", 2024-09-12T22:32:46.942 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.516e-06 2024-09-12T22:32:46.942 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.942 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.942 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:46.942 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409750+0000", 2024-09-12T22:32:46.942 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1151000000000001e-05 2024-09-12T22:32:46.942 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.942 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.942 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:46.942 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410015+0000", 2024-09-12T22:32:46.942 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00026477599999999999 2024-09-12T22:32:46.942 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.942 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.943 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:46.943 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410104+0000", 2024-09-12T22:32:46.943 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.9586000000000006e-05 2024-09-12T22:32:46.943 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.943 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.943 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:46.943 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413528+0000", 2024-09-12T22:32:46.943 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0034237880000000001 2024-09-12T22:32:46.943 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.943 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.943 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:46.943 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413570+0000", 2024-09-12T22:32:46.943 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2157999999999999e-05 2024-09-12T22:32:46.943 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:46.944 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:46.944 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:46.944 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.944 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.944 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:27 3.13 e19/17 3:c91d4a1d:::mds0_inotable:head v 19'2, mlcod=0'0)", 2024-09-12T22:32:46.944 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.409760+0000", 2024-09-12T22:32:46.944 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 69.468150926000007, 2024-09-12T22:32:46.944 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0039301910000000004, 2024-09-12T22:32:46.944 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:46.944 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:46.944 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:46.944 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:46.944 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.945 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:46.945 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409760+0000", 2024-09-12T22:32:46.945 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:46.945 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.945 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.945 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:46.945 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409760+0000", 2024-09-12T22:32:46.945 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:46.945 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.945 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.945 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:46.945 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409760+0000", 2024-09-12T22:32:46.945 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.39e-07 2024-09-12T22:32:46.946 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.946 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.946 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:46.946 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409765+0000", 2024-09-12T22:32:46.946 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4449999999999998e-06 2024-09-12T22:32:46.946 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.946 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.946 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:46.946 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409771+0000", 2024-09-12T22:32:46.946 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7159999999999997e-06 2024-09-12T22:32:46.946 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.946 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.946 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:46.947 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409778+0000", 2024-09-12T22:32:46.947 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.331e-06 2024-09-12T22:32:46.947 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.947 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.947 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:46.947 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410191+0000", 2024-09-12T22:32:46.947 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00041348300000000003 2024-09-12T22:32:46.947 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.947 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.947 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:46.947 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410211+0000", 2024-09-12T22:32:46.947 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9933999999999999e-05 2024-09-12T22:32:46.947 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.947 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.948 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:46.948 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413638+0000", 2024-09-12T22:32:46.948 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003426854 2024-09-12T22:32:46.948 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.948 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.948 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:46.948 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413690+0000", 2024-09-12T22:32:46.948 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2089000000000002e-05 2024-09-12T22:32:46.948 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:46.948 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:46.948 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:46.948 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.948 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.949 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "pg_update_log_missing_reply(3.b epoch 19/17 rep_tid 4 lcod 19'2)", 2024-09-12T22:32:46.949 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.410060+0000", 2024-09-12T22:32:46.949 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 69.467851261000007, 2024-09-12T22:32:46.949 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00098016500000000007, 2024-09-12T22:32:46.949 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:46.949 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:46.949 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "reached pg", 2024-09-12T22:32:46.949 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:46.949 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.949 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:46.949 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410060+0000", 2024-09-12T22:32:46.949 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:46.949 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.950 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.950 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:46.950 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410060+0000", 2024-09-12T22:32:46.950 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:46.950 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.950 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.950 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:46.950 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410060+0000", 2024-09-12T22:32:46.950 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.8299999999999998e-07 2024-09-12T22:32:46.950 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.950 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.950 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:46.950 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410062+0000", 2024-09-12T22:32:46.950 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5749999999999999e-06 2024-09-12T22:32:46.951 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.951 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.951 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:46.951 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410070+0000", 2024-09-12T22:32:46.951 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.909e-06 2024-09-12T22:32:46.951 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.951 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.951 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:46.951 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410076+0000", 2024-09-12T22:32:46.951 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7049999999999996e-06 2024-09-12T22:32:46.951 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.951 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.951 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:46.952 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410943+0000", 2024-09-12T22:32:46.952 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00086681900000000001 2024-09-12T22:32:46.952 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.952 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.952 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:46.952 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411040+0000", 2024-09-12T22:32:46.952 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.6774000000000006e-05 2024-09-12T22:32:46.952 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:46.952 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:46.952 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:46.952 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.952 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.952 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e19/17 ondisk, result = 0)", 2024-09-12T22:32:46.952 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.410113+0000", 2024-09-12T22:32:46.953 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 69.467797993999994, 2024-09-12T22:32:46.953 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00098911599999999995, 2024-09-12T22:32:46.953 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:46.953 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:46.953 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:32:46.953 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:46.953 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.953 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:46.953 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410113+0000", 2024-09-12T22:32:46.953 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:46.953 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.953 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.953 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:46.954 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410113+0000", 2024-09-12T22:32:46.954 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:46.954 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.954 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.954 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:46.954 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410113+0000", 2024-09-12T22:32:46.954 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.99e-07 2024-09-12T22:32:46.954 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.954 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.954 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:46.954 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410115+0000", 2024-09-12T22:32:46.954 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.046e-06 2024-09-12T22:32:46.954 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.955 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.955 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:46.955 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410121+0000", 2024-09-12T22:32:46.955 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0050000000000001e-06 2024-09-12T22:32:46.955 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.955 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.955 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:46.955 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410126+0000", 2024-09-12T22:32:46.955 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8339999999999998e-06 2024-09-12T22:32:46.955 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.955 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.955 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:46.956 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410587+0000", 2024-09-12T22:32:46.956 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00046095499999999998 2024-09-12T22:32:46.956 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.956 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.956 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:46.956 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410595+0000", 2024-09-12T22:32:46.956 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.9419999999999995e-06 2024-09-12T22:32:46.956 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.956 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.956 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:46.956 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411102+0000", 2024-09-12T22:32:46.956 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00050713500000000003 2024-09-12T22:32:46.956 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:46.957 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:46.957 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:46.957 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.957 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.957 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 19/17 rep_tid 8 lcod 19'4)", 2024-09-12T22:32:46.957 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.410133+0000", 2024-09-12T22:32:46.957 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 69.467778065999994, 2024-09-12T22:32:46.957 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0013504000000000001, 2024-09-12T22:32:46.957 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:46.957 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:46.957 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "reached pg", 2024-09-12T22:32:46.957 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:46.957 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.958 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:46.958 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410133+0000", 2024-09-12T22:32:46.958 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:46.958 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.958 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.958 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:46.958 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410133+0000", 2024-09-12T22:32:46.958 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:46.958 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.958 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.958 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:46.958 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410133+0000", 2024-09-12T22:32:46.958 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.0599999999999999e-07 2024-09-12T22:32:46.958 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.959 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.959 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:46.959 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410135+0000", 2024-09-12T22:32:46.959 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7770000000000001e-06 2024-09-12T22:32:46.959 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.959 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.959 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:46.959 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410140+0000", 2024-09-12T22:32:46.959 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9960000000000001e-06 2024-09-12T22:32:46.959 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.959 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.959 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:46.959 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410144+0000", 2024-09-12T22:32:46.960 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9500000000000003e-06 2024-09-12T22:32:46.960 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.960 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.960 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:46.960 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411310+0000", 2024-09-12T22:32:46.960 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001166311 2024-09-12T22:32:46.960 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.960 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.960 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:46.960 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411483+0000", 2024-09-12T22:32:46.960 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00017316 2024-09-12T22:32:46.960 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:46.960 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:46.961 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:46.961 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.961 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.961 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "pg_update_log_missing(3.1a epoch 19/17 rep_tid 0 entries 19'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T22:32:46.961 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.410617+0000", 2024-09-12T22:32:46.961 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 69.467293670999993, 2024-09-12T22:32:46.961 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0030439709999999999, 2024-09-12T22:32:46.961 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:46.961 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:46.961 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "reached pg", 2024-09-12T22:32:46.961 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:46.961 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.961 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:46.962 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410617+0000", 2024-09-12T22:32:46.962 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:46.962 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.962 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.962 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:46.962 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410617+0000", 2024-09-12T22:32:46.962 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:46.962 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.962 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.962 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:46.962 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410617+0000", 2024-09-12T22:32:46.962 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3599999999999999e-07 2024-09-12T22:32:46.962 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.962 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.963 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:46.963 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410625+0000", 2024-09-12T22:32:46.963 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5410000000000003e-06 2024-09-12T22:32:46.963 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.963 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.963 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:46.963 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410638+0000", 2024-09-12T22:32:46.963 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3261999999999999e-05 2024-09-12T22:32:46.963 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.963 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.963 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:46.963 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410653+0000", 2024-09-12T22:32:46.963 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4844000000000001e-05 2024-09-12T22:32:46.964 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.964 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.964 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:46.964 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410814+0000", 2024-09-12T22:32:46.964 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00016119999999999999 2024-09-12T22:32:46.964 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.964 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.964 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:46.964 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413661+0000", 2024-09-12T22:32:46.964 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0028467879999999998 2024-09-12T22:32:46.964 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:46.964 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:46.964 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:46.965 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.965 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.965 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-09-12T22:32:46.965 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:39.398875+0000", 2024-09-12T22:32:46.965 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 67.479035390999996, 2024-09-12T22:32:46.965 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0015679069999999999, 2024-09-12T22:32:46.965 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:46.965 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:46.965 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:46.965 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:46.965 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.965 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:46.965 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398875+0000", 2024-09-12T22:32:46.966 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:46.966 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.966 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.966 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:46.966 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398875+0000", 2024-09-12T22:32:46.966 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:46.966 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.966 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.966 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:46.967 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398878+0000", 2024-09-12T22:32:46.967 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1679999999999998e-06 2024-09-12T22:32:46.967 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.967 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.967 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:46.967 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398888+0000", 2024-09-12T22:32:46.967 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.084e-05 2024-09-12T22:32:46.967 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.967 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.967 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:46.967 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398906+0000", 2024-09-12T22:32:46.967 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7518000000000001e-05 2024-09-12T22:32:46.967 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.967 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.968 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:46.968 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398914+0000", 2024-09-12T22:32:46.968 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5989999999999996e-06 2024-09-12T22:32:46.968 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.968 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.968 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:46.968 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398974+0000", 2024-09-12T22:32:46.968 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0988e-05 2024-09-12T22:32:46.968 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.968 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.968 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:46.968 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.399078+0000", 2024-09-12T22:32:46.968 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000103133 2024-09-12T22:32:46.969 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.969 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.969 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:46.969 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.399166+0000", 2024-09-12T22:32:46.969 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.8183999999999995e-05 2024-09-12T22:32:46.969 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.969 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.969 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:46.969 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.399747+0000", 2024-09-12T22:32:46.969 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00058110599999999996 2024-09-12T22:32:46.969 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.969 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.969 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:46.970 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.400377+0000", 2024-09-12T22:32:46.970 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000630157 2024-09-12T22:32:46.970 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.970 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.970 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:46.970 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.400415+0000", 2024-09-12T22:32:46.970 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7814000000000001e-05 2024-09-12T22:32:46.970 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.970 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.970 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:46.970 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.400443+0000", 2024-09-12T22:32:46.970 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8399999999999999e-05 2024-09-12T22:32:46.970 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:46.971 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:46.971 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:46.971 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.971 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.971 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e23)", 2024-09-12T22:32:46.971 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:58.400966+0000", 2024-09-12T22:32:46.971 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 48.476944482999997, 2024-09-12T22:32:46.971 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001468876, 2024-09-12T22:32:46.971 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:46.971 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:46.971 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:46.971 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:46.971 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.972 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:46.972 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400966+0000", 2024-09-12T22:32:46.972 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:46.972 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.972 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.972 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:46.972 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400966+0000", 2024-09-12T22:32:46.972 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:46.972 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.972 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.972 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:46.972 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400967+0000", 2024-09-12T22:32:46.972 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.046e-06 2024-09-12T22:32:46.973 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.973 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.973 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:46.973 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400974+0000", 2024-09-12T22:32:46.973 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2310000000000001e-06 2024-09-12T22:32:46.973 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.973 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.973 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:46.973 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400988+0000", 2024-09-12T22:32:46.973 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4482e-05 2024-09-12T22:32:46.973 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.973 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.973 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:46.974 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400997+0000", 2024-09-12T22:32:46.974 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.0189999999999995e-06 2024-09-12T22:32:46.974 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.974 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.974 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:46.974 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.401068+0000", 2024-09-12T22:32:46.974 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1426000000000004e-05 2024-09-12T22:32:46.974 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.974 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.974 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:46.974 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.401174+0000", 2024-09-12T22:32:46.974 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000105769 2024-09-12T22:32:46.974 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.975 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.975 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:46.975 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.401335+0000", 2024-09-12T22:32:46.975 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000161225 2024-09-12T22:32:46.975 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.975 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.975 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:46.975 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.402110+0000", 2024-09-12T22:32:46.975 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00077428800000000004 2024-09-12T22:32:46.975 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.975 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.975 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:46.975 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.402333+0000", 2024-09-12T22:32:46.976 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000223723 2024-09-12T22:32:46.976 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.976 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.976 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:46.976 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.402388+0000", 2024-09-12T22:32:46.976 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4700999999999997e-05 2024-09-12T22:32:46.976 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.976 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.976 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:46.976 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.402435+0000", 2024-09-12T22:32:46.976 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6965999999999997e-05 2024-09-12T22:32:46.976 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:46.976 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:46.977 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:46.977 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.977 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.977 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:45 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e27)", 2024-09-12T22:32:46.977 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:32:04.401614+0000", 2024-09-12T22:32:46.977 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 42.476297054, 2024-09-12T22:32:46.977 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0014279749999999999, 2024-09-12T22:32:46.977 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:46.977 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:46.977 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:46.977 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:46.977 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.977 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:46.978 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401614+0000", 2024-09-12T22:32:46.978 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:46.978 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.978 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.978 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:46.978 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401614+0000", 2024-09-12T22:32:46.978 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:46.978 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.978 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.978 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:46.978 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401615+0000", 2024-09-12T22:32:46.978 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.161e-06 2024-09-12T22:32:46.978 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.979 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.979 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:46.979 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401621+0000", 2024-09-12T22:32:46.979 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8730000000000004e-06 2024-09-12T22:32:46.979 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.979 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.979 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:46.979 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401633+0000", 2024-09-12T22:32:46.979 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1800000000000001e-05 2024-09-12T22:32:46.979 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.979 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.979 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:46.979 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401656+0000", 2024-09-12T22:32:46.980 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.3521999999999999e-05 2024-09-12T22:32:46.980 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.980 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.980 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:46.980 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401713+0000", 2024-09-12T22:32:46.980 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7259000000000002e-05 2024-09-12T22:32:46.980 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.980 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.980 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:46.980 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401849+0000", 2024-09-12T22:32:46.980 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013613500000000001 2024-09-12T22:32:46.980 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.980 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.980 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:46.981 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.402009+0000", 2024-09-12T22:32:46.981 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00015947199999999999 2024-09-12T22:32:46.981 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.981 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.981 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:46.981 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.402629+0000", 2024-09-12T22:32:46.981 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00061962200000000001 2024-09-12T22:32:46.981 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.981 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.981 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:46.981 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.402983+0000", 2024-09-12T22:32:46.981 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00035447499999999998 2024-09-12T22:32:46.981 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.982 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.982 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:46.982 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.403016+0000", 2024-09-12T22:32:46.982 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3108999999999998e-05 2024-09-12T22:32:46.982 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:46.982 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:46.982 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:46.982 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.403042+0000", 2024-09-12T22:32:46.982 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5547000000000001e-05 2024-09-12T22:32:46.982 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:46.982 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:46.982 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:46.982 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:46.983 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:46.983 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:32:46.984 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:32:46.985 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:46.983+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:47.085 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:47.084+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:47.089 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-09-12T22:32:47.089 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-09-12T22:32:47.090 INFO:teuthology.orchestra.run.smithi163.stdout: "num_ops": 0 2024-09-12T22:32:47.090 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-09-12T22:32:47.098 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:32:47.186 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:47.185+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:47.241 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-09-12T22:32:47.242 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-09-12T22:32:47.242 INFO:teuthology.orchestra.run.smithi163.stdout: "complaint_time": 30, 2024-09-12T22:32:47.242 INFO:teuthology.orchestra.run.smithi163.stdout: "num_blocked_ops": 0 2024-09-12T22:32:47.242 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-09-12T22:32:47.250 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:32:47.288 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:47.286+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:47.389 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:47.388+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:47.396 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-09-12T22:32:47.396 INFO:teuthology.orchestra.run.smithi163.stdout: "size": 20, 2024-09-12T22:32:47.396 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 600, 2024-09-12T22:32:47.396 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2024-09-12T22:32:47.396 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.396 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-09-12T22:32:47.396 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:27.254459+0000", 2024-09-12T22:32:47.396 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 80.139221347000003, 2024-09-12T22:32:47.397 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.37816283899999997, 2024-09-12T22:32:47.397 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:47.397 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:47.397 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:47.397 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:47.397 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:47.397 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:47.397 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 1 2024-09-12T22:32:47.397 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.397 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:47.397 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.397 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:47.397 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254459+0000", 2024-09-12T22:32:47.397 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:47.398 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.398 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.398 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:47.398 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254459+0000", 2024-09-12T22:32:47.398 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:47.398 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.398 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.398 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:47.398 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254460+0000", 2024-09-12T22:32:47.398 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1739999999999999e-06 2024-09-12T22:32:47.398 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.398 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.398 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:47.399 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254472+0000", 2024-09-12T22:32:47.399 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2207e-05 2024-09-12T22:32:47.399 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.399 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.399 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:47.399 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254483+0000", 2024-09-12T22:32:47.399 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0631999999999999e-05 2024-09-12T22:32:47.399 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.399 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.399 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:47.399 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254492+0000", 2024-09-12T22:32:47.399 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3670000000000003e-06 2024-09-12T22:32:47.399 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.399 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.400 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:47.400 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254551+0000", 2024-09-12T22:32:47.400 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8687999999999998e-05 2024-09-12T22:32:47.400 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.400 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.400 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for peered", 2024-09-12T22:32:47.400 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254562+0000", 2024-09-12T22:32:47.400 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1249e-05 2024-09-12T22:32:47.400 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.400 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.400 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:47.400 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.631211+0000", 2024-09-12T22:32:47.400 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.376649018 2024-09-12T22:32:47.401 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.401 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.401 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:47.401 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.631345+0000", 2024-09-12T22:32:47.401 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013378700000000001 2024-09-12T22:32:47.401 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.401 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.401 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:47.401 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.631479+0000", 2024-09-12T22:32:47.401 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013352399999999999 2024-09-12T22:32:47.401 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.401 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.401 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:47.401 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632324+0000", 2024-09-12T22:32:47.402 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00084508100000000002 2024-09-12T22:32:47.402 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.402 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.402 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:47.402 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632548+0000", 2024-09-12T22:32:47.402 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000224329 2024-09-12T22:32:47.402 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.402 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.402 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:47.402 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632591+0000", 2024-09-12T22:32:47.402 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2564000000000001e-05 2024-09-12T22:32:47.402 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.402 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.403 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:47.403 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632622+0000", 2024-09-12T22:32:47.403 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1219e-05 2024-09-12T22:32:47.403 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:47.403 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:47.403 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:47.403 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.403 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.403 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:185 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:32:47.403 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394355+0000", 2024-09-12T22:32:47.403 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 78.999325249999998, 2024-09-12T22:32:47.403 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011302394, 2024-09-12T22:32:47.403 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:47.404 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:47.404 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:47.404 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:47.404 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:47.404 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:47.404 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 185 2024-09-12T22:32:47.404 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.404 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:47.404 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.404 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:47.404 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394355+0000", 2024-09-12T22:32:47.404 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:47.404 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.404 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.405 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:47.405 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394355+0000", 2024-09-12T22:32:47.405 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:47.405 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.405 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.405 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:47.405 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394355+0000", 2024-09-12T22:32:47.405 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9099999999999999e-07 2024-09-12T22:32:47.405 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.405 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.405 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:47.405 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394385+0000", 2024-09-12T22:32:47.405 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9963000000000001e-05 2024-09-12T22:32:47.405 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.406 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.406 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:47.406 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394390+0000", 2024-09-12T22:32:47.406 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8420000000000004e-06 2024-09-12T22:32:47.406 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.406 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.406 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:47.406 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394393+0000", 2024-09-12T22:32:47.406 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1e-06 2024-09-12T22:32:47.406 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.406 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.406 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:47.406 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.400546+0000", 2024-09-12T22:32:47.406 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0061523309999999996 2024-09-12T22:32:47.407 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.407 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.407 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:47.407 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.400588+0000", 2024-09-12T22:32:47.407 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1835000000000002e-05 2024-09-12T22:32:47.407 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.407 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.407 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:47.407 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.400677+0000", 2024-09-12T22:32:47.407 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9195000000000002e-05 2024-09-12T22:32:47.407 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.407 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.407 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:47.407 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405378+0000", 2024-09-12T22:32:47.408 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0047008659999999997 2024-09-12T22:32:47.408 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.408 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.408 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:47.408 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405569+0000", 2024-09-12T22:32:47.408 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00019148599999999999 2024-09-12T22:32:47.408 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.408 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.408 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:47.408 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405620+0000", 2024-09-12T22:32:47.408 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1416999999999999e-05 2024-09-12T22:32:47.408 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.408 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.409 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:47.409 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405657+0000", 2024-09-12T22:32:47.409 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6968000000000002e-05 2024-09-12T22:32:47.409 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:47.409 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:47.409 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:47.409 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.409 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.409 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:32:47.409 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394399+0000", 2024-09-12T22:32:47.409 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 78.999281038999996, 2024-09-12T22:32:47.409 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011336601999999999, 2024-09-12T22:32:47.410 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:47.410 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:47.410 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:47.410 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:47.410 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:47.410 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:47.410 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 186 2024-09-12T22:32:47.410 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.410 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:47.410 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.410 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:47.410 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394399+0000", 2024-09-12T22:32:47.410 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:47.411 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.411 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.411 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:47.411 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394399+0000", 2024-09-12T22:32:47.411 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:47.411 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.411 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.411 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:47.411 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394400+0000", 2024-09-12T22:32:47.411 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4499999999999998e-07 2024-09-12T22:32:47.411 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.411 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.412 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:47.412 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394402+0000", 2024-09-12T22:32:47.412 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.875e-06 2024-09-12T22:32:47.412 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.412 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.412 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:47.412 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394405+0000", 2024-09-12T22:32:47.412 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6799999999999999e-06 2024-09-12T22:32:47.412 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.412 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.412 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:47.412 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394408+0000", 2024-09-12T22:32:47.412 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.667e-06 2024-09-12T22:32:47.412 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.413 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.413 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:47.413 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401395+0000", 2024-09-12T22:32:47.413 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0069867230000000002 2024-09-12T22:32:47.413 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.413 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.413 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:47.413 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401438+0000", 2024-09-12T22:32:47.413 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3554999999999999e-05 2024-09-12T22:32:47.413 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.413 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.413 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:47.413 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401509+0000", 2024-09-12T22:32:47.413 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0631999999999997e-05 2024-09-12T22:32:47.413 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.414 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.414 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:47.414 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405392+0000", 2024-09-12T22:32:47.415 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0038830449999999999 2024-09-12T22:32:47.416 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.416 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.416 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:47.416 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405690+0000", 2024-09-12T22:32:47.416 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000298435 2024-09-12T22:32:47.416 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.416 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.416 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:47.416 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405716+0000", 2024-09-12T22:32:47.416 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5435999999999998e-05 2024-09-12T22:32:47.417 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.417 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.417 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:47.417 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405736+0000", 2024-09-12T22:32:47.417 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0208999999999999e-05 2024-09-12T22:32:47.417 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:47.417 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:47.417 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:47.417 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.417 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.417 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:32:47.417 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394411+0000", 2024-09-12T22:32:47.417 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 78.999268912999995, 2024-09-12T22:32:47.418 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011400117, 2024-09-12T22:32:47.418 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:47.418 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:47.418 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:47.418 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:47.418 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:47.418 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:47.418 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 187 2024-09-12T22:32:47.418 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.418 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:47.418 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.418 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:47.418 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394411+0000", 2024-09-12T22:32:47.418 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:47.419 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.419 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.419 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:47.419 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394411+0000", 2024-09-12T22:32:47.419 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:47.419 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.419 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.419 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:47.419 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394412+0000", 2024-09-12T22:32:47.419 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.4999999999999999e-07 2024-09-12T22:32:47.419 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.419 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.419 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:47.419 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394414+0000", 2024-09-12T22:32:47.420 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.984e-06 2024-09-12T22:32:47.420 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.420 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.420 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:47.420 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394418+0000", 2024-09-12T22:32:47.420 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0840000000000002e-06 2024-09-12T22:32:47.420 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.420 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.420 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:47.420 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394431+0000", 2024-09-12T22:32:47.420 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.361e-05 2024-09-12T22:32:47.420 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.420 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.420 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:47.421 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401778+0000", 2024-09-12T22:32:47.421 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0073462659999999997 2024-09-12T22:32:47.421 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.421 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.421 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:47.421 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401853+0000", 2024-09-12T22:32:47.421 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5797000000000006e-05 2024-09-12T22:32:47.421 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.421 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.421 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:47.421 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401990+0000", 2024-09-12T22:32:47.421 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013651399999999999 2024-09-12T22:32:47.421 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.421 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.422 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:47.422 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405402+0000", 2024-09-12T22:32:47.422 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0034116070000000001 2024-09-12T22:32:47.422 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.422 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.422 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:47.422 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405764+0000", 2024-09-12T22:32:47.422 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00036234899999999998 2024-09-12T22:32:47.422 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.422 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.422 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:47.422 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405791+0000", 2024-09-12T22:32:47.422 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7029000000000002e-05 2024-09-12T22:32:47.422 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.423 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.423 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:47.423 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405812+0000", 2024-09-12T22:32:47.423 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0627000000000001e-05 2024-09-12T22:32:47.423 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:47.423 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:47.423 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:47.423 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.423 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.423 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:32:47.423 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394447+0000", 2024-09-12T22:32:47.423 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 78.999233762000003, 2024-09-12T22:32:47.423 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011759588, 2024-09-12T22:32:47.423 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:47.424 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:47.424 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:47.424 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:47.424 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:47.424 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:47.424 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 188 2024-09-12T22:32:47.424 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.424 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:47.424 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.424 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:47.424 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394447+0000", 2024-09-12T22:32:47.424 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:47.424 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.424 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.425 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:47.425 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394447+0000", 2024-09-12T22:32:47.425 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:47.425 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.425 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.425 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:47.425 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394447+0000", 2024-09-12T22:32:47.425 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.15e-07 2024-09-12T22:32:47.425 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.425 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.425 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:47.425 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394512+0000", 2024-09-12T22:32:47.425 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4580999999999997e-05 2024-09-12T22:32:47.425 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.425 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.426 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:47.426 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394518+0000", 2024-09-12T22:32:47.426 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.3380000000000001e-06 2024-09-12T22:32:47.426 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.426 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.426 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:47.426 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394521+0000", 2024-09-12T22:32:47.426 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3340000000000002e-06 2024-09-12T22:32:47.426 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.426 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.426 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:47.426 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.402628+0000", 2024-09-12T22:32:47.426 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.008106996 2024-09-12T22:32:47.427 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.427 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.427 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:47.427 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.402670+0000", 2024-09-12T22:32:47.427 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1983000000000001e-05 2024-09-12T22:32:47.427 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.427 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.427 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:47.427 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.402738+0000", 2024-09-12T22:32:47.427 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.8114999999999994e-05 2024-09-12T22:32:47.427 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.427 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.427 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:47.427 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405668+0000", 2024-09-12T22:32:47.428 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.002929545 2024-09-12T22:32:47.428 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.428 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.428 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:47.428 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406162+0000", 2024-09-12T22:32:47.428 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000494408 2024-09-12T22:32:47.428 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.428 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.428 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:47.428 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406188+0000", 2024-09-12T22:32:47.428 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5766e-05 2024-09-12T22:32:47.428 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.429 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.429 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:47.429 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406206+0000", 2024-09-12T22:32:47.429 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.8107000000000001e-05 2024-09-12T22:32:47.429 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:47.429 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:47.429 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:47.429 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.429 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.429 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:32:47.429 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394528+0000", 2024-09-12T22:32:47.429 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 78.999152093000006, 2024-09-12T22:32:47.429 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.01195536, 2024-09-12T22:32:47.429 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:47.430 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:47.430 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:47.430 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:47.430 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:47.430 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:47.430 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 189 2024-09-12T22:32:47.430 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.430 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:47.430 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.430 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:47.430 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394528+0000", 2024-09-12T22:32:47.430 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:47.430 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.431 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.431 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:47.431 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394528+0000", 2024-09-12T22:32:47.431 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:47.431 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.431 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.431 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:47.431 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394529+0000", 2024-09-12T22:32:47.431 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4900000000000001e-07 2024-09-12T22:32:47.431 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.431 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.431 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:47.431 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394531+0000", 2024-09-12T22:32:47.431 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.458e-06 2024-09-12T22:32:47.432 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.432 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.432 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:47.432 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394535+0000", 2024-09-12T22:32:47.432 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7900000000000001e-06 2024-09-12T22:32:47.432 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.432 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.432 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:47.432 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394537+0000", 2024-09-12T22:32:47.432 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.632e-06 2024-09-12T22:32:47.432 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.432 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.433 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:47.433 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.404932+0000", 2024-09-12T22:32:47.433 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010394158000000001 2024-09-12T22:32:47.433 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.433 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.433 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:47.433 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405017+0000", 2024-09-12T22:32:47.433 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5525000000000005e-05 2024-09-12T22:32:47.433 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.433 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.433 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:47.434 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405114+0000", 2024-09-12T22:32:47.434 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.6527000000000006e-05 2024-09-12T22:32:47.434 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.434 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.434 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:47.434 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405818+0000", 2024-09-12T22:32:47.434 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00070412800000000005 2024-09-12T22:32:47.434 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.434 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.434 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:47.434 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406437+0000", 2024-09-12T22:32:47.434 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00061898900000000002 2024-09-12T22:32:47.434 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.434 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.435 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:47.435 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406463+0000", 2024-09-12T22:32:47.435 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6268e-05 2024-09-12T22:32:47.435 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.435 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.435 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:47.435 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406484+0000", 2024-09-12T22:32:47.435 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0536000000000001e-05 2024-09-12T22:32:47.435 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:47.435 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:47.435 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:47.435 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.435 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.435 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:47.436 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.401422+0000", 2024-09-12T22:32:47.436 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 69.992258187999994, 2024-09-12T22:32:47.436 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016896452999999999, 2024-09-12T22:32:47.436 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:47.436 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:47.436 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:47.436 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:47.436 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.436 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:47.436 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401422+0000", 2024-09-12T22:32:47.436 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:47.437 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.437 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.437 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:47.437 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401422+0000", 2024-09-12T22:32:47.437 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:47.437 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.437 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.437 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:47.437 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401424+0000", 2024-09-12T22:32:47.437 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9e-06 2024-09-12T22:32:47.437 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.437 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.437 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:47.438 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401437+0000", 2024-09-12T22:32:47.438 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2831e-05 2024-09-12T22:32:47.438 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.438 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.438 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:47.438 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401471+0000", 2024-09-12T22:32:47.438 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4010000000000001e-05 2024-09-12T22:32:47.438 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.438 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.438 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:47.438 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401484+0000", 2024-09-12T22:32:47.438 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2711000000000001e-05 2024-09-12T22:32:47.439 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.439 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.439 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:47.439 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405410+0000", 2024-09-12T22:32:47.439 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0039259170000000001 2024-09-12T22:32:47.439 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.439 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.439 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:47.439 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405529+0000", 2024-09-12T22:32:47.439 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000119778 2024-09-12T22:32:47.439 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.439 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.439 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:47.440 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405655+0000", 2024-09-12T22:32:47.440 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012556700000000001 2024-09-12T22:32:47.440 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.440 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.440 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:47.440 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410456+0000", 2024-09-12T22:32:47.440 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0048008269999999997 2024-09-12T22:32:47.440 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.440 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.440 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:47.440 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418226+0000", 2024-09-12T22:32:47.440 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0077707729999999999 2024-09-12T22:32:47.440 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.441 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.441 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:47.441 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418277+0000", 2024-09-12T22:32:47.441 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0476000000000003e-05 2024-09-12T22:32:47.441 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.441 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.441 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:47.441 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418319+0000", 2024-09-12T22:32:47.441 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1662999999999997e-05 2024-09-12T22:32:47.441 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:47.441 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:47.441 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:47.441 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.442 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.442 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:47.442 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.401505+0000", 2024-09-12T22:32:47.442 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 69.992175524000004, 2024-09-12T22:32:47.442 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016987904000000002, 2024-09-12T22:32:47.442 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:47.442 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:47.442 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:47.442 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:47.442 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.442 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:47.442 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401505+0000", 2024-09-12T22:32:47.442 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:47.443 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.443 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.443 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:47.443 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401505+0000", 2024-09-12T22:32:47.443 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:47.443 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.443 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.443 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:47.443 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401506+0000", 2024-09-12T22:32:47.443 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4700000000000001e-07 2024-09-12T22:32:47.443 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.443 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.443 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:47.444 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401510+0000", 2024-09-12T22:32:47.444 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6609999999999999e-06 2024-09-12T22:32:47.444 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.444 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.444 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:47.444 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401771+0000", 2024-09-12T22:32:47.444 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00026110700000000001 2024-09-12T22:32:47.444 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.444 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.444 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:47.444 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401921+0000", 2024-09-12T22:32:47.444 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014939099999999999 2024-09-12T22:32:47.444 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.444 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.445 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:47.445 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405944+0000", 2024-09-12T22:32:47.445 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0040235449999999999 2024-09-12T22:32:47.445 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.445 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.445 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:47.445 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406018+0000", 2024-09-12T22:32:47.445 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3373000000000004e-05 2024-09-12T22:32:47.445 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.445 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.445 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:47.445 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406172+0000", 2024-09-12T22:32:47.446 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00015435399999999999 2024-09-12T22:32:47.446 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.446 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.446 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:47.446 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410461+0000", 2024-09-12T22:32:47.446 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0042888609999999997 2024-09-12T22:32:47.446 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.446 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.446 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:47.446 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418371+0000", 2024-09-12T22:32:47.446 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0079098380000000006 2024-09-12T22:32:47.446 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.447 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.447 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:47.447 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418443+0000", 2024-09-12T22:32:47.447 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2705000000000003e-05 2024-09-12T22:32:47.447 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.447 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.447 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:47.447 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418493+0000", 2024-09-12T22:32:47.447 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9322e-05 2024-09-12T22:32:47.447 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:47.447 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:47.447 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:47.447 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.448 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.448 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:47.448 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.401939+0000", 2024-09-12T22:32:47.448 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 69.991741787999999, 2024-09-12T22:32:47.448 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016722292999999999, 2024-09-12T22:32:47.448 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:47.448 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:47.448 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:47.448 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:47.448 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.448 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:47.448 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401939+0000", 2024-09-12T22:32:47.448 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:47.449 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.449 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.449 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:47.449 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401939+0000", 2024-09-12T22:32:47.449 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:47.449 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.449 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.449 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:47.449 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401940+0000", 2024-09-12T22:32:47.449 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1990000000000001e-06 2024-09-12T22:32:47.449 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.449 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.449 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:47.450 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401956+0000", 2024-09-12T22:32:47.450 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.6344000000000001e-05 2024-09-12T22:32:47.450 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.450 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.450 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:47.450 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401974+0000", 2024-09-12T22:32:47.450 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7730000000000001e-05 2024-09-12T22:32:47.450 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.450 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.450 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:47.450 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401982+0000", 2024-09-12T22:32:47.450 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.7800000000000001e-06 2024-09-12T22:32:47.451 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.451 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.451 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:47.451 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406557+0000", 2024-09-12T22:32:47.451 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0045758489999999999 2024-09-12T22:32:47.451 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.451 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.451 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:47.451 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406697+0000", 2024-09-12T22:32:47.451 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013925100000000001 2024-09-12T22:32:47.451 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.451 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.451 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:47.451 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406830+0000", 2024-09-12T22:32:47.452 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013293499999999999 2024-09-12T22:32:47.452 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.452 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.452 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:47.452 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410465+0000", 2024-09-12T22:32:47.452 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0036352680000000001 2024-09-12T22:32:47.452 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.452 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.452 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:47.452 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418564+0000", 2024-09-12T22:32:47.452 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0080992140000000004 2024-09-12T22:32:47.452 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.453 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.453 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:47.453 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418621+0000", 2024-09-12T22:32:47.453 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7167999999999999e-05 2024-09-12T22:32:47.453 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.453 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.453 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:47.453 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418661+0000", 2024-09-12T22:32:47.453 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9555000000000003e-05 2024-09-12T22:32:47.453 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:47.453 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:47.453 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:47.453 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.453 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.454 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:47.454 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.401994+0000", 2024-09-12T22:32:47.454 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 69.991685915999994, 2024-09-12T22:32:47.454 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016804109000000001, 2024-09-12T22:32:47.454 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:47.454 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:47.454 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:47.454 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:47.454 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.454 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:47.454 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401994+0000", 2024-09-12T22:32:47.455 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:47.455 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.455 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.455 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:47.455 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401994+0000", 2024-09-12T22:32:47.455 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:47.455 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.455 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.455 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:47.455 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401995+0000", 2024-09-12T22:32:47.455 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.8899999999999998e-07 2024-09-12T22:32:47.455 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.455 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.455 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:47.456 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402000+0000", 2024-09-12T22:32:47.456 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.498e-06 2024-09-12T22:32:47.456 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.456 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.456 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:47.456 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402007+0000", 2024-09-12T22:32:47.456 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.554e-06 2024-09-12T22:32:47.456 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.456 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.456 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:47.456 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402046+0000", 2024-09-12T22:32:47.456 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9156000000000003e-05 2024-09-12T22:32:47.456 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.456 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.457 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:47.457 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407342+0000", 2024-09-12T22:32:47.457 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052957610000000004 2024-09-12T22:32:47.457 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.457 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.457 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:47.457 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407521+0000", 2024-09-12T22:32:47.457 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00017878100000000001 2024-09-12T22:32:47.457 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.457 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.457 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:47.458 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407641+0000", 2024-09-12T22:32:47.458 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012013 2024-09-12T22:32:47.458 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.458 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.458 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:47.458 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410472+0000", 2024-09-12T22:32:47.458 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.002830455 2024-09-12T22:32:47.458 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.458 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.458 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:47.458 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418714+0000", 2024-09-12T22:32:47.458 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0082422789999999999 2024-09-12T22:32:47.458 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.458 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.459 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:47.459 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418761+0000", 2024-09-12T22:32:47.459 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6956999999999998e-05 2024-09-12T22:32:47.459 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.459 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.459 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:47.459 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418799+0000", 2024-09-12T22:32:47.459 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7749000000000001e-05 2024-09-12T22:32:47.459 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:47.459 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:47.459 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:47.459 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.460 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.460 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:47.460 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.402060+0000", 2024-09-12T22:32:47.460 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 69.991620471999994, 2024-09-12T22:32:47.460 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016885686, 2024-09-12T22:32:47.460 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:47.460 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:47.460 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:47.460 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:47.460 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.460 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:47.460 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402060+0000", 2024-09-12T22:32:47.460 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:47.461 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.461 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.461 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:47.461 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402060+0000", 2024-09-12T22:32:47.461 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:47.461 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.461 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.461 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:47.461 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402061+0000", 2024-09-12T22:32:47.461 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4399999999999999e-07 2024-09-12T22:32:47.461 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.461 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.461 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:47.461 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402066+0000", 2024-09-12T22:32:47.462 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8649999999999998e-06 2024-09-12T22:32:47.462 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.462 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.462 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:47.462 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402146+0000", 2024-09-12T22:32:47.462 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9054000000000006e-05 2024-09-12T22:32:47.462 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.462 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.462 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:47.462 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402287+0000", 2024-09-12T22:32:47.462 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014108600000000001 2024-09-12T22:32:47.462 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.462 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.463 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:47.463 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408185+0000", 2024-09-12T22:32:47.463 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0058983919999999997 2024-09-12T22:32:47.463 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.463 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.463 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:47.463 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408299+0000", 2024-09-12T22:32:47.463 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114102 2024-09-12T22:32:47.463 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.463 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.463 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:47.463 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408420+0000", 2024-09-12T22:32:47.463 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000120492 2024-09-12T22:32:47.464 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.464 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.464 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:47.464 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410867+0000", 2024-09-12T22:32:47.464 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0024476430000000002 2024-09-12T22:32:47.464 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.464 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.464 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:47.464 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418851+0000", 2024-09-12T22:32:47.464 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0079841489999999994 2024-09-12T22:32:47.464 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.464 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.465 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:47.465 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418894+0000", 2024-09-12T22:32:47.465 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3090000000000002e-05 2024-09-12T22:32:47.465 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.465 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.465 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:47.465 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418946+0000", 2024-09-12T22:32:47.465 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1069000000000002e-05 2024-09-12T22:32:47.465 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:47.465 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:47.465 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:47.465 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.465 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.465 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:47.466 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.402375+0000", 2024-09-12T22:32:47.466 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 69.991305406999999, 2024-09-12T22:32:47.466 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016768531999999999, 2024-09-12T22:32:47.466 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:47.466 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:47.466 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:47.466 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:47.466 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.466 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:47.466 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402375+0000", 2024-09-12T22:32:47.466 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:47.466 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.466 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.466 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:47.467 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402375+0000", 2024-09-12T22:32:47.467 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:47.467 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.467 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.467 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:47.467 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402375+0000", 2024-09-12T22:32:47.467 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4099999999999999e-07 2024-09-12T22:32:47.467 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.467 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.467 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:47.467 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402379+0000", 2024-09-12T22:32:47.467 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9870000000000001e-06 2024-09-12T22:32:47.467 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.468 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.468 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:47.468 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402389+0000", 2024-09-12T22:32:47.468 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0000000000000001e-05 2024-09-12T22:32:47.468 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.468 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.468 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:47.468 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402401+0000", 2024-09-12T22:32:47.468 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.148e-05 2024-09-12T22:32:47.468 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.468 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.468 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:47.468 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409108+0000", 2024-09-12T22:32:47.469 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0067068429999999997 2024-09-12T22:32:47.469 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.469 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.469 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:47.469 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409189+0000", 2024-09-12T22:32:47.469 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0815999999999993e-05 2024-09-12T22:32:47.469 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.470 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.470 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:47.470 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409320+0000", 2024-09-12T22:32:47.470 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000131586 2024-09-12T22:32:47.470 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.470 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.470 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:47.470 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410872+0000", 2024-09-12T22:32:47.470 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0015521599999999999 2024-09-12T22:32:47.470 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.470 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.470 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:47.470 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419049+0000", 2024-09-12T22:32:47.471 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0081763719999999995 2024-09-12T22:32:47.471 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.471 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.471 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:47.471 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419107+0000", 2024-09-12T22:32:47.471 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7899000000000002e-05 2024-09-12T22:32:47.471 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.471 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.471 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:47.471 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419143+0000", 2024-09-12T22:32:47.471 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6847999999999997e-05 2024-09-12T22:32:47.471 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:47.471 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:47.471 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:47.472 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.472 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.472 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:47.472 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.402903+0000", 2024-09-12T22:32:47.472 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 69.990776995000004, 2024-09-12T22:32:47.472 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016378428, 2024-09-12T22:32:47.472 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:47.472 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:47.472 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:47.472 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:47.472 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.472 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:47.472 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402903+0000", 2024-09-12T22:32:47.473 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:47.473 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.473 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.473 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:47.473 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402903+0000", 2024-09-12T22:32:47.473 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:47.473 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.473 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.473 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:47.473 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402904+0000", 2024-09-12T22:32:47.473 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9500000000000001e-07 2024-09-12T22:32:47.473 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.473 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.473 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:47.474 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402944+0000", 2024-09-12T22:32:47.474 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0265000000000002e-05 2024-09-12T22:32:47.474 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.474 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.474 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:47.474 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402979+0000", 2024-09-12T22:32:47.474 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4378000000000002e-05 2024-09-12T22:32:47.474 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.474 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.474 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:47.474 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402987+0000", 2024-09-12T22:32:47.474 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3559999999999993e-06 2024-09-12T22:32:47.474 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.474 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.475 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:47.475 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409577+0000", 2024-09-12T22:32:47.475 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0065901709999999997 2024-09-12T22:32:47.475 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.475 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.475 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:47.475 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409653+0000", 2024-09-12T22:32:47.475 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5819e-05 2024-09-12T22:32:47.475 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.475 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.475 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:47.475 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409725+0000", 2024-09-12T22:32:47.475 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2200000000000007e-05 2024-09-12T22:32:47.476 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.476 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.476 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:47.476 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.411234+0000", 2024-09-12T22:32:47.476 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001508225 2024-09-12T22:32:47.476 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.476 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.476 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:47.476 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419212+0000", 2024-09-12T22:32:47.476 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0079783400000000004 2024-09-12T22:32:47.476 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.476 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.477 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:47.477 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419244+0000", 2024-09-12T22:32:47.477 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2384e-05 2024-09-12T22:32:47.477 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.477 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.477 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:47.477 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419282+0000", 2024-09-12T22:32:47.477 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7394999999999997e-05 2024-09-12T22:32:47.477 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:47.477 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:47.477 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:47.477 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.477 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.478 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:47.478 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.403135+0000", 2024-09-12T22:32:47.478 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 69.990545124999997, 2024-09-12T22:32:47.478 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016294211999999999, 2024-09-12T22:32:47.478 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:47.478 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:47.478 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:47.478 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:47.478 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.478 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:47.478 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403135+0000", 2024-09-12T22:32:47.478 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:47.478 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.479 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.479 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:47.479 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403135+0000", 2024-09-12T22:32:47.479 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:47.479 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.479 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.479 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:47.479 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403136+0000", 2024-09-12T22:32:47.479 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.4e-07 2024-09-12T22:32:47.479 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.479 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.479 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:47.479 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403149+0000", 2024-09-12T22:32:47.479 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2723e-05 2024-09-12T22:32:47.480 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.480 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.480 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:47.480 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403158+0000", 2024-09-12T22:32:47.480 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3919999999999992e-06 2024-09-12T22:32:47.480 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.480 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.480 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:47.480 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403166+0000", 2024-09-12T22:32:47.480 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.2309999999999996e-06 2024-09-12T22:32:47.480 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.480 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.481 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:47.481 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409944+0000", 2024-09-12T22:32:47.481 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0067775309999999998 2024-09-12T22:32:47.481 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.481 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.481 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:47.481 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410032+0000", 2024-09-12T22:32:47.481 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.7906999999999997e-05 2024-09-12T22:32:47.481 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.481 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.481 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:47.481 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410152+0000", 2024-09-12T22:32:47.481 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012037800000000001 2024-09-12T22:32:47.482 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.482 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.482 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:47.482 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.411945+0000", 2024-09-12T22:32:47.482 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0017931850000000001 2024-09-12T22:32:47.482 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.482 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.482 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:47.482 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419319+0000", 2024-09-12T22:32:47.482 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0073731780000000002 2024-09-12T22:32:47.482 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.482 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.482 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:47.482 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419376+0000", 2024-09-12T22:32:47.483 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7728e-05 2024-09-12T22:32:47.483 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.483 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.483 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:47.483 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419429+0000", 2024-09-12T22:32:47.483 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3019000000000002e-05 2024-09-12T22:32:47.483 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:47.483 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:47.483 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:47.483 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.483 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.483 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:47.483 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.403185+0000", 2024-09-12T22:32:47.484 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 69.990495244000002, 2024-09-12T22:32:47.484 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.014902164000000001, 2024-09-12T22:32:47.484 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:47.484 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:47.484 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:47.484 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:47.484 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.484 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:47.484 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403185+0000", 2024-09-12T22:32:47.484 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:47.484 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.484 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.484 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:47.485 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403185+0000", 2024-09-12T22:32:47.485 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:47.485 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.485 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.485 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:47.485 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403186+0000", 2024-09-12T22:32:47.485 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9400000000000005e-07 2024-09-12T22:32:47.485 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.485 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.485 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:47.485 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403191+0000", 2024-09-12T22:32:47.485 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6980000000000003e-06 2024-09-12T22:32:47.485 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.485 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.486 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:47.486 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403199+0000", 2024-09-12T22:32:47.486 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2520000000000002e-06 2024-09-12T22:32:47.486 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.486 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.486 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:47.486 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403205+0000", 2024-09-12T22:32:47.486 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.908e-06 2024-09-12T22:32:47.486 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.486 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.486 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:47.486 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403359+0000", 2024-09-12T22:32:47.486 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000154544 2024-09-12T22:32:47.487 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.487 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.487 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:47.487 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403528+0000", 2024-09-12T22:32:47.487 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000168455 2024-09-12T22:32:47.487 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.487 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.487 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:47.487 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403763+0000", 2024-09-12T22:32:47.487 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00023539599999999999 2024-09-12T22:32:47.487 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.487 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.487 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:47.487 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409378+0000", 2024-09-12T22:32:47.488 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056150000000000002 2024-09-12T22:32:47.488 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.488 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.488 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:47.488 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418012+0000", 2024-09-12T22:32:47.488 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0086339559999999999 2024-09-12T22:32:47.488 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.488 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.488 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:47.488 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418046+0000", 2024-09-12T22:32:47.488 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4267999999999998e-05 2024-09-12T22:32:47.488 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.488 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.489 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:47.489 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418087+0000", 2024-09-12T22:32:47.489 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0992999999999999e-05 2024-09-12T22:32:47.489 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:47.489 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:47.489 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:47.489 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.489 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.489 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:47.489 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.403273+0000", 2024-09-12T22:32:47.489 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 69.990407293000004, 2024-09-12T22:32:47.489 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.014934866, 2024-09-12T22:32:47.489 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:47.489 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:47.490 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:47.490 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:47.490 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.490 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:47.490 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403273+0000", 2024-09-12T22:32:47.490 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:47.490 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.490 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.490 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:47.490 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403273+0000", 2024-09-12T22:32:47.490 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:47.490 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.490 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.490 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:47.491 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403274+0000", 2024-09-12T22:32:47.491 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.297e-06 2024-09-12T22:32:47.491 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.491 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.491 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:47.491 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403282+0000", 2024-09-12T22:32:47.491 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6340000000000001e-06 2024-09-12T22:32:47.491 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.491 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.491 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:47.491 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403305+0000", 2024-09-12T22:32:47.491 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3149000000000001e-05 2024-09-12T22:32:47.491 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.491 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.492 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:47.492 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403320+0000", 2024-09-12T22:32:47.492 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4527e-05 2024-09-12T22:32:47.492 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.492 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.492 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:47.492 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.404928+0000", 2024-09-12T22:32:47.492 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001608459 2024-09-12T22:32:47.492 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.492 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.492 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:47.492 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405218+0000", 2024-09-12T22:32:47.492 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00028982900000000002 2024-09-12T22:32:47.492 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.493 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.493 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:47.493 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405829+0000", 2024-09-12T22:32:47.493 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00061127900000000005 2024-09-12T22:32:47.493 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.493 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.493 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:47.493 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409403+0000", 2024-09-12T22:32:47.493 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.003573597 2024-09-12T22:32:47.493 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.493 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.493 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:47.493 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418138+0000", 2024-09-12T22:32:47.493 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0087349969999999996 2024-09-12T22:32:47.494 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.494 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.494 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:47.494 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418178+0000", 2024-09-12T22:32:47.494 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0649999999999999e-05 2024-09-12T22:32:47.494 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.494 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.494 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:47.494 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418208+0000", 2024-09-12T22:32:47.494 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9448e-05 2024-09-12T22:32:47.494 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:47.494 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:47.494 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:47.495 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.495 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.495 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:47.495 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.405456+0000", 2024-09-12T22:32:47.495 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 69.988224148, 2024-09-12T22:32:47.495 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012888389, 2024-09-12T22:32:47.495 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:47.495 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:47.495 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:47.495 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:47.495 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.495 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:47.495 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405456+0000", 2024-09-12T22:32:47.495 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:47.496 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.496 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.496 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:47.496 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405456+0000", 2024-09-12T22:32:47.496 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:47.496 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.496 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.496 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:47.496 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405457+0000", 2024-09-12T22:32:47.496 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.6599999999999994e-07 2024-09-12T22:32:47.496 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.496 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.496 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:47.497 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405463+0000", 2024-09-12T22:32:47.497 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4739999999999996e-06 2024-09-12T22:32:47.497 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.497 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.497 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:47.497 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405474+0000", 2024-09-12T22:32:47.497 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1095e-05 2024-09-12T22:32:47.497 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.497 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.497 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:47.497 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405482+0000", 2024-09-12T22:32:47.497 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3610000000000001e-06 2024-09-12T22:32:47.497 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.498 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.498 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:47.498 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407051+0000", 2024-09-12T22:32:47.498 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0015688970000000001 2024-09-12T22:32:47.498 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.498 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.498 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:47.498 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407259+0000", 2024-09-12T22:32:47.498 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00020778300000000001 2024-09-12T22:32:47.498 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.498 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.498 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:47.498 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407622+0000", 2024-09-12T22:32:47.498 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000363066 2024-09-12T22:32:47.499 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.499 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.499 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:47.499 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409438+0000", 2024-09-12T22:32:47.499 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001816319 2024-09-12T22:32:47.499 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.499 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.499 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:47.499 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418257+0000", 2024-09-12T22:32:47.499 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0088187720000000008 2024-09-12T22:32:47.499 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.499 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.499 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:47.499 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418308+0000", 2024-09-12T22:32:47.500 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1180000000000001e-05 2024-09-12T22:32:47.500 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.500 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.500 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:47.500 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418345+0000", 2024-09-12T22:32:47.500 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6476000000000001e-05 2024-09-12T22:32:47.500 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:47.500 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:47.500 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:47.500 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.500 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.501 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:47.501 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.405496+0000", 2024-09-12T22:32:47.501 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 69.988184790999995, 2024-09-12T22:32:47.501 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013016012, 2024-09-12T22:32:47.501 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:47.501 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:47.501 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:47.501 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:47.501 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.501 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:47.501 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405496+0000", 2024-09-12T22:32:47.501 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:47.501 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.501 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.502 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:47.502 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405496+0000", 2024-09-12T22:32:47.502 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:47.502 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.502 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.502 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:47.502 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405496+0000", 2024-09-12T22:32:47.502 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7999999999999995e-07 2024-09-12T22:32:47.502 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.502 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.502 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:47.502 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405501+0000", 2024-09-12T22:32:47.502 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8359999999999999e-06 2024-09-12T22:32:47.503 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.503 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.503 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:47.503 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405514+0000", 2024-09-12T22:32:47.503 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2522e-05 2024-09-12T22:32:47.503 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.503 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.503 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:47.503 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405521+0000", 2024-09-12T22:32:47.503 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5020000000000003e-06 2024-09-12T22:32:47.503 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.503 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.503 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:47.503 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405575+0000", 2024-09-12T22:32:47.504 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4169999999999998e-05 2024-09-12T22:32:47.504 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.504 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.504 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:47.504 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405697+0000", 2024-09-12T22:32:47.504 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000121301 2024-09-12T22:32:47.504 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.504 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.504 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:47.504 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405829+0000", 2024-09-12T22:32:47.504 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000132662 2024-09-12T22:32:47.504 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.504 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.504 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:47.505 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409155+0000", 2024-09-12T22:32:47.505 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0033259050000000001 2024-09-12T22:32:47.505 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.505 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.505 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:47.505 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418425+0000", 2024-09-12T22:32:47.505 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0092696319999999999 2024-09-12T22:32:47.505 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.505 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.505 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:47.505 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418471+0000", 2024-09-12T22:32:47.505 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6213e-05 2024-09-12T22:32:47.505 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.506 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.506 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:47.506 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418512+0000", 2024-09-12T22:32:47.506 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0589000000000001e-05 2024-09-12T22:32:47.506 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:47.506 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:47.506 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:47.506 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.506 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.507 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:47.507 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.406108+0000", 2024-09-12T22:32:47.507 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 69.987572393999997, 2024-09-12T22:32:47.507 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012458175, 2024-09-12T22:32:47.507 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:47.507 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:47.507 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:47.507 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:47.507 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.507 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:47.507 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406108+0000", 2024-09-12T22:32:47.508 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:47.508 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.508 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.508 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:47.508 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406108+0000", 2024-09-12T22:32:47.508 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:47.508 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.508 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.508 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:47.508 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406109+0000", 2024-09-12T22:32:47.508 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9899999999999999e-07 2024-09-12T22:32:47.508 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.508 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.508 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:47.509 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406115+0000", 2024-09-12T22:32:47.509 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9030000000000001e-06 2024-09-12T22:32:47.509 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.509 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.509 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:47.509 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406141+0000", 2024-09-12T22:32:47.509 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5999e-05 2024-09-12T22:32:47.509 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.509 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.509 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:47.509 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406150+0000", 2024-09-12T22:32:47.509 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.6050000000000004e-06 2024-09-12T22:32:47.509 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.510 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.510 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:47.510 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408163+0000", 2024-09-12T22:32:47.510 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0020122769999999998 2024-09-12T22:32:47.510 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.510 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.510 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:47.510 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408309+0000", 2024-09-12T22:32:47.510 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014606999999999999 2024-09-12T22:32:47.510 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.510 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.510 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:47.510 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408433+0000", 2024-09-12T22:32:47.510 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012460300000000001 2024-09-12T22:32:47.511 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.511 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.511 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:47.511 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409903+0000", 2024-09-12T22:32:47.511 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001469499 2024-09-12T22:32:47.511 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.511 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.511 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:47.511 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418427+0000", 2024-09-12T22:32:47.511 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0085241139999999993 2024-09-12T22:32:47.511 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.511 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.511 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:47.511 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418471+0000", 2024-09-12T22:32:47.512 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4474000000000001e-05 2024-09-12T22:32:47.512 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.512 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.512 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:47.512 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418566+0000", 2024-09-12T22:32:47.512 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.4732e-05 2024-09-12T22:32:47.512 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:47.512 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:47.512 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:47.512 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.512 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.512 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:47.512 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.407266+0000", 2024-09-12T22:32:47.512 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 69.986414538000005, 2024-09-12T22:32:47.513 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011442905, 2024-09-12T22:32:47.513 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:47.513 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:47.513 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2024-09-12T22:32:47.513 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:47.513 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.513 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:47.513 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407266+0000", 2024-09-12T22:32:47.513 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:47.513 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.513 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.513 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:47.513 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407266+0000", 2024-09-12T22:32:47.514 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:47.514 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.514 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.514 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:47.514 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407266+0000", 2024-09-12T22:32:47.514 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7899999999999998e-07 2024-09-12T22:32:47.514 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.514 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.514 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:47.514 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407269+0000", 2024-09-12T22:32:47.514 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9210000000000001e-06 2024-09-12T22:32:47.514 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.514 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.514 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:47.515 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407331+0000", 2024-09-12T22:32:47.515 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1376000000000003e-05 2024-09-12T22:32:47.515 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.515 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.515 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:47.515 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407337+0000", 2024-09-12T22:32:47.515 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1929999999999998e-06 2024-09-12T22:32:47.515 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.515 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.515 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:47.515 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408974+0000", 2024-09-12T22:32:47.515 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0016367109999999999 2024-09-12T22:32:47.516 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.516 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.516 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:47.516 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409112+0000", 2024-09-12T22:32:47.516 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000137952 2024-09-12T22:32:47.516 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:47.516 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:47.516 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:47.516 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418709+0000", 2024-09-12T22:32:47.516 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0095971730000000005 2024-09-12T22:32:47.516 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:47.516 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:47.516 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:47.517 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:47.517 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:47.517 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-09-12T22:32:47.519 INFO:teuthology.orchestra.run.smithi019.stderr:nodeep-scrub is set 2024-09-12T22:32:47.519 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:47.517+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:47.519 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:32:47.619 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:47.618+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:47.626 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:32:47.626 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:32:47.626 INFO:teuthology.orchestra.run.smithi148.stdout: "num_ops": 0 2024-09-12T22:32:47.626 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:32:47.635 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:32:47.720 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:47.719+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:47.738 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:32:47.738 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:32:47.738 INFO:teuthology.orchestra.run.smithi148.stdout: "complaint_time": 30, 2024-09-12T22:32:47.738 INFO:teuthology.orchestra.run.smithi148.stdout: "num_blocked_ops": 0 2024-09-12T22:32:47.738 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:32:47.747 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:32:47.824 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:47.820+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:47.853 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:32:47.853 INFO:teuthology.orchestra.run.smithi148.stdout: "size": 20, 2024-09-12T22:32:47.853 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 600, 2024-09-12T22:32:47.853 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [ 2024-09-12T22:32:47.853 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.853 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:47.853 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.400880+0000", 2024-09-12T22:32:47.853 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 70.449889975000005, 2024-09-12T22:32:47.853 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0095133660000000005, 2024-09-12T22:32:47.853 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:47.853 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:47.854 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:47.854 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:47.854 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.854 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:47.854 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400880+0000", 2024-09-12T22:32:47.854 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:47.854 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.854 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.854 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:47.854 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400880+0000", 2024-09-12T22:32:47.854 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:47.854 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.854 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.854 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:47.855 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400892+0000", 2024-09-12T22:32:47.855 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1941e-05 2024-09-12T22:32:47.856 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.856 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.856 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:47.856 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400900+0000", 2024-09-12T22:32:47.857 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0080000000000002e-06 2024-09-12T22:32:47.857 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.857 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.857 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:47.857 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400911+0000", 2024-09-12T22:32:47.857 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1452e-05 2024-09-12T22:32:47.857 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.857 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.857 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:47.857 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400922+0000", 2024-09-12T22:32:47.858 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0772e-05 2024-09-12T22:32:47.858 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.858 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.858 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:47.858 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401009+0000", 2024-09-12T22:32:47.858 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.7206000000000005e-05 2024-09-12T22:32:47.858 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.858 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.858 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:47.858 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401157+0000", 2024-09-12T22:32:47.858 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014831499999999999 2024-09-12T22:32:47.859 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.859 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.859 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:47.859 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401312+0000", 2024-09-12T22:32:47.859 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00015495600000000001 2024-09-12T22:32:47.859 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.859 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.859 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:47.859 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.403060+0000", 2024-09-12T22:32:47.859 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0017475220000000001 2024-09-12T22:32:47.859 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.860 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.860 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:47.860 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410300+0000", 2024-09-12T22:32:47.860 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0072403260000000001 2024-09-12T22:32:47.860 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.860 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.860 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:47.860 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410350+0000", 2024-09-12T22:32:47.860 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9814000000000001e-05 2024-09-12T22:32:47.860 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.860 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.861 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:47.861 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410393+0000", 2024-09-12T22:32:47.861 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3053999999999998e-05 2024-09-12T22:32:47.861 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:47.861 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:47.861 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:47.861 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.861 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.861 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:47.861 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.400952+0000", 2024-09-12T22:32:47.862 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 70.449817823000004, 2024-09-12T22:32:47.862 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0096045620000000005, 2024-09-12T22:32:47.862 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:47.862 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:47.862 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:47.862 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:47.862 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.862 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:47.862 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400952+0000", 2024-09-12T22:32:47.862 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:47.862 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.863 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.863 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:47.863 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400952+0000", 2024-09-12T22:32:47.863 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:47.863 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.863 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.863 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:47.863 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400953+0000", 2024-09-12T22:32:47.863 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.8000000000000005e-07 2024-09-12T22:32:47.863 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.864 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.864 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:47.864 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400957+0000", 2024-09-12T22:32:47.864 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.33e-06 2024-09-12T22:32:47.864 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.864 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.864 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:47.864 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400966+0000", 2024-09-12T22:32:47.864 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1989999999999995e-06 2024-09-12T22:32:47.864 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.864 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.864 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:47.865 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400973+0000", 2024-09-12T22:32:47.865 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2779999999999999e-06 2024-09-12T22:32:47.865 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.865 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.865 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:47.865 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401696+0000", 2024-09-12T22:32:47.865 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00072363500000000003 2024-09-12T22:32:47.865 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.865 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.865 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:47.866 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401788+0000", 2024-09-12T22:32:47.866 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1862999999999998e-05 2024-09-12T22:32:47.866 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.867 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.867 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:47.867 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401929+0000", 2024-09-12T22:32:47.867 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014096000000000001 2024-09-12T22:32:47.867 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.867 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.867 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:47.867 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.403542+0000", 2024-09-12T22:32:47.867 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001612963 2024-09-12T22:32:47.867 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.868 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.868 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:47.868 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410460+0000", 2024-09-12T22:32:47.868 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0069180500000000002 2024-09-12T22:32:47.868 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.868 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.868 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:47.868 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410515+0000", 2024-09-12T22:32:47.869 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5009000000000001e-05 2024-09-12T22:32:47.869 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.869 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.869 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:47.869 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410557+0000", 2024-09-12T22:32:47.869 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1495000000000002e-05 2024-09-12T22:32:47.869 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:47.869 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:47.870 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:47.870 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.870 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.870 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:47.870 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.400984+0000", 2024-09-12T22:32:47.870 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 70.449785328000004, 2024-09-12T22:32:47.870 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0073703950000000001, 2024-09-12T22:32:47.870 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:47.870 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:47.870 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:47.870 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:47.870 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.871 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:47.871 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400984+0000", 2024-09-12T22:32:47.871 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:47.871 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.871 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.871 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:47.871 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400984+0000", 2024-09-12T22:32:47.871 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:47.871 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.871 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.871 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:47.871 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400985+0000", 2024-09-12T22:32:47.871 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3200000000000005e-07 2024-09-12T22:32:47.871 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.872 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.872 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:47.872 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400998+0000", 2024-09-12T22:32:47.872 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2726e-05 2024-09-12T22:32:47.872 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.872 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.872 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:47.872 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401006+0000", 2024-09-12T22:32:47.873 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.3110000000000006e-06 2024-09-12T22:32:47.873 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.873 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.873 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:47.873 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401022+0000", 2024-09-12T22:32:47.873 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6249e-05 2024-09-12T22:32:47.873 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.873 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.874 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:47.874 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401700+0000", 2024-09-12T22:32:47.874 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00067811100000000001 2024-09-12T22:32:47.874 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.874 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.874 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:47.874 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401839+0000", 2024-09-12T22:32:47.874 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013865399999999999 2024-09-12T22:32:47.874 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.874 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.874 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:47.874 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401962+0000", 2024-09-12T22:32:47.875 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000123266 2024-09-12T22:32:47.875 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.875 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.875 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:47.875 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.403589+0000", 2024-09-12T22:32:47.875 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001626932 2024-09-12T22:32:47.875 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.875 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.875 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:47.875 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.408274+0000", 2024-09-12T22:32:47.876 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0046848100000000002 2024-09-12T22:32:47.876 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.876 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.876 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:47.876 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.408324+0000", 2024-09-12T22:32:47.876 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9784000000000003e-05 2024-09-12T22:32:47.876 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.876 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.876 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:47.876 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.408355+0000", 2024-09-12T22:32:47.877 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.1019999999999998e-05 2024-09-12T22:32:47.877 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:47.877 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:47.877 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:47.877 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.877 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.877 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:47.878 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401034+0000", 2024-09-12T22:32:47.878 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 70.449735888000006, 2024-09-12T22:32:47.878 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011063051000000001, 2024-09-12T22:32:47.878 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:47.878 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:47.878 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:47.878 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:47.878 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.878 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:47.878 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401034+0000", 2024-09-12T22:32:47.879 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:47.879 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.879 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.879 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:47.879 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401034+0000", 2024-09-12T22:32:47.879 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:47.879 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.879 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.879 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:47.880 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401034+0000", 2024-09-12T22:32:47.880 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8899999999999999e-07 2024-09-12T22:32:47.880 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.880 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.880 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:47.880 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401038+0000", 2024-09-12T22:32:47.880 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.523e-06 2024-09-12T22:32:47.880 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.880 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.880 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:47.880 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401046+0000", 2024-09-12T22:32:47.880 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0479999999999999e-06 2024-09-12T22:32:47.880 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.881 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.881 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:47.881 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401051+0000", 2024-09-12T22:32:47.881 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2619999999999998e-06 2024-09-12T22:32:47.881 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.881 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.881 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:47.881 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402270+0000", 2024-09-12T22:32:47.881 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012182429999999999 2024-09-12T22:32:47.881 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.881 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.881 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:47.881 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402325+0000", 2024-09-12T22:32:47.881 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5526999999999999e-05 2024-09-12T22:32:47.882 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.882 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.882 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:47.882 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402403+0000", 2024-09-12T22:32:47.882 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.7559999999999996e-05 2024-09-12T22:32:47.882 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.882 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.882 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:47.882 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.403655+0000", 2024-09-12T22:32:47.883 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012521489999999999 2024-09-12T22:32:47.883 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.883 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.883 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:47.883 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411979+0000", 2024-09-12T22:32:47.883 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0083240420000000002 2024-09-12T22:32:47.883 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.883 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.883 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:47.883 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.412036+0000", 2024-09-12T22:32:47.883 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7639000000000002e-05 2024-09-12T22:32:47.883 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.883 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.883 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:47.884 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.412097+0000", 2024-09-12T22:32:47.884 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0469e-05 2024-09-12T22:32:47.884 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:47.884 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:47.884 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:47.884 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.884 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.884 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:47.884 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401060+0000", 2024-09-12T22:32:47.884 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 70.449710135999993, 2024-09-12T22:32:47.884 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.010030172, 2024-09-12T22:32:47.884 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:47.884 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:47.885 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:47.885 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:47.885 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.885 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:47.885 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401060+0000", 2024-09-12T22:32:47.885 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:47.885 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.885 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.885 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:47.885 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401060+0000", 2024-09-12T22:32:47.885 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:47.885 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.885 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.885 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:47.886 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401060+0000", 2024-09-12T22:32:47.886 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2500000000000001e-07 2024-09-12T22:32:47.886 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.886 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.886 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:47.886 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401063+0000", 2024-09-12T22:32:47.886 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0910000000000001e-06 2024-09-12T22:32:47.886 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.886 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.887 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:47.887 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401070+0000", 2024-09-12T22:32:47.887 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1210000000000001e-06 2024-09-12T22:32:47.887 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.887 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.887 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:47.888 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401076+0000", 2024-09-12T22:32:47.888 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2830000000000001e-06 2024-09-12T22:32:47.888 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.888 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.888 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:47.888 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402288+0000", 2024-09-12T22:32:47.888 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012123699999999999 2024-09-12T22:32:47.888 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.888 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.888 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:47.888 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402359+0000", 2024-09-12T22:32:47.888 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.0988000000000005e-05 2024-09-12T22:32:47.888 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.889 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.889 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:47.889 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402457+0000", 2024-09-12T22:32:47.889 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.7857999999999997e-05 2024-09-12T22:32:47.889 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.889 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.889 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:47.889 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.404395+0000", 2024-09-12T22:32:47.889 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0019380160000000001 2024-09-12T22:32:47.889 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.889 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.889 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:47.890 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410603+0000", 2024-09-12T22:32:47.890 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.006208061 2024-09-12T22:32:47.890 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.890 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.890 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:47.890 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410687+0000", 2024-09-12T22:32:47.890 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.4623000000000006e-05 2024-09-12T22:32:47.890 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.890 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.890 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:47.890 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411090+0000", 2024-09-12T22:32:47.890 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00040233599999999999 2024-09-12T22:32:47.891 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:47.891 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:47.891 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:47.891 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.891 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.891 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:47.891 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401083+0000", 2024-09-12T22:32:47.891 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 70.449686720000003, 2024-09-12T22:32:47.891 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0097591850000000001, 2024-09-12T22:32:47.891 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:47.891 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:47.891 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:47.891 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:47.892 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.892 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:47.892 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401083+0000", 2024-09-12T22:32:47.892 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:47.892 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.892 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.892 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:47.892 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401083+0000", 2024-09-12T22:32:47.892 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:47.892 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.892 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.893 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:47.893 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401084+0000", 2024-09-12T22:32:47.893 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4799999999999999e-07 2024-09-12T22:32:47.893 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.893 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.893 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:47.893 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401088+0000", 2024-09-12T22:32:47.893 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6419999999999998e-06 2024-09-12T22:32:47.893 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.893 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.893 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:47.893 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401094+0000", 2024-09-12T22:32:47.893 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0090000000000004e-06 2024-09-12T22:32:47.894 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.894 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.894 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:47.894 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401108+0000", 2024-09-12T22:32:47.894 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3884e-05 2024-09-12T22:32:47.894 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.894 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.894 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:47.894 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401165+0000", 2024-09-12T22:32:47.894 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.6499000000000002e-05 2024-09-12T22:32:47.894 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.895 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.895 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:47.895 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401261+0000", 2024-09-12T22:32:47.895 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.6872000000000004e-05 2024-09-12T22:32:47.895 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.895 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.895 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:47.895 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401376+0000", 2024-09-12T22:32:47.895 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000114508 2024-09-12T22:32:47.895 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.895 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.896 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:47.896 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402666+0000", 2024-09-12T22:32:47.896 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012901659999999999 2024-09-12T22:32:47.896 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.896 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.896 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:47.896 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410572+0000", 2024-09-12T22:32:47.896 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0079055489999999996 2024-09-12T22:32:47.896 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.896 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.896 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:47.897 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410661+0000", 2024-09-12T22:32:47.897 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.9578000000000002e-05 2024-09-12T22:32:47.897 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.897 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.897 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:47.897 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410842+0000", 2024-09-12T22:32:47.897 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00018102999999999999 2024-09-12T22:32:47.897 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:47.897 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:47.897 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:47.898 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.898 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.898 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:47.898 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401122+0000", 2024-09-12T22:32:47.898 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 70.449647687999999, 2024-09-12T22:32:47.898 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0099122080000000005, 2024-09-12T22:32:47.898 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:47.898 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:47.898 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:32:47.898 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:47.898 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.899 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:47.899 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401122+0000", 2024-09-12T22:32:47.899 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:47.899 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.899 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.899 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:47.899 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401122+0000", 2024-09-12T22:32:47.899 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:47.899 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.899 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.899 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:47.899 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401123+0000", 2024-09-12T22:32:47.899 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2600000000000002e-07 2024-09-12T22:32:47.900 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.900 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.900 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:47.900 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401126+0000", 2024-09-12T22:32:47.900 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.6449999999999998e-06 2024-09-12T22:32:47.900 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.900 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.900 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:47.900 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401133+0000", 2024-09-12T22:32:47.900 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.9890000000000003e-06 2024-09-12T22:32:47.900 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.900 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.900 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:47.901 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401138+0000", 2024-09-12T22:32:47.901 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8060000000000002e-06 2024-09-12T22:32:47.901 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.901 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.901 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:47.901 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401703+0000", 2024-09-12T22:32:47.901 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00056509099999999999 2024-09-12T22:32:47.901 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.901 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.901 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:47.901 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401837+0000", 2024-09-12T22:32:47.901 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013338799999999999 2024-09-12T22:32:47.901 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.902 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.902 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:47.902 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411034+0000", 2024-09-12T22:32:47.902 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.009197663 2024-09-12T22:32:47.902 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:47.902 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:47.902 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:47.902 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.902 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.902 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:47.902 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401158+0000", 2024-09-12T22:32:47.902 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 70.449611908999998, 2024-09-12T22:32:47.902 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.010292437999999999, 2024-09-12T22:32:47.903 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:47.903 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:47.903 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:32:47.903 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:47.903 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.903 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:47.903 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401158+0000", 2024-09-12T22:32:47.903 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:47.903 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.903 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.903 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:47.903 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401158+0000", 2024-09-12T22:32:47.903 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:47.903 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.904 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.904 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:47.904 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401158+0000", 2024-09-12T22:32:47.904 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9699999999999996e-07 2024-09-12T22:32:47.904 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.904 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.904 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:47.904 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401161+0000", 2024-09-12T22:32:47.904 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.7410000000000001e-06 2024-09-12T22:32:47.904 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.904 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.904 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:47.905 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401168+0000", 2024-09-12T22:32:47.905 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.844e-06 2024-09-12T22:32:47.905 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.905 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.905 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:47.905 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401174+0000", 2024-09-12T22:32:47.905 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4700000000000001e-06 2024-09-12T22:32:47.905 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.905 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.905 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:47.905 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402799+0000", 2024-09-12T22:32:47.906 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0016256409999999999 2024-09-12T22:32:47.906 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.906 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.906 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:47.906 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402893+0000", 2024-09-12T22:32:47.906 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.3807999999999994e-05 2024-09-12T22:32:47.906 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.906 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.906 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:47.906 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411450+0000", 2024-09-12T22:32:47.906 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0085573369999999999 2024-09-12T22:32:47.907 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:47.907 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:47.907 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:47.907 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.907 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.907 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:47.907 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401183+0000", 2024-09-12T22:32:47.907 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 70.449587057000002, 2024-09-12T22:32:47.907 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0068597830000000004, 2024-09-12T22:32:47.907 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:47.907 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:47.908 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:32:47.908 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:47.908 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.908 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:47.908 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401183+0000", 2024-09-12T22:32:47.908 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:47.908 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.908 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.908 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:47.909 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401183+0000", 2024-09-12T22:32:47.909 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:47.909 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.909 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.909 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:47.909 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401183+0000", 2024-09-12T22:32:47.909 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.6700000000000003e-07 2024-09-12T22:32:47.909 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.909 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.909 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:47.909 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401186+0000", 2024-09-12T22:32:47.910 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4679999999999999e-06 2024-09-12T22:32:47.910 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.910 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.910 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:47.910 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401192+0000", 2024-09-12T22:32:47.910 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.1519999999999997e-06 2024-09-12T22:32:47.910 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.910 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.910 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:47.910 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401197+0000", 2024-09-12T22:32:47.911 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4669999999999998e-06 2024-09-12T22:32:47.911 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.911 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.911 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:47.911 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401253+0000", 2024-09-12T22:32:47.911 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.6211000000000001e-05 2024-09-12T22:32:47.911 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.911 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.911 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:47.911 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401413+0000", 2024-09-12T22:32:47.912 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00016021399999999999 2024-09-12T22:32:47.912 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.912 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.912 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:47.912 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.408043+0000", 2024-09-12T22:32:47.912 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0066295039999999996 2024-09-12T22:32:47.912 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:47.912 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:47.912 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:47.912 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.913 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.913 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:20 3.1c e19/17 3:3ed09add:::607.00000000:head v 19'1, mlcod=0'0)", 2024-09-12T22:32:47.913 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.409642+0000", 2024-09-12T22:32:47.913 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 70.441127597999994, 2024-09-12T22:32:47.913 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0038816269999999999, 2024-09-12T22:32:47.913 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:47.913 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:47.913 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:47.913 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:47.914 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.914 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:47.914 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409642+0000", 2024-09-12T22:32:47.914 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:47.914 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.914 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.914 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:47.914 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409642+0000", 2024-09-12T22:32:47.914 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:47.914 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.914 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.914 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:47.915 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409642+0000", 2024-09-12T22:32:47.915 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.6899999999999999e-07 2024-09-12T22:32:47.915 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.915 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.915 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:47.915 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409648+0000", 2024-09-12T22:32:47.915 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.49e-06 2024-09-12T22:32:47.915 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.915 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.915 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:47.915 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409656+0000", 2024-09-12T22:32:47.916 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.2949999999999994e-06 2024-09-12T22:32:47.916 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.916 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.916 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:47.916 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409664+0000", 2024-09-12T22:32:47.916 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.1219999999999995e-06 2024-09-12T22:32:47.916 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.916 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.916 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:47.916 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409707+0000", 2024-09-12T22:32:47.916 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2222000000000003e-05 2024-09-12T22:32:47.916 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.917 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.917 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:47.917 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409724+0000", 2024-09-12T22:32:47.917 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7496999999999999e-05 2024-09-12T22:32:47.917 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.917 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.917 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:47.917 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413439+0000", 2024-09-12T22:32:47.917 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00371448 2024-09-12T22:32:47.918 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.918 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.918 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:47.918 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413524+0000", 2024-09-12T22:32:47.918 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.5252000000000003e-05 2024-09-12T22:32:47.918 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:47.918 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:47.918 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:47.918 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.918 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.919 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:28 3.13 e19/17 3:cd5a64a3:::100.00000000:head v 19'1, mlcod=0'0)", 2024-09-12T22:32:47.919 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.409681+0000", 2024-09-12T22:32:47.919 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 70.441089114999997, 2024-09-12T22:32:47.919 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0038708710000000001, 2024-09-12T22:32:47.919 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:47.919 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:47.919 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:47.919 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:47.919 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.919 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:47.920 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409681+0000", 2024-09-12T22:32:47.920 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:47.920 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.920 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.920 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:47.920 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409681+0000", 2024-09-12T22:32:47.920 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:47.920 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.920 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.920 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:47.921 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409681+0000", 2024-09-12T22:32:47.921 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3000000000000002e-07 2024-09-12T22:32:47.921 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.921 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.921 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:47.921 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409695+0000", 2024-09-12T22:32:47.921 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4313e-05 2024-09-12T22:32:47.921 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.921 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.921 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:47.922 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409703+0000", 2024-09-12T22:32:47.922 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4000000000000003e-06 2024-09-12T22:32:47.922 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.922 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.922 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:47.922 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409708+0000", 2024-09-12T22:32:47.922 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3190000000000002e-06 2024-09-12T22:32:47.922 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.922 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.923 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:47.923 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409875+0000", 2024-09-12T22:32:47.923 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000167329 2024-09-12T22:32:47.923 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.923 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.923 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:47.923 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409892+0000", 2024-09-12T22:32:47.923 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6957999999999999e-05 2024-09-12T22:32:47.923 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.923 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.924 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:47.924 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413457+0000", 2024-09-12T22:32:47.924 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0035651279999999999 2024-09-12T22:32:47.924 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.924 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.924 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:47.924 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413552+0000", 2024-09-12T22:32:47.924 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.4093999999999997e-05 2024-09-12T22:32:47.924 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:47.924 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:47.924 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:47.924 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.925 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.925 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:21 3.1c e19/17 3:3ed09add:::607.00000000:head v 19'2, mlcod=0'0)", 2024-09-12T22:32:47.925 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.409718+0000", 2024-09-12T22:32:47.925 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 70.441051450000003, 2024-09-12T22:32:47.925 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003851883, 2024-09-12T22:32:47.925 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:47.925 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:47.925 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:47.925 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:47.925 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.926 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:47.926 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409718+0000", 2024-09-12T22:32:47.926 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:47.926 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.926 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.926 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:47.926 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409718+0000", 2024-09-12T22:32:47.926 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:47.926 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.926 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.926 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:47.926 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409719+0000", 2024-09-12T22:32:47.927 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.16e-07 2024-09-12T22:32:47.927 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.927 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.927 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:47.927 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409722+0000", 2024-09-12T22:32:47.927 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.692e-06 2024-09-12T22:32:47.927 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.927 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.927 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:47.927 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409729+0000", 2024-09-12T22:32:47.927 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.516e-06 2024-09-12T22:32:47.927 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.927 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.927 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:47.928 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409750+0000", 2024-09-12T22:32:47.928 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1151000000000001e-05 2024-09-12T22:32:47.928 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.928 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.928 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:47.928 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410015+0000", 2024-09-12T22:32:47.928 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00026477599999999999 2024-09-12T22:32:47.928 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.928 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.928 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:47.928 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410104+0000", 2024-09-12T22:32:47.928 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.9586000000000006e-05 2024-09-12T22:32:47.929 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.929 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.929 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:47.929 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413528+0000", 2024-09-12T22:32:47.929 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0034237880000000001 2024-09-12T22:32:47.929 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.929 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.929 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:47.929 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413570+0000", 2024-09-12T22:32:47.929 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2157999999999999e-05 2024-09-12T22:32:47.929 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:47.929 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:47.929 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:47.929 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.930 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.930 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:27 3.13 e19/17 3:c91d4a1d:::mds0_inotable:head v 19'2, mlcod=0'0)", 2024-09-12T22:32:47.930 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.409760+0000", 2024-09-12T22:32:47.930 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 70.441009933999993, 2024-09-12T22:32:47.930 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0039301910000000004, 2024-09-12T22:32:47.930 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:47.930 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:47.930 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:47.930 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:47.930 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.930 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:47.930 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409760+0000", 2024-09-12T22:32:47.930 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:47.930 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.931 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.931 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:47.931 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409760+0000", 2024-09-12T22:32:47.931 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:47.931 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.931 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.931 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:47.931 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409760+0000", 2024-09-12T22:32:47.931 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.39e-07 2024-09-12T22:32:47.931 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.931 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.931 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:47.931 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409765+0000", 2024-09-12T22:32:47.931 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4449999999999998e-06 2024-09-12T22:32:47.932 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.932 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.932 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:47.932 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409771+0000", 2024-09-12T22:32:47.932 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7159999999999997e-06 2024-09-12T22:32:47.932 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.932 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.932 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:47.932 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409778+0000", 2024-09-12T22:32:47.932 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.331e-06 2024-09-12T22:32:47.932 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.932 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.932 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:47.933 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410191+0000", 2024-09-12T22:32:47.933 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00041348300000000003 2024-09-12T22:32:47.933 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.933 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.933 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:47.933 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410211+0000", 2024-09-12T22:32:47.933 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9933999999999999e-05 2024-09-12T22:32:47.933 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.933 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.933 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:47.933 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413638+0000", 2024-09-12T22:32:47.934 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003426854 2024-09-12T22:32:47.934 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.934 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.934 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:47.934 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413690+0000", 2024-09-12T22:32:47.934 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2089000000000002e-05 2024-09-12T22:32:47.934 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:47.934 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:47.934 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:47.934 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.934 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.934 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "pg_update_log_missing_reply(3.b epoch 19/17 rep_tid 4 lcod 19'2)", 2024-09-12T22:32:47.934 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.410060+0000", 2024-09-12T22:32:47.935 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 70.440710268999993, 2024-09-12T22:32:47.935 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00098016500000000007, 2024-09-12T22:32:47.935 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:47.935 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:47.935 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "reached pg", 2024-09-12T22:32:47.935 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:47.935 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.935 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:47.935 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410060+0000", 2024-09-12T22:32:47.935 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:47.935 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.935 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.936 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:47.936 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410060+0000", 2024-09-12T22:32:47.936 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:47.936 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.936 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.936 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:47.936 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410060+0000", 2024-09-12T22:32:47.936 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.8299999999999998e-07 2024-09-12T22:32:47.936 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.936 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.936 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:47.937 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410062+0000", 2024-09-12T22:32:47.937 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5749999999999999e-06 2024-09-12T22:32:47.937 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.937 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.937 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:47.937 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410070+0000", 2024-09-12T22:32:47.937 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.909e-06 2024-09-12T22:32:47.938 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.938 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.938 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:47.938 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410076+0000", 2024-09-12T22:32:47.938 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7049999999999996e-06 2024-09-12T22:32:47.938 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.938 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.938 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:47.938 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410943+0000", 2024-09-12T22:32:47.938 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00086681900000000001 2024-09-12T22:32:47.938 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.939 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.939 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:47.939 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411040+0000", 2024-09-12T22:32:47.939 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.6774000000000006e-05 2024-09-12T22:32:47.939 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:47.939 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:47.939 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:47.939 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.939 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.939 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e19/17 ondisk, result = 0)", 2024-09-12T22:32:47.940 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.410113+0000", 2024-09-12T22:32:47.940 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 70.440657001999995, 2024-09-12T22:32:47.940 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00098911599999999995, 2024-09-12T22:32:47.940 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:47.940 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:47.940 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:32:47.940 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:47.940 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.940 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:47.940 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410113+0000", 2024-09-12T22:32:47.940 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:47.940 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.941 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.941 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:47.941 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410113+0000", 2024-09-12T22:32:47.941 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:47.941 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.941 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.941 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:47.941 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410113+0000", 2024-09-12T22:32:47.941 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.99e-07 2024-09-12T22:32:47.941 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.942 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.942 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:47.942 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410115+0000", 2024-09-12T22:32:47.942 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.046e-06 2024-09-12T22:32:47.942 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.942 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.942 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:47.942 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410121+0000", 2024-09-12T22:32:47.942 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0050000000000001e-06 2024-09-12T22:32:47.942 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.942 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.943 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:47.943 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410126+0000", 2024-09-12T22:32:47.943 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8339999999999998e-06 2024-09-12T22:32:47.943 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.943 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.943 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:47.943 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410587+0000", 2024-09-12T22:32:47.943 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00046095499999999998 2024-09-12T22:32:47.943 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.943 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.944 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:47.944 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410595+0000", 2024-09-12T22:32:47.944 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.9419999999999995e-06 2024-09-12T22:32:47.944 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.944 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.944 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:47.944 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411102+0000", 2024-09-12T22:32:47.944 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00050713500000000003 2024-09-12T22:32:47.944 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:47.944 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:47.945 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:47.945 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.945 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.945 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 19/17 rep_tid 8 lcod 19'4)", 2024-09-12T22:32:47.945 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.410133+0000", 2024-09-12T22:32:47.945 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 70.440637073999994, 2024-09-12T22:32:47.945 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0013504000000000001, 2024-09-12T22:32:47.945 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:47.945 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:47.945 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "reached pg", 2024-09-12T22:32:47.945 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:47.946 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.946 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:47.946 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410133+0000", 2024-09-12T22:32:47.946 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:47.946 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.946 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.946 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:47.946 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410133+0000", 2024-09-12T22:32:47.946 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:47.946 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.947 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.947 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:47.947 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410133+0000", 2024-09-12T22:32:47.947 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.0599999999999999e-07 2024-09-12T22:32:47.947 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.947 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.947 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:47.947 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410135+0000", 2024-09-12T22:32:47.947 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7770000000000001e-06 2024-09-12T22:32:47.947 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.947 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.948 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:47.948 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410140+0000", 2024-09-12T22:32:47.948 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9960000000000001e-06 2024-09-12T22:32:47.948 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.948 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.948 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:47.948 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410144+0000", 2024-09-12T22:32:47.948 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9500000000000003e-06 2024-09-12T22:32:47.948 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.948 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.949 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:47.949 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411310+0000", 2024-09-12T22:32:47.949 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001166311 2024-09-12T22:32:47.949 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.949 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.949 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:47.949 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411483+0000", 2024-09-12T22:32:47.949 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00017316 2024-09-12T22:32:47.949 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:47.949 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:47.949 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:47.950 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.950 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.950 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "pg_update_log_missing(3.1a epoch 19/17 rep_tid 0 entries 19'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T22:32:47.950 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.410617+0000", 2024-09-12T22:32:47.950 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 70.440152678999993, 2024-09-12T22:32:47.950 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0030439709999999999, 2024-09-12T22:32:47.950 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:47.950 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:47.950 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "reached pg", 2024-09-12T22:32:47.951 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:47.951 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.951 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:47.951 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410617+0000", 2024-09-12T22:32:47.951 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:47.951 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.951 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.951 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:47.951 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410617+0000", 2024-09-12T22:32:47.951 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:47.951 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.952 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.952 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:47.952 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410617+0000", 2024-09-12T22:32:47.952 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3599999999999999e-07 2024-09-12T22:32:47.952 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.952 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.952 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:47.952 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410625+0000", 2024-09-12T22:32:47.952 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5410000000000003e-06 2024-09-12T22:32:47.952 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.953 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.953 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:47.953 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410638+0000", 2024-09-12T22:32:47.953 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3261999999999999e-05 2024-09-12T22:32:47.953 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.953 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.953 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:47.953 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410653+0000", 2024-09-12T22:32:47.953 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4844000000000001e-05 2024-09-12T22:32:47.953 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.953 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.953 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:47.954 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410814+0000", 2024-09-12T22:32:47.954 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00016119999999999999 2024-09-12T22:32:47.954 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.954 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.954 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:47.954 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413661+0000", 2024-09-12T22:32:47.954 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0028467879999999998 2024-09-12T22:32:47.954 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:47.954 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:47.954 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:47.954 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.954 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.954 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-09-12T22:32:47.955 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:39.398875+0000", 2024-09-12T22:32:47.955 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 68.451894398999997, 2024-09-12T22:32:47.955 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0015679069999999999, 2024-09-12T22:32:47.955 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:47.955 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:47.955 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:47.955 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:47.955 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.955 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:47.955 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398875+0000", 2024-09-12T22:32:47.955 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:47.955 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.955 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.956 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:47.956 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398875+0000", 2024-09-12T22:32:47.956 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:47.956 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.956 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.956 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:47.956 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398878+0000", 2024-09-12T22:32:47.956 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1679999999999998e-06 2024-09-12T22:32:47.956 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.956 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.956 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:47.956 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398888+0000", 2024-09-12T22:32:47.956 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.084e-05 2024-09-12T22:32:47.956 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.957 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.957 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:47.957 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398906+0000", 2024-09-12T22:32:47.957 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7518000000000001e-05 2024-09-12T22:32:47.957 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.957 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.957 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:47.957 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398914+0000", 2024-09-12T22:32:47.957 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5989999999999996e-06 2024-09-12T22:32:47.957 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.957 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.957 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:47.957 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398974+0000", 2024-09-12T22:32:47.958 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0988e-05 2024-09-12T22:32:47.958 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.958 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.958 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:47.958 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.399078+0000", 2024-09-12T22:32:47.958 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000103133 2024-09-12T22:32:47.958 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.958 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.958 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:47.958 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.399166+0000", 2024-09-12T22:32:47.958 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.8183999999999995e-05 2024-09-12T22:32:47.958 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.958 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.958 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:47.959 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.399747+0000", 2024-09-12T22:32:47.959 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00058110599999999996 2024-09-12T22:32:47.959 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.959 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.959 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:47.959 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.400377+0000", 2024-09-12T22:32:47.959 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000630157 2024-09-12T22:32:47.959 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.959 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.959 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:47.959 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.400415+0000", 2024-09-12T22:32:47.959 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7814000000000001e-05 2024-09-12T22:32:47.959 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.959 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.960 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:47.960 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.400443+0000", 2024-09-12T22:32:47.960 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8399999999999999e-05 2024-09-12T22:32:47.960 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:47.960 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:47.960 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:47.960 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.960 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.960 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e23)", 2024-09-12T22:32:47.960 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:58.400966+0000", 2024-09-12T22:32:47.960 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 49.449803490999997, 2024-09-12T22:32:47.960 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001468876, 2024-09-12T22:32:47.960 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:47.961 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:47.961 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:47.961 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:47.961 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.961 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:47.961 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400966+0000", 2024-09-12T22:32:47.961 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:47.961 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.961 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.961 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:47.961 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400966+0000", 2024-09-12T22:32:47.961 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:47.961 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.962 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.962 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:47.962 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400967+0000", 2024-09-12T22:32:47.962 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.046e-06 2024-09-12T22:32:47.962 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.962 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.962 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:47.962 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400974+0000", 2024-09-12T22:32:47.962 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2310000000000001e-06 2024-09-12T22:32:47.962 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.962 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.962 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:47.962 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400988+0000", 2024-09-12T22:32:47.963 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4482e-05 2024-09-12T22:32:47.963 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.963 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.963 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:47.963 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400997+0000", 2024-09-12T22:32:47.963 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.0189999999999995e-06 2024-09-12T22:32:47.963 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.963 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.963 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:47.963 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.401068+0000", 2024-09-12T22:32:47.963 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1426000000000004e-05 2024-09-12T22:32:47.963 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.964 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.964 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:47.964 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.401174+0000", 2024-09-12T22:32:47.964 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000105769 2024-09-12T22:32:47.964 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.964 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.964 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:47.964 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.401335+0000", 2024-09-12T22:32:47.964 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000161225 2024-09-12T22:32:47.964 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.965 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.965 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:47.965 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.402110+0000", 2024-09-12T22:32:47.965 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00077428800000000004 2024-09-12T22:32:47.965 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.965 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.965 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:47.965 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.402333+0000", 2024-09-12T22:32:47.965 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000223723 2024-09-12T22:32:47.966 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.966 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.966 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:47.966 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.402388+0000", 2024-09-12T22:32:47.966 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4700999999999997e-05 2024-09-12T22:32:47.966 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.966 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.966 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:47.966 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.402435+0000", 2024-09-12T22:32:47.966 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6965999999999997e-05 2024-09-12T22:32:47.966 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:47.967 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:47.967 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:47.967 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.967 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.967 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:45 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e27)", 2024-09-12T22:32:47.967 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:32:04.401614+0000", 2024-09-12T22:32:47.967 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 43.449156062, 2024-09-12T22:32:47.967 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0014279749999999999, 2024-09-12T22:32:47.967 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:47.967 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:47.968 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:47.968 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:47.968 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.968 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:47.968 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401614+0000", 2024-09-12T22:32:47.968 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:47.968 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.968 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.968 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:47.968 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401614+0000", 2024-09-12T22:32:47.968 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:47.969 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.969 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.969 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:47.969 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401615+0000", 2024-09-12T22:32:47.969 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.161e-06 2024-09-12T22:32:47.969 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.969 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.969 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:47.969 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401621+0000", 2024-09-12T22:32:47.970 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8730000000000004e-06 2024-09-12T22:32:47.970 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.970 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.970 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:47.970 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401633+0000", 2024-09-12T22:32:47.970 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1800000000000001e-05 2024-09-12T22:32:47.970 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.970 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.970 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:47.970 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401656+0000", 2024-09-12T22:32:47.970 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.3521999999999999e-05 2024-09-12T22:32:47.971 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.971 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.971 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:47.971 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401713+0000", 2024-09-12T22:32:47.971 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7259000000000002e-05 2024-09-12T22:32:47.971 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.971 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.971 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:47.971 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401849+0000", 2024-09-12T22:32:47.971 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013613500000000001 2024-09-12T22:32:47.971 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.972 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.972 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:47.972 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.402009+0000", 2024-09-12T22:32:47.972 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00015947199999999999 2024-09-12T22:32:47.972 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.972 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.972 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:47.972 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.402629+0000", 2024-09-12T22:32:47.972 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00061962200000000001 2024-09-12T22:32:47.972 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.972 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.973 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:47.973 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.402983+0000", 2024-09-12T22:32:47.973 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00035447499999999998 2024-09-12T22:32:47.973 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.973 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.973 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:47.973 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.403016+0000", 2024-09-12T22:32:47.973 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3108999999999998e-05 2024-09-12T22:32:47.973 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:47.973 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:47.974 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:47.974 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.403042+0000", 2024-09-12T22:32:47.974 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5547000000000001e-05 2024-09-12T22:32:47.974 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:47.974 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:47.974 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:47.974 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:47.974 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:47.974 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:32:47.976 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:47.974+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:47.976 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:32:48.076 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:48.075+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:48.083 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-09-12T22:32:48.083 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-09-12T22:32:48.083 INFO:teuthology.orchestra.run.smithi163.stdout: "num_ops": 0 2024-09-12T22:32:48.084 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-09-12T22:32:48.092 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:32:48.177 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:48.176+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:48.236 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-09-12T22:32:48.236 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-09-12T22:32:48.236 INFO:teuthology.orchestra.run.smithi163.stdout: "complaint_time": 30, 2024-09-12T22:32:48.236 INFO:teuthology.orchestra.run.smithi163.stdout: "num_blocked_ops": 0 2024-09-12T22:32:48.236 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-09-12T22:32:48.244 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:32:48.288 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:48.287+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:48.350 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-09-12T22:32:48.350 INFO:teuthology.orchestra.run.smithi163.stdout: "size": 20, 2024-09-12T22:32:48.351 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 600, 2024-09-12T22:32:48.351 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2024-09-12T22:32:48.351 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.351 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-09-12T22:32:48.351 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:27.254459+0000", 2024-09-12T22:32:48.351 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 81.093811267999996, 2024-09-12T22:32:48.351 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.37816283899999997, 2024-09-12T22:32:48.351 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:48.351 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:48.351 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:48.351 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:48.352 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:48.352 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:48.352 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 1 2024-09-12T22:32:48.352 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.352 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:48.352 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.352 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:48.352 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254459+0000", 2024-09-12T22:32:48.352 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:48.352 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.352 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.352 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:48.352 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254459+0000", 2024-09-12T22:32:48.353 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:48.353 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.353 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.353 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:48.353 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254460+0000", 2024-09-12T22:32:48.353 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1739999999999999e-06 2024-09-12T22:32:48.353 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.353 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.353 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:48.353 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254472+0000", 2024-09-12T22:32:48.353 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2207e-05 2024-09-12T22:32:48.353 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.353 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.353 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:48.354 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254483+0000", 2024-09-12T22:32:48.354 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0631999999999999e-05 2024-09-12T22:32:48.354 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.354 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.354 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:48.354 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254492+0000", 2024-09-12T22:32:48.354 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3670000000000003e-06 2024-09-12T22:32:48.354 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.354 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.354 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:48.354 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254551+0000", 2024-09-12T22:32:48.354 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8687999999999998e-05 2024-09-12T22:32:48.354 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.355 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.355 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for peered", 2024-09-12T22:32:48.355 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254562+0000", 2024-09-12T22:32:48.355 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1249e-05 2024-09-12T22:32:48.355 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.355 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.355 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:48.355 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.631211+0000", 2024-09-12T22:32:48.355 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.376649018 2024-09-12T22:32:48.355 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.355 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.355 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:48.355 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.631345+0000", 2024-09-12T22:32:48.355 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013378700000000001 2024-09-12T22:32:48.356 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.356 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.356 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:48.356 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.631479+0000", 2024-09-12T22:32:48.356 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013352399999999999 2024-09-12T22:32:48.356 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.356 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.356 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:48.356 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632324+0000", 2024-09-12T22:32:48.356 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00084508100000000002 2024-09-12T22:32:48.356 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.356 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.356 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:48.357 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632548+0000", 2024-09-12T22:32:48.357 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000224329 2024-09-12T22:32:48.357 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.357 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.357 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:48.357 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632591+0000", 2024-09-12T22:32:48.357 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2564000000000001e-05 2024-09-12T22:32:48.357 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.357 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.357 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:48.357 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632622+0000", 2024-09-12T22:32:48.357 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1219e-05 2024-09-12T22:32:48.357 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:48.358 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:48.358 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:48.358 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.358 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.358 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:185 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:32:48.358 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394355+0000", 2024-09-12T22:32:48.358 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 79.953915171000006, 2024-09-12T22:32:48.358 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011302394, 2024-09-12T22:32:48.358 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:48.358 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:48.358 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:48.358 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:48.358 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:48.358 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:48.359 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 185 2024-09-12T22:32:48.359 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.359 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:48.359 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.359 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:48.359 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394355+0000", 2024-09-12T22:32:48.359 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:48.359 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.359 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.359 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:48.359 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394355+0000", 2024-09-12T22:32:48.359 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:48.359 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.360 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.360 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:48.360 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394355+0000", 2024-09-12T22:32:48.360 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9099999999999999e-07 2024-09-12T22:32:48.360 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.360 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.360 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:48.360 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394385+0000", 2024-09-12T22:32:48.360 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9963000000000001e-05 2024-09-12T22:32:48.360 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.360 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.360 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:48.360 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394390+0000", 2024-09-12T22:32:48.361 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8420000000000004e-06 2024-09-12T22:32:48.361 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.361 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.361 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:48.361 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394393+0000", 2024-09-12T22:32:48.361 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1e-06 2024-09-12T22:32:48.361 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.361 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.361 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:48.361 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.400546+0000", 2024-09-12T22:32:48.361 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0061523309999999996 2024-09-12T22:32:48.361 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.361 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.362 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:48.362 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.400588+0000", 2024-09-12T22:32:48.362 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1835000000000002e-05 2024-09-12T22:32:48.362 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.362 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.362 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:48.362 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.400677+0000", 2024-09-12T22:32:48.362 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9195000000000002e-05 2024-09-12T22:32:48.362 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.362 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.362 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:48.362 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405378+0000", 2024-09-12T22:32:48.362 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0047008659999999997 2024-09-12T22:32:48.363 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.363 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.363 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:48.363 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405569+0000", 2024-09-12T22:32:48.363 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00019148599999999999 2024-09-12T22:32:48.363 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.363 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.363 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:48.363 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405620+0000", 2024-09-12T22:32:48.363 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1416999999999999e-05 2024-09-12T22:32:48.363 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.363 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.363 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:48.364 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405657+0000", 2024-09-12T22:32:48.364 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6968000000000002e-05 2024-09-12T22:32:48.364 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:48.364 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:48.364 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:48.364 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.364 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.364 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:32:48.364 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394399+0000", 2024-09-12T22:32:48.364 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 79.953870960000003, 2024-09-12T22:32:48.364 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011336601999999999, 2024-09-12T22:32:48.364 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:48.364 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:48.365 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:48.365 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:48.365 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:48.365 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:48.365 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 186 2024-09-12T22:32:48.365 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.365 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:48.365 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.365 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:48.365 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394399+0000", 2024-09-12T22:32:48.365 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:48.365 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.365 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.366 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:48.366 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394399+0000", 2024-09-12T22:32:48.366 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:48.366 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.366 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.366 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:48.366 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394400+0000", 2024-09-12T22:32:48.366 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4499999999999998e-07 2024-09-12T22:32:48.366 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.366 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.366 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:48.366 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394402+0000", 2024-09-12T22:32:48.366 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.875e-06 2024-09-12T22:32:48.366 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.367 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.367 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:48.367 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394405+0000", 2024-09-12T22:32:48.367 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6799999999999999e-06 2024-09-12T22:32:48.367 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.367 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.367 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:48.367 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394408+0000", 2024-09-12T22:32:48.367 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.667e-06 2024-09-12T22:32:48.367 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.367 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.367 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:48.368 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401395+0000", 2024-09-12T22:32:48.368 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0069867230000000002 2024-09-12T22:32:48.368 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.368 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.368 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:48.368 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401438+0000", 2024-09-12T22:32:48.368 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3554999999999999e-05 2024-09-12T22:32:48.368 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.368 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.368 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:48.368 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401509+0000", 2024-09-12T22:32:48.368 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0631999999999997e-05 2024-09-12T22:32:48.368 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.368 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.369 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:48.369 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405392+0000", 2024-09-12T22:32:48.369 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0038830449999999999 2024-09-12T22:32:48.369 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.369 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.369 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:48.369 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405690+0000", 2024-09-12T22:32:48.369 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000298435 2024-09-12T22:32:48.369 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.369 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.369 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:48.369 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405716+0000", 2024-09-12T22:32:48.370 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5435999999999998e-05 2024-09-12T22:32:48.370 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.370 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.370 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:48.370 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405736+0000", 2024-09-12T22:32:48.370 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0208999999999999e-05 2024-09-12T22:32:48.370 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:48.370 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:48.370 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:48.370 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.370 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.370 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:32:48.370 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394411+0000", 2024-09-12T22:32:48.370 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 79.953858834000002, 2024-09-12T22:32:48.371 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011400117, 2024-09-12T22:32:48.371 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:48.371 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:48.371 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:48.371 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:48.371 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:48.371 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:48.371 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 187 2024-09-12T22:32:48.371 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.371 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:48.371 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.371 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:48.372 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394411+0000", 2024-09-12T22:32:48.372 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:48.372 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.372 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.372 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:48.372 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394411+0000", 2024-09-12T22:32:48.372 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:48.372 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.372 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.372 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:48.372 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394412+0000", 2024-09-12T22:32:48.372 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.4999999999999999e-07 2024-09-12T22:32:48.372 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.373 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.373 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:48.373 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394414+0000", 2024-09-12T22:32:48.373 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.984e-06 2024-09-12T22:32:48.373 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.373 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.373 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:48.373 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394418+0000", 2024-09-12T22:32:48.373 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0840000000000002e-06 2024-09-12T22:32:48.373 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.373 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.373 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:48.373 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394431+0000", 2024-09-12T22:32:48.374 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.361e-05 2024-09-12T22:32:48.374 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.374 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.374 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:48.374 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401778+0000", 2024-09-12T22:32:48.374 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0073462659999999997 2024-09-12T22:32:48.374 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.374 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.374 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:48.374 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401853+0000", 2024-09-12T22:32:48.374 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5797000000000006e-05 2024-09-12T22:32:48.374 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.375 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.375 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:48.375 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401990+0000", 2024-09-12T22:32:48.375 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013651399999999999 2024-09-12T22:32:48.375 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.375 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.375 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:48.375 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405402+0000", 2024-09-12T22:32:48.375 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0034116070000000001 2024-09-12T22:32:48.375 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.375 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.375 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:48.375 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405764+0000", 2024-09-12T22:32:48.376 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00036234899999999998 2024-09-12T22:32:48.376 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.376 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.376 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:48.376 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405791+0000", 2024-09-12T22:32:48.376 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7029000000000002e-05 2024-09-12T22:32:48.376 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.376 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.376 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:48.376 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405812+0000", 2024-09-12T22:32:48.376 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0627000000000001e-05 2024-09-12T22:32:48.376 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:48.376 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:48.377 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:48.377 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.377 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.377 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:32:48.377 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394447+0000", 2024-09-12T22:32:48.377 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 79.953823682999996, 2024-09-12T22:32:48.377 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011759588, 2024-09-12T22:32:48.377 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:48.377 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:48.377 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:48.377 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:48.377 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:48.377 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:48.378 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 188 2024-09-12T22:32:48.378 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.378 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:48.378 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.378 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:48.378 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394447+0000", 2024-09-12T22:32:48.378 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:48.378 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.378 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.378 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:48.378 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394447+0000", 2024-09-12T22:32:48.378 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:48.378 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.378 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.379 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:48.379 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394447+0000", 2024-09-12T22:32:48.379 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.15e-07 2024-09-12T22:32:48.379 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.379 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.379 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:48.379 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394512+0000", 2024-09-12T22:32:48.379 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4580999999999997e-05 2024-09-12T22:32:48.379 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.379 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.379 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:48.379 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394518+0000", 2024-09-12T22:32:48.379 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.3380000000000001e-06 2024-09-12T22:32:48.380 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.380 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.380 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:48.380 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394521+0000", 2024-09-12T22:32:48.380 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3340000000000002e-06 2024-09-12T22:32:48.380 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.380 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.380 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:48.380 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.402628+0000", 2024-09-12T22:32:48.380 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.008106996 2024-09-12T22:32:48.380 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.380 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.381 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:48.381 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.402670+0000", 2024-09-12T22:32:48.381 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1983000000000001e-05 2024-09-12T22:32:48.381 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.381 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.381 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:48.381 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.402738+0000", 2024-09-12T22:32:48.381 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.8114999999999994e-05 2024-09-12T22:32:48.381 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.381 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.381 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:48.381 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405668+0000", 2024-09-12T22:32:48.381 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.002929545 2024-09-12T22:32:48.382 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.382 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.382 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:48.382 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406162+0000", 2024-09-12T22:32:48.382 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000494408 2024-09-12T22:32:48.382 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.382 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.382 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:48.382 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406188+0000", 2024-09-12T22:32:48.382 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5766e-05 2024-09-12T22:32:48.382 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.382 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.382 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:48.383 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406206+0000", 2024-09-12T22:32:48.383 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.8107000000000001e-05 2024-09-12T22:32:48.383 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:48.383 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:48.383 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:48.383 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.383 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.383 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:32:48.383 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394528+0000", 2024-09-12T22:32:48.383 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 79.953742013999999, 2024-09-12T22:32:48.383 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.01195536, 2024-09-12T22:32:48.383 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:48.383 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:48.384 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:48.384 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:48.384 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:48.384 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:48.384 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 189 2024-09-12T22:32:48.384 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.384 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:48.384 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.384 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:48.384 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394528+0000", 2024-09-12T22:32:48.384 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:48.384 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.385 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.385 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:48.385 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394528+0000", 2024-09-12T22:32:48.385 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:48.385 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.385 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.385 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:48.385 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394529+0000", 2024-09-12T22:32:48.385 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4900000000000001e-07 2024-09-12T22:32:48.385 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.385 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.385 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:48.385 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394531+0000", 2024-09-12T22:32:48.386 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.458e-06 2024-09-12T22:32:48.386 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.386 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.386 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:48.386 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394535+0000", 2024-09-12T22:32:48.386 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7900000000000001e-06 2024-09-12T22:32:48.386 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.386 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.386 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:48.386 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394537+0000", 2024-09-12T22:32:48.386 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.632e-06 2024-09-12T22:32:48.386 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.386 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.387 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:48.387 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.404932+0000", 2024-09-12T22:32:48.387 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010394158000000001 2024-09-12T22:32:48.387 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.387 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.387 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:48.387 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405017+0000", 2024-09-12T22:32:48.387 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5525000000000005e-05 2024-09-12T22:32:48.387 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.387 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.387 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:48.387 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405114+0000", 2024-09-12T22:32:48.387 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.6527000000000006e-05 2024-09-12T22:32:48.387 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.388 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.388 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:48.388 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405818+0000", 2024-09-12T22:32:48.388 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00070412800000000005 2024-09-12T22:32:48.388 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.388 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.388 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:48.388 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406437+0000", 2024-09-12T22:32:48.388 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00061898900000000002 2024-09-12T22:32:48.388 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.388 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.388 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:48.388 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406463+0000", 2024-09-12T22:32:48.389 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6268e-05 2024-09-12T22:32:48.389 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.389 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.389 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:48.389 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406484+0000", 2024-09-12T22:32:48.389 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0536000000000001e-05 2024-09-12T22:32:48.389 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:48.389 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:48.389 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:48.389 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.389 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.389 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:48.389 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.401422+0000", 2024-09-12T22:32:48.390 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 70.946848109000001, 2024-09-12T22:32:48.390 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016896452999999999, 2024-09-12T22:32:48.390 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:48.390 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:48.390 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:48.390 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:48.390 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.390 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:48.390 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401422+0000", 2024-09-12T22:32:48.390 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:48.390 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.390 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.390 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:48.391 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401422+0000", 2024-09-12T22:32:48.391 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:48.391 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.391 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.391 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:48.391 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401424+0000", 2024-09-12T22:32:48.391 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9e-06 2024-09-12T22:32:48.391 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.391 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.391 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:48.391 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401437+0000", 2024-09-12T22:32:48.391 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2831e-05 2024-09-12T22:32:48.391 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.391 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.392 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:48.392 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401471+0000", 2024-09-12T22:32:48.392 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4010000000000001e-05 2024-09-12T22:32:48.392 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.392 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.392 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:48.392 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401484+0000", 2024-09-12T22:32:48.392 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2711000000000001e-05 2024-09-12T22:32:48.392 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.392 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.392 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:48.392 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405410+0000", 2024-09-12T22:32:48.392 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0039259170000000001 2024-09-12T22:32:48.393 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.393 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.393 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:48.393 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405529+0000", 2024-09-12T22:32:48.393 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000119778 2024-09-12T22:32:48.393 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.393 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.393 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:48.393 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405655+0000", 2024-09-12T22:32:48.393 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012556700000000001 2024-09-12T22:32:48.393 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.393 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.393 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:48.394 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410456+0000", 2024-09-12T22:32:48.394 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0048008269999999997 2024-09-12T22:32:48.394 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.394 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.394 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:48.394 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418226+0000", 2024-09-12T22:32:48.394 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0077707729999999999 2024-09-12T22:32:48.394 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.394 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.394 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:48.394 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418277+0000", 2024-09-12T22:32:48.394 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0476000000000003e-05 2024-09-12T22:32:48.394 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.395 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.395 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:48.395 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418319+0000", 2024-09-12T22:32:48.395 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1662999999999997e-05 2024-09-12T22:32:48.395 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:48.395 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:48.395 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:48.395 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.395 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.395 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:48.395 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.401505+0000", 2024-09-12T22:32:48.395 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 70.946765444999997, 2024-09-12T22:32:48.395 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016987904000000002, 2024-09-12T22:32:48.396 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:48.396 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:48.396 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:48.396 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:48.396 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.396 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:48.396 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401505+0000", 2024-09-12T22:32:48.396 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:48.396 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.396 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.396 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:48.396 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401505+0000", 2024-09-12T22:32:48.396 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:48.397 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.397 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.397 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:48.397 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401506+0000", 2024-09-12T22:32:48.397 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4700000000000001e-07 2024-09-12T22:32:48.397 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.397 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.397 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:48.397 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401510+0000", 2024-09-12T22:32:48.397 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6609999999999999e-06 2024-09-12T22:32:48.397 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.397 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.397 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:48.397 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401771+0000", 2024-09-12T22:32:48.398 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00026110700000000001 2024-09-12T22:32:48.398 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.398 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.398 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:48.398 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401921+0000", 2024-09-12T22:32:48.398 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014939099999999999 2024-09-12T22:32:48.398 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.398 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.398 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:48.398 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405944+0000", 2024-09-12T22:32:48.398 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0040235449999999999 2024-09-12T22:32:48.398 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.398 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.399 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:48.399 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406018+0000", 2024-09-12T22:32:48.399 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3373000000000004e-05 2024-09-12T22:32:48.399 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.399 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.399 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:48.399 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406172+0000", 2024-09-12T22:32:48.399 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00015435399999999999 2024-09-12T22:32:48.399 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.399 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.399 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:48.399 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410461+0000", 2024-09-12T22:32:48.399 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0042888609999999997 2024-09-12T22:32:48.400 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.400 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.400 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:48.400 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418371+0000", 2024-09-12T22:32:48.400 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0079098380000000006 2024-09-12T22:32:48.400 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.400 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.400 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:48.400 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418443+0000", 2024-09-12T22:32:48.400 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2705000000000003e-05 2024-09-12T22:32:48.400 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.400 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.400 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:48.401 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418493+0000", 2024-09-12T22:32:48.401 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9322e-05 2024-09-12T22:32:48.401 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:48.401 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:48.401 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:48.401 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.401 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.401 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:48.401 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.401939+0000", 2024-09-12T22:32:48.401 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 70.946331709000006, 2024-09-12T22:32:48.401 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016722292999999999, 2024-09-12T22:32:48.401 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:48.401 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:48.402 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:48.402 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:48.402 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.402 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:48.402 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401939+0000", 2024-09-12T22:32:48.402 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:48.402 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.402 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.402 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:48.402 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401939+0000", 2024-09-12T22:32:48.402 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:48.402 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.402 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.403 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:48.403 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401940+0000", 2024-09-12T22:32:48.403 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1990000000000001e-06 2024-09-12T22:32:48.403 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.403 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.403 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:48.403 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401956+0000", 2024-09-12T22:32:48.403 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.6344000000000001e-05 2024-09-12T22:32:48.403 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.403 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.403 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:48.403 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401974+0000", 2024-09-12T22:32:48.403 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7730000000000001e-05 2024-09-12T22:32:48.403 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.404 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.404 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:48.404 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401982+0000", 2024-09-12T22:32:48.404 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.7800000000000001e-06 2024-09-12T22:32:48.404 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.404 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.404 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:48.404 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406557+0000", 2024-09-12T22:32:48.404 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0045758489999999999 2024-09-12T22:32:48.404 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.404 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.404 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:48.404 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406697+0000", 2024-09-12T22:32:48.405 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013925100000000001 2024-09-12T22:32:48.405 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.405 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.405 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:48.405 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406830+0000", 2024-09-12T22:32:48.405 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013293499999999999 2024-09-12T22:32:48.405 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.405 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.405 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:48.405 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410465+0000", 2024-09-12T22:32:48.405 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0036352680000000001 2024-09-12T22:32:48.405 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.405 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.406 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:48.406 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418564+0000", 2024-09-12T22:32:48.406 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0080992140000000004 2024-09-12T22:32:48.406 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.406 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.406 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:48.406 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418621+0000", 2024-09-12T22:32:48.406 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7167999999999999e-05 2024-09-12T22:32:48.406 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.407 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.407 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:48.407 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418661+0000", 2024-09-12T22:32:48.407 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9555000000000003e-05 2024-09-12T22:32:48.407 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:48.407 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:48.407 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:48.407 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.407 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.407 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:48.407 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.401994+0000", 2024-09-12T22:32:48.407 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 70.946275837000002, 2024-09-12T22:32:48.407 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016804109000000001, 2024-09-12T22:32:48.408 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:48.408 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:48.408 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:48.408 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:48.408 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.408 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:48.408 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401994+0000", 2024-09-12T22:32:48.408 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:48.408 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.408 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.408 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:48.408 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401994+0000", 2024-09-12T22:32:48.408 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:48.409 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.409 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.409 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:48.409 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401995+0000", 2024-09-12T22:32:48.409 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.8899999999999998e-07 2024-09-12T22:32:48.409 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.409 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.409 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:48.409 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402000+0000", 2024-09-12T22:32:48.409 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.498e-06 2024-09-12T22:32:48.409 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.409 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.410 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:48.410 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402007+0000", 2024-09-12T22:32:48.410 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.554e-06 2024-09-12T22:32:48.410 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.410 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.410 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:48.410 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402046+0000", 2024-09-12T22:32:48.410 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9156000000000003e-05 2024-09-12T22:32:48.410 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.410 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.410 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:48.410 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407342+0000", 2024-09-12T22:32:48.410 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052957610000000004 2024-09-12T22:32:48.411 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.411 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.411 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:48.411 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407521+0000", 2024-09-12T22:32:48.411 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00017878100000000001 2024-09-12T22:32:48.411 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.411 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.411 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:48.411 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407641+0000", 2024-09-12T22:32:48.411 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012013 2024-09-12T22:32:48.411 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.411 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.411 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:48.412 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410472+0000", 2024-09-12T22:32:48.412 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.002830455 2024-09-12T22:32:48.412 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.412 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.412 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:48.412 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418714+0000", 2024-09-12T22:32:48.412 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0082422789999999999 2024-09-12T22:32:48.412 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.412 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.412 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:48.412 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418761+0000", 2024-09-12T22:32:48.412 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6956999999999998e-05 2024-09-12T22:32:48.412 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.413 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.413 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:48.413 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418799+0000", 2024-09-12T22:32:48.413 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7749000000000001e-05 2024-09-12T22:32:48.413 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:48.413 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:48.413 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:48.413 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.413 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.413 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:48.413 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.402060+0000", 2024-09-12T22:32:48.413 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 70.946210393000001, 2024-09-12T22:32:48.413 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016885686, 2024-09-12T22:32:48.414 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:48.414 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:48.414 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:48.414 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:48.414 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.414 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:48.414 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402060+0000", 2024-09-12T22:32:48.414 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:48.414 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.414 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.414 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:48.414 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402060+0000", 2024-09-12T22:32:48.414 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:48.415 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.415 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.415 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:48.415 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402061+0000", 2024-09-12T22:32:48.415 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4399999999999999e-07 2024-09-12T22:32:48.415 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.415 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.415 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:48.415 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402066+0000", 2024-09-12T22:32:48.415 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8649999999999998e-06 2024-09-12T22:32:48.415 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.415 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.415 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:48.416 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402146+0000", 2024-09-12T22:32:48.416 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9054000000000006e-05 2024-09-12T22:32:48.416 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.416 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.416 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:48.416 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402287+0000", 2024-09-12T22:32:48.416 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014108600000000001 2024-09-12T22:32:48.416 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.416 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.416 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:48.416 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408185+0000", 2024-09-12T22:32:48.416 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0058983919999999997 2024-09-12T22:32:48.416 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.417 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.417 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:48.417 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408299+0000", 2024-09-12T22:32:48.417 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114102 2024-09-12T22:32:48.417 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.417 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.417 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:48.417 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408420+0000", 2024-09-12T22:32:48.417 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000120492 2024-09-12T22:32:48.417 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.417 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.417 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:48.417 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410867+0000", 2024-09-12T22:32:48.418 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0024476430000000002 2024-09-12T22:32:48.418 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.418 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.418 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:48.418 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418851+0000", 2024-09-12T22:32:48.418 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0079841489999999994 2024-09-12T22:32:48.418 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.418 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.418 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:48.418 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418894+0000", 2024-09-12T22:32:48.418 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3090000000000002e-05 2024-09-12T22:32:48.418 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.418 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.418 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:48.419 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418946+0000", 2024-09-12T22:32:48.419 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1069000000000002e-05 2024-09-12T22:32:48.419 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:48.419 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:48.419 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:48.419 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.419 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.419 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:48.419 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.402375+0000", 2024-09-12T22:32:48.419 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 70.945895328000006, 2024-09-12T22:32:48.419 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016768531999999999, 2024-09-12T22:32:48.419 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:48.419 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:48.420 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:48.420 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:48.420 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.420 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:48.420 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402375+0000", 2024-09-12T22:32:48.420 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:48.420 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.420 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.420 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:48.420 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402375+0000", 2024-09-12T22:32:48.420 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:48.420 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.420 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.421 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:48.421 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402375+0000", 2024-09-12T22:32:48.421 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4099999999999999e-07 2024-09-12T22:32:48.421 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.421 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.421 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:48.421 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402379+0000", 2024-09-12T22:32:48.421 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9870000000000001e-06 2024-09-12T22:32:48.421 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.421 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.421 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:48.421 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402389+0000", 2024-09-12T22:32:48.421 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0000000000000001e-05 2024-09-12T22:32:48.422 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.422 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.422 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:48.422 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402401+0000", 2024-09-12T22:32:48.422 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.148e-05 2024-09-12T22:32:48.422 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.422 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.422 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:48.422 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409108+0000", 2024-09-12T22:32:48.422 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0067068429999999997 2024-09-12T22:32:48.422 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.422 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.422 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:48.423 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409189+0000", 2024-09-12T22:32:48.423 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0815999999999993e-05 2024-09-12T22:32:48.423 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.423 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.423 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:48.423 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409320+0000", 2024-09-12T22:32:48.423 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000131586 2024-09-12T22:32:48.423 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.423 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.423 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:48.423 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410872+0000", 2024-09-12T22:32:48.423 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0015521599999999999 2024-09-12T22:32:48.424 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.424 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.424 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:48.424 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419049+0000", 2024-09-12T22:32:48.424 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0081763719999999995 2024-09-12T22:32:48.424 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.424 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.424 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:48.424 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419107+0000", 2024-09-12T22:32:48.424 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7899000000000002e-05 2024-09-12T22:32:48.424 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.424 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.425 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:48.425 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419143+0000", 2024-09-12T22:32:48.425 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6847999999999997e-05 2024-09-12T22:32:48.425 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:48.425 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:48.425 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:48.425 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.425 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.425 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:48.425 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.402903+0000", 2024-09-12T22:32:48.425 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 70.945366915999998, 2024-09-12T22:32:48.425 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016378428, 2024-09-12T22:32:48.425 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:48.426 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:48.426 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:48.426 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:48.426 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.426 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:48.426 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402903+0000", 2024-09-12T22:32:48.426 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:48.426 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.426 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.426 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:48.426 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402903+0000", 2024-09-12T22:32:48.426 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:48.426 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.427 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.427 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:48.427 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402904+0000", 2024-09-12T22:32:48.427 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9500000000000001e-07 2024-09-12T22:32:48.427 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.427 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.427 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:48.427 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402944+0000", 2024-09-12T22:32:48.427 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0265000000000002e-05 2024-09-12T22:32:48.427 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.427 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.427 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:48.427 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402979+0000", 2024-09-12T22:32:48.427 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4378000000000002e-05 2024-09-12T22:32:48.428 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.428 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.428 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:48.428 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402987+0000", 2024-09-12T22:32:48.428 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3559999999999993e-06 2024-09-12T22:32:48.428 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.428 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.428 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:48.428 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409577+0000", 2024-09-12T22:32:48.428 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0065901709999999997 2024-09-12T22:32:48.428 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.428 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.429 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:48.429 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409653+0000", 2024-09-12T22:32:48.429 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5819e-05 2024-09-12T22:32:48.429 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.429 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.429 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:48.429 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409725+0000", 2024-09-12T22:32:48.429 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2200000000000007e-05 2024-09-12T22:32:48.429 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.429 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.429 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:48.429 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.411234+0000", 2024-09-12T22:32:48.429 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001508225 2024-09-12T22:32:48.429 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.430 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.430 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:48.430 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419212+0000", 2024-09-12T22:32:48.430 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0079783400000000004 2024-09-12T22:32:48.430 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.430 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.430 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:48.430 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419244+0000", 2024-09-12T22:32:48.430 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2384e-05 2024-09-12T22:32:48.430 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.430 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.430 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:48.430 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419282+0000", 2024-09-12T22:32:48.431 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7394999999999997e-05 2024-09-12T22:32:48.431 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:48.431 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:48.431 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:48.431 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.431 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.431 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:48.431 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.403135+0000", 2024-09-12T22:32:48.431 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 70.945135046000004, 2024-09-12T22:32:48.431 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016294211999999999, 2024-09-12T22:32:48.431 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:48.431 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:48.431 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:48.432 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:48.432 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.432 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:48.432 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403135+0000", 2024-09-12T22:32:48.432 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:48.432 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.432 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.432 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:48.432 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403135+0000", 2024-09-12T22:32:48.432 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:48.432 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.432 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.432 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:48.433 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403136+0000", 2024-09-12T22:32:48.433 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.4e-07 2024-09-12T22:32:48.433 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.433 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.433 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:48.433 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403149+0000", 2024-09-12T22:32:48.434 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2723e-05 2024-09-12T22:32:48.434 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.434 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.434 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:48.434 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403158+0000", 2024-09-12T22:32:48.434 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3919999999999992e-06 2024-09-12T22:32:48.434 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.434 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.434 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:48.434 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403166+0000", 2024-09-12T22:32:48.434 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.2309999999999996e-06 2024-09-12T22:32:48.434 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.434 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.435 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:48.435 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409944+0000", 2024-09-12T22:32:48.435 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0067775309999999998 2024-09-12T22:32:48.435 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.435 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.435 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:48.435 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410032+0000", 2024-09-12T22:32:48.435 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.7906999999999997e-05 2024-09-12T22:32:48.435 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.435 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.435 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:48.435 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410152+0000", 2024-09-12T22:32:48.435 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012037800000000001 2024-09-12T22:32:48.435 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.436 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.436 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:48.436 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.411945+0000", 2024-09-12T22:32:48.436 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0017931850000000001 2024-09-12T22:32:48.436 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.436 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.436 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:48.436 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419319+0000", 2024-09-12T22:32:48.436 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0073731780000000002 2024-09-12T22:32:48.436 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.436 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.436 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:48.436 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419376+0000", 2024-09-12T22:32:48.437 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7728e-05 2024-09-12T22:32:48.437 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.437 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.437 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:48.437 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419429+0000", 2024-09-12T22:32:48.437 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3019000000000002e-05 2024-09-12T22:32:48.437 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:48.437 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:48.437 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:48.437 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.437 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.437 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:48.437 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.403185+0000", 2024-09-12T22:32:48.438 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 70.945085164999995, 2024-09-12T22:32:48.438 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.014902164000000001, 2024-09-12T22:32:48.438 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:48.438 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:48.438 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:48.438 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:48.438 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.438 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:48.438 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403185+0000", 2024-09-12T22:32:48.440 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:48.440 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.440 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.440 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:48.440 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403185+0000", 2024-09-12T22:32:48.440 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:48.441 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.441 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.441 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:48.441 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403186+0000", 2024-09-12T22:32:48.441 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9400000000000005e-07 2024-09-12T22:32:48.441 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.441 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.441 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:48.441 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403191+0000", 2024-09-12T22:32:48.442 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6980000000000003e-06 2024-09-12T22:32:48.442 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.442 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.442 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:48.442 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403199+0000", 2024-09-12T22:32:48.442 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2520000000000002e-06 2024-09-12T22:32:48.442 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.442 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.442 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:48.443 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403205+0000", 2024-09-12T22:32:48.443 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.908e-06 2024-09-12T22:32:48.443 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.443 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.443 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:48.443 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403359+0000", 2024-09-12T22:32:48.443 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000154544 2024-09-12T22:32:48.443 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.443 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.443 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:48.443 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403528+0000", 2024-09-12T22:32:48.443 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000168455 2024-09-12T22:32:48.443 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.444 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.444 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:48.444 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403763+0000", 2024-09-12T22:32:48.444 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00023539599999999999 2024-09-12T22:32:48.444 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.444 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.444 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:48.444 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409378+0000", 2024-09-12T22:32:48.444 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056150000000000002 2024-09-12T22:32:48.444 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.444 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.444 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:48.444 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418012+0000", 2024-09-12T22:32:48.445 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0086339559999999999 2024-09-12T22:32:48.445 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.445 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.445 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:48.445 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418046+0000", 2024-09-12T22:32:48.445 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4267999999999998e-05 2024-09-12T22:32:48.445 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.445 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.445 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:48.445 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418087+0000", 2024-09-12T22:32:48.445 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0992999999999999e-05 2024-09-12T22:32:48.445 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:48.445 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:48.446 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:48.446 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.446 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.446 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:48.446 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.403273+0000", 2024-09-12T22:32:48.446 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 70.944997213999997, 2024-09-12T22:32:48.446 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.014934866, 2024-09-12T22:32:48.446 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:48.446 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:48.446 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:48.447 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:48.447 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.447 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:48.447 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403273+0000", 2024-09-12T22:32:48.447 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:48.447 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.447 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.447 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:48.447 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403273+0000", 2024-09-12T22:32:48.447 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:48.447 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.447 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.447 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:48.448 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403274+0000", 2024-09-12T22:32:48.448 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.297e-06 2024-09-12T22:32:48.448 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.448 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.448 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:48.448 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403282+0000", 2024-09-12T22:32:48.448 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6340000000000001e-06 2024-09-12T22:32:48.448 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.448 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.448 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:48.448 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403305+0000", 2024-09-12T22:32:48.448 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3149000000000001e-05 2024-09-12T22:32:48.448 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.449 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.449 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:48.449 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403320+0000", 2024-09-12T22:32:48.449 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4527e-05 2024-09-12T22:32:48.449 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.449 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.449 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:48.449 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.404928+0000", 2024-09-12T22:32:48.449 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001608459 2024-09-12T22:32:48.449 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.449 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.449 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:48.449 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405218+0000", 2024-09-12T22:32:48.450 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00028982900000000002 2024-09-12T22:32:48.450 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.450 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.450 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:48.450 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405829+0000", 2024-09-12T22:32:48.450 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00061127900000000005 2024-09-12T22:32:48.450 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.450 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.450 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:48.450 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409403+0000", 2024-09-12T22:32:48.450 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.003573597 2024-09-12T22:32:48.450 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.450 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.451 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:48.451 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418138+0000", 2024-09-12T22:32:48.451 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0087349969999999996 2024-09-12T22:32:48.451 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.451 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.451 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:48.451 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418178+0000", 2024-09-12T22:32:48.451 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0649999999999999e-05 2024-09-12T22:32:48.451 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.451 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.451 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:48.451 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418208+0000", 2024-09-12T22:32:48.451 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9448e-05 2024-09-12T22:32:48.451 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:48.452 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:48.452 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:48.452 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.452 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.452 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:48.452 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.405456+0000", 2024-09-12T22:32:48.452 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 70.942814068999994, 2024-09-12T22:32:48.452 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012888389, 2024-09-12T22:32:48.452 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:48.452 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:48.452 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:48.452 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:48.452 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.453 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:48.453 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405456+0000", 2024-09-12T22:32:48.453 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:48.453 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.453 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.453 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:48.453 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405456+0000", 2024-09-12T22:32:48.453 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:48.453 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.453 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.453 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:48.453 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405457+0000", 2024-09-12T22:32:48.453 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.6599999999999994e-07 2024-09-12T22:32:48.454 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.454 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.454 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:48.454 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405463+0000", 2024-09-12T22:32:48.454 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4739999999999996e-06 2024-09-12T22:32:48.454 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.454 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.454 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:48.454 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405474+0000", 2024-09-12T22:32:48.454 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1095e-05 2024-09-12T22:32:48.454 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.454 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.454 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:48.454 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405482+0000", 2024-09-12T22:32:48.455 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3610000000000001e-06 2024-09-12T22:32:48.455 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.455 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.455 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:48.455 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407051+0000", 2024-09-12T22:32:48.455 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0015688970000000001 2024-09-12T22:32:48.455 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.455 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.455 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:48.455 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407259+0000", 2024-09-12T22:32:48.455 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00020778300000000001 2024-09-12T22:32:48.455 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.455 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.456 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:48.456 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407622+0000", 2024-09-12T22:32:48.456 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000363066 2024-09-12T22:32:48.456 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.456 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.456 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:48.456 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409438+0000", 2024-09-12T22:32:48.456 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001816319 2024-09-12T22:32:48.456 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.456 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.456 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:48.456 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418257+0000", 2024-09-12T22:32:48.457 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0088187720000000008 2024-09-12T22:32:48.457 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.457 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.457 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:48.457 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418308+0000", 2024-09-12T22:32:48.457 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1180000000000001e-05 2024-09-12T22:32:48.457 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.457 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.457 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:48.457 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418345+0000", 2024-09-12T22:32:48.457 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6476000000000001e-05 2024-09-12T22:32:48.457 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:48.457 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:48.457 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:48.458 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.458 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.458 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:48.458 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.405496+0000", 2024-09-12T22:32:48.458 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 70.942774712000002, 2024-09-12T22:32:48.458 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013016012, 2024-09-12T22:32:48.458 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:48.458 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:48.458 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:48.458 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:48.458 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.458 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:48.458 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405496+0000", 2024-09-12T22:32:48.459 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:48.459 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.459 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.459 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:48.459 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405496+0000", 2024-09-12T22:32:48.459 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:48.459 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.459 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.459 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:48.459 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405496+0000", 2024-09-12T22:32:48.459 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7999999999999995e-07 2024-09-12T22:32:48.459 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.459 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.460 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:48.460 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405501+0000", 2024-09-12T22:32:48.460 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8359999999999999e-06 2024-09-12T22:32:48.460 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.460 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.460 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:48.460 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405514+0000", 2024-09-12T22:32:48.460 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2522e-05 2024-09-12T22:32:48.460 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.460 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.460 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:48.460 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405521+0000", 2024-09-12T22:32:48.460 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5020000000000003e-06 2024-09-12T22:32:48.461 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.461 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.461 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:48.461 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405575+0000", 2024-09-12T22:32:48.461 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4169999999999998e-05 2024-09-12T22:32:48.461 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.461 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.461 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:48.461 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405697+0000", 2024-09-12T22:32:48.461 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000121301 2024-09-12T22:32:48.461 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.461 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.461 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:48.462 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405829+0000", 2024-09-12T22:32:48.462 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000132662 2024-09-12T22:32:48.462 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.462 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.462 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:48.462 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409155+0000", 2024-09-12T22:32:48.462 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0033259050000000001 2024-09-12T22:32:48.462 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.462 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.462 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:48.462 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418425+0000", 2024-09-12T22:32:48.462 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0092696319999999999 2024-09-12T22:32:48.462 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.463 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.463 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:48.463 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418471+0000", 2024-09-12T22:32:48.463 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6213e-05 2024-09-12T22:32:48.463 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.463 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.463 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:48.463 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418512+0000", 2024-09-12T22:32:48.463 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0589000000000001e-05 2024-09-12T22:32:48.463 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:48.463 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:48.463 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:48.463 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.463 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.464 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:48.464 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.406108+0000", 2024-09-12T22:32:48.464 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 70.942162315000004, 2024-09-12T22:32:48.464 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012458175, 2024-09-12T22:32:48.464 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:48.464 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:48.464 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:48.464 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:48.464 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.464 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:48.464 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406108+0000", 2024-09-12T22:32:48.464 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:48.465 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.465 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.465 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:48.465 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406108+0000", 2024-09-12T22:32:48.465 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:48.465 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.465 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.465 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:48.465 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406109+0000", 2024-09-12T22:32:48.465 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9899999999999999e-07 2024-09-12T22:32:48.465 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.465 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.465 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:48.465 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406115+0000", 2024-09-12T22:32:48.466 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9030000000000001e-06 2024-09-12T22:32:48.466 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.466 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.466 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:48.466 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406141+0000", 2024-09-12T22:32:48.466 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5999e-05 2024-09-12T22:32:48.466 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.466 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.466 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:48.466 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406150+0000", 2024-09-12T22:32:48.466 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.6050000000000004e-06 2024-09-12T22:32:48.466 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.466 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.467 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:48.467 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408163+0000", 2024-09-12T22:32:48.467 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0020122769999999998 2024-09-12T22:32:48.467 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.467 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.467 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:48.467 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408309+0000", 2024-09-12T22:32:48.467 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014606999999999999 2024-09-12T22:32:48.467 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.467 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.467 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:48.467 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408433+0000", 2024-09-12T22:32:48.467 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012460300000000001 2024-09-12T22:32:48.468 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.468 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.468 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:48.468 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409903+0000", 2024-09-12T22:32:48.468 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001469499 2024-09-12T22:32:48.468 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.468 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.468 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:48.468 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418427+0000", 2024-09-12T22:32:48.468 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0085241139999999993 2024-09-12T22:32:48.468 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.469 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.469 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:48.469 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418471+0000", 2024-09-12T22:32:48.469 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4474000000000001e-05 2024-09-12T22:32:48.469 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.469 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.469 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:48.469 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418566+0000", 2024-09-12T22:32:48.469 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.4732e-05 2024-09-12T22:32:48.469 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:48.469 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:48.469 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:48.469 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.469 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.470 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:48.470 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.407266+0000", 2024-09-12T22:32:48.470 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 70.941004458999998, 2024-09-12T22:32:48.470 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011442905, 2024-09-12T22:32:48.470 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:48.470 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:48.470 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2024-09-12T22:32:48.470 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:48.470 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.470 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:48.470 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407266+0000", 2024-09-12T22:32:48.470 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:48.470 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.471 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.471 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:48.471 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407266+0000", 2024-09-12T22:32:48.471 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:48.471 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.471 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.471 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:48.471 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407266+0000", 2024-09-12T22:32:48.471 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7899999999999998e-07 2024-09-12T22:32:48.471 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.471 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.471 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:48.471 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407269+0000", 2024-09-12T22:32:48.471 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9210000000000001e-06 2024-09-12T22:32:48.472 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.472 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.472 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:48.472 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407331+0000", 2024-09-12T22:32:48.472 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1376000000000003e-05 2024-09-12T22:32:48.472 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.472 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.472 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:48.472 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407337+0000", 2024-09-12T22:32:48.472 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1929999999999998e-06 2024-09-12T22:32:48.472 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.472 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.472 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:48.473 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408974+0000", 2024-09-12T22:32:48.473 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0016367109999999999 2024-09-12T22:32:48.473 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.473 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.473 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:48.473 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409112+0000", 2024-09-12T22:32:48.473 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000137952 2024-09-12T22:32:48.473 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:48.473 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:48.473 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:48.473 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418709+0000", 2024-09-12T22:32:48.473 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0095971730000000005 2024-09-12T22:32:48.473 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:48.473 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:48.474 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:48.474 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:48.474 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:48.474 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-09-12T22:32:48.475 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:48.474+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:48.476 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:32:48.576 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:48.575+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:48.588 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:32:48.588 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:32:48.588 INFO:teuthology.orchestra.run.smithi148.stdout: "num_ops": 0 2024-09-12T22:32:48.588 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:32:48.598 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:32:48.682 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:48.681+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:48.722 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T22:32:48.741 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:32:48.741 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:32:48.741 INFO:teuthology.orchestra.run.smithi148.stdout: "complaint_time": 30, 2024-09-12T22:32:48.741 INFO:teuthology.orchestra.run.smithi148.stdout: "num_blocked_ops": 0 2024-09-12T22:32:48.741 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:32:48.749 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:32:48.790 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:48.789+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:48.841 INFO:teuthology.orchestra.run.smithi019.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-12T22:32:48.872 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T22:32:48.872 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:32:48.879 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:48.878+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:48.890 INFO:teuthology.orchestra.run.smithi019.stdout:osd.2: {} 2024-09-12T22:32:48.891 INFO:teuthology.orchestra.run.smithi019.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T22:32:48.892 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:48.892 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:48.895 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:32:48.895 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:32:48.901 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:32:48.980 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:48.979+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:49.011 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:49.011 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:49.020 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:32:49.104 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:49.103+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:49.164 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:49.164 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:49.172 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:32:49.213 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:49.212+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:49.283 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:49.282+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:49.315 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:49.315 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:49.324 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:32:49.384 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:49.383+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:49.431 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:49.431 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:49.440 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:32:49.485 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:49.483+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:49.519 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T22:32:49.543 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:49.543 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:49.551 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:32:49.595 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:49.594+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:49.654 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:49.654 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:49.663 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:32:49.707 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:49.706+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:49.718 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [0] live_osds: [1, 2] 2024-09-12T22:32:49.719 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-12T22:32:49.719 INFO:tasks.thrashosds.thrasher:inject_pause on osd.1 2024-09-12T22:32:49.719 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-12T22:32:49.719 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-12T22:32:49.719 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok config set filestore_inject_stall 3 2024-09-12T22:32:49.768 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:49.768 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:49.777 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:32:49.818 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:49.817+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:49.822 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:32:49.822 INFO:teuthology.orchestra.run.smithi148.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-09-12T22:32:49.823 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:32:49.889 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:49.888+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:49.921 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:49.921 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:49.930 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:32:49.990 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:49.988+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:50.033 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:50.033 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:50.041 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:32:50.091 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:50.090+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:50.145 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:50.146 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:50.154 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:32:50.199 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:50.197+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:50.258 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:50.258 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:50.266 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:32:50.307 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:50.306+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:50.394 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:50.393+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:50.409 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:50.410 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:50.418 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:32:50.437 INFO:teuthology.orchestra.run.smithi019.stderr:noscrub is unset 2024-09-12T22:32:50.495 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:50.494+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:50.525 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:50.525 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:50.534 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:32:50.596 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:50.594+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:50.638 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:50.638 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:50.647 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:32:50.697 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:50.696+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:50.792 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:50.792 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:50.798 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:50.797+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:50.801 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:32:50.897 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T22:32:50.898 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:50.897+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:50.904 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:50.905 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:50.913 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:32:51.000 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:50.999+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:51.008 INFO:teuthology.orchestra.run.smithi019.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-12T22:32:51.040 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T22:32:51.041 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:32:51.058 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:32:51.058 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:32:51.059 INFO:teuthology.orchestra.run.smithi148.stdout: "complaint_time": 30, 2024-09-12T22:32:51.059 INFO:teuthology.orchestra.run.smithi148.stdout: "num_blocked_ops": 0 2024-09-12T22:32:51.059 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:32:51.067 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:32:51.071 INFO:teuthology.orchestra.run.smithi019.stdout:osd.2: {} 2024-09-12T22:32:51.072 INFO:teuthology.orchestra.run.smithi019.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T22:32:51.076 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:32:51.076 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:32:51.111 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:51.110+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:51.172 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:32:51.173 INFO:teuthology.orchestra.run.smithi148.stdout: "size": 20, 2024-09-12T22:32:51.173 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 600, 2024-09-12T22:32:51.173 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [ 2024-09-12T22:32:51.173 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.173 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:51.173 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.400880+0000", 2024-09-12T22:32:51.174 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 73.769227596999997, 2024-09-12T22:32:51.174 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0095133660000000005, 2024-09-12T22:32:51.174 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:51.174 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:51.174 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:51.174 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:51.174 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.174 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:51.174 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400880+0000", 2024-09-12T22:32:51.174 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:51.175 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.175 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.175 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:51.175 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400880+0000", 2024-09-12T22:32:51.175 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:51.175 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.175 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.175 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:51.175 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400892+0000", 2024-09-12T22:32:51.175 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1941e-05 2024-09-12T22:32:51.175 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.175 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.176 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:51.176 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400900+0000", 2024-09-12T22:32:51.176 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0080000000000002e-06 2024-09-12T22:32:51.176 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.176 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.176 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:51.176 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400911+0000", 2024-09-12T22:32:51.176 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1452e-05 2024-09-12T22:32:51.176 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.176 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.176 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:51.176 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400922+0000", 2024-09-12T22:32:51.177 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0772e-05 2024-09-12T22:32:51.177 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.177 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.177 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:51.178 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401009+0000", 2024-09-12T22:32:51.178 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.7206000000000005e-05 2024-09-12T22:32:51.178 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.178 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.178 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:51.178 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401157+0000", 2024-09-12T22:32:51.178 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014831499999999999 2024-09-12T22:32:51.178 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.178 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.178 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:51.178 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401312+0000", 2024-09-12T22:32:51.178 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00015495600000000001 2024-09-12T22:32:51.178 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.179 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.179 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:51.179 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.403060+0000", 2024-09-12T22:32:51.179 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0017475220000000001 2024-09-12T22:32:51.179 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.179 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.179 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:51.179 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410300+0000", 2024-09-12T22:32:51.179 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0072403260000000001 2024-09-12T22:32:51.179 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.179 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.179 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:51.179 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410350+0000", 2024-09-12T22:32:51.180 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9814000000000001e-05 2024-09-12T22:32:51.180 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.180 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.180 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:51.180 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410393+0000", 2024-09-12T22:32:51.180 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3053999999999998e-05 2024-09-12T22:32:51.180 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:51.180 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:51.180 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:51.180 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.180 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.180 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:51.180 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.400952+0000", 2024-09-12T22:32:51.181 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 73.769155444999996, 2024-09-12T22:32:51.181 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0096045620000000005, 2024-09-12T22:32:51.181 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:51.181 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:51.181 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:51.181 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:51.181 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.181 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:51.182 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400952+0000", 2024-09-12T22:32:51.182 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:51.182 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.182 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.182 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:51.182 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400952+0000", 2024-09-12T22:32:51.182 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:51.182 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.183 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.183 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:51.183 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400953+0000", 2024-09-12T22:32:51.183 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.8000000000000005e-07 2024-09-12T22:32:51.183 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.183 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.183 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:51.183 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400957+0000", 2024-09-12T22:32:51.183 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.33e-06 2024-09-12T22:32:51.184 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.184 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.184 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:51.184 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400966+0000", 2024-09-12T22:32:51.184 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1989999999999995e-06 2024-09-12T22:32:51.184 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.184 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.184 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:51.184 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400973+0000", 2024-09-12T22:32:51.185 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2779999999999999e-06 2024-09-12T22:32:51.185 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.185 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.185 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:51.185 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401696+0000", 2024-09-12T22:32:51.185 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00072363500000000003 2024-09-12T22:32:51.185 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.185 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.185 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:51.185 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401788+0000", 2024-09-12T22:32:51.185 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1862999999999998e-05 2024-09-12T22:32:51.185 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.185 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.186 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:51.186 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401929+0000", 2024-09-12T22:32:51.186 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014096000000000001 2024-09-12T22:32:51.186 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.186 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.186 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:51.186 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.403542+0000", 2024-09-12T22:32:51.186 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001612963 2024-09-12T22:32:51.186 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.186 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.186 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:51.186 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410460+0000", 2024-09-12T22:32:51.186 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0069180500000000002 2024-09-12T22:32:51.187 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.187 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.187 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:51.187 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410515+0000", 2024-09-12T22:32:51.187 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5009000000000001e-05 2024-09-12T22:32:51.187 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.187 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.187 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:51.187 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410557+0000", 2024-09-12T22:32:51.188 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1495000000000002e-05 2024-09-12T22:32:51.188 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:51.188 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:51.188 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:51.188 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.188 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.188 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:51.188 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.400984+0000", 2024-09-12T22:32:51.188 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 73.769122949999996, 2024-09-12T22:32:51.188 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0073703950000000001, 2024-09-12T22:32:51.188 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:51.188 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:51.189 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:51.189 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:51.189 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.189 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:51.189 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400984+0000", 2024-09-12T22:32:51.189 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:51.189 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.189 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.189 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:51.189 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400984+0000", 2024-09-12T22:32:51.189 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:51.189 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.189 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.190 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:51.190 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400985+0000", 2024-09-12T22:32:51.190 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3200000000000005e-07 2024-09-12T22:32:51.190 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.190 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.190 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:51.190 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400998+0000", 2024-09-12T22:32:51.190 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2726e-05 2024-09-12T22:32:51.190 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.190 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.190 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:51.190 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401006+0000", 2024-09-12T22:32:51.190 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.3110000000000006e-06 2024-09-12T22:32:51.191 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.191 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.191 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:51.191 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401022+0000", 2024-09-12T22:32:51.191 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6249e-05 2024-09-12T22:32:51.191 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.191 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.191 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:51.191 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401700+0000", 2024-09-12T22:32:51.191 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00067811100000000001 2024-09-12T22:32:51.191 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.191 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.191 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:51.192 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401839+0000", 2024-09-12T22:32:51.192 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013865399999999999 2024-09-12T22:32:51.192 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.192 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.192 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:51.192 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401962+0000", 2024-09-12T22:32:51.192 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000123266 2024-09-12T22:32:51.192 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.192 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.192 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:51.192 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.403589+0000", 2024-09-12T22:32:51.192 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001626932 2024-09-12T22:32:51.192 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.193 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.193 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:51.193 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.408274+0000", 2024-09-12T22:32:51.193 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0046848100000000002 2024-09-12T22:32:51.193 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.193 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.193 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:51.193 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.408324+0000", 2024-09-12T22:32:51.193 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9784000000000003e-05 2024-09-12T22:32:51.193 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.193 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.194 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:51.194 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.408355+0000", 2024-09-12T22:32:51.194 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.1019999999999998e-05 2024-09-12T22:32:51.194 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:51.194 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:51.194 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:51.194 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.194 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.194 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:51.194 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401034+0000", 2024-09-12T22:32:51.194 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 73.769073509999998, 2024-09-12T22:32:51.194 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011063051000000001, 2024-09-12T22:32:51.195 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:51.195 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:51.195 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:51.195 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:51.195 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.195 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:51.195 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401034+0000", 2024-09-12T22:32:51.195 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:51.195 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.195 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.195 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:51.195 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401034+0000", 2024-09-12T22:32:51.195 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:51.196 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.196 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.196 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:51.196 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401034+0000", 2024-09-12T22:32:51.196 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8899999999999999e-07 2024-09-12T22:32:51.196 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.196 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.196 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:51.196 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401038+0000", 2024-09-12T22:32:51.196 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.523e-06 2024-09-12T22:32:51.196 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.196 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.196 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:51.197 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401046+0000", 2024-09-12T22:32:51.197 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0479999999999999e-06 2024-09-12T22:32:51.197 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.197 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.197 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:51.197 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401051+0000", 2024-09-12T22:32:51.197 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2619999999999998e-06 2024-09-12T22:32:51.197 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.197 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.197 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:51.197 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402270+0000", 2024-09-12T22:32:51.197 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012182429999999999 2024-09-12T22:32:51.197 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.198 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.198 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:51.198 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402325+0000", 2024-09-12T22:32:51.198 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5526999999999999e-05 2024-09-12T22:32:51.198 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.198 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.198 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:51.198 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402403+0000", 2024-09-12T22:32:51.198 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.7559999999999996e-05 2024-09-12T22:32:51.199 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.199 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.199 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:51.199 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.403655+0000", 2024-09-12T22:32:51.199 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012521489999999999 2024-09-12T22:32:51.199 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.199 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.199 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:51.199 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411979+0000", 2024-09-12T22:32:51.199 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0083240420000000002 2024-09-12T22:32:51.199 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.199 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.199 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:51.200 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.412036+0000", 2024-09-12T22:32:51.200 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7639000000000002e-05 2024-09-12T22:32:51.200 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.200 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.200 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:51.200 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.412097+0000", 2024-09-12T22:32:51.200 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0469e-05 2024-09-12T22:32:51.200 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:51.200 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:51.200 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:51.200 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.200 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.200 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:51.200 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401060+0000", 2024-09-12T22:32:51.201 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 73.769047757999999, 2024-09-12T22:32:51.201 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.010030172, 2024-09-12T22:32:51.201 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:51.201 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:51.201 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:51.201 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:51.201 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.201 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:51.201 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401060+0000", 2024-09-12T22:32:51.201 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:51.201 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.201 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.201 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:51.202 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401060+0000", 2024-09-12T22:32:51.202 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:51.202 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.202 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.202 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:51.202 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401060+0000", 2024-09-12T22:32:51.202 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2500000000000001e-07 2024-09-12T22:32:51.202 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.202 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.202 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:51.202 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401063+0000", 2024-09-12T22:32:51.202 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0910000000000001e-06 2024-09-12T22:32:51.202 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.203 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.203 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:51.203 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401070+0000", 2024-09-12T22:32:51.203 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1210000000000001e-06 2024-09-12T22:32:51.203 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.203 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.203 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:51.203 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401076+0000", 2024-09-12T22:32:51.203 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2830000000000001e-06 2024-09-12T22:32:51.203 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.203 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.203 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:51.203 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402288+0000", 2024-09-12T22:32:51.203 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012123699999999999 2024-09-12T22:32:51.204 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.204 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.204 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:51.204 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402359+0000", 2024-09-12T22:32:51.204 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.0988000000000005e-05 2024-09-12T22:32:51.204 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.204 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.204 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:51.204 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402457+0000", 2024-09-12T22:32:51.204 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.7857999999999997e-05 2024-09-12T22:32:51.204 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.204 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.204 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:51.204 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.404395+0000", 2024-09-12T22:32:51.205 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0019380160000000001 2024-09-12T22:32:51.205 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.205 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.205 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:51.205 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410603+0000", 2024-09-12T22:32:51.205 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.006208061 2024-09-12T22:32:51.205 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.205 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.205 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:51.205 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410687+0000", 2024-09-12T22:32:51.205 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.4623000000000006e-05 2024-09-12T22:32:51.205 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.205 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.206 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:51.206 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411090+0000", 2024-09-12T22:32:51.206 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00040233599999999999 2024-09-12T22:32:51.206 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:51.206 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:51.206 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:51.206 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.206 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.206 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:51.206 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401083+0000", 2024-09-12T22:32:51.206 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 73.769024341999994, 2024-09-12T22:32:51.206 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0097591850000000001, 2024-09-12T22:32:51.206 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:51.206 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:51.207 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:51.207 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:51.207 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.207 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:51.207 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401083+0000", 2024-09-12T22:32:51.207 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:51.207 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.207 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.207 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:51.207 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401083+0000", 2024-09-12T22:32:51.207 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:51.207 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.207 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.208 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:51.208 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401084+0000", 2024-09-12T22:32:51.208 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4799999999999999e-07 2024-09-12T22:32:51.208 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.208 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.208 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:51.208 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401088+0000", 2024-09-12T22:32:51.208 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6419999999999998e-06 2024-09-12T22:32:51.208 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.209 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.209 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:51.209 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401094+0000", 2024-09-12T22:32:51.209 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0090000000000004e-06 2024-09-12T22:32:51.209 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.209 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.209 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:51.209 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401108+0000", 2024-09-12T22:32:51.209 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3884e-05 2024-09-12T22:32:51.209 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.209 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.209 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:51.209 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401165+0000", 2024-09-12T22:32:51.210 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.6499000000000002e-05 2024-09-12T22:32:51.210 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.210 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.210 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:51.210 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401261+0000", 2024-09-12T22:32:51.210 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.6872000000000004e-05 2024-09-12T22:32:51.210 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.210 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.210 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:51.210 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401376+0000", 2024-09-12T22:32:51.210 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000114508 2024-09-12T22:32:51.210 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.210 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.210 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:51.211 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402666+0000", 2024-09-12T22:32:51.211 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012901659999999999 2024-09-12T22:32:51.211 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.211 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.211 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:51.211 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410572+0000", 2024-09-12T22:32:51.211 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0079055489999999996 2024-09-12T22:32:51.211 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.211 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.211 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:51.211 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410661+0000", 2024-09-12T22:32:51.211 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.9578000000000002e-05 2024-09-12T22:32:51.211 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.211 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.212 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:51.212 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410842+0000", 2024-09-12T22:32:51.212 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00018102999999999999 2024-09-12T22:32:51.212 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:51.212 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:51.212 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:51.212 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.212 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.212 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:51.212 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401122+0000", 2024-09-12T22:32:51.212 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 73.768985310000005, 2024-09-12T22:32:51.212 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0099122080000000005, 2024-09-12T22:32:51.212 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:51.213 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:51.213 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:32:51.213 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:51.213 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.213 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:51.213 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401122+0000", 2024-09-12T22:32:51.213 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:51.213 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.213 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.213 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:51.213 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401122+0000", 2024-09-12T22:32:51.213 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:51.213 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.213 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.214 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:51.214 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401123+0000", 2024-09-12T22:32:51.214 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2600000000000002e-07 2024-09-12T22:32:51.214 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.214 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.214 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:51.214 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401126+0000", 2024-09-12T22:32:51.214 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.6449999999999998e-06 2024-09-12T22:32:51.214 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.214 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.214 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:51.214 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401133+0000", 2024-09-12T22:32:51.214 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.9890000000000003e-06 2024-09-12T22:32:51.214 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.215 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.215 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:51.215 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401138+0000", 2024-09-12T22:32:51.215 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8060000000000002e-06 2024-09-12T22:32:51.215 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.215 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.215 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:51.215 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401703+0000", 2024-09-12T22:32:51.215 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00056509099999999999 2024-09-12T22:32:51.215 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.215 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.215 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:51.215 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401837+0000", 2024-09-12T22:32:51.215 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013338799999999999 2024-09-12T22:32:51.216 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.216 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.216 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:51.216 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411034+0000", 2024-09-12T22:32:51.216 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.009197663 2024-09-12T22:32:51.216 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:51.216 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:51.216 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:51.216 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.216 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.216 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:51.216 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401158+0000", 2024-09-12T22:32:51.216 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 73.768949531000004, 2024-09-12T22:32:51.217 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.010292437999999999, 2024-09-12T22:32:51.217 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:51.217 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:51.217 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:32:51.217 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:51.217 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.217 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:51.218 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401158+0000", 2024-09-12T22:32:51.218 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:51.218 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.218 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.218 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:51.218 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401158+0000", 2024-09-12T22:32:51.218 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:51.219 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.219 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.219 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:51.219 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401158+0000", 2024-09-12T22:32:51.219 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9699999999999996e-07 2024-09-12T22:32:51.219 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.219 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.220 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:51.220 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401161+0000", 2024-09-12T22:32:51.220 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.7410000000000001e-06 2024-09-12T22:32:51.220 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.220 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.220 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:51.220 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401168+0000", 2024-09-12T22:32:51.220 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.844e-06 2024-09-12T22:32:51.220 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.220 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.220 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:51.220 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401174+0000", 2024-09-12T22:32:51.220 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4700000000000001e-06 2024-09-12T22:32:51.221 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.221 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.221 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:51.221 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402799+0000", 2024-09-12T22:32:51.221 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0016256409999999999 2024-09-12T22:32:51.221 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.221 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.221 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:51.221 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402893+0000", 2024-09-12T22:32:51.221 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.3807999999999994e-05 2024-09-12T22:32:51.221 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.221 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.221 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:51.221 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411450+0000", 2024-09-12T22:32:51.222 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0085573369999999999 2024-09-12T22:32:51.222 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:51.222 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:51.222 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:51.222 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.222 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.222 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:51.222 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401183+0000", 2024-09-12T22:32:51.222 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 73.768924678999994, 2024-09-12T22:32:51.222 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0068597830000000004, 2024-09-12T22:32:51.222 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:51.222 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:51.222 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:32:51.223 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:51.223 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.223 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:51.223 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401183+0000", 2024-09-12T22:32:51.223 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:51.223 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.223 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.223 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:51.223 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401183+0000", 2024-09-12T22:32:51.223 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:51.223 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.223 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.223 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:51.223 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401183+0000", 2024-09-12T22:32:51.224 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.6700000000000003e-07 2024-09-12T22:32:51.224 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.224 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.224 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:51.224 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401186+0000", 2024-09-12T22:32:51.224 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4679999999999999e-06 2024-09-12T22:32:51.224 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.224 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.224 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:51.224 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401192+0000", 2024-09-12T22:32:51.224 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.1519999999999997e-06 2024-09-12T22:32:51.224 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.225 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.225 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:51.225 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401197+0000", 2024-09-12T22:32:51.225 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4669999999999998e-06 2024-09-12T22:32:51.225 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.225 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.225 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:51.225 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401253+0000", 2024-09-12T22:32:51.226 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.6211000000000001e-05 2024-09-12T22:32:51.226 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.226 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.226 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:51.226 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401413+0000", 2024-09-12T22:32:51.226 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00016021399999999999 2024-09-12T22:32:51.226 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.226 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.226 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:51.226 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.408043+0000", 2024-09-12T22:32:51.226 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0066295039999999996 2024-09-12T22:32:51.226 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:51.226 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:51.226 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:51.227 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.227 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.227 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:20 3.1c e19/17 3:3ed09add:::607.00000000:head v 19'1, mlcod=0'0)", 2024-09-12T22:32:51.227 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.409642+0000", 2024-09-12T22:32:51.227 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 73.76046522, 2024-09-12T22:32:51.227 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0038816269999999999, 2024-09-12T22:32:51.227 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:51.227 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:51.227 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:51.227 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:51.227 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.227 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:51.227 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409642+0000", 2024-09-12T22:32:51.227 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:51.228 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.228 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.228 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:51.228 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409642+0000", 2024-09-12T22:32:51.228 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:51.228 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.228 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.228 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:51.228 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409642+0000", 2024-09-12T22:32:51.228 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.6899999999999999e-07 2024-09-12T22:32:51.228 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.228 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.228 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:51.229 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409648+0000", 2024-09-12T22:32:51.229 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.49e-06 2024-09-12T22:32:51.229 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.229 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.229 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:51.229 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409656+0000", 2024-09-12T22:32:51.230 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.2949999999999994e-06 2024-09-12T22:32:51.230 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.230 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.230 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:51.230 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409664+0000", 2024-09-12T22:32:51.230 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.1219999999999995e-06 2024-09-12T22:32:51.230 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.230 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.230 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:51.230 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409707+0000", 2024-09-12T22:32:51.230 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2222000000000003e-05 2024-09-12T22:32:51.230 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.230 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.231 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:51.231 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409724+0000", 2024-09-12T22:32:51.231 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7496999999999999e-05 2024-09-12T22:32:51.231 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.231 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.231 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:51.231 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413439+0000", 2024-09-12T22:32:51.231 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00371448 2024-09-12T22:32:51.231 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.231 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.231 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:51.231 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413524+0000", 2024-09-12T22:32:51.231 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.5252000000000003e-05 2024-09-12T22:32:51.231 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:51.232 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:51.232 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:51.232 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.232 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.232 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:28 3.13 e19/17 3:cd5a64a3:::100.00000000:head v 19'1, mlcod=0'0)", 2024-09-12T22:32:51.232 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.409681+0000", 2024-09-12T22:32:51.232 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 73.760426737000003, 2024-09-12T22:32:51.232 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0038708710000000001, 2024-09-12T22:32:51.232 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:51.232 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:51.232 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:51.233 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:51.233 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.233 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:51.233 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409681+0000", 2024-09-12T22:32:51.233 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:51.233 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.233 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.233 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:51.233 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409681+0000", 2024-09-12T22:32:51.233 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:51.233 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.233 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.233 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:51.234 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409681+0000", 2024-09-12T22:32:51.234 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3000000000000002e-07 2024-09-12T22:32:51.234 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.234 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.234 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:51.234 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409695+0000", 2024-09-12T22:32:51.234 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4313e-05 2024-09-12T22:32:51.234 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.234 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.234 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:51.234 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409703+0000", 2024-09-12T22:32:51.234 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4000000000000003e-06 2024-09-12T22:32:51.234 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.234 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.235 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:51.235 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409708+0000", 2024-09-12T22:32:51.235 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3190000000000002e-06 2024-09-12T22:32:51.235 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.235 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.235 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:51.235 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409875+0000", 2024-09-12T22:32:51.235 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000167329 2024-09-12T22:32:51.235 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.235 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.235 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:51.235 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409892+0000", 2024-09-12T22:32:51.235 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6957999999999999e-05 2024-09-12T22:32:51.235 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.236 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.236 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:51.236 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413457+0000", 2024-09-12T22:32:51.236 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0035651279999999999 2024-09-12T22:32:51.236 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.236 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.236 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:51.236 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413552+0000", 2024-09-12T22:32:51.236 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.4093999999999997e-05 2024-09-12T22:32:51.236 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:51.236 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:51.236 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:51.236 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.236 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.237 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:21 3.1c e19/17 3:3ed09add:::607.00000000:head v 19'2, mlcod=0'0)", 2024-09-12T22:32:51.237 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.409718+0000", 2024-09-12T22:32:51.237 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 73.760389071999995, 2024-09-12T22:32:51.237 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003851883, 2024-09-12T22:32:51.237 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:51.237 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:51.237 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:51.237 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:51.237 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.237 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:51.237 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409718+0000", 2024-09-12T22:32:51.237 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:51.237 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.238 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.238 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:51.238 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409718+0000", 2024-09-12T22:32:51.238 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:51.238 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.238 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.238 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:51.238 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409719+0000", 2024-09-12T22:32:51.238 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.16e-07 2024-09-12T22:32:51.238 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.238 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.238 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:51.238 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409722+0000", 2024-09-12T22:32:51.238 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.692e-06 2024-09-12T22:32:51.239 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.239 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.239 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:51.239 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409729+0000", 2024-09-12T22:32:51.239 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.516e-06 2024-09-12T22:32:51.239 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.239 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.239 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:51.240 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409750+0000", 2024-09-12T22:32:51.240 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1151000000000001e-05 2024-09-12T22:32:51.240 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.240 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.240 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:51.240 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410015+0000", 2024-09-12T22:32:51.240 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00026477599999999999 2024-09-12T22:32:51.240 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.240 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.240 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:51.240 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410104+0000", 2024-09-12T22:32:51.240 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.9586000000000006e-05 2024-09-12T22:32:51.240 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.241 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.241 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:51.241 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413528+0000", 2024-09-12T22:32:51.241 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0034237880000000001 2024-09-12T22:32:51.241 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.241 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.241 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:51.241 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413570+0000", 2024-09-12T22:32:51.241 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2157999999999999e-05 2024-09-12T22:32:51.241 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:51.241 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:51.241 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:51.241 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.242 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.242 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:27 3.13 e19/17 3:c91d4a1d:::mds0_inotable:head v 19'2, mlcod=0'0)", 2024-09-12T22:32:51.242 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.409760+0000", 2024-09-12T22:32:51.242 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 73.760347555999999, 2024-09-12T22:32:51.242 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0039301910000000004, 2024-09-12T22:32:51.242 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:51.242 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:51.242 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:51.242 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:51.242 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.242 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:51.242 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409760+0000", 2024-09-12T22:32:51.243 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:51.243 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.243 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.243 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:51.243 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409760+0000", 2024-09-12T22:32:51.244 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:51.244 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.244 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.244 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:51.244 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409760+0000", 2024-09-12T22:32:51.244 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.39e-07 2024-09-12T22:32:51.244 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.244 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.244 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:51.244 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409765+0000", 2024-09-12T22:32:51.244 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4449999999999998e-06 2024-09-12T22:32:51.244 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.244 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.245 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:51.245 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409771+0000", 2024-09-12T22:32:51.245 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7159999999999997e-06 2024-09-12T22:32:51.245 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.245 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.245 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:51.245 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409778+0000", 2024-09-12T22:32:51.245 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.331e-06 2024-09-12T22:32:51.245 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.245 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.245 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:51.245 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410191+0000", 2024-09-12T22:32:51.246 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00041348300000000003 2024-09-12T22:32:51.246 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.246 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.246 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:51.246 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410211+0000", 2024-09-12T22:32:51.246 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9933999999999999e-05 2024-09-12T22:32:51.246 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.246 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.246 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:51.246 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413638+0000", 2024-09-12T22:32:51.246 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003426854 2024-09-12T22:32:51.246 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.246 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.247 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:51.247 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413690+0000", 2024-09-12T22:32:51.247 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2089000000000002e-05 2024-09-12T22:32:51.247 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:51.247 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:51.247 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:51.247 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.247 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.247 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "pg_update_log_missing_reply(3.b epoch 19/17 rep_tid 4 lcod 19'2)", 2024-09-12T22:32:51.247 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.410060+0000", 2024-09-12T22:32:51.247 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 73.760047890999999, 2024-09-12T22:32:51.247 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00098016500000000007, 2024-09-12T22:32:51.247 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:51.248 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:51.248 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "reached pg", 2024-09-12T22:32:51.248 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:51.248 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.248 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:51.248 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410060+0000", 2024-09-12T22:32:51.248 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:51.248 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.248 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.248 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:51.248 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410060+0000", 2024-09-12T22:32:51.248 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:51.248 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.249 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.249 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:51.249 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410060+0000", 2024-09-12T22:32:51.249 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.8299999999999998e-07 2024-09-12T22:32:51.249 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.249 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.249 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:51.249 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410062+0000", 2024-09-12T22:32:51.249 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5749999999999999e-06 2024-09-12T22:32:51.249 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.249 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.249 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:51.249 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410070+0000", 2024-09-12T22:32:51.249 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.909e-06 2024-09-12T22:32:51.250 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.250 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.250 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:51.250 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410076+0000", 2024-09-12T22:32:51.250 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7049999999999996e-06 2024-09-12T22:32:51.250 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.250 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.250 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:51.250 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410943+0000", 2024-09-12T22:32:51.250 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00086681900000000001 2024-09-12T22:32:51.250 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.250 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.250 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:51.251 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411040+0000", 2024-09-12T22:32:51.251 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.6774000000000006e-05 2024-09-12T22:32:51.251 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:51.251 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:51.251 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:51.251 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.251 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.251 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e19/17 ondisk, result = 0)", 2024-09-12T22:32:51.251 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.410113+0000", 2024-09-12T22:32:51.251 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 73.759994624000001, 2024-09-12T22:32:51.251 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00098911599999999995, 2024-09-12T22:32:51.251 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:51.251 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:51.251 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:32:51.252 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:51.252 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.252 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:51.252 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410113+0000", 2024-09-12T22:32:51.252 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:51.252 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.252 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.252 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:51.252 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410113+0000", 2024-09-12T22:32:51.252 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:51.252 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.252 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.252 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:51.253 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410113+0000", 2024-09-12T22:32:51.253 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.99e-07 2024-09-12T22:32:51.253 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.253 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.253 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:51.253 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410115+0000", 2024-09-12T22:32:51.253 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.046e-06 2024-09-12T22:32:51.253 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.253 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.253 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:51.253 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410121+0000", 2024-09-12T22:32:51.253 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0050000000000001e-06 2024-09-12T22:32:51.253 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.253 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.254 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:51.254 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410126+0000", 2024-09-12T22:32:51.254 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8339999999999998e-06 2024-09-12T22:32:51.254 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.254 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.254 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:51.254 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410587+0000", 2024-09-12T22:32:51.254 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00046095499999999998 2024-09-12T22:32:51.254 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.254 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.254 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:51.254 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410595+0000", 2024-09-12T22:32:51.254 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.9419999999999995e-06 2024-09-12T22:32:51.255 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.255 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.255 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:51.255 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411102+0000", 2024-09-12T22:32:51.255 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00050713500000000003 2024-09-12T22:32:51.255 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:51.255 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:51.255 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:51.255 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.256 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.256 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 19/17 rep_tid 8 lcod 19'4)", 2024-09-12T22:32:51.256 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.410133+0000", 2024-09-12T22:32:51.256 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 73.759974696, 2024-09-12T22:32:51.256 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0013504000000000001, 2024-09-12T22:32:51.256 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:51.256 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:51.256 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "reached pg", 2024-09-12T22:32:51.256 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:51.256 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.256 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:51.256 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410133+0000", 2024-09-12T22:32:51.257 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:51.257 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.257 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.257 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:51.257 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410133+0000", 2024-09-12T22:32:51.257 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:51.257 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.257 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.257 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:51.257 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410133+0000", 2024-09-12T22:32:51.257 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.0599999999999999e-07 2024-09-12T22:32:51.257 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.257 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.257 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:51.258 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410135+0000", 2024-09-12T22:32:51.258 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7770000000000001e-06 2024-09-12T22:32:51.258 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.258 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.258 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:51.258 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410140+0000", 2024-09-12T22:32:51.258 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9960000000000001e-06 2024-09-12T22:32:51.258 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.258 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.258 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:51.258 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410144+0000", 2024-09-12T22:32:51.258 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9500000000000003e-06 2024-09-12T22:32:51.258 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.259 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.259 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:51.259 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411310+0000", 2024-09-12T22:32:51.259 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001166311 2024-09-12T22:32:51.259 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.259 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.259 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:51.259 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411483+0000", 2024-09-12T22:32:51.259 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00017316 2024-09-12T22:32:51.259 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:51.259 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:51.259 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:51.259 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.260 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.260 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "pg_update_log_missing(3.1a epoch 19/17 rep_tid 0 entries 19'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T22:32:51.260 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.410617+0000", 2024-09-12T22:32:51.260 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 73.759490301, 2024-09-12T22:32:51.260 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0030439709999999999, 2024-09-12T22:32:51.260 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:51.260 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:51.260 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "reached pg", 2024-09-12T22:32:51.260 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:51.260 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.260 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:51.260 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410617+0000", 2024-09-12T22:32:51.260 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:51.261 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.261 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.261 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:51.261 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410617+0000", 2024-09-12T22:32:51.261 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:51.261 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.261 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.261 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:51.261 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410617+0000", 2024-09-12T22:32:51.261 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3599999999999999e-07 2024-09-12T22:32:51.261 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.261 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.261 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:51.261 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410625+0000", 2024-09-12T22:32:51.262 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5410000000000003e-06 2024-09-12T22:32:51.262 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.262 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.262 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:51.262 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410638+0000", 2024-09-12T22:32:51.262 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3261999999999999e-05 2024-09-12T22:32:51.262 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.262 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.262 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:51.262 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410653+0000", 2024-09-12T22:32:51.262 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4844000000000001e-05 2024-09-12T22:32:51.262 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.262 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.262 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:51.263 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410814+0000", 2024-09-12T22:32:51.263 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00016119999999999999 2024-09-12T22:32:51.263 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.263 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.263 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:51.263 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413661+0000", 2024-09-12T22:32:51.263 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0028467879999999998 2024-09-12T22:32:51.263 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:51.263 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:51.263 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:51.263 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.263 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.263 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-09-12T22:32:51.264 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:39.398875+0000", 2024-09-12T22:32:51.264 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 71.771232021000003, 2024-09-12T22:32:51.264 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0015679069999999999, 2024-09-12T22:32:51.264 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:51.264 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:51.264 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:51.264 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:51.264 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.264 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:51.264 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398875+0000", 2024-09-12T22:32:51.264 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:51.264 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.264 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.264 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:51.265 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398875+0000", 2024-09-12T22:32:51.265 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:51.265 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.265 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.265 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:51.265 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398878+0000", 2024-09-12T22:32:51.265 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1679999999999998e-06 2024-09-12T22:32:51.265 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.265 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.265 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:51.265 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398888+0000", 2024-09-12T22:32:51.265 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.084e-05 2024-09-12T22:32:51.265 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.266 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.266 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:51.266 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398906+0000", 2024-09-12T22:32:51.266 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7518000000000001e-05 2024-09-12T22:32:51.266 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.266 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.266 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:51.266 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398914+0000", 2024-09-12T22:32:51.266 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5989999999999996e-06 2024-09-12T22:32:51.266 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.266 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.266 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:51.266 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398974+0000", 2024-09-12T22:32:51.266 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0988e-05 2024-09-12T22:32:51.267 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.267 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.267 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:51.267 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.399078+0000", 2024-09-12T22:32:51.267 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000103133 2024-09-12T22:32:51.267 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.267 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.267 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:51.267 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.399166+0000", 2024-09-12T22:32:51.267 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.8183999999999995e-05 2024-09-12T22:32:51.267 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.267 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.267 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:51.267 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.399747+0000", 2024-09-12T22:32:51.268 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00058110599999999996 2024-09-12T22:32:51.268 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.268 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.268 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:51.268 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.400377+0000", 2024-09-12T22:32:51.268 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000630157 2024-09-12T22:32:51.268 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.268 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.268 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:51.268 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.400415+0000", 2024-09-12T22:32:51.268 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7814000000000001e-05 2024-09-12T22:32:51.268 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.268 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.269 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:51.269 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.400443+0000", 2024-09-12T22:32:51.269 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8399999999999999e-05 2024-09-12T22:32:51.269 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:51.269 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:51.269 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:51.269 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.269 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.269 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e23)", 2024-09-12T22:32:51.269 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:58.400966+0000", 2024-09-12T22:32:51.269 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 52.769141113000003, 2024-09-12T22:32:51.269 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001468876, 2024-09-12T22:32:51.269 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:51.270 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:51.270 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:51.270 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:51.270 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.270 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:51.270 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400966+0000", 2024-09-12T22:32:51.270 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:51.270 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.270 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.270 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:51.270 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400966+0000", 2024-09-12T22:32:51.270 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:51.270 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.270 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.271 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:51.271 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400967+0000", 2024-09-12T22:32:51.271 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.046e-06 2024-09-12T22:32:51.271 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.271 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.271 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:51.271 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400974+0000", 2024-09-12T22:32:51.271 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2310000000000001e-06 2024-09-12T22:32:51.271 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.271 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.271 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:51.271 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400988+0000", 2024-09-12T22:32:51.271 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4482e-05 2024-09-12T22:32:51.272 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.272 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.272 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:51.272 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400997+0000", 2024-09-12T22:32:51.272 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.0189999999999995e-06 2024-09-12T22:32:51.272 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.272 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.272 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:51.272 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.401068+0000", 2024-09-12T22:32:51.272 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1426000000000004e-05 2024-09-12T22:32:51.272 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.272 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.272 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:51.272 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.401174+0000", 2024-09-12T22:32:51.273 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000105769 2024-09-12T22:32:51.273 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.273 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.273 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:51.273 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.401335+0000", 2024-09-12T22:32:51.273 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000161225 2024-09-12T22:32:51.273 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.273 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.273 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:51.273 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.402110+0000", 2024-09-12T22:32:51.273 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00077428800000000004 2024-09-12T22:32:51.273 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.273 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.274 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:51.274 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.402333+0000", 2024-09-12T22:32:51.274 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000223723 2024-09-12T22:32:51.274 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.274 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.274 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:51.274 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.402388+0000", 2024-09-12T22:32:51.274 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4700999999999997e-05 2024-09-12T22:32:51.274 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.274 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.274 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:51.274 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.402435+0000", 2024-09-12T22:32:51.274 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6965999999999997e-05 2024-09-12T22:32:51.274 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:51.275 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:51.275 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:51.275 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.275 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.275 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:45 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e27)", 2024-09-12T22:32:51.275 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:32:04.401614+0000", 2024-09-12T22:32:51.275 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 46.768493683999999, 2024-09-12T22:32:51.275 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0014279749999999999, 2024-09-12T22:32:51.275 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:51.275 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:51.275 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:51.275 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:51.275 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.276 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:51.276 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401614+0000", 2024-09-12T22:32:51.276 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:51.276 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.276 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.276 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:51.276 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401614+0000", 2024-09-12T22:32:51.276 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:51.276 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.276 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.276 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:51.276 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401615+0000", 2024-09-12T22:32:51.276 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.161e-06 2024-09-12T22:32:51.277 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.277 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.277 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:51.277 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401621+0000", 2024-09-12T22:32:51.277 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8730000000000004e-06 2024-09-12T22:32:51.277 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.277 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.277 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:51.277 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401633+0000", 2024-09-12T22:32:51.277 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1800000000000001e-05 2024-09-12T22:32:51.277 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.277 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.277 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:51.277 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401656+0000", 2024-09-12T22:32:51.278 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.3521999999999999e-05 2024-09-12T22:32:51.278 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.278 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.278 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:51.278 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401713+0000", 2024-09-12T22:32:51.278 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7259000000000002e-05 2024-09-12T22:32:51.278 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.278 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.278 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:51.278 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401849+0000", 2024-09-12T22:32:51.278 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013613500000000001 2024-09-12T22:32:51.278 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.278 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.278 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:51.279 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.402009+0000", 2024-09-12T22:32:51.279 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00015947199999999999 2024-09-12T22:32:51.279 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.279 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.279 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:51.279 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.402629+0000", 2024-09-12T22:32:51.279 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00061962200000000001 2024-09-12T22:32:51.279 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.279 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.279 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:51.279 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.402983+0000", 2024-09-12T22:32:51.279 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00035447499999999998 2024-09-12T22:32:51.279 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.280 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.280 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:51.280 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.403016+0000", 2024-09-12T22:32:51.280 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3108999999999998e-05 2024-09-12T22:32:51.280 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:51.280 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:51.280 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:51.280 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.403042+0000", 2024-09-12T22:32:51.280 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5547000000000001e-05 2024-09-12T22:32:51.280 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:51.280 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:51.280 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:51.280 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:51.280 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:51.281 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:32:51.282 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:32:51.283 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:51.281+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:51.382 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~6s 2024-09-12T22:32:51.383 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:51.382+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:51.387 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-09-12T22:32:51.388 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-09-12T22:32:51.388 INFO:teuthology.orchestra.run.smithi163.stdout: "num_ops": 0 2024-09-12T22:32:51.388 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-09-12T22:32:51.396 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:32:51.484 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:51.483+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:51.539 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-09-12T22:32:51.539 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-09-12T22:32:51.540 INFO:teuthology.orchestra.run.smithi163.stdout: "complaint_time": 30, 2024-09-12T22:32:51.540 INFO:teuthology.orchestra.run.smithi163.stdout: "num_blocked_ops": 0 2024-09-12T22:32:51.540 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-09-12T22:32:51.548 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:32:51.591 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:51.590+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:51.653 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-09-12T22:32:51.653 INFO:teuthology.orchestra.run.smithi163.stdout: "size": 20, 2024-09-12T22:32:51.653 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 600, 2024-09-12T22:32:51.654 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2024-09-12T22:32:51.654 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.654 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-09-12T22:32:51.654 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:27.254459+0000", 2024-09-12T22:32:51.654 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 84.396582495000004, 2024-09-12T22:32:51.654 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.37816283899999997, 2024-09-12T22:32:51.654 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:51.654 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:51.654 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:51.654 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:51.654 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:51.654 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:51.654 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 1 2024-09-12T22:32:51.655 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.655 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:51.655 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.655 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:51.655 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254459+0000", 2024-09-12T22:32:51.655 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:51.655 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.655 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.655 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:51.655 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254459+0000", 2024-09-12T22:32:51.655 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:51.655 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.655 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.655 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:51.656 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254460+0000", 2024-09-12T22:32:51.656 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1739999999999999e-06 2024-09-12T22:32:51.656 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.656 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.656 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:51.656 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254472+0000", 2024-09-12T22:32:51.656 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2207e-05 2024-09-12T22:32:51.656 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.656 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.656 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:51.656 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254483+0000", 2024-09-12T22:32:51.657 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0631999999999999e-05 2024-09-12T22:32:51.657 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.657 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.657 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:51.657 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254492+0000", 2024-09-12T22:32:51.657 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3670000000000003e-06 2024-09-12T22:32:51.657 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.657 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.657 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:51.657 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254551+0000", 2024-09-12T22:32:51.658 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8687999999999998e-05 2024-09-12T22:32:51.658 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.658 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.658 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for peered", 2024-09-12T22:32:51.658 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254562+0000", 2024-09-12T22:32:51.658 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1249e-05 2024-09-12T22:32:51.658 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.658 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.658 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:51.658 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.631211+0000", 2024-09-12T22:32:51.658 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.376649018 2024-09-12T22:32:51.658 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.658 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.659 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:51.659 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.631345+0000", 2024-09-12T22:32:51.659 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013378700000000001 2024-09-12T22:32:51.659 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.659 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.659 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:51.659 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.631479+0000", 2024-09-12T22:32:51.659 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013352399999999999 2024-09-12T22:32:51.659 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.659 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.659 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:51.659 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632324+0000", 2024-09-12T22:32:51.659 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00084508100000000002 2024-09-12T22:32:51.660 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.660 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.660 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:51.660 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632548+0000", 2024-09-12T22:32:51.660 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000224329 2024-09-12T22:32:51.660 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.660 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.660 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:51.660 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632591+0000", 2024-09-12T22:32:51.660 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2564000000000001e-05 2024-09-12T22:32:51.660 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.660 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.660 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:51.661 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632622+0000", 2024-09-12T22:32:51.661 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1219e-05 2024-09-12T22:32:51.661 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:51.661 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:51.661 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:51.661 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.661 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.661 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:185 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:32:51.661 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394355+0000", 2024-09-12T22:32:51.661 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 83.256686397999999, 2024-09-12T22:32:51.661 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011302394, 2024-09-12T22:32:51.661 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:51.661 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:51.662 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:51.662 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:51.662 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:51.662 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:51.662 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 185 2024-09-12T22:32:51.662 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.662 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:51.662 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.662 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:51.662 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394355+0000", 2024-09-12T22:32:51.662 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:51.662 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.662 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.663 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:51.663 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394355+0000", 2024-09-12T22:32:51.663 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:51.663 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.663 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.663 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:51.663 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394355+0000", 2024-09-12T22:32:51.663 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9099999999999999e-07 2024-09-12T22:32:51.663 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.663 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.663 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:51.663 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394385+0000", 2024-09-12T22:32:51.663 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9963000000000001e-05 2024-09-12T22:32:51.663 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.664 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.664 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:51.664 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394390+0000", 2024-09-12T22:32:51.664 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8420000000000004e-06 2024-09-12T22:32:51.664 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.664 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.664 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:51.664 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394393+0000", 2024-09-12T22:32:51.664 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1e-06 2024-09-12T22:32:51.664 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.664 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.664 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:51.664 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.400546+0000", 2024-09-12T22:32:51.665 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0061523309999999996 2024-09-12T22:32:51.665 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.665 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.665 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:51.665 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.400588+0000", 2024-09-12T22:32:51.665 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1835000000000002e-05 2024-09-12T22:32:51.665 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.665 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.665 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:51.665 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.400677+0000", 2024-09-12T22:32:51.665 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9195000000000002e-05 2024-09-12T22:32:51.665 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.665 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.665 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:51.666 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405378+0000", 2024-09-12T22:32:51.666 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0047008659999999997 2024-09-12T22:32:51.666 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.666 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.666 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:51.666 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405569+0000", 2024-09-12T22:32:51.666 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00019148599999999999 2024-09-12T22:32:51.666 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.666 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.666 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:51.666 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405620+0000", 2024-09-12T22:32:51.666 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1416999999999999e-05 2024-09-12T22:32:51.666 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.667 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.667 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:51.667 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405657+0000", 2024-09-12T22:32:51.667 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6968000000000002e-05 2024-09-12T22:32:51.667 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:51.667 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:51.667 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:51.667 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.667 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.667 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:32:51.667 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394399+0000", 2024-09-12T22:32:51.667 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 83.256642186999997, 2024-09-12T22:32:51.667 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011336601999999999, 2024-09-12T22:32:51.667 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:51.668 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:51.668 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:51.668 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:51.668 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:51.668 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:51.668 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 186 2024-09-12T22:32:51.668 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.668 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:51.668 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.668 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:51.668 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394399+0000", 2024-09-12T22:32:51.668 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:51.669 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.669 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.669 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:51.669 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394399+0000", 2024-09-12T22:32:51.669 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:51.669 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.669 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.669 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:51.669 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394400+0000", 2024-09-12T22:32:51.669 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4499999999999998e-07 2024-09-12T22:32:51.669 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.669 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.669 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:51.669 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394402+0000", 2024-09-12T22:32:51.670 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.875e-06 2024-09-12T22:32:51.670 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.670 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.670 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:51.670 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394405+0000", 2024-09-12T22:32:51.670 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6799999999999999e-06 2024-09-12T22:32:51.670 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.670 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.670 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:51.670 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394408+0000", 2024-09-12T22:32:51.670 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.667e-06 2024-09-12T22:32:51.670 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.670 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.671 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:51.671 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401395+0000", 2024-09-12T22:32:51.671 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0069867230000000002 2024-09-12T22:32:51.671 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.671 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.671 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:51.671 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401438+0000", 2024-09-12T22:32:51.671 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3554999999999999e-05 2024-09-12T22:32:51.671 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.671 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.671 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:51.671 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401509+0000", 2024-09-12T22:32:51.671 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0631999999999997e-05 2024-09-12T22:32:51.671 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.672 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.672 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:51.672 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405392+0000", 2024-09-12T22:32:51.672 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0038830449999999999 2024-09-12T22:32:51.672 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.672 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.672 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:51.672 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405690+0000", 2024-09-12T22:32:51.672 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000298435 2024-09-12T22:32:51.672 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.672 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.672 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:51.672 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405716+0000", 2024-09-12T22:32:51.673 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5435999999999998e-05 2024-09-12T22:32:51.673 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.673 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.673 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:51.673 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405736+0000", 2024-09-12T22:32:51.673 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0208999999999999e-05 2024-09-12T22:32:51.673 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:51.673 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:51.673 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:51.673 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.673 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.673 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:32:51.673 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394411+0000", 2024-09-12T22:32:51.674 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 83.256630060999996, 2024-09-12T22:32:51.674 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011400117, 2024-09-12T22:32:51.674 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:51.674 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:51.674 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:51.674 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:51.674 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:51.674 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:51.674 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 187 2024-09-12T22:32:51.674 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.674 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:51.674 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.675 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:51.675 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394411+0000", 2024-09-12T22:32:51.675 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:51.675 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.675 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.675 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:51.675 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394411+0000", 2024-09-12T22:32:51.675 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:51.675 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.675 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.675 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:51.675 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394412+0000", 2024-09-12T22:32:51.675 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.4999999999999999e-07 2024-09-12T22:32:51.675 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.676 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.676 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:51.676 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394414+0000", 2024-09-12T22:32:51.676 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.984e-06 2024-09-12T22:32:51.676 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.676 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.676 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:51.676 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394418+0000", 2024-09-12T22:32:51.676 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0840000000000002e-06 2024-09-12T22:32:51.676 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.676 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.676 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:51.676 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394431+0000", 2024-09-12T22:32:51.677 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.361e-05 2024-09-12T22:32:51.677 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.677 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.677 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:51.677 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401778+0000", 2024-09-12T22:32:51.677 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0073462659999999997 2024-09-12T22:32:51.677 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.677 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.677 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:51.677 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401853+0000", 2024-09-12T22:32:51.677 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5797000000000006e-05 2024-09-12T22:32:51.677 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.677 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.678 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:51.678 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401990+0000", 2024-09-12T22:32:51.678 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013651399999999999 2024-09-12T22:32:51.678 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.678 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.678 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:51.678 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405402+0000", 2024-09-12T22:32:51.678 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0034116070000000001 2024-09-12T22:32:51.678 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.678 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.678 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:51.678 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405764+0000", 2024-09-12T22:32:51.678 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00036234899999999998 2024-09-12T22:32:51.679 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.679 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.679 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:51.679 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405791+0000", 2024-09-12T22:32:51.679 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7029000000000002e-05 2024-09-12T22:32:51.679 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.679 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.679 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:51.679 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405812+0000", 2024-09-12T22:32:51.679 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0627000000000001e-05 2024-09-12T22:32:51.679 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:51.679 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:51.679 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:51.679 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.680 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.680 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:32:51.680 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394447+0000", 2024-09-12T22:32:51.680 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 83.256594910000004, 2024-09-12T22:32:51.680 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011759588, 2024-09-12T22:32:51.680 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:51.680 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:51.680 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:51.680 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:51.680 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:51.680 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:51.680 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 188 2024-09-12T22:32:51.680 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.681 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:51.681 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.681 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:51.681 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394447+0000", 2024-09-12T22:32:51.681 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:51.681 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.681 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.681 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:51.681 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394447+0000", 2024-09-12T22:32:51.681 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:51.681 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.681 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.681 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:51.681 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394447+0000", 2024-09-12T22:32:51.682 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.15e-07 2024-09-12T22:32:51.682 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.682 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.682 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:51.682 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394512+0000", 2024-09-12T22:32:51.682 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4580999999999997e-05 2024-09-12T22:32:51.682 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.682 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.682 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:51.682 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394518+0000", 2024-09-12T22:32:51.682 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.3380000000000001e-06 2024-09-12T22:32:51.682 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.682 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.683 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:51.683 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394521+0000", 2024-09-12T22:32:51.683 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3340000000000002e-06 2024-09-12T22:32:51.683 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.683 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.683 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:51.683 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.402628+0000", 2024-09-12T22:32:51.683 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.008106996 2024-09-12T22:32:51.683 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.683 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.683 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:51.683 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.402670+0000", 2024-09-12T22:32:51.683 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1983000000000001e-05 2024-09-12T22:32:51.683 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.684 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.684 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:51.684 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.402738+0000", 2024-09-12T22:32:51.684 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.8114999999999994e-05 2024-09-12T22:32:51.684 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.684 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.684 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:51.684 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405668+0000", 2024-09-12T22:32:51.684 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.002929545 2024-09-12T22:32:51.684 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.684 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.684 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:51.684 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406162+0000", 2024-09-12T22:32:51.685 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000494408 2024-09-12T22:32:51.685 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.685 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.685 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:51.685 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406188+0000", 2024-09-12T22:32:51.685 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5766e-05 2024-09-12T22:32:51.685 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.685 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.685 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:51.685 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406206+0000", 2024-09-12T22:32:51.685 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.8107000000000001e-05 2024-09-12T22:32:51.685 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:51.685 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:51.686 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:51.686 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.686 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.686 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:32:51.686 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394528+0000", 2024-09-12T22:32:51.686 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 83.256513240999993, 2024-09-12T22:32:51.686 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.01195536, 2024-09-12T22:32:51.686 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:51.686 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:51.686 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:51.686 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:51.686 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:51.686 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:51.687 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 189 2024-09-12T22:32:51.687 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.687 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:51.687 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.687 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:51.687 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394528+0000", 2024-09-12T22:32:51.687 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:51.687 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.687 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.687 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:51.687 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394528+0000", 2024-09-12T22:32:51.687 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:51.687 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.688 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.688 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:51.688 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394529+0000", 2024-09-12T22:32:51.688 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4900000000000001e-07 2024-09-12T22:32:51.688 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.688 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.688 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:51.688 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394531+0000", 2024-09-12T22:32:51.688 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.458e-06 2024-09-12T22:32:51.688 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.688 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.688 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:51.688 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394535+0000", 2024-09-12T22:32:51.688 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7900000000000001e-06 2024-09-12T22:32:51.689 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.689 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.689 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:51.689 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394537+0000", 2024-09-12T22:32:51.689 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.632e-06 2024-09-12T22:32:51.689 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.689 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.689 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:51.689 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.404932+0000", 2024-09-12T22:32:51.689 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010394158000000001 2024-09-12T22:32:51.689 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.689 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.689 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:51.690 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405017+0000", 2024-09-12T22:32:51.690 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5525000000000005e-05 2024-09-12T22:32:51.690 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.690 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.690 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:51.690 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405114+0000", 2024-09-12T22:32:51.690 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.6527000000000006e-05 2024-09-12T22:32:51.690 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.690 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.690 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:51.690 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405818+0000", 2024-09-12T22:32:51.690 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00070412800000000005 2024-09-12T22:32:51.690 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.691 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.691 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:51.691 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406437+0000", 2024-09-12T22:32:51.691 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00061898900000000002 2024-09-12T22:32:51.691 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.691 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.691 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:51.691 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406463+0000", 2024-09-12T22:32:51.691 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6268e-05 2024-09-12T22:32:51.691 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.691 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.691 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:51.691 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406484+0000", 2024-09-12T22:32:51.692 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0536000000000001e-05 2024-09-12T22:32:51.692 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:51.692 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:51.692 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:51.692 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.692 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.692 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:51.692 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.401422+0000", 2024-09-12T22:32:51.692 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 74.249619335999995, 2024-09-12T22:32:51.692 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016896452999999999, 2024-09-12T22:32:51.692 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:51.692 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:51.692 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:51.693 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:51.693 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.693 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:51.693 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401422+0000", 2024-09-12T22:32:51.693 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:51.693 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.693 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.693 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:51.693 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401422+0000", 2024-09-12T22:32:51.693 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:51.693 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.693 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.693 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:51.694 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401424+0000", 2024-09-12T22:32:51.694 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9e-06 2024-09-12T22:32:51.694 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.694 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.694 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:51.694 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401437+0000", 2024-09-12T22:32:51.694 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2831e-05 2024-09-12T22:32:51.694 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.694 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.694 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:51.694 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401471+0000", 2024-09-12T22:32:51.694 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4010000000000001e-05 2024-09-12T22:32:51.694 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.694 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.695 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:51.695 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401484+0000", 2024-09-12T22:32:51.695 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2711000000000001e-05 2024-09-12T22:32:51.695 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.695 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.695 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:51.695 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405410+0000", 2024-09-12T22:32:51.695 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0039259170000000001 2024-09-12T22:32:51.695 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.695 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.695 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:51.695 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405529+0000", 2024-09-12T22:32:51.695 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000119778 2024-09-12T22:32:51.696 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.696 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.696 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:51.696 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405655+0000", 2024-09-12T22:32:51.696 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012556700000000001 2024-09-12T22:32:51.696 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.696 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.696 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:51.696 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410456+0000", 2024-09-12T22:32:51.696 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0048008269999999997 2024-09-12T22:32:51.696 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.696 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.696 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:51.696 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418226+0000", 2024-09-12T22:32:51.697 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0077707729999999999 2024-09-12T22:32:51.697 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.697 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.697 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:51.697 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418277+0000", 2024-09-12T22:32:51.697 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0476000000000003e-05 2024-09-12T22:32:51.697 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.697 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.697 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:51.697 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418319+0000", 2024-09-12T22:32:51.697 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1662999999999997e-05 2024-09-12T22:32:51.697 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:51.697 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:51.698 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:51.698 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.698 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.698 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:51.698 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.401505+0000", 2024-09-12T22:32:51.698 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 74.249536672000005, 2024-09-12T22:32:51.698 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016987904000000002, 2024-09-12T22:32:51.698 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:51.698 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:51.698 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:51.698 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:51.698 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.698 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:51.699 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401505+0000", 2024-09-12T22:32:51.699 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:51.699 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.699 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.699 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:51.699 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401505+0000", 2024-09-12T22:32:51.699 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:51.699 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.699 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.699 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:51.699 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401506+0000", 2024-09-12T22:32:51.699 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4700000000000001e-07 2024-09-12T22:32:51.700 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.700 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.700 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:51.700 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401510+0000", 2024-09-12T22:32:51.700 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6609999999999999e-06 2024-09-12T22:32:51.700 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.700 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.700 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:51.700 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401771+0000", 2024-09-12T22:32:51.700 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00026110700000000001 2024-09-12T22:32:51.700 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.700 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.700 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:51.701 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401921+0000", 2024-09-12T22:32:51.701 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014939099999999999 2024-09-12T22:32:51.701 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.701 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.701 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:51.701 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405944+0000", 2024-09-12T22:32:51.701 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0040235449999999999 2024-09-12T22:32:51.701 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.701 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.701 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:51.701 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406018+0000", 2024-09-12T22:32:51.701 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3373000000000004e-05 2024-09-12T22:32:51.701 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.702 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.702 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:51.702 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406172+0000", 2024-09-12T22:32:51.702 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00015435399999999999 2024-09-12T22:32:51.702 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.702 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.702 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:51.702 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410461+0000", 2024-09-12T22:32:51.702 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0042888609999999997 2024-09-12T22:32:51.702 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.702 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.702 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:51.703 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418371+0000", 2024-09-12T22:32:51.703 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0079098380000000006 2024-09-12T22:32:51.703 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.703 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.703 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:51.703 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418443+0000", 2024-09-12T22:32:51.703 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2705000000000003e-05 2024-09-12T22:32:51.703 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.703 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.703 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:51.703 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418493+0000", 2024-09-12T22:32:51.703 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9322e-05 2024-09-12T22:32:51.703 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:51.704 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:51.704 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:51.704 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.704 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.704 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:51.704 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.401939+0000", 2024-09-12T22:32:51.704 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 74.249102936, 2024-09-12T22:32:51.704 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016722292999999999, 2024-09-12T22:32:51.704 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:51.704 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:51.704 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:51.704 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:51.704 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.705 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:51.705 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401939+0000", 2024-09-12T22:32:51.705 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:51.705 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.705 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.705 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:51.705 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401939+0000", 2024-09-12T22:32:51.705 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:51.705 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.705 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.705 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:51.705 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401940+0000", 2024-09-12T22:32:51.705 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1990000000000001e-06 2024-09-12T22:32:51.706 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.706 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.706 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:51.706 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401956+0000", 2024-09-12T22:32:51.706 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.6344000000000001e-05 2024-09-12T22:32:51.706 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.706 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.706 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:51.706 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401974+0000", 2024-09-12T22:32:51.706 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7730000000000001e-05 2024-09-12T22:32:51.706 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.706 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.706 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:51.707 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401982+0000", 2024-09-12T22:32:51.707 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.7800000000000001e-06 2024-09-12T22:32:51.707 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.707 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.707 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:51.707 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406557+0000", 2024-09-12T22:32:51.707 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0045758489999999999 2024-09-12T22:32:51.707 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.707 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.707 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:51.707 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406697+0000", 2024-09-12T22:32:51.707 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013925100000000001 2024-09-12T22:32:51.707 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.707 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.708 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:51.708 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406830+0000", 2024-09-12T22:32:51.708 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013293499999999999 2024-09-12T22:32:51.708 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.708 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.708 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:51.708 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410465+0000", 2024-09-12T22:32:51.708 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0036352680000000001 2024-09-12T22:32:51.708 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.708 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.708 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:51.708 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418564+0000", 2024-09-12T22:32:51.708 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0080992140000000004 2024-09-12T22:32:51.709 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.709 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.709 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:51.709 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418621+0000", 2024-09-12T22:32:51.709 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7167999999999999e-05 2024-09-12T22:32:51.709 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.709 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.709 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:51.709 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418661+0000", 2024-09-12T22:32:51.709 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9555000000000003e-05 2024-09-12T22:32:51.709 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:51.709 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:51.709 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:51.709 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.710 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.710 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:51.710 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.401994+0000", 2024-09-12T22:32:51.710 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 74.249047063999996, 2024-09-12T22:32:51.710 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016804109000000001, 2024-09-12T22:32:51.710 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:51.710 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:51.710 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:51.710 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:51.710 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.710 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:51.710 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401994+0000", 2024-09-12T22:32:51.710 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:51.711 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.711 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.711 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:51.711 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401994+0000", 2024-09-12T22:32:51.711 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:51.711 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.711 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.711 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:51.711 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401995+0000", 2024-09-12T22:32:51.711 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.8899999999999998e-07 2024-09-12T22:32:51.711 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.711 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.711 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:51.712 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402000+0000", 2024-09-12T22:32:51.712 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.498e-06 2024-09-12T22:32:51.712 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.712 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.712 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:51.712 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402007+0000", 2024-09-12T22:32:51.712 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.554e-06 2024-09-12T22:32:51.712 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.712 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.712 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:51.712 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402046+0000", 2024-09-12T22:32:51.712 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9156000000000003e-05 2024-09-12T22:32:51.712 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.713 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.713 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:51.713 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407342+0000", 2024-09-12T22:32:51.713 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052957610000000004 2024-09-12T22:32:51.713 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.713 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.713 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:51.713 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407521+0000", 2024-09-12T22:32:51.713 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00017878100000000001 2024-09-12T22:32:51.713 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.713 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.713 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:51.713 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407641+0000", 2024-09-12T22:32:51.714 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012013 2024-09-12T22:32:51.714 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.714 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.714 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:51.714 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410472+0000", 2024-09-12T22:32:51.714 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.002830455 2024-09-12T22:32:51.714 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.714 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.714 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:51.714 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418714+0000", 2024-09-12T22:32:51.716 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0082422789999999999 2024-09-12T22:32:51.716 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.716 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.716 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:51.716 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418761+0000", 2024-09-12T22:32:51.716 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6956999999999998e-05 2024-09-12T22:32:51.716 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.716 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.716 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:51.716 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418799+0000", 2024-09-12T22:32:51.716 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7749000000000001e-05 2024-09-12T22:32:51.716 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:51.717 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:51.717 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:51.717 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.717 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.717 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:51.717 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.402060+0000", 2024-09-12T22:32:51.717 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 74.248981619999995, 2024-09-12T22:32:51.717 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016885686, 2024-09-12T22:32:51.717 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:51.717 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:51.717 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:51.717 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:51.717 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.718 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:51.718 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402060+0000", 2024-09-12T22:32:51.718 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:51.718 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.718 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.718 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:51.718 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402060+0000", 2024-09-12T22:32:51.718 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:51.718 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.718 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.718 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:51.718 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402061+0000", 2024-09-12T22:32:51.718 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4399999999999999e-07 2024-09-12T22:32:51.719 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.719 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.719 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:51.719 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402066+0000", 2024-09-12T22:32:51.719 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8649999999999998e-06 2024-09-12T22:32:51.719 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.719 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.719 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:51.719 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402146+0000", 2024-09-12T22:32:51.719 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9054000000000006e-05 2024-09-12T22:32:51.719 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.719 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.719 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:51.720 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402287+0000", 2024-09-12T22:32:51.720 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014108600000000001 2024-09-12T22:32:51.720 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.720 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.720 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:51.720 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408185+0000", 2024-09-12T22:32:51.720 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0058983919999999997 2024-09-12T22:32:51.720 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.720 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.720 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:51.720 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408299+0000", 2024-09-12T22:32:51.720 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114102 2024-09-12T22:32:51.721 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.721 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.721 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:51.721 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408420+0000", 2024-09-12T22:32:51.721 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000120492 2024-09-12T22:32:51.721 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.721 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.721 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:51.721 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410867+0000", 2024-09-12T22:32:51.721 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0024476430000000002 2024-09-12T22:32:51.721 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.721 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.721 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:51.721 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418851+0000", 2024-09-12T22:32:51.722 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0079841489999999994 2024-09-12T22:32:51.722 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.722 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.722 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:51.722 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418894+0000", 2024-09-12T22:32:51.722 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3090000000000002e-05 2024-09-12T22:32:51.722 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.722 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.722 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:51.722 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418946+0000", 2024-09-12T22:32:51.722 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1069000000000002e-05 2024-09-12T22:32:51.722 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:51.722 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:51.723 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:51.723 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.723 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.723 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:51.723 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.402375+0000", 2024-09-12T22:32:51.723 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 74.248666555, 2024-09-12T22:32:51.723 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016768531999999999, 2024-09-12T22:32:51.723 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:51.723 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:51.723 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:51.723 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:51.723 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.723 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:51.724 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402375+0000", 2024-09-12T22:32:51.724 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:51.724 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.724 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.724 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:51.724 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402375+0000", 2024-09-12T22:32:51.724 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:51.724 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.724 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.724 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:51.724 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402375+0000", 2024-09-12T22:32:51.724 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4099999999999999e-07 2024-09-12T22:32:51.724 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.725 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.725 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:51.725 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402379+0000", 2024-09-12T22:32:51.725 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9870000000000001e-06 2024-09-12T22:32:51.725 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.725 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.725 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:51.725 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402389+0000", 2024-09-12T22:32:51.725 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0000000000000001e-05 2024-09-12T22:32:51.725 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.725 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.725 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:51.726 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402401+0000", 2024-09-12T22:32:51.726 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.148e-05 2024-09-12T22:32:51.726 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.726 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.726 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:51.726 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409108+0000", 2024-09-12T22:32:51.726 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0067068429999999997 2024-09-12T22:32:51.726 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.726 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.726 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:51.726 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409189+0000", 2024-09-12T22:32:51.726 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0815999999999993e-05 2024-09-12T22:32:51.726 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.727 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.727 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:51.727 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409320+0000", 2024-09-12T22:32:51.727 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000131586 2024-09-12T22:32:51.727 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.727 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.727 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:51.727 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410872+0000", 2024-09-12T22:32:51.727 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0015521599999999999 2024-09-12T22:32:51.727 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.727 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.727 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:51.728 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419049+0000", 2024-09-12T22:32:51.728 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0081763719999999995 2024-09-12T22:32:51.728 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.728 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.728 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:51.728 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419107+0000", 2024-09-12T22:32:51.728 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7899000000000002e-05 2024-09-12T22:32:51.728 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.728 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.728 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:51.728 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419143+0000", 2024-09-12T22:32:51.728 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6847999999999997e-05 2024-09-12T22:32:51.728 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:51.729 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:51.729 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:51.729 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.729 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.729 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:51.729 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.402903+0000", 2024-09-12T22:32:51.729 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 74.248138143000006, 2024-09-12T22:32:51.729 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016378428, 2024-09-12T22:32:51.729 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:51.729 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:51.729 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:51.729 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:51.730 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.730 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:51.730 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402903+0000", 2024-09-12T22:32:51.730 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:51.730 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.730 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.730 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:51.730 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402903+0000", 2024-09-12T22:32:51.730 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:51.730 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.730 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.730 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:51.730 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402904+0000", 2024-09-12T22:32:51.730 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9500000000000001e-07 2024-09-12T22:32:51.731 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.731 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.731 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:51.731 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402944+0000", 2024-09-12T22:32:51.731 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0265000000000002e-05 2024-09-12T22:32:51.731 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.731 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.731 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:51.731 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402979+0000", 2024-09-12T22:32:51.731 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4378000000000002e-05 2024-09-12T22:32:51.731 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.731 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.731 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:51.732 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402987+0000", 2024-09-12T22:32:51.732 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3559999999999993e-06 2024-09-12T22:32:51.732 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.732 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.732 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:51.732 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409577+0000", 2024-09-12T22:32:51.732 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0065901709999999997 2024-09-12T22:32:51.732 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.732 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.732 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:51.732 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409653+0000", 2024-09-12T22:32:51.732 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5819e-05 2024-09-12T22:32:51.732 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.733 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.733 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:51.733 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409725+0000", 2024-09-12T22:32:51.733 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2200000000000007e-05 2024-09-12T22:32:51.733 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.733 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.733 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:51.733 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.411234+0000", 2024-09-12T22:32:51.733 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001508225 2024-09-12T22:32:51.733 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.733 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.733 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:51.733 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419212+0000", 2024-09-12T22:32:51.733 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0079783400000000004 2024-09-12T22:32:51.734 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.734 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.734 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:51.734 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419244+0000", 2024-09-12T22:32:51.734 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2384e-05 2024-09-12T22:32:51.734 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.734 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.734 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:51.734 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419282+0000", 2024-09-12T22:32:51.734 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7394999999999997e-05 2024-09-12T22:32:51.734 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:51.734 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:51.734 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:51.735 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.735 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.735 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:51.735 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.403135+0000", 2024-09-12T22:32:51.735 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 74.247906272999998, 2024-09-12T22:32:51.735 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016294211999999999, 2024-09-12T22:32:51.735 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:51.735 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:51.735 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:51.735 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:51.735 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.735 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:51.735 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403135+0000", 2024-09-12T22:32:51.736 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:51.736 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.736 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.736 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:51.736 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403135+0000", 2024-09-12T22:32:51.736 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:51.736 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.736 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.736 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:51.736 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403136+0000", 2024-09-12T22:32:51.736 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.4e-07 2024-09-12T22:32:51.736 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.737 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.737 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:51.737 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403149+0000", 2024-09-12T22:32:51.737 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2723e-05 2024-09-12T22:32:51.737 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.737 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.737 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:51.737 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403158+0000", 2024-09-12T22:32:51.737 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3919999999999992e-06 2024-09-12T22:32:51.737 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.737 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.737 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:51.737 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403166+0000", 2024-09-12T22:32:51.738 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.2309999999999996e-06 2024-09-12T22:32:51.738 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.738 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.738 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:51.738 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409944+0000", 2024-09-12T22:32:51.738 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0067775309999999998 2024-09-12T22:32:51.738 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.738 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.738 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:51.738 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410032+0000", 2024-09-12T22:32:51.738 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.7906999999999997e-05 2024-09-12T22:32:51.738 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.738 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.739 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:51.739 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410152+0000", 2024-09-12T22:32:51.739 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012037800000000001 2024-09-12T22:32:51.739 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.739 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.739 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:51.739 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.411945+0000", 2024-09-12T22:32:51.739 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0017931850000000001 2024-09-12T22:32:51.739 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.739 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.739 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:51.739 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419319+0000", 2024-09-12T22:32:51.739 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0073731780000000002 2024-09-12T22:32:51.739 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.740 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.740 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:51.740 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419376+0000", 2024-09-12T22:32:51.740 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7728e-05 2024-09-12T22:32:51.740 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.740 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.740 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:51.740 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419429+0000", 2024-09-12T22:32:51.740 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3019000000000002e-05 2024-09-12T22:32:51.740 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:51.740 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:51.741 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:51.741 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.741 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.741 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:51.741 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.403185+0000", 2024-09-12T22:32:51.741 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 74.247856392000003, 2024-09-12T22:32:51.741 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.014902164000000001, 2024-09-12T22:32:51.741 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:51.741 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:51.741 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:51.741 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:51.741 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.741 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:51.742 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403185+0000", 2024-09-12T22:32:51.742 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:51.742 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.742 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.742 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:51.742 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403185+0000", 2024-09-12T22:32:51.742 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:51.742 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.742 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.742 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:51.742 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403186+0000", 2024-09-12T22:32:51.742 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9400000000000005e-07 2024-09-12T22:32:51.742 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.743 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.743 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:51.743 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403191+0000", 2024-09-12T22:32:51.743 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6980000000000003e-06 2024-09-12T22:32:51.743 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.743 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.743 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:51.743 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403199+0000", 2024-09-12T22:32:51.743 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2520000000000002e-06 2024-09-12T22:32:51.743 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.743 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.743 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:51.744 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403205+0000", 2024-09-12T22:32:51.744 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.908e-06 2024-09-12T22:32:51.744 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.744 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.744 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:51.744 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403359+0000", 2024-09-12T22:32:51.744 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000154544 2024-09-12T22:32:51.744 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.744 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.744 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:51.744 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403528+0000", 2024-09-12T22:32:51.744 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000168455 2024-09-12T22:32:51.744 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.745 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.745 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:51.745 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403763+0000", 2024-09-12T22:32:51.745 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00023539599999999999 2024-09-12T22:32:51.745 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.745 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.745 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:51.745 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409378+0000", 2024-09-12T22:32:51.745 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056150000000000002 2024-09-12T22:32:51.745 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.745 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.745 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:51.746 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418012+0000", 2024-09-12T22:32:51.746 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0086339559999999999 2024-09-12T22:32:51.746 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.746 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.746 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:51.746 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418046+0000", 2024-09-12T22:32:51.746 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4267999999999998e-05 2024-09-12T22:32:51.746 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.746 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.746 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:51.746 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418087+0000", 2024-09-12T22:32:51.746 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0992999999999999e-05 2024-09-12T22:32:51.746 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:51.747 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:51.747 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:51.747 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.747 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.747 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:51.747 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.403273+0000", 2024-09-12T22:32:51.747 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 74.247768441000005, 2024-09-12T22:32:51.747 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.014934866, 2024-09-12T22:32:51.747 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:51.747 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:51.747 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:51.747 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:51.747 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.748 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:51.748 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403273+0000", 2024-09-12T22:32:51.748 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:51.748 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.748 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.748 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:51.748 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403273+0000", 2024-09-12T22:32:51.748 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:51.748 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.748 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.748 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:51.748 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403274+0000", 2024-09-12T22:32:51.748 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.297e-06 2024-09-12T22:32:51.749 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.749 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.749 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:51.749 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403282+0000", 2024-09-12T22:32:51.749 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6340000000000001e-06 2024-09-12T22:32:51.749 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.749 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.749 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:51.749 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403305+0000", 2024-09-12T22:32:51.749 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3149000000000001e-05 2024-09-12T22:32:51.749 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.749 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.749 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:51.750 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403320+0000", 2024-09-12T22:32:51.750 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4527e-05 2024-09-12T22:32:51.750 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.750 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.750 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:51.750 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.404928+0000", 2024-09-12T22:32:51.750 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001608459 2024-09-12T22:32:51.750 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.750 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.750 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:51.750 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405218+0000", 2024-09-12T22:32:51.750 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00028982900000000002 2024-09-12T22:32:51.750 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.750 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.751 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:51.751 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405829+0000", 2024-09-12T22:32:51.751 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00061127900000000005 2024-09-12T22:32:51.751 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.751 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.751 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:51.751 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409403+0000", 2024-09-12T22:32:51.751 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.003573597 2024-09-12T22:32:51.751 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.751 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.751 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:51.751 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418138+0000", 2024-09-12T22:32:51.751 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0087349969999999996 2024-09-12T22:32:51.752 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.752 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.752 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:51.752 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418178+0000", 2024-09-12T22:32:51.752 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0649999999999999e-05 2024-09-12T22:32:51.752 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.752 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.752 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:51.752 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418208+0000", 2024-09-12T22:32:51.752 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9448e-05 2024-09-12T22:32:51.752 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:51.752 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:51.752 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:51.752 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.753 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.753 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:51.753 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.405456+0000", 2024-09-12T22:32:51.753 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 74.245585296000002, 2024-09-12T22:32:51.753 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012888389, 2024-09-12T22:32:51.753 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:51.753 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:51.753 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:51.753 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:51.753 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.753 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:51.753 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405456+0000", 2024-09-12T22:32:51.754 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:51.754 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.754 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.754 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:51.754 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405456+0000", 2024-09-12T22:32:51.754 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:51.754 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.754 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.754 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:51.754 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405457+0000", 2024-09-12T22:32:51.754 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.6599999999999994e-07 2024-09-12T22:32:51.754 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.754 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.755 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:51.755 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405463+0000", 2024-09-12T22:32:51.755 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4739999999999996e-06 2024-09-12T22:32:51.755 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.755 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.755 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:51.755 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405474+0000", 2024-09-12T22:32:51.755 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1095e-05 2024-09-12T22:32:51.755 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.755 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.755 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:51.755 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405482+0000", 2024-09-12T22:32:51.755 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3610000000000001e-06 2024-09-12T22:32:51.755 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.756 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.756 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:51.756 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407051+0000", 2024-09-12T22:32:51.756 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0015688970000000001 2024-09-12T22:32:51.756 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.756 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.756 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:51.756 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407259+0000", 2024-09-12T22:32:51.756 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00020778300000000001 2024-09-12T22:32:51.756 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.756 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.756 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:51.756 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407622+0000", 2024-09-12T22:32:51.757 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000363066 2024-09-12T22:32:51.757 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.757 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.757 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:51.757 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409438+0000", 2024-09-12T22:32:51.757 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001816319 2024-09-12T22:32:51.757 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.757 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.757 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:51.758 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418257+0000", 2024-09-12T22:32:51.758 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0088187720000000008 2024-09-12T22:32:51.758 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.758 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.758 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:51.758 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418308+0000", 2024-09-12T22:32:51.758 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1180000000000001e-05 2024-09-12T22:32:51.758 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.758 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.758 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:51.758 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418345+0000", 2024-09-12T22:32:51.758 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6476000000000001e-05 2024-09-12T22:32:51.758 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:51.759 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:51.759 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:51.759 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.759 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.759 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:51.759 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.405496+0000", 2024-09-12T22:32:51.759 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 74.245545938999996, 2024-09-12T22:32:51.759 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013016012, 2024-09-12T22:32:51.759 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:51.759 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:51.759 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:51.759 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:51.759 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.760 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:51.760 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405496+0000", 2024-09-12T22:32:51.760 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:51.760 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.760 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.760 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:51.760 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405496+0000", 2024-09-12T22:32:51.760 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:51.760 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.760 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.760 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:51.760 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405496+0000", 2024-09-12T22:32:51.760 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7999999999999995e-07 2024-09-12T22:32:51.761 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.761 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.761 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:51.761 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405501+0000", 2024-09-12T22:32:51.761 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8359999999999999e-06 2024-09-12T22:32:51.761 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.761 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.761 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:51.761 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405514+0000", 2024-09-12T22:32:51.761 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2522e-05 2024-09-12T22:32:51.761 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.761 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.762 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:51.762 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405521+0000", 2024-09-12T22:32:51.762 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5020000000000003e-06 2024-09-12T22:32:51.762 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.762 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.762 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:51.762 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405575+0000", 2024-09-12T22:32:51.762 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4169999999999998e-05 2024-09-12T22:32:51.762 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.762 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.762 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:51.762 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405697+0000", 2024-09-12T22:32:51.762 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000121301 2024-09-12T22:32:51.762 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.763 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.763 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:51.763 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405829+0000", 2024-09-12T22:32:51.763 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000132662 2024-09-12T22:32:51.763 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.763 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.763 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:51.763 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409155+0000", 2024-09-12T22:32:51.763 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0033259050000000001 2024-09-12T22:32:51.763 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.763 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.763 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:51.763 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418425+0000", 2024-09-12T22:32:51.764 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0092696319999999999 2024-09-12T22:32:51.764 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.764 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.764 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:51.764 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418471+0000", 2024-09-12T22:32:51.764 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6213e-05 2024-09-12T22:32:51.764 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.764 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.764 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:51.764 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418512+0000", 2024-09-12T22:32:51.764 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0589000000000001e-05 2024-09-12T22:32:51.764 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:51.764 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:51.765 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:51.765 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.765 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.765 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:51.765 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.406108+0000", 2024-09-12T22:32:51.765 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 74.244933541999998, 2024-09-12T22:32:51.765 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012458175, 2024-09-12T22:32:51.765 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:51.765 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:51.765 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:51.765 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:51.765 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.765 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:51.766 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406108+0000", 2024-09-12T22:32:51.766 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:51.766 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.766 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.766 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:51.766 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406108+0000", 2024-09-12T22:32:51.766 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:51.766 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.766 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.766 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:51.766 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406109+0000", 2024-09-12T22:32:51.766 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9899999999999999e-07 2024-09-12T22:32:51.766 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.766 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.766 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:51.767 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406115+0000", 2024-09-12T22:32:51.767 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9030000000000001e-06 2024-09-12T22:32:51.767 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.767 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.767 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:51.767 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406141+0000", 2024-09-12T22:32:51.767 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5999e-05 2024-09-12T22:32:51.767 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.767 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.767 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:51.767 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406150+0000", 2024-09-12T22:32:51.767 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.6050000000000004e-06 2024-09-12T22:32:51.767 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.768 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.768 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:51.768 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408163+0000", 2024-09-12T22:32:51.768 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0020122769999999998 2024-09-12T22:32:51.768 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.768 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.768 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:51.768 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408309+0000", 2024-09-12T22:32:51.768 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014606999999999999 2024-09-12T22:32:51.768 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.768 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.768 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:51.769 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408433+0000", 2024-09-12T22:32:51.769 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012460300000000001 2024-09-12T22:32:51.769 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.769 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.769 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:51.769 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409903+0000", 2024-09-12T22:32:51.769 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001469499 2024-09-12T22:32:51.769 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.769 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.769 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:51.769 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418427+0000", 2024-09-12T22:32:51.769 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0085241139999999993 2024-09-12T22:32:51.769 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.769 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.770 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:51.770 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418471+0000", 2024-09-12T22:32:51.770 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4474000000000001e-05 2024-09-12T22:32:51.770 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.770 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.770 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:51.770 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418566+0000", 2024-09-12T22:32:51.770 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.4732e-05 2024-09-12T22:32:51.770 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:51.770 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:51.770 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:51.770 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.771 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.771 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:51.771 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.407266+0000", 2024-09-12T22:32:51.771 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 74.243775686000006, 2024-09-12T22:32:51.771 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011442905, 2024-09-12T22:32:51.771 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:51.771 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:51.771 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2024-09-12T22:32:51.771 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:51.771 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.771 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:51.771 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407266+0000", 2024-09-12T22:32:51.771 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:51.771 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.772 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.772 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:51.772 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407266+0000", 2024-09-12T22:32:51.772 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:51.772 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.772 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.772 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:51.772 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407266+0000", 2024-09-12T22:32:51.772 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7899999999999998e-07 2024-09-12T22:32:51.772 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.772 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.772 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:51.772 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407269+0000", 2024-09-12T22:32:51.773 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9210000000000001e-06 2024-09-12T22:32:51.773 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.773 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.773 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:51.773 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407331+0000", 2024-09-12T22:32:51.773 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1376000000000003e-05 2024-09-12T22:32:51.773 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.773 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.773 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:51.773 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407337+0000", 2024-09-12T22:32:51.773 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1929999999999998e-06 2024-09-12T22:32:51.773 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.774 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.774 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:51.774 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408974+0000", 2024-09-12T22:32:51.774 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0016367109999999999 2024-09-12T22:32:51.774 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.774 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.774 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:51.774 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409112+0000", 2024-09-12T22:32:51.774 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000137952 2024-09-12T22:32:51.774 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:51.774 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:51.774 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:51.774 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418709+0000", 2024-09-12T22:32:51.775 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0095971730000000005 2024-09-12T22:32:51.775 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:51.775 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:51.775 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:51.775 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:51.775 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:51.775 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-09-12T22:32:51.777 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:32:51.777 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:51.775+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:51.878 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:51.877+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:51.887 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:32:51.887 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:32:51.888 INFO:teuthology.orchestra.run.smithi148.stdout: "num_ops": 0 2024-09-12T22:32:51.888 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:32:51.896 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:32:51.980 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:51.979+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:52.039 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:32:52.039 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:32:52.039 INFO:teuthology.orchestra.run.smithi148.stdout: "complaint_time": 30, 2024-09-12T22:32:52.039 INFO:teuthology.orchestra.run.smithi148.stdout: "num_blocked_ops": 0 2024-09-12T22:32:52.039 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:32:52.047 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:32:52.080 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:52.079+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:52.180 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:52.179+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:52.192 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:32:52.192 INFO:teuthology.orchestra.run.smithi148.stdout: "size": 20, 2024-09-12T22:32:52.192 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 600, 2024-09-12T22:32:52.192 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [ 2024-09-12T22:32:52.193 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.193 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:52.193 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.400880+0000", 2024-09-12T22:32:52.193 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 74.789736742000002, 2024-09-12T22:32:52.193 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0095133660000000005, 2024-09-12T22:32:52.193 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:52.193 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:52.193 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:52.193 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:52.193 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.193 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:52.193 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400880+0000", 2024-09-12T22:32:52.193 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:52.194 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.194 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.194 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:52.194 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400880+0000", 2024-09-12T22:32:52.194 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:52.194 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.194 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.194 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:52.194 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400892+0000", 2024-09-12T22:32:52.194 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1941e-05 2024-09-12T22:32:52.194 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.194 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.195 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:52.195 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400900+0000", 2024-09-12T22:32:52.195 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0080000000000002e-06 2024-09-12T22:32:52.195 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.195 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.195 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:52.195 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400911+0000", 2024-09-12T22:32:52.195 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1452e-05 2024-09-12T22:32:52.195 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.195 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.195 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:52.195 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400922+0000", 2024-09-12T22:32:52.196 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0772e-05 2024-09-12T22:32:52.196 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.196 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.196 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:52.196 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401009+0000", 2024-09-12T22:32:52.196 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.7206000000000005e-05 2024-09-12T22:32:52.196 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.196 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.196 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:52.196 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401157+0000", 2024-09-12T22:32:52.196 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014831499999999999 2024-09-12T22:32:52.196 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.197 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.197 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:52.197 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401312+0000", 2024-09-12T22:32:52.197 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00015495600000000001 2024-09-12T22:32:52.197 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.197 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.197 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:52.197 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.403060+0000", 2024-09-12T22:32:52.197 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0017475220000000001 2024-09-12T22:32:52.197 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.197 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.197 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:52.197 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410300+0000", 2024-09-12T22:32:52.198 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0072403260000000001 2024-09-12T22:32:52.198 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.198 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.198 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:52.198 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410350+0000", 2024-09-12T22:32:52.198 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9814000000000001e-05 2024-09-12T22:32:52.198 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.198 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.198 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:52.198 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410393+0000", 2024-09-12T22:32:52.198 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3053999999999998e-05 2024-09-12T22:32:52.198 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:52.199 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:52.199 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:52.199 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.199 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.199 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:52.199 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.400952+0000", 2024-09-12T22:32:52.199 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 74.789664590000001, 2024-09-12T22:32:52.199 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0096045620000000005, 2024-09-12T22:32:52.199 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:52.199 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:52.199 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:52.199 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:52.199 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.200 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:52.200 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400952+0000", 2024-09-12T22:32:52.200 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:52.200 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.200 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.200 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:52.200 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400952+0000", 2024-09-12T22:32:52.200 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:52.200 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.200 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.200 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:52.200 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400953+0000", 2024-09-12T22:32:52.200 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.8000000000000005e-07 2024-09-12T22:32:52.201 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.201 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.201 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:52.201 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400957+0000", 2024-09-12T22:32:52.201 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.33e-06 2024-09-12T22:32:52.201 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.201 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.201 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:52.201 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400966+0000", 2024-09-12T22:32:52.201 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1989999999999995e-06 2024-09-12T22:32:52.201 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.201 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.201 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:52.202 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400973+0000", 2024-09-12T22:32:52.202 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2779999999999999e-06 2024-09-12T22:32:52.202 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.202 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.202 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:52.202 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401696+0000", 2024-09-12T22:32:52.202 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00072363500000000003 2024-09-12T22:32:52.202 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.202 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.202 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:52.202 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401788+0000", 2024-09-12T22:32:52.202 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1862999999999998e-05 2024-09-12T22:32:52.202 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.202 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.203 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:52.203 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401929+0000", 2024-09-12T22:32:52.203 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014096000000000001 2024-09-12T22:32:52.203 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.203 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.203 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:52.203 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.403542+0000", 2024-09-12T22:32:52.203 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001612963 2024-09-12T22:32:52.203 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.203 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.203 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:52.203 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410460+0000", 2024-09-12T22:32:52.203 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0069180500000000002 2024-09-12T22:32:52.204 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.204 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.204 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:52.204 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410515+0000", 2024-09-12T22:32:52.204 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5009000000000001e-05 2024-09-12T22:32:52.204 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.204 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.204 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:52.204 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410557+0000", 2024-09-12T22:32:52.204 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1495000000000002e-05 2024-09-12T22:32:52.204 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:52.204 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:52.204 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:52.205 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.205 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.205 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:52.205 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.400984+0000", 2024-09-12T22:32:52.205 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 74.789632095000002, 2024-09-12T22:32:52.205 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0073703950000000001, 2024-09-12T22:32:52.205 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:52.205 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:52.205 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:52.205 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:52.205 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.205 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:52.205 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400984+0000", 2024-09-12T22:32:52.205 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:52.206 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.206 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.206 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:52.206 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400984+0000", 2024-09-12T22:32:52.206 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:52.206 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.206 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.206 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:52.206 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400985+0000", 2024-09-12T22:32:52.206 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3200000000000005e-07 2024-09-12T22:32:52.206 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.206 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.206 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:52.206 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400998+0000", 2024-09-12T22:32:52.207 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2726e-05 2024-09-12T22:32:52.207 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.207 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.207 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:52.207 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401006+0000", 2024-09-12T22:32:52.207 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.3110000000000006e-06 2024-09-12T22:32:52.207 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.207 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.207 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:52.207 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401022+0000", 2024-09-12T22:32:52.207 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6249e-05 2024-09-12T22:32:52.207 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.207 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.207 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:52.208 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401700+0000", 2024-09-12T22:32:52.208 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00067811100000000001 2024-09-12T22:32:52.208 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.208 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.208 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:52.208 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401839+0000", 2024-09-12T22:32:52.208 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013865399999999999 2024-09-12T22:32:52.208 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.208 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.208 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:52.208 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401962+0000", 2024-09-12T22:32:52.208 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000123266 2024-09-12T22:32:52.208 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.209 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.209 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:52.209 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.403589+0000", 2024-09-12T22:32:52.209 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001626932 2024-09-12T22:32:52.209 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.209 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.209 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:52.209 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.408274+0000", 2024-09-12T22:32:52.209 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0046848100000000002 2024-09-12T22:32:52.209 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.209 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.209 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:52.209 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.408324+0000", 2024-09-12T22:32:52.210 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9784000000000003e-05 2024-09-12T22:32:52.210 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.210 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.210 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:52.210 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.408355+0000", 2024-09-12T22:32:52.210 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.1019999999999998e-05 2024-09-12T22:32:52.210 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:52.210 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:52.210 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:52.210 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.210 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.210 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:52.210 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401034+0000", 2024-09-12T22:32:52.210 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 74.789582655000004, 2024-09-12T22:32:52.211 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011063051000000001, 2024-09-12T22:32:52.211 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:52.211 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:52.211 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:52.211 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:52.211 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.211 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:52.211 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401034+0000", 2024-09-12T22:32:52.211 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:52.211 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.211 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.211 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:52.212 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401034+0000", 2024-09-12T22:32:52.212 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:52.212 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.212 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.212 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:52.212 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401034+0000", 2024-09-12T22:32:52.212 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8899999999999999e-07 2024-09-12T22:32:52.212 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.212 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.212 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:52.212 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401038+0000", 2024-09-12T22:32:52.212 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.523e-06 2024-09-12T22:32:52.212 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.213 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.213 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:52.213 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401046+0000", 2024-09-12T22:32:52.213 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0479999999999999e-06 2024-09-12T22:32:52.213 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.213 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.213 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:52.213 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401051+0000", 2024-09-12T22:32:52.213 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2619999999999998e-06 2024-09-12T22:32:52.213 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.213 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.213 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:52.213 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402270+0000", 2024-09-12T22:32:52.214 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012182429999999999 2024-09-12T22:32:52.214 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.214 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.214 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:52.214 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402325+0000", 2024-09-12T22:32:52.214 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5526999999999999e-05 2024-09-12T22:32:52.214 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.214 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.214 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:52.214 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402403+0000", 2024-09-12T22:32:52.214 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.7559999999999996e-05 2024-09-12T22:32:52.214 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.214 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.215 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:52.215 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.403655+0000", 2024-09-12T22:32:52.215 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012521489999999999 2024-09-12T22:32:52.215 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.215 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.215 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:52.215 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411979+0000", 2024-09-12T22:32:52.215 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0083240420000000002 2024-09-12T22:32:52.215 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.215 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.215 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:52.215 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.412036+0000", 2024-09-12T22:32:52.215 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7639000000000002e-05 2024-09-12T22:32:52.216 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.216 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.216 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:52.216 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.412097+0000", 2024-09-12T22:32:52.216 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0469e-05 2024-09-12T22:32:52.216 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:52.216 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:52.216 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:52.216 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.216 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.216 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:52.216 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401060+0000", 2024-09-12T22:32:52.216 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 74.789556903000005, 2024-09-12T22:32:52.217 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.010030172, 2024-09-12T22:32:52.217 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:52.217 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:52.217 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:52.217 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:52.217 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.217 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:52.217 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401060+0000", 2024-09-12T22:32:52.217 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:52.217 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.217 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.217 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:52.217 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401060+0000", 2024-09-12T22:32:52.218 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:52.218 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.218 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.218 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:52.218 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401060+0000", 2024-09-12T22:32:52.218 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2500000000000001e-07 2024-09-12T22:32:52.218 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.218 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.218 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:52.218 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401063+0000", 2024-09-12T22:32:52.218 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0910000000000001e-06 2024-09-12T22:32:52.218 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.218 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.219 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:52.219 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401070+0000", 2024-09-12T22:32:52.219 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1210000000000001e-06 2024-09-12T22:32:52.219 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.219 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.219 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:52.219 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401076+0000", 2024-09-12T22:32:52.219 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2830000000000001e-06 2024-09-12T22:32:52.219 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.219 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.219 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:52.219 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402288+0000", 2024-09-12T22:32:52.219 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012123699999999999 2024-09-12T22:32:52.220 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.220 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.220 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:52.220 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402359+0000", 2024-09-12T22:32:52.220 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.0988000000000005e-05 2024-09-12T22:32:52.220 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.220 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.220 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:52.220 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402457+0000", 2024-09-12T22:32:52.220 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.7857999999999997e-05 2024-09-12T22:32:52.220 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.220 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.220 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:52.221 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.404395+0000", 2024-09-12T22:32:52.221 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0019380160000000001 2024-09-12T22:32:52.221 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.221 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.221 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:52.221 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410603+0000", 2024-09-12T22:32:52.221 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.006208061 2024-09-12T22:32:52.221 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.221 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.221 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:52.221 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410687+0000", 2024-09-12T22:32:52.221 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.4623000000000006e-05 2024-09-12T22:32:52.222 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.222 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.222 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:52.222 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411090+0000", 2024-09-12T22:32:52.222 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00040233599999999999 2024-09-12T22:32:52.222 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:52.222 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:52.222 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:52.222 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.222 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.222 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:52.222 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401083+0000", 2024-09-12T22:32:52.222 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 74.789533487, 2024-09-12T22:32:52.223 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0097591850000000001, 2024-09-12T22:32:52.223 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:52.223 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:52.223 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:52.223 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:52.223 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.223 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:52.223 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401083+0000", 2024-09-12T22:32:52.223 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:52.223 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.223 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.223 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:52.223 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401083+0000", 2024-09-12T22:32:52.224 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:52.224 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.224 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.224 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:52.224 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401084+0000", 2024-09-12T22:32:52.224 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4799999999999999e-07 2024-09-12T22:32:52.224 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.224 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.224 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:52.224 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401088+0000", 2024-09-12T22:32:52.224 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6419999999999998e-06 2024-09-12T22:32:52.224 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.224 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.225 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:52.225 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401094+0000", 2024-09-12T22:32:52.225 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0090000000000004e-06 2024-09-12T22:32:52.225 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.225 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.225 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:52.225 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401108+0000", 2024-09-12T22:32:52.225 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3884e-05 2024-09-12T22:32:52.225 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.225 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.225 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:52.225 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401165+0000", 2024-09-12T22:32:52.225 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.6499000000000002e-05 2024-09-12T22:32:52.226 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.226 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.226 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:52.226 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401261+0000", 2024-09-12T22:32:52.226 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.6872000000000004e-05 2024-09-12T22:32:52.226 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.226 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.226 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:52.226 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401376+0000", 2024-09-12T22:32:52.226 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000114508 2024-09-12T22:32:52.226 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.226 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.227 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:52.227 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402666+0000", 2024-09-12T22:32:52.227 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012901659999999999 2024-09-12T22:32:52.227 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.227 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.227 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:52.227 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410572+0000", 2024-09-12T22:32:52.227 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0079055489999999996 2024-09-12T22:32:52.227 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.227 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.227 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:52.227 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410661+0000", 2024-09-12T22:32:52.228 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.9578000000000002e-05 2024-09-12T22:32:52.228 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.228 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.228 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:52.228 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410842+0000", 2024-09-12T22:32:52.228 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00018102999999999999 2024-09-12T22:32:52.228 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:52.228 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:52.228 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:52.228 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.228 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.228 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:52.228 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401122+0000", 2024-09-12T22:32:52.229 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 74.789494454999996, 2024-09-12T22:32:52.229 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0099122080000000005, 2024-09-12T22:32:52.229 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:52.229 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:52.229 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:32:52.229 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:52.229 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.229 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:52.229 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401122+0000", 2024-09-12T22:32:52.229 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:52.229 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.229 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.229 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:52.230 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401122+0000", 2024-09-12T22:32:52.230 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:52.230 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.230 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.230 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:52.230 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401123+0000", 2024-09-12T22:32:52.230 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2600000000000002e-07 2024-09-12T22:32:52.230 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.230 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.230 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:52.230 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401126+0000", 2024-09-12T22:32:52.230 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.6449999999999998e-06 2024-09-12T22:32:52.230 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.230 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.231 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:52.231 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401133+0000", 2024-09-12T22:32:52.231 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.9890000000000003e-06 2024-09-12T22:32:52.231 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.231 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.231 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:52.231 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401138+0000", 2024-09-12T22:32:52.231 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8060000000000002e-06 2024-09-12T22:32:52.231 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.231 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.231 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:52.231 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401703+0000", 2024-09-12T22:32:52.231 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00056509099999999999 2024-09-12T22:32:52.231 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.232 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.232 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:52.232 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401837+0000", 2024-09-12T22:32:52.232 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013338799999999999 2024-09-12T22:32:52.232 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.232 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.232 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:52.232 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411034+0000", 2024-09-12T22:32:52.232 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.009197663 2024-09-12T22:32:52.232 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:52.232 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:52.232 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:52.232 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.233 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.233 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:52.233 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401158+0000", 2024-09-12T22:32:52.233 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 74.789458675999995, 2024-09-12T22:32:52.233 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.010292437999999999, 2024-09-12T22:32:52.233 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:52.233 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:52.233 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:32:52.233 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:52.233 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.233 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:52.233 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401158+0000", 2024-09-12T22:32:52.233 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:52.234 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.234 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.234 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:52.234 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401158+0000", 2024-09-12T22:32:52.234 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:52.234 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.234 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.234 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:52.234 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401158+0000", 2024-09-12T22:32:52.234 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9699999999999996e-07 2024-09-12T22:32:52.234 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.234 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.234 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:52.235 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401161+0000", 2024-09-12T22:32:52.235 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.7410000000000001e-06 2024-09-12T22:32:52.235 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.235 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.235 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:52.235 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401168+0000", 2024-09-12T22:32:52.235 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.844e-06 2024-09-12T22:32:52.235 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.235 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.235 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:52.235 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401174+0000", 2024-09-12T22:32:52.235 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4700000000000001e-06 2024-09-12T22:32:52.235 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.236 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.236 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:52.236 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402799+0000", 2024-09-12T22:32:52.236 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0016256409999999999 2024-09-12T22:32:52.236 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.236 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.236 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:52.236 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402893+0000", 2024-09-12T22:32:52.236 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.3807999999999994e-05 2024-09-12T22:32:52.236 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.236 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.236 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:52.236 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411450+0000", 2024-09-12T22:32:52.237 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0085573369999999999 2024-09-12T22:32:52.237 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:52.237 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:52.237 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:52.237 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.237 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.237 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:52.237 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401183+0000", 2024-09-12T22:32:52.237 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 74.789433824, 2024-09-12T22:32:52.237 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0068597830000000004, 2024-09-12T22:32:52.237 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:52.237 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:52.238 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:32:52.238 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:52.238 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.238 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:52.238 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401183+0000", 2024-09-12T22:32:52.238 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:52.238 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.238 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.238 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:52.238 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401183+0000", 2024-09-12T22:32:52.238 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:52.238 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.238 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.239 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:52.239 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401183+0000", 2024-09-12T22:32:52.239 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.6700000000000003e-07 2024-09-12T22:32:52.239 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.239 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.239 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:52.239 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401186+0000", 2024-09-12T22:32:52.239 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4679999999999999e-06 2024-09-12T22:32:52.239 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.239 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.239 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:52.239 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401192+0000", 2024-09-12T22:32:52.240 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.1519999999999997e-06 2024-09-12T22:32:52.240 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.240 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.240 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:52.240 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401197+0000", 2024-09-12T22:32:52.240 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4669999999999998e-06 2024-09-12T22:32:52.240 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.240 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.240 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:52.240 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401253+0000", 2024-09-12T22:32:52.240 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.6211000000000001e-05 2024-09-12T22:32:52.241 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.241 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.241 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:52.241 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401413+0000", 2024-09-12T22:32:52.241 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00016021399999999999 2024-09-12T22:32:52.241 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.241 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.241 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:52.241 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.408043+0000", 2024-09-12T22:32:52.241 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0066295039999999996 2024-09-12T22:32:52.241 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:52.241 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:52.241 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:52.241 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.242 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.242 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:20 3.1c e19/17 3:3ed09add:::607.00000000:head v 19'1, mlcod=0'0)", 2024-09-12T22:32:52.242 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.409642+0000", 2024-09-12T22:32:52.242 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 74.780974365000006, 2024-09-12T22:32:52.242 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0038816269999999999, 2024-09-12T22:32:52.242 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:52.242 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:52.242 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:52.242 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:52.242 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.242 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:52.242 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409642+0000", 2024-09-12T22:32:52.242 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:52.243 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.243 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.243 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:52.243 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409642+0000", 2024-09-12T22:32:52.243 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:52.243 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.243 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.243 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:52.243 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409642+0000", 2024-09-12T22:32:52.243 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.6899999999999999e-07 2024-09-12T22:32:52.243 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.243 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.243 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:52.243 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409648+0000", 2024-09-12T22:32:52.244 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.49e-06 2024-09-12T22:32:52.244 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.244 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.244 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:52.244 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409656+0000", 2024-09-12T22:32:52.244 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.2949999999999994e-06 2024-09-12T22:32:52.244 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.244 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.244 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:52.244 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409664+0000", 2024-09-12T22:32:52.244 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.1219999999999995e-06 2024-09-12T22:32:52.244 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.244 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.245 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:52.245 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409707+0000", 2024-09-12T22:32:52.245 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2222000000000003e-05 2024-09-12T22:32:52.245 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.245 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.245 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:52.245 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409724+0000", 2024-09-12T22:32:52.245 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7496999999999999e-05 2024-09-12T22:32:52.245 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.245 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.245 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:52.245 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413439+0000", 2024-09-12T22:32:52.245 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00371448 2024-09-12T22:32:52.245 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.246 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.246 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:52.246 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413524+0000", 2024-09-12T22:32:52.246 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.5252000000000003e-05 2024-09-12T22:32:52.246 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:52.246 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:52.246 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:52.246 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.246 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.246 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:28 3.13 e19/17 3:cd5a64a3:::100.00000000:head v 19'1, mlcod=0'0)", 2024-09-12T22:32:52.246 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.409681+0000", 2024-09-12T22:32:52.246 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 74.780935881999994, 2024-09-12T22:32:52.246 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0038708710000000001, 2024-09-12T22:32:52.247 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:52.247 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:52.247 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:52.247 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:52.247 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.247 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:52.247 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409681+0000", 2024-09-12T22:32:52.247 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:52.247 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.247 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.247 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:52.247 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409681+0000", 2024-09-12T22:32:52.247 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:52.248 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.248 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.248 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:52.248 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409681+0000", 2024-09-12T22:32:52.248 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3000000000000002e-07 2024-09-12T22:32:52.248 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.248 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.248 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:52.248 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409695+0000", 2024-09-12T22:32:52.248 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4313e-05 2024-09-12T22:32:52.248 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.248 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.248 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:52.248 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409703+0000", 2024-09-12T22:32:52.249 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4000000000000003e-06 2024-09-12T22:32:52.249 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.249 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.249 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:52.249 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409708+0000", 2024-09-12T22:32:52.249 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3190000000000002e-06 2024-09-12T22:32:52.249 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.249 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.249 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:52.249 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409875+0000", 2024-09-12T22:32:52.249 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000167329 2024-09-12T22:32:52.249 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.250 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.250 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:52.250 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409892+0000", 2024-09-12T22:32:52.250 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6957999999999999e-05 2024-09-12T22:32:52.250 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.250 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.250 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:52.250 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413457+0000", 2024-09-12T22:32:52.250 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0035651279999999999 2024-09-12T22:32:52.250 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.250 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.250 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:52.250 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413552+0000", 2024-09-12T22:32:52.250 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.4093999999999997e-05 2024-09-12T22:32:52.251 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:52.251 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:52.251 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:52.251 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.251 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.251 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:21 3.1c e19/17 3:3ed09add:::607.00000000:head v 19'2, mlcod=0'0)", 2024-09-12T22:32:52.251 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.409718+0000", 2024-09-12T22:32:52.251 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 74.780898217000001, 2024-09-12T22:32:52.251 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003851883, 2024-09-12T22:32:52.251 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:52.251 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:52.251 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:52.251 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:52.251 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.252 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:52.252 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409718+0000", 2024-09-12T22:32:52.252 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:52.252 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.252 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.252 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:52.252 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409718+0000", 2024-09-12T22:32:52.252 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:52.252 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.252 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.252 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:52.252 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409719+0000", 2024-09-12T22:32:52.252 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.16e-07 2024-09-12T22:32:52.253 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.253 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.253 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:52.253 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409722+0000", 2024-09-12T22:32:52.253 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.692e-06 2024-09-12T22:32:52.253 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.253 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.253 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:52.253 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409729+0000", 2024-09-12T22:32:52.253 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.516e-06 2024-09-12T22:32:52.253 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.253 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.253 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:52.254 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409750+0000", 2024-09-12T22:32:52.254 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1151000000000001e-05 2024-09-12T22:32:52.254 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.254 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.254 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:52.254 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410015+0000", 2024-09-12T22:32:52.254 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00026477599999999999 2024-09-12T22:32:52.254 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.254 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.254 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:52.254 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410104+0000", 2024-09-12T22:32:52.254 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.9586000000000006e-05 2024-09-12T22:32:52.254 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.254 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.255 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:52.255 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413528+0000", 2024-09-12T22:32:52.255 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0034237880000000001 2024-09-12T22:32:52.255 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.255 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.255 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:52.255 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413570+0000", 2024-09-12T22:32:52.255 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2157999999999999e-05 2024-09-12T22:32:52.255 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:52.255 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:52.255 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:52.255 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.255 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.255 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:27 3.13 e19/17 3:c91d4a1d:::mds0_inotable:head v 19'2, mlcod=0'0)", 2024-09-12T22:32:52.256 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.409760+0000", 2024-09-12T22:32:52.256 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 74.780856701000005, 2024-09-12T22:32:52.256 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0039301910000000004, 2024-09-12T22:32:52.256 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:52.256 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:52.256 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:52.256 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:52.256 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.256 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:52.256 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409760+0000", 2024-09-12T22:32:52.256 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:52.256 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.256 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.257 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:52.257 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409760+0000", 2024-09-12T22:32:52.257 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:52.257 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.257 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.257 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:52.257 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409760+0000", 2024-09-12T22:32:52.257 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.39e-07 2024-09-12T22:32:52.257 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.257 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.257 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:52.257 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409765+0000", 2024-09-12T22:32:52.257 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4449999999999998e-06 2024-09-12T22:32:52.257 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.258 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.258 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:52.258 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409771+0000", 2024-09-12T22:32:52.258 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7159999999999997e-06 2024-09-12T22:32:52.258 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.258 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.258 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:52.258 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409778+0000", 2024-09-12T22:32:52.258 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.331e-06 2024-09-12T22:32:52.258 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.258 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.258 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:52.258 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410191+0000", 2024-09-12T22:32:52.259 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00041348300000000003 2024-09-12T22:32:52.259 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.259 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.259 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:52.259 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410211+0000", 2024-09-12T22:32:52.259 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9933999999999999e-05 2024-09-12T22:32:52.259 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.259 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.259 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:52.259 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413638+0000", 2024-09-12T22:32:52.259 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003426854 2024-09-12T22:32:52.259 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.259 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.259 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:52.260 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413690+0000", 2024-09-12T22:32:52.260 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2089000000000002e-05 2024-09-12T22:32:52.260 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:52.260 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:52.260 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:52.260 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.260 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.260 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "pg_update_log_missing_reply(3.b epoch 19/17 rep_tid 4 lcod 19'2)", 2024-09-12T22:32:52.260 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.410060+0000", 2024-09-12T22:32:52.260 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 74.780557036000005, 2024-09-12T22:32:52.260 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00098016500000000007, 2024-09-12T22:32:52.260 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:52.260 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:52.261 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "reached pg", 2024-09-12T22:32:52.261 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:52.261 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.261 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:52.261 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410060+0000", 2024-09-12T22:32:52.261 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:52.261 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.261 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.261 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:52.261 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410060+0000", 2024-09-12T22:32:52.261 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:52.261 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.261 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.261 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:52.262 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410060+0000", 2024-09-12T22:32:52.262 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.8299999999999998e-07 2024-09-12T22:32:52.262 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.262 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.262 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:52.262 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410062+0000", 2024-09-12T22:32:52.262 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5749999999999999e-06 2024-09-12T22:32:52.262 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.262 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.262 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:52.262 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410070+0000", 2024-09-12T22:32:52.262 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.909e-06 2024-09-12T22:32:52.262 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.262 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.263 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:52.263 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410076+0000", 2024-09-12T22:32:52.263 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7049999999999996e-06 2024-09-12T22:32:52.263 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.263 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.263 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:52.263 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410943+0000", 2024-09-12T22:32:52.263 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00086681900000000001 2024-09-12T22:32:52.263 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.263 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.263 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:52.263 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411040+0000", 2024-09-12T22:32:52.263 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.6774000000000006e-05 2024-09-12T22:32:52.263 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:52.264 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:52.264 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:52.264 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.264 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.264 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e19/17 ondisk, result = 0)", 2024-09-12T22:32:52.264 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.410113+0000", 2024-09-12T22:32:52.264 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 74.780503769000006, 2024-09-12T22:32:52.264 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00098911599999999995, 2024-09-12T22:32:52.264 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:52.264 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:52.264 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:32:52.264 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:52.264 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.265 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:52.265 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410113+0000", 2024-09-12T22:32:52.265 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:52.265 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.265 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.265 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:52.265 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410113+0000", 2024-09-12T22:32:52.265 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:52.265 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.265 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.265 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:52.265 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410113+0000", 2024-09-12T22:32:52.265 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.99e-07 2024-09-12T22:32:52.265 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.266 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.266 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:52.266 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410115+0000", 2024-09-12T22:32:52.266 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.046e-06 2024-09-12T22:32:52.266 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.266 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.266 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:52.266 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410121+0000", 2024-09-12T22:32:52.266 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0050000000000001e-06 2024-09-12T22:32:52.266 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.266 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.266 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:52.266 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410126+0000", 2024-09-12T22:32:52.266 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8339999999999998e-06 2024-09-12T22:32:52.267 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.267 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.267 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:52.267 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410587+0000", 2024-09-12T22:32:52.267 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00046095499999999998 2024-09-12T22:32:52.267 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.267 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.267 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:52.267 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410595+0000", 2024-09-12T22:32:52.267 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.9419999999999995e-06 2024-09-12T22:32:52.267 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.267 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.267 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:52.268 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411102+0000", 2024-09-12T22:32:52.268 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00050713500000000003 2024-09-12T22:32:52.268 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:52.268 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:52.268 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:52.268 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.268 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.268 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 19/17 rep_tid 8 lcod 19'4)", 2024-09-12T22:32:52.268 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.410133+0000", 2024-09-12T22:32:52.268 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 74.780483841000006, 2024-09-12T22:32:52.268 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0013504000000000001, 2024-09-12T22:32:52.268 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:52.268 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:52.269 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "reached pg", 2024-09-12T22:32:52.269 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:52.269 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.269 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:52.269 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410133+0000", 2024-09-12T22:32:52.269 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:52.269 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.269 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.269 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:52.269 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410133+0000", 2024-09-12T22:32:52.269 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:52.269 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.269 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.269 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:52.270 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410133+0000", 2024-09-12T22:32:52.270 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.0599999999999999e-07 2024-09-12T22:32:52.270 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.270 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.270 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:52.270 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410135+0000", 2024-09-12T22:32:52.270 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7770000000000001e-06 2024-09-12T22:32:52.270 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.270 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.270 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:52.270 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410140+0000", 2024-09-12T22:32:52.270 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9960000000000001e-06 2024-09-12T22:32:52.270 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.270 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.271 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:52.271 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410144+0000", 2024-09-12T22:32:52.271 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9500000000000003e-06 2024-09-12T22:32:52.271 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.271 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.271 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:52.271 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411310+0000", 2024-09-12T22:32:52.271 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001166311 2024-09-12T22:32:52.271 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.271 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.271 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:52.271 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411483+0000", 2024-09-12T22:32:52.271 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00017316 2024-09-12T22:32:52.272 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:52.272 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:52.272 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:52.272 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.272 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.272 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "pg_update_log_missing(3.1a epoch 19/17 rep_tid 0 entries 19'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T22:32:52.272 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.410617+0000", 2024-09-12T22:32:52.272 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 74.779999446000005, 2024-09-12T22:32:52.272 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0030439709999999999, 2024-09-12T22:32:52.272 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:52.272 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:52.272 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "reached pg", 2024-09-12T22:32:52.272 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:52.272 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.273 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:52.273 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410617+0000", 2024-09-12T22:32:52.273 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:52.273 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.273 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.273 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:52.273 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410617+0000", 2024-09-12T22:32:52.273 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:52.273 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.273 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.273 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:52.273 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410617+0000", 2024-09-12T22:32:52.273 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3599999999999999e-07 2024-09-12T22:32:52.274 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.274 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.274 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:52.274 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410625+0000", 2024-09-12T22:32:52.274 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5410000000000003e-06 2024-09-12T22:32:52.274 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.274 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.274 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:52.274 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410638+0000", 2024-09-12T22:32:52.274 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3261999999999999e-05 2024-09-12T22:32:52.274 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.274 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.274 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:52.274 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410653+0000", 2024-09-12T22:32:52.275 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4844000000000001e-05 2024-09-12T22:32:52.275 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.275 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.275 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:52.275 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410814+0000", 2024-09-12T22:32:52.275 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00016119999999999999 2024-09-12T22:32:52.275 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.275 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.275 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:52.275 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413661+0000", 2024-09-12T22:32:52.275 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0028467879999999998 2024-09-12T22:32:52.275 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:52.275 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:52.276 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:52.276 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.276 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.276 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-09-12T22:32:52.276 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:39.398875+0000", 2024-09-12T22:32:52.276 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 72.791741165999994, 2024-09-12T22:32:52.276 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0015679069999999999, 2024-09-12T22:32:52.276 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:52.276 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:52.276 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:52.276 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:52.276 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.276 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:52.277 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398875+0000", 2024-09-12T22:32:52.277 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:52.277 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.277 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.277 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:52.277 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398875+0000", 2024-09-12T22:32:52.277 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:52.277 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.277 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.277 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:52.277 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398878+0000", 2024-09-12T22:32:52.277 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1679999999999998e-06 2024-09-12T22:32:52.277 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.278 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.278 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:52.278 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398888+0000", 2024-09-12T22:32:52.278 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.084e-05 2024-09-12T22:32:52.278 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.278 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.278 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:52.278 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398906+0000", 2024-09-12T22:32:52.278 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7518000000000001e-05 2024-09-12T22:32:52.278 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.278 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.278 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:52.278 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398914+0000", 2024-09-12T22:32:52.278 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5989999999999996e-06 2024-09-12T22:32:52.279 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.279 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.279 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:52.279 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398974+0000", 2024-09-12T22:32:52.279 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0988e-05 2024-09-12T22:32:52.279 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.279 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.279 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:52.279 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.399078+0000", 2024-09-12T22:32:52.279 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000103133 2024-09-12T22:32:52.279 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.279 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.279 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:52.280 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.399166+0000", 2024-09-12T22:32:52.280 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.8183999999999995e-05 2024-09-12T22:32:52.280 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.280 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.280 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:52.280 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.399747+0000", 2024-09-12T22:32:52.280 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00058110599999999996 2024-09-12T22:32:52.280 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.280 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.280 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:52.280 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.400377+0000", 2024-09-12T22:32:52.280 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000630157 2024-09-12T22:32:52.280 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.281 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.281 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:52.281 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.400415+0000", 2024-09-12T22:32:52.281 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7814000000000001e-05 2024-09-12T22:32:52.281 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.281 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.281 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:52.281 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.400443+0000", 2024-09-12T22:32:52.281 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8399999999999999e-05 2024-09-12T22:32:52.281 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:52.281 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:52.281 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:52.281 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.282 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.282 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e23)", 2024-09-12T22:32:52.282 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:58.400966+0000", 2024-09-12T22:32:52.282 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 53.789650258000002, 2024-09-12T22:32:52.282 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001468876, 2024-09-12T22:32:52.282 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:52.282 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:52.282 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:52.282 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:52.282 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.282 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:52.282 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400966+0000", 2024-09-12T22:32:52.282 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:52.283 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.283 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.283 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:52.283 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400966+0000", 2024-09-12T22:32:52.283 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:52.283 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.283 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.283 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:52.283 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400967+0000", 2024-09-12T22:32:52.283 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.046e-06 2024-09-12T22:32:52.283 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.283 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.283 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:52.283 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400974+0000", 2024-09-12T22:32:52.284 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2310000000000001e-06 2024-09-12T22:32:52.284 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.284 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.284 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:52.284 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400988+0000", 2024-09-12T22:32:52.284 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4482e-05 2024-09-12T22:32:52.284 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.284 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.284 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:52.284 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400997+0000", 2024-09-12T22:32:52.284 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.0189999999999995e-06 2024-09-12T22:32:52.284 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.285 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.285 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:52.285 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.401068+0000", 2024-09-12T22:32:52.285 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1426000000000004e-05 2024-09-12T22:32:52.285 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.285 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.285 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:52.285 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.401174+0000", 2024-09-12T22:32:52.285 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000105769 2024-09-12T22:32:52.285 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.285 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.285 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:52.285 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.401335+0000", 2024-09-12T22:32:52.285 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000161225 2024-09-12T22:32:52.286 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.286 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.286 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:52.286 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.402110+0000", 2024-09-12T22:32:52.286 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00077428800000000004 2024-09-12T22:32:52.286 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.286 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.286 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:52.286 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.402333+0000", 2024-09-12T22:32:52.286 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000223723 2024-09-12T22:32:52.286 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.286 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.286 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:52.286 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.402388+0000", 2024-09-12T22:32:52.287 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4700999999999997e-05 2024-09-12T22:32:52.287 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.287 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.287 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:52.287 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.402435+0000", 2024-09-12T22:32:52.287 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6965999999999997e-05 2024-09-12T22:32:52.287 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:52.287 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:52.287 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:52.287 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.287 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.287 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:45 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e27)", 2024-09-12T22:32:52.287 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:32:04.401614+0000", 2024-09-12T22:32:52.288 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 47.789002828999998, 2024-09-12T22:32:52.288 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0014279749999999999, 2024-09-12T22:32:52.288 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:52.288 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:52.288 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:52.288 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:52.288 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.288 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:52.288 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401614+0000", 2024-09-12T22:32:52.289 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:52.289 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.289 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.289 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:52.289 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401614+0000", 2024-09-12T22:32:52.289 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:52.289 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.289 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.289 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:52.289 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401615+0000", 2024-09-12T22:32:52.289 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.161e-06 2024-09-12T22:32:52.289 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.290 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.290 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:52.290 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401621+0000", 2024-09-12T22:32:52.290 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8730000000000004e-06 2024-09-12T22:32:52.290 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.290 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.290 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:52.290 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401633+0000", 2024-09-12T22:32:52.290 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1800000000000001e-05 2024-09-12T22:32:52.290 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.290 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.290 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:52.291 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401656+0000", 2024-09-12T22:32:52.291 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.3521999999999999e-05 2024-09-12T22:32:52.291 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.291 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.291 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:52.291 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401713+0000", 2024-09-12T22:32:52.291 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7259000000000002e-05 2024-09-12T22:32:52.291 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.291 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.291 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:52.291 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401849+0000", 2024-09-12T22:32:52.291 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013613500000000001 2024-09-12T22:32:52.291 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.292 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.292 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:52.292 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.402009+0000", 2024-09-12T22:32:52.292 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00015947199999999999 2024-09-12T22:32:52.292 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.292 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.292 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:52.292 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.402629+0000", 2024-09-12T22:32:52.292 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00061962200000000001 2024-09-12T22:32:52.292 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.292 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.292 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:52.292 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.402983+0000", 2024-09-12T22:32:52.292 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00035447499999999998 2024-09-12T22:32:52.293 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.293 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.293 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:52.293 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.403016+0000", 2024-09-12T22:32:52.293 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3108999999999998e-05 2024-09-12T22:32:52.293 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:52.293 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:52.293 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:52.293 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.403042+0000", 2024-09-12T22:32:52.293 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5547000000000001e-05 2024-09-12T22:32:52.293 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:52.293 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:52.293 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:52.293 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:52.294 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:52.294 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:32:52.295 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:32:52.296 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:52.294+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:52.395 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:52.394+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:52.406 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-09-12T22:32:52.406 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-09-12T22:32:52.406 INFO:teuthology.orchestra.run.smithi163.stdout: "num_ops": 0 2024-09-12T22:32:52.406 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-09-12T22:32:52.414 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:32:52.455 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T22:32:52.496 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:52.496+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:52.557 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-09-12T22:32:52.557 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-09-12T22:32:52.557 INFO:teuthology.orchestra.run.smithi163.stdout: "complaint_time": 30, 2024-09-12T22:32:52.557 INFO:teuthology.orchestra.run.smithi163.stdout: "num_blocked_ops": 0 2024-09-12T22:32:52.557 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-09-12T22:32:52.566 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:32:52.610 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:52.609+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:52.671 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-09-12T22:32:52.671 INFO:teuthology.orchestra.run.smithi163.stdout: "size": 20, 2024-09-12T22:32:52.671 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 600, 2024-09-12T22:32:52.671 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2024-09-12T22:32:52.671 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.671 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-09-12T22:32:52.671 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:27.254459+0000", 2024-09-12T22:32:52.671 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 85.414255799000003, 2024-09-12T22:32:52.671 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.37816283899999997, 2024-09-12T22:32:52.672 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:52.672 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:52.672 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:52.672 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:52.672 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:52.672 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:52.672 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 1 2024-09-12T22:32:52.672 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.672 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:52.672 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.672 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:52.672 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254459+0000", 2024-09-12T22:32:52.672 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:52.672 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.673 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.673 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:52.673 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254459+0000", 2024-09-12T22:32:52.673 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:52.673 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.673 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.673 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:52.673 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254460+0000", 2024-09-12T22:32:52.673 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1739999999999999e-06 2024-09-12T22:32:52.673 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.673 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.673 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:52.673 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254472+0000", 2024-09-12T22:32:52.673 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2207e-05 2024-09-12T22:32:52.674 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.674 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.674 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:52.674 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254483+0000", 2024-09-12T22:32:52.674 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0631999999999999e-05 2024-09-12T22:32:52.674 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.674 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.674 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:52.674 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254492+0000", 2024-09-12T22:32:52.674 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3670000000000003e-06 2024-09-12T22:32:52.674 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.674 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.674 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:52.675 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254551+0000", 2024-09-12T22:32:52.675 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8687999999999998e-05 2024-09-12T22:32:52.675 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.675 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.675 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for peered", 2024-09-12T22:32:52.675 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254562+0000", 2024-09-12T22:32:52.675 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1249e-05 2024-09-12T22:32:52.675 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.675 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.675 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:52.675 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.631211+0000", 2024-09-12T22:32:52.675 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.376649018 2024-09-12T22:32:52.675 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.675 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.676 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:52.676 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.631345+0000", 2024-09-12T22:32:52.676 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013378700000000001 2024-09-12T22:32:52.676 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.676 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.676 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:52.676 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.631479+0000", 2024-09-12T22:32:52.676 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013352399999999999 2024-09-12T22:32:52.676 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.676 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.676 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:52.676 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632324+0000", 2024-09-12T22:32:52.676 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00084508100000000002 2024-09-12T22:32:52.676 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.677 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.677 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:52.677 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632548+0000", 2024-09-12T22:32:52.677 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000224329 2024-09-12T22:32:52.677 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.677 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.677 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:52.677 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632591+0000", 2024-09-12T22:32:52.677 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2564000000000001e-05 2024-09-12T22:32:52.677 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.677 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.677 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:52.677 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632622+0000", 2024-09-12T22:32:52.678 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1219e-05 2024-09-12T22:32:52.678 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:52.678 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:52.678 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:52.678 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.678 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.678 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:185 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:32:52.678 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394355+0000", 2024-09-12T22:32:52.678 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 84.274359701999998, 2024-09-12T22:32:52.678 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011302394, 2024-09-12T22:32:52.678 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:52.678 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:52.678 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:52.679 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:52.679 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:52.679 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:52.679 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 185 2024-09-12T22:32:52.679 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.679 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:52.679 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.679 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:52.679 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394355+0000", 2024-09-12T22:32:52.679 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:52.679 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.679 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.679 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:52.679 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394355+0000", 2024-09-12T22:32:52.680 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:52.680 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.680 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.680 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:52.680 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394355+0000", 2024-09-12T22:32:52.680 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9099999999999999e-07 2024-09-12T22:32:52.680 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.680 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.680 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:52.680 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394385+0000", 2024-09-12T22:32:52.680 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9963000000000001e-05 2024-09-12T22:32:52.680 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.680 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.680 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:52.681 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394390+0000", 2024-09-12T22:32:52.681 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8420000000000004e-06 2024-09-12T22:32:52.681 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.681 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.681 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:52.681 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394393+0000", 2024-09-12T22:32:52.681 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1e-06 2024-09-12T22:32:52.681 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.681 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.681 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:52.681 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.400546+0000", 2024-09-12T22:32:52.681 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0061523309999999996 2024-09-12T22:32:52.681 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.681 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.682 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:52.682 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.400588+0000", 2024-09-12T22:32:52.682 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1835000000000002e-05 2024-09-12T22:32:52.682 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.682 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.682 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:52.682 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.400677+0000", 2024-09-12T22:32:52.682 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9195000000000002e-05 2024-09-12T22:32:52.682 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.682 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.682 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:52.682 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405378+0000", 2024-09-12T22:32:52.682 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0047008659999999997 2024-09-12T22:32:52.682 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.683 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.683 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:52.683 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405569+0000", 2024-09-12T22:32:52.683 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00019148599999999999 2024-09-12T22:32:52.683 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.683 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.683 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:52.683 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405620+0000", 2024-09-12T22:32:52.683 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1416999999999999e-05 2024-09-12T22:32:52.683 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.683 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.683 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:52.683 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405657+0000", 2024-09-12T22:32:52.683 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6968000000000002e-05 2024-09-12T22:32:52.684 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:52.684 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:52.684 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:52.684 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.684 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.684 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:32:52.684 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394399+0000", 2024-09-12T22:32:52.684 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 84.274315490999996, 2024-09-12T22:32:52.684 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011336601999999999, 2024-09-12T22:32:52.684 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:52.684 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:52.684 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:52.685 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:52.685 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:52.685 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:52.685 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 186 2024-09-12T22:32:52.685 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.685 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:52.685 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.685 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:52.685 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394399+0000", 2024-09-12T22:32:52.685 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:52.685 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.685 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.685 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:52.686 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394399+0000", 2024-09-12T22:32:52.686 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:52.686 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.686 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.686 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:52.686 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394400+0000", 2024-09-12T22:32:52.686 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4499999999999998e-07 2024-09-12T22:32:52.686 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.686 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.686 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:52.686 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394402+0000", 2024-09-12T22:32:52.686 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.875e-06 2024-09-12T22:32:52.686 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.686 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.687 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:52.687 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394405+0000", 2024-09-12T22:32:52.687 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6799999999999999e-06 2024-09-12T22:32:52.687 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.687 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.687 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:52.687 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394408+0000", 2024-09-12T22:32:52.687 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.667e-06 2024-09-12T22:32:52.687 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.687 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.687 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:52.687 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401395+0000", 2024-09-12T22:32:52.687 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0069867230000000002 2024-09-12T22:32:52.687 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.688 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.688 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:52.688 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401438+0000", 2024-09-12T22:32:52.688 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3554999999999999e-05 2024-09-12T22:32:52.688 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.688 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.688 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:52.688 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401509+0000", 2024-09-12T22:32:52.688 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0631999999999997e-05 2024-09-12T22:32:52.688 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.688 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.688 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:52.688 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405392+0000", 2024-09-12T22:32:52.688 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0038830449999999999 2024-09-12T22:32:52.689 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.689 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.689 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:52.689 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405690+0000", 2024-09-12T22:32:52.689 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000298435 2024-09-12T22:32:52.689 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.689 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.689 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:52.689 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405716+0000", 2024-09-12T22:32:52.689 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5435999999999998e-05 2024-09-12T22:32:52.689 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.689 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.689 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:52.690 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405736+0000", 2024-09-12T22:32:52.690 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0208999999999999e-05 2024-09-12T22:32:52.690 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:52.690 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:52.690 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:52.690 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.690 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.690 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:32:52.690 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394411+0000", 2024-09-12T22:32:52.691 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 84.274303364999994, 2024-09-12T22:32:52.691 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011400117, 2024-09-12T22:32:52.691 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:52.691 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:52.691 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:52.691 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:52.691 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:52.691 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:52.691 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 187 2024-09-12T22:32:52.691 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.692 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:52.692 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.692 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:52.692 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394411+0000", 2024-09-12T22:32:52.692 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:52.692 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.692 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.692 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:52.692 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394411+0000", 2024-09-12T22:32:52.692 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:52.692 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.693 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.693 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:52.693 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394412+0000", 2024-09-12T22:32:52.693 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.4999999999999999e-07 2024-09-12T22:32:52.693 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.693 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.693 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:52.693 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394414+0000", 2024-09-12T22:32:52.693 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.984e-06 2024-09-12T22:32:52.693 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.693 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.693 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:52.693 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394418+0000", 2024-09-12T22:32:52.694 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0840000000000002e-06 2024-09-12T22:32:52.694 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.694 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.694 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:52.694 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394431+0000", 2024-09-12T22:32:52.694 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.361e-05 2024-09-12T22:32:52.694 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.694 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.694 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:52.694 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401778+0000", 2024-09-12T22:32:52.694 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0073462659999999997 2024-09-12T22:32:52.694 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.694 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.694 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:52.695 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401853+0000", 2024-09-12T22:32:52.695 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5797000000000006e-05 2024-09-12T22:32:52.695 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.695 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.695 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:52.695 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401990+0000", 2024-09-12T22:32:52.695 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013651399999999999 2024-09-12T22:32:52.695 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.695 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.695 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:52.695 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405402+0000", 2024-09-12T22:32:52.695 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0034116070000000001 2024-09-12T22:32:52.695 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.695 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.696 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:52.696 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405764+0000", 2024-09-12T22:32:52.696 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00036234899999999998 2024-09-12T22:32:52.696 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.696 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.696 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:52.696 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405791+0000", 2024-09-12T22:32:52.696 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7029000000000002e-05 2024-09-12T22:32:52.696 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.696 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.696 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:52.697 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405812+0000", 2024-09-12T22:32:52.697 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0627000000000001e-05 2024-09-12T22:32:52.697 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:52.697 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:52.697 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:52.697 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.697 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.697 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:32:52.697 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394447+0000", 2024-09-12T22:32:52.697 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 84.274268214000003, 2024-09-12T22:32:52.697 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011759588, 2024-09-12T22:32:52.697 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:52.697 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:52.697 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:52.697 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:52.698 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:52.698 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:52.698 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 188 2024-09-12T22:32:52.698 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.698 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:52.698 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.698 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:52.698 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394447+0000", 2024-09-12T22:32:52.698 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:52.698 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.698 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.698 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:52.698 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394447+0000", 2024-09-12T22:32:52.698 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:52.698 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.699 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.699 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:52.699 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394447+0000", 2024-09-12T22:32:52.699 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.15e-07 2024-09-12T22:32:52.699 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.699 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.699 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:52.699 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394512+0000", 2024-09-12T22:32:52.699 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4580999999999997e-05 2024-09-12T22:32:52.699 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.699 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.699 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:52.699 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394518+0000", 2024-09-12T22:32:52.699 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.3380000000000001e-06 2024-09-12T22:32:52.700 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.700 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.700 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:52.700 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394521+0000", 2024-09-12T22:32:52.700 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3340000000000002e-06 2024-09-12T22:32:52.700 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.700 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.700 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:52.700 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.402628+0000", 2024-09-12T22:32:52.700 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.008106996 2024-09-12T22:32:52.700 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.700 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.700 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:52.700 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.402670+0000", 2024-09-12T22:32:52.700 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1983000000000001e-05 2024-09-12T22:32:52.701 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.701 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.701 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:52.701 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.402738+0000", 2024-09-12T22:32:52.701 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.8114999999999994e-05 2024-09-12T22:32:52.701 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.701 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.701 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:52.701 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405668+0000", 2024-09-12T22:32:52.701 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.002929545 2024-09-12T22:32:52.701 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.701 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.701 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:52.701 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406162+0000", 2024-09-12T22:32:52.701 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000494408 2024-09-12T22:32:52.702 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.702 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.702 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:52.702 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406188+0000", 2024-09-12T22:32:52.702 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5766e-05 2024-09-12T22:32:52.702 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.702 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.702 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:52.702 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406206+0000", 2024-09-12T22:32:52.702 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.8107000000000001e-05 2024-09-12T22:32:52.702 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:52.702 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:52.702 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:52.702 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.703 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.703 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:32:52.703 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394528+0000", 2024-09-12T22:32:52.703 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 84.274186545000006, 2024-09-12T22:32:52.703 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.01195536, 2024-09-12T22:32:52.703 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:52.703 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:52.703 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:52.703 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:52.703 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:52.703 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:52.703 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 189 2024-09-12T22:32:52.703 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.703 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:52.704 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.704 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:52.704 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394528+0000", 2024-09-12T22:32:52.704 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:52.704 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.704 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.704 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:52.704 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394528+0000", 2024-09-12T22:32:52.704 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:52.704 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.704 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.704 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:52.704 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394529+0000", 2024-09-12T22:32:52.705 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4900000000000001e-07 2024-09-12T22:32:52.705 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.705 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.705 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:52.705 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394531+0000", 2024-09-12T22:32:52.705 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.458e-06 2024-09-12T22:32:52.705 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.705 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.705 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:52.705 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394535+0000", 2024-09-12T22:32:52.705 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7900000000000001e-06 2024-09-12T22:32:52.705 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.705 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.705 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:52.706 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394537+0000", 2024-09-12T22:32:52.706 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.632e-06 2024-09-12T22:32:52.706 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.706 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.706 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:52.706 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.404932+0000", 2024-09-12T22:32:52.706 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010394158000000001 2024-09-12T22:32:52.706 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.706 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.706 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:52.706 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405017+0000", 2024-09-12T22:32:52.706 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5525000000000005e-05 2024-09-12T22:32:52.706 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.707 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.707 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:52.707 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405114+0000", 2024-09-12T22:32:52.707 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.6527000000000006e-05 2024-09-12T22:32:52.707 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.707 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.707 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:52.707 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405818+0000", 2024-09-12T22:32:52.707 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00070412800000000005 2024-09-12T22:32:52.707 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.707 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.707 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:52.707 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406437+0000", 2024-09-12T22:32:52.707 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00061898900000000002 2024-09-12T22:32:52.707 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.708 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.708 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:52.708 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406463+0000", 2024-09-12T22:32:52.708 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6268e-05 2024-09-12T22:32:52.708 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.708 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.708 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:52.708 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406484+0000", 2024-09-12T22:32:52.708 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0536000000000001e-05 2024-09-12T22:32:52.708 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:52.708 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:52.708 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:52.708 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.708 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.709 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:52.709 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.401422+0000", 2024-09-12T22:32:52.709 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 75.267292639999994, 2024-09-12T22:32:52.709 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016896452999999999, 2024-09-12T22:32:52.709 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:52.709 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:52.709 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:52.709 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:52.709 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.709 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:52.709 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401422+0000", 2024-09-12T22:32:52.709 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:52.709 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.709 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.710 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:52.710 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401422+0000", 2024-09-12T22:32:52.710 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:52.710 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.710 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.710 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:52.710 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401424+0000", 2024-09-12T22:32:52.710 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9e-06 2024-09-12T22:32:52.710 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.710 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.710 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:52.710 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401437+0000", 2024-09-12T22:32:52.710 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2831e-05 2024-09-12T22:32:52.710 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.711 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.711 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:52.711 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401471+0000", 2024-09-12T22:32:52.711 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4010000000000001e-05 2024-09-12T22:32:52.711 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.711 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.711 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:52.711 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401484+0000", 2024-09-12T22:32:52.711 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2711000000000001e-05 2024-09-12T22:32:52.711 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.711 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.711 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:52.711 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405410+0000", 2024-09-12T22:32:52.711 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0039259170000000001 2024-09-12T22:32:52.712 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.712 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.712 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:52.712 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405529+0000", 2024-09-12T22:32:52.712 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000119778 2024-09-12T22:32:52.712 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.712 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.712 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:52.712 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405655+0000", 2024-09-12T22:32:52.712 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012556700000000001 2024-09-12T22:32:52.712 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.712 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.712 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:52.713 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410456+0000", 2024-09-12T22:32:52.713 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0048008269999999997 2024-09-12T22:32:52.713 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.713 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.713 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:52.713 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418226+0000", 2024-09-12T22:32:52.713 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0077707729999999999 2024-09-12T22:32:52.713 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.713 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.713 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:52.713 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418277+0000", 2024-09-12T22:32:52.713 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0476000000000003e-05 2024-09-12T22:32:52.713 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.714 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.714 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:52.714 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418319+0000", 2024-09-12T22:32:52.714 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1662999999999997e-05 2024-09-12T22:32:52.714 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:52.714 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:52.714 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:52.714 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.714 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.714 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:52.714 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.401505+0000", 2024-09-12T22:32:52.714 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 75.267209976000004, 2024-09-12T22:32:52.714 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016987904000000002, 2024-09-12T22:32:52.714 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:52.715 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:52.715 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:52.715 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:52.715 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.715 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:52.715 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401505+0000", 2024-09-12T22:32:52.715 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:52.715 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.715 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.715 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:52.715 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401505+0000", 2024-09-12T22:32:52.715 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:52.715 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.715 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.716 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:52.716 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401506+0000", 2024-09-12T22:32:52.716 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4700000000000001e-07 2024-09-12T22:32:52.716 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.716 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.716 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:52.716 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401510+0000", 2024-09-12T22:32:52.716 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6609999999999999e-06 2024-09-12T22:32:52.716 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.716 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.716 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:52.716 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401771+0000", 2024-09-12T22:32:52.717 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00026110700000000001 2024-09-12T22:32:52.717 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.717 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.717 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:52.717 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401921+0000", 2024-09-12T22:32:52.717 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014939099999999999 2024-09-12T22:32:52.717 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.717 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.717 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:52.717 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405944+0000", 2024-09-12T22:32:52.717 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0040235449999999999 2024-09-12T22:32:52.717 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.717 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.717 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:52.717 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406018+0000", 2024-09-12T22:32:52.718 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3373000000000004e-05 2024-09-12T22:32:52.718 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.718 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.718 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:52.718 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406172+0000", 2024-09-12T22:32:52.718 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00015435399999999999 2024-09-12T22:32:52.718 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.718 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.718 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:52.718 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410461+0000", 2024-09-12T22:32:52.718 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0042888609999999997 2024-09-12T22:32:52.718 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.718 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.718 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:52.719 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418371+0000", 2024-09-12T22:32:52.719 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0079098380000000006 2024-09-12T22:32:52.719 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.719 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.719 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:52.719 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418443+0000", 2024-09-12T22:32:52.719 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2705000000000003e-05 2024-09-12T22:32:52.719 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.719 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.719 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:52.719 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418493+0000", 2024-09-12T22:32:52.719 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9322e-05 2024-09-12T22:32:52.719 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:52.720 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:52.720 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:52.720 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.720 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.720 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:52.720 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.401939+0000", 2024-09-12T22:32:52.720 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 75.266776239999999, 2024-09-12T22:32:52.720 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016722292999999999, 2024-09-12T22:32:52.720 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:52.720 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:52.720 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:52.720 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:52.721 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.721 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:52.721 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401939+0000", 2024-09-12T22:32:52.721 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:52.721 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.721 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.721 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:52.721 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401939+0000", 2024-09-12T22:32:52.721 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:52.721 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.721 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.721 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:52.721 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401940+0000", 2024-09-12T22:32:52.721 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1990000000000001e-06 2024-09-12T22:32:52.722 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.722 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.722 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:52.722 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401956+0000", 2024-09-12T22:32:52.722 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.6344000000000001e-05 2024-09-12T22:32:52.722 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.722 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.722 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:52.722 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401974+0000", 2024-09-12T22:32:52.722 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7730000000000001e-05 2024-09-12T22:32:52.722 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.722 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.722 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:52.723 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401982+0000", 2024-09-12T22:32:52.723 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.7800000000000001e-06 2024-09-12T22:32:52.723 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.723 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.723 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:52.723 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406557+0000", 2024-09-12T22:32:52.723 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0045758489999999999 2024-09-12T22:32:52.723 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.723 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.723 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:52.723 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406697+0000", 2024-09-12T22:32:52.723 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013925100000000001 2024-09-12T22:32:52.723 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.724 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.724 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:52.724 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406830+0000", 2024-09-12T22:32:52.724 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013293499999999999 2024-09-12T22:32:52.724 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.724 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.724 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:52.724 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410465+0000", 2024-09-12T22:32:52.724 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0036352680000000001 2024-09-12T22:32:52.724 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.724 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.724 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:52.724 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418564+0000", 2024-09-12T22:32:52.724 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0080992140000000004 2024-09-12T22:32:52.725 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.725 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.725 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:52.725 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418621+0000", 2024-09-12T22:32:52.725 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7167999999999999e-05 2024-09-12T22:32:52.725 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.725 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.725 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:52.725 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418661+0000", 2024-09-12T22:32:52.725 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9555000000000003e-05 2024-09-12T22:32:52.725 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:52.725 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:52.725 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:52.725 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.726 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.726 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:52.726 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.401994+0000", 2024-09-12T22:32:52.726 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 75.266720367999994, 2024-09-12T22:32:52.726 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016804109000000001, 2024-09-12T22:32:52.726 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:52.726 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:52.726 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:52.726 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:52.726 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.726 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:52.726 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401994+0000", 2024-09-12T22:32:52.726 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:52.726 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.727 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.727 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:52.727 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401994+0000", 2024-09-12T22:32:52.727 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:52.727 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.727 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.727 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:52.727 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401995+0000", 2024-09-12T22:32:52.727 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.8899999999999998e-07 2024-09-12T22:32:52.727 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.727 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.727 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:52.727 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402000+0000", 2024-09-12T22:32:52.728 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.498e-06 2024-09-12T22:32:52.728 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.728 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.728 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:52.728 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402007+0000", 2024-09-12T22:32:52.728 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.554e-06 2024-09-12T22:32:52.728 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.728 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.728 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:52.728 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402046+0000", 2024-09-12T22:32:52.728 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9156000000000003e-05 2024-09-12T22:32:52.728 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.728 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.729 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:52.729 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407342+0000", 2024-09-12T22:32:52.729 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052957610000000004 2024-09-12T22:32:52.729 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.729 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.729 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:52.729 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407521+0000", 2024-09-12T22:32:52.729 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00017878100000000001 2024-09-12T22:32:52.729 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.729 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.729 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:52.729 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407641+0000", 2024-09-12T22:32:52.729 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012013 2024-09-12T22:32:52.730 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.730 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.730 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:52.730 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410472+0000", 2024-09-12T22:32:52.730 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.002830455 2024-09-12T22:32:52.730 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.730 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.730 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:52.730 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418714+0000", 2024-09-12T22:32:52.730 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0082422789999999999 2024-09-12T22:32:52.730 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.730 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.730 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:52.730 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418761+0000", 2024-09-12T22:32:52.731 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6956999999999998e-05 2024-09-12T22:32:52.731 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.731 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.731 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:52.731 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418799+0000", 2024-09-12T22:32:52.731 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7749000000000001e-05 2024-09-12T22:32:52.731 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:52.731 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:52.731 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:52.731 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.731 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.731 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:52.731 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.402060+0000", 2024-09-12T22:32:52.732 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 75.266654923999994, 2024-09-12T22:32:52.732 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016885686, 2024-09-12T22:32:52.732 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:52.732 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:52.732 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:52.732 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:52.732 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.732 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:52.732 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402060+0000", 2024-09-12T22:32:52.732 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:52.732 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.732 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.733 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:52.733 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402060+0000", 2024-09-12T22:32:52.733 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:52.733 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.733 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.733 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:52.733 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402061+0000", 2024-09-12T22:32:52.733 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4399999999999999e-07 2024-09-12T22:32:52.733 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.733 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.733 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:52.733 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402066+0000", 2024-09-12T22:32:52.734 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8649999999999998e-06 2024-09-12T22:32:52.734 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.734 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.734 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:52.734 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402146+0000", 2024-09-12T22:32:52.734 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9054000000000006e-05 2024-09-12T22:32:52.734 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.734 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.734 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:52.734 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402287+0000", 2024-09-12T22:32:52.734 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014108600000000001 2024-09-12T22:32:52.735 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.735 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.735 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:52.735 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408185+0000", 2024-09-12T22:32:52.735 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0058983919999999997 2024-09-12T22:32:52.735 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.735 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.735 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:52.735 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408299+0000", 2024-09-12T22:32:52.735 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114102 2024-09-12T22:32:52.735 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.735 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.736 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:52.736 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408420+0000", 2024-09-12T22:32:52.736 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000120492 2024-09-12T22:32:52.736 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.736 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.736 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:52.736 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410867+0000", 2024-09-12T22:32:52.736 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0024476430000000002 2024-09-12T22:32:52.736 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.736 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.736 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:52.736 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418851+0000", 2024-09-12T22:32:52.736 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0079841489999999994 2024-09-12T22:32:52.736 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.737 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.737 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:52.737 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418894+0000", 2024-09-12T22:32:52.737 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3090000000000002e-05 2024-09-12T22:32:52.737 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.737 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.737 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:52.737 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418946+0000", 2024-09-12T22:32:52.737 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1069000000000002e-05 2024-09-12T22:32:52.737 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:52.737 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:52.737 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:52.737 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.738 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.738 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:52.738 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.402375+0000", 2024-09-12T22:32:52.738 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 75.266339858999999, 2024-09-12T22:32:52.738 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016768531999999999, 2024-09-12T22:32:52.738 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:52.738 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:52.738 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:52.738 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:52.738 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.738 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:52.738 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402375+0000", 2024-09-12T22:32:52.738 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:52.739 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.739 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.739 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:52.739 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402375+0000", 2024-09-12T22:32:52.739 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:52.739 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.739 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.739 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:52.739 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402375+0000", 2024-09-12T22:32:52.739 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4099999999999999e-07 2024-09-12T22:32:52.739 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.739 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.740 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:52.740 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402379+0000", 2024-09-12T22:32:52.740 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9870000000000001e-06 2024-09-12T22:32:52.740 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.740 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.740 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:52.740 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402389+0000", 2024-09-12T22:32:52.740 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0000000000000001e-05 2024-09-12T22:32:52.740 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.740 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.740 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:52.740 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402401+0000", 2024-09-12T22:32:52.740 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.148e-05 2024-09-12T22:32:52.740 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.741 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.741 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:52.741 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409108+0000", 2024-09-12T22:32:52.741 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0067068429999999997 2024-09-12T22:32:52.741 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.741 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.741 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:52.741 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409189+0000", 2024-09-12T22:32:52.741 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0815999999999993e-05 2024-09-12T22:32:52.741 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.741 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.741 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:52.741 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409320+0000", 2024-09-12T22:32:52.741 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000131586 2024-09-12T22:32:52.742 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.742 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.742 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:52.742 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410872+0000", 2024-09-12T22:32:52.742 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0015521599999999999 2024-09-12T22:32:52.742 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.742 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.742 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:52.742 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419049+0000", 2024-09-12T22:32:52.742 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0081763719999999995 2024-09-12T22:32:52.742 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.742 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.742 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:52.743 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419107+0000", 2024-09-12T22:32:52.743 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7899000000000002e-05 2024-09-12T22:32:52.743 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.743 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.743 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:52.743 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419143+0000", 2024-09-12T22:32:52.743 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6847999999999997e-05 2024-09-12T22:32:52.743 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:52.743 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:52.743 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:52.743 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.743 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.744 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:52.744 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.402903+0000", 2024-09-12T22:32:52.744 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 75.265811447000004, 2024-09-12T22:32:52.744 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016378428, 2024-09-12T22:32:52.744 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:52.744 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:52.744 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:52.744 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:52.744 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.744 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:52.744 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402903+0000", 2024-09-12T22:32:52.744 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:52.745 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.745 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.745 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:52.745 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402903+0000", 2024-09-12T22:32:52.745 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:52.745 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.745 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.745 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:52.745 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402904+0000", 2024-09-12T22:32:52.745 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9500000000000001e-07 2024-09-12T22:32:52.745 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.745 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.745 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:52.746 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402944+0000", 2024-09-12T22:32:52.746 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0265000000000002e-05 2024-09-12T22:32:52.746 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.746 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.746 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:52.746 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402979+0000", 2024-09-12T22:32:52.746 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4378000000000002e-05 2024-09-12T22:32:52.746 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.746 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.746 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:52.746 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402987+0000", 2024-09-12T22:32:52.746 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3559999999999993e-06 2024-09-12T22:32:52.746 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.747 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.747 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:52.747 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409577+0000", 2024-09-12T22:32:52.747 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0065901709999999997 2024-09-12T22:32:52.747 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.747 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.747 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:52.747 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409653+0000", 2024-09-12T22:32:52.747 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5819e-05 2024-09-12T22:32:52.747 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.747 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.747 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:52.747 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409725+0000", 2024-09-12T22:32:52.748 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2200000000000007e-05 2024-09-12T22:32:52.748 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.748 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.748 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:52.748 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.411234+0000", 2024-09-12T22:32:52.748 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001508225 2024-09-12T22:32:52.748 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.748 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.748 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:52.748 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419212+0000", 2024-09-12T22:32:52.748 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0079783400000000004 2024-09-12T22:32:52.748 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.748 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.749 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:52.749 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419244+0000", 2024-09-12T22:32:52.749 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2384e-05 2024-09-12T22:32:52.749 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.749 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.749 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:52.749 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419282+0000", 2024-09-12T22:32:52.749 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7394999999999997e-05 2024-09-12T22:32:52.749 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:52.749 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:52.749 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:52.749 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.749 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.749 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:52.750 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.403135+0000", 2024-09-12T22:32:52.750 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 75.265579576999997, 2024-09-12T22:32:52.750 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016294211999999999, 2024-09-12T22:32:52.750 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:52.750 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:52.750 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:52.750 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:52.750 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.750 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:52.750 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403135+0000", 2024-09-12T22:32:52.750 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:52.750 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.750 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.751 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:52.751 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403135+0000", 2024-09-12T22:32:52.751 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:52.751 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.751 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.751 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:52.751 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403136+0000", 2024-09-12T22:32:52.751 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.4e-07 2024-09-12T22:32:52.751 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.751 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.751 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:52.751 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403149+0000", 2024-09-12T22:32:52.751 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2723e-05 2024-09-12T22:32:52.751 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.752 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.752 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:52.752 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403158+0000", 2024-09-12T22:32:52.752 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3919999999999992e-06 2024-09-12T22:32:52.752 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.752 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.752 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:52.752 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403166+0000", 2024-09-12T22:32:52.752 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.2309999999999996e-06 2024-09-12T22:32:52.752 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.752 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.752 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:52.752 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409944+0000", 2024-09-12T22:32:52.752 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0067775309999999998 2024-09-12T22:32:52.753 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.753 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.753 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:52.753 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410032+0000", 2024-09-12T22:32:52.753 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.7906999999999997e-05 2024-09-12T22:32:52.753 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.753 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.753 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:52.753 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410152+0000", 2024-09-12T22:32:52.753 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012037800000000001 2024-09-12T22:32:52.753 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.753 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.754 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:52.754 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.411945+0000", 2024-09-12T22:32:52.754 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0017931850000000001 2024-09-12T22:32:52.754 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.754 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.754 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:52.754 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419319+0000", 2024-09-12T22:32:52.754 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0073731780000000002 2024-09-12T22:32:52.754 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.754 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.754 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:52.754 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419376+0000", 2024-09-12T22:32:52.754 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7728e-05 2024-09-12T22:32:52.755 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.755 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.755 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:52.755 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419429+0000", 2024-09-12T22:32:52.755 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3019000000000002e-05 2024-09-12T22:32:52.755 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:52.755 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:52.755 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:52.755 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.755 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.755 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:52.755 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.403185+0000", 2024-09-12T22:32:52.755 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 75.265529696000002, 2024-09-12T22:32:52.756 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.014902164000000001, 2024-09-12T22:32:52.756 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:52.756 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:52.756 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:52.756 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:52.756 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.756 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:52.756 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403185+0000", 2024-09-12T22:32:52.756 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:52.756 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.756 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.756 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:52.756 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403185+0000", 2024-09-12T22:32:52.756 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:52.757 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.757 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.757 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:52.757 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403186+0000", 2024-09-12T22:32:52.757 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9400000000000005e-07 2024-09-12T22:32:52.757 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.757 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.757 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:52.757 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403191+0000", 2024-09-12T22:32:52.757 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6980000000000003e-06 2024-09-12T22:32:52.757 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.757 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.757 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:52.758 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403199+0000", 2024-09-12T22:32:52.758 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2520000000000002e-06 2024-09-12T22:32:52.758 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.758 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.758 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:52.758 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403205+0000", 2024-09-12T22:32:52.758 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.908e-06 2024-09-12T22:32:52.758 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.758 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.758 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:52.758 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403359+0000", 2024-09-12T22:32:52.758 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000154544 2024-09-12T22:32:52.758 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.759 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.759 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:52.759 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403528+0000", 2024-09-12T22:32:52.759 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000168455 2024-09-12T22:32:52.759 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.759 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.759 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:52.759 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403763+0000", 2024-09-12T22:32:52.759 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00023539599999999999 2024-09-12T22:32:52.759 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.759 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.759 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:52.759 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409378+0000", 2024-09-12T22:32:52.760 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056150000000000002 2024-09-12T22:32:52.760 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.760 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.760 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:52.760 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418012+0000", 2024-09-12T22:32:52.760 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0086339559999999999 2024-09-12T22:32:52.760 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.760 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.760 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:52.760 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418046+0000", 2024-09-12T22:32:52.760 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4267999999999998e-05 2024-09-12T22:32:52.760 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.760 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.760 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:52.761 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418087+0000", 2024-09-12T22:32:52.761 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0992999999999999e-05 2024-09-12T22:32:52.761 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:52.761 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:52.761 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:52.761 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.761 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.761 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:52.761 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.403273+0000", 2024-09-12T22:32:52.761 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 75.265441745000004, 2024-09-12T22:32:52.761 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.014934866, 2024-09-12T22:32:52.761 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:52.762 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:52.762 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:52.762 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:52.762 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.762 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:52.762 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403273+0000", 2024-09-12T22:32:52.762 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:52.762 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.762 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.762 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:52.762 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403273+0000", 2024-09-12T22:32:52.762 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:52.762 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.762 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.763 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:52.763 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403274+0000", 2024-09-12T22:32:52.763 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.297e-06 2024-09-12T22:32:52.763 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.763 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.763 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:52.763 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403282+0000", 2024-09-12T22:32:52.763 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6340000000000001e-06 2024-09-12T22:32:52.763 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.763 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.763 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:52.763 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403305+0000", 2024-09-12T22:32:52.763 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3149000000000001e-05 2024-09-12T22:32:52.763 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.764 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.764 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:52.764 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403320+0000", 2024-09-12T22:32:52.764 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4527e-05 2024-09-12T22:32:52.764 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.764 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.764 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:52.764 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.404928+0000", 2024-09-12T22:32:52.764 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001608459 2024-09-12T22:32:52.764 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.764 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.764 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:52.764 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405218+0000", 2024-09-12T22:32:52.765 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00028982900000000002 2024-09-12T22:32:52.765 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.765 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.765 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:52.765 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405829+0000", 2024-09-12T22:32:52.765 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00061127900000000005 2024-09-12T22:32:52.765 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.765 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.765 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:52.765 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409403+0000", 2024-09-12T22:32:52.765 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.003573597 2024-09-12T22:32:52.765 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.765 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.766 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:52.766 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418138+0000", 2024-09-12T22:32:52.766 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0087349969999999996 2024-09-12T22:32:52.766 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.766 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.766 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:52.766 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418178+0000", 2024-09-12T22:32:52.766 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0649999999999999e-05 2024-09-12T22:32:52.766 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.766 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.766 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:52.766 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418208+0000", 2024-09-12T22:32:52.766 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9448e-05 2024-09-12T22:32:52.766 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:52.767 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:52.767 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:52.767 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.767 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.767 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:52.767 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.405456+0000", 2024-09-12T22:32:52.767 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 75.2632586, 2024-09-12T22:32:52.767 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012888389, 2024-09-12T22:32:52.767 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:52.767 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:52.767 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:52.767 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:52.767 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.768 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:52.768 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405456+0000", 2024-09-12T22:32:52.768 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:52.768 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.768 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.768 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:52.768 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405456+0000", 2024-09-12T22:32:52.768 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:52.768 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.768 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.768 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:52.768 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405457+0000", 2024-09-12T22:32:52.768 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.6599999999999994e-07 2024-09-12T22:32:52.768 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.768 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.769 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:52.769 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405463+0000", 2024-09-12T22:32:52.769 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4739999999999996e-06 2024-09-12T22:32:52.769 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.769 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.769 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:52.769 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405474+0000", 2024-09-12T22:32:52.769 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1095e-05 2024-09-12T22:32:52.769 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.769 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.769 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:52.769 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405482+0000", 2024-09-12T22:32:52.769 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3610000000000001e-06 2024-09-12T22:32:52.770 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.770 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.770 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:52.770 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407051+0000", 2024-09-12T22:32:52.770 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0015688970000000001 2024-09-12T22:32:52.770 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.770 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.770 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:52.770 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407259+0000", 2024-09-12T22:32:52.770 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00020778300000000001 2024-09-12T22:32:52.770 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.770 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.770 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:52.771 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407622+0000", 2024-09-12T22:32:52.771 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000363066 2024-09-12T22:32:52.771 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.771 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.771 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:52.771 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409438+0000", 2024-09-12T22:32:52.771 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001816319 2024-09-12T22:32:52.771 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.771 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.771 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:52.771 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418257+0000", 2024-09-12T22:32:52.771 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0088187720000000008 2024-09-12T22:32:52.771 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.772 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.772 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:52.772 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418308+0000", 2024-09-12T22:32:52.772 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1180000000000001e-05 2024-09-12T22:32:52.772 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.772 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.772 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:52.772 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418345+0000", 2024-09-12T22:32:52.772 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6476000000000001e-05 2024-09-12T22:32:52.772 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:52.772 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:52.772 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:52.772 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.773 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.773 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:52.773 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.405496+0000", 2024-09-12T22:32:52.773 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 75.263219242999995, 2024-09-12T22:32:52.773 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013016012, 2024-09-12T22:32:52.773 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:52.773 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:52.773 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:52.773 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:52.773 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.773 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:52.773 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405496+0000", 2024-09-12T22:32:52.773 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:52.774 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.774 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.774 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:52.774 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405496+0000", 2024-09-12T22:32:52.774 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:52.774 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.774 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.774 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:52.774 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405496+0000", 2024-09-12T22:32:52.774 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7999999999999995e-07 2024-09-12T22:32:52.774 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.774 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.774 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:52.775 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405501+0000", 2024-09-12T22:32:52.775 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8359999999999999e-06 2024-09-12T22:32:52.775 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.775 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.775 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:52.775 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405514+0000", 2024-09-12T22:32:52.775 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2522e-05 2024-09-12T22:32:52.775 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.775 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.775 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:52.775 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405521+0000", 2024-09-12T22:32:52.775 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5020000000000003e-06 2024-09-12T22:32:52.775 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.776 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.776 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:52.776 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405575+0000", 2024-09-12T22:32:52.776 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4169999999999998e-05 2024-09-12T22:32:52.776 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.776 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.776 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:52.776 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405697+0000", 2024-09-12T22:32:52.776 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000121301 2024-09-12T22:32:52.776 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.776 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.777 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:52.777 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405829+0000", 2024-09-12T22:32:52.777 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000132662 2024-09-12T22:32:52.777 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.777 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.777 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:52.777 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409155+0000", 2024-09-12T22:32:52.777 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0033259050000000001 2024-09-12T22:32:52.777 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.777 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.777 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:52.777 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418425+0000", 2024-09-12T22:32:52.777 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0092696319999999999 2024-09-12T22:32:52.778 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.778 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.778 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:52.778 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418471+0000", 2024-09-12T22:32:52.778 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6213e-05 2024-09-12T22:32:52.778 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.778 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.778 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:52.778 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418512+0000", 2024-09-12T22:32:52.778 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0589000000000001e-05 2024-09-12T22:32:52.778 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:52.778 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:52.778 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:52.778 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.778 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.779 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:52.779 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.406108+0000", 2024-09-12T22:32:52.779 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 75.262606845999997, 2024-09-12T22:32:52.779 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012458175, 2024-09-12T22:32:52.779 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:52.779 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:52.779 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:52.779 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:52.779 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.779 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:52.779 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406108+0000", 2024-09-12T22:32:52.779 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:52.779 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.780 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.780 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:52.780 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406108+0000", 2024-09-12T22:32:52.780 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:52.780 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.780 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.780 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:52.780 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406109+0000", 2024-09-12T22:32:52.780 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9899999999999999e-07 2024-09-12T22:32:52.780 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.780 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.780 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:52.780 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406115+0000", 2024-09-12T22:32:52.780 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9030000000000001e-06 2024-09-12T22:32:52.781 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.781 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.781 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:52.781 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406141+0000", 2024-09-12T22:32:52.781 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5999e-05 2024-09-12T22:32:52.781 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.781 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.781 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:52.781 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406150+0000", 2024-09-12T22:32:52.781 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.6050000000000004e-06 2024-09-12T22:32:52.781 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.781 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.781 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:52.781 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408163+0000", 2024-09-12T22:32:52.782 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0020122769999999998 2024-09-12T22:32:52.782 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.782 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.782 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:52.782 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408309+0000", 2024-09-12T22:32:52.782 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014606999999999999 2024-09-12T22:32:52.782 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.782 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.782 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:52.782 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408433+0000", 2024-09-12T22:32:52.782 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012460300000000001 2024-09-12T22:32:52.782 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.783 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.783 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:52.783 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409903+0000", 2024-09-12T22:32:52.783 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001469499 2024-09-12T22:32:52.783 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.783 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.783 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:52.783 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418427+0000", 2024-09-12T22:32:52.783 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0085241139999999993 2024-09-12T22:32:52.783 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.783 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.783 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:52.783 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418471+0000", 2024-09-12T22:32:52.783 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4474000000000001e-05 2024-09-12T22:32:52.784 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.784 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.784 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:52.784 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418566+0000", 2024-09-12T22:32:52.784 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.4732e-05 2024-09-12T22:32:52.784 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:52.784 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:52.784 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:52.784 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.784 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.784 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:52.784 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.407266+0000", 2024-09-12T22:32:52.785 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 75.261448990000005, 2024-09-12T22:32:52.785 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011442905, 2024-09-12T22:32:52.785 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:52.785 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:52.785 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2024-09-12T22:32:52.785 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:52.785 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.785 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:52.785 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407266+0000", 2024-09-12T22:32:52.785 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:52.785 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.785 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.786 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:52.786 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407266+0000", 2024-09-12T22:32:52.786 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:52.786 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.786 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.786 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:52.786 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407266+0000", 2024-09-12T22:32:52.786 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7899999999999998e-07 2024-09-12T22:32:52.786 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.786 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.786 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:52.787 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407269+0000", 2024-09-12T22:32:52.787 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9210000000000001e-06 2024-09-12T22:32:52.787 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.787 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.787 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:52.787 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407331+0000", 2024-09-12T22:32:52.787 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1376000000000003e-05 2024-09-12T22:32:52.787 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.787 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.788 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:52.788 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407337+0000", 2024-09-12T22:32:52.788 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1929999999999998e-06 2024-09-12T22:32:52.788 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.788 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.788 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:52.788 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408974+0000", 2024-09-12T22:32:52.788 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0016367109999999999 2024-09-12T22:32:52.788 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.788 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.788 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:52.788 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409112+0000", 2024-09-12T22:32:52.789 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000137952 2024-09-12T22:32:52.789 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:52.789 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:52.789 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:52.789 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418709+0000", 2024-09-12T22:32:52.789 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0095971730000000005 2024-09-12T22:32:52.789 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:52.789 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:52.789 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:52.789 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:52.789 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:52.789 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-09-12T22:32:52.791 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:52.789+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:52.791 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:32:52.891 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:52.890+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:52.896 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:32:52.896 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:32:52.896 INFO:teuthology.orchestra.run.smithi148.stdout: "num_ops": 0 2024-09-12T22:32:52.896 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:32:52.905 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:32:52.992 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:52.991+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:53.008 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:32:53.008 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:32:53.008 INFO:teuthology.orchestra.run.smithi148.stdout: "complaint_time": 30, 2024-09-12T22:32:53.008 INFO:teuthology.orchestra.run.smithi148.stdout: "num_blocked_ops": 0 2024-09-12T22:32:53.008 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:32:53.017 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:32:53.078 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T22:32:53.093 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:53.092+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:53.162 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:32:53.162 INFO:teuthology.orchestra.run.smithi148.stdout: "size": 20, 2024-09-12T22:32:53.162 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 600, 2024-09-12T22:32:53.162 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [ 2024-09-12T22:32:53.162 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.162 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:53.162 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.400880+0000", 2024-09-12T22:32:53.162 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 75.759152521999994, 2024-09-12T22:32:53.162 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0095133660000000005, 2024-09-12T22:32:53.162 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:53.162 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:53.163 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:53.163 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:53.163 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.163 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:53.163 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400880+0000", 2024-09-12T22:32:53.163 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:53.163 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.163 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.163 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:53.163 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400880+0000", 2024-09-12T22:32:53.163 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:53.163 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.163 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.164 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:53.164 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400892+0000", 2024-09-12T22:32:53.164 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1941e-05 2024-09-12T22:32:53.164 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.164 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.164 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:53.164 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400900+0000", 2024-09-12T22:32:53.164 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0080000000000002e-06 2024-09-12T22:32:53.164 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.164 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.164 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:53.164 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400911+0000", 2024-09-12T22:32:53.164 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1452e-05 2024-09-12T22:32:53.165 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.165 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.165 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:53.165 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400922+0000", 2024-09-12T22:32:53.165 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0772e-05 2024-09-12T22:32:53.165 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.165 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.165 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:53.165 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401009+0000", 2024-09-12T22:32:53.165 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.7206000000000005e-05 2024-09-12T22:32:53.165 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.165 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.165 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:53.166 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401157+0000", 2024-09-12T22:32:53.166 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014831499999999999 2024-09-12T22:32:53.166 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.166 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.166 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:53.166 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401312+0000", 2024-09-12T22:32:53.166 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00015495600000000001 2024-09-12T22:32:53.166 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.166 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.166 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:53.166 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.403060+0000", 2024-09-12T22:32:53.166 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0017475220000000001 2024-09-12T22:32:53.166 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.167 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.167 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:53.167 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410300+0000", 2024-09-12T22:32:53.167 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0072403260000000001 2024-09-12T22:32:53.167 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.167 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.167 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:53.167 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410350+0000", 2024-09-12T22:32:53.167 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9814000000000001e-05 2024-09-12T22:32:53.167 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.167 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.167 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:53.167 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410393+0000", 2024-09-12T22:32:53.167 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3053999999999998e-05 2024-09-12T22:32:53.168 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:53.168 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:53.168 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:53.168 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.168 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.168 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:53.168 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.400952+0000", 2024-09-12T22:32:53.168 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 75.759080370000007, 2024-09-12T22:32:53.168 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0096045620000000005, 2024-09-12T22:32:53.168 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:53.168 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:53.168 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:53.168 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:53.168 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.169 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:53.169 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400952+0000", 2024-09-12T22:32:53.169 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:53.169 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.169 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.169 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:53.169 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400952+0000", 2024-09-12T22:32:53.169 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:53.169 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.169 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.169 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:53.169 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400953+0000", 2024-09-12T22:32:53.169 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.8000000000000005e-07 2024-09-12T22:32:53.170 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.170 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.170 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:53.170 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400957+0000", 2024-09-12T22:32:53.170 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.33e-06 2024-09-12T22:32:53.170 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.170 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.170 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:53.170 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400966+0000", 2024-09-12T22:32:53.170 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1989999999999995e-06 2024-09-12T22:32:53.170 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.170 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.170 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:53.170 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400973+0000", 2024-09-12T22:32:53.171 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2779999999999999e-06 2024-09-12T22:32:53.171 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.171 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.171 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:53.171 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401696+0000", 2024-09-12T22:32:53.171 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00072363500000000003 2024-09-12T22:32:53.171 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.171 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.171 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:53.171 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401788+0000", 2024-09-12T22:32:53.171 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1862999999999998e-05 2024-09-12T22:32:53.171 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.171 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.172 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:53.172 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401929+0000", 2024-09-12T22:32:53.172 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014096000000000001 2024-09-12T22:32:53.172 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.172 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.172 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:53.172 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.403542+0000", 2024-09-12T22:32:53.172 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001612963 2024-09-12T22:32:53.172 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.172 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.172 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:53.172 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410460+0000", 2024-09-12T22:32:53.172 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0069180500000000002 2024-09-12T22:32:53.172 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.173 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.173 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:53.173 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410515+0000", 2024-09-12T22:32:53.173 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5009000000000001e-05 2024-09-12T22:32:53.173 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.173 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.173 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:53.173 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410557+0000", 2024-09-12T22:32:53.173 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1495000000000002e-05 2024-09-12T22:32:53.173 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:53.173 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:53.173 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:53.173 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.174 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.174 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:53.174 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.400984+0000", 2024-09-12T22:32:53.174 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 75.759047874999993, 2024-09-12T22:32:53.174 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0073703950000000001, 2024-09-12T22:32:53.174 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:53.174 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:53.174 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:53.174 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:53.174 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.174 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:53.174 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400984+0000", 2024-09-12T22:32:53.174 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:53.175 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.175 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.175 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:53.175 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400984+0000", 2024-09-12T22:32:53.175 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:53.175 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.175 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.175 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:53.175 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400985+0000", 2024-09-12T22:32:53.175 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3200000000000005e-07 2024-09-12T22:32:53.175 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.175 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.175 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:53.175 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400998+0000", 2024-09-12T22:32:53.176 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2726e-05 2024-09-12T22:32:53.176 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.176 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.176 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:53.176 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401006+0000", 2024-09-12T22:32:53.176 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.3110000000000006e-06 2024-09-12T22:32:53.176 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.176 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.176 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:53.176 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401022+0000", 2024-09-12T22:32:53.176 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6249e-05 2024-09-12T22:32:53.176 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.176 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.177 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:53.177 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401700+0000", 2024-09-12T22:32:53.177 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00067811100000000001 2024-09-12T22:32:53.177 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.177 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.177 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:53.177 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401839+0000", 2024-09-12T22:32:53.177 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013865399999999999 2024-09-12T22:32:53.177 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.177 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.177 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:53.177 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401962+0000", 2024-09-12T22:32:53.177 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000123266 2024-09-12T22:32:53.177 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.178 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.178 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:53.178 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.403589+0000", 2024-09-12T22:32:53.178 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001626932 2024-09-12T22:32:53.178 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.178 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.178 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:53.178 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.408274+0000", 2024-09-12T22:32:53.178 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0046848100000000002 2024-09-12T22:32:53.178 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.178 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.178 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:53.178 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.408324+0000", 2024-09-12T22:32:53.178 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9784000000000003e-05 2024-09-12T22:32:53.179 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.179 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.179 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:53.179 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.408355+0000", 2024-09-12T22:32:53.179 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.1019999999999998e-05 2024-09-12T22:32:53.179 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:53.179 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:53.179 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:53.179 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.179 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.179 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:53.179 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401034+0000", 2024-09-12T22:32:53.179 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 75.758998434999995, 2024-09-12T22:32:53.179 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011063051000000001, 2024-09-12T22:32:53.180 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:53.180 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:53.180 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:53.180 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:53.180 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.180 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:53.180 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401034+0000", 2024-09-12T22:32:53.180 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:53.180 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.180 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.180 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:53.180 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401034+0000", 2024-09-12T22:32:53.180 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:53.181 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.181 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.181 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:53.181 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401034+0000", 2024-09-12T22:32:53.181 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8899999999999999e-07 2024-09-12T22:32:53.181 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.181 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.181 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:53.181 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401038+0000", 2024-09-12T22:32:53.181 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.523e-06 2024-09-12T22:32:53.182 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.182 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.182 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:53.182 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401046+0000", 2024-09-12T22:32:53.182 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0479999999999999e-06 2024-09-12T22:32:53.182 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.182 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.182 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:53.182 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401051+0000", 2024-09-12T22:32:53.182 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2619999999999998e-06 2024-09-12T22:32:53.182 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.182 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.182 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:53.183 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402270+0000", 2024-09-12T22:32:53.183 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012182429999999999 2024-09-12T22:32:53.183 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.183 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.183 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:53.183 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402325+0000", 2024-09-12T22:32:53.183 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5526999999999999e-05 2024-09-12T22:32:53.183 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.183 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.183 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:53.183 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402403+0000", 2024-09-12T22:32:53.183 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.7559999999999996e-05 2024-09-12T22:32:53.184 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.184 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.184 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:53.184 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.403655+0000", 2024-09-12T22:32:53.184 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012521489999999999 2024-09-12T22:32:53.184 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.184 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.184 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:53.184 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411979+0000", 2024-09-12T22:32:53.184 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0083240420000000002 2024-09-12T22:32:53.184 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.185 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.185 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:53.185 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.412036+0000", 2024-09-12T22:32:53.185 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7639000000000002e-05 2024-09-12T22:32:53.185 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.185 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.185 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:53.185 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.412097+0000", 2024-09-12T22:32:53.185 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0469e-05 2024-09-12T22:32:53.185 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:53.185 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:53.185 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:53.185 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.186 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.186 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:53.186 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401060+0000", 2024-09-12T22:32:53.186 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 75.758972682999996, 2024-09-12T22:32:53.186 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.010030172, 2024-09-12T22:32:53.186 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:53.186 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:53.186 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:53.186 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:53.186 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.187 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:53.187 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401060+0000", 2024-09-12T22:32:53.187 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:53.187 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.187 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.187 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:53.187 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401060+0000", 2024-09-12T22:32:53.187 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:53.188 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.189 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.189 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:53.189 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401060+0000", 2024-09-12T22:32:53.189 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2500000000000001e-07 2024-09-12T22:32:53.189 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.189 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.189 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:53.189 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401063+0000", 2024-09-12T22:32:53.189 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0910000000000001e-06 2024-09-12T22:32:53.189 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.189 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.190 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:53.190 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401070+0000", 2024-09-12T22:32:53.190 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1210000000000001e-06 2024-09-12T22:32:53.190 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.190 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.190 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:53.190 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401076+0000", 2024-09-12T22:32:53.190 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2830000000000001e-06 2024-09-12T22:32:53.190 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.190 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.191 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:53.191 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402288+0000", 2024-09-12T22:32:53.191 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012123699999999999 2024-09-12T22:32:53.191 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.191 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.191 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:53.191 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402359+0000", 2024-09-12T22:32:53.191 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.0988000000000005e-05 2024-09-12T22:32:53.191 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.191 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.191 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:53.191 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402457+0000", 2024-09-12T22:32:53.191 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.7857999999999997e-05 2024-09-12T22:32:53.192 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.192 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.192 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:53.192 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.404395+0000", 2024-09-12T22:32:53.192 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0019380160000000001 2024-09-12T22:32:53.192 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.192 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.192 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:53.192 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410603+0000", 2024-09-12T22:32:53.192 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.006208061 2024-09-12T22:32:53.192 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.192 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.192 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:53.193 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410687+0000", 2024-09-12T22:32:53.193 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.4623000000000006e-05 2024-09-12T22:32:53.193 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.193 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.193 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:53.193 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411090+0000", 2024-09-12T22:32:53.193 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00040233599999999999 2024-09-12T22:32:53.193 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:53.193 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:53.194 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:53.194 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.194 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.194 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:53.194 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401083+0000", 2024-09-12T22:32:53.194 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 75.758949267000006, 2024-09-12T22:32:53.194 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0097591850000000001, 2024-09-12T22:32:53.194 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:53.195 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:53.195 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:53.195 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:53.195 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.195 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:53.195 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401083+0000", 2024-09-12T22:32:53.195 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:53.195 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.195 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.196 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:53.196 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401083+0000", 2024-09-12T22:32:53.196 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:53.196 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.196 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.196 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:53.196 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401084+0000", 2024-09-12T22:32:53.196 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4799999999999999e-07 2024-09-12T22:32:53.196 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.197 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.197 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:53.197 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401088+0000", 2024-09-12T22:32:53.197 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6419999999999998e-06 2024-09-12T22:32:53.197 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.197 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.197 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:53.197 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401094+0000", 2024-09-12T22:32:53.197 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0090000000000004e-06 2024-09-12T22:32:53.197 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.197 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.197 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:53.198 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401108+0000", 2024-09-12T22:32:53.198 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3884e-05 2024-09-12T22:32:53.198 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.198 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.198 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:53.198 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401165+0000", 2024-09-12T22:32:53.198 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.6499000000000002e-05 2024-09-12T22:32:53.198 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.198 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.198 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:53.198 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401261+0000", 2024-09-12T22:32:53.198 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.6872000000000004e-05 2024-09-12T22:32:53.198 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.199 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.199 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:53.199 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401376+0000", 2024-09-12T22:32:53.199 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000114508 2024-09-12T22:32:53.199 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.199 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.199 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:53.199 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402666+0000", 2024-09-12T22:32:53.199 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012901659999999999 2024-09-12T22:32:53.199 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.199 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.199 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:53.199 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410572+0000", 2024-09-12T22:32:53.199 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0079055489999999996 2024-09-12T22:32:53.200 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.200 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.200 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:53.200 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410661+0000", 2024-09-12T22:32:53.200 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.9578000000000002e-05 2024-09-12T22:32:53.200 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.200 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.200 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:53.200 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410842+0000", 2024-09-12T22:32:53.200 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00018102999999999999 2024-09-12T22:32:53.200 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:53.200 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:53.200 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:53.201 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.201 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.201 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:53.201 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401122+0000", 2024-09-12T22:32:53.201 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 75.758910235000002, 2024-09-12T22:32:53.201 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0099122080000000005, 2024-09-12T22:32:53.201 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:53.201 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:53.201 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:32:53.201 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:53.201 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.201 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:53.201 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401122+0000", 2024-09-12T22:32:53.202 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:53.202 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.202 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.202 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:53.202 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401122+0000", 2024-09-12T22:32:53.202 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:53.202 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.202 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.202 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:53.202 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401123+0000", 2024-09-12T22:32:53.202 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2600000000000002e-07 2024-09-12T22:32:53.202 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.202 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.202 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:53.203 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401126+0000", 2024-09-12T22:32:53.203 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.6449999999999998e-06 2024-09-12T22:32:53.203 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.203 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.203 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:53.203 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401133+0000", 2024-09-12T22:32:53.203 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.9890000000000003e-06 2024-09-12T22:32:53.203 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.203 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.203 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:53.203 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401138+0000", 2024-09-12T22:32:53.203 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8060000000000002e-06 2024-09-12T22:32:53.203 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.203 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.204 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:53.204 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401703+0000", 2024-09-12T22:32:53.204 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00056509099999999999 2024-09-12T22:32:53.204 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.204 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.204 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:53.204 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401837+0000", 2024-09-12T22:32:53.204 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013338799999999999 2024-09-12T22:32:53.204 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.204 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.204 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:53.204 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411034+0000", 2024-09-12T22:32:53.204 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.009197663 2024-09-12T22:32:53.204 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:53.204 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:53.205 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:53.205 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.205 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.205 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:53.205 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401158+0000", 2024-09-12T22:32:53.205 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 75.758874456000001, 2024-09-12T22:32:53.205 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.010292437999999999, 2024-09-12T22:32:53.205 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:53.205 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:53.205 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:32:53.205 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:53.205 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.205 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:53.206 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401158+0000", 2024-09-12T22:32:53.206 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:53.206 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.206 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.206 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:53.206 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401158+0000", 2024-09-12T22:32:53.206 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:53.206 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.206 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.206 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:53.206 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401158+0000", 2024-09-12T22:32:53.206 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9699999999999996e-07 2024-09-12T22:32:53.206 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.206 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.206 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:53.207 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401161+0000", 2024-09-12T22:32:53.207 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.7410000000000001e-06 2024-09-12T22:32:53.207 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.207 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.207 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:53.207 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401168+0000", 2024-09-12T22:32:53.207 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.844e-06 2024-09-12T22:32:53.207 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.207 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.207 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:53.207 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401174+0000", 2024-09-12T22:32:53.207 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4700000000000001e-06 2024-09-12T22:32:53.207 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.208 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.208 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:53.208 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402799+0000", 2024-09-12T22:32:53.208 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0016256409999999999 2024-09-12T22:32:53.208 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.208 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.208 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:53.208 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402893+0000", 2024-09-12T22:32:53.208 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.3807999999999994e-05 2024-09-12T22:32:53.208 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.208 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.208 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:53.209 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411450+0000", 2024-09-12T22:32:53.209 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0085573369999999999 2024-09-12T22:32:53.209 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:53.209 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:53.209 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:53.209 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.209 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.209 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:53.209 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401183+0000", 2024-09-12T22:32:53.209 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 75.758849604000005, 2024-09-12T22:32:53.209 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0068597830000000004, 2024-09-12T22:32:53.209 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:53.209 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:53.210 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:32:53.210 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:53.210 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.210 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:53.210 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401183+0000", 2024-09-12T22:32:53.210 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:53.210 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.210 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.210 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:53.210 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401183+0000", 2024-09-12T22:32:53.210 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:53.210 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.211 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.211 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:53.211 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401183+0000", 2024-09-12T22:32:53.211 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.6700000000000003e-07 2024-09-12T22:32:53.211 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.211 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.211 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:53.211 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401186+0000", 2024-09-12T22:32:53.211 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4679999999999999e-06 2024-09-12T22:32:53.211 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.211 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.211 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:53.211 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401192+0000", 2024-09-12T22:32:53.211 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.1519999999999997e-06 2024-09-12T22:32:53.212 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.212 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.212 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:53.212 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401197+0000", 2024-09-12T22:32:53.212 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4669999999999998e-06 2024-09-12T22:32:53.212 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.212 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.212 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:53.212 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401253+0000", 2024-09-12T22:32:53.212 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.6211000000000001e-05 2024-09-12T22:32:53.212 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.212 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.212 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:53.212 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401413+0000", 2024-09-12T22:32:53.213 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00016021399999999999 2024-09-12T22:32:53.213 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.213 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.213 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:53.213 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.408043+0000", 2024-09-12T22:32:53.213 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0066295039999999996 2024-09-12T22:32:53.213 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:53.213 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:53.213 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:53.213 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.213 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.213 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:20 3.1c e19/17 3:3ed09add:::607.00000000:head v 19'1, mlcod=0'0)", 2024-09-12T22:32:53.213 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.409642+0000", 2024-09-12T22:32:53.213 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 75.750390144999997, 2024-09-12T22:32:53.214 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0038816269999999999, 2024-09-12T22:32:53.214 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:53.214 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:53.214 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:53.214 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:53.214 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.214 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:53.214 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409642+0000", 2024-09-12T22:32:53.214 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:53.214 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.214 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.214 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:53.214 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409642+0000", 2024-09-12T22:32:53.214 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:53.215 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.215 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.215 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:53.215 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409642+0000", 2024-09-12T22:32:53.215 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.6899999999999999e-07 2024-09-12T22:32:53.215 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.215 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.215 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:53.215 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409648+0000", 2024-09-12T22:32:53.215 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.49e-06 2024-09-12T22:32:53.215 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.215 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.215 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:53.215 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409656+0000", 2024-09-12T22:32:53.216 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.2949999999999994e-06 2024-09-12T22:32:53.216 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.216 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.216 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:53.216 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409664+0000", 2024-09-12T22:32:53.216 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.1219999999999995e-06 2024-09-12T22:32:53.216 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.216 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.216 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:53.216 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409707+0000", 2024-09-12T22:32:53.216 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2222000000000003e-05 2024-09-12T22:32:53.216 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.216 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.217 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:53.217 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409724+0000", 2024-09-12T22:32:53.217 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7496999999999999e-05 2024-09-12T22:32:53.217 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.217 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.217 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:53.217 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413439+0000", 2024-09-12T22:32:53.217 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00371448 2024-09-12T22:32:53.217 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.217 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.217 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:53.218 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413524+0000", 2024-09-12T22:32:53.218 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.5252000000000003e-05 2024-09-12T22:32:53.218 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:53.218 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:53.218 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:53.218 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.218 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.218 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:28 3.13 e19/17 3:cd5a64a3:::100.00000000:head v 19'1, mlcod=0'0)", 2024-09-12T22:32:53.218 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.409681+0000", 2024-09-12T22:32:53.218 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 75.750351662, 2024-09-12T22:32:53.218 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0038708710000000001, 2024-09-12T22:32:53.218 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:53.219 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:53.219 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:53.219 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:53.219 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.219 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:53.219 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409681+0000", 2024-09-12T22:32:53.219 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:53.219 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.219 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.219 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:53.219 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409681+0000", 2024-09-12T22:32:53.219 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:53.219 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.220 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.220 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:53.220 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409681+0000", 2024-09-12T22:32:53.220 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3000000000000002e-07 2024-09-12T22:32:53.220 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.220 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.220 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:53.220 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409695+0000", 2024-09-12T22:32:53.220 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4313e-05 2024-09-12T22:32:53.220 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.220 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.221 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:53.221 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409703+0000", 2024-09-12T22:32:53.221 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4000000000000003e-06 2024-09-12T22:32:53.221 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.221 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.221 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:53.221 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409708+0000", 2024-09-12T22:32:53.221 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3190000000000002e-06 2024-09-12T22:32:53.221 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.221 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.221 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:53.221 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409875+0000", 2024-09-12T22:32:53.221 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000167329 2024-09-12T22:32:53.221 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.222 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.222 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:53.222 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409892+0000", 2024-09-12T22:32:53.222 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6957999999999999e-05 2024-09-12T22:32:53.222 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.222 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.222 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:53.222 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413457+0000", 2024-09-12T22:32:53.222 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0035651279999999999 2024-09-12T22:32:53.223 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.223 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.223 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:53.223 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413552+0000", 2024-09-12T22:32:53.223 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.4093999999999997e-05 2024-09-12T22:32:53.223 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:53.223 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:53.223 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:53.223 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.223 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.223 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:21 3.1c e19/17 3:3ed09add:::607.00000000:head v 19'2, mlcod=0'0)", 2024-09-12T22:32:53.223 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.409718+0000", 2024-09-12T22:32:53.224 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 75.750313997000006, 2024-09-12T22:32:53.224 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003851883, 2024-09-12T22:32:53.224 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:53.224 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:53.224 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:53.224 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:53.224 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.224 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:53.224 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409718+0000", 2024-09-12T22:32:53.224 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:53.225 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.225 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.225 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:53.225 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409718+0000", 2024-09-12T22:32:53.225 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:53.225 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.225 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.225 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:53.226 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409719+0000", 2024-09-12T22:32:53.226 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.16e-07 2024-09-12T22:32:53.226 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.226 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.226 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:53.226 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409722+0000", 2024-09-12T22:32:53.226 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.692e-06 2024-09-12T22:32:53.226 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.226 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.226 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:53.226 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409729+0000", 2024-09-12T22:32:53.227 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.516e-06 2024-09-12T22:32:53.227 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.227 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.227 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:53.227 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409750+0000", 2024-09-12T22:32:53.227 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1151000000000001e-05 2024-09-12T22:32:53.227 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.227 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.227 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:53.227 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410015+0000", 2024-09-12T22:32:53.227 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00026477599999999999 2024-09-12T22:32:53.228 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.228 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.228 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:53.228 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410104+0000", 2024-09-12T22:32:53.228 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.9586000000000006e-05 2024-09-12T22:32:53.228 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.228 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.228 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:53.228 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413528+0000", 2024-09-12T22:32:53.228 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0034237880000000001 2024-09-12T22:32:53.228 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.228 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.228 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:53.229 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413570+0000", 2024-09-12T22:32:53.229 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2157999999999999e-05 2024-09-12T22:32:53.229 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:53.229 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:53.229 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:53.229 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.229 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.229 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:27 3.13 e19/17 3:c91d4a1d:::mds0_inotable:head v 19'2, mlcod=0'0)", 2024-09-12T22:32:53.229 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.409760+0000", 2024-09-12T22:32:53.229 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 75.750272480999996, 2024-09-12T22:32:53.229 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0039301910000000004, 2024-09-12T22:32:53.229 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:53.229 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:53.230 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:53.230 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:53.230 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.230 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:53.230 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409760+0000", 2024-09-12T22:32:53.230 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:53.230 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.230 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.230 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:53.230 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409760+0000", 2024-09-12T22:32:53.230 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:53.230 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.230 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.231 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:53.231 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409760+0000", 2024-09-12T22:32:53.231 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.39e-07 2024-09-12T22:32:53.231 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.231 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.231 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:53.231 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409765+0000", 2024-09-12T22:32:53.231 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4449999999999998e-06 2024-09-12T22:32:53.231 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.231 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.231 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:53.231 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409771+0000", 2024-09-12T22:32:53.231 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7159999999999997e-06 2024-09-12T22:32:53.231 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.231 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.232 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:53.232 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409778+0000", 2024-09-12T22:32:53.232 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.331e-06 2024-09-12T22:32:53.232 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.232 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.232 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:53.232 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410191+0000", 2024-09-12T22:32:53.232 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00041348300000000003 2024-09-12T22:32:53.232 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.232 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.232 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:53.232 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410211+0000", 2024-09-12T22:32:53.232 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9933999999999999e-05 2024-09-12T22:32:53.233 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.233 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.233 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:53.233 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413638+0000", 2024-09-12T22:32:53.233 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003426854 2024-09-12T22:32:53.233 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.233 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.233 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:53.233 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413690+0000", 2024-09-12T22:32:53.233 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2089000000000002e-05 2024-09-12T22:32:53.233 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:53.233 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:53.233 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:53.233 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.234 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.234 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "pg_update_log_missing_reply(3.b epoch 19/17 rep_tid 4 lcod 19'2)", 2024-09-12T22:32:53.234 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.410060+0000", 2024-09-12T22:32:53.234 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 75.749972815999996, 2024-09-12T22:32:53.234 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00098016500000000007, 2024-09-12T22:32:53.234 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:53.234 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:53.234 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "reached pg", 2024-09-12T22:32:53.234 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:53.234 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.234 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:53.235 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410060+0000", 2024-09-12T22:32:53.235 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:53.235 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.235 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.235 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:53.235 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410060+0000", 2024-09-12T22:32:53.235 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:53.235 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.235 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.236 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:53.236 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410060+0000", 2024-09-12T22:32:53.236 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.8299999999999998e-07 2024-09-12T22:32:53.236 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.236 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.236 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:53.236 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410062+0000", 2024-09-12T22:32:53.236 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5749999999999999e-06 2024-09-12T22:32:53.236 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.237 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.237 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:53.237 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410070+0000", 2024-09-12T22:32:53.237 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.909e-06 2024-09-12T22:32:53.237 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.237 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.237 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:53.237 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410076+0000", 2024-09-12T22:32:53.237 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7049999999999996e-06 2024-09-12T22:32:53.237 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.237 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.238 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:53.238 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410943+0000", 2024-09-12T22:32:53.238 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00086681900000000001 2024-09-12T22:32:53.238 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.238 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.238 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:53.238 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411040+0000", 2024-09-12T22:32:53.238 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.6774000000000006e-05 2024-09-12T22:32:53.238 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:53.238 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:53.238 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:53.238 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.238 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.239 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e19/17 ondisk, result = 0)", 2024-09-12T22:32:53.239 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.410113+0000", 2024-09-12T22:32:53.239 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 75.749919548999998, 2024-09-12T22:32:53.239 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00098911599999999995, 2024-09-12T22:32:53.239 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:53.239 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:53.239 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:32:53.239 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:53.239 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.239 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:53.239 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410113+0000", 2024-09-12T22:32:53.239 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:53.239 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.240 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.240 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:53.240 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410113+0000", 2024-09-12T22:32:53.240 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:53.240 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.240 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.240 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:53.240 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410113+0000", 2024-09-12T22:32:53.240 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.99e-07 2024-09-12T22:32:53.240 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.240 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.240 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:53.240 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410115+0000", 2024-09-12T22:32:53.240 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.046e-06 2024-09-12T22:32:53.241 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.241 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.241 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:53.241 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410121+0000", 2024-09-12T22:32:53.241 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0050000000000001e-06 2024-09-12T22:32:53.241 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.241 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.241 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:53.241 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410126+0000", 2024-09-12T22:32:53.241 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8339999999999998e-06 2024-09-12T22:32:53.241 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.241 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.241 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:53.242 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410587+0000", 2024-09-12T22:32:53.242 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00046095499999999998 2024-09-12T22:32:53.242 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.242 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.242 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:53.242 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410595+0000", 2024-09-12T22:32:53.242 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.9419999999999995e-06 2024-09-12T22:32:53.242 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.242 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.242 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:53.242 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411102+0000", 2024-09-12T22:32:53.242 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00050713500000000003 2024-09-12T22:32:53.242 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:53.243 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:53.243 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:53.243 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.243 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.243 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 19/17 rep_tid 8 lcod 19'4)", 2024-09-12T22:32:53.243 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.410133+0000", 2024-09-12T22:32:53.243 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 75.749899620999997, 2024-09-12T22:32:53.243 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0013504000000000001, 2024-09-12T22:32:53.243 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:53.243 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:53.243 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "reached pg", 2024-09-12T22:32:53.243 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:53.243 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.244 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:53.244 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410133+0000", 2024-09-12T22:32:53.244 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:53.244 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.244 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.244 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:53.244 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410133+0000", 2024-09-12T22:32:53.244 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:53.244 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.244 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.244 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:53.244 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410133+0000", 2024-09-12T22:32:53.244 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.0599999999999999e-07 2024-09-12T22:32:53.245 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.245 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.245 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:53.245 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410135+0000", 2024-09-12T22:32:53.245 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7770000000000001e-06 2024-09-12T22:32:53.245 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.245 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.245 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:53.245 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410140+0000", 2024-09-12T22:32:53.245 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9960000000000001e-06 2024-09-12T22:32:53.245 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.245 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.245 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:53.245 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410144+0000", 2024-09-12T22:32:53.246 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9500000000000003e-06 2024-09-12T22:32:53.246 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.246 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.246 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:53.246 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411310+0000", 2024-09-12T22:32:53.246 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001166311 2024-09-12T22:32:53.246 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.246 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.246 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:53.246 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411483+0000", 2024-09-12T22:32:53.246 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00017316 2024-09-12T22:32:53.246 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:53.246 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:53.246 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:53.247 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.247 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.247 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "pg_update_log_missing(3.1a epoch 19/17 rep_tid 0 entries 19'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T22:32:53.247 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.410617+0000", 2024-09-12T22:32:53.247 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 75.749415225999996, 2024-09-12T22:32:53.247 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0030439709999999999, 2024-09-12T22:32:53.247 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:53.247 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:53.247 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "reached pg", 2024-09-12T22:32:53.247 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:53.247 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.247 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:53.247 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410617+0000", 2024-09-12T22:32:53.248 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:53.248 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.248 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.248 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:53.248 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410617+0000", 2024-09-12T22:32:53.248 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:53.248 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.248 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.248 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:53.248 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410617+0000", 2024-09-12T22:32:53.248 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3599999999999999e-07 2024-09-12T22:32:53.248 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.248 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.249 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:53.249 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410625+0000", 2024-09-12T22:32:53.249 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5410000000000003e-06 2024-09-12T22:32:53.249 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.249 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.249 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:53.249 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410638+0000", 2024-09-12T22:32:53.249 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3261999999999999e-05 2024-09-12T22:32:53.249 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.249 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.249 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:53.249 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410653+0000", 2024-09-12T22:32:53.249 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4844000000000001e-05 2024-09-12T22:32:53.249 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.250 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.250 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:53.250 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410814+0000", 2024-09-12T22:32:53.250 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00016119999999999999 2024-09-12T22:32:53.250 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.250 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.250 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:53.250 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413661+0000", 2024-09-12T22:32:53.250 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0028467879999999998 2024-09-12T22:32:53.250 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:53.250 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:53.250 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:53.250 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.251 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.251 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-09-12T22:32:53.251 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:39.398875+0000", 2024-09-12T22:32:53.251 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 73.761156946, 2024-09-12T22:32:53.251 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0015679069999999999, 2024-09-12T22:32:53.251 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:53.251 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:53.251 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:53.251 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:53.251 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.251 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:53.252 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398875+0000", 2024-09-12T22:32:53.252 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:53.252 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.252 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.252 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:53.252 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398875+0000", 2024-09-12T22:32:53.252 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:53.252 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.252 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.252 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:53.252 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398878+0000", 2024-09-12T22:32:53.252 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1679999999999998e-06 2024-09-12T22:32:53.252 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.253 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.253 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:53.253 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398888+0000", 2024-09-12T22:32:53.253 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.084e-05 2024-09-12T22:32:53.253 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.253 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.253 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:53.253 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398906+0000", 2024-09-12T22:32:53.253 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7518000000000001e-05 2024-09-12T22:32:53.253 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.253 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.253 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:53.254 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398914+0000", 2024-09-12T22:32:53.254 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5989999999999996e-06 2024-09-12T22:32:53.254 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.254 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.254 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:53.254 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398974+0000", 2024-09-12T22:32:53.254 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0988e-05 2024-09-12T22:32:53.254 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.254 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.254 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:53.254 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.399078+0000", 2024-09-12T22:32:53.255 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000103133 2024-09-12T22:32:53.255 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.255 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.255 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:53.255 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.399166+0000", 2024-09-12T22:32:53.255 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.8183999999999995e-05 2024-09-12T22:32:53.255 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.255 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.255 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:53.255 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.399747+0000", 2024-09-12T22:32:53.255 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00058110599999999996 2024-09-12T22:32:53.255 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.256 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.256 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:53.256 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.400377+0000", 2024-09-12T22:32:53.256 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000630157 2024-09-12T22:32:53.256 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.256 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.256 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:53.256 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.400415+0000", 2024-09-12T22:32:53.256 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7814000000000001e-05 2024-09-12T22:32:53.256 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.256 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.257 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:53.257 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.400443+0000", 2024-09-12T22:32:53.257 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8399999999999999e-05 2024-09-12T22:32:53.257 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:53.257 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:53.257 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:53.257 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.257 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.257 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e23)", 2024-09-12T22:32:53.257 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:58.400966+0000", 2024-09-12T22:32:53.257 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 54.759066038, 2024-09-12T22:32:53.257 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001468876, 2024-09-12T22:32:53.258 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:53.258 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:53.258 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:53.258 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:53.258 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.258 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:53.258 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400966+0000", 2024-09-12T22:32:53.258 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:53.258 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.258 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.259 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:53.259 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400966+0000", 2024-09-12T22:32:53.259 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:53.259 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.259 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.259 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:53.259 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400967+0000", 2024-09-12T22:32:53.259 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.046e-06 2024-09-12T22:32:53.259 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.259 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.259 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:53.260 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400974+0000", 2024-09-12T22:32:53.260 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2310000000000001e-06 2024-09-12T22:32:53.260 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.260 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.260 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:53.260 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400988+0000", 2024-09-12T22:32:53.260 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4482e-05 2024-09-12T22:32:53.260 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.260 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.260 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:53.260 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400997+0000", 2024-09-12T22:32:53.261 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.0189999999999995e-06 2024-09-12T22:32:53.261 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.261 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.261 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:53.261 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.401068+0000", 2024-09-12T22:32:53.261 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1426000000000004e-05 2024-09-12T22:32:53.261 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.261 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.261 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:53.262 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.401174+0000", 2024-09-12T22:32:53.262 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000105769 2024-09-12T22:32:53.262 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.262 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.262 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:53.262 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.401335+0000", 2024-09-12T22:32:53.262 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000161225 2024-09-12T22:32:53.262 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.262 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.262 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:53.262 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.402110+0000", 2024-09-12T22:32:53.262 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00077428800000000004 2024-09-12T22:32:53.262 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.262 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.263 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:53.263 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.402333+0000", 2024-09-12T22:32:53.263 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000223723 2024-09-12T22:32:53.263 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.263 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.263 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:53.263 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.402388+0000", 2024-09-12T22:32:53.263 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4700999999999997e-05 2024-09-12T22:32:53.263 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.263 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.263 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:53.263 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.402435+0000", 2024-09-12T22:32:53.263 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6965999999999997e-05 2024-09-12T22:32:53.263 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:53.263 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:53.263 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:53.264 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.264 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.264 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:45 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e27)", 2024-09-12T22:32:53.264 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:32:04.401614+0000", 2024-09-12T22:32:53.264 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 48.758418609000003, 2024-09-12T22:32:53.264 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0014279749999999999, 2024-09-12T22:32:53.264 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:53.264 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:53.264 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:53.264 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:53.264 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.264 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:53.264 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401614+0000", 2024-09-12T22:32:53.264 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:53.265 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.265 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.265 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:53.265 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401614+0000", 2024-09-12T22:32:53.265 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:53.265 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.265 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.265 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:53.265 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401615+0000", 2024-09-12T22:32:53.265 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.161e-06 2024-09-12T22:32:53.265 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.265 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.265 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:53.265 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401621+0000", 2024-09-12T22:32:53.266 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8730000000000004e-06 2024-09-12T22:32:53.266 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.266 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.266 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:53.266 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401633+0000", 2024-09-12T22:32:53.266 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1800000000000001e-05 2024-09-12T22:32:53.266 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.266 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.266 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:53.266 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401656+0000", 2024-09-12T22:32:53.266 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.3521999999999999e-05 2024-09-12T22:32:53.266 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.266 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.266 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:53.267 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401713+0000", 2024-09-12T22:32:53.267 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7259000000000002e-05 2024-09-12T22:32:53.267 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.267 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.267 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:53.267 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401849+0000", 2024-09-12T22:32:53.267 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013613500000000001 2024-09-12T22:32:53.267 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.267 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.267 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:53.267 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.402009+0000", 2024-09-12T22:32:53.267 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00015947199999999999 2024-09-12T22:32:53.267 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.268 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.268 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:53.268 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.402629+0000", 2024-09-12T22:32:53.268 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00061962200000000001 2024-09-12T22:32:53.268 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.268 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.268 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:53.268 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.402983+0000", 2024-09-12T22:32:53.268 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00035447499999999998 2024-09-12T22:32:53.268 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.269 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.269 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:53.269 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.403016+0000", 2024-09-12T22:32:53.269 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3108999999999998e-05 2024-09-12T22:32:53.269 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:53.269 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:53.269 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:53.269 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.403042+0000", 2024-09-12T22:32:53.269 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5547000000000001e-05 2024-09-12T22:32:53.270 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:53.270 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:53.270 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:53.270 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:53.270 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:53.270 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:32:53.271 INFO:teuthology.orchestra.run.smithi019.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-12T22:32:53.272 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:53.270+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:53.272 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T22:32:53.272 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:32:53.273 INFO:teuthology.orchestra.run.smithi019.stdout:osd.2: {} 2024-09-12T22:32:53.273 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:32:53.274 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:32:53.274 INFO:teuthology.orchestra.run.smithi019.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T22:32:53.274 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:32:53.373 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:53.371+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:53.381 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:53.381 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:53.390 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:32:53.433 INFO:teuthology.orchestra.run.smithi019.stderr:nodeep-scrub is unset 2024-09-12T22:32:53.475 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:53.474+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:53.535 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:53.535 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:53.544 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:32:53.575 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:53.574+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:53.676 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:53.675+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:53.689 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:53.689 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:53.698 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:32:53.777 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:53.776+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:53.803 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:53.804 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:53.812 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:32:53.877 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:53.876+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:53.915 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:53.915 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:53.924 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:32:53.978 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:53.977+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:54.067 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:54.067 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:54.076 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:32:54.079 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:54.078+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:54.180 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:54.178+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:54.180 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:54.181 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:54.190 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:32:54.281 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:54.280+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:54.334 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:54.334 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:54.342 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:32:54.382 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:54.381+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:54.445 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:54.446 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:54.455 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:32:54.482 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:54.481+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:54.561 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:54.561 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:54.570 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:32:54.584 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:54.583+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:54.672 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:54.673 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:54.681 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:32:54.684 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:54.683+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:54.785 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:54.785 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:54.785 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:54.784+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:54.793 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:32:54.831 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [0] live_osds: [1, 2] 2024-09-12T22:32:54.831 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-09-12T22:32:54.831 INFO:tasks.thrashosds.thrasher:Reviving osd 0 2024-09-12T22:32:54.831 INFO:tasks.ceph.ceph_manager.ceph:kill_osd on osd.0 doing powercycle of ubuntu@smithi076.front.sepia.ceph.com 2024-09-12T22:32:54.832 INFO:teuthology.orchestra.console.smithi076:Power on 2024-09-12T22:32:54.832 DEBUG:teuthology.orchestra.console.smithi076:pexpect command: ipmitool -H smithi076.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-09-12T22:32:54.855 DEBUG:teuthology.orchestra.console.smithi076:power on output: Chassis Power Control: Up/On 2024-09-12T22:32:54.886 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:54.885+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:54.899 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:54.899 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:54.908 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:32:54.987 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:54.986+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:55.052 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:55.052 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:55.061 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:32:55.088 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:55.087+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:55.164 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:55.164 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:55.173 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:32:55.217 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:55.216+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:55.275 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T22:32:55.277 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:55.277 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:55.286 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:32:55.290 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:55.289+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:55.385 INFO:teuthology.orchestra.run.smithi019.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-12T22:32:55.391 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:55.390+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:55.403 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T22:32:55.403 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:32:55.421 INFO:teuthology.orchestra.run.smithi019.stdout:osd.2: {} 2024-09-12T22:32:55.421 INFO:teuthology.orchestra.run.smithi019.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T22:32:55.424 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:32:55.425 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:32:55.429 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:32:55.430 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:32:55.430 INFO:teuthology.orchestra.run.smithi148.stdout: "complaint_time": 30, 2024-09-12T22:32:55.430 INFO:teuthology.orchestra.run.smithi148.stdout: "num_blocked_ops": 0 2024-09-12T22:32:55.430 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:32:55.438 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:32:55.449 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T22:32:55.492 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:55.491+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:55.542 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:32:55.542 INFO:teuthology.orchestra.run.smithi148.stdout: "size": 20, 2024-09-12T22:32:55.542 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 600, 2024-09-12T22:32:55.542 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [ 2024-09-12T22:32:55.542 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.542 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:55.542 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.400880+0000", 2024-09-12T22:32:55.542 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 78.138998463999997, 2024-09-12T22:32:55.543 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0095133660000000005, 2024-09-12T22:32:55.543 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:55.543 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:55.543 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:55.543 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:55.543 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.543 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:55.543 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400880+0000", 2024-09-12T22:32:55.543 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:55.543 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.543 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.543 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:55.543 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400880+0000", 2024-09-12T22:32:55.544 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:55.544 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.544 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.544 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:55.544 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400892+0000", 2024-09-12T22:32:55.544 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1941e-05 2024-09-12T22:32:55.544 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.544 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.544 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:55.544 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400900+0000", 2024-09-12T22:32:55.544 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0080000000000002e-06 2024-09-12T22:32:55.544 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.545 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.545 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:55.545 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400911+0000", 2024-09-12T22:32:55.545 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1452e-05 2024-09-12T22:32:55.545 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.545 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.545 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:55.545 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400922+0000", 2024-09-12T22:32:55.545 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0772e-05 2024-09-12T22:32:55.545 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.545 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.545 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:55.546 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401009+0000", 2024-09-12T22:32:55.546 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.7206000000000005e-05 2024-09-12T22:32:55.546 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.546 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.546 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:55.546 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401157+0000", 2024-09-12T22:32:55.546 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014831499999999999 2024-09-12T22:32:55.546 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.546 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.546 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:55.546 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401312+0000", 2024-09-12T22:32:55.546 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00015495600000000001 2024-09-12T22:32:55.546 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.547 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.547 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:55.547 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.403060+0000", 2024-09-12T22:32:55.547 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0017475220000000001 2024-09-12T22:32:55.547 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.547 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.547 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:55.547 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410300+0000", 2024-09-12T22:32:55.547 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0072403260000000001 2024-09-12T22:32:55.547 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.547 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.547 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:55.547 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410350+0000", 2024-09-12T22:32:55.548 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9814000000000001e-05 2024-09-12T22:32:55.548 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.548 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.548 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:55.548 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410393+0000", 2024-09-12T22:32:55.548 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3053999999999998e-05 2024-09-12T22:32:55.548 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:55.548 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:55.548 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:55.548 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.548 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.548 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:55.549 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.400952+0000", 2024-09-12T22:32:55.549 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 78.138926311999995, 2024-09-12T22:32:55.549 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0096045620000000005, 2024-09-12T22:32:55.549 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:55.549 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:55.549 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:55.549 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:55.549 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.549 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:55.549 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400952+0000", 2024-09-12T22:32:55.549 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:55.549 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.549 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.550 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:55.550 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400952+0000", 2024-09-12T22:32:55.550 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:55.550 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.550 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.550 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:55.550 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400953+0000", 2024-09-12T22:32:55.550 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.8000000000000005e-07 2024-09-12T22:32:55.550 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.550 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.550 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:55.550 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400957+0000", 2024-09-12T22:32:55.550 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.33e-06 2024-09-12T22:32:55.550 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.551 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.551 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:55.551 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400966+0000", 2024-09-12T22:32:55.551 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1989999999999995e-06 2024-09-12T22:32:55.551 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.551 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.551 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:55.551 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400973+0000", 2024-09-12T22:32:55.551 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2779999999999999e-06 2024-09-12T22:32:55.551 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.551 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.551 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:55.551 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401696+0000", 2024-09-12T22:32:55.551 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00072363500000000003 2024-09-12T22:32:55.552 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.552 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.552 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:55.552 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401788+0000", 2024-09-12T22:32:55.552 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1862999999999998e-05 2024-09-12T22:32:55.552 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.552 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.552 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:55.552 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401929+0000", 2024-09-12T22:32:55.552 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014096000000000001 2024-09-12T22:32:55.552 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.552 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.553 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:55.553 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.403542+0000", 2024-09-12T22:32:55.553 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001612963 2024-09-12T22:32:55.553 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.553 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.553 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:55.553 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410460+0000", 2024-09-12T22:32:55.553 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0069180500000000002 2024-09-12T22:32:55.553 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.553 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.553 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:55.553 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410515+0000", 2024-09-12T22:32:55.553 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5009000000000001e-05 2024-09-12T22:32:55.554 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.554 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.554 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:55.554 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410557+0000", 2024-09-12T22:32:55.554 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1495000000000002e-05 2024-09-12T22:32:55.554 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:55.554 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:55.554 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:55.554 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.554 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.554 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:55.554 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.400984+0000", 2024-09-12T22:32:55.554 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 78.138893816999996, 2024-09-12T22:32:55.555 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0073703950000000001, 2024-09-12T22:32:55.555 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:55.555 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:55.555 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:55.555 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:55.555 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.555 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:55.555 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400984+0000", 2024-09-12T22:32:55.555 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:55.555 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.555 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.555 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:55.555 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400984+0000", 2024-09-12T22:32:55.555 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:55.556 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.556 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.556 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:55.556 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400985+0000", 2024-09-12T22:32:55.556 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3200000000000005e-07 2024-09-12T22:32:55.556 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.556 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.556 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:55.556 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400998+0000", 2024-09-12T22:32:55.556 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2726e-05 2024-09-12T22:32:55.556 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.556 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.556 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:55.556 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401006+0000", 2024-09-12T22:32:55.557 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.3110000000000006e-06 2024-09-12T22:32:55.557 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.557 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.557 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:55.557 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401022+0000", 2024-09-12T22:32:55.557 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6249e-05 2024-09-12T22:32:55.557 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.557 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.557 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:55.557 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401700+0000", 2024-09-12T22:32:55.557 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00067811100000000001 2024-09-12T22:32:55.557 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.558 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.558 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:55.558 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401839+0000", 2024-09-12T22:32:55.558 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013865399999999999 2024-09-12T22:32:55.558 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.558 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.558 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:55.558 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401962+0000", 2024-09-12T22:32:55.558 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000123266 2024-09-12T22:32:55.558 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.558 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.558 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:55.559 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.403589+0000", 2024-09-12T22:32:55.559 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001626932 2024-09-12T22:32:55.559 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.559 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.559 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:55.559 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.408274+0000", 2024-09-12T22:32:55.559 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0046848100000000002 2024-09-12T22:32:55.559 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.559 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.559 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:55.559 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.408324+0000", 2024-09-12T22:32:55.559 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9784000000000003e-05 2024-09-12T22:32:55.559 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.560 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.560 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:55.560 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.408355+0000", 2024-09-12T22:32:55.560 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.1019999999999998e-05 2024-09-12T22:32:55.560 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:55.560 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:55.560 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:55.560 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.560 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.560 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:55.560 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401034+0000", 2024-09-12T22:32:55.560 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 78.138844376999998, 2024-09-12T22:32:55.560 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011063051000000001, 2024-09-12T22:32:55.560 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:55.561 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:55.561 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:55.561 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:55.561 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.561 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:55.561 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401034+0000", 2024-09-12T22:32:55.561 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:55.561 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.561 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.561 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:55.561 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401034+0000", 2024-09-12T22:32:55.561 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:55.561 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.562 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.562 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:55.562 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401034+0000", 2024-09-12T22:32:55.562 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8899999999999999e-07 2024-09-12T22:32:55.562 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.562 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.562 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:55.562 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401038+0000", 2024-09-12T22:32:55.562 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.523e-06 2024-09-12T22:32:55.562 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.562 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.562 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:55.562 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401046+0000", 2024-09-12T22:32:55.563 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0479999999999999e-06 2024-09-12T22:32:55.563 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.563 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.563 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:55.563 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401051+0000", 2024-09-12T22:32:55.563 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2619999999999998e-06 2024-09-12T22:32:55.563 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.563 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.563 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:55.563 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402270+0000", 2024-09-12T22:32:55.563 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012182429999999999 2024-09-12T22:32:55.563 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.563 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.564 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:55.564 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402325+0000", 2024-09-12T22:32:55.564 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5526999999999999e-05 2024-09-12T22:32:55.564 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.564 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.564 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:55.564 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402403+0000", 2024-09-12T22:32:55.564 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.7559999999999996e-05 2024-09-12T22:32:55.564 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.564 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.564 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:55.564 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.403655+0000", 2024-09-12T22:32:55.564 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012521489999999999 2024-09-12T22:32:55.565 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.565 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.565 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:55.565 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411979+0000", 2024-09-12T22:32:55.565 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0083240420000000002 2024-09-12T22:32:55.565 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.565 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.565 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:55.565 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.412036+0000", 2024-09-12T22:32:55.565 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7639000000000002e-05 2024-09-12T22:32:55.565 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.565 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.566 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:55.566 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.412097+0000", 2024-09-12T22:32:55.566 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0469e-05 2024-09-12T22:32:55.566 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:55.566 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:55.566 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:55.566 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.566 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.566 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:55.566 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401060+0000", 2024-09-12T22:32:55.566 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 78.138818624999999, 2024-09-12T22:32:55.566 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.010030172, 2024-09-12T22:32:55.566 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:55.567 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:55.567 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:55.567 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:55.567 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.567 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:55.567 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401060+0000", 2024-09-12T22:32:55.567 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:55.567 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.567 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.567 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:55.567 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401060+0000", 2024-09-12T22:32:55.567 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:55.567 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.568 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.568 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:55.568 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401060+0000", 2024-09-12T22:32:55.568 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2500000000000001e-07 2024-09-12T22:32:55.568 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.568 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.568 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:55.568 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401063+0000", 2024-09-12T22:32:55.568 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0910000000000001e-06 2024-09-12T22:32:55.568 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.568 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.568 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:55.568 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401070+0000", 2024-09-12T22:32:55.568 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1210000000000001e-06 2024-09-12T22:32:55.569 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.569 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.569 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:55.569 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401076+0000", 2024-09-12T22:32:55.569 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2830000000000001e-06 2024-09-12T22:32:55.569 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.569 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.569 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:55.569 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402288+0000", 2024-09-12T22:32:55.569 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012123699999999999 2024-09-12T22:32:55.569 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.569 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.569 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:55.570 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402359+0000", 2024-09-12T22:32:55.570 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.0988000000000005e-05 2024-09-12T22:32:55.570 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.570 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.570 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:55.570 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402457+0000", 2024-09-12T22:32:55.570 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.7857999999999997e-05 2024-09-12T22:32:55.570 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.570 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.570 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:55.570 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.404395+0000", 2024-09-12T22:32:55.570 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0019380160000000001 2024-09-12T22:32:55.570 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.571 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.571 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:55.571 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410603+0000", 2024-09-12T22:32:55.571 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.006208061 2024-09-12T22:32:55.571 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.571 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.571 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:55.571 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410687+0000", 2024-09-12T22:32:55.571 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.4623000000000006e-05 2024-09-12T22:32:55.571 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.571 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.571 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:55.572 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411090+0000", 2024-09-12T22:32:55.572 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00040233599999999999 2024-09-12T22:32:55.572 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:55.572 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:55.572 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:55.572 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.572 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.572 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:55.572 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401083+0000", 2024-09-12T22:32:55.572 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 78.138795208999994, 2024-09-12T22:32:55.572 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0097591850000000001, 2024-09-12T22:32:55.572 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:55.572 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:55.573 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:55.573 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:55.573 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.573 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:55.573 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401083+0000", 2024-09-12T22:32:55.573 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:55.573 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.573 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.573 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:55.573 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401083+0000", 2024-09-12T22:32:55.573 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:55.573 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.573 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.574 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:55.574 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401084+0000", 2024-09-12T22:32:55.574 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4799999999999999e-07 2024-09-12T22:32:55.574 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.574 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.574 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:55.574 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401088+0000", 2024-09-12T22:32:55.574 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6419999999999998e-06 2024-09-12T22:32:55.574 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.574 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.574 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:55.574 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401094+0000", 2024-09-12T22:32:55.574 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0090000000000004e-06 2024-09-12T22:32:55.575 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.575 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.575 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:55.575 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401108+0000", 2024-09-12T22:32:55.575 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3884e-05 2024-09-12T22:32:55.575 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.575 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.575 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:55.575 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401165+0000", 2024-09-12T22:32:55.575 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.6499000000000002e-05 2024-09-12T22:32:55.575 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.575 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.575 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:55.575 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401261+0000", 2024-09-12T22:32:55.576 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.6872000000000004e-05 2024-09-12T22:32:55.576 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.576 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.576 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:55.576 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401376+0000", 2024-09-12T22:32:55.576 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000114508 2024-09-12T22:32:55.576 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.576 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.576 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:55.576 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402666+0000", 2024-09-12T22:32:55.576 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012901659999999999 2024-09-12T22:32:55.576 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.577 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.577 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:55.577 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410572+0000", 2024-09-12T22:32:55.577 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0079055489999999996 2024-09-12T22:32:55.577 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.577 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.577 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:55.577 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410661+0000", 2024-09-12T22:32:55.577 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.9578000000000002e-05 2024-09-12T22:32:55.577 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.577 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.577 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:55.577 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410842+0000", 2024-09-12T22:32:55.578 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00018102999999999999 2024-09-12T22:32:55.578 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:55.578 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:55.578 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:55.578 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.578 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.578 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:55.578 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401122+0000", 2024-09-12T22:32:55.578 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 78.138756177000005, 2024-09-12T22:32:55.578 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0099122080000000005, 2024-09-12T22:32:55.578 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:55.578 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:55.578 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:32:55.579 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:55.579 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.579 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:55.579 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401122+0000", 2024-09-12T22:32:55.579 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:55.579 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.579 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.579 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:55.579 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401122+0000", 2024-09-12T22:32:55.579 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:55.579 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.579 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.579 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:55.580 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401123+0000", 2024-09-12T22:32:55.580 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2600000000000002e-07 2024-09-12T22:32:55.580 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.580 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.580 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:55.580 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401126+0000", 2024-09-12T22:32:55.580 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.6449999999999998e-06 2024-09-12T22:32:55.580 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.580 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.580 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:55.580 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401133+0000", 2024-09-12T22:32:55.580 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.9890000000000003e-06 2024-09-12T22:32:55.580 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.580 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.581 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:55.581 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401138+0000", 2024-09-12T22:32:55.581 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8060000000000002e-06 2024-09-12T22:32:55.581 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.581 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.581 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:55.581 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401703+0000", 2024-09-12T22:32:55.581 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00056509099999999999 2024-09-12T22:32:55.581 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.581 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.581 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:55.581 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401837+0000", 2024-09-12T22:32:55.581 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013338799999999999 2024-09-12T22:32:55.582 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.582 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.582 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:55.582 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411034+0000", 2024-09-12T22:32:55.582 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.009197663 2024-09-12T22:32:55.582 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:55.582 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:55.582 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:55.582 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.582 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.582 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:55.582 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401158+0000", 2024-09-12T22:32:55.582 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 78.138720398000004, 2024-09-12T22:32:55.583 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.010292437999999999, 2024-09-12T22:32:55.583 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:55.583 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:55.583 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:32:55.583 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:55.583 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.583 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:55.583 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401158+0000", 2024-09-12T22:32:55.583 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:55.583 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.583 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.583 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:55.584 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401158+0000", 2024-09-12T22:32:55.584 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:55.584 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.584 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.584 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:55.584 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401158+0000", 2024-09-12T22:32:55.584 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9699999999999996e-07 2024-09-12T22:32:55.584 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.584 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.584 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:55.584 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401161+0000", 2024-09-12T22:32:55.584 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.7410000000000001e-06 2024-09-12T22:32:55.584 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.585 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.585 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:55.585 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401168+0000", 2024-09-12T22:32:55.585 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.844e-06 2024-09-12T22:32:55.585 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.585 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.585 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:55.585 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401174+0000", 2024-09-12T22:32:55.585 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4700000000000001e-06 2024-09-12T22:32:55.585 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.585 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.585 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:55.585 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402799+0000", 2024-09-12T22:32:55.586 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0016256409999999999 2024-09-12T22:32:55.586 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.586 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.586 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:55.586 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402893+0000", 2024-09-12T22:32:55.586 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.3807999999999994e-05 2024-09-12T22:32:55.586 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.586 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.586 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:55.586 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411450+0000", 2024-09-12T22:32:55.586 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0085573369999999999 2024-09-12T22:32:55.586 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:55.586 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:55.587 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:55.587 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.587 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.587 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:55.587 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401183+0000", 2024-09-12T22:32:55.587 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 78.138695545999994, 2024-09-12T22:32:55.587 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0068597830000000004, 2024-09-12T22:32:55.587 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:55.587 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:55.587 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:32:55.587 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:55.587 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.587 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:55.588 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401183+0000", 2024-09-12T22:32:55.588 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:55.588 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.588 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.588 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:55.588 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401183+0000", 2024-09-12T22:32:55.588 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:55.588 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.588 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.588 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:55.588 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401183+0000", 2024-09-12T22:32:55.588 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.6700000000000003e-07 2024-09-12T22:32:55.588 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.588 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.589 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:55.589 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401186+0000", 2024-09-12T22:32:55.589 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4679999999999999e-06 2024-09-12T22:32:55.589 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.589 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.589 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:55.589 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401192+0000", 2024-09-12T22:32:55.589 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.1519999999999997e-06 2024-09-12T22:32:55.589 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.589 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.589 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:55.589 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401197+0000", 2024-09-12T22:32:55.589 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4669999999999998e-06 2024-09-12T22:32:55.590 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.590 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.590 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:55.590 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401253+0000", 2024-09-12T22:32:55.590 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.6211000000000001e-05 2024-09-12T22:32:55.590 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.590 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.590 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:55.590 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401413+0000", 2024-09-12T22:32:55.590 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00016021399999999999 2024-09-12T22:32:55.590 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.590 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.590 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:55.591 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.408043+0000", 2024-09-12T22:32:55.591 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0066295039999999996 2024-09-12T22:32:55.591 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:55.591 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:55.591 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:55.591 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.591 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.591 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:20 3.1c e19/17 3:3ed09add:::607.00000000:head v 19'1, mlcod=0'0)", 2024-09-12T22:32:55.591 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.409642+0000", 2024-09-12T22:32:55.591 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 78.130236087, 2024-09-12T22:32:55.592 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0038816269999999999, 2024-09-12T22:32:55.592 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:55.592 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:55.592 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:55.592 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:55.592 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.593 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:55.593 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409642+0000", 2024-09-12T22:32:55.593 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:55.593 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.593 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.593 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:55.593 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409642+0000", 2024-09-12T22:32:55.593 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:55.593 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.593 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.593 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:55.593 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409642+0000", 2024-09-12T22:32:55.593 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.6899999999999999e-07 2024-09-12T22:32:55.594 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.594 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.594 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:55.594 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409648+0000", 2024-09-12T22:32:55.594 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.49e-06 2024-09-12T22:32:55.594 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.594 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.594 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:55.594 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409656+0000", 2024-09-12T22:32:55.594 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.2949999999999994e-06 2024-09-12T22:32:55.594 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.594 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.594 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:55.594 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409664+0000", 2024-09-12T22:32:55.595 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.1219999999999995e-06 2024-09-12T22:32:55.595 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.595 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.595 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:55.595 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409707+0000", 2024-09-12T22:32:55.595 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2222000000000003e-05 2024-09-12T22:32:55.595 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.595 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.595 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:55.595 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409724+0000", 2024-09-12T22:32:55.595 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7496999999999999e-05 2024-09-12T22:32:55.595 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.596 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.596 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:55.596 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413439+0000", 2024-09-12T22:32:55.596 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00371448 2024-09-12T22:32:55.596 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.596 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.596 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:55.596 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413524+0000", 2024-09-12T22:32:55.596 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.5252000000000003e-05 2024-09-12T22:32:55.596 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:55.596 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:55.596 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:55.596 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.597 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.597 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:28 3.13 e19/17 3:cd5a64a3:::100.00000000:head v 19'1, mlcod=0'0)", 2024-09-12T22:32:55.597 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.409681+0000", 2024-09-12T22:32:55.597 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 78.130197604000003, 2024-09-12T22:32:55.597 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0038708710000000001, 2024-09-12T22:32:55.597 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:55.597 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:55.597 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:55.597 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:55.597 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.597 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:55.598 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409681+0000", 2024-09-12T22:32:55.598 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:55.598 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.598 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.598 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:55.598 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409681+0000", 2024-09-12T22:32:55.598 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:55.598 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.598 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.598 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:55.599 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409681+0000", 2024-09-12T22:32:55.599 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3000000000000002e-07 2024-09-12T22:32:55.599 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.599 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.599 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:55.599 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409695+0000", 2024-09-12T22:32:55.599 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4313e-05 2024-09-12T22:32:55.599 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.599 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.599 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:55.599 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409703+0000", 2024-09-12T22:32:55.599 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4000000000000003e-06 2024-09-12T22:32:55.599 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.600 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.600 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:55.600 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409708+0000", 2024-09-12T22:32:55.600 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3190000000000002e-06 2024-09-12T22:32:55.600 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.600 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.600 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:55.600 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409875+0000", 2024-09-12T22:32:55.600 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000167329 2024-09-12T22:32:55.600 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.600 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.600 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:55.601 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409892+0000", 2024-09-12T22:32:55.601 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6957999999999999e-05 2024-09-12T22:32:55.601 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.601 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.601 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:55.601 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413457+0000", 2024-09-12T22:32:55.601 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0035651279999999999 2024-09-12T22:32:55.601 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.601 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.601 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:55.601 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413552+0000", 2024-09-12T22:32:55.601 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.4093999999999997e-05 2024-09-12T22:32:55.601 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:55.602 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:55.602 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:55.602 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.602 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.602 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:21 3.1c e19/17 3:3ed09add:::607.00000000:head v 19'2, mlcod=0'0)", 2024-09-12T22:32:55.602 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.409718+0000", 2024-09-12T22:32:55.602 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 78.130159938999995, 2024-09-12T22:32:55.602 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003851883, 2024-09-12T22:32:55.602 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:55.602 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:55.602 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:55.602 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:55.602 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.603 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:55.603 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409718+0000", 2024-09-12T22:32:55.603 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:55.603 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.603 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.603 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:55.603 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409718+0000", 2024-09-12T22:32:55.603 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:55.603 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.603 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.603 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:55.603 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409719+0000", 2024-09-12T22:32:55.603 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.16e-07 2024-09-12T22:32:55.604 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.604 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.604 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:55.604 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409722+0000", 2024-09-12T22:32:55.604 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.692e-06 2024-09-12T22:32:55.604 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.604 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.604 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:55.604 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409729+0000", 2024-09-12T22:32:55.604 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.516e-06 2024-09-12T22:32:55.604 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.604 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.605 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:55.605 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409750+0000", 2024-09-12T22:32:55.605 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1151000000000001e-05 2024-09-12T22:32:55.605 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.605 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.605 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:55.605 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410015+0000", 2024-09-12T22:32:55.605 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00026477599999999999 2024-09-12T22:32:55.605 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.605 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.605 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:55.605 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410104+0000", 2024-09-12T22:32:55.606 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.9586000000000006e-05 2024-09-12T22:32:55.606 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.606 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.606 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:55.606 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413528+0000", 2024-09-12T22:32:55.606 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0034237880000000001 2024-09-12T22:32:55.606 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.606 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.606 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:55.606 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413570+0000", 2024-09-12T22:32:55.606 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2157999999999999e-05 2024-09-12T22:32:55.606 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:55.606 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:55.607 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:55.607 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.607 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.607 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:27 3.13 e19/17 3:c91d4a1d:::mds0_inotable:head v 19'2, mlcod=0'0)", 2024-09-12T22:32:55.607 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.409760+0000", 2024-09-12T22:32:55.607 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 78.130118422999999, 2024-09-12T22:32:55.607 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0039301910000000004, 2024-09-12T22:32:55.607 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:55.607 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:55.607 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:55.607 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:55.607 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.607 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:55.607 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409760+0000", 2024-09-12T22:32:55.608 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:55.608 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.608 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.608 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:55.608 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409760+0000", 2024-09-12T22:32:55.608 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:55.608 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.608 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.608 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:55.608 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409760+0000", 2024-09-12T22:32:55.608 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.39e-07 2024-09-12T22:32:55.608 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.609 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.609 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:55.609 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409765+0000", 2024-09-12T22:32:55.609 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4449999999999998e-06 2024-09-12T22:32:55.609 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.609 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.609 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:55.609 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409771+0000", 2024-09-12T22:32:55.609 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7159999999999997e-06 2024-09-12T22:32:55.609 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.609 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.609 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:55.609 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409778+0000", 2024-09-12T22:32:55.610 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.331e-06 2024-09-12T22:32:55.610 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.610 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.610 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:55.610 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410191+0000", 2024-09-12T22:32:55.610 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00041348300000000003 2024-09-12T22:32:55.610 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.610 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.610 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:55.610 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410211+0000", 2024-09-12T22:32:55.610 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9933999999999999e-05 2024-09-12T22:32:55.610 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.610 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.610 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:55.611 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413638+0000", 2024-09-12T22:32:55.611 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003426854 2024-09-12T22:32:55.611 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.611 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.611 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:55.611 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413690+0000", 2024-09-12T22:32:55.611 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2089000000000002e-05 2024-09-12T22:32:55.611 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:55.611 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:55.611 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:55.611 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.611 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.612 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "pg_update_log_missing_reply(3.b epoch 19/17 rep_tid 4 lcod 19'2)", 2024-09-12T22:32:55.612 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.410060+0000", 2024-09-12T22:32:55.612 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 78.129818757999999, 2024-09-12T22:32:55.612 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00098016500000000007, 2024-09-12T22:32:55.612 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:55.612 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:55.612 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "reached pg", 2024-09-12T22:32:55.612 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:55.612 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.612 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:55.612 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410060+0000", 2024-09-12T22:32:55.612 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:55.612 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.613 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.613 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:55.613 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410060+0000", 2024-09-12T22:32:55.613 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:55.613 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.613 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.613 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:55.613 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410060+0000", 2024-09-12T22:32:55.613 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.8299999999999998e-07 2024-09-12T22:32:55.613 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.613 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.613 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:55.613 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410062+0000", 2024-09-12T22:32:55.613 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5749999999999999e-06 2024-09-12T22:32:55.614 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.614 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.614 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:55.614 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410070+0000", 2024-09-12T22:32:55.614 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.909e-06 2024-09-12T22:32:55.614 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.614 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.614 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:55.614 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410076+0000", 2024-09-12T22:32:55.614 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7049999999999996e-06 2024-09-12T22:32:55.614 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.614 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.614 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:55.614 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410943+0000", 2024-09-12T22:32:55.615 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00086681900000000001 2024-09-12T22:32:55.615 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.615 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.615 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:55.615 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411040+0000", 2024-09-12T22:32:55.615 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.6774000000000006e-05 2024-09-12T22:32:55.615 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:55.615 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:55.615 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:55.615 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.615 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.615 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e19/17 ondisk, result = 0)", 2024-09-12T22:32:55.615 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.410113+0000", 2024-09-12T22:32:55.615 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 78.129765491000001, 2024-09-12T22:32:55.616 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00098911599999999995, 2024-09-12T22:32:55.616 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:55.616 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:55.616 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:32:55.616 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:55.616 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.616 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:55.616 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410113+0000", 2024-09-12T22:32:55.616 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:55.616 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.616 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.616 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:55.616 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410113+0000", 2024-09-12T22:32:55.616 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:55.617 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.617 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.617 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:55.617 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410113+0000", 2024-09-12T22:32:55.617 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.99e-07 2024-09-12T22:32:55.617 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.617 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.617 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:55.617 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410115+0000", 2024-09-12T22:32:55.617 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.046e-06 2024-09-12T22:32:55.617 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.617 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.617 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:55.617 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410121+0000", 2024-09-12T22:32:55.618 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0050000000000001e-06 2024-09-12T22:32:55.618 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.618 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.618 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:55.618 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410126+0000", 2024-09-12T22:32:55.618 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8339999999999998e-06 2024-09-12T22:32:55.618 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.618 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.618 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:55.618 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410587+0000", 2024-09-12T22:32:55.618 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00046095499999999998 2024-09-12T22:32:55.618 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.618 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.619 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:55.619 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410595+0000", 2024-09-12T22:32:55.619 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.9419999999999995e-06 2024-09-12T22:32:55.619 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.619 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.619 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:55.619 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411102+0000", 2024-09-12T22:32:55.619 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00050713500000000003 2024-09-12T22:32:55.619 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:55.619 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:55.619 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:55.619 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.619 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.620 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 19/17 rep_tid 8 lcod 19'4)", 2024-09-12T22:32:55.620 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.410133+0000", 2024-09-12T22:32:55.620 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 78.129745563, 2024-09-12T22:32:55.620 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0013504000000000001, 2024-09-12T22:32:55.620 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:55.620 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:55.620 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "reached pg", 2024-09-12T22:32:55.620 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:55.620 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.620 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:55.620 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410133+0000", 2024-09-12T22:32:55.620 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:55.620 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.621 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.621 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:55.621 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410133+0000", 2024-09-12T22:32:55.621 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:55.621 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.621 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.621 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:55.621 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410133+0000", 2024-09-12T22:32:55.621 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.0599999999999999e-07 2024-09-12T22:32:55.621 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.621 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.621 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:55.621 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410135+0000", 2024-09-12T22:32:55.621 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7770000000000001e-06 2024-09-12T22:32:55.622 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.622 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.622 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:55.622 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410140+0000", 2024-09-12T22:32:55.622 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9960000000000001e-06 2024-09-12T22:32:55.622 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.622 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.622 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:55.622 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410144+0000", 2024-09-12T22:32:55.622 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9500000000000003e-06 2024-09-12T22:32:55.622 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.622 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.622 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:55.622 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411310+0000", 2024-09-12T22:32:55.623 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001166311 2024-09-12T22:32:55.623 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.623 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.623 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:55.623 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411483+0000", 2024-09-12T22:32:55.623 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00017316 2024-09-12T22:32:55.623 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:55.623 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:55.623 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:55.623 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.623 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.623 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "pg_update_log_missing(3.1a epoch 19/17 rep_tid 0 entries 19'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T22:32:55.623 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.410617+0000", 2024-09-12T22:32:55.624 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 78.129261167999999, 2024-09-12T22:32:55.624 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0030439709999999999, 2024-09-12T22:32:55.624 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:55.624 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:55.624 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "reached pg", 2024-09-12T22:32:55.624 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:55.624 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.624 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:55.624 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410617+0000", 2024-09-12T22:32:55.624 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:55.624 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.624 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.624 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:55.625 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410617+0000", 2024-09-12T22:32:55.625 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:55.625 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.625 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.625 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:55.625 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410617+0000", 2024-09-12T22:32:55.625 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3599999999999999e-07 2024-09-12T22:32:55.625 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.625 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.625 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:55.625 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410625+0000", 2024-09-12T22:32:55.625 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5410000000000003e-06 2024-09-12T22:32:55.625 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.625 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.626 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:55.626 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410638+0000", 2024-09-12T22:32:55.626 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3261999999999999e-05 2024-09-12T22:32:55.626 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.626 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.626 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:55.626 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410653+0000", 2024-09-12T22:32:55.626 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4844000000000001e-05 2024-09-12T22:32:55.626 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.626 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.626 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:55.626 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410814+0000", 2024-09-12T22:32:55.626 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00016119999999999999 2024-09-12T22:32:55.626 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.627 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.627 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:55.627 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413661+0000", 2024-09-12T22:32:55.627 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0028467879999999998 2024-09-12T22:32:55.627 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:55.627 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:55.627 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:55.627 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.627 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.627 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-09-12T22:32:55.627 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:39.398875+0000", 2024-09-12T22:32:55.627 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 76.141002888000003, 2024-09-12T22:32:55.627 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0015679069999999999, 2024-09-12T22:32:55.627 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:55.628 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:55.628 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:55.628 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:55.628 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.628 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:55.628 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398875+0000", 2024-09-12T22:32:55.628 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:55.628 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.628 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.628 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:55.628 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398875+0000", 2024-09-12T22:32:55.628 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:55.628 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.629 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.629 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:55.629 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398878+0000", 2024-09-12T22:32:55.629 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1679999999999998e-06 2024-09-12T22:32:55.629 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.629 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.629 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:55.629 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398888+0000", 2024-09-12T22:32:55.629 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.084e-05 2024-09-12T22:32:55.629 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.629 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.629 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:55.629 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398906+0000", 2024-09-12T22:32:55.630 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7518000000000001e-05 2024-09-12T22:32:55.630 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.630 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.630 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:55.630 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398914+0000", 2024-09-12T22:32:55.630 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5989999999999996e-06 2024-09-12T22:32:55.630 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.630 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.630 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:55.630 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398974+0000", 2024-09-12T22:32:55.630 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0988e-05 2024-09-12T22:32:55.630 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.630 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.630 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:55.631 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.399078+0000", 2024-09-12T22:32:55.631 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000103133 2024-09-12T22:32:55.631 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.631 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.631 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:55.631 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.399166+0000", 2024-09-12T22:32:55.631 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.8183999999999995e-05 2024-09-12T22:32:55.631 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.631 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.631 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:55.631 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.399747+0000", 2024-09-12T22:32:55.631 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00058110599999999996 2024-09-12T22:32:55.631 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.632 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.632 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:55.632 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.400377+0000", 2024-09-12T22:32:55.632 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000630157 2024-09-12T22:32:55.632 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.632 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.632 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:55.632 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.400415+0000", 2024-09-12T22:32:55.632 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7814000000000001e-05 2024-09-12T22:32:55.632 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.632 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.632 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:55.633 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.400443+0000", 2024-09-12T22:32:55.633 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8399999999999999e-05 2024-09-12T22:32:55.633 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:55.633 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:55.633 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:55.633 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.633 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.633 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e23)", 2024-09-12T22:32:55.633 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:58.400966+0000", 2024-09-12T22:32:55.633 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 57.138911980000003, 2024-09-12T22:32:55.633 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001468876, 2024-09-12T22:32:55.633 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:55.633 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:55.634 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:55.634 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:55.634 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.634 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:55.634 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400966+0000", 2024-09-12T22:32:55.634 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:55.634 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.634 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.634 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:55.634 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400966+0000", 2024-09-12T22:32:55.634 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:55.634 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.634 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.635 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:55.635 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400967+0000", 2024-09-12T22:32:55.635 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.046e-06 2024-09-12T22:32:55.635 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.635 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.635 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:55.635 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400974+0000", 2024-09-12T22:32:55.635 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2310000000000001e-06 2024-09-12T22:32:55.635 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.635 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.635 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:55.635 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400988+0000", 2024-09-12T22:32:55.635 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4482e-05 2024-09-12T22:32:55.635 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.636 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.636 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:55.636 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400997+0000", 2024-09-12T22:32:55.636 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.0189999999999995e-06 2024-09-12T22:32:55.636 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.636 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.636 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:55.636 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.401068+0000", 2024-09-12T22:32:55.636 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1426000000000004e-05 2024-09-12T22:32:55.636 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.636 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.636 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:55.636 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.401174+0000", 2024-09-12T22:32:55.637 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000105769 2024-09-12T22:32:55.637 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.637 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.637 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:55.637 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.401335+0000", 2024-09-12T22:32:55.637 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000161225 2024-09-12T22:32:55.637 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.637 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.637 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:55.637 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.402110+0000", 2024-09-12T22:32:55.637 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00077428800000000004 2024-09-12T22:32:55.637 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.637 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.637 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:55.638 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.402333+0000", 2024-09-12T22:32:55.638 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000223723 2024-09-12T22:32:55.638 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.638 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.638 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:55.638 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.402388+0000", 2024-09-12T22:32:55.638 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4700999999999997e-05 2024-09-12T22:32:55.638 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.638 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.638 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:55.638 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.402435+0000", 2024-09-12T22:32:55.638 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6965999999999997e-05 2024-09-12T22:32:55.638 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:55.638 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:55.639 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:55.639 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.639 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.639 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:45 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e27)", 2024-09-12T22:32:55.639 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:32:04.401614+0000", 2024-09-12T22:32:55.639 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 51.138264550999999, 2024-09-12T22:32:55.639 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0014279749999999999, 2024-09-12T22:32:55.639 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:55.639 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:55.639 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:55.639 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:55.639 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.639 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:55.640 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401614+0000", 2024-09-12T22:32:55.640 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:55.640 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.640 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.640 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:55.640 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401614+0000", 2024-09-12T22:32:55.640 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:55.640 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.640 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.640 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:55.640 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401615+0000", 2024-09-12T22:32:55.640 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.161e-06 2024-09-12T22:32:55.640 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.641 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.641 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:55.641 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401621+0000", 2024-09-12T22:32:55.641 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8730000000000004e-06 2024-09-12T22:32:55.641 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.641 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.641 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:55.641 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401633+0000", 2024-09-12T22:32:55.641 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1800000000000001e-05 2024-09-12T22:32:55.641 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.641 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.641 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:55.641 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401656+0000", 2024-09-12T22:32:55.642 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.3521999999999999e-05 2024-09-12T22:32:55.642 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.642 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.642 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:55.642 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401713+0000", 2024-09-12T22:32:55.642 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7259000000000002e-05 2024-09-12T22:32:55.642 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.642 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.642 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:55.642 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401849+0000", 2024-09-12T22:32:55.642 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013613500000000001 2024-09-12T22:32:55.642 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.642 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.643 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:55.643 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.402009+0000", 2024-09-12T22:32:55.643 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00015947199999999999 2024-09-12T22:32:55.643 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.643 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.643 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:55.643 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.402629+0000", 2024-09-12T22:32:55.643 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00061962200000000001 2024-09-12T22:32:55.643 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.643 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.643 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:55.643 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.402983+0000", 2024-09-12T22:32:55.643 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00035447499999999998 2024-09-12T22:32:55.643 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.644 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.644 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:55.644 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.403016+0000", 2024-09-12T22:32:55.644 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3108999999999998e-05 2024-09-12T22:32:55.644 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:55.644 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:55.644 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:55.644 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.403042+0000", 2024-09-12T22:32:55.644 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5547000000000001e-05 2024-09-12T22:32:55.644 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:55.644 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:55.644 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:55.644 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:55.645 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:55.645 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:32:55.647 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:32:55.647 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:55.645+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:55.649 INFO:tasks.workunit.client.0.smithi019.stderr:Updating files: 94% (12200/12903) Updating files: 95% (12258/12903) Updating files: 96% (12387/12903) Updating files: 97% (12516/12903) Updating files: 98% (12645/12903) Updating files: 99% (12774/12903) Updating files: 100% (12903/12903) Updating files: 100% (12903/12903), done. 2024-09-12T22:32:55.747 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:55.746+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:55.754 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-09-12T22:32:55.754 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-09-12T22:32:55.755 INFO:teuthology.orchestra.run.smithi163.stdout: "num_ops": 0 2024-09-12T22:32:55.755 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-09-12T22:32:55.763 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:32:55.848 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:55.846+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:55.905 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-09-12T22:32:55.906 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-09-12T22:32:55.906 INFO:teuthology.orchestra.run.smithi163.stdout: "complaint_time": 30, 2024-09-12T22:32:55.906 INFO:teuthology.orchestra.run.smithi163.stdout: "num_blocked_ops": 0 2024-09-12T22:32:55.906 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-09-12T22:32:55.914 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:32:55.955 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:55.954+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:56.049 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:56.048+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:56.060 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-09-12T22:32:56.060 INFO:teuthology.orchestra.run.smithi163.stdout: "size": 20, 2024-09-12T22:32:56.060 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 600, 2024-09-12T22:32:56.060 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2024-09-12T22:32:56.060 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.060 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-09-12T22:32:56.060 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:27.254459+0000", 2024-09-12T22:32:56.060 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 88.803183981999993, 2024-09-12T22:32:56.060 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.37816283899999997, 2024-09-12T22:32:56.061 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:56.061 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:56.061 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:56.061 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:56.061 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:56.061 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:56.061 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 1 2024-09-12T22:32:56.061 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.061 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:56.061 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.062 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:56.062 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254459+0000", 2024-09-12T22:32:56.062 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:56.062 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.062 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.062 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:56.062 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254459+0000", 2024-09-12T22:32:56.062 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:56.062 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.062 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.062 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:56.062 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254460+0000", 2024-09-12T22:32:56.062 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1739999999999999e-06 2024-09-12T22:32:56.062 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.063 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.063 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:56.063 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254472+0000", 2024-09-12T22:32:56.063 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2207e-05 2024-09-12T22:32:56.063 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.063 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.063 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:56.063 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254483+0000", 2024-09-12T22:32:56.063 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0631999999999999e-05 2024-09-12T22:32:56.063 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.063 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.063 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:56.063 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254492+0000", 2024-09-12T22:32:56.064 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3670000000000003e-06 2024-09-12T22:32:56.064 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.064 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.064 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:56.064 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254551+0000", 2024-09-12T22:32:56.064 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8687999999999998e-05 2024-09-12T22:32:56.064 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.064 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.064 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for peered", 2024-09-12T22:32:56.064 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254562+0000", 2024-09-12T22:32:56.064 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1249e-05 2024-09-12T22:32:56.064 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.064 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.065 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:56.065 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.631211+0000", 2024-09-12T22:32:56.065 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.376649018 2024-09-12T22:32:56.065 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.065 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.065 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:56.065 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.631345+0000", 2024-09-12T22:32:56.065 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013378700000000001 2024-09-12T22:32:56.065 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.065 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.065 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:56.065 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.631479+0000", 2024-09-12T22:32:56.065 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013352399999999999 2024-09-12T22:32:56.066 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.066 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.066 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:56.066 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632324+0000", 2024-09-12T22:32:56.066 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00084508100000000002 2024-09-12T22:32:56.066 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.066 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.066 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:56.066 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632548+0000", 2024-09-12T22:32:56.066 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000224329 2024-09-12T22:32:56.066 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.066 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.066 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:56.066 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632591+0000", 2024-09-12T22:32:56.067 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2564000000000001e-05 2024-09-12T22:32:56.067 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.067 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.067 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:56.067 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632622+0000", 2024-09-12T22:32:56.067 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1219e-05 2024-09-12T22:32:56.067 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:56.067 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:56.067 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:56.067 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.067 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.067 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:185 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:32:56.068 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394355+0000", 2024-09-12T22:32:56.068 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 87.663287885000003, 2024-09-12T22:32:56.068 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011302394, 2024-09-12T22:32:56.068 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:56.068 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:56.068 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:56.068 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:56.068 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:56.068 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:56.068 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 185 2024-09-12T22:32:56.068 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.068 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:56.069 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.069 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:56.069 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394355+0000", 2024-09-12T22:32:56.069 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:56.069 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.069 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.069 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:56.069 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394355+0000", 2024-09-12T22:32:56.069 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:56.069 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.069 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.070 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:56.070 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394355+0000", 2024-09-12T22:32:56.070 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9099999999999999e-07 2024-09-12T22:32:56.070 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.070 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.070 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:56.070 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394385+0000", 2024-09-12T22:32:56.070 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9963000000000001e-05 2024-09-12T22:32:56.070 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.070 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.070 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:56.070 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394390+0000", 2024-09-12T22:32:56.071 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8420000000000004e-06 2024-09-12T22:32:56.071 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.071 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.071 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:56.071 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394393+0000", 2024-09-12T22:32:56.071 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1e-06 2024-09-12T22:32:56.071 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.071 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.071 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:56.071 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.400546+0000", 2024-09-12T22:32:56.071 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0061523309999999996 2024-09-12T22:32:56.071 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.071 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.072 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:56.072 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.400588+0000", 2024-09-12T22:32:56.072 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1835000000000002e-05 2024-09-12T22:32:56.072 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.072 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.072 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:56.072 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.400677+0000", 2024-09-12T22:32:56.072 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9195000000000002e-05 2024-09-12T22:32:56.072 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.072 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.072 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:56.072 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405378+0000", 2024-09-12T22:32:56.072 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0047008659999999997 2024-09-12T22:32:56.073 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.073 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.073 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:56.073 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405569+0000", 2024-09-12T22:32:56.073 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00019148599999999999 2024-09-12T22:32:56.073 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.073 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.073 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:56.073 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405620+0000", 2024-09-12T22:32:56.073 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1416999999999999e-05 2024-09-12T22:32:56.073 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.073 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.073 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:56.073 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405657+0000", 2024-09-12T22:32:56.074 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6968000000000002e-05 2024-09-12T22:32:56.074 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:56.074 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:56.074 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:56.074 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.074 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.074 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:32:56.074 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394399+0000", 2024-09-12T22:32:56.074 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 87.663243674, 2024-09-12T22:32:56.074 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011336601999999999, 2024-09-12T22:32:56.074 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:56.074 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:56.074 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:56.074 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:56.074 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:56.075 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:56.075 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 186 2024-09-12T22:32:56.075 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.075 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:56.075 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.075 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:56.075 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394399+0000", 2024-09-12T22:32:56.075 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:56.075 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.075 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.075 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:56.075 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394399+0000", 2024-09-12T22:32:56.075 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:56.075 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.075 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.076 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:56.076 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394400+0000", 2024-09-12T22:32:56.076 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4499999999999998e-07 2024-09-12T22:32:56.076 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.076 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.076 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:56.076 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394402+0000", 2024-09-12T22:32:56.076 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.875e-06 2024-09-12T22:32:56.076 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.076 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.076 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:56.076 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394405+0000", 2024-09-12T22:32:56.076 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6799999999999999e-06 2024-09-12T22:32:56.076 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.076 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.077 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:56.077 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394408+0000", 2024-09-12T22:32:56.077 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.667e-06 2024-09-12T22:32:56.077 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.077 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.077 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:56.077 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401395+0000", 2024-09-12T22:32:56.077 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0069867230000000002 2024-09-12T22:32:56.077 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.077 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.077 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:56.077 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401438+0000", 2024-09-12T22:32:56.077 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3554999999999999e-05 2024-09-12T22:32:56.078 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.078 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.078 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:56.078 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401509+0000", 2024-09-12T22:32:56.078 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0631999999999997e-05 2024-09-12T22:32:56.078 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.078 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.078 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:56.078 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405392+0000", 2024-09-12T22:32:56.078 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0038830449999999999 2024-09-12T22:32:56.078 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.078 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.078 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:56.078 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405690+0000", 2024-09-12T22:32:56.079 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000298435 2024-09-12T22:32:56.079 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.079 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.079 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:56.079 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405716+0000", 2024-09-12T22:32:56.079 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5435999999999998e-05 2024-09-12T22:32:56.079 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.079 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.079 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:56.079 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405736+0000", 2024-09-12T22:32:56.079 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0208999999999999e-05 2024-09-12T22:32:56.079 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:56.079 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:56.079 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:56.079 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.080 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.080 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:32:56.080 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394411+0000", 2024-09-12T22:32:56.080 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 87.663231547999999, 2024-09-12T22:32:56.080 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011400117, 2024-09-12T22:32:56.080 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:56.080 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:56.080 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:56.080 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:56.080 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:56.080 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:56.080 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 187 2024-09-12T22:32:56.080 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.081 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:56.081 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.081 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:56.081 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394411+0000", 2024-09-12T22:32:56.081 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:56.081 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.081 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.081 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:56.081 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394411+0000", 2024-09-12T22:32:56.081 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:56.081 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.081 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.081 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:56.081 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394412+0000", 2024-09-12T22:32:56.082 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.4999999999999999e-07 2024-09-12T22:32:56.082 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.082 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.082 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:56.082 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394414+0000", 2024-09-12T22:32:56.082 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.984e-06 2024-09-12T22:32:56.082 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.082 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.082 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:56.082 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394418+0000", 2024-09-12T22:32:56.082 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0840000000000002e-06 2024-09-12T22:32:56.082 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.082 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.082 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:56.083 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394431+0000", 2024-09-12T22:32:56.083 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.361e-05 2024-09-12T22:32:56.083 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.083 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.083 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:56.083 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401778+0000", 2024-09-12T22:32:56.083 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0073462659999999997 2024-09-12T22:32:56.083 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.083 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.083 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:56.083 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401853+0000", 2024-09-12T22:32:56.083 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5797000000000006e-05 2024-09-12T22:32:56.083 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.083 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.084 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:56.084 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401990+0000", 2024-09-12T22:32:56.084 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013651399999999999 2024-09-12T22:32:56.084 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.084 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.084 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:56.084 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405402+0000", 2024-09-12T22:32:56.084 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0034116070000000001 2024-09-12T22:32:56.084 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.084 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.084 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:56.084 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405764+0000", 2024-09-12T22:32:56.084 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00036234899999999998 2024-09-12T22:32:56.084 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.085 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.085 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:56.085 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405791+0000", 2024-09-12T22:32:56.085 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7029000000000002e-05 2024-09-12T22:32:56.085 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.085 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.085 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:56.085 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405812+0000", 2024-09-12T22:32:56.085 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0627000000000001e-05 2024-09-12T22:32:56.085 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:56.085 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:56.085 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:56.085 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.085 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.086 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:32:56.086 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394447+0000", 2024-09-12T22:32:56.086 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 87.663196396999993, 2024-09-12T22:32:56.086 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011759588, 2024-09-12T22:32:56.086 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:56.086 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:56.086 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:56.086 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:56.086 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:56.086 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:56.086 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 188 2024-09-12T22:32:56.086 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.086 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:56.086 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.087 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:56.087 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394447+0000", 2024-09-12T22:32:56.087 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:56.087 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.087 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.087 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:56.087 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394447+0000", 2024-09-12T22:32:56.087 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:56.087 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.087 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.087 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:56.087 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394447+0000", 2024-09-12T22:32:56.087 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.15e-07 2024-09-12T22:32:56.087 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.088 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.088 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:56.088 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394512+0000", 2024-09-12T22:32:56.088 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4580999999999997e-05 2024-09-12T22:32:56.088 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.088 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.088 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:56.088 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394518+0000", 2024-09-12T22:32:56.088 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.3380000000000001e-06 2024-09-12T22:32:56.088 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.088 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.088 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:56.088 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394521+0000", 2024-09-12T22:32:56.088 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3340000000000002e-06 2024-09-12T22:32:56.089 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.089 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.089 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:56.089 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.402628+0000", 2024-09-12T22:32:56.089 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.008106996 2024-09-12T22:32:56.089 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.089 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.089 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:56.089 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.402670+0000", 2024-09-12T22:32:56.089 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1983000000000001e-05 2024-09-12T22:32:56.089 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.089 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.089 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:56.089 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.402738+0000", 2024-09-12T22:32:56.090 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.8114999999999994e-05 2024-09-12T22:32:56.090 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.090 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.090 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:56.090 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405668+0000", 2024-09-12T22:32:56.090 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.002929545 2024-09-12T22:32:56.090 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.090 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.090 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:56.090 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406162+0000", 2024-09-12T22:32:56.090 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000494408 2024-09-12T22:32:56.090 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.090 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.090 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:56.091 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406188+0000", 2024-09-12T22:32:56.091 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5766e-05 2024-09-12T22:32:56.091 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.091 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.091 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:56.091 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406206+0000", 2024-09-12T22:32:56.091 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.8107000000000001e-05 2024-09-12T22:32:56.091 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:56.091 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:56.091 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:56.091 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.091 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.091 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:32:56.091 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394528+0000", 2024-09-12T22:32:56.092 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 87.663114727999996, 2024-09-12T22:32:56.092 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.01195536, 2024-09-12T22:32:56.092 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:56.092 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:56.092 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:56.092 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:56.092 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:56.092 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:56.092 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 189 2024-09-12T22:32:56.092 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.092 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:56.092 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.092 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:56.092 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394528+0000", 2024-09-12T22:32:56.093 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:56.093 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.093 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.093 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:56.093 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394528+0000", 2024-09-12T22:32:56.093 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:56.093 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.093 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.093 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:56.093 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394529+0000", 2024-09-12T22:32:56.093 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4900000000000001e-07 2024-09-12T22:32:56.093 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.093 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.094 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:56.094 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394531+0000", 2024-09-12T22:32:56.094 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.458e-06 2024-09-12T22:32:56.094 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.094 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.094 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:56.094 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394535+0000", 2024-09-12T22:32:56.094 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7900000000000001e-06 2024-09-12T22:32:56.094 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.094 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.094 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:56.094 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394537+0000", 2024-09-12T22:32:56.094 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.632e-06 2024-09-12T22:32:56.094 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.094 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.095 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:56.095 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.404932+0000", 2024-09-12T22:32:56.095 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010394158000000001 2024-09-12T22:32:56.095 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.095 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.095 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:56.095 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405017+0000", 2024-09-12T22:32:56.095 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5525000000000005e-05 2024-09-12T22:32:56.095 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.095 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.095 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:56.095 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405114+0000", 2024-09-12T22:32:56.095 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.6527000000000006e-05 2024-09-12T22:32:56.096 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.096 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.096 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:56.096 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405818+0000", 2024-09-12T22:32:56.096 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00070412800000000005 2024-09-12T22:32:56.096 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.096 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.096 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:56.096 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406437+0000", 2024-09-12T22:32:56.096 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00061898900000000002 2024-09-12T22:32:56.096 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.096 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.096 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:56.096 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406463+0000", 2024-09-12T22:32:56.096 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6268e-05 2024-09-12T22:32:56.097 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.097 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.097 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:56.097 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406484+0000", 2024-09-12T22:32:56.097 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0536000000000001e-05 2024-09-12T22:32:56.097 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:56.097 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:56.097 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:56.097 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.097 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.097 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:56.097 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.401422+0000", 2024-09-12T22:32:56.097 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 78.656220822999998, 2024-09-12T22:32:56.098 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016896452999999999, 2024-09-12T22:32:56.098 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:56.098 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:56.098 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:56.098 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:56.098 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.098 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:56.098 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401422+0000", 2024-09-12T22:32:56.098 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:56.098 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.098 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.098 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:56.098 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401422+0000", 2024-09-12T22:32:56.098 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:56.099 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.099 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.099 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:56.099 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401424+0000", 2024-09-12T22:32:56.099 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9e-06 2024-09-12T22:32:56.099 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.099 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.099 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:56.099 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401437+0000", 2024-09-12T22:32:56.099 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2831e-05 2024-09-12T22:32:56.099 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.099 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.099 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:56.099 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401471+0000", 2024-09-12T22:32:56.100 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4010000000000001e-05 2024-09-12T22:32:56.100 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.100 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.100 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:56.100 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401484+0000", 2024-09-12T22:32:56.100 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2711000000000001e-05 2024-09-12T22:32:56.100 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.100 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.100 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:56.100 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405410+0000", 2024-09-12T22:32:56.100 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0039259170000000001 2024-09-12T22:32:56.100 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.100 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.100 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:56.101 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405529+0000", 2024-09-12T22:32:56.101 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000119778 2024-09-12T22:32:56.101 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.101 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.101 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:56.102 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405655+0000", 2024-09-12T22:32:56.102 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012556700000000001 2024-09-12T22:32:56.102 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.102 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.102 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:56.103 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410456+0000", 2024-09-12T22:32:56.103 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0048008269999999997 2024-09-12T22:32:56.103 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.103 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.103 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:56.103 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418226+0000", 2024-09-12T22:32:56.103 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0077707729999999999 2024-09-12T22:32:56.103 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.103 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.103 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:56.103 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418277+0000", 2024-09-12T22:32:56.104 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0476000000000003e-05 2024-09-12T22:32:56.104 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.104 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.104 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:56.104 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418319+0000", 2024-09-12T22:32:56.104 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1662999999999997e-05 2024-09-12T22:32:56.104 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:56.104 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:56.104 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:56.104 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.105 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.105 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:56.105 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.401505+0000", 2024-09-12T22:32:56.105 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 78.656138158999994, 2024-09-12T22:32:56.105 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016987904000000002, 2024-09-12T22:32:56.105 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:56.105 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:56.105 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:56.105 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:56.105 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.105 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:56.105 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401505+0000", 2024-09-12T22:32:56.106 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:56.106 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.106 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.106 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:56.106 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401505+0000", 2024-09-12T22:32:56.106 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:56.106 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.106 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.106 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:56.106 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401506+0000", 2024-09-12T22:32:56.106 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4700000000000001e-07 2024-09-12T22:32:56.106 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.106 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.106 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:56.107 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401510+0000", 2024-09-12T22:32:56.107 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6609999999999999e-06 2024-09-12T22:32:56.107 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.107 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.107 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:56.107 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401771+0000", 2024-09-12T22:32:56.107 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00026110700000000001 2024-09-12T22:32:56.107 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.107 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.107 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:56.107 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401921+0000", 2024-09-12T22:32:56.107 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014939099999999999 2024-09-12T22:32:56.107 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.107 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.108 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:56.108 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405944+0000", 2024-09-12T22:32:56.108 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0040235449999999999 2024-09-12T22:32:56.108 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.108 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.108 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:56.108 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406018+0000", 2024-09-12T22:32:56.108 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3373000000000004e-05 2024-09-12T22:32:56.108 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.108 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.108 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:56.108 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406172+0000", 2024-09-12T22:32:56.108 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00015435399999999999 2024-09-12T22:32:56.109 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.109 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.109 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:56.109 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410461+0000", 2024-09-12T22:32:56.109 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0042888609999999997 2024-09-12T22:32:56.109 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.109 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.109 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:56.109 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418371+0000", 2024-09-12T22:32:56.109 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0079098380000000006 2024-09-12T22:32:56.109 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.109 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.109 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:56.110 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418443+0000", 2024-09-12T22:32:56.110 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2705000000000003e-05 2024-09-12T22:32:56.110 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.110 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.110 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:56.110 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418493+0000", 2024-09-12T22:32:56.110 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9322e-05 2024-09-12T22:32:56.110 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:56.110 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:56.110 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:56.110 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.110 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.110 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:56.111 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.401939+0000", 2024-09-12T22:32:56.111 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 78.655704423000003, 2024-09-12T22:32:56.111 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016722292999999999, 2024-09-12T22:32:56.111 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:56.111 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:56.111 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:56.111 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:56.111 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.111 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:56.111 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401939+0000", 2024-09-12T22:32:56.111 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:56.111 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.111 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.111 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:56.112 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401939+0000", 2024-09-12T22:32:56.112 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:56.112 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.112 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.112 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:56.112 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401940+0000", 2024-09-12T22:32:56.112 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1990000000000001e-06 2024-09-12T22:32:56.112 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.112 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.112 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:56.112 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401956+0000", 2024-09-12T22:32:56.112 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.6344000000000001e-05 2024-09-12T22:32:56.112 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.113 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.113 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:56.113 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401974+0000", 2024-09-12T22:32:56.113 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7730000000000001e-05 2024-09-12T22:32:56.113 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.113 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.113 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:56.113 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401982+0000", 2024-09-12T22:32:56.113 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.7800000000000001e-06 2024-09-12T22:32:56.113 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.113 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.113 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:56.114 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406557+0000", 2024-09-12T22:32:56.114 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0045758489999999999 2024-09-12T22:32:56.114 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.114 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.114 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:56.114 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406697+0000", 2024-09-12T22:32:56.114 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013925100000000001 2024-09-12T22:32:56.114 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.115 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.115 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:56.115 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406830+0000", 2024-09-12T22:32:56.115 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013293499999999999 2024-09-12T22:32:56.115 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.115 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.115 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:56.115 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410465+0000", 2024-09-12T22:32:56.115 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0036352680000000001 2024-09-12T22:32:56.115 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.115 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.115 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:56.115 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418564+0000", 2024-09-12T22:32:56.115 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0080992140000000004 2024-09-12T22:32:56.116 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.116 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.116 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:56.116 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418621+0000", 2024-09-12T22:32:56.116 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7167999999999999e-05 2024-09-12T22:32:56.116 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.116 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.116 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:56.116 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418661+0000", 2024-09-12T22:32:56.116 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9555000000000003e-05 2024-09-12T22:32:56.116 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:56.116 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:56.116 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:56.117 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.117 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.117 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:56.117 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.401994+0000", 2024-09-12T22:32:56.117 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 78.655648550999999, 2024-09-12T22:32:56.117 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016804109000000001, 2024-09-12T22:32:56.117 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:56.117 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:56.117 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:56.117 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:56.117 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.117 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:56.117 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401994+0000", 2024-09-12T22:32:56.117 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:56.118 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.118 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.118 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:56.118 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401994+0000", 2024-09-12T22:32:56.118 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:56.118 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.118 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.118 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:56.118 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401995+0000", 2024-09-12T22:32:56.118 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.8899999999999998e-07 2024-09-12T22:32:56.118 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.118 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.118 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:56.119 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402000+0000", 2024-09-12T22:32:56.119 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.498e-06 2024-09-12T22:32:56.119 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.119 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.119 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:56.119 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402007+0000", 2024-09-12T22:32:56.119 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.554e-06 2024-09-12T22:32:56.119 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.119 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.119 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:56.119 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402046+0000", 2024-09-12T22:32:56.119 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9156000000000003e-05 2024-09-12T22:32:56.119 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.119 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.119 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:56.120 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407342+0000", 2024-09-12T22:32:56.120 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052957610000000004 2024-09-12T22:32:56.120 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.120 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.120 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:56.120 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407521+0000", 2024-09-12T22:32:56.120 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00017878100000000001 2024-09-12T22:32:56.120 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.120 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.120 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:56.120 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407641+0000", 2024-09-12T22:32:56.120 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012013 2024-09-12T22:32:56.120 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.121 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.121 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:56.121 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410472+0000", 2024-09-12T22:32:56.121 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.002830455 2024-09-12T22:32:56.121 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.121 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.121 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:56.121 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418714+0000", 2024-09-12T22:32:56.121 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0082422789999999999 2024-09-12T22:32:56.121 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.121 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.121 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:56.121 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418761+0000", 2024-09-12T22:32:56.121 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6956999999999998e-05 2024-09-12T22:32:56.122 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.122 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.122 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:56.122 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418799+0000", 2024-09-12T22:32:56.122 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7749000000000001e-05 2024-09-12T22:32:56.122 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:56.122 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:56.122 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:56.122 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.122 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.122 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:56.122 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.402060+0000", 2024-09-12T22:32:56.122 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 78.655583106999998, 2024-09-12T22:32:56.122 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016885686, 2024-09-12T22:32:56.123 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:56.123 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:56.123 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:56.123 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:56.123 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.123 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:56.123 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402060+0000", 2024-09-12T22:32:56.123 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:56.123 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.123 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.123 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:56.123 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402060+0000", 2024-09-12T22:32:56.123 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:56.123 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.124 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.124 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:56.124 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402061+0000", 2024-09-12T22:32:56.124 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4399999999999999e-07 2024-09-12T22:32:56.124 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.124 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.124 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:56.124 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402066+0000", 2024-09-12T22:32:56.124 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8649999999999998e-06 2024-09-12T22:32:56.124 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.124 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.124 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:56.124 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402146+0000", 2024-09-12T22:32:56.125 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9054000000000006e-05 2024-09-12T22:32:56.125 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.125 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.125 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:56.125 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402287+0000", 2024-09-12T22:32:56.125 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014108600000000001 2024-09-12T22:32:56.125 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.125 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.125 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:56.125 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408185+0000", 2024-09-12T22:32:56.125 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0058983919999999997 2024-09-12T22:32:56.125 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.125 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.126 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:56.126 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408299+0000", 2024-09-12T22:32:56.126 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114102 2024-09-12T22:32:56.126 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.126 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.126 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:56.126 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408420+0000", 2024-09-12T22:32:56.126 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000120492 2024-09-12T22:32:56.126 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.126 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.126 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:56.126 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410867+0000", 2024-09-12T22:32:56.126 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0024476430000000002 2024-09-12T22:32:56.126 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.127 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.127 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:56.127 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418851+0000", 2024-09-12T22:32:56.127 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0079841489999999994 2024-09-12T22:32:56.127 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.127 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.127 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:56.127 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418894+0000", 2024-09-12T22:32:56.127 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3090000000000002e-05 2024-09-12T22:32:56.127 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.127 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.127 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:56.127 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418946+0000", 2024-09-12T22:32:56.127 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1069000000000002e-05 2024-09-12T22:32:56.128 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:56.128 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:56.128 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:56.128 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.128 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.128 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:56.128 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.402375+0000", 2024-09-12T22:32:56.128 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 78.655268042000003, 2024-09-12T22:32:56.128 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016768531999999999, 2024-09-12T22:32:56.128 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:56.128 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:56.128 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:56.128 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:56.128 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.129 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:56.129 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402375+0000", 2024-09-12T22:32:56.129 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:56.129 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.129 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.129 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:56.129 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402375+0000", 2024-09-12T22:32:56.129 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:56.129 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.129 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.129 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:56.129 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402375+0000", 2024-09-12T22:32:56.129 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4099999999999999e-07 2024-09-12T22:32:56.129 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.130 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.130 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:56.130 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402379+0000", 2024-09-12T22:32:56.130 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9870000000000001e-06 2024-09-12T22:32:56.130 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.130 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.130 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:56.130 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402389+0000", 2024-09-12T22:32:56.130 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0000000000000001e-05 2024-09-12T22:32:56.130 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.130 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.130 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:56.130 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402401+0000", 2024-09-12T22:32:56.130 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.148e-05 2024-09-12T22:32:56.131 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.131 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.131 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:56.131 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409108+0000", 2024-09-12T22:32:56.131 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0067068429999999997 2024-09-12T22:32:56.131 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.131 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.131 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:56.131 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409189+0000", 2024-09-12T22:32:56.131 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0815999999999993e-05 2024-09-12T22:32:56.131 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.131 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.131 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:56.131 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409320+0000", 2024-09-12T22:32:56.131 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000131586 2024-09-12T22:32:56.132 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.132 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.132 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:56.132 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410872+0000", 2024-09-12T22:32:56.132 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0015521599999999999 2024-09-12T22:32:56.132 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.132 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.132 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:56.132 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419049+0000", 2024-09-12T22:32:56.132 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0081763719999999995 2024-09-12T22:32:56.132 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.132 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.132 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:56.133 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419107+0000", 2024-09-12T22:32:56.133 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7899000000000002e-05 2024-09-12T22:32:56.133 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.133 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.133 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:56.133 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419143+0000", 2024-09-12T22:32:56.133 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6847999999999997e-05 2024-09-12T22:32:56.133 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:56.133 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:56.133 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:56.133 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.133 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.133 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:56.133 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.402903+0000", 2024-09-12T22:32:56.134 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 78.654739629999995, 2024-09-12T22:32:56.134 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016378428, 2024-09-12T22:32:56.134 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:56.134 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:56.134 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:56.134 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:56.134 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.134 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:56.134 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402903+0000", 2024-09-12T22:32:56.134 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:56.134 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.134 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.134 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:56.135 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402903+0000", 2024-09-12T22:32:56.135 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:56.135 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.135 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.135 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:56.135 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402904+0000", 2024-09-12T22:32:56.135 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9500000000000001e-07 2024-09-12T22:32:56.135 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.135 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.135 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:56.135 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402944+0000", 2024-09-12T22:32:56.135 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0265000000000002e-05 2024-09-12T22:32:56.135 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.135 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.136 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:56.136 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402979+0000", 2024-09-12T22:32:56.136 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4378000000000002e-05 2024-09-12T22:32:56.136 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.136 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.136 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:56.136 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402987+0000", 2024-09-12T22:32:56.136 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3559999999999993e-06 2024-09-12T22:32:56.136 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.136 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.136 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:56.136 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409577+0000", 2024-09-12T22:32:56.136 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0065901709999999997 2024-09-12T22:32:56.136 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.137 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.137 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:56.137 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409653+0000", 2024-09-12T22:32:56.137 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5819e-05 2024-09-12T22:32:56.137 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.137 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.137 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:56.137 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409725+0000", 2024-09-12T22:32:56.137 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2200000000000007e-05 2024-09-12T22:32:56.137 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.137 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.137 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:56.137 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.411234+0000", 2024-09-12T22:32:56.138 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001508225 2024-09-12T22:32:56.138 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.138 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.138 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:56.138 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419212+0000", 2024-09-12T22:32:56.138 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0079783400000000004 2024-09-12T22:32:56.138 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.138 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.138 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:56.138 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419244+0000", 2024-09-12T22:32:56.138 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2384e-05 2024-09-12T22:32:56.138 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.138 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.138 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:56.139 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419282+0000", 2024-09-12T22:32:56.139 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7394999999999997e-05 2024-09-12T22:32:56.139 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:56.139 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:56.139 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:56.139 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.139 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.139 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:56.139 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.403135+0000", 2024-09-12T22:32:56.139 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 78.654507760000001, 2024-09-12T22:32:56.139 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016294211999999999, 2024-09-12T22:32:56.139 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:56.139 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:56.139 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:56.140 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:56.140 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.140 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:56.140 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403135+0000", 2024-09-12T22:32:56.140 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:56.140 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.140 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.140 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:56.140 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403135+0000", 2024-09-12T22:32:56.140 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:56.140 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.140 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.140 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:56.140 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403136+0000", 2024-09-12T22:32:56.141 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.4e-07 2024-09-12T22:32:56.141 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.141 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.141 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:56.141 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403149+0000", 2024-09-12T22:32:56.141 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2723e-05 2024-09-12T22:32:56.141 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.141 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.141 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:56.141 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403158+0000", 2024-09-12T22:32:56.141 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3919999999999992e-06 2024-09-12T22:32:56.141 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.142 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.142 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:56.142 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403166+0000", 2024-09-12T22:32:56.142 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.2309999999999996e-06 2024-09-12T22:32:56.142 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.142 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.142 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:56.142 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409944+0000", 2024-09-12T22:32:56.142 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0067775309999999998 2024-09-12T22:32:56.142 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.142 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.142 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:56.142 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410032+0000", 2024-09-12T22:32:56.143 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.7906999999999997e-05 2024-09-12T22:32:56.143 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.143 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.143 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:56.143 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410152+0000", 2024-09-12T22:32:56.143 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012037800000000001 2024-09-12T22:32:56.143 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.143 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.143 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:56.143 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.411945+0000", 2024-09-12T22:32:56.143 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0017931850000000001 2024-09-12T22:32:56.143 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.143 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.143 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:56.144 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419319+0000", 2024-09-12T22:32:56.144 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0073731780000000002 2024-09-12T22:32:56.144 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.144 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.144 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:56.144 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419376+0000", 2024-09-12T22:32:56.144 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7728e-05 2024-09-12T22:32:56.144 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.144 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.144 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:56.144 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419429+0000", 2024-09-12T22:32:56.144 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3019000000000002e-05 2024-09-12T22:32:56.144 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:56.144 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:56.145 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:56.145 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.145 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.145 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:56.145 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.403185+0000", 2024-09-12T22:32:56.145 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 78.654457879000006, 2024-09-12T22:32:56.145 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.014902164000000001, 2024-09-12T22:32:56.145 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:56.145 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:56.145 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:56.145 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:56.145 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.145 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:56.146 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403185+0000", 2024-09-12T22:32:56.146 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:56.146 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.146 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.146 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:56.146 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403185+0000", 2024-09-12T22:32:56.146 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:56.146 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.146 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.146 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:56.146 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403186+0000", 2024-09-12T22:32:56.146 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9400000000000005e-07 2024-09-12T22:32:56.146 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.147 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.147 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:56.147 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403191+0000", 2024-09-12T22:32:56.147 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6980000000000003e-06 2024-09-12T22:32:56.147 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.147 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.147 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:56.147 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403199+0000", 2024-09-12T22:32:56.147 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2520000000000002e-06 2024-09-12T22:32:56.147 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.147 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.147 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:56.147 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403205+0000", 2024-09-12T22:32:56.147 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.908e-06 2024-09-12T22:32:56.148 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.148 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.148 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:56.148 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403359+0000", 2024-09-12T22:32:56.148 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000154544 2024-09-12T22:32:56.148 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.148 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.148 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:56.148 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403528+0000", 2024-09-12T22:32:56.148 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000168455 2024-09-12T22:32:56.148 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.148 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.148 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:56.148 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403763+0000", 2024-09-12T22:32:56.149 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00023539599999999999 2024-09-12T22:32:56.149 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.149 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.149 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:56.149 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409378+0000", 2024-09-12T22:32:56.149 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056150000000000002 2024-09-12T22:32:56.149 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.149 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.149 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:56.149 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418012+0000", 2024-09-12T22:32:56.149 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0086339559999999999 2024-09-12T22:32:56.149 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.149 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.150 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:56.150 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418046+0000", 2024-09-12T22:32:56.150 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4267999999999998e-05 2024-09-12T22:32:56.150 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.150 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.150 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:56.150 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418087+0000", 2024-09-12T22:32:56.150 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0992999999999999e-05 2024-09-12T22:32:56.150 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:56.150 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:56.150 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:56.150 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.150 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.150 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:56.151 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.403273+0000", 2024-09-12T22:32:56.151 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 78.654369927999994, 2024-09-12T22:32:56.151 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.014934866, 2024-09-12T22:32:56.151 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:56.151 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:56.151 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:56.151 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:56.151 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.151 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:56.151 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403273+0000", 2024-09-12T22:32:56.151 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:56.151 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.151 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.151 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:56.152 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403273+0000", 2024-09-12T22:32:56.152 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:56.152 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.152 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.152 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:56.152 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403274+0000", 2024-09-12T22:32:56.152 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.297e-06 2024-09-12T22:32:56.152 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.152 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.152 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:56.152 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403282+0000", 2024-09-12T22:32:56.152 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6340000000000001e-06 2024-09-12T22:32:56.152 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.152 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.153 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:56.153 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403305+0000", 2024-09-12T22:32:56.153 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3149000000000001e-05 2024-09-12T22:32:56.153 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.153 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.153 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:56.153 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403320+0000", 2024-09-12T22:32:56.153 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4527e-05 2024-09-12T22:32:56.153 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.153 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.153 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:56.153 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.404928+0000", 2024-09-12T22:32:56.153 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001608459 2024-09-12T22:32:56.153 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.154 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.154 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:56.154 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405218+0000", 2024-09-12T22:32:56.154 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00028982900000000002 2024-09-12T22:32:56.154 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.154 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.154 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:56.154 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405829+0000", 2024-09-12T22:32:56.154 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00061127900000000005 2024-09-12T22:32:56.154 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.154 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.154 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:56.154 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409403+0000", 2024-09-12T22:32:56.154 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.003573597 2024-09-12T22:32:56.154 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.155 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.155 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:56.155 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418138+0000", 2024-09-12T22:32:56.155 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0087349969999999996 2024-09-12T22:32:56.155 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.155 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.155 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:56.155 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418178+0000", 2024-09-12T22:32:56.155 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0649999999999999e-05 2024-09-12T22:32:56.155 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.155 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.155 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:56.155 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418208+0000", 2024-09-12T22:32:56.155 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9448e-05 2024-09-12T22:32:56.156 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:56.156 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:56.156 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:56.156 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.156 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.156 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:56.156 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.405456+0000", 2024-09-12T22:32:56.156 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 78.652186783000005, 2024-09-12T22:32:56.156 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012888389, 2024-09-12T22:32:56.156 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:56.156 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:56.156 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:56.156 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:56.157 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.157 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:56.157 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405456+0000", 2024-09-12T22:32:56.157 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:56.157 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.157 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.157 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:56.157 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405456+0000", 2024-09-12T22:32:56.157 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:56.157 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.157 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.157 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:56.157 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405457+0000", 2024-09-12T22:32:56.157 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.6599999999999994e-07 2024-09-12T22:32:56.158 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.158 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.158 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:56.158 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405463+0000", 2024-09-12T22:32:56.158 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4739999999999996e-06 2024-09-12T22:32:56.158 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.158 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.158 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:56.158 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405474+0000", 2024-09-12T22:32:56.158 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1095e-05 2024-09-12T22:32:56.158 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.158 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.158 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:56.158 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405482+0000", 2024-09-12T22:32:56.158 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3610000000000001e-06 2024-09-12T22:32:56.159 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.159 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.159 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:56.159 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407051+0000", 2024-09-12T22:32:56.159 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0015688970000000001 2024-09-12T22:32:56.159 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.159 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.159 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:56.159 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407259+0000", 2024-09-12T22:32:56.159 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00020778300000000001 2024-09-12T22:32:56.159 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.159 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.159 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:56.159 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407622+0000", 2024-09-12T22:32:56.160 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000363066 2024-09-12T22:32:56.160 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.160 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.160 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:56.160 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409438+0000", 2024-09-12T22:32:56.160 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001816319 2024-09-12T22:32:56.160 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.160 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.160 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:56.160 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418257+0000", 2024-09-12T22:32:56.160 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0088187720000000008 2024-09-12T22:32:56.160 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.160 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.161 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:56.161 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418308+0000", 2024-09-12T22:32:56.161 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1180000000000001e-05 2024-09-12T22:32:56.161 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.161 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.161 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:56.161 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418345+0000", 2024-09-12T22:32:56.161 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6476000000000001e-05 2024-09-12T22:32:56.161 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:56.161 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:56.161 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:56.161 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.161 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.162 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:56.162 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.405496+0000", 2024-09-12T22:32:56.162 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 78.652147425999999, 2024-09-12T22:32:56.162 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013016012, 2024-09-12T22:32:56.162 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:56.162 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:56.162 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:56.162 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:56.162 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.162 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:56.162 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405496+0000", 2024-09-12T22:32:56.162 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:56.162 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.162 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.163 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:56.163 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405496+0000", 2024-09-12T22:32:56.163 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:56.163 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.163 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.163 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:56.163 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405496+0000", 2024-09-12T22:32:56.163 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7999999999999995e-07 2024-09-12T22:32:56.163 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.163 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.163 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:56.163 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405501+0000", 2024-09-12T22:32:56.163 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8359999999999999e-06 2024-09-12T22:32:56.163 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.163 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.164 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:56.164 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405514+0000", 2024-09-12T22:32:56.164 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2522e-05 2024-09-12T22:32:56.164 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.164 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.164 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:56.164 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405521+0000", 2024-09-12T22:32:56.164 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5020000000000003e-06 2024-09-12T22:32:56.164 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.164 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.164 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:56.164 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405575+0000", 2024-09-12T22:32:56.164 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4169999999999998e-05 2024-09-12T22:32:56.165 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.165 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.165 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:56.165 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405697+0000", 2024-09-12T22:32:56.165 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000121301 2024-09-12T22:32:56.165 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.165 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.165 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:56.165 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405829+0000", 2024-09-12T22:32:56.165 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000132662 2024-09-12T22:32:56.165 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.165 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.165 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:56.165 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409155+0000", 2024-09-12T22:32:56.166 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0033259050000000001 2024-09-12T22:32:56.166 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.166 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.166 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:56.166 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418425+0000", 2024-09-12T22:32:56.166 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0092696319999999999 2024-09-12T22:32:56.166 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.166 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.166 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:56.166 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418471+0000", 2024-09-12T22:32:56.166 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6213e-05 2024-09-12T22:32:56.166 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.166 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.166 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:56.166 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418512+0000", 2024-09-12T22:32:56.167 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0589000000000001e-05 2024-09-12T22:32:56.167 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:56.167 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:56.167 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:56.167 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.167 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.167 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:56.167 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.406108+0000", 2024-09-12T22:32:56.167 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 78.651535029000001, 2024-09-12T22:32:56.167 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012458175, 2024-09-12T22:32:56.167 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:56.167 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:56.167 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:56.167 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:56.168 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.168 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:56.168 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406108+0000", 2024-09-12T22:32:56.168 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:56.168 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.168 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.168 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:56.168 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406108+0000", 2024-09-12T22:32:56.168 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:56.168 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.168 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.168 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:56.168 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406109+0000", 2024-09-12T22:32:56.169 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9899999999999999e-07 2024-09-12T22:32:56.169 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.169 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.169 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:56.169 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406115+0000", 2024-09-12T22:32:56.169 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9030000000000001e-06 2024-09-12T22:32:56.169 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.169 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.169 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:56.169 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406141+0000", 2024-09-12T22:32:56.169 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5999e-05 2024-09-12T22:32:56.169 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.169 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.169 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:56.170 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406150+0000", 2024-09-12T22:32:56.170 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.6050000000000004e-06 2024-09-12T22:32:56.170 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.170 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.170 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:56.170 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408163+0000", 2024-09-12T22:32:56.170 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0020122769999999998 2024-09-12T22:32:56.170 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.170 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.170 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:56.170 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408309+0000", 2024-09-12T22:32:56.170 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014606999999999999 2024-09-12T22:32:56.170 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.170 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.171 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:56.171 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408433+0000", 2024-09-12T22:32:56.171 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012460300000000001 2024-09-12T22:32:56.171 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.171 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.171 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:56.171 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409903+0000", 2024-09-12T22:32:56.171 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001469499 2024-09-12T22:32:56.171 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.171 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.171 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:56.171 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418427+0000", 2024-09-12T22:32:56.171 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0085241139999999993 2024-09-12T22:32:56.171 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.171 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.172 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:56.172 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418471+0000", 2024-09-12T22:32:56.172 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4474000000000001e-05 2024-09-12T22:32:56.172 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.172 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.172 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:56.172 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418566+0000", 2024-09-12T22:32:56.172 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.4732e-05 2024-09-12T22:32:56.172 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:56.172 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:56.172 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:56.172 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.173 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.173 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:56.173 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.407266+0000", 2024-09-12T22:32:56.173 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 78.650377172999995, 2024-09-12T22:32:56.173 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011442905, 2024-09-12T22:32:56.173 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:56.173 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:56.173 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2024-09-12T22:32:56.173 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:56.173 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.173 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:56.173 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407266+0000", 2024-09-12T22:32:56.173 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:56.173 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.174 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.174 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:56.174 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407266+0000", 2024-09-12T22:32:56.174 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:56.174 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.174 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.174 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:56.174 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407266+0000", 2024-09-12T22:32:56.174 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7899999999999998e-07 2024-09-12T22:32:56.174 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.174 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.174 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:56.174 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407269+0000", 2024-09-12T22:32:56.174 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9210000000000001e-06 2024-09-12T22:32:56.175 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.175 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.175 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:56.175 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407331+0000", 2024-09-12T22:32:56.175 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1376000000000003e-05 2024-09-12T22:32:56.175 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.175 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.175 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:56.175 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407337+0000", 2024-09-12T22:32:56.175 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1929999999999998e-06 2024-09-12T22:32:56.175 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.175 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.175 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:56.175 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408974+0000", 2024-09-12T22:32:56.176 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0016367109999999999 2024-09-12T22:32:56.176 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.176 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.176 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:56.176 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409112+0000", 2024-09-12T22:32:56.176 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000137952 2024-09-12T22:32:56.176 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.176 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.176 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:56.176 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418709+0000", 2024-09-12T22:32:56.176 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0095971730000000005 2024-09-12T22:32:56.176 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:56.176 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:56.177 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:56.177 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:56.177 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:56.177 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-09-12T22:32:56.178 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:32:56.179 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:56.177+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:56.279 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:56.279+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:56.287 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:32:56.287 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:32:56.287 INFO:teuthology.orchestra.run.smithi148.stdout: "num_ops": 0 2024-09-12T22:32:56.287 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:32:56.296 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:32:56.381 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:56.380+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:56.399 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:32:56.399 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:32:56.399 INFO:teuthology.orchestra.run.smithi148.stdout: "complaint_time": 30, 2024-09-12T22:32:56.399 INFO:teuthology.orchestra.run.smithi148.stdout: "num_blocked_ops": 0 2024-09-12T22:32:56.399 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:32:56.409 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:32:56.453 INFO:teuthology.orchestra.run.smithi019.stderr:noscrub is set 2024-09-12T22:32:56.482 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:56.481+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:56.497 INFO:tasks.workunit.client.0.smithi019.stderr:Note: switching to '7741f7f9ee20524f89b8f61d1609b32fb3b1570a'. 2024-09-12T22:32:56.497 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T22:32:56.497 INFO:tasks.workunit.client.0.smithi019.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T22:32:56.497 INFO:tasks.workunit.client.0.smithi019.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T22:32:56.497 INFO:tasks.workunit.client.0.smithi019.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T22:32:56.498 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T22:32:56.498 INFO:tasks.workunit.client.0.smithi019.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T22:32:56.498 INFO:tasks.workunit.client.0.smithi019.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T22:32:56.498 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T22:32:56.498 INFO:tasks.workunit.client.0.smithi019.stderr: git switch -c 2024-09-12T22:32:56.498 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T22:32:56.498 INFO:tasks.workunit.client.0.smithi019.stderr:Or undo this operation with: 2024-09-12T22:32:56.498 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T22:32:56.498 INFO:tasks.workunit.client.0.smithi019.stderr: git switch - 2024-09-12T22:32:56.498 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T22:32:56.498 INFO:tasks.workunit.client.0.smithi019.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T22:32:56.498 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T22:32:56.498 INFO:tasks.workunit.client.0.smithi019.stderr:HEAD is now at 7741f7f9ee2 Merge pull request #59718 from afreen23/wip-67994-squid 2024-09-12T22:32:56.503 DEBUG:teuthology.orchestra.run.smithi019:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T22:32:56.515 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:32:56.515 INFO:teuthology.orchestra.run.smithi148.stdout: "size": 20, 2024-09-12T22:32:56.515 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 600, 2024-09-12T22:32:56.515 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [ 2024-09-12T22:32:56.515 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.515 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:56.516 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.400880+0000", 2024-09-12T22:32:56.516 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 79.112466218999998, 2024-09-12T22:32:56.516 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0095133660000000005, 2024-09-12T22:32:56.516 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:56.516 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:56.516 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:56.516 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:56.516 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.516 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:56.516 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400880+0000", 2024-09-12T22:32:56.516 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:56.516 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.516 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.517 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:56.517 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400880+0000", 2024-09-12T22:32:56.517 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:56.517 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.517 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.517 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:56.517 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400892+0000", 2024-09-12T22:32:56.517 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1941e-05 2024-09-12T22:32:56.517 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.517 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.517 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:56.517 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400900+0000", 2024-09-12T22:32:56.518 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0080000000000002e-06 2024-09-12T22:32:56.518 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.518 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.518 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:56.518 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400911+0000", 2024-09-12T22:32:56.518 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1452e-05 2024-09-12T22:32:56.518 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.518 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.518 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:56.518 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400922+0000", 2024-09-12T22:32:56.518 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0772e-05 2024-09-12T22:32:56.518 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.518 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.518 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:56.519 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401009+0000", 2024-09-12T22:32:56.519 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.7206000000000005e-05 2024-09-12T22:32:56.519 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.519 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.519 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:56.519 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401157+0000", 2024-09-12T22:32:56.519 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014831499999999999 2024-09-12T22:32:56.519 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.519 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.519 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:56.519 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401312+0000", 2024-09-12T22:32:56.519 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00015495600000000001 2024-09-12T22:32:56.519 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.520 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.520 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:56.520 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.403060+0000", 2024-09-12T22:32:56.520 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0017475220000000001 2024-09-12T22:32:56.520 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.520 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.520 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:56.520 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410300+0000", 2024-09-12T22:32:56.520 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0072403260000000001 2024-09-12T22:32:56.520 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.520 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.520 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:56.521 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410350+0000", 2024-09-12T22:32:56.521 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9814000000000001e-05 2024-09-12T22:32:56.521 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.521 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.521 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:56.521 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410393+0000", 2024-09-12T22:32:56.521 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3053999999999998e-05 2024-09-12T22:32:56.521 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:56.521 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:56.521 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:56.521 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.521 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.522 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:56.522 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.400952+0000", 2024-09-12T22:32:56.522 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 79.112394066999997, 2024-09-12T22:32:56.522 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0096045620000000005, 2024-09-12T22:32:56.522 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:56.522 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:56.522 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:56.522 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:56.522 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.522 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:56.522 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400952+0000", 2024-09-12T22:32:56.522 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:56.522 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.523 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.523 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:56.523 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400952+0000", 2024-09-12T22:32:56.523 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:56.523 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.523 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.523 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:56.523 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400953+0000", 2024-09-12T22:32:56.523 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.8000000000000005e-07 2024-09-12T22:32:56.523 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.523 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.523 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:56.524 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400957+0000", 2024-09-12T22:32:56.524 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.33e-06 2024-09-12T22:32:56.524 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.524 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.524 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:56.524 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400966+0000", 2024-09-12T22:32:56.524 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1989999999999995e-06 2024-09-12T22:32:56.524 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.524 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.524 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:56.524 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400973+0000", 2024-09-12T22:32:56.524 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2779999999999999e-06 2024-09-12T22:32:56.525 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.525 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.525 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:56.525 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401696+0000", 2024-09-12T22:32:56.525 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00072363500000000003 2024-09-12T22:32:56.525 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.525 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.525 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:56.525 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401788+0000", 2024-09-12T22:32:56.525 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1862999999999998e-05 2024-09-12T22:32:56.525 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.525 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.525 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:56.526 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401929+0000", 2024-09-12T22:32:56.526 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014096000000000001 2024-09-12T22:32:56.526 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.526 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.526 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:56.526 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.403542+0000", 2024-09-12T22:32:56.526 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001612963 2024-09-12T22:32:56.526 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.526 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.526 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:56.526 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410460+0000", 2024-09-12T22:32:56.526 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0069180500000000002 2024-09-12T22:32:56.526 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.526 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.527 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:56.527 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410515+0000", 2024-09-12T22:32:56.527 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5009000000000001e-05 2024-09-12T22:32:56.527 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.527 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.527 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:56.527 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410557+0000", 2024-09-12T22:32:56.527 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1495000000000002e-05 2024-09-12T22:32:56.527 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:56.527 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:56.527 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:56.527 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.527 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.527 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:56.528 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.400984+0000", 2024-09-12T22:32:56.528 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 79.112361571999998, 2024-09-12T22:32:56.528 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0073703950000000001, 2024-09-12T22:32:56.528 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:56.528 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:56.528 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:56.528 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:56.528 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.528 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:56.528 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400984+0000", 2024-09-12T22:32:56.528 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:56.528 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.529 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.529 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:56.529 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400984+0000", 2024-09-12T22:32:56.529 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:56.529 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.529 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.529 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:56.529 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400985+0000", 2024-09-12T22:32:56.529 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3200000000000005e-07 2024-09-12T22:32:56.529 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.529 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.529 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:56.529 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400998+0000", 2024-09-12T22:32:56.530 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2726e-05 2024-09-12T22:32:56.530 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.530 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.530 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:56.530 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401006+0000", 2024-09-12T22:32:56.530 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.3110000000000006e-06 2024-09-12T22:32:56.530 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.530 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.530 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:56.530 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401022+0000", 2024-09-12T22:32:56.530 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6249e-05 2024-09-12T22:32:56.530 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.530 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.531 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:56.531 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401700+0000", 2024-09-12T22:32:56.531 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00067811100000000001 2024-09-12T22:32:56.531 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.531 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.531 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:56.531 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401839+0000", 2024-09-12T22:32:56.531 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013865399999999999 2024-09-12T22:32:56.531 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.531 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.531 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:56.531 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401962+0000", 2024-09-12T22:32:56.531 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000123266 2024-09-12T22:32:56.532 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.532 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.532 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:56.532 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.403589+0000", 2024-09-12T22:32:56.532 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001626932 2024-09-12T22:32:56.532 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.532 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.532 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:56.532 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.408274+0000", 2024-09-12T22:32:56.532 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0046848100000000002 2024-09-12T22:32:56.532 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.532 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.532 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:56.532 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.408324+0000", 2024-09-12T22:32:56.532 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9784000000000003e-05 2024-09-12T22:32:56.533 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.533 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.533 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:56.533 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.408355+0000", 2024-09-12T22:32:56.533 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.1019999999999998e-05 2024-09-12T22:32:56.533 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:56.533 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:56.533 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:56.533 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.533 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.533 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:56.533 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401034+0000", 2024-09-12T22:32:56.533 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 79.112312132, 2024-09-12T22:32:56.534 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011063051000000001, 2024-09-12T22:32:56.534 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:56.534 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:56.534 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:56.534 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:56.534 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.534 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:56.534 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401034+0000", 2024-09-12T22:32:56.534 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:56.534 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.534 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.534 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:56.535 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401034+0000", 2024-09-12T22:32:56.535 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:56.535 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.535 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.535 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:56.535 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401034+0000", 2024-09-12T22:32:56.535 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8899999999999999e-07 2024-09-12T22:32:56.535 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.535 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.535 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:56.535 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401038+0000", 2024-09-12T22:32:56.536 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.523e-06 2024-09-12T22:32:56.536 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.536 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.536 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:56.536 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401046+0000", 2024-09-12T22:32:56.536 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0479999999999999e-06 2024-09-12T22:32:56.536 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.536 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.536 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:56.536 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401051+0000", 2024-09-12T22:32:56.537 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2619999999999998e-06 2024-09-12T22:32:56.537 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.537 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.537 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:56.537 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402270+0000", 2024-09-12T22:32:56.537 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012182429999999999 2024-09-12T22:32:56.537 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.537 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.537 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:56.537 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402325+0000", 2024-09-12T22:32:56.537 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5526999999999999e-05 2024-09-12T22:32:56.537 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.537 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.538 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:56.538 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402403+0000", 2024-09-12T22:32:56.538 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.7559999999999996e-05 2024-09-12T22:32:56.538 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.538 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.538 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:56.538 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.403655+0000", 2024-09-12T22:32:56.538 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012521489999999999 2024-09-12T22:32:56.538 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.538 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.538 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:56.538 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411979+0000", 2024-09-12T22:32:56.538 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0083240420000000002 2024-09-12T22:32:56.539 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.539 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.539 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:56.539 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.412036+0000", 2024-09-12T22:32:56.539 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7639000000000002e-05 2024-09-12T22:32:56.539 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.539 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.539 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:56.539 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.412097+0000", 2024-09-12T22:32:56.539 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0469e-05 2024-09-12T22:32:56.539 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:56.539 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:56.540 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:56.540 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.540 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.540 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:56.540 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401060+0000", 2024-09-12T22:32:56.540 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 79.11228638, 2024-09-12T22:32:56.540 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.010030172, 2024-09-12T22:32:56.540 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:56.540 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:56.540 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:56.541 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:56.541 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.541 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:56.541 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401060+0000", 2024-09-12T22:32:56.541 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:56.541 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.541 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.541 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:56.541 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401060+0000", 2024-09-12T22:32:56.541 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:56.541 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.541 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.542 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:56.542 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401060+0000", 2024-09-12T22:32:56.542 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2500000000000001e-07 2024-09-12T22:32:56.542 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.542 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.542 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:56.542 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401063+0000", 2024-09-12T22:32:56.542 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0910000000000001e-06 2024-09-12T22:32:56.542 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.542 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.542 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:56.542 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401070+0000", 2024-09-12T22:32:56.542 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1210000000000001e-06 2024-09-12T22:32:56.543 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.543 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.543 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:56.543 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401076+0000", 2024-09-12T22:32:56.543 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2830000000000001e-06 2024-09-12T22:32:56.543 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.543 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.543 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:56.543 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402288+0000", 2024-09-12T22:32:56.543 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012123699999999999 2024-09-12T22:32:56.543 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.543 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.543 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:56.543 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402359+0000", 2024-09-12T22:32:56.544 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.0988000000000005e-05 2024-09-12T22:32:56.544 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.544 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.544 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:56.544 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402457+0000", 2024-09-12T22:32:56.544 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.7857999999999997e-05 2024-09-12T22:32:56.544 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.544 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.544 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:56.544 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.404395+0000", 2024-09-12T22:32:56.544 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0019380160000000001 2024-09-12T22:32:56.544 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.544 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.544 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:56.545 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410603+0000", 2024-09-12T22:32:56.545 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.006208061 2024-09-12T22:32:56.545 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.545 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.545 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:56.545 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410687+0000", 2024-09-12T22:32:56.545 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.4623000000000006e-05 2024-09-12T22:32:56.545 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.545 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.545 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:56.545 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411090+0000", 2024-09-12T22:32:56.545 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00040233599999999999 2024-09-12T22:32:56.546 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:56.546 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:56.546 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:56.546 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.546 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.546 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:56.546 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401083+0000", 2024-09-12T22:32:56.546 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 79.112262963999996, 2024-09-12T22:32:56.546 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0097591850000000001, 2024-09-12T22:32:56.546 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:56.546 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:56.546 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:56.546 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:56.546 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.547 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:56.547 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401083+0000", 2024-09-12T22:32:56.547 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:56.547 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.547 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.547 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:56.547 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401083+0000", 2024-09-12T22:32:56.547 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:56.547 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.547 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.547 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:56.547 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401084+0000", 2024-09-12T22:32:56.547 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4799999999999999e-07 2024-09-12T22:32:56.547 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.547 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.548 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:56.548 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401088+0000", 2024-09-12T22:32:56.548 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6419999999999998e-06 2024-09-12T22:32:56.548 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.548 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.548 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:56.548 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401094+0000", 2024-09-12T22:32:56.548 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0090000000000004e-06 2024-09-12T22:32:56.548 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.548 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.549 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:56.549 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401108+0000", 2024-09-12T22:32:56.549 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3884e-05 2024-09-12T22:32:56.549 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.549 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.549 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:56.549 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401165+0000", 2024-09-12T22:32:56.549 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.6499000000000002e-05 2024-09-12T22:32:56.549 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.549 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.549 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:56.549 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401261+0000", 2024-09-12T22:32:56.549 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.6872000000000004e-05 2024-09-12T22:32:56.549 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.550 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.550 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:56.550 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401376+0000", 2024-09-12T22:32:56.550 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000114508 2024-09-12T22:32:56.550 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.550 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.550 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:56.550 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402666+0000", 2024-09-12T22:32:56.550 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012901659999999999 2024-09-12T22:32:56.550 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.550 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.550 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:56.550 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410572+0000", 2024-09-12T22:32:56.550 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0079055489999999996 2024-09-12T22:32:56.551 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.551 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.551 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:56.551 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410661+0000", 2024-09-12T22:32:56.551 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.9578000000000002e-05 2024-09-12T22:32:56.551 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.551 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.551 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:56.551 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410842+0000", 2024-09-12T22:32:56.551 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00018102999999999999 2024-09-12T22:32:56.551 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:56.551 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:56.551 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:56.551 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.551 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.552 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:56.552 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401122+0000", 2024-09-12T22:32:56.552 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 79.112223932000006, 2024-09-12T22:32:56.552 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0099122080000000005, 2024-09-12T22:32:56.552 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:56.552 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:56.552 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:32:56.552 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:56.552 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.552 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:56.552 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401122+0000", 2024-09-12T22:32:56.552 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:56.552 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.552 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.552 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:56.553 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401122+0000", 2024-09-12T22:32:56.553 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:56.553 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.553 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.553 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:56.553 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401123+0000", 2024-09-12T22:32:56.553 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2600000000000002e-07 2024-09-12T22:32:56.553 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.553 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.553 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:56.553 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401126+0000", 2024-09-12T22:32:56.553 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.6449999999999998e-06 2024-09-12T22:32:56.553 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.553 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.554 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:56.554 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401133+0000", 2024-09-12T22:32:56.554 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.9890000000000003e-06 2024-09-12T22:32:56.554 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.554 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.554 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:56.554 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401138+0000", 2024-09-12T22:32:56.554 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8060000000000002e-06 2024-09-12T22:32:56.554 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.554 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.554 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:56.554 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401703+0000", 2024-09-12T22:32:56.555 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00056509099999999999 2024-09-12T22:32:56.555 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.555 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.555 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:56.555 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401837+0000", 2024-09-12T22:32:56.555 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013338799999999999 2024-09-12T22:32:56.555 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.555 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.555 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:56.555 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411034+0000", 2024-09-12T22:32:56.555 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.009197663 2024-09-12T22:32:56.555 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:56.555 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:56.555 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:56.556 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.556 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.556 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:56.556 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401158+0000", 2024-09-12T22:32:56.556 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 79.112188153000005, 2024-09-12T22:32:56.556 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.010292437999999999, 2024-09-12T22:32:56.556 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:56.556 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:56.556 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:32:56.556 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:56.556 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.557 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:56.557 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401158+0000", 2024-09-12T22:32:56.557 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:56.557 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.557 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.557 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:56.557 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401158+0000", 2024-09-12T22:32:56.557 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:56.557 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.557 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.557 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:56.557 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401158+0000", 2024-09-12T22:32:56.557 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9699999999999996e-07 2024-09-12T22:32:56.558 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.558 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.558 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:56.558 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401161+0000", 2024-09-12T22:32:56.558 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.7410000000000001e-06 2024-09-12T22:32:56.558 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.558 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.558 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:56.558 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401168+0000", 2024-09-12T22:32:56.558 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.844e-06 2024-09-12T22:32:56.558 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.558 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.559 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:56.559 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401174+0000", 2024-09-12T22:32:56.559 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4700000000000001e-06 2024-09-12T22:32:56.559 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.559 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.559 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:56.559 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402799+0000", 2024-09-12T22:32:56.559 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0016256409999999999 2024-09-12T22:32:56.559 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.559 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.559 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:56.559 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402893+0000", 2024-09-12T22:32:56.559 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.3807999999999994e-05 2024-09-12T22:32:56.560 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.560 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.560 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:56.560 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411450+0000", 2024-09-12T22:32:56.560 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0085573369999999999 2024-09-12T22:32:56.560 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:56.560 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:56.560 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:56.560 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.560 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.560 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:56.560 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401183+0000", 2024-09-12T22:32:56.560 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 79.112163300999995, 2024-09-12T22:32:56.561 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0068597830000000004, 2024-09-12T22:32:56.561 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:56.561 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:56.561 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:32:56.561 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:56.561 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.561 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:56.561 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401183+0000", 2024-09-12T22:32:56.561 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:56.561 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.561 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.561 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:56.561 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401183+0000", 2024-09-12T22:32:56.562 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:56.562 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.562 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.562 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:56.562 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401183+0000", 2024-09-12T22:32:56.562 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.6700000000000003e-07 2024-09-12T22:32:56.562 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.562 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.562 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:56.562 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401186+0000", 2024-09-12T22:32:56.562 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4679999999999999e-06 2024-09-12T22:32:56.562 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.562 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.562 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:56.562 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401192+0000", 2024-09-12T22:32:56.563 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.1519999999999997e-06 2024-09-12T22:32:56.563 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.563 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.563 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:56.563 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401197+0000", 2024-09-12T22:32:56.563 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4669999999999998e-06 2024-09-12T22:32:56.563 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.563 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.563 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:56.563 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401253+0000", 2024-09-12T22:32:56.563 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.6211000000000001e-05 2024-09-12T22:32:56.563 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.563 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.563 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:56.563 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401413+0000", 2024-09-12T22:32:56.564 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00016021399999999999 2024-09-12T22:32:56.564 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.564 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.564 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:56.564 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.408043+0000", 2024-09-12T22:32:56.564 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0066295039999999996 2024-09-12T22:32:56.564 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:56.564 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:56.564 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:56.564 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.564 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.564 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:20 3.1c e19/17 3:3ed09add:::607.00000000:head v 19'1, mlcod=0'0)", 2024-09-12T22:32:56.564 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.409642+0000", 2024-09-12T22:32:56.564 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 79.103703842000002, 2024-09-12T22:32:56.565 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0038816269999999999, 2024-09-12T22:32:56.565 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:56.565 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:56.565 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:56.565 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:56.565 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.565 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:56.565 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409642+0000", 2024-09-12T22:32:56.565 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:56.565 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.565 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.565 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:56.565 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409642+0000", 2024-09-12T22:32:56.565 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:56.565 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.566 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.566 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:56.566 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409642+0000", 2024-09-12T22:32:56.566 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.6899999999999999e-07 2024-09-12T22:32:56.566 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.566 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.566 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:56.566 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409648+0000", 2024-09-12T22:32:56.566 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.49e-06 2024-09-12T22:32:56.566 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.566 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.566 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:56.566 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409656+0000", 2024-09-12T22:32:56.566 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.2949999999999994e-06 2024-09-12T22:32:56.567 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.567 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.567 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:56.567 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409664+0000", 2024-09-12T22:32:56.567 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.1219999999999995e-06 2024-09-12T22:32:56.567 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.567 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.567 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:56.567 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409707+0000", 2024-09-12T22:32:56.567 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2222000000000003e-05 2024-09-12T22:32:56.567 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.567 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.567 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:56.567 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409724+0000", 2024-09-12T22:32:56.568 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7496999999999999e-05 2024-09-12T22:32:56.568 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.568 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.568 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:56.568 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413439+0000", 2024-09-12T22:32:56.568 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00371448 2024-09-12T22:32:56.568 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.568 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.568 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:56.568 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413524+0000", 2024-09-12T22:32:56.568 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.5252000000000003e-05 2024-09-12T22:32:56.568 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:56.568 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:56.569 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:56.569 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.569 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.569 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:28 3.13 e19/17 3:cd5a64a3:::100.00000000:head v 19'1, mlcod=0'0)", 2024-09-12T22:32:56.569 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.409681+0000", 2024-09-12T22:32:56.569 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 79.103665359000004, 2024-09-12T22:32:56.569 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0038708710000000001, 2024-09-12T22:32:56.569 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:56.569 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:56.569 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:56.569 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:56.569 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.570 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:56.570 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409681+0000", 2024-09-12T22:32:56.570 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:56.570 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.570 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.570 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:56.570 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409681+0000", 2024-09-12T22:32:56.570 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:56.570 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.570 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.570 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:56.571 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409681+0000", 2024-09-12T22:32:56.571 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3000000000000002e-07 2024-09-12T22:32:56.571 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.571 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.571 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:56.571 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409695+0000", 2024-09-12T22:32:56.571 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4313e-05 2024-09-12T22:32:56.571 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.571 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.571 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:56.571 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409703+0000", 2024-09-12T22:32:56.571 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4000000000000003e-06 2024-09-12T22:32:56.571 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.572 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.572 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:56.572 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409708+0000", 2024-09-12T22:32:56.572 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3190000000000002e-06 2024-09-12T22:32:56.572 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.572 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.572 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:56.572 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409875+0000", 2024-09-12T22:32:56.572 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000167329 2024-09-12T22:32:56.572 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.572 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.572 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:56.572 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409892+0000", 2024-09-12T22:32:56.573 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6957999999999999e-05 2024-09-12T22:32:56.573 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.573 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.573 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:56.573 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413457+0000", 2024-09-12T22:32:56.573 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0035651279999999999 2024-09-12T22:32:56.573 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.573 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.573 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:56.573 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413552+0000", 2024-09-12T22:32:56.573 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.4093999999999997e-05 2024-09-12T22:32:56.574 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:56.574 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:56.574 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:56.574 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.574 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.574 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:21 3.1c e19/17 3:3ed09add:::607.00000000:head v 19'2, mlcod=0'0)", 2024-09-12T22:32:56.574 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.409718+0000", 2024-09-12T22:32:56.574 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 79.103627693999996, 2024-09-12T22:32:56.574 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003851883, 2024-09-12T22:32:56.574 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:56.574 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:56.574 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:56.574 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:56.575 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.575 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:56.575 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409718+0000", 2024-09-12T22:32:56.575 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:56.575 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.575 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.575 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:56.575 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409718+0000", 2024-09-12T22:32:56.575 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:56.575 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.575 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.575 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:56.575 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409719+0000", 2024-09-12T22:32:56.575 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.16e-07 2024-09-12T22:32:56.576 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.576 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.576 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:56.576 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409722+0000", 2024-09-12T22:32:56.576 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.692e-06 2024-09-12T22:32:56.576 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.576 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.576 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:56.576 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409729+0000", 2024-09-12T22:32:56.576 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.516e-06 2024-09-12T22:32:56.576 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.576 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.576 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:56.576 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409750+0000", 2024-09-12T22:32:56.576 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1151000000000001e-05 2024-09-12T22:32:56.577 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.577 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.577 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:56.577 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410015+0000", 2024-09-12T22:32:56.577 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00026477599999999999 2024-09-12T22:32:56.577 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.577 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.577 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:56.577 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410104+0000", 2024-09-12T22:32:56.577 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.9586000000000006e-05 2024-09-12T22:32:56.577 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.577 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.577 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:56.578 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413528+0000", 2024-09-12T22:32:56.578 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0034237880000000001 2024-09-12T22:32:56.578 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.578 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.578 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:56.578 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413570+0000", 2024-09-12T22:32:56.578 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2157999999999999e-05 2024-09-12T22:32:56.578 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:56.578 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:56.578 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:56.578 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.578 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.578 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:27 3.13 e19/17 3:c91d4a1d:::mds0_inotable:head v 19'2, mlcod=0'0)", 2024-09-12T22:32:56.578 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.409760+0000", 2024-09-12T22:32:56.579 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 79.103586178, 2024-09-12T22:32:56.579 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0039301910000000004, 2024-09-12T22:32:56.579 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:56.579 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:56.579 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:56.579 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:56.579 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.579 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:56.579 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409760+0000", 2024-09-12T22:32:56.579 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:56.579 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.579 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.579 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:56.579 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409760+0000", 2024-09-12T22:32:56.579 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:56.580 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.580 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.580 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:56.580 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409760+0000", 2024-09-12T22:32:56.580 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.39e-07 2024-09-12T22:32:56.580 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.580 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.580 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:56.580 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409765+0000", 2024-09-12T22:32:56.580 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4449999999999998e-06 2024-09-12T22:32:56.580 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.580 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.580 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:56.580 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409771+0000", 2024-09-12T22:32:56.581 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7159999999999997e-06 2024-09-12T22:32:56.581 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.581 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.581 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:56.581 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409778+0000", 2024-09-12T22:32:56.581 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.331e-06 2024-09-12T22:32:56.581 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.581 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.581 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:56.581 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410191+0000", 2024-09-12T22:32:56.581 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00041348300000000003 2024-09-12T22:32:56.581 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.581 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.581 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:56.581 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410211+0000", 2024-09-12T22:32:56.582 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9933999999999999e-05 2024-09-12T22:32:56.582 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.582 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.582 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:56.582 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413638+0000", 2024-09-12T22:32:56.582 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003426854 2024-09-12T22:32:56.582 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.582 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.582 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:56.582 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413690+0000", 2024-09-12T22:32:56.582 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2089000000000002e-05 2024-09-12T22:32:56.582 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:56.582 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:56.582 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:56.583 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.583 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.583 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "pg_update_log_missing_reply(3.b epoch 19/17 rep_tid 4 lcod 19'2)", 2024-09-12T22:32:56.583 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.410060+0000", 2024-09-12T22:32:56.583 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 79.103286513, 2024-09-12T22:32:56.583 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00098016500000000007, 2024-09-12T22:32:56.583 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:56.583 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:56.583 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "reached pg", 2024-09-12T22:32:56.583 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:56.583 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.583 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:56.583 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410060+0000", 2024-09-12T22:32:56.583 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:56.583 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.584 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.584 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:56.584 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410060+0000", 2024-09-12T22:32:56.584 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:56.584 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.584 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.584 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:56.584 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410060+0000", 2024-09-12T22:32:56.584 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.8299999999999998e-07 2024-09-12T22:32:56.584 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.584 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.584 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:56.584 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410062+0000", 2024-09-12T22:32:56.584 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5749999999999999e-06 2024-09-12T22:32:56.584 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.585 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.585 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:56.585 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410070+0000", 2024-09-12T22:32:56.585 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.909e-06 2024-09-12T22:32:56.585 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.585 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.585 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:56.585 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410076+0000", 2024-09-12T22:32:56.585 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7049999999999996e-06 2024-09-12T22:32:56.585 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.585 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.585 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:56.585 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410943+0000", 2024-09-12T22:32:56.585 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00086681900000000001 2024-09-12T22:32:56.585 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.585 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.586 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:56.586 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411040+0000", 2024-09-12T22:32:56.586 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.6774000000000006e-05 2024-09-12T22:32:56.586 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:56.586 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:56.586 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:56.586 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.586 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.586 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e19/17 ondisk, result = 0)", 2024-09-12T22:32:56.586 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.410113+0000", 2024-09-12T22:32:56.586 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 79.103233246000002, 2024-09-12T22:32:56.586 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00098911599999999995, 2024-09-12T22:32:56.586 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:56.586 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:56.586 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:32:56.587 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:56.587 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.587 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:56.587 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410113+0000", 2024-09-12T22:32:56.587 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:56.587 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.587 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.587 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:56.587 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410113+0000", 2024-09-12T22:32:56.587 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:56.587 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.587 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.587 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:56.587 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410113+0000", 2024-09-12T22:32:56.587 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.99e-07 2024-09-12T22:32:56.588 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.588 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.588 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:56.588 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410115+0000", 2024-09-12T22:32:56.588 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.046e-06 2024-09-12T22:32:56.588 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.588 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.588 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:56.588 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410121+0000", 2024-09-12T22:32:56.588 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0050000000000001e-06 2024-09-12T22:32:56.588 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.588 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.588 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:56.588 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410126+0000", 2024-09-12T22:32:56.589 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8339999999999998e-06 2024-09-12T22:32:56.589 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.589 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.589 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:56.589 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410587+0000", 2024-09-12T22:32:56.589 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00046095499999999998 2024-09-12T22:32:56.589 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.589 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.589 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:56.589 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410595+0000", 2024-09-12T22:32:56.589 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.9419999999999995e-06 2024-09-12T22:32:56.589 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.589 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.589 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:56.590 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411102+0000", 2024-09-12T22:32:56.590 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00050713500000000003 2024-09-12T22:32:56.590 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:56.590 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:56.590 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:56.590 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.590 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.590 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 19/17 rep_tid 8 lcod 19'4)", 2024-09-12T22:32:56.590 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.410133+0000", 2024-09-12T22:32:56.590 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 79.103213318000002, 2024-09-12T22:32:56.590 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0013504000000000001, 2024-09-12T22:32:56.591 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:56.591 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:56.591 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "reached pg", 2024-09-12T22:32:56.591 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:56.591 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.591 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:56.591 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410133+0000", 2024-09-12T22:32:56.591 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:56.591 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.591 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.591 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:56.591 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410133+0000", 2024-09-12T22:32:56.592 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:56.592 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.592 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.592 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:56.592 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410133+0000", 2024-09-12T22:32:56.592 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.0599999999999999e-07 2024-09-12T22:32:56.592 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.592 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.592 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:56.592 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410135+0000", 2024-09-12T22:32:56.592 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7770000000000001e-06 2024-09-12T22:32:56.592 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.592 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.593 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:56.593 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410140+0000", 2024-09-12T22:32:56.593 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9960000000000001e-06 2024-09-12T22:32:56.593 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.593 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.593 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:56.593 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410144+0000", 2024-09-12T22:32:56.593 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9500000000000003e-06 2024-09-12T22:32:56.593 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.593 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.593 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:56.593 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411310+0000", 2024-09-12T22:32:56.594 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001166311 2024-09-12T22:32:56.594 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.594 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.594 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:56.594 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411483+0000", 2024-09-12T22:32:56.594 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00017316 2024-09-12T22:32:56.594 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:56.594 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:56.594 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:56.594 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.594 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.594 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "pg_update_log_missing(3.1a epoch 19/17 rep_tid 0 entries 19'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T22:32:56.594 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.410617+0000", 2024-09-12T22:32:56.594 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 79.102728923000001, 2024-09-12T22:32:56.595 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0030439709999999999, 2024-09-12T22:32:56.595 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:56.595 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:56.595 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "reached pg", 2024-09-12T22:32:56.595 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:56.595 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.595 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:56.595 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410617+0000", 2024-09-12T22:32:56.595 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:56.595 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.595 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.595 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:56.595 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410617+0000", 2024-09-12T22:32:56.595 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:56.595 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.596 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.596 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:56.596 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410617+0000", 2024-09-12T22:32:56.596 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3599999999999999e-07 2024-09-12T22:32:56.596 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.596 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.596 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:56.596 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410625+0000", 2024-09-12T22:32:56.596 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5410000000000003e-06 2024-09-12T22:32:56.596 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.596 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.596 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:56.596 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410638+0000", 2024-09-12T22:32:56.596 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3261999999999999e-05 2024-09-12T22:32:56.597 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.597 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.597 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:56.597 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410653+0000", 2024-09-12T22:32:56.597 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4844000000000001e-05 2024-09-12T22:32:56.597 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.597 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.597 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:56.597 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410814+0000", 2024-09-12T22:32:56.597 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00016119999999999999 2024-09-12T22:32:56.597 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.597 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.597 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:56.597 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413661+0000", 2024-09-12T22:32:56.597 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0028467879999999998 2024-09-12T22:32:56.598 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:56.598 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:56.598 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:56.598 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.598 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.598 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-09-12T22:32:56.598 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:39.398875+0000", 2024-09-12T22:32:56.598 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 77.114470643000004, 2024-09-12T22:32:56.598 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0015679069999999999, 2024-09-12T22:32:56.598 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:56.598 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:56.598 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:56.599 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:56.599 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.599 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:56.599 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398875+0000", 2024-09-12T22:32:56.599 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:56.599 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.599 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.599 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:56.599 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398875+0000", 2024-09-12T22:32:56.599 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:56.599 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.599 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.599 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:56.599 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398878+0000", 2024-09-12T22:32:56.600 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1679999999999998e-06 2024-09-12T22:32:56.600 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.600 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.600 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:56.600 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398888+0000", 2024-09-12T22:32:56.600 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.084e-05 2024-09-12T22:32:56.600 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.600 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.600 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:56.600 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398906+0000", 2024-09-12T22:32:56.600 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7518000000000001e-05 2024-09-12T22:32:56.600 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.600 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.601 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:56.601 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398914+0000", 2024-09-12T22:32:56.601 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5989999999999996e-06 2024-09-12T22:32:56.601 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.601 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.601 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:56.601 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398974+0000", 2024-09-12T22:32:56.601 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0988e-05 2024-09-12T22:32:56.601 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.601 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.601 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:56.601 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.399078+0000", 2024-09-12T22:32:56.601 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000103133 2024-09-12T22:32:56.602 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.602 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.602 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:56.602 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.399166+0000", 2024-09-12T22:32:56.602 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.8183999999999995e-05 2024-09-12T22:32:56.602 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.602 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.602 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:56.602 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.399747+0000", 2024-09-12T22:32:56.602 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00058110599999999996 2024-09-12T22:32:56.602 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.602 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.602 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:56.603 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.400377+0000", 2024-09-12T22:32:56.603 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000630157 2024-09-12T22:32:56.603 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.603 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.603 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:56.603 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.400415+0000", 2024-09-12T22:32:56.603 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7814000000000001e-05 2024-09-12T22:32:56.604 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.604 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.604 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:56.604 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.400443+0000", 2024-09-12T22:32:56.604 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8399999999999999e-05 2024-09-12T22:32:56.604 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:56.604 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:56.605 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:56.605 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.605 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.605 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e23)", 2024-09-12T22:32:56.605 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:58.400966+0000", 2024-09-12T22:32:56.605 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 58.112379734999998, 2024-09-12T22:32:56.605 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001468876, 2024-09-12T22:32:56.605 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:56.605 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:56.605 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:56.605 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:56.605 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.605 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:56.606 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400966+0000", 2024-09-12T22:32:56.606 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:56.606 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.606 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.606 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:56.606 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400966+0000", 2024-09-12T22:32:56.606 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:56.606 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.606 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.606 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:56.606 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400967+0000", 2024-09-12T22:32:56.606 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.046e-06 2024-09-12T22:32:56.606 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.607 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.607 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:56.607 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400974+0000", 2024-09-12T22:32:56.607 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2310000000000001e-06 2024-09-12T22:32:56.607 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.607 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.607 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:56.607 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400988+0000", 2024-09-12T22:32:56.607 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4482e-05 2024-09-12T22:32:56.607 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.607 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.607 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:56.607 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400997+0000", 2024-09-12T22:32:56.607 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.0189999999999995e-06 2024-09-12T22:32:56.608 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.608 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.608 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:56.608 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.401068+0000", 2024-09-12T22:32:56.608 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1426000000000004e-05 2024-09-12T22:32:56.608 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.608 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.608 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:56.608 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.401174+0000", 2024-09-12T22:32:56.608 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000105769 2024-09-12T22:32:56.608 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.608 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.608 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:56.609 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.401335+0000", 2024-09-12T22:32:56.609 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000161225 2024-09-12T22:32:56.609 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.609 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.609 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:56.609 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.402110+0000", 2024-09-12T22:32:56.609 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00077428800000000004 2024-09-12T22:32:56.609 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.609 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.609 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:56.609 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.402333+0000", 2024-09-12T22:32:56.609 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000223723 2024-09-12T22:32:56.609 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.610 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.610 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:56.610 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.402388+0000", 2024-09-12T22:32:56.610 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4700999999999997e-05 2024-09-12T22:32:56.610 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.610 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.610 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:56.610 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.402435+0000", 2024-09-12T22:32:56.610 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6965999999999997e-05 2024-09-12T22:32:56.610 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:56.610 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:56.610 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:56.611 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.611 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.611 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:45 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e27)", 2024-09-12T22:32:56.611 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:32:04.401614+0000", 2024-09-12T22:32:56.611 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 52.111732306, 2024-09-12T22:32:56.611 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0014279749999999999, 2024-09-12T22:32:56.611 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:56.611 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:56.611 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:56.611 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:56.611 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.611 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:56.611 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401614+0000", 2024-09-12T22:32:56.611 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:56.612 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.612 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.612 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:56.612 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401614+0000", 2024-09-12T22:32:56.612 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:56.612 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.612 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.612 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:56.612 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401615+0000", 2024-09-12T22:32:56.612 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.161e-06 2024-09-12T22:32:56.612 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.612 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.612 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:56.612 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401621+0000", 2024-09-12T22:32:56.613 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8730000000000004e-06 2024-09-12T22:32:56.613 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.613 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.613 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:56.613 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401633+0000", 2024-09-12T22:32:56.613 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1800000000000001e-05 2024-09-12T22:32:56.617 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.617 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.617 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:56.617 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401656+0000", 2024-09-12T22:32:56.617 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.3521999999999999e-05 2024-09-12T22:32:56.617 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.617 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.617 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:56.617 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401713+0000", 2024-09-12T22:32:56.617 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7259000000000002e-05 2024-09-12T22:32:56.618 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.618 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.618 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:56.618 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401849+0000", 2024-09-12T22:32:56.618 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013613500000000001 2024-09-12T22:32:56.618 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.618 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.618 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:56.618 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.402009+0000", 2024-09-12T22:32:56.618 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00015947199999999999 2024-09-12T22:32:56.618 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.618 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.618 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:56.619 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.402629+0000", 2024-09-12T22:32:56.619 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00061962200000000001 2024-09-12T22:32:56.619 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.619 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.619 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:56.619 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.402983+0000", 2024-09-12T22:32:56.619 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00035447499999999998 2024-09-12T22:32:56.619 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.619 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.619 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:56.619 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.403016+0000", 2024-09-12T22:32:56.619 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3108999999999998e-05 2024-09-12T22:32:56.619 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:56.619 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:56.620 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:56.620 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.403042+0000", 2024-09-12T22:32:56.620 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5547000000000001e-05 2024-09-12T22:32:56.620 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:56.620 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:56.620 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:56.620 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:56.620 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:56.620 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:32:56.622 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:56.620+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:56.622 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:32:56.652 INFO:tasks.workunit.client.0.smithi019.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T22:32:56.655 INFO:tasks.workunit.client.0.smithi019.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T22:32:56.655 INFO:tasks.workunit.client.0.smithi019.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T22:32:56.722 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:56.721+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:56.728 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-09-12T22:32:56.728 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-09-12T22:32:56.728 INFO:teuthology.orchestra.run.smithi163.stdout: "num_ops": 0 2024-09-12T22:32:56.728 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-09-12T22:32:56.737 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:32:56.823 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:56.822+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:56.881 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-09-12T22:32:56.881 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-09-12T22:32:56.881 INFO:teuthology.orchestra.run.smithi163.stdout: "complaint_time": 30, 2024-09-12T22:32:56.881 INFO:teuthology.orchestra.run.smithi163.stdout: "num_blocked_ops": 0 2024-09-12T22:32:56.881 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-09-12T22:32:56.890 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:32:56.924 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:56.923+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:56.995 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-09-12T22:32:56.995 INFO:teuthology.orchestra.run.smithi163.stdout: "size": 20, 2024-09-12T22:32:56.995 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 600, 2024-09-12T22:32:56.995 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2024-09-12T22:32:56.995 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.995 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-09-12T22:32:56.995 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:27.254459+0000", 2024-09-12T22:32:56.995 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 89.738154250999997, 2024-09-12T22:32:56.996 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.37816283899999997, 2024-09-12T22:32:56.996 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:56.996 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:56.996 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:56.996 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:56.996 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:56.996 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:56.996 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 1 2024-09-12T22:32:56.996 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.996 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:56.996 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.996 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:56.996 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254459+0000", 2024-09-12T22:32:56.996 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:56.997 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.997 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.997 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:56.997 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254459+0000", 2024-09-12T22:32:56.997 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:56.997 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.997 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.997 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:56.997 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254460+0000", 2024-09-12T22:32:56.997 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1739999999999999e-06 2024-09-12T22:32:56.997 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.997 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.997 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:56.998 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254472+0000", 2024-09-12T22:32:56.998 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2207e-05 2024-09-12T22:32:56.998 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.998 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.998 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:56.998 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254483+0000", 2024-09-12T22:32:56.998 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0631999999999999e-05 2024-09-12T22:32:56.998 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.998 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.998 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:56.998 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254492+0000", 2024-09-12T22:32:56.998 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3670000000000003e-06 2024-09-12T22:32:56.998 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.999 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.999 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:56.999 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254551+0000", 2024-09-12T22:32:56.999 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8687999999999998e-05 2024-09-12T22:32:56.999 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.999 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.999 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for peered", 2024-09-12T22:32:56.999 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254562+0000", 2024-09-12T22:32:56.999 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1249e-05 2024-09-12T22:32:56.999 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:56.999 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:56.999 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:56.999 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.631211+0000", 2024-09-12T22:32:56.999 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.376649018 2024-09-12T22:32:57.000 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.000 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.000 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:57.000 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.631345+0000", 2024-09-12T22:32:57.000 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013378700000000001 2024-09-12T22:32:57.000 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.000 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.000 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:57.000 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.631479+0000", 2024-09-12T22:32:57.000 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013352399999999999 2024-09-12T22:32:57.000 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.000 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.000 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:57.001 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632324+0000", 2024-09-12T22:32:57.001 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00084508100000000002 2024-09-12T22:32:57.001 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.001 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.001 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:57.001 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632548+0000", 2024-09-12T22:32:57.001 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000224329 2024-09-12T22:32:57.001 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.001 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.001 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:57.001 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632591+0000", 2024-09-12T22:32:57.001 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2564000000000001e-05 2024-09-12T22:32:57.001 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.002 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.002 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:57.002 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632622+0000", 2024-09-12T22:32:57.002 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1219e-05 2024-09-12T22:32:57.002 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:57.002 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:57.002 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:57.002 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.002 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.002 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:185 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:32:57.002 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394355+0000", 2024-09-12T22:32:57.002 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 88.598258154000007, 2024-09-12T22:32:57.002 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011302394, 2024-09-12T22:32:57.002 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:57.003 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:57.003 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:57.003 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:57.003 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:57.003 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:57.003 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 185 2024-09-12T22:32:57.003 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.003 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:57.003 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.003 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:57.003 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394355+0000", 2024-09-12T22:32:57.003 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:57.003 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.004 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.004 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:57.004 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394355+0000", 2024-09-12T22:32:57.004 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:57.004 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.004 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.004 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:57.004 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394355+0000", 2024-09-12T22:32:57.004 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9099999999999999e-07 2024-09-12T22:32:57.004 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.004 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.004 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:57.005 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394385+0000", 2024-09-12T22:32:57.005 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9963000000000001e-05 2024-09-12T22:32:57.005 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.005 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.005 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:57.005 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394390+0000", 2024-09-12T22:32:57.005 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8420000000000004e-06 2024-09-12T22:32:57.005 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.005 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.005 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:57.005 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394393+0000", 2024-09-12T22:32:57.005 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1e-06 2024-09-12T22:32:57.005 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.006 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.006 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:57.006 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.400546+0000", 2024-09-12T22:32:57.006 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0061523309999999996 2024-09-12T22:32:57.006 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.006 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.006 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:57.006 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.400588+0000", 2024-09-12T22:32:57.006 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1835000000000002e-05 2024-09-12T22:32:57.006 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.006 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.006 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:57.006 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.400677+0000", 2024-09-12T22:32:57.006 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9195000000000002e-05 2024-09-12T22:32:57.007 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.007 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.007 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:57.007 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405378+0000", 2024-09-12T22:32:57.007 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0047008659999999997 2024-09-12T22:32:57.007 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.007 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.007 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:57.007 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405569+0000", 2024-09-12T22:32:57.007 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00019148599999999999 2024-09-12T22:32:57.007 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.007 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.007 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:57.008 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405620+0000", 2024-09-12T22:32:57.008 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1416999999999999e-05 2024-09-12T22:32:57.008 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.008 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.008 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:57.008 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405657+0000", 2024-09-12T22:32:57.008 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6968000000000002e-05 2024-09-12T22:32:57.008 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:57.008 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:57.008 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:57.008 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.008 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.009 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:32:57.009 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394399+0000", 2024-09-12T22:32:57.009 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 88.598213943000005, 2024-09-12T22:32:57.009 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011336601999999999, 2024-09-12T22:32:57.009 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:57.009 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:57.009 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:57.009 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:57.009 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:57.009 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:57.009 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 186 2024-09-12T22:32:57.009 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.009 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:57.010 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.010 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:57.010 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394399+0000", 2024-09-12T22:32:57.010 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:57.010 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.010 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.010 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:57.010 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394399+0000", 2024-09-12T22:32:57.010 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:57.010 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.010 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.010 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:57.010 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394400+0000", 2024-09-12T22:32:57.010 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4499999999999998e-07 2024-09-12T22:32:57.011 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.011 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.011 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:57.011 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394402+0000", 2024-09-12T22:32:57.011 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.875e-06 2024-09-12T22:32:57.011 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.011 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.011 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:57.011 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394405+0000", 2024-09-12T22:32:57.011 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6799999999999999e-06 2024-09-12T22:32:57.011 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.011 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.011 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:57.012 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394408+0000", 2024-09-12T22:32:57.012 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.667e-06 2024-09-12T22:32:57.012 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.012 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.012 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:57.012 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401395+0000", 2024-09-12T22:32:57.012 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0069867230000000002 2024-09-12T22:32:57.012 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.012 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.012 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:57.012 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401438+0000", 2024-09-12T22:32:57.012 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3554999999999999e-05 2024-09-12T22:32:57.012 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.013 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.013 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:57.013 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401509+0000", 2024-09-12T22:32:57.013 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0631999999999997e-05 2024-09-12T22:32:57.013 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.013 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.013 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:57.013 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405392+0000", 2024-09-12T22:32:57.013 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0038830449999999999 2024-09-12T22:32:57.013 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.013 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.013 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:57.013 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405690+0000", 2024-09-12T22:32:57.014 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000298435 2024-09-12T22:32:57.014 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.014 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.014 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:57.014 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405716+0000", 2024-09-12T22:32:57.014 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5435999999999998e-05 2024-09-12T22:32:57.014 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.014 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.014 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:57.014 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405736+0000", 2024-09-12T22:32:57.014 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0208999999999999e-05 2024-09-12T22:32:57.014 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:57.014 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:57.014 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:57.015 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.015 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.015 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:32:57.015 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394411+0000", 2024-09-12T22:32:57.015 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 88.598201817000003, 2024-09-12T22:32:57.015 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011400117, 2024-09-12T22:32:57.015 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:57.015 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:57.015 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:57.015 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:57.015 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:57.015 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:57.015 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 187 2024-09-12T22:32:57.015 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.016 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:57.016 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.016 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:57.016 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394411+0000", 2024-09-12T22:32:57.016 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:57.016 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.016 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.016 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:57.016 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394411+0000", 2024-09-12T22:32:57.016 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:57.016 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.016 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.016 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:57.016 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394412+0000", 2024-09-12T22:32:57.017 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.4999999999999999e-07 2024-09-12T22:32:57.017 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.017 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.017 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:57.017 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394414+0000", 2024-09-12T22:32:57.017 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.984e-06 2024-09-12T22:32:57.017 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.017 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.017 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:57.017 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394418+0000", 2024-09-12T22:32:57.017 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0840000000000002e-06 2024-09-12T22:32:57.017 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.017 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.018 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:57.018 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394431+0000", 2024-09-12T22:32:57.018 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.361e-05 2024-09-12T22:32:57.018 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.018 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.018 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:57.018 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401778+0000", 2024-09-12T22:32:57.018 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0073462659999999997 2024-09-12T22:32:57.018 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.018 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.018 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:57.018 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401853+0000", 2024-09-12T22:32:57.018 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5797000000000006e-05 2024-09-12T22:32:57.018 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.019 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.019 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:57.019 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401990+0000", 2024-09-12T22:32:57.019 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013651399999999999 2024-09-12T22:32:57.019 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.019 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.019 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:57.019 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405402+0000", 2024-09-12T22:32:57.019 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0034116070000000001 2024-09-12T22:32:57.019 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.019 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.019 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:57.020 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405764+0000", 2024-09-12T22:32:57.020 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00036234899999999998 2024-09-12T22:32:57.020 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.020 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.020 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:57.020 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405791+0000", 2024-09-12T22:32:57.020 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7029000000000002e-05 2024-09-12T22:32:57.020 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.020 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.020 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:57.020 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405812+0000", 2024-09-12T22:32:57.020 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0627000000000001e-05 2024-09-12T22:32:57.020 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:57.020 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:57.021 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:57.021 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.021 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.021 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:32:57.021 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394447+0000", 2024-09-12T22:32:57.021 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 88.598166665999997, 2024-09-12T22:32:57.021 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011759588, 2024-09-12T22:32:57.021 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:57.021 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:57.021 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:57.021 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:57.021 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:57.021 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:57.022 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 188 2024-09-12T22:32:57.022 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.022 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:57.022 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.022 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:57.022 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394447+0000", 2024-09-12T22:32:57.022 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:57.022 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.022 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.022 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:57.022 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394447+0000", 2024-09-12T22:32:57.022 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:57.022 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.023 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.023 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:57.023 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394447+0000", 2024-09-12T22:32:57.023 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.15e-07 2024-09-12T22:32:57.023 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.023 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.023 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:57.023 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394512+0000", 2024-09-12T22:32:57.023 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4580999999999997e-05 2024-09-12T22:32:57.023 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.023 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.023 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:57.023 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394518+0000", 2024-09-12T22:32:57.024 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.3380000000000001e-06 2024-09-12T22:32:57.024 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.024 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.024 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:57.024 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394521+0000", 2024-09-12T22:32:57.024 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3340000000000002e-06 2024-09-12T22:32:57.024 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.024 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.024 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:57.024 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.402628+0000", 2024-09-12T22:32:57.024 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.008106996 2024-09-12T22:32:57.024 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.024 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.024 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:57.025 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.402670+0000", 2024-09-12T22:32:57.025 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1983000000000001e-05 2024-09-12T22:32:57.025 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.025 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.025 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:57.025 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.402738+0000", 2024-09-12T22:32:57.025 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.8114999999999994e-05 2024-09-12T22:32:57.025 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.025 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.025 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:57.025 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405668+0000", 2024-09-12T22:32:57.025 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.002929545 2024-09-12T22:32:57.025 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.025 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.026 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:57.026 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406162+0000", 2024-09-12T22:32:57.026 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000494408 2024-09-12T22:32:57.026 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.026 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.026 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:57.026 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406188+0000", 2024-09-12T22:32:57.026 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5766e-05 2024-09-12T22:32:57.026 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.026 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.026 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:57.026 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406206+0000", 2024-09-12T22:32:57.026 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.8107000000000001e-05 2024-09-12T22:32:57.026 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:57.026 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:57.027 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:57.027 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.027 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.027 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:32:57.028 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394528+0000", 2024-09-12T22:32:57.028 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 88.598084997000001, 2024-09-12T22:32:57.028 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.01195536, 2024-09-12T22:32:57.028 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:57.029 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:57.029 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:57.029 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:32:57.029 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:32:57.029 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:32:57.029 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 189 2024-09-12T22:32:57.029 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.029 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:57.029 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.029 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:57.029 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394528+0000", 2024-09-12T22:32:57.029 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:57.030 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.030 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.030 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:57.030 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394528+0000", 2024-09-12T22:32:57.030 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:57.030 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.030 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.030 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:57.030 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394529+0000", 2024-09-12T22:32:57.030 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4900000000000001e-07 2024-09-12T22:32:57.030 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.030 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.030 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:57.031 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394531+0000", 2024-09-12T22:32:57.031 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.458e-06 2024-09-12T22:32:57.031 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.031 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.031 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:57.031 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394535+0000", 2024-09-12T22:32:57.031 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7900000000000001e-06 2024-09-12T22:32:57.031 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.031 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.031 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:57.031 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394537+0000", 2024-09-12T22:32:57.031 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.632e-06 2024-09-12T22:32:57.031 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.032 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.032 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:57.032 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.404932+0000", 2024-09-12T22:32:57.032 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010394158000000001 2024-09-12T22:32:57.032 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.032 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.032 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:57.032 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405017+0000", 2024-09-12T22:32:57.032 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5525000000000005e-05 2024-09-12T22:32:57.032 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.032 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.032 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:57.033 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405114+0000", 2024-09-12T22:32:57.033 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.6527000000000006e-05 2024-09-12T22:32:57.033 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.033 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.033 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:57.033 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405818+0000", 2024-09-12T22:32:57.033 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00070412800000000005 2024-09-12T22:32:57.033 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.033 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.033 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:57.033 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406437+0000", 2024-09-12T22:32:57.033 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00061898900000000002 2024-09-12T22:32:57.033 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.033 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.034 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:57.034 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406463+0000", 2024-09-12T22:32:57.034 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6268e-05 2024-09-12T22:32:57.034 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.034 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.034 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:57.034 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406484+0000", 2024-09-12T22:32:57.034 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0536000000000001e-05 2024-09-12T22:32:57.034 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:57.034 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:57.034 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:57.034 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.034 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.035 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:57.035 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.401422+0000", 2024-09-12T22:32:57.035 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 79.591191092000003, 2024-09-12T22:32:57.035 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016896452999999999, 2024-09-12T22:32:57.035 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:57.035 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:57.035 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:57.035 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:57.035 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.035 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:57.035 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401422+0000", 2024-09-12T22:32:57.035 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:57.035 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.036 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.036 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:57.036 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401422+0000", 2024-09-12T22:32:57.036 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:57.036 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.036 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.036 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:57.036 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401424+0000", 2024-09-12T22:32:57.036 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9e-06 2024-09-12T22:32:57.036 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.036 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.036 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:57.036 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401437+0000", 2024-09-12T22:32:57.036 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2831e-05 2024-09-12T22:32:57.037 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.037 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.037 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:57.037 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401471+0000", 2024-09-12T22:32:57.037 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4010000000000001e-05 2024-09-12T22:32:57.037 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.037 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.037 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:57.037 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401484+0000", 2024-09-12T22:32:57.038 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2711000000000001e-05 2024-09-12T22:32:57.038 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.038 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.038 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:57.038 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405410+0000", 2024-09-12T22:32:57.038 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0039259170000000001 2024-09-12T22:32:57.038 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.038 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.038 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:57.038 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405529+0000", 2024-09-12T22:32:57.038 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000119778 2024-09-12T22:32:57.038 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.038 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.038 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:57.039 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405655+0000", 2024-09-12T22:32:57.039 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012556700000000001 2024-09-12T22:32:57.039 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.039 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.039 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:57.039 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410456+0000", 2024-09-12T22:32:57.039 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0048008269999999997 2024-09-12T22:32:57.039 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.039 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.039 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:57.039 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418226+0000", 2024-09-12T22:32:57.039 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0077707729999999999 2024-09-12T22:32:57.039 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.040 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.040 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:57.040 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418277+0000", 2024-09-12T22:32:57.040 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0476000000000003e-05 2024-09-12T22:32:57.040 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.040 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.040 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:57.040 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418319+0000", 2024-09-12T22:32:57.040 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1662999999999997e-05 2024-09-12T22:32:57.040 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:57.040 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:57.040 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:57.040 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.040 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.041 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:57.041 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.401505+0000", 2024-09-12T22:32:57.041 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 79.591108427999998, 2024-09-12T22:32:57.041 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016987904000000002, 2024-09-12T22:32:57.041 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:57.041 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:57.041 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:57.041 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:57.041 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.041 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:57.041 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401505+0000", 2024-09-12T22:32:57.041 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:57.041 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.042 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.042 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:57.042 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401505+0000", 2024-09-12T22:32:57.042 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:57.042 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.042 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.042 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:57.042 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401506+0000", 2024-09-12T22:32:57.042 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4700000000000001e-07 2024-09-12T22:32:57.042 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.042 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.042 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:57.042 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401510+0000", 2024-09-12T22:32:57.043 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6609999999999999e-06 2024-09-12T22:32:57.043 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.043 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.043 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:57.043 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401771+0000", 2024-09-12T22:32:57.043 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00026110700000000001 2024-09-12T22:32:57.043 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.043 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.043 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:57.043 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401921+0000", 2024-09-12T22:32:57.043 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014939099999999999 2024-09-12T22:32:57.043 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.044 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.044 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:57.044 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405944+0000", 2024-09-12T22:32:57.044 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0040235449999999999 2024-09-12T22:32:57.044 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.044 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.044 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:57.044 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406018+0000", 2024-09-12T22:32:57.044 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3373000000000004e-05 2024-09-12T22:32:57.044 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.044 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.044 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:57.044 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406172+0000", 2024-09-12T22:32:57.044 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00015435399999999999 2024-09-12T22:32:57.045 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.045 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.045 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:57.045 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410461+0000", 2024-09-12T22:32:57.045 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0042888609999999997 2024-09-12T22:32:57.045 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.045 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.045 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:57.045 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418371+0000", 2024-09-12T22:32:57.045 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0079098380000000006 2024-09-12T22:32:57.045 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.045 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.045 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:57.046 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418443+0000", 2024-09-12T22:32:57.046 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2705000000000003e-05 2024-09-12T22:32:57.046 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.046 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.046 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:57.046 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418493+0000", 2024-09-12T22:32:57.046 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9322e-05 2024-09-12T22:32:57.046 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:57.046 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:57.046 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:57.046 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.046 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.046 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:57.046 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.401939+0000", 2024-09-12T22:32:57.047 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 79.590674691999993, 2024-09-12T22:32:57.047 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016722292999999999, 2024-09-12T22:32:57.047 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:57.047 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:57.047 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:57.047 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:57.047 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.047 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:57.047 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401939+0000", 2024-09-12T22:32:57.047 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:57.047 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.047 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.047 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:57.048 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401939+0000", 2024-09-12T22:32:57.048 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:57.048 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.048 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.048 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:57.048 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401940+0000", 2024-09-12T22:32:57.048 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1990000000000001e-06 2024-09-12T22:32:57.048 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.048 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.048 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:57.048 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401956+0000", 2024-09-12T22:32:57.048 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.6344000000000001e-05 2024-09-12T22:32:57.049 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.049 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.049 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:57.049 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401974+0000", 2024-09-12T22:32:57.049 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7730000000000001e-05 2024-09-12T22:32:57.049 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.049 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.049 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:57.049 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401982+0000", 2024-09-12T22:32:57.049 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.7800000000000001e-06 2024-09-12T22:32:57.049 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.049 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.049 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:57.050 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406557+0000", 2024-09-12T22:32:57.050 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0045758489999999999 2024-09-12T22:32:57.050 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.050 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.050 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:57.050 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406697+0000", 2024-09-12T22:32:57.050 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013925100000000001 2024-09-12T22:32:57.050 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.050 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.050 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:57.050 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406830+0000", 2024-09-12T22:32:57.050 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013293499999999999 2024-09-12T22:32:57.050 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.051 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.051 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:57.051 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410465+0000", 2024-09-12T22:32:57.051 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0036352680000000001 2024-09-12T22:32:57.051 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.051 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.051 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:57.051 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418564+0000", 2024-09-12T22:32:57.051 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0080992140000000004 2024-09-12T22:32:57.051 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.051 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.051 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:57.051 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418621+0000", 2024-09-12T22:32:57.051 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7167999999999999e-05 2024-09-12T22:32:57.052 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.052 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.052 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:57.052 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418661+0000", 2024-09-12T22:32:57.052 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9555000000000003e-05 2024-09-12T22:32:57.052 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:57.052 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:57.052 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:57.052 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.052 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.052 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:57.052 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.401994+0000", 2024-09-12T22:32:57.052 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 79.590618820000003, 2024-09-12T22:32:57.053 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016804109000000001, 2024-09-12T22:32:57.053 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:57.053 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:57.053 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:57.053 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:57.053 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.053 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:57.053 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401994+0000", 2024-09-12T22:32:57.053 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:57.053 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.053 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.053 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:57.053 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401994+0000", 2024-09-12T22:32:57.053 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:57.054 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.054 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.054 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:57.054 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401995+0000", 2024-09-12T22:32:57.054 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.8899999999999998e-07 2024-09-12T22:32:57.054 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.054 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.054 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:57.054 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402000+0000", 2024-09-12T22:32:57.054 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.498e-06 2024-09-12T22:32:57.054 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.054 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.054 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:57.055 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402007+0000", 2024-09-12T22:32:57.055 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.554e-06 2024-09-12T22:32:57.055 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.055 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.055 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:57.055 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402046+0000", 2024-09-12T22:32:57.055 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9156000000000003e-05 2024-09-12T22:32:57.055 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.055 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.055 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:57.055 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407342+0000", 2024-09-12T22:32:57.055 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052957610000000004 2024-09-12T22:32:57.055 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.055 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.056 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:57.056 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407521+0000", 2024-09-12T22:32:57.056 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00017878100000000001 2024-09-12T22:32:57.056 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.056 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.056 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:57.056 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407641+0000", 2024-09-12T22:32:57.056 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012013 2024-09-12T22:32:57.056 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.056 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.056 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:57.056 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410472+0000", 2024-09-12T22:32:57.057 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.002830455 2024-09-12T22:32:57.057 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.057 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.057 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:57.057 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418714+0000", 2024-09-12T22:32:57.057 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0082422789999999999 2024-09-12T22:32:57.057 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.057 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.057 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:57.057 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418761+0000", 2024-09-12T22:32:57.057 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6956999999999998e-05 2024-09-12T22:32:57.057 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.057 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.057 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:57.058 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418799+0000", 2024-09-12T22:32:57.058 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7749000000000001e-05 2024-09-12T22:32:57.058 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:57.058 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:57.058 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:57.058 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.058 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.058 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:57.058 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.402060+0000", 2024-09-12T22:32:57.058 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 79.590553376000003, 2024-09-12T22:32:57.058 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016885686, 2024-09-12T22:32:57.058 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:57.059 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:57.059 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:57.059 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:57.059 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.059 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:57.059 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402060+0000", 2024-09-12T22:32:57.059 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:57.059 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.059 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.059 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:57.059 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402060+0000", 2024-09-12T22:32:57.059 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:57.059 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.059 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.060 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:57.060 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402061+0000", 2024-09-12T22:32:57.060 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4399999999999999e-07 2024-09-12T22:32:57.060 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.060 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.060 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:57.060 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402066+0000", 2024-09-12T22:32:57.060 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8649999999999998e-06 2024-09-12T22:32:57.060 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.060 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.060 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:57.060 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402146+0000", 2024-09-12T22:32:57.060 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9054000000000006e-05 2024-09-12T22:32:57.061 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.061 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.061 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:57.061 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402287+0000", 2024-09-12T22:32:57.061 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014108600000000001 2024-09-12T22:32:57.061 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.061 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.061 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:57.061 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408185+0000", 2024-09-12T22:32:57.061 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0058983919999999997 2024-09-12T22:32:57.061 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.061 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.061 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:57.062 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408299+0000", 2024-09-12T22:32:57.062 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114102 2024-09-12T22:32:57.062 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.062 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.062 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:57.062 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408420+0000", 2024-09-12T22:32:57.062 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000120492 2024-09-12T22:32:57.062 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.062 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.062 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:57.062 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410867+0000", 2024-09-12T22:32:57.062 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0024476430000000002 2024-09-12T22:32:57.062 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.062 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.063 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:57.063 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418851+0000", 2024-09-12T22:32:57.063 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0079841489999999994 2024-09-12T22:32:57.063 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.063 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.063 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:57.063 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418894+0000", 2024-09-12T22:32:57.063 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3090000000000002e-05 2024-09-12T22:32:57.063 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.063 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.063 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:57.063 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418946+0000", 2024-09-12T22:32:57.063 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1069000000000002e-05 2024-09-12T22:32:57.064 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:57.064 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:57.064 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:57.064 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.064 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.064 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:57.064 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.402375+0000", 2024-09-12T22:32:57.064 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 79.590238310999993, 2024-09-12T22:32:57.064 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016768531999999999, 2024-09-12T22:32:57.064 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:57.064 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:57.064 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:57.065 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:57.065 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.065 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:57.065 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402375+0000", 2024-09-12T22:32:57.065 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:57.065 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.065 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.065 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:57.065 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402375+0000", 2024-09-12T22:32:57.065 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:57.065 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.065 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.065 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:57.065 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402375+0000", 2024-09-12T22:32:57.066 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4099999999999999e-07 2024-09-12T22:32:57.066 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.066 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.066 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:57.066 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402379+0000", 2024-09-12T22:32:57.066 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9870000000000001e-06 2024-09-12T22:32:57.066 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.066 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.066 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:57.066 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402389+0000", 2024-09-12T22:32:57.066 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0000000000000001e-05 2024-09-12T22:32:57.066 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.066 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.067 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:57.067 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402401+0000", 2024-09-12T22:32:57.067 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.148e-05 2024-09-12T22:32:57.067 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.067 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.067 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:57.067 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409108+0000", 2024-09-12T22:32:57.067 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0067068429999999997 2024-09-12T22:32:57.067 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.067 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.067 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:57.067 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409189+0000", 2024-09-12T22:32:57.067 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0815999999999993e-05 2024-09-12T22:32:57.067 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.068 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.068 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:57.068 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409320+0000", 2024-09-12T22:32:57.068 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000131586 2024-09-12T22:32:57.068 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.068 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.068 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:57.068 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410872+0000", 2024-09-12T22:32:57.068 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0015521599999999999 2024-09-12T22:32:57.068 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.068 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.068 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:57.068 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419049+0000", 2024-09-12T22:32:57.069 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0081763719999999995 2024-09-12T22:32:57.069 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.069 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.069 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:57.069 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419107+0000", 2024-09-12T22:32:57.069 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7899000000000002e-05 2024-09-12T22:32:57.069 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.069 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.069 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:57.069 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419143+0000", 2024-09-12T22:32:57.069 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6847999999999997e-05 2024-09-12T22:32:57.069 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:57.069 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:57.070 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:57.070 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.070 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.070 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:57.070 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.402903+0000", 2024-09-12T22:32:57.070 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 79.589709898999999, 2024-09-12T22:32:57.070 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016378428, 2024-09-12T22:32:57.070 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:57.070 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:57.070 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:57.070 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:57.070 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.070 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:57.071 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402903+0000", 2024-09-12T22:32:57.071 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:57.071 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.071 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.071 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:57.071 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402903+0000", 2024-09-12T22:32:57.071 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:57.071 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.071 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.071 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:57.071 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402904+0000", 2024-09-12T22:32:57.071 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9500000000000001e-07 2024-09-12T22:32:57.071 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.071 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.072 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:57.072 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402944+0000", 2024-09-12T22:32:57.072 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0265000000000002e-05 2024-09-12T22:32:57.072 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.072 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.072 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:57.072 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402979+0000", 2024-09-12T22:32:57.072 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4378000000000002e-05 2024-09-12T22:32:57.072 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.072 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.072 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:57.072 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402987+0000", 2024-09-12T22:32:57.072 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3559999999999993e-06 2024-09-12T22:32:57.073 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.073 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.073 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:57.073 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409577+0000", 2024-09-12T22:32:57.073 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0065901709999999997 2024-09-12T22:32:57.073 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.073 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.073 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:57.073 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409653+0000", 2024-09-12T22:32:57.073 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5819e-05 2024-09-12T22:32:57.073 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.073 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.073 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:57.074 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409725+0000", 2024-09-12T22:32:57.074 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2200000000000007e-05 2024-09-12T22:32:57.074 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.074 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.074 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:57.074 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.411234+0000", 2024-09-12T22:32:57.074 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001508225 2024-09-12T22:32:57.074 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.074 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.074 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:57.074 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419212+0000", 2024-09-12T22:32:57.074 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0079783400000000004 2024-09-12T22:32:57.074 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.074 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.075 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:57.075 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419244+0000", 2024-09-12T22:32:57.075 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2384e-05 2024-09-12T22:32:57.075 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.075 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.075 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:57.075 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419282+0000", 2024-09-12T22:32:57.075 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7394999999999997e-05 2024-09-12T22:32:57.075 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:57.075 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:57.075 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:57.075 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.075 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.076 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:57.076 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.403135+0000", 2024-09-12T22:32:57.076 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 79.589478029000006, 2024-09-12T22:32:57.076 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016294211999999999, 2024-09-12T22:32:57.076 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:57.076 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:57.076 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:57.076 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:57.076 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.076 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:57.076 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403135+0000", 2024-09-12T22:32:57.076 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:57.076 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.077 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.077 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:57.077 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403135+0000", 2024-09-12T22:32:57.077 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:57.077 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.077 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.077 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:57.077 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403136+0000", 2024-09-12T22:32:57.077 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.4e-07 2024-09-12T22:32:57.077 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.077 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.077 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:57.077 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403149+0000", 2024-09-12T22:32:57.078 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2723e-05 2024-09-12T22:32:57.078 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.078 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.078 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:57.078 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403158+0000", 2024-09-12T22:32:57.078 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3919999999999992e-06 2024-09-12T22:32:57.078 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.078 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.078 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:57.078 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403166+0000", 2024-09-12T22:32:57.078 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.2309999999999996e-06 2024-09-12T22:32:57.078 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.078 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.078 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:57.079 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409944+0000", 2024-09-12T22:32:57.079 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0067775309999999998 2024-09-12T22:32:57.079 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.079 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.079 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:57.079 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410032+0000", 2024-09-12T22:32:57.079 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.7906999999999997e-05 2024-09-12T22:32:57.079 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.079 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.079 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:57.079 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410152+0000", 2024-09-12T22:32:57.079 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012037800000000001 2024-09-12T22:32:57.079 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.080 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.080 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:57.080 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.411945+0000", 2024-09-12T22:32:57.080 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0017931850000000001 2024-09-12T22:32:57.080 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.080 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.080 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:57.080 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419319+0000", 2024-09-12T22:32:57.080 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0073731780000000002 2024-09-12T22:32:57.080 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.080 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.080 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:57.080 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419376+0000", 2024-09-12T22:32:57.080 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7728e-05 2024-09-12T22:32:57.081 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.081 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.081 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:57.081 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419429+0000", 2024-09-12T22:32:57.081 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3019000000000002e-05 2024-09-12T22:32:57.081 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:57.081 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:57.081 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:57.081 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.081 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.081 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:57.081 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.403185+0000", 2024-09-12T22:32:57.081 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 79.589428147999996, 2024-09-12T22:32:57.082 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.014902164000000001, 2024-09-12T22:32:57.082 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:57.082 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:57.082 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:57.082 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:57.082 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.082 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:57.082 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403185+0000", 2024-09-12T22:32:57.082 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:57.082 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.082 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.082 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:57.082 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403185+0000", 2024-09-12T22:32:57.082 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:57.083 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.083 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.083 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:57.083 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403186+0000", 2024-09-12T22:32:57.083 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9400000000000005e-07 2024-09-12T22:32:57.083 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.083 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.083 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:57.083 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403191+0000", 2024-09-12T22:32:57.083 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6980000000000003e-06 2024-09-12T22:32:57.083 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.083 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.083 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:57.084 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403199+0000", 2024-09-12T22:32:57.084 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2520000000000002e-06 2024-09-12T22:32:57.084 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.084 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.084 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:57.084 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403205+0000", 2024-09-12T22:32:57.084 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.908e-06 2024-09-12T22:32:57.084 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.084 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.084 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:57.084 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403359+0000", 2024-09-12T22:32:57.084 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000154544 2024-09-12T22:32:57.084 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.085 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.085 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:57.085 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403528+0000", 2024-09-12T22:32:57.085 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000168455 2024-09-12T22:32:57.085 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.085 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.085 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:57.085 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403763+0000", 2024-09-12T22:32:57.085 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00023539599999999999 2024-09-12T22:32:57.085 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.085 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.085 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:57.085 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409378+0000", 2024-09-12T22:32:57.086 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056150000000000002 2024-09-12T22:32:57.086 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.086 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.086 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:57.086 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418012+0000", 2024-09-12T22:32:57.086 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0086339559999999999 2024-09-12T22:32:57.086 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.086 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.086 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:57.086 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418046+0000", 2024-09-12T22:32:57.086 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4267999999999998e-05 2024-09-12T22:32:57.086 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.086 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.086 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:57.087 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418087+0000", 2024-09-12T22:32:57.087 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0992999999999999e-05 2024-09-12T22:32:57.087 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:57.087 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:57.087 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:57.087 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.087 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.087 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:57.087 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.403273+0000", 2024-09-12T22:32:57.087 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 79.589340196999999, 2024-09-12T22:32:57.087 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.014934866, 2024-09-12T22:32:57.087 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:57.087 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:57.087 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:57.088 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:57.088 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.088 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:57.088 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403273+0000", 2024-09-12T22:32:57.088 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:57.088 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.088 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.088 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:57.088 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403273+0000", 2024-09-12T22:32:57.088 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:57.088 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.088 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.088 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:57.089 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403274+0000", 2024-09-12T22:32:57.089 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.297e-06 2024-09-12T22:32:57.089 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.089 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.089 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:57.089 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403282+0000", 2024-09-12T22:32:57.089 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6340000000000001e-06 2024-09-12T22:32:57.089 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.089 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.089 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:57.089 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403305+0000", 2024-09-12T22:32:57.089 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3149000000000001e-05 2024-09-12T22:32:57.089 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.090 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.090 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:57.090 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403320+0000", 2024-09-12T22:32:57.090 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4527e-05 2024-09-12T22:32:57.090 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.090 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.090 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:57.090 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.404928+0000", 2024-09-12T22:32:57.090 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001608459 2024-09-12T22:32:57.090 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.090 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.090 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:57.090 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405218+0000", 2024-09-12T22:32:57.090 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00028982900000000002 2024-09-12T22:32:57.091 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.091 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.091 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:57.091 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405829+0000", 2024-09-12T22:32:57.091 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00061127900000000005 2024-09-12T22:32:57.091 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.091 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.091 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:57.091 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409403+0000", 2024-09-12T22:32:57.091 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.003573597 2024-09-12T22:32:57.091 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.091 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.091 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:57.091 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418138+0000", 2024-09-12T22:32:57.092 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0087349969999999996 2024-09-12T22:32:57.092 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.092 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.092 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:57.092 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418178+0000", 2024-09-12T22:32:57.092 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0649999999999999e-05 2024-09-12T22:32:57.092 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.092 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.092 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:57.092 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418208+0000", 2024-09-12T22:32:57.093 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9448e-05 2024-09-12T22:32:57.093 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:57.093 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:57.093 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:57.093 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.093 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.093 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:57.093 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.405456+0000", 2024-09-12T22:32:57.093 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 79.587157051999995, 2024-09-12T22:32:57.093 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012888389, 2024-09-12T22:32:57.093 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:57.093 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:57.093 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:57.094 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:57.094 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.094 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:57.094 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405456+0000", 2024-09-12T22:32:57.094 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:57.094 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.094 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.094 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:57.094 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405456+0000", 2024-09-12T22:32:57.094 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:57.094 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.094 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.095 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:57.095 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405457+0000", 2024-09-12T22:32:57.095 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.6599999999999994e-07 2024-09-12T22:32:57.095 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.095 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.095 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:57.095 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405463+0000", 2024-09-12T22:32:57.095 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4739999999999996e-06 2024-09-12T22:32:57.095 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.095 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.095 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:57.095 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405474+0000", 2024-09-12T22:32:57.096 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1095e-05 2024-09-12T22:32:57.096 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.096 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.096 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:57.096 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405482+0000", 2024-09-12T22:32:57.096 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3610000000000001e-06 2024-09-12T22:32:57.096 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.096 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.096 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:57.096 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407051+0000", 2024-09-12T22:32:57.096 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0015688970000000001 2024-09-12T22:32:57.096 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.096 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.097 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:57.097 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407259+0000", 2024-09-12T22:32:57.097 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00020778300000000001 2024-09-12T22:32:57.097 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.097 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.097 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:57.097 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407622+0000", 2024-09-12T22:32:57.097 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000363066 2024-09-12T22:32:57.097 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.097 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.097 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:57.097 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409438+0000", 2024-09-12T22:32:57.097 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001816319 2024-09-12T22:32:57.098 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.098 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.098 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:57.098 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418257+0000", 2024-09-12T22:32:57.098 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0088187720000000008 2024-09-12T22:32:57.098 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.098 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.098 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:57.098 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418308+0000", 2024-09-12T22:32:57.098 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1180000000000001e-05 2024-09-12T22:32:57.098 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.098 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.098 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:57.098 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418345+0000", 2024-09-12T22:32:57.099 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6476000000000001e-05 2024-09-12T22:32:57.099 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:57.099 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:57.099 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:57.099 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.099 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.099 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:57.099 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.405496+0000", 2024-09-12T22:32:57.099 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 79.587117695000003, 2024-09-12T22:32:57.099 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013016012, 2024-09-12T22:32:57.099 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:57.099 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:57.099 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:57.100 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:57.100 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.100 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:57.100 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405496+0000", 2024-09-12T22:32:57.100 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:57.100 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.100 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.100 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:57.100 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405496+0000", 2024-09-12T22:32:57.100 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:57.100 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.100 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.100 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:57.101 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405496+0000", 2024-09-12T22:32:57.101 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7999999999999995e-07 2024-09-12T22:32:57.101 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.101 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.101 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:57.101 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405501+0000", 2024-09-12T22:32:57.101 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8359999999999999e-06 2024-09-12T22:32:57.101 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.101 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.101 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:57.101 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405514+0000", 2024-09-12T22:32:57.101 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2522e-05 2024-09-12T22:32:57.101 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.102 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.102 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:57.102 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405521+0000", 2024-09-12T22:32:57.102 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5020000000000003e-06 2024-09-12T22:32:57.102 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.102 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.102 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:57.102 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405575+0000", 2024-09-12T22:32:57.102 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4169999999999998e-05 2024-09-12T22:32:57.102 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.102 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.102 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:57.102 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405697+0000", 2024-09-12T22:32:57.102 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000121301 2024-09-12T22:32:57.103 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.103 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.103 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:57.103 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405829+0000", 2024-09-12T22:32:57.103 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000132662 2024-09-12T22:32:57.103 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.103 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.103 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:57.103 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409155+0000", 2024-09-12T22:32:57.103 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0033259050000000001 2024-09-12T22:32:57.103 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.103 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.103 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:57.104 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418425+0000", 2024-09-12T22:32:57.104 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0092696319999999999 2024-09-12T22:32:57.104 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.104 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.104 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:57.104 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418471+0000", 2024-09-12T22:32:57.104 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6213e-05 2024-09-12T22:32:57.104 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.104 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.104 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:57.104 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418512+0000", 2024-09-12T22:32:57.104 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0589000000000001e-05 2024-09-12T22:32:57.104 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:57.105 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:57.105 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:57.105 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.105 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.105 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:57.105 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.406108+0000", 2024-09-12T22:32:57.105 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 79.586505298000006, 2024-09-12T22:32:57.105 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012458175, 2024-09-12T22:32:57.105 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:57.105 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:57.105 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:57.105 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:57.105 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.105 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:57.106 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406108+0000", 2024-09-12T22:32:57.106 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:57.106 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.106 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.106 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:57.106 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406108+0000", 2024-09-12T22:32:57.106 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:57.106 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.106 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.106 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:57.106 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406109+0000", 2024-09-12T22:32:57.106 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9899999999999999e-07 2024-09-12T22:32:57.106 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.107 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.107 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:57.107 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406115+0000", 2024-09-12T22:32:57.107 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9030000000000001e-06 2024-09-12T22:32:57.107 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.107 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.107 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:57.107 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406141+0000", 2024-09-12T22:32:57.107 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5999e-05 2024-09-12T22:32:57.107 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.107 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.107 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:57.107 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406150+0000", 2024-09-12T22:32:57.107 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.6050000000000004e-06 2024-09-12T22:32:57.108 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.108 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.108 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:57.108 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408163+0000", 2024-09-12T22:32:57.108 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0020122769999999998 2024-09-12T22:32:57.108 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.108 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.108 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:57.108 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408309+0000", 2024-09-12T22:32:57.108 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014606999999999999 2024-09-12T22:32:57.108 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.108 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.108 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:57.108 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408433+0000", 2024-09-12T22:32:57.109 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012460300000000001 2024-09-12T22:32:57.109 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.109 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.109 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:32:57.109 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409903+0000", 2024-09-12T22:32:57.109 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001469499 2024-09-12T22:32:57.109 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.109 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.109 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:57.109 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418427+0000", 2024-09-12T22:32:57.109 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0085241139999999993 2024-09-12T22:32:57.109 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.109 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.110 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:32:57.110 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418471+0000", 2024-09-12T22:32:57.110 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4474000000000001e-05 2024-09-12T22:32:57.110 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.110 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.110 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:57.110 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418566+0000", 2024-09-12T22:32:57.110 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.4732e-05 2024-09-12T22:32:57.110 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:57.110 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:57.110 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:57.110 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.110 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.110 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:57.111 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.407266+0000", 2024-09-12T22:32:57.111 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 79.585347442, 2024-09-12T22:32:57.111 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011442905, 2024-09-12T22:32:57.111 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:32:57.111 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:32:57.111 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2024-09-12T22:32:57.111 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:32:57.111 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.111 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:32:57.111 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407266+0000", 2024-09-12T22:32:57.111 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:57.111 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.111 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.111 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:32:57.112 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407266+0000", 2024-09-12T22:32:57.112 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:32:57.112 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.112 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.112 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:32:57.112 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407266+0000", 2024-09-12T22:32:57.112 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7899999999999998e-07 2024-09-12T22:32:57.112 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.112 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.112 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:32:57.112 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407269+0000", 2024-09-12T22:32:57.112 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9210000000000001e-06 2024-09-12T22:32:57.112 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.112 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.113 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:32:57.113 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407331+0000", 2024-09-12T22:32:57.113 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1376000000000003e-05 2024-09-12T22:32:57.113 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.113 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.113 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:32:57.113 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407337+0000", 2024-09-12T22:32:57.113 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1929999999999998e-06 2024-09-12T22:32:57.113 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.113 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.113 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:32:57.113 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408974+0000", 2024-09-12T22:32:57.113 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0016367109999999999 2024-09-12T22:32:57.114 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.114 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.114 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:32:57.114 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409112+0000", 2024-09-12T22:32:57.114 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000137952 2024-09-12T22:32:57.114 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:32:57.114 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:32:57.114 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:32:57.114 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418709+0000", 2024-09-12T22:32:57.114 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0095971730000000005 2024-09-12T22:32:57.114 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:57.114 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:57.114 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:57.114 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:32:57.114 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:32:57.115 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-09-12T22:32:57.116 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:32:57.117 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:57.115+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:57.217 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:57.215+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:57.224 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:32:57.224 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:32:57.224 INFO:teuthology.orchestra.run.smithi148.stdout: "num_ops": 0 2024-09-12T22:32:57.224 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:32:57.234 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:32:57.242 INFO:tasks.workunit.client.0.smithi019.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T22:32:57.311 INFO:tasks.workunit.client.0.smithi019.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T22:32:57.317 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~12s 2024-09-12T22:32:57.318 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:57.316+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:57.337 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:32:57.337 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:32:57.337 INFO:teuthology.orchestra.run.smithi148.stdout: "complaint_time": 30, 2024-09-12T22:32:57.337 INFO:teuthology.orchestra.run.smithi148.stdout: "num_blocked_ops": 0 2024-09-12T22:32:57.337 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:32:57.345 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:32:57.354 INFO:tasks.workunit.client.0.smithi019.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T22:32:57.356 INFO:tasks.workunit.client.0.smithi019.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T22:32:57.356 INFO:tasks.workunit.client.0.smithi019.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T22:32:57.396 INFO:tasks.workunit.client.0.smithi019.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T22:32:57.399 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T22:32:57.400 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T22:32:57.426 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T22:32:57.430 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:57.429+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:57.458 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2024-09-12T22:32:57.459 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-09-12T22:32:57.459 DEBUG:teuthology.orchestra.run.smithi019:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=7741f7f9ee20524f89b8f61d1609b32fb3b1570a TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2024-09-12T22:32:57.491 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:32:57.491 INFO:teuthology.orchestra.run.smithi148.stdout: "size": 20, 2024-09-12T22:32:57.491 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 600, 2024-09-12T22:32:57.491 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [ 2024-09-12T22:32:57.491 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.491 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:57.491 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.400880+0000", 2024-09-12T22:32:57.491 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 80.088318310000005, 2024-09-12T22:32:57.491 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0095133660000000005, 2024-09-12T22:32:57.492 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:57.492 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:57.492 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:57.492 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:57.492 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.492 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:57.492 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400880+0000", 2024-09-12T22:32:57.492 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:57.492 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.492 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.492 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:57.492 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400880+0000", 2024-09-12T22:32:57.492 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:57.492 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.493 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.493 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:57.493 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400892+0000", 2024-09-12T22:32:57.493 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1941e-05 2024-09-12T22:32:57.493 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.493 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.493 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:57.493 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400900+0000", 2024-09-12T22:32:57.493 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0080000000000002e-06 2024-09-12T22:32:57.493 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.493 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.493 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:57.494 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400911+0000", 2024-09-12T22:32:57.494 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1452e-05 2024-09-12T22:32:57.494 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.494 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.494 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:57.494 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400922+0000", 2024-09-12T22:32:57.494 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0772e-05 2024-09-12T22:32:57.494 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.494 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.495 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:57.495 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401009+0000", 2024-09-12T22:32:57.495 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.7206000000000005e-05 2024-09-12T22:32:57.495 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.495 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.495 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:57.495 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401157+0000", 2024-09-12T22:32:57.495 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014831499999999999 2024-09-12T22:32:57.496 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.496 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.496 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:57.496 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401312+0000", 2024-09-12T22:32:57.496 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00015495600000000001 2024-09-12T22:32:57.496 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.496 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.496 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:57.497 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.403060+0000", 2024-09-12T22:32:57.497 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0017475220000000001 2024-09-12T22:32:57.497 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.497 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.497 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:57.497 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410300+0000", 2024-09-12T22:32:57.497 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0072403260000000001 2024-09-12T22:32:57.497 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.497 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.497 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:57.497 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410350+0000", 2024-09-12T22:32:57.497 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9814000000000001e-05 2024-09-12T22:32:57.497 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.497 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.498 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:57.498 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410393+0000", 2024-09-12T22:32:57.498 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3053999999999998e-05 2024-09-12T22:32:57.498 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:57.498 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:57.498 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:57.498 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.498 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.498 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:57.498 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.400952+0000", 2024-09-12T22:32:57.498 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 80.088246158000004, 2024-09-12T22:32:57.498 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0096045620000000005, 2024-09-12T22:32:57.499 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:57.499 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:57.500 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:57.500 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:57.500 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.500 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:57.500 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400952+0000", 2024-09-12T22:32:57.500 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:57.500 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.500 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.500 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:57.500 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400952+0000", 2024-09-12T22:32:57.500 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:57.500 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.501 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.501 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:57.501 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400953+0000", 2024-09-12T22:32:57.501 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.8000000000000005e-07 2024-09-12T22:32:57.501 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.501 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.501 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:57.501 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400957+0000", 2024-09-12T22:32:57.501 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.33e-06 2024-09-12T22:32:57.501 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.501 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.501 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:57.501 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400966+0000", 2024-09-12T22:32:57.502 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1989999999999995e-06 2024-09-12T22:32:57.502 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.502 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.502 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:57.502 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400973+0000", 2024-09-12T22:32:57.502 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2779999999999999e-06 2024-09-12T22:32:57.502 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.502 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.502 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:57.502 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401696+0000", 2024-09-12T22:32:57.502 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00072363500000000003 2024-09-12T22:32:57.502 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.502 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.503 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:57.503 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401788+0000", 2024-09-12T22:32:57.503 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1862999999999998e-05 2024-09-12T22:32:57.503 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.503 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.503 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:57.503 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401929+0000", 2024-09-12T22:32:57.503 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014096000000000001 2024-09-12T22:32:57.503 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.503 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.503 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:57.503 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.403542+0000", 2024-09-12T22:32:57.503 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001612963 2024-09-12T22:32:57.503 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.503 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.503 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:57.504 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410460+0000", 2024-09-12T22:32:57.504 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0069180500000000002 2024-09-12T22:32:57.504 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.504 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.504 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:57.504 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410515+0000", 2024-09-12T22:32:57.504 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5009000000000001e-05 2024-09-12T22:32:57.504 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.504 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.504 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:57.504 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410557+0000", 2024-09-12T22:32:57.504 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1495000000000002e-05 2024-09-12T22:32:57.504 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:57.504 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:57.505 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:57.505 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.505 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.505 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:57.505 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.400984+0000", 2024-09-12T22:32:57.505 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 80.088213663000005, 2024-09-12T22:32:57.505 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0073703950000000001, 2024-09-12T22:32:57.505 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:57.505 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:57.505 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:57.505 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:57.505 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.505 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:57.506 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400984+0000", 2024-09-12T22:32:57.506 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:57.506 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.506 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.506 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:57.506 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400984+0000", 2024-09-12T22:32:57.506 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:57.506 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.506 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.507 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:57.507 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400985+0000", 2024-09-12T22:32:57.507 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3200000000000005e-07 2024-09-12T22:32:57.507 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.507 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.507 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:57.507 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400998+0000", 2024-09-12T22:32:57.507 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2726e-05 2024-09-12T22:32:57.507 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.507 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.507 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:57.507 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401006+0000", 2024-09-12T22:32:57.507 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.3110000000000006e-06 2024-09-12T22:32:57.507 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.508 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.508 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:57.508 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401022+0000", 2024-09-12T22:32:57.508 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6249e-05 2024-09-12T22:32:57.508 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.508 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.508 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:57.508 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401700+0000", 2024-09-12T22:32:57.508 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00067811100000000001 2024-09-12T22:32:57.508 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.508 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.508 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:57.509 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401839+0000", 2024-09-12T22:32:57.509 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013865399999999999 2024-09-12T22:32:57.509 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.509 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.509 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:57.509 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401962+0000", 2024-09-12T22:32:57.509 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000123266 2024-09-12T22:32:57.509 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.509 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.509 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:57.509 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.403589+0000", 2024-09-12T22:32:57.509 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001626932 2024-09-12T22:32:57.509 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.510 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.510 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:57.510 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.408274+0000", 2024-09-12T22:32:57.510 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0046848100000000002 2024-09-12T22:32:57.510 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.510 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.510 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:57.510 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.408324+0000", 2024-09-12T22:32:57.510 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9784000000000003e-05 2024-09-12T22:32:57.510 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.510 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.511 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:57.511 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.408355+0000", 2024-09-12T22:32:57.511 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.1019999999999998e-05 2024-09-12T22:32:57.511 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:57.511 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:57.511 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:57.511 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.511 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.511 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:57.511 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401034+0000", 2024-09-12T22:32:57.511 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 80.088164223000007, 2024-09-12T22:32:57.511 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011063051000000001, 2024-09-12T22:32:57.511 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:57.512 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:57.512 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:57.512 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:57.512 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.512 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:57.512 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401034+0000", 2024-09-12T22:32:57.512 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:57.512 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.512 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.512 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:57.512 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401034+0000", 2024-09-12T22:32:57.512 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:57.512 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.512 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.513 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:57.513 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401034+0000", 2024-09-12T22:32:57.513 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8899999999999999e-07 2024-09-12T22:32:57.513 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.513 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.513 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:57.513 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401038+0000", 2024-09-12T22:32:57.513 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.523e-06 2024-09-12T22:32:57.513 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.513 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.513 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:57.513 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401046+0000", 2024-09-12T22:32:57.513 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0479999999999999e-06 2024-09-12T22:32:57.514 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.514 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.514 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:57.514 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401051+0000", 2024-09-12T22:32:57.514 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2619999999999998e-06 2024-09-12T22:32:57.514 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.514 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.514 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:57.514 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402270+0000", 2024-09-12T22:32:57.514 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012182429999999999 2024-09-12T22:32:57.514 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.514 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.514 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:57.515 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402325+0000", 2024-09-12T22:32:57.515 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5526999999999999e-05 2024-09-12T22:32:57.515 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.515 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.515 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:32:57.515 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402403+0000", 2024-09-12T22:32:57.515 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.7559999999999996e-05 2024-09-12T22:32:57.515 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.515 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.515 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:57.515 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.403655+0000", 2024-09-12T22:32:57.515 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012521489999999999 2024-09-12T22:32:57.515 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.516 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.516 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:57.516 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411979+0000", 2024-09-12T22:32:57.516 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0083240420000000002 2024-09-12T22:32:57.516 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.516 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.516 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:57.516 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.412036+0000", 2024-09-12T22:32:57.516 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7639000000000002e-05 2024-09-12T22:32:57.516 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.517 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.517 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:57.517 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.412097+0000", 2024-09-12T22:32:57.517 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0469e-05 2024-09-12T22:32:57.517 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:57.517 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:57.517 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:57.517 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.517 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.517 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:57.517 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401060+0000", 2024-09-12T22:32:57.517 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 80.088138470999994, 2024-09-12T22:32:57.518 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.010030172, 2024-09-12T22:32:57.518 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:57.518 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:57.518 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:57.518 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:57.518 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.518 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:57.518 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401060+0000", 2024-09-12T22:32:57.518 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:57.518 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.518 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.518 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:57.518 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401060+0000", 2024-09-12T22:32:57.519 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:57.519 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.519 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.519 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:57.519 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401060+0000", 2024-09-12T22:32:57.519 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2500000000000001e-07 2024-09-12T22:32:57.519 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.519 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.519 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:57.519 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401063+0000", 2024-09-12T22:32:57.519 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0910000000000001e-06 2024-09-12T22:32:57.519 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.519 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.519 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:57.520 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401070+0000", 2024-09-12T22:32:57.520 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1210000000000001e-06 2024-09-12T22:32:57.520 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.520 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.520 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:57.520 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401076+0000", 2024-09-12T22:32:57.520 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2830000000000001e-06 2024-09-12T22:32:57.520 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.520 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.520 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:57.520 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402288+0000", 2024-09-12T22:32:57.520 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012123699999999999 2024-09-12T22:32:57.520 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.521 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.521 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:57.521 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402359+0000", 2024-09-12T22:32:57.521 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.0988000000000005e-05 2024-09-12T22:32:57.521 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.521 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.521 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:57.521 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402457+0000", 2024-09-12T22:32:57.521 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.7857999999999997e-05 2024-09-12T22:32:57.521 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.522 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.522 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:57.522 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.404395+0000", 2024-09-12T22:32:57.522 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0019380160000000001 2024-09-12T22:32:57.522 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.522 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.522 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:57.522 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410603+0000", 2024-09-12T22:32:57.522 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.006208061 2024-09-12T22:32:57.522 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.522 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.522 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:57.522 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410687+0000", 2024-09-12T22:32:57.523 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.4623000000000006e-05 2024-09-12T22:32:57.523 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.523 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.523 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:57.523 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411090+0000", 2024-09-12T22:32:57.523 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00040233599999999999 2024-09-12T22:32:57.523 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:57.523 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:57.523 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:57.523 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.523 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.523 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:57.523 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401083+0000", 2024-09-12T22:32:57.524 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 80.088115055000003, 2024-09-12T22:32:57.524 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0097591850000000001, 2024-09-12T22:32:57.524 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:57.524 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:57.524 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:57.524 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:57.524 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.524 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:57.524 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401083+0000", 2024-09-12T22:32:57.524 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:57.524 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.524 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.525 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:57.525 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401083+0000", 2024-09-12T22:32:57.525 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:57.525 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.525 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.525 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:57.525 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401084+0000", 2024-09-12T22:32:57.525 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4799999999999999e-07 2024-09-12T22:32:57.525 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.525 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.525 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:57.525 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401088+0000", 2024-09-12T22:32:57.525 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6419999999999998e-06 2024-09-12T22:32:57.526 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.526 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.526 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:57.526 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401094+0000", 2024-09-12T22:32:57.526 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0090000000000004e-06 2024-09-12T22:32:57.526 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.526 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.526 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:57.526 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401108+0000", 2024-09-12T22:32:57.526 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3884e-05 2024-09-12T22:32:57.526 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.526 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.526 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:57.526 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401165+0000", 2024-09-12T22:32:57.527 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.6499000000000002e-05 2024-09-12T22:32:57.527 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.527 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.527 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:57.527 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401261+0000", 2024-09-12T22:32:57.527 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.6872000000000004e-05 2024-09-12T22:32:57.527 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.527 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.527 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:57.527 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401376+0000", 2024-09-12T22:32:57.527 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000114508 2024-09-12T22:32:57.527 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.527 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.528 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:57.528 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402666+0000", 2024-09-12T22:32:57.528 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012901659999999999 2024-09-12T22:32:57.528 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.528 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.528 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:57.528 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410572+0000", 2024-09-12T22:32:57.528 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0079055489999999996 2024-09-12T22:32:57.528 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.528 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.528 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:57.528 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410661+0000", 2024-09-12T22:32:57.529 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.9578000000000002e-05 2024-09-12T22:32:57.529 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.529 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.529 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:57.529 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410842+0000", 2024-09-12T22:32:57.529 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00018102999999999999 2024-09-12T22:32:57.529 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:57.529 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:57.529 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:57.529 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.529 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.529 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:57.529 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401122+0000", 2024-09-12T22:32:57.529 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 80.088076022999999, 2024-09-12T22:32:57.529 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0099122080000000005, 2024-09-12T22:32:57.530 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:57.530 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:57.530 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:32:57.530 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:57.530 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.530 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:57.530 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401122+0000", 2024-09-12T22:32:57.530 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:57.530 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.530 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.530 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:57.530 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401122+0000", 2024-09-12T22:32:57.530 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:57.530 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.531 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.531 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:57.531 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401123+0000", 2024-09-12T22:32:57.531 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2600000000000002e-07 2024-09-12T22:32:57.531 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.531 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.531 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:57.531 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401126+0000", 2024-09-12T22:32:57.531 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.6449999999999998e-06 2024-09-12T22:32:57.531 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.531 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.531 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:57.531 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401133+0000", 2024-09-12T22:32:57.531 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.9890000000000003e-06 2024-09-12T22:32:57.531 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.532 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.532 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:57.532 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401138+0000", 2024-09-12T22:32:57.532 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8060000000000002e-06 2024-09-12T22:32:57.532 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.532 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.532 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:57.532 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401703+0000", 2024-09-12T22:32:57.532 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00056509099999999999 2024-09-12T22:32:57.532 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.532 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.532 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:57.532 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401837+0000", 2024-09-12T22:32:57.532 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013338799999999999 2024-09-12T22:32:57.533 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.533 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.533 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:57.533 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411034+0000", 2024-09-12T22:32:57.533 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.009197663 2024-09-12T22:32:57.533 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:57.533 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:57.533 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:57.533 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.533 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.533 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:57.533 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401158+0000", 2024-09-12T22:32:57.533 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 80.088040243999998, 2024-09-12T22:32:57.533 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.010292437999999999, 2024-09-12T22:32:57.534 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:57.534 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:57.534 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:32:57.534 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:57.534 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.534 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:57.534 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401158+0000", 2024-09-12T22:32:57.534 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:57.534 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.534 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.534 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:57.534 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401158+0000", 2024-09-12T22:32:57.534 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:57.534 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.534 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.535 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:57.535 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401158+0000", 2024-09-12T22:32:57.535 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9699999999999996e-07 2024-09-12T22:32:57.535 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.535 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.535 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:57.535 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401161+0000", 2024-09-12T22:32:57.535 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.7410000000000001e-06 2024-09-12T22:32:57.535 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.535 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.535 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:57.535 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401168+0000", 2024-09-12T22:32:57.535 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.844e-06 2024-09-12T22:32:57.536 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.536 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.536 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:57.536 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401174+0000", 2024-09-12T22:32:57.536 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4700000000000001e-06 2024-09-12T22:32:57.536 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.536 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.536 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:57.536 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402799+0000", 2024-09-12T22:32:57.536 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0016256409999999999 2024-09-12T22:32:57.536 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.536 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.536 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:57.537 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402893+0000", 2024-09-12T22:32:57.537 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.3807999999999994e-05 2024-09-12T22:32:57.537 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.537 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.537 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:57.537 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411450+0000", 2024-09-12T22:32:57.537 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0085573369999999999 2024-09-12T22:32:57.537 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:57.537 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:57.537 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:57.537 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.537 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.538 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:32:57.538 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401183+0000", 2024-09-12T22:32:57.538 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 80.088015392000003, 2024-09-12T22:32:57.538 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0068597830000000004, 2024-09-12T22:32:57.538 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:57.538 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:57.538 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:32:57.538 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:57.538 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.538 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:57.538 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401183+0000", 2024-09-12T22:32:57.538 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:57.538 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.538 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.539 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:57.539 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401183+0000", 2024-09-12T22:32:57.539 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:57.539 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.539 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.539 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:57.539 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401183+0000", 2024-09-12T22:32:57.539 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.6700000000000003e-07 2024-09-12T22:32:57.539 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.539 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.539 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:57.539 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401186+0000", 2024-09-12T22:32:57.539 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4679999999999999e-06 2024-09-12T22:32:57.540 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.540 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.540 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:57.540 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401192+0000", 2024-09-12T22:32:57.540 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.1519999999999997e-06 2024-09-12T22:32:57.540 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.540 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.540 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:57.540 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401197+0000", 2024-09-12T22:32:57.540 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4669999999999998e-06 2024-09-12T22:32:57.540 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.540 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.540 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:57.540 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401253+0000", 2024-09-12T22:32:57.541 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.6211000000000001e-05 2024-09-12T22:32:57.541 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.541 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.541 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:57.541 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401413+0000", 2024-09-12T22:32:57.541 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00016021399999999999 2024-09-12T22:32:57.541 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.541 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.541 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:57.541 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.408043+0000", 2024-09-12T22:32:57.541 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0066295039999999996 2024-09-12T22:32:57.541 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:57.542 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:57.542 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:57.542 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.542 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.542 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:20 3.1c e19/17 3:3ed09add:::607.00000000:head v 19'1, mlcod=0'0)", 2024-09-12T22:32:57.542 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.409642+0000", 2024-09-12T22:32:57.542 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 80.079555932999995, 2024-09-12T22:32:57.542 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0038816269999999999, 2024-09-12T22:32:57.542 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:57.542 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:57.542 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:57.542 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:57.543 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.543 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:57.543 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409642+0000", 2024-09-12T22:32:57.543 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:57.543 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.543 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.543 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:57.543 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409642+0000", 2024-09-12T22:32:57.543 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:57.543 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.543 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.543 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:57.543 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409642+0000", 2024-09-12T22:32:57.543 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.6899999999999999e-07 2024-09-12T22:32:57.544 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.544 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.544 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:57.544 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409648+0000", 2024-09-12T22:32:57.544 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.49e-06 2024-09-12T22:32:57.544 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.544 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.544 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:57.544 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409656+0000", 2024-09-12T22:32:57.544 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.2949999999999994e-06 2024-09-12T22:32:57.544 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.544 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.544 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:57.545 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409664+0000", 2024-09-12T22:32:57.545 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.1219999999999995e-06 2024-09-12T22:32:57.545 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.545 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.545 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:57.545 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409707+0000", 2024-09-12T22:32:57.545 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2222000000000003e-05 2024-09-12T22:32:57.545 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.545 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.545 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:57.545 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409724+0000", 2024-09-12T22:32:57.545 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7496999999999999e-05 2024-09-12T22:32:57.545 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.546 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.546 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:57.546 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413439+0000", 2024-09-12T22:32:57.546 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00371448 2024-09-12T22:32:57.546 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.546 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.546 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:57.546 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413524+0000", 2024-09-12T22:32:57.546 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.5252000000000003e-05 2024-09-12T22:32:57.546 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:57.546 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:57.546 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:57.546 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.546 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.546 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:28 3.13 e19/17 3:cd5a64a3:::100.00000000:head v 19'1, mlcod=0'0)", 2024-09-12T22:32:57.547 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.409681+0000", 2024-09-12T22:32:57.547 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 80.079517449999997, 2024-09-12T22:32:57.547 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0038708710000000001, 2024-09-12T22:32:57.547 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:57.547 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:57.547 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:57.547 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:57.547 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.547 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:57.547 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409681+0000", 2024-09-12T22:32:57.547 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:57.547 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.547 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.547 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:57.548 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409681+0000", 2024-09-12T22:32:57.548 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:57.548 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.548 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.548 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:57.548 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409681+0000", 2024-09-12T22:32:57.548 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3000000000000002e-07 2024-09-12T22:32:57.548 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.548 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.548 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:57.548 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409695+0000", 2024-09-12T22:32:57.548 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4313e-05 2024-09-12T22:32:57.548 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.548 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.549 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:57.549 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409703+0000", 2024-09-12T22:32:57.549 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4000000000000003e-06 2024-09-12T22:32:57.549 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.549 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.549 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:57.549 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409708+0000", 2024-09-12T22:32:57.549 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3190000000000002e-06 2024-09-12T22:32:57.549 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.549 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.549 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:57.549 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409875+0000", 2024-09-12T22:32:57.549 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000167329 2024-09-12T22:32:57.549 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.550 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.550 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:57.550 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409892+0000", 2024-09-12T22:32:57.550 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6957999999999999e-05 2024-09-12T22:32:57.550 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.550 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.550 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:57.550 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413457+0000", 2024-09-12T22:32:57.550 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0035651279999999999 2024-09-12T22:32:57.550 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.550 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.550 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:57.550 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413552+0000", 2024-09-12T22:32:57.550 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.4093999999999997e-05 2024-09-12T22:32:57.550 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:57.551 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:57.551 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:57.551 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.551 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.551 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:21 3.1c e19/17 3:3ed09add:::607.00000000:head v 19'2, mlcod=0'0)", 2024-09-12T22:32:57.551 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.409718+0000", 2024-09-12T22:32:57.551 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 80.079479785000004, 2024-09-12T22:32:57.551 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003851883, 2024-09-12T22:32:57.551 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:57.551 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:57.551 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:57.551 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:57.551 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.551 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:57.552 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409718+0000", 2024-09-12T22:32:57.552 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:57.552 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.552 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.552 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:57.552 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409718+0000", 2024-09-12T22:32:57.552 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:57.552 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.552 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.552 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:57.552 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409719+0000", 2024-09-12T22:32:57.552 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.16e-07 2024-09-12T22:32:57.552 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.552 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.552 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:57.553 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409722+0000", 2024-09-12T22:32:57.553 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.692e-06 2024-09-12T22:32:57.553 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.553 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.553 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:57.553 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409729+0000", 2024-09-12T22:32:57.553 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.516e-06 2024-09-12T22:32:57.553 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.553 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.553 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:57.553 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409750+0000", 2024-09-12T22:32:57.553 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1151000000000001e-05 2024-09-12T22:32:57.553 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.553 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.554 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:57.554 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410015+0000", 2024-09-12T22:32:57.554 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00026477599999999999 2024-09-12T22:32:57.554 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.554 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.554 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:57.554 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410104+0000", 2024-09-12T22:32:57.554 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.9586000000000006e-05 2024-09-12T22:32:57.554 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.554 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.554 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:57.554 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413528+0000", 2024-09-12T22:32:57.554 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0034237880000000001 2024-09-12T22:32:57.554 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.555 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.555 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:57.555 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413570+0000", 2024-09-12T22:32:57.555 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2157999999999999e-05 2024-09-12T22:32:57.555 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:57.555 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:57.555 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:57.555 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.555 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.555 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:27 3.13 e19/17 3:c91d4a1d:::mds0_inotable:head v 19'2, mlcod=0'0)", 2024-09-12T22:32:57.555 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.409760+0000", 2024-09-12T22:32:57.555 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 80.079438268999994, 2024-09-12T22:32:57.555 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0039301910000000004, 2024-09-12T22:32:57.555 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:57.556 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:57.556 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:57.556 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:57.556 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.556 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:57.556 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409760+0000", 2024-09-12T22:32:57.556 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:57.556 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.556 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.556 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:57.556 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409760+0000", 2024-09-12T22:32:57.556 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:57.556 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.556 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.556 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:57.557 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409760+0000", 2024-09-12T22:32:57.557 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.39e-07 2024-09-12T22:32:57.557 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.557 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.557 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:57.557 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409765+0000", 2024-09-12T22:32:57.557 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4449999999999998e-06 2024-09-12T22:32:57.557 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.557 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.557 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:57.557 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409771+0000", 2024-09-12T22:32:57.557 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7159999999999997e-06 2024-09-12T22:32:57.557 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.557 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.557 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:57.558 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409778+0000", 2024-09-12T22:32:57.558 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.331e-06 2024-09-12T22:32:57.558 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.558 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.558 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:57.558 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410191+0000", 2024-09-12T22:32:57.558 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00041348300000000003 2024-09-12T22:32:57.558 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.558 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.558 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:57.558 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410211+0000", 2024-09-12T22:32:57.558 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9933999999999999e-05 2024-09-12T22:32:57.558 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.558 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.559 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:57.559 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413638+0000", 2024-09-12T22:32:57.559 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003426854 2024-09-12T22:32:57.559 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.559 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.559 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:57.559 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413690+0000", 2024-09-12T22:32:57.559 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2089000000000002e-05 2024-09-12T22:32:57.559 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:57.559 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:57.559 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:57.559 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.559 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.560 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "pg_update_log_missing_reply(3.b epoch 19/17 rep_tid 4 lcod 19'2)", 2024-09-12T22:32:57.560 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.410060+0000", 2024-09-12T22:32:57.560 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 80.079138603999994, 2024-09-12T22:32:57.560 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00098016500000000007, 2024-09-12T22:32:57.560 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:57.560 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:57.560 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "reached pg", 2024-09-12T22:32:57.560 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:57.560 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.560 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:57.560 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410060+0000", 2024-09-12T22:32:57.560 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:57.560 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.561 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.561 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:57.561 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410060+0000", 2024-09-12T22:32:57.561 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:57.561 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.561 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.561 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:57.561 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410060+0000", 2024-09-12T22:32:57.561 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.8299999999999998e-07 2024-09-12T22:32:57.561 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.561 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.561 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:57.561 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410062+0000", 2024-09-12T22:32:57.562 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5749999999999999e-06 2024-09-12T22:32:57.562 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.562 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.562 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:57.562 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410070+0000", 2024-09-12T22:32:57.562 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.909e-06 2024-09-12T22:32:57.562 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.562 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.562 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:57.562 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410076+0000", 2024-09-12T22:32:57.562 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7049999999999996e-06 2024-09-12T22:32:57.562 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.562 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.562 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:57.563 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410943+0000", 2024-09-12T22:32:57.563 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00086681900000000001 2024-09-12T22:32:57.563 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.563 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.563 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:57.563 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411040+0000", 2024-09-12T22:32:57.563 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.6774000000000006e-05 2024-09-12T22:32:57.563 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:57.563 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:57.563 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:57.563 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.563 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.563 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e19/17 ondisk, result = 0)", 2024-09-12T22:32:57.563 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.410113+0000", 2024-09-12T22:32:57.563 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 80.079085336999995, 2024-09-12T22:32:57.564 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00098911599999999995, 2024-09-12T22:32:57.564 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:57.564 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:57.564 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:32:57.564 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:57.564 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.564 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:57.564 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410113+0000", 2024-09-12T22:32:57.564 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:57.564 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.564 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.564 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:57.564 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410113+0000", 2024-09-12T22:32:57.565 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:57.565 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.565 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.565 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:57.565 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410113+0000", 2024-09-12T22:32:57.565 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.99e-07 2024-09-12T22:32:57.565 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.565 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.565 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:57.565 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410115+0000", 2024-09-12T22:32:57.565 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.046e-06 2024-09-12T22:32:57.565 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.565 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.565 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:57.566 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410121+0000", 2024-09-12T22:32:57.566 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0050000000000001e-06 2024-09-12T22:32:57.566 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.566 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.566 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:57.566 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410126+0000", 2024-09-12T22:32:57.566 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8339999999999998e-06 2024-09-12T22:32:57.566 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.566 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.566 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:57.566 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410587+0000", 2024-09-12T22:32:57.566 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00046095499999999998 2024-09-12T22:32:57.566 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.566 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.567 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:57.567 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410595+0000", 2024-09-12T22:32:57.567 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.9419999999999995e-06 2024-09-12T22:32:57.567 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.567 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.567 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:57.567 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411102+0000", 2024-09-12T22:32:57.567 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00050713500000000003 2024-09-12T22:32:57.567 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:57.567 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:57.567 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:57.567 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.567 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.567 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 19/17 rep_tid 8 lcod 19'4)", 2024-09-12T22:32:57.567 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.410133+0000", 2024-09-12T22:32:57.568 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 80.079065408999995, 2024-09-12T22:32:57.568 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0013504000000000001, 2024-09-12T22:32:57.568 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:57.568 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:57.568 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "reached pg", 2024-09-12T22:32:57.568 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:57.568 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.568 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:57.568 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410133+0000", 2024-09-12T22:32:57.568 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:57.568 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.568 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.568 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:57.568 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410133+0000", 2024-09-12T22:32:57.569 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:57.569 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.569 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.569 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:57.569 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410133+0000", 2024-09-12T22:32:57.569 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.0599999999999999e-07 2024-09-12T22:32:57.569 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.569 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.569 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:57.569 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410135+0000", 2024-09-12T22:32:57.569 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7770000000000001e-06 2024-09-12T22:32:57.569 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.569 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.569 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:57.570 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410140+0000", 2024-09-12T22:32:57.570 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9960000000000001e-06 2024-09-12T22:32:57.570 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.570 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.570 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:57.570 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410144+0000", 2024-09-12T22:32:57.570 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9500000000000003e-06 2024-09-12T22:32:57.570 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.570 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.570 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:57.570 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411310+0000", 2024-09-12T22:32:57.570 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001166311 2024-09-12T22:32:57.570 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.570 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.570 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:57.571 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411483+0000", 2024-09-12T22:32:57.571 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00017316 2024-09-12T22:32:57.571 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:57.571 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:57.571 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:57.571 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.571 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.571 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "pg_update_log_missing(3.1a epoch 19/17 rep_tid 0 entries 19'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T22:32:57.571 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.410617+0000", 2024-09-12T22:32:57.571 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 80.078581013999994, 2024-09-12T22:32:57.571 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0030439709999999999, 2024-09-12T22:32:57.571 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:57.571 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:57.571 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "reached pg", 2024-09-12T22:32:57.572 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:57.572 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.572 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:57.572 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410617+0000", 2024-09-12T22:32:57.572 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:57.572 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.572 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.572 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:57.572 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410617+0000", 2024-09-12T22:32:57.572 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:57.572 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.572 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.572 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:57.572 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410617+0000", 2024-09-12T22:32:57.573 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3599999999999999e-07 2024-09-12T22:32:57.573 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.573 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.573 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:57.573 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410625+0000", 2024-09-12T22:32:57.573 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5410000000000003e-06 2024-09-12T22:32:57.573 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.573 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.573 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:57.573 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410638+0000", 2024-09-12T22:32:57.573 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3261999999999999e-05 2024-09-12T22:32:57.573 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.573 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.574 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:57.574 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410653+0000", 2024-09-12T22:32:57.574 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4844000000000001e-05 2024-09-12T22:32:57.574 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.574 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.574 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:57.574 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410814+0000", 2024-09-12T22:32:57.574 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00016119999999999999 2024-09-12T22:32:57.574 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.574 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.574 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:57.574 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413661+0000", 2024-09-12T22:32:57.574 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0028467879999999998 2024-09-12T22:32:57.574 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:57.574 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:57.574 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:57.575 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.575 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.575 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-09-12T22:32:57.575 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:39.398875+0000", 2024-09-12T22:32:57.575 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 78.090322733999997, 2024-09-12T22:32:57.575 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0015679069999999999, 2024-09-12T22:32:57.575 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:57.575 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:57.575 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:57.575 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:57.575 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.575 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:57.575 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398875+0000", 2024-09-12T22:32:57.575 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:57.576 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.576 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.576 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:57.576 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398875+0000", 2024-09-12T22:32:57.576 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:57.576 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.576 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.576 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:57.576 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398878+0000", 2024-09-12T22:32:57.576 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1679999999999998e-06 2024-09-12T22:32:57.576 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.576 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.576 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:57.576 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398888+0000", 2024-09-12T22:32:57.577 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.084e-05 2024-09-12T22:32:57.577 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.577 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.577 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:57.577 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398906+0000", 2024-09-12T22:32:57.577 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7518000000000001e-05 2024-09-12T22:32:57.577 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.577 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.577 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:57.577 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398914+0000", 2024-09-12T22:32:57.577 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5989999999999996e-06 2024-09-12T22:32:57.577 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.577 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.577 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:57.578 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398974+0000", 2024-09-12T22:32:57.578 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0988e-05 2024-09-12T22:32:57.578 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.578 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.578 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:57.578 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.399078+0000", 2024-09-12T22:32:57.578 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000103133 2024-09-12T22:32:57.578 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.578 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.578 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:57.578 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.399166+0000", 2024-09-12T22:32:57.578 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.8183999999999995e-05 2024-09-12T22:32:57.578 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.579 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.579 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:57.579 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.399747+0000", 2024-09-12T22:32:57.579 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00058110599999999996 2024-09-12T22:32:57.579 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.579 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.579 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:57.579 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.400377+0000", 2024-09-12T22:32:57.579 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000630157 2024-09-12T22:32:57.579 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.579 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.579 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:57.579 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.400415+0000", 2024-09-12T22:32:57.580 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7814000000000001e-05 2024-09-12T22:32:57.580 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.580 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.580 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:57.580 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.400443+0000", 2024-09-12T22:32:57.580 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8399999999999999e-05 2024-09-12T22:32:57.580 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:57.580 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:57.580 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:57.580 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.580 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.581 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e23)", 2024-09-12T22:32:57.581 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:58.400966+0000", 2024-09-12T22:32:57.581 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 59.088231825999998, 2024-09-12T22:32:57.581 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001468876, 2024-09-12T22:32:57.581 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:57.581 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:57.581 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:57.581 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:57.581 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.581 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:57.581 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400966+0000", 2024-09-12T22:32:57.581 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:57.581 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.581 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.582 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:57.582 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400966+0000", 2024-09-12T22:32:57.582 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:57.582 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.582 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.582 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:57.582 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400967+0000", 2024-09-12T22:32:57.582 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.046e-06 2024-09-12T22:32:57.582 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.582 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.582 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:57.582 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400974+0000", 2024-09-12T22:32:57.582 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2310000000000001e-06 2024-09-12T22:32:57.582 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.583 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.583 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:57.583 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400988+0000", 2024-09-12T22:32:57.583 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4482e-05 2024-09-12T22:32:57.583 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.583 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.583 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:57.583 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400997+0000", 2024-09-12T22:32:57.583 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.0189999999999995e-06 2024-09-12T22:32:57.583 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.583 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.583 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:57.583 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.401068+0000", 2024-09-12T22:32:57.583 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1426000000000004e-05 2024-09-12T22:32:57.584 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.584 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.584 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:57.584 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.401174+0000", 2024-09-12T22:32:57.584 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000105769 2024-09-12T22:32:57.584 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.584 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.584 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:57.584 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.401335+0000", 2024-09-12T22:32:57.584 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000161225 2024-09-12T22:32:57.584 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.584 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.584 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:57.585 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.402110+0000", 2024-09-12T22:32:57.585 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00077428800000000004 2024-09-12T22:32:57.585 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.585 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.585 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:57.585 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.402333+0000", 2024-09-12T22:32:57.585 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000223723 2024-09-12T22:32:57.585 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.585 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.585 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:57.585 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.402388+0000", 2024-09-12T22:32:57.585 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4700999999999997e-05 2024-09-12T22:32:57.585 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.586 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.586 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:57.586 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.402435+0000", 2024-09-12T22:32:57.586 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6965999999999997e-05 2024-09-12T22:32:57.586 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:57.586 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:57.586 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:57.586 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.586 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.586 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:45 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e27)", 2024-09-12T22:32:57.586 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:32:04.401614+0000", 2024-09-12T22:32:57.586 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 53.087584397000001, 2024-09-12T22:32:57.586 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0014279749999999999, 2024-09-12T22:32:57.586 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:32:57.587 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:32:57.587 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:32:57.587 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:32:57.587 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.587 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:32:57.587 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401614+0000", 2024-09-12T22:32:57.587 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:57.587 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.587 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.587 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:32:57.587 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401614+0000", 2024-09-12T22:32:57.587 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:32:57.587 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.587 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.588 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:32:57.588 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401615+0000", 2024-09-12T22:32:57.588 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.161e-06 2024-09-12T22:32:57.588 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.588 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.588 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:32:57.588 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401621+0000", 2024-09-12T22:32:57.588 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8730000000000004e-06 2024-09-12T22:32:57.588 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.588 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.588 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:32:57.588 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401633+0000", 2024-09-12T22:32:57.588 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1800000000000001e-05 2024-09-12T22:32:57.588 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.589 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.589 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:32:57.589 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401656+0000", 2024-09-12T22:32:57.589 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.3521999999999999e-05 2024-09-12T22:32:57.589 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.589 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.589 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:32:57.589 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401713+0000", 2024-09-12T22:32:57.589 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7259000000000002e-05 2024-09-12T22:32:57.589 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.589 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.589 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:32:57.589 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401849+0000", 2024-09-12T22:32:57.589 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013613500000000001 2024-09-12T22:32:57.590 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.590 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.590 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:32:57.590 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.402009+0000", 2024-09-12T22:32:57.590 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00015947199999999999 2024-09-12T22:32:57.590 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.590 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.590 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:32:57.590 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.402629+0000", 2024-09-12T22:32:57.590 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00061962200000000001 2024-09-12T22:32:57.590 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.590 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.590 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:32:57.590 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.402983+0000", 2024-09-12T22:32:57.591 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00035447499999999998 2024-09-12T22:32:57.591 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.591 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.591 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:32:57.591 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.403016+0000", 2024-09-12T22:32:57.591 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3108999999999998e-05 2024-09-12T22:32:57.591 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:32:57.591 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:32:57.591 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:32:57.591 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.403042+0000", 2024-09-12T22:32:57.591 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5547000000000001e-05 2024-09-12T22:32:57.591 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:57.591 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:57.591 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:57.592 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:32:57.592 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:32:57.592 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:32:57.593 INFO:teuthology.orchestra.run.smithi019.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-12T22:32:57.594 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:57.592+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:57.594 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T22:32:57.594 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:32:57.595 INFO:teuthology.orchestra.run.smithi019.stdout:osd.2: {} 2024-09-12T22:32:57.595 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:32:57.596 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:32:57.596 INFO:teuthology.orchestra.run.smithi019.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T22:32:57.596 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:32:57.616 INFO:tasks.workunit.client.0.smithi019.stderr:+ mkdir -p fsstress 2024-09-12T22:32:57.617 INFO:tasks.workunit.client.0.smithi019.stderr:+ pushd fsstress 2024-09-12T22:32:57.618 INFO:tasks.workunit.client.0.smithi019.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-12T22:32:57.618 INFO:tasks.workunit.client.0.smithi019.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-09-12T22:32:57.693 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:57.693+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:57.702 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:57.702 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:57.711 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:32:57.795 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:57.794+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:57.814 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:57.815 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:57.823 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:32:57.896 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:57.895+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:57.926 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:57.926 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:57.935 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:32:57.996 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:57.995+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:58.040 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:58.040 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:58.049 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:32:58.097 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:58.096+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:58.192 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:58.192 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:58.198 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:58.197+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:58.202 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:32:58.207 INFO:tasks.workunit.client.0.smithi019.stderr:+ tar xzf ltp-full.tgz 2024-09-12T22:32:58.299 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:58.298+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:58.355 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:58.356 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:58.365 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:32:58.410 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:58.409+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:58.467 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T22:32:58.479 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:58.479 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:58.488 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:32:58.529 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:58.528+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:58.602 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:58.601+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:58.636 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:58.636 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:58.645 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:32:58.729 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:58.728+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:58.795 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:58.795 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:58.804 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:58.803+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:58.804 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:32:58.856 DEBUG:teuthology.orchestra.console.smithi076:pexpect command: ipmitool -H smithi076.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-09-12T22:32:58.905 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:58.904+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:58.916 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:58.916 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:58.926 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:32:58.967 DEBUG:teuthology.orchestra.console.smithi076:check power output: Chassis Power is off 2024-09-12T22:32:59.006 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:59.005+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:59.074 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:59.075 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:59.085 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:32:59.107 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:59.106+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:59.193 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:59.193 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:59.202 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:32:59.246 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:59.245+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:59.309 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:59.308+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:59.314 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:59.314 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:59.324 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:32:59.409 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:59.408+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:59.468 INFO:teuthology.orchestra.run.smithi019.stderr:nodeep-scrub is set 2024-09-12T22:32:59.477 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:59.477 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:59.483 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:32:59.524 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:59.523+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:59.597 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T22:32:59.611 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:59.610+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:59.629 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:32:59.630 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:32:59.639 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:32:59.712 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:59.711+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:32:59.716 INFO:teuthology.orchestra.run.smithi019.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-12T22:32:59.734 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T22:32:59.734 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:32:59.751 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:32:59.751 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:32:59.751 INFO:teuthology.orchestra.run.smithi148.stdout: "num_ops": 0 2024-09-12T22:32:59.751 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:32:59.755 INFO:teuthology.orchestra.run.smithi019.stdout:osd.2: {} 2024-09-12T22:32:59.755 INFO:teuthology.orchestra.run.smithi019.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T22:32:59.758 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:32:59.759 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:32:59.760 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:32:59.813 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:32:59.812+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:32:59.874 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:32:59.874 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:32:59.874 INFO:teuthology.orchestra.run.smithi148.stdout: "complaint_time": 30, 2024-09-12T22:32:59.874 INFO:teuthology.orchestra.run.smithi148.stdout: "num_blocked_ops": 0 2024-09-12T22:32:59.874 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:32:59.885 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:32:59.913 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:32:59.912+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:00.015 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:00.013+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:00.039 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:33:00.039 INFO:teuthology.orchestra.run.smithi148.stdout: "size": 20, 2024-09-12T22:33:00.039 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 600, 2024-09-12T22:33:00.039 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [ 2024-09-12T22:33:00.039 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.039 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:33:00.039 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.400880+0000", 2024-09-12T22:33:00.039 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 82.635742136999994, 2024-09-12T22:33:00.039 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0095133660000000005, 2024-09-12T22:33:00.040 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:00.040 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:00.040 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:00.040 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:00.040 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.040 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:00.040 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400880+0000", 2024-09-12T22:33:00.040 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:00.040 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.040 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.040 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:00.040 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400880+0000", 2024-09-12T22:33:00.040 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:00.040 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.041 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.041 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:00.041 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400892+0000", 2024-09-12T22:33:00.041 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1941e-05 2024-09-12T22:33:00.041 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.041 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.041 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:00.041 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400900+0000", 2024-09-12T22:33:00.041 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0080000000000002e-06 2024-09-12T22:33:00.041 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.041 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.041 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:00.041 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400911+0000", 2024-09-12T22:33:00.042 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1452e-05 2024-09-12T22:33:00.042 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.042 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.042 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:00.042 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400922+0000", 2024-09-12T22:33:00.042 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0772e-05 2024-09-12T22:33:00.042 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.042 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.042 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:00.042 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401009+0000", 2024-09-12T22:33:00.042 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.7206000000000005e-05 2024-09-12T22:33:00.042 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.042 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.043 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:00.043 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401157+0000", 2024-09-12T22:33:00.043 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014831499999999999 2024-09-12T22:33:00.043 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.043 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.043 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:00.043 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401312+0000", 2024-09-12T22:33:00.043 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00015495600000000001 2024-09-12T22:33:00.043 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.043 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.043 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:00.043 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.403060+0000", 2024-09-12T22:33:00.043 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0017475220000000001 2024-09-12T22:33:00.044 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.044 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.044 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:00.044 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410300+0000", 2024-09-12T22:33:00.044 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0072403260000000001 2024-09-12T22:33:00.044 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.044 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.044 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:00.044 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410350+0000", 2024-09-12T22:33:00.044 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9814000000000001e-05 2024-09-12T22:33:00.044 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.044 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.044 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:00.045 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410393+0000", 2024-09-12T22:33:00.045 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3053999999999998e-05 2024-09-12T22:33:00.045 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:00.045 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:00.045 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:00.045 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.045 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.045 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:33:00.045 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.400952+0000", 2024-09-12T22:33:00.045 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 82.635669985000007, 2024-09-12T22:33:00.045 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0096045620000000005, 2024-09-12T22:33:00.045 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:00.045 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:00.046 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:00.046 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:00.046 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.046 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:00.046 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400952+0000", 2024-09-12T22:33:00.046 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:00.046 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.046 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.046 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:00.046 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400952+0000", 2024-09-12T22:33:00.046 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:00.046 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.046 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.047 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:00.047 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400953+0000", 2024-09-12T22:33:00.047 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.8000000000000005e-07 2024-09-12T22:33:00.047 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.047 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.047 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:00.047 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400957+0000", 2024-09-12T22:33:00.047 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.33e-06 2024-09-12T22:33:00.047 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.047 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.047 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:00.047 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400966+0000", 2024-09-12T22:33:00.047 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1989999999999995e-06 2024-09-12T22:33:00.048 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.048 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.048 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:00.048 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400973+0000", 2024-09-12T22:33:00.048 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2779999999999999e-06 2024-09-12T22:33:00.048 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.048 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.048 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:00.049 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401696+0000", 2024-09-12T22:33:00.049 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00072363500000000003 2024-09-12T22:33:00.049 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.049 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.049 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:00.049 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401788+0000", 2024-09-12T22:33:00.049 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1862999999999998e-05 2024-09-12T22:33:00.049 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.049 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.049 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:00.049 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401929+0000", 2024-09-12T22:33:00.049 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014096000000000001 2024-09-12T22:33:00.049 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.050 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.050 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:00.050 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.403542+0000", 2024-09-12T22:33:00.050 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001612963 2024-09-12T22:33:00.050 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.050 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.050 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:00.050 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410460+0000", 2024-09-12T22:33:00.050 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0069180500000000002 2024-09-12T22:33:00.050 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.050 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.050 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:00.050 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410515+0000", 2024-09-12T22:33:00.051 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5009000000000001e-05 2024-09-12T22:33:00.051 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.051 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.051 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:00.051 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410557+0000", 2024-09-12T22:33:00.051 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1495000000000002e-05 2024-09-12T22:33:00.051 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:00.051 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:00.051 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:00.051 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.051 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.051 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:33:00.051 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.400984+0000", 2024-09-12T22:33:00.051 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 82.635637489999993, 2024-09-12T22:33:00.052 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0073703950000000001, 2024-09-12T22:33:00.052 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:00.052 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:00.052 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:00.052 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:00.052 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.052 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:00.052 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400984+0000", 2024-09-12T22:33:00.052 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:00.052 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.052 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.052 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:00.052 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400984+0000", 2024-09-12T22:33:00.052 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:00.053 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.053 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.053 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:00.053 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400985+0000", 2024-09-12T22:33:00.053 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3200000000000005e-07 2024-09-12T22:33:00.053 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.053 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.053 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:00.053 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400998+0000", 2024-09-12T22:33:00.053 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2726e-05 2024-09-12T22:33:00.053 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.053 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.053 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:00.054 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401006+0000", 2024-09-12T22:33:00.054 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.3110000000000006e-06 2024-09-12T22:33:00.054 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.054 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.054 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:00.054 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401022+0000", 2024-09-12T22:33:00.054 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6249e-05 2024-09-12T22:33:00.054 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.054 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.054 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:00.054 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401700+0000", 2024-09-12T22:33:00.054 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00067811100000000001 2024-09-12T22:33:00.054 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.054 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.055 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:00.055 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401839+0000", 2024-09-12T22:33:00.055 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013865399999999999 2024-09-12T22:33:00.055 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.055 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.055 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:33:00.055 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401962+0000", 2024-09-12T22:33:00.055 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000123266 2024-09-12T22:33:00.055 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.055 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.056 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:00.056 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.403589+0000", 2024-09-12T22:33:00.056 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001626932 2024-09-12T22:33:00.056 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.056 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.056 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:00.056 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.408274+0000", 2024-09-12T22:33:00.056 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0046848100000000002 2024-09-12T22:33:00.056 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.056 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.056 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:00.056 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.408324+0000", 2024-09-12T22:33:00.056 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9784000000000003e-05 2024-09-12T22:33:00.057 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.057 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.057 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:00.057 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.408355+0000", 2024-09-12T22:33:00.057 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.1019999999999998e-05 2024-09-12T22:33:00.057 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:00.057 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:00.057 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:00.057 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.057 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.057 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:33:00.057 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401034+0000", 2024-09-12T22:33:00.057 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 82.635588049999996, 2024-09-12T22:33:00.057 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011063051000000001, 2024-09-12T22:33:00.058 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:00.058 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:00.058 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:00.058 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:00.058 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.058 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:00.058 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401034+0000", 2024-09-12T22:33:00.058 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:00.058 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.058 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.058 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:00.058 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401034+0000", 2024-09-12T22:33:00.058 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:00.059 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.059 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.059 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:00.059 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401034+0000", 2024-09-12T22:33:00.059 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8899999999999999e-07 2024-09-12T22:33:00.059 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.059 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.059 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:00.059 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401038+0000", 2024-09-12T22:33:00.059 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.523e-06 2024-09-12T22:33:00.059 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.059 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.059 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:00.059 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401046+0000", 2024-09-12T22:33:00.060 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0479999999999999e-06 2024-09-12T22:33:00.060 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.060 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.060 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:00.060 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401051+0000", 2024-09-12T22:33:00.060 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2619999999999998e-06 2024-09-12T22:33:00.060 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.060 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.060 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:00.060 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402270+0000", 2024-09-12T22:33:00.060 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012182429999999999 2024-09-12T22:33:00.060 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.060 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.060 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:00.061 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402325+0000", 2024-09-12T22:33:00.061 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5526999999999999e-05 2024-09-12T22:33:00.061 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.061 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.061 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:33:00.061 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402403+0000", 2024-09-12T22:33:00.061 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.7559999999999996e-05 2024-09-12T22:33:00.061 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.061 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.061 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:00.061 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.403655+0000", 2024-09-12T22:33:00.061 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012521489999999999 2024-09-12T22:33:00.061 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.062 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.062 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:00.062 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411979+0000", 2024-09-12T22:33:00.062 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0083240420000000002 2024-09-12T22:33:00.062 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.062 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.062 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:00.062 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.412036+0000", 2024-09-12T22:33:00.062 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7639000000000002e-05 2024-09-12T22:33:00.062 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.062 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.062 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:00.062 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.412097+0000", 2024-09-12T22:33:00.062 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0469e-05 2024-09-12T22:33:00.063 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:00.063 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:00.063 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:00.063 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.063 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.063 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:33:00.063 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401060+0000", 2024-09-12T22:33:00.063 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 82.635562297999996, 2024-09-12T22:33:00.063 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.010030172, 2024-09-12T22:33:00.063 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:00.063 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:00.063 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:00.063 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:00.063 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.064 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:00.064 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401060+0000", 2024-09-12T22:33:00.064 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:00.064 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.064 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.064 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:00.064 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401060+0000", 2024-09-12T22:33:00.064 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:00.064 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.064 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.065 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:00.065 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401060+0000", 2024-09-12T22:33:00.065 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2500000000000001e-07 2024-09-12T22:33:00.065 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.065 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.065 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:00.065 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401063+0000", 2024-09-12T22:33:00.065 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0910000000000001e-06 2024-09-12T22:33:00.065 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.065 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.065 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:00.065 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401070+0000", 2024-09-12T22:33:00.065 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1210000000000001e-06 2024-09-12T22:33:00.065 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.066 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.066 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:00.066 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401076+0000", 2024-09-12T22:33:00.066 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2830000000000001e-06 2024-09-12T22:33:00.066 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.066 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.066 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:00.066 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402288+0000", 2024-09-12T22:33:00.066 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012123699999999999 2024-09-12T22:33:00.066 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.066 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.066 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:00.066 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402359+0000", 2024-09-12T22:33:00.067 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.0988000000000005e-05 2024-09-12T22:33:00.067 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.067 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.067 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:00.067 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402457+0000", 2024-09-12T22:33:00.067 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.7857999999999997e-05 2024-09-12T22:33:00.067 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.067 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.067 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:00.067 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.404395+0000", 2024-09-12T22:33:00.067 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0019380160000000001 2024-09-12T22:33:00.067 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.067 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.067 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:00.068 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410603+0000", 2024-09-12T22:33:00.068 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.006208061 2024-09-12T22:33:00.068 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.068 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.068 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:00.068 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410687+0000", 2024-09-12T22:33:00.068 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.4623000000000006e-05 2024-09-12T22:33:00.068 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.068 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.068 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:00.068 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411090+0000", 2024-09-12T22:33:00.068 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00040233599999999999 2024-09-12T22:33:00.069 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:00.069 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:00.069 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:00.069 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.069 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.069 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:33:00.069 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401083+0000", 2024-09-12T22:33:00.069 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 82.635538882000006, 2024-09-12T22:33:00.069 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0097591850000000001, 2024-09-12T22:33:00.069 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:00.069 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:00.069 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:00.069 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:00.069 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.070 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:00.070 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401083+0000", 2024-09-12T22:33:00.070 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:00.070 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.070 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.070 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:00.070 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401083+0000", 2024-09-12T22:33:00.070 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:00.070 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.070 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.070 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:00.070 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401084+0000", 2024-09-12T22:33:00.070 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4799999999999999e-07 2024-09-12T22:33:00.071 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.071 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.071 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:00.071 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401088+0000", 2024-09-12T22:33:00.071 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6419999999999998e-06 2024-09-12T22:33:00.071 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.071 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.071 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:00.071 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401094+0000", 2024-09-12T22:33:00.071 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0090000000000004e-06 2024-09-12T22:33:00.071 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.071 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.071 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:00.071 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401108+0000", 2024-09-12T22:33:00.072 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3884e-05 2024-09-12T22:33:00.072 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.072 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.072 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:00.072 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401165+0000", 2024-09-12T22:33:00.072 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.6499000000000002e-05 2024-09-12T22:33:00.072 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.072 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.072 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:00.072 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401261+0000", 2024-09-12T22:33:00.072 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.6872000000000004e-05 2024-09-12T22:33:00.072 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.072 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.073 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:00.073 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401376+0000", 2024-09-12T22:33:00.073 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000114508 2024-09-12T22:33:00.073 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.073 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.073 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:00.073 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402666+0000", 2024-09-12T22:33:00.073 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012901659999999999 2024-09-12T22:33:00.073 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.073 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.074 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:00.074 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410572+0000", 2024-09-12T22:33:00.074 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0079055489999999996 2024-09-12T22:33:00.074 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.074 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.074 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:00.074 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410661+0000", 2024-09-12T22:33:00.074 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.9578000000000002e-05 2024-09-12T22:33:00.075 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.075 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.075 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:00.075 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410842+0000", 2024-09-12T22:33:00.075 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00018102999999999999 2024-09-12T22:33:00.075 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:00.075 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:00.076 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:00.076 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.076 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.076 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:33:00.076 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401122+0000", 2024-09-12T22:33:00.076 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 82.635499850000002, 2024-09-12T22:33:00.076 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0099122080000000005, 2024-09-12T22:33:00.076 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:00.077 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:00.077 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:33:00.077 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:00.077 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.077 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:00.077 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401122+0000", 2024-09-12T22:33:00.077 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:00.077 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.077 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.077 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:00.078 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401122+0000", 2024-09-12T22:33:00.078 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:00.078 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.078 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.078 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:00.078 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401123+0000", 2024-09-12T22:33:00.078 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2600000000000002e-07 2024-09-12T22:33:00.078 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.078 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.078 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:00.078 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401126+0000", 2024-09-12T22:33:00.079 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.6449999999999998e-06 2024-09-12T22:33:00.079 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.079 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.079 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:00.079 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401133+0000", 2024-09-12T22:33:00.079 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.9890000000000003e-06 2024-09-12T22:33:00.079 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.079 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.079 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:00.079 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401138+0000", 2024-09-12T22:33:00.079 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8060000000000002e-06 2024-09-12T22:33:00.079 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.079 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.080 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:00.080 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401703+0000", 2024-09-12T22:33:00.080 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00056509099999999999 2024-09-12T22:33:00.080 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.080 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.080 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:00.080 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401837+0000", 2024-09-12T22:33:00.080 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013338799999999999 2024-09-12T22:33:00.080 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.080 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.080 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:00.080 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411034+0000", 2024-09-12T22:33:00.080 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.009197663 2024-09-12T22:33:00.081 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:00.081 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:00.081 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:00.081 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.081 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.081 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:33:00.081 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401158+0000", 2024-09-12T22:33:00.081 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 82.635464071000001, 2024-09-12T22:33:00.081 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.010292437999999999, 2024-09-12T22:33:00.081 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:00.082 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:00.082 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:33:00.082 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:00.082 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.082 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:00.082 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401158+0000", 2024-09-12T22:33:00.082 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:00.082 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.082 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.082 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:00.082 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401158+0000", 2024-09-12T22:33:00.082 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:00.082 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.083 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.083 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:00.083 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401158+0000", 2024-09-12T22:33:00.083 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9699999999999996e-07 2024-09-12T22:33:00.083 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.083 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.083 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:00.083 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401161+0000", 2024-09-12T22:33:00.083 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.7410000000000001e-06 2024-09-12T22:33:00.083 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.083 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.083 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:00.083 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401168+0000", 2024-09-12T22:33:00.084 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.844e-06 2024-09-12T22:33:00.084 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.084 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.084 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:00.084 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401174+0000", 2024-09-12T22:33:00.084 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4700000000000001e-06 2024-09-12T22:33:00.084 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.084 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.084 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:00.084 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402799+0000", 2024-09-12T22:33:00.084 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0016256409999999999 2024-09-12T22:33:00.084 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.084 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.085 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:00.085 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402893+0000", 2024-09-12T22:33:00.085 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.3807999999999994e-05 2024-09-12T22:33:00.085 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.085 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.085 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:00.085 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411450+0000", 2024-09-12T22:33:00.085 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0085573369999999999 2024-09-12T22:33:00.085 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:00.085 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:00.085 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:00.085 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.086 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.086 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:33:00.086 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401183+0000", 2024-09-12T22:33:00.086 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 82.635439219000006, 2024-09-12T22:33:00.086 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0068597830000000004, 2024-09-12T22:33:00.086 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:00.086 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:00.086 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:33:00.086 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:00.086 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.086 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:00.086 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401183+0000", 2024-09-12T22:33:00.086 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:00.086 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.087 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.087 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:00.087 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401183+0000", 2024-09-12T22:33:00.087 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:00.088 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.088 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.088 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:00.088 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401183+0000", 2024-09-12T22:33:00.088 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.6700000000000003e-07 2024-09-12T22:33:00.089 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.089 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.089 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:00.089 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401186+0000", 2024-09-12T22:33:00.089 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4679999999999999e-06 2024-09-12T22:33:00.089 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.089 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.089 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:00.089 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401192+0000", 2024-09-12T22:33:00.089 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.1519999999999997e-06 2024-09-12T22:33:00.089 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.089 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.089 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:00.090 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401197+0000", 2024-09-12T22:33:00.090 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4669999999999998e-06 2024-09-12T22:33:00.090 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.090 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.090 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:00.090 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401253+0000", 2024-09-12T22:33:00.090 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.6211000000000001e-05 2024-09-12T22:33:00.090 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.090 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.090 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:00.090 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401413+0000", 2024-09-12T22:33:00.090 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00016021399999999999 2024-09-12T22:33:00.090 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.090 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.091 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:00.091 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.408043+0000", 2024-09-12T22:33:00.091 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0066295039999999996 2024-09-12T22:33:00.091 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:00.091 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:00.091 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:00.091 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.091 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.091 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:20 3.1c e19/17 3:3ed09add:::607.00000000:head v 19'1, mlcod=0'0)", 2024-09-12T22:33:00.091 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.409642+0000", 2024-09-12T22:33:00.091 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 82.626979759999998, 2024-09-12T22:33:00.091 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0038816269999999999, 2024-09-12T22:33:00.091 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:00.092 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:00.092 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:00.092 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:00.092 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.092 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:00.092 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409642+0000", 2024-09-12T22:33:00.092 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:00.092 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.092 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.092 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:00.092 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409642+0000", 2024-09-12T22:33:00.092 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:00.092 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.093 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.093 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:00.093 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409642+0000", 2024-09-12T22:33:00.093 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.6899999999999999e-07 2024-09-12T22:33:00.093 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.093 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.093 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:00.093 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409648+0000", 2024-09-12T22:33:00.093 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.49e-06 2024-09-12T22:33:00.093 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.093 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.093 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:00.093 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409656+0000", 2024-09-12T22:33:00.094 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.2949999999999994e-06 2024-09-12T22:33:00.094 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.094 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.094 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:00.094 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409664+0000", 2024-09-12T22:33:00.094 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.1219999999999995e-06 2024-09-12T22:33:00.094 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.094 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.094 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:00.094 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409707+0000", 2024-09-12T22:33:00.094 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2222000000000003e-05 2024-09-12T22:33:00.094 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.094 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.094 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:00.095 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409724+0000", 2024-09-12T22:33:00.095 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7496999999999999e-05 2024-09-12T22:33:00.095 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.095 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.095 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:00.095 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413439+0000", 2024-09-12T22:33:00.095 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00371448 2024-09-12T22:33:00.095 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.095 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.095 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:00.095 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413524+0000", 2024-09-12T22:33:00.095 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.5252000000000003e-05 2024-09-12T22:33:00.095 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:00.096 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:00.096 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:00.096 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.096 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.096 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:28 3.13 e19/17 3:cd5a64a3:::100.00000000:head v 19'1, mlcod=0'0)", 2024-09-12T22:33:00.096 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.409681+0000", 2024-09-12T22:33:00.096 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 82.626941277, 2024-09-12T22:33:00.096 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0038708710000000001, 2024-09-12T22:33:00.096 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:00.096 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:00.096 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:00.096 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:00.096 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.096 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:00.097 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409681+0000", 2024-09-12T22:33:00.097 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:00.097 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.097 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.097 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:00.097 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409681+0000", 2024-09-12T22:33:00.097 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:00.097 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.097 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.097 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:00.097 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409681+0000", 2024-09-12T22:33:00.097 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3000000000000002e-07 2024-09-12T22:33:00.097 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.097 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.097 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:00.098 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409695+0000", 2024-09-12T22:33:00.098 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4313e-05 2024-09-12T22:33:00.098 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.098 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.098 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:00.098 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409703+0000", 2024-09-12T22:33:00.098 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4000000000000003e-06 2024-09-12T22:33:00.098 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.098 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.098 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:00.098 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409708+0000", 2024-09-12T22:33:00.098 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3190000000000002e-06 2024-09-12T22:33:00.098 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.098 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.099 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:00.099 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409875+0000", 2024-09-12T22:33:00.099 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000167329 2024-09-12T22:33:00.099 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.099 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.099 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:00.099 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409892+0000", 2024-09-12T22:33:00.099 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6957999999999999e-05 2024-09-12T22:33:00.099 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.099 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.099 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:00.099 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413457+0000", 2024-09-12T22:33:00.099 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0035651279999999999 2024-09-12T22:33:00.100 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.100 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.100 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:00.100 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413552+0000", 2024-09-12T22:33:00.100 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.4093999999999997e-05 2024-09-12T22:33:00.100 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:00.100 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:00.100 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:00.100 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.100 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.100 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:21 3.1c e19/17 3:3ed09add:::607.00000000:head v 19'2, mlcod=0'0)", 2024-09-12T22:33:00.100 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.409718+0000", 2024-09-12T22:33:00.101 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 82.626903612000007, 2024-09-12T22:33:00.101 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003851883, 2024-09-12T22:33:00.101 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:00.101 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:00.101 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:00.101 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:00.101 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.101 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:00.101 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409718+0000", 2024-09-12T22:33:00.101 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:00.101 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.101 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.101 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:00.101 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409718+0000", 2024-09-12T22:33:00.102 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:00.102 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.102 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.102 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:00.102 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409719+0000", 2024-09-12T22:33:00.102 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.16e-07 2024-09-12T22:33:00.102 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.102 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.102 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:00.102 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409722+0000", 2024-09-12T22:33:00.102 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.692e-06 2024-09-12T22:33:00.102 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.102 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.103 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:00.103 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409729+0000", 2024-09-12T22:33:00.103 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.516e-06 2024-09-12T22:33:00.103 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.103 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.103 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:00.103 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409750+0000", 2024-09-12T22:33:00.103 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1151000000000001e-05 2024-09-12T22:33:00.103 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.103 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.103 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:00.103 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410015+0000", 2024-09-12T22:33:00.103 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00026477599999999999 2024-09-12T22:33:00.103 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.104 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.104 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:00.104 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410104+0000", 2024-09-12T22:33:00.104 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.9586000000000006e-05 2024-09-12T22:33:00.104 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.104 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.104 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:00.104 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413528+0000", 2024-09-12T22:33:00.104 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0034237880000000001 2024-09-12T22:33:00.104 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.104 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.104 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:00.104 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413570+0000", 2024-09-12T22:33:00.104 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2157999999999999e-05 2024-09-12T22:33:00.104 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:00.105 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:00.105 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:00.105 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.105 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.105 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:27 3.13 e19/17 3:c91d4a1d:::mds0_inotable:head v 19'2, mlcod=0'0)", 2024-09-12T22:33:00.105 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.409760+0000", 2024-09-12T22:33:00.105 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 82.626862095999996, 2024-09-12T22:33:00.105 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0039301910000000004, 2024-09-12T22:33:00.105 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:00.105 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:00.105 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:00.105 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:00.105 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.105 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:00.106 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409760+0000", 2024-09-12T22:33:00.106 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:00.106 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.106 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.106 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:00.106 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409760+0000", 2024-09-12T22:33:00.106 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:00.106 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.106 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.106 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:00.106 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409760+0000", 2024-09-12T22:33:00.106 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.39e-07 2024-09-12T22:33:00.106 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.107 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.107 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:00.107 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409765+0000", 2024-09-12T22:33:00.107 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4449999999999998e-06 2024-09-12T22:33:00.107 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.107 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.107 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:00.107 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409771+0000", 2024-09-12T22:33:00.107 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7159999999999997e-06 2024-09-12T22:33:00.107 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.107 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.107 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:00.107 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409778+0000", 2024-09-12T22:33:00.108 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.331e-06 2024-09-12T22:33:00.108 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.108 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.108 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:00.108 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410191+0000", 2024-09-12T22:33:00.108 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00041348300000000003 2024-09-12T22:33:00.108 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.108 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.108 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:00.108 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410211+0000", 2024-09-12T22:33:00.108 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9933999999999999e-05 2024-09-12T22:33:00.108 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.108 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.109 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:00.109 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413638+0000", 2024-09-12T22:33:00.109 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003426854 2024-09-12T22:33:00.109 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.109 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.109 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:00.109 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413690+0000", 2024-09-12T22:33:00.109 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2089000000000002e-05 2024-09-12T22:33:00.109 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:00.109 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:00.109 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:00.109 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.109 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.110 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "pg_update_log_missing(3.1a epoch 19/17 rep_tid 0 entries 19'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T22:33:00.110 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.410617+0000", 2024-09-12T22:33:00.110 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 82.626004840999997, 2024-09-12T22:33:00.110 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0030439709999999999, 2024-09-12T22:33:00.110 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:00.110 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:00.110 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "reached pg", 2024-09-12T22:33:00.110 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:00.110 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.110 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:00.110 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410617+0000", 2024-09-12T22:33:00.110 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:00.110 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.110 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.111 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:00.111 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410617+0000", 2024-09-12T22:33:00.111 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:00.111 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.111 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.111 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:00.111 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410617+0000", 2024-09-12T22:33:00.111 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3599999999999999e-07 2024-09-12T22:33:00.111 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.111 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.111 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:00.111 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410625+0000", 2024-09-12T22:33:00.111 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5410000000000003e-06 2024-09-12T22:33:00.111 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.112 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.112 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:00.112 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410638+0000", 2024-09-12T22:33:00.112 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3261999999999999e-05 2024-09-12T22:33:00.112 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.112 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.112 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:00.112 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410653+0000", 2024-09-12T22:33:00.112 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4844000000000001e-05 2024-09-12T22:33:00.112 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.112 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.112 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:00.112 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410814+0000", 2024-09-12T22:33:00.113 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00016119999999999999 2024-09-12T22:33:00.113 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.113 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.113 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:00.113 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413661+0000", 2024-09-12T22:33:00.113 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0028467879999999998 2024-09-12T22:33:00.113 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:00.113 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:00.113 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:00.113 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.113 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.113 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-09-12T22:33:00.113 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:39.398875+0000", 2024-09-12T22:33:00.113 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 80.637746561, 2024-09-12T22:33:00.114 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0015679069999999999, 2024-09-12T22:33:00.114 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:00.114 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:00.114 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:00.114 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:00.114 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.114 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:00.114 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398875+0000", 2024-09-12T22:33:00.114 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:00.114 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.114 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.114 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:00.114 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398875+0000", 2024-09-12T22:33:00.114 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:00.115 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.115 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.115 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:00.115 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398878+0000", 2024-09-12T22:33:00.115 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1679999999999998e-06 2024-09-12T22:33:00.115 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.115 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.115 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:00.115 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398888+0000", 2024-09-12T22:33:00.115 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.084e-05 2024-09-12T22:33:00.115 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.115 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.115 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:00.115 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398906+0000", 2024-09-12T22:33:00.116 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7518000000000001e-05 2024-09-12T22:33:00.116 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.116 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.116 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:00.116 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398914+0000", 2024-09-12T22:33:00.116 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5989999999999996e-06 2024-09-12T22:33:00.116 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.116 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.116 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:00.117 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.398974+0000", 2024-09-12T22:33:00.117 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0988e-05 2024-09-12T22:33:00.117 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.117 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.117 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:00.117 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.399078+0000", 2024-09-12T22:33:00.117 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000103133 2024-09-12T22:33:00.117 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.117 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.117 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:00.117 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.399166+0000", 2024-09-12T22:33:00.117 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.8183999999999995e-05 2024-09-12T22:33:00.118 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.118 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.118 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:00.118 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.399747+0000", 2024-09-12T22:33:00.118 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00058110599999999996 2024-09-12T22:33:00.118 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.118 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.118 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:00.118 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.400377+0000", 2024-09-12T22:33:00.118 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000630157 2024-09-12T22:33:00.118 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.118 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.118 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:00.119 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.400415+0000", 2024-09-12T22:33:00.119 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7814000000000001e-05 2024-09-12T22:33:00.119 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.119 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.119 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:00.119 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:39.400443+0000", 2024-09-12T22:33:00.119 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8399999999999999e-05 2024-09-12T22:33:00.119 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:00.119 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:00.119 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:00.119 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.119 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.119 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e23)", 2024-09-12T22:33:00.119 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:58.400966+0000", 2024-09-12T22:33:00.120 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 61.635655653000001, 2024-09-12T22:33:00.120 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001468876, 2024-09-12T22:33:00.120 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:00.120 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:00.120 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:00.120 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:00.120 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.120 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:00.120 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400966+0000", 2024-09-12T22:33:00.120 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:00.120 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.120 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.120 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:00.121 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400966+0000", 2024-09-12T22:33:00.121 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:00.121 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.121 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.121 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:00.121 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400967+0000", 2024-09-12T22:33:00.121 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.046e-06 2024-09-12T22:33:00.121 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.121 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.121 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:00.121 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400974+0000", 2024-09-12T22:33:00.121 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2310000000000001e-06 2024-09-12T22:33:00.121 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.122 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.122 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:00.122 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400988+0000", 2024-09-12T22:33:00.122 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4482e-05 2024-09-12T22:33:00.122 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.122 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.122 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:00.122 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.400997+0000", 2024-09-12T22:33:00.122 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.0189999999999995e-06 2024-09-12T22:33:00.122 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.122 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.122 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:00.122 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.401068+0000", 2024-09-12T22:33:00.122 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1426000000000004e-05 2024-09-12T22:33:00.123 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.123 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.123 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:00.123 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.401174+0000", 2024-09-12T22:33:00.123 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000105769 2024-09-12T22:33:00.123 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.123 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.123 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:00.123 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.401335+0000", 2024-09-12T22:33:00.123 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000161225 2024-09-12T22:33:00.123 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.123 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.123 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:00.123 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.402110+0000", 2024-09-12T22:33:00.124 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00077428800000000004 2024-09-12T22:33:00.124 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.124 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.124 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:00.124 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.402333+0000", 2024-09-12T22:33:00.124 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000223723 2024-09-12T22:33:00.124 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.124 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.124 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:00.124 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.402388+0000", 2024-09-12T22:33:00.124 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4700999999999997e-05 2024-09-12T22:33:00.124 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.124 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.125 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:00.125 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:58.402435+0000", 2024-09-12T22:33:00.125 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6965999999999997e-05 2024-09-12T22:33:00.125 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:00.125 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:00.125 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:00.125 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.125 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.125 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:45 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e27)", 2024-09-12T22:33:00.125 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:32:04.401614+0000", 2024-09-12T22:33:00.125 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 55.635008224000003, 2024-09-12T22:33:00.125 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0014279749999999999, 2024-09-12T22:33:00.125 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:00.125 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:00.126 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:00.126 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:00.126 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.126 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:00.126 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401614+0000", 2024-09-12T22:33:00.126 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:00.126 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.126 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.126 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:00.126 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401614+0000", 2024-09-12T22:33:00.126 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:00.126 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.126 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.127 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:00.127 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401615+0000", 2024-09-12T22:33:00.127 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.161e-06 2024-09-12T22:33:00.127 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.127 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.127 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:00.127 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401621+0000", 2024-09-12T22:33:00.127 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8730000000000004e-06 2024-09-12T22:33:00.127 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.127 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.127 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:00.127 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401633+0000", 2024-09-12T22:33:00.127 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1800000000000001e-05 2024-09-12T22:33:00.128 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.128 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.128 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:00.128 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401656+0000", 2024-09-12T22:33:00.128 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.3521999999999999e-05 2024-09-12T22:33:00.128 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.128 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.128 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:00.128 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401713+0000", 2024-09-12T22:33:00.128 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7259000000000002e-05 2024-09-12T22:33:00.128 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.128 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.128 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:00.129 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.401849+0000", 2024-09-12T22:33:00.129 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013613500000000001 2024-09-12T22:33:00.129 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.129 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.129 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:00.129 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.402009+0000", 2024-09-12T22:33:00.129 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00015947199999999999 2024-09-12T22:33:00.129 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.129 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.129 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:00.129 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.402629+0000", 2024-09-12T22:33:00.129 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00061962200000000001 2024-09-12T22:33:00.129 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.130 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.130 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:00.130 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.402983+0000", 2024-09-12T22:33:00.130 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00035447499999999998 2024-09-12T22:33:00.130 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.130 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.130 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:00.130 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.403016+0000", 2024-09-12T22:33:00.130 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3108999999999998e-05 2024-09-12T22:33:00.130 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.130 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.130 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:00.131 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:04.403042+0000", 2024-09-12T22:33:00.131 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5547000000000001e-05 2024-09-12T22:33:00.131 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:00.131 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:00.131 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:00.131 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.131 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.131 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4490.0:1423 4.11 4:8a956be3:::1000000087f.00000000:head [write 0~998] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T22:33:00.131 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:32:59.919618+0000", 2024-09-12T22:33:00.131 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.11700368999999999, 2024-09-12T22:33:00.131 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0014619170000000001, 2024-09-12T22:33:00.131 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:00.131 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:00.131 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:00.132 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:33:00.132 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4490", 2024-09-12T22:33:00.132 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:00.132 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 1423 2024-09-12T22:33:00.132 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.132 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:00.132 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.132 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:00.132 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:59.919618+0000", 2024-09-12T22:33:00.132 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:00.132 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.132 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.132 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:00.132 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:59.919618+0000", 2024-09-12T22:33:00.133 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:00.133 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.133 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.133 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:00.133 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:59.919619+0000", 2024-09-12T22:33:00.133 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.75e-07 2024-09-12T22:33:00.133 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.133 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.133 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:00.133 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:59.919622+0000", 2024-09-12T22:33:00.133 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.5489999999999998e-06 2024-09-12T22:33:00.133 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.133 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.133 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:00.134 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:59.919630+0000", 2024-09-12T22:33:00.134 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.9410000000000007e-06 2024-09-12T22:33:00.134 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.134 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.134 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:00.134 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:59.919635+0000", 2024-09-12T22:33:00.134 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4739999999999999e-06 2024-09-12T22:33:00.134 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.134 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.134 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:00.134 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:59.919675+0000", 2024-09-12T22:33:00.134 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0005000000000001e-05 2024-09-12T22:33:00.134 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.134 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.135 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:00.135 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:59.919743+0000", 2024-09-12T22:33:00.135 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7688000000000007e-05 2024-09-12T22:33:00.135 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.135 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.135 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:00.135 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:59.919812+0000", 2024-09-12T22:33:00.135 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.9301999999999995e-05 2024-09-12T22:33:00.135 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.135 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.135 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:00.135 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:59.920237+0000", 2024-09-12T22:33:00.135 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00042493300000000001 2024-09-12T22:33:00.135 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.136 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.136 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:00.136 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:59.921024+0000", 2024-09-12T22:33:00.136 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00078735600000000002 2024-09-12T22:33:00.136 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.136 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.136 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:00.136 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:59.921056+0000", 2024-09-12T22:33:00.136 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.1449000000000003e-05 2024-09-12T22:33:00.136 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.136 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.136 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:00.136 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:59.921080+0000", 2024-09-12T22:33:00.136 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4545e-05 2024-09-12T22:33:00.137 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:00.137 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:00.137 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:00.137 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.137 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.137 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4490.0:1435 4.37 4:ed3dd789:::1000000088c.00000000:head [write 0~2486] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T22:33:00.137 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:32:59.931655+0000", 2024-09-12T22:33:00.137 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.104966586, 2024-09-12T22:33:00.137 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001846758, 2024-09-12T22:33:00.137 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:00.137 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:00.137 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:00.137 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:33:00.137 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4490", 2024-09-12T22:33:00.138 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:00.138 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 1435 2024-09-12T22:33:00.138 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.138 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:00.138 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.138 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:00.138 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:59.931655+0000", 2024-09-12T22:33:00.138 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:00.138 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.138 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.138 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:00.138 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:59.931655+0000", 2024-09-12T22:33:00.139 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:00.139 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.139 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.139 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:00.139 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:59.931656+0000", 2024-09-12T22:33:00.139 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5700000000000002e-07 2024-09-12T22:33:00.139 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.139 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.139 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:00.139 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:59.931661+0000", 2024-09-12T22:33:00.139 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6779999999999999e-06 2024-09-12T22:33:00.139 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.139 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.139 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:00.140 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:59.931669+0000", 2024-09-12T22:33:00.140 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.3720000000000005e-06 2024-09-12T22:33:00.140 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.140 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.140 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:00.140 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:59.931674+0000", 2024-09-12T22:33:00.140 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6149999999999999e-06 2024-09-12T22:33:00.140 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.140 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.140 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:00.140 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:59.931710+0000", 2024-09-12T22:33:00.140 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.6566000000000002e-05 2024-09-12T22:33:00.141 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.141 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.141 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:00.141 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:59.931788+0000", 2024-09-12T22:33:00.141 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.7224999999999993e-05 2024-09-12T22:33:00.141 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.141 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.141 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:00.141 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:59.933415+0000", 2024-09-12T22:33:00.141 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0016275479999999999 2024-09-12T22:33:00.141 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.141 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.141 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:00.141 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:59.933449+0000", 2024-09-12T22:33:00.141 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3578000000000003e-05 2024-09-12T22:33:00.142 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.142 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.142 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:00.142 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:59.933502+0000", 2024-09-12T22:33:00.142 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3418999999999998e-05 2024-09-12T22:33:00.142 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:00.142 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:00.142 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:00.142 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.142 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.142 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4490.0:1499 4.23 4:c75fca82:::100000008d2.00000000:head [write 0~1003] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T22:33:00.142 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:32:59.997947+0000", 2024-09-12T22:33:00.142 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.038675058999999998, 2024-09-12T22:33:00.143 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0024489920000000001, 2024-09-12T22:33:00.143 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:00.143 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:00.143 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:00.143 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:33:00.143 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4490", 2024-09-12T22:33:00.143 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:00.143 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 1499 2024-09-12T22:33:00.143 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.143 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:00.143 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.143 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:00.143 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:59.997947+0000", 2024-09-12T22:33:00.143 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:00.144 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.144 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.144 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:00.144 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:59.997947+0000", 2024-09-12T22:33:00.144 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:00.144 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.144 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.144 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:00.144 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:59.997948+0000", 2024-09-12T22:33:00.144 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7000000000000004e-07 2024-09-12T22:33:00.144 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.144 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.144 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:00.145 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:59.997951+0000", 2024-09-12T22:33:00.145 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7160000000000001e-06 2024-09-12T22:33:00.145 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.145 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.145 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:00.145 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:59.997959+0000", 2024-09-12T22:33:00.145 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.9889999999999992e-06 2024-09-12T22:33:00.145 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.145 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.145 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:00.145 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:59.997964+0000", 2024-09-12T22:33:00.145 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4479999999999996e-06 2024-09-12T22:33:00.145 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.145 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.146 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:00.146 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:59.998004+0000", 2024-09-12T22:33:00.146 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0762e-05 2024-09-12T22:33:00.146 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.146 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.146 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:00.146 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:59.998085+0000", 2024-09-12T22:33:00.146 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0741999999999994e-05 2024-09-12T22:33:00.146 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.146 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.146 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:00.146 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:00.000306+0000", 2024-09-12T22:33:00.146 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.002220844 2024-09-12T22:33:00.146 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.147 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.147 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:00.147 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:00.000336+0000", 2024-09-12T22:33:00.147 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.9529000000000001e-05 2024-09-12T22:33:00.147 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:00.147 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:00.147 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:00.147 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:00.000396+0000", 2024-09-12T22:33:00.147 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0291999999999998e-05 2024-09-12T22:33:00.147 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:00.147 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:00.147 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:00.147 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:00.147 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:00.148 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:33:00.149 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:33:00.150 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:00.148+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:00.250 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:00.249+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:00.257 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-09-12T22:33:00.257 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2024-09-12T22:33:00.257 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.257 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4490.0:1748 4.18 4:1ab5d2a3:::100000009d4.00000000:head [write 0~2428 in=2428b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T22:33:00.257 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:00.256193+0000", 2024-09-12T22:33:00.258 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.00085161199999999996, 2024-09-12T22:33:00.258 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00086760199999999998, 2024-09-12T22:33:00.258 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:00.258 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:00.258 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:33:00.258 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:00.258 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4490", 2024-09-12T22:33:00.258 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:00.258 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 1748 2024-09-12T22:33:00.258 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.258 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:00.258 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.258 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:00.259 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:00.256193+0000", 2024-09-12T22:33:00.259 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:00.259 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.259 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.259 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:00.259 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:00.256193+0000", 2024-09-12T22:33:00.259 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:00.259 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.259 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.259 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:00.259 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:00.256194+0000", 2024-09-12T22:33:00.259 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.2500000000000005e-07 2024-09-12T22:33:00.259 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.260 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.260 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:00.260 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:00.256198+0000", 2024-09-12T22:33:00.260 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6399999999999999e-06 2024-09-12T22:33:00.260 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.260 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.260 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:00.260 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:00.256206+0000", 2024-09-12T22:33:00.260 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9319999999999996e-06 2024-09-12T22:33:00.260 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.260 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.260 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:00.260 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:00.256212+0000", 2024-09-12T22:33:00.260 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.3029999999999996e-06 2024-09-12T22:33:00.261 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.261 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.261 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:00.261 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:00.256250+0000", 2024-09-12T22:33:00.261 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7969000000000002e-05 2024-09-12T22:33:00.261 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.261 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.261 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:00.261 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:00.256323+0000", 2024-09-12T22:33:00.261 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2805000000000005e-05 2024-09-12T22:33:00.261 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.261 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.261 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:00.261 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:00.256395+0000", 2024-09-12T22:33:00.262 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2571999999999996e-05 2024-09-12T22:33:00.262 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.262 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.262 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:00.262 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:00.256851+0000", 2024-09-12T22:33:00.262 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000455885 2024-09-12T22:33:00.262 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.262 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.262 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:00.262 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:00.257039+0000", 2024-09-12T22:33:00.262 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000187751 2024-09-12T22:33:00.262 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.262 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.263 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:00.263 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:00.257070+0000", 2024-09-12T22:33:00.263 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0811e-05 2024-09-12T22:33:00.263 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:00.263 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:00.263 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:00.263 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.263 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.263 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_repop_reply(client.4490.0:1748 4.18 e50/18 ondisk, result = 0)", 2024-09-12T22:33:00.263 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:00.256977+0000", 2024-09-12T22:33:00.263 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 6.7750999999999996e-05, 2024-09-12T22:33:00.263 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000145864, 2024-09-12T22:33:00.263 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:00.263 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:00.264 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2024-09-12T22:33:00.264 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:00.264 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.264 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:00.264 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:00.256977+0000", 2024-09-12T22:33:00.264 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:00.264 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.264 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.264 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:00.264 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:00.256977+0000", 2024-09-12T22:33:00.264 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:00.264 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.264 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.265 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:00.265 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:00.256978+0000", 2024-09-12T22:33:00.265 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6899999999999998e-07 2024-09-12T22:33:00.265 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.265 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.265 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:00.265 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:00.256980+0000", 2024-09-12T22:33:00.265 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8200000000000001e-06 2024-09-12T22:33:00.265 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.265 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.265 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:00.265 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:00.256988+0000", 2024-09-12T22:33:00.266 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1690000000000003e-06 2024-09-12T22:33:00.266 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.266 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.266 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:00.266 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:00.256993+0000", 2024-09-12T22:33:00.266 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3090000000000003e-06 2024-09-12T22:33:00.266 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.266 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.266 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:00.266 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:00.257031+0000", 2024-09-12T22:33:00.266 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7580999999999998e-05 2024-09-12T22:33:00.266 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.266 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.267 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:00.267 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:00.257036+0000", 2024-09-12T22:33:00.267 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1189999999999996e-06 2024-09-12T22:33:00.267 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.267 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.267 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:00.267 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:00.257124+0000", 2024-09-12T22:33:00.267 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8453000000000002e-05 2024-09-12T22:33:00.267 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:00.267 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:00.267 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:00.267 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.267 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.267 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4490.0:1749 4.2 4.40c78402 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T22:33:00.268 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:00.257101+0000", 2024-09-12T22:33:00.268 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 4294967295.9999442, 2024-09-12T22:33:00.268 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2341000000000004e-05, 2024-09-12T22:33:00.268 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:00.268 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:00.268 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "reached pg", 2024-09-12T22:33:00.268 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:00.268 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4490", 2024-09-12T22:33:00.268 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:00.268 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 1749 2024-09-12T22:33:00.268 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.268 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:00.268 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.268 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:00.269 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:00.257101+0000", 2024-09-12T22:33:00.269 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:00.269 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.269 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.269 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:00.269 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:00.257101+0000", 2024-09-12T22:33:00.269 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:00.269 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.269 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.269 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:00.269 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:00.257101+0000", 2024-09-12T22:33:00.269 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7000000000000005e-07 2024-09-12T22:33:00.269 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.270 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.270 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:00.270 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:00.257105+0000", 2024-09-12T22:33:00.270 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4599999999999999e-06 2024-09-12T22:33:00.270 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.270 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.270 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:00.270 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:00.257112+0000", 2024-09-12T22:33:00.270 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5820000000000004e-06 2024-09-12T22:33:00.270 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.270 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.270 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:00.270 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:00.257119+0000", 2024-09-12T22:33:00.270 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.2570000000000004e-06 2024-09-12T22:33:00.271 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.271 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.271 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:00.271 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:00.257161+0000", 2024-09-12T22:33:00.271 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2858999999999997e-05 2024-09-12T22:33:00.271 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:00.271 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:00.271 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:00.271 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:00.271 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2024-09-12T22:33:00.271 INFO:teuthology.orchestra.run.smithi163.stdout: "num_ops": 3 2024-09-12T22:33:00.271 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-09-12T22:33:00.272 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:33:00.350 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:00.349+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:00.392 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-09-12T22:33:00.392 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-09-12T22:33:00.392 INFO:teuthology.orchestra.run.smithi163.stdout: "complaint_time": 30, 2024-09-12T22:33:00.392 INFO:teuthology.orchestra.run.smithi163.stdout: "num_blocked_ops": 0 2024-09-12T22:33:00.392 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-09-12T22:33:00.401 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:33:00.451 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:00.450+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:00.513 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-09-12T22:33:00.514 INFO:teuthology.orchestra.run.smithi163.stdout: "size": 20, 2024-09-12T22:33:00.514 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 600, 2024-09-12T22:33:00.514 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2024-09-12T22:33:00.514 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.514 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-09-12T22:33:00.514 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:27.254459+0000", 2024-09-12T22:33:00.514 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 93.256824846000001, 2024-09-12T22:33:00.514 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.37816283899999997, 2024-09-12T22:33:00.514 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:00.514 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:00.514 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:00.514 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:00.514 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:33:00.515 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:33:00.515 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 1 2024-09-12T22:33:00.515 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.515 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:00.516 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.516 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:00.516 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254459+0000", 2024-09-12T22:33:00.516 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:00.516 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.517 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.517 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:00.517 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254459+0000", 2024-09-12T22:33:00.517 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:00.517 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.517 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.517 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:00.517 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254460+0000", 2024-09-12T22:33:00.517 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1739999999999999e-06 2024-09-12T22:33:00.517 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.517 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.517 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:00.517 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254472+0000", 2024-09-12T22:33:00.518 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2207e-05 2024-09-12T22:33:00.518 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.518 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.518 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:00.518 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254483+0000", 2024-09-12T22:33:00.518 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0631999999999999e-05 2024-09-12T22:33:00.518 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.518 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.518 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:00.518 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254492+0000", 2024-09-12T22:33:00.519 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3670000000000003e-06 2024-09-12T22:33:00.519 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.519 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.519 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:00.519 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254551+0000", 2024-09-12T22:33:00.519 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8687999999999998e-05 2024-09-12T22:33:00.519 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.519 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.519 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for peered", 2024-09-12T22:33:00.519 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254562+0000", 2024-09-12T22:33:00.519 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1249e-05 2024-09-12T22:33:00.519 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.519 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.520 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:00.520 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.631211+0000", 2024-09-12T22:33:00.520 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.376649018 2024-09-12T22:33:00.520 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.520 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.520 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:00.520 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.631345+0000", 2024-09-12T22:33:00.520 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013378700000000001 2024-09-12T22:33:00.520 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.520 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.520 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:33:00.520 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.631479+0000", 2024-09-12T22:33:00.520 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013352399999999999 2024-09-12T22:33:00.521 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.521 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.521 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:00.521 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632324+0000", 2024-09-12T22:33:00.521 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00084508100000000002 2024-09-12T22:33:00.521 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.521 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.521 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:00.521 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632548+0000", 2024-09-12T22:33:00.521 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000224329 2024-09-12T22:33:00.521 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.521 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.521 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:00.521 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632591+0000", 2024-09-12T22:33:00.522 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2564000000000001e-05 2024-09-12T22:33:00.522 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.522 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.522 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:00.522 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632622+0000", 2024-09-12T22:33:00.522 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1219e-05 2024-09-12T22:33:00.522 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:00.522 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:00.522 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:00.522 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.522 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.522 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:185 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:33:00.522 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394355+0000", 2024-09-12T22:33:00.523 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 92.116928748999996, 2024-09-12T22:33:00.523 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011302394, 2024-09-12T22:33:00.523 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:00.523 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:00.523 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:00.523 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:00.523 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:33:00.523 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:33:00.523 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 185 2024-09-12T22:33:00.523 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.523 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:00.523 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.523 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:00.524 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394355+0000", 2024-09-12T22:33:00.524 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:00.524 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.524 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.524 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:00.524 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394355+0000", 2024-09-12T22:33:00.524 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:00.524 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.524 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.524 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:00.524 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394355+0000", 2024-09-12T22:33:00.524 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9099999999999999e-07 2024-09-12T22:33:00.524 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.524 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.525 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:00.525 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394385+0000", 2024-09-12T22:33:00.525 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9963000000000001e-05 2024-09-12T22:33:00.525 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.525 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.525 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:00.525 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394390+0000", 2024-09-12T22:33:00.525 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8420000000000004e-06 2024-09-12T22:33:00.525 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.525 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.525 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:00.525 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394393+0000", 2024-09-12T22:33:00.525 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1e-06 2024-09-12T22:33:00.525 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.526 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.526 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:00.526 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.400546+0000", 2024-09-12T22:33:00.526 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0061523309999999996 2024-09-12T22:33:00.526 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.526 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.526 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:00.526 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.400588+0000", 2024-09-12T22:33:00.526 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1835000000000002e-05 2024-09-12T22:33:00.526 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.526 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.526 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:33:00.526 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.400677+0000", 2024-09-12T22:33:00.526 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9195000000000002e-05 2024-09-12T22:33:00.527 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.527 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.527 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:00.527 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405378+0000", 2024-09-12T22:33:00.527 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0047008659999999997 2024-09-12T22:33:00.527 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.527 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.527 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:00.527 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405569+0000", 2024-09-12T22:33:00.527 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00019148599999999999 2024-09-12T22:33:00.527 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.527 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.527 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:00.527 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405620+0000", 2024-09-12T22:33:00.528 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1416999999999999e-05 2024-09-12T22:33:00.528 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.528 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.528 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:00.528 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405657+0000", 2024-09-12T22:33:00.528 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6968000000000002e-05 2024-09-12T22:33:00.528 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:00.529 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:00.529 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:00.529 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.529 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.529 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:33:00.529 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394399+0000", 2024-09-12T22:33:00.529 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 92.116884537999994, 2024-09-12T22:33:00.529 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011336601999999999, 2024-09-12T22:33:00.529 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:00.529 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:00.529 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:00.529 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:00.529 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:33:00.530 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:33:00.530 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 186 2024-09-12T22:33:00.530 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.530 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:00.530 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.530 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:00.530 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394399+0000", 2024-09-12T22:33:00.530 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:00.530 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.530 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.530 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:00.530 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394399+0000", 2024-09-12T22:33:00.530 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:00.531 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.531 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.531 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:00.531 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394400+0000", 2024-09-12T22:33:00.531 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4499999999999998e-07 2024-09-12T22:33:00.531 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.531 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.531 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:00.531 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394402+0000", 2024-09-12T22:33:00.531 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.875e-06 2024-09-12T22:33:00.531 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.531 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.531 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:00.531 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394405+0000", 2024-09-12T22:33:00.532 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6799999999999999e-06 2024-09-12T22:33:00.532 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.532 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.532 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:00.532 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394408+0000", 2024-09-12T22:33:00.532 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.667e-06 2024-09-12T22:33:00.532 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.532 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.532 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:00.532 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401395+0000", 2024-09-12T22:33:00.533 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0069867230000000002 2024-09-12T22:33:00.533 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.533 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.533 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:00.533 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401438+0000", 2024-09-12T22:33:00.533 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3554999999999999e-05 2024-09-12T22:33:00.533 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.533 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.533 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:33:00.533 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401509+0000", 2024-09-12T22:33:00.533 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0631999999999997e-05 2024-09-12T22:33:00.533 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.533 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.534 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:00.534 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405392+0000", 2024-09-12T22:33:00.534 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0038830449999999999 2024-09-12T22:33:00.534 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.534 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.534 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:00.534 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405690+0000", 2024-09-12T22:33:00.534 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000298435 2024-09-12T22:33:00.534 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.534 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.535 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:00.535 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405716+0000", 2024-09-12T22:33:00.535 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5435999999999998e-05 2024-09-12T22:33:00.535 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.535 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.535 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:00.535 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405736+0000", 2024-09-12T22:33:00.535 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0208999999999999e-05 2024-09-12T22:33:00.535 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:00.535 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:00.535 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:00.535 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.535 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.535 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:33:00.536 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394411+0000", 2024-09-12T22:33:00.536 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 92.116872412000006, 2024-09-12T22:33:00.536 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011400117, 2024-09-12T22:33:00.536 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:00.536 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:00.536 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:00.536 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:00.536 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:33:00.536 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:33:00.536 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 187 2024-09-12T22:33:00.536 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.536 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:00.536 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.537 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:00.537 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394411+0000", 2024-09-12T22:33:00.537 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:00.537 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.537 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.537 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:00.537 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394411+0000", 2024-09-12T22:33:00.537 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:00.537 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.537 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.537 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:00.537 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394412+0000", 2024-09-12T22:33:00.537 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.4999999999999999e-07 2024-09-12T22:33:00.537 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.538 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.538 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:00.538 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394414+0000", 2024-09-12T22:33:00.538 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.984e-06 2024-09-12T22:33:00.538 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.538 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.538 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:00.538 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394418+0000", 2024-09-12T22:33:00.538 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0840000000000002e-06 2024-09-12T22:33:00.538 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.538 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.539 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:00.539 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394431+0000", 2024-09-12T22:33:00.539 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.361e-05 2024-09-12T22:33:00.539 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.539 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.539 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:00.539 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401778+0000", 2024-09-12T22:33:00.539 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0073462659999999997 2024-09-12T22:33:00.539 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.539 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.539 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:00.539 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401853+0000", 2024-09-12T22:33:00.539 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5797000000000006e-05 2024-09-12T22:33:00.540 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.540 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.540 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:33:00.540 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401990+0000", 2024-09-12T22:33:00.540 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013651399999999999 2024-09-12T22:33:00.540 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.540 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.540 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:00.540 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405402+0000", 2024-09-12T22:33:00.540 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0034116070000000001 2024-09-12T22:33:00.540 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.540 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.540 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:00.541 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405764+0000", 2024-09-12T22:33:00.541 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00036234899999999998 2024-09-12T22:33:00.541 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.541 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.541 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:00.541 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405791+0000", 2024-09-12T22:33:00.541 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7029000000000002e-05 2024-09-12T22:33:00.541 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.541 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.541 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:00.541 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405812+0000", 2024-09-12T22:33:00.541 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0627000000000001e-05 2024-09-12T22:33:00.541 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:00.542 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:00.542 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:00.542 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.542 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.542 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:33:00.542 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394447+0000", 2024-09-12T22:33:00.542 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 92.116837261000001, 2024-09-12T22:33:00.542 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011759588, 2024-09-12T22:33:00.542 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:00.542 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:00.542 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:00.542 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:00.542 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:33:00.543 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:33:00.543 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 188 2024-09-12T22:33:00.543 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.543 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:00.543 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.543 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:00.543 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394447+0000", 2024-09-12T22:33:00.543 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:00.543 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.543 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.543 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:00.543 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394447+0000", 2024-09-12T22:33:00.543 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:00.544 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.544 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.544 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:00.544 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394447+0000", 2024-09-12T22:33:00.544 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.15e-07 2024-09-12T22:33:00.544 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.544 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.544 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:00.544 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394512+0000", 2024-09-12T22:33:00.544 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4580999999999997e-05 2024-09-12T22:33:00.544 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.544 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.544 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:00.545 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394518+0000", 2024-09-12T22:33:00.545 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.3380000000000001e-06 2024-09-12T22:33:00.545 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.545 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.545 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:00.545 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394521+0000", 2024-09-12T22:33:00.545 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3340000000000002e-06 2024-09-12T22:33:00.545 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.545 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.545 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:00.545 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.402628+0000", 2024-09-12T22:33:00.545 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.008106996 2024-09-12T22:33:00.545 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.546 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.546 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:00.546 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.402670+0000", 2024-09-12T22:33:00.546 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1983000000000001e-05 2024-09-12T22:33:00.546 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.546 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.546 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:33:00.546 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.402738+0000", 2024-09-12T22:33:00.546 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.8114999999999994e-05 2024-09-12T22:33:00.546 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.546 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.546 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:00.546 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405668+0000", 2024-09-12T22:33:00.547 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.002929545 2024-09-12T22:33:00.547 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.547 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.547 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:00.547 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406162+0000", 2024-09-12T22:33:00.547 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000494408 2024-09-12T22:33:00.547 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.547 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.547 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:00.547 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406188+0000", 2024-09-12T22:33:00.547 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5766e-05 2024-09-12T22:33:00.547 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.547 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.547 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:00.548 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406206+0000", 2024-09-12T22:33:00.548 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.8107000000000001e-05 2024-09-12T22:33:00.548 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:00.548 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:00.548 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:00.548 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.548 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.548 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:33:00.548 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394528+0000", 2024-09-12T22:33:00.548 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 92.116755592000004, 2024-09-12T22:33:00.548 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.01195536, 2024-09-12T22:33:00.548 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:00.548 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:00.549 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:00.549 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:00.549 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:33:00.549 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:33:00.549 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 189 2024-09-12T22:33:00.549 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.549 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:00.549 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.549 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:00.549 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394528+0000", 2024-09-12T22:33:00.549 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:00.549 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.549 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.550 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:00.550 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394528+0000", 2024-09-12T22:33:00.550 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:00.550 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.550 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.550 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:00.550 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394529+0000", 2024-09-12T22:33:00.550 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4900000000000001e-07 2024-09-12T22:33:00.550 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.550 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.550 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:00.550 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394531+0000", 2024-09-12T22:33:00.550 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.458e-06 2024-09-12T22:33:00.550 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.551 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.551 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:00.551 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394535+0000", 2024-09-12T22:33:00.551 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7900000000000001e-06 2024-09-12T22:33:00.551 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.551 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.551 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:00.551 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394537+0000", 2024-09-12T22:33:00.551 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.632e-06 2024-09-12T22:33:00.551 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.551 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.551 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:00.551 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.404932+0000", 2024-09-12T22:33:00.552 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010394158000000001 2024-09-12T22:33:00.552 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.552 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.552 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:00.552 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405017+0000", 2024-09-12T22:33:00.552 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5525000000000005e-05 2024-09-12T22:33:00.552 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.552 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.552 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:33:00.552 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405114+0000", 2024-09-12T22:33:00.552 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.6527000000000006e-05 2024-09-12T22:33:00.552 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.552 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.553 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:00.553 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405818+0000", 2024-09-12T22:33:00.553 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00070412800000000005 2024-09-12T22:33:00.553 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.553 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.553 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:00.553 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406437+0000", 2024-09-12T22:33:00.553 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00061898900000000002 2024-09-12T22:33:00.553 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.553 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.553 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:00.553 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406463+0000", 2024-09-12T22:33:00.553 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6268e-05 2024-09-12T22:33:00.553 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.554 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.554 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:00.554 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406484+0000", 2024-09-12T22:33:00.554 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0536000000000001e-05 2024-09-12T22:33:00.554 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:00.554 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:00.554 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:00.554 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.554 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.554 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:33:00.554 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.401422+0000", 2024-09-12T22:33:00.554 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 83.109861687000006, 2024-09-12T22:33:00.554 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016896452999999999, 2024-09-12T22:33:00.555 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:00.555 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:00.555 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:00.555 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:00.555 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.555 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:00.555 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401422+0000", 2024-09-12T22:33:00.555 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:00.555 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.555 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.555 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:00.555 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401422+0000", 2024-09-12T22:33:00.555 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:00.555 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.556 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.556 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:00.556 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401424+0000", 2024-09-12T22:33:00.556 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9e-06 2024-09-12T22:33:00.556 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.556 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.556 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:00.556 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401437+0000", 2024-09-12T22:33:00.556 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2831e-05 2024-09-12T22:33:00.556 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.556 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.556 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:00.556 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401471+0000", 2024-09-12T22:33:00.557 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4010000000000001e-05 2024-09-12T22:33:00.557 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.557 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.557 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:00.557 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401484+0000", 2024-09-12T22:33:00.557 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2711000000000001e-05 2024-09-12T22:33:00.557 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.557 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.557 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:00.557 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405410+0000", 2024-09-12T22:33:00.557 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0039259170000000001 2024-09-12T22:33:00.557 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.557 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.557 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:00.558 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405529+0000", 2024-09-12T22:33:00.558 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000119778 2024-09-12T22:33:00.558 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.558 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.558 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:33:00.558 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405655+0000", 2024-09-12T22:33:00.558 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012556700000000001 2024-09-12T22:33:00.558 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.558 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.558 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:00.558 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410456+0000", 2024-09-12T22:33:00.558 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0048008269999999997 2024-09-12T22:33:00.558 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.558 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.559 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:00.559 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418226+0000", 2024-09-12T22:33:00.559 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0077707729999999999 2024-09-12T22:33:00.559 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.559 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.559 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:00.559 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418277+0000", 2024-09-12T22:33:00.559 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0476000000000003e-05 2024-09-12T22:33:00.559 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.559 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.559 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:00.559 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418319+0000", 2024-09-12T22:33:00.560 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1662999999999997e-05 2024-09-12T22:33:00.560 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:00.560 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:00.560 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:00.560 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.560 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.560 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:33:00.560 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.401505+0000", 2024-09-12T22:33:00.560 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 83.109779023000002, 2024-09-12T22:33:00.560 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016987904000000002, 2024-09-12T22:33:00.560 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:00.560 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:00.560 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:00.561 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:00.561 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.561 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:00.561 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401505+0000", 2024-09-12T22:33:00.561 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:00.561 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.561 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.561 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:00.561 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401505+0000", 2024-09-12T22:33:00.561 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:00.561 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.561 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.561 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:00.561 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401506+0000", 2024-09-12T22:33:00.562 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4700000000000001e-07 2024-09-12T22:33:00.562 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.562 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.562 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:00.562 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401510+0000", 2024-09-12T22:33:00.562 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6609999999999999e-06 2024-09-12T22:33:00.562 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.562 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.562 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:00.562 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401771+0000", 2024-09-12T22:33:00.562 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00026110700000000001 2024-09-12T22:33:00.562 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.562 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.563 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:00.563 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401921+0000", 2024-09-12T22:33:00.563 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014939099999999999 2024-09-12T22:33:00.563 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.563 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.563 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:00.563 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405944+0000", 2024-09-12T22:33:00.563 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0040235449999999999 2024-09-12T22:33:00.563 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.563 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.563 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:00.563 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406018+0000", 2024-09-12T22:33:00.563 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3373000000000004e-05 2024-09-12T22:33:00.564 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.564 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.564 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:33:00.564 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406172+0000", 2024-09-12T22:33:00.564 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00015435399999999999 2024-09-12T22:33:00.564 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.564 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.564 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:00.564 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410461+0000", 2024-09-12T22:33:00.564 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0042888609999999997 2024-09-12T22:33:00.564 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.564 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.564 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:00.564 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418371+0000", 2024-09-12T22:33:00.565 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0079098380000000006 2024-09-12T22:33:00.565 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.565 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.565 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:00.565 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418443+0000", 2024-09-12T22:33:00.565 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2705000000000003e-05 2024-09-12T22:33:00.565 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.565 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.565 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:00.565 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418493+0000", 2024-09-12T22:33:00.565 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9322e-05 2024-09-12T22:33:00.565 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:00.565 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:00.566 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:00.566 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.566 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.566 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:33:00.566 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.401939+0000", 2024-09-12T22:33:00.566 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 83.109345286999996, 2024-09-12T22:33:00.566 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016722292999999999, 2024-09-12T22:33:00.566 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:00.566 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:00.566 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:00.566 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:00.566 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.567 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:00.567 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401939+0000", 2024-09-12T22:33:00.567 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:00.567 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.567 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.567 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:00.567 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401939+0000", 2024-09-12T22:33:00.567 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:00.567 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.567 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.567 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:00.567 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401940+0000", 2024-09-12T22:33:00.567 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1990000000000001e-06 2024-09-12T22:33:00.568 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.568 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.568 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:00.568 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401956+0000", 2024-09-12T22:33:00.568 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.6344000000000001e-05 2024-09-12T22:33:00.568 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.568 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.568 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:00.568 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401974+0000", 2024-09-12T22:33:00.568 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7730000000000001e-05 2024-09-12T22:33:00.568 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.568 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.568 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:00.569 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401982+0000", 2024-09-12T22:33:00.569 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.7800000000000001e-06 2024-09-12T22:33:00.569 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.569 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.569 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:00.569 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406557+0000", 2024-09-12T22:33:00.569 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0045758489999999999 2024-09-12T22:33:00.569 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.569 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.569 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:00.569 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406697+0000", 2024-09-12T22:33:00.569 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013925100000000001 2024-09-12T22:33:00.569 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.569 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.570 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:33:00.570 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406830+0000", 2024-09-12T22:33:00.570 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013293499999999999 2024-09-12T22:33:00.570 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.570 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.570 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:00.570 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410465+0000", 2024-09-12T22:33:00.570 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0036352680000000001 2024-09-12T22:33:00.570 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.570 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.570 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:00.570 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418564+0000", 2024-09-12T22:33:00.570 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0080992140000000004 2024-09-12T22:33:00.570 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.571 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.571 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:00.571 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418621+0000", 2024-09-12T22:33:00.571 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7167999999999999e-05 2024-09-12T22:33:00.571 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.571 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.571 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:00.571 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418661+0000", 2024-09-12T22:33:00.571 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9555000000000003e-05 2024-09-12T22:33:00.571 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:00.571 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:00.571 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:00.571 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.572 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.572 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:33:00.572 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.401994+0000", 2024-09-12T22:33:00.572 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 83.109289415000006, 2024-09-12T22:33:00.572 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016804109000000001, 2024-09-12T22:33:00.572 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:00.572 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:00.572 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:00.572 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:00.572 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.572 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:00.572 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401994+0000", 2024-09-12T22:33:00.572 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:00.572 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.573 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.573 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:00.573 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401994+0000", 2024-09-12T22:33:00.573 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:00.573 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.573 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.573 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:00.573 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401995+0000", 2024-09-12T22:33:00.573 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.8899999999999998e-07 2024-09-12T22:33:00.573 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.573 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.573 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:00.573 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402000+0000", 2024-09-12T22:33:00.574 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.498e-06 2024-09-12T22:33:00.574 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.574 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.574 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:00.574 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402007+0000", 2024-09-12T22:33:00.574 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.554e-06 2024-09-12T22:33:00.574 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.574 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.574 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:00.574 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402046+0000", 2024-09-12T22:33:00.574 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9156000000000003e-05 2024-09-12T22:33:00.574 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.574 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.575 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:00.575 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407342+0000", 2024-09-12T22:33:00.575 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052957610000000004 2024-09-12T22:33:00.575 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.575 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.575 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:00.575 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407521+0000", 2024-09-12T22:33:00.575 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00017878100000000001 2024-09-12T22:33:00.575 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.575 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.575 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:33:00.575 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407641+0000", 2024-09-12T22:33:00.575 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012013 2024-09-12T22:33:00.575 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.576 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.576 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:00.576 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410472+0000", 2024-09-12T22:33:00.576 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.002830455 2024-09-12T22:33:00.576 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.576 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.576 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:00.576 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418714+0000", 2024-09-12T22:33:00.576 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0082422789999999999 2024-09-12T22:33:00.576 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.576 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.576 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:00.576 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418761+0000", 2024-09-12T22:33:00.577 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6956999999999998e-05 2024-09-12T22:33:00.577 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.577 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.577 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:00.577 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418799+0000", 2024-09-12T22:33:00.577 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7749000000000001e-05 2024-09-12T22:33:00.577 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:00.577 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:00.577 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:00.577 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.577 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.577 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:33:00.577 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.402060+0000", 2024-09-12T22:33:00.578 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 83.109223971000006, 2024-09-12T22:33:00.578 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016885686, 2024-09-12T22:33:00.578 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:00.578 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:00.578 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:00.578 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:00.578 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.578 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:00.578 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402060+0000", 2024-09-12T22:33:00.578 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:00.578 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.578 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.578 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:00.579 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402060+0000", 2024-09-12T22:33:00.579 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:00.579 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.579 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.579 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:00.579 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402061+0000", 2024-09-12T22:33:00.579 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4399999999999999e-07 2024-09-12T22:33:00.579 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.579 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.579 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:00.579 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402066+0000", 2024-09-12T22:33:00.579 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8649999999999998e-06 2024-09-12T22:33:00.579 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.579 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.580 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:00.580 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402146+0000", 2024-09-12T22:33:00.580 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9054000000000006e-05 2024-09-12T22:33:00.580 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.580 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.580 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:00.580 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402287+0000", 2024-09-12T22:33:00.580 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014108600000000001 2024-09-12T22:33:00.580 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.580 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.580 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:00.580 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408185+0000", 2024-09-12T22:33:00.580 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0058983919999999997 2024-09-12T22:33:00.581 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.581 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.581 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:00.581 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408299+0000", 2024-09-12T22:33:00.581 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114102 2024-09-12T22:33:00.581 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.581 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.581 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:33:00.581 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408420+0000", 2024-09-12T22:33:00.581 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000120492 2024-09-12T22:33:00.581 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.581 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.581 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:00.581 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410867+0000", 2024-09-12T22:33:00.582 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0024476430000000002 2024-09-12T22:33:00.582 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.582 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.582 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:00.582 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418851+0000", 2024-09-12T22:33:00.582 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0079841489999999994 2024-09-12T22:33:00.582 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.582 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.582 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:00.582 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418894+0000", 2024-09-12T22:33:00.582 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3090000000000002e-05 2024-09-12T22:33:00.582 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.582 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.583 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:00.583 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418946+0000", 2024-09-12T22:33:00.583 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1069000000000002e-05 2024-09-12T22:33:00.583 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:00.583 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:00.583 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:00.583 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.583 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.583 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:33:00.583 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.402375+0000", 2024-09-12T22:33:00.583 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 83.108908905999996, 2024-09-12T22:33:00.583 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016768531999999999, 2024-09-12T22:33:00.583 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:00.583 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:00.584 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:00.584 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:00.584 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.584 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:00.584 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402375+0000", 2024-09-12T22:33:00.584 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:00.584 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.584 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.584 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:00.584 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402375+0000", 2024-09-12T22:33:00.584 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:00.584 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.584 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.585 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:00.585 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402375+0000", 2024-09-12T22:33:00.585 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4099999999999999e-07 2024-09-12T22:33:00.585 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.585 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.585 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:00.585 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402379+0000", 2024-09-12T22:33:00.585 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9870000000000001e-06 2024-09-12T22:33:00.585 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.585 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.585 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:00.585 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402389+0000", 2024-09-12T22:33:00.585 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0000000000000001e-05 2024-09-12T22:33:00.585 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.586 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.586 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:00.586 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402401+0000", 2024-09-12T22:33:00.586 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.148e-05 2024-09-12T22:33:00.586 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.586 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.586 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:00.586 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409108+0000", 2024-09-12T22:33:00.586 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0067068429999999997 2024-09-12T22:33:00.586 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.586 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.586 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:00.586 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409189+0000", 2024-09-12T22:33:00.587 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0815999999999993e-05 2024-09-12T22:33:00.587 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.587 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.587 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:33:00.587 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409320+0000", 2024-09-12T22:33:00.587 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000131586 2024-09-12T22:33:00.587 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.587 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.587 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:00.587 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410872+0000", 2024-09-12T22:33:00.587 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0015521599999999999 2024-09-12T22:33:00.587 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.587 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.588 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:00.588 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419049+0000", 2024-09-12T22:33:00.588 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0081763719999999995 2024-09-12T22:33:00.588 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.588 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.588 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:00.588 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419107+0000", 2024-09-12T22:33:00.588 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7899000000000002e-05 2024-09-12T22:33:00.588 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.588 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.588 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:00.588 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419143+0000", 2024-09-12T22:33:00.589 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6847999999999997e-05 2024-09-12T22:33:00.589 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:00.589 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:00.589 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:00.589 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.589 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.589 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:33:00.589 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.402903+0000", 2024-09-12T22:33:00.589 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 83.108380494000002, 2024-09-12T22:33:00.589 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016378428, 2024-09-12T22:33:00.589 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:00.589 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:00.589 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:00.590 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:00.590 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.590 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:00.590 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402903+0000", 2024-09-12T22:33:00.590 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:00.590 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.590 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.590 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:00.590 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402903+0000", 2024-09-12T22:33:00.590 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:00.590 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.590 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.590 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:00.590 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402904+0000", 2024-09-12T22:33:00.591 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9500000000000001e-07 2024-09-12T22:33:00.591 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.591 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.591 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:00.591 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402944+0000", 2024-09-12T22:33:00.591 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0265000000000002e-05 2024-09-12T22:33:00.591 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.591 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.591 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:00.591 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402979+0000", 2024-09-12T22:33:00.591 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4378000000000002e-05 2024-09-12T22:33:00.591 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.592 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.592 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:00.592 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402987+0000", 2024-09-12T22:33:00.592 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3559999999999993e-06 2024-09-12T22:33:00.592 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.592 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.592 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:00.592 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409577+0000", 2024-09-12T22:33:00.592 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0065901709999999997 2024-09-12T22:33:00.592 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.592 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.592 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:00.592 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409653+0000", 2024-09-12T22:33:00.592 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5819e-05 2024-09-12T22:33:00.593 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.593 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.593 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:33:00.593 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409725+0000", 2024-09-12T22:33:00.593 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2200000000000007e-05 2024-09-12T22:33:00.593 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.593 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.593 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:00.593 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.411234+0000", 2024-09-12T22:33:00.593 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001508225 2024-09-12T22:33:00.593 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.593 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.593 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:00.594 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419212+0000", 2024-09-12T22:33:00.594 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0079783400000000004 2024-09-12T22:33:00.594 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.594 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.594 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:00.594 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419244+0000", 2024-09-12T22:33:00.594 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2384e-05 2024-09-12T22:33:00.594 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.594 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.594 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:00.594 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419282+0000", 2024-09-12T22:33:00.594 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7394999999999997e-05 2024-09-12T22:33:00.594 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:00.594 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:00.595 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:00.595 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.595 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.595 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:33:00.595 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.403135+0000", 2024-09-12T22:33:00.595 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 83.108148623999995, 2024-09-12T22:33:00.595 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016294211999999999, 2024-09-12T22:33:00.595 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:00.595 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:00.595 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:00.595 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:00.595 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.595 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:00.595 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403135+0000", 2024-09-12T22:33:00.596 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:00.596 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.596 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.596 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:00.596 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403135+0000", 2024-09-12T22:33:00.596 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:00.596 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.596 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.596 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:00.596 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403136+0000", 2024-09-12T22:33:00.596 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.4e-07 2024-09-12T22:33:00.596 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.596 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.597 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:00.597 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403149+0000", 2024-09-12T22:33:00.597 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2723e-05 2024-09-12T22:33:00.597 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.597 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.597 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:00.597 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403158+0000", 2024-09-12T22:33:00.597 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3919999999999992e-06 2024-09-12T22:33:00.597 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.597 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.597 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:00.597 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403166+0000", 2024-09-12T22:33:00.597 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.2309999999999996e-06 2024-09-12T22:33:00.597 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.598 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.598 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:00.598 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409944+0000", 2024-09-12T22:33:00.598 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0067775309999999998 2024-09-12T22:33:00.598 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.598 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.598 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:00.598 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410032+0000", 2024-09-12T22:33:00.598 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.7906999999999997e-05 2024-09-12T22:33:00.598 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.598 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.598 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:33:00.598 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410152+0000", 2024-09-12T22:33:00.599 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012037800000000001 2024-09-12T22:33:00.599 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.599 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.599 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:00.599 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.411945+0000", 2024-09-12T22:33:00.599 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0017931850000000001 2024-09-12T22:33:00.599 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.599 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.599 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:00.599 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419319+0000", 2024-09-12T22:33:00.599 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0073731780000000002 2024-09-12T22:33:00.599 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.599 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.599 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:00.600 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419376+0000", 2024-09-12T22:33:00.600 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7728e-05 2024-09-12T22:33:00.600 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.600 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.600 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:00.600 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419429+0000", 2024-09-12T22:33:00.600 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3019000000000002e-05 2024-09-12T22:33:00.600 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:00.600 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:00.600 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:00.600 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.600 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.600 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:33:00.601 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.403185+0000", 2024-09-12T22:33:00.601 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 83.108098742999999, 2024-09-12T22:33:00.601 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.014902164000000001, 2024-09-12T22:33:00.601 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:00.601 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:00.601 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:00.601 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:00.601 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.601 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:00.601 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403185+0000", 2024-09-12T22:33:00.601 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:00.601 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.601 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.602 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:00.602 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403185+0000", 2024-09-12T22:33:00.602 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:00.602 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.602 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.602 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:00.602 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403186+0000", 2024-09-12T22:33:00.602 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9400000000000005e-07 2024-09-12T22:33:00.602 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.602 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.602 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:00.602 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403191+0000", 2024-09-12T22:33:00.602 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6980000000000003e-06 2024-09-12T22:33:00.602 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.603 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.603 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:00.603 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403199+0000", 2024-09-12T22:33:00.603 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2520000000000002e-06 2024-09-12T22:33:00.603 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.603 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.603 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:00.603 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403205+0000", 2024-09-12T22:33:00.603 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.908e-06 2024-09-12T22:33:00.603 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.603 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.603 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:00.603 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403359+0000", 2024-09-12T22:33:00.604 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000154544 2024-09-12T22:33:00.604 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.604 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.604 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:00.604 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403528+0000", 2024-09-12T22:33:00.604 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000168455 2024-09-12T22:33:00.604 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.604 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.604 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:33:00.604 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403763+0000", 2024-09-12T22:33:00.604 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00023539599999999999 2024-09-12T22:33:00.604 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.604 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.604 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:00.605 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409378+0000", 2024-09-12T22:33:00.605 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056150000000000002 2024-09-12T22:33:00.605 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.605 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.605 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:00.605 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418012+0000", 2024-09-12T22:33:00.605 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0086339559999999999 2024-09-12T22:33:00.605 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.605 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.605 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:00.605 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418046+0000", 2024-09-12T22:33:00.605 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4267999999999998e-05 2024-09-12T22:33:00.605 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.606 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.606 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:00.606 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418087+0000", 2024-09-12T22:33:00.606 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0992999999999999e-05 2024-09-12T22:33:00.606 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:00.606 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:00.606 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:00.606 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.606 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.606 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:33:00.606 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.403273+0000", 2024-09-12T22:33:00.606 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 83.108010792000002, 2024-09-12T22:33:00.606 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.014934866, 2024-09-12T22:33:00.607 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:00.607 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:00.607 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:00.607 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:00.607 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.607 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:00.607 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403273+0000", 2024-09-12T22:33:00.607 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:00.607 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.607 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.607 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:00.607 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403273+0000", 2024-09-12T22:33:00.607 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:00.607 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.608 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.608 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:00.608 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403274+0000", 2024-09-12T22:33:00.608 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.297e-06 2024-09-12T22:33:00.608 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.608 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.608 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:00.608 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403282+0000", 2024-09-12T22:33:00.608 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6340000000000001e-06 2024-09-12T22:33:00.608 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.608 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.608 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:00.608 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403305+0000", 2024-09-12T22:33:00.609 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3149000000000001e-05 2024-09-12T22:33:00.609 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.609 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.609 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:00.609 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403320+0000", 2024-09-12T22:33:00.609 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4527e-05 2024-09-12T22:33:00.609 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.609 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.609 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:00.609 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.404928+0000", 2024-09-12T22:33:00.609 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001608459 2024-09-12T22:33:00.609 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.609 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.609 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:00.610 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405218+0000", 2024-09-12T22:33:00.610 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00028982900000000002 2024-09-12T22:33:00.610 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.610 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.610 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:33:00.610 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405829+0000", 2024-09-12T22:33:00.610 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00061127900000000005 2024-09-12T22:33:00.610 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.610 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.610 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:00.610 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409403+0000", 2024-09-12T22:33:00.610 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.003573597 2024-09-12T22:33:00.610 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.610 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.611 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:00.611 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418138+0000", 2024-09-12T22:33:00.611 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0087349969999999996 2024-09-12T22:33:00.611 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.611 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.611 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:00.611 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418178+0000", 2024-09-12T22:33:00.611 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0649999999999999e-05 2024-09-12T22:33:00.611 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.611 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.611 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:00.611 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418208+0000", 2024-09-12T22:33:00.611 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9448e-05 2024-09-12T22:33:00.611 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:00.612 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:00.612 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:00.612 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.612 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.612 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:33:00.612 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.405456+0000", 2024-09-12T22:33:00.612 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 83.105827646999998, 2024-09-12T22:33:00.612 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012888389, 2024-09-12T22:33:00.612 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:00.612 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:00.612 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:00.612 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:00.612 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.613 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:00.613 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405456+0000", 2024-09-12T22:33:00.613 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:00.613 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.613 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.613 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:00.613 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405456+0000", 2024-09-12T22:33:00.613 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:00.613 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.613 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.613 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:00.613 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405457+0000", 2024-09-12T22:33:00.613 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.6599999999999994e-07 2024-09-12T22:33:00.613 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.614 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.614 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:00.614 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405463+0000", 2024-09-12T22:33:00.614 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4739999999999996e-06 2024-09-12T22:33:00.614 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.614 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.614 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:00.614 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405474+0000", 2024-09-12T22:33:00.614 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1095e-05 2024-09-12T22:33:00.614 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.614 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.614 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:00.614 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405482+0000", 2024-09-12T22:33:00.615 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3610000000000001e-06 2024-09-12T22:33:00.615 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.615 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.615 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:00.615 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407051+0000", 2024-09-12T22:33:00.615 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0015688970000000001 2024-09-12T22:33:00.615 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.615 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.615 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:00.615 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407259+0000", 2024-09-12T22:33:00.615 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00020778300000000001 2024-09-12T22:33:00.615 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.615 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.615 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:33:00.616 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407622+0000", 2024-09-12T22:33:00.616 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000363066 2024-09-12T22:33:00.616 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.616 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.616 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:00.616 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409438+0000", 2024-09-12T22:33:00.616 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001816319 2024-09-12T22:33:00.616 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.616 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.616 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:00.616 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418257+0000", 2024-09-12T22:33:00.616 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0088187720000000008 2024-09-12T22:33:00.617 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.617 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.617 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:00.617 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418308+0000", 2024-09-12T22:33:00.617 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1180000000000001e-05 2024-09-12T22:33:00.617 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.617 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.617 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:00.618 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418345+0000", 2024-09-12T22:33:00.618 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6476000000000001e-05 2024-09-12T22:33:00.618 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:00.618 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:00.618 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:00.618 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.618 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.618 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:33:00.618 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.405496+0000", 2024-09-12T22:33:00.618 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 83.105788290000007, 2024-09-12T22:33:00.619 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013016012, 2024-09-12T22:33:00.619 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:00.619 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:00.619 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:00.619 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:00.619 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.619 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:00.619 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405496+0000", 2024-09-12T22:33:00.619 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:00.619 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.619 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.620 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:00.620 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405496+0000", 2024-09-12T22:33:00.620 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:00.620 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.620 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.620 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:00.620 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405496+0000", 2024-09-12T22:33:00.620 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7999999999999995e-07 2024-09-12T22:33:00.620 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.620 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.620 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:00.620 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405501+0000", 2024-09-12T22:33:00.621 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8359999999999999e-06 2024-09-12T22:33:00.621 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.621 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.621 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:00.621 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405514+0000", 2024-09-12T22:33:00.621 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2522e-05 2024-09-12T22:33:00.621 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.621 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.621 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:00.621 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405521+0000", 2024-09-12T22:33:00.621 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5020000000000003e-06 2024-09-12T22:33:00.621 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.621 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.622 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:00.622 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405575+0000", 2024-09-12T22:33:00.622 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4169999999999998e-05 2024-09-12T22:33:00.622 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.622 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.622 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:00.622 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405697+0000", 2024-09-12T22:33:00.622 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000121301 2024-09-12T22:33:00.622 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.622 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.622 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:33:00.622 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405829+0000", 2024-09-12T22:33:00.622 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000132662 2024-09-12T22:33:00.622 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.623 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.623 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:00.623 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409155+0000", 2024-09-12T22:33:00.623 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0033259050000000001 2024-09-12T22:33:00.623 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.623 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.623 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:00.623 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418425+0000", 2024-09-12T22:33:00.623 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0092696319999999999 2024-09-12T22:33:00.623 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.623 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.623 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:00.623 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418471+0000", 2024-09-12T22:33:00.623 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6213e-05 2024-09-12T22:33:00.624 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.624 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.624 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:00.624 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418512+0000", 2024-09-12T22:33:00.624 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0589000000000001e-05 2024-09-12T22:33:00.624 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:00.624 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:00.624 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:00.624 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.624 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.624 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:33:00.624 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.406108+0000", 2024-09-12T22:33:00.624 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 83.105175892999995, 2024-09-12T22:33:00.625 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012458175, 2024-09-12T22:33:00.625 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:00.625 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:00.625 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:00.625 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:00.625 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.625 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:00.625 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406108+0000", 2024-09-12T22:33:00.625 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:00.625 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.625 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.625 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:00.625 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406108+0000", 2024-09-12T22:33:00.626 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:00.626 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.626 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.626 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:00.626 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406109+0000", 2024-09-12T22:33:00.626 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9899999999999999e-07 2024-09-12T22:33:00.626 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.626 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.626 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:00.626 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406115+0000", 2024-09-12T22:33:00.626 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9030000000000001e-06 2024-09-12T22:33:00.626 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.626 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.626 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:00.627 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406141+0000", 2024-09-12T22:33:00.627 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5999e-05 2024-09-12T22:33:00.627 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.627 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.627 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:00.627 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406150+0000", 2024-09-12T22:33:00.627 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.6050000000000004e-06 2024-09-12T22:33:00.627 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.627 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.627 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:00.627 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408163+0000", 2024-09-12T22:33:00.627 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0020122769999999998 2024-09-12T22:33:00.627 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.627 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.628 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:00.628 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408309+0000", 2024-09-12T22:33:00.628 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014606999999999999 2024-09-12T22:33:00.628 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.628 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.628 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:33:00.628 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408433+0000", 2024-09-12T22:33:00.628 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012460300000000001 2024-09-12T22:33:00.628 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.628 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.628 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:00.628 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409903+0000", 2024-09-12T22:33:00.628 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001469499 2024-09-12T22:33:00.629 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.629 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.629 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:00.629 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418427+0000", 2024-09-12T22:33:00.629 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0085241139999999993 2024-09-12T22:33:00.629 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.629 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.629 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:00.629 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418471+0000", 2024-09-12T22:33:00.629 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4474000000000001e-05 2024-09-12T22:33:00.629 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.629 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.629 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:00.629 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418566+0000", 2024-09-12T22:33:00.630 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.4732e-05 2024-09-12T22:33:00.630 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:00.630 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:00.630 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:00.630 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.630 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.630 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:33:00.630 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.407266+0000", 2024-09-12T22:33:00.630 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 83.104018037000003, 2024-09-12T22:33:00.630 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011442905, 2024-09-12T22:33:00.630 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:00.630 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:00.630 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2024-09-12T22:33:00.631 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:00.631 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.631 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:00.631 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407266+0000", 2024-09-12T22:33:00.631 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:00.631 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.631 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.631 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:00.631 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407266+0000", 2024-09-12T22:33:00.631 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:00.631 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.631 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.631 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:00.631 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407266+0000", 2024-09-12T22:33:00.632 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7899999999999998e-07 2024-09-12T22:33:00.632 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.632 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.632 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:00.632 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407269+0000", 2024-09-12T22:33:00.632 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9210000000000001e-06 2024-09-12T22:33:00.632 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.632 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.632 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:00.632 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407331+0000", 2024-09-12T22:33:00.632 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1376000000000003e-05 2024-09-12T22:33:00.632 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.632 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.633 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:00.633 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407337+0000", 2024-09-12T22:33:00.633 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1929999999999998e-06 2024-09-12T22:33:00.633 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.633 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.633 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:00.633 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408974+0000", 2024-09-12T22:33:00.633 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0016367109999999999 2024-09-12T22:33:00.633 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.633 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.633 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:00.633 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409112+0000", 2024-09-12T22:33:00.633 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000137952 2024-09-12T22:33:00.633 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:00.634 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:00.634 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:00.634 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418709+0000", 2024-09-12T22:33:00.634 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0095971730000000005 2024-09-12T22:33:00.634 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:00.634 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:00.634 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:00.634 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:00.634 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:00.634 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-09-12T22:33:00.635 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:00.634+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:00.636 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:33:00.737 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:00.735+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:00.745 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:33:00.746 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:33:00.746 INFO:teuthology.orchestra.run.smithi148.stdout: "num_ops": 0 2024-09-12T22:33:00.746 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:33:00.755 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:33:00.839 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:00.838+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:00.903 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:33:00.904 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:33:00.904 INFO:teuthology.orchestra.run.smithi148.stdout: "complaint_time": 30, 2024-09-12T22:33:00.904 INFO:teuthology.orchestra.run.smithi148.stdout: "num_blocked_ops": 0 2024-09-12T22:33:00.904 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:33:00.913 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:33:00.954 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:00.953+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:01.039 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:01.038+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:01.070 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:33:01.070 INFO:teuthology.orchestra.run.smithi148.stdout: "size": 20, 2024-09-12T22:33:01.070 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 600, 2024-09-12T22:33:01.070 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [ 2024-09-12T22:33:01.070 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.070 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:33:01.070 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.400880+0000", 2024-09-12T22:33:01.070 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 83.667175170999997, 2024-09-12T22:33:01.070 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0095133660000000005, 2024-09-12T22:33:01.070 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:01.070 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:01.071 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:01.071 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:01.071 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.071 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:01.071 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400880+0000", 2024-09-12T22:33:01.071 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:01.071 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.071 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.071 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:01.071 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400880+0000", 2024-09-12T22:33:01.071 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:01.071 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.071 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.072 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:01.072 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400892+0000", 2024-09-12T22:33:01.072 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1941e-05 2024-09-12T22:33:01.072 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.072 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.072 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:01.072 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400900+0000", 2024-09-12T22:33:01.072 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0080000000000002e-06 2024-09-12T22:33:01.072 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.072 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.072 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:01.072 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400911+0000", 2024-09-12T22:33:01.072 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1452e-05 2024-09-12T22:33:01.073 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.073 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.073 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:01.073 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400922+0000", 2024-09-12T22:33:01.073 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0772e-05 2024-09-12T22:33:01.073 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.073 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.073 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:01.073 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401009+0000", 2024-09-12T22:33:01.073 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.7206000000000005e-05 2024-09-12T22:33:01.073 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.073 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.073 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:01.073 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401157+0000", 2024-09-12T22:33:01.074 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014831499999999999 2024-09-12T22:33:01.074 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.074 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.074 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:01.074 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401312+0000", 2024-09-12T22:33:01.074 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00015495600000000001 2024-09-12T22:33:01.074 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.074 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.074 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:01.074 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.403060+0000", 2024-09-12T22:33:01.074 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0017475220000000001 2024-09-12T22:33:01.074 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.074 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.074 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:01.075 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410300+0000", 2024-09-12T22:33:01.075 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0072403260000000001 2024-09-12T22:33:01.075 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.075 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.075 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:01.075 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410350+0000", 2024-09-12T22:33:01.075 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9814000000000001e-05 2024-09-12T22:33:01.075 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.075 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.075 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:01.075 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410393+0000", 2024-09-12T22:33:01.075 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3053999999999998e-05 2024-09-12T22:33:01.075 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:01.076 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:01.076 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:01.076 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.076 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.076 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:33:01.076 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.400952+0000", 2024-09-12T22:33:01.076 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 83.667103018999995, 2024-09-12T22:33:01.076 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0096045620000000005, 2024-09-12T22:33:01.076 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:01.076 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:01.076 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:01.076 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:01.076 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.076 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:01.077 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400952+0000", 2024-09-12T22:33:01.077 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:01.077 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.077 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.077 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:01.077 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400952+0000", 2024-09-12T22:33:01.077 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:01.077 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.077 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.077 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:01.077 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400953+0000", 2024-09-12T22:33:01.077 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.8000000000000005e-07 2024-09-12T22:33:01.077 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.078 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.078 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:01.078 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400957+0000", 2024-09-12T22:33:01.078 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.33e-06 2024-09-12T22:33:01.078 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.078 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.078 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:01.078 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400966+0000", 2024-09-12T22:33:01.078 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1989999999999995e-06 2024-09-12T22:33:01.078 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.078 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.078 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:01.078 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400973+0000", 2024-09-12T22:33:01.078 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2779999999999999e-06 2024-09-12T22:33:01.079 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.079 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.079 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:01.079 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401696+0000", 2024-09-12T22:33:01.079 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00072363500000000003 2024-09-12T22:33:01.079 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.079 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.079 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:01.079 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401788+0000", 2024-09-12T22:33:01.079 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1862999999999998e-05 2024-09-12T22:33:01.079 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.079 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.079 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:01.079 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401929+0000", 2024-09-12T22:33:01.080 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014096000000000001 2024-09-12T22:33:01.080 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.080 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.080 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:01.080 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.403542+0000", 2024-09-12T22:33:01.080 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001612963 2024-09-12T22:33:01.080 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.080 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.080 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:01.080 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410460+0000", 2024-09-12T22:33:01.080 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0069180500000000002 2024-09-12T22:33:01.080 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.080 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.081 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:01.081 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410515+0000", 2024-09-12T22:33:01.081 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5009000000000001e-05 2024-09-12T22:33:01.081 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.081 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.081 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:01.081 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410557+0000", 2024-09-12T22:33:01.081 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1495000000000002e-05 2024-09-12T22:33:01.081 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:01.081 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:01.081 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:01.081 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.081 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.082 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:33:01.082 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.400984+0000", 2024-09-12T22:33:01.082 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 83.667070523999996, 2024-09-12T22:33:01.082 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0073703950000000001, 2024-09-12T22:33:01.082 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:01.082 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:01.082 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:01.082 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:01.082 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.082 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:01.082 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400984+0000", 2024-09-12T22:33:01.082 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:01.082 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.082 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.083 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:01.083 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400984+0000", 2024-09-12T22:33:01.083 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:01.083 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.083 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.083 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:01.083 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400985+0000", 2024-09-12T22:33:01.083 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3200000000000005e-07 2024-09-12T22:33:01.083 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.083 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.083 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:01.083 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.400998+0000", 2024-09-12T22:33:01.083 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2726e-05 2024-09-12T22:33:01.083 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.083 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.084 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:01.084 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401006+0000", 2024-09-12T22:33:01.084 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.3110000000000006e-06 2024-09-12T22:33:01.084 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.084 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.084 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:01.084 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401022+0000", 2024-09-12T22:33:01.084 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6249e-05 2024-09-12T22:33:01.084 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.084 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.084 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:01.084 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401700+0000", 2024-09-12T22:33:01.084 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00067811100000000001 2024-09-12T22:33:01.085 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.085 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.085 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:01.085 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401839+0000", 2024-09-12T22:33:01.085 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013865399999999999 2024-09-12T22:33:01.085 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.085 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.085 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:33:01.085 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401962+0000", 2024-09-12T22:33:01.085 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000123266 2024-09-12T22:33:01.085 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.085 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.085 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:01.085 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.403589+0000", 2024-09-12T22:33:01.086 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001626932 2024-09-12T22:33:01.086 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.086 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.086 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:01.086 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.408274+0000", 2024-09-12T22:33:01.086 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0046848100000000002 2024-09-12T22:33:01.086 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.086 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.086 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:01.086 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.408324+0000", 2024-09-12T22:33:01.086 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9784000000000003e-05 2024-09-12T22:33:01.086 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.086 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.087 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:01.087 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.408355+0000", 2024-09-12T22:33:01.087 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.1019999999999998e-05 2024-09-12T22:33:01.087 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:01.087 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:01.087 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:01.087 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.087 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.087 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:33:01.087 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401034+0000", 2024-09-12T22:33:01.087 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 83.667021083999998, 2024-09-12T22:33:01.087 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011063051000000001, 2024-09-12T22:33:01.087 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:01.087 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:01.088 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:01.088 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:01.088 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.088 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:01.088 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401034+0000", 2024-09-12T22:33:01.088 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:01.088 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.088 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.088 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:01.088 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401034+0000", 2024-09-12T22:33:01.088 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:01.088 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.088 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.089 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:01.089 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401034+0000", 2024-09-12T22:33:01.089 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8899999999999999e-07 2024-09-12T22:33:01.089 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.089 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.089 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:01.089 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401038+0000", 2024-09-12T22:33:01.089 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.523e-06 2024-09-12T22:33:01.089 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.089 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.089 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:01.089 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401046+0000", 2024-09-12T22:33:01.089 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0479999999999999e-06 2024-09-12T22:33:01.090 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.090 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.090 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:01.090 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401051+0000", 2024-09-12T22:33:01.090 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2619999999999998e-06 2024-09-12T22:33:01.090 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.090 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.090 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:01.090 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402270+0000", 2024-09-12T22:33:01.090 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012182429999999999 2024-09-12T22:33:01.090 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.090 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.090 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:01.091 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402325+0000", 2024-09-12T22:33:01.091 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5526999999999999e-05 2024-09-12T22:33:01.091 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.091 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.091 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 0", 2024-09-12T22:33:01.091 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402403+0000", 2024-09-12T22:33:01.091 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.7559999999999996e-05 2024-09-12T22:33:01.091 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.091 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.091 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:01.091 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.403655+0000", 2024-09-12T22:33:01.091 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012521489999999999 2024-09-12T22:33:01.091 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.092 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.092 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:01.092 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411979+0000", 2024-09-12T22:33:01.092 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0083240420000000002 2024-09-12T22:33:01.092 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.092 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.092 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:01.092 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.412036+0000", 2024-09-12T22:33:01.092 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7639000000000002e-05 2024-09-12T22:33:01.092 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.092 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.092 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:01.092 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.412097+0000", 2024-09-12T22:33:01.093 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0469e-05 2024-09-12T22:33:01.093 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:01.093 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:01.093 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:01.093 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.093 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.093 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:33:01.093 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401060+0000", 2024-09-12T22:33:01.093 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 83.666995331999999, 2024-09-12T22:33:01.093 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.010030172, 2024-09-12T22:33:01.094 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:01.094 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:01.094 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:01.094 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:01.094 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.094 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:01.094 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401060+0000", 2024-09-12T22:33:01.094 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:01.094 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.094 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.094 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:01.094 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401060+0000", 2024-09-12T22:33:01.094 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:01.094 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.095 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.095 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:01.095 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401060+0000", 2024-09-12T22:33:01.095 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2500000000000001e-07 2024-09-12T22:33:01.095 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.095 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.095 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:01.095 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401063+0000", 2024-09-12T22:33:01.095 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0910000000000001e-06 2024-09-12T22:33:01.095 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.095 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.095 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:01.095 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401070+0000", 2024-09-12T22:33:01.096 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1210000000000001e-06 2024-09-12T22:33:01.096 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.096 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.096 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:01.096 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401076+0000", 2024-09-12T22:33:01.096 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2830000000000001e-06 2024-09-12T22:33:01.096 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.096 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.096 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:01.096 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402288+0000", 2024-09-12T22:33:01.096 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012123699999999999 2024-09-12T22:33:01.096 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.096 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.096 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:01.097 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402359+0000", 2024-09-12T22:33:01.097 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.0988000000000005e-05 2024-09-12T22:33:01.097 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.097 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.097 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:01.097 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402457+0000", 2024-09-12T22:33:01.097 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.7857999999999997e-05 2024-09-12T22:33:01.097 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.097 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.097 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:01.097 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.404395+0000", 2024-09-12T22:33:01.097 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0019380160000000001 2024-09-12T22:33:01.098 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.098 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.098 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:01.098 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410603+0000", 2024-09-12T22:33:01.098 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.006208061 2024-09-12T22:33:01.098 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.098 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.098 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:01.098 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410687+0000", 2024-09-12T22:33:01.098 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.4623000000000006e-05 2024-09-12T22:33:01.098 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.098 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.098 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:01.099 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411090+0000", 2024-09-12T22:33:01.099 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00040233599999999999 2024-09-12T22:33:01.099 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:01.099 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:01.099 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:01.099 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.099 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.099 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:33:01.099 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401083+0000", 2024-09-12T22:33:01.099 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 83.666971915999994, 2024-09-12T22:33:01.099 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0097591850000000001, 2024-09-12T22:33:01.099 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:01.099 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:01.099 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:01.100 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:01.100 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.100 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:01.100 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401083+0000", 2024-09-12T22:33:01.100 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:01.100 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.100 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.100 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:01.100 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401083+0000", 2024-09-12T22:33:01.100 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:01.100 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.100 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.100 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:01.101 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401084+0000", 2024-09-12T22:33:01.101 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4799999999999999e-07 2024-09-12T22:33:01.101 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.101 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.101 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:01.101 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401088+0000", 2024-09-12T22:33:01.101 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6419999999999998e-06 2024-09-12T22:33:01.101 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.101 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.101 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:01.101 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401094+0000", 2024-09-12T22:33:01.101 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0090000000000004e-06 2024-09-12T22:33:01.101 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.101 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.102 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:01.102 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401108+0000", 2024-09-12T22:33:01.102 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3884e-05 2024-09-12T22:33:01.102 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.102 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.102 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:01.102 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401165+0000", 2024-09-12T22:33:01.102 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.6499000000000002e-05 2024-09-12T22:33:01.102 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.102 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.102 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:01.102 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401261+0000", 2024-09-12T22:33:01.102 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.6872000000000004e-05 2024-09-12T22:33:01.103 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.103 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.103 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:01.103 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401376+0000", 2024-09-12T22:33:01.103 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000114508 2024-09-12T22:33:01.103 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.103 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.103 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:01.103 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402666+0000", 2024-09-12T22:33:01.103 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012901659999999999 2024-09-12T22:33:01.103 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.103 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.103 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:01.103 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410572+0000", 2024-09-12T22:33:01.104 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0079055489999999996 2024-09-12T22:33:01.104 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.104 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.104 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:01.104 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410661+0000", 2024-09-12T22:33:01.104 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.9578000000000002e-05 2024-09-12T22:33:01.104 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.104 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.104 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:01.104 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410842+0000", 2024-09-12T22:33:01.104 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00018102999999999999 2024-09-12T22:33:01.104 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:01.104 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:01.105 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:01.105 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.105 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.105 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:33:01.105 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401122+0000", 2024-09-12T22:33:01.105 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 83.666932884000005, 2024-09-12T22:33:01.105 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0099122080000000005, 2024-09-12T22:33:01.105 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:01.105 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:01.105 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:33:01.105 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:01.105 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.105 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:01.105 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401122+0000", 2024-09-12T22:33:01.106 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:01.106 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.108 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.108 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:01.108 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401122+0000", 2024-09-12T22:33:01.108 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:01.108 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.108 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.108 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:01.108 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401123+0000", 2024-09-12T22:33:01.108 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2600000000000002e-07 2024-09-12T22:33:01.109 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.109 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.109 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:01.109 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401126+0000", 2024-09-12T22:33:01.109 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.6449999999999998e-06 2024-09-12T22:33:01.109 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.109 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.109 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:01.109 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401133+0000", 2024-09-12T22:33:01.109 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.9890000000000003e-06 2024-09-12T22:33:01.109 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.109 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.109 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:01.109 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401138+0000", 2024-09-12T22:33:01.110 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8060000000000002e-06 2024-09-12T22:33:01.110 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.110 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.110 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:01.110 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401703+0000", 2024-09-12T22:33:01.110 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00056509099999999999 2024-09-12T22:33:01.110 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.110 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.110 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:01.110 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401837+0000", 2024-09-12T22:33:01.110 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013338799999999999 2024-09-12T22:33:01.110 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.110 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.110 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:01.111 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411034+0000", 2024-09-12T22:33:01.111 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.009197663 2024-09-12T22:33:01.111 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:01.111 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:01.111 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:01.111 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.111 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.111 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:33:01.111 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401158+0000", 2024-09-12T22:33:01.111 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 83.666897105000004, 2024-09-12T22:33:01.111 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.010292437999999999, 2024-09-12T22:33:01.111 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:01.111 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:01.111 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:33:01.112 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:01.112 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.112 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:01.112 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401158+0000", 2024-09-12T22:33:01.112 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:01.112 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.112 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.112 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:01.112 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401158+0000", 2024-09-12T22:33:01.112 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:01.112 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.112 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.112 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:01.112 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401158+0000", 2024-09-12T22:33:01.113 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9699999999999996e-07 2024-09-12T22:33:01.113 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.113 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.113 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:01.113 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401161+0000", 2024-09-12T22:33:01.113 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.7410000000000001e-06 2024-09-12T22:33:01.113 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.113 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.113 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:01.113 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401168+0000", 2024-09-12T22:33:01.113 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.844e-06 2024-09-12T22:33:01.113 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.113 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.114 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:01.114 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401174+0000", 2024-09-12T22:33:01.114 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4700000000000001e-06 2024-09-12T22:33:01.114 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.114 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.114 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:01.114 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402799+0000", 2024-09-12T22:33:01.114 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0016256409999999999 2024-09-12T22:33:01.114 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.114 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.114 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:01.114 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.402893+0000", 2024-09-12T22:33:01.114 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.3807999999999994e-05 2024-09-12T22:33:01.114 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.115 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.115 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:01.115 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.411450+0000", 2024-09-12T22:33:01.115 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0085573369999999999 2024-09-12T22:33:01.115 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:01.115 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:01.115 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:01.115 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.115 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.115 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:33:01.115 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.401183+0000", 2024-09-12T22:33:01.115 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 83.666872252999994, 2024-09-12T22:33:01.115 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0068597830000000004, 2024-09-12T22:33:01.116 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:01.116 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:01.116 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:33:01.116 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:01.116 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.116 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:01.116 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401183+0000", 2024-09-12T22:33:01.116 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:01.116 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.116 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.116 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:01.116 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401183+0000", 2024-09-12T22:33:01.116 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:01.117 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.117 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.117 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:01.117 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401183+0000", 2024-09-12T22:33:01.117 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.6700000000000003e-07 2024-09-12T22:33:01.117 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.117 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.117 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:01.117 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401186+0000", 2024-09-12T22:33:01.117 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4679999999999999e-06 2024-09-12T22:33:01.117 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.117 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.117 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:01.118 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401192+0000", 2024-09-12T22:33:01.118 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.1519999999999997e-06 2024-09-12T22:33:01.118 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.118 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.118 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:01.118 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401197+0000", 2024-09-12T22:33:01.118 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4669999999999998e-06 2024-09-12T22:33:01.118 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.118 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.118 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:01.118 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401253+0000", 2024-09-12T22:33:01.118 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.6211000000000001e-05 2024-09-12T22:33:01.118 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.118 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.119 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:01.119 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.401413+0000", 2024-09-12T22:33:01.119 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00016021399999999999 2024-09-12T22:33:01.119 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.119 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.119 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:01.119 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.408043+0000", 2024-09-12T22:33:01.119 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0066295039999999996 2024-09-12T22:33:01.119 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:01.119 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:01.119 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:01.119 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.119 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.120 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:20 3.1c e19/17 3:3ed09add:::607.00000000:head v 19'1, mlcod=0'0)", 2024-09-12T22:33:01.120 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.409642+0000", 2024-09-12T22:33:01.120 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 83.658412794, 2024-09-12T22:33:01.120 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0038816269999999999, 2024-09-12T22:33:01.120 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:01.120 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:01.120 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:01.120 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:01.120 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.120 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:01.120 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409642+0000", 2024-09-12T22:33:01.120 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:01.120 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.121 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.121 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:01.121 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409642+0000", 2024-09-12T22:33:01.121 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:01.121 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.121 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.121 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:01.121 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409642+0000", 2024-09-12T22:33:01.121 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.6899999999999999e-07 2024-09-12T22:33:01.121 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.121 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.121 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:01.121 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409648+0000", 2024-09-12T22:33:01.121 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.49e-06 2024-09-12T22:33:01.122 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.122 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.122 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:01.122 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409656+0000", 2024-09-12T22:33:01.122 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.2949999999999994e-06 2024-09-12T22:33:01.122 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.122 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.122 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:01.122 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409664+0000", 2024-09-12T22:33:01.122 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.1219999999999995e-06 2024-09-12T22:33:01.122 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.122 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.122 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:01.123 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409707+0000", 2024-09-12T22:33:01.123 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2222000000000003e-05 2024-09-12T22:33:01.123 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.123 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.123 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:01.123 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409724+0000", 2024-09-12T22:33:01.123 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7496999999999999e-05 2024-09-12T22:33:01.123 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.123 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.123 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:01.123 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413439+0000", 2024-09-12T22:33:01.123 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00371448 2024-09-12T22:33:01.123 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.123 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.124 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:01.124 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413524+0000", 2024-09-12T22:33:01.124 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.5252000000000003e-05 2024-09-12T22:33:01.124 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:01.124 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:01.124 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:01.124 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.124 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.124 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:28 3.13 e19/17 3:cd5a64a3:::100.00000000:head v 19'1, mlcod=0'0)", 2024-09-12T22:33:01.124 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.409681+0000", 2024-09-12T22:33:01.124 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 83.658374311000003, 2024-09-12T22:33:01.124 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0038708710000000001, 2024-09-12T22:33:01.124 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:01.125 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:01.125 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:01.125 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:01.125 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.125 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:01.125 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409681+0000", 2024-09-12T22:33:01.125 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:01.125 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.125 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.125 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:01.125 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409681+0000", 2024-09-12T22:33:01.125 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:01.125 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.125 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.126 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:01.126 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409681+0000", 2024-09-12T22:33:01.126 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3000000000000002e-07 2024-09-12T22:33:01.126 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.126 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.126 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:01.126 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409695+0000", 2024-09-12T22:33:01.126 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4313e-05 2024-09-12T22:33:01.126 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.126 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.126 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:01.126 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409703+0000", 2024-09-12T22:33:01.126 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4000000000000003e-06 2024-09-12T22:33:01.126 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.127 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.127 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:01.127 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409708+0000", 2024-09-12T22:33:01.127 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3190000000000002e-06 2024-09-12T22:33:01.127 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.127 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.127 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:01.127 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409875+0000", 2024-09-12T22:33:01.127 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000167329 2024-09-12T22:33:01.127 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.127 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.127 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:01.127 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409892+0000", 2024-09-12T22:33:01.127 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6957999999999999e-05 2024-09-12T22:33:01.128 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.128 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.128 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:01.128 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413457+0000", 2024-09-12T22:33:01.128 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0035651279999999999 2024-09-12T22:33:01.128 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.128 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.128 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:01.128 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413552+0000", 2024-09-12T22:33:01.128 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.4093999999999997e-05 2024-09-12T22:33:01.128 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:01.128 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:01.128 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:01.129 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.129 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.129 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:21 3.1c e19/17 3:3ed09add:::607.00000000:head v 19'2, mlcod=0'0)", 2024-09-12T22:33:01.129 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.409718+0000", 2024-09-12T22:33:01.129 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 83.658336645999995, 2024-09-12T22:33:01.129 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003851883, 2024-09-12T22:33:01.129 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:01.129 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:01.129 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:01.129 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:01.129 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.129 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:01.129 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409718+0000", 2024-09-12T22:33:01.130 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:01.130 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.130 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.130 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:01.130 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409718+0000", 2024-09-12T22:33:01.130 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:01.130 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.130 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.130 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:01.130 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409719+0000", 2024-09-12T22:33:01.130 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.16e-07 2024-09-12T22:33:01.130 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.130 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.130 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:01.131 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409722+0000", 2024-09-12T22:33:01.131 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.692e-06 2024-09-12T22:33:01.131 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.131 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.131 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:01.131 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409729+0000", 2024-09-12T22:33:01.131 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.516e-06 2024-09-12T22:33:01.131 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.131 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.131 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:01.131 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409750+0000", 2024-09-12T22:33:01.131 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1151000000000001e-05 2024-09-12T22:33:01.131 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.131 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.132 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:01.132 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410015+0000", 2024-09-12T22:33:01.132 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00026477599999999999 2024-09-12T22:33:01.132 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.132 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.132 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:01.132 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410104+0000", 2024-09-12T22:33:01.132 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.9586000000000006e-05 2024-09-12T22:33:01.132 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.132 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.132 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:01.132 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413528+0000", 2024-09-12T22:33:01.132 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0034237880000000001 2024-09-12T22:33:01.132 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.133 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.133 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:01.133 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413570+0000", 2024-09-12T22:33:01.133 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2157999999999999e-05 2024-09-12T22:33:01.133 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:01.133 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:01.133 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:01.133 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.133 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.133 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(mds.0.3:27 3.13 e19/17 3:c91d4a1d:::mds0_inotable:head v 19'2, mlcod=0'0)", 2024-09-12T22:33:01.133 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.409760+0000", 2024-09-12T22:33:01.133 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 83.658295129999999, 2024-09-12T22:33:01.133 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0039301910000000004, 2024-09-12T22:33:01.134 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:01.134 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:01.134 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:01.134 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:01.134 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.134 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:01.134 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409760+0000", 2024-09-12T22:33:01.134 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:01.134 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.134 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.134 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:01.134 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409760+0000", 2024-09-12T22:33:01.134 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:01.134 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.135 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.135 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:01.135 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409760+0000", 2024-09-12T22:33:01.135 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.39e-07 2024-09-12T22:33:01.135 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.135 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.135 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:01.135 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409765+0000", 2024-09-12T22:33:01.135 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4449999999999998e-06 2024-09-12T22:33:01.135 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.135 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.135 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:01.135 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409771+0000", 2024-09-12T22:33:01.136 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7159999999999997e-06 2024-09-12T22:33:01.136 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.136 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.136 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:01.136 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.409778+0000", 2024-09-12T22:33:01.136 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.331e-06 2024-09-12T22:33:01.136 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.136 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.136 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:01.136 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410191+0000", 2024-09-12T22:33:01.136 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00041348300000000003 2024-09-12T22:33:01.136 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.136 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.137 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:01.137 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410211+0000", 2024-09-12T22:33:01.137 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9933999999999999e-05 2024-09-12T22:33:01.137 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.137 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.137 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:01.137 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413638+0000", 2024-09-12T22:33:01.137 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003426854 2024-09-12T22:33:01.137 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.137 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.137 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:01.137 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413690+0000", 2024-09-12T22:33:01.137 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2089000000000002e-05 2024-09-12T22:33:01.138 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:01.138 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:01.138 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:01.138 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.138 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.138 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "pg_update_log_missing(3.1a epoch 19/17 rep_tid 0 entries 19'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T22:33:01.138 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:31:37.410617+0000", 2024-09-12T22:33:01.138 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 83.657437874999999, 2024-09-12T22:33:01.138 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0030439709999999999, 2024-09-12T22:33:01.138 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:01.138 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:01.138 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "reached pg", 2024-09-12T22:33:01.138 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:01.139 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.139 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:01.139 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410617+0000", 2024-09-12T22:33:01.139 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:01.139 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.139 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.139 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:01.139 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410617+0000", 2024-09-12T22:33:01.139 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:01.139 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.139 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.139 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:01.139 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410617+0000", 2024-09-12T22:33:01.139 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3599999999999999e-07 2024-09-12T22:33:01.140 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.140 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.140 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:01.140 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410625+0000", 2024-09-12T22:33:01.140 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5410000000000003e-06 2024-09-12T22:33:01.140 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.140 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.140 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:01.140 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410638+0000", 2024-09-12T22:33:01.140 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3261999999999999e-05 2024-09-12T22:33:01.140 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.140 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.140 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:01.141 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410653+0000", 2024-09-12T22:33:01.141 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4844000000000001e-05 2024-09-12T22:33:01.141 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.141 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.141 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:01.141 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.410814+0000", 2024-09-12T22:33:01.141 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00016119999999999999 2024-09-12T22:33:01.141 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.141 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.141 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:01.141 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:31:37.413661+0000", 2024-09-12T22:33:01.141 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0028467879999999998 2024-09-12T22:33:01.141 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:01.141 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:01.142 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:01.142 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.142 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.142 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4490.0:1499 4.23 4:c75fca82:::100000008d2.00000000:head [write 0~1003] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T22:33:01.142 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:32:59.997947+0000", 2024-09-12T22:33:01.142 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 1.070108093, 2024-09-12T22:33:01.142 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0024489920000000001, 2024-09-12T22:33:01.142 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:01.142 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:01.142 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:01.142 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:33:01.142 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4490", 2024-09-12T22:33:01.142 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:01.143 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 1499 2024-09-12T22:33:01.143 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.143 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:01.143 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.143 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:01.143 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:59.997947+0000", 2024-09-12T22:33:01.143 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:01.143 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.143 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.144 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:01.144 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:59.997947+0000", 2024-09-12T22:33:01.144 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:01.144 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.144 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.144 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:01.144 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:59.997948+0000", 2024-09-12T22:33:01.144 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7000000000000004e-07 2024-09-12T22:33:01.144 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.144 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.144 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:01.144 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:59.997951+0000", 2024-09-12T22:33:01.145 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7160000000000001e-06 2024-09-12T22:33:01.145 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.145 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.145 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:01.145 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:59.997959+0000", 2024-09-12T22:33:01.145 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.9889999999999992e-06 2024-09-12T22:33:01.145 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.145 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.145 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:01.145 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:59.997964+0000", 2024-09-12T22:33:01.145 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4479999999999996e-06 2024-09-12T22:33:01.145 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.145 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.146 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:01.146 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:59.998004+0000", 2024-09-12T22:33:01.146 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0762e-05 2024-09-12T22:33:01.146 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.146 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.146 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:01.146 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:32:59.998085+0000", 2024-09-12T22:33:01.146 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0741999999999994e-05 2024-09-12T22:33:01.146 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.146 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.146 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:01.146 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:00.000306+0000", 2024-09-12T22:33:01.146 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.002220844 2024-09-12T22:33:01.147 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.147 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.147 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:01.147 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:00.000336+0000", 2024-09-12T22:33:01.147 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.9529000000000001e-05 2024-09-12T22:33:01.147 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.147 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.147 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:01.147 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:00.000396+0000", 2024-09-12T22:33:01.147 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0291999999999998e-05 2024-09-12T22:33:01.147 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:01.147 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:01.147 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:01.147 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.148 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.148 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4490.0:1568 4.b 4:d21fb823:::1000000091b.00000000:head [write 0~2556] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T22:33:01.148 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:00.065542+0000", 2024-09-12T22:33:01.148 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 1.0025132910000001, 2024-09-12T22:33:01.148 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001880458, 2024-09-12T22:33:01.148 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:01.148 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:01.148 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:01.148 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:33:01.148 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4490", 2024-09-12T22:33:01.148 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:01.148 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 1568 2024-09-12T22:33:01.148 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.149 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:01.149 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.149 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:01.149 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:00.065542+0000", 2024-09-12T22:33:01.149 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:01.149 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.149 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.149 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:01.149 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:00.065542+0000", 2024-09-12T22:33:01.149 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:01.149 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.149 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.149 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:01.149 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:00.065544+0000", 2024-09-12T22:33:01.150 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.17e-06 2024-09-12T22:33:01.150 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.150 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.150 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:01.150 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:00.065555+0000", 2024-09-12T22:33:01.150 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1199999999999999e-05 2024-09-12T22:33:01.150 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.150 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.150 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:01.150 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:00.065583+0000", 2024-09-12T22:33:01.150 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.756e-05 2024-09-12T22:33:01.150 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.150 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.150 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:01.151 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:00.065596+0000", 2024-09-12T22:33:01.151 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3145999999999999e-05 2024-09-12T22:33:01.151 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.151 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.151 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:01.151 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:00.065731+0000", 2024-09-12T22:33:01.151 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013477300000000001 2024-09-12T22:33:01.151 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.151 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.151 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:01.151 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:00.066003+0000", 2024-09-12T22:33:01.151 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00027213600000000003 2024-09-12T22:33:01.151 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.152 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.152 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:01.152 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:00.066134+0000", 2024-09-12T22:33:01.152 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000131013 2024-09-12T22:33:01.152 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.152 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.152 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:01.152 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:00.066665+0000", 2024-09-12T22:33:01.152 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00053141699999999996 2024-09-12T22:33:01.153 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.153 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.153 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:01.153 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:00.067341+0000", 2024-09-12T22:33:01.153 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00067593700000000004 2024-09-12T22:33:01.153 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.153 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.153 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:01.153 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:00.067387+0000", 2024-09-12T22:33:01.153 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5989000000000003e-05 2024-09-12T22:33:01.153 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.153 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.154 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:01.154 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:00.067422+0000", 2024-09-12T22:33:01.154 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.5117000000000003e-05 2024-09-12T22:33:01.154 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:01.154 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:01.154 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:01.154 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.154 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.154 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:59 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e50)", 2024-09-12T22:33:01.154 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:00.409388+0000", 2024-09-12T22:33:01.155 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.65866687599999996, 2024-09-12T22:33:01.155 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0064586130000000002, 2024-09-12T22:33:01.155 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:01.155 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:01.155 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:01.155 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:01.155 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.155 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:01.155 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:00.409388+0000", 2024-09-12T22:33:01.155 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:01.155 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.155 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.155 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:01.156 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:00.409388+0000", 2024-09-12T22:33:01.156 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:01.156 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.156 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.156 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:01.156 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:00.409389+0000", 2024-09-12T22:33:01.156 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5700000000000002e-07 2024-09-12T22:33:01.156 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.156 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.156 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:01.156 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:00.409526+0000", 2024-09-12T22:33:01.156 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013745599999999999 2024-09-12T22:33:01.156 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.156 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.157 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:01.157 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:00.409535+0000", 2024-09-12T22:33:01.157 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.2230000000000007e-06 2024-09-12T22:33:01.157 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.157 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.157 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:01.157 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:00.409539+0000", 2024-09-12T22:33:01.157 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.206e-06 2024-09-12T22:33:01.157 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.157 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.157 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:01.157 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:00.409580+0000", 2024-09-12T22:33:01.157 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0955999999999999e-05 2024-09-12T22:33:01.157 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.158 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.158 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:01.158 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:00.409658+0000", 2024-09-12T22:33:01.158 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.7837999999999996e-05 2024-09-12T22:33:01.158 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.158 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.158 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:01.158 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:00.413433+0000", 2024-09-12T22:33:01.158 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0037755000000000002 2024-09-12T22:33:01.158 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.158 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.158 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:01.158 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:00.415732+0000", 2024-09-12T22:33:01.158 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0022990100000000002 2024-09-12T22:33:01.159 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.159 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.159 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:01.159 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:00.415746+0000", 2024-09-12T22:33:01.159 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4323e-05 2024-09-12T22:33:01.159 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.159 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.159 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:01.159 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:00.415790+0000", 2024-09-12T22:33:01.159 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3924000000000002e-05 2024-09-12T22:33:01.159 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.159 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.159 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:01.160 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:00.415847+0000", 2024-09-12T22:33:01.160 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.6419999999999999e-05 2024-09-12T22:33:01.160 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:01.160 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:01.160 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:01.160 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.160 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.160 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4490.0:2158 4.16 4:69147533:::10000000ba1.00000000:head [write 0~91] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T22:33:01.160 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:00.671773+0000", 2024-09-12T22:33:01.160 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.39628159699999999, 2024-09-12T22:33:01.160 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0029524410000000001, 2024-09-12T22:33:01.160 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:01.160 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:01.161 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:01.161 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:33:01.161 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4490", 2024-09-12T22:33:01.161 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:01.161 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 2158 2024-09-12T22:33:01.161 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.161 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:01.161 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.161 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:01.161 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:00.671773+0000", 2024-09-12T22:33:01.161 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:01.161 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.161 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.161 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:01.162 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:00.671773+0000", 2024-09-12T22:33:01.162 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:01.162 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.162 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.162 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:01.162 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:00.671774+0000", 2024-09-12T22:33:01.162 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5400000000000001e-07 2024-09-12T22:33:01.162 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.162 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.162 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:01.162 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:00.671777+0000", 2024-09-12T22:33:01.162 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.5640000000000001e-06 2024-09-12T22:33:01.162 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.163 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.163 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:01.163 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:00.671786+0000", 2024-09-12T22:33:01.163 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.7180000000000002e-06 2024-09-12T22:33:01.163 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.163 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.163 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:01.163 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:00.671794+0000", 2024-09-12T22:33:01.163 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4719999999999998e-06 2024-09-12T22:33:01.163 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.163 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.163 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:01.163 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:00.671843+0000", 2024-09-12T22:33:01.163 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8964000000000001e-05 2024-09-12T22:33:01.164 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.164 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.164 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:01.164 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:00.671913+0000", 2024-09-12T22:33:01.164 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.0529000000000002e-05 2024-09-12T22:33:01.164 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.164 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.164 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:01.164 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:00.671987+0000", 2024-09-12T22:33:01.164 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4262000000000002e-05 2024-09-12T22:33:01.164 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.164 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.164 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:01.165 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:00.672807+0000", 2024-09-12T22:33:01.165 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00081973199999999999 2024-09-12T22:33:01.165 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.165 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.165 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:01.165 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:00.674666+0000", 2024-09-12T22:33:01.165 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0018593049999999999 2024-09-12T22:33:01.165 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.165 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.165 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:01.165 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:00.674703+0000", 2024-09-12T22:33:01.165 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.6764000000000002e-05 2024-09-12T22:33:01.165 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.166 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.166 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:01.166 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:00.674726+0000", 2024-09-12T22:33:01.166 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.2577000000000001e-05 2024-09-12T22:33:01.166 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:01.166 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:01.166 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:01.166 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.166 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.166 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4490.0:2360 4.1e 4:7a2ea0db:::10000000c90.00000000:head [write 0~1403] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T22:33:01.166 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:00.905079+0000", 2024-09-12T22:33:01.167 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.16297610400000001, 2024-09-12T22:33:01.167 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0027330449999999999, 2024-09-12T22:33:01.167 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:01.167 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:01.167 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:01.167 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:33:01.167 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4490", 2024-09-12T22:33:01.167 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:01.167 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 2360 2024-09-12T22:33:01.167 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.167 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:01.168 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.168 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:01.168 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:00.905079+0000", 2024-09-12T22:33:01.168 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:01.168 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.168 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.168 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:01.168 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:00.905079+0000", 2024-09-12T22:33:01.168 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:01.168 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.168 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.168 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:01.168 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:00.905080+0000", 2024-09-12T22:33:01.169 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.5099999999999998e-07 2024-09-12T22:33:01.169 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.169 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.169 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:01.169 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:00.905085+0000", 2024-09-12T22:33:01.169 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3070000000000002e-06 2024-09-12T22:33:01.169 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.169 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.169 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:01.169 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:00.905096+0000", 2024-09-12T22:33:01.170 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0711e-05 2024-09-12T22:33:01.170 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.170 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.170 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:01.170 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:00.905111+0000", 2024-09-12T22:33:01.170 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4891e-05 2024-09-12T22:33:01.170 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.170 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.170 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:01.170 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:00.905150+0000", 2024-09-12T22:33:01.170 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.8949999999999998e-05 2024-09-12T22:33:01.170 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.170 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.171 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:01.171 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:00.905224+0000", 2024-09-12T22:33:01.171 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4153999999999995e-05 2024-09-12T22:33:01.171 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.171 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.171 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:01.171 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:00.905298+0000", 2024-09-12T22:33:01.171 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3747999999999999e-05 2024-09-12T22:33:01.171 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.171 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.172 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:01.172 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:00.906533+0000", 2024-09-12T22:33:01.172 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0012354480000000001 2024-09-12T22:33:01.172 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.172 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.172 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:01.172 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:00.907715+0000", 2024-09-12T22:33:01.172 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001181657 2024-09-12T22:33:01.172 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.172 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.172 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:01.173 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:00.907767+0000", 2024-09-12T22:33:01.173 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2052999999999998e-05 2024-09-12T22:33:01.173 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.173 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.173 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:01.173 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:00.907812+0000", 2024-09-12T22:33:01.173 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5175e-05 2024-09-12T22:33:01.173 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:01.173 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:01.173 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:01.173 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.173 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.174 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(client.4490.0:2510 4.1b e50/18 4:dbbe0ad9:::10000000d27.00000000:head v 50'39, mlcod=50'37)", 2024-09-12T22:33:01.174 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:01.047131+0000", 2024-09-12T22:33:01.174 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.020924452, 2024-09-12T22:33:01.174 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0022404479999999999, 2024-09-12T22:33:01.174 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:01.174 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:01.174 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:01.174 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:01.174 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.174 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:01.174 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:01.047131+0000", 2024-09-12T22:33:01.174 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:01.174 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.174 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.175 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:01.175 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:01.047131+0000", 2024-09-12T22:33:01.175 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:01.175 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.175 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.175 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:01.175 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:01.047131+0000", 2024-09-12T22:33:01.175 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2799999999999996e-07 2024-09-12T22:33:01.175 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.175 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.175 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:01.175 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:01.047141+0000", 2024-09-12T22:33:01.175 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.8640000000000008e-06 2024-09-12T22:33:01.176 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.176 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.176 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:01.176 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:01.047151+0000", 2024-09-12T22:33:01.176 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.6430000000000007e-06 2024-09-12T22:33:01.176 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.176 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.176 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:01.176 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:01.047155+0000", 2024-09-12T22:33:01.176 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5619999999999997e-06 2024-09-12T22:33:01.176 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.176 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.176 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:01.176 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:01.047184+0000", 2024-09-12T22:33:01.177 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.9167e-05 2024-09-12T22:33:01.177 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.177 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.177 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:01.177 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:01.047197+0000", 2024-09-12T22:33:01.177 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3104e-05 2024-09-12T22:33:01.177 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.177 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.177 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:01.177 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:01.049343+0000", 2024-09-12T22:33:01.177 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0021453309999999999 2024-09-12T22:33:01.177 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.178 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.178 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:01.178 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:01.049371+0000", 2024-09-12T22:33:01.178 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8149000000000001e-05 2024-09-12T22:33:01.178 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:01.178 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:01.178 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:01.178 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:01.178 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:01.178 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:33:01.180 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:33:01.180 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:01.178+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:01.280 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:01.279+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:01.298 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-09-12T22:33:01.298 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-09-12T22:33:01.298 INFO:teuthology.orchestra.run.smithi163.stdout: "num_ops": 0 2024-09-12T22:33:01.298 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-09-12T22:33:01.308 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:33:01.393 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:01.391+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:01.459 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-09-12T22:33:01.459 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-09-12T22:33:01.460 INFO:teuthology.orchestra.run.smithi163.stdout: "complaint_time": 30, 2024-09-12T22:33:01.460 INFO:teuthology.orchestra.run.smithi163.stdout: "num_blocked_ops": 0 2024-09-12T22:33:01.460 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-09-12T22:33:01.469 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:33:01.482 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T22:33:01.483 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:01.481+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:01.584 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:01.582+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:01.618 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-09-12T22:33:01.618 INFO:teuthology.orchestra.run.smithi163.stdout: "size": 20, 2024-09-12T22:33:01.619 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 600, 2024-09-12T22:33:01.619 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2024-09-12T22:33:01.619 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.619 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-09-12T22:33:01.619 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:27.254459+0000", 2024-09-12T22:33:01.619 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 94.361597408999998, 2024-09-12T22:33:01.619 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.37816283899999997, 2024-09-12T22:33:01.619 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:01.619 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:01.619 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:01.619 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:01.619 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:33:01.620 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:33:01.620 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 1 2024-09-12T22:33:01.620 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.620 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:01.620 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.620 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:01.620 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254459+0000", 2024-09-12T22:33:01.620 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:01.620 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.620 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.620 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:01.620 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254459+0000", 2024-09-12T22:33:01.621 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:01.621 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.621 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.621 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:01.621 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254460+0000", 2024-09-12T22:33:01.621 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1739999999999999e-06 2024-09-12T22:33:01.621 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.621 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.622 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:01.622 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254472+0000", 2024-09-12T22:33:01.622 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2207e-05 2024-09-12T22:33:01.622 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.622 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.622 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:01.622 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254483+0000", 2024-09-12T22:33:01.622 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0631999999999999e-05 2024-09-12T22:33:01.622 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.623 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.623 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:01.623 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254492+0000", 2024-09-12T22:33:01.623 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3670000000000003e-06 2024-09-12T22:33:01.623 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.623 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.623 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:01.623 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254551+0000", 2024-09-12T22:33:01.623 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8687999999999998e-05 2024-09-12T22:33:01.623 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.623 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.623 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for peered", 2024-09-12T22:33:01.623 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254562+0000", 2024-09-12T22:33:01.624 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1249e-05 2024-09-12T22:33:01.624 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.624 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.624 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:01.624 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.631211+0000", 2024-09-12T22:33:01.624 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.376649018 2024-09-12T22:33:01.624 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.624 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.624 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:01.624 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.631345+0000", 2024-09-12T22:33:01.624 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013378700000000001 2024-09-12T22:33:01.624 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.624 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.625 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:33:01.625 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.631479+0000", 2024-09-12T22:33:01.625 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013352399999999999 2024-09-12T22:33:01.625 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.625 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.625 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:01.625 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632324+0000", 2024-09-12T22:33:01.625 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00084508100000000002 2024-09-12T22:33:01.625 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.625 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.625 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:01.625 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632548+0000", 2024-09-12T22:33:01.625 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000224329 2024-09-12T22:33:01.626 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.626 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.626 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:01.626 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632591+0000", 2024-09-12T22:33:01.626 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2564000000000001e-05 2024-09-12T22:33:01.626 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.626 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.626 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:01.626 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632622+0000", 2024-09-12T22:33:01.626 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1219e-05 2024-09-12T22:33:01.626 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:01.626 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:01.626 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:01.627 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.627 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.627 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:185 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:33:01.627 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394355+0000", 2024-09-12T22:33:01.627 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 93.221701311999993, 2024-09-12T22:33:01.627 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011302394, 2024-09-12T22:33:01.627 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:01.627 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:01.627 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:01.627 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:01.627 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:33:01.627 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:33:01.628 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 185 2024-09-12T22:33:01.628 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.628 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:01.628 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.628 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:01.628 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394355+0000", 2024-09-12T22:33:01.628 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:01.628 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.628 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.628 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:01.628 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394355+0000", 2024-09-12T22:33:01.628 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:01.629 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.629 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.629 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:01.629 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394355+0000", 2024-09-12T22:33:01.629 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9099999999999999e-07 2024-09-12T22:33:01.629 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.629 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.629 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:01.629 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394385+0000", 2024-09-12T22:33:01.629 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9963000000000001e-05 2024-09-12T22:33:01.629 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.629 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.629 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:01.629 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394390+0000", 2024-09-12T22:33:01.630 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8420000000000004e-06 2024-09-12T22:33:01.630 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.630 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.630 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:01.630 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394393+0000", 2024-09-12T22:33:01.630 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1e-06 2024-09-12T22:33:01.630 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.630 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.630 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:01.630 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.400546+0000", 2024-09-12T22:33:01.630 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0061523309999999996 2024-09-12T22:33:01.630 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.630 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.631 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:01.631 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.400588+0000", 2024-09-12T22:33:01.631 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1835000000000002e-05 2024-09-12T22:33:01.631 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.631 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.631 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:33:01.631 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.400677+0000", 2024-09-12T22:33:01.631 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9195000000000002e-05 2024-09-12T22:33:01.631 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.631 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.631 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:01.631 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405378+0000", 2024-09-12T22:33:01.631 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0047008659999999997 2024-09-12T22:33:01.632 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.632 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.632 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:01.632 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405569+0000", 2024-09-12T22:33:01.632 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00019148599999999999 2024-09-12T22:33:01.632 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.632 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.632 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:01.632 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405620+0000", 2024-09-12T22:33:01.632 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1416999999999999e-05 2024-09-12T22:33:01.632 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.632 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.632 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:01.633 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405657+0000", 2024-09-12T22:33:01.633 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6968000000000002e-05 2024-09-12T22:33:01.633 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:01.633 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:01.633 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:01.633 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.633 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.633 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:33:01.633 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394399+0000", 2024-09-12T22:33:01.633 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 93.221657101000005, 2024-09-12T22:33:01.633 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011336601999999999, 2024-09-12T22:33:01.633 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:01.633 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:01.634 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:01.634 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:01.634 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:33:01.634 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:33:01.634 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 186 2024-09-12T22:33:01.634 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.634 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:01.634 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.634 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:01.634 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394399+0000", 2024-09-12T22:33:01.634 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:01.634 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.634 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.634 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:01.635 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394399+0000", 2024-09-12T22:33:01.635 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:01.635 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.635 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.635 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:01.635 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394400+0000", 2024-09-12T22:33:01.635 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4499999999999998e-07 2024-09-12T22:33:01.635 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.635 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.635 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:01.635 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394402+0000", 2024-09-12T22:33:01.635 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.875e-06 2024-09-12T22:33:01.635 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.635 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.636 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:01.636 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394405+0000", 2024-09-12T22:33:01.636 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6799999999999999e-06 2024-09-12T22:33:01.636 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.636 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.636 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:01.636 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394408+0000", 2024-09-12T22:33:01.636 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.667e-06 2024-09-12T22:33:01.636 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.636 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.636 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:01.636 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401395+0000", 2024-09-12T22:33:01.636 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0069867230000000002 2024-09-12T22:33:01.637 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.637 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.637 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:01.637 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401438+0000", 2024-09-12T22:33:01.637 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3554999999999999e-05 2024-09-12T22:33:01.637 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.637 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.637 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:33:01.637 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401509+0000", 2024-09-12T22:33:01.637 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0631999999999997e-05 2024-09-12T22:33:01.637 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.637 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.637 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:01.638 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405392+0000", 2024-09-12T22:33:01.638 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0038830449999999999 2024-09-12T22:33:01.638 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.638 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.638 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:01.638 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405690+0000", 2024-09-12T22:33:01.638 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000298435 2024-09-12T22:33:01.638 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.638 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.638 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:01.638 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405716+0000", 2024-09-12T22:33:01.638 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5435999999999998e-05 2024-09-12T22:33:01.638 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.638 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.639 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:01.639 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405736+0000", 2024-09-12T22:33:01.639 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0208999999999999e-05 2024-09-12T22:33:01.639 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:01.639 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:01.639 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:01.639 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.639 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.639 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:33:01.639 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394411+0000", 2024-09-12T22:33:01.639 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 93.221644975000004, 2024-09-12T22:33:01.639 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011400117, 2024-09-12T22:33:01.639 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:01.639 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:01.640 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:01.640 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:01.640 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:33:01.640 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:33:01.640 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 187 2024-09-12T22:33:01.640 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.640 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:01.640 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.640 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:01.640 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394411+0000", 2024-09-12T22:33:01.640 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:01.640 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.640 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.641 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:01.641 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394411+0000", 2024-09-12T22:33:01.641 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:01.641 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.641 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.641 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:01.641 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394412+0000", 2024-09-12T22:33:01.641 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.4999999999999999e-07 2024-09-12T22:33:01.641 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.641 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.641 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:01.641 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394414+0000", 2024-09-12T22:33:01.641 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.984e-06 2024-09-12T22:33:01.642 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.642 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.642 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:01.642 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394418+0000", 2024-09-12T22:33:01.642 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0840000000000002e-06 2024-09-12T22:33:01.642 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.642 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.642 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:01.642 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394431+0000", 2024-09-12T22:33:01.642 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.361e-05 2024-09-12T22:33:01.642 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.642 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.642 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:01.642 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401778+0000", 2024-09-12T22:33:01.643 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0073462659999999997 2024-09-12T22:33:01.643 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.643 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.643 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:01.643 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401853+0000", 2024-09-12T22:33:01.643 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5797000000000006e-05 2024-09-12T22:33:01.643 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.643 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.643 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:33:01.643 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401990+0000", 2024-09-12T22:33:01.643 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013651399999999999 2024-09-12T22:33:01.643 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.643 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.643 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:01.644 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405402+0000", 2024-09-12T22:33:01.644 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0034116070000000001 2024-09-12T22:33:01.644 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.644 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.644 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:01.644 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405764+0000", 2024-09-12T22:33:01.644 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00036234899999999998 2024-09-12T22:33:01.644 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.644 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.644 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:01.644 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405791+0000", 2024-09-12T22:33:01.644 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7029000000000002e-05 2024-09-12T22:33:01.644 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.645 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.645 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:01.645 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405812+0000", 2024-09-12T22:33:01.645 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0627000000000001e-05 2024-09-12T22:33:01.645 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:01.645 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:01.645 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:01.645 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.645 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.645 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:33:01.645 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394447+0000", 2024-09-12T22:33:01.645 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 93.221609823999998, 2024-09-12T22:33:01.645 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011759588, 2024-09-12T22:33:01.646 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:01.646 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:01.646 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:01.646 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:01.646 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:33:01.646 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:33:01.646 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 188 2024-09-12T22:33:01.646 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.646 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:01.646 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.646 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:01.646 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394447+0000", 2024-09-12T22:33:01.646 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:01.647 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.647 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.647 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:01.647 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394447+0000", 2024-09-12T22:33:01.647 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:01.647 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.647 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.647 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:01.647 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394447+0000", 2024-09-12T22:33:01.647 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.15e-07 2024-09-12T22:33:01.647 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.647 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.647 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:01.647 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394512+0000", 2024-09-12T22:33:01.648 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4580999999999997e-05 2024-09-12T22:33:01.648 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.648 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.648 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:01.648 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394518+0000", 2024-09-12T22:33:01.648 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.3380000000000001e-06 2024-09-12T22:33:01.648 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.648 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.648 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:01.648 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394521+0000", 2024-09-12T22:33:01.648 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3340000000000002e-06 2024-09-12T22:33:01.648 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.648 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.649 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:01.649 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.402628+0000", 2024-09-12T22:33:01.649 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.008106996 2024-09-12T22:33:01.649 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.649 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.649 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:01.649 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.402670+0000", 2024-09-12T22:33:01.649 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1983000000000001e-05 2024-09-12T22:33:01.649 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.649 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.649 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:33:01.649 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.402738+0000", 2024-09-12T22:33:01.649 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.8114999999999994e-05 2024-09-12T22:33:01.649 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.650 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.650 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:01.650 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405668+0000", 2024-09-12T22:33:01.650 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.002929545 2024-09-12T22:33:01.650 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.650 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.650 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:01.650 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406162+0000", 2024-09-12T22:33:01.650 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000494408 2024-09-12T22:33:01.650 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.650 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.650 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:01.650 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406188+0000", 2024-09-12T22:33:01.651 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5766e-05 2024-09-12T22:33:01.651 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.651 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.651 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:01.651 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406206+0000", 2024-09-12T22:33:01.651 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.8107000000000001e-05 2024-09-12T22:33:01.651 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:01.651 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:01.651 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:01.651 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.651 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.651 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:33:01.651 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394528+0000", 2024-09-12T22:33:01.651 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 93.221528155000001, 2024-09-12T22:33:01.652 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.01195536, 2024-09-12T22:33:01.652 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:01.652 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:01.652 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:01.652 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:01.652 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:33:01.652 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:33:01.652 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 189 2024-09-12T22:33:01.652 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.652 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:01.652 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.652 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:01.653 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394528+0000", 2024-09-12T22:33:01.653 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:01.653 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.653 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.653 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:01.653 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394528+0000", 2024-09-12T22:33:01.653 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:01.653 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.653 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.653 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:01.653 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394529+0000", 2024-09-12T22:33:01.653 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4900000000000001e-07 2024-09-12T22:33:01.653 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.653 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.654 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:01.654 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394531+0000", 2024-09-12T22:33:01.654 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.458e-06 2024-09-12T22:33:01.654 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.654 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.654 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:01.654 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394535+0000", 2024-09-12T22:33:01.654 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7900000000000001e-06 2024-09-12T22:33:01.654 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.654 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.654 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:01.654 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394537+0000", 2024-09-12T22:33:01.654 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.632e-06 2024-09-12T22:33:01.655 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.655 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.655 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:01.655 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.404932+0000", 2024-09-12T22:33:01.655 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010394158000000001 2024-09-12T22:33:01.655 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.655 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.655 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:01.655 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405017+0000", 2024-09-12T22:33:01.655 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5525000000000005e-05 2024-09-12T22:33:01.655 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.655 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.655 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:33:01.655 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405114+0000", 2024-09-12T22:33:01.656 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.6527000000000006e-05 2024-09-12T22:33:01.656 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.656 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.656 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:01.656 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405818+0000", 2024-09-12T22:33:01.656 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00070412800000000005 2024-09-12T22:33:01.656 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.656 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.656 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:01.656 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406437+0000", 2024-09-12T22:33:01.656 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00061898900000000002 2024-09-12T22:33:01.656 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.656 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.657 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:01.657 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406463+0000", 2024-09-12T22:33:01.657 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6268e-05 2024-09-12T22:33:01.657 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.657 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.657 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:01.657 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406484+0000", 2024-09-12T22:33:01.657 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0536000000000001e-05 2024-09-12T22:33:01.657 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:01.657 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:01.657 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:01.657 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.657 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.658 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:33:01.658 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.401422+0000", 2024-09-12T22:33:01.658 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 84.214634250000003, 2024-09-12T22:33:01.658 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016896452999999999, 2024-09-12T22:33:01.658 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:01.658 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:01.658 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:01.658 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:01.658 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.658 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:01.658 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401422+0000", 2024-09-12T22:33:01.658 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:01.658 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.659 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.659 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:01.659 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401422+0000", 2024-09-12T22:33:01.659 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:01.659 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.659 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.659 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:01.659 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401424+0000", 2024-09-12T22:33:01.659 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9e-06 2024-09-12T22:33:01.659 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.659 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.659 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:01.659 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401437+0000", 2024-09-12T22:33:01.660 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2831e-05 2024-09-12T22:33:01.660 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.660 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.660 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:01.660 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401471+0000", 2024-09-12T22:33:01.660 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4010000000000001e-05 2024-09-12T22:33:01.660 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.660 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.660 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:01.660 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401484+0000", 2024-09-12T22:33:01.660 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2711000000000001e-05 2024-09-12T22:33:01.660 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.660 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.661 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:01.661 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405410+0000", 2024-09-12T22:33:01.661 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0039259170000000001 2024-09-12T22:33:01.661 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.661 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.661 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:01.661 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405529+0000", 2024-09-12T22:33:01.661 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000119778 2024-09-12T22:33:01.661 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.661 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.661 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:33:01.661 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405655+0000", 2024-09-12T22:33:01.661 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012556700000000001 2024-09-12T22:33:01.661 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.662 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.662 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:01.662 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410456+0000", 2024-09-12T22:33:01.662 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0048008269999999997 2024-09-12T22:33:01.662 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.662 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.662 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:01.662 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418226+0000", 2024-09-12T22:33:01.662 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0077707729999999999 2024-09-12T22:33:01.662 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.662 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.662 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:01.662 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418277+0000", 2024-09-12T22:33:01.663 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0476000000000003e-05 2024-09-12T22:33:01.663 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.663 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.663 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:01.663 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418319+0000", 2024-09-12T22:33:01.663 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1662999999999997e-05 2024-09-12T22:33:01.663 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:01.663 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:01.663 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:01.663 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.663 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.663 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:33:01.663 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.401505+0000", 2024-09-12T22:33:01.664 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 84.214551585999999, 2024-09-12T22:33:01.664 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016987904000000002, 2024-09-12T22:33:01.664 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:01.664 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:01.664 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:01.664 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:01.664 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.664 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:01.664 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401505+0000", 2024-09-12T22:33:01.664 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:01.665 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.665 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.665 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:01.665 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401505+0000", 2024-09-12T22:33:01.665 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:01.665 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.665 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.665 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:01.665 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401506+0000", 2024-09-12T22:33:01.665 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4700000000000001e-07 2024-09-12T22:33:01.665 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.665 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.665 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:01.666 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401510+0000", 2024-09-12T22:33:01.666 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6609999999999999e-06 2024-09-12T22:33:01.666 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.666 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.666 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:01.666 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401771+0000", 2024-09-12T22:33:01.666 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00026110700000000001 2024-09-12T22:33:01.666 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.666 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.666 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:01.666 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401921+0000", 2024-09-12T22:33:01.666 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014939099999999999 2024-09-12T22:33:01.667 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.667 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.667 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:01.667 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405944+0000", 2024-09-12T22:33:01.667 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0040235449999999999 2024-09-12T22:33:01.667 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.667 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.667 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:01.667 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406018+0000", 2024-09-12T22:33:01.667 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3373000000000004e-05 2024-09-12T22:33:01.667 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.667 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.667 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:33:01.667 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406172+0000", 2024-09-12T22:33:01.668 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00015435399999999999 2024-09-12T22:33:01.668 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.668 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.668 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:01.668 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410461+0000", 2024-09-12T22:33:01.668 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0042888609999999997 2024-09-12T22:33:01.668 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.668 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.668 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:01.668 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418371+0000", 2024-09-12T22:33:01.668 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0079098380000000006 2024-09-12T22:33:01.668 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.669 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.669 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:01.669 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418443+0000", 2024-09-12T22:33:01.669 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2705000000000003e-05 2024-09-12T22:33:01.669 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.669 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.669 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:01.669 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418493+0000", 2024-09-12T22:33:01.669 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9322e-05 2024-09-12T22:33:01.669 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:01.669 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:01.669 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:01.669 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.670 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.670 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:33:01.670 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.401939+0000", 2024-09-12T22:33:01.670 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 84.214117849999994, 2024-09-12T22:33:01.670 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016722292999999999, 2024-09-12T22:33:01.670 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:01.670 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:01.670 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:01.670 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:01.670 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.670 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:01.670 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401939+0000", 2024-09-12T22:33:01.670 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:01.671 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.671 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.671 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:01.671 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401939+0000", 2024-09-12T22:33:01.671 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:01.671 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.671 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.671 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:01.671 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401940+0000", 2024-09-12T22:33:01.671 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1990000000000001e-06 2024-09-12T22:33:01.671 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.671 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.671 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:01.672 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401956+0000", 2024-09-12T22:33:01.672 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.6344000000000001e-05 2024-09-12T22:33:01.672 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.672 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.672 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:01.672 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401974+0000", 2024-09-12T22:33:01.672 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7730000000000001e-05 2024-09-12T22:33:01.672 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.672 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.672 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:01.672 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401982+0000", 2024-09-12T22:33:01.672 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.7800000000000001e-06 2024-09-12T22:33:01.672 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.673 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.673 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:01.673 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406557+0000", 2024-09-12T22:33:01.673 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0045758489999999999 2024-09-12T22:33:01.673 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.673 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.673 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:01.673 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406697+0000", 2024-09-12T22:33:01.673 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013925100000000001 2024-09-12T22:33:01.673 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.673 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.673 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:33:01.673 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406830+0000", 2024-09-12T22:33:01.674 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013293499999999999 2024-09-12T22:33:01.674 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.674 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.674 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:01.674 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410465+0000", 2024-09-12T22:33:01.674 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0036352680000000001 2024-09-12T22:33:01.674 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.674 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.674 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:01.674 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418564+0000", 2024-09-12T22:33:01.674 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0080992140000000004 2024-09-12T22:33:01.674 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.674 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.674 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:01.675 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418621+0000", 2024-09-12T22:33:01.675 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7167999999999999e-05 2024-09-12T22:33:01.675 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.675 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.675 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:01.675 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418661+0000", 2024-09-12T22:33:01.675 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9555000000000003e-05 2024-09-12T22:33:01.675 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:01.675 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:01.675 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:01.675 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.675 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.675 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:33:01.675 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.401994+0000", 2024-09-12T22:33:01.676 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 84.214061978000004, 2024-09-12T22:33:01.676 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016804109000000001, 2024-09-12T22:33:01.676 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:01.676 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:01.676 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:01.676 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:01.676 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.676 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:01.676 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401994+0000", 2024-09-12T22:33:01.676 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:01.676 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.676 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.676 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:01.676 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401994+0000", 2024-09-12T22:33:01.677 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:01.677 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.677 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.677 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:01.677 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401995+0000", 2024-09-12T22:33:01.677 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.8899999999999998e-07 2024-09-12T22:33:01.677 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.677 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.677 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:01.677 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402000+0000", 2024-09-12T22:33:01.677 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.498e-06 2024-09-12T22:33:01.677 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.677 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.678 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:01.678 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402007+0000", 2024-09-12T22:33:01.678 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.554e-06 2024-09-12T22:33:01.678 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.678 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.678 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:01.678 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402046+0000", 2024-09-12T22:33:01.678 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9156000000000003e-05 2024-09-12T22:33:01.678 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.678 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.678 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:01.678 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407342+0000", 2024-09-12T22:33:01.678 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052957610000000004 2024-09-12T22:33:01.679 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.679 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.679 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:01.679 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407521+0000", 2024-09-12T22:33:01.679 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00017878100000000001 2024-09-12T22:33:01.679 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.679 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.679 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:33:01.679 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407641+0000", 2024-09-12T22:33:01.679 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012013 2024-09-12T22:33:01.679 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.679 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.679 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:01.679 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410472+0000", 2024-09-12T22:33:01.680 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.002830455 2024-09-12T22:33:01.680 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.680 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.680 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:01.680 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418714+0000", 2024-09-12T22:33:01.680 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0082422789999999999 2024-09-12T22:33:01.680 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.680 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.680 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:01.680 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418761+0000", 2024-09-12T22:33:01.680 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6956999999999998e-05 2024-09-12T22:33:01.680 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.680 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.680 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:01.681 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418799+0000", 2024-09-12T22:33:01.681 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7749000000000001e-05 2024-09-12T22:33:01.681 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:01.681 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:01.681 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:01.681 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.681 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.681 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:33:01.681 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.402060+0000", 2024-09-12T22:33:01.681 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 84.213996534000003, 2024-09-12T22:33:01.681 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016885686, 2024-09-12T22:33:01.681 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:01.681 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:01.682 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:01.682 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:01.682 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.682 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:01.682 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402060+0000", 2024-09-12T22:33:01.682 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:01.682 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.682 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.682 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:01.682 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402060+0000", 2024-09-12T22:33:01.682 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:01.682 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.682 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.683 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:01.683 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402061+0000", 2024-09-12T22:33:01.683 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4399999999999999e-07 2024-09-12T22:33:01.683 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.683 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.683 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:01.683 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402066+0000", 2024-09-12T22:33:01.683 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8649999999999998e-06 2024-09-12T22:33:01.683 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.683 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.683 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:01.683 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402146+0000", 2024-09-12T22:33:01.683 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9054000000000006e-05 2024-09-12T22:33:01.683 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.684 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.684 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:01.684 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402287+0000", 2024-09-12T22:33:01.684 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014108600000000001 2024-09-12T22:33:01.684 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.684 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.684 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:01.684 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408185+0000", 2024-09-12T22:33:01.684 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0058983919999999997 2024-09-12T22:33:01.684 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.684 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.684 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:01.684 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408299+0000", 2024-09-12T22:33:01.684 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114102 2024-09-12T22:33:01.685 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.685 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.685 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:33:01.685 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408420+0000", 2024-09-12T22:33:01.685 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000120492 2024-09-12T22:33:01.685 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.685 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.685 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:01.685 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410867+0000", 2024-09-12T22:33:01.685 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0024476430000000002 2024-09-12T22:33:01.685 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.685 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.685 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:01.686 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418851+0000", 2024-09-12T22:33:01.686 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0079841489999999994 2024-09-12T22:33:01.686 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.686 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.686 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:01.686 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418894+0000", 2024-09-12T22:33:01.686 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3090000000000002e-05 2024-09-12T22:33:01.686 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.686 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.686 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:01.686 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418946+0000", 2024-09-12T22:33:01.686 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1069000000000002e-05 2024-09-12T22:33:01.686 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:01.686 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:01.687 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:01.687 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.687 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.687 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:33:01.687 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.402375+0000", 2024-09-12T22:33:01.687 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 84.213681468999994, 2024-09-12T22:33:01.687 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016768531999999999, 2024-09-12T22:33:01.687 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:01.687 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:01.687 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:01.687 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:01.687 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.687 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:01.687 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402375+0000", 2024-09-12T22:33:01.688 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:01.688 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.688 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.688 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:01.688 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402375+0000", 2024-09-12T22:33:01.688 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:01.688 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.688 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.688 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:01.688 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402375+0000", 2024-09-12T22:33:01.688 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4099999999999999e-07 2024-09-12T22:33:01.688 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.688 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.688 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:01.689 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402379+0000", 2024-09-12T22:33:01.689 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9870000000000001e-06 2024-09-12T22:33:01.689 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.689 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.689 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:01.689 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402389+0000", 2024-09-12T22:33:01.689 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0000000000000001e-05 2024-09-12T22:33:01.689 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.689 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.689 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:01.689 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402401+0000", 2024-09-12T22:33:01.689 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.148e-05 2024-09-12T22:33:01.689 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.689 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.689 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:01.690 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409108+0000", 2024-09-12T22:33:01.690 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0067068429999999997 2024-09-12T22:33:01.690 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.690 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.690 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:01.690 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409189+0000", 2024-09-12T22:33:01.690 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0815999999999993e-05 2024-09-12T22:33:01.690 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.690 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.690 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:33:01.690 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409320+0000", 2024-09-12T22:33:01.690 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000131586 2024-09-12T22:33:01.690 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.690 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.690 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:01.691 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410872+0000", 2024-09-12T22:33:01.691 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0015521599999999999 2024-09-12T22:33:01.691 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.691 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.691 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:01.691 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419049+0000", 2024-09-12T22:33:01.691 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0081763719999999995 2024-09-12T22:33:01.691 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.691 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.691 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:01.691 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419107+0000", 2024-09-12T22:33:01.691 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7899000000000002e-05 2024-09-12T22:33:01.692 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.692 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.692 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:01.692 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419143+0000", 2024-09-12T22:33:01.692 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6847999999999997e-05 2024-09-12T22:33:01.692 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:01.692 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:01.692 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:01.692 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.693 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.693 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:33:01.693 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.402903+0000", 2024-09-12T22:33:01.693 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 84.213153057, 2024-09-12T22:33:01.693 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016378428, 2024-09-12T22:33:01.693 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:01.693 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:01.693 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:01.693 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:01.693 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.693 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:01.693 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402903+0000", 2024-09-12T22:33:01.694 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:01.694 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.694 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.694 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:01.694 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402903+0000", 2024-09-12T22:33:01.694 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:01.694 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.694 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.694 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:01.694 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402904+0000", 2024-09-12T22:33:01.694 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9500000000000001e-07 2024-09-12T22:33:01.694 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.694 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.695 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:01.695 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402944+0000", 2024-09-12T22:33:01.695 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0265000000000002e-05 2024-09-12T22:33:01.695 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.695 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.695 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:01.695 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402979+0000", 2024-09-12T22:33:01.695 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4378000000000002e-05 2024-09-12T22:33:01.695 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.695 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.695 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:01.695 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402987+0000", 2024-09-12T22:33:01.696 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3559999999999993e-06 2024-09-12T22:33:01.696 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.696 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.696 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:01.696 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409577+0000", 2024-09-12T22:33:01.696 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0065901709999999997 2024-09-12T22:33:01.696 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.696 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.696 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:01.696 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409653+0000", 2024-09-12T22:33:01.697 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5819e-05 2024-09-12T22:33:01.697 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.697 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.697 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:33:01.697 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409725+0000", 2024-09-12T22:33:01.697 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2200000000000007e-05 2024-09-12T22:33:01.697 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.697 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.697 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:01.697 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.411234+0000", 2024-09-12T22:33:01.697 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001508225 2024-09-12T22:33:01.697 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.698 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.698 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:01.698 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419212+0000", 2024-09-12T22:33:01.698 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0079783400000000004 2024-09-12T22:33:01.698 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.698 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.698 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:01.698 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419244+0000", 2024-09-12T22:33:01.698 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2384e-05 2024-09-12T22:33:01.698 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.699 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.699 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:01.699 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419282+0000", 2024-09-12T22:33:01.699 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7394999999999997e-05 2024-09-12T22:33:01.699 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:01.699 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:01.699 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:01.699 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.699 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.699 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:33:01.699 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.403135+0000", 2024-09-12T22:33:01.700 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 84.212921187000006, 2024-09-12T22:33:01.700 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016294211999999999, 2024-09-12T22:33:01.700 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:01.700 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:01.700 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:01.700 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:01.700 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.700 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:01.700 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403135+0000", 2024-09-12T22:33:01.700 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:01.700 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.701 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.701 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:01.701 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403135+0000", 2024-09-12T22:33:01.701 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:01.701 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.701 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.701 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:01.701 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403136+0000", 2024-09-12T22:33:01.701 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.4e-07 2024-09-12T22:33:01.701 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.701 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.702 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:01.702 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403149+0000", 2024-09-12T22:33:01.702 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2723e-05 2024-09-12T22:33:01.702 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.702 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.702 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:01.702 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403158+0000", 2024-09-12T22:33:01.702 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3919999999999992e-06 2024-09-12T22:33:01.702 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.702 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.702 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:01.702 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403166+0000", 2024-09-12T22:33:01.703 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.2309999999999996e-06 2024-09-12T22:33:01.703 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.703 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.703 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:01.703 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409944+0000", 2024-09-12T22:33:01.703 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0067775309999999998 2024-09-12T22:33:01.703 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.703 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.703 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:01.703 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410032+0000", 2024-09-12T22:33:01.704 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.7906999999999997e-05 2024-09-12T22:33:01.704 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.704 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.704 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:33:01.704 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410152+0000", 2024-09-12T22:33:01.704 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012037800000000001 2024-09-12T22:33:01.704 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.704 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.704 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:01.704 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.411945+0000", 2024-09-12T22:33:01.704 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0017931850000000001 2024-09-12T22:33:01.704 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.704 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.704 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:01.705 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419319+0000", 2024-09-12T22:33:01.705 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0073731780000000002 2024-09-12T22:33:01.705 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.705 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.705 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:01.705 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419376+0000", 2024-09-12T22:33:01.705 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7728e-05 2024-09-12T22:33:01.705 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.705 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.705 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:01.705 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419429+0000", 2024-09-12T22:33:01.705 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3019000000000002e-05 2024-09-12T22:33:01.705 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:01.706 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:01.706 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:01.706 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.706 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.706 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:33:01.706 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.403185+0000", 2024-09-12T22:33:01.706 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 84.212871305999997, 2024-09-12T22:33:01.706 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.014902164000000001, 2024-09-12T22:33:01.706 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:01.706 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:01.706 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:01.706 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:01.707 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.707 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:01.707 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403185+0000", 2024-09-12T22:33:01.707 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:01.707 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.707 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.707 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:01.707 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403185+0000", 2024-09-12T22:33:01.708 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:01.708 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.708 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.708 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:01.708 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403186+0000", 2024-09-12T22:33:01.708 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9400000000000005e-07 2024-09-12T22:33:01.708 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.708 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.709 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:01.709 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403191+0000", 2024-09-12T22:33:01.709 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6980000000000003e-06 2024-09-12T22:33:01.709 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.709 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.709 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:01.709 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403199+0000", 2024-09-12T22:33:01.709 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2520000000000002e-06 2024-09-12T22:33:01.709 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.709 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.709 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:01.709 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403205+0000", 2024-09-12T22:33:01.709 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.908e-06 2024-09-12T22:33:01.709 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.710 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.710 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:01.710 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403359+0000", 2024-09-12T22:33:01.710 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000154544 2024-09-12T22:33:01.710 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.710 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.710 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:01.710 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403528+0000", 2024-09-12T22:33:01.710 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000168455 2024-09-12T22:33:01.710 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.710 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.710 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:33:01.710 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403763+0000", 2024-09-12T22:33:01.710 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00023539599999999999 2024-09-12T22:33:01.711 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.711 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.711 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:01.711 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409378+0000", 2024-09-12T22:33:01.711 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056150000000000002 2024-09-12T22:33:01.711 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.711 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.711 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:01.711 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418012+0000", 2024-09-12T22:33:01.711 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0086339559999999999 2024-09-12T22:33:01.711 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.711 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.711 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:01.711 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418046+0000", 2024-09-12T22:33:01.712 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4267999999999998e-05 2024-09-12T22:33:01.712 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.712 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.712 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:01.712 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418087+0000", 2024-09-12T22:33:01.712 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0992999999999999e-05 2024-09-12T22:33:01.712 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:01.712 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:01.712 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:01.712 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.712 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.712 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:33:01.712 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.403273+0000", 2024-09-12T22:33:01.712 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 84.212783354999999, 2024-09-12T22:33:01.712 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.014934866, 2024-09-12T22:33:01.713 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:01.713 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:01.713 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:01.713 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:01.713 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.713 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:01.713 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403273+0000", 2024-09-12T22:33:01.713 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:01.713 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.713 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.713 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:01.713 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403273+0000", 2024-09-12T22:33:01.713 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:01.713 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.714 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.714 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:01.714 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403274+0000", 2024-09-12T22:33:01.714 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.297e-06 2024-09-12T22:33:01.714 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.714 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.714 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:01.714 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403282+0000", 2024-09-12T22:33:01.714 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6340000000000001e-06 2024-09-12T22:33:01.714 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.714 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.714 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:01.714 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403305+0000", 2024-09-12T22:33:01.714 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3149000000000001e-05 2024-09-12T22:33:01.715 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.715 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.715 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:01.715 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403320+0000", 2024-09-12T22:33:01.715 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4527e-05 2024-09-12T22:33:01.715 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.715 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.715 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:01.715 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.404928+0000", 2024-09-12T22:33:01.715 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001608459 2024-09-12T22:33:01.715 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.715 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.715 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:01.715 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405218+0000", 2024-09-12T22:33:01.715 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00028982900000000002 2024-09-12T22:33:01.716 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.716 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.716 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:33:01.716 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405829+0000", 2024-09-12T22:33:01.716 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00061127900000000005 2024-09-12T22:33:01.716 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.716 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.716 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:01.716 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409403+0000", 2024-09-12T22:33:01.716 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.003573597 2024-09-12T22:33:01.716 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.716 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.716 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:01.717 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418138+0000", 2024-09-12T22:33:01.717 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0087349969999999996 2024-09-12T22:33:01.717 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.717 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.717 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:01.717 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418178+0000", 2024-09-12T22:33:01.717 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0649999999999999e-05 2024-09-12T22:33:01.717 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.717 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.717 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:01.717 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418208+0000", 2024-09-12T22:33:01.717 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9448e-05 2024-09-12T22:33:01.717 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:01.717 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:01.718 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:01.718 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.718 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.718 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:33:01.718 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.405456+0000", 2024-09-12T22:33:01.718 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 84.210600209999996, 2024-09-12T22:33:01.718 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012888389, 2024-09-12T22:33:01.718 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:01.718 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:01.718 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:01.718 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:01.718 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.718 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:01.718 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405456+0000", 2024-09-12T22:33:01.719 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:01.719 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.719 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.719 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:01.719 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405456+0000", 2024-09-12T22:33:01.719 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:01.719 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.719 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.719 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:01.719 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405457+0000", 2024-09-12T22:33:01.719 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.6599999999999994e-07 2024-09-12T22:33:01.719 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.719 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.719 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:01.720 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405463+0000", 2024-09-12T22:33:01.720 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4739999999999996e-06 2024-09-12T22:33:01.720 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.720 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.720 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:01.720 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405474+0000", 2024-09-12T22:33:01.720 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1095e-05 2024-09-12T22:33:01.720 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.720 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.720 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:01.720 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405482+0000", 2024-09-12T22:33:01.720 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3610000000000001e-06 2024-09-12T22:33:01.720 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.721 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.721 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:01.721 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407051+0000", 2024-09-12T22:33:01.721 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0015688970000000001 2024-09-12T22:33:01.721 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.721 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.721 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:01.721 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407259+0000", 2024-09-12T22:33:01.721 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00020778300000000001 2024-09-12T22:33:01.721 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.722 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.722 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:33:01.722 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407622+0000", 2024-09-12T22:33:01.722 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000363066 2024-09-12T22:33:01.722 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.722 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.722 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:01.722 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409438+0000", 2024-09-12T22:33:01.722 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001816319 2024-09-12T22:33:01.723 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.723 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.723 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:01.723 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418257+0000", 2024-09-12T22:33:01.723 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0088187720000000008 2024-09-12T22:33:01.723 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.723 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.723 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:01.723 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418308+0000", 2024-09-12T22:33:01.723 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1180000000000001e-05 2024-09-12T22:33:01.723 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.723 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.723 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:01.724 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418345+0000", 2024-09-12T22:33:01.724 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6476000000000001e-05 2024-09-12T22:33:01.724 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:01.724 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:01.724 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:01.724 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.724 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.724 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:33:01.724 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.405496+0000", 2024-09-12T22:33:01.724 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 84.210560853000004, 2024-09-12T22:33:01.724 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013016012, 2024-09-12T22:33:01.724 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:01.725 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:01.725 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:01.725 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:01.725 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.725 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:01.725 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405496+0000", 2024-09-12T22:33:01.725 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:01.725 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.725 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.725 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:01.725 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405496+0000", 2024-09-12T22:33:01.725 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:01.725 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.726 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.726 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:01.726 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405496+0000", 2024-09-12T22:33:01.726 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7999999999999995e-07 2024-09-12T22:33:01.726 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.726 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.726 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:01.726 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405501+0000", 2024-09-12T22:33:01.726 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8359999999999999e-06 2024-09-12T22:33:01.726 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.726 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.726 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:01.727 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405514+0000", 2024-09-12T22:33:01.727 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2522e-05 2024-09-12T22:33:01.727 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.727 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.727 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:01.727 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405521+0000", 2024-09-12T22:33:01.727 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5020000000000003e-06 2024-09-12T22:33:01.727 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.727 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.727 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:01.727 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405575+0000", 2024-09-12T22:33:01.727 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4169999999999998e-05 2024-09-12T22:33:01.727 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.728 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.728 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:01.728 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405697+0000", 2024-09-12T22:33:01.728 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000121301 2024-09-12T22:33:01.728 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.728 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.728 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:33:01.728 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405829+0000", 2024-09-12T22:33:01.728 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000132662 2024-09-12T22:33:01.728 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.728 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.728 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:01.728 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409155+0000", 2024-09-12T22:33:01.729 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0033259050000000001 2024-09-12T22:33:01.729 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.729 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.729 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:01.729 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418425+0000", 2024-09-12T22:33:01.729 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0092696319999999999 2024-09-12T22:33:01.729 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.729 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.729 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:01.729 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418471+0000", 2024-09-12T22:33:01.729 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6213e-05 2024-09-12T22:33:01.729 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.729 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.730 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:01.730 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418512+0000", 2024-09-12T22:33:01.730 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0589000000000001e-05 2024-09-12T22:33:01.730 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:01.730 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:01.730 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:01.730 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.730 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.730 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:33:01.730 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.406108+0000", 2024-09-12T22:33:01.730 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 84.209948456000006, 2024-09-12T22:33:01.730 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012458175, 2024-09-12T22:33:01.730 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:01.730 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:01.731 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:01.731 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:01.731 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.731 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:01.731 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406108+0000", 2024-09-12T22:33:01.731 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:01.731 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.731 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.731 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:01.731 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406108+0000", 2024-09-12T22:33:01.731 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:01.731 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.731 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.732 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:01.732 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406109+0000", 2024-09-12T22:33:01.732 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9899999999999999e-07 2024-09-12T22:33:01.732 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.732 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.732 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:01.732 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406115+0000", 2024-09-12T22:33:01.732 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9030000000000001e-06 2024-09-12T22:33:01.732 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.732 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.732 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:01.732 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406141+0000", 2024-09-12T22:33:01.732 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5999e-05 2024-09-12T22:33:01.733 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.733 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.733 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:01.733 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406150+0000", 2024-09-12T22:33:01.733 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.6050000000000004e-06 2024-09-12T22:33:01.733 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.733 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.733 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:01.733 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408163+0000", 2024-09-12T22:33:01.733 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0020122769999999998 2024-09-12T22:33:01.733 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.733 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.733 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:01.733 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408309+0000", 2024-09-12T22:33:01.734 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014606999999999999 2024-09-12T22:33:01.734 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.734 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.734 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:33:01.734 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408433+0000", 2024-09-12T22:33:01.734 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012460300000000001 2024-09-12T22:33:01.734 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.734 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.734 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:01.734 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409903+0000", 2024-09-12T22:33:01.734 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001469499 2024-09-12T22:33:01.734 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.734 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.735 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:01.735 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418427+0000", 2024-09-12T22:33:01.735 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0085241139999999993 2024-09-12T22:33:01.735 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.735 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.735 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:01.735 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418471+0000", 2024-09-12T22:33:01.735 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4474000000000001e-05 2024-09-12T22:33:01.735 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.735 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.735 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:01.735 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418566+0000", 2024-09-12T22:33:01.735 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.4732e-05 2024-09-12T22:33:01.735 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:01.736 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:01.736 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:01.736 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.736 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.736 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:33:01.736 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.407266+0000", 2024-09-12T22:33:01.736 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 84.2087906, 2024-09-12T22:33:01.736 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011442905, 2024-09-12T22:33:01.736 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:01.736 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:01.736 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2024-09-12T22:33:01.736 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:01.736 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.737 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:01.737 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407266+0000", 2024-09-12T22:33:01.737 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:01.737 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.737 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.737 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:01.737 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407266+0000", 2024-09-12T22:33:01.737 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:01.737 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.737 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.737 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:01.737 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407266+0000", 2024-09-12T22:33:01.737 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7899999999999998e-07 2024-09-12T22:33:01.738 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.738 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.738 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:01.738 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407269+0000", 2024-09-12T22:33:01.738 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9210000000000001e-06 2024-09-12T22:33:01.738 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.738 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.738 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:01.738 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407331+0000", 2024-09-12T22:33:01.738 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1376000000000003e-05 2024-09-12T22:33:01.738 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.738 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.738 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:01.738 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407337+0000", 2024-09-12T22:33:01.739 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1929999999999998e-06 2024-09-12T22:33:01.739 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.739 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.739 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:01.739 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408974+0000", 2024-09-12T22:33:01.739 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0016367109999999999 2024-09-12T22:33:01.739 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.739 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.739 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:01.739 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409112+0000", 2024-09-12T22:33:01.739 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000137952 2024-09-12T22:33:01.739 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:01.739 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:01.739 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:01.740 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418709+0000", 2024-09-12T22:33:01.740 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0095971730000000005 2024-09-12T22:33:01.740 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:01.740 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:01.740 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:01.740 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:01.740 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:01.740 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-09-12T22:33:01.742 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:33:01.742 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:01.741+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:01.759 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T22:33:01.842 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:01.841+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:01.851 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:33:01.851 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [ 2024-09-12T22:33:01.851 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.851 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4490.0:3252 4.28 4:15fa74e5:::10000001018.00000000:head [write 0~14302 in=14302b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-12T22:33:01.851 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:01.850535+0000", 2024-09-12T22:33:01.852 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.00044696699999999999, 2024-09-12T22:33:01.852 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00046445900000000002, 2024-09-12T22:33:01.852 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:01.852 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:01.852 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:33:01.852 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:33:01.852 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4490", 2024-09-12T22:33:01.852 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:01.852 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 3252 2024-09-12T22:33:01.852 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.852 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:01.852 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.853 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:01.853 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:01.850535+0000", 2024-09-12T22:33:01.853 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:01.853 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.853 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.853 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:01.853 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:01.850535+0000", 2024-09-12T22:33:01.853 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:01.853 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.853 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.853 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:01.853 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:01.850535+0000", 2024-09-12T22:33:01.853 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.9699999999999995e-07 2024-09-12T22:33:01.854 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.854 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.854 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:01.854 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:01.850546+0000", 2024-09-12T22:33:01.854 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0479000000000001e-05 2024-09-12T22:33:01.854 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.854 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.854 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:01.854 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:01.850554+0000", 2024-09-12T22:33:01.854 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.5750000000000001e-06 2024-09-12T22:33:01.854 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.854 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.854 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:01.854 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:01.850559+0000", 2024-09-12T22:33:01.855 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5560000000000001e-06 2024-09-12T22:33:01.855 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.855 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.855 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:01.855 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:01.850607+0000", 2024-09-12T22:33:01.855 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8427000000000002e-05 2024-09-12T22:33:01.855 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:01.855 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:01.855 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:01.855 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:01.850724+0000", 2024-09-12T22:33:01.855 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00011671999999999999 2024-09-12T22:33:01.855 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:01.855 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:01.856 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:01.856 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:01.856 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-12T22:33:01.856 INFO:teuthology.orchestra.run.smithi148.stdout: "num_ops": 1 2024-09-12T22:33:01.856 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:33:01.861 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:33:01.880 INFO:teuthology.orchestra.run.smithi019.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-12T22:33:01.904 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T22:33:01.904 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:33:01.924 INFO:teuthology.orchestra.run.smithi019.stdout:osd.2: {} 2024-09-12T22:33:01.924 INFO:teuthology.orchestra.run.smithi019.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T22:33:01.927 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:33:01.928 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:33:01.943 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:01.942+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:02.010 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:33:02.010 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:33:02.020 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:33:02.064 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:02.063+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:02.130 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:33:02.130 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:33:02.140 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:33:02.183 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:02.182+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:02.245 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:02.244+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:02.249 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:33:02.249 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:33:02.259 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:33:02.346 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:02.345+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:02.421 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:33:02.422 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:33:02.432 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:33:02.447 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:02.446+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:02.480 INFO:teuthology.orchestra.run.smithi019.stderr:noscrub is unset 2024-09-12T22:33:02.548 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:02.547+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:02.581 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:33:02.582 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:33:02.591 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:33:02.649 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:02.648+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:02.702 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:33:02.702 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:33:02.712 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:33:02.750 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:02.749+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:02.850 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:02.849+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:02.863 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:33:02.863 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:33:02.872 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:33:02.952 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:02.951+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:02.967 DEBUG:teuthology.orchestra.console.smithi076:pexpect command: ipmitool -H smithi076.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-09-12T22:33:02.981 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:33:02.982 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:33:02.992 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:33:03.053 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:03.051+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:03.102 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:33:03.102 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:33:03.111 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:33:03.120 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~18s 2024-09-12T22:33:03.126 DEBUG:teuthology.orchestra.console.smithi076:check power output: Chassis Power is on 2024-09-12T22:33:03.126 INFO:teuthology.orchestra.console.smithi076:Power on completed 2024-09-12T22:33:03.154 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:03.152+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:03.217 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:33:03.217 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:33:03.227 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:33:03.228 DEBUG:teuthology.orchestra.console.smithi076:Waiting for login prompt 2024-09-12T22:33:03.228 DEBUG:teuthology.orchestra.console.smithi076:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi076 2024-09-12T22:33:03.282 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:03.281+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:03.346 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:33:03.346 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:33:03.356 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:03.354+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:03.356 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:33:03.456 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:03.454+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:03.463 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:33:03.464 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:33:03.473 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:33:03.557 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:03.555+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:03.623 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:33:03.623 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:33:03.633 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:33:03.658 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:03.657+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:03.759 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:03.757+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:03.784 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:33:03.784 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:33:03.794 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:33:03.859 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:03.858+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:03.904 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:33:03.905 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:33:03.914 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:33:03.929 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T22:33:03.998 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:03.997+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:04.049 INFO:teuthology.orchestra.run.smithi019.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-12T22:33:04.061 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:04.059+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:04.065 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:33:04.066 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:33:04.071 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T22:33:04.071 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:33:04.075 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:33:04.093 INFO:teuthology.orchestra.run.smithi019.stdout:osd.2: {} 2024-09-12T22:33:04.093 INFO:teuthology.orchestra.run.smithi019.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T22:33:04.096 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:33:04.096 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:33:04.161 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:04.160+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:04.228 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-09-12T22:33:04.229 INFO:teuthology.orchestra.run.smithi163.stdout: "size": 20, 2024-09-12T22:33:04.229 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 600, 2024-09-12T22:33:04.229 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2024-09-12T22:33:04.229 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.229 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-09-12T22:33:04.229 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:27.254459+0000", 2024-09-12T22:33:04.229 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 96.971722710999998, 2024-09-12T22:33:04.229 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.37816283899999997, 2024-09-12T22:33:04.229 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:04.229 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:04.229 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:04.230 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:04.230 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:33:04.230 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:33:04.230 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 1 2024-09-12T22:33:04.230 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.230 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:04.230 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.230 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:04.230 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254459+0000", 2024-09-12T22:33:04.230 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:04.230 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.230 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.230 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:04.231 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254459+0000", 2024-09-12T22:33:04.231 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:04.231 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.231 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.231 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:04.231 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254460+0000", 2024-09-12T22:33:04.231 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1739999999999999e-06 2024-09-12T22:33:04.231 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.231 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.231 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:04.231 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254472+0000", 2024-09-12T22:33:04.231 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2207e-05 2024-09-12T22:33:04.232 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.232 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.232 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:04.232 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254483+0000", 2024-09-12T22:33:04.232 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0631999999999999e-05 2024-09-12T22:33:04.232 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.232 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.232 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:04.232 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254492+0000", 2024-09-12T22:33:04.232 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3670000000000003e-06 2024-09-12T22:33:04.232 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.232 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.232 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:04.233 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254551+0000", 2024-09-12T22:33:04.233 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8687999999999998e-05 2024-09-12T22:33:04.233 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.233 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.233 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for peered", 2024-09-12T22:33:04.233 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254562+0000", 2024-09-12T22:33:04.233 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1249e-05 2024-09-12T22:33:04.233 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.233 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.233 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:04.233 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.631211+0000", 2024-09-12T22:33:04.233 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.376649018 2024-09-12T22:33:04.233 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.234 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.234 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:04.234 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.631345+0000", 2024-09-12T22:33:04.234 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013378700000000001 2024-09-12T22:33:04.234 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.234 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.234 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:33:04.234 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.631479+0000", 2024-09-12T22:33:04.234 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013352399999999999 2024-09-12T22:33:04.234 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.234 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.234 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:04.234 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632324+0000", 2024-09-12T22:33:04.235 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00084508100000000002 2024-09-12T22:33:04.235 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.235 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.235 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:04.235 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632548+0000", 2024-09-12T22:33:04.235 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000224329 2024-09-12T22:33:04.235 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.235 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.235 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:04.235 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632591+0000", 2024-09-12T22:33:04.235 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2564000000000001e-05 2024-09-12T22:33:04.235 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.235 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.235 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:04.235 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632622+0000", 2024-09-12T22:33:04.236 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1219e-05 2024-09-12T22:33:04.236 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:04.236 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:04.236 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:04.236 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.236 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.236 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:185 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:33:04.236 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394355+0000", 2024-09-12T22:33:04.236 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 95.831826613999993, 2024-09-12T22:33:04.236 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011302394, 2024-09-12T22:33:04.236 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:04.236 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:04.237 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:04.237 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:04.237 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:33:04.237 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:33:04.237 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 185 2024-09-12T22:33:04.237 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.237 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:04.237 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.237 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:04.237 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394355+0000", 2024-09-12T22:33:04.237 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:04.237 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.238 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.238 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:04.238 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394355+0000", 2024-09-12T22:33:04.238 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:04.238 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.238 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.238 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:04.238 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394355+0000", 2024-09-12T22:33:04.238 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9099999999999999e-07 2024-09-12T22:33:04.238 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.238 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.238 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:04.238 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394385+0000", 2024-09-12T22:33:04.238 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9963000000000001e-05 2024-09-12T22:33:04.239 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.239 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.239 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:04.239 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394390+0000", 2024-09-12T22:33:04.239 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8420000000000004e-06 2024-09-12T22:33:04.239 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.239 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.239 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:04.239 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394393+0000", 2024-09-12T22:33:04.239 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1e-06 2024-09-12T22:33:04.239 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.239 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.239 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:04.240 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.400546+0000", 2024-09-12T22:33:04.240 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0061523309999999996 2024-09-12T22:33:04.240 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.240 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.240 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:04.240 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.400588+0000", 2024-09-12T22:33:04.240 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1835000000000002e-05 2024-09-12T22:33:04.240 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.240 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.240 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:33:04.240 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.400677+0000", 2024-09-12T22:33:04.240 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9195000000000002e-05 2024-09-12T22:33:04.240 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.240 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.241 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:04.241 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405378+0000", 2024-09-12T22:33:04.241 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0047008659999999997 2024-09-12T22:33:04.241 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.241 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.241 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:04.241 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405569+0000", 2024-09-12T22:33:04.241 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00019148599999999999 2024-09-12T22:33:04.241 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.241 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.241 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:04.242 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405620+0000", 2024-09-12T22:33:04.242 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1416999999999999e-05 2024-09-12T22:33:04.242 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.242 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.242 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:04.242 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405657+0000", 2024-09-12T22:33:04.242 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6968000000000002e-05 2024-09-12T22:33:04.242 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:04.242 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:04.242 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:04.242 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.242 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.243 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:33:04.243 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394399+0000", 2024-09-12T22:33:04.243 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 95.831782403000005, 2024-09-12T22:33:04.243 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011336601999999999, 2024-09-12T22:33:04.243 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:04.243 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:04.243 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:04.243 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:04.243 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:33:04.243 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:33:04.243 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 186 2024-09-12T22:33:04.243 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.243 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:04.244 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.244 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:04.244 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394399+0000", 2024-09-12T22:33:04.244 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:04.244 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.244 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.244 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:04.244 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394399+0000", 2024-09-12T22:33:04.244 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:04.244 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.244 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.244 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:04.244 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394400+0000", 2024-09-12T22:33:04.245 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4499999999999998e-07 2024-09-12T22:33:04.245 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.245 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.245 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:04.245 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394402+0000", 2024-09-12T22:33:04.245 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.875e-06 2024-09-12T22:33:04.245 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.245 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.245 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:04.245 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394405+0000", 2024-09-12T22:33:04.245 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6799999999999999e-06 2024-09-12T22:33:04.245 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.245 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.246 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:04.246 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394408+0000", 2024-09-12T22:33:04.246 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.667e-06 2024-09-12T22:33:04.246 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.246 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.246 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:04.246 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401395+0000", 2024-09-12T22:33:04.246 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0069867230000000002 2024-09-12T22:33:04.246 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.246 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.246 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:04.246 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401438+0000", 2024-09-12T22:33:04.246 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3554999999999999e-05 2024-09-12T22:33:04.247 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.247 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.247 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:33:04.247 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401509+0000", 2024-09-12T22:33:04.247 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0631999999999997e-05 2024-09-12T22:33:04.247 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.247 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.247 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:04.247 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405392+0000", 2024-09-12T22:33:04.247 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0038830449999999999 2024-09-12T22:33:04.247 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.247 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.247 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:04.247 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405690+0000", 2024-09-12T22:33:04.248 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000298435 2024-09-12T22:33:04.248 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.248 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.248 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:04.248 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405716+0000", 2024-09-12T22:33:04.248 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5435999999999998e-05 2024-09-12T22:33:04.248 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.248 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.248 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:04.248 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405736+0000", 2024-09-12T22:33:04.248 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0208999999999999e-05 2024-09-12T22:33:04.248 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:04.248 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:04.249 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:04.249 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.249 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.249 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:33:04.249 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394411+0000", 2024-09-12T22:33:04.249 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 95.831770277000004, 2024-09-12T22:33:04.249 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011400117, 2024-09-12T22:33:04.249 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:04.249 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:04.249 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:04.249 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:04.249 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:33:04.249 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:33:04.249 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 187 2024-09-12T22:33:04.250 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.250 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:04.250 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.250 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:04.250 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394411+0000", 2024-09-12T22:33:04.250 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:04.250 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.250 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.250 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:04.250 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394411+0000", 2024-09-12T22:33:04.250 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:04.250 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.250 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.250 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:04.251 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394412+0000", 2024-09-12T22:33:04.251 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.4999999999999999e-07 2024-09-12T22:33:04.251 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.251 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.251 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:04.251 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394414+0000", 2024-09-12T22:33:04.251 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.984e-06 2024-09-12T22:33:04.251 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.251 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.251 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:04.251 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394418+0000", 2024-09-12T22:33:04.251 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0840000000000002e-06 2024-09-12T22:33:04.251 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.252 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.252 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:04.252 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394431+0000", 2024-09-12T22:33:04.252 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.361e-05 2024-09-12T22:33:04.252 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.252 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.252 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:04.252 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401778+0000", 2024-09-12T22:33:04.252 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0073462659999999997 2024-09-12T22:33:04.252 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.252 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.252 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:04.252 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401853+0000", 2024-09-12T22:33:04.252 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5797000000000006e-05 2024-09-12T22:33:04.252 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.253 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.253 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:33:04.253 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401990+0000", 2024-09-12T22:33:04.253 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013651399999999999 2024-09-12T22:33:04.253 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.253 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.253 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:04.253 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405402+0000", 2024-09-12T22:33:04.253 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0034116070000000001 2024-09-12T22:33:04.253 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.253 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.253 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:04.253 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405764+0000", 2024-09-12T22:33:04.253 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00036234899999999998 2024-09-12T22:33:04.254 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.254 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.254 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:04.254 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405791+0000", 2024-09-12T22:33:04.254 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7029000000000002e-05 2024-09-12T22:33:04.254 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.254 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.254 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:04.254 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405812+0000", 2024-09-12T22:33:04.254 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0627000000000001e-05 2024-09-12T22:33:04.254 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:04.254 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:04.254 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:04.254 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.254 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.255 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:33:04.255 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394447+0000", 2024-09-12T22:33:04.255 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 95.831735125999998, 2024-09-12T22:33:04.255 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011759588, 2024-09-12T22:33:04.255 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:04.255 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:04.255 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:04.255 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:04.255 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:33:04.255 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:33:04.255 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 188 2024-09-12T22:33:04.255 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.255 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:04.255 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.256 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:04.256 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394447+0000", 2024-09-12T22:33:04.256 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:04.256 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.256 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.256 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:04.256 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394447+0000", 2024-09-12T22:33:04.256 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:04.256 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.256 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.256 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:04.256 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394447+0000", 2024-09-12T22:33:04.256 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.15e-07 2024-09-12T22:33:04.256 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.257 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.257 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:04.257 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394512+0000", 2024-09-12T22:33:04.257 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4580999999999997e-05 2024-09-12T22:33:04.257 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.257 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.257 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:04.257 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394518+0000", 2024-09-12T22:33:04.257 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.3380000000000001e-06 2024-09-12T22:33:04.257 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.257 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.257 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:04.257 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394521+0000", 2024-09-12T22:33:04.258 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3340000000000002e-06 2024-09-12T22:33:04.258 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.258 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.258 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:04.258 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.402628+0000", 2024-09-12T22:33:04.258 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.008106996 2024-09-12T22:33:04.258 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.258 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.258 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:04.258 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.402670+0000", 2024-09-12T22:33:04.258 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1983000000000001e-05 2024-09-12T22:33:04.258 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.258 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.258 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:33:04.259 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.402738+0000", 2024-09-12T22:33:04.259 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.8114999999999994e-05 2024-09-12T22:33:04.259 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.259 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.259 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:04.259 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405668+0000", 2024-09-12T22:33:04.259 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.002929545 2024-09-12T22:33:04.259 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.259 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.259 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:04.259 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406162+0000", 2024-09-12T22:33:04.259 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000494408 2024-09-12T22:33:04.259 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.260 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.260 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:04.260 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406188+0000", 2024-09-12T22:33:04.260 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5766e-05 2024-09-12T22:33:04.260 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.260 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.260 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:04.260 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406206+0000", 2024-09-12T22:33:04.260 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.8107000000000001e-05 2024-09-12T22:33:04.260 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:04.260 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:04.260 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:04.261 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.261 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.261 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:33:04.261 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394528+0000", 2024-09-12T22:33:04.261 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 95.831653457000002, 2024-09-12T22:33:04.261 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.01195536, 2024-09-12T22:33:04.261 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:04.261 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:04.261 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:04.261 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:04.261 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:33:04.261 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:33:04.261 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 189 2024-09-12T22:33:04.261 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.262 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:04.262 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.262 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:04.262 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394528+0000", 2024-09-12T22:33:04.262 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:04.262 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.262 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.262 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:04.262 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394528+0000", 2024-09-12T22:33:04.262 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:04.262 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.262 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.262 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:04.262 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394529+0000", 2024-09-12T22:33:04.262 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4900000000000001e-07 2024-09-12T22:33:04.263 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.263 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.263 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:04.263 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394531+0000", 2024-09-12T22:33:04.263 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.458e-06 2024-09-12T22:33:04.263 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.263 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.263 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:04.263 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394535+0000", 2024-09-12T22:33:04.263 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7900000000000001e-06 2024-09-12T22:33:04.263 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.263 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.263 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:04.263 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394537+0000", 2024-09-12T22:33:04.263 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.632e-06 2024-09-12T22:33:04.264 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.264 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.264 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:04.264 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.404932+0000", 2024-09-12T22:33:04.264 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010394158000000001 2024-09-12T22:33:04.264 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.264 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.264 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:04.264 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405017+0000", 2024-09-12T22:33:04.264 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5525000000000005e-05 2024-09-12T22:33:04.264 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.264 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.264 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:33:04.264 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405114+0000", 2024-09-12T22:33:04.264 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.6527000000000006e-05 2024-09-12T22:33:04.265 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.265 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.265 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:04.265 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405818+0000", 2024-09-12T22:33:04.265 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00070412800000000005 2024-09-12T22:33:04.265 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.265 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.265 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:04.265 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406437+0000", 2024-09-12T22:33:04.265 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00061898900000000002 2024-09-12T22:33:04.265 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.265 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.265 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:04.266 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406463+0000", 2024-09-12T22:33:04.266 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6268e-05 2024-09-12T22:33:04.266 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.266 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.266 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:04.266 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406484+0000", 2024-09-12T22:33:04.266 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0536000000000001e-05 2024-09-12T22:33:04.266 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:04.266 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:04.266 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:04.266 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.266 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.266 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:33:04.267 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.401422+0000", 2024-09-12T22:33:04.267 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 86.824759552000003, 2024-09-12T22:33:04.267 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016896452999999999, 2024-09-12T22:33:04.267 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:04.267 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:04.267 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:04.267 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:04.267 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.267 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:04.267 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401422+0000", 2024-09-12T22:33:04.267 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:04.267 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.267 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.267 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:04.268 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401422+0000", 2024-09-12T22:33:04.268 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:04.268 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.268 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.268 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:04.268 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401424+0000", 2024-09-12T22:33:04.268 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9e-06 2024-09-12T22:33:04.268 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.268 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.268 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:04.268 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401437+0000", 2024-09-12T22:33:04.268 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2831e-05 2024-09-12T22:33:04.268 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.268 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.269 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:04.269 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401471+0000", 2024-09-12T22:33:04.269 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4010000000000001e-05 2024-09-12T22:33:04.269 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.269 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.269 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:04.269 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401484+0000", 2024-09-12T22:33:04.269 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2711000000000001e-05 2024-09-12T22:33:04.269 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.269 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.269 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:04.269 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405410+0000", 2024-09-12T22:33:04.269 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0039259170000000001 2024-09-12T22:33:04.270 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.270 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.270 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:04.270 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405529+0000", 2024-09-12T22:33:04.270 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000119778 2024-09-12T22:33:04.270 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.270 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.270 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:33:04.270 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405655+0000", 2024-09-12T22:33:04.270 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012556700000000001 2024-09-12T22:33:04.270 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.270 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.270 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:04.271 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410456+0000", 2024-09-12T22:33:04.271 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0048008269999999997 2024-09-12T22:33:04.271 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.271 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.271 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:04.271 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418226+0000", 2024-09-12T22:33:04.271 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0077707729999999999 2024-09-12T22:33:04.271 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.271 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.271 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:04.271 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418277+0000", 2024-09-12T22:33:04.271 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0476000000000003e-05 2024-09-12T22:33:04.271 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.271 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.272 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:04.272 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418319+0000", 2024-09-12T22:33:04.272 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1662999999999997e-05 2024-09-12T22:33:04.272 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:04.272 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:04.272 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:04.272 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.272 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.272 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:33:04.272 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.401505+0000", 2024-09-12T22:33:04.272 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 86.824676887999999, 2024-09-12T22:33:04.272 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016987904000000002, 2024-09-12T22:33:04.272 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:04.273 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:04.273 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:04.273 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:04.273 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.273 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:04.273 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401505+0000", 2024-09-12T22:33:04.273 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:04.273 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.273 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.273 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:04.273 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401505+0000", 2024-09-12T22:33:04.273 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:04.273 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.273 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.274 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:04.274 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401506+0000", 2024-09-12T22:33:04.274 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4700000000000001e-07 2024-09-12T22:33:04.274 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.274 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.274 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:04.274 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401510+0000", 2024-09-12T22:33:04.274 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6609999999999999e-06 2024-09-12T22:33:04.274 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.274 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.274 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:04.274 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401771+0000", 2024-09-12T22:33:04.274 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00026110700000000001 2024-09-12T22:33:04.275 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.275 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.275 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:04.275 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401921+0000", 2024-09-12T22:33:04.275 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014939099999999999 2024-09-12T22:33:04.275 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.275 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.275 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:04.275 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405944+0000", 2024-09-12T22:33:04.275 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0040235449999999999 2024-09-12T22:33:04.275 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.276 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.276 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:04.276 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406018+0000", 2024-09-12T22:33:04.276 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3373000000000004e-05 2024-09-12T22:33:04.276 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.276 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.276 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:33:04.276 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406172+0000", 2024-09-12T22:33:04.276 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00015435399999999999 2024-09-12T22:33:04.276 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.276 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.276 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:04.277 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410461+0000", 2024-09-12T22:33:04.277 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0042888609999999997 2024-09-12T22:33:04.277 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.277 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.277 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:04.277 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418371+0000", 2024-09-12T22:33:04.277 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0079098380000000006 2024-09-12T22:33:04.277 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.277 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.277 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:04.277 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418443+0000", 2024-09-12T22:33:04.277 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2705000000000003e-05 2024-09-12T22:33:04.277 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.277 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.278 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:04.278 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418493+0000", 2024-09-12T22:33:04.278 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9322e-05 2024-09-12T22:33:04.278 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:04.278 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:04.278 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:04.278 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.278 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.278 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:33:04.278 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.401939+0000", 2024-09-12T22:33:04.278 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 86.824243151999994, 2024-09-12T22:33:04.278 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016722292999999999, 2024-09-12T22:33:04.278 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:04.279 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:04.279 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:04.279 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:04.279 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.279 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:04.279 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401939+0000", 2024-09-12T22:33:04.279 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:04.279 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.279 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.279 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:04.279 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401939+0000", 2024-09-12T22:33:04.279 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:04.279 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.280 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.280 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:04.280 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401940+0000", 2024-09-12T22:33:04.280 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1990000000000001e-06 2024-09-12T22:33:04.280 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.280 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.280 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:04.280 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401956+0000", 2024-09-12T22:33:04.280 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.6344000000000001e-05 2024-09-12T22:33:04.280 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.280 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.280 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:04.280 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401974+0000", 2024-09-12T22:33:04.280 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7730000000000001e-05 2024-09-12T22:33:04.281 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.281 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.281 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:04.281 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401982+0000", 2024-09-12T22:33:04.281 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.7800000000000001e-06 2024-09-12T22:33:04.281 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.281 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.281 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:04.281 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406557+0000", 2024-09-12T22:33:04.281 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0045758489999999999 2024-09-12T22:33:04.281 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.281 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.281 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:04.281 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406697+0000", 2024-09-12T22:33:04.282 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013925100000000001 2024-09-12T22:33:04.282 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.282 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.282 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:33:04.282 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406830+0000", 2024-09-12T22:33:04.282 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013293499999999999 2024-09-12T22:33:04.282 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.282 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.282 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:04.282 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410465+0000", 2024-09-12T22:33:04.282 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0036352680000000001 2024-09-12T22:33:04.282 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.282 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.283 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:04.283 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418564+0000", 2024-09-12T22:33:04.283 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0080992140000000004 2024-09-12T22:33:04.283 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.283 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.283 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:04.283 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418621+0000", 2024-09-12T22:33:04.283 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7167999999999999e-05 2024-09-12T22:33:04.283 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.283 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.283 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:04.283 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418661+0000", 2024-09-12T22:33:04.283 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9555000000000003e-05 2024-09-12T22:33:04.283 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:04.284 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:04.284 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:04.284 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.284 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.284 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:33:04.284 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.401994+0000", 2024-09-12T22:33:04.284 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 86.824187280000004, 2024-09-12T22:33:04.284 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016804109000000001, 2024-09-12T22:33:04.284 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:04.284 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:04.284 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:04.284 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:04.284 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.285 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:04.285 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401994+0000", 2024-09-12T22:33:04.285 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:04.285 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.285 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.285 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:04.285 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401994+0000", 2024-09-12T22:33:04.285 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:04.285 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.285 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.285 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:04.285 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401995+0000", 2024-09-12T22:33:04.285 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.8899999999999998e-07 2024-09-12T22:33:04.285 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.286 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.286 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:04.286 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402000+0000", 2024-09-12T22:33:04.286 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.498e-06 2024-09-12T22:33:04.286 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.286 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.286 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:04.286 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402007+0000", 2024-09-12T22:33:04.286 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.554e-06 2024-09-12T22:33:04.286 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.286 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.286 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:04.286 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402046+0000", 2024-09-12T22:33:04.286 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9156000000000003e-05 2024-09-12T22:33:04.287 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.287 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.287 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:04.287 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407342+0000", 2024-09-12T22:33:04.287 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052957610000000004 2024-09-12T22:33:04.287 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.287 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.287 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:04.287 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407521+0000", 2024-09-12T22:33:04.287 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00017878100000000001 2024-09-12T22:33:04.287 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.287 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.287 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:33:04.288 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407641+0000", 2024-09-12T22:33:04.288 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012013 2024-09-12T22:33:04.288 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.288 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.288 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:04.288 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410472+0000", 2024-09-12T22:33:04.288 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.002830455 2024-09-12T22:33:04.288 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.288 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.288 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:04.288 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418714+0000", 2024-09-12T22:33:04.288 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0082422789999999999 2024-09-12T22:33:04.289 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.289 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.289 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:04.289 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418761+0000", 2024-09-12T22:33:04.289 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6956999999999998e-05 2024-09-12T22:33:04.289 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.289 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.289 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:04.289 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418799+0000", 2024-09-12T22:33:04.289 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7749000000000001e-05 2024-09-12T22:33:04.289 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:04.289 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:04.289 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:04.290 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.290 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.290 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:33:04.290 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.402060+0000", 2024-09-12T22:33:04.290 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 86.824121836000003, 2024-09-12T22:33:04.290 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016885686, 2024-09-12T22:33:04.290 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:04.290 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:04.290 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:04.290 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:04.290 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.290 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:04.291 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402060+0000", 2024-09-12T22:33:04.291 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:04.291 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.291 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.291 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:04.291 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402060+0000", 2024-09-12T22:33:04.291 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:04.291 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.291 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.291 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:04.291 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402061+0000", 2024-09-12T22:33:04.291 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4399999999999999e-07 2024-09-12T22:33:04.291 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.292 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.292 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:04.292 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402066+0000", 2024-09-12T22:33:04.292 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8649999999999998e-06 2024-09-12T22:33:04.292 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.292 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.292 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:04.292 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402146+0000", 2024-09-12T22:33:04.292 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9054000000000006e-05 2024-09-12T22:33:04.292 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.292 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.292 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:04.292 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402287+0000", 2024-09-12T22:33:04.293 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014108600000000001 2024-09-12T22:33:04.293 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.293 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.293 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:04.293 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408185+0000", 2024-09-12T22:33:04.293 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0058983919999999997 2024-09-12T22:33:04.293 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.293 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.293 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:04.293 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408299+0000", 2024-09-12T22:33:04.293 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114102 2024-09-12T22:33:04.293 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.293 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.293 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:33:04.294 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408420+0000", 2024-09-12T22:33:04.294 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000120492 2024-09-12T22:33:04.294 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.294 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.294 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:04.294 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410867+0000", 2024-09-12T22:33:04.294 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0024476430000000002 2024-09-12T22:33:04.294 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.294 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.294 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:04.294 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418851+0000", 2024-09-12T22:33:04.294 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0079841489999999994 2024-09-12T22:33:04.294 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.295 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.295 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:04.295 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418894+0000", 2024-09-12T22:33:04.295 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3090000000000002e-05 2024-09-12T22:33:04.295 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.295 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.295 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:04.295 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418946+0000", 2024-09-12T22:33:04.295 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1069000000000002e-05 2024-09-12T22:33:04.295 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:04.295 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:04.295 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:04.295 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.295 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.296 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:33:04.296 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.402375+0000", 2024-09-12T22:33:04.296 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 86.823806770999994, 2024-09-12T22:33:04.296 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016768531999999999, 2024-09-12T22:33:04.296 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:04.296 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:04.296 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:04.296 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:04.296 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.296 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:04.296 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402375+0000", 2024-09-12T22:33:04.296 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:04.296 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.296 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.296 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:04.297 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402375+0000", 2024-09-12T22:33:04.297 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:04.297 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.297 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.297 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:04.297 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402375+0000", 2024-09-12T22:33:04.297 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4099999999999999e-07 2024-09-12T22:33:04.297 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.297 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.297 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:04.297 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402379+0000", 2024-09-12T22:33:04.297 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9870000000000001e-06 2024-09-12T22:33:04.297 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.297 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.297 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:04.298 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402389+0000", 2024-09-12T22:33:04.298 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0000000000000001e-05 2024-09-12T22:33:04.298 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.298 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.298 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:04.298 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402401+0000", 2024-09-12T22:33:04.298 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.148e-05 2024-09-12T22:33:04.298 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.298 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.298 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:04.298 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409108+0000", 2024-09-12T22:33:04.298 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0067068429999999997 2024-09-12T22:33:04.298 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.298 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.299 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:04.299 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409189+0000", 2024-09-12T22:33:04.299 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0815999999999993e-05 2024-09-12T22:33:04.299 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.299 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.299 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:33:04.299 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409320+0000", 2024-09-12T22:33:04.299 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000131586 2024-09-12T22:33:04.299 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.299 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.299 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:04.299 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410872+0000", 2024-09-12T22:33:04.299 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0015521599999999999 2024-09-12T22:33:04.299 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.300 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.300 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:04.300 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419049+0000", 2024-09-12T22:33:04.300 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0081763719999999995 2024-09-12T22:33:04.300 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.300 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.300 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:04.300 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419107+0000", 2024-09-12T22:33:04.300 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7899000000000002e-05 2024-09-12T22:33:04.300 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.300 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.300 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:04.300 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419143+0000", 2024-09-12T22:33:04.301 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6847999999999997e-05 2024-09-12T22:33:04.301 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:04.301 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:04.301 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:04.301 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.301 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.301 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:33:04.301 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.402903+0000", 2024-09-12T22:33:04.301 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 86.823278359, 2024-09-12T22:33:04.301 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016378428, 2024-09-12T22:33:04.301 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:04.301 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:04.301 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:04.302 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:04.302 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.302 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:04.302 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402903+0000", 2024-09-12T22:33:04.302 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:04.302 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.302 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.302 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:04.302 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402903+0000", 2024-09-12T22:33:04.302 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:04.303 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.303 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.303 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:04.303 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402904+0000", 2024-09-12T22:33:04.303 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9500000000000001e-07 2024-09-12T22:33:04.303 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.303 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.303 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:04.303 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402944+0000", 2024-09-12T22:33:04.303 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0265000000000002e-05 2024-09-12T22:33:04.303 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.303 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.303 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:04.303 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402979+0000", 2024-09-12T22:33:04.304 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4378000000000002e-05 2024-09-12T22:33:04.304 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.304 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.304 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:04.304 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402987+0000", 2024-09-12T22:33:04.304 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3559999999999993e-06 2024-09-12T22:33:04.304 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.304 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.304 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:04.304 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409577+0000", 2024-09-12T22:33:04.304 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0065901709999999997 2024-09-12T22:33:04.304 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.304 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.305 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:04.305 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409653+0000", 2024-09-12T22:33:04.305 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5819e-05 2024-09-12T22:33:04.305 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.305 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.305 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:33:04.305 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409725+0000", 2024-09-12T22:33:04.305 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2200000000000007e-05 2024-09-12T22:33:04.305 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.305 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.305 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:04.305 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.411234+0000", 2024-09-12T22:33:04.305 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001508225 2024-09-12T22:33:04.306 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.306 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.306 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:04.306 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419212+0000", 2024-09-12T22:33:04.306 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0079783400000000004 2024-09-12T22:33:04.306 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.306 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.306 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:04.306 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419244+0000", 2024-09-12T22:33:04.306 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2384e-05 2024-09-12T22:33:04.306 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.306 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.306 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:04.306 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419282+0000", 2024-09-12T22:33:04.307 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7394999999999997e-05 2024-09-12T22:33:04.307 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:04.307 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:04.307 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:04.307 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.307 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.307 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:33:04.307 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.403135+0000", 2024-09-12T22:33:04.307 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 86.823046489000006, 2024-09-12T22:33:04.307 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016294211999999999, 2024-09-12T22:33:04.307 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:04.307 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:04.307 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:04.308 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:04.308 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.308 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:04.308 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403135+0000", 2024-09-12T22:33:04.308 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:04.308 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.308 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.308 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:04.308 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403135+0000", 2024-09-12T22:33:04.308 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:04.308 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.308 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.308 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:04.309 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403136+0000", 2024-09-12T22:33:04.309 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.4e-07 2024-09-12T22:33:04.309 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.309 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.309 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:04.309 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403149+0000", 2024-09-12T22:33:04.309 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2723e-05 2024-09-12T22:33:04.309 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.309 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.309 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:04.309 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403158+0000", 2024-09-12T22:33:04.309 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3919999999999992e-06 2024-09-12T22:33:04.309 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.309 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.310 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:04.310 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403166+0000", 2024-09-12T22:33:04.310 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.2309999999999996e-06 2024-09-12T22:33:04.310 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.310 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.310 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:04.310 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409944+0000", 2024-09-12T22:33:04.310 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0067775309999999998 2024-09-12T22:33:04.310 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.310 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.310 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:04.310 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410032+0000", 2024-09-12T22:33:04.310 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.7906999999999997e-05 2024-09-12T22:33:04.311 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.311 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.311 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:33:04.311 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410152+0000", 2024-09-12T22:33:04.311 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012037800000000001 2024-09-12T22:33:04.311 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.311 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.311 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:04.311 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.411945+0000", 2024-09-12T22:33:04.311 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0017931850000000001 2024-09-12T22:33:04.311 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.311 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.311 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:04.311 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419319+0000", 2024-09-12T22:33:04.312 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0073731780000000002 2024-09-12T22:33:04.312 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.312 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.312 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:04.312 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419376+0000", 2024-09-12T22:33:04.312 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7728e-05 2024-09-12T22:33:04.312 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.312 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.312 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:04.312 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419429+0000", 2024-09-12T22:33:04.312 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3019000000000002e-05 2024-09-12T22:33:04.312 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:04.312 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:04.313 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:04.313 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.313 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.313 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:33:04.313 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.403185+0000", 2024-09-12T22:33:04.313 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 86.822996607999997, 2024-09-12T22:33:04.313 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.014902164000000001, 2024-09-12T22:33:04.313 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:04.313 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:04.313 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:04.313 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:04.313 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.313 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:04.313 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403185+0000", 2024-09-12T22:33:04.314 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:04.314 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.314 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.314 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:04.314 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403185+0000", 2024-09-12T22:33:04.314 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:04.314 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.314 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.314 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:04.314 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403186+0000", 2024-09-12T22:33:04.314 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9400000000000005e-07 2024-09-12T22:33:04.314 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.314 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.314 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:04.315 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403191+0000", 2024-09-12T22:33:04.315 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6980000000000003e-06 2024-09-12T22:33:04.315 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.315 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.315 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:04.315 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403199+0000", 2024-09-12T22:33:04.315 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2520000000000002e-06 2024-09-12T22:33:04.315 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.315 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.315 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:04.315 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403205+0000", 2024-09-12T22:33:04.315 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.908e-06 2024-09-12T22:33:04.315 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.315 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.316 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:04.316 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403359+0000", 2024-09-12T22:33:04.316 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000154544 2024-09-12T22:33:04.316 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.316 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.316 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:04.316 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403528+0000", 2024-09-12T22:33:04.316 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000168455 2024-09-12T22:33:04.316 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.316 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.316 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:33:04.316 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403763+0000", 2024-09-12T22:33:04.316 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00023539599999999999 2024-09-12T22:33:04.317 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.317 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.317 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:04.317 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409378+0000", 2024-09-12T22:33:04.317 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056150000000000002 2024-09-12T22:33:04.317 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.317 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.317 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:04.317 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418012+0000", 2024-09-12T22:33:04.317 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0086339559999999999 2024-09-12T22:33:04.317 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.317 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.317 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:04.318 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418046+0000", 2024-09-12T22:33:04.318 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4267999999999998e-05 2024-09-12T22:33:04.318 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.318 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.318 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:04.318 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418087+0000", 2024-09-12T22:33:04.318 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0992999999999999e-05 2024-09-12T22:33:04.318 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:04.318 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:04.318 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:04.318 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.318 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.318 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:33:04.318 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.403273+0000", 2024-09-12T22:33:04.319 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 86.822908656999999, 2024-09-12T22:33:04.319 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.014934866, 2024-09-12T22:33:04.319 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:04.319 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:04.319 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:04.319 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:04.319 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.319 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:04.319 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403273+0000", 2024-09-12T22:33:04.319 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:04.319 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.319 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.319 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:04.319 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403273+0000", 2024-09-12T22:33:04.320 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:04.320 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.320 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.320 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:04.320 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403274+0000", 2024-09-12T22:33:04.320 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.297e-06 2024-09-12T22:33:04.320 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.320 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.320 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:04.320 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403282+0000", 2024-09-12T22:33:04.320 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6340000000000001e-06 2024-09-12T22:33:04.320 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.320 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.321 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:04.321 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403305+0000", 2024-09-12T22:33:04.321 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3149000000000001e-05 2024-09-12T22:33:04.321 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.321 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.321 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:04.321 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403320+0000", 2024-09-12T22:33:04.321 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4527e-05 2024-09-12T22:33:04.321 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.321 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.321 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:04.321 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.404928+0000", 2024-09-12T22:33:04.321 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001608459 2024-09-12T22:33:04.322 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.322 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.322 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:04.322 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405218+0000", 2024-09-12T22:33:04.322 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00028982900000000002 2024-09-12T22:33:04.322 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.322 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.322 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:33:04.322 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405829+0000", 2024-09-12T22:33:04.322 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00061127900000000005 2024-09-12T22:33:04.322 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.322 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.322 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:04.322 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409403+0000", 2024-09-12T22:33:04.323 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.003573597 2024-09-12T22:33:04.323 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.323 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.323 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:04.323 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418138+0000", 2024-09-12T22:33:04.323 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0087349969999999996 2024-09-12T22:33:04.323 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.323 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.323 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:04.323 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418178+0000", 2024-09-12T22:33:04.323 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0649999999999999e-05 2024-09-12T22:33:04.323 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.323 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.324 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:04.324 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418208+0000", 2024-09-12T22:33:04.324 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9448e-05 2024-09-12T22:33:04.324 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:04.324 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:04.324 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:04.324 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.324 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.324 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:33:04.324 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.405456+0000", 2024-09-12T22:33:04.324 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 86.820725511999996, 2024-09-12T22:33:04.324 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012888389, 2024-09-12T22:33:04.324 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:04.325 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:04.325 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:04.325 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:04.325 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.325 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:04.325 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405456+0000", 2024-09-12T22:33:04.325 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:04.325 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.325 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.325 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:04.325 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405456+0000", 2024-09-12T22:33:04.325 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:04.325 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.325 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.326 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:04.326 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405457+0000", 2024-09-12T22:33:04.326 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.6599999999999994e-07 2024-09-12T22:33:04.326 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.326 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.326 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:04.326 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405463+0000", 2024-09-12T22:33:04.326 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4739999999999996e-06 2024-09-12T22:33:04.326 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.326 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.326 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:04.326 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405474+0000", 2024-09-12T22:33:04.326 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1095e-05 2024-09-12T22:33:04.326 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.327 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.327 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:04.327 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405482+0000", 2024-09-12T22:33:04.327 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3610000000000001e-06 2024-09-12T22:33:04.327 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.327 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.327 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:04.327 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407051+0000", 2024-09-12T22:33:04.327 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0015688970000000001 2024-09-12T22:33:04.327 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.327 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.327 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:04.327 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407259+0000", 2024-09-12T22:33:04.327 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00020778300000000001 2024-09-12T22:33:04.328 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.328 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.328 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:33:04.328 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407622+0000", 2024-09-12T22:33:04.328 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000363066 2024-09-12T22:33:04.328 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.328 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.328 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:04.328 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409438+0000", 2024-09-12T22:33:04.328 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001816319 2024-09-12T22:33:04.328 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.328 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.329 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:04.329 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418257+0000", 2024-09-12T22:33:04.329 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0088187720000000008 2024-09-12T22:33:04.329 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.329 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.329 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:04.329 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418308+0000", 2024-09-12T22:33:04.329 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1180000000000001e-05 2024-09-12T22:33:04.329 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.329 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.329 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:04.329 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418345+0000", 2024-09-12T22:33:04.329 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6476000000000001e-05 2024-09-12T22:33:04.330 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:04.330 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:04.330 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:04.330 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.330 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.330 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:33:04.330 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.405496+0000", 2024-09-12T22:33:04.330 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 86.820686155000004, 2024-09-12T22:33:04.330 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013016012, 2024-09-12T22:33:04.330 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:04.330 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:04.330 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:04.330 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:04.331 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.331 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:04.331 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405496+0000", 2024-09-12T22:33:04.331 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:04.331 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.331 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.331 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:04.331 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405496+0000", 2024-09-12T22:33:04.331 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:04.331 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.331 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.331 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:04.331 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405496+0000", 2024-09-12T22:33:04.331 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7999999999999995e-07 2024-09-12T22:33:04.332 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.332 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.332 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:04.332 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405501+0000", 2024-09-12T22:33:04.332 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8359999999999999e-06 2024-09-12T22:33:04.332 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.332 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.332 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:04.332 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405514+0000", 2024-09-12T22:33:04.332 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2522e-05 2024-09-12T22:33:04.332 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.332 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.333 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:04.333 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405521+0000", 2024-09-12T22:33:04.333 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5020000000000003e-06 2024-09-12T22:33:04.333 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.333 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.333 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:04.333 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405575+0000", 2024-09-12T22:33:04.333 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4169999999999998e-05 2024-09-12T22:33:04.333 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.333 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.333 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:04.333 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405697+0000", 2024-09-12T22:33:04.333 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000121301 2024-09-12T22:33:04.334 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.334 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.334 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:33:04.334 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405829+0000", 2024-09-12T22:33:04.334 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000132662 2024-09-12T22:33:04.334 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.334 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.334 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:04.334 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409155+0000", 2024-09-12T22:33:04.334 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0033259050000000001 2024-09-12T22:33:04.334 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.334 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.334 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:04.335 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418425+0000", 2024-09-12T22:33:04.335 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0092696319999999999 2024-09-12T22:33:04.335 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.335 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.335 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:04.335 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418471+0000", 2024-09-12T22:33:04.335 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6213e-05 2024-09-12T22:33:04.335 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.335 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.335 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:04.335 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418512+0000", 2024-09-12T22:33:04.335 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0589000000000001e-05 2024-09-12T22:33:04.335 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:04.335 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:04.336 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:04.336 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.336 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.336 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:33:04.336 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.406108+0000", 2024-09-12T22:33:04.336 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 86.820073758000007, 2024-09-12T22:33:04.336 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012458175, 2024-09-12T22:33:04.336 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:04.336 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:04.336 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:04.336 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:04.336 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.337 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:04.337 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406108+0000", 2024-09-12T22:33:04.337 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:04.337 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.337 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.337 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:04.337 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406108+0000", 2024-09-12T22:33:04.337 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:04.337 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.337 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.337 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:04.337 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406109+0000", 2024-09-12T22:33:04.337 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9899999999999999e-07 2024-09-12T22:33:04.338 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.338 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.338 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:04.338 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406115+0000", 2024-09-12T22:33:04.338 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9030000000000001e-06 2024-09-12T22:33:04.338 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.338 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.338 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:04.338 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406141+0000", 2024-09-12T22:33:04.338 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5999e-05 2024-09-12T22:33:04.338 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.338 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.338 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:04.339 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406150+0000", 2024-09-12T22:33:04.339 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.6050000000000004e-06 2024-09-12T22:33:04.339 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.339 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.339 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:04.339 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408163+0000", 2024-09-12T22:33:04.339 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0020122769999999998 2024-09-12T22:33:04.339 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.339 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.339 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:04.339 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408309+0000", 2024-09-12T22:33:04.339 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014606999999999999 2024-09-12T22:33:04.339 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.340 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.340 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:33:04.340 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408433+0000", 2024-09-12T22:33:04.340 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012460300000000001 2024-09-12T22:33:04.340 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.340 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.340 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:04.340 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409903+0000", 2024-09-12T22:33:04.340 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001469499 2024-09-12T22:33:04.340 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.340 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.340 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:04.340 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418427+0000", 2024-09-12T22:33:04.340 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0085241139999999993 2024-09-12T22:33:04.341 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.341 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.341 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:04.341 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418471+0000", 2024-09-12T22:33:04.341 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4474000000000001e-05 2024-09-12T22:33:04.341 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.341 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.341 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:04.341 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418566+0000", 2024-09-12T22:33:04.341 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.4732e-05 2024-09-12T22:33:04.341 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:04.341 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:04.341 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:04.341 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.342 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.342 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:33:04.342 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.407266+0000", 2024-09-12T22:33:04.342 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 86.818915902000001, 2024-09-12T22:33:04.342 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011442905, 2024-09-12T22:33:04.342 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:04.342 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:04.342 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2024-09-12T22:33:04.342 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:04.342 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.342 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:04.342 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407266+0000", 2024-09-12T22:33:04.343 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:04.343 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.343 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.343 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:04.343 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407266+0000", 2024-09-12T22:33:04.343 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:04.343 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.343 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.343 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:04.343 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407266+0000", 2024-09-12T22:33:04.343 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7899999999999998e-07 2024-09-12T22:33:04.343 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.343 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.344 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:04.344 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407269+0000", 2024-09-12T22:33:04.344 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9210000000000001e-06 2024-09-12T22:33:04.344 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.344 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.344 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:04.344 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407331+0000", 2024-09-12T22:33:04.344 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1376000000000003e-05 2024-09-12T22:33:04.344 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.344 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.344 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:04.344 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407337+0000", 2024-09-12T22:33:04.344 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1929999999999998e-06 2024-09-12T22:33:04.344 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.345 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.345 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:04.345 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408974+0000", 2024-09-12T22:33:04.345 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0016367109999999999 2024-09-12T22:33:04.345 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.345 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.345 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:04.345 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409112+0000", 2024-09-12T22:33:04.345 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000137952 2024-09-12T22:33:04.345 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.345 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.345 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:04.345 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418709+0000", 2024-09-12T22:33:04.346 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0095971730000000005 2024-09-12T22:33:04.346 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:04.346 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:04.346 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:04.346 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:04.346 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:04.346 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-09-12T22:33:04.347 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:04.346+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:04.348 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:33:04.448 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:04.446+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:04.465 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:33:04.465 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [ 2024-09-12T22:33:04.465 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.465 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4490.0:5756 4.2d 4.52223aed (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T22:33:04.465 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:04.464355+0000", 2024-09-12T22:33:04.465 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 9.2770999999999997e-05, 2024-09-12T22:33:04.465 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000112297, 2024-09-12T22:33:04.466 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:04.466 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:04.466 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "reached pg", 2024-09-12T22:33:04.466 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:33:04.466 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4490", 2024-09-12T22:33:04.466 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:04.466 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 5756 2024-09-12T22:33:04.466 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.466 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:04.466 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.466 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:04.467 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.464355+0000", 2024-09-12T22:33:04.467 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:04.467 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.467 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.467 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:04.467 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.464355+0000", 2024-09-12T22:33:04.467 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:04.467 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.467 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.467 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:04.467 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.464356+0000", 2024-09-12T22:33:04.468 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5899999999999995e-07 2024-09-12T22:33:04.468 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.468 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.468 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:04.468 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.464361+0000", 2024-09-12T22:33:04.468 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4099999999999999e-06 2024-09-12T22:33:04.468 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.468 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.468 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:04.468 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.464372+0000", 2024-09-12T22:33:04.468 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0631e-05 2024-09-12T22:33:04.468 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.468 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.469 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:04.469 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.464377+0000", 2024-09-12T22:33:04.469 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8600000000000001e-06 2024-09-12T22:33:04.469 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.469 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.469 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:04.469 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.464448+0000", 2024-09-12T22:33:04.469 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1730999999999995e-05 2024-09-12T22:33:04.469 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:04.469 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:04.469 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:04.469 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:04.470 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-12T22:33:04.470 INFO:teuthology.orchestra.run.smithi148.stdout: "num_ops": 1 2024-09-12T22:33:04.470 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:33:04.475 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:33:04.496 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T22:33:04.549 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:04.548+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:04.621 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:33:04.622 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:33:04.622 INFO:teuthology.orchestra.run.smithi148.stdout: "complaint_time": 30, 2024-09-12T22:33:04.622 INFO:teuthology.orchestra.run.smithi148.stdout: "num_blocked_ops": 0 2024-09-12T22:33:04.622 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:33:04.631 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:33:04.650 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:04.649+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:04.745 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:33:04.745 INFO:teuthology.orchestra.run.smithi148.stdout: "size": 20, 2024-09-12T22:33:04.745 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 600, 2024-09-12T22:33:04.745 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [ 2024-09-12T22:33:04.746 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.746 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:98 3.1f 3:f83d65d8:::200.00000004:head [write 409563~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-09-12T22:33:04.746 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:04.385076+0000", 2024-09-12T22:33:04.746 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.35739943099999999, 2024-09-12T22:33:04.746 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.022769053000000001, 2024-09-12T22:33:04.746 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:04.746 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:04.746 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:04.746 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:04.746 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.746 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:04.747 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385076+0000", 2024-09-12T22:33:04.747 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:04.747 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.747 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.747 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:04.747 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385076+0000", 2024-09-12T22:33:04.747 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:04.747 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.747 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.747 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:04.747 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385076+0000", 2024-09-12T22:33:04.747 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8799999999999998e-07 2024-09-12T22:33:04.748 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.748 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.748 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:04.748 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385082+0000", 2024-09-12T22:33:04.748 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0950000000000003e-06 2024-09-12T22:33:04.748 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.748 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.748 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:04.748 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385087+0000", 2024-09-12T22:33:04.748 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.463e-06 2024-09-12T22:33:04.748 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.749 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.749 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:04.749 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385090+0000", 2024-09-12T22:33:04.749 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4359999999999998e-06 2024-09-12T22:33:04.749 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.749 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.749 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:04.749 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.400713+0000", 2024-09-12T22:33:04.749 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.015622416 2024-09-12T22:33:04.749 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.749 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.749 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:04.750 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.400785+0000", 2024-09-12T22:33:04.750 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1761000000000006e-05 2024-09-12T22:33:04.750 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.750 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.750 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:04.750 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.400904+0000", 2024-09-12T22:33:04.750 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000119422 2024-09-12T22:33:04.750 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.750 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.750 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:04.750 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.403113+0000", 2024-09-12T22:33:04.751 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0022093899999999999 2024-09-12T22:33:04.751 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.751 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.751 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:04.751 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.407757+0000", 2024-09-12T22:33:04.751 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0046435119999999998 2024-09-12T22:33:04.751 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.751 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.751 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:04.751 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.407802+0000", 2024-09-12T22:33:04.751 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5479000000000003e-05 2024-09-12T22:33:04.751 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.752 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.752 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:04.752 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.407845+0000", 2024-09-12T22:33:04.752 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2790999999999997e-05 2024-09-12T22:33:04.752 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:04.752 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:04.752 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:04.752 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.752 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.752 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:99 3.1f 3:f83d65d8:::200.00000004:head [write 410964~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-09-12T22:33:04.752 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:04.385097+0000", 2024-09-12T22:33:04.753 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.35737817, 2024-09-12T22:33:04.753 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.02283048, 2024-09-12T22:33:04.753 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:04.753 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:04.753 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:04.753 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:04.753 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.754 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:04.754 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385097+0000", 2024-09-12T22:33:04.754 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:04.754 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.754 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.754 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:04.754 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385097+0000", 2024-09-12T22:33:04.754 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:04.754 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.754 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.754 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:04.755 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385098+0000", 2024-09-12T22:33:04.755 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5699999999999999e-07 2024-09-12T22:33:04.755 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.755 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.755 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:04.755 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385100+0000", 2024-09-12T22:33:04.755 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9139999999999998e-06 2024-09-12T22:33:04.755 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.755 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.755 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:04.755 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385104+0000", 2024-09-12T22:33:04.755 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1910000000000002e-06 2024-09-12T22:33:04.756 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.756 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.756 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:04.756 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385107+0000", 2024-09-12T22:33:04.756 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.7939999999999998e-06 2024-09-12T22:33:04.756 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.756 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.756 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:04.756 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.401260+0000", 2024-09-12T22:33:04.756 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016153700999999999 2024-09-12T22:33:04.756 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.757 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.757 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:04.757 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.401337+0000", 2024-09-12T22:33:04.757 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.6470000000000005e-05 2024-09-12T22:33:04.757 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.757 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.757 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:04.757 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.401462+0000", 2024-09-12T22:33:04.757 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000125666 2024-09-12T22:33:04.757 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.757 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.758 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:04.758 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.404304+0000", 2024-09-12T22:33:04.758 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0028414809999999999 2024-09-12T22:33:04.758 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.758 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.758 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:04.758 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.407853+0000", 2024-09-12T22:33:04.758 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0035488310000000001 2024-09-12T22:33:04.758 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.758 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.758 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:04.758 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.407894+0000", 2024-09-12T22:33:04.759 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1455000000000002e-05 2024-09-12T22:33:04.759 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.759 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.759 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:04.759 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.407928+0000", 2024-09-12T22:33:04.759 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3720000000000002e-05 2024-09-12T22:33:04.759 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:04.759 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:04.759 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:04.759 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.759 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.759 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:100 3.1f 3:f83d65d8:::200.00000004:head [write 412367~1404 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-09-12T22:33:04.760 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:04.385111+0000", 2024-09-12T22:33:04.760 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.357364562, 2024-09-12T22:33:04.760 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.022896741000000002, 2024-09-12T22:33:04.760 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:04.760 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:04.760 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:04.760 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:04.760 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.760 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:04.760 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385111+0000", 2024-09-12T22:33:04.760 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:04.761 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.761 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.761 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:04.761 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385111+0000", 2024-09-12T22:33:04.761 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:04.761 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.761 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.761 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:04.761 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385111+0000", 2024-09-12T22:33:04.761 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.22e-07 2024-09-12T22:33:04.762 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.762 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.762 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:04.762 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385113+0000", 2024-09-12T22:33:04.762 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7069999999999999e-06 2024-09-12T22:33:04.762 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.762 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.762 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:04.762 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385119+0000", 2024-09-12T22:33:04.762 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2090000000000002e-06 2024-09-12T22:33:04.762 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.763 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.763 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:04.763 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385122+0000", 2024-09-12T22:33:04.763 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.033e-06 2024-09-12T22:33:04.763 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.763 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.763 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:04.763 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.401990+0000", 2024-09-12T22:33:04.763 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016867534 2024-09-12T22:33:04.763 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.763 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.764 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:04.764 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.402057+0000", 2024-09-12T22:33:04.764 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7118000000000004e-05 2024-09-12T22:33:04.764 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.764 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.764 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:04.764 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.402161+0000", 2024-09-12T22:33:04.764 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000103905 2024-09-12T22:33:04.764 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.764 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.764 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:04.765 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.404360+0000", 2024-09-12T22:33:04.765 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0021992940000000001 2024-09-12T22:33:04.765 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.765 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.765 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:04.765 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.407935+0000", 2024-09-12T22:33:04.765 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0035751630000000001 2024-09-12T22:33:04.765 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.765 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.765 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:04.765 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.407976+0000", 2024-09-12T22:33:04.766 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0376000000000001e-05 2024-09-12T22:33:04.766 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.766 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.766 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:04.766 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.408008+0000", 2024-09-12T22:33:04.766 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.218e-05 2024-09-12T22:33:04.766 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:04.766 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:04.766 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:04.766 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.766 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.767 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:101 3.1f 3:f83d65d8:::200.00000004:head [write 413771~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-09-12T22:33:04.767 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:04.385126+0000", 2024-09-12T22:33:04.767 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.35734956099999998, 2024-09-12T22:33:04.767 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.022964140000000001, 2024-09-12T22:33:04.767 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:04.767 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:04.767 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:04.767 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:04.767 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.767 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:04.767 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385126+0000", 2024-09-12T22:33:04.768 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:04.768 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.768 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.768 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:04.768 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385126+0000", 2024-09-12T22:33:04.768 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:04.768 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.768 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.768 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:04.768 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385126+0000", 2024-09-12T22:33:04.768 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.29e-07 2024-09-12T22:33:04.769 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.769 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.769 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:04.769 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385139+0000", 2024-09-12T22:33:04.769 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2877000000000001e-05 2024-09-12T22:33:04.769 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.769 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.769 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:04.769 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385144+0000", 2024-09-12T22:33:04.769 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9840000000000001e-06 2024-09-12T22:33:04.769 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.770 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.770 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:04.770 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385147+0000", 2024-09-12T22:33:04.770 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0750000000000002e-06 2024-09-12T22:33:04.770 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.770 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.770 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:04.770 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.402511+0000", 2024-09-12T22:33:04.770 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017363456999999999 2024-09-12T22:33:04.770 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.771 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.771 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:04.771 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.402587+0000", 2024-09-12T22:33:04.771 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.6128e-05 2024-09-12T22:33:04.771 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.771 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.771 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:04.771 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.402706+0000", 2024-09-12T22:33:04.771 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000119157 2024-09-12T22:33:04.771 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.771 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.771 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:04.772 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.404414+0000", 2024-09-12T22:33:04.772 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00170773 2024-09-12T22:33:04.772 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.772 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.772 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:04.772 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.408015+0000", 2024-09-12T22:33:04.772 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003601389 2024-09-12T22:33:04.772 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.772 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.772 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:04.772 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.408057+0000", 2024-09-12T22:33:04.772 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1548999999999998e-05 2024-09-12T22:33:04.773 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.773 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.773 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:04.773 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.408090+0000", 2024-09-12T22:33:04.773 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3565000000000001e-05 2024-09-12T22:33:04.773 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:04.773 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:04.773 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:04.773 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.773 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.773 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:102 3.1f 3:f83d65d8:::200.00000004:head [write 415176~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-09-12T22:33:04.774 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:04.385152+0000", 2024-09-12T22:33:04.774 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.35732324300000001, 2024-09-12T22:33:04.774 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.023015768999999998, 2024-09-12T22:33:04.774 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:04.774 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:04.774 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:04.774 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:04.774 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.774 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:04.774 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385152+0000", 2024-09-12T22:33:04.774 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:04.774 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.775 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.775 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:04.775 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385152+0000", 2024-09-12T22:33:04.775 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:04.775 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.775 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.775 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:04.775 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385155+0000", 2024-09-12T22:33:04.776 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4200000000000001e-06 2024-09-12T22:33:04.776 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.776 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.776 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:04.776 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385157+0000", 2024-09-12T22:33:04.776 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.8640000000000001e-06 2024-09-12T22:33:04.776 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.776 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.776 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:04.776 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385161+0000", 2024-09-12T22:33:04.776 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1590000000000003e-06 2024-09-12T22:33:04.776 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.777 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.777 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:04.777 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385164+0000", 2024-09-12T22:33:04.777 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8150000000000002e-06 2024-09-12T22:33:04.777 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.777 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.777 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:04.777 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.403160+0000", 2024-09-12T22:33:04.777 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017996174 2024-09-12T22:33:04.777 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.777 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.778 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:04.778 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.403229+0000", 2024-09-12T22:33:04.778 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.9301999999999995e-05 2024-09-12T22:33:04.778 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.778 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.778 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:04.778 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.403341+0000", 2024-09-12T22:33:04.778 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000112002 2024-09-12T22:33:04.778 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.778 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.778 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:04.779 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.405776+0000", 2024-09-12T22:33:04.779 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0024350079999999998 2024-09-12T22:33:04.779 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.779 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.779 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:04.779 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.408097+0000", 2024-09-12T22:33:04.779 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.002321086 2024-09-12T22:33:04.779 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.779 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.779 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:04.779 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.408137+0000", 2024-09-12T22:33:04.779 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9743999999999998e-05 2024-09-12T22:33:04.779 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.780 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.780 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:04.780 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.408168+0000", 2024-09-12T22:33:04.780 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.1195000000000002e-05 2024-09-12T22:33:04.780 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:04.780 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:04.780 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:04.780 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.780 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.780 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:103 3.1f 3:f83d65d8:::200.00000004:head [write 416575~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-09-12T22:33:04.780 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:04.385167+0000", 2024-09-12T22:33:04.781 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.35730869599999998, 2024-09-12T22:33:04.781 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.024972646000000001, 2024-09-12T22:33:04.781 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:04.781 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:04.781 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:04.781 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:04.781 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.781 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:04.781 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385167+0000", 2024-09-12T22:33:04.781 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:04.781 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.781 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.782 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:04.782 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385167+0000", 2024-09-12T22:33:04.782 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:04.782 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.782 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.782 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:04.782 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385167+0000", 2024-09-12T22:33:04.782 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.2100000000000001e-07 2024-09-12T22:33:04.782 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.782 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.782 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:04.783 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385176+0000", 2024-09-12T22:33:04.783 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.8249999999999994e-06 2024-09-12T22:33:04.783 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.783 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.783 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:04.783 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385182+0000", 2024-09-12T22:33:04.783 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0469999999999999e-06 2024-09-12T22:33:04.783 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.783 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.783 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:04.783 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385185+0000", 2024-09-12T22:33:04.783 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0570000000000001e-06 2024-09-12T22:33:04.784 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.784 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.784 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:04.784 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.403629+0000", 2024-09-12T22:33:04.784 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.018443838000000001 2024-09-12T22:33:04.784 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.784 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.784 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:04.784 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.403710+0000", 2024-09-12T22:33:04.784 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0851000000000002e-05 2024-09-12T22:33:04.784 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.785 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.785 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:04.785 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.403859+0000", 2024-09-12T22:33:04.785 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014873800000000001 2024-09-12T22:33:04.785 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.785 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.785 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:04.785 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.406967+0000", 2024-09-12T22:33:04.785 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0031080320000000002 2024-09-12T22:33:04.785 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.785 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.786 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:04.786 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410055+0000", 2024-09-12T22:33:04.786 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003088698 2024-09-12T22:33:04.786 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.786 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.786 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:04.786 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410104+0000", 2024-09-12T22:33:04.786 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8469e-05 2024-09-12T22:33:04.786 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.786 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.786 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:04.786 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410140+0000", 2024-09-12T22:33:04.787 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.587e-05 2024-09-12T22:33:04.787 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:04.787 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:04.787 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:04.787 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.787 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.787 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:104 3.1f 3:f83d65d8:::200.00000004:head [write 417974~1421 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-09-12T22:33:04.787 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:04.385189+0000", 2024-09-12T22:33:04.787 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.35728654199999998, 2024-09-12T22:33:04.787 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.025034507000000001, 2024-09-12T22:33:04.788 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:04.788 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:04.788 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:04.788 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:04.788 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.788 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:04.788 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385189+0000", 2024-09-12T22:33:04.788 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:04.788 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.788 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.788 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:04.788 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385189+0000", 2024-09-12T22:33:04.789 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:04.789 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.789 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.789 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:04.789 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385189+0000", 2024-09-12T22:33:04.789 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5199999999999998e-07 2024-09-12T22:33:04.789 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.789 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.789 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:04.789 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385191+0000", 2024-09-12T22:33:04.789 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7489999999999999e-06 2024-09-12T22:33:04.789 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.790 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.790 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:04.790 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385194+0000", 2024-09-12T22:33:04.790 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.1039999999999998e-06 2024-09-12T22:33:04.790 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.790 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.790 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:04.790 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385197+0000", 2024-09-12T22:33:04.790 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.3740000000000001e-06 2024-09-12T22:33:04.790 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.790 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.791 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:04.791 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.404717+0000", 2024-09-12T22:33:04.791 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.019520056000000001 2024-09-12T22:33:04.791 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.791 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.791 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:04.791 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.404795+0000", 2024-09-12T22:33:04.791 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.818e-05 2024-09-12T22:33:04.791 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.791 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.791 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:04.792 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.404930+0000", 2024-09-12T22:33:04.792 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013531400000000001 2024-09-12T22:33:04.792 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.792 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.792 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:04.792 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.407028+0000", 2024-09-12T22:33:04.792 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0020980899999999999 2024-09-12T22:33:04.792 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.792 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.792 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:04.792 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410147+0000", 2024-09-12T22:33:04.793 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0031188710000000001 2024-09-12T22:33:04.793 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.793 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.793 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:04.793 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410190+0000", 2024-09-12T22:33:04.793 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2899999999999999e-05 2024-09-12T22:33:04.793 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.793 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.793 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:04.793 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410224+0000", 2024-09-12T22:33:04.793 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3617e-05 2024-09-12T22:33:04.793 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:04.794 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:04.794 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:04.794 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.794 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.794 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:105 3.1f 3:f83d65d8:::200.00000004:head [write 419395~1406 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-09-12T22:33:04.794 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:04.385200+0000", 2024-09-12T22:33:04.794 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.35727598700000002, 2024-09-12T22:33:04.794 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.025105683, 2024-09-12T22:33:04.794 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:04.794 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:04.794 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:04.794 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:04.795 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.795 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:04.795 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385200+0000", 2024-09-12T22:33:04.795 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:04.795 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.795 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.795 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:04.795 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385200+0000", 2024-09-12T22:33:04.795 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:04.795 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.795 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.796 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:04.796 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385200+0000", 2024-09-12T22:33:04.796 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.05e-07 2024-09-12T22:33:04.796 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.796 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.796 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:04.796 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385205+0000", 2024-09-12T22:33:04.796 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.6269999999999997e-06 2024-09-12T22:33:04.796 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.796 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.796 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:04.797 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385209+0000", 2024-09-12T22:33:04.797 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.439e-06 2024-09-12T22:33:04.797 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.797 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.797 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:04.797 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385211+0000", 2024-09-12T22:33:04.797 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5040000000000001e-06 2024-09-12T22:33:04.797 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.797 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.797 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:04.797 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.405286+0000", 2024-09-12T22:33:04.798 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.020074229999999998 2024-09-12T22:33:04.798 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.798 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.798 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:04.798 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.405359+0000", 2024-09-12T22:33:04.798 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3355000000000005e-05 2024-09-12T22:33:04.798 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.798 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.798 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:04.798 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.405471+0000", 2024-09-12T22:33:04.798 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000112175 2024-09-12T22:33:04.799 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.799 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.799 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:04.799 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.408223+0000", 2024-09-12T22:33:04.799 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0027517779999999999 2024-09-12T22:33:04.799 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.799 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.799 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:04.799 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410231+0000", 2024-09-12T22:33:04.799 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0020078190000000001 2024-09-12T22:33:04.799 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.799 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.800 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:04.800 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410273+0000", 2024-09-12T22:33:04.800 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2530000000000001e-05 2024-09-12T22:33:04.800 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.800 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.800 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:04.800 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410305+0000", 2024-09-12T22:33:04.800 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2020999999999997e-05 2024-09-12T22:33:04.800 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:04.800 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:04.800 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:04.801 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.801 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.801 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:106 3.1f 3:f83d65d8:::200.00000004:head [write 420801~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-09-12T22:33:04.801 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:04.385215+0000", 2024-09-12T22:33:04.801 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.35726066099999998, 2024-09-12T22:33:04.801 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.025168234000000001, 2024-09-12T22:33:04.801 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:04.801 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:04.801 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:04.801 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:04.801 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.801 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:04.802 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385215+0000", 2024-09-12T22:33:04.802 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:04.802 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.802 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.802 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:04.802 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385215+0000", 2024-09-12T22:33:04.802 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:04.802 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.802 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.802 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:04.802 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385215+0000", 2024-09-12T22:33:04.803 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.2600000000000001e-07 2024-09-12T22:33:04.803 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.803 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.803 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:04.803 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385217+0000", 2024-09-12T22:33:04.803 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7099999999999999e-06 2024-09-12T22:33:04.803 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.803 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.803 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:04.804 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385220+0000", 2024-09-12T22:33:04.804 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.004e-06 2024-09-12T22:33:04.804 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.804 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.804 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:04.805 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385223+0000", 2024-09-12T22:33:04.805 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.633e-06 2024-09-12T22:33:04.805 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.805 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.805 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:04.805 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.405826+0000", 2024-09-12T22:33:04.805 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.020603831999999999 2024-09-12T22:33:04.805 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.805 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.805 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:04.805 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.405898+0000", 2024-09-12T22:33:04.806 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1398999999999999e-05 2024-09-12T22:33:04.806 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.806 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.806 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:04.806 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.406011+0000", 2024-09-12T22:33:04.806 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000113411 2024-09-12T22:33:04.806 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.806 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.806 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:04.806 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.408285+0000", 2024-09-12T22:33:04.807 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.002273639 2024-09-12T22:33:04.807 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.807 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.807 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:04.807 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410313+0000", 2024-09-12T22:33:04.807 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0020280760000000002 2024-09-12T22:33:04.807 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.807 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.807 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:04.807 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410350+0000", 2024-09-12T22:33:04.807 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7307e-05 2024-09-12T22:33:04.807 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.808 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.808 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:04.808 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410383+0000", 2024-09-12T22:33:04.808 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2997000000000003e-05 2024-09-12T22:33:04.808 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:04.808 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:04.808 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:04.808 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.808 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.808 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:107 3.1f 3:f83d65d8:::200.00000004:head [write 422206~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-09-12T22:33:04.808 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:04.385226+0000", 2024-09-12T22:33:04.809 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.357249926, 2024-09-12T22:33:04.809 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.025350256000000002, 2024-09-12T22:33:04.809 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:04.809 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:04.809 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:04.809 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:04.809 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.809 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:04.809 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385226+0000", 2024-09-12T22:33:04.809 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:04.809 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.810 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.810 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:04.810 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385226+0000", 2024-09-12T22:33:04.810 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:04.810 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.810 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.810 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:04.810 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385226+0000", 2024-09-12T22:33:04.810 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.2399999999999999e-07 2024-09-12T22:33:04.810 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.810 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.811 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:04.811 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385228+0000", 2024-09-12T22:33:04.811 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.508e-06 2024-09-12T22:33:04.811 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.811 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.811 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:04.811 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385235+0000", 2024-09-12T22:33:04.811 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.3169999999999998e-06 2024-09-12T22:33:04.811 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.811 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.811 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:04.812 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385238+0000", 2024-09-12T22:33:04.812 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.9249999999999999e-06 2024-09-12T22:33:04.812 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.812 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.812 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:04.812 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.406376+0000", 2024-09-12T22:33:04.812 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.021138364999999999 2024-09-12T22:33:04.812 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.812 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.812 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:04.812 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.406451+0000", 2024-09-12T22:33:04.812 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4882000000000006e-05 2024-09-12T22:33:04.812 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.813 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.813 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:04.813 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.406590+0000", 2024-09-12T22:33:04.813 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000138627 2024-09-12T22:33:04.813 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.813 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.813 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:04.813 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410461+0000", 2024-09-12T22:33:04.813 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0038712109999999998 2024-09-12T22:33:04.813 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.813 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.814 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:04.814 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410493+0000", 2024-09-12T22:33:04.814 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2147999999999998e-05 2024-09-12T22:33:04.814 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.814 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.814 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:04.814 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410537+0000", 2024-09-12T22:33:04.814 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3792999999999999e-05 2024-09-12T22:33:04.814 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.814 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.814 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:04.814 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410576+0000", 2024-09-12T22:33:04.814 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9255999999999998e-05 2024-09-12T22:33:04.815 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:04.815 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:04.815 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:04.815 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.815 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.815 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4490.0:5682 4.3f 4:ff1ebe6d:::10000001a29.00000000:head [write 0~2106] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T22:33:04.815 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:04.386989+0000", 2024-09-12T22:33:04.815 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.35548700300000002, 2024-09-12T22:33:04.815 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.023595390000000001, 2024-09-12T22:33:04.815 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:04.815 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:04.815 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:04.816 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:33:04.816 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4490", 2024-09-12T22:33:04.816 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:04.816 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 5682 2024-09-12T22:33:04.816 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.816 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:04.816 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.816 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:04.816 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.386989+0000", 2024-09-12T22:33:04.816 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:04.816 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.817 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.817 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:04.817 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.386989+0000", 2024-09-12T22:33:04.817 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:04.817 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.817 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.817 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:04.817 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.386989+0000", 2024-09-12T22:33:04.817 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.8800000000000002e-07 2024-09-12T22:33:04.817 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.817 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.817 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:04.818 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.386994+0000", 2024-09-12T22:33:04.818 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4279999999999998e-06 2024-09-12T22:33:04.818 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.818 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.818 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:04.818 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.387001+0000", 2024-09-12T22:33:04.818 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.2320000000000004e-06 2024-09-12T22:33:04.818 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.818 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.818 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:04.819 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.387006+0000", 2024-09-12T22:33:04.819 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6589999999999998e-06 2024-09-12T22:33:04.819 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.819 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.819 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:04.819 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.407003+0000", 2024-09-12T22:33:04.819 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.019997635 2024-09-12T22:33:04.819 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.819 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.819 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:04.819 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.407134+0000", 2024-09-12T22:33:04.820 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013037899999999999 2024-09-12T22:33:04.820 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.820 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.820 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:04.820 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410469+0000", 2024-09-12T22:33:04.820 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0033353160000000001 2024-09-12T22:33:04.820 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.820 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.820 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:04.820 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410510+0000", 2024-09-12T22:33:04.820 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0553999999999998e-05 2024-09-12T22:33:04.821 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.821 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.821 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:04.821 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410584+0000", 2024-09-12T22:33:04.821 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4399000000000004e-05 2024-09-12T22:33:04.821 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:04.821 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:04.821 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:04.821 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.821 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.821 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:108 3.1f 3:f83d65d8:::200.00000004:head [write 423607~16211 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-09-12T22:33:04.822 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:04.392223+0000", 2024-09-12T22:33:04.822 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.35025300700000001, 2024-09-12T22:33:04.822 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.022025629000000001, 2024-09-12T22:33:04.822 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:04.822 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:04.822 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:04.822 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:04.822 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.822 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:04.822 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.392223+0000", 2024-09-12T22:33:04.822 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:04.823 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.823 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.823 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:04.823 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.392223+0000", 2024-09-12T22:33:04.823 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:04.823 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.823 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.823 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:04.823 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.392224+0000", 2024-09-12T22:33:04.823 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.358e-06 2024-09-12T22:33:04.823 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.823 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.824 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:04.824 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.392238+0000", 2024-09-12T22:33:04.824 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4408e-05 2024-09-12T22:33:04.824 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.824 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.824 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:04.824 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.392248+0000", 2024-09-12T22:33:04.824 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0013000000000001e-05 2024-09-12T22:33:04.824 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.824 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.824 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:04.824 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.392256+0000", 2024-09-12T22:33:04.825 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1060000000000002e-06 2024-09-12T22:33:04.825 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.825 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.825 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:04.825 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.407080+0000", 2024-09-12T22:33:04.825 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.014824519 2024-09-12T22:33:04.825 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.825 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.825 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:04.825 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.407152+0000", 2024-09-12T22:33:04.825 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1543000000000003e-05 2024-09-12T22:33:04.826 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.826 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.826 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:04.826 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.407270+0000", 2024-09-12T22:33:04.826 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000118721 2024-09-12T22:33:04.826 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.826 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.826 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:04.826 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410591+0000", 2024-09-12T22:33:04.826 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0033203080000000001 2024-09-12T22:33:04.826 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.826 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.827 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:04.827 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.414179+0000", 2024-09-12T22:33:04.827 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00358838 2024-09-12T22:33:04.827 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.827 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.827 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:04.827 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.414215+0000", 2024-09-12T22:33:04.827 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.5753999999999997e-05 2024-09-12T22:33:04.827 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.827 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.827 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:04.828 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.414248+0000", 2024-09-12T22:33:04.828 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3519000000000002e-05 2024-09-12T22:33:04.828 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:04.828 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:04.828 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:04.828 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.828 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.828 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:109 3.1f 3:f83d65d8:::200.00000004:head [write 439818~3871 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-09-12T22:33:04.828 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:04.393309+0000", 2024-09-12T22:33:04.828 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.34916689699999998, 2024-09-12T22:33:04.828 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.021084952000000001, 2024-09-12T22:33:04.828 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:04.829 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:04.829 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:04.829 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:04.829 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.829 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:04.829 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393309+0000", 2024-09-12T22:33:04.829 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:04.829 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.829 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.829 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:04.829 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393309+0000", 2024-09-12T22:33:04.830 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:04.830 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.830 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.830 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:04.830 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393309+0000", 2024-09-12T22:33:04.830 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.8400000000000004e-07 2024-09-12T22:33:04.830 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.830 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.830 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:04.830 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393317+0000", 2024-09-12T22:33:04.830 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.8199999999999997e-06 2024-09-12T22:33:04.831 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.831 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.831 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:04.831 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393327+0000", 2024-09-12T22:33:04.831 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.7450000000000007e-06 2024-09-12T22:33:04.831 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.831 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.831 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:04.831 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393334+0000", 2024-09-12T22:33:04.831 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3409999999999997e-06 2024-09-12T22:33:04.831 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.832 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.832 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:04.832 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.408316+0000", 2024-09-12T22:33:04.832 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.014981335 2024-09-12T22:33:04.832 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.832 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.832 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:04.832 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.408391+0000", 2024-09-12T22:33:04.832 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4948000000000001e-05 2024-09-12T22:33:04.832 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.832 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.833 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:04.833 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.408502+0000", 2024-09-12T22:33:04.833 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000111643 2024-09-12T22:33:04.833 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.833 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.833 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:04.833 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410597+0000", 2024-09-12T22:33:04.833 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0020942909999999999 2024-09-12T22:33:04.834 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.834 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.834 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:04.834 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.414301+0000", 2024-09-12T22:33:04.834 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0037040100000000002 2024-09-12T22:33:04.834 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.834 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.834 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:04.834 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.414355+0000", 2024-09-12T22:33:04.834 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4555999999999997e-05 2024-09-12T22:33:04.835 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.835 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.835 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:04.835 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.414394+0000", 2024-09-12T22:33:04.835 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.8578999999999998e-05 2024-09-12T22:33:04.835 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:04.835 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:04.835 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:04.835 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.835 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.836 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:110 3.1f 3:f83d65d8:::200.00000004:head [write 443689~1928 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-09-12T22:33:04.836 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:04.393358+0000", 2024-09-12T22:33:04.836 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.34911758700000001, 2024-09-12T22:33:04.836 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.021144165999999999, 2024-09-12T22:33:04.836 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:04.836 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:04.836 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:04.836 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:04.836 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.836 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:04.836 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393358+0000", 2024-09-12T22:33:04.837 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:04.837 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.837 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.837 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:04.837 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393358+0000", 2024-09-12T22:33:04.837 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:04.837 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.837 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.837 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:04.837 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393359+0000", 2024-09-12T22:33:04.837 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3900000000000005e-07 2024-09-12T22:33:04.837 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.838 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.838 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:04.838 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393363+0000", 2024-09-12T22:33:04.838 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0509999999999998e-06 2024-09-12T22:33:04.838 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.838 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.838 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:04.838 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393370+0000", 2024-09-12T22:33:04.838 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.8350000000000004e-06 2024-09-12T22:33:04.838 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.838 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.838 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:04.838 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393376+0000", 2024-09-12T22:33:04.839 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8030000000000002e-06 2024-09-12T22:33:04.839 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.839 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.839 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:04.839 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.408908+0000", 2024-09-12T22:33:04.839 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.01553218 2024-09-12T22:33:04.839 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.839 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.839 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:04.839 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.408978+0000", 2024-09-12T22:33:04.840 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.9142999999999999e-05 2024-09-12T22:33:04.840 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.840 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.840 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:04.840 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.409088+0000", 2024-09-12T22:33:04.840 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000110357 2024-09-12T22:33:04.840 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.840 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.840 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:04.840 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.411046+0000", 2024-09-12T22:33:04.840 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001958338 2024-09-12T22:33:04.840 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.841 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.841 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:04.841 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.414431+0000", 2024-09-12T22:33:04.841 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0033846340000000001 2024-09-12T22:33:04.841 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.841 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.841 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:04.841 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.414474+0000", 2024-09-12T22:33:04.841 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2777000000000001e-05 2024-09-12T22:33:04.841 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.841 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.841 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:04.842 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.414502+0000", 2024-09-12T22:33:04.842 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8509000000000001e-05 2024-09-12T22:33:04.842 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:04.842 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:04.842 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:04.842 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.842 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.842 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:111 3.1f 3:f83d65d8:::200.00000004:head [write 445617~3886 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-09-12T22:33:04.842 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:04.393579+0000", 2024-09-12T22:33:04.842 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.348897028, 2024-09-12T22:33:04.842 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.021052739000000001, 2024-09-12T22:33:04.842 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:04.842 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:04.843 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:04.843 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:04.843 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.843 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:04.843 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393579+0000", 2024-09-12T22:33:04.843 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:04.843 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.843 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.843 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:04.843 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393579+0000", 2024-09-12T22:33:04.844 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:04.844 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.844 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.844 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:04.844 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393579+0000", 2024-09-12T22:33:04.844 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.09e-07 2024-09-12T22:33:04.844 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.844 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.844 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:04.844 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393586+0000", 2024-09-12T22:33:04.844 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.6279999999999999e-06 2024-09-12T22:33:04.845 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.845 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.845 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:04.845 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393603+0000", 2024-09-12T22:33:04.845 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6750000000000001e-05 2024-09-12T22:33:04.845 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.845 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.845 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:04.845 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393609+0000", 2024-09-12T22:33:04.845 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.3090000000000001e-06 2024-09-12T22:33:04.845 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.846 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.846 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:04.846 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.409440+0000", 2024-09-12T22:33:04.846 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.015830486000000001 2024-09-12T22:33:04.846 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.846 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.846 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:04.846 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.409520+0000", 2024-09-12T22:33:04.846 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0761999999999997e-05 2024-09-12T22:33:04.846 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.846 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.847 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:04.847 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.409634+0000", 2024-09-12T22:33:04.847 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000113155 2024-09-12T22:33:04.847 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.847 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.847 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:04.847 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.411630+0000", 2024-09-12T22:33:04.847 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0019964940000000001 2024-09-12T22:33:04.847 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.847 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.847 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:04.847 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.414551+0000", 2024-09-12T22:33:04.848 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0029212660000000001 2024-09-12T22:33:04.848 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.848 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.848 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:04.848 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.414598+0000", 2024-09-12T22:33:04.848 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6836999999999999e-05 2024-09-12T22:33:04.848 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.848 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.848 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:04.848 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.414631+0000", 2024-09-12T22:33:04.849 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3243e-05 2024-09-12T22:33:04.849 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:04.849 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:04.849 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:04.849 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.849 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.849 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:112 3.1f 3:f83d65d8:::200.00000004:head [write 449503~3460 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-09-12T22:33:04.849 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:04.393638+0000", 2024-09-12T22:33:04.849 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.34883722, 2024-09-12T22:33:04.849 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.023344696000000002, 2024-09-12T22:33:04.849 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:04.849 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:04.850 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:04.850 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:04.850 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.850 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:04.850 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393638+0000", 2024-09-12T22:33:04.850 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:04.850 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.850 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.850 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:04.850 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393638+0000", 2024-09-12T22:33:04.850 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:04.850 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.851 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.851 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:04.851 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393639+0000", 2024-09-12T22:33:04.851 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.68e-07 2024-09-12T22:33:04.851 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.851 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.851 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:04.851 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393643+0000", 2024-09-12T22:33:04.851 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.98e-06 2024-09-12T22:33:04.851 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.851 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.851 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:04.852 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393650+0000", 2024-09-12T22:33:04.852 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.131e-06 2024-09-12T22:33:04.852 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.852 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.852 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:04.852 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393655+0000", 2024-09-12T22:33:04.852 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0270000000000003e-06 2024-09-12T22:33:04.852 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.852 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.852 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:04.852 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410618+0000", 2024-09-12T22:33:04.853 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016962600000000001 2024-09-12T22:33:04.853 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.853 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.853 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:04.853 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410679+0000", 2024-09-12T22:33:04.853 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.1014999999999998e-05 2024-09-12T22:33:04.853 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.853 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.853 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:04.853 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410763+0000", 2024-09-12T22:33:04.853 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.4586000000000006e-05 2024-09-12T22:33:04.854 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.854 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.854 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:04.854 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.412605+0000", 2024-09-12T22:33:04.854 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001842036 2024-09-12T22:33:04.854 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.854 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.854 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:04.854 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.416894+0000", 2024-09-12T22:33:04.854 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0042887649999999999 2024-09-12T22:33:04.854 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.855 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.855 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:04.855 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.416947+0000", 2024-09-12T22:33:04.855 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2500999999999998e-05 2024-09-12T22:33:04.855 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.855 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.855 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:04.855 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.416983+0000", 2024-09-12T22:33:04.855 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.6486999999999998e-05 2024-09-12T22:33:04.855 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:04.855 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:04.855 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:04.856 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.856 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.856 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:113 3.1f 3:f83d65d8:::200.00000004:head [write 452963~1919 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-09-12T22:33:04.856 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:04.393838+0000", 2024-09-12T22:33:04.856 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.34863781799999999, 2024-09-12T22:33:04.856 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.023234016999999999, 2024-09-12T22:33:04.856 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:04.856 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:04.856 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:04.856 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:04.856 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.856 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:04.856 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393838+0000", 2024-09-12T22:33:04.857 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:04.857 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.857 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.857 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:04.857 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393838+0000", 2024-09-12T22:33:04.857 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:04.857 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.857 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.857 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:04.857 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393839+0000", 2024-09-12T22:33:04.857 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.9299999999999997e-07 2024-09-12T22:33:04.858 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.858 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.858 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:04.858 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393842+0000", 2024-09-12T22:33:04.858 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7759999999999999e-06 2024-09-12T22:33:04.858 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.858 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.858 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:04.858 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393850+0000", 2024-09-12T22:33:04.858 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.6590000000000007e-06 2024-09-12T22:33:04.858 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.859 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.859 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:04.859 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393856+0000", 2024-09-12T22:33:04.859 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.1659999999999999e-06 2024-09-12T22:33:04.859 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.859 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.859 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:04.859 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.411099+0000", 2024-09-12T22:33:04.859 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017242785 2024-09-12T22:33:04.859 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.859 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.859 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:04.860 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.411172+0000", 2024-09-12T22:33:04.860 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.2552999999999995e-05 2024-09-12T22:33:04.860 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.860 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.860 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:04.860 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.411280+0000", 2024-09-12T22:33:04.860 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000108701 2024-09-12T22:33:04.860 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.860 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.860 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:04.860 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.413582+0000", 2024-09-12T22:33:04.861 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0023020290000000001 2024-09-12T22:33:04.861 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.861 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.861 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:04.861 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.417020+0000", 2024-09-12T22:33:04.861 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0034373860000000002 2024-09-12T22:33:04.861 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.861 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.861 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:04.861 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.417049+0000", 2024-09-12T22:33:04.861 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8986e-05 2024-09-12T22:33:04.862 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.862 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.862 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:04.862 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.417072+0000", 2024-09-12T22:33:04.862 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.3183000000000001e-05 2024-09-12T22:33:04.862 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:04.862 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:04.862 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:04.862 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.862 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.862 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:114 3.1f 3:f83d65d8:::200.00000004:head [write 454882~5842 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-09-12T22:33:04.863 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:04.396101+0000", 2024-09-12T22:33:04.863 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.34637479500000001, 2024-09-12T22:33:04.863 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.021098186000000001, 2024-09-12T22:33:04.863 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:04.863 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:04.863 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:04.863 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:04.863 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.863 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:04.863 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.396101+0000", 2024-09-12T22:33:04.863 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:04.864 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.864 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.864 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:04.864 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.396101+0000", 2024-09-12T22:33:04.864 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:04.864 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.864 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.864 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:04.864 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.396102+0000", 2024-09-12T22:33:04.864 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1600000000000001e-07 2024-09-12T22:33:04.864 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.864 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.865 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:04.865 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.396108+0000", 2024-09-12T22:33:04.865 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.9290000000000001e-06 2024-09-12T22:33:04.865 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.865 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.865 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:04.865 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.396116+0000", 2024-09-12T22:33:04.865 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.0960000000000003e-06 2024-09-12T22:33:04.865 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.865 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.865 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:04.866 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.396120+0000", 2024-09-12T22:33:04.866 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5000000000000001e-06 2024-09-12T22:33:04.866 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.866 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.866 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:04.866 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.411666+0000", 2024-09-12T22:33:04.866 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.015545608000000001 2024-09-12T22:33:04.866 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.866 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.866 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:04.866 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.411712+0000", 2024-09-12T22:33:04.867 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6233000000000003e-05 2024-09-12T22:33:04.867 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.867 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.867 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:04.867 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.411777+0000", 2024-09-12T22:33:04.867 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.5019999999999998e-05 2024-09-12T22:33:04.867 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.867 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.867 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:04.867 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.413586+0000", 2024-09-12T22:33:04.867 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0018087979999999999 2024-09-12T22:33:04.867 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.868 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.868 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:04.868 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.417115+0000", 2024-09-12T22:33:04.868 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003528972 2024-09-12T22:33:04.868 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.868 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.868 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:04.868 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.417163+0000", 2024-09-12T22:33:04.868 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8136000000000001e-05 2024-09-12T22:33:04.868 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.868 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.869 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:04.869 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.417199+0000", 2024-09-12T22:33:04.869 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.6177999999999998e-05 2024-09-12T22:33:04.869 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:04.869 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:04.869 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:04.869 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.869 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.869 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:115 3.1f 3:f83d65d8:::200.00000004:head [write 460724~3955 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-09-12T22:33:04.869 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:04.396288+0000", 2024-09-12T22:33:04.869 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.34618813199999998, 2024-09-12T22:33:04.870 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.020991639999999999, 2024-09-12T22:33:04.870 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:04.870 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:04.870 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:04.870 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:04.870 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.870 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:04.870 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.396288+0000", 2024-09-12T22:33:04.870 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:04.870 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.870 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.870 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:04.871 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.396288+0000", 2024-09-12T22:33:04.871 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:04.871 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.871 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.871 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:04.871 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.396288+0000", 2024-09-12T22:33:04.871 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4200000000000001e-07 2024-09-12T22:33:04.871 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.871 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.871 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:04.871 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.396292+0000", 2024-09-12T22:33:04.871 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5290000000000002e-06 2024-09-12T22:33:04.872 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.872 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.872 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:04.872 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.396299+0000", 2024-09-12T22:33:04.872 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.55e-06 2024-09-12T22:33:04.872 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.872 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.872 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:04.872 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.396303+0000", 2024-09-12T22:33:04.872 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.636e-06 2024-09-12T22:33:04.872 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.873 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.873 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:04.873 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.412101+0000", 2024-09-12T22:33:04.873 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.015798053999999999 2024-09-12T22:33:04.873 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.873 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.873 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:04.873 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.412189+0000", 2024-09-12T22:33:04.873 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.8488999999999999e-05 2024-09-12T22:33:04.873 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.873 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.874 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:04.874 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.412296+0000", 2024-09-12T22:33:04.874 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000107014 2024-09-12T22:33:04.874 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.874 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.874 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:04.874 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.414256+0000", 2024-09-12T22:33:04.874 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0019593269999999999 2024-09-12T22:33:04.874 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.874 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.874 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:04.874 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.417232+0000", 2024-09-12T22:33:04.875 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0029769229999999998 2024-09-12T22:33:04.875 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.875 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.875 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:04.875 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.417258+0000", 2024-09-12T22:33:04.875 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5618000000000001e-05 2024-09-12T22:33:04.875 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.875 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.875 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:04.875 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.417279+0000", 2024-09-12T22:33:04.875 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1058000000000001e-05 2024-09-12T22:33:04.876 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:04.876 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:04.876 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:04.876 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.876 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.876 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:116 3.1f 3:f83d65d8:::200.00000004:head [write 464679~2931 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-09-12T22:33:04.876 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:04.396580+0000", 2024-09-12T22:33:04.876 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.34589603600000002, 2024-09-12T22:33:04.876 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.020824097, 2024-09-12T22:33:04.876 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:04.876 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:04.877 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:04.877 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:04.877 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.877 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:04.877 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.396580+0000", 2024-09-12T22:33:04.877 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:04.877 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.877 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.877 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:04.877 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.396580+0000", 2024-09-12T22:33:04.877 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:04.877 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.878 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.878 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:04.878 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.396580+0000", 2024-09-12T22:33:04.878 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2499999999999995e-07 2024-09-12T22:33:04.878 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.878 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.878 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:04.878 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.396583+0000", 2024-09-12T22:33:04.878 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.157e-06 2024-09-12T22:33:04.878 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.878 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.879 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:04.879 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.396588+0000", 2024-09-12T22:33:04.879 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9350000000000002e-06 2024-09-12T22:33:04.879 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.879 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.879 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:04.879 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.396591+0000", 2024-09-12T22:33:04.879 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2820000000000001e-06 2024-09-12T22:33:04.879 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.879 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.879 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:04.880 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.412646+0000", 2024-09-12T22:33:04.880 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016054029000000001 2024-09-12T22:33:04.880 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.880 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.880 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:04.880 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.412712+0000", 2024-09-12T22:33:04.880 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.6693999999999995e-05 2024-09-12T22:33:04.880 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.880 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.880 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:04.880 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.412780+0000", 2024-09-12T22:33:04.881 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7688000000000007e-05 2024-09-12T22:33:04.881 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.881 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.881 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:04.881 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.414259+0000", 2024-09-12T22:33:04.881 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0014787820000000001 2024-09-12T22:33:04.881 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.881 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.881 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:04.881 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.417321+0000", 2024-09-12T22:33:04.881 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0030626659999999999 2024-09-12T22:33:04.882 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.882 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.882 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:04.882 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.417369+0000", 2024-09-12T22:33:04.882 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8084000000000002e-05 2024-09-12T22:33:04.882 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:04.882 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:04.882 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:04.882 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.417404+0000", 2024-09-12T22:33:04.882 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4255000000000003e-05 2024-09-12T22:33:04.882 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:04.882 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:04.883 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:04.883 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:04.883 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:04.883 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:33:04.884 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:04.883+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:04.885 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:33:04.985 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:04.984+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:04.997 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-09-12T22:33:04.997 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2024-09-12T22:33:04.997 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.997 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4490.0:6217 4.35 4:afa87278:::10000001c7e.00000000:head [write 0~2274 in=2274b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T22:33:04.997 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:04.996546+0000", 2024-09-12T22:33:04.997 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 8.5834999999999994e-05, 2024-09-12T22:33:04.997 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00010289300000000001, 2024-09-12T22:33:04.997 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:04.997 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:04.997 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "reached pg", 2024-09-12T22:33:04.998 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:04.998 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4490", 2024-09-12T22:33:04.998 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:04.998 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 6217 2024-09-12T22:33:04.998 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.998 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:04.998 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.998 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:04.998 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:04.996546+0000", 2024-09-12T22:33:04.998 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:04.998 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.998 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.998 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:04.999 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:04.996546+0000", 2024-09-12T22:33:04.999 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:04.999 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.999 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.999 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:04.999 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:04.996547+0000", 2024-09-12T22:33:04.999 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.1999999999999998e-07 2024-09-12T22:33:04.999 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:04.999 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:04.999 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:04.999 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:04.996552+0000", 2024-09-12T22:33:04.999 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.775e-06 2024-09-12T22:33:04.999 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.000 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.000 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:05.000 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:04.996563+0000", 2024-09-12T22:33:05.000 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1252e-05 2024-09-12T22:33:05.000 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.000 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.000 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:05.000 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:04.996568+0000", 2024-09-12T22:33:05.000 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2390000000000002e-06 2024-09-12T22:33:05.000 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.000 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.000 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:05.000 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:04.996615+0000", 2024-09-12T22:33:05.001 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6239999999999998e-05 2024-09-12T22:33:05.001 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:05.001 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:05.001 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:05.001 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:05.001 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2024-09-12T22:33:05.001 INFO:teuthology.orchestra.run.smithi163.stdout: "num_ops": 1 2024-09-12T22:33:05.001 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-09-12T22:33:05.007 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:33:05.087 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:05.085+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:05.157 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-09-12T22:33:05.157 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-09-12T22:33:05.157 INFO:teuthology.orchestra.run.smithi163.stdout: "complaint_time": 30, 2024-09-12T22:33:05.157 INFO:teuthology.orchestra.run.smithi163.stdout: "num_blocked_ops": 0 2024-09-12T22:33:05.157 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-09-12T22:33:05.167 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:33:05.188 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:05.186+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:05.274 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-09-12T22:33:05.274 INFO:teuthology.orchestra.run.smithi163.stdout: "size": 20, 2024-09-12T22:33:05.274 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 600, 2024-09-12T22:33:05.274 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2024-09-12T22:33:05.274 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.274 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-09-12T22:33:05.274 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:27.254459+0000", 2024-09-12T22:33:05.274 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 98.016790555, 2024-09-12T22:33:05.274 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.37816283899999997, 2024-09-12T22:33:05.274 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:05.274 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:05.275 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:05.275 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:05.275 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:33:05.275 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:33:05.275 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 1 2024-09-12T22:33:05.275 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.275 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:05.275 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.275 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:05.275 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254459+0000", 2024-09-12T22:33:05.275 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:05.275 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.276 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.276 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:05.276 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254459+0000", 2024-09-12T22:33:05.276 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:05.276 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.276 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.276 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:05.276 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254460+0000", 2024-09-12T22:33:05.276 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1739999999999999e-06 2024-09-12T22:33:05.276 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.276 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.277 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:05.277 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254472+0000", 2024-09-12T22:33:05.277 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2207e-05 2024-09-12T22:33:05.277 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.277 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.277 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:05.277 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254483+0000", 2024-09-12T22:33:05.277 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0631999999999999e-05 2024-09-12T22:33:05.277 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.277 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.277 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:05.277 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254492+0000", 2024-09-12T22:33:05.278 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3670000000000003e-06 2024-09-12T22:33:05.278 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.278 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.278 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:05.278 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254551+0000", 2024-09-12T22:33:05.278 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8687999999999998e-05 2024-09-12T22:33:05.278 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.278 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.278 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for peered", 2024-09-12T22:33:05.278 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254562+0000", 2024-09-12T22:33:05.278 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1249e-05 2024-09-12T22:33:05.279 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.279 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.279 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:05.279 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.631211+0000", 2024-09-12T22:33:05.279 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.376649018 2024-09-12T22:33:05.279 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.279 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.279 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:05.279 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.631345+0000", 2024-09-12T22:33:05.279 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013378700000000001 2024-09-12T22:33:05.279 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.279 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.280 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:33:05.280 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.631479+0000", 2024-09-12T22:33:05.280 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013352399999999999 2024-09-12T22:33:05.280 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.280 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.280 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:05.280 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632324+0000", 2024-09-12T22:33:05.280 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00084508100000000002 2024-09-12T22:33:05.280 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.280 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.280 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:05.280 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632548+0000", 2024-09-12T22:33:05.280 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000224329 2024-09-12T22:33:05.280 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.281 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.281 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:05.281 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632591+0000", 2024-09-12T22:33:05.281 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2564000000000001e-05 2024-09-12T22:33:05.281 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.281 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.281 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:05.281 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632622+0000", 2024-09-12T22:33:05.281 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1219e-05 2024-09-12T22:33:05.281 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:05.281 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:05.281 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:05.281 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.282 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.282 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:185 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:33:05.282 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394355+0000", 2024-09-12T22:33:05.282 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 96.876894457999995, 2024-09-12T22:33:05.282 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011302394, 2024-09-12T22:33:05.282 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:05.282 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:05.282 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:05.282 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:05.282 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:33:05.282 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:33:05.282 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 185 2024-09-12T22:33:05.282 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.282 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:05.282 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.283 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:05.283 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394355+0000", 2024-09-12T22:33:05.283 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:05.283 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.283 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.283 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:05.283 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394355+0000", 2024-09-12T22:33:05.283 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:05.283 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.283 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.283 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:05.283 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394355+0000", 2024-09-12T22:33:05.284 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9099999999999999e-07 2024-09-12T22:33:05.284 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.284 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.284 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:05.284 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394385+0000", 2024-09-12T22:33:05.284 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9963000000000001e-05 2024-09-12T22:33:05.284 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.284 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.284 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:05.284 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394390+0000", 2024-09-12T22:33:05.284 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8420000000000004e-06 2024-09-12T22:33:05.284 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.284 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.285 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:05.285 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394393+0000", 2024-09-12T22:33:05.285 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1e-06 2024-09-12T22:33:05.285 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.285 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.285 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:05.285 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.400546+0000", 2024-09-12T22:33:05.285 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0061523309999999996 2024-09-12T22:33:05.285 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.285 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.285 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:05.285 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.400588+0000", 2024-09-12T22:33:05.285 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1835000000000002e-05 2024-09-12T22:33:05.286 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.286 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.286 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:33:05.286 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.400677+0000", 2024-09-12T22:33:05.286 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9195000000000002e-05 2024-09-12T22:33:05.286 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.286 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.286 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:05.286 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405378+0000", 2024-09-12T22:33:05.286 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0047008659999999997 2024-09-12T22:33:05.286 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.286 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.286 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:05.286 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405569+0000", 2024-09-12T22:33:05.287 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00019148599999999999 2024-09-12T22:33:05.287 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.287 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.287 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:05.287 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405620+0000", 2024-09-12T22:33:05.287 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1416999999999999e-05 2024-09-12T22:33:05.287 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.287 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.287 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:05.287 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405657+0000", 2024-09-12T22:33:05.287 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6968000000000002e-05 2024-09-12T22:33:05.287 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:05.287 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:05.287 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:05.287 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.288 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.288 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:33:05.288 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394399+0000", 2024-09-12T22:33:05.288 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 96.876850246999993, 2024-09-12T22:33:05.288 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011336601999999999, 2024-09-12T22:33:05.288 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:05.288 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:05.288 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:05.288 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:05.288 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:33:05.288 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:33:05.288 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 186 2024-09-12T22:33:05.288 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.289 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:05.289 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.289 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:05.289 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394399+0000", 2024-09-12T22:33:05.289 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:05.289 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.289 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.289 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:05.289 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394399+0000", 2024-09-12T22:33:05.289 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:05.289 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.289 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.289 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:05.290 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394400+0000", 2024-09-12T22:33:05.290 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4499999999999998e-07 2024-09-12T22:33:05.290 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.290 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.290 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:05.290 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394402+0000", 2024-09-12T22:33:05.290 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.875e-06 2024-09-12T22:33:05.290 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.290 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.290 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:05.290 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394405+0000", 2024-09-12T22:33:05.290 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6799999999999999e-06 2024-09-12T22:33:05.290 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.291 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.291 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:05.291 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394408+0000", 2024-09-12T22:33:05.291 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.667e-06 2024-09-12T22:33:05.291 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.291 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.291 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:05.291 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401395+0000", 2024-09-12T22:33:05.291 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0069867230000000002 2024-09-12T22:33:05.291 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.291 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.291 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:05.291 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401438+0000", 2024-09-12T22:33:05.291 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3554999999999999e-05 2024-09-12T22:33:05.292 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.292 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.292 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:33:05.292 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401509+0000", 2024-09-12T22:33:05.292 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0631999999999997e-05 2024-09-12T22:33:05.292 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.292 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.292 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:05.293 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405392+0000", 2024-09-12T22:33:05.293 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0038830449999999999 2024-09-12T22:33:05.293 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.293 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.293 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:05.293 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405690+0000", 2024-09-12T22:33:05.293 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000298435 2024-09-12T22:33:05.293 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.293 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.293 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:05.293 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405716+0000", 2024-09-12T22:33:05.293 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5435999999999998e-05 2024-09-12T22:33:05.293 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.293 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.294 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:05.294 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405736+0000", 2024-09-12T22:33:05.294 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0208999999999999e-05 2024-09-12T22:33:05.294 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:05.294 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:05.294 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:05.294 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.294 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.294 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:33:05.295 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394411+0000", 2024-09-12T22:33:05.295 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 96.876838121000006, 2024-09-12T22:33:05.295 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011400117, 2024-09-12T22:33:05.295 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:05.295 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:05.295 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:05.295 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:05.295 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:33:05.295 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:33:05.295 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 187 2024-09-12T22:33:05.295 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.295 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:05.295 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.296 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:05.296 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394411+0000", 2024-09-12T22:33:05.296 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:05.296 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.296 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.296 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:05.296 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394411+0000", 2024-09-12T22:33:05.296 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:05.296 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.296 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.296 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:05.297 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394412+0000", 2024-09-12T22:33:05.297 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.4999999999999999e-07 2024-09-12T22:33:05.297 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.297 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.297 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:05.297 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394414+0000", 2024-09-12T22:33:05.297 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.984e-06 2024-09-12T22:33:05.297 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.297 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.297 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:05.297 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394418+0000", 2024-09-12T22:33:05.298 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0840000000000002e-06 2024-09-12T22:33:05.298 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.298 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.298 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:05.298 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394431+0000", 2024-09-12T22:33:05.298 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.361e-05 2024-09-12T22:33:05.298 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.298 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.298 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:05.298 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401778+0000", 2024-09-12T22:33:05.298 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0073462659999999997 2024-09-12T22:33:05.299 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.299 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.299 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:05.299 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401853+0000", 2024-09-12T22:33:05.299 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5797000000000006e-05 2024-09-12T22:33:05.299 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.299 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.299 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:33:05.299 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401990+0000", 2024-09-12T22:33:05.299 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013651399999999999 2024-09-12T22:33:05.300 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.300 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.300 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:05.300 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405402+0000", 2024-09-12T22:33:05.300 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0034116070000000001 2024-09-12T22:33:05.300 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.300 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.300 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:05.300 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405764+0000", 2024-09-12T22:33:05.300 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00036234899999999998 2024-09-12T22:33:05.300 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.300 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.300 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:05.301 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405791+0000", 2024-09-12T22:33:05.301 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7029000000000002e-05 2024-09-12T22:33:05.301 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.301 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.301 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:05.301 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405812+0000", 2024-09-12T22:33:05.301 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0627000000000001e-05 2024-09-12T22:33:05.301 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:05.301 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:05.301 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:05.301 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.302 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.302 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:33:05.302 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394447+0000", 2024-09-12T22:33:05.302 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 96.87680297, 2024-09-12T22:33:05.302 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011759588, 2024-09-12T22:33:05.302 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:05.302 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:05.302 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:05.302 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:05.303 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:33:05.303 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:33:05.303 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 188 2024-09-12T22:33:05.303 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.303 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:05.303 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.303 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:05.303 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394447+0000", 2024-09-12T22:33:05.303 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:05.304 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.304 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.304 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:05.304 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394447+0000", 2024-09-12T22:33:05.304 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:05.304 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.304 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.304 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:05.304 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394447+0000", 2024-09-12T22:33:05.304 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.15e-07 2024-09-12T22:33:05.305 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.305 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.305 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:05.305 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394512+0000", 2024-09-12T22:33:05.305 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4580999999999997e-05 2024-09-12T22:33:05.305 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.305 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.305 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:05.305 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394518+0000", 2024-09-12T22:33:05.305 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.3380000000000001e-06 2024-09-12T22:33:05.305 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.305 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.305 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:05.305 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394521+0000", 2024-09-12T22:33:05.306 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3340000000000002e-06 2024-09-12T22:33:05.306 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.306 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.306 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:05.306 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.402628+0000", 2024-09-12T22:33:05.306 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.008106996 2024-09-12T22:33:05.306 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.306 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.306 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:05.306 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.402670+0000", 2024-09-12T22:33:05.306 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1983000000000001e-05 2024-09-12T22:33:05.306 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.306 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.306 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:33:05.307 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.402738+0000", 2024-09-12T22:33:05.307 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.8114999999999994e-05 2024-09-12T22:33:05.307 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.307 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.307 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:05.307 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405668+0000", 2024-09-12T22:33:05.307 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.002929545 2024-09-12T22:33:05.307 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.307 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.307 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:05.307 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406162+0000", 2024-09-12T22:33:05.307 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000494408 2024-09-12T22:33:05.307 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.307 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.307 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:05.308 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406188+0000", 2024-09-12T22:33:05.308 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5766e-05 2024-09-12T22:33:05.308 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.308 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.308 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:05.308 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406206+0000", 2024-09-12T22:33:05.308 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.8107000000000001e-05 2024-09-12T22:33:05.308 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:05.308 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:05.308 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:05.308 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.308 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.309 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:33:05.309 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394528+0000", 2024-09-12T22:33:05.309 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 96.876721301000003, 2024-09-12T22:33:05.309 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.01195536, 2024-09-12T22:33:05.309 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:05.309 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:05.309 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:05.309 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:05.309 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:33:05.309 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:33:05.309 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 189 2024-09-12T22:33:05.309 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.310 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:05.310 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.310 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:05.310 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394528+0000", 2024-09-12T22:33:05.310 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:05.310 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.310 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.310 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:05.310 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394528+0000", 2024-09-12T22:33:05.310 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:05.310 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.310 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.310 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:05.311 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394529+0000", 2024-09-12T22:33:05.311 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4900000000000001e-07 2024-09-12T22:33:05.311 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.311 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.311 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:05.311 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394531+0000", 2024-09-12T22:33:05.311 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.458e-06 2024-09-12T22:33:05.311 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.311 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.311 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:05.311 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394535+0000", 2024-09-12T22:33:05.311 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7900000000000001e-06 2024-09-12T22:33:05.311 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.312 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.312 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:05.312 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394537+0000", 2024-09-12T22:33:05.312 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.632e-06 2024-09-12T22:33:05.312 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.312 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.312 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:05.312 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.404932+0000", 2024-09-12T22:33:05.312 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010394158000000001 2024-09-12T22:33:05.312 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.312 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.312 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:05.312 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405017+0000", 2024-09-12T22:33:05.312 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5525000000000005e-05 2024-09-12T22:33:05.313 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.313 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.313 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:33:05.313 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405114+0000", 2024-09-12T22:33:05.313 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.6527000000000006e-05 2024-09-12T22:33:05.313 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.313 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.313 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:05.313 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405818+0000", 2024-09-12T22:33:05.313 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00070412800000000005 2024-09-12T22:33:05.313 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.313 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.313 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:05.314 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406437+0000", 2024-09-12T22:33:05.314 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00061898900000000002 2024-09-12T22:33:05.314 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.314 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.314 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:05.314 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406463+0000", 2024-09-12T22:33:05.314 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6268e-05 2024-09-12T22:33:05.314 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.314 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.314 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:05.314 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406484+0000", 2024-09-12T22:33:05.314 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0536000000000001e-05 2024-09-12T22:33:05.314 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:05.315 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:05.315 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:05.315 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.315 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.315 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:33:05.315 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.401422+0000", 2024-09-12T22:33:05.315 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 87.869827396000005, 2024-09-12T22:33:05.315 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016896452999999999, 2024-09-12T22:33:05.315 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:05.315 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:05.315 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:05.315 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:05.315 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.316 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:05.316 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401422+0000", 2024-09-12T22:33:05.316 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:05.316 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.316 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.316 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:05.316 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401422+0000", 2024-09-12T22:33:05.316 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:05.316 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.316 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.316 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:05.316 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401424+0000", 2024-09-12T22:33:05.316 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9e-06 2024-09-12T22:33:05.316 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.316 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.317 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:05.317 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401437+0000", 2024-09-12T22:33:05.317 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2831e-05 2024-09-12T22:33:05.317 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.317 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.317 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:05.317 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401471+0000", 2024-09-12T22:33:05.317 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4010000000000001e-05 2024-09-12T22:33:05.317 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.317 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.317 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:05.317 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401484+0000", 2024-09-12T22:33:05.317 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2711000000000001e-05 2024-09-12T22:33:05.318 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.318 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.318 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:05.318 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405410+0000", 2024-09-12T22:33:05.318 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0039259170000000001 2024-09-12T22:33:05.318 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.318 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.318 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:05.318 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405529+0000", 2024-09-12T22:33:05.318 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000119778 2024-09-12T22:33:05.318 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.318 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.318 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:33:05.318 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405655+0000", 2024-09-12T22:33:05.319 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012556700000000001 2024-09-12T22:33:05.319 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.319 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.319 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:05.319 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410456+0000", 2024-09-12T22:33:05.319 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0048008269999999997 2024-09-12T22:33:05.319 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.319 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.319 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:05.319 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418226+0000", 2024-09-12T22:33:05.319 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0077707729999999999 2024-09-12T22:33:05.319 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.319 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.319 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:05.319 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418277+0000", 2024-09-12T22:33:05.320 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0476000000000003e-05 2024-09-12T22:33:05.320 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.320 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.320 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:05.320 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418319+0000", 2024-09-12T22:33:05.320 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1662999999999997e-05 2024-09-12T22:33:05.320 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:05.320 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:05.320 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:05.320 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.320 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.320 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:33:05.320 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.401505+0000", 2024-09-12T22:33:05.320 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 87.869744732000001, 2024-09-12T22:33:05.320 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016987904000000002, 2024-09-12T22:33:05.321 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:05.321 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:05.321 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:05.321 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:05.321 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.321 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:05.321 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401505+0000", 2024-09-12T22:33:05.321 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:05.321 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.321 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.321 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:05.321 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401505+0000", 2024-09-12T22:33:05.321 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:05.322 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.322 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.322 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:05.322 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401506+0000", 2024-09-12T22:33:05.322 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4700000000000001e-07 2024-09-12T22:33:05.322 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.322 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.322 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:05.322 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401510+0000", 2024-09-12T22:33:05.322 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6609999999999999e-06 2024-09-12T22:33:05.322 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.322 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.322 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:05.322 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401771+0000", 2024-09-12T22:33:05.322 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00026110700000000001 2024-09-12T22:33:05.323 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.323 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.323 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:05.323 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401921+0000", 2024-09-12T22:33:05.323 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014939099999999999 2024-09-12T22:33:05.323 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.323 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.323 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:05.323 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405944+0000", 2024-09-12T22:33:05.323 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0040235449999999999 2024-09-12T22:33:05.323 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.323 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.323 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:05.323 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406018+0000", 2024-09-12T22:33:05.323 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3373000000000004e-05 2024-09-12T22:33:05.324 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.324 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.324 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:33:05.324 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406172+0000", 2024-09-12T22:33:05.324 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00015435399999999999 2024-09-12T22:33:05.324 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.324 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.324 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:05.324 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410461+0000", 2024-09-12T22:33:05.324 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0042888609999999997 2024-09-12T22:33:05.324 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.324 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.324 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:05.325 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418371+0000", 2024-09-12T22:33:05.325 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0079098380000000006 2024-09-12T22:33:05.325 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.325 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.325 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:05.325 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418443+0000", 2024-09-12T22:33:05.325 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2705000000000003e-05 2024-09-12T22:33:05.325 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.325 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.325 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:05.325 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418493+0000", 2024-09-12T22:33:05.326 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9322e-05 2024-09-12T22:33:05.326 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:05.326 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:05.326 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:05.326 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.326 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.326 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:33:05.326 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.401939+0000", 2024-09-12T22:33:05.326 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 87.869310995999996, 2024-09-12T22:33:05.326 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016722292999999999, 2024-09-12T22:33:05.326 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:05.326 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:05.326 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:05.326 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:05.326 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.327 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:05.327 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401939+0000", 2024-09-12T22:33:05.327 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:05.327 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.327 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.327 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:05.327 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401939+0000", 2024-09-12T22:33:05.327 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:05.327 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.327 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.327 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:05.327 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401940+0000", 2024-09-12T22:33:05.327 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1990000000000001e-06 2024-09-12T22:33:05.327 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.327 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.328 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:05.328 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401956+0000", 2024-09-12T22:33:05.328 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.6344000000000001e-05 2024-09-12T22:33:05.328 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.328 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.328 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:05.328 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401974+0000", 2024-09-12T22:33:05.328 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7730000000000001e-05 2024-09-12T22:33:05.328 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.328 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.328 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:05.328 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401982+0000", 2024-09-12T22:33:05.328 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.7800000000000001e-06 2024-09-12T22:33:05.328 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.329 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.329 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:05.329 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406557+0000", 2024-09-12T22:33:05.329 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0045758489999999999 2024-09-12T22:33:05.329 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.329 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.329 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:05.329 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406697+0000", 2024-09-12T22:33:05.329 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013925100000000001 2024-09-12T22:33:05.329 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.329 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.330 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:33:05.330 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406830+0000", 2024-09-12T22:33:05.330 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013293499999999999 2024-09-12T22:33:05.330 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.330 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.330 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:05.330 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410465+0000", 2024-09-12T22:33:05.330 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0036352680000000001 2024-09-12T22:33:05.330 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.330 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.330 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:05.330 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418564+0000", 2024-09-12T22:33:05.330 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0080992140000000004 2024-09-12T22:33:05.330 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.331 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.331 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:05.331 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418621+0000", 2024-09-12T22:33:05.331 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7167999999999999e-05 2024-09-12T22:33:05.331 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.331 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.331 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:05.331 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418661+0000", 2024-09-12T22:33:05.331 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9555000000000003e-05 2024-09-12T22:33:05.331 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:05.331 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:05.331 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:05.332 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.332 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.332 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:33:05.332 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.401994+0000", 2024-09-12T22:33:05.332 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 87.869255124000006, 2024-09-12T22:33:05.332 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016804109000000001, 2024-09-12T22:33:05.332 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:05.332 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:05.332 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:05.332 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:05.332 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.332 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:05.333 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401994+0000", 2024-09-12T22:33:05.333 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:05.333 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.333 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.333 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:05.333 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401994+0000", 2024-09-12T22:33:05.333 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:05.333 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.333 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.333 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:05.334 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401995+0000", 2024-09-12T22:33:05.334 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.8899999999999998e-07 2024-09-12T22:33:05.334 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.334 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.334 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:05.334 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402000+0000", 2024-09-12T22:33:05.334 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.498e-06 2024-09-12T22:33:05.334 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.334 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.334 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:05.334 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402007+0000", 2024-09-12T22:33:05.334 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.554e-06 2024-09-12T22:33:05.335 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.335 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.335 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:05.335 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402046+0000", 2024-09-12T22:33:05.335 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9156000000000003e-05 2024-09-12T22:33:05.335 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.335 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.335 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:05.335 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407342+0000", 2024-09-12T22:33:05.336 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052957610000000004 2024-09-12T22:33:05.336 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.336 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.336 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:05.336 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407521+0000", 2024-09-12T22:33:05.336 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00017878100000000001 2024-09-12T22:33:05.336 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.336 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.336 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:33:05.336 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407641+0000", 2024-09-12T22:33:05.336 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012013 2024-09-12T22:33:05.336 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.336 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.336 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:05.337 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410472+0000", 2024-09-12T22:33:05.337 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.002830455 2024-09-12T22:33:05.337 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.337 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.337 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:05.337 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418714+0000", 2024-09-12T22:33:05.337 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0082422789999999999 2024-09-12T22:33:05.337 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.337 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.337 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:05.337 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418761+0000", 2024-09-12T22:33:05.337 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6956999999999998e-05 2024-09-12T22:33:05.337 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.338 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.338 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:05.338 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418799+0000", 2024-09-12T22:33:05.338 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7749000000000001e-05 2024-09-12T22:33:05.338 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:05.338 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:05.338 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:05.338 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.338 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.338 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:33:05.338 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.402060+0000", 2024-09-12T22:33:05.338 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 87.869189680000005, 2024-09-12T22:33:05.338 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016885686, 2024-09-12T22:33:05.339 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:05.339 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:05.339 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:05.339 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:05.339 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.339 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:05.339 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402060+0000", 2024-09-12T22:33:05.339 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:05.339 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.339 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.339 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:05.339 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402060+0000", 2024-09-12T22:33:05.339 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:05.340 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.340 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.340 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:05.340 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402061+0000", 2024-09-12T22:33:05.340 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4399999999999999e-07 2024-09-12T22:33:05.340 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.340 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.340 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:05.340 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402066+0000", 2024-09-12T22:33:05.340 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8649999999999998e-06 2024-09-12T22:33:05.340 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.340 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.340 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:05.340 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402146+0000", 2024-09-12T22:33:05.341 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9054000000000006e-05 2024-09-12T22:33:05.341 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.341 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.341 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:05.341 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402287+0000", 2024-09-12T22:33:05.341 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014108600000000001 2024-09-12T22:33:05.341 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.341 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.341 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:05.341 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408185+0000", 2024-09-12T22:33:05.341 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0058983919999999997 2024-09-12T22:33:05.341 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.341 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.342 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:05.342 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408299+0000", 2024-09-12T22:33:05.342 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114102 2024-09-12T22:33:05.342 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.342 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.342 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:33:05.342 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408420+0000", 2024-09-12T22:33:05.342 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000120492 2024-09-12T22:33:05.342 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.342 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.342 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:05.342 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410867+0000", 2024-09-12T22:33:05.342 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0024476430000000002 2024-09-12T22:33:05.342 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.343 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.343 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:05.343 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418851+0000", 2024-09-12T22:33:05.343 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0079841489999999994 2024-09-12T22:33:05.343 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.343 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.343 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:05.343 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418894+0000", 2024-09-12T22:33:05.343 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3090000000000002e-05 2024-09-12T22:33:05.343 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.343 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.343 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:05.343 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418946+0000", 2024-09-12T22:33:05.344 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1069000000000002e-05 2024-09-12T22:33:05.344 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:05.344 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:05.344 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:05.344 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.344 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.344 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:33:05.344 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.402375+0000", 2024-09-12T22:33:05.344 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 87.868874614999996, 2024-09-12T22:33:05.344 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016768531999999999, 2024-09-12T22:33:05.344 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:05.344 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:05.344 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:05.345 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:05.345 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.345 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:05.345 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402375+0000", 2024-09-12T22:33:05.345 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:05.345 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.345 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.345 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:05.345 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402375+0000", 2024-09-12T22:33:05.345 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:05.345 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.345 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.345 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:05.345 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402375+0000", 2024-09-12T22:33:05.346 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4099999999999999e-07 2024-09-12T22:33:05.346 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.346 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.346 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:05.346 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402379+0000", 2024-09-12T22:33:05.346 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9870000000000001e-06 2024-09-12T22:33:05.346 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.346 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.346 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:05.346 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402389+0000", 2024-09-12T22:33:05.346 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0000000000000001e-05 2024-09-12T22:33:05.346 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.346 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.346 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:05.347 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402401+0000", 2024-09-12T22:33:05.347 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.148e-05 2024-09-12T22:33:05.347 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.347 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.347 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:05.347 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409108+0000", 2024-09-12T22:33:05.347 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0067068429999999997 2024-09-12T22:33:05.347 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.347 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.347 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:05.347 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409189+0000", 2024-09-12T22:33:05.347 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0815999999999993e-05 2024-09-12T22:33:05.347 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.347 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.348 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:33:05.348 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409320+0000", 2024-09-12T22:33:05.348 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000131586 2024-09-12T22:33:05.348 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.348 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.348 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:05.348 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410872+0000", 2024-09-12T22:33:05.348 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0015521599999999999 2024-09-12T22:33:05.348 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.348 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.348 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:05.348 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419049+0000", 2024-09-12T22:33:05.348 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0081763719999999995 2024-09-12T22:33:05.349 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.349 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.349 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:05.349 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419107+0000", 2024-09-12T22:33:05.349 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7899000000000002e-05 2024-09-12T22:33:05.349 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.349 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.349 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:05.349 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419143+0000", 2024-09-12T22:33:05.349 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6847999999999997e-05 2024-09-12T22:33:05.349 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:05.349 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:05.349 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:05.350 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.350 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.350 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:33:05.350 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.402903+0000", 2024-09-12T22:33:05.350 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 87.868346203000002, 2024-09-12T22:33:05.350 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016378428, 2024-09-12T22:33:05.350 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:05.350 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:05.350 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:05.350 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:05.350 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.350 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:05.350 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402903+0000", 2024-09-12T22:33:05.350 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:05.351 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.351 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.351 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:05.351 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402903+0000", 2024-09-12T22:33:05.351 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:05.351 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.351 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.351 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:05.351 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402904+0000", 2024-09-12T22:33:05.351 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9500000000000001e-07 2024-09-12T22:33:05.351 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.351 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.351 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:05.351 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402944+0000", 2024-09-12T22:33:05.352 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0265000000000002e-05 2024-09-12T22:33:05.352 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.352 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.352 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:05.352 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402979+0000", 2024-09-12T22:33:05.352 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4378000000000002e-05 2024-09-12T22:33:05.352 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.352 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.352 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:05.352 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402987+0000", 2024-09-12T22:33:05.352 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3559999999999993e-06 2024-09-12T22:33:05.352 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.352 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.353 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:05.353 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409577+0000", 2024-09-12T22:33:05.353 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0065901709999999997 2024-09-12T22:33:05.353 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.353 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.353 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:05.353 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409653+0000", 2024-09-12T22:33:05.353 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5819e-05 2024-09-12T22:33:05.353 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.353 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.353 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:33:05.353 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409725+0000", 2024-09-12T22:33:05.353 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2200000000000007e-05 2024-09-12T22:33:05.353 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.354 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.354 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:05.354 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.411234+0000", 2024-09-12T22:33:05.354 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001508225 2024-09-12T22:33:05.354 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.354 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.354 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:05.354 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419212+0000", 2024-09-12T22:33:05.354 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0079783400000000004 2024-09-12T22:33:05.354 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.354 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.354 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:05.354 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419244+0000", 2024-09-12T22:33:05.355 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2384e-05 2024-09-12T22:33:05.355 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.355 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.355 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:05.355 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419282+0000", 2024-09-12T22:33:05.355 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7394999999999997e-05 2024-09-12T22:33:05.355 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:05.355 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:05.355 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:05.355 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.355 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.355 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:33:05.355 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.403135+0000", 2024-09-12T22:33:05.355 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 87.868114332999994, 2024-09-12T22:33:05.356 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016294211999999999, 2024-09-12T22:33:05.356 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:05.356 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:05.356 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:05.356 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:05.356 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.356 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:05.356 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403135+0000", 2024-09-12T22:33:05.356 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:05.356 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.356 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.356 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:05.356 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403135+0000", 2024-09-12T22:33:05.357 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:05.357 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.357 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.357 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:05.357 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403136+0000", 2024-09-12T22:33:05.357 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.4e-07 2024-09-12T22:33:05.357 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.357 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.357 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:05.357 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403149+0000", 2024-09-12T22:33:05.357 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2723e-05 2024-09-12T22:33:05.357 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.357 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.357 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:05.358 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403158+0000", 2024-09-12T22:33:05.358 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3919999999999992e-06 2024-09-12T22:33:05.358 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.358 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.358 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:05.358 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403166+0000", 2024-09-12T22:33:05.358 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.2309999999999996e-06 2024-09-12T22:33:05.358 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.358 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.358 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:05.358 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409944+0000", 2024-09-12T22:33:05.358 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0067775309999999998 2024-09-12T22:33:05.358 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.359 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.359 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:05.359 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410032+0000", 2024-09-12T22:33:05.359 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.7906999999999997e-05 2024-09-12T22:33:05.359 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.359 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.359 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:33:05.359 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410152+0000", 2024-09-12T22:33:05.359 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012037800000000001 2024-09-12T22:33:05.359 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.359 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.359 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:05.359 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.411945+0000", 2024-09-12T22:33:05.360 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0017931850000000001 2024-09-12T22:33:05.360 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.360 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.360 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:05.360 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419319+0000", 2024-09-12T22:33:05.360 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0073731780000000002 2024-09-12T22:33:05.360 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.360 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.360 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:05.360 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419376+0000", 2024-09-12T22:33:05.360 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7728e-05 2024-09-12T22:33:05.360 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.360 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.360 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:05.361 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419429+0000", 2024-09-12T22:33:05.361 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3019000000000002e-05 2024-09-12T22:33:05.361 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:05.361 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:05.361 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:05.361 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.361 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.361 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:33:05.361 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.403185+0000", 2024-09-12T22:33:05.361 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 87.868064451999999, 2024-09-12T22:33:05.361 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.014902164000000001, 2024-09-12T22:33:05.361 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:05.361 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:05.361 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:05.362 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:05.362 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.362 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:05.362 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403185+0000", 2024-09-12T22:33:05.362 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:05.362 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.362 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.362 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:05.362 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403185+0000", 2024-09-12T22:33:05.362 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:05.362 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.362 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.362 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:05.363 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403186+0000", 2024-09-12T22:33:05.363 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9400000000000005e-07 2024-09-12T22:33:05.363 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.363 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.363 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:05.363 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403191+0000", 2024-09-12T22:33:05.363 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6980000000000003e-06 2024-09-12T22:33:05.363 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.363 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.363 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:05.363 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403199+0000", 2024-09-12T22:33:05.363 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2520000000000002e-06 2024-09-12T22:33:05.363 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.363 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.364 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:05.364 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403205+0000", 2024-09-12T22:33:05.364 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.908e-06 2024-09-12T22:33:05.364 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.364 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.364 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:05.364 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403359+0000", 2024-09-12T22:33:05.364 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000154544 2024-09-12T22:33:05.364 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.364 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.364 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:05.364 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403528+0000", 2024-09-12T22:33:05.364 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000168455 2024-09-12T22:33:05.364 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.364 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.365 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:33:05.365 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403763+0000", 2024-09-12T22:33:05.365 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00023539599999999999 2024-09-12T22:33:05.365 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.365 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.365 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:05.365 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409378+0000", 2024-09-12T22:33:05.365 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056150000000000002 2024-09-12T22:33:05.365 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.365 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.365 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:05.365 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418012+0000", 2024-09-12T22:33:05.365 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0086339559999999999 2024-09-12T22:33:05.366 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.366 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.366 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:05.366 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418046+0000", 2024-09-12T22:33:05.366 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4267999999999998e-05 2024-09-12T22:33:05.366 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.366 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.366 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:05.366 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418087+0000", 2024-09-12T22:33:05.366 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0992999999999999e-05 2024-09-12T22:33:05.366 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:05.366 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:05.366 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:05.366 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.367 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.367 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:33:05.367 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.403273+0000", 2024-09-12T22:33:05.367 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 87.867976501000001, 2024-09-12T22:33:05.367 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.014934866, 2024-09-12T22:33:05.367 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:05.367 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:05.367 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:05.367 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:05.367 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.367 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:05.367 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403273+0000", 2024-09-12T22:33:05.367 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:05.368 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.368 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.368 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:05.368 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403273+0000", 2024-09-12T22:33:05.368 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:05.368 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.368 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.368 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:05.368 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403274+0000", 2024-09-12T22:33:05.368 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.297e-06 2024-09-12T22:33:05.368 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.368 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.368 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:05.369 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403282+0000", 2024-09-12T22:33:05.369 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6340000000000001e-06 2024-09-12T22:33:05.369 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.369 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.369 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:05.369 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403305+0000", 2024-09-12T22:33:05.369 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3149000000000001e-05 2024-09-12T22:33:05.369 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.369 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.369 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:05.369 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403320+0000", 2024-09-12T22:33:05.369 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4527e-05 2024-09-12T22:33:05.369 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.369 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.370 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:05.370 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.404928+0000", 2024-09-12T22:33:05.370 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001608459 2024-09-12T22:33:05.370 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.370 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.370 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:05.370 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405218+0000", 2024-09-12T22:33:05.370 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00028982900000000002 2024-09-12T22:33:05.370 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.370 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.370 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:33:05.370 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405829+0000", 2024-09-12T22:33:05.370 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00061127900000000005 2024-09-12T22:33:05.371 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.371 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.371 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:05.371 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409403+0000", 2024-09-12T22:33:05.371 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.003573597 2024-09-12T22:33:05.371 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.371 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.371 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:05.371 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418138+0000", 2024-09-12T22:33:05.371 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0087349969999999996 2024-09-12T22:33:05.371 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.371 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.371 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:05.371 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418178+0000", 2024-09-12T22:33:05.372 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0649999999999999e-05 2024-09-12T22:33:05.372 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.372 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.372 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:05.372 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418208+0000", 2024-09-12T22:33:05.372 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9448e-05 2024-09-12T22:33:05.372 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:05.372 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:05.372 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:05.372 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.372 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.372 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:33:05.373 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.405456+0000", 2024-09-12T22:33:05.373 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 87.865793355999998, 2024-09-12T22:33:05.373 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012888389, 2024-09-12T22:33:05.373 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:05.373 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:05.373 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:05.373 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:05.373 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.373 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:05.373 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405456+0000", 2024-09-12T22:33:05.374 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:05.374 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.374 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.374 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:05.374 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405456+0000", 2024-09-12T22:33:05.374 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:05.374 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.374 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.374 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:05.375 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405457+0000", 2024-09-12T22:33:05.375 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.6599999999999994e-07 2024-09-12T22:33:05.375 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.375 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.375 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:05.375 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405463+0000", 2024-09-12T22:33:05.375 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4739999999999996e-06 2024-09-12T22:33:05.375 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.375 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.375 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:05.375 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405474+0000", 2024-09-12T22:33:05.375 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1095e-05 2024-09-12T22:33:05.376 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.376 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.376 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:05.376 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405482+0000", 2024-09-12T22:33:05.376 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3610000000000001e-06 2024-09-12T22:33:05.376 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.376 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.376 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:05.376 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407051+0000", 2024-09-12T22:33:05.376 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0015688970000000001 2024-09-12T22:33:05.376 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.376 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.377 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:05.377 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407259+0000", 2024-09-12T22:33:05.377 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00020778300000000001 2024-09-12T22:33:05.377 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.377 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.377 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:33:05.377 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407622+0000", 2024-09-12T22:33:05.377 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000363066 2024-09-12T22:33:05.377 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.377 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.377 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:05.377 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409438+0000", 2024-09-12T22:33:05.377 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001816319 2024-09-12T22:33:05.378 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.378 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.378 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:05.378 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418257+0000", 2024-09-12T22:33:05.378 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0088187720000000008 2024-09-12T22:33:05.378 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.378 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.378 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:05.378 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418308+0000", 2024-09-12T22:33:05.378 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1180000000000001e-05 2024-09-12T22:33:05.379 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.379 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.379 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:05.379 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418345+0000", 2024-09-12T22:33:05.379 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6476000000000001e-05 2024-09-12T22:33:05.379 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:05.379 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:05.379 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:05.379 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.379 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.379 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:33:05.379 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.405496+0000", 2024-09-12T22:33:05.379 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 87.865753999000006, 2024-09-12T22:33:05.380 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013016012, 2024-09-12T22:33:05.380 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:05.380 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:05.380 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:05.380 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:05.380 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.380 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:05.380 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405496+0000", 2024-09-12T22:33:05.380 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:05.380 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.380 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.380 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:05.380 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405496+0000", 2024-09-12T22:33:05.381 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:05.381 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.381 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.381 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:05.381 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405496+0000", 2024-09-12T22:33:05.381 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7999999999999995e-07 2024-09-12T22:33:05.381 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.381 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.381 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:05.381 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405501+0000", 2024-09-12T22:33:05.381 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8359999999999999e-06 2024-09-12T22:33:05.381 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.381 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.381 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:05.382 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405514+0000", 2024-09-12T22:33:05.382 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2522e-05 2024-09-12T22:33:05.382 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.382 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.382 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:05.382 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405521+0000", 2024-09-12T22:33:05.382 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5020000000000003e-06 2024-09-12T22:33:05.382 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.382 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.382 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:05.382 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405575+0000", 2024-09-12T22:33:05.382 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4169999999999998e-05 2024-09-12T22:33:05.382 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.382 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.383 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:05.383 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405697+0000", 2024-09-12T22:33:05.383 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000121301 2024-09-12T22:33:05.383 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.383 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.383 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:33:05.383 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405829+0000", 2024-09-12T22:33:05.383 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000132662 2024-09-12T22:33:05.383 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.383 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.383 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:05.383 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409155+0000", 2024-09-12T22:33:05.383 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0033259050000000001 2024-09-12T22:33:05.383 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.384 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.384 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:05.384 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418425+0000", 2024-09-12T22:33:05.384 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0092696319999999999 2024-09-12T22:33:05.384 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.384 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.384 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:05.384 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418471+0000", 2024-09-12T22:33:05.384 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6213e-05 2024-09-12T22:33:05.384 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.384 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.384 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:05.384 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418512+0000", 2024-09-12T22:33:05.384 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0589000000000001e-05 2024-09-12T22:33:05.385 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:05.385 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:05.385 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:05.385 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.385 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.385 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:33:05.385 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.406108+0000", 2024-09-12T22:33:05.385 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 87.865141601999994, 2024-09-12T22:33:05.385 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012458175, 2024-09-12T22:33:05.385 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:05.385 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:05.385 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:05.385 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:05.385 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.386 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:05.386 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406108+0000", 2024-09-12T22:33:05.386 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:05.386 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.386 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.386 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:05.386 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406108+0000", 2024-09-12T22:33:05.386 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:05.386 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.386 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.386 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:05.386 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406109+0000", 2024-09-12T22:33:05.386 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9899999999999999e-07 2024-09-12T22:33:05.386 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.387 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.387 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:05.387 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406115+0000", 2024-09-12T22:33:05.387 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9030000000000001e-06 2024-09-12T22:33:05.387 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.387 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.387 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:05.387 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406141+0000", 2024-09-12T22:33:05.387 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5999e-05 2024-09-12T22:33:05.387 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.387 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.387 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:05.387 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406150+0000", 2024-09-12T22:33:05.387 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.6050000000000004e-06 2024-09-12T22:33:05.388 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.388 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.388 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:05.388 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408163+0000", 2024-09-12T22:33:05.388 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0020122769999999998 2024-09-12T22:33:05.388 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.388 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.388 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:05.388 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408309+0000", 2024-09-12T22:33:05.388 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014606999999999999 2024-09-12T22:33:05.388 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.388 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.388 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:33:05.389 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408433+0000", 2024-09-12T22:33:05.389 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012460300000000001 2024-09-12T22:33:05.389 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.389 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.389 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:05.389 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409903+0000", 2024-09-12T22:33:05.389 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001469499 2024-09-12T22:33:05.389 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.389 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.389 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:05.389 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418427+0000", 2024-09-12T22:33:05.389 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0085241139999999993 2024-09-12T22:33:05.389 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.392 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.392 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:05.392 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418471+0000", 2024-09-12T22:33:05.392 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4474000000000001e-05 2024-09-12T22:33:05.392 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.392 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.392 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:05.392 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418566+0000", 2024-09-12T22:33:05.392 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.4732e-05 2024-09-12T22:33:05.392 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:05.393 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:05.393 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:05.393 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.393 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.393 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:33:05.393 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.407266+0000", 2024-09-12T22:33:05.393 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 87.863983746000002, 2024-09-12T22:33:05.393 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011442905, 2024-09-12T22:33:05.393 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:05.393 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:05.393 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2024-09-12T22:33:05.393 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:05.393 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.394 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:05.394 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407266+0000", 2024-09-12T22:33:05.394 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:05.394 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.394 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.394 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:05.394 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407266+0000", 2024-09-12T22:33:05.394 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:05.394 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.394 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.394 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:05.394 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407266+0000", 2024-09-12T22:33:05.394 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7899999999999998e-07 2024-09-12T22:33:05.394 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.395 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.395 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:05.395 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407269+0000", 2024-09-12T22:33:05.395 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9210000000000001e-06 2024-09-12T22:33:05.395 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.395 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.395 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:05.395 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407331+0000", 2024-09-12T22:33:05.395 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1376000000000003e-05 2024-09-12T22:33:05.395 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.395 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.395 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:05.395 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407337+0000", 2024-09-12T22:33:05.395 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1929999999999998e-06 2024-09-12T22:33:05.396 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.396 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.396 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:05.396 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408974+0000", 2024-09-12T22:33:05.396 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0016367109999999999 2024-09-12T22:33:05.396 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.396 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.396 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:05.396 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409112+0000", 2024-09-12T22:33:05.396 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000137952 2024-09-12T22:33:05.396 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:05.396 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:05.396 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:05.396 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418709+0000", 2024-09-12T22:33:05.397 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0095971730000000005 2024-09-12T22:33:05.397 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:05.397 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:05.397 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:05.397 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:05.397 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:05.397 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-09-12T22:33:05.398 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:05.396+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:05.399 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:33:05.491 INFO:teuthology.orchestra.run.smithi019.stderr:nodeep-scrub is unset 2024-09-12T22:33:05.499 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:05.498+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:05.508 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:33:05.508 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:33:05.508 INFO:teuthology.orchestra.run.smithi148.stdout: "num_ops": 0 2024-09-12T22:33:05.508 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:33:05.517 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:33:05.600 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:05.598+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:05.625 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:33:05.625 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:33:05.625 INFO:teuthology.orchestra.run.smithi148.stdout: "complaint_time": 30, 2024-09-12T22:33:05.625 INFO:teuthology.orchestra.run.smithi148.stdout: "num_blocked_ops": 0 2024-09-12T22:33:05.625 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:33:05.634 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:33:05.701 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:05.700+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:05.785 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:33:05.785 INFO:teuthology.orchestra.run.smithi148.stdout: "size": 20, 2024-09-12T22:33:05.785 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 600, 2024-09-12T22:33:05.785 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [ 2024-09-12T22:33:05.786 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.786 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:98 3.1f 3:f83d65d8:::200.00000004:head [write 409563~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-09-12T22:33:05.786 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:04.385076+0000", 2024-09-12T22:33:05.786 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 1.397850901, 2024-09-12T22:33:05.786 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.022769053000000001, 2024-09-12T22:33:05.786 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:05.786 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:05.786 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:05.786 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:05.786 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.786 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:05.786 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385076+0000", 2024-09-12T22:33:05.786 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:05.787 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.787 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.787 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:05.787 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385076+0000", 2024-09-12T22:33:05.787 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:05.787 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.787 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.787 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:05.787 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385076+0000", 2024-09-12T22:33:05.787 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8799999999999998e-07 2024-09-12T22:33:05.787 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.787 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.787 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:05.788 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385082+0000", 2024-09-12T22:33:05.788 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0950000000000003e-06 2024-09-12T22:33:05.788 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.788 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.788 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:05.788 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385087+0000", 2024-09-12T22:33:05.788 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.463e-06 2024-09-12T22:33:05.788 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.788 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.788 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:05.788 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385090+0000", 2024-09-12T22:33:05.788 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4359999999999998e-06 2024-09-12T22:33:05.788 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.789 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.789 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:05.789 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.400713+0000", 2024-09-12T22:33:05.789 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.015622416 2024-09-12T22:33:05.789 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.789 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.789 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:05.789 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.400785+0000", 2024-09-12T22:33:05.789 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1761000000000006e-05 2024-09-12T22:33:05.789 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.789 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.789 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:05.789 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.400904+0000", 2024-09-12T22:33:05.790 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000119422 2024-09-12T22:33:05.790 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.790 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.790 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:05.790 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.403113+0000", 2024-09-12T22:33:05.790 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0022093899999999999 2024-09-12T22:33:05.790 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.790 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.790 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:05.790 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.407757+0000", 2024-09-12T22:33:05.790 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0046435119999999998 2024-09-12T22:33:05.790 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.790 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.790 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:05.791 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.407802+0000", 2024-09-12T22:33:05.791 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5479000000000003e-05 2024-09-12T22:33:05.791 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.791 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.791 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:05.791 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.407845+0000", 2024-09-12T22:33:05.791 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2790999999999997e-05 2024-09-12T22:33:05.791 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:05.791 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:05.791 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:05.791 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.791 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.791 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:99 3.1f 3:f83d65d8:::200.00000004:head [write 410964~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-09-12T22:33:05.791 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:04.385097+0000", 2024-09-12T22:33:05.792 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 1.3978296399999999, 2024-09-12T22:33:05.792 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.02283048, 2024-09-12T22:33:05.792 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:05.792 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:05.792 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:05.792 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:05.792 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.792 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:05.792 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385097+0000", 2024-09-12T22:33:05.792 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:05.792 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.792 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.792 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:05.792 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385097+0000", 2024-09-12T22:33:05.793 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:05.793 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.793 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.793 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:05.793 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385098+0000", 2024-09-12T22:33:05.793 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5699999999999999e-07 2024-09-12T22:33:05.793 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.793 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.793 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:05.793 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385100+0000", 2024-09-12T22:33:05.793 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9139999999999998e-06 2024-09-12T22:33:05.793 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.794 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.794 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:05.794 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385104+0000", 2024-09-12T22:33:05.794 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1910000000000002e-06 2024-09-12T22:33:05.794 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.794 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.794 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:05.794 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385107+0000", 2024-09-12T22:33:05.794 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.7939999999999998e-06 2024-09-12T22:33:05.794 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.794 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.794 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:05.794 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.401260+0000", 2024-09-12T22:33:05.795 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016153700999999999 2024-09-12T22:33:05.795 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.795 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.795 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:05.795 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.401337+0000", 2024-09-12T22:33:05.795 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.6470000000000005e-05 2024-09-12T22:33:05.795 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.795 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.795 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:05.795 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.401462+0000", 2024-09-12T22:33:05.795 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000125666 2024-09-12T22:33:05.795 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.795 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.795 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:05.796 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.404304+0000", 2024-09-12T22:33:05.796 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0028414809999999999 2024-09-12T22:33:05.796 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.796 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.796 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:05.796 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.407853+0000", 2024-09-12T22:33:05.796 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0035488310000000001 2024-09-12T22:33:05.796 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.796 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.796 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:05.796 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.407894+0000", 2024-09-12T22:33:05.796 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1455000000000002e-05 2024-09-12T22:33:05.796 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.797 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.797 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:05.797 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.407928+0000", 2024-09-12T22:33:05.797 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3720000000000002e-05 2024-09-12T22:33:05.797 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:05.797 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:05.797 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:05.797 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.797 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.797 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:100 3.1f 3:f83d65d8:::200.00000004:head [write 412367~1404 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-09-12T22:33:05.797 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:04.385111+0000", 2024-09-12T22:33:05.797 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 1.3978160319999999, 2024-09-12T22:33:05.798 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.022896741000000002, 2024-09-12T22:33:05.798 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:05.798 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:05.798 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:05.798 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:05.798 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.798 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:05.798 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385111+0000", 2024-09-12T22:33:05.798 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:05.798 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.798 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.798 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:05.798 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385111+0000", 2024-09-12T22:33:05.799 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:05.799 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.799 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.799 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:05.799 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385111+0000", 2024-09-12T22:33:05.799 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.22e-07 2024-09-12T22:33:05.800 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.800 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.800 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:05.800 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385113+0000", 2024-09-12T22:33:05.800 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7069999999999999e-06 2024-09-12T22:33:05.800 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.800 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.801 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:05.801 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385119+0000", 2024-09-12T22:33:05.801 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2090000000000002e-06 2024-09-12T22:33:05.801 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.801 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.801 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:05.801 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385122+0000", 2024-09-12T22:33:05.801 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.033e-06 2024-09-12T22:33:05.801 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.801 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.801 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:05.802 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.401990+0000", 2024-09-12T22:33:05.802 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016867534 2024-09-12T22:33:05.802 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.802 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.802 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:05.802 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.402057+0000", 2024-09-12T22:33:05.802 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7118000000000004e-05 2024-09-12T22:33:05.802 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.802 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.802 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:05.802 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.402161+0000", 2024-09-12T22:33:05.802 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000103905 2024-09-12T22:33:05.802 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.803 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.803 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:05.803 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.404360+0000", 2024-09-12T22:33:05.803 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0021992940000000001 2024-09-12T22:33:05.803 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.803 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.803 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:05.803 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.407935+0000", 2024-09-12T22:33:05.803 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0035751630000000001 2024-09-12T22:33:05.803 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.803 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.803 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:05.803 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.407976+0000", 2024-09-12T22:33:05.804 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0376000000000001e-05 2024-09-12T22:33:05.804 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.804 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.804 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:05.804 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.408008+0000", 2024-09-12T22:33:05.804 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.218e-05 2024-09-12T22:33:05.804 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:05.804 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:05.804 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:05.804 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.804 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.804 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:101 3.1f 3:f83d65d8:::200.00000004:head [write 413771~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-09-12T22:33:05.804 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:04.385126+0000", 2024-09-12T22:33:05.805 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 1.397801031, 2024-09-12T22:33:05.805 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.022964140000000001, 2024-09-12T22:33:05.805 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:05.805 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:05.805 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:05.805 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:05.805 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.805 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:05.805 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385126+0000", 2024-09-12T22:33:05.805 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:05.805 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.805 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.805 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:05.805 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385126+0000", 2024-09-12T22:33:05.806 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:05.806 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.806 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.806 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:05.806 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385126+0000", 2024-09-12T22:33:05.806 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.29e-07 2024-09-12T22:33:05.806 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.806 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.806 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:05.806 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385139+0000", 2024-09-12T22:33:05.806 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2877000000000001e-05 2024-09-12T22:33:05.806 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.806 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.806 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:05.807 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385144+0000", 2024-09-12T22:33:05.807 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9840000000000001e-06 2024-09-12T22:33:05.807 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.807 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.807 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:05.807 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385147+0000", 2024-09-12T22:33:05.807 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0750000000000002e-06 2024-09-12T22:33:05.807 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.807 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.807 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:05.807 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.402511+0000", 2024-09-12T22:33:05.807 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017363456999999999 2024-09-12T22:33:05.807 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.808 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.808 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:05.808 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.402587+0000", 2024-09-12T22:33:05.808 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.6128e-05 2024-09-12T22:33:05.808 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.808 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.808 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:05.808 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.402706+0000", 2024-09-12T22:33:05.808 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000119157 2024-09-12T22:33:05.808 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.808 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.808 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:05.809 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.404414+0000", 2024-09-12T22:33:05.809 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00170773 2024-09-12T22:33:05.809 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.809 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.809 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:05.809 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.408015+0000", 2024-09-12T22:33:05.809 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003601389 2024-09-12T22:33:05.809 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.809 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.809 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:05.809 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.408057+0000", 2024-09-12T22:33:05.809 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1548999999999998e-05 2024-09-12T22:33:05.809 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.810 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.810 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:05.810 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.408090+0000", 2024-09-12T22:33:05.810 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3565000000000001e-05 2024-09-12T22:33:05.810 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:05.810 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:05.810 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:05.810 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.810 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.810 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:102 3.1f 3:f83d65d8:::200.00000004:head [write 415176~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-09-12T22:33:05.810 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:04.385152+0000", 2024-09-12T22:33:05.810 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 1.397774713, 2024-09-12T22:33:05.810 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.023015768999999998, 2024-09-12T22:33:05.811 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:05.811 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:05.811 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:05.811 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:05.811 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.811 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:05.811 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385152+0000", 2024-09-12T22:33:05.811 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:05.811 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.811 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.811 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:05.811 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385152+0000", 2024-09-12T22:33:05.811 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:05.812 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.812 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.812 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:05.812 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385155+0000", 2024-09-12T22:33:05.812 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4200000000000001e-06 2024-09-12T22:33:05.812 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.812 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.812 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:05.812 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385157+0000", 2024-09-12T22:33:05.812 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.8640000000000001e-06 2024-09-12T22:33:05.812 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.812 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.812 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:05.813 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385161+0000", 2024-09-12T22:33:05.813 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1590000000000003e-06 2024-09-12T22:33:05.813 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.813 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.813 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:05.813 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385164+0000", 2024-09-12T22:33:05.813 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8150000000000002e-06 2024-09-12T22:33:05.813 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.813 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.813 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:05.813 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.403160+0000", 2024-09-12T22:33:05.813 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017996174 2024-09-12T22:33:05.813 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.813 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.814 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:05.814 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.403229+0000", 2024-09-12T22:33:05.814 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.9301999999999995e-05 2024-09-12T22:33:05.814 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.814 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.814 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:05.814 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.403341+0000", 2024-09-12T22:33:05.814 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000112002 2024-09-12T22:33:05.814 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.814 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.814 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:05.814 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.405776+0000", 2024-09-12T22:33:05.814 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0024350079999999998 2024-09-12T22:33:05.814 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.815 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.815 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:05.815 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.408097+0000", 2024-09-12T22:33:05.815 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.002321086 2024-09-12T22:33:05.815 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.815 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.815 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:05.815 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.408137+0000", 2024-09-12T22:33:05.815 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9743999999999998e-05 2024-09-12T22:33:05.815 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.815 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.815 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:05.815 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.408168+0000", 2024-09-12T22:33:05.816 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.1195000000000002e-05 2024-09-12T22:33:05.816 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:05.816 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:05.816 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:05.816 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.816 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.816 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:103 3.1f 3:f83d65d8:::200.00000004:head [write 416575~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-09-12T22:33:05.816 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:04.385167+0000", 2024-09-12T22:33:05.816 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 1.3977601660000001, 2024-09-12T22:33:05.816 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.024972646000000001, 2024-09-12T22:33:05.816 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:05.816 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:05.816 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:05.816 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:05.817 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.817 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:05.817 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385167+0000", 2024-09-12T22:33:05.817 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:05.817 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.817 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.817 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:05.817 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385167+0000", 2024-09-12T22:33:05.817 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:05.817 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.817 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.817 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:05.817 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385167+0000", 2024-09-12T22:33:05.817 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.2100000000000001e-07 2024-09-12T22:33:05.818 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.818 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.818 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:05.818 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385176+0000", 2024-09-12T22:33:05.818 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.8249999999999994e-06 2024-09-12T22:33:05.818 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.818 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.818 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:05.818 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385182+0000", 2024-09-12T22:33:05.818 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0469999999999999e-06 2024-09-12T22:33:05.818 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.818 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.819 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:05.819 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385185+0000", 2024-09-12T22:33:05.819 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0570000000000001e-06 2024-09-12T22:33:05.819 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.819 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.819 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:05.819 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.403629+0000", 2024-09-12T22:33:05.819 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.018443838000000001 2024-09-12T22:33:05.819 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.819 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.819 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:05.819 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.403710+0000", 2024-09-12T22:33:05.819 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0851000000000002e-05 2024-09-12T22:33:05.819 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.820 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.820 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:05.820 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.403859+0000", 2024-09-12T22:33:05.820 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014873800000000001 2024-09-12T22:33:05.820 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.820 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.820 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:05.820 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.406967+0000", 2024-09-12T22:33:05.820 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0031080320000000002 2024-09-12T22:33:05.820 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.820 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.820 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:05.820 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410055+0000", 2024-09-12T22:33:05.821 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003088698 2024-09-12T22:33:05.821 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.821 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.821 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:05.821 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410104+0000", 2024-09-12T22:33:05.821 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8469e-05 2024-09-12T22:33:05.821 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.821 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.821 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:05.821 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410140+0000", 2024-09-12T22:33:05.821 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.587e-05 2024-09-12T22:33:05.821 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:05.821 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:05.822 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:05.822 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.822 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.822 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:104 3.1f 3:f83d65d8:::200.00000004:head [write 417974~1421 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-09-12T22:33:05.822 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:04.385189+0000", 2024-09-12T22:33:05.822 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 1.397738012, 2024-09-12T22:33:05.822 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.025034507000000001, 2024-09-12T22:33:05.822 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:05.822 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:05.822 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:05.822 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:05.822 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.822 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:05.822 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385189+0000", 2024-09-12T22:33:05.823 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:05.823 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.823 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.823 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:05.823 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385189+0000", 2024-09-12T22:33:05.823 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:05.823 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.823 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.823 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:05.823 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385189+0000", 2024-09-12T22:33:05.823 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5199999999999998e-07 2024-09-12T22:33:05.823 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.823 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.823 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:05.824 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385191+0000", 2024-09-12T22:33:05.824 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7489999999999999e-06 2024-09-12T22:33:05.824 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.824 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.824 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:05.824 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385194+0000", 2024-09-12T22:33:05.824 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.1039999999999998e-06 2024-09-12T22:33:05.824 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.824 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.824 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:05.824 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385197+0000", 2024-09-12T22:33:05.824 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.3740000000000001e-06 2024-09-12T22:33:05.825 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.825 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.825 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:05.825 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.404717+0000", 2024-09-12T22:33:05.825 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.019520056000000001 2024-09-12T22:33:05.825 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.825 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.825 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:05.825 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.404795+0000", 2024-09-12T22:33:05.825 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.818e-05 2024-09-12T22:33:05.825 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.825 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.825 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:05.825 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.404930+0000", 2024-09-12T22:33:05.826 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013531400000000001 2024-09-12T22:33:05.826 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.826 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.826 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:05.826 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.407028+0000", 2024-09-12T22:33:05.826 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0020980899999999999 2024-09-12T22:33:05.826 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.826 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.826 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:05.826 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410147+0000", 2024-09-12T22:33:05.826 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0031188710000000001 2024-09-12T22:33:05.826 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.826 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.826 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:05.827 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410190+0000", 2024-09-12T22:33:05.827 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2899999999999999e-05 2024-09-12T22:33:05.827 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.827 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.827 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:05.827 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410224+0000", 2024-09-12T22:33:05.827 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3617e-05 2024-09-12T22:33:05.827 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:05.827 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:05.827 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:05.827 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.827 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.827 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:105 3.1f 3:f83d65d8:::200.00000004:head [write 419395~1406 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-09-12T22:33:05.827 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:04.385200+0000", 2024-09-12T22:33:05.828 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 1.397727457, 2024-09-12T22:33:05.828 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.025105683, 2024-09-12T22:33:05.828 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:05.828 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:05.828 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:05.828 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:05.828 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.828 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:05.828 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385200+0000", 2024-09-12T22:33:05.828 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:05.828 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.828 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.828 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:05.828 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385200+0000", 2024-09-12T22:33:05.829 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:05.829 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.829 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.829 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:05.829 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385200+0000", 2024-09-12T22:33:05.829 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.05e-07 2024-09-12T22:33:05.829 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.829 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.829 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:05.829 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385205+0000", 2024-09-12T22:33:05.829 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.6269999999999997e-06 2024-09-12T22:33:05.829 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.829 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.829 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:05.830 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385209+0000", 2024-09-12T22:33:05.830 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.439e-06 2024-09-12T22:33:05.830 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.830 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.830 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:05.830 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385211+0000", 2024-09-12T22:33:05.830 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5040000000000001e-06 2024-09-12T22:33:05.830 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.830 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.830 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:05.830 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.405286+0000", 2024-09-12T22:33:05.830 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.020074229999999998 2024-09-12T22:33:05.830 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.830 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.831 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:05.831 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.405359+0000", 2024-09-12T22:33:05.831 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3355000000000005e-05 2024-09-12T22:33:05.831 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.831 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.831 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:05.831 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.405471+0000", 2024-09-12T22:33:05.831 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000112175 2024-09-12T22:33:05.831 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.831 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.831 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:05.831 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.408223+0000", 2024-09-12T22:33:05.831 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0027517779999999999 2024-09-12T22:33:05.831 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.832 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.832 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:05.832 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410231+0000", 2024-09-12T22:33:05.832 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0020078190000000001 2024-09-12T22:33:05.832 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.832 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.832 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:05.832 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410273+0000", 2024-09-12T22:33:05.832 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2530000000000001e-05 2024-09-12T22:33:05.832 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.832 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.832 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:05.832 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410305+0000", 2024-09-12T22:33:05.832 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2020999999999997e-05 2024-09-12T22:33:05.833 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:05.833 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:05.833 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:05.833 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.833 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.833 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:106 3.1f 3:f83d65d8:::200.00000004:head [write 420801~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-09-12T22:33:05.833 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:04.385215+0000", 2024-09-12T22:33:05.833 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 1.397712131, 2024-09-12T22:33:05.833 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.025168234000000001, 2024-09-12T22:33:05.833 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:05.833 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:05.833 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:05.833 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:05.833 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.834 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:05.834 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385215+0000", 2024-09-12T22:33:05.834 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:05.834 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.834 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.834 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:05.834 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385215+0000", 2024-09-12T22:33:05.834 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:05.834 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.834 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.834 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:05.834 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385215+0000", 2024-09-12T22:33:05.834 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.2600000000000001e-07 2024-09-12T22:33:05.835 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.835 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.835 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:05.835 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385217+0000", 2024-09-12T22:33:05.835 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7099999999999999e-06 2024-09-12T22:33:05.835 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.835 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.835 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:05.835 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385220+0000", 2024-09-12T22:33:05.835 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.004e-06 2024-09-12T22:33:05.835 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.835 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.836 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:05.836 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385223+0000", 2024-09-12T22:33:05.836 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.633e-06 2024-09-12T22:33:05.836 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.836 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.836 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:05.836 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.405826+0000", 2024-09-12T22:33:05.836 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.020603831999999999 2024-09-12T22:33:05.836 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.836 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.836 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:05.836 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.405898+0000", 2024-09-12T22:33:05.836 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1398999999999999e-05 2024-09-12T22:33:05.836 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.837 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.837 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:05.837 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.406011+0000", 2024-09-12T22:33:05.837 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000113411 2024-09-12T22:33:05.837 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.837 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.837 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:05.837 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.408285+0000", 2024-09-12T22:33:05.837 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.002273639 2024-09-12T22:33:05.838 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.838 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.838 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:05.838 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410313+0000", 2024-09-12T22:33:05.838 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0020280760000000002 2024-09-12T22:33:05.838 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.838 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.838 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:05.838 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410350+0000", 2024-09-12T22:33:05.838 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7307e-05 2024-09-12T22:33:05.838 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.838 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.838 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:05.839 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410383+0000", 2024-09-12T22:33:05.839 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2997000000000003e-05 2024-09-12T22:33:05.839 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:05.839 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:05.839 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:05.839 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.839 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.839 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:107 3.1f 3:f83d65d8:::200.00000004:head [write 422206~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-09-12T22:33:05.839 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:04.385226+0000", 2024-09-12T22:33:05.839 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 1.397701396, 2024-09-12T22:33:05.839 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.025350256000000002, 2024-09-12T22:33:05.839 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:05.839 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:05.839 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:05.840 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:05.840 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.840 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:05.840 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385226+0000", 2024-09-12T22:33:05.840 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:05.840 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.840 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.840 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:05.840 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385226+0000", 2024-09-12T22:33:05.840 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:05.840 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.840 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.840 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:05.840 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385226+0000", 2024-09-12T22:33:05.841 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.2399999999999999e-07 2024-09-12T22:33:05.841 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.841 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.841 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:05.841 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385228+0000", 2024-09-12T22:33:05.841 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.508e-06 2024-09-12T22:33:05.841 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.841 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.841 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:05.841 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385235+0000", 2024-09-12T22:33:05.841 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.3169999999999998e-06 2024-09-12T22:33:05.841 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.841 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.842 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:05.842 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385238+0000", 2024-09-12T22:33:05.842 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.9249999999999999e-06 2024-09-12T22:33:05.842 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.842 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.842 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:05.842 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.406376+0000", 2024-09-12T22:33:05.842 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.021138364999999999 2024-09-12T22:33:05.842 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.842 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.842 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:05.842 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.406451+0000", 2024-09-12T22:33:05.842 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4882000000000006e-05 2024-09-12T22:33:05.842 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.843 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.843 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:05.843 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.406590+0000", 2024-09-12T22:33:05.843 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000138627 2024-09-12T22:33:05.843 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.843 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.843 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:05.843 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410461+0000", 2024-09-12T22:33:05.843 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0038712109999999998 2024-09-12T22:33:05.843 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.843 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.843 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:05.843 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410493+0000", 2024-09-12T22:33:05.843 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2147999999999998e-05 2024-09-12T22:33:05.844 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.844 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.844 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:05.844 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410537+0000", 2024-09-12T22:33:05.844 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3792999999999999e-05 2024-09-12T22:33:05.844 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.844 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.844 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:05.844 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410576+0000", 2024-09-12T22:33:05.844 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9255999999999998e-05 2024-09-12T22:33:05.844 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:05.844 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:05.844 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:05.845 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.845 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.845 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4490.0:5682 4.3f 4:ff1ebe6d:::10000001a29.00000000:head [write 0~2106] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T22:33:05.845 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:04.386989+0000", 2024-09-12T22:33:05.845 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 1.395938473, 2024-09-12T22:33:05.845 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.023595390000000001, 2024-09-12T22:33:05.845 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:05.845 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:05.845 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:05.845 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:33:05.845 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4490", 2024-09-12T22:33:05.845 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:05.845 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 5682 2024-09-12T22:33:05.846 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.846 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:05.846 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.846 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:05.846 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.386989+0000", 2024-09-12T22:33:05.846 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:05.846 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.846 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.846 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:05.846 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.386989+0000", 2024-09-12T22:33:05.846 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:05.846 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.846 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.846 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:05.846 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.386989+0000", 2024-09-12T22:33:05.847 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.8800000000000002e-07 2024-09-12T22:33:05.847 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.847 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.847 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:05.847 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.386994+0000", 2024-09-12T22:33:05.847 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4279999999999998e-06 2024-09-12T22:33:05.847 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.847 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.847 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:05.847 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.387001+0000", 2024-09-12T22:33:05.847 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.2320000000000004e-06 2024-09-12T22:33:05.847 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.847 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.847 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:05.848 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.387006+0000", 2024-09-12T22:33:05.848 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6589999999999998e-06 2024-09-12T22:33:05.848 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.848 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.848 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:05.848 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.407003+0000", 2024-09-12T22:33:05.848 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.019997635 2024-09-12T22:33:05.848 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.848 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.848 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:05.848 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.407134+0000", 2024-09-12T22:33:05.848 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013037899999999999 2024-09-12T22:33:05.848 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.848 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.849 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:05.849 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410469+0000", 2024-09-12T22:33:05.849 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0033353160000000001 2024-09-12T22:33:05.849 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.849 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.849 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:05.849 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410510+0000", 2024-09-12T22:33:05.849 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0553999999999998e-05 2024-09-12T22:33:05.849 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.849 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.849 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:05.849 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410584+0000", 2024-09-12T22:33:05.849 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4399000000000004e-05 2024-09-12T22:33:05.850 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:05.850 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:05.850 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:05.850 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.850 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.850 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:108 3.1f 3:f83d65d8:::200.00000004:head [write 423607~16211 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-09-12T22:33:05.850 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:04.392223+0000", 2024-09-12T22:33:05.850 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 1.3907044769999999, 2024-09-12T22:33:05.850 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.022025629000000001, 2024-09-12T22:33:05.850 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:05.850 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:05.850 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:05.850 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:05.850 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.851 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:05.851 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.392223+0000", 2024-09-12T22:33:05.851 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:05.851 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.851 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.851 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:05.851 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.392223+0000", 2024-09-12T22:33:05.851 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:05.851 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.851 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.851 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:05.851 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.392224+0000", 2024-09-12T22:33:05.851 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.358e-06 2024-09-12T22:33:05.851 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.852 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.852 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:05.852 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.392238+0000", 2024-09-12T22:33:05.852 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4408e-05 2024-09-12T22:33:05.852 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.852 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.852 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:05.852 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.392248+0000", 2024-09-12T22:33:05.852 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0013000000000001e-05 2024-09-12T22:33:05.852 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.852 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.852 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:05.852 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.392256+0000", 2024-09-12T22:33:05.852 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1060000000000002e-06 2024-09-12T22:33:05.853 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.853 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.853 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:05.853 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.407080+0000", 2024-09-12T22:33:05.853 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.014824519 2024-09-12T22:33:05.853 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.853 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.853 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:05.853 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.407152+0000", 2024-09-12T22:33:05.853 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1543000000000003e-05 2024-09-12T22:33:05.853 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.853 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.853 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:05.854 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.407270+0000", 2024-09-12T22:33:05.854 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000118721 2024-09-12T22:33:05.854 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.854 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.854 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:05.854 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410591+0000", 2024-09-12T22:33:05.854 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0033203080000000001 2024-09-12T22:33:05.854 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.854 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.854 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:05.854 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.414179+0000", 2024-09-12T22:33:05.854 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00358838 2024-09-12T22:33:05.854 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.854 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.855 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:05.855 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.414215+0000", 2024-09-12T22:33:05.855 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.5753999999999997e-05 2024-09-12T22:33:05.855 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.855 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.855 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:05.855 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.414248+0000", 2024-09-12T22:33:05.855 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3519000000000002e-05 2024-09-12T22:33:05.855 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:05.855 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:05.855 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:05.855 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.855 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.856 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:109 3.1f 3:f83d65d8:::200.00000004:head [write 439818~3871 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-09-12T22:33:05.856 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:04.393309+0000", 2024-09-12T22:33:05.856 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 1.389618367, 2024-09-12T22:33:05.856 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.021084952000000001, 2024-09-12T22:33:05.856 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:05.856 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:05.856 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:05.856 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:05.856 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.856 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:05.856 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393309+0000", 2024-09-12T22:33:05.856 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:05.856 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.857 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.857 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:05.857 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393309+0000", 2024-09-12T22:33:05.857 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:05.857 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.857 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.857 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:05.857 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393309+0000", 2024-09-12T22:33:05.857 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.8400000000000004e-07 2024-09-12T22:33:05.857 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.857 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.857 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:05.857 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393317+0000", 2024-09-12T22:33:05.857 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.8199999999999997e-06 2024-09-12T22:33:05.858 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.858 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.858 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:05.858 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393327+0000", 2024-09-12T22:33:05.858 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.7450000000000007e-06 2024-09-12T22:33:05.858 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.858 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.858 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:05.858 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393334+0000", 2024-09-12T22:33:05.858 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3409999999999997e-06 2024-09-12T22:33:05.858 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.858 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.859 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:05.859 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.408316+0000", 2024-09-12T22:33:05.859 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.014981335 2024-09-12T22:33:05.859 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.859 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.859 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:05.859 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.408391+0000", 2024-09-12T22:33:05.859 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4948000000000001e-05 2024-09-12T22:33:05.859 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.859 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.859 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:05.859 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.408502+0000", 2024-09-12T22:33:05.859 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000111643 2024-09-12T22:33:05.859 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.860 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.860 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:05.860 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410597+0000", 2024-09-12T22:33:05.860 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0020942909999999999 2024-09-12T22:33:05.860 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.860 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.860 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:05.860 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.414301+0000", 2024-09-12T22:33:05.860 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0037040100000000002 2024-09-12T22:33:05.860 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.860 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.860 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:05.861 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.414355+0000", 2024-09-12T22:33:05.861 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4555999999999997e-05 2024-09-12T22:33:05.861 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.861 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.861 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:05.861 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.414394+0000", 2024-09-12T22:33:05.861 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.8578999999999998e-05 2024-09-12T22:33:05.861 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:05.861 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:05.861 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:05.861 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.861 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.862 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:110 3.1f 3:f83d65d8:::200.00000004:head [write 443689~1928 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-09-12T22:33:05.862 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:04.393358+0000", 2024-09-12T22:33:05.862 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 1.3895690570000001, 2024-09-12T22:33:05.862 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.021144165999999999, 2024-09-12T22:33:05.862 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:05.862 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:05.862 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:05.862 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:05.862 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.862 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:05.862 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393358+0000", 2024-09-12T22:33:05.862 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:05.862 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.863 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.863 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:05.863 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393358+0000", 2024-09-12T22:33:05.863 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:05.863 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.863 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.863 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:05.863 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393359+0000", 2024-09-12T22:33:05.863 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3900000000000005e-07 2024-09-12T22:33:05.863 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.863 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.863 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:05.863 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393363+0000", 2024-09-12T22:33:05.864 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0509999999999998e-06 2024-09-12T22:33:05.864 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.864 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.864 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:05.864 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393370+0000", 2024-09-12T22:33:05.864 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.8350000000000004e-06 2024-09-12T22:33:05.864 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.864 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.864 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:05.864 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393376+0000", 2024-09-12T22:33:05.864 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8030000000000002e-06 2024-09-12T22:33:05.864 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.865 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.865 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:05.865 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.408908+0000", 2024-09-12T22:33:05.865 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.01553218 2024-09-12T22:33:05.865 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.865 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.865 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:05.865 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.408978+0000", 2024-09-12T22:33:05.865 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.9142999999999999e-05 2024-09-12T22:33:05.865 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.865 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.865 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:05.865 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.409088+0000", 2024-09-12T22:33:05.865 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000110357 2024-09-12T22:33:05.866 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.866 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.866 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:05.866 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.411046+0000", 2024-09-12T22:33:05.866 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001958338 2024-09-12T22:33:05.866 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.866 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.866 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:05.866 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.414431+0000", 2024-09-12T22:33:05.866 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0033846340000000001 2024-09-12T22:33:05.866 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.866 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.866 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:05.866 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.414474+0000", 2024-09-12T22:33:05.867 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2777000000000001e-05 2024-09-12T22:33:05.867 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.867 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.867 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:05.867 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.414502+0000", 2024-09-12T22:33:05.867 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8509000000000001e-05 2024-09-12T22:33:05.867 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:05.867 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:05.867 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:05.867 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.867 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.867 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:111 3.1f 3:f83d65d8:::200.00000004:head [write 445617~3886 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-09-12T22:33:05.867 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:04.393579+0000", 2024-09-12T22:33:05.867 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 1.3893484979999999, 2024-09-12T22:33:05.868 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.021052739000000001, 2024-09-12T22:33:05.868 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:05.868 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:05.868 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:05.868 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:05.868 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.868 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:05.868 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393579+0000", 2024-09-12T22:33:05.868 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:05.868 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.868 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.868 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:05.868 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393579+0000", 2024-09-12T22:33:05.869 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:05.869 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.869 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.869 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:05.869 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393579+0000", 2024-09-12T22:33:05.869 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.09e-07 2024-09-12T22:33:05.869 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.869 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.869 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:05.869 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393586+0000", 2024-09-12T22:33:05.869 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.6279999999999999e-06 2024-09-12T22:33:05.869 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.870 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.870 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:05.870 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393603+0000", 2024-09-12T22:33:05.870 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6750000000000001e-05 2024-09-12T22:33:05.870 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.870 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.870 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:05.870 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393609+0000", 2024-09-12T22:33:05.870 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.3090000000000001e-06 2024-09-12T22:33:05.870 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.870 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.870 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:05.870 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.409440+0000", 2024-09-12T22:33:05.870 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.015830486000000001 2024-09-12T22:33:05.871 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.871 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.871 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:05.871 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.409520+0000", 2024-09-12T22:33:05.871 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0761999999999997e-05 2024-09-12T22:33:05.871 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.871 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.871 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:05.871 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.409634+0000", 2024-09-12T22:33:05.871 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000113155 2024-09-12T22:33:05.871 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.871 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.871 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:05.871 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.411630+0000", 2024-09-12T22:33:05.872 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0019964940000000001 2024-09-12T22:33:05.872 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.872 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.872 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:05.872 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.414551+0000", 2024-09-12T22:33:05.872 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0029212660000000001 2024-09-12T22:33:05.872 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.872 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.872 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:05.872 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.414598+0000", 2024-09-12T22:33:05.872 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6836999999999999e-05 2024-09-12T22:33:05.872 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.872 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.873 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:05.873 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.414631+0000", 2024-09-12T22:33:05.873 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3243e-05 2024-09-12T22:33:05.873 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:05.873 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:05.873 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:05.873 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.873 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.873 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:112 3.1f 3:f83d65d8:::200.00000004:head [write 449503~3460 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-09-12T22:33:05.873 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:04.393638+0000", 2024-09-12T22:33:05.873 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 1.3892886899999999, 2024-09-12T22:33:05.873 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.023344696000000002, 2024-09-12T22:33:05.873 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:05.873 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:05.874 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:05.874 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:05.874 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.874 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:05.874 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393638+0000", 2024-09-12T22:33:05.874 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:05.874 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.874 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.874 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:05.874 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393638+0000", 2024-09-12T22:33:05.874 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:05.874 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.874 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.874 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:05.875 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393639+0000", 2024-09-12T22:33:05.875 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.68e-07 2024-09-12T22:33:05.875 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.875 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.875 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:05.875 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393643+0000", 2024-09-12T22:33:05.875 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.98e-06 2024-09-12T22:33:05.875 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.875 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.875 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:05.875 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393650+0000", 2024-09-12T22:33:05.875 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.131e-06 2024-09-12T22:33:05.875 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.875 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.875 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:05.876 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393655+0000", 2024-09-12T22:33:05.876 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0270000000000003e-06 2024-09-12T22:33:05.876 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.876 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.876 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:05.876 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410618+0000", 2024-09-12T22:33:05.876 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016962600000000001 2024-09-12T22:33:05.876 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.876 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.876 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:05.876 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410679+0000", 2024-09-12T22:33:05.876 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.1014999999999998e-05 2024-09-12T22:33:05.876 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.876 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.877 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:05.877 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410763+0000", 2024-09-12T22:33:05.877 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.4586000000000006e-05 2024-09-12T22:33:05.877 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.877 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.877 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:05.877 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.412605+0000", 2024-09-12T22:33:05.877 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001842036 2024-09-12T22:33:05.877 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.877 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.877 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:05.877 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.416894+0000", 2024-09-12T22:33:05.877 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0042887649999999999 2024-09-12T22:33:05.878 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.878 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.878 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:05.878 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.416947+0000", 2024-09-12T22:33:05.878 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2500999999999998e-05 2024-09-12T22:33:05.878 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.878 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.878 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:05.878 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.416983+0000", 2024-09-12T22:33:05.878 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.6486999999999998e-05 2024-09-12T22:33:05.878 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:05.878 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:05.878 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:05.878 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.879 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.879 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:113 3.1f 3:f83d65d8:::200.00000004:head [write 452963~1919 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-09-12T22:33:05.879 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:04.393838+0000", 2024-09-12T22:33:05.879 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 1.3890892880000001, 2024-09-12T22:33:05.879 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.023234016999999999, 2024-09-12T22:33:05.879 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:05.879 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:05.879 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:05.879 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:05.879 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.879 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:05.879 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393838+0000", 2024-09-12T22:33:05.879 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:05.880 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.880 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.880 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:05.880 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393838+0000", 2024-09-12T22:33:05.880 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:05.880 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.880 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.880 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:05.880 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393839+0000", 2024-09-12T22:33:05.880 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.9299999999999997e-07 2024-09-12T22:33:05.880 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.880 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.880 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:05.881 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393842+0000", 2024-09-12T22:33:05.881 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7759999999999999e-06 2024-09-12T22:33:05.881 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.881 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.881 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:05.881 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393850+0000", 2024-09-12T22:33:05.881 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.6590000000000007e-06 2024-09-12T22:33:05.881 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.881 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.881 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:05.881 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393856+0000", 2024-09-12T22:33:05.881 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.1659999999999999e-06 2024-09-12T22:33:05.881 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.882 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.882 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:05.882 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.411099+0000", 2024-09-12T22:33:05.882 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017242785 2024-09-12T22:33:05.882 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.882 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.882 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:05.882 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.411172+0000", 2024-09-12T22:33:05.882 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.2552999999999995e-05 2024-09-12T22:33:05.882 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.882 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.882 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:05.882 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.411280+0000", 2024-09-12T22:33:05.882 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000108701 2024-09-12T22:33:05.883 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.883 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.883 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:05.883 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.413582+0000", 2024-09-12T22:33:05.883 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0023020290000000001 2024-09-12T22:33:05.883 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.883 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.883 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:05.883 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.417020+0000", 2024-09-12T22:33:05.883 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0034373860000000002 2024-09-12T22:33:05.883 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.883 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.883 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:05.884 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.417049+0000", 2024-09-12T22:33:05.884 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8986e-05 2024-09-12T22:33:05.884 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.884 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.884 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:05.884 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.417072+0000", 2024-09-12T22:33:05.884 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.3183000000000001e-05 2024-09-12T22:33:05.884 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:05.884 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:05.884 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:05.884 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.884 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.884 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:114 3.1f 3:f83d65d8:::200.00000004:head [write 454882~5842 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-09-12T22:33:05.885 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:04.396101+0000", 2024-09-12T22:33:05.885 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 1.3868262650000001, 2024-09-12T22:33:05.885 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.021098186000000001, 2024-09-12T22:33:05.885 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:05.885 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:05.885 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:05.885 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:05.885 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.885 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:05.885 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.396101+0000", 2024-09-12T22:33:05.885 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:05.885 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.885 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.885 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:05.885 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.396101+0000", 2024-09-12T22:33:05.886 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:05.886 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.886 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.886 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:05.886 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.396102+0000", 2024-09-12T22:33:05.886 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1600000000000001e-07 2024-09-12T22:33:05.886 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.886 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.886 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:05.886 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.396108+0000", 2024-09-12T22:33:05.886 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.9290000000000001e-06 2024-09-12T22:33:05.886 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.887 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.887 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:05.887 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.396116+0000", 2024-09-12T22:33:05.887 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.0960000000000003e-06 2024-09-12T22:33:05.887 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.887 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.887 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:05.887 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.396120+0000", 2024-09-12T22:33:05.887 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5000000000000001e-06 2024-09-12T22:33:05.887 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.887 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.887 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:05.887 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.411666+0000", 2024-09-12T22:33:05.888 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.015545608000000001 2024-09-12T22:33:05.888 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.888 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.888 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:05.888 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.411712+0000", 2024-09-12T22:33:05.888 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6233000000000003e-05 2024-09-12T22:33:05.888 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.888 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.888 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:05.888 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.411777+0000", 2024-09-12T22:33:05.888 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.5019999999999998e-05 2024-09-12T22:33:05.888 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.888 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.889 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:05.889 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.413586+0000", 2024-09-12T22:33:05.889 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0018087979999999999 2024-09-12T22:33:05.889 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.889 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.889 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:05.889 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.417115+0000", 2024-09-12T22:33:05.889 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003528972 2024-09-12T22:33:05.889 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.889 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.889 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:05.889 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.417163+0000", 2024-09-12T22:33:05.889 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8136000000000001e-05 2024-09-12T22:33:05.889 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.890 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.890 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:05.890 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.417199+0000", 2024-09-12T22:33:05.890 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.6177999999999998e-05 2024-09-12T22:33:05.890 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:05.890 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:05.890 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:05.890 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.890 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.890 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:115 3.1f 3:f83d65d8:::200.00000004:head [write 460724~3955 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-09-12T22:33:05.890 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:04.396288+0000", 2024-09-12T22:33:05.890 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 1.386639602, 2024-09-12T22:33:05.890 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.020991639999999999, 2024-09-12T22:33:05.890 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:05.891 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:05.891 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:05.891 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:05.891 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.891 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:05.891 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.396288+0000", 2024-09-12T22:33:05.891 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:05.891 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.891 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.891 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:05.891 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.396288+0000", 2024-09-12T22:33:05.891 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:05.891 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.891 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.891 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:05.892 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.396288+0000", 2024-09-12T22:33:05.892 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4200000000000001e-07 2024-09-12T22:33:05.892 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.892 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.892 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:05.892 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.396292+0000", 2024-09-12T22:33:05.892 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5290000000000002e-06 2024-09-12T22:33:05.892 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.892 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.892 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:05.892 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.396299+0000", 2024-09-12T22:33:05.892 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.55e-06 2024-09-12T22:33:05.892 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.892 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.893 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:05.893 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.396303+0000", 2024-09-12T22:33:05.893 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.636e-06 2024-09-12T22:33:05.893 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.893 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.893 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:05.893 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.412101+0000", 2024-09-12T22:33:05.893 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.015798053999999999 2024-09-12T22:33:05.893 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.893 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.893 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:05.893 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.412189+0000", 2024-09-12T22:33:05.893 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.8488999999999999e-05 2024-09-12T22:33:05.893 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.894 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.894 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:05.894 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.412296+0000", 2024-09-12T22:33:05.894 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000107014 2024-09-12T22:33:05.894 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.894 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.894 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:05.894 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.414256+0000", 2024-09-12T22:33:05.894 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0019593269999999999 2024-09-12T22:33:05.894 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.894 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.894 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:05.894 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.417232+0000", 2024-09-12T22:33:05.894 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0029769229999999998 2024-09-12T22:33:05.895 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.895 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.895 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:05.895 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.417258+0000", 2024-09-12T22:33:05.895 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5618000000000001e-05 2024-09-12T22:33:05.895 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.895 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.895 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:05.895 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.417279+0000", 2024-09-12T22:33:05.895 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1058000000000001e-05 2024-09-12T22:33:05.895 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:05.895 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:05.895 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:05.895 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.896 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.896 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:116 3.1f 3:f83d65d8:::200.00000004:head [write 464679~2931 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-09-12T22:33:05.896 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:04.396580+0000", 2024-09-12T22:33:05.896 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 1.3863475059999999, 2024-09-12T22:33:05.896 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.020824097, 2024-09-12T22:33:05.896 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:05.896 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:05.896 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:05.896 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:05.896 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.896 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:05.896 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.396580+0000", 2024-09-12T22:33:05.896 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:05.896 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.896 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.897 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:05.897 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.396580+0000", 2024-09-12T22:33:05.897 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:05.897 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.897 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.897 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:05.897 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.396580+0000", 2024-09-12T22:33:05.897 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2499999999999995e-07 2024-09-12T22:33:05.897 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.897 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.897 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:05.897 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.396583+0000", 2024-09-12T22:33:05.897 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.157e-06 2024-09-12T22:33:05.897 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.898 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.898 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:05.898 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.396588+0000", 2024-09-12T22:33:05.898 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9350000000000002e-06 2024-09-12T22:33:05.898 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.898 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.898 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:05.898 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.396591+0000", 2024-09-12T22:33:05.898 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2820000000000001e-06 2024-09-12T22:33:05.898 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.898 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.898 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:05.898 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.412646+0000", 2024-09-12T22:33:05.898 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016054029000000001 2024-09-12T22:33:05.899 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.899 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.899 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:05.899 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.412712+0000", 2024-09-12T22:33:05.899 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.6693999999999995e-05 2024-09-12T22:33:05.899 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.899 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.899 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:05.899 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.412780+0000", 2024-09-12T22:33:05.899 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7688000000000007e-05 2024-09-12T22:33:05.899 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.899 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.899 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:05.899 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.414259+0000", 2024-09-12T22:33:05.899 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0014787820000000001 2024-09-12T22:33:05.900 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.900 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.900 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:05.900 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.417321+0000", 2024-09-12T22:33:05.900 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0030626659999999999 2024-09-12T22:33:05.900 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.900 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.900 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:05.900 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.417369+0000", 2024-09-12T22:33:05.900 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8084000000000002e-05 2024-09-12T22:33:05.900 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:05.900 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:05.900 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:05.901 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.417404+0000", 2024-09-12T22:33:05.901 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4255000000000003e-05 2024-09-12T22:33:05.901 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:05.901 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:05.901 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:05.901 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:05.901 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:05.901 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:33:05.903 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:33:05.903 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:05.900+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:06.003 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:06.002+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:06.013 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-09-12T22:33:06.013 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-09-12T22:33:06.013 INFO:teuthology.orchestra.run.smithi163.stdout: "num_ops": 0 2024-09-12T22:33:06.013 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-09-12T22:33:06.022 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:33:06.097 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T22:33:06.107 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:06.106+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:06.175 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-09-12T22:33:06.175 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-09-12T22:33:06.175 INFO:teuthology.orchestra.run.smithi163.stdout: "complaint_time": 30, 2024-09-12T22:33:06.175 INFO:teuthology.orchestra.run.smithi163.stdout: "num_blocked_ops": 0 2024-09-12T22:33:06.175 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-09-12T22:33:06.185 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:33:06.221 INFO:teuthology.orchestra.run.smithi019.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-12T22:33:06.226 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:06.225+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:06.242 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T22:33:06.243 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:33:06.261 INFO:teuthology.orchestra.run.smithi019.stdout:osd.2: {} 2024-09-12T22:33:06.261 INFO:teuthology.orchestra.run.smithi019.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T22:33:06.264 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:33:06.265 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:33:06.306 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:06.305+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:06.334 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:33:06.334 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:33:06.344 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:33:06.407 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:06.405+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:06.453 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:33:06.453 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:33:06.462 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:33:06.508 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:06.507+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:06.609 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:06.607+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:06.612 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:33:06.612 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:33:06.621 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:33:06.709 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:06.708+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:06.776 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:33:06.777 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:33:06.787 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:33:06.810 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:06.808+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:06.896 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:33:06.896 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:33:06.905 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:33:06.949 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:06.948+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:07.012 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:07.009+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:07.014 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:33:07.015 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:33:07.024 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:33:07.113 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:07.111+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:07.172 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:33:07.172 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:33:07.181 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:33:07.213 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:07.212+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:07.301 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:33:07.301 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:33:07.310 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:33:07.354 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:07.352+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:07.415 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:07.413+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:07.419 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:33:07.419 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:33:07.428 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:33:07.507 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T22:33:07.516 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:07.516+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:07.575 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:33:07.575 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:33:07.585 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:33:07.629 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:07.628+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:07.700 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:33:07.700 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:33:07.714 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:33:07.718 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:07.716+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:07.819 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:07.818+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:07.865 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:33:07.865 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:33:07.874 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:33:07.960 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:07.959+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:08.020 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:08.018+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:08.034 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:33:08.034 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:33:08.045 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:33:08.121 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:08.119+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:08.152 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:33:08.152 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:33:08.162 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:33:08.246 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:08.244+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:08.266 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T22:33:08.314 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:33:08.314 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:33:08.322 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:08.321+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:08.324 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:33:08.385 INFO:teuthology.orchestra.run.smithi019.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-12T22:33:08.406 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T22:33:08.406 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:33:08.423 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:08.422+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:08.427 INFO:teuthology.orchestra.run.smithi019.stdout:osd.2: {} 2024-09-12T22:33:08.427 INFO:teuthology.orchestra.run.smithi019.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T22:33:08.430 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:33:08.431 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:33:08.476 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:33:08.476 INFO:teuthology.orchestra.run.smithi148.stdout: "size": 20, 2024-09-12T22:33:08.476 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 600, 2024-09-12T22:33:08.476 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [ 2024-09-12T22:33:08.476 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.476 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:98 3.1f 3:f83d65d8:::200.00000004:head [write 409563~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-09-12T22:33:08.476 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:04.385076+0000", 2024-09-12T22:33:08.476 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 4.0883676959999997, 2024-09-12T22:33:08.476 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.022769053000000001, 2024-09-12T22:33:08.477 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:08.477 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:08.477 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:08.477 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:08.477 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.477 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:08.477 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385076+0000", 2024-09-12T22:33:08.477 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:08.477 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.477 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.477 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:08.477 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385076+0000", 2024-09-12T22:33:08.477 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:08.477 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.478 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.478 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:08.478 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385076+0000", 2024-09-12T22:33:08.478 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8799999999999998e-07 2024-09-12T22:33:08.478 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.478 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.478 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:08.478 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385082+0000", 2024-09-12T22:33:08.478 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0950000000000003e-06 2024-09-12T22:33:08.478 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.478 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.478 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:08.478 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385087+0000", 2024-09-12T22:33:08.479 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.463e-06 2024-09-12T22:33:08.479 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.479 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.479 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:08.479 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385090+0000", 2024-09-12T22:33:08.479 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4359999999999998e-06 2024-09-12T22:33:08.479 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.479 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.479 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:08.479 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.400713+0000", 2024-09-12T22:33:08.479 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.015622416 2024-09-12T22:33:08.479 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.480 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.480 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:08.480 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.400785+0000", 2024-09-12T22:33:08.480 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1761000000000006e-05 2024-09-12T22:33:08.480 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.480 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.480 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:08.480 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.400904+0000", 2024-09-12T22:33:08.480 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000119422 2024-09-12T22:33:08.480 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.480 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.480 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:08.480 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.403113+0000", 2024-09-12T22:33:08.481 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0022093899999999999 2024-09-12T22:33:08.481 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.481 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.481 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:08.481 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.407757+0000", 2024-09-12T22:33:08.481 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0046435119999999998 2024-09-12T22:33:08.481 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.481 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.481 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:08.481 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.407802+0000", 2024-09-12T22:33:08.481 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5479000000000003e-05 2024-09-12T22:33:08.481 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.482 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.482 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:08.482 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.407845+0000", 2024-09-12T22:33:08.482 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2790999999999997e-05 2024-09-12T22:33:08.482 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:08.482 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:08.482 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:08.482 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.482 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.482 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:99 3.1f 3:f83d65d8:::200.00000004:head [write 410964~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-09-12T22:33:08.482 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:04.385097+0000", 2024-09-12T22:33:08.483 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 4.0883464350000001, 2024-09-12T22:33:08.483 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.02283048, 2024-09-12T22:33:08.483 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:08.483 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:08.483 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:08.483 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:08.483 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.483 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:08.483 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385097+0000", 2024-09-12T22:33:08.483 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:08.483 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.483 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.483 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:08.484 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385097+0000", 2024-09-12T22:33:08.484 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:08.484 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.484 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.484 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:08.484 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385098+0000", 2024-09-12T22:33:08.484 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5699999999999999e-07 2024-09-12T22:33:08.484 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.484 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.484 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:08.484 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385100+0000", 2024-09-12T22:33:08.484 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9139999999999998e-06 2024-09-12T22:33:08.484 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.485 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.485 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:08.485 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385104+0000", 2024-09-12T22:33:08.485 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1910000000000002e-06 2024-09-12T22:33:08.485 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.485 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.485 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:08.485 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385107+0000", 2024-09-12T22:33:08.485 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.7939999999999998e-06 2024-09-12T22:33:08.485 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.485 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.485 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:08.485 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.401260+0000", 2024-09-12T22:33:08.486 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016153700999999999 2024-09-12T22:33:08.486 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.486 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.486 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:08.486 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.401337+0000", 2024-09-12T22:33:08.486 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.6470000000000005e-05 2024-09-12T22:33:08.486 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.486 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.486 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:08.486 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.401462+0000", 2024-09-12T22:33:08.486 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000125666 2024-09-12T22:33:08.486 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.486 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.486 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:08.487 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.404304+0000", 2024-09-12T22:33:08.487 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0028414809999999999 2024-09-12T22:33:08.487 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.487 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.487 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:08.487 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.407853+0000", 2024-09-12T22:33:08.487 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0035488310000000001 2024-09-12T22:33:08.487 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.487 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.487 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:08.487 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.407894+0000", 2024-09-12T22:33:08.487 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1455000000000002e-05 2024-09-12T22:33:08.487 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.487 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.488 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:08.488 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.407928+0000", 2024-09-12T22:33:08.488 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3720000000000002e-05 2024-09-12T22:33:08.488 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:08.488 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:08.488 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:08.488 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.488 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.488 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:100 3.1f 3:f83d65d8:::200.00000004:head [write 412367~1404 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-09-12T22:33:08.488 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:04.385111+0000", 2024-09-12T22:33:08.488 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 4.0883328270000003, 2024-09-12T22:33:08.488 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.022896741000000002, 2024-09-12T22:33:08.489 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:08.489 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:08.489 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:08.489 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:08.489 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.489 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:08.489 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385111+0000", 2024-09-12T22:33:08.489 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:08.489 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.489 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.489 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:08.489 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385111+0000", 2024-09-12T22:33:08.489 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:08.489 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.490 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.490 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:08.490 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385111+0000", 2024-09-12T22:33:08.490 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.22e-07 2024-09-12T22:33:08.490 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.490 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.490 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:08.490 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385113+0000", 2024-09-12T22:33:08.490 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7069999999999999e-06 2024-09-12T22:33:08.490 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.490 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.490 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:08.490 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385119+0000", 2024-09-12T22:33:08.491 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2090000000000002e-06 2024-09-12T22:33:08.491 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.491 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.491 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:08.491 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385122+0000", 2024-09-12T22:33:08.491 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.033e-06 2024-09-12T22:33:08.491 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.491 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.491 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:08.491 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.401990+0000", 2024-09-12T22:33:08.491 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016867534 2024-09-12T22:33:08.491 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.491 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.492 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:08.492 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.402057+0000", 2024-09-12T22:33:08.492 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7118000000000004e-05 2024-09-12T22:33:08.492 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.492 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.492 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:08.492 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.402161+0000", 2024-09-12T22:33:08.492 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000103905 2024-09-12T22:33:08.492 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.492 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.492 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:08.492 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.404360+0000", 2024-09-12T22:33:08.492 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0021992940000000001 2024-09-12T22:33:08.493 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.493 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.493 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:08.493 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.407935+0000", 2024-09-12T22:33:08.493 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0035751630000000001 2024-09-12T22:33:08.493 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.493 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.493 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:08.493 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.407976+0000", 2024-09-12T22:33:08.493 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0376000000000001e-05 2024-09-12T22:33:08.493 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.493 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.494 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:08.494 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.408008+0000", 2024-09-12T22:33:08.494 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.218e-05 2024-09-12T22:33:08.494 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:08.494 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:08.494 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:08.494 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.494 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.494 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:101 3.1f 3:f83d65d8:::200.00000004:head [write 413771~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-09-12T22:33:08.494 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:04.385126+0000", 2024-09-12T22:33:08.494 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 4.0883178259999999, 2024-09-12T22:33:08.494 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.022964140000000001, 2024-09-12T22:33:08.494 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:08.495 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:08.495 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:08.495 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:08.495 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.495 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:08.495 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385126+0000", 2024-09-12T22:33:08.495 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:08.495 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.495 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.495 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:08.495 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385126+0000", 2024-09-12T22:33:08.495 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:08.495 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.496 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.496 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:08.496 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385126+0000", 2024-09-12T22:33:08.496 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.29e-07 2024-09-12T22:33:08.496 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.496 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.496 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:08.496 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385139+0000", 2024-09-12T22:33:08.496 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2877000000000001e-05 2024-09-12T22:33:08.496 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.496 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.496 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:08.497 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385144+0000", 2024-09-12T22:33:08.497 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9840000000000001e-06 2024-09-12T22:33:08.497 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.497 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.497 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:08.497 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385147+0000", 2024-09-12T22:33:08.497 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0750000000000002e-06 2024-09-12T22:33:08.497 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.497 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.497 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:08.497 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.402511+0000", 2024-09-12T22:33:08.497 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017363456999999999 2024-09-12T22:33:08.497 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.498 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.498 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:08.498 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.402587+0000", 2024-09-12T22:33:08.498 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.6128e-05 2024-09-12T22:33:08.498 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.498 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.498 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:08.498 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.402706+0000", 2024-09-12T22:33:08.498 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000119157 2024-09-12T22:33:08.498 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.498 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.498 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:08.498 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.404414+0000", 2024-09-12T22:33:08.498 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00170773 2024-09-12T22:33:08.499 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.499 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.499 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:08.499 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.408015+0000", 2024-09-12T22:33:08.499 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003601389 2024-09-12T22:33:08.499 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.499 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.499 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:08.499 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.408057+0000", 2024-09-12T22:33:08.499 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1548999999999998e-05 2024-09-12T22:33:08.499 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.499 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.500 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:08.500 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.408090+0000", 2024-09-12T22:33:08.500 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3565000000000001e-05 2024-09-12T22:33:08.500 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:08.500 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:08.500 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:08.500 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.500 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.500 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:102 3.1f 3:f83d65d8:::200.00000004:head [write 415176~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-09-12T22:33:08.500 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:04.385152+0000", 2024-09-12T22:33:08.500 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 4.0882915080000002, 2024-09-12T22:33:08.501 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.023015768999999998, 2024-09-12T22:33:08.501 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:08.501 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:08.501 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:08.501 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:08.501 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.501 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:08.501 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385152+0000", 2024-09-12T22:33:08.501 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:08.501 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.501 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.501 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:08.501 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385152+0000", 2024-09-12T22:33:08.502 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:08.502 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.502 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.502 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:08.502 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385155+0000", 2024-09-12T22:33:08.502 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4200000000000001e-06 2024-09-12T22:33:08.502 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.502 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.502 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:08.502 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385157+0000", 2024-09-12T22:33:08.502 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.8640000000000001e-06 2024-09-12T22:33:08.502 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.502 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.502 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:08.503 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385161+0000", 2024-09-12T22:33:08.503 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1590000000000003e-06 2024-09-12T22:33:08.503 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.503 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.503 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:08.503 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385164+0000", 2024-09-12T22:33:08.503 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8150000000000002e-06 2024-09-12T22:33:08.503 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.503 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.503 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:08.503 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.403160+0000", 2024-09-12T22:33:08.503 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017996174 2024-09-12T22:33:08.503 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.504 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.504 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:08.504 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.403229+0000", 2024-09-12T22:33:08.504 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.9301999999999995e-05 2024-09-12T22:33:08.504 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.504 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.504 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:08.504 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.403341+0000", 2024-09-12T22:33:08.504 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000112002 2024-09-12T22:33:08.504 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.504 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.504 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:08.505 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.405776+0000", 2024-09-12T22:33:08.505 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0024350079999999998 2024-09-12T22:33:08.505 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.505 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.505 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:08.505 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.408097+0000", 2024-09-12T22:33:08.505 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.002321086 2024-09-12T22:33:08.505 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.505 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.505 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:08.505 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.408137+0000", 2024-09-12T22:33:08.505 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9743999999999998e-05 2024-09-12T22:33:08.506 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.506 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.506 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:08.506 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.408168+0000", 2024-09-12T22:33:08.506 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.1195000000000002e-05 2024-09-12T22:33:08.506 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:08.506 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:08.506 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:08.506 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.506 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.506 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:103 3.1f 3:f83d65d8:::200.00000004:head [write 416575~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-09-12T22:33:08.506 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:04.385167+0000", 2024-09-12T22:33:08.506 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 4.088276961, 2024-09-12T22:33:08.507 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.024972646000000001, 2024-09-12T22:33:08.507 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:08.507 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:08.507 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:08.507 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:08.507 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.507 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:08.507 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385167+0000", 2024-09-12T22:33:08.507 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:08.507 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.507 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.507 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:08.507 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385167+0000", 2024-09-12T22:33:08.508 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:08.508 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.508 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.508 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:08.508 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385167+0000", 2024-09-12T22:33:08.508 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.2100000000000001e-07 2024-09-12T22:33:08.508 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.508 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.508 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:08.508 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385176+0000", 2024-09-12T22:33:08.508 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.8249999999999994e-06 2024-09-12T22:33:08.508 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.508 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.509 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:08.509 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385182+0000", 2024-09-12T22:33:08.509 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0469999999999999e-06 2024-09-12T22:33:08.509 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.509 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.509 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:08.509 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385185+0000", 2024-09-12T22:33:08.509 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0570000000000001e-06 2024-09-12T22:33:08.509 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.509 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.509 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:08.509 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.403629+0000", 2024-09-12T22:33:08.509 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.018443838000000001 2024-09-12T22:33:08.509 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.510 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.510 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:08.510 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.403710+0000", 2024-09-12T22:33:08.510 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0851000000000002e-05 2024-09-12T22:33:08.510 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.510 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.510 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:08.510 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.403859+0000", 2024-09-12T22:33:08.510 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014873800000000001 2024-09-12T22:33:08.510 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.510 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.510 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:08.511 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.406967+0000", 2024-09-12T22:33:08.511 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0031080320000000002 2024-09-12T22:33:08.511 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.511 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.511 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:08.511 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410055+0000", 2024-09-12T22:33:08.511 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003088698 2024-09-12T22:33:08.511 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.511 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.511 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:08.511 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410104+0000", 2024-09-12T22:33:08.511 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8469e-05 2024-09-12T22:33:08.511 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.512 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.512 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:08.512 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410140+0000", 2024-09-12T22:33:08.512 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.587e-05 2024-09-12T22:33:08.512 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:08.512 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:08.512 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:08.512 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.512 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.512 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:104 3.1f 3:f83d65d8:::200.00000004:head [write 417974~1421 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-09-12T22:33:08.513 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:04.385189+0000", 2024-09-12T22:33:08.513 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 4.0882548070000002, 2024-09-12T22:33:08.513 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.025034507000000001, 2024-09-12T22:33:08.513 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:08.513 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:08.513 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:08.513 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:08.513 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.513 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:08.514 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385189+0000", 2024-09-12T22:33:08.514 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:08.514 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.514 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.514 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:08.514 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385189+0000", 2024-09-12T22:33:08.514 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:08.514 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.514 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.514 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:08.514 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385189+0000", 2024-09-12T22:33:08.514 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5199999999999998e-07 2024-09-12T22:33:08.514 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.515 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.515 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:08.515 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385191+0000", 2024-09-12T22:33:08.515 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7489999999999999e-06 2024-09-12T22:33:08.515 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.515 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.515 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:08.515 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385194+0000", 2024-09-12T22:33:08.515 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.1039999999999998e-06 2024-09-12T22:33:08.515 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.515 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.515 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:08.515 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385197+0000", 2024-09-12T22:33:08.516 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.3740000000000001e-06 2024-09-12T22:33:08.516 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.516 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.516 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:08.516 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.404717+0000", 2024-09-12T22:33:08.516 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.019520056000000001 2024-09-12T22:33:08.516 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.516 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.516 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:08.516 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.404795+0000", 2024-09-12T22:33:08.516 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.818e-05 2024-09-12T22:33:08.516 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.516 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.516 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:08.517 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.404930+0000", 2024-09-12T22:33:08.517 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013531400000000001 2024-09-12T22:33:08.517 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.517 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.517 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:08.517 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.407028+0000", 2024-09-12T22:33:08.517 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0020980899999999999 2024-09-12T22:33:08.517 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.517 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.517 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:08.517 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410147+0000", 2024-09-12T22:33:08.517 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0031188710000000001 2024-09-12T22:33:08.517 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.518 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.518 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:08.518 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410190+0000", 2024-09-12T22:33:08.518 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2899999999999999e-05 2024-09-12T22:33:08.518 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.518 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.518 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:08.518 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410224+0000", 2024-09-12T22:33:08.518 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3617e-05 2024-09-12T22:33:08.518 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:08.518 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:08.518 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:08.518 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.518 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.519 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:105 3.1f 3:f83d65d8:::200.00000004:head [write 419395~1406 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-09-12T22:33:08.519 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:04.385200+0000", 2024-09-12T22:33:08.519 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 4.088244252, 2024-09-12T22:33:08.519 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.025105683, 2024-09-12T22:33:08.519 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:08.519 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:08.519 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:08.519 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:08.519 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.519 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:08.519 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385200+0000", 2024-09-12T22:33:08.519 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:08.519 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.519 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.520 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:08.520 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385200+0000", 2024-09-12T22:33:08.520 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:08.520 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.520 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.520 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:08.520 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385200+0000", 2024-09-12T22:33:08.520 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.05e-07 2024-09-12T22:33:08.520 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.520 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.520 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:08.520 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385205+0000", 2024-09-12T22:33:08.520 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.6269999999999997e-06 2024-09-12T22:33:08.521 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.521 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.521 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:08.521 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385209+0000", 2024-09-12T22:33:08.521 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.439e-06 2024-09-12T22:33:08.521 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.521 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.521 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:08.521 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385211+0000", 2024-09-12T22:33:08.521 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5040000000000001e-06 2024-09-12T22:33:08.521 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.521 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.521 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:08.522 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.405286+0000", 2024-09-12T22:33:08.522 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.020074229999999998 2024-09-12T22:33:08.522 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.522 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.522 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:08.522 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.405359+0000", 2024-09-12T22:33:08.522 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3355000000000005e-05 2024-09-12T22:33:08.522 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.522 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.522 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:08.522 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.405471+0000", 2024-09-12T22:33:08.522 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000112175 2024-09-12T22:33:08.522 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.523 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.523 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:08.523 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.408223+0000", 2024-09-12T22:33:08.523 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0027517779999999999 2024-09-12T22:33:08.523 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.523 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.523 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:08.523 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410231+0000", 2024-09-12T22:33:08.523 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0020078190000000001 2024-09-12T22:33:08.523 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.523 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.523 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:08.523 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410273+0000", 2024-09-12T22:33:08.523 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2530000000000001e-05 2024-09-12T22:33:08.524 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.524 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.524 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:08.524 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410305+0000", 2024-09-12T22:33:08.524 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2020999999999997e-05 2024-09-12T22:33:08.524 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:08.524 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:08.524 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:08.524 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.524 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.524 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:106 3.1f 3:f83d65d8:::200.00000004:head [write 420801~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-09-12T22:33:08.524 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:04.385215+0000", 2024-09-12T22:33:08.525 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 4.0882289260000002, 2024-09-12T22:33:08.525 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.025168234000000001, 2024-09-12T22:33:08.525 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:08.525 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:08.525 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:08.525 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:08.525 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.525 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:08.525 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385215+0000", 2024-09-12T22:33:08.525 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:08.525 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.525 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.525 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:08.526 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385215+0000", 2024-09-12T22:33:08.526 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:08.526 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.526 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.526 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:08.526 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385215+0000", 2024-09-12T22:33:08.526 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.2600000000000001e-07 2024-09-12T22:33:08.526 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.526 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.526 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:08.526 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385217+0000", 2024-09-12T22:33:08.526 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7099999999999999e-06 2024-09-12T22:33:08.526 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.527 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.527 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:08.527 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385220+0000", 2024-09-12T22:33:08.527 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.004e-06 2024-09-12T22:33:08.527 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.527 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.527 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:08.527 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385223+0000", 2024-09-12T22:33:08.527 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.633e-06 2024-09-12T22:33:08.527 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.528 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.528 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:08.528 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.405826+0000", 2024-09-12T22:33:08.528 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.020603831999999999 2024-09-12T22:33:08.528 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.528 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.528 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:08.528 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.405898+0000", 2024-09-12T22:33:08.528 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1398999999999999e-05 2024-09-12T22:33:08.528 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.528 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.529 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:08.529 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.406011+0000", 2024-09-12T22:33:08.529 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000113411 2024-09-12T22:33:08.529 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.529 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.529 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:08.529 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.408285+0000", 2024-09-12T22:33:08.529 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.002273639 2024-09-12T22:33:08.529 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.529 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.529 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:08.529 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410313+0000", 2024-09-12T22:33:08.529 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0020280760000000002 2024-09-12T22:33:08.530 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.530 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.530 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:08.530 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410350+0000", 2024-09-12T22:33:08.530 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7307e-05 2024-09-12T22:33:08.530 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.530 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.530 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:08.530 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410383+0000", 2024-09-12T22:33:08.531 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2997000000000003e-05 2024-09-12T22:33:08.531 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:08.531 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:08.531 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:08.531 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.531 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.531 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:107 3.1f 3:f83d65d8:::200.00000004:head [write 422206~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-09-12T22:33:08.531 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:04.385226+0000", 2024-09-12T22:33:08.531 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 4.0882181910000002, 2024-09-12T22:33:08.531 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.025350256000000002, 2024-09-12T22:33:08.531 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:08.531 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:08.531 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:08.532 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:08.532 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.532 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:08.532 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385226+0000", 2024-09-12T22:33:08.532 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:08.532 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.532 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.532 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:08.532 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385226+0000", 2024-09-12T22:33:08.533 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:08.533 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.533 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.533 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:08.533 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385226+0000", 2024-09-12T22:33:08.533 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.2399999999999999e-07 2024-09-12T22:33:08.533 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.533 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.533 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:08.533 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385228+0000", 2024-09-12T22:33:08.533 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.508e-06 2024-09-12T22:33:08.533 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.534 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.534 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:08.534 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385235+0000", 2024-09-12T22:33:08.534 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.3169999999999998e-06 2024-09-12T22:33:08.534 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.534 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.534 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:08.534 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385238+0000", 2024-09-12T22:33:08.534 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.9249999999999999e-06 2024-09-12T22:33:08.534 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.535 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.535 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:08.535 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.406376+0000", 2024-09-12T22:33:08.535 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.021138364999999999 2024-09-12T22:33:08.535 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.535 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.535 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:08.535 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.406451+0000", 2024-09-12T22:33:08.535 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4882000000000006e-05 2024-09-12T22:33:08.535 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.535 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.536 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:08.536 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.406590+0000", 2024-09-12T22:33:08.536 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000138627 2024-09-12T22:33:08.536 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.536 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.536 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:08.536 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410461+0000", 2024-09-12T22:33:08.536 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0038712109999999998 2024-09-12T22:33:08.536 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.536 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.537 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:08.537 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410493+0000", 2024-09-12T22:33:08.537 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2147999999999998e-05 2024-09-12T22:33:08.537 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.537 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.537 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:08.537 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410537+0000", 2024-09-12T22:33:08.537 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3792999999999999e-05 2024-09-12T22:33:08.537 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.537 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.538 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:08.538 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410576+0000", 2024-09-12T22:33:08.538 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9255999999999998e-05 2024-09-12T22:33:08.538 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:08.538 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:08.538 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:08.538 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.538 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.538 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4490.0:5682 4.3f 4:ff1ebe6d:::10000001a29.00000000:head [write 0~2106] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T22:33:08.538 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:04.386989+0000", 2024-09-12T22:33:08.538 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 4.0864552679999999, 2024-09-12T22:33:08.538 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.023595390000000001, 2024-09-12T22:33:08.538 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:08.539 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:08.539 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:08.539 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:33:08.539 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4490", 2024-09-12T22:33:08.539 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:08.539 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 5682 2024-09-12T22:33:08.539 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.539 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:08.539 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.539 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:08.539 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.386989+0000", 2024-09-12T22:33:08.539 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:08.539 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.540 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.540 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:08.540 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.386989+0000", 2024-09-12T22:33:08.540 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:08.540 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.540 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.540 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:08.540 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.386989+0000", 2024-09-12T22:33:08.540 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.8800000000000002e-07 2024-09-12T22:33:08.541 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.541 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.541 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:08.541 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.386994+0000", 2024-09-12T22:33:08.541 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4279999999999998e-06 2024-09-12T22:33:08.541 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.541 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.541 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:08.541 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.387001+0000", 2024-09-12T22:33:08.542 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.2320000000000004e-06 2024-09-12T22:33:08.542 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.542 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.542 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:08.542 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.387006+0000", 2024-09-12T22:33:08.542 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6589999999999998e-06 2024-09-12T22:33:08.542 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.542 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.542 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:08.542 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.407003+0000", 2024-09-12T22:33:08.543 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.019997635 2024-09-12T22:33:08.543 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.543 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.543 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:08.543 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.407134+0000", 2024-09-12T22:33:08.543 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013037899999999999 2024-09-12T22:33:08.543 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.543 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.543 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:08.543 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410469+0000", 2024-09-12T22:33:08.543 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0033353160000000001 2024-09-12T22:33:08.543 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.543 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.544 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:08.544 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410510+0000", 2024-09-12T22:33:08.544 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0553999999999998e-05 2024-09-12T22:33:08.544 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.544 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.544 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:08.544 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410584+0000", 2024-09-12T22:33:08.544 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4399000000000004e-05 2024-09-12T22:33:08.544 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:08.544 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:08.544 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:08.544 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.545 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.545 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:108 3.1f 3:f83d65d8:::200.00000004:head [write 423607~16211 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-09-12T22:33:08.545 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:04.392223+0000", 2024-09-12T22:33:08.545 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 4.0812212719999996, 2024-09-12T22:33:08.545 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.022025629000000001, 2024-09-12T22:33:08.545 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:08.545 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:08.545 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:08.545 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:08.545 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.545 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:08.545 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.392223+0000", 2024-09-12T22:33:08.545 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:08.546 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.546 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.546 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:08.546 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.392223+0000", 2024-09-12T22:33:08.546 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:08.546 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.546 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.546 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:08.546 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.392224+0000", 2024-09-12T22:33:08.546 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.358e-06 2024-09-12T22:33:08.546 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.547 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.547 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:08.547 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.392238+0000", 2024-09-12T22:33:08.547 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4408e-05 2024-09-12T22:33:08.547 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.547 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.547 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:08.547 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.392248+0000", 2024-09-12T22:33:08.547 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0013000000000001e-05 2024-09-12T22:33:08.547 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.547 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.547 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:08.547 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.392256+0000", 2024-09-12T22:33:08.548 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1060000000000002e-06 2024-09-12T22:33:08.548 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.548 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.548 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:08.548 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.407080+0000", 2024-09-12T22:33:08.548 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.014824519 2024-09-12T22:33:08.548 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.548 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.548 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:08.548 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.407152+0000", 2024-09-12T22:33:08.548 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1543000000000003e-05 2024-09-12T22:33:08.548 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.549 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.549 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:08.549 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.407270+0000", 2024-09-12T22:33:08.549 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000118721 2024-09-12T22:33:08.549 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.549 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.549 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:08.549 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410591+0000", 2024-09-12T22:33:08.549 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0033203080000000001 2024-09-12T22:33:08.549 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.549 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.549 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:08.550 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.414179+0000", 2024-09-12T22:33:08.550 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00358838 2024-09-12T22:33:08.550 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.550 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.550 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:08.550 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.414215+0000", 2024-09-12T22:33:08.550 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.5753999999999997e-05 2024-09-12T22:33:08.550 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.550 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.550 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:08.550 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.414248+0000", 2024-09-12T22:33:08.550 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3519000000000002e-05 2024-09-12T22:33:08.550 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:08.550 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:08.551 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:08.551 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.551 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.551 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:109 3.1f 3:f83d65d8:::200.00000004:head [write 439818~3871 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-09-12T22:33:08.551 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:04.393309+0000", 2024-09-12T22:33:08.551 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 4.0801351620000004, 2024-09-12T22:33:08.551 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.021084952000000001, 2024-09-12T22:33:08.551 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:08.551 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:08.551 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:08.551 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:08.551 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.551 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:08.552 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393309+0000", 2024-09-12T22:33:08.552 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:08.552 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.552 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.552 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:08.552 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393309+0000", 2024-09-12T22:33:08.552 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:08.552 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.552 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.552 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:08.552 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393309+0000", 2024-09-12T22:33:08.552 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.8400000000000004e-07 2024-09-12T22:33:08.552 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.553 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.553 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:08.553 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393317+0000", 2024-09-12T22:33:08.553 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.8199999999999997e-06 2024-09-12T22:33:08.553 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.553 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.553 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:08.553 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393327+0000", 2024-09-12T22:33:08.553 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.7450000000000007e-06 2024-09-12T22:33:08.553 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.553 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.553 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:08.553 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393334+0000", 2024-09-12T22:33:08.554 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3409999999999997e-06 2024-09-12T22:33:08.554 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.554 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.554 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:08.554 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.408316+0000", 2024-09-12T22:33:08.554 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.014981335 2024-09-12T22:33:08.554 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.554 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.554 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:08.554 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.408391+0000", 2024-09-12T22:33:08.554 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4948000000000001e-05 2024-09-12T22:33:08.554 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.554 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.555 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:08.555 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.408502+0000", 2024-09-12T22:33:08.555 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000111643 2024-09-12T22:33:08.555 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.555 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.555 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:08.555 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410597+0000", 2024-09-12T22:33:08.555 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0020942909999999999 2024-09-12T22:33:08.555 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.555 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.555 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:08.555 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.414301+0000", 2024-09-12T22:33:08.555 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0037040100000000002 2024-09-12T22:33:08.556 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.556 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.556 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:08.556 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.414355+0000", 2024-09-12T22:33:08.556 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4555999999999997e-05 2024-09-12T22:33:08.556 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.556 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.556 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:08.556 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.414394+0000", 2024-09-12T22:33:08.556 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.8578999999999998e-05 2024-09-12T22:33:08.556 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:08.556 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:08.557 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:08.557 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.557 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.557 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:110 3.1f 3:f83d65d8:::200.00000004:head [write 443689~1928 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-09-12T22:33:08.557 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:04.393358+0000", 2024-09-12T22:33:08.557 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 4.0800858519999998, 2024-09-12T22:33:08.557 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.021144165999999999, 2024-09-12T22:33:08.557 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:08.557 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:08.557 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:08.557 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:08.557 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.557 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:08.558 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393358+0000", 2024-09-12T22:33:08.558 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:08.558 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.558 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.558 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:08.558 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393358+0000", 2024-09-12T22:33:08.558 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:08.558 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.558 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.558 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:08.558 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393359+0000", 2024-09-12T22:33:08.558 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3900000000000005e-07 2024-09-12T22:33:08.558 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.559 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.559 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:08.559 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393363+0000", 2024-09-12T22:33:08.559 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0509999999999998e-06 2024-09-12T22:33:08.559 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.559 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.559 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:08.559 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393370+0000", 2024-09-12T22:33:08.559 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.8350000000000004e-06 2024-09-12T22:33:08.559 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.559 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.559 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:08.559 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393376+0000", 2024-09-12T22:33:08.560 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8030000000000002e-06 2024-09-12T22:33:08.560 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.560 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.560 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:08.560 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.408908+0000", 2024-09-12T22:33:08.560 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.01553218 2024-09-12T22:33:08.560 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.560 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.560 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:08.560 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.408978+0000", 2024-09-12T22:33:08.560 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.9142999999999999e-05 2024-09-12T22:33:08.560 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.561 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.561 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:08.561 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.409088+0000", 2024-09-12T22:33:08.561 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000110357 2024-09-12T22:33:08.561 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.561 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.561 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:08.561 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.411046+0000", 2024-09-12T22:33:08.561 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001958338 2024-09-12T22:33:08.561 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.561 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.561 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:08.561 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.414431+0000", 2024-09-12T22:33:08.561 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0033846340000000001 2024-09-12T22:33:08.562 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.562 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.562 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:08.562 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.414474+0000", 2024-09-12T22:33:08.562 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2777000000000001e-05 2024-09-12T22:33:08.562 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.562 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.562 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:08.562 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.414502+0000", 2024-09-12T22:33:08.562 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8509000000000001e-05 2024-09-12T22:33:08.562 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:08.562 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:08.562 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:08.562 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.563 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.563 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:111 3.1f 3:f83d65d8:::200.00000004:head [write 445617~3886 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-09-12T22:33:08.563 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:04.393579+0000", 2024-09-12T22:33:08.563 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 4.0798652930000001, 2024-09-12T22:33:08.563 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.021052739000000001, 2024-09-12T22:33:08.563 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:08.563 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:08.563 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:08.563 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:08.563 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.563 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:08.563 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393579+0000", 2024-09-12T22:33:08.563 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:08.564 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.564 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.564 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:08.564 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393579+0000", 2024-09-12T22:33:08.564 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:08.564 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.564 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.564 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:08.564 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393579+0000", 2024-09-12T22:33:08.564 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.09e-07 2024-09-12T22:33:08.564 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.564 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.564 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:08.565 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393586+0000", 2024-09-12T22:33:08.565 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.6279999999999999e-06 2024-09-12T22:33:08.565 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.565 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.565 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:08.565 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393603+0000", 2024-09-12T22:33:08.565 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6750000000000001e-05 2024-09-12T22:33:08.565 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.565 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.565 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:08.565 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393609+0000", 2024-09-12T22:33:08.565 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.3090000000000001e-06 2024-09-12T22:33:08.565 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.566 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.566 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:08.566 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.409440+0000", 2024-09-12T22:33:08.566 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.015830486000000001 2024-09-12T22:33:08.566 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.566 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.566 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:08.566 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.409520+0000", 2024-09-12T22:33:08.566 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0761999999999997e-05 2024-09-12T22:33:08.566 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.566 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.566 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:08.566 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.409634+0000", 2024-09-12T22:33:08.567 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000113155 2024-09-12T22:33:08.567 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.567 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.567 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:08.567 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.411630+0000", 2024-09-12T22:33:08.567 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0019964940000000001 2024-09-12T22:33:08.567 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.567 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.567 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:08.567 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.414551+0000", 2024-09-12T22:33:08.567 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0029212660000000001 2024-09-12T22:33:08.567 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.567 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.568 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:08.568 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.414598+0000", 2024-09-12T22:33:08.568 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6836999999999999e-05 2024-09-12T22:33:08.568 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.568 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.568 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:08.568 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.414631+0000", 2024-09-12T22:33:08.568 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3243e-05 2024-09-12T22:33:08.568 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:08.568 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:08.568 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:08.568 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.569 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.569 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:112 3.1f 3:f83d65d8:::200.00000004:head [write 449503~3460 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-09-12T22:33:08.569 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:04.393638+0000", 2024-09-12T22:33:08.569 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 4.0798054849999996, 2024-09-12T22:33:08.569 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.023344696000000002, 2024-09-12T22:33:08.569 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:08.569 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:08.569 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:08.569 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:08.569 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.570 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:08.570 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393638+0000", 2024-09-12T22:33:08.570 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:08.570 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.570 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.570 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:08.570 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393638+0000", 2024-09-12T22:33:08.570 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:08.570 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.570 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.570 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:08.571 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393639+0000", 2024-09-12T22:33:08.571 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.68e-07 2024-09-12T22:33:08.571 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.571 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.571 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:08.571 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393643+0000", 2024-09-12T22:33:08.571 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.98e-06 2024-09-12T22:33:08.571 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.571 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.571 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:08.572 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393650+0000", 2024-09-12T22:33:08.572 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.131e-06 2024-09-12T22:33:08.572 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.572 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.572 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:08.572 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393655+0000", 2024-09-12T22:33:08.572 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0270000000000003e-06 2024-09-12T22:33:08.572 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.572 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.573 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:08.573 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410618+0000", 2024-09-12T22:33:08.573 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016962600000000001 2024-09-12T22:33:08.573 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.573 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.573 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:08.573 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410679+0000", 2024-09-12T22:33:08.573 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.1014999999999998e-05 2024-09-12T22:33:08.573 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.573 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.573 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:08.574 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410763+0000", 2024-09-12T22:33:08.574 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.4586000000000006e-05 2024-09-12T22:33:08.574 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.574 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.574 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:08.574 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.412605+0000", 2024-09-12T22:33:08.574 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001842036 2024-09-12T22:33:08.574 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.574 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.575 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:08.575 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.416894+0000", 2024-09-12T22:33:08.575 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0042887649999999999 2024-09-12T22:33:08.575 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.575 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.575 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:08.575 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.416947+0000", 2024-09-12T22:33:08.575 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2500999999999998e-05 2024-09-12T22:33:08.575 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.575 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.576 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:08.576 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.416983+0000", 2024-09-12T22:33:08.576 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.6486999999999998e-05 2024-09-12T22:33:08.576 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:08.576 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:08.576 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:08.576 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.576 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.576 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:113 3.1f 3:f83d65d8:::200.00000004:head [write 452963~1919 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-09-12T22:33:08.576 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:04.393838+0000", 2024-09-12T22:33:08.576 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 4.0796060829999998, 2024-09-12T22:33:08.577 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.023234016999999999, 2024-09-12T22:33:08.577 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:08.577 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:08.577 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:08.577 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:08.577 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.577 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:08.577 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393838+0000", 2024-09-12T22:33:08.577 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:08.577 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.577 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.577 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:08.577 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393838+0000", 2024-09-12T22:33:08.578 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:08.578 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.578 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.578 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:08.578 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393839+0000", 2024-09-12T22:33:08.578 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.9299999999999997e-07 2024-09-12T22:33:08.578 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.578 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.578 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:08.578 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393842+0000", 2024-09-12T22:33:08.578 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7759999999999999e-06 2024-09-12T22:33:08.578 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.578 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.578 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:08.579 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393850+0000", 2024-09-12T22:33:08.579 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.6590000000000007e-06 2024-09-12T22:33:08.579 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.579 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.579 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:08.579 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393856+0000", 2024-09-12T22:33:08.579 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.1659999999999999e-06 2024-09-12T22:33:08.579 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.579 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.579 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:08.579 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.411099+0000", 2024-09-12T22:33:08.579 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017242785 2024-09-12T22:33:08.579 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.580 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.580 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:08.580 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.411172+0000", 2024-09-12T22:33:08.580 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.2552999999999995e-05 2024-09-12T22:33:08.580 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.580 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.580 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:08.580 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.411280+0000", 2024-09-12T22:33:08.580 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000108701 2024-09-12T22:33:08.580 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.580 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.580 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:08.580 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.413582+0000", 2024-09-12T22:33:08.581 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0023020290000000001 2024-09-12T22:33:08.581 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.581 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.581 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:08.581 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.417020+0000", 2024-09-12T22:33:08.581 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0034373860000000002 2024-09-12T22:33:08.581 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.581 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.581 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:08.581 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.417049+0000", 2024-09-12T22:33:08.581 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8986e-05 2024-09-12T22:33:08.581 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.581 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.582 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:08.582 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.417072+0000", 2024-09-12T22:33:08.582 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.3183000000000001e-05 2024-09-12T22:33:08.582 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:08.582 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:08.582 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:08.582 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.582 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.582 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:114 3.1f 3:f83d65d8:::200.00000004:head [write 454882~5842 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-09-12T22:33:08.582 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:04.396101+0000", 2024-09-12T22:33:08.582 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 4.0773430599999996, 2024-09-12T22:33:08.582 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.021098186000000001, 2024-09-12T22:33:08.582 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:08.582 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:08.583 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:08.583 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:08.583 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.583 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:08.583 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.396101+0000", 2024-09-12T22:33:08.583 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:08.583 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.583 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.583 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:08.583 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.396101+0000", 2024-09-12T22:33:08.583 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:08.583 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.583 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.583 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:08.584 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.396102+0000", 2024-09-12T22:33:08.584 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1600000000000001e-07 2024-09-12T22:33:08.584 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.584 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.584 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:08.584 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.396108+0000", 2024-09-12T22:33:08.584 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.9290000000000001e-06 2024-09-12T22:33:08.584 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.584 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.584 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:08.584 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.396116+0000", 2024-09-12T22:33:08.584 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.0960000000000003e-06 2024-09-12T22:33:08.584 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.585 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.585 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:08.585 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.396120+0000", 2024-09-12T22:33:08.585 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5000000000000001e-06 2024-09-12T22:33:08.585 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.585 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.585 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:08.585 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.411666+0000", 2024-09-12T22:33:08.585 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.015545608000000001 2024-09-12T22:33:08.585 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.585 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.585 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:08.585 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.411712+0000", 2024-09-12T22:33:08.585 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6233000000000003e-05 2024-09-12T22:33:08.586 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.586 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.586 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:08.586 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.411777+0000", 2024-09-12T22:33:08.586 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.5019999999999998e-05 2024-09-12T22:33:08.586 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.586 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.586 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:08.586 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.413586+0000", 2024-09-12T22:33:08.586 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0018087979999999999 2024-09-12T22:33:08.586 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.586 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.586 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:08.587 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.417115+0000", 2024-09-12T22:33:08.587 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003528972 2024-09-12T22:33:08.587 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.587 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.587 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:08.587 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.417163+0000", 2024-09-12T22:33:08.587 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8136000000000001e-05 2024-09-12T22:33:08.587 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.587 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.587 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:08.587 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.417199+0000", 2024-09-12T22:33:08.587 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.6177999999999998e-05 2024-09-12T22:33:08.587 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:08.587 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:08.588 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:08.588 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.588 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.588 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:115 3.1f 3:f83d65d8:::200.00000004:head [write 460724~3955 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-09-12T22:33:08.588 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:04.396288+0000", 2024-09-12T22:33:08.588 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 4.0771563970000004, 2024-09-12T22:33:08.588 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.020991639999999999, 2024-09-12T22:33:08.588 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:08.588 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:08.588 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:08.588 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:08.588 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.589 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:08.589 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.396288+0000", 2024-09-12T22:33:08.589 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:08.589 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.589 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.589 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:08.589 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.396288+0000", 2024-09-12T22:33:08.589 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:08.589 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.589 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.589 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:08.589 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.396288+0000", 2024-09-12T22:33:08.590 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4200000000000001e-07 2024-09-12T22:33:08.590 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.590 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.590 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:08.590 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.396292+0000", 2024-09-12T22:33:08.590 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5290000000000002e-06 2024-09-12T22:33:08.590 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.590 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.590 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:08.590 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.396299+0000", 2024-09-12T22:33:08.590 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.55e-06 2024-09-12T22:33:08.590 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.590 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.591 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:08.591 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.396303+0000", 2024-09-12T22:33:08.591 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.636e-06 2024-09-12T22:33:08.591 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.591 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.591 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:08.591 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.412101+0000", 2024-09-12T22:33:08.591 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.015798053999999999 2024-09-12T22:33:08.591 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.591 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.591 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:08.591 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.412189+0000", 2024-09-12T22:33:08.591 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.8488999999999999e-05 2024-09-12T22:33:08.592 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.592 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.592 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:08.592 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.412296+0000", 2024-09-12T22:33:08.592 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000107014 2024-09-12T22:33:08.592 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.592 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.592 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:08.592 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.414256+0000", 2024-09-12T22:33:08.592 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0019593269999999999 2024-09-12T22:33:08.592 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.592 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.592 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:08.593 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.417232+0000", 2024-09-12T22:33:08.593 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0029769229999999998 2024-09-12T22:33:08.593 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.593 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.593 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:08.593 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.417258+0000", 2024-09-12T22:33:08.593 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5618000000000001e-05 2024-09-12T22:33:08.593 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.593 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.593 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:08.593 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.417279+0000", 2024-09-12T22:33:08.593 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1058000000000001e-05 2024-09-12T22:33:08.594 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:08.594 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:08.594 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:08.594 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.594 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.594 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:116 3.1f 3:f83d65d8:::200.00000004:head [write 464679~2931 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-09-12T22:33:08.594 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:04.396580+0000", 2024-09-12T22:33:08.594 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 4.0768643009999996, 2024-09-12T22:33:08.594 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.020824097, 2024-09-12T22:33:08.594 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:08.594 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:08.594 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:08.594 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:08.594 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.595 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:08.595 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.396580+0000", 2024-09-12T22:33:08.595 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:08.595 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.595 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.595 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:08.595 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.396580+0000", 2024-09-12T22:33:08.595 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:08.595 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.595 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.595 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:08.595 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.396580+0000", 2024-09-12T22:33:08.596 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2499999999999995e-07 2024-09-12T22:33:08.596 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.596 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.596 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:08.596 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.396583+0000", 2024-09-12T22:33:08.596 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.157e-06 2024-09-12T22:33:08.596 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.596 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.596 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:08.596 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.396588+0000", 2024-09-12T22:33:08.596 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9350000000000002e-06 2024-09-12T22:33:08.596 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.596 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.597 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:08.597 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.396591+0000", 2024-09-12T22:33:08.597 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2820000000000001e-06 2024-09-12T22:33:08.597 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.597 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.597 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:08.597 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.412646+0000", 2024-09-12T22:33:08.597 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016054029000000001 2024-09-12T22:33:08.597 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.597 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.597 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:08.597 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.412712+0000", 2024-09-12T22:33:08.597 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.6693999999999995e-05 2024-09-12T22:33:08.597 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.598 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.598 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:08.598 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.412780+0000", 2024-09-12T22:33:08.598 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7688000000000007e-05 2024-09-12T22:33:08.598 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.598 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.598 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:08.598 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.414259+0000", 2024-09-12T22:33:08.598 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0014787820000000001 2024-09-12T22:33:08.598 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.598 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.598 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:08.598 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.417321+0000", 2024-09-12T22:33:08.599 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0030626659999999999 2024-09-12T22:33:08.599 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.599 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.599 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:08.599 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.417369+0000", 2024-09-12T22:33:08.599 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8084000000000002e-05 2024-09-12T22:33:08.599 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:08.599 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:08.599 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:08.599 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.417404+0000", 2024-09-12T22:33:08.599 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4255000000000003e-05 2024-09-12T22:33:08.599 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:08.599 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:08.599 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:08.600 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:08.600 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:08.600 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:33:08.602 INFO:teuthology.orchestra.run.smithi019.stderr:noscrub is set 2024-09-12T22:33:08.602 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:33:08.602 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:08.599+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:08.702 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:08.701+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:08.713 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-09-12T22:33:08.713 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-09-12T22:33:08.713 INFO:teuthology.orchestra.run.smithi163.stdout: "num_ops": 0 2024-09-12T22:33:08.714 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-09-12T22:33:08.723 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:33:08.803 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:08.801+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:08.871 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-09-12T22:33:08.871 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-09-12T22:33:08.871 INFO:teuthology.orchestra.run.smithi163.stdout: "complaint_time": 30, 2024-09-12T22:33:08.871 INFO:teuthology.orchestra.run.smithi163.stdout: "num_blocked_ops": 0 2024-09-12T22:33:08.872 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-09-12T22:33:08.881 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:33:08.924 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:08.923+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:08.993 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-09-12T22:33:08.993 INFO:teuthology.orchestra.run.smithi163.stdout: "size": 20, 2024-09-12T22:33:08.994 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 600, 2024-09-12T22:33:08.994 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2024-09-12T22:33:08.994 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:08.994 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-09-12T22:33:08.994 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:27.254459+0000", 2024-09-12T22:33:08.994 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 101.736376978, 2024-09-12T22:33:08.994 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.37816283899999997, 2024-09-12T22:33:08.994 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:08.994 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:08.994 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:08.994 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:08.995 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:33:08.995 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:33:08.995 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 1 2024-09-12T22:33:08.995 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:08.995 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:08.995 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:08.995 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:08.995 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254459+0000", 2024-09-12T22:33:08.995 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:08.995 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:08.995 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:08.995 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:08.995 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254459+0000", 2024-09-12T22:33:08.995 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:08.996 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:08.996 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:08.996 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:08.996 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254460+0000", 2024-09-12T22:33:08.996 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1739999999999999e-06 2024-09-12T22:33:08.996 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:08.996 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:08.996 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:08.996 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254472+0000", 2024-09-12T22:33:08.996 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2207e-05 2024-09-12T22:33:08.997 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:08.997 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:08.997 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:08.997 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254483+0000", 2024-09-12T22:33:08.997 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0631999999999999e-05 2024-09-12T22:33:08.997 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:08.997 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:08.997 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:08.997 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254492+0000", 2024-09-12T22:33:08.997 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3670000000000003e-06 2024-09-12T22:33:08.997 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:08.997 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:08.997 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:08.998 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254551+0000", 2024-09-12T22:33:08.998 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8687999999999998e-05 2024-09-12T22:33:08.998 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:08.998 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:08.998 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for peered", 2024-09-12T22:33:08.998 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254562+0000", 2024-09-12T22:33:08.998 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1249e-05 2024-09-12T22:33:08.998 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:08.998 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:08.998 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:08.998 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.631211+0000", 2024-09-12T22:33:08.998 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.376649018 2024-09-12T22:33:08.998 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:08.998 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:08.999 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:08.999 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.631345+0000", 2024-09-12T22:33:08.999 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013378700000000001 2024-09-12T22:33:08.999 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:08.999 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:08.999 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:33:08.999 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.631479+0000", 2024-09-12T22:33:08.999 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013352399999999999 2024-09-12T22:33:08.999 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:08.999 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:08.999 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:08.999 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632324+0000", 2024-09-12T22:33:08.999 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00084508100000000002 2024-09-12T22:33:09.000 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.000 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.000 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:09.000 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632548+0000", 2024-09-12T22:33:09.000 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000224329 2024-09-12T22:33:09.000 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.000 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.000 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:09.000 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632591+0000", 2024-09-12T22:33:09.000 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2564000000000001e-05 2024-09-12T22:33:09.000 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.000 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.000 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:09.001 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632622+0000", 2024-09-12T22:33:09.001 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1219e-05 2024-09-12T22:33:09.001 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:09.001 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:09.001 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:09.001 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.001 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.001 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:185 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:33:09.001 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394355+0000", 2024-09-12T22:33:09.001 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 100.59648088100001, 2024-09-12T22:33:09.001 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011302394, 2024-09-12T22:33:09.001 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:09.001 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:09.002 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:09.002 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:09.002 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:33:09.002 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:33:09.002 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 185 2024-09-12T22:33:09.002 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.002 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:09.002 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.002 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:09.002 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394355+0000", 2024-09-12T22:33:09.002 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:09.002 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.003 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.003 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:09.003 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394355+0000", 2024-09-12T22:33:09.003 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:09.003 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.003 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.003 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:09.003 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394355+0000", 2024-09-12T22:33:09.003 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9099999999999999e-07 2024-09-12T22:33:09.003 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.003 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.003 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:09.003 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394385+0000", 2024-09-12T22:33:09.003 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9963000000000001e-05 2024-09-12T22:33:09.003 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.004 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.004 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:09.004 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394390+0000", 2024-09-12T22:33:09.004 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8420000000000004e-06 2024-09-12T22:33:09.004 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.004 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.004 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:09.004 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394393+0000", 2024-09-12T22:33:09.004 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1e-06 2024-09-12T22:33:09.004 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.004 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.004 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:09.005 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.400546+0000", 2024-09-12T22:33:09.005 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0061523309999999996 2024-09-12T22:33:09.005 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.005 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.005 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:09.005 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.400588+0000", 2024-09-12T22:33:09.005 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1835000000000002e-05 2024-09-12T22:33:09.005 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.005 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.005 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:33:09.005 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.400677+0000", 2024-09-12T22:33:09.005 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9195000000000002e-05 2024-09-12T22:33:09.005 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.006 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.006 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:09.006 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405378+0000", 2024-09-12T22:33:09.006 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0047008659999999997 2024-09-12T22:33:09.006 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.006 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.006 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:09.006 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405569+0000", 2024-09-12T22:33:09.006 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00019148599999999999 2024-09-12T22:33:09.006 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.006 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.006 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:09.006 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405620+0000", 2024-09-12T22:33:09.007 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1416999999999999e-05 2024-09-12T22:33:09.007 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.007 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.007 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:09.007 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405657+0000", 2024-09-12T22:33:09.007 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6968000000000002e-05 2024-09-12T22:33:09.007 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:09.007 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:09.007 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:09.007 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.007 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.007 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:33:09.007 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394399+0000", 2024-09-12T22:33:09.007 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 100.59643667, 2024-09-12T22:33:09.008 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011336601999999999, 2024-09-12T22:33:09.008 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:09.008 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:09.008 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:09.008 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:09.008 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:33:09.008 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:33:09.008 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 186 2024-09-12T22:33:09.008 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.008 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:09.008 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.008 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:09.008 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394399+0000", 2024-09-12T22:33:09.009 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:09.009 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.009 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.009 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:09.009 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394399+0000", 2024-09-12T22:33:09.009 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:09.009 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.009 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.009 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:09.009 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394400+0000", 2024-09-12T22:33:09.009 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4499999999999998e-07 2024-09-12T22:33:09.009 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.009 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.009 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:09.010 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394402+0000", 2024-09-12T22:33:09.010 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.875e-06 2024-09-12T22:33:09.010 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.010 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.010 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:09.010 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394405+0000", 2024-09-12T22:33:09.010 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6799999999999999e-06 2024-09-12T22:33:09.010 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.010 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.010 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:09.010 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394408+0000", 2024-09-12T22:33:09.010 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.667e-06 2024-09-12T22:33:09.010 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.010 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.011 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:09.011 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401395+0000", 2024-09-12T22:33:09.011 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0069867230000000002 2024-09-12T22:33:09.011 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.011 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.011 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:09.011 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401438+0000", 2024-09-12T22:33:09.011 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3554999999999999e-05 2024-09-12T22:33:09.011 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.012 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.012 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:33:09.012 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401509+0000", 2024-09-12T22:33:09.012 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0631999999999997e-05 2024-09-12T22:33:09.012 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.012 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.012 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:09.012 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405392+0000", 2024-09-12T22:33:09.012 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0038830449999999999 2024-09-12T22:33:09.012 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.012 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.012 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:09.012 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405690+0000", 2024-09-12T22:33:09.012 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000298435 2024-09-12T22:33:09.013 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.013 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.013 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:09.013 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405716+0000", 2024-09-12T22:33:09.013 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5435999999999998e-05 2024-09-12T22:33:09.013 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.013 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.013 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:09.013 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405736+0000", 2024-09-12T22:33:09.013 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0208999999999999e-05 2024-09-12T22:33:09.013 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:09.013 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:09.013 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:09.014 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.014 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.014 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:33:09.014 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394411+0000", 2024-09-12T22:33:09.014 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 100.596424544, 2024-09-12T22:33:09.014 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011400117, 2024-09-12T22:33:09.014 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:09.014 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:09.014 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:09.014 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:09.014 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:33:09.014 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:33:09.014 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 187 2024-09-12T22:33:09.014 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.015 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:09.015 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.015 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:09.015 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394411+0000", 2024-09-12T22:33:09.015 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:09.015 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.015 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.015 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:09.015 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394411+0000", 2024-09-12T22:33:09.015 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:09.015 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.015 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.016 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:09.016 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394412+0000", 2024-09-12T22:33:09.016 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.4999999999999999e-07 2024-09-12T22:33:09.016 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.016 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.016 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:09.016 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394414+0000", 2024-09-12T22:33:09.016 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.984e-06 2024-09-12T22:33:09.016 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.016 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.016 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:09.016 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394418+0000", 2024-09-12T22:33:09.016 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0840000000000002e-06 2024-09-12T22:33:09.016 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.017 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.017 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:09.017 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394431+0000", 2024-09-12T22:33:09.017 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.361e-05 2024-09-12T22:33:09.017 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.017 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.017 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:09.017 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401778+0000", 2024-09-12T22:33:09.017 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0073462659999999997 2024-09-12T22:33:09.017 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.017 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.017 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:09.017 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401853+0000", 2024-09-12T22:33:09.018 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5797000000000006e-05 2024-09-12T22:33:09.018 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.018 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.018 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:33:09.018 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.401990+0000", 2024-09-12T22:33:09.018 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013651399999999999 2024-09-12T22:33:09.018 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.018 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.018 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:09.018 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405402+0000", 2024-09-12T22:33:09.018 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0034116070000000001 2024-09-12T22:33:09.018 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.018 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.018 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:09.019 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405764+0000", 2024-09-12T22:33:09.019 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00036234899999999998 2024-09-12T22:33:09.019 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.019 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.019 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:09.019 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405791+0000", 2024-09-12T22:33:09.019 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7029000000000002e-05 2024-09-12T22:33:09.019 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.019 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.019 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:09.019 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405812+0000", 2024-09-12T22:33:09.019 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0627000000000001e-05 2024-09-12T22:33:09.019 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:09.020 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:09.020 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:09.020 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.020 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.020 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:33:09.020 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394447+0000", 2024-09-12T22:33:09.020 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 100.596389393, 2024-09-12T22:33:09.020 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011759588, 2024-09-12T22:33:09.020 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:09.020 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:09.020 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:09.020 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:09.020 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:33:09.020 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:33:09.021 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 188 2024-09-12T22:33:09.021 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.021 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:09.021 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.021 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:09.021 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394447+0000", 2024-09-12T22:33:09.021 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:09.021 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.021 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.021 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:09.021 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394447+0000", 2024-09-12T22:33:09.021 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:09.021 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.021 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.022 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:09.022 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394447+0000", 2024-09-12T22:33:09.022 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.15e-07 2024-09-12T22:33:09.022 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.022 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.022 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:09.022 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394512+0000", 2024-09-12T22:33:09.022 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4580999999999997e-05 2024-09-12T22:33:09.022 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.022 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.022 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:09.022 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394518+0000", 2024-09-12T22:33:09.022 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.3380000000000001e-06 2024-09-12T22:33:09.022 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.023 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.023 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:09.023 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394521+0000", 2024-09-12T22:33:09.023 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3340000000000002e-06 2024-09-12T22:33:09.023 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.023 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.023 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:09.023 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.402628+0000", 2024-09-12T22:33:09.023 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.008106996 2024-09-12T22:33:09.023 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.023 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.023 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:09.023 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.402670+0000", 2024-09-12T22:33:09.024 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1983000000000001e-05 2024-09-12T22:33:09.024 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.024 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.024 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:33:09.024 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.402738+0000", 2024-09-12T22:33:09.024 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.8114999999999994e-05 2024-09-12T22:33:09.024 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.024 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.024 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:09.024 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405668+0000", 2024-09-12T22:33:09.024 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.002929545 2024-09-12T22:33:09.024 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.024 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.024 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:09.025 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406162+0000", 2024-09-12T22:33:09.025 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000494408 2024-09-12T22:33:09.025 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.025 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.025 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:09.025 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406188+0000", 2024-09-12T22:33:09.025 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5766e-05 2024-09-12T22:33:09.025 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.025 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.025 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:09.025 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406206+0000", 2024-09-12T22:33:09.025 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.8107000000000001e-05 2024-09-12T22:33:09.025 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:09.025 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:09.026 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:09.026 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.026 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.026 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12)", 2024-09-12T22:33:09.026 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:28.394528+0000", 2024-09-12T22:33:09.026 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 100.596307724, 2024-09-12T22:33:09.026 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.01195536, 2024-09-12T22:33:09.026 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:09.026 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:09.027 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:09.027 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:09.027 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:33:09.027 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:33:09.027 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 189 2024-09-12T22:33:09.027 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.027 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:09.027 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.027 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:09.027 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394528+0000", 2024-09-12T22:33:09.027 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:09.027 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.028 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.028 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:09.028 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394528+0000", 2024-09-12T22:33:09.028 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:09.028 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.028 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.028 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:09.028 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394529+0000", 2024-09-12T22:33:09.028 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4900000000000001e-07 2024-09-12T22:33:09.028 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.028 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.028 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:09.029 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394531+0000", 2024-09-12T22:33:09.029 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.458e-06 2024-09-12T22:33:09.029 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.029 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.029 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:09.029 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394535+0000", 2024-09-12T22:33:09.029 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7900000000000001e-06 2024-09-12T22:33:09.029 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.029 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.030 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:09.030 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.394537+0000", 2024-09-12T22:33:09.030 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.632e-06 2024-09-12T22:33:09.030 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.030 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.030 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:09.030 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.404932+0000", 2024-09-12T22:33:09.030 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010394158000000001 2024-09-12T22:33:09.030 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.030 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.030 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:09.030 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405017+0000", 2024-09-12T22:33:09.030 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5525000000000005e-05 2024-09-12T22:33:09.030 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.031 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.031 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:33:09.031 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405114+0000", 2024-09-12T22:33:09.031 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.6527000000000006e-05 2024-09-12T22:33:09.031 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.031 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.031 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:09.031 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.405818+0000", 2024-09-12T22:33:09.031 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00070412800000000005 2024-09-12T22:33:09.031 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.031 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.031 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:09.031 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406437+0000", 2024-09-12T22:33:09.031 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00061898900000000002 2024-09-12T22:33:09.032 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.032 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.032 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:09.032 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406463+0000", 2024-09-12T22:33:09.032 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6268e-05 2024-09-12T22:33:09.032 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.032 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.032 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:09.032 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:28.406484+0000", 2024-09-12T22:33:09.032 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0536000000000001e-05 2024-09-12T22:33:09.032 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:09.032 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:09.032 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:09.032 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.033 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.033 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:33:09.033 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.401422+0000", 2024-09-12T22:33:09.033 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 91.589413819000001, 2024-09-12T22:33:09.033 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016896452999999999, 2024-09-12T22:33:09.033 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:09.033 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:09.033 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:09.033 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:09.033 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.033 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:09.033 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401422+0000", 2024-09-12T22:33:09.033 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:09.034 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.034 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.034 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:09.034 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401422+0000", 2024-09-12T22:33:09.034 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:09.034 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.034 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.034 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:09.034 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401424+0000", 2024-09-12T22:33:09.034 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9e-06 2024-09-12T22:33:09.034 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.034 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.034 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:09.034 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401437+0000", 2024-09-12T22:33:09.035 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2831e-05 2024-09-12T22:33:09.035 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.035 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.035 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:09.035 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401471+0000", 2024-09-12T22:33:09.035 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4010000000000001e-05 2024-09-12T22:33:09.035 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.035 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.035 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:09.035 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401484+0000", 2024-09-12T22:33:09.035 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2711000000000001e-05 2024-09-12T22:33:09.036 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.036 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.036 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:09.036 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405410+0000", 2024-09-12T22:33:09.036 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0039259170000000001 2024-09-12T22:33:09.036 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.036 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.036 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:09.036 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405529+0000", 2024-09-12T22:33:09.036 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000119778 2024-09-12T22:33:09.036 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.036 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.036 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:33:09.037 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405655+0000", 2024-09-12T22:33:09.037 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012556700000000001 2024-09-12T22:33:09.037 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.037 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.037 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:09.037 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410456+0000", 2024-09-12T22:33:09.037 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0048008269999999997 2024-09-12T22:33:09.037 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.037 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.037 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:09.037 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418226+0000", 2024-09-12T22:33:09.037 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0077707729999999999 2024-09-12T22:33:09.037 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.037 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.038 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:09.038 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418277+0000", 2024-09-12T22:33:09.038 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0476000000000003e-05 2024-09-12T22:33:09.038 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.038 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.038 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:09.038 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418319+0000", 2024-09-12T22:33:09.038 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1662999999999997e-05 2024-09-12T22:33:09.038 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:09.038 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:09.038 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:09.038 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.039 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.039 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:33:09.039 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.401505+0000", 2024-09-12T22:33:09.039 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 91.589331154999996, 2024-09-12T22:33:09.039 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016987904000000002, 2024-09-12T22:33:09.039 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:09.039 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:09.039 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:09.039 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:09.040 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.040 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:09.040 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401505+0000", 2024-09-12T22:33:09.040 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:09.040 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.040 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.040 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:09.040 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401505+0000", 2024-09-12T22:33:09.040 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:09.040 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.040 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.040 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:09.040 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401506+0000", 2024-09-12T22:33:09.041 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4700000000000001e-07 2024-09-12T22:33:09.041 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.041 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.041 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:09.041 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401510+0000", 2024-09-12T22:33:09.041 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6609999999999999e-06 2024-09-12T22:33:09.041 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.041 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.041 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:09.041 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401771+0000", 2024-09-12T22:33:09.041 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00026110700000000001 2024-09-12T22:33:09.041 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.042 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.042 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:09.042 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401921+0000", 2024-09-12T22:33:09.042 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014939099999999999 2024-09-12T22:33:09.042 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.042 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.042 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:09.042 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405944+0000", 2024-09-12T22:33:09.042 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0040235449999999999 2024-09-12T22:33:09.042 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.042 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.043 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:09.043 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406018+0000", 2024-09-12T22:33:09.043 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3373000000000004e-05 2024-09-12T22:33:09.043 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.043 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.043 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:33:09.043 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406172+0000", 2024-09-12T22:33:09.043 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00015435399999999999 2024-09-12T22:33:09.043 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.043 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.043 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:09.043 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410461+0000", 2024-09-12T22:33:09.044 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0042888609999999997 2024-09-12T22:33:09.044 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.044 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.044 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:09.044 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418371+0000", 2024-09-12T22:33:09.044 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0079098380000000006 2024-09-12T22:33:09.044 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.044 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.044 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:09.044 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418443+0000", 2024-09-12T22:33:09.044 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2705000000000003e-05 2024-09-12T22:33:09.044 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.045 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.045 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:09.045 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418493+0000", 2024-09-12T22:33:09.045 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9322e-05 2024-09-12T22:33:09.045 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:09.045 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:09.045 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:09.045 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.045 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.045 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:33:09.045 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.401939+0000", 2024-09-12T22:33:09.046 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 91.588897419000006, 2024-09-12T22:33:09.046 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016722292999999999, 2024-09-12T22:33:09.046 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:09.046 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:09.046 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:09.046 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:09.046 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.046 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:09.046 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401939+0000", 2024-09-12T22:33:09.046 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:09.046 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.046 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.047 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:09.047 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401939+0000", 2024-09-12T22:33:09.047 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:09.047 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.047 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.047 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:09.047 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401940+0000", 2024-09-12T22:33:09.047 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1990000000000001e-06 2024-09-12T22:33:09.047 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.047 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.048 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:09.048 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401956+0000", 2024-09-12T22:33:09.048 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.6344000000000001e-05 2024-09-12T22:33:09.048 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.048 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.048 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:09.048 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401974+0000", 2024-09-12T22:33:09.048 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7730000000000001e-05 2024-09-12T22:33:09.048 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.048 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.049 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:09.049 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401982+0000", 2024-09-12T22:33:09.049 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.7800000000000001e-06 2024-09-12T22:33:09.049 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.049 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.049 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:09.049 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406557+0000", 2024-09-12T22:33:09.049 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0045758489999999999 2024-09-12T22:33:09.049 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.050 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.050 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:09.050 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406697+0000", 2024-09-12T22:33:09.050 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013925100000000001 2024-09-12T22:33:09.050 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.050 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.050 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:33:09.050 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406830+0000", 2024-09-12T22:33:09.050 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013293499999999999 2024-09-12T22:33:09.050 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.051 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.051 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:09.051 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410465+0000", 2024-09-12T22:33:09.051 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0036352680000000001 2024-09-12T22:33:09.051 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.051 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.051 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:09.051 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418564+0000", 2024-09-12T22:33:09.051 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0080992140000000004 2024-09-12T22:33:09.051 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.051 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.051 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:09.052 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418621+0000", 2024-09-12T22:33:09.052 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7167999999999999e-05 2024-09-12T22:33:09.052 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.052 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.052 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:09.052 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418661+0000", 2024-09-12T22:33:09.052 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9555000000000003e-05 2024-09-12T22:33:09.052 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:09.052 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:09.052 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:09.052 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.052 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.052 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:33:09.052 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.401994+0000", 2024-09-12T22:33:09.053 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 91.588841547000001, 2024-09-12T22:33:09.053 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016804109000000001, 2024-09-12T22:33:09.053 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:09.053 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:09.053 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:09.053 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:09.053 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.053 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:09.053 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401994+0000", 2024-09-12T22:33:09.053 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:09.054 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.054 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.054 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:09.054 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401994+0000", 2024-09-12T22:33:09.054 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:09.054 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.054 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.054 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:09.054 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.401995+0000", 2024-09-12T22:33:09.054 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.8899999999999998e-07 2024-09-12T22:33:09.054 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.054 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.055 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:09.055 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402000+0000", 2024-09-12T22:33:09.055 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.498e-06 2024-09-12T22:33:09.055 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.055 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.055 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:09.055 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402007+0000", 2024-09-12T22:33:09.055 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.554e-06 2024-09-12T22:33:09.055 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.055 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.055 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:09.055 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402046+0000", 2024-09-12T22:33:09.055 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9156000000000003e-05 2024-09-12T22:33:09.055 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.056 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.056 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:09.056 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407342+0000", 2024-09-12T22:33:09.056 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052957610000000004 2024-09-12T22:33:09.056 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.056 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.056 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:09.056 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407521+0000", 2024-09-12T22:33:09.056 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00017878100000000001 2024-09-12T22:33:09.056 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.056 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.056 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:33:09.056 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407641+0000", 2024-09-12T22:33:09.056 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012013 2024-09-12T22:33:09.057 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.057 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.057 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:09.057 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410472+0000", 2024-09-12T22:33:09.057 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.002830455 2024-09-12T22:33:09.057 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.057 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.057 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:09.057 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418714+0000", 2024-09-12T22:33:09.057 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0082422789999999999 2024-09-12T22:33:09.057 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.057 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.057 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:09.057 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418761+0000", 2024-09-12T22:33:09.058 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6956999999999998e-05 2024-09-12T22:33:09.058 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.058 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.058 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:09.058 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418799+0000", 2024-09-12T22:33:09.058 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7749000000000001e-05 2024-09-12T22:33:09.058 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:09.058 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:09.058 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:09.058 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.058 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.058 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:33:09.058 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.402060+0000", 2024-09-12T22:33:09.059 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 91.588776103000001, 2024-09-12T22:33:09.059 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016885686, 2024-09-12T22:33:09.059 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:09.059 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:09.059 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:09.059 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:09.059 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.059 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:09.059 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402060+0000", 2024-09-12T22:33:09.059 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:09.059 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.059 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.059 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:09.059 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402060+0000", 2024-09-12T22:33:09.060 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:09.060 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.060 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.060 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:09.060 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402061+0000", 2024-09-12T22:33:09.060 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4399999999999999e-07 2024-09-12T22:33:09.060 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.060 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.060 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:09.060 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402066+0000", 2024-09-12T22:33:09.060 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8649999999999998e-06 2024-09-12T22:33:09.060 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.060 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.061 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:09.061 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402146+0000", 2024-09-12T22:33:09.061 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9054000000000006e-05 2024-09-12T22:33:09.061 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.064 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.065 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:09.065 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402287+0000", 2024-09-12T22:33:09.065 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014108600000000001 2024-09-12T22:33:09.065 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.065 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.065 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:09.065 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408185+0000", 2024-09-12T22:33:09.065 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0058983919999999997 2024-09-12T22:33:09.065 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.065 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.065 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:09.065 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408299+0000", 2024-09-12T22:33:09.065 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114102 2024-09-12T22:33:09.066 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.066 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.066 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:33:09.066 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408420+0000", 2024-09-12T22:33:09.066 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000120492 2024-09-12T22:33:09.066 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.066 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.066 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:09.066 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410867+0000", 2024-09-12T22:33:09.066 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0024476430000000002 2024-09-12T22:33:09.066 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.066 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.066 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:09.066 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418851+0000", 2024-09-12T22:33:09.067 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0079841489999999994 2024-09-12T22:33:09.067 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.067 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.067 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:09.067 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418894+0000", 2024-09-12T22:33:09.067 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3090000000000002e-05 2024-09-12T22:33:09.067 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.067 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.067 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:09.067 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418946+0000", 2024-09-12T22:33:09.067 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1069000000000002e-05 2024-09-12T22:33:09.067 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:09.067 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:09.067 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:09.068 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.068 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.068 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:33:09.068 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.402375+0000", 2024-09-12T22:33:09.068 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 91.588461038000005, 2024-09-12T22:33:09.068 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016768531999999999, 2024-09-12T22:33:09.068 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:09.068 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:09.068 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:09.068 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:09.068 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.068 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:09.068 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402375+0000", 2024-09-12T22:33:09.068 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:09.069 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.069 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.069 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:09.069 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402375+0000", 2024-09-12T22:33:09.069 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:09.069 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.069 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.069 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:09.069 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402375+0000", 2024-09-12T22:33:09.069 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4099999999999999e-07 2024-09-12T22:33:09.069 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.069 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.069 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:09.069 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402379+0000", 2024-09-12T22:33:09.070 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9870000000000001e-06 2024-09-12T22:33:09.070 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.070 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.070 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:09.070 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402389+0000", 2024-09-12T22:33:09.070 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0000000000000001e-05 2024-09-12T22:33:09.070 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.070 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.070 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:09.070 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402401+0000", 2024-09-12T22:33:09.070 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.148e-05 2024-09-12T22:33:09.070 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.070 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.070 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:09.071 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409108+0000", 2024-09-12T22:33:09.071 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0067068429999999997 2024-09-12T22:33:09.071 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.071 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.071 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:09.071 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409189+0000", 2024-09-12T22:33:09.071 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0815999999999993e-05 2024-09-12T22:33:09.071 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.071 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.071 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:33:09.071 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409320+0000", 2024-09-12T22:33:09.071 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000131586 2024-09-12T22:33:09.071 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.071 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.072 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:09.072 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410872+0000", 2024-09-12T22:33:09.072 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0015521599999999999 2024-09-12T22:33:09.072 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.072 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.072 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:09.072 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419049+0000", 2024-09-12T22:33:09.072 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0081763719999999995 2024-09-12T22:33:09.072 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.072 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.072 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:09.072 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419107+0000", 2024-09-12T22:33:09.072 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7899000000000002e-05 2024-09-12T22:33:09.073 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.073 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.073 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:09.073 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419143+0000", 2024-09-12T22:33:09.073 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6847999999999997e-05 2024-09-12T22:33:09.073 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:09.073 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:09.073 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:09.073 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.073 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.073 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:33:09.073 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.402903+0000", 2024-09-12T22:33:09.074 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 91.587932625999997, 2024-09-12T22:33:09.074 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016378428, 2024-09-12T22:33:09.074 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:09.074 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:09.074 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:09.074 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:09.074 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.074 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:09.074 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402903+0000", 2024-09-12T22:33:09.074 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:09.074 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.074 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.074 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:09.074 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402903+0000", 2024-09-12T22:33:09.075 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:09.075 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.075 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.075 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:09.075 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402904+0000", 2024-09-12T22:33:09.075 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9500000000000001e-07 2024-09-12T22:33:09.075 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.075 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.075 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:09.075 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402944+0000", 2024-09-12T22:33:09.075 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0265000000000002e-05 2024-09-12T22:33:09.075 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.075 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.075 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:09.076 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402979+0000", 2024-09-12T22:33:09.076 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4378000000000002e-05 2024-09-12T22:33:09.076 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.076 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.076 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:09.076 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.402987+0000", 2024-09-12T22:33:09.076 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3559999999999993e-06 2024-09-12T22:33:09.076 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.076 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.076 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:09.076 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409577+0000", 2024-09-12T22:33:09.076 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0065901709999999997 2024-09-12T22:33:09.076 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.076 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.077 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:09.077 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409653+0000", 2024-09-12T22:33:09.077 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5819e-05 2024-09-12T22:33:09.077 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.077 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.077 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:33:09.077 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409725+0000", 2024-09-12T22:33:09.077 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2200000000000007e-05 2024-09-12T22:33:09.077 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.077 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.077 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:09.077 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.411234+0000", 2024-09-12T22:33:09.077 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001508225 2024-09-12T22:33:09.077 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.078 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.078 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:09.078 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419212+0000", 2024-09-12T22:33:09.078 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0079783400000000004 2024-09-12T22:33:09.078 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.078 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.078 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:09.078 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419244+0000", 2024-09-12T22:33:09.078 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2384e-05 2024-09-12T22:33:09.078 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.078 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.078 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:09.078 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419282+0000", 2024-09-12T22:33:09.078 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7394999999999997e-05 2024-09-12T22:33:09.079 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:09.079 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:09.079 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:09.079 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.079 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.079 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:33:09.079 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.403135+0000", 2024-09-12T22:33:09.079 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 91.587700756000004, 2024-09-12T22:33:09.079 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016294211999999999, 2024-09-12T22:33:09.079 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:09.079 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:09.079 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:09.079 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:09.080 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.080 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:09.080 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403135+0000", 2024-09-12T22:33:09.080 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:09.080 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.080 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.080 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:09.080 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403135+0000", 2024-09-12T22:33:09.080 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:09.080 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.080 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.080 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:09.080 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403136+0000", 2024-09-12T22:33:09.081 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.4e-07 2024-09-12T22:33:09.081 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.081 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.081 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:09.081 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403149+0000", 2024-09-12T22:33:09.081 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2723e-05 2024-09-12T22:33:09.081 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.081 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.081 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:09.081 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403158+0000", 2024-09-12T22:33:09.081 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3919999999999992e-06 2024-09-12T22:33:09.081 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.081 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.082 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:09.082 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403166+0000", 2024-09-12T22:33:09.082 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.2309999999999996e-06 2024-09-12T22:33:09.082 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.082 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.082 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:09.082 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409944+0000", 2024-09-12T22:33:09.082 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0067775309999999998 2024-09-12T22:33:09.082 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.082 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.082 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:09.082 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410032+0000", 2024-09-12T22:33:09.082 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.7906999999999997e-05 2024-09-12T22:33:09.082 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.083 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.083 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:33:09.083 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.410152+0000", 2024-09-12T22:33:09.083 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012037800000000001 2024-09-12T22:33:09.083 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.083 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.083 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:09.083 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.411945+0000", 2024-09-12T22:33:09.083 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0017931850000000001 2024-09-12T22:33:09.083 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.083 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.083 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:09.083 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419319+0000", 2024-09-12T22:33:09.083 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0073731780000000002 2024-09-12T22:33:09.084 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.084 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.084 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:09.084 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419376+0000", 2024-09-12T22:33:09.084 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7728e-05 2024-09-12T22:33:09.084 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.084 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.084 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:09.084 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.419429+0000", 2024-09-12T22:33:09.084 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3019000000000002e-05 2024-09-12T22:33:09.084 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:09.084 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:09.084 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:09.084 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.085 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.085 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:33:09.085 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.403185+0000", 2024-09-12T22:33:09.085 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 91.587650874999994, 2024-09-12T22:33:09.085 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.014902164000000001, 2024-09-12T22:33:09.085 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:09.085 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:09.085 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:09.085 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:09.085 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.085 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:09.085 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403185+0000", 2024-09-12T22:33:09.085 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:09.085 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.086 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.086 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:09.086 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403185+0000", 2024-09-12T22:33:09.086 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:09.086 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.086 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.086 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:09.086 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403186+0000", 2024-09-12T22:33:09.086 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9400000000000005e-07 2024-09-12T22:33:09.086 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.086 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.086 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:09.086 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403191+0000", 2024-09-12T22:33:09.086 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6980000000000003e-06 2024-09-12T22:33:09.087 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.087 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.087 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:09.087 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403199+0000", 2024-09-12T22:33:09.087 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2520000000000002e-06 2024-09-12T22:33:09.087 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.087 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.087 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:09.087 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403205+0000", 2024-09-12T22:33:09.087 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.908e-06 2024-09-12T22:33:09.087 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.087 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.087 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:09.087 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403359+0000", 2024-09-12T22:33:09.088 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000154544 2024-09-12T22:33:09.088 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.088 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.088 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:09.088 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403528+0000", 2024-09-12T22:33:09.088 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000168455 2024-09-12T22:33:09.088 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.088 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.088 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:33:09.088 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403763+0000", 2024-09-12T22:33:09.088 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00023539599999999999 2024-09-12T22:33:09.088 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.088 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.088 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:09.089 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409378+0000", 2024-09-12T22:33:09.089 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0056150000000000002 2024-09-12T22:33:09.089 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.089 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.089 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:09.089 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418012+0000", 2024-09-12T22:33:09.089 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0086339559999999999 2024-09-12T22:33:09.089 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.089 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.089 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:09.089 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418046+0000", 2024-09-12T22:33:09.089 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4267999999999998e-05 2024-09-12T22:33:09.089 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.090 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.090 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:09.090 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418087+0000", 2024-09-12T22:33:09.090 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0992999999999999e-05 2024-09-12T22:33:09.090 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:09.090 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:09.090 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:09.090 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.090 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.090 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:33:09.090 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.403273+0000", 2024-09-12T22:33:09.090 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 91.587562923999997, 2024-09-12T22:33:09.090 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.014934866, 2024-09-12T22:33:09.090 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:09.091 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:09.091 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:09.091 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:09.091 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.091 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:09.091 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403273+0000", 2024-09-12T22:33:09.091 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:09.091 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.091 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.091 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:09.091 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403273+0000", 2024-09-12T22:33:09.091 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:09.091 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.091 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.092 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:09.092 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403274+0000", 2024-09-12T22:33:09.092 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.297e-06 2024-09-12T22:33:09.092 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.092 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.092 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:09.092 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403282+0000", 2024-09-12T22:33:09.092 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6340000000000001e-06 2024-09-12T22:33:09.092 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.092 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.092 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:09.092 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403305+0000", 2024-09-12T22:33:09.092 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3149000000000001e-05 2024-09-12T22:33:09.092 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.093 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.093 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:09.093 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.403320+0000", 2024-09-12T22:33:09.093 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4527e-05 2024-09-12T22:33:09.093 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.093 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.093 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:09.093 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.404928+0000", 2024-09-12T22:33:09.093 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001608459 2024-09-12T22:33:09.093 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.093 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.093 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:09.093 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405218+0000", 2024-09-12T22:33:09.093 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00028982900000000002 2024-09-12T22:33:09.094 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.094 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.094 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:33:09.094 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405829+0000", 2024-09-12T22:33:09.094 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00061127900000000005 2024-09-12T22:33:09.094 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.094 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.094 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:09.094 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409403+0000", 2024-09-12T22:33:09.094 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.003573597 2024-09-12T22:33:09.094 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.094 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.094 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:09.094 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418138+0000", 2024-09-12T22:33:09.095 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0087349969999999996 2024-09-12T22:33:09.095 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.095 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.095 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:09.095 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418178+0000", 2024-09-12T22:33:09.095 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0649999999999999e-05 2024-09-12T22:33:09.095 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.095 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.095 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:09.095 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418208+0000", 2024-09-12T22:33:09.095 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9448e-05 2024-09-12T22:33:09.095 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:09.095 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:09.095 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:09.096 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.096 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.096 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:33:09.096 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.405456+0000", 2024-09-12T22:33:09.096 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 91.585379778999993, 2024-09-12T22:33:09.096 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012888389, 2024-09-12T22:33:09.096 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:09.096 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:09.096 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:09.096 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:09.096 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.096 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:09.096 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405456+0000", 2024-09-12T22:33:09.096 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:09.097 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.097 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.097 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:09.097 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405456+0000", 2024-09-12T22:33:09.097 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:09.097 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.097 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.097 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:09.097 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405457+0000", 2024-09-12T22:33:09.097 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.6599999999999994e-07 2024-09-12T22:33:09.097 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.097 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.098 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:09.098 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405463+0000", 2024-09-12T22:33:09.098 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4739999999999996e-06 2024-09-12T22:33:09.098 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.098 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.098 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:09.098 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405474+0000", 2024-09-12T22:33:09.098 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1095e-05 2024-09-12T22:33:09.098 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.098 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.098 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:09.098 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405482+0000", 2024-09-12T22:33:09.098 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3610000000000001e-06 2024-09-12T22:33:09.098 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.099 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.099 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:09.099 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407051+0000", 2024-09-12T22:33:09.099 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0015688970000000001 2024-09-12T22:33:09.099 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.099 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.099 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:09.099 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407259+0000", 2024-09-12T22:33:09.099 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00020778300000000001 2024-09-12T22:33:09.099 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.099 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.099 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:33:09.099 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407622+0000", 2024-09-12T22:33:09.100 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000363066 2024-09-12T22:33:09.100 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.100 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.100 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:09.100 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409438+0000", 2024-09-12T22:33:09.100 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001816319 2024-09-12T22:33:09.100 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.100 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.100 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:09.100 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418257+0000", 2024-09-12T22:33:09.100 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0088187720000000008 2024-09-12T22:33:09.100 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.100 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.101 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:09.101 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418308+0000", 2024-09-12T22:33:09.101 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1180000000000001e-05 2024-09-12T22:33:09.101 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.101 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.101 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:09.101 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418345+0000", 2024-09-12T22:33:09.101 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6476000000000001e-05 2024-09-12T22:33:09.101 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:09.101 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:09.101 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:09.101 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.101 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.102 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:33:09.102 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.405496+0000", 2024-09-12T22:33:09.102 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 91.585340422000002, 2024-09-12T22:33:09.102 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.013016012, 2024-09-12T22:33:09.102 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:09.102 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:09.102 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:09.102 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:09.102 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.102 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:09.102 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405496+0000", 2024-09-12T22:33:09.102 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:09.102 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.102 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.103 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:09.103 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405496+0000", 2024-09-12T22:33:09.103 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:09.103 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.103 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.103 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:09.103 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405496+0000", 2024-09-12T22:33:09.103 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7999999999999995e-07 2024-09-12T22:33:09.103 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.103 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.103 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:09.103 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405501+0000", 2024-09-12T22:33:09.103 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8359999999999999e-06 2024-09-12T22:33:09.103 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.104 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.104 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:09.104 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405514+0000", 2024-09-12T22:33:09.104 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2522e-05 2024-09-12T22:33:09.104 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.104 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.104 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:09.104 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405521+0000", 2024-09-12T22:33:09.104 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5020000000000003e-06 2024-09-12T22:33:09.104 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.104 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.104 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:09.104 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405575+0000", 2024-09-12T22:33:09.105 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4169999999999998e-05 2024-09-12T22:33:09.105 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.105 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.105 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:09.105 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405697+0000", 2024-09-12T22:33:09.105 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000121301 2024-09-12T22:33:09.105 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.105 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.105 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:33:09.105 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.405829+0000", 2024-09-12T22:33:09.105 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000132662 2024-09-12T22:33:09.105 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.105 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.105 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:09.106 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409155+0000", 2024-09-12T22:33:09.106 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0033259050000000001 2024-09-12T22:33:09.106 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.106 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.106 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:09.106 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418425+0000", 2024-09-12T22:33:09.106 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0092696319999999999 2024-09-12T22:33:09.106 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.106 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.106 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:09.106 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418471+0000", 2024-09-12T22:33:09.106 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6213e-05 2024-09-12T22:33:09.106 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.106 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.107 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:09.107 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418512+0000", 2024-09-12T22:33:09.107 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0589000000000001e-05 2024-09-12T22:33:09.107 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:09.107 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:09.107 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:09.107 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.107 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.107 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:33:09.107 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.406108+0000", 2024-09-12T22:33:09.107 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 91.584728025000004, 2024-09-12T22:33:09.107 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.012458175, 2024-09-12T22:33:09.107 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:09.107 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:09.108 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:09.108 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:09.108 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.108 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:09.108 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406108+0000", 2024-09-12T22:33:09.108 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:09.108 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.108 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.108 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:09.108 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406108+0000", 2024-09-12T22:33:09.108 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:09.108 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.108 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.109 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:09.109 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406109+0000", 2024-09-12T22:33:09.109 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9899999999999999e-07 2024-09-12T22:33:09.109 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.109 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.109 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:09.109 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406115+0000", 2024-09-12T22:33:09.109 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9030000000000001e-06 2024-09-12T22:33:09.109 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.109 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.109 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:09.109 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406141+0000", 2024-09-12T22:33:09.109 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5999e-05 2024-09-12T22:33:09.109 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.110 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.110 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:09.110 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.406150+0000", 2024-09-12T22:33:09.110 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.6050000000000004e-06 2024-09-12T22:33:09.110 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.110 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.110 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:09.110 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408163+0000", 2024-09-12T22:33:09.110 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0020122769999999998 2024-09-12T22:33:09.110 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.110 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.110 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:09.110 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408309+0000", 2024-09-12T22:33:09.110 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014606999999999999 2024-09-12T22:33:09.110 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.111 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.111 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:33:09.111 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408433+0000", 2024-09-12T22:33:09.111 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00012460300000000001 2024-09-12T22:33:09.111 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.111 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.111 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:09.111 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409903+0000", 2024-09-12T22:33:09.111 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001469499 2024-09-12T22:33:09.111 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.111 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.111 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:09.111 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418427+0000", 2024-09-12T22:33:09.111 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0085241139999999993 2024-09-12T22:33:09.112 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.112 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.112 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:09.112 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418471+0000", 2024-09-12T22:33:09.112 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4474000000000001e-05 2024-09-12T22:33:09.112 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.112 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.112 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:09.112 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418566+0000", 2024-09-12T22:33:09.112 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.4732e-05 2024-09-12T22:33:09.112 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:09.112 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:09.112 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:09.113 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.113 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.113 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2024-09-12T22:33:09.113 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:37.407266+0000", 2024-09-12T22:33:09.113 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 91.583570168999998, 2024-09-12T22:33:09.113 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.011442905, 2024-09-12T22:33:09.113 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:09.113 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:09.113 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "started", 2024-09-12T22:33:09.113 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:09.113 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.113 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:09.113 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407266+0000", 2024-09-12T22:33:09.113 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:09.113 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.114 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.114 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:09.114 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407266+0000", 2024-09-12T22:33:09.114 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:09.114 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.114 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.114 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:09.114 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407266+0000", 2024-09-12T22:33:09.114 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7899999999999998e-07 2024-09-12T22:33:09.114 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.114 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.114 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:09.114 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407269+0000", 2024-09-12T22:33:09.114 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9210000000000001e-06 2024-09-12T22:33:09.115 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.115 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.115 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:09.115 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407331+0000", 2024-09-12T22:33:09.115 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1376000000000003e-05 2024-09-12T22:33:09.115 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.115 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.115 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:09.115 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.407337+0000", 2024-09-12T22:33:09.115 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1929999999999998e-06 2024-09-12T22:33:09.115 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.115 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.115 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:09.115 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.408974+0000", 2024-09-12T22:33:09.116 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0016367109999999999 2024-09-12T22:33:09.116 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.116 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.116 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:09.116 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.409112+0000", 2024-09-12T22:33:09.116 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000137952 2024-09-12T22:33:09.116 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:09.116 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:09.116 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:09.116 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:37.418709+0000", 2024-09-12T22:33:09.116 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0095971730000000005 2024-09-12T22:33:09.116 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:09.116 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:09.116 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:09.117 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:09.117 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:09.117 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-09-12T22:33:09.117 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~23s 2024-09-12T22:33:09.118 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:09.116+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:09.119 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:33:09.219 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:09.217+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:09.231 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:33:09.231 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [ 2024-09-12T22:33:09.231 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.231 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4490.0:9693 4.33 4:cdfd0b9b:::10000002c88.00000000:head [write 0~5563 in=5563b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:33:09.232 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:09.230822+0000", 2024-09-12T22:33:09.232 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.000221566, 2024-09-12T22:33:09.232 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00024551199999999998, 2024-09-12T22:33:09.232 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:09.232 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:09.232 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:33:09.232 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:33:09.232 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4490", 2024-09-12T22:33:09.232 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:09.232 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 9693 2024-09-12T22:33:09.232 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.232 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:09.232 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.232 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:09.233 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.230822+0000", 2024-09-12T22:33:09.233 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:09.233 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.233 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.233 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:09.233 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.230822+0000", 2024-09-12T22:33:09.233 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:09.233 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.233 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.233 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:09.233 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.230823+0000", 2024-09-12T22:33:09.233 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.6700000000000002e-07 2024-09-12T22:33:09.233 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.233 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.234 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:09.234 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.230830+0000", 2024-09-12T22:33:09.234 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.2350000000000002e-06 2024-09-12T22:33:09.234 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.234 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.234 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:09.234 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.230841+0000", 2024-09-12T22:33:09.234 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0674e-05 2024-09-12T22:33:09.234 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.234 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.234 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:09.234 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.230846+0000", 2024-09-12T22:33:09.234 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3310000000000003e-06 2024-09-12T22:33:09.234 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.235 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.235 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:09.235 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.230896+0000", 2024-09-12T22:33:09.235 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0050999999999999e-05 2024-09-12T22:33:09.235 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.235 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.235 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:09.235 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.231014+0000", 2024-09-12T22:33:09.235 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0001178 2024-09-12T22:33:09.235 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:09.235 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:09.235 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:09.235 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:09.236 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-12T22:33:09.236 INFO:teuthology.orchestra.run.smithi148.stdout: "num_ops": 1 2024-09-12T22:33:09.236 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:33:09.241 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:33:09.321 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:09.320+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:09.388 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:33:09.388 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:33:09.388 INFO:teuthology.orchestra.run.smithi148.stdout: "complaint_time": 30, 2024-09-12T22:33:09.388 INFO:teuthology.orchestra.run.smithi148.stdout: "num_blocked_ops": 0 2024-09-12T22:33:09.388 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:33:09.398 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:33:09.422 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:09.421+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:09.507 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:33:09.508 INFO:teuthology.orchestra.run.smithi148.stdout: "size": 20, 2024-09-12T22:33:09.508 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 600, 2024-09-12T22:33:09.508 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [ 2024-09-12T22:33:09.508 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.508 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:98 3.1f 3:f83d65d8:::200.00000004:head [write 409563~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-09-12T22:33:09.508 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:04.385076+0000", 2024-09-12T22:33:09.508 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 5.1205037449999997, 2024-09-12T22:33:09.508 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.022769053000000001, 2024-09-12T22:33:09.508 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:09.508 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:09.509 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:09.509 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:09.509 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.509 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:09.509 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385076+0000", 2024-09-12T22:33:09.509 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:09.509 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.509 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.509 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:09.509 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385076+0000", 2024-09-12T22:33:09.509 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:09.509 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.509 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.510 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:09.510 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385076+0000", 2024-09-12T22:33:09.510 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8799999999999998e-07 2024-09-12T22:33:09.510 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.510 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.510 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:09.510 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385082+0000", 2024-09-12T22:33:09.510 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0950000000000003e-06 2024-09-12T22:33:09.510 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.510 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.510 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:09.510 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385087+0000", 2024-09-12T22:33:09.510 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.463e-06 2024-09-12T22:33:09.511 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.511 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.511 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:09.511 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385090+0000", 2024-09-12T22:33:09.511 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4359999999999998e-06 2024-09-12T22:33:09.511 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.511 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.511 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:09.511 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.400713+0000", 2024-09-12T22:33:09.511 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.015622416 2024-09-12T22:33:09.511 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.511 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.511 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:09.511 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.400785+0000", 2024-09-12T22:33:09.512 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1761000000000006e-05 2024-09-12T22:33:09.512 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.512 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.512 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:09.512 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.400904+0000", 2024-09-12T22:33:09.512 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000119422 2024-09-12T22:33:09.512 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.512 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.512 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:09.512 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.403113+0000", 2024-09-12T22:33:09.512 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0022093899999999999 2024-09-12T22:33:09.512 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.512 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.512 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:09.513 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.407757+0000", 2024-09-12T22:33:09.513 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0046435119999999998 2024-09-12T22:33:09.513 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.513 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.513 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:09.513 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.407802+0000", 2024-09-12T22:33:09.513 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5479000000000003e-05 2024-09-12T22:33:09.513 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.513 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.513 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:09.513 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.407845+0000", 2024-09-12T22:33:09.513 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2790999999999997e-05 2024-09-12T22:33:09.513 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:09.514 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:09.514 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:09.514 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.514 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.514 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:99 3.1f 3:f83d65d8:::200.00000004:head [write 410964~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-09-12T22:33:09.514 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:04.385097+0000", 2024-09-12T22:33:09.514 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 5.1204824840000001, 2024-09-12T22:33:09.514 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.02283048, 2024-09-12T22:33:09.514 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:09.514 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:09.514 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:09.514 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:09.514 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.514 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:09.515 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385097+0000", 2024-09-12T22:33:09.515 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:09.515 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.515 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.515 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:09.515 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385097+0000", 2024-09-12T22:33:09.515 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:09.515 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.515 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.515 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:09.515 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385098+0000", 2024-09-12T22:33:09.515 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5699999999999999e-07 2024-09-12T22:33:09.516 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.516 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.516 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:09.516 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385100+0000", 2024-09-12T22:33:09.516 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9139999999999998e-06 2024-09-12T22:33:09.516 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.516 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.516 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:09.516 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385104+0000", 2024-09-12T22:33:09.516 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1910000000000002e-06 2024-09-12T22:33:09.516 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.516 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.516 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:09.517 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385107+0000", 2024-09-12T22:33:09.517 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.7939999999999998e-06 2024-09-12T22:33:09.517 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.517 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.517 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:09.517 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.401260+0000", 2024-09-12T22:33:09.517 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016153700999999999 2024-09-12T22:33:09.517 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.517 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.517 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:09.517 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.401337+0000", 2024-09-12T22:33:09.517 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.6470000000000005e-05 2024-09-12T22:33:09.517 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.518 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.518 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:09.518 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.401462+0000", 2024-09-12T22:33:09.518 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000125666 2024-09-12T22:33:09.518 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.518 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.518 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:09.518 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.404304+0000", 2024-09-12T22:33:09.518 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0028414809999999999 2024-09-12T22:33:09.518 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.518 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.518 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:09.518 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.407853+0000", 2024-09-12T22:33:09.519 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0035488310000000001 2024-09-12T22:33:09.519 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.519 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.519 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:09.519 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.407894+0000", 2024-09-12T22:33:09.519 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1455000000000002e-05 2024-09-12T22:33:09.519 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.519 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.519 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:09.519 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.407928+0000", 2024-09-12T22:33:09.519 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3720000000000002e-05 2024-09-12T22:33:09.519 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:09.520 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:09.520 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:09.520 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.520 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.520 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:100 3.1f 3:f83d65d8:::200.00000004:head [write 412367~1404 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-09-12T22:33:09.520 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:04.385111+0000", 2024-09-12T22:33:09.520 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 5.1204688760000003, 2024-09-12T22:33:09.520 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.022896741000000002, 2024-09-12T22:33:09.520 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:09.520 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:09.520 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:09.520 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:09.520 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.521 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:09.521 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385111+0000", 2024-09-12T22:33:09.521 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:09.521 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.521 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.521 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:09.521 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385111+0000", 2024-09-12T22:33:09.521 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:09.521 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.521 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.521 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:09.522 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385111+0000", 2024-09-12T22:33:09.522 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.22e-07 2024-09-12T22:33:09.522 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.522 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.522 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:09.522 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385113+0000", 2024-09-12T22:33:09.522 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7069999999999999e-06 2024-09-12T22:33:09.522 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.522 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.522 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:09.522 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385119+0000", 2024-09-12T22:33:09.522 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2090000000000002e-06 2024-09-12T22:33:09.522 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.522 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.523 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:09.523 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385122+0000", 2024-09-12T22:33:09.523 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.033e-06 2024-09-12T22:33:09.523 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.523 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.523 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:09.523 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.401990+0000", 2024-09-12T22:33:09.523 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016867534 2024-09-12T22:33:09.523 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.523 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.523 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:09.523 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.402057+0000", 2024-09-12T22:33:09.523 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7118000000000004e-05 2024-09-12T22:33:09.524 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.524 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.524 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:09.524 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.402161+0000", 2024-09-12T22:33:09.524 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000103905 2024-09-12T22:33:09.524 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.524 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.524 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:09.524 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.404360+0000", 2024-09-12T22:33:09.524 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0021992940000000001 2024-09-12T22:33:09.524 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.525 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.525 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:09.525 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.407935+0000", 2024-09-12T22:33:09.525 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0035751630000000001 2024-09-12T22:33:09.525 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.525 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.525 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:09.525 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.407976+0000", 2024-09-12T22:33:09.525 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0376000000000001e-05 2024-09-12T22:33:09.525 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.525 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.525 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:09.525 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.408008+0000", 2024-09-12T22:33:09.525 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.218e-05 2024-09-12T22:33:09.526 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:09.526 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:09.526 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:09.526 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.526 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.526 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:101 3.1f 3:f83d65d8:::200.00000004:head [write 413771~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-09-12T22:33:09.526 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:04.385126+0000", 2024-09-12T22:33:09.526 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 5.1204538749999999, 2024-09-12T22:33:09.526 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.022964140000000001, 2024-09-12T22:33:09.526 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:09.526 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:09.526 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:09.526 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:09.527 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.527 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:09.527 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385126+0000", 2024-09-12T22:33:09.527 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:09.527 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.527 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.527 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:09.527 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385126+0000", 2024-09-12T22:33:09.527 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:09.527 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.527 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.527 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:09.527 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385126+0000", 2024-09-12T22:33:09.528 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.29e-07 2024-09-12T22:33:09.528 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.528 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.528 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:09.528 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385139+0000", 2024-09-12T22:33:09.528 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2877000000000001e-05 2024-09-12T22:33:09.528 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.528 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.528 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:09.528 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385144+0000", 2024-09-12T22:33:09.528 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9840000000000001e-06 2024-09-12T22:33:09.528 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.528 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.529 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:09.529 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385147+0000", 2024-09-12T22:33:09.529 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0750000000000002e-06 2024-09-12T22:33:09.529 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.529 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.529 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:09.529 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.402511+0000", 2024-09-12T22:33:09.529 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017363456999999999 2024-09-12T22:33:09.529 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.529 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.529 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:09.529 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.402587+0000", 2024-09-12T22:33:09.530 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.6128e-05 2024-09-12T22:33:09.530 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.530 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.530 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:09.530 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.402706+0000", 2024-09-12T22:33:09.530 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000119157 2024-09-12T22:33:09.530 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.530 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.530 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:09.530 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.404414+0000", 2024-09-12T22:33:09.530 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00170773 2024-09-12T22:33:09.530 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.530 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.531 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:09.531 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.408015+0000", 2024-09-12T22:33:09.531 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003601389 2024-09-12T22:33:09.531 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.531 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.531 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:09.531 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.408057+0000", 2024-09-12T22:33:09.531 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1548999999999998e-05 2024-09-12T22:33:09.531 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.531 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.531 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:09.531 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.408090+0000", 2024-09-12T22:33:09.532 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3565000000000001e-05 2024-09-12T22:33:09.532 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:09.532 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:09.532 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:09.532 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.532 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.532 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:102 3.1f 3:f83d65d8:::200.00000004:head [write 415176~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-09-12T22:33:09.532 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:04.385152+0000", 2024-09-12T22:33:09.532 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 5.1204275570000002, 2024-09-12T22:33:09.532 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.023015768999999998, 2024-09-12T22:33:09.532 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:09.532 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:09.532 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:09.533 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:09.533 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.533 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:09.533 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385152+0000", 2024-09-12T22:33:09.533 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:09.533 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.533 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.533 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:09.533 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385152+0000", 2024-09-12T22:33:09.533 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:09.533 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.533 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.533 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:09.533 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385155+0000", 2024-09-12T22:33:09.534 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4200000000000001e-06 2024-09-12T22:33:09.534 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.534 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.534 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:09.534 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385157+0000", 2024-09-12T22:33:09.534 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.8640000000000001e-06 2024-09-12T22:33:09.534 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.534 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.534 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:09.534 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385161+0000", 2024-09-12T22:33:09.534 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1590000000000003e-06 2024-09-12T22:33:09.534 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.534 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.535 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:09.535 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385164+0000", 2024-09-12T22:33:09.535 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8150000000000002e-06 2024-09-12T22:33:09.535 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.535 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.535 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:09.535 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.403160+0000", 2024-09-12T22:33:09.535 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017996174 2024-09-12T22:33:09.535 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.535 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.535 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:09.535 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.403229+0000", 2024-09-12T22:33:09.536 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.9301999999999995e-05 2024-09-12T22:33:09.536 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.536 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.536 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:09.536 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.403341+0000", 2024-09-12T22:33:09.536 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000112002 2024-09-12T22:33:09.536 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.536 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.536 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:09.537 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.405776+0000", 2024-09-12T22:33:09.537 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0024350079999999998 2024-09-12T22:33:09.537 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.537 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.537 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:09.537 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.408097+0000", 2024-09-12T22:33:09.537 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.002321086 2024-09-12T22:33:09.537 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.537 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.537 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:09.537 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.408137+0000", 2024-09-12T22:33:09.537 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9743999999999998e-05 2024-09-12T22:33:09.537 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.537 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.538 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:09.538 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.408168+0000", 2024-09-12T22:33:09.538 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.1195000000000002e-05 2024-09-12T22:33:09.538 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:09.538 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:09.538 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:09.538 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.538 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.538 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:103 3.1f 3:f83d65d8:::200.00000004:head [write 416575~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-09-12T22:33:09.538 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:04.385167+0000", 2024-09-12T22:33:09.538 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 5.12041301, 2024-09-12T22:33:09.538 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.024972646000000001, 2024-09-12T22:33:09.538 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:09.538 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:09.539 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:09.539 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:09.539 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.539 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:09.539 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385167+0000", 2024-09-12T22:33:09.539 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:09.539 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.539 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.539 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:09.539 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385167+0000", 2024-09-12T22:33:09.539 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:09.539 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.539 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.539 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:09.540 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385167+0000", 2024-09-12T22:33:09.540 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.2100000000000001e-07 2024-09-12T22:33:09.540 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.540 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.540 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:09.540 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385176+0000", 2024-09-12T22:33:09.540 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.8249999999999994e-06 2024-09-12T22:33:09.540 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.540 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.540 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:09.540 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385182+0000", 2024-09-12T22:33:09.540 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0469999999999999e-06 2024-09-12T22:33:09.540 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.541 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.541 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:09.541 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385185+0000", 2024-09-12T22:33:09.541 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0570000000000001e-06 2024-09-12T22:33:09.541 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.541 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.541 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:09.541 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.403629+0000", 2024-09-12T22:33:09.541 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.018443838000000001 2024-09-12T22:33:09.541 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.541 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.541 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:09.541 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.403710+0000", 2024-09-12T22:33:09.541 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0851000000000002e-05 2024-09-12T22:33:09.542 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.542 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.542 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:09.542 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.403859+0000", 2024-09-12T22:33:09.542 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014873800000000001 2024-09-12T22:33:09.542 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.542 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.542 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:09.542 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.406967+0000", 2024-09-12T22:33:09.542 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0031080320000000002 2024-09-12T22:33:09.542 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.542 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.543 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:09.543 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410055+0000", 2024-09-12T22:33:09.543 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003088698 2024-09-12T22:33:09.543 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.543 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.543 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:09.543 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410104+0000", 2024-09-12T22:33:09.543 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8469e-05 2024-09-12T22:33:09.543 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.543 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.543 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:09.543 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410140+0000", 2024-09-12T22:33:09.543 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.587e-05 2024-09-12T22:33:09.544 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:09.544 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:09.544 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:09.544 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.544 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.544 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:104 3.1f 3:f83d65d8:::200.00000004:head [write 417974~1421 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-09-12T22:33:09.544 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:04.385189+0000", 2024-09-12T22:33:09.544 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 5.1203908560000002, 2024-09-12T22:33:09.544 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.025034507000000001, 2024-09-12T22:33:09.544 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:09.544 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:09.544 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:09.544 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:09.545 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.545 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:09.545 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385189+0000", 2024-09-12T22:33:09.545 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:09.545 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.545 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.545 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:09.545 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385189+0000", 2024-09-12T22:33:09.545 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:09.545 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.545 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.545 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:09.545 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385189+0000", 2024-09-12T22:33:09.546 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5199999999999998e-07 2024-09-12T22:33:09.546 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.546 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.546 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:09.546 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385191+0000", 2024-09-12T22:33:09.546 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7489999999999999e-06 2024-09-12T22:33:09.546 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.546 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.546 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:09.546 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385194+0000", 2024-09-12T22:33:09.546 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.1039999999999998e-06 2024-09-12T22:33:09.546 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.546 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.546 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:09.547 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385197+0000", 2024-09-12T22:33:09.547 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.3740000000000001e-06 2024-09-12T22:33:09.547 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.547 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.547 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:09.547 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.404717+0000", 2024-09-12T22:33:09.547 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.019520056000000001 2024-09-12T22:33:09.547 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.547 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.547 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:09.547 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.404795+0000", 2024-09-12T22:33:09.547 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.818e-05 2024-09-12T22:33:09.547 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.548 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.548 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:09.548 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.404930+0000", 2024-09-12T22:33:09.548 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013531400000000001 2024-09-12T22:33:09.548 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.548 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.548 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:09.548 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.407028+0000", 2024-09-12T22:33:09.548 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0020980899999999999 2024-09-12T22:33:09.548 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.548 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.548 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:09.549 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410147+0000", 2024-09-12T22:33:09.549 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0031188710000000001 2024-09-12T22:33:09.549 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.549 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.549 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:09.549 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410190+0000", 2024-09-12T22:33:09.549 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2899999999999999e-05 2024-09-12T22:33:09.549 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.549 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.549 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:09.549 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410224+0000", 2024-09-12T22:33:09.549 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3617e-05 2024-09-12T22:33:09.549 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:09.550 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:09.550 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:09.550 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.550 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.550 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:105 3.1f 3:f83d65d8:::200.00000004:head [write 419395~1406 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-09-12T22:33:09.550 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:04.385200+0000", 2024-09-12T22:33:09.550 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 5.120380301, 2024-09-12T22:33:09.550 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.025105683, 2024-09-12T22:33:09.550 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:09.550 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:09.550 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:09.550 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:09.550 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.550 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:09.551 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385200+0000", 2024-09-12T22:33:09.551 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:09.551 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.551 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.551 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:09.551 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385200+0000", 2024-09-12T22:33:09.551 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:09.551 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.551 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.551 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:09.551 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385200+0000", 2024-09-12T22:33:09.551 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.05e-07 2024-09-12T22:33:09.551 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.551 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.552 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:09.552 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385205+0000", 2024-09-12T22:33:09.552 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.6269999999999997e-06 2024-09-12T22:33:09.552 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.552 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.552 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:09.552 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385209+0000", 2024-09-12T22:33:09.552 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.439e-06 2024-09-12T22:33:09.552 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.552 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.552 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:09.552 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385211+0000", 2024-09-12T22:33:09.552 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5040000000000001e-06 2024-09-12T22:33:09.553 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.553 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.553 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:09.553 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.405286+0000", 2024-09-12T22:33:09.553 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.020074229999999998 2024-09-12T22:33:09.553 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.553 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.553 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:09.553 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.405359+0000", 2024-09-12T22:33:09.553 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3355000000000005e-05 2024-09-12T22:33:09.553 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.553 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.553 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:09.553 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.405471+0000", 2024-09-12T22:33:09.554 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000112175 2024-09-12T22:33:09.554 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.554 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.554 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:09.554 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.408223+0000", 2024-09-12T22:33:09.554 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0027517779999999999 2024-09-12T22:33:09.554 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.554 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.554 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:09.554 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410231+0000", 2024-09-12T22:33:09.554 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0020078190000000001 2024-09-12T22:33:09.554 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.554 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.554 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:09.555 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410273+0000", 2024-09-12T22:33:09.555 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2530000000000001e-05 2024-09-12T22:33:09.555 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.555 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.555 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:09.555 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410305+0000", 2024-09-12T22:33:09.555 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2020999999999997e-05 2024-09-12T22:33:09.555 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:09.555 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:09.555 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:09.555 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.555 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.555 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:106 3.1f 3:f83d65d8:::200.00000004:head [write 420801~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-09-12T22:33:09.556 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:04.385215+0000", 2024-09-12T22:33:09.556 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 5.1203649750000002, 2024-09-12T22:33:09.556 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.025168234000000001, 2024-09-12T22:33:09.556 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:09.556 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:09.556 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:09.556 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:09.556 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.556 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:09.556 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385215+0000", 2024-09-12T22:33:09.556 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:09.556 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.556 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.556 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:09.557 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385215+0000", 2024-09-12T22:33:09.557 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:09.557 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.557 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.557 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:09.557 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385215+0000", 2024-09-12T22:33:09.557 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.2600000000000001e-07 2024-09-12T22:33:09.557 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.557 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.557 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:09.557 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385217+0000", 2024-09-12T22:33:09.557 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7099999999999999e-06 2024-09-12T22:33:09.557 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.558 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.558 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:09.558 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385220+0000", 2024-09-12T22:33:09.558 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.004e-06 2024-09-12T22:33:09.558 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.558 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.558 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:09.558 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385223+0000", 2024-09-12T22:33:09.558 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.633e-06 2024-09-12T22:33:09.558 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.558 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.558 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:09.558 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.405826+0000", 2024-09-12T22:33:09.559 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.020603831999999999 2024-09-12T22:33:09.559 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.559 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.559 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:09.559 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.405898+0000", 2024-09-12T22:33:09.559 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1398999999999999e-05 2024-09-12T22:33:09.559 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.559 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.559 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:09.559 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.406011+0000", 2024-09-12T22:33:09.559 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000113411 2024-09-12T22:33:09.559 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.559 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.559 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:09.560 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.408285+0000", 2024-09-12T22:33:09.560 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.002273639 2024-09-12T22:33:09.560 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.560 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.560 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:09.560 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410313+0000", 2024-09-12T22:33:09.560 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0020280760000000002 2024-09-12T22:33:09.560 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.560 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.560 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:09.560 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410350+0000", 2024-09-12T22:33:09.560 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7307e-05 2024-09-12T22:33:09.560 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.561 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.561 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:09.561 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410383+0000", 2024-09-12T22:33:09.561 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2997000000000003e-05 2024-09-12T22:33:09.561 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:09.561 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:09.561 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:09.561 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.561 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.561 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:107 3.1f 3:f83d65d8:::200.00000004:head [write 422206~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-09-12T22:33:09.561 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:04.385226+0000", 2024-09-12T22:33:09.561 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 5.1203542400000002, 2024-09-12T22:33:09.561 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.025350256000000002, 2024-09-12T22:33:09.561 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:09.562 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:09.562 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:09.562 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:09.562 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.562 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:09.562 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385226+0000", 2024-09-12T22:33:09.562 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:09.562 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.562 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.562 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:09.562 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385226+0000", 2024-09-12T22:33:09.562 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:09.562 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.563 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.563 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:09.563 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385226+0000", 2024-09-12T22:33:09.563 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.2399999999999999e-07 2024-09-12T22:33:09.563 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.563 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.563 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:09.563 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385228+0000", 2024-09-12T22:33:09.563 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.508e-06 2024-09-12T22:33:09.563 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.563 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.563 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:09.563 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385235+0000", 2024-09-12T22:33:09.563 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.3169999999999998e-06 2024-09-12T22:33:09.564 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.564 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.564 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:09.564 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385238+0000", 2024-09-12T22:33:09.564 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.9249999999999999e-06 2024-09-12T22:33:09.564 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.564 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.564 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:09.564 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.406376+0000", 2024-09-12T22:33:09.564 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.021138364999999999 2024-09-12T22:33:09.564 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.564 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.564 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:09.564 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.406451+0000", 2024-09-12T22:33:09.565 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4882000000000006e-05 2024-09-12T22:33:09.565 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.565 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.565 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:09.565 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.406590+0000", 2024-09-12T22:33:09.565 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000138627 2024-09-12T22:33:09.565 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.565 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.565 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:09.565 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410461+0000", 2024-09-12T22:33:09.565 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0038712109999999998 2024-09-12T22:33:09.565 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.565 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.565 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:09.566 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410493+0000", 2024-09-12T22:33:09.566 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2147999999999998e-05 2024-09-12T22:33:09.566 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.566 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.566 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:09.566 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410537+0000", 2024-09-12T22:33:09.566 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3792999999999999e-05 2024-09-12T22:33:09.566 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.566 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.566 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:09.566 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410576+0000", 2024-09-12T22:33:09.566 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9255999999999998e-05 2024-09-12T22:33:09.566 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:09.567 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:09.567 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:09.567 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.567 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.567 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4490.0:5682 4.3f 4:ff1ebe6d:::10000001a29.00000000:head [write 0~2106] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T22:33:09.567 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:04.386989+0000", 2024-09-12T22:33:09.567 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 5.1185913169999999, 2024-09-12T22:33:09.567 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.023595390000000001, 2024-09-12T22:33:09.567 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:09.567 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:09.567 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:09.567 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:33:09.567 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4490", 2024-09-12T22:33:09.567 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:09.568 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 5682 2024-09-12T22:33:09.568 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.568 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:09.568 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.568 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:09.568 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.386989+0000", 2024-09-12T22:33:09.568 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:09.568 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.568 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.568 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:09.568 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.386989+0000", 2024-09-12T22:33:09.568 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:09.568 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.568 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.569 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:09.569 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.386989+0000", 2024-09-12T22:33:09.569 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.8800000000000002e-07 2024-09-12T22:33:09.569 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.569 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.569 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:09.569 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.386994+0000", 2024-09-12T22:33:09.569 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4279999999999998e-06 2024-09-12T22:33:09.569 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.569 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.569 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:09.569 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.387001+0000", 2024-09-12T22:33:09.569 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.2320000000000004e-06 2024-09-12T22:33:09.570 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.570 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.570 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:09.570 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.387006+0000", 2024-09-12T22:33:09.570 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6589999999999998e-06 2024-09-12T22:33:09.570 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.570 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.570 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:09.570 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.407003+0000", 2024-09-12T22:33:09.570 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.019997635 2024-09-12T22:33:09.570 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.570 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.570 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:09.570 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.407134+0000", 2024-09-12T22:33:09.571 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013037899999999999 2024-09-12T22:33:09.571 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.571 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.571 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:09.571 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410469+0000", 2024-09-12T22:33:09.571 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0033353160000000001 2024-09-12T22:33:09.571 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.571 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.571 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:09.571 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410510+0000", 2024-09-12T22:33:09.571 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0553999999999998e-05 2024-09-12T22:33:09.571 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.571 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.572 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:09.572 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410584+0000", 2024-09-12T22:33:09.572 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4399000000000004e-05 2024-09-12T22:33:09.572 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:09.572 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:09.572 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:09.572 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.572 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.572 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:108 3.1f 3:f83d65d8:::200.00000004:head [write 423607~16211 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-09-12T22:33:09.572 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:04.392223+0000", 2024-09-12T22:33:09.572 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 5.1133573209999996, 2024-09-12T22:33:09.572 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.022025629000000001, 2024-09-12T22:33:09.572 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:09.572 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:09.573 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:09.573 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:09.573 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.573 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:09.573 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.392223+0000", 2024-09-12T22:33:09.573 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:09.573 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.573 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.573 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:09.573 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.392223+0000", 2024-09-12T22:33:09.573 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:09.573 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.573 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.574 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:09.574 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.392224+0000", 2024-09-12T22:33:09.574 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.358e-06 2024-09-12T22:33:09.574 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.574 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.574 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:09.574 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.392238+0000", 2024-09-12T22:33:09.574 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4408e-05 2024-09-12T22:33:09.574 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.574 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.574 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:09.574 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.392248+0000", 2024-09-12T22:33:09.574 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0013000000000001e-05 2024-09-12T22:33:09.575 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.575 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.575 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:09.575 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.392256+0000", 2024-09-12T22:33:09.575 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1060000000000002e-06 2024-09-12T22:33:09.575 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.575 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.575 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:09.575 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.407080+0000", 2024-09-12T22:33:09.575 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.014824519 2024-09-12T22:33:09.575 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.575 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.575 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:09.575 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.407152+0000", 2024-09-12T22:33:09.576 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1543000000000003e-05 2024-09-12T22:33:09.576 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.576 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.576 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:09.576 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.407270+0000", 2024-09-12T22:33:09.576 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000118721 2024-09-12T22:33:09.576 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.576 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.576 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:09.576 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410591+0000", 2024-09-12T22:33:09.576 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0033203080000000001 2024-09-12T22:33:09.576 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.576 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.577 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:09.577 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.414179+0000", 2024-09-12T22:33:09.577 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00358838 2024-09-12T22:33:09.577 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.577 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.577 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:09.577 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.414215+0000", 2024-09-12T22:33:09.577 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.5753999999999997e-05 2024-09-12T22:33:09.577 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.577 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.577 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:09.577 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.414248+0000", 2024-09-12T22:33:09.577 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3519000000000002e-05 2024-09-12T22:33:09.578 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:09.578 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:09.578 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:09.578 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.578 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.578 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:109 3.1f 3:f83d65d8:::200.00000004:head [write 439818~3871 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-09-12T22:33:09.578 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:04.393309+0000", 2024-09-12T22:33:09.578 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 5.1122712110000004, 2024-09-12T22:33:09.578 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.021084952000000001, 2024-09-12T22:33:09.578 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:09.578 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:09.578 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:09.578 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:09.579 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.579 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:09.579 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393309+0000", 2024-09-12T22:33:09.579 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:09.579 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.579 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.579 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:09.579 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393309+0000", 2024-09-12T22:33:09.579 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:09.579 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.579 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.579 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:09.579 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393309+0000", 2024-09-12T22:33:09.580 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.8400000000000004e-07 2024-09-12T22:33:09.580 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.580 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.580 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:09.580 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393317+0000", 2024-09-12T22:33:09.580 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.8199999999999997e-06 2024-09-12T22:33:09.580 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.580 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.580 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:09.580 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393327+0000", 2024-09-12T22:33:09.580 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.7450000000000007e-06 2024-09-12T22:33:09.580 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.581 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.581 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:09.581 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393334+0000", 2024-09-12T22:33:09.581 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3409999999999997e-06 2024-09-12T22:33:09.581 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.581 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.581 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:09.581 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.408316+0000", 2024-09-12T22:33:09.581 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.014981335 2024-09-12T22:33:09.581 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.581 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.581 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:09.581 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.408391+0000", 2024-09-12T22:33:09.581 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4948000000000001e-05 2024-09-12T22:33:09.582 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.582 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.582 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:09.582 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.408502+0000", 2024-09-12T22:33:09.582 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000111643 2024-09-12T22:33:09.582 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.582 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.582 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:09.582 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410597+0000", 2024-09-12T22:33:09.582 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0020942909999999999 2024-09-12T22:33:09.582 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.582 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.582 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:09.582 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.414301+0000", 2024-09-12T22:33:09.583 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0037040100000000002 2024-09-12T22:33:09.583 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.583 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.583 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:09.583 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.414355+0000", 2024-09-12T22:33:09.583 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4555999999999997e-05 2024-09-12T22:33:09.583 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.583 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.583 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:09.583 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.414394+0000", 2024-09-12T22:33:09.583 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.8578999999999998e-05 2024-09-12T22:33:09.583 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:09.583 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:09.583 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:09.584 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.584 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.584 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:110 3.1f 3:f83d65d8:::200.00000004:head [write 443689~1928 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-09-12T22:33:09.584 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:04.393358+0000", 2024-09-12T22:33:09.584 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 5.1122219009999998, 2024-09-12T22:33:09.584 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.021144165999999999, 2024-09-12T22:33:09.584 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:09.584 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:09.584 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:09.584 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:09.584 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.585 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:09.585 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393358+0000", 2024-09-12T22:33:09.585 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:09.585 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.585 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.585 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:09.585 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393358+0000", 2024-09-12T22:33:09.585 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:09.585 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.585 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.585 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:09.585 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393359+0000", 2024-09-12T22:33:09.585 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3900000000000005e-07 2024-09-12T22:33:09.586 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.586 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.586 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:09.586 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393363+0000", 2024-09-12T22:33:09.586 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0509999999999998e-06 2024-09-12T22:33:09.586 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.586 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.586 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:09.586 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393370+0000", 2024-09-12T22:33:09.586 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.8350000000000004e-06 2024-09-12T22:33:09.586 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.586 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.586 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:09.586 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393376+0000", 2024-09-12T22:33:09.587 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8030000000000002e-06 2024-09-12T22:33:09.587 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.587 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.587 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:09.587 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.408908+0000", 2024-09-12T22:33:09.587 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.01553218 2024-09-12T22:33:09.587 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.587 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.587 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:09.587 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.408978+0000", 2024-09-12T22:33:09.587 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.9142999999999999e-05 2024-09-12T22:33:09.587 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.587 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.587 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:09.588 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.409088+0000", 2024-09-12T22:33:09.588 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000110357 2024-09-12T22:33:09.588 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.588 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.588 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:09.588 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.411046+0000", 2024-09-12T22:33:09.588 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001958338 2024-09-12T22:33:09.588 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.588 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.588 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:09.588 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.414431+0000", 2024-09-12T22:33:09.588 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0033846340000000001 2024-09-12T22:33:09.588 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.589 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.589 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:09.589 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.414474+0000", 2024-09-12T22:33:09.589 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2777000000000001e-05 2024-09-12T22:33:09.589 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.589 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.589 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:09.589 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.414502+0000", 2024-09-12T22:33:09.589 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8509000000000001e-05 2024-09-12T22:33:09.589 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:09.589 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:09.589 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:09.589 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.589 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.590 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:111 3.1f 3:f83d65d8:::200.00000004:head [write 445617~3886 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-09-12T22:33:09.590 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:04.393579+0000", 2024-09-12T22:33:09.590 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 5.1120013420000001, 2024-09-12T22:33:09.590 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.021052739000000001, 2024-09-12T22:33:09.590 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:09.590 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:09.590 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:09.590 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:09.590 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.590 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:09.590 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393579+0000", 2024-09-12T22:33:09.590 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:09.590 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.590 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.591 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:09.591 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393579+0000", 2024-09-12T22:33:09.591 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:09.591 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.591 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.591 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:09.591 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393579+0000", 2024-09-12T22:33:09.591 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.09e-07 2024-09-12T22:33:09.591 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.591 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.591 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:09.591 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393586+0000", 2024-09-12T22:33:09.591 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.6279999999999999e-06 2024-09-12T22:33:09.592 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.592 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.592 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:09.592 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393603+0000", 2024-09-12T22:33:09.592 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6750000000000001e-05 2024-09-12T22:33:09.592 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.592 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.592 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:09.592 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393609+0000", 2024-09-12T22:33:09.592 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.3090000000000001e-06 2024-09-12T22:33:09.592 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.592 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.592 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:09.593 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.409440+0000", 2024-09-12T22:33:09.593 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.015830486000000001 2024-09-12T22:33:09.593 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.593 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.593 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:09.593 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.409520+0000", 2024-09-12T22:33:09.593 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0761999999999997e-05 2024-09-12T22:33:09.593 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.593 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.593 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:09.593 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.409634+0000", 2024-09-12T22:33:09.593 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000113155 2024-09-12T22:33:09.593 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.593 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.594 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:09.594 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.411630+0000", 2024-09-12T22:33:09.594 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0019964940000000001 2024-09-12T22:33:09.594 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.594 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.594 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:09.594 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.414551+0000", 2024-09-12T22:33:09.594 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0029212660000000001 2024-09-12T22:33:09.594 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.594 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.594 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:09.594 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.414598+0000", 2024-09-12T22:33:09.594 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6836999999999999e-05 2024-09-12T22:33:09.594 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.595 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.595 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:09.595 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.414631+0000", 2024-09-12T22:33:09.595 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3243e-05 2024-09-12T22:33:09.595 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:09.595 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:09.595 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:09.595 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.595 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.595 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:112 3.1f 3:f83d65d8:::200.00000004:head [write 449503~3460 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-09-12T22:33:09.595 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:04.393638+0000", 2024-09-12T22:33:09.595 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 5.1119415339999996, 2024-09-12T22:33:09.595 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.023344696000000002, 2024-09-12T22:33:09.596 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:09.596 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:09.596 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:09.596 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:09.596 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.596 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:09.596 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393638+0000", 2024-09-12T22:33:09.596 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:09.596 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.596 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.596 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:09.596 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393638+0000", 2024-09-12T22:33:09.596 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:09.596 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.597 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.597 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:09.597 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393639+0000", 2024-09-12T22:33:09.597 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.68e-07 2024-09-12T22:33:09.597 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.597 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.597 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:09.597 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393643+0000", 2024-09-12T22:33:09.597 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.98e-06 2024-09-12T22:33:09.597 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.597 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.597 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:09.597 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393650+0000", 2024-09-12T22:33:09.597 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.131e-06 2024-09-12T22:33:09.598 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.598 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.598 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:09.598 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393655+0000", 2024-09-12T22:33:09.598 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0270000000000003e-06 2024-09-12T22:33:09.598 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.598 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.598 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:09.598 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410618+0000", 2024-09-12T22:33:09.598 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016962600000000001 2024-09-12T22:33:09.598 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.598 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.598 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:09.598 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410679+0000", 2024-09-12T22:33:09.599 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.1014999999999998e-05 2024-09-12T22:33:09.599 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.599 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.599 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:09.599 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410763+0000", 2024-09-12T22:33:09.599 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.4586000000000006e-05 2024-09-12T22:33:09.599 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.599 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.599 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:09.599 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.412605+0000", 2024-09-12T22:33:09.599 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001842036 2024-09-12T22:33:09.599 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.599 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.599 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:09.600 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.416894+0000", 2024-09-12T22:33:09.600 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0042887649999999999 2024-09-12T22:33:09.600 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.600 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.600 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:09.600 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.416947+0000", 2024-09-12T22:33:09.600 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2500999999999998e-05 2024-09-12T22:33:09.600 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.600 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.600 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:09.600 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.416983+0000", 2024-09-12T22:33:09.600 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.6486999999999998e-05 2024-09-12T22:33:09.600 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:09.601 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:09.601 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:09.601 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.601 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.601 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:113 3.1f 3:f83d65d8:::200.00000004:head [write 452963~1919 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-09-12T22:33:09.601 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:04.393838+0000", 2024-09-12T22:33:09.601 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 5.1117421319999998, 2024-09-12T22:33:09.601 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.023234016999999999, 2024-09-12T22:33:09.601 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:09.601 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:09.601 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:09.601 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:09.601 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.601 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:09.602 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393838+0000", 2024-09-12T22:33:09.602 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:09.602 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.602 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.602 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:09.602 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393838+0000", 2024-09-12T22:33:09.602 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:09.602 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.602 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.602 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:09.602 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393839+0000", 2024-09-12T22:33:09.602 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.9299999999999997e-07 2024-09-12T22:33:09.602 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.602 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.603 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:09.603 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393842+0000", 2024-09-12T22:33:09.603 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7759999999999999e-06 2024-09-12T22:33:09.603 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.603 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.603 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:09.603 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393850+0000", 2024-09-12T22:33:09.603 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.6590000000000007e-06 2024-09-12T22:33:09.603 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.603 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.603 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:09.603 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393856+0000", 2024-09-12T22:33:09.603 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.1659999999999999e-06 2024-09-12T22:33:09.604 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.604 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.604 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:09.604 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.411099+0000", 2024-09-12T22:33:09.604 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017242785 2024-09-12T22:33:09.604 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.604 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.604 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:09.604 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.411172+0000", 2024-09-12T22:33:09.604 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.2552999999999995e-05 2024-09-12T22:33:09.604 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.604 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.604 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:09.605 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.411280+0000", 2024-09-12T22:33:09.605 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000108701 2024-09-12T22:33:09.605 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.605 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.605 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:09.605 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.413582+0000", 2024-09-12T22:33:09.605 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0023020290000000001 2024-09-12T22:33:09.605 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.605 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.605 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:09.605 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.417020+0000", 2024-09-12T22:33:09.605 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0034373860000000002 2024-09-12T22:33:09.605 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.606 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.606 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:09.606 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.417049+0000", 2024-09-12T22:33:09.606 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8986e-05 2024-09-12T22:33:09.606 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.606 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.606 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:09.606 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.417072+0000", 2024-09-12T22:33:09.606 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.3183000000000001e-05 2024-09-12T22:33:09.606 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:09.606 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:09.606 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:09.606 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.606 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.607 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:114 3.1f 3:f83d65d8:::200.00000004:head [write 454882~5842 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-09-12T22:33:09.607 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:04.396101+0000", 2024-09-12T22:33:09.607 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 5.1094791089999996, 2024-09-12T22:33:09.607 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.021098186000000001, 2024-09-12T22:33:09.607 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:09.607 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:09.607 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:09.607 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:09.607 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.607 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:09.607 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.396101+0000", 2024-09-12T22:33:09.607 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:09.607 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.607 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.608 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:09.608 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.396101+0000", 2024-09-12T22:33:09.608 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:09.608 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.608 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.608 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:09.608 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.396102+0000", 2024-09-12T22:33:09.608 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1600000000000001e-07 2024-09-12T22:33:09.608 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.608 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.608 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:09.608 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.396108+0000", 2024-09-12T22:33:09.608 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.9290000000000001e-06 2024-09-12T22:33:09.609 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.609 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.609 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:09.609 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.396116+0000", 2024-09-12T22:33:09.609 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.0960000000000003e-06 2024-09-12T22:33:09.609 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.609 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.609 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:09.609 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.396120+0000", 2024-09-12T22:33:09.609 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5000000000000001e-06 2024-09-12T22:33:09.609 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.609 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.609 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:09.610 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.411666+0000", 2024-09-12T22:33:09.610 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.015545608000000001 2024-09-12T22:33:09.610 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.610 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.610 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:09.610 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.411712+0000", 2024-09-12T22:33:09.610 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6233000000000003e-05 2024-09-12T22:33:09.610 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.610 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.610 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:09.610 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.411777+0000", 2024-09-12T22:33:09.610 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.5019999999999998e-05 2024-09-12T22:33:09.610 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.610 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.611 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:09.611 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.413586+0000", 2024-09-12T22:33:09.611 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0018087979999999999 2024-09-12T22:33:09.611 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.611 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.611 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:09.611 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.417115+0000", 2024-09-12T22:33:09.611 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003528972 2024-09-12T22:33:09.611 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.611 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.611 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:09.611 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.417163+0000", 2024-09-12T22:33:09.611 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8136000000000001e-05 2024-09-12T22:33:09.611 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.612 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.612 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:09.612 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.417199+0000", 2024-09-12T22:33:09.612 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.6177999999999998e-05 2024-09-12T22:33:09.612 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:09.612 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:09.612 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:09.612 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.612 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.612 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:115 3.1f 3:f83d65d8:::200.00000004:head [write 460724~3955 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-09-12T22:33:09.612 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:04.396288+0000", 2024-09-12T22:33:09.612 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 5.1092924460000004, 2024-09-12T22:33:09.612 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.020991639999999999, 2024-09-12T22:33:09.612 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:09.613 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:09.613 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:09.613 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:09.613 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.613 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:09.613 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.396288+0000", 2024-09-12T22:33:09.613 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:09.613 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.613 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.613 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:09.613 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.396288+0000", 2024-09-12T22:33:09.613 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:09.613 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.614 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.614 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:09.614 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.396288+0000", 2024-09-12T22:33:09.614 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4200000000000001e-07 2024-09-12T22:33:09.614 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.614 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.614 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:09.614 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.396292+0000", 2024-09-12T22:33:09.614 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5290000000000002e-06 2024-09-12T22:33:09.614 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.614 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.614 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:09.614 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.396299+0000", 2024-09-12T22:33:09.614 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.55e-06 2024-09-12T22:33:09.615 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.615 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.615 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:09.615 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.396303+0000", 2024-09-12T22:33:09.615 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.636e-06 2024-09-12T22:33:09.615 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.615 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.615 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:09.615 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.412101+0000", 2024-09-12T22:33:09.615 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.015798053999999999 2024-09-12T22:33:09.615 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.615 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.615 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:09.615 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.412189+0000", 2024-09-12T22:33:09.616 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.8488999999999999e-05 2024-09-12T22:33:09.616 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.616 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.616 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:09.616 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.412296+0000", 2024-09-12T22:33:09.616 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000107014 2024-09-12T22:33:09.616 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.616 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.616 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:09.616 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.414256+0000", 2024-09-12T22:33:09.616 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0019593269999999999 2024-09-12T22:33:09.616 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.617 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.617 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:09.617 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.417232+0000", 2024-09-12T22:33:09.617 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0029769229999999998 2024-09-12T22:33:09.617 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.617 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.617 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:09.617 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.417258+0000", 2024-09-12T22:33:09.617 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5618000000000001e-05 2024-09-12T22:33:09.617 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.617 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.617 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:09.617 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.417279+0000", 2024-09-12T22:33:09.618 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1058000000000001e-05 2024-09-12T22:33:09.618 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:09.618 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:09.618 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:09.618 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.618 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.618 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:116 3.1f 3:f83d65d8:::200.00000004:head [write 464679~2931 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-09-12T22:33:09.618 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:04.396580+0000", 2024-09-12T22:33:09.618 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 5.1090003499999996, 2024-09-12T22:33:09.618 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.020824097, 2024-09-12T22:33:09.618 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:09.618 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:09.618 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:09.618 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:09.619 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.619 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:09.619 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.396580+0000", 2024-09-12T22:33:09.619 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:09.619 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.619 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.619 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:09.619 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.396580+0000", 2024-09-12T22:33:09.619 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:09.619 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.619 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.619 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:09.620 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.396580+0000", 2024-09-12T22:33:09.620 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2499999999999995e-07 2024-09-12T22:33:09.620 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.620 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.620 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:09.620 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.396583+0000", 2024-09-12T22:33:09.620 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.157e-06 2024-09-12T22:33:09.620 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.620 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.620 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:09.620 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.396588+0000", 2024-09-12T22:33:09.620 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9350000000000002e-06 2024-09-12T22:33:09.620 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.620 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.621 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:09.621 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.396591+0000", 2024-09-12T22:33:09.621 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2820000000000001e-06 2024-09-12T22:33:09.621 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.621 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.621 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:09.621 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.412646+0000", 2024-09-12T22:33:09.621 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016054029000000001 2024-09-12T22:33:09.621 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.621 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.621 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:09.621 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.412712+0000", 2024-09-12T22:33:09.621 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.6693999999999995e-05 2024-09-12T22:33:09.621 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.622 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.622 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:09.622 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.412780+0000", 2024-09-12T22:33:09.622 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7688000000000007e-05 2024-09-12T22:33:09.622 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.622 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.622 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:09.622 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.414259+0000", 2024-09-12T22:33:09.622 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0014787820000000001 2024-09-12T22:33:09.622 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.622 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.622 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:09.622 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.417321+0000", 2024-09-12T22:33:09.623 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0030626659999999999 2024-09-12T22:33:09.623 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.623 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.623 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:09.623 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.417369+0000", 2024-09-12T22:33:09.623 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8084000000000002e-05 2024-09-12T22:33:09.623 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:09.623 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:09.623 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:09.623 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.417404+0000", 2024-09-12T22:33:09.623 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4255000000000003e-05 2024-09-12T22:33:09.623 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:09.623 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:09.623 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:09.623 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:09.624 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:09.624 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:33:09.625 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:33:09.626 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:09.623+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:09.726 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:09.725+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:09.734 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-09-12T22:33:09.734 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-09-12T22:33:09.734 INFO:teuthology.orchestra.run.smithi163.stdout: "num_ops": 0 2024-09-12T22:33:09.734 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-09-12T22:33:09.743 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:33:09.827 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:09.826+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:09.892 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-09-12T22:33:09.893 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-09-12T22:33:09.893 INFO:teuthology.orchestra.run.smithi163.stdout: "complaint_time": 30, 2024-09-12T22:33:09.893 INFO:teuthology.orchestra.run.smithi163.stdout: "num_blocked_ops": 0 2024-09-12T22:33:09.893 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-09-12T22:33:09.903 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:33:09.944 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:09.943+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:10.027 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:10.026+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:10.056 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-09-12T22:33:10.056 INFO:teuthology.orchestra.run.smithi163.stdout: "size": 20, 2024-09-12T22:33:10.057 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 600, 2024-09-12T22:33:10.057 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2024-09-12T22:33:10.057 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.057 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-09-12T22:33:10.057 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:27.254459+0000", 2024-09-12T22:33:10.057 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 102.79981318199999, 2024-09-12T22:33:10.057 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.37816283899999997, 2024-09-12T22:33:10.057 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:10.057 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:10.057 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:10.057 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:10.057 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:33:10.058 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:33:10.058 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 1 2024-09-12T22:33:10.058 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.058 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:10.058 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.058 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:10.058 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254459+0000", 2024-09-12T22:33:10.058 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:10.058 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.059 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.059 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:10.059 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254459+0000", 2024-09-12T22:33:10.059 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:10.059 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.059 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.059 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:10.059 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254460+0000", 2024-09-12T22:33:10.059 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1739999999999999e-06 2024-09-12T22:33:10.059 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.059 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.059 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:10.059 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254472+0000", 2024-09-12T22:33:10.060 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2207e-05 2024-09-12T22:33:10.060 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.060 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.060 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:10.060 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254483+0000", 2024-09-12T22:33:10.060 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0631999999999999e-05 2024-09-12T22:33:10.060 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.060 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.060 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:10.060 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254492+0000", 2024-09-12T22:33:10.060 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3670000000000003e-06 2024-09-12T22:33:10.060 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.060 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.061 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:10.061 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254551+0000", 2024-09-12T22:33:10.061 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8687999999999998e-05 2024-09-12T22:33:10.061 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.061 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.061 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for peered", 2024-09-12T22:33:10.061 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254562+0000", 2024-09-12T22:33:10.061 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1249e-05 2024-09-12T22:33:10.061 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.061 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.061 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:10.061 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.631211+0000", 2024-09-12T22:33:10.062 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.376649018 2024-09-12T22:33:10.062 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.062 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.062 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:10.062 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.631345+0000", 2024-09-12T22:33:10.062 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013378700000000001 2024-09-12T22:33:10.062 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.062 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.062 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:33:10.063 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.631479+0000", 2024-09-12T22:33:10.063 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013352399999999999 2024-09-12T22:33:10.063 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.063 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.063 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:10.063 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632324+0000", 2024-09-12T22:33:10.063 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00084508100000000002 2024-09-12T22:33:10.063 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.063 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.063 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:10.063 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632548+0000", 2024-09-12T22:33:10.063 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000224329 2024-09-12T22:33:10.063 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.064 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.064 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:10.064 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632591+0000", 2024-09-12T22:33:10.064 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2564000000000001e-05 2024-09-12T22:33:10.064 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.064 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.064 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:10.064 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632622+0000", 2024-09-12T22:33:10.064 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1219e-05 2024-09-12T22:33:10.064 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:10.064 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:10.064 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:10.064 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.065 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.065 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:208 3.1d 3:bf8dcf43:::200.00000008:head [write 3196120~1414 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-09-12T22:33:10.065 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:09.385379+0000", 2024-09-12T22:33:10.065 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.668893085, 2024-09-12T22:33:10.065 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.029907771999999999, 2024-09-12T22:33:10.065 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:10.065 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:10.065 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:10.065 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:10.065 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.065 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:10.065 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.385379+0000", 2024-09-12T22:33:10.065 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:10.066 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.066 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.066 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:10.066 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.385379+0000", 2024-09-12T22:33:10.066 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:10.066 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.066 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.066 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:10.066 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.385379+0000", 2024-09-12T22:33:10.066 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0599999999999999e-07 2024-09-12T22:33:10.067 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.067 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.067 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:10.067 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.385382+0000", 2024-09-12T22:33:10.067 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1690000000000001e-06 2024-09-12T22:33:10.067 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.067 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.067 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:10.067 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.385386+0000", 2024-09-12T22:33:10.067 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3129999999999999e-06 2024-09-12T22:33:10.067 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.067 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.067 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:10.068 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.385388+0000", 2024-09-12T22:33:10.068 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7240000000000001e-06 2024-09-12T22:33:10.068 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.068 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.068 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:10.068 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.413301+0000", 2024-09-12T22:33:10.068 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.027912922999999999 2024-09-12T22:33:10.068 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.068 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.068 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:10.068 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.413345+0000", 2024-09-12T22:33:10.068 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3726000000000001e-05 2024-09-12T22:33:10.068 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.069 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.069 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:10.069 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.415220+0000", 2024-09-12T22:33:10.069 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0018744759999999999 2024-09-12T22:33:10.069 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.069 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.069 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:10.069 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.415247+0000", 2024-09-12T22:33:10.069 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7676000000000001e-05 2024-09-12T22:33:10.069 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.069 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.069 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:10.069 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.415287+0000", 2024-09-12T22:33:10.070 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9558999999999999e-05 2024-09-12T22:33:10.070 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:10.070 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:10.070 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:10.070 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.070 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.070 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:209 3.1d 3:bf8dcf43:::200.00000008:head [write 3197534~1408 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-09-12T22:33:10.070 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:09.385392+0000", 2024-09-12T22:33:10.070 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.66888006300000002, 2024-09-12T22:33:10.070 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.029968742, 2024-09-12T22:33:10.070 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:10.071 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:10.071 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:10.071 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:10.071 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.071 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:10.071 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.385392+0000", 2024-09-12T22:33:10.071 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:10.071 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.071 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.071 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:10.071 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.385392+0000", 2024-09-12T22:33:10.071 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:10.071 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.072 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.072 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:10.072 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.385392+0000", 2024-09-12T22:33:10.072 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.36e-07 2024-09-12T22:33:10.072 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.072 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.072 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:10.072 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.385394+0000", 2024-09-12T22:33:10.072 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.322e-06 2024-09-12T22:33:10.072 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.072 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.072 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:10.073 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.385401+0000", 2024-09-12T22:33:10.073 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5379999999999997e-06 2024-09-12T22:33:10.073 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.073 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.073 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:10.073 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.385405+0000", 2024-09-12T22:33:10.073 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0579999999999999e-06 2024-09-12T22:33:10.073 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.073 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.073 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:10.073 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.413703+0000", 2024-09-12T22:33:10.073 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.028298088999999998 2024-09-12T22:33:10.073 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.074 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.074 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:10.074 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.413746+0000", 2024-09-12T22:33:10.074 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2898000000000002e-05 2024-09-12T22:33:10.074 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.074 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.074 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:10.074 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.415292+0000", 2024-09-12T22:33:10.074 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0015459289999999999 2024-09-12T22:33:10.074 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.074 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.074 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:10.075 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.415325+0000", 2024-09-12T22:33:10.075 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2657000000000003e-05 2024-09-12T22:33:10.075 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.075 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.075 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:10.075 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.415361+0000", 2024-09-12T22:33:10.075 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6015e-05 2024-09-12T22:33:10.075 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:10.075 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:10.075 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:10.075 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.075 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.075 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:210 3.1d 3:bf8dcf43:::200.00000008:head [write 3198942~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-09-12T22:33:10.075 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:09.385409+0000", 2024-09-12T22:33:10.076 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.66886322399999998, 2024-09-12T22:33:10.076 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.031918920000000003, 2024-09-12T22:33:10.076 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:10.076 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:10.076 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:10.076 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:10.076 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.076 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:10.076 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.385409+0000", 2024-09-12T22:33:10.076 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:10.076 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.076 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.077 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:10.077 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.385409+0000", 2024-09-12T22:33:10.077 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:10.077 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.077 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.077 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:10.077 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.385409+0000", 2024-09-12T22:33:10.077 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.35e-07 2024-09-12T22:33:10.077 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.077 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.077 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:10.077 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.385413+0000", 2024-09-12T22:33:10.077 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6490000000000001e-06 2024-09-12T22:33:10.077 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.078 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.078 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:10.078 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.385417+0000", 2024-09-12T22:33:10.078 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3749999999999996e-06 2024-09-12T22:33:10.078 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.078 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.078 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:10.078 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.385420+0000", 2024-09-12T22:33:10.078 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9110000000000002e-06 2024-09-12T22:33:10.078 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.078 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.078 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:10.078 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.414015+0000", 2024-09-12T22:33:10.079 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.028595155000000001 2024-09-12T22:33:10.079 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.079 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.079 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:10.079 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.414064+0000", 2024-09-12T22:33:10.079 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8362999999999998e-05 2024-09-12T22:33:10.079 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.079 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.079 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:10.079 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.417260+0000", 2024-09-12T22:33:10.079 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0031964609999999998 2024-09-12T22:33:10.079 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.079 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.080 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:10.080 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.417287+0000", 2024-09-12T22:33:10.080 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7109000000000001e-05 2024-09-12T22:33:10.080 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.080 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.080 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:10.080 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.417328+0000", 2024-09-12T22:33:10.080 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0661999999999998e-05 2024-09-12T22:33:10.080 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:10.080 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:10.080 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:10.080 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.080 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.081 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:211 3.1d 3:bf8dcf43:::200.00000008:head [write 3200345~1408 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-09-12T22:33:10.081 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:09.385423+0000", 2024-09-12T22:33:10.081 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.66884874100000002, 2024-09-12T22:33:10.081 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.035080515, 2024-09-12T22:33:10.081 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:10.081 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:10.081 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:10.081 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:10.081 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.081 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:10.081 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.385423+0000", 2024-09-12T22:33:10.082 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:10.082 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.082 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.082 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:10.082 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.385423+0000", 2024-09-12T22:33:10.082 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:10.082 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.082 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.082 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:10.082 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.385424+0000", 2024-09-12T22:33:10.082 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.36e-07 2024-09-12T22:33:10.082 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.083 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.083 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:10.083 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.385425+0000", 2024-09-12T22:33:10.083 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4109999999999999e-06 2024-09-12T22:33:10.083 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.083 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.083 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:10.083 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.385429+0000", 2024-09-12T22:33:10.083 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9600000000000002e-06 2024-09-12T22:33:10.083 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.083 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.083 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:10.083 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.385432+0000", 2024-09-12T22:33:10.084 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6850000000000001e-06 2024-09-12T22:33:10.084 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.084 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.084 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:10.084 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.414560+0000", 2024-09-12T22:33:10.084 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.029128483 2024-09-12T22:33:10.084 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.084 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.084 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:10.084 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.414606+0000", 2024-09-12T22:33:10.084 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6156999999999999e-05 2024-09-12T22:33:10.084 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.085 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.085 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:10.085 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.420405+0000", 2024-09-12T22:33:10.085 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005798264 2024-09-12T22:33:10.085 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.085 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.085 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:10.085 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.420441+0000", 2024-09-12T22:33:10.086 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6454e-05 2024-09-12T22:33:10.086 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.086 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.086 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:10.086 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.420504+0000", 2024-09-12T22:33:10.086 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.2865000000000002e-05 2024-09-12T22:33:10.086 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:10.086 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:10.086 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:10.087 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.087 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.087 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:212 3.1d 3:bf8dcf43:::200.00000008:head [write 3201753~1410 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-09-12T22:33:10.087 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:09.385435+0000", 2024-09-12T22:33:10.087 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.66883748399999998, 2024-09-12T22:33:10.087 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.035207347, 2024-09-12T22:33:10.087 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:10.087 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:10.087 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:10.087 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:10.087 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.087 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:10.087 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.385435+0000", 2024-09-12T22:33:10.088 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:10.088 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.088 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.088 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:10.088 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.385435+0000", 2024-09-12T22:33:10.088 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:10.088 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.088 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.088 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:10.089 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.385435+0000", 2024-09-12T22:33:10.089 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.2700000000000001e-07 2024-09-12T22:33:10.089 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.090 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.090 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:10.090 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.385437+0000", 2024-09-12T22:33:10.091 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.663e-06 2024-09-12T22:33:10.091 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.091 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.091 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:10.091 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.385441+0000", 2024-09-12T22:33:10.091 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9770000000000002e-06 2024-09-12T22:33:10.091 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.091 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.091 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:10.091 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.385443+0000", 2024-09-12T22:33:10.092 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.689e-06 2024-09-12T22:33:10.092 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.092 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.092 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:10.092 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.414866+0000", 2024-09-12T22:33:10.092 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.029422784 2024-09-12T22:33:10.092 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.092 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.092 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:10.092 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.414914+0000", 2024-09-12T22:33:10.092 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.7620000000000001e-05 2024-09-12T22:33:10.092 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.093 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.093 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:10.093 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.420513+0000", 2024-09-12T22:33:10.093 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005599082 2024-09-12T22:33:10.093 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.094 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.094 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:10.094 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.420559+0000", 2024-09-12T22:33:10.094 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6118000000000001e-05 2024-09-12T22:33:10.094 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.094 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.094 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:10.094 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.420642+0000", 2024-09-12T22:33:10.094 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3187000000000002e-05 2024-09-12T22:33:10.095 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:10.095 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:10.095 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:10.095 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.095 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.095 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:213 3.1d 3:bf8dcf43:::200.00000008:head [write 3203163~1404 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-09-12T22:33:10.095 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:09.385446+0000", 2024-09-12T22:33:10.095 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.66882593800000001, 2024-09-12T22:33:10.095 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.035328399000000003, 2024-09-12T22:33:10.096 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:10.096 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:10.096 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:10.096 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:10.096 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.096 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:10.096 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.385446+0000", 2024-09-12T22:33:10.096 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:10.096 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.096 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.097 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:10.097 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.385446+0000", 2024-09-12T22:33:10.097 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:10.097 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.097 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.097 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:10.097 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.385446+0000", 2024-09-12T22:33:10.097 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.28e-07 2024-09-12T22:33:10.097 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.097 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.097 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:10.097 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.385450+0000", 2024-09-12T22:33:10.097 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3809999999999999e-06 2024-09-12T22:33:10.097 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.098 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.098 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:10.098 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.385458+0000", 2024-09-12T22:33:10.098 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9519999999999994e-06 2024-09-12T22:33:10.098 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.098 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.098 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:10.098 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.385462+0000", 2024-09-12T22:33:10.098 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4959999999999998e-06 2024-09-12T22:33:10.098 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.098 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.098 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:10.098 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.415396+0000", 2024-09-12T22:33:10.099 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.029933607000000001 2024-09-12T22:33:10.099 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.099 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.099 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:10.099 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.415446+0000", 2024-09-12T22:33:10.099 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9641000000000001e-05 2024-09-12T22:33:10.099 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.099 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.099 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:10.099 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.420649+0000", 2024-09-12T22:33:10.099 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0052034539999999997 2024-09-12T22:33:10.099 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.099 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.099 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:10.100 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.420701+0000", 2024-09-12T22:33:10.100 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1959000000000002e-05 2024-09-12T22:33:10.100 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.100 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.100 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:10.100 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.420775+0000", 2024-09-12T22:33:10.100 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3681000000000001e-05 2024-09-12T22:33:10.100 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:10.100 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:10.100 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:10.100 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.100 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.100 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:214 3.1d 3:bf8dcf43:::200.00000008:head [write 3204567~1421 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-09-12T22:33:10.101 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:09.385466+0000", 2024-09-12T22:33:10.101 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.668805965, 2024-09-12T22:33:10.101 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.035431110000000002, 2024-09-12T22:33:10.101 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:10.101 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:10.101 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:10.101 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:10.101 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.101 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:10.101 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.385466+0000", 2024-09-12T22:33:10.101 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:10.101 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.101 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.101 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:10.102 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.385466+0000", 2024-09-12T22:33:10.102 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:10.102 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.102 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.102 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:10.102 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.385466+0000", 2024-09-12T22:33:10.102 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.4299999999999999e-07 2024-09-12T22:33:10.102 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.102 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.102 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:10.102 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.385469+0000", 2024-09-12T22:33:10.102 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7970000000000001e-06 2024-09-12T22:33:10.102 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.103 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.103 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:10.103 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.385476+0000", 2024-09-12T22:33:10.103 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6479999999999997e-06 2024-09-12T22:33:10.103 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.103 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.103 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:10.103 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.385483+0000", 2024-09-12T22:33:10.103 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9380000000000003e-06 2024-09-12T22:33:10.103 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.103 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.103 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:10.103 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.415728+0000", 2024-09-12T22:33:10.103 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.030244854000000002 2024-09-12T22:33:10.104 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.104 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.104 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:10.104 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.415776+0000", 2024-09-12T22:33:10.104 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8529999999999998e-05 2024-09-12T22:33:10.104 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.104 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.104 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:10.104 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.420783+0000", 2024-09-12T22:33:10.105 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0050064159999999996 2024-09-12T22:33:10.105 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.105 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.105 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:10.105 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.420831+0000", 2024-09-12T22:33:10.105 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8547999999999997e-05 2024-09-12T22:33:10.105 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.105 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.105 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:10.105 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.420897+0000", 2024-09-12T22:33:10.105 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6136000000000005e-05 2024-09-12T22:33:10.105 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:10.105 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:10.106 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:10.106 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.106 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.106 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4490.0:9785 4.d 4:b164db11:::10000002cf0.00000000:head [write 0~2414] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:33:10.106 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:09.388578+0000", 2024-09-12T22:33:10.106 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.66569433300000003, 2024-09-12T22:33:10.106 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.032448960999999998, 2024-09-12T22:33:10.106 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:10.106 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:10.106 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:10.106 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:10.106 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4490", 2024-09-12T22:33:10.106 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:10.106 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 9785 2024-09-12T22:33:10.107 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.107 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:10.107 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.107 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:10.107 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.388578+0000", 2024-09-12T22:33:10.107 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:10.107 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.107 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.107 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:10.107 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.388578+0000", 2024-09-12T22:33:10.107 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:10.107 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.107 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.108 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:10.108 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.388578+0000", 2024-09-12T22:33:10.108 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6100000000000001e-07 2024-09-12T22:33:10.108 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.108 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.108 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:10.108 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.388581+0000", 2024-09-12T22:33:10.108 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0189999999999998e-06 2024-09-12T22:33:10.108 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.108 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.108 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:10.108 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.388587+0000", 2024-09-12T22:33:10.108 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.0950000000000001e-06 2024-09-12T22:33:10.108 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.109 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.109 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:10.109 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.388591+0000", 2024-09-12T22:33:10.109 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.585e-06 2024-09-12T22:33:10.109 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.109 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.109 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:10.109 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.415725+0000", 2024-09-12T22:33:10.109 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.027133628999999999 2024-09-12T22:33:10.109 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.109 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.109 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:10.109 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.415795+0000", 2024-09-12T22:33:10.109 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0881000000000001e-05 2024-09-12T22:33:10.110 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.110 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.110 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:10.110 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.420907+0000", 2024-09-12T22:33:10.110 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0051113319999999997 2024-09-12T22:33:10.110 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.110 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.110 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:10.110 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.420950+0000", 2024-09-12T22:33:10.110 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3186999999999998e-05 2024-09-12T22:33:10.110 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.110 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.110 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:10.111 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.421027+0000", 2024-09-12T22:33:10.111 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6772000000000003e-05 2024-09-12T22:33:10.111 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:10.111 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:10.111 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:10.111 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.111 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.111 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:215 3.1d 3:bf8dcf43:::200.00000008:head [write 3205988~20541 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-09-12T22:33:10.111 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:09.391911+0000", 2024-09-12T22:33:10.111 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.66236130500000001, 2024-09-12T22:33:10.111 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.029387653, 2024-09-12T22:33:10.111 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:10.111 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:10.111 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:10.111 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:10.112 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.112 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:10.112 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.391911+0000", 2024-09-12T22:33:10.112 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:10.112 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.112 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.112 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:10.112 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.391911+0000", 2024-09-12T22:33:10.112 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:10.112 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.112 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.112 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:10.112 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.391912+0000", 2024-09-12T22:33:10.113 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.8199999999999999e-07 2024-09-12T22:33:10.113 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.113 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.113 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:10.113 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.391932+0000", 2024-09-12T22:33:10.113 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0825000000000001e-05 2024-09-12T22:33:10.113 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.113 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.113 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:10.113 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.391939+0000", 2024-09-12T22:33:10.113 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.973e-06 2024-09-12T22:33:10.113 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.113 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.113 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:10.114 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.391944+0000", 2024-09-12T22:33:10.114 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8720000000000001e-06 2024-09-12T22:33:10.114 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.114 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.114 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:10.114 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.416053+0000", 2024-09-12T22:33:10.114 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.024109142 2024-09-12T22:33:10.114 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.114 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.114 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:10.115 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.416100+0000", 2024-09-12T22:33:10.115 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6919999999999998e-05 2024-09-12T22:33:10.115 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.115 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.115 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:10.115 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.421230+0000", 2024-09-12T22:33:10.115 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0051295330000000004 2024-09-12T22:33:10.115 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.115 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.115 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:10.115 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.421260+0000", 2024-09-12T22:33:10.115 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0185999999999999e-05 2024-09-12T22:33:10.115 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.115 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.116 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:10.116 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.421299+0000", 2024-09-12T22:33:10.116 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8420000000000001e-05 2024-09-12T22:33:10.116 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:10.116 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:10.116 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:10.116 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.116 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.116 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:216 3.1d 3:bf8dcf43:::200.00000008:head [write 3226529~4299 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-09-12T22:33:10.116 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:09.392021+0000", 2024-09-12T22:33:10.117 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.66225110899999995, 2024-09-12T22:33:10.117 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.029341658, 2024-09-12T22:33:10.117 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:10.117 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:10.117 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:10.117 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:10.117 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.117 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:10.117 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.392021+0000", 2024-09-12T22:33:10.117 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:10.117 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.117 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.118 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:10.118 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.392021+0000", 2024-09-12T22:33:10.118 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:10.118 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.118 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.118 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:10.118 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.392022+0000", 2024-09-12T22:33:10.118 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0500000000000004e-07 2024-09-12T22:33:10.118 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.118 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.118 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:10.118 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.392026+0000", 2024-09-12T22:33:10.118 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4859999999999999e-06 2024-09-12T22:33:10.118 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.119 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.119 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:10.119 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.392031+0000", 2024-09-12T22:33:10.119 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2240000000000003e-06 2024-09-12T22:33:10.119 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.119 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.119 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:10.119 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.392036+0000", 2024-09-12T22:33:10.119 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2340000000000002e-06 2024-09-12T22:33:10.120 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.120 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.120 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:10.120 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.416565+0000", 2024-09-12T22:33:10.120 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.024528986999999999 2024-09-12T22:33:10.120 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.120 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.120 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:10.120 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.416613+0000", 2024-09-12T22:33:10.120 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.7129999999999998e-05 2024-09-12T22:33:10.120 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.120 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.120 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:10.120 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.421304+0000", 2024-09-12T22:33:10.121 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0046909589999999998 2024-09-12T22:33:10.121 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.121 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.121 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:10.121 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.421328+0000", 2024-09-12T22:33:10.121 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.4655e-05 2024-09-12T22:33:10.121 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.121 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.121 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:10.121 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.421363+0000", 2024-09-12T22:33:10.121 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4477999999999998e-05 2024-09-12T22:33:10.121 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:10.121 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:10.121 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:10.122 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.122 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.122 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4490.0:9871 4.35 4:ad66404a:::10000002d4d.00000000:head [write 0~6507] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:33:10.122 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:09.472309+0000", 2024-09-12T22:33:10.122 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.581962906, 2024-09-12T22:33:10.122 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.080251445000000005, 2024-09-12T22:33:10.122 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:10.122 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:10.122 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:10.122 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:10.122 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4490", 2024-09-12T22:33:10.122 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:10.122 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 9871 2024-09-12T22:33:10.122 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.123 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:10.123 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.123 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:10.123 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.472309+0000", 2024-09-12T22:33:10.123 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:10.123 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.123 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.123 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:10.123 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.472309+0000", 2024-09-12T22:33:10.123 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:10.123 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.123 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.123 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:10.123 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.472310+0000", 2024-09-12T22:33:10.124 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3799999999999996e-07 2024-09-12T22:33:10.124 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.124 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.124 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:10.124 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.472318+0000", 2024-09-12T22:33:10.124 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.8099999999999998e-06 2024-09-12T22:33:10.124 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.124 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.124 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:10.124 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.472328+0000", 2024-09-12T22:33:10.124 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0359e-05 2024-09-12T22:33:10.124 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.125 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.125 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:10.125 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.472334+0000", 2024-09-12T22:33:10.125 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.0109999999999997e-06 2024-09-12T22:33:10.125 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.125 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.125 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:10.125 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.472382+0000", 2024-09-12T22:33:10.125 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.7311000000000002e-05 2024-09-12T22:33:10.125 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.125 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.125 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:10.125 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.472497+0000", 2024-09-12T22:33:10.125 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011537800000000001 2024-09-12T22:33:10.126 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.126 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.126 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:10.126 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.472617+0000", 2024-09-12T22:33:10.126 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011989600000000001 2024-09-12T22:33:10.126 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.126 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.126 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:10.126 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473149+0000", 2024-09-12T22:33:10.126 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00053227999999999999 2024-09-12T22:33:10.126 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.126 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.127 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:10.127 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.552479+0000", 2024-09-12T22:33:10.127 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.079329541000000003 2024-09-12T22:33:10.127 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.127 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.127 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:10.127 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.552525+0000", 2024-09-12T22:33:10.127 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6421000000000002e-05 2024-09-12T22:33:10.127 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.127 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.127 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:10.128 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.552561+0000", 2024-09-12T22:33:10.128 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5599999999999998e-05 2024-09-12T22:33:10.128 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:10.128 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:10.128 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:10.128 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.128 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.128 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4490.0:9872 4.2c 4:3602c8d3:::10000002d4e.00000000:head [write 0~1178] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:33:10.128 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:09.473085+0000", 2024-09-12T22:33:10.128 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.58118760199999997, 2024-09-12T22:33:10.129 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.079631104999999994, 2024-09-12T22:33:10.129 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:10.129 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:10.129 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:10.129 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:10.129 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4490", 2024-09-12T22:33:10.129 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:10.129 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 9872 2024-09-12T22:33:10.129 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.129 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:10.129 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.130 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:10.130 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473085+0000", 2024-09-12T22:33:10.130 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:10.130 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.130 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.130 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:10.130 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473085+0000", 2024-09-12T22:33:10.130 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:10.130 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.130 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.130 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:10.130 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473085+0000", 2024-09-12T22:33:10.131 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3600000000000004e-07 2024-09-12T22:33:10.131 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.131 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.131 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:10.131 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473088+0000", 2024-09-12T22:33:10.131 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.005e-06 2024-09-12T22:33:10.131 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.131 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.131 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:10.132 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473095+0000", 2024-09-12T22:33:10.132 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3950000000000003e-06 2024-09-12T22:33:10.132 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.132 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.132 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:10.132 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473100+0000", 2024-09-12T22:33:10.132 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5460000000000002e-06 2024-09-12T22:33:10.132 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.132 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.133 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:10.133 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473138+0000", 2024-09-12T22:33:10.133 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8244999999999997e-05 2024-09-12T22:33:10.133 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.133 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.133 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:10.133 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473216+0000", 2024-09-12T22:33:10.133 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.7756000000000006e-05 2024-09-12T22:33:10.133 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.133 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.133 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:10.133 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473291+0000", 2024-09-12T22:33:10.133 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5110000000000004e-05 2024-09-12T22:33:10.134 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.134 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.134 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:10.134 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473736+0000", 2024-09-12T22:33:10.134 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00044486500000000002 2024-09-12T22:33:10.134 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.134 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.134 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:10.134 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.552637+0000", 2024-09-12T22:33:10.134 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.078900782000000003 2024-09-12T22:33:10.134 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.134 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.134 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:10.134 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.552680+0000", 2024-09-12T22:33:10.135 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3047999999999998e-05 2024-09-12T22:33:10.135 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.135 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.135 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:10.135 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.552716+0000", 2024-09-12T22:33:10.135 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5816999999999999e-05 2024-09-12T22:33:10.135 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:10.135 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:10.135 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:10.135 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.135 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.135 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4490.0:9873 4.2c 4:372c52ff:::10000002d4f.00000000:head [write 0~1230] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:33:10.135 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:09.473878+0000", 2024-09-12T22:33:10.136 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.58039413900000003, 2024-09-12T22:33:10.136 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.079036047999999998, 2024-09-12T22:33:10.136 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:10.136 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:10.136 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:10.136 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:10.136 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4490", 2024-09-12T22:33:10.136 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:10.136 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 9873 2024-09-12T22:33:10.136 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.136 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:10.136 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.136 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:10.136 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473878+0000", 2024-09-12T22:33:10.137 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:10.137 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.137 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.137 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:10.137 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473878+0000", 2024-09-12T22:33:10.137 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:10.137 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.137 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.137 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:10.137 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473879+0000", 2024-09-12T22:33:10.137 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9100000000000004e-07 2024-09-12T22:33:10.137 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.137 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.137 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:10.138 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473882+0000", 2024-09-12T22:33:10.138 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.405e-06 2024-09-12T22:33:10.138 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.138 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.138 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:10.138 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473889+0000", 2024-09-12T22:33:10.138 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7519999999999999e-06 2024-09-12T22:33:10.138 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.138 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.138 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:10.138 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473893+0000", 2024-09-12T22:33:10.138 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9310000000000001e-06 2024-09-12T22:33:10.138 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.138 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.138 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:10.139 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473922+0000", 2024-09-12T22:33:10.139 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9346999999999999e-05 2024-09-12T22:33:10.139 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.139 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.139 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:10.139 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474000+0000", 2024-09-12T22:33:10.139 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.7972000000000005e-05 2024-09-12T22:33:10.139 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.139 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.139 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:10.139 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474072+0000", 2024-09-12T22:33:10.139 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1960999999999998e-05 2024-09-12T22:33:10.139 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.139 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.140 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:10.140 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474470+0000", 2024-09-12T22:33:10.140 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00039803400000000002 2024-09-12T22:33:10.140 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.140 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.140 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:10.140 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.552814+0000", 2024-09-12T22:33:10.140 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.078344164999999993 2024-09-12T22:33:10.140 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.140 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.140 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:10.140 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.552875+0000", 2024-09-12T22:33:10.140 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1008999999999998e-05 2024-09-12T22:33:10.140 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.141 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.141 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:10.141 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.552914+0000", 2024-09-12T22:33:10.141 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8881000000000003e-05 2024-09-12T22:33:10.141 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:10.141 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:10.141 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:10.141 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.141 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.141 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4490.0:9874 4.1b 4:db19d96a:::10000002d50.00000000:head [write 0~1088] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:33:10.141 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:09.474673+0000", 2024-09-12T22:33:10.141 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.57959914599999995, 2024-09-12T22:33:10.141 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.080314317999999996, 2024-09-12T22:33:10.142 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:10.142 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:10.142 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:10.142 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:10.142 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4490", 2024-09-12T22:33:10.142 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:10.142 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 9874 2024-09-12T22:33:10.142 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.142 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:10.142 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.142 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:10.142 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474673+0000", 2024-09-12T22:33:10.142 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:10.142 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.143 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.143 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:10.143 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474673+0000", 2024-09-12T22:33:10.143 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:10.143 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.143 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.143 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:10.143 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474674+0000", 2024-09-12T22:33:10.143 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6199999999999998e-07 2024-09-12T22:33:10.143 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.143 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.143 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:10.143 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474677+0000", 2024-09-12T22:33:10.143 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.224e-06 2024-09-12T22:33:10.144 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.144 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.144 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:10.144 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474683+0000", 2024-09-12T22:33:10.144 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.3160000000000002e-06 2024-09-12T22:33:10.144 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.144 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.144 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:10.144 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474687+0000", 2024-09-12T22:33:10.144 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7869999999999999e-06 2024-09-12T22:33:10.144 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.144 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.144 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:10.145 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474730+0000", 2024-09-12T22:33:10.145 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3309000000000002e-05 2024-09-12T22:33:10.145 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.145 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.145 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:10.145 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474845+0000", 2024-09-12T22:33:10.145 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114306 2024-09-12T22:33:10.145 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.145 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.145 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:10.145 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474970+0000", 2024-09-12T22:33:10.145 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000125096 2024-09-12T22:33:10.145 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.145 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.146 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:10.146 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.475621+0000", 2024-09-12T22:33:10.146 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00065124900000000001 2024-09-12T22:33:10.146 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.146 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.146 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:10.146 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.554885+0000", 2024-09-12T22:33:10.146 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.079264055 2024-09-12T22:33:10.146 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.146 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.146 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:10.146 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.554942+0000", 2024-09-12T22:33:10.146 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7284000000000002e-05 2024-09-12T22:33:10.147 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.147 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.147 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:10.147 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.554987+0000", 2024-09-12T22:33:10.147 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5130000000000003e-05 2024-09-12T22:33:10.147 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:10.147 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:10.147 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:10.147 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.147 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.147 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4490.0:9890 4.1a 4:5b0facce:::10000002d60.00000000:head [write 0~3380] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:33:10.147 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:09.487873+0000", 2024-09-12T22:33:10.147 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.56639899599999999, 2024-09-12T22:33:10.147 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.067101901000000005, 2024-09-12T22:33:10.148 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:10.148 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:10.148 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:10.148 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:10.148 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4490", 2024-09-12T22:33:10.148 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:10.148 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 9890 2024-09-12T22:33:10.148 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.148 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:10.148 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.148 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:10.148 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.487873+0000", 2024-09-12T22:33:10.148 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:10.149 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.149 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.149 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:10.149 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.487873+0000", 2024-09-12T22:33:10.149 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:10.149 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.149 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.149 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:10.149 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.487874+0000", 2024-09-12T22:33:10.149 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5499999999999997e-07 2024-09-12T22:33:10.149 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.149 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.149 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:10.149 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.487878+0000", 2024-09-12T22:33:10.150 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5229999999999997e-06 2024-09-12T22:33:10.150 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.150 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.150 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:10.150 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.487888+0000", 2024-09-12T22:33:10.150 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.4739999999999994e-06 2024-09-12T22:33:10.150 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.150 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.150 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:10.150 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.487893+0000", 2024-09-12T22:33:10.150 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5049999999999998e-06 2024-09-12T22:33:10.150 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.150 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.150 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:10.151 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.487935+0000", 2024-09-12T22:33:10.151 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1508999999999998e-05 2024-09-12T22:33:10.151 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.151 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.151 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:10.151 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.488018+0000", 2024-09-12T22:33:10.151 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.2593e-05 2024-09-12T22:33:10.151 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.151 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.151 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:10.151 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.488089+0000", 2024-09-12T22:33:10.151 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1261999999999996e-05 2024-09-12T22:33:10.151 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.152 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.152 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:10.152 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.488576+0000", 2024-09-12T22:33:10.152 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00048686200000000002 2024-09-12T22:33:10.152 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.152 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.152 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:10.152 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.554908+0000", 2024-09-12T22:33:10.152 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.066331958999999996 2024-09-12T22:33:10.152 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.152 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.152 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:10.152 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.554937+0000", 2024-09-12T22:33:10.153 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9162999999999998e-05 2024-09-12T22:33:10.153 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.153 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.153 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:10.153 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.554975+0000", 2024-09-12T22:33:10.153 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8296000000000001e-05 2024-09-12T22:33:10.153 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:10.153 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:10.153 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:10.153 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.154 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.154 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4490.0:9902 4.1a 4:5b620645:::10000002d6c.00000000:head [write 0~1540] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:33:10.154 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:09.498667+0000", 2024-09-12T22:33:10.154 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.55560523399999995, 2024-09-12T22:33:10.154 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.056727697000000001, 2024-09-12T22:33:10.154 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:10.154 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:10.154 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:10.154 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:10.154 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4490", 2024-09-12T22:33:10.154 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:10.154 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 9902 2024-09-12T22:33:10.154 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.155 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:10.155 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.155 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:10.155 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.498667+0000", 2024-09-12T22:33:10.155 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:10.155 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.155 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.155 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:10.155 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.498667+0000", 2024-09-12T22:33:10.155 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:10.155 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.155 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.156 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:10.156 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.498668+0000", 2024-09-12T22:33:10.156 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6799999999999999e-07 2024-09-12T22:33:10.156 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.156 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.156 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:10.156 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.498673+0000", 2024-09-12T22:33:10.156 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9389999999999996e-06 2024-09-12T22:33:10.156 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.156 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.156 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:10.157 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.498682+0000", 2024-09-12T22:33:10.157 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.5810000000000003e-06 2024-09-12T22:33:10.157 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.157 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.157 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:10.157 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.498688+0000", 2024-09-12T22:33:10.157 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4750000000000001e-06 2024-09-12T22:33:10.157 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.157 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.157 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:10.157 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.498733+0000", 2024-09-12T22:33:10.157 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5182000000000002e-05 2024-09-12T22:33:10.157 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.158 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.158 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:10.158 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.498844+0000", 2024-09-12T22:33:10.158 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011139800000000001 2024-09-12T22:33:10.158 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.158 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.158 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:10.158 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.498978+0000", 2024-09-12T22:33:10.158 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013347399999999999 2024-09-12T22:33:10.158 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.158 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.159 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:10.159 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.499453+0000", 2024-09-12T22:33:10.159 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000474986 2024-09-12T22:33:10.159 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.159 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.159 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:10.159 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.555348+0000", 2024-09-12T22:33:10.159 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.055895011000000001 2024-09-12T22:33:10.159 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.159 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.159 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:10.159 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.555373+0000", 2024-09-12T22:33:10.159 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5023000000000001e-05 2024-09-12T22:33:10.160 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.160 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.160 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:10.160 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.555395+0000", 2024-09-12T22:33:10.160 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1860000000000001e-05 2024-09-12T22:33:10.160 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:10.160 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:10.160 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:10.160 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.160 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.160 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4490.0:9904 4.1b 4:d91b240f:::10000002d6e.00000000:head [write 0~1086] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:33:10.160 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:09.500507+0000", 2024-09-12T22:33:10.160 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.55376557299999996, 2024-09-12T22:33:10.160 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.055162873000000001, 2024-09-12T22:33:10.161 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:10.161 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:10.161 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:10.161 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:10.161 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4490", 2024-09-12T22:33:10.161 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:10.161 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 9904 2024-09-12T22:33:10.161 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.161 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:10.161 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.161 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:10.161 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.500507+0000", 2024-09-12T22:33:10.161 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:10.161 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.162 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.162 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:10.162 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.500507+0000", 2024-09-12T22:33:10.162 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:10.162 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.162 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.162 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:10.162 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.500508+0000", 2024-09-12T22:33:10.162 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.844e-06 2024-09-12T22:33:10.162 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.162 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.162 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:10.162 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.500518+0000", 2024-09-12T22:33:10.162 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.9899999999999992e-06 2024-09-12T22:33:10.163 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.163 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.163 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:10.163 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.500546+0000", 2024-09-12T22:33:10.163 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7288999999999999e-05 2024-09-12T22:33:10.163 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.163 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.163 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:10.163 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.500559+0000", 2024-09-12T22:33:10.163 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.3499999999999999e-05 2024-09-12T22:33:10.163 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.163 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.163 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:10.163 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.500682+0000", 2024-09-12T22:33:10.164 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000122562 2024-09-12T22:33:10.164 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.164 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.164 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:10.164 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.500761+0000", 2024-09-12T22:33:10.164 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9005000000000007e-05 2024-09-12T22:33:10.164 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.164 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.164 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:10.164 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.500836+0000", 2024-09-12T22:33:10.164 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5393000000000001e-05 2024-09-12T22:33:10.164 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.164 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.164 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:10.165 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.501269+0000", 2024-09-12T22:33:10.165 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000432349 2024-09-12T22:33:10.165 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.165 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.165 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:10.165 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.555592+0000", 2024-09-12T22:33:10.165 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.054323313999999998 2024-09-12T22:33:10.165 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.165 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.165 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:10.165 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.555635+0000", 2024-09-12T22:33:10.165 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3170999999999997e-05 2024-09-12T22:33:10.165 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.165 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.166 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:10.166 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.555669+0000", 2024-09-12T22:33:10.166 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4455999999999997e-05 2024-09-12T22:33:10.166 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:10.166 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:10.166 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:10.166 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.166 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.166 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4490.0:9908 4.39 4:9cd81ca0:::10000002d72.00000000:head [write 0~2164] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:33:10.166 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:09.503732+0000", 2024-09-12T22:33:10.166 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.55054021399999997, 2024-09-12T22:33:10.166 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.051725401999999997, 2024-09-12T22:33:10.166 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:10.166 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:10.167 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:10.167 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:10.167 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4490", 2024-09-12T22:33:10.167 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:10.167 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 9908 2024-09-12T22:33:10.167 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.167 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:10.167 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.167 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:10.167 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.503732+0000", 2024-09-12T22:33:10.167 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:10.167 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.167 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.167 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:10.168 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.503732+0000", 2024-09-12T22:33:10.168 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:10.168 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.168 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.168 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:10.168 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.503733+0000", 2024-09-12T22:33:10.168 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4300000000000002e-07 2024-09-12T22:33:10.168 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.168 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.168 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:10.168 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.503737+0000", 2024-09-12T22:33:10.168 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6129999999999997e-06 2024-09-12T22:33:10.168 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.169 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.169 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:10.169 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.503746+0000", 2024-09-12T22:33:10.169 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.6260000000000001e-06 2024-09-12T22:33:10.169 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.169 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.169 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:10.169 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.503751+0000", 2024-09-12T22:33:10.169 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.293e-06 2024-09-12T22:33:10.169 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.169 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.169 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:10.169 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.503791+0000", 2024-09-12T22:33:10.169 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9484999999999999e-05 2024-09-12T22:33:10.170 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.170 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.170 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:10.170 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.503859+0000", 2024-09-12T22:33:10.170 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.8367000000000005e-05 2024-09-12T22:33:10.170 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.170 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.170 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:10.170 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.503929+0000", 2024-09-12T22:33:10.170 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0431000000000004e-05 2024-09-12T22:33:10.170 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.170 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.170 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:10.170 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.504396+0000", 2024-09-12T22:33:10.171 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00046626799999999999 2024-09-12T22:33:10.171 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.171 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.171 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:10.171 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.555379+0000", 2024-09-12T22:33:10.171 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.050983524000000002 2024-09-12T22:33:10.171 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.171 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.171 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:10.171 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.555423+0000", 2024-09-12T22:33:10.171 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3996999999999999e-05 2024-09-12T22:33:10.171 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.171 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.172 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:10.172 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.555457+0000", 2024-09-12T22:33:10.172 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4054999999999998e-05 2024-09-12T22:33:10.172 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:10.172 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:10.172 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:10.172 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.172 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.172 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4490.0:9911 4.3a 4:5f6b4c9e:::10000002d75.00000000:head [write 0~1107] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:33:10.172 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:09.506443+0000", 2024-09-12T22:33:10.172 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.54782899500000004, 2024-09-12T22:33:10.173 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.049042281, 2024-09-12T22:33:10.173 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:10.173 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:10.173 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:10.173 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:10.173 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4490", 2024-09-12T22:33:10.173 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:10.173 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 9911 2024-09-12T22:33:10.173 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.173 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:10.174 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.174 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:10.174 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.506443+0000", 2024-09-12T22:33:10.174 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:10.174 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.174 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.174 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:10.174 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.506443+0000", 2024-09-12T22:33:10.174 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:10.175 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.175 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.175 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:10.175 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.506445+0000", 2024-09-12T22:33:10.175 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.99e-06 2024-09-12T22:33:10.175 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.175 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.175 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:10.175 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.506456+0000", 2024-09-12T22:33:10.176 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0516000000000001e-05 2024-09-12T22:33:10.176 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.176 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.176 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:10.176 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.506483+0000", 2024-09-12T22:33:10.176 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7793e-05 2024-09-12T22:33:10.176 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.176 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.176 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:10.176 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.506497+0000", 2024-09-12T22:33:10.176 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.3963e-05 2024-09-12T22:33:10.177 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.177 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.177 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:10.177 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.506601+0000", 2024-09-12T22:33:10.177 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000103787 2024-09-12T22:33:10.177 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.177 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.177 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:10.177 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.506705+0000", 2024-09-12T22:33:10.177 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00010416000000000001 2024-09-12T22:33:10.177 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.178 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.178 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:10.178 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.506793+0000", 2024-09-12T22:33:10.178 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8022999999999994e-05 2024-09-12T22:33:10.178 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.178 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.178 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:10.178 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.507806+0000", 2024-09-12T22:33:10.178 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001012191 2024-09-12T22:33:10.178 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.178 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.178 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:10.179 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.555403+0000", 2024-09-12T22:33:10.179 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.047597439999999998 2024-09-12T22:33:10.179 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.179 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.179 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:10.179 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.555448+0000", 2024-09-12T22:33:10.179 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5408999999999998e-05 2024-09-12T22:33:10.179 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:10.179 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:10.179 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:10.180 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.555485+0000", 2024-09-12T22:33:10.180 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7008999999999998e-05 2024-09-12T22:33:10.180 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:10.180 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:10.180 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:10.180 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:10.180 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:10.180 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-09-12T22:33:10.182 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:33:10.183 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:10.179+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:10.234 INFO:tasks.workunit.client.0.smithi019.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-09-12T22:33:10.237 INFO:tasks.workunit.client.0.smithi019.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-12T22:33:10.237 INFO:tasks.workunit.client.0.smithi019.stderr:+ make 2024-09-12T22:33:10.283 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:10.281+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:10.285 INFO:tasks.workunit.client.0.smithi019.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-09-12T22:33:10.289 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:33:10.289 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:33:10.289 INFO:teuthology.orchestra.run.smithi148.stdout: "num_ops": 0 2024-09-12T22:33:10.289 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:33:10.298 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:33:10.383 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:10.382+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:10.400 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:33:10.400 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:33:10.401 INFO:teuthology.orchestra.run.smithi148.stdout: "complaint_time": 30, 2024-09-12T22:33:10.401 INFO:teuthology.orchestra.run.smithi148.stdout: "num_blocked_ops": 0 2024-09-12T22:33:10.401 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:33:10.409 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:33:10.432 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T22:33:10.485 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:10.483+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:10.515 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:33:10.515 INFO:teuthology.orchestra.run.smithi148.stdout: "size": 20, 2024-09-12T22:33:10.516 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 600, 2024-09-12T22:33:10.516 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [ 2024-09-12T22:33:10.516 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.516 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:98 3.1f 3:f83d65d8:::200.00000004:head [write 409563~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-09-12T22:33:10.516 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:04.385076+0000", 2024-09-12T22:33:10.516 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 6.1282247090000004, 2024-09-12T22:33:10.516 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.022769053000000001, 2024-09-12T22:33:10.516 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:10.516 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:10.516 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:10.516 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:10.516 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.517 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:10.517 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385076+0000", 2024-09-12T22:33:10.517 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:10.517 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.517 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.517 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:10.517 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385076+0000", 2024-09-12T22:33:10.517 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:10.517 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.517 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.517 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:10.518 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385076+0000", 2024-09-12T22:33:10.518 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8799999999999998e-07 2024-09-12T22:33:10.518 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.518 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.518 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:10.518 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385082+0000", 2024-09-12T22:33:10.518 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0950000000000003e-06 2024-09-12T22:33:10.518 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.518 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.518 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:10.518 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385087+0000", 2024-09-12T22:33:10.518 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.463e-06 2024-09-12T22:33:10.518 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.519 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.519 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:10.519 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385090+0000", 2024-09-12T22:33:10.519 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4359999999999998e-06 2024-09-12T22:33:10.519 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.519 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.519 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:10.519 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.400713+0000", 2024-09-12T22:33:10.519 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.015622416 2024-09-12T22:33:10.519 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.519 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.519 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:10.519 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.400785+0000", 2024-09-12T22:33:10.520 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1761000000000006e-05 2024-09-12T22:33:10.520 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.520 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.520 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:10.520 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.400904+0000", 2024-09-12T22:33:10.520 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000119422 2024-09-12T22:33:10.520 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.520 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.520 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:10.520 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.403113+0000", 2024-09-12T22:33:10.520 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0022093899999999999 2024-09-12T22:33:10.521 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.521 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.521 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:10.521 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.407757+0000", 2024-09-12T22:33:10.521 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0046435119999999998 2024-09-12T22:33:10.521 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.521 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.521 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:10.521 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.407802+0000", 2024-09-12T22:33:10.522 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5479000000000003e-05 2024-09-12T22:33:10.522 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.522 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.522 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:10.522 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.407845+0000", 2024-09-12T22:33:10.522 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2790999999999997e-05 2024-09-12T22:33:10.522 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:10.522 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:10.522 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:10.522 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.522 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.522 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:99 3.1f 3:f83d65d8:::200.00000004:head [write 410964~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-09-12T22:33:10.523 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:04.385097+0000", 2024-09-12T22:33:10.523 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 6.1282034479999998, 2024-09-12T22:33:10.523 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.02283048, 2024-09-12T22:33:10.523 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:10.523 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:10.523 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:10.523 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:10.523 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.523 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:10.523 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385097+0000", 2024-09-12T22:33:10.523 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:10.523 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.523 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.523 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:10.524 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385097+0000", 2024-09-12T22:33:10.524 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:10.524 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.524 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.524 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:10.524 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385098+0000", 2024-09-12T22:33:10.524 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5699999999999999e-07 2024-09-12T22:33:10.524 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.524 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.524 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:10.524 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385100+0000", 2024-09-12T22:33:10.524 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9139999999999998e-06 2024-09-12T22:33:10.524 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.525 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.525 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:10.525 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385104+0000", 2024-09-12T22:33:10.525 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1910000000000002e-06 2024-09-12T22:33:10.525 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.525 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.525 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:10.525 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385107+0000", 2024-09-12T22:33:10.525 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.7939999999999998e-06 2024-09-12T22:33:10.526 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.526 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.526 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:10.526 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.401260+0000", 2024-09-12T22:33:10.526 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016153700999999999 2024-09-12T22:33:10.526 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.526 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.526 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:10.526 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.401337+0000", 2024-09-12T22:33:10.526 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.6470000000000005e-05 2024-09-12T22:33:10.526 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.526 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.526 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:10.527 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.401462+0000", 2024-09-12T22:33:10.527 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000125666 2024-09-12T22:33:10.527 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.527 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.527 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:10.527 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.404304+0000", 2024-09-12T22:33:10.527 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0028414809999999999 2024-09-12T22:33:10.527 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.527 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.527 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:10.527 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.407853+0000", 2024-09-12T22:33:10.528 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0035488310000000001 2024-09-12T22:33:10.528 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.528 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.528 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:10.528 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.407894+0000", 2024-09-12T22:33:10.528 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1455000000000002e-05 2024-09-12T22:33:10.528 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.528 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.528 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:10.528 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.407928+0000", 2024-09-12T22:33:10.528 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3720000000000002e-05 2024-09-12T22:33:10.528 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:10.528 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:10.529 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:10.529 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.529 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.529 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:100 3.1f 3:f83d65d8:::200.00000004:head [write 412367~1404 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-09-12T22:33:10.529 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:04.385111+0000", 2024-09-12T22:33:10.529 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 6.1281898400000001, 2024-09-12T22:33:10.529 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.022896741000000002, 2024-09-12T22:33:10.529 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:10.529 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:10.529 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:10.529 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:10.529 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.529 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:10.530 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385111+0000", 2024-09-12T22:33:10.530 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:10.530 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.530 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.530 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:10.530 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385111+0000", 2024-09-12T22:33:10.530 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:10.530 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.530 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.530 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:10.531 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385111+0000", 2024-09-12T22:33:10.531 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.22e-07 2024-09-12T22:33:10.531 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.531 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.531 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:10.531 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385113+0000", 2024-09-12T22:33:10.531 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7069999999999999e-06 2024-09-12T22:33:10.531 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.531 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.531 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:10.531 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385119+0000", 2024-09-12T22:33:10.531 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2090000000000002e-06 2024-09-12T22:33:10.532 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.532 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.532 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:10.532 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385122+0000", 2024-09-12T22:33:10.532 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.033e-06 2024-09-12T22:33:10.532 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.532 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.532 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:10.532 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.401990+0000", 2024-09-12T22:33:10.532 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016867534 2024-09-12T22:33:10.532 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.532 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.532 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:10.533 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.402057+0000", 2024-09-12T22:33:10.533 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7118000000000004e-05 2024-09-12T22:33:10.533 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.533 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.533 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:10.533 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.402161+0000", 2024-09-12T22:33:10.533 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000103905 2024-09-12T22:33:10.533 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.533 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.533 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:10.533 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.404360+0000", 2024-09-12T22:33:10.533 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0021992940000000001 2024-09-12T22:33:10.533 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.534 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.534 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:10.534 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.407935+0000", 2024-09-12T22:33:10.534 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0035751630000000001 2024-09-12T22:33:10.534 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.534 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.534 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:10.534 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.407976+0000", 2024-09-12T22:33:10.534 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0376000000000001e-05 2024-09-12T22:33:10.534 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.534 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.534 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:10.534 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.408008+0000", 2024-09-12T22:33:10.534 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.218e-05 2024-09-12T22:33:10.535 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:10.535 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:10.535 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:10.535 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.535 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.535 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:101 3.1f 3:f83d65d8:::200.00000004:head [write 413771~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-09-12T22:33:10.535 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:04.385126+0000", 2024-09-12T22:33:10.535 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 6.1281748389999997, 2024-09-12T22:33:10.535 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.022964140000000001, 2024-09-12T22:33:10.535 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:10.535 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:10.535 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:10.535 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:10.536 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.536 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:10.536 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385126+0000", 2024-09-12T22:33:10.536 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:10.536 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.536 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.536 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:10.536 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385126+0000", 2024-09-12T22:33:10.536 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:10.536 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.536 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.536 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:10.536 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385126+0000", 2024-09-12T22:33:10.536 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.29e-07 2024-09-12T22:33:10.537 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.537 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.537 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:10.537 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385139+0000", 2024-09-12T22:33:10.537 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2877000000000001e-05 2024-09-12T22:33:10.537 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.537 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.537 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:10.537 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385144+0000", 2024-09-12T22:33:10.537 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9840000000000001e-06 2024-09-12T22:33:10.537 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.537 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.537 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:10.538 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385147+0000", 2024-09-12T22:33:10.538 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0750000000000002e-06 2024-09-12T22:33:10.538 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.538 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.538 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:10.538 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.402511+0000", 2024-09-12T22:33:10.538 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017363456999999999 2024-09-12T22:33:10.538 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.538 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.538 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:10.538 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.402587+0000", 2024-09-12T22:33:10.538 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.6128e-05 2024-09-12T22:33:10.538 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.538 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.539 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:10.539 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.402706+0000", 2024-09-12T22:33:10.539 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000119157 2024-09-12T22:33:10.539 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.539 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.539 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:10.539 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.404414+0000", 2024-09-12T22:33:10.539 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00170773 2024-09-12T22:33:10.539 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.539 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.539 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:10.539 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.408015+0000", 2024-09-12T22:33:10.539 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003601389 2024-09-12T22:33:10.539 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.540 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.540 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:10.540 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.408057+0000", 2024-09-12T22:33:10.540 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1548999999999998e-05 2024-09-12T22:33:10.540 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.540 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.540 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:10.540 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.408090+0000", 2024-09-12T22:33:10.540 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3565000000000001e-05 2024-09-12T22:33:10.540 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:10.540 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:10.540 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:10.540 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.541 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.541 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:102 3.1f 3:f83d65d8:::200.00000004:head [write 415176~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-09-12T22:33:10.541 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:04.385152+0000", 2024-09-12T22:33:10.541 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 6.128148521, 2024-09-12T22:33:10.541 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.023015768999999998, 2024-09-12T22:33:10.541 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:10.541 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:10.541 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:10.541 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:10.541 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.541 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:10.541 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385152+0000", 2024-09-12T22:33:10.541 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:10.542 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.542 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.542 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:10.542 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385152+0000", 2024-09-12T22:33:10.542 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:10.542 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.542 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.542 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:10.542 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385155+0000", 2024-09-12T22:33:10.542 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4200000000000001e-06 2024-09-12T22:33:10.543 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.543 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.543 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:10.543 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385157+0000", 2024-09-12T22:33:10.543 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.8640000000000001e-06 2024-09-12T22:33:10.543 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.543 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.543 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:10.543 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385161+0000", 2024-09-12T22:33:10.543 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1590000000000003e-06 2024-09-12T22:33:10.543 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.543 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.543 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:10.544 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385164+0000", 2024-09-12T22:33:10.544 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8150000000000002e-06 2024-09-12T22:33:10.544 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.544 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.544 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:10.544 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.403160+0000", 2024-09-12T22:33:10.544 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017996174 2024-09-12T22:33:10.544 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.544 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.544 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:10.544 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.403229+0000", 2024-09-12T22:33:10.544 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.9301999999999995e-05 2024-09-12T22:33:10.545 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.545 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.545 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:10.545 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.403341+0000", 2024-09-12T22:33:10.545 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000112002 2024-09-12T22:33:10.545 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.545 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.545 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:10.545 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.405776+0000", 2024-09-12T22:33:10.545 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0024350079999999998 2024-09-12T22:33:10.545 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.545 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.545 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:10.545 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.408097+0000", 2024-09-12T22:33:10.546 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.002321086 2024-09-12T22:33:10.546 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.546 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.546 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:10.546 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.408137+0000", 2024-09-12T22:33:10.546 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9743999999999998e-05 2024-09-12T22:33:10.546 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.546 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.546 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:10.546 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.408168+0000", 2024-09-12T22:33:10.546 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.1195000000000002e-05 2024-09-12T22:33:10.546 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:10.547 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:10.547 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:10.547 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.547 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.547 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:103 3.1f 3:f83d65d8:::200.00000004:head [write 416575~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-09-12T22:33:10.547 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:04.385167+0000", 2024-09-12T22:33:10.547 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 6.1281339739999998, 2024-09-12T22:33:10.547 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.024972646000000001, 2024-09-12T22:33:10.547 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:10.547 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:10.547 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:10.547 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:10.547 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.548 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:10.548 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385167+0000", 2024-09-12T22:33:10.548 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:10.548 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.548 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.548 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:10.548 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385167+0000", 2024-09-12T22:33:10.548 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:10.548 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.548 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.548 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:10.548 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385167+0000", 2024-09-12T22:33:10.548 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.2100000000000001e-07 2024-09-12T22:33:10.549 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.549 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.549 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:10.549 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385176+0000", 2024-09-12T22:33:10.549 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.8249999999999994e-06 2024-09-12T22:33:10.549 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.549 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.549 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:10.549 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385182+0000", 2024-09-12T22:33:10.549 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0469999999999999e-06 2024-09-12T22:33:10.549 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.549 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.550 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:10.550 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385185+0000", 2024-09-12T22:33:10.550 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0570000000000001e-06 2024-09-12T22:33:10.550 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.550 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.550 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:10.550 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.403629+0000", 2024-09-12T22:33:10.550 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.018443838000000001 2024-09-12T22:33:10.550 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.550 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.550 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:10.551 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.403710+0000", 2024-09-12T22:33:10.551 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0851000000000002e-05 2024-09-12T22:33:10.551 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.551 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.551 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:10.551 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.403859+0000", 2024-09-12T22:33:10.551 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014873800000000001 2024-09-12T22:33:10.552 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.552 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.552 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:10.552 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.406967+0000", 2024-09-12T22:33:10.552 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0031080320000000002 2024-09-12T22:33:10.552 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.552 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.552 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:10.552 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410055+0000", 2024-09-12T22:33:10.552 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003088698 2024-09-12T22:33:10.552 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.552 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.552 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:10.553 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410104+0000", 2024-09-12T22:33:10.553 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8469e-05 2024-09-12T22:33:10.553 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.553 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.553 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:10.553 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410140+0000", 2024-09-12T22:33:10.553 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.587e-05 2024-09-12T22:33:10.553 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:10.553 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:10.553 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:10.553 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.553 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.554 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:104 3.1f 3:f83d65d8:::200.00000004:head [write 417974~1421 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-09-12T22:33:10.554 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:04.385189+0000", 2024-09-12T22:33:10.554 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 6.12811182, 2024-09-12T22:33:10.554 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.025034507000000001, 2024-09-12T22:33:10.554 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:10.554 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:10.554 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:10.554 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:10.554 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.554 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:10.554 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385189+0000", 2024-09-12T22:33:10.554 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:10.554 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.554 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.555 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:10.555 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385189+0000", 2024-09-12T22:33:10.555 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:10.555 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.555 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.555 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:10.555 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385189+0000", 2024-09-12T22:33:10.555 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5199999999999998e-07 2024-09-12T22:33:10.555 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.555 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.555 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:10.555 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385191+0000", 2024-09-12T22:33:10.555 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7489999999999999e-06 2024-09-12T22:33:10.556 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.556 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.556 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:10.556 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385194+0000", 2024-09-12T22:33:10.556 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.1039999999999998e-06 2024-09-12T22:33:10.556 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.556 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.556 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:10.556 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385197+0000", 2024-09-12T22:33:10.556 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.3740000000000001e-06 2024-09-12T22:33:10.556 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.556 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.556 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:10.557 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.404717+0000", 2024-09-12T22:33:10.557 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.019520056000000001 2024-09-12T22:33:10.557 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.557 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.557 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:10.557 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.404795+0000", 2024-09-12T22:33:10.557 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.818e-05 2024-09-12T22:33:10.557 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.557 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.557 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:10.557 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.404930+0000", 2024-09-12T22:33:10.557 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013531400000000001 2024-09-12T22:33:10.558 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.558 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.558 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:10.558 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.407028+0000", 2024-09-12T22:33:10.558 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0020980899999999999 2024-09-12T22:33:10.558 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.558 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.558 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:10.558 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410147+0000", 2024-09-12T22:33:10.558 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0031188710000000001 2024-09-12T22:33:10.558 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.558 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.559 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:10.559 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410190+0000", 2024-09-12T22:33:10.559 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2899999999999999e-05 2024-09-12T22:33:10.559 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.559 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.559 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:10.559 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410224+0000", 2024-09-12T22:33:10.559 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3617e-05 2024-09-12T22:33:10.559 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:10.559 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:10.559 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:10.559 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.559 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.560 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:105 3.1f 3:f83d65d8:::200.00000004:head [write 419395~1406 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-09-12T22:33:10.560 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:04.385200+0000", 2024-09-12T22:33:10.560 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 6.1281012649999997, 2024-09-12T22:33:10.560 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.025105683, 2024-09-12T22:33:10.560 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:10.560 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:10.560 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:10.560 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:10.560 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.560 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:10.560 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385200+0000", 2024-09-12T22:33:10.560 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:10.560 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.561 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.561 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:10.561 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385200+0000", 2024-09-12T22:33:10.561 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:10.561 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.561 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.561 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:10.561 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385200+0000", 2024-09-12T22:33:10.561 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.05e-07 2024-09-12T22:33:10.561 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.561 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.561 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:10.561 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385205+0000", 2024-09-12T22:33:10.562 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.6269999999999997e-06 2024-09-12T22:33:10.562 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.562 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.562 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:10.562 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385209+0000", 2024-09-12T22:33:10.562 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.439e-06 2024-09-12T22:33:10.562 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.562 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.562 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:10.562 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385211+0000", 2024-09-12T22:33:10.562 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5040000000000001e-06 2024-09-12T22:33:10.562 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.562 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.563 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:10.563 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.405286+0000", 2024-09-12T22:33:10.563 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.020074229999999998 2024-09-12T22:33:10.563 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.563 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.563 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:10.563 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.405359+0000", 2024-09-12T22:33:10.563 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3355000000000005e-05 2024-09-12T22:33:10.563 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.563 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.563 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:10.563 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.405471+0000", 2024-09-12T22:33:10.563 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000112175 2024-09-12T22:33:10.564 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.564 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.564 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:10.564 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.408223+0000", 2024-09-12T22:33:10.564 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0027517779999999999 2024-09-12T22:33:10.564 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.564 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.564 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:10.565 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410231+0000", 2024-09-12T22:33:10.565 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0020078190000000001 2024-09-12T22:33:10.565 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.565 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.565 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:10.565 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410273+0000", 2024-09-12T22:33:10.565 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2530000000000001e-05 2024-09-12T22:33:10.565 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.565 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.565 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:10.565 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410305+0000", 2024-09-12T22:33:10.565 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2020999999999997e-05 2024-09-12T22:33:10.565 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:10.566 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:10.566 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:10.566 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.566 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.566 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:106 3.1f 3:f83d65d8:::200.00000004:head [write 420801~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-09-12T22:33:10.566 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:04.385215+0000", 2024-09-12T22:33:10.566 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 6.128085939, 2024-09-12T22:33:10.566 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.025168234000000001, 2024-09-12T22:33:10.566 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:10.566 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:10.566 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:10.566 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:10.566 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.567 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:10.567 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385215+0000", 2024-09-12T22:33:10.567 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:10.567 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.567 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.567 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:10.567 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385215+0000", 2024-09-12T22:33:10.567 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:10.567 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.567 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.567 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:10.567 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385215+0000", 2024-09-12T22:33:10.567 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.2600000000000001e-07 2024-09-12T22:33:10.567 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.568 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.568 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:10.568 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385217+0000", 2024-09-12T22:33:10.568 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7099999999999999e-06 2024-09-12T22:33:10.568 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.568 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.568 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:10.568 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385220+0000", 2024-09-12T22:33:10.568 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.004e-06 2024-09-12T22:33:10.568 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.568 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.568 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:10.568 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385223+0000", 2024-09-12T22:33:10.569 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.633e-06 2024-09-12T22:33:10.569 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.569 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.569 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:10.569 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.405826+0000", 2024-09-12T22:33:10.569 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.020603831999999999 2024-09-12T22:33:10.569 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.569 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.569 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:10.569 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.405898+0000", 2024-09-12T22:33:10.569 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1398999999999999e-05 2024-09-12T22:33:10.569 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.569 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.570 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:10.570 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.406011+0000", 2024-09-12T22:33:10.570 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000113411 2024-09-12T22:33:10.570 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.570 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.570 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:10.570 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.408285+0000", 2024-09-12T22:33:10.570 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.002273639 2024-09-12T22:33:10.570 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.570 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.570 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:10.570 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410313+0000", 2024-09-12T22:33:10.571 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0020280760000000002 2024-09-12T22:33:10.571 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.571 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.571 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:10.571 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410350+0000", 2024-09-12T22:33:10.571 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7307e-05 2024-09-12T22:33:10.571 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.571 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.571 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:10.571 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410383+0000", 2024-09-12T22:33:10.571 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2997000000000003e-05 2024-09-12T22:33:10.571 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:10.572 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:10.572 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:10.572 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.572 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.572 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:107 3.1f 3:f83d65d8:::200.00000004:head [write 422206~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-09-12T22:33:10.572 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:04.385226+0000", 2024-09-12T22:33:10.573 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 6.1280752039999999, 2024-09-12T22:33:10.573 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.025350256000000002, 2024-09-12T22:33:10.573 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:10.573 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:10.573 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:10.573 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:10.573 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.573 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:10.573 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385226+0000", 2024-09-12T22:33:10.573 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:10.573 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.573 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.573 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:10.574 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385226+0000", 2024-09-12T22:33:10.574 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:10.574 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.574 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.574 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:10.574 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385226+0000", 2024-09-12T22:33:10.574 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.2399999999999999e-07 2024-09-12T22:33:10.574 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.574 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.574 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:10.574 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385228+0000", 2024-09-12T22:33:10.574 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.508e-06 2024-09-12T22:33:10.574 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.574 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.575 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:10.575 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385235+0000", 2024-09-12T22:33:10.575 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.3169999999999998e-06 2024-09-12T22:33:10.575 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.575 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.575 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:10.575 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385238+0000", 2024-09-12T22:33:10.575 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.9249999999999999e-06 2024-09-12T22:33:10.575 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.575 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.575 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:10.575 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.406376+0000", 2024-09-12T22:33:10.576 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.021138364999999999 2024-09-12T22:33:10.576 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.576 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.576 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:10.576 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.406451+0000", 2024-09-12T22:33:10.576 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4882000000000006e-05 2024-09-12T22:33:10.576 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.576 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.576 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:10.576 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.406590+0000", 2024-09-12T22:33:10.576 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000138627 2024-09-12T22:33:10.576 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.576 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.576 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:10.577 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410461+0000", 2024-09-12T22:33:10.577 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0038712109999999998 2024-09-12T22:33:10.577 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.577 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.577 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:10.577 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410493+0000", 2024-09-12T22:33:10.577 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2147999999999998e-05 2024-09-12T22:33:10.577 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.577 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.577 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:10.577 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410537+0000", 2024-09-12T22:33:10.577 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3792999999999999e-05 2024-09-12T22:33:10.577 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.578 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.578 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:10.578 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410576+0000", 2024-09-12T22:33:10.578 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9255999999999998e-05 2024-09-12T22:33:10.578 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:10.578 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:10.578 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:10.578 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.578 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.578 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4490.0:5682 4.3f 4:ff1ebe6d:::10000001a29.00000000:head [write 0~2106] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T22:33:10.578 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:04.386989+0000", 2024-09-12T22:33:10.578 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 6.1263122809999997, 2024-09-12T22:33:10.579 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.023595390000000001, 2024-09-12T22:33:10.579 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:10.579 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:10.579 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:10.579 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:33:10.579 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4490", 2024-09-12T22:33:10.579 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:10.579 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 5682 2024-09-12T22:33:10.579 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.579 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:10.579 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.579 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:10.579 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.386989+0000", 2024-09-12T22:33:10.580 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:10.580 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.580 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.580 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:10.580 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.386989+0000", 2024-09-12T22:33:10.580 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:10.580 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.580 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.580 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:10.582 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.386989+0000", 2024-09-12T22:33:10.582 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.8800000000000002e-07 2024-09-12T22:33:10.582 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.582 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.582 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:10.583 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.386994+0000", 2024-09-12T22:33:10.583 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4279999999999998e-06 2024-09-12T22:33:10.584 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.584 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.584 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:10.584 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.387001+0000", 2024-09-12T22:33:10.584 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.2320000000000004e-06 2024-09-12T22:33:10.584 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.584 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.585 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:10.585 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.387006+0000", 2024-09-12T22:33:10.585 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6589999999999998e-06 2024-09-12T22:33:10.585 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.585 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.585 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:10.585 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.407003+0000", 2024-09-12T22:33:10.585 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.019997635 2024-09-12T22:33:10.585 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.585 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.585 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:10.586 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.407134+0000", 2024-09-12T22:33:10.586 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013037899999999999 2024-09-12T22:33:10.586 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.586 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.586 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:10.586 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410469+0000", 2024-09-12T22:33:10.586 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0033353160000000001 2024-09-12T22:33:10.586 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.586 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.586 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:10.587 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410510+0000", 2024-09-12T22:33:10.587 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0553999999999998e-05 2024-09-12T22:33:10.587 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.587 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.587 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:10.587 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410584+0000", 2024-09-12T22:33:10.587 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4399000000000004e-05 2024-09-12T22:33:10.587 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:10.587 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:10.587 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:10.587 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.588 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.588 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:108 3.1f 3:f83d65d8:::200.00000004:head [write 423607~16211 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-09-12T22:33:10.588 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:04.392223+0000", 2024-09-12T22:33:10.588 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 6.1210782850000003, 2024-09-12T22:33:10.588 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.022025629000000001, 2024-09-12T22:33:10.588 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:10.588 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:10.588 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:10.588 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:10.588 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.589 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:10.589 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.392223+0000", 2024-09-12T22:33:10.589 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:10.589 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.589 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.589 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:10.589 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.392223+0000", 2024-09-12T22:33:10.589 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:10.589 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.589 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.590 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:10.590 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.392224+0000", 2024-09-12T22:33:10.590 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.358e-06 2024-09-12T22:33:10.590 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.590 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.590 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:10.590 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.392238+0000", 2024-09-12T22:33:10.590 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4408e-05 2024-09-12T22:33:10.590 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.590 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.590 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:10.591 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.392248+0000", 2024-09-12T22:33:10.591 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0013000000000001e-05 2024-09-12T22:33:10.591 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.591 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.591 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:10.591 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.392256+0000", 2024-09-12T22:33:10.591 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1060000000000002e-06 2024-09-12T22:33:10.591 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.592 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.592 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:10.592 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.407080+0000", 2024-09-12T22:33:10.592 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.014824519 2024-09-12T22:33:10.592 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.592 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.592 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:10.592 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.407152+0000", 2024-09-12T22:33:10.592 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1543000000000003e-05 2024-09-12T22:33:10.592 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.592 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.593 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:10.593 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.407270+0000", 2024-09-12T22:33:10.593 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000118721 2024-09-12T22:33:10.593 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.593 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.593 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:10.593 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410591+0000", 2024-09-12T22:33:10.593 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0033203080000000001 2024-09-12T22:33:10.593 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.594 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.594 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:10.594 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.414179+0000", 2024-09-12T22:33:10.594 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00358838 2024-09-12T22:33:10.594 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.594 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.594 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:10.594 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.414215+0000", 2024-09-12T22:33:10.594 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.5753999999999997e-05 2024-09-12T22:33:10.594 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.594 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.594 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:10.594 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.414248+0000", 2024-09-12T22:33:10.594 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3519000000000002e-05 2024-09-12T22:33:10.595 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:10.595 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:10.595 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:10.595 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.595 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.595 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:112 3.1f 3:f83d65d8:::200.00000004:head [write 449503~3460 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-09-12T22:33:10.595 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:04.393638+0000", 2024-09-12T22:33:10.595 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 6.1196624980000003, 2024-09-12T22:33:10.595 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.023344696000000002, 2024-09-12T22:33:10.595 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:10.595 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:10.595 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:10.595 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:10.596 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.596 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:10.596 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393638+0000", 2024-09-12T22:33:10.596 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:10.596 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.596 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.596 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:10.596 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393638+0000", 2024-09-12T22:33:10.596 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:10.596 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.596 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.596 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:10.596 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393639+0000", 2024-09-12T22:33:10.597 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.68e-07 2024-09-12T22:33:10.597 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.597 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.597 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:10.597 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393643+0000", 2024-09-12T22:33:10.597 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.98e-06 2024-09-12T22:33:10.597 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.597 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.597 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:10.597 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393650+0000", 2024-09-12T22:33:10.597 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.131e-06 2024-09-12T22:33:10.597 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.597 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.598 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:10.598 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393655+0000", 2024-09-12T22:33:10.598 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0270000000000003e-06 2024-09-12T22:33:10.598 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.598 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.598 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:10.598 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410618+0000", 2024-09-12T22:33:10.598 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016962600000000001 2024-09-12T22:33:10.598 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.598 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.598 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:10.598 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410679+0000", 2024-09-12T22:33:10.598 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.1014999999999998e-05 2024-09-12T22:33:10.599 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.599 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.599 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:10.599 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410763+0000", 2024-09-12T22:33:10.599 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.4586000000000006e-05 2024-09-12T22:33:10.599 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.599 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.599 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:10.599 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.412605+0000", 2024-09-12T22:33:10.599 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001842036 2024-09-12T22:33:10.599 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.599 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.599 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:10.600 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.416894+0000", 2024-09-12T22:33:10.600 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0042887649999999999 2024-09-12T22:33:10.600 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.600 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.600 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:10.600 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.416947+0000", 2024-09-12T22:33:10.600 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2500999999999998e-05 2024-09-12T22:33:10.600 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.600 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.600 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:10.600 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.416983+0000", 2024-09-12T22:33:10.600 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.6486999999999998e-05 2024-09-12T22:33:10.600 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:10.601 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:10.601 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:10.601 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.601 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.601 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:113 3.1f 3:f83d65d8:::200.00000004:head [write 452963~1919 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-09-12T22:33:10.601 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:04.393838+0000", 2024-09-12T22:33:10.601 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 6.1194630959999996, 2024-09-12T22:33:10.601 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.023234016999999999, 2024-09-12T22:33:10.601 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:10.601 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:10.601 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:10.601 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:10.601 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.602 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:10.602 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393838+0000", 2024-09-12T22:33:10.602 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:10.602 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.602 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.602 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:10.602 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393838+0000", 2024-09-12T22:33:10.602 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:10.602 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.602 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.602 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:10.603 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393839+0000", 2024-09-12T22:33:10.603 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.9299999999999997e-07 2024-09-12T22:33:10.603 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.603 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.603 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:10.603 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393842+0000", 2024-09-12T22:33:10.603 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7759999999999999e-06 2024-09-12T22:33:10.603 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.603 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.603 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:10.603 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393850+0000", 2024-09-12T22:33:10.603 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.6590000000000007e-06 2024-09-12T22:33:10.603 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.604 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.604 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:10.604 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393856+0000", 2024-09-12T22:33:10.604 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.1659999999999999e-06 2024-09-12T22:33:10.604 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.604 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.604 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:10.604 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.411099+0000", 2024-09-12T22:33:10.604 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017242785 2024-09-12T22:33:10.604 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.604 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.604 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:10.604 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.411172+0000", 2024-09-12T22:33:10.605 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.2552999999999995e-05 2024-09-12T22:33:10.605 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.605 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.605 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:10.605 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.411280+0000", 2024-09-12T22:33:10.605 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000108701 2024-09-12T22:33:10.605 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.605 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.605 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:10.605 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.413582+0000", 2024-09-12T22:33:10.605 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0023020290000000001 2024-09-12T22:33:10.605 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.605 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.605 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:10.606 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.417020+0000", 2024-09-12T22:33:10.606 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0034373860000000002 2024-09-12T22:33:10.606 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.606 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.606 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:10.606 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.417049+0000", 2024-09-12T22:33:10.606 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8986e-05 2024-09-12T22:33:10.606 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.606 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.606 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:10.606 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.417072+0000", 2024-09-12T22:33:10.606 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.3183000000000001e-05 2024-09-12T22:33:10.606 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:10.607 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:10.607 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:10.607 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.607 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.607 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4490.0:9866 4.b 4:d370243b:::10000002d48.00000000:head [write 0~1308] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:33:10.607 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:09.467883+0000", 2024-09-12T22:33:10.607 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 1.0454181199999999, 2024-09-12T22:33:10.607 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.085024817000000003, 2024-09-12T22:33:10.607 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:10.607 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:10.607 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:10.607 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:33:10.607 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4490", 2024-09-12T22:33:10.608 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:10.608 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 9866 2024-09-12T22:33:10.608 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.608 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:10.608 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.608 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:10.608 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.467883+0000", 2024-09-12T22:33:10.608 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:10.608 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.608 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.608 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:10.608 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.467883+0000", 2024-09-12T22:33:10.608 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:10.608 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.609 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.609 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:10.609 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.467884+0000", 2024-09-12T22:33:10.609 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1800000000000005e-07 2024-09-12T22:33:10.609 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.609 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.609 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:10.609 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.467888+0000", 2024-09-12T22:33:10.609 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5959999999999997e-06 2024-09-12T22:33:10.609 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.609 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.609 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:10.609 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.467896+0000", 2024-09-12T22:33:10.610 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.8679999999999999e-06 2024-09-12T22:33:10.610 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.610 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.610 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:10.610 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.467901+0000", 2024-09-12T22:33:10.610 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9169999999999997e-06 2024-09-12T22:33:10.610 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.610 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.610 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:10.610 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.467944+0000", 2024-09-12T22:33:10.610 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3055e-05 2024-09-12T22:33:10.610 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.610 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.610 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:10.611 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.468011+0000", 2024-09-12T22:33:10.611 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7328000000000003e-05 2024-09-12T22:33:10.611 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.611 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.611 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:10.611 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.468078+0000", 2024-09-12T22:33:10.611 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7063999999999994e-05 2024-09-12T22:33:10.611 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.611 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.611 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:10.611 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.551406+0000", 2024-09-12T22:33:10.611 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.083327485000000007 2024-09-12T22:33:10.611 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.611 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.612 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:10.612 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.552822+0000", 2024-09-12T22:33:10.612 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001415929 2024-09-12T22:33:10.612 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.612 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.612 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:10.612 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.552863+0000", 2024-09-12T22:33:10.612 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0809000000000002e-05 2024-09-12T22:33:10.612 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.612 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.612 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:10.612 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.552908+0000", 2024-09-12T22:33:10.612 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5048e-05 2024-09-12T22:33:10.613 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:10.613 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:10.613 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:10.613 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.613 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.613 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4490.0:9867 4.16 4:6bd8f1b8:::10000002d49.00000000:head [write 0~1599] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:33:10.613 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:09.468760+0000", 2024-09-12T22:33:10.613 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 1.044541111, 2024-09-12T22:33:10.613 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.086660499000000002, 2024-09-12T22:33:10.613 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:10.613 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:10.613 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:10.613 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:33:10.614 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4490", 2024-09-12T22:33:10.614 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:10.614 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 9867 2024-09-12T22:33:10.614 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.614 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:10.614 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.614 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:10.614 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.468760+0000", 2024-09-12T22:33:10.614 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:10.614 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.614 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.614 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:10.614 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.468760+0000", 2024-09-12T22:33:10.614 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:10.615 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.615 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.615 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:10.615 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.468761+0000", 2024-09-12T22:33:10.615 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4399999999999999e-07 2024-09-12T22:33:10.615 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.616 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.616 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:10.616 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.468765+0000", 2024-09-12T22:33:10.616 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3259999999999997e-06 2024-09-12T22:33:10.616 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.616 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.616 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:10.616 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.548969+0000", 2024-09-12T22:33:10.616 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.080204172000000004 2024-09-12T22:33:10.616 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.616 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.616 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:10.616 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.549001+0000", 2024-09-12T22:33:10.617 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.1464999999999998e-05 2024-09-12T22:33:10.617 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.617 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.617 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:10.617 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.549148+0000", 2024-09-12T22:33:10.617 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014749399999999999 2024-09-12T22:33:10.617 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.617 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.617 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:10.617 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.549379+0000", 2024-09-12T22:33:10.617 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000231091 2024-09-12T22:33:10.617 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.617 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.618 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:10.618 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.549518+0000", 2024-09-12T22:33:10.618 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013844899999999999 2024-09-12T22:33:10.618 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.618 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.618 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:10.618 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.552236+0000", 2024-09-12T22:33:10.618 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0027179869999999998 2024-09-12T22:33:10.618 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.618 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.618 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:10.618 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.555333+0000", 2024-09-12T22:33:10.618 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0030973559999999999 2024-09-12T22:33:10.619 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.619 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.619 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:10.619 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.555379+0000", 2024-09-12T22:33:10.619 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6236999999999998e-05 2024-09-12T22:33:10.619 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.619 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.619 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:10.619 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.555420+0000", 2024-09-12T22:33:10.619 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1177999999999998e-05 2024-09-12T22:33:10.619 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:10.619 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:10.619 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:10.619 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.620 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.620 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop_reply(client.4490.0:9866 4.b e53/18 ondisk, result = 0)", 2024-09-12T22:33:10.620 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:09.468826+0000", 2024-09-12T22:33:10.620 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 1.0444748159999999, 2024-09-12T22:33:10.620 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.082588348000000006, 2024-09-12T22:33:10.620 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:10.620 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:10.620 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:33:10.620 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:10.621 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.621 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:10.621 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.468826+0000", 2024-09-12T22:33:10.621 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:10.621 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.621 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.621 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:10.621 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.468826+0000", 2024-09-12T22:33:10.621 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:10.621 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.621 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.622 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:10.622 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.468827+0000", 2024-09-12T22:33:10.622 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3399999999999999e-07 2024-09-12T22:33:10.622 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.622 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.622 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:10.622 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.468830+0000", 2024-09-12T22:33:10.622 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.1559999999999999e-06 2024-09-12T22:33:10.622 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.622 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.623 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:10.623 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.548957+0000", 2024-09-12T22:33:10.623 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.080126852999999998 2024-09-12T22:33:10.623 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.623 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.623 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:10.623 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.548989+0000", 2024-09-12T22:33:10.623 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2409000000000001e-05 2024-09-12T22:33:10.623 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.623 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.623 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:10.624 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.551065+0000", 2024-09-12T22:33:10.624 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.002075871 2024-09-12T22:33:10.624 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.624 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.624 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:10.624 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.551398+0000", 2024-09-12T22:33:10.624 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00033339099999999999 2024-09-12T22:33:10.624 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.624 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.624 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:10.625 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.551414+0000", 2024-09-12T22:33:10.625 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6133999999999998e-05 2024-09-12T22:33:10.625 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:10.625 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:10.625 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:10.625 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.625 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.625 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4490.0:10437 4.2f 4:f6cd553b:::10000002fce.00000000:head [write 0~27313] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:33:10.625 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:10.050890+0000", 2024-09-12T22:33:10.626 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.46241041999999999, 2024-09-12T22:33:10.626 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.056482601, 2024-09-12T22:33:10.626 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:10.626 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:10.626 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:10.626 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:33:10.626 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4490", 2024-09-12T22:33:10.626 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:10.626 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 10437 2024-09-12T22:33:10.626 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.627 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:10.627 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.627 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:10.627 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.050890+0000", 2024-09-12T22:33:10.627 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:10.627 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.627 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.627 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:10.627 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.050890+0000", 2024-09-12T22:33:10.628 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:10.628 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.628 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.628 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:10.628 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.050891+0000", 2024-09-12T22:33:10.628 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.6600000000000005e-07 2024-09-12T22:33:10.628 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.628 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.628 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:10.628 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.050906+0000", 2024-09-12T22:33:10.629 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4521e-05 2024-09-12T22:33:10.629 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.629 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.629 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:10.629 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.050915+0000", 2024-09-12T22:33:10.629 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.2569999999999996e-06 2024-09-12T22:33:10.629 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.629 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.629 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:10.629 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.050920+0000", 2024-09-12T22:33:10.629 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.724e-06 2024-09-12T22:33:10.629 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.630 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.630 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:10.630 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.050960+0000", 2024-09-12T22:33:10.630 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9999000000000001e-05 2024-09-12T22:33:10.630 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.630 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.630 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:10.630 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.051031+0000", 2024-09-12T22:33:10.630 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1007000000000006e-05 2024-09-12T22:33:10.630 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.630 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.630 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:10.630 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.107249+0000", 2024-09-12T22:33:10.630 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.056218432999999998 2024-09-12T22:33:10.631 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.631 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.631 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:10.631 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.107301+0000", 2024-09-12T22:33:10.631 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1289000000000003e-05 2024-09-12T22:33:10.631 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.631 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.631 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:10.631 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.107373+0000", 2024-09-12T22:33:10.631 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.2504999999999998e-05 2024-09-12T22:33:10.631 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:10.631 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:10.631 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:10.632 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.632 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.632 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4490.0:10439 4.12 4:483953cb:::10000002fd0.00000000:head [write 0~4842] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:33:10.632 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:10.052567+0000", 2024-09-12T22:33:10.632 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.46073421199999998, 2024-09-12T22:33:10.632 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.055835449000000002, 2024-09-12T22:33:10.632 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:10.632 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:10.632 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:10.632 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:33:10.632 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4490", 2024-09-12T22:33:10.632 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:10.632 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 10439 2024-09-12T22:33:10.633 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.633 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:10.633 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.633 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:10.633 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.052567+0000", 2024-09-12T22:33:10.633 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:10.633 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.633 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.633 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:10.633 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.052567+0000", 2024-09-12T22:33:10.633 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:10.633 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.633 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.633 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:10.634 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.052568+0000", 2024-09-12T22:33:10.634 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.3600000000000002e-07 2024-09-12T22:33:10.634 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.634 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.634 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:10.634 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.052591+0000", 2024-09-12T22:33:10.634 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.3110000000000001e-05 2024-09-12T22:33:10.634 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.634 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.634 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:10.634 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.106740+0000", 2024-09-12T22:33:10.634 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.054149315000000003 2024-09-12T22:33:10.634 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.634 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.635 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:10.635 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.106751+0000", 2024-09-12T22:33:10.635 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1056000000000001e-05 2024-09-12T22:33:10.635 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.635 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.635 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:10.635 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.106811+0000", 2024-09-12T22:33:10.635 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9515999999999997e-05 2024-09-12T22:33:10.635 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.635 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.635 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:10.635 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.106929+0000", 2024-09-12T22:33:10.635 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00011879000000000001 2024-09-12T22:33:10.635 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.636 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.636 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:10.636 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.108283+0000", 2024-09-12T22:33:10.636 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001354177 2024-09-12T22:33:10.636 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.636 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.636 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:10.636 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.108328+0000", 2024-09-12T22:33:10.636 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4931000000000001e-05 2024-09-12T22:33:10.636 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.636 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.636 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:10.636 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.108402+0000", 2024-09-12T22:33:10.637 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3718000000000001e-05 2024-09-12T22:33:10.637 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:10.637 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:10.637 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:10.637 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.637 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.637 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(client.4490.0:10445 4.3c e53/18 4:3d97251e:::10000002fd8.00000000:head v 53'154, mlcod=53'152)", 2024-09-12T22:33:10.637 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:10.058521+0000", 2024-09-12T22:33:10.637 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.45477987199999997, 2024-09-12T22:33:10.637 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.049310138000000003, 2024-09-12T22:33:10.637 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:10.637 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:10.637 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:10.637 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:10.638 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.638 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:10.638 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.058521+0000", 2024-09-12T22:33:10.638 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:10.638 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.638 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.638 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:10.638 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.058521+0000", 2024-09-12T22:33:10.638 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:10.638 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.638 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.638 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:10.638 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.058522+0000", 2024-09-12T22:33:10.638 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.1099999999999995e-07 2024-09-12T22:33:10.639 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.639 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.639 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:10.639 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.058530+0000", 2024-09-12T22:33:10.639 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.7290000000000006e-06 2024-09-12T22:33:10.639 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.639 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.639 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:10.639 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.106760+0000", 2024-09-12T22:33:10.639 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.048229384 2024-09-12T22:33:10.639 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.639 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.639 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:10.639 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.106770+0000", 2024-09-12T22:33:10.640 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0431999999999999e-05 2024-09-12T22:33:10.640 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.640 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.640 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:10.640 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.106823+0000", 2024-09-12T22:33:10.640 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2309999999999999e-05 2024-09-12T22:33:10.640 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.640 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.640 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:10.640 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.106841+0000", 2024-09-12T22:33:10.640 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.8218000000000001e-05 2024-09-12T22:33:10.640 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.640 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.641 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:10.641 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.107796+0000", 2024-09-12T22:33:10.641 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00095552600000000005 2024-09-12T22:33:10.641 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:10.641 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:10.641 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:10.641 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.107831+0000", 2024-09-12T22:33:10.641 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4928000000000002e-05 2024-09-12T22:33:10.641 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:10.641 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:10.641 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:10.641 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:10.641 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:10.641 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:33:10.642 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T22:33:10.643 INFO:teuthology.orchestra.run.smithi019.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-12T22:33:10.643 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:10.641+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:10.644 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T22:33:10.644 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:33:10.645 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:33:10.645 INFO:tasks.workunit.client.0.smithi019.stderr:++ readlink -f fsstress 2024-09-12T22:33:10.645 INFO:tasks.workunit.client.0.smithi019.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-09-12T22:33:10.645 INFO:tasks.workunit.client.0.smithi019.stderr:+ popd 2024-09-12T22:33:10.646 INFO:tasks.workunit.client.0.smithi019.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-12T22:33:10.646 INFO:tasks.workunit.client.0.smithi019.stderr:+ popd 2024-09-12T22:33:10.646 INFO:tasks.workunit.client.0.smithi019.stdout:~/cephtest/mnt.0/client.0/tmp 2024-09-12T22:33:10.647 INFO:tasks.workunit.client.0.smithi019.stderr:++ mktemp -d -p . 2024-09-12T22:33:10.647 INFO:tasks.workunit.client.0.smithi019.stderr:+ T=./tmp.1a2zdSyw4w 2024-09-12T22:33:10.647 INFO:tasks.workunit.client.0.smithi019.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.1a2zdSyw4w -l 1 -n 1000 -p 10 -v 2024-09-12T22:33:10.648 INFO:tasks.workunit.client.0.smithi019.stdout:seed = 1726713759 2024-09-12T22:33:10.648 INFO:tasks.workunit.client.0.smithi019.stdout:0/0: truncate - no filename 2024-09-12T22:33:10.648 INFO:tasks.workunit.client.0.smithi019.stdout:0/1: truncate - no filename 2024-09-12T22:33:10.648 INFO:tasks.workunit.client.0.smithi019.stdout:0/2: dread - no filename 2024-09-12T22:33:10.648 INFO:tasks.workunit.client.0.smithi019.stdout:0/3: dread - no filename 2024-09-12T22:33:10.648 INFO:tasks.workunit.client.0.smithi019.stdout:0/4: write - no filename 2024-09-12T22:33:10.648 INFO:tasks.workunit.client.0.smithi019.stdout:0/5: dwrite - no filename 2024-09-12T22:33:10.648 INFO:tasks.workunit.client.0.smithi019.stdout:0/6: read - no filename 2024-09-12T22:33:10.648 INFO:tasks.workunit.client.0.smithi019.stdout:1/0: dread - no filename 2024-09-12T22:33:10.648 INFO:tasks.workunit.client.0.smithi019.stdout:0/7: mknod c0 0 2024-09-12T22:33:10.648 INFO:tasks.workunit.client.0.smithi019.stdout:0/8: dread - no filename 2024-09-12T22:33:10.649 INFO:tasks.workunit.client.0.smithi019.stdout:1/1: mknod c0 0 2024-09-12T22:33:10.649 INFO:tasks.workunit.client.0.smithi019.stdout:0/9: mkdir d1 0 2024-09-12T22:33:10.649 INFO:tasks.workunit.client.0.smithi019.stdout:1/2: symlink l1 0 2024-09-12T22:33:10.649 INFO:tasks.workunit.client.0.smithi019.stdout:1/3: write - no filename 2024-09-12T22:33:10.649 INFO:tasks.workunit.client.0.smithi019.stdout:2/0: mkdir d0 0 2024-09-12T22:33:10.649 INFO:tasks.workunit.client.0.smithi019.stdout:2/1: truncate - no filename 2024-09-12T22:33:10.649 INFO:tasks.workunit.client.0.smithi019.stdout:2/2: dwrite - no filename 2024-09-12T22:33:10.649 INFO:tasks.workunit.client.0.smithi019.stdout:2/3: dwrite - no filename 2024-09-12T22:33:10.649 INFO:teuthology.orchestra.run.smithi019.stdout:osd.2: {} 2024-09-12T22:33:10.650 INFO:tasks.workunit.client.0.smithi019.stdout:1/4: rename l1 to l2 0 2024-09-12T22:33:10.650 INFO:teuthology.orchestra.run.smithi019.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T22:33:10.652 INFO:tasks.workunit.client.0.smithi019.stdout:0/10: rename c0 to d1/c2 0 2024-09-12T22:33:10.652 INFO:tasks.workunit.client.0.smithi019.stdout:4/0: dread - no filename 2024-09-12T22:33:10.653 INFO:tasks.workunit.client.0.smithi019.stdout:4/1: write - no filename 2024-09-12T22:33:10.653 INFO:tasks.workunit.client.0.smithi019.stdout:3/0: symlink l0 0 2024-09-12T22:33:10.653 INFO:tasks.workunit.client.0.smithi019.stdout:5/0: read - no filename 2024-09-12T22:33:10.653 INFO:tasks.workunit.client.0.smithi019.stdout:5/1: dread - no filename 2024-09-12T22:33:10.653 INFO:tasks.workunit.client.0.smithi019.stdout:5/2: unlink - no file 2024-09-12T22:33:10.653 INFO:tasks.workunit.client.0.smithi019.stdout:1/5: mkdir d3 0 2024-09-12T22:33:10.653 INFO:tasks.workunit.client.0.smithi019.stdout:1/6: write - no filename 2024-09-12T22:33:10.653 INFO:tasks.workunit.client.0.smithi019.stdout:2/4: creat d0/f1 x:0 0 0 2024-09-12T22:33:10.653 INFO:tasks.workunit.client.0.smithi019.stdout:3/1: chown l0 3 1 2024-09-12T22:33:10.653 INFO:tasks.workunit.client.0.smithi019.stdout:3/2: dwrite - no filename 2024-09-12T22:33:10.653 INFO:tasks.workunit.client.0.smithi019.stdout:2/5: chown d0/f1 14 1 2024-09-12T22:33:10.654 INFO:tasks.workunit.client.0.smithi019.stdout:2/6: chown d0/f1 4294521 1 2024-09-12T22:33:10.654 INFO:tasks.workunit.client.0.smithi019.stdout:4/2: symlink l0 0 2024-09-12T22:33:10.654 INFO:tasks.workunit.client.0.smithi019.stdout:4/3: dwrite - no filename 2024-09-12T22:33:10.654 INFO:tasks.workunit.client.0.smithi019.stdout:5/3: mkdir d0 0 2024-09-12T22:33:10.654 INFO:tasks.workunit.client.0.smithi019.stdout:5/4: write - no filename 2024-09-12T22:33:10.654 INFO:tasks.workunit.client.0.smithi019.stdout:5/5: truncate - no filename 2024-09-12T22:33:10.654 INFO:tasks.workunit.client.0.smithi019.stdout:5/6: truncate - no filename 2024-09-12T22:33:10.654 INFO:tasks.workunit.client.0.smithi019.stdout:2/7: link d0/f1 d0/f2 0 2024-09-12T22:33:10.654 INFO:tasks.workunit.client.0.smithi019.stdout:6/0: dread - no filename 2024-09-12T22:33:10.654 INFO:tasks.workunit.client.0.smithi019.stdout:2/8: dread - d0/f2 zero size 2024-09-12T22:33:10.654 INFO:tasks.workunit.client.0.smithi019.stdout:4/4: mkdir d1 0 2024-09-12T22:33:10.654 INFO:tasks.workunit.client.0.smithi019.stdout:4/5: write - no filename 2024-09-12T22:33:10.655 INFO:tasks.workunit.client.0.smithi019.stdout:4/6: dread - no filename 2024-09-12T22:33:10.655 INFO:tasks.workunit.client.0.smithi019.stdout:5/7: mknod d0/c1 0 2024-09-12T22:33:10.655 INFO:tasks.workunit.client.0.smithi019.stdout:5/8: write - no filename 2024-09-12T22:33:10.655 INFO:tasks.workunit.client.0.smithi019.stdout:5/9: dread - no filename 2024-09-12T22:33:10.655 INFO:tasks.workunit.client.0.smithi019.stdout:6/1: creat f0 x:0 0 0 2024-09-12T22:33:10.655 INFO:tasks.workunit.client.0.smithi019.stdout:5/10: chown d0 1800353 1 2024-09-12T22:33:10.656 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:33:10.656 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:33:10.671 INFO:tasks.workunit.client.0.smithi019.stdout:6/2: creat f1 x:0 0 0 2024-09-12T22:33:10.671 INFO:tasks.workunit.client.0.smithi019.stdout:5/11: creat d0/f2 x:0 0 0 2024-09-12T22:33:10.671 INFO:tasks.workunit.client.0.smithi019.stdout:4/7: link l0 d1/l2 0 2024-09-12T22:33:10.671 INFO:tasks.workunit.client.0.smithi019.stdout:6/3: fdatasync f0 0 2024-09-12T22:33:10.671 INFO:tasks.workunit.client.0.smithi019.stdout:7/0: symlink l0 0 2024-09-12T22:33:10.671 INFO:tasks.workunit.client.0.smithi019.stdout:7/1: dread - no filename 2024-09-12T22:33:10.671 INFO:tasks.workunit.client.0.smithi019.stdout:7/2: truncate - no filename 2024-09-12T22:33:10.671 INFO:tasks.workunit.client.0.smithi019.stdout:4/8: rename d1 to d1/d3 22 2024-09-12T22:33:10.671 INFO:tasks.workunit.client.0.smithi019.stdout:4/9: dread - no filename 2024-09-12T22:33:10.671 INFO:tasks.workunit.client.0.smithi019.stdout:5/12: fdatasync d0/f2 0 2024-09-12T22:33:10.672 INFO:tasks.workunit.client.0.smithi019.stdout:8/0: creat f0 x:0 0 0 2024-09-12T22:33:10.672 INFO:tasks.workunit.client.0.smithi019.stdout:7/3: creat f1 x:0 0 0 2024-09-12T22:33:10.672 INFO:tasks.workunit.client.0.smithi019.stdout:9/0: symlink l0 0 2024-09-12T22:33:10.672 INFO:tasks.workunit.client.0.smithi019.stdout:9/1: dwrite - no filename 2024-09-12T22:33:10.672 INFO:tasks.workunit.client.0.smithi019.stdout:9/2: rmdir - no directory 2024-09-12T22:33:10.672 INFO:tasks.workunit.client.0.smithi019.stdout:9/3: truncate - no filename 2024-09-12T22:33:10.672 INFO:tasks.workunit.client.0.smithi019.stdout:5/13: unlink d0/c1 0 2024-09-12T22:33:10.672 INFO:tasks.workunit.client.0.smithi019.stdout:8/1: dread - f0 zero size 2024-09-12T22:33:10.672 INFO:tasks.workunit.client.0.smithi019.stdout:4/10: unlink d1/l2 0 2024-09-12T22:33:10.672 INFO:tasks.workunit.client.0.smithi019.stdout:7/4: write f1 [52588,115110] 0 2024-09-12T22:33:10.672 INFO:tasks.workunit.client.0.smithi019.stdout:9/4: symlink l1 0 2024-09-12T22:33:10.672 INFO:tasks.workunit.client.0.smithi019.stdout:8/2: chown f0 3050232 1 2024-09-12T22:33:10.672 INFO:tasks.workunit.client.0.smithi019.stdout:5/14: creat d0/f3 x:0 0 0 2024-09-12T22:33:10.673 INFO:tasks.workunit.client.0.smithi019.stdout:4/11: mkdir d1/d4 0 2024-09-12T22:33:10.673 INFO:tasks.workunit.client.0.smithi019.stdout:5/15: chown d0/f3 0 1 2024-09-12T22:33:10.673 INFO:tasks.workunit.client.0.smithi019.stdout:8/3: mknod c1 0 2024-09-12T22:33:10.673 INFO:tasks.workunit.client.0.smithi019.stdout:9/5: rename l0 to l2 0 2024-09-12T22:33:10.673 INFO:tasks.workunit.client.0.smithi019.stdout:6/4: dwrite f0 [0,4194304] 0 2024-09-12T22:33:10.673 INFO:tasks.workunit.client.0.smithi019.stdout:7/5: dwrite f1 [0,4194304] 0 2024-09-12T22:33:10.673 INFO:tasks.workunit.client.0.smithi019.stdout:7/6: write f1 [1457359,26130] 0 2024-09-12T22:33:10.673 INFO:tasks.workunit.client.0.smithi019.stdout:8/4: dwrite f0 [0,4194304] 0 2024-09-12T22:33:10.673 INFO:tasks.workunit.client.0.smithi019.stdout:5/16: mknod d0/c4 0 2024-09-12T22:33:10.673 INFO:tasks.workunit.client.0.smithi019.stdout:5/17: chown d0/c4 19948080 1 2024-09-12T22:33:10.673 INFO:tasks.workunit.client.0.smithi019.stdout:7/7: dread f1 [0,4194304] 0 2024-09-12T22:33:10.673 INFO:tasks.workunit.client.0.smithi019.stdout:5/18: truncate d0/f3 915562 0 2024-09-12T22:33:10.673 INFO:tasks.workunit.client.0.smithi019.stdout:1/7: readlink l2 0 2024-09-12T22:33:10.674 INFO:tasks.workunit.client.0.smithi019.stdout:1/8: write - no filename 2024-09-12T22:33:10.674 INFO:tasks.workunit.client.0.smithi019.stdout:3/3: getdents . 0 2024-09-12T22:33:10.674 INFO:tasks.workunit.client.0.smithi019.stdout:2/9: getdents d0 0 2024-09-12T22:33:10.674 INFO:tasks.workunit.client.0.smithi019.stdout:3/4: chown l0 32505 1 2024-09-12T22:33:10.674 INFO:tasks.workunit.client.0.smithi019.stdout:3/5: write - no filename 2024-09-12T22:33:10.674 INFO:tasks.workunit.client.0.smithi019.stdout:3/6: truncate - no filename 2024-09-12T22:33:10.674 INFO:tasks.workunit.client.0.smithi019.stdout:9/6: creat f3 x:0 0 0 2024-09-12T22:33:10.674 INFO:tasks.workunit.client.0.smithi019.stdout:4/12: rename l0 to d1/l5 0 2024-09-12T22:33:10.674 INFO:tasks.workunit.client.0.smithi019.stdout:3/7: stat l0 0 2024-09-12T22:33:10.674 INFO:tasks.workunit.client.0.smithi019.stdout:8/5: write f0 [4266177,102897] 0 2024-09-12T22:33:10.674 INFO:tasks.workunit.client.0.smithi019.stdout:7/8: mknod c2 0 2024-09-12T22:33:10.674 INFO:tasks.workunit.client.0.smithi019.stdout:0/11: rename d1/c2 to d1/c3 0 2024-09-12T22:33:10.674 INFO:tasks.workunit.client.0.smithi019.stdout:8/6: rmdir - no directory 2024-09-12T22:33:10.675 INFO:tasks.workunit.client.0.smithi019.stdout:2/10: mkdir d0/d3 0 2024-09-12T22:33:10.675 INFO:tasks.workunit.client.0.smithi019.stdout:6/5: rename f1 to f2 0 2024-09-12T22:33:10.675 INFO:tasks.workunit.client.0.smithi019.stdout:9/7: creat f4 x:0 0 0 2024-09-12T22:33:10.675 INFO:tasks.workunit.client.0.smithi019.stdout:1/9: creat d3/f4 x:0 0 0 2024-09-12T22:33:10.675 INFO:tasks.workunit.client.0.smithi019.stdout:3/8: mknod c1 0 2024-09-12T22:33:10.675 INFO:tasks.workunit.client.0.smithi019.stdout:7/9: mknod c3 0 2024-09-12T22:33:10.675 INFO:tasks.workunit.client.0.smithi019.stdout:4/13: symlink d1/d4/l6 0 2024-09-12T22:33:10.675 INFO:tasks.workunit.client.0.smithi019.stdout:3/9: creat f2 x:0 0 0 2024-09-12T22:33:10.675 INFO:tasks.workunit.client.0.smithi019.stdout:7/10: symlink l4 0 2024-09-12T22:33:10.675 INFO:tasks.workunit.client.0.smithi019.stdout:1/10: symlink d3/l5 0 2024-09-12T22:33:10.675 INFO:tasks.workunit.client.0.smithi019.stdout:9/8: link f3 f5 0 2024-09-12T22:33:10.675 INFO:tasks.workunit.client.0.smithi019.stdout:2/11: getdents d0/d3 0 2024-09-12T22:33:10.675 INFO:tasks.workunit.client.0.smithi019.stdout:7/11: read f1 [1797751,16789] 0 2024-09-12T22:33:10.676 INFO:tasks.workunit.client.0.smithi019.stdout:4/14: rename d1/l5 to d1/l7 0 2024-09-12T22:33:10.676 INFO:tasks.workunit.client.0.smithi019.stdout:4/15: write - no filename 2024-09-12T22:33:10.676 INFO:tasks.workunit.client.0.smithi019.stdout:9/9: unlink f4 0 2024-09-12T22:33:10.676 INFO:tasks.workunit.client.0.smithi019.stdout:9/10: stat l1 0 2024-09-12T22:33:10.676 INFO:tasks.workunit.client.0.smithi019.stdout:1/11: write d3/f4 [314163,74847] 0 2024-09-12T22:33:10.676 INFO:tasks.workunit.client.0.smithi019.stdout:4/16: mkdir d1/d8 0 2024-09-12T22:33:10.676 INFO:tasks.workunit.client.0.smithi019.stdout:7/12: write f1 [3013692,32780] 0 2024-09-12T22:33:10.676 INFO:tasks.workunit.client.0.smithi019.stdout:9/11: creat f6 x:0 0 0 2024-09-12T22:33:10.676 INFO:tasks.workunit.client.0.smithi019.stdout:4/17: rename d1 to d1/d8/d9 22 2024-09-12T22:33:10.676 INFO:tasks.workunit.client.0.smithi019.stdout:5/19: dwrite d0/f3 [0,4194304] 0 2024-09-12T22:33:10.676 INFO:tasks.workunit.client.0.smithi019.stdout:9/12: write f3 [387110,29678] 0 2024-09-12T22:33:10.676 INFO:tasks.workunit.client.0.smithi019.stdout:4/18: rename d1/d4/l6 to d1/d8/la 0 2024-09-12T22:33:10.676 INFO:tasks.workunit.client.0.smithi019.stdout:4/19: truncate - no filename 2024-09-12T22:33:10.677 INFO:tasks.workunit.client.0.smithi019.stdout:9/13: symlink l7 0 2024-09-12T22:33:10.677 INFO:tasks.workunit.client.0.smithi019.stdout:5/20: creat d0/f5 x:0 0 0 2024-09-12T22:33:10.677 INFO:tasks.workunit.client.0.smithi019.stdout:4/20: creat d1/d8/fb x:0 0 0 2024-09-12T22:33:10.677 INFO:tasks.workunit.client.0.smithi019.stdout:4/21: symlink d1/d8/lc 0 2024-09-12T22:33:10.677 INFO:tasks.workunit.client.0.smithi019.stdout:6/6: truncate f0 1640982 0 2024-09-12T22:33:10.677 INFO:tasks.workunit.client.0.smithi019.stdout:2/12: write d0/f2 [336137,30783] 0 2024-09-12T22:33:10.677 INFO:tasks.workunit.client.0.smithi019.stdout:1/12: dread d3/f4 [0,4194304] 0 2024-09-12T22:33:10.677 INFO:tasks.workunit.client.0.smithi019.stdout:4/22: getdents d1/d4 0 2024-09-12T22:33:10.677 INFO:tasks.workunit.client.0.smithi019.stdout:9/14: dread f5 [0,4194304] 0 2024-09-12T22:33:10.677 INFO:tasks.workunit.client.0.smithi019.stdout:1/13: rename d3 to d3/d6 22 2024-09-12T22:33:10.677 INFO:tasks.workunit.client.0.smithi019.stdout:0/12: link d1/c3 d1/c4 0 2024-09-12T22:33:10.677 INFO:tasks.workunit.client.0.smithi019.stdout:9/15: readlink l1 0 2024-09-12T22:33:10.677 INFO:tasks.workunit.client.0.smithi019.stdout:6/7: write f2 [452318,44431] 0 2024-09-12T22:33:10.677 INFO:tasks.workunit.client.0.smithi019.stdout:0/13: chown d1 15732656 1 2024-09-12T22:33:10.678 INFO:tasks.workunit.client.0.smithi019.stdout:1/14: read d3/f4 [74204,115509] 0 2024-09-12T22:33:10.678 INFO:tasks.workunit.client.0.smithi019.stdout:2/13: rmdir d0/d3 0 2024-09-12T22:33:10.678 INFO:tasks.workunit.client.0.smithi019.stdout:4/23: rename d1/d8/lc to d1/d8/ld 0 2024-09-12T22:33:10.678 INFO:tasks.workunit.client.0.smithi019.stdout:6/8: creat f3 x:0 0 0 2024-09-12T22:33:10.678 INFO:tasks.workunit.client.0.smithi019.stdout:9/16: read f5 [381535,117475] 0 2024-09-12T22:33:10.678 INFO:tasks.workunit.client.0.smithi019.stdout:5/21: dwrite d0/f3 [0,4194304] 0 2024-09-12T22:33:10.678 INFO:tasks.workunit.client.0.smithi019.stdout:1/15: symlink d3/l7 0 2024-09-12T22:33:10.678 INFO:tasks.workunit.client.0.smithi019.stdout:2/14: mknod d0/c4 0 2024-09-12T22:33:10.678 INFO:tasks.workunit.client.0.smithi019.stdout:9/17: fdatasync f6 0 2024-09-12T22:33:10.678 INFO:tasks.workunit.client.0.smithi019.stdout:4/24: chown d1/d8/la 13431043 1 2024-09-12T22:33:10.678 INFO:tasks.workunit.client.0.smithi019.stdout:9/18: stat f3 0 2024-09-12T22:33:10.678 INFO:tasks.workunit.client.0.smithi019.stdout:5/22: dread - d0/f5 zero size 2024-09-12T22:33:10.679 INFO:tasks.workunit.client.0.smithi019.stdout:9/19: chown l1 5358 1 2024-09-12T22:33:10.679 INFO:tasks.workunit.client.0.smithi019.stdout:1/16: write d3/f4 [1378613,42346] 0 2024-09-12T22:33:10.679 INFO:tasks.workunit.client.0.smithi019.stdout:0/14: link d1/c3 d1/c5 0 2024-09-12T22:33:10.679 INFO:tasks.workunit.client.0.smithi019.stdout:0/15: dwrite - no filename 2024-09-12T22:33:10.679 INFO:tasks.workunit.client.0.smithi019.stdout:0/16: truncate - no filename 2024-09-12T22:33:10.679 INFO:tasks.workunit.client.0.smithi019.stdout:4/25: write d1/d8/fb [411377,81002] 0 2024-09-12T22:33:10.679 INFO:tasks.workunit.client.0.smithi019.stdout:1/17: symlink d3/l8 0 2024-09-12T22:33:10.679 INFO:tasks.workunit.client.0.smithi019.stdout:9/20: chown l2 3 1 2024-09-12T22:33:10.679 INFO:tasks.workunit.client.0.smithi019.stdout:5/23: write d0/f5 [49600,6425] 0 2024-09-12T22:33:10.679 INFO:tasks.workunit.client.0.smithi019.stdout:0/17: chown d1/c5 1343 1 2024-09-12T22:33:10.679 INFO:tasks.workunit.client.0.smithi019.stdout:0/18: fsync - no filename 2024-09-12T22:33:10.679 INFO:tasks.workunit.client.0.smithi019.stdout:9/21: fsync f5 0 2024-09-12T22:33:10.679 INFO:tasks.workunit.client.0.smithi019.stdout:1/18: creat d3/f9 x:0 0 0 2024-09-12T22:33:10.680 INFO:tasks.workunit.client.0.smithi019.stdout:5/24: rename d0/f5 to d0/f6 0 2024-09-12T22:33:10.680 INFO:tasks.workunit.client.0.smithi019.stdout:0/19: creat d1/f6 x:0 0 0 2024-09-12T22:33:10.680 INFO:tasks.workunit.client.0.smithi019.stdout:4/26: truncate d1/d8/fb 748573 0 2024-09-12T22:33:10.680 INFO:tasks.workunit.client.0.smithi019.stdout:1/19: unlink d3/f4 0 2024-09-12T22:33:10.680 INFO:tasks.workunit.client.0.smithi019.stdout:4/27: stat d1/d4 0 2024-09-12T22:33:10.680 INFO:tasks.workunit.client.0.smithi019.stdout:9/22: getdents . 0 2024-09-12T22:33:10.680 INFO:tasks.workunit.client.0.smithi019.stdout:1/20: dread - d3/f9 zero size 2024-09-12T22:33:10.680 INFO:tasks.workunit.client.0.smithi019.stdout:6/9: dwrite f3 [0,4194304] 0 2024-09-12T22:33:10.680 INFO:tasks.workunit.client.0.smithi019.stdout:2/15: dwrite d0/f2 [0,4194304] 0 2024-09-12T22:33:10.680 INFO:tasks.workunit.client.0.smithi019.stdout:1/21: dread - d3/f9 zero size 2024-09-12T22:33:10.680 INFO:tasks.workunit.client.0.smithi019.stdout:6/10: mknod c4 0 2024-09-12T22:33:10.680 INFO:tasks.workunit.client.0.smithi019.stdout:4/28: unlink d1/d8/ld 0 2024-09-12T22:33:10.680 INFO:tasks.workunit.client.0.smithi019.stdout:2/16: mkdir d0/d5 0 2024-09-12T22:33:10.681 INFO:tasks.workunit.client.0.smithi019.stdout:2/17: stat d0 0 2024-09-12T22:33:10.681 INFO:tasks.workunit.client.0.smithi019.stdout:2/18: mknod d0/c6 0 2024-09-12T22:33:10.681 INFO:tasks.workunit.client.0.smithi019.stdout:5/25: dwrite d0/f2 [0,4194304] 0 2024-09-12T22:33:10.681 INFO:tasks.workunit.client.0.smithi019.stdout:0/20: dwrite d1/f6 [0,4194304] 0 2024-09-12T22:33:10.681 INFO:tasks.workunit.client.0.smithi019.stdout:5/26: mkdir d0/d7 0 2024-09-12T22:33:10.681 INFO:tasks.workunit.client.0.smithi019.stdout:9/23: dwrite f6 [0,4194304] 0 2024-09-12T22:33:10.681 INFO:tasks.workunit.client.0.smithi019.stdout:9/24: unlink f3 0 2024-09-12T22:33:10.681 INFO:tasks.workunit.client.0.smithi019.stdout:5/27: symlink d0/l8 0 2024-09-12T22:33:10.681 INFO:tasks.workunit.client.0.smithi019.stdout:1/22: dwrite d3/f9 [0,4194304] 0 2024-09-12T22:33:10.681 INFO:tasks.workunit.client.0.smithi019.stdout:9/25: mknod c8 0 2024-09-12T22:33:10.681 INFO:tasks.workunit.client.0.smithi019.stdout:6/11: truncate f3 2058626 0 2024-09-12T22:33:10.681 INFO:tasks.workunit.client.0.smithi019.stdout:5/28: write d0/f2 [1856163,58960] 0 2024-09-12T22:33:10.681 INFO:tasks.workunit.client.0.smithi019.stdout:9/26: creat f9 x:0 0 0 2024-09-12T22:33:10.682 INFO:tasks.workunit.client.0.smithi019.stdout:1/23: truncate d3/f9 4328822 0 2024-09-12T22:33:10.682 INFO:tasks.workunit.client.0.smithi019.stdout:9/27: unlink f9 0 2024-09-12T22:33:10.682 INFO:tasks.workunit.client.0.smithi019.stdout:1/24: unlink d3/l7 0 2024-09-12T22:33:10.682 INFO:tasks.workunit.client.0.smithi019.stdout:2/19: dwrite d0/f2 [0,4194304] 0 2024-09-12T22:33:10.682 INFO:tasks.workunit.client.0.smithi019.stdout:2/20: chown d0 177124576 1 2024-09-12T22:33:10.682 INFO:tasks.workunit.client.0.smithi019.stdout:2/21: read d0/f2 [1774159,17517] 0 2024-09-12T22:33:10.682 INFO:tasks.workunit.client.0.smithi019.stdout:1/25: rmdir d3 39 2024-09-12T22:33:10.682 INFO:tasks.workunit.client.0.smithi019.stdout:2/22: mknod d0/d5/c7 0 2024-09-12T22:33:10.682 INFO:tasks.workunit.client.0.smithi019.stdout:2/23: symlink d0/l8 0 2024-09-12T22:33:10.682 INFO:tasks.workunit.client.0.smithi019.stdout:9/28: read f5 [117800,127378] 0 2024-09-12T22:33:10.682 INFO:tasks.workunit.client.0.smithi019.stdout:5/29: dread d0/f2 [0,4194304] 0 2024-09-12T22:33:10.682 INFO:tasks.workunit.client.0.smithi019.stdout:2/24: mkdir d0/d9 0 2024-09-12T22:33:10.683 INFO:tasks.workunit.client.0.smithi019.stdout:4/29: dread d1/d8/fb [0,4194304] 0 2024-09-12T22:33:10.683 INFO:tasks.workunit.client.0.smithi019.stdout:9/29: truncate f6 4729589 0 2024-09-12T22:33:10.683 INFO:tasks.workunit.client.0.smithi019.stdout:5/30: write d0/f2 [2361773,128779] 0 2024-09-12T22:33:10.683 INFO:tasks.workunit.client.0.smithi019.stdout:4/30: symlink d1/le 0 2024-09-12T22:33:10.683 INFO:tasks.workunit.client.0.smithi019.stdout:0/21: fsync d1/f6 0 2024-09-12T22:33:10.686 INFO:tasks.workunit.client.0.smithi019.stdout:6/12: dwrite f3 [0,4194304] 0 2024-09-12T22:33:10.686 INFO:tasks.workunit.client.0.smithi019.stdout:1/26: dwrite d3/f9 [4194304,4194304] 0 2024-09-12T22:33:10.686 INFO:tasks.workunit.client.0.smithi019.stdout:4/31: dread d1/d8/fb [0,4194304] 0 2024-09-12T22:33:10.686 INFO:tasks.workunit.client.0.smithi019.stdout:6/13: mknod c5 0 2024-09-12T22:33:10.686 INFO:tasks.workunit.client.0.smithi019.stdout:1/27: symlink d3/la 0 2024-09-12T22:33:10.686 INFO:tasks.workunit.client.0.smithi019.stdout:0/22: chown d1/c4 1786023 1 2024-09-12T22:33:10.686 INFO:tasks.workunit.client.0.smithi019.stdout:9/30: creat fa x:0 0 0 2024-09-12T22:33:10.686 INFO:tasks.workunit.client.0.smithi019.stdout:2/25: dread d0/f1 [0,4194304] 0 2024-09-12T22:33:10.687 INFO:tasks.workunit.client.0.smithi019.stdout:0/23: mknod d1/c7 0 2024-09-12T22:33:10.687 INFO:tasks.workunit.client.0.smithi019.stdout:6/14: dread f0 [0,4194304] 0 2024-09-12T22:33:10.687 INFO:tasks.workunit.client.0.smithi019.stdout:2/26: rename d0/d9 to d0/da 0 2024-09-12T22:33:10.687 INFO:tasks.workunit.client.0.smithi019.stdout:0/24: rename d1/c5 to d1/c8 0 2024-09-12T22:33:10.687 INFO:tasks.workunit.client.0.smithi019.stdout:5/31: dread d0/f3 [0,4194304] 0 2024-09-12T22:33:10.687 INFO:tasks.workunit.client.0.smithi019.stdout:0/25: truncate d1/f6 2082829 0 2024-09-12T22:33:10.687 INFO:tasks.workunit.client.0.smithi019.stdout:1/28: dread d3/f9 [0,4194304] 0 2024-09-12T22:33:10.687 INFO:tasks.workunit.client.0.smithi019.stdout:5/32: write d0/f3 [3157821,105145] 0 2024-09-12T22:33:10.687 INFO:tasks.workunit.client.0.smithi019.stdout:1/29: creat d3/fb x:0 0 0 2024-09-12T22:33:10.687 INFO:tasks.workunit.client.0.smithi019.stdout:5/33: unlink d0/f3 0 2024-09-12T22:33:10.688 INFO:tasks.workunit.client.0.smithi019.stdout:2/27: dread d0/f2 [0,4194304] 0 2024-09-12T22:33:10.688 INFO:tasks.workunit.client.0.smithi019.stdout:4/32: dwrite d1/d8/fb [0,4194304] 0 2024-09-12T22:33:10.688 INFO:tasks.workunit.client.0.smithi019.stdout:1/30: write d3/fb [193338,69106] 0 2024-09-12T22:33:10.688 INFO:tasks.workunit.client.0.smithi019.stdout:5/34: write d0/f6 [1014539,56512] 0 2024-09-12T22:33:10.688 INFO:tasks.workunit.client.0.smithi019.stdout:1/31: symlink d3/lc 0 2024-09-12T22:33:10.688 INFO:tasks.workunit.client.0.smithi019.stdout:4/33: read d1/d8/fb [2047855,71928] 0 2024-09-12T22:33:10.688 INFO:tasks.workunit.client.0.smithi019.stdout:6/15: read f2 [4502,121798] 0 2024-09-12T22:33:10.688 INFO:tasks.workunit.client.0.smithi019.stdout:4/34: chown d1/l7 1073458027 1 2024-09-12T22:33:10.688 INFO:tasks.workunit.client.0.smithi019.stdout:5/35: symlink d0/d7/l9 0 2024-09-12T22:33:10.688 INFO:tasks.workunit.client.0.smithi019.stdout:6/16: chown c5 2266 1 2024-09-12T22:33:10.689 INFO:tasks.workunit.client.0.smithi019.stdout:9/31: link f6 fb 0 2024-09-12T22:33:10.690 INFO:tasks.workunit.client.0.smithi019.stdout:2/28: dread d0/f1 [0,4194304] 0 2024-09-12T22:33:10.690 INFO:tasks.workunit.client.0.smithi019.stdout:6/17: dread f0 [0,4194304] 0 2024-09-12T22:33:10.690 INFO:tasks.workunit.client.0.smithi019.stdout:9/32: readlink l2 0 2024-09-12T22:33:10.692 INFO:tasks.workunit.client.0.smithi019.stdout:6/18: fdatasync f2 0 2024-09-12T22:33:10.692 INFO:tasks.workunit.client.0.smithi019.stdout:2/29: chown d0/d5 210143179 1 2024-09-12T22:33:10.692 INFO:tasks.workunit.client.0.smithi019.stdout:9/33: symlink lc 0 2024-09-12T22:33:10.697 INFO:tasks.workunit.client.0.smithi019.stdout:6/19: mknod c6 0 2024-09-12T22:33:10.697 INFO:tasks.workunit.client.0.smithi019.stdout:2/30: read d0/f1 [1048906,73482] 0 2024-09-12T22:33:10.697 INFO:tasks.workunit.client.0.smithi019.stdout:6/20: creat f7 x:0 0 0 2024-09-12T22:33:10.697 INFO:tasks.workunit.client.0.smithi019.stdout:1/32: dwrite d3/fb [0,4194304] 0 2024-09-12T22:33:10.698 INFO:tasks.workunit.client.0.smithi019.stdout:2/31: chown d0/c6 16 1 2024-09-12T22:33:10.699 INFO:tasks.workunit.client.0.smithi019.stdout:5/36: dwrite d0/f6 [0,4194304] 0 2024-09-12T22:33:10.699 INFO:tasks.workunit.client.0.smithi019.stdout:6/21: chown c4 1221732263 1 2024-09-12T22:33:10.699 INFO:tasks.workunit.client.0.smithi019.stdout:4/35: dwrite d1/d8/fb [0,4194304] 0 2024-09-12T22:33:10.701 INFO:tasks.workunit.client.0.smithi019.stdout:4/36: symlink d1/lf 0 2024-09-12T22:33:10.701 INFO:tasks.workunit.client.0.smithi019.stdout:1/33: getdents d3 0 2024-09-12T22:33:10.702 INFO:tasks.workunit.client.0.smithi019.stdout:0/26: write d1/f6 [1053353,70296] 0 2024-09-12T22:33:10.706 INFO:tasks.workunit.client.0.smithi019.stdout:0/27: write d1/f6 [240335,41869] 0 2024-09-12T22:33:10.710 INFO:tasks.workunit.client.0.smithi019.stdout:0/28: stat d1/c7 0 2024-09-12T22:33:10.714 INFO:tasks.workunit.client.0.smithi019.stdout:0/29: chown d1/c4 32 1 2024-09-12T22:33:10.716 INFO:tasks.workunit.client.0.smithi019.stdout:5/37: dwrite d0/f6 [0,4194304] 0 2024-09-12T22:33:10.717 INFO:tasks.workunit.client.0.smithi019.stdout:6/22: dwrite f3 [0,4194304] 0 2024-09-12T22:33:10.717 INFO:tasks.workunit.client.0.smithi019.stdout:2/32: dwrite d0/f1 [0,4194304] 0 2024-09-12T22:33:10.717 INFO:tasks.workunit.client.0.smithi019.stdout:9/34: dwrite f5 [0,4194304] 0 2024-09-12T22:33:10.718 INFO:tasks.workunit.client.0.smithi019.stdout:6/23: symlink l8 0 2024-09-12T22:33:10.719 INFO:tasks.workunit.client.0.smithi019.stdout:5/38: chown d0/c4 41391 1 2024-09-12T22:33:10.719 INFO:tasks.workunit.client.0.smithi019.stdout:9/35: readlink l7 0 2024-09-12T22:33:10.720 INFO:tasks.workunit.client.0.smithi019.stdout:4/37: dwrite d1/d8/fb [0,4194304] 0 2024-09-12T22:33:10.721 INFO:tasks.workunit.client.0.smithi019.stdout:1/34: dwrite d3/fb [0,4194304] 0 2024-09-12T22:33:10.721 INFO:tasks.workunit.client.0.smithi019.stdout:9/36: mkdir dd 0 2024-09-12T22:33:10.722 INFO:tasks.workunit.client.0.smithi019.stdout:1/35: stat c0 0 2024-09-12T22:33:10.722 INFO:tasks.workunit.client.0.smithi019.stdout:9/37: unlink f6 0 2024-09-12T22:33:10.723 INFO:tasks.workunit.client.0.smithi019.stdout:6/24: dread f0 [0,4194304] 0 2024-09-12T22:33:10.723 INFO:tasks.workunit.client.0.smithi019.stdout:1/36: fsync d3/f9 0 2024-09-12T22:33:10.723 INFO:tasks.workunit.client.0.smithi019.stdout:6/25: read f3 [3128503,93875] 0 2024-09-12T22:33:10.724 INFO:tasks.workunit.client.0.smithi019.stdout:1/37: write d3/fb [2299429,120141] 0 2024-09-12T22:33:10.724 INFO:tasks.workunit.client.0.smithi019.stdout:6/26: creat f9 x:0 0 0 2024-09-12T22:33:10.725 INFO:tasks.workunit.client.0.smithi019.stdout:2/33: dread d0/f1 [0,4194304] 0 2024-09-12T22:33:10.725 INFO:tasks.workunit.client.0.smithi019.stdout:6/27: chown f0 240 1 2024-09-12T22:33:10.725 INFO:tasks.workunit.client.0.smithi019.stdout:1/38: mkdir d3/dd 0 2024-09-12T22:33:10.725 INFO:tasks.workunit.client.0.smithi019.stdout:4/38: dread d1/d8/fb [0,4194304] 0 2024-09-12T22:33:10.726 INFO:tasks.workunit.client.0.smithi019.stdout:6/28: rename f2 to fa 0 2024-09-12T22:33:10.726 INFO:tasks.workunit.client.0.smithi019.stdout:0/30: fsync d1/f6 0 2024-09-12T22:33:10.727 INFO:tasks.workunit.client.0.smithi019.stdout:0/31: unlink d1/c8 0 2024-09-12T22:33:10.727 INFO:tasks.workunit.client.0.smithi019.stdout:6/29: rename f7 to fb 0 2024-09-12T22:33:10.728 INFO:tasks.workunit.client.0.smithi019.stdout:6/30: stat f0 0 2024-09-12T22:33:10.728 INFO:tasks.workunit.client.0.smithi019.stdout:0/32: chown d1/f6 92948 1 2024-09-12T22:33:10.731 INFO:tasks.workunit.client.0.smithi019.stdout:1/39: dread d3/f9 [4194304,4194304] 0 2024-09-12T22:33:10.732 INFO:tasks.workunit.client.0.smithi019.stdout:5/39: truncate d0/f2 929226 0 2024-09-12T22:33:10.733 INFO:tasks.workunit.client.0.smithi019.stdout:4/39: dread d1/d8/fb [0,4194304] 0 2024-09-12T22:33:10.734 INFO:tasks.workunit.client.0.smithi019.stdout:5/40: symlink d0/la 0 2024-09-12T22:33:10.734 INFO:tasks.workunit.client.0.smithi019.stdout:2/34: dwrite d0/f2 [4194304,4194304] 0 2024-09-12T22:33:10.735 INFO:tasks.workunit.client.0.smithi019.stdout:2/35: stat d0/c6 0 2024-09-12T22:33:10.736 INFO:tasks.workunit.client.0.smithi019.stdout:4/40: creat d1/d8/f10 x:0 0 0 2024-09-12T22:33:10.738 INFO:tasks.workunit.client.0.smithi019.stdout:6/31: dwrite f0 [0,4194304] 0 2024-09-12T22:33:10.739 INFO:tasks.workunit.client.0.smithi019.stdout:5/41: rename d0/l8 to d0/lb 0 2024-09-12T22:33:10.740 INFO:tasks.workunit.client.0.smithi019.stdout:2/36: rename d0/f2 to d0/d5/fb 0 2024-09-12T22:33:10.740 INFO:tasks.workunit.client.0.smithi019.stdout:6/32: chown l8 2531082 1 2024-09-12T22:33:10.740 INFO:tasks.workunit.client.0.smithi019.stdout:0/33: dwrite d1/f6 [0,4194304] 0 2024-09-12T22:33:10.740 INFO:tasks.workunit.client.0.smithi019.stdout:5/42: chown d0/c4 477 1 2024-09-12T22:33:10.741 INFO:tasks.workunit.client.0.smithi019.stdout:6/33: readlink l8 0 2024-09-12T22:33:10.741 INFO:tasks.workunit.client.0.smithi019.stdout:2/37: rmdir d0/d5 39 2024-09-12T22:33:10.741 INFO:tasks.workunit.client.0.smithi019.stdout:6/34: dread - f9 zero size 2024-09-12T22:33:10.742 INFO:tasks.workunit.client.0.smithi019.stdout:5/43: chown d0/f6 0 1 2024-09-12T22:33:10.742 INFO:tasks.workunit.client.0.smithi019.stdout:1/40: dwrite d3/fb [0,4194304] 0 2024-09-12T22:33:10.742 INFO:tasks.workunit.client.0.smithi019.stdout:2/38: mkdir d0/da/dc 0 2024-09-12T22:33:10.742 INFO:tasks.workunit.client.0.smithi019.stdout:6/35: mknod cc 0 2024-09-12T22:33:10.742 INFO:tasks.workunit.client.0.smithi019.stdout:1/41: readlink d3/lc 0 2024-09-12T22:33:10.743 INFO:tasks.workunit.client.0.smithi019.stdout:4/41: fsync d1/d8/f10 0 2024-09-12T22:33:10.743 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:10.742+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:10.744 INFO:tasks.workunit.client.0.smithi019.stdout:6/36: creat fd x:0 0 0 2024-09-12T22:33:10.744 INFO:tasks.workunit.client.0.smithi019.stdout:1/42: rmdir d3/dd 0 2024-09-12T22:33:10.744 INFO:tasks.workunit.client.0.smithi019.stdout:6/37: symlink le 0 2024-09-12T22:33:10.745 INFO:tasks.workunit.client.0.smithi019.stdout:6/38: chown f3 20112 1 2024-09-12T22:33:10.745 INFO:tasks.workunit.client.0.smithi019.stdout:1/43: creat d3/fe x:0 0 0 2024-09-12T22:33:10.745 INFO:tasks.workunit.client.0.smithi019.stdout:6/39: mknod cf 0 2024-09-12T22:33:10.745 INFO:tasks.workunit.client.0.smithi019.stdout:1/44: chown d3/fb 46819 1 2024-09-12T22:33:10.746 INFO:tasks.workunit.client.0.smithi019.stdout:1/45: rmdir d3 39 2024-09-12T22:33:10.748 INFO:tasks.workunit.client.0.smithi019.stdout:2/39: dread d0/d5/fb [0,4194304] 0 2024-09-12T22:33:10.748 INFO:tasks.workunit.client.0.smithi019.stdout:1/46: mkdir d3/df 0 2024-09-12T22:33:10.751 INFO:tasks.workunit.client.0.smithi019.stdout:2/40: write d0/d5/fb [2486203,111199] 0 2024-09-12T22:33:10.751 INFO:tasks.workunit.client.0.smithi019.stdout:4/42: dwrite d1/d8/f10 [0,4194304] 0 2024-09-12T22:33:10.753 INFO:tasks.workunit.client.0.smithi019.stdout:5/44: chown d0/lb 5517225 1 2024-09-12T22:33:10.754 INFO:tasks.workunit.client.0.smithi019.stdout:6/40: dwrite fd [0,4194304] 0 2024-09-12T22:33:10.755 INFO:tasks.workunit.client.0.smithi019.stdout:4/43: truncate d1/d8/fb 5231797 0 2024-09-12T22:33:10.755 INFO:tasks.workunit.client.0.smithi019.stdout:0/34: truncate d1/f6 1468720 0 2024-09-12T22:33:10.756 INFO:tasks.workunit.client.0.smithi019.stdout:0/35: stat d1/c7 0 2024-09-12T22:33:10.756 INFO:tasks.workunit.client.0.smithi019.stdout:6/41: symlink l10 0 2024-09-12T22:33:10.758 INFO:tasks.workunit.client.0.smithi019.stdout:4/44: write d1/d8/f10 [3497873,57152] 0 2024-09-12T22:33:10.759 INFO:tasks.workunit.client.0.smithi019.stdout:1/47: dwrite d3/fb [0,4194304] 0 2024-09-12T22:33:10.760 INFO:tasks.workunit.client.0.smithi019.stdout:5/45: dread d0/f2 [0,4194304] 0 2024-09-12T22:33:10.760 INFO:tasks.workunit.client.0.smithi019.stdout:4/45: write d1/d8/f10 [3084960,100542] 0 2024-09-12T22:33:10.760 INFO:tasks.workunit.client.0.smithi019.stdout:5/46: stat d0/la 0 2024-09-12T22:33:10.762 INFO:tasks.workunit.client.0.smithi019.stdout:2/41: dwrite d0/d5/fb [4194304,4194304] 0 2024-09-12T22:33:10.762 INFO:tasks.workunit.client.0.smithi019.stdout:4/46: mkdir d1/d11 0 2024-09-12T22:33:10.762 INFO:tasks.workunit.client.0.smithi019.stdout:5/47: unlink d0/d7/l9 0 2024-09-12T22:33:10.762 INFO:tasks.workunit.client.0.smithi019.stdout:1/48: getdents d3 0 2024-09-12T22:33:10.763 INFO:tasks.workunit.client.0.smithi019.stdout:0/36: dread d1/f6 [0,4194304] 0 2024-09-12T22:33:10.763 INFO:tasks.workunit.client.0.smithi019.stdout:2/42: creat d0/da/fd x:0 0 0 2024-09-12T22:33:10.764 INFO:tasks.workunit.client.0.smithi019.stdout:4/47: creat d1/d11/f12 x:0 0 0 2024-09-12T22:33:10.764 INFO:tasks.workunit.client.0.smithi019.stdout:0/37: symlink d1/l9 0 2024-09-12T22:33:10.765 INFO:tasks.workunit.client.0.smithi019.stdout:4/48: creat d1/d4/f13 x:0 0 0 2024-09-12T22:33:10.765 INFO:tasks.workunit.client.0.smithi019.stdout:1/49: link d3/la d3/l10 0 2024-09-12T22:33:10.765 INFO:tasks.workunit.client.0.smithi019.stdout:0/38: mknod d1/ca 0 2024-09-12T22:33:10.766 INFO:tasks.workunit.client.0.smithi019.stdout:1/50: rmdir d3 39 2024-09-12T22:33:10.766 INFO:tasks.workunit.client.0.smithi019.stdout:0/39: creat d1/fb x:0 0 0 2024-09-12T22:33:10.767 INFO:tasks.workunit.client.0.smithi019.stdout:6/42: dwrite f0 [0,4194304] 0 2024-09-12T22:33:10.770 INFO:tasks.workunit.client.0.smithi019.stdout:1/51: mkdir d3/d11 0 2024-09-12T22:33:10.770 INFO:tasks.workunit.client.0.smithi019.stdout:2/43: dread d0/f1 [4194304,4194304] 0 2024-09-12T22:33:10.771 INFO:tasks.workunit.client.0.smithi019.stdout:0/40: dread d1/f6 [0,4194304] 0 2024-09-12T22:33:10.771 INFO:tasks.workunit.client.0.smithi019.stdout:5/48: dwrite d0/f6 [0,4194304] 0 2024-09-12T22:33:10.772 INFO:tasks.workunit.client.0.smithi019.stdout:2/44: dread - d0/da/fd zero size 2024-09-12T22:33:10.773 INFO:tasks.workunit.client.0.smithi019.stdout:5/49: mkdir d0/dc 0 2024-09-12T22:33:10.773 INFO:tasks.workunit.client.0.smithi019.stdout:0/41: creat d1/fc x:0 0 0 2024-09-12T22:33:10.773 INFO:tasks.workunit.client.0.smithi019.stdout:2/45: unlink d0/l8 0 2024-09-12T22:33:10.773 INFO:tasks.workunit.client.0.smithi019.stdout:0/42: read - d1/fb zero size 2024-09-12T22:33:10.774 INFO:tasks.workunit.client.0.smithi019.stdout:4/49: dwrite d1/d8/fb [4194304,4194304] 0 2024-09-12T22:33:10.775 INFO:tasks.workunit.client.0.smithi019.stdout:0/43: creat d1/fd x:0 0 0 2024-09-12T22:33:10.776 INFO:tasks.workunit.client.0.smithi019.stdout:2/46: creat d0/da/dc/fe x:0 0 0 2024-09-12T22:33:10.776 INFO:tasks.workunit.client.0.smithi019.stdout:1/52: fdatasync d3/fb 0 2024-09-12T22:33:10.776 INFO:tasks.workunit.client.0.smithi019.stdout:0/44: fdatasync d1/fc 0 2024-09-12T22:33:10.776 INFO:tasks.workunit.client.0.smithi019.stdout:4/50: unlink d1/d11/f12 0 2024-09-12T22:33:10.777 INFO:tasks.workunit.client.0.smithi019.stdout:2/47: unlink d0/d5/c7 0 2024-09-12T22:33:10.777 INFO:tasks.workunit.client.0.smithi019.stdout:0/45: rmdir d1 39 2024-09-12T22:33:10.778 INFO:tasks.workunit.client.0.smithi019.stdout:4/51: creat d1/d8/f14 x:0 0 0 2024-09-12T22:33:10.778 INFO:tasks.workunit.client.0.smithi019.stdout:5/50: dread d0/f6 [0,4194304] 0 2024-09-12T22:33:10.779 INFO:tasks.workunit.client.0.smithi019.stdout:5/51: readlink d0/la 0 2024-09-12T22:33:10.780 INFO:tasks.workunit.client.0.smithi019.stdout:0/46: link d1/c3 d1/ce 0 2024-09-12T22:33:10.781 INFO:tasks.workunit.client.0.smithi019.stdout:5/52: creat d0/d7/fd x:0 0 0 2024-09-12T22:33:10.782 INFO:tasks.workunit.client.0.smithi019.stdout:5/53: mkdir d0/dc/de 0 2024-09-12T22:33:10.783 INFO:tasks.workunit.client.0.smithi019.stdout:5/54: chown d0/d7 49616839 1 2024-09-12T22:33:10.783 INFO:tasks.workunit.client.0.smithi019.stdout:0/47: dread d1/f6 [0,4194304] 0 2024-09-12T22:33:10.784 INFO:tasks.workunit.client.0.smithi019.stdout:4/52: dread d1/d8/fb [0,4194304] 0 2024-09-12T22:33:10.784 INFO:tasks.workunit.client.0.smithi019.stdout:2/48: dwrite d0/da/dc/fe [0,4194304] 0 2024-09-12T22:33:10.784 INFO:tasks.workunit.client.0.smithi019.stdout:0/48: fdatasync d1/fc 0 2024-09-12T22:33:10.784 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:33:10.785 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:33:10.785 INFO:tasks.workunit.client.0.smithi019.stdout:1/53: truncate d3/fb 2280868 0 2024-09-12T22:33:10.785 INFO:tasks.workunit.client.0.smithi019.stdout:4/53: chown d1/d4/f13 126 1 2024-09-12T22:33:10.785 INFO:tasks.workunit.client.0.smithi019.stdout:5/55: mknod d0/d7/cf 0 2024-09-12T22:33:10.786 INFO:tasks.workunit.client.0.smithi019.stdout:0/49: chown d1/c4 1 1 2024-09-12T22:33:10.787 INFO:tasks.workunit.client.0.smithi019.stdout:5/56: mknod d0/dc/de/c10 0 2024-09-12T22:33:10.787 INFO:tasks.workunit.client.0.smithi019.stdout:0/50: write d1/fc [573048,67381] 0 2024-09-12T22:33:10.787 INFO:tasks.workunit.client.0.smithi019.stdout:0/51: write d1/fd [514768,42752] 0 2024-09-12T22:33:10.789 INFO:tasks.workunit.client.0.smithi019.stdout:6/43: dread fa [0,4194304] 0 2024-09-12T22:33:10.789 INFO:tasks.workunit.client.0.smithi019.stdout:0/52: mknod d1/cf 0 2024-09-12T22:33:10.789 INFO:tasks.workunit.client.0.smithi019.stdout:6/44: mknod c11 0 2024-09-12T22:33:10.790 INFO:tasks.workunit.client.0.smithi019.stdout:0/53: write d1/fb [630902,9346] 0 2024-09-12T22:33:10.790 INFO:tasks.workunit.client.0.smithi019.stdout:6/45: chown fb 3318 1 2024-09-12T22:33:10.790 INFO:tasks.workunit.client.0.smithi019.stdout:2/49: dwrite d0/f1 [4194304,4194304] 0 2024-09-12T22:33:10.791 INFO:tasks.workunit.client.0.smithi019.stdout:6/46: symlink l12 0 2024-09-12T22:33:10.791 INFO:tasks.workunit.client.0.smithi019.stdout:2/50: mknod d0/d5/cf 0 2024-09-12T22:33:10.792 INFO:tasks.workunit.client.0.smithi019.stdout:0/54: rename d1/ce to d1/c10 0 2024-09-12T22:33:10.793 INFO:tasks.workunit.client.0.smithi019.stdout:6/47: rename c5 to c13 0 2024-09-12T22:33:10.793 INFO:tasks.workunit.client.0.smithi019.stdout:0/55: write d1/fc [1337042,28543] 0 2024-09-12T22:33:10.794 INFO:tasks.workunit.client.0.smithi019.stdout:0/56: mknod d1/c11 0 2024-09-12T22:33:10.794 INFO:tasks.workunit.client.0.smithi019.stdout:6/48: link c4 c14 0 2024-09-12T22:33:10.795 INFO:tasks.workunit.client.0.smithi019.stdout:5/57: dwrite d0/d7/fd [0,4194304] 0 2024-09-12T22:33:10.795 INFO:tasks.workunit.client.0.smithi019.stdout:0/57: rename d1 to d1/d12 22 2024-09-12T22:33:10.796 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:33:10.797 INFO:tasks.workunit.client.0.smithi019.stdout:6/49: write f3 [4407313,31129] 0 2024-09-12T22:33:10.797 INFO:tasks.workunit.client.0.smithi019.stdout:0/58: truncate d1/fd 636266 0 2024-09-12T22:33:10.797 INFO:tasks.workunit.client.0.smithi019.stdout:6/50: creat f15 x:0 0 0 2024-09-12T22:33:10.798 INFO:tasks.workunit.client.0.smithi019.stdout:0/59: symlink d1/l13 0 2024-09-12T22:33:10.800 INFO:tasks.workunit.client.0.smithi019.stdout:0/60: mkdir d1/d14 0 2024-09-12T22:33:10.800 INFO:tasks.workunit.client.0.smithi019.stdout:2/51: dwrite d0/da/dc/fe [0,4194304] 0 2024-09-12T22:33:10.801 INFO:tasks.workunit.client.0.smithi019.stdout:0/61: readlink d1/l13 0 2024-09-12T22:33:10.802 INFO:tasks.workunit.client.0.smithi019.stdout:5/58: dread d0/f6 [0,4194304] 0 2024-09-12T22:33:10.802 INFO:tasks.workunit.client.0.smithi019.stdout:0/62: rename d1/d14 to d1/d14/d15 22 2024-09-12T22:33:10.804 INFO:tasks.workunit.client.0.smithi019.stdout:1/54: dread d3/fb [0,4194304] 0 2024-09-12T22:33:10.804 INFO:tasks.workunit.client.0.smithi019.stdout:5/59: write d0/d7/fd [21782,99957] 0 2024-09-12T22:33:10.805 INFO:tasks.workunit.client.0.smithi019.stdout:0/63: read d1/fc [328529,40746] 0 2024-09-12T22:33:10.805 INFO:tasks.workunit.client.0.smithi019.stdout:1/55: mknod d3/d11/c12 0 2024-09-12T22:33:10.806 INFO:tasks.workunit.client.0.smithi019.stdout:6/51: dwrite fb [0,4194304] 0 2024-09-12T22:33:10.806 INFO:tasks.workunit.client.0.smithi019.stdout:5/60: creat d0/d7/f11 x:0 0 0 2024-09-12T22:33:10.806 INFO:tasks.workunit.client.0.smithi019.stdout:1/56: fdatasync d3/f9 0 2024-09-12T22:33:10.807 INFO:tasks.workunit.client.0.smithi019.stdout:0/64: symlink d1/d14/l16 0 2024-09-12T22:33:10.807 INFO:tasks.workunit.client.0.smithi019.stdout:6/52: unlink f15 0 2024-09-12T22:33:10.807 INFO:tasks.workunit.client.0.smithi019.stdout:1/57: write d3/f9 [5005195,45361] 0 2024-09-12T22:33:10.809 INFO:tasks.workunit.client.0.smithi019.stdout:0/65: rename d1/fc to d1/d14/f17 0 2024-09-12T22:33:10.809 INFO:tasks.workunit.client.0.smithi019.stdout:2/52: dread d0/f1 [0,4194304] 0 2024-09-12T22:33:10.809 INFO:tasks.workunit.client.0.smithi019.stdout:1/58: symlink d3/df/l13 0 2024-09-12T22:33:10.811 INFO:tasks.workunit.client.0.smithi019.stdout:1/59: dread d3/fb [0,4194304] 0 2024-09-12T22:33:10.811 INFO:tasks.workunit.client.0.smithi019.stdout:1/60: stat c0 0 2024-09-12T22:33:10.812 INFO:tasks.workunit.client.0.smithi019.stdout:1/61: creat d3/f14 x:0 0 0 2024-09-12T22:33:10.812 INFO:tasks.workunit.client.0.smithi019.stdout:1/62: symlink d3/l15 0 2024-09-12T22:33:10.813 INFO:tasks.workunit.client.0.smithi019.stdout:1/63: unlink d3/la 0 2024-09-12T22:33:10.814 INFO:tasks.workunit.client.0.smithi019.stdout:1/64: mkdir d3/d11/d16 0 2024-09-12T22:33:10.814 INFO:tasks.workunit.client.0.smithi019.stdout:0/66: dread d1/fd [0,4194304] 0 2024-09-12T22:33:10.815 INFO:tasks.workunit.client.0.smithi019.stdout:1/65: link l2 d3/d11/d16/l17 0 2024-09-12T22:33:10.815 INFO:tasks.workunit.client.0.smithi019.stdout:6/53: truncate f3 662622 0 2024-09-12T22:33:10.816 INFO:tasks.workunit.client.0.smithi019.stdout:2/53: truncate d0/da/dc/fe 1508244 0 2024-09-12T22:33:10.816 INFO:tasks.workunit.client.0.smithi019.stdout:1/66: chown d3/df 3 1 2024-09-12T22:33:10.816 INFO:tasks.workunit.client.0.smithi019.stdout:6/54: symlink l16 0 2024-09-12T22:33:10.817 INFO:tasks.workunit.client.0.smithi019.stdout:5/61: dwrite d0/f2 [0,4194304] 0 2024-09-12T22:33:10.817 INFO:tasks.workunit.client.0.smithi019.stdout:1/67: symlink d3/l18 0 2024-09-12T22:33:10.818 INFO:tasks.workunit.client.0.smithi019.stdout:5/62: link d0/c4 d0/c12 0 2024-09-12T22:33:10.819 INFO:tasks.workunit.client.0.smithi019.stdout:5/63: write d0/d7/f11 [22808,35355] 0 2024-09-12T22:33:10.819 INFO:tasks.workunit.client.0.smithi019.stdout:5/64: fsync d0/d7/fd 0 2024-09-12T22:33:10.820 INFO:tasks.workunit.client.0.smithi019.stdout:5/65: write d0/f2 [992571,51329] 0 2024-09-12T22:33:10.821 INFO:tasks.workunit.client.0.smithi019.stdout:5/66: rename d0/c12 to d0/dc/de/c13 0 2024-09-12T22:33:10.822 INFO:tasks.workunit.client.0.smithi019.stdout:6/55: dread f3 [0,4194304] 0 2024-09-12T22:33:10.822 INFO:tasks.workunit.client.0.smithi019.stdout:6/56: readlink le 0 2024-09-12T22:33:10.823 INFO:tasks.workunit.client.0.smithi019.stdout:6/57: rename fa to f17 0 2024-09-12T22:33:10.823 INFO:tasks.workunit.client.0.smithi019.stdout:5/67: dread d0/d7/f11 [0,4194304] 0 2024-09-12T22:33:10.824 INFO:tasks.workunit.client.0.smithi019.stdout:6/58: rename c13 to c18 0 2024-09-12T22:33:10.824 INFO:tasks.workunit.client.0.smithi019.stdout:6/59: fdatasync fb 0 2024-09-12T22:33:10.825 INFO:tasks.workunit.client.0.smithi019.stdout:2/54: dwrite d0/da/dc/fe [0,4194304] 0 2024-09-12T22:33:10.826 INFO:tasks.workunit.client.0.smithi019.stdout:6/60: dread f17 [0,4194304] 0 2024-09-12T22:33:10.826 INFO:tasks.workunit.client.0.smithi019.stdout:2/55: creat d0/d5/f10 x:0 0 0 2024-09-12T22:33:10.827 INFO:tasks.workunit.client.0.smithi019.stdout:6/61: write f3 [928841,37736] 0 2024-09-12T22:33:10.828 INFO:tasks.workunit.client.0.smithi019.stdout:6/62: unlink c14 0 2024-09-12T22:33:10.828 INFO:tasks.workunit.client.0.smithi019.stdout:5/68: dread d0/d7/fd [0,4194304] 0 2024-09-12T22:33:10.828 INFO:tasks.workunit.client.0.smithi019.stdout:6/63: creat f19 x:0 0 0 2024-09-12T22:33:10.829 INFO:tasks.workunit.client.0.smithi019.stdout:5/69: unlink d0/dc/de/c10 0 2024-09-12T22:33:10.829 INFO:tasks.workunit.client.0.smithi019.stdout:6/64: truncate f9 217510 0 2024-09-12T22:33:10.830 INFO:tasks.workunit.client.0.smithi019.stdout:6/65: write f3 [639250,102560] 0 2024-09-12T22:33:10.830 INFO:tasks.workunit.client.0.smithi019.stdout:5/70: write d0/d7/f11 [203800,107783] 0 2024-09-12T22:33:10.831 INFO:tasks.workunit.client.0.smithi019.stdout:6/66: mknod c1a 0 2024-09-12T22:33:10.832 INFO:tasks.workunit.client.0.smithi019.stdout:5/71: creat d0/f14 x:0 0 0 2024-09-12T22:33:10.832 INFO:tasks.workunit.client.0.smithi019.stdout:2/56: dwrite d0/da/dc/fe [0,4194304] 0 2024-09-12T22:33:10.832 INFO:tasks.workunit.client.0.smithi019.stdout:6/67: dread f17 [0,4194304] 0 2024-09-12T22:33:10.834 INFO:tasks.workunit.client.0.smithi019.stdout:2/57: creat d0/f11 x:0 0 0 2024-09-12T22:33:10.834 INFO:tasks.workunit.client.0.smithi019.stdout:6/68: dread f17 [0,4194304] 0 2024-09-12T22:33:10.835 INFO:tasks.workunit.client.0.smithi019.stdout:6/69: rmdir - no directory 2024-09-12T22:33:10.836 INFO:tasks.workunit.client.0.smithi019.stdout:6/70: write f19 [293561,35865] 0 2024-09-12T22:33:10.836 INFO:tasks.workunit.client.0.smithi019.stdout:2/58: mknod d0/da/dc/c12 0 2024-09-12T22:33:10.837 INFO:tasks.workunit.client.0.smithi019.stdout:6/71: mkdir d1b 0 2024-09-12T22:33:10.837 INFO:tasks.workunit.client.0.smithi019.stdout:1/68: dwrite d3/fb [0,4194304] 0 2024-09-12T22:33:10.837 INFO:tasks.workunit.client.0.smithi019.stdout:2/59: write d0/f11 [98514,123117] 0 2024-09-12T22:33:10.840 INFO:tasks.workunit.client.0.smithi019.stdout:5/72: dwrite d0/d7/fd [0,4194304] 0 2024-09-12T22:33:10.844 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:10.843+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:10.844 INFO:tasks.workunit.client.0.smithi019.stdout:6/72: dwrite f9 [0,4194304] 0 2024-09-12T22:33:10.845 INFO:tasks.workunit.client.0.smithi019.stdout:2/60: dread d0/f1 [0,4194304] 0 2024-09-12T22:33:10.847 INFO:tasks.workunit.client.0.smithi019.stdout:6/73: mknod d1b/c1c 0 2024-09-12T22:33:10.849 INFO:tasks.workunit.client.0.smithi019.stdout:6/74: fdatasync f17 0 2024-09-12T22:33:10.849 INFO:tasks.workunit.client.0.smithi019.stdout:5/73: dwrite d0/f14 [0,4194304] 0 2024-09-12T22:33:10.849 INFO:tasks.workunit.client.0.smithi019.stdout:1/69: dwrite d3/fe [0,4194304] 0 2024-09-12T22:33:10.850 INFO:tasks.workunit.client.0.smithi019.stdout:5/74: symlink d0/d7/l15 0 2024-09-12T22:33:10.850 INFO:tasks.workunit.client.0.smithi019.stdout:1/70: read - d3/f14 zero size 2024-09-12T22:33:10.850 INFO:tasks.workunit.client.0.smithi019.stdout:6/75: write f19 [224814,93095] 0 2024-09-12T22:33:10.851 INFO:tasks.workunit.client.0.smithi019.stdout:2/61: dread d0/d5/fb [0,4194304] 0 2024-09-12T22:33:10.852 INFO:tasks.workunit.client.0.smithi019.stdout:1/71: mkdir d3/d11/d16/d19 0 2024-09-12T22:33:10.852 INFO:tasks.workunit.client.0.smithi019.stdout:2/62: creat d0/d5/f13 x:0 0 0 2024-09-12T22:33:10.853 INFO:tasks.workunit.client.0.smithi019.stdout:2/63: rmdir d0 39 2024-09-12T22:33:10.853 INFO:tasks.workunit.client.0.smithi019.stdout:1/72: write d3/fb [3504737,86303] 0 2024-09-12T22:33:10.854 INFO:tasks.workunit.client.0.smithi019.stdout:6/76: dread f9 [0,4194304] 0 2024-09-12T22:33:10.854 INFO:tasks.workunit.client.0.smithi019.stdout:1/73: rmdir d3/df 39 2024-09-12T22:33:10.854 INFO:tasks.workunit.client.0.smithi019.stdout:2/64: write d0/d5/f13 [761296,65958] 0 2024-09-12T22:33:10.855 INFO:tasks.workunit.client.0.smithi019.stdout:2/65: creat d0/da/dc/f14 x:0 0 0 2024-09-12T22:33:10.857 INFO:tasks.workunit.client.0.smithi019.stdout:1/74: dread d3/fb [0,4194304] 0 2024-09-12T22:33:10.858 INFO:tasks.workunit.client.0.smithi019.stdout:6/77: truncate f9 3279478 0 2024-09-12T22:33:10.859 INFO:tasks.workunit.client.0.smithi019.stdout:5/75: truncate d0/f14 1625716 0 2024-09-12T22:33:10.859 INFO:tasks.workunit.client.0.smithi019.stdout:1/75: rmdir d3/d11 39 2024-09-12T22:33:10.860 INFO:tasks.workunit.client.0.smithi019.stdout:5/76: write d0/d7/f11 [988960,39049] 0 2024-09-12T22:33:10.861 INFO:tasks.workunit.client.0.smithi019.stdout:1/76: mknod d3/d11/d16/d19/c1a 0 2024-09-12T22:33:10.861 INFO:tasks.workunit.client.0.smithi019.stdout:5/77: mkdir d0/d7/d16 0 2024-09-12T22:33:10.862 INFO:tasks.workunit.client.0.smithi019.stdout:5/78: symlink d0/dc/l17 0 2024-09-12T22:33:10.862 INFO:tasks.workunit.client.0.smithi019.stdout:1/77: rmdir d3/df 39 2024-09-12T22:33:10.862 INFO:tasks.workunit.client.0.smithi019.stdout:2/66: dwrite d0/da/dc/f14 [0,4194304] 0 2024-09-12T22:33:10.863 INFO:tasks.workunit.client.0.smithi019.stdout:5/79: stat d0/dc/l17 0 2024-09-12T22:33:10.863 INFO:tasks.workunit.client.0.smithi019.stdout:1/78: mkdir d3/d1b 0 2024-09-12T22:33:10.863 INFO:tasks.workunit.client.0.smithi019.stdout:5/80: fdatasync d0/d7/f11 0 2024-09-12T22:33:10.863 INFO:tasks.workunit.client.0.smithi019.stdout:2/67: rename d0/c4 to d0/c15 0 2024-09-12T22:33:10.864 INFO:tasks.workunit.client.0.smithi019.stdout:1/79: chown d3/l15 5756 1 2024-09-12T22:33:10.864 INFO:tasks.workunit.client.0.smithi019.stdout:5/81: rename d0/dc/de to d0/d7/d16/d18 0 2024-09-12T22:33:10.865 INFO:tasks.workunit.client.0.smithi019.stdout:1/80: mkdir d3/d11/d1c 0 2024-09-12T22:33:10.865 INFO:tasks.workunit.client.0.smithi019.stdout:5/82: fsync d0/d7/fd 0 2024-09-12T22:33:10.866 INFO:tasks.workunit.client.0.smithi019.stdout:1/81: write d3/fe [3555083,23034] 0 2024-09-12T22:33:10.868 INFO:tasks.workunit.client.0.smithi019.stdout:5/83: creat d0/d7/d16/d18/f19 x:0 0 0 2024-09-12T22:33:10.869 INFO:tasks.workunit.client.0.smithi019.stdout:1/82: write d3/f9 [2703745,37900] 0 2024-09-12T22:33:10.869 INFO:tasks.workunit.client.0.smithi019.stdout:5/84: write d0/f2 [980941,99756] 0 2024-09-12T22:33:10.871 INFO:tasks.workunit.client.0.smithi019.stdout:6/78: dwrite f9 [0,4194304] 0 2024-09-12T22:33:10.872 INFO:tasks.workunit.client.0.smithi019.stdout:1/83: write d3/f9 [2521870,100843] 0 2024-09-12T22:33:10.872 INFO:tasks.workunit.client.0.smithi019.stdout:2/68: dwrite d0/d5/fb [4194304,4194304] 0 2024-09-12T22:33:10.872 INFO:tasks.workunit.client.0.smithi019.stdout:6/79: chown l10 13071 1 2024-09-12T22:33:10.873 INFO:tasks.workunit.client.0.smithi019.stdout:6/80: rename c6 to d1b/c1d 0 2024-09-12T22:33:10.873 INFO:tasks.workunit.client.0.smithi019.stdout:2/69: creat d0/f16 x:0 0 0 2024-09-12T22:33:10.874 INFO:tasks.workunit.client.0.smithi019.stdout:6/81: creat d1b/f1e x:0 0 0 2024-09-12T22:33:10.876 INFO:tasks.workunit.client.0.smithi019.stdout:5/85: dwrite d0/f2 [0,4194304] 0 2024-09-12T22:33:10.876 INFO:tasks.workunit.client.0.smithi019.stdout:6/82: symlink d1b/l1f 0 2024-09-12T22:33:10.878 INFO:tasks.workunit.client.0.smithi019.stdout:5/86: creat d0/f1a x:0 0 0 2024-09-12T22:33:10.878 INFO:tasks.workunit.client.0.smithi019.stdout:6/83: rename f17 to d1b/f20 0 2024-09-12T22:33:10.880 INFO:tasks.workunit.client.0.smithi019.stdout:5/87: mknod d0/d7/d16/d18/c1b 0 2024-09-12T22:33:10.880 INFO:tasks.workunit.client.0.smithi019.stdout:6/84: truncate d1b/f1e 1040586 0 2024-09-12T22:33:10.882 INFO:tasks.workunit.client.0.smithi019.stdout:2/70: dwrite d0/d5/f10 [0,4194304] 0 2024-09-12T22:33:10.883 INFO:tasks.workunit.client.0.smithi019.stdout:2/71: rename d0/da/dc to d0/d5/d17 0 2024-09-12T22:33:10.884 INFO:tasks.workunit.client.0.smithi019.stdout:2/72: mkdir d0/d5/d18 0 2024-09-12T22:33:10.885 INFO:tasks.workunit.client.0.smithi019.stdout:6/85: dread f9 [0,4194304] 0 2024-09-12T22:33:10.885 INFO:tasks.workunit.client.0.smithi019.stdout:1/84: fdatasync d3/f9 0 2024-09-12T22:33:10.887 INFO:tasks.workunit.client.0.smithi019.stdout:6/86: link c4 d1b/c21 0 2024-09-12T22:33:10.889 INFO:tasks.workunit.client.0.smithi019.stdout:6/87: creat d1b/f22 x:0 0 0 2024-09-12T22:33:10.889 INFO:tasks.workunit.client.0.smithi019.stdout:2/73: dread d0/d5/f10 [0,4194304] 0 2024-09-12T22:33:10.891 INFO:tasks.workunit.client.0.smithi019.stdout:6/88: truncate fb 3363605 0 2024-09-12T22:33:10.891 INFO:tasks.workunit.client.0.smithi019.stdout:1/85: dwrite d3/fe [0,4194304] 0 2024-09-12T22:33:10.892 INFO:tasks.workunit.client.0.smithi019.stdout:6/89: creat d1b/f23 x:0 0 0 2024-09-12T22:33:10.892 INFO:tasks.workunit.client.0.smithi019.stdout:2/74: dread d0/f11 [0,4194304] 0 2024-09-12T22:33:10.892 INFO:tasks.workunit.client.0.smithi019.stdout:2/75: mknod d0/da/c19 0 2024-09-12T22:33:10.893 INFO:tasks.workunit.client.0.smithi019.stdout:2/76: write d0/f1 [8139418,48104] 0 2024-09-12T22:33:10.894 INFO:tasks.workunit.client.0.smithi019.stdout:2/77: symlink d0/d5/d18/l1a 0 2024-09-12T22:33:10.895 INFO:tasks.workunit.client.0.smithi019.stdout:2/78: mkdir d0/d5/d18/d1b 0 2024-09-12T22:33:10.895 INFO:tasks.workunit.client.0.smithi019.stdout:5/88: fsync d0/f2 0 2024-09-12T22:33:10.896 INFO:tasks.workunit.client.0.smithi019.stdout:5/89: creat d0/d7/f1c x:0 0 0 2024-09-12T22:33:10.900 INFO:tasks.workunit.client.0.smithi019.stdout:2/79: dwrite d0/f11 [0,4194304] 0 2024-09-12T22:33:10.902 INFO:tasks.workunit.client.0.smithi019.stdout:5/90: dwrite d0/d7/d16/d18/f19 [0,4194304] 0 2024-09-12T22:33:10.902 INFO:tasks.workunit.client.0.smithi019.stdout:2/80: creat d0/d5/d18/d1b/f1c x:0 0 0 2024-09-12T22:33:10.904 INFO:tasks.workunit.client.0.smithi019.stdout:2/81: write d0/d5/f13 [1345257,92843] 0 2024-09-12T22:33:10.905 INFO:tasks.workunit.client.0.smithi019.stdout:2/82: unlink d0/f1 0 2024-09-12T22:33:10.906 INFO:tasks.workunit.client.0.smithi019.stdout:2/83: unlink d0/d5/f13 0 2024-09-12T22:33:10.907 INFO:tasks.workunit.client.0.smithi019.stdout:2/84: chown d0/c6 1 1 2024-09-12T22:33:10.908 INFO:tasks.workunit.client.0.smithi019.stdout:2/85: read d0/d5/d17/f14 [1146734,110066] 0 2024-09-12T22:33:10.909 INFO:tasks.workunit.client.0.smithi019.stdout:5/91: dwrite d0/f1a [0,4194304] 0 2024-09-12T22:33:10.909 INFO:tasks.workunit.client.0.smithi019.stdout:2/86: write d0/f11 [440015,86970] 0 2024-09-12T22:33:10.910 INFO:tasks.workunit.client.0.smithi019.stdout:5/92: creat d0/d7/f1d x:0 0 0 2024-09-12T22:33:10.910 INFO:tasks.workunit.client.0.smithi019.stdout:5/93: mknod d0/dc/c1e 0 2024-09-12T22:33:10.911 INFO:tasks.workunit.client.0.smithi019.stdout:5/94: rename d0/d7/f11 to d0/d7/f1f 0 2024-09-12T22:33:10.912 INFO:tasks.workunit.client.0.smithi019.stdout:5/95: creat d0/d7/f20 x:0 0 0 2024-09-12T22:33:10.912 INFO:tasks.workunit.client.0.smithi019.stdout:5/96: chown d0 20 1 2024-09-12T22:33:10.913 INFO:tasks.workunit.client.0.smithi019.stdout:5/97: creat d0/dc/f21 x:0 0 0 2024-09-12T22:33:10.916 INFO:tasks.workunit.client.0.smithi019.stdout:5/98: dread d0/f2 [0,4194304] 0 2024-09-12T22:33:10.918 INFO:tasks.workunit.client.0.smithi019.stdout:2/87: rename d0/d5/fb to d0/d5/d17/f1d 0 2024-09-12T22:33:10.921 INFO:tasks.workunit.client.0.smithi019.stdout:5/99: dwrite d0/f2 [0,4194304] 0 2024-09-12T22:33:10.921 INFO:tasks.workunit.client.0.smithi019.stdout:5/100: creat d0/f22 x:0 0 0 2024-09-12T22:33:10.922 INFO:tasks.workunit.client.0.smithi019.stdout:2/88: truncate d0/d5/d17/f1d 3794902 0 2024-09-12T22:33:10.923 INFO:tasks.workunit.client.0.smithi019.stdout:2/89: rename d0/c6 to d0/d5/d17/c1e 0 2024-09-12T22:33:10.923 INFO:tasks.workunit.client.0.smithi019.stdout:2/90: chown d0/d5/cf 21 1 2024-09-12T22:33:10.924 INFO:tasks.workunit.client.0.smithi019.stdout:2/91: rename d0/f16 to d0/f1f 0 2024-09-12T22:33:10.925 INFO:tasks.workunit.client.0.smithi019.stdout:2/92: fdatasync d0/d5/f10 0 2024-09-12T22:33:10.926 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:33:10.926 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:33:10.937 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:33:10.938 INFO:tasks.workunit.client.0.smithi019.stdout:5/101: fsync d0/f2 0 2024-09-12T22:33:10.938 INFO:tasks.workunit.client.0.smithi019.stdout:5/102: stat d0/f6 0 2024-09-12T22:33:10.940 INFO:tasks.workunit.client.0.smithi019.stdout:5/103: dread d0/f1a [0,4194304] 0 2024-09-12T22:33:10.942 INFO:tasks.workunit.client.0.smithi019.stdout:5/104: dread d0/d7/fd [0,4194304] 0 2024-09-12T22:33:10.943 INFO:tasks.workunit.client.0.smithi019.stdout:5/105: creat d0/f23 x:0 0 0 2024-09-12T22:33:10.943 INFO:tasks.workunit.client.0.smithi019.stdout:5/106: mkdir d0/dc/d24 0 2024-09-12T22:33:10.944 INFO:tasks.workunit.client.0.smithi019.stdout:5/107: symlink d0/l25 0 2024-09-12T22:33:10.944 INFO:tasks.workunit.client.0.smithi019.stdout:5/108: unlink d0/f14 0 2024-09-12T22:33:10.945 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:10.944+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:10.948 INFO:tasks.workunit.client.0.smithi019.stdout:5/109: dwrite d0/d7/f1d [0,4194304] 0 2024-09-12T22:33:10.949 INFO:tasks.workunit.client.0.smithi019.stdout:5/110: fdatasync d0/d7/fd 0 2024-09-12T22:33:10.950 INFO:tasks.workunit.client.0.smithi019.stdout:5/111: unlink d0/c4 0 2024-09-12T22:33:10.955 INFO:tasks.workunit.client.0.smithi019.stdout:5/112: dwrite d0/d7/fd [4194304,4194304] 0 2024-09-12T22:33:10.956 INFO:tasks.workunit.client.0.smithi019.stdout:5/113: creat d0/d7/d16/d18/f26 x:0 0 0 2024-09-12T22:33:10.957 INFO:tasks.workunit.client.0.smithi019.stdout:5/114: getdents d0/d7 0 2024-09-12T22:33:10.958 INFO:tasks.workunit.client.0.smithi019.stdout:5/115: rename d0/la to d0/d7/d16/l27 0 2024-09-12T22:33:10.960 INFO:tasks.workunit.client.0.smithi019.stdout:5/116: dread d0/d7/f1d [0,4194304] 0 2024-09-12T22:33:10.961 INFO:tasks.workunit.client.0.smithi019.stdout:5/117: rmdir d0 39 2024-09-12T22:33:10.966 INFO:tasks.workunit.client.0.smithi019.stdout:5/118: creat d0/d7/d16/d18/f28 x:0 0 0 2024-09-12T22:33:10.966 INFO:tasks.workunit.client.0.smithi019.stdout:5/119: symlink d0/l29 0 2024-09-12T22:33:10.967 INFO:tasks.workunit.client.0.smithi019.stdout:5/120: creat d0/d7/d16/f2a x:0 0 0 2024-09-12T22:33:10.968 INFO:tasks.workunit.client.0.smithi019.stdout:5/121: write d0/d7/f1f [122989,128246] 0 2024-09-12T22:33:10.969 INFO:tasks.workunit.client.0.smithi019.stdout:5/122: creat d0/d7/d16/f2b x:0 0 0 2024-09-12T22:33:10.969 INFO:tasks.workunit.client.0.smithi019.stdout:5/123: fsync d0/f2 0 2024-09-12T22:33:10.969 INFO:tasks.workunit.client.0.smithi019.stdout:5/124: chown d0/d7/f1c 270847358 1 2024-09-12T22:33:10.970 INFO:tasks.workunit.client.0.smithi019.stdout:5/125: mknod d0/dc/d24/c2c 0 2024-09-12T22:33:10.970 INFO:tasks.workunit.client.0.smithi019.stdout:5/126: mkdir d0/d7/d2d 0 2024-09-12T22:33:10.971 INFO:tasks.workunit.client.0.smithi019.stdout:5/127: creat d0/d7/f2e x:0 0 0 2024-09-12T22:33:10.971 INFO:tasks.workunit.client.0.smithi019.stdout:5/128: chown d0/d7 871 1 2024-09-12T22:33:10.971 INFO:tasks.workunit.client.0.smithi019.stdout:5/129: chown d0/l29 12075 1 2024-09-12T22:33:10.972 INFO:tasks.workunit.client.0.smithi019.stdout:5/130: write d0/f2 [599425,61117] 0 2024-09-12T22:33:10.972 INFO:tasks.workunit.client.0.smithi019.stdout:5/131: unlink d0/f22 0 2024-09-12T22:33:10.973 INFO:tasks.workunit.client.0.smithi019.stdout:5/132: write d0/d7/d16/d18/f28 [561877,94318] 0 2024-09-12T22:33:10.974 INFO:tasks.workunit.client.0.smithi019.stdout:5/133: link d0/d7/d16/d18/c13 d0/dc/c2f 0 2024-09-12T22:33:10.974 INFO:tasks.workunit.client.0.smithi019.stdout:5/134: stat d0/f6 0 2024-09-12T22:33:10.975 INFO:tasks.workunit.client.0.smithi019.stdout:5/135: dread - d0/d7/f20 zero size 2024-09-12T22:33:10.980 INFO:tasks.workunit.client.0.smithi019.stdout:5/136: dwrite d0/dc/f21 [0,4194304] 0 2024-09-12T22:33:10.981 INFO:tasks.workunit.client.0.smithi019.stdout:5/137: unlink d0/d7/fd 0 2024-09-12T22:33:10.982 INFO:tasks.workunit.client.0.smithi019.stdout:5/138: rmdir d0/d7/d16/d18 39 2024-09-12T22:33:10.982 INFO:tasks.workunit.client.0.smithi019.stdout:5/139: symlink d0/d7/l30 0 2024-09-12T22:33:10.983 INFO:tasks.workunit.client.0.smithi019.stdout:5/140: symlink d0/dc/d24/l31 0 2024-09-12T22:33:10.984 INFO:tasks.workunit.client.0.smithi019.stdout:5/141: write d0/d7/f1c [862236,51799] 0 2024-09-12T22:33:10.984 INFO:tasks.workunit.client.0.smithi019.stdout:5/142: chown d0/f23 299 1 2024-09-12T22:33:10.989 INFO:tasks.workunit.client.0.smithi019.stdout:5/143: dwrite d0/dc/f21 [0,4194304] 0 2024-09-12T22:33:10.990 INFO:tasks.workunit.client.0.smithi019.stdout:5/144: mkdir d0/d7/d2d/d32 0 2024-09-12T22:33:10.991 INFO:tasks.workunit.client.0.smithi019.stdout:5/145: chown d0/dc/c2f 39946 1 2024-09-12T22:33:10.992 INFO:tasks.workunit.client.0.smithi019.stdout:5/146: mkdir d0/dc/d24/d33 0 2024-09-12T22:33:10.993 INFO:tasks.workunit.client.0.smithi019.stdout:5/147: write d0/d7/d16/f2b [308733,97241] 0 2024-09-12T22:33:10.996 INFO:tasks.workunit.client.0.smithi019.stdout:5/148: dread d0/d7/f1f [0,4194304] 0 2024-09-12T22:33:10.996 INFO:tasks.workunit.client.0.smithi019.stdout:5/149: write d0/f2 [2978464,97206] 0 2024-09-12T22:33:10.997 INFO:tasks.workunit.client.0.smithi019.stdout:5/150: creat d0/dc/f34 x:0 0 0 2024-09-12T22:33:10.998 INFO:tasks.workunit.client.0.smithi019.stdout:5/151: creat d0/dc/d24/f35 x:0 0 0 2024-09-12T22:33:10.999 INFO:tasks.workunit.client.0.smithi019.stdout:5/152: mkdir d0/d7/d2d/d32/d36 0 2024-09-12T22:33:10.999 INFO:tasks.workunit.client.0.smithi019.stdout:5/153: readlink d0/d7/l15 0 2024-09-12T22:33:11.000 INFO:tasks.workunit.client.0.smithi019.stdout:5/154: write d0/d7/d16/f2a [73540,17212] 0 2024-09-12T22:33:11.000 INFO:tasks.workunit.client.0.smithi019.stdout:5/155: dread - d0/d7/f20 zero size 2024-09-12T22:33:11.001 INFO:tasks.workunit.client.0.smithi019.stdout:5/156: chown d0/d7/d16/d18/f26 12 1 2024-09-12T22:33:11.002 INFO:tasks.workunit.client.0.smithi019.stdout:5/157: getdents d0/d7/d16/d18 0 2024-09-12T22:33:11.002 INFO:tasks.workunit.client.0.smithi019.stdout:5/158: creat d0/f37 x:0 0 0 2024-09-12T22:33:11.003 INFO:tasks.workunit.client.0.smithi019.stdout:5/159: write d0/d7/d16/f2a [677216,90433] 0 2024-09-12T22:33:11.004 INFO:tasks.workunit.client.0.smithi019.stdout:5/160: mkdir d0/dc/d24/d33/d38 0 2024-09-12T22:33:11.007 INFO:tasks.workunit.client.0.smithi019.stdout:5/161: rename d0/dc/d24/d33 to d0/dc/d39 0 2024-09-12T22:33:11.007 INFO:tasks.workunit.client.0.smithi019.stdout:5/162: truncate d0/dc/f34 864534 0 2024-09-12T22:33:11.008 INFO:tasks.workunit.client.0.smithi019.stdout:5/163: symlink d0/dc/d39/d38/l3a 0 2024-09-12T22:33:11.011 INFO:tasks.workunit.client.0.smithi019.stdout:5/164: dread d0/d7/d16/d18/f28 [0,4194304] 0 2024-09-12T22:33:11.012 INFO:tasks.workunit.client.0.smithi019.stdout:5/165: chown d0/f2 731632 1 2024-09-12T22:33:11.012 INFO:tasks.workunit.client.0.smithi019.stdout:5/166: chown d0/lb 89 1 2024-09-12T22:33:11.013 INFO:tasks.workunit.client.0.smithi019.stdout:5/167: write d0/f1a [306473,36689] 0 2024-09-12T22:33:11.015 INFO:tasks.workunit.client.0.smithi019.stdout:5/168: truncate d0/d7/f1f 625954 0 2024-09-12T22:33:11.016 INFO:tasks.workunit.client.0.smithi019.stdout:5/169: symlink d0/d7/d2d/d32/d36/l3b 0 2024-09-12T22:33:11.017 INFO:tasks.workunit.client.0.smithi019.stdout:5/170: write d0/f6 [5233195,103325] 0 2024-09-12T22:33:11.017 INFO:tasks.workunit.client.0.smithi019.stdout:5/171: mkdir d0/d7/d3c 0 2024-09-12T22:33:11.022 INFO:tasks.workunit.client.0.smithi019.stdout:5/172: dwrite d0/dc/f21 [0,4194304] 0 2024-09-12T22:33:11.023 INFO:tasks.workunit.client.0.smithi019.stdout:5/173: symlink d0/dc/d24/l3d 0 2024-09-12T22:33:11.023 INFO:tasks.workunit.client.0.smithi019.stdout:5/174: mknod d0/d7/d2d/d32/c3e 0 2024-09-12T22:33:11.024 INFO:tasks.workunit.client.0.smithi019.stdout:5/175: readlink d0/dc/d39/d38/l3a 0 2024-09-12T22:33:11.024 INFO:tasks.workunit.client.0.smithi019.stdout:5/176: dread - d0/d7/d16/d18/f26 zero size 2024-09-12T22:33:11.027 INFO:tasks.workunit.client.0.smithi019.stdout:5/177: dread d0/d7/f1d [0,4194304] 0 2024-09-12T22:33:11.028 INFO:tasks.workunit.client.0.smithi019.stdout:5/178: creat d0/dc/d39/d38/f3f x:0 0 0 2024-09-12T22:33:11.042 INFO:tasks.workunit.client.0.smithi019.stdout:5/179: dwrite d0/d7/f1f [0,4194304] 0 2024-09-12T22:33:11.045 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:11.044+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:11.047 INFO:tasks.workunit.client.0.smithi019.stdout:5/180: dwrite d0/f6 [0,4194304] 0 2024-09-12T22:33:11.048 INFO:tasks.workunit.client.0.smithi019.stdout:5/181: getdents d0/d7/d16/d18 0 2024-09-12T22:33:11.049 INFO:tasks.workunit.client.0.smithi019.stdout:5/182: fsync d0/f2 0 2024-09-12T22:33:11.050 INFO:tasks.workunit.client.0.smithi019.stdout:5/183: rename d0/dc/c1e to d0/d7/d16/d18/c40 0 2024-09-12T22:33:11.050 INFO:tasks.workunit.client.0.smithi019.stdout:5/184: symlink d0/d7/d2d/d32/l41 0 2024-09-12T22:33:11.051 INFO:tasks.workunit.client.0.smithi019.stdout:5/185: fdatasync d0/f1a 0 2024-09-12T22:33:11.051 INFO:tasks.workunit.client.0.smithi019.stdout:5/186: symlink d0/dc/d39/l42 0 2024-09-12T22:33:11.052 INFO:tasks.workunit.client.0.smithi019.stdout:5/187: truncate d0/d7/d16/d18/f26 942289 0 2024-09-12T22:33:11.053 INFO:tasks.workunit.client.0.smithi019.stdout:5/188: mknod d0/d7/d2d/d32/c43 0 2024-09-12T22:33:11.090 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:33:11.090 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:33:11.098 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:33:11.146 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:11.145+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:11.201 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:33:11.202 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:33:11.210 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:33:11.247 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:11.246+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:11.348 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:11.347+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:11.353 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:33:11.354 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:33:11.362 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:33:11.449 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:11.448+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:11.506 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:33:11.506 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:33:11.510 INFO:teuthology.orchestra.run.smithi019.stderr:nodeep-scrub is set 2024-09-12T22:33:11.516 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:33:11.557 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:11.556+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:11.620 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:33:11.620 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:33:11.629 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:33:11.672 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:11.671+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:11.733 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:33:11.733 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:33:11.741 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:33:11.782 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:11.781+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:11.851 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:11.850+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:11.886 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:33:11.886 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:33:11.894 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:33:11.953 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:11.952+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:11.999 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:33:11.999 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:33:12.008 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:33:12.054 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:12.053+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:12.110 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:33:12.110 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:33:12.119 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:33:12.160 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:12.159+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:12.256 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:12.255+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:12.263 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:33:12.263 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:33:12.271 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:33:12.356 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:12.355+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:12.378 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:33:12.379 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:33:12.387 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:33:12.427 INFO:tasks.workunit.client.0.smithi019.stdout:3/10: sync 2024-09-12T22:33:12.427 INFO:tasks.workunit.client.0.smithi019.stdout:9/38: sync 2024-09-12T22:33:12.427 INFO:tasks.workunit.client.0.smithi019.stdout:5/189: sync 2024-09-12T22:33:12.427 INFO:tasks.workunit.client.0.smithi019.stdout:2/93: sync 2024-09-12T22:33:12.427 INFO:tasks.workunit.client.0.smithi019.stdout:7/13: sync 2024-09-12T22:33:12.427 INFO:tasks.workunit.client.0.smithi019.stdout:1/86: sync 2024-09-12T22:33:12.427 INFO:tasks.workunit.client.0.smithi019.stdout:0/67: sync 2024-09-12T22:33:12.428 INFO:tasks.workunit.client.0.smithi019.stdout:4/54: sync 2024-09-12T22:33:12.428 INFO:tasks.workunit.client.0.smithi019.stdout:6/90: sync 2024-09-12T22:33:12.428 INFO:tasks.workunit.client.0.smithi019.stdout:8/7: sync 2024-09-12T22:33:12.428 INFO:tasks.workunit.client.0.smithi019.stdout:7/14: creat f5 x:0 0 0 2024-09-12T22:33:12.430 INFO:tasks.workunit.client.0.smithi019.stdout:5/190: creat d0/dc/d39/d38/f44 x:0 0 0 2024-09-12T22:33:12.432 INFO:tasks.workunit.client.0.smithi019.stdout:5/191: write d0/f37 [982505,45386] 0 2024-09-12T22:33:12.437 INFO:tasks.workunit.client.0.smithi019.stdout:3/11: dwrite f2 [0,4194304] 0 2024-09-12T22:33:12.438 INFO:tasks.workunit.client.0.smithi019.stdout:9/39: dread f5 [0,4194304] 0 2024-09-12T22:33:12.438 INFO:tasks.workunit.client.0.smithi019.stdout:1/87: creat d3/d1b/f1d x:0 0 0 2024-09-12T22:33:12.438 INFO:tasks.workunit.client.0.smithi019.stdout:6/91: link l12 d1b/l24 0 2024-09-12T22:33:12.438 INFO:tasks.workunit.client.0.smithi019.stdout:2/94: creat d0/d5/d18/f20 x:0 0 0 2024-09-12T22:33:12.438 INFO:tasks.workunit.client.0.smithi019.stdout:6/92: dread - d1b/f23 zero size 2024-09-12T22:33:12.439 INFO:tasks.workunit.client.0.smithi019.stdout:5/192: creat d0/d7/d16/f45 x:0 0 0 2024-09-12T22:33:12.439 INFO:tasks.workunit.client.0.smithi019.stdout:8/8: dwrite f0 [0,4194304] 0 2024-09-12T22:33:12.440 INFO:tasks.workunit.client.0.smithi019.stdout:4/55: dwrite d1/d4/f13 [0,4194304] 0 2024-09-12T22:33:12.440 INFO:tasks.workunit.client.0.smithi019.stdout:1/88: symlink d3/d11/d16/d19/l1e 0 2024-09-12T22:33:12.440 INFO:tasks.workunit.client.0.smithi019.stdout:9/40: creat dd/fe x:0 0 0 2024-09-12T22:33:12.440 INFO:tasks.workunit.client.0.smithi019.stdout:2/95: mknod d0/d5/d17/c21 0 2024-09-12T22:33:12.442 INFO:tasks.workunit.client.0.smithi019.stdout:9/41: mknod dd/cf 0 2024-09-12T22:33:12.442 INFO:tasks.workunit.client.0.smithi019.stdout:6/93: rename d1b/l1f to d1b/l25 0 2024-09-12T22:33:12.442 INFO:tasks.workunit.client.0.smithi019.stdout:2/96: fsync d0/d5/d17/fe 0 2024-09-12T22:33:12.443 INFO:tasks.workunit.client.0.smithi019.stdout:4/56: mkdir d1/d11/d15 0 2024-09-12T22:33:12.443 INFO:tasks.workunit.client.0.smithi019.stdout:9/42: read - dd/fe zero size 2024-09-12T22:33:12.444 INFO:tasks.workunit.client.0.smithi019.stdout:5/193: creat d0/dc/d39/d38/f46 x:0 0 0 2024-09-12T22:33:12.444 INFO:tasks.workunit.client.0.smithi019.stdout:4/57: unlink d1/lf 0 2024-09-12T22:33:12.446 INFO:tasks.workunit.client.0.smithi019.stdout:9/43: mkdir dd/d10 0 2024-09-12T22:33:12.446 INFO:tasks.workunit.client.0.smithi019.stdout:3/12: dread f2 [0,4194304] 0 2024-09-12T22:33:12.446 INFO:tasks.workunit.client.0.smithi019.stdout:4/58: symlink d1/d11/l16 0 2024-09-12T22:33:12.446 INFO:tasks.workunit.client.0.smithi019.stdout:2/97: unlink d0/d5/d17/f1d 0 2024-09-12T22:33:12.448 INFO:tasks.workunit.client.0.smithi019.stdout:8/9: dread f0 [0,4194304] 0 2024-09-12T22:33:12.450 INFO:tasks.workunit.client.0.smithi019.stdout:1/89: dwrite d3/f9 [8388608,4194304] 0 2024-09-12T22:33:12.451 INFO:tasks.workunit.client.0.smithi019.stdout:1/90: read - d3/d1b/f1d zero size 2024-09-12T22:33:12.452 INFO:tasks.workunit.client.0.smithi019.stdout:4/59: symlink d1/l17 0 2024-09-12T22:33:12.452 INFO:tasks.workunit.client.0.smithi019.stdout:2/98: unlink d0/d5/d17/c12 0 2024-09-12T22:33:12.453 INFO:tasks.workunit.client.0.smithi019.stdout:5/194: creat d0/d7/d16/f47 x:0 0 0 2024-09-12T22:33:12.453 INFO:tasks.workunit.client.0.smithi019.stdout:8/10: write f0 [3017131,62793] 0 2024-09-12T22:33:12.457 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:12.456+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:12.459 INFO:tasks.workunit.client.0.smithi019.stdout:2/99: dwrite d0/d5/d18/f20 [0,4194304] 0 2024-09-12T22:33:12.460 INFO:tasks.workunit.client.0.smithi019.stdout:5/195: dread d0/f1a [0,4194304] 0 2024-09-12T22:33:12.460 INFO:tasks.workunit.client.0.smithi019.stdout:8/11: dread f0 [0,4194304] 0 2024-09-12T22:33:12.461 INFO:tasks.workunit.client.0.smithi019.stdout:2/100: fsync d0/d5/d18/d1b/f1c 0 2024-09-12T22:33:12.464 INFO:tasks.workunit.client.0.smithi019.stdout:3/13: link f2 f3 0 2024-09-12T22:33:12.465 INFO:tasks.workunit.client.0.smithi019.stdout:1/91: write d3/f14 [813626,38469] 0 2024-09-12T22:33:12.467 INFO:tasks.workunit.client.0.smithi019.stdout:1/92: write d3/d1b/f1d [279468,16442] 0 2024-09-12T22:33:12.467 INFO:tasks.workunit.client.0.smithi019.stdout:5/196: dwrite d0/d7/f1c [0,4194304] 0 2024-09-12T22:33:12.468 INFO:tasks.workunit.client.0.smithi019.stdout:5/197: readlink d0/dc/d39/l42 0 2024-09-12T22:33:12.472 INFO:tasks.workunit.client.0.smithi019.stdout:0/68: write d1/fd [501659,90764] 0 2024-09-12T22:33:12.472 INFO:tasks.workunit.client.0.smithi019.stdout:7/15: truncate f1 1646059 0 2024-09-12T22:33:12.472 INFO:tasks.workunit.client.0.smithi019.stdout:6/94: truncate f0 2545466 0 2024-09-12T22:33:12.472 INFO:tasks.workunit.client.0.smithi019.stdout:8/12: mknod c2 0 2024-09-12T22:33:12.473 INFO:tasks.workunit.client.0.smithi019.stdout:2/101: write d0/d5/d17/f14 [4424000,122403] 0 2024-09-12T22:33:12.473 INFO:tasks.workunit.client.0.smithi019.stdout:0/69: chown d1/l9 13 1 2024-09-12T22:33:12.473 INFO:tasks.workunit.client.0.smithi019.stdout:4/60: creat d1/d11/d15/f18 x:0 0 0 2024-09-12T22:33:12.473 INFO:tasks.workunit.client.0.smithi019.stdout:3/14: write f3 [5096786,39313] 0 2024-09-12T22:33:12.474 INFO:tasks.workunit.client.0.smithi019.stdout:5/198: creat d0/f48 x:0 0 0 2024-09-12T22:33:12.474 INFO:tasks.workunit.client.0.smithi019.stdout:7/16: mkdir d6 0 2024-09-12T22:33:12.474 INFO:tasks.workunit.client.0.smithi019.stdout:6/95: mkdir d1b/d26 0 2024-09-12T22:33:12.475 INFO:tasks.workunit.client.0.smithi019.stdout:0/70: write d1/fb [442907,92507] 0 2024-09-12T22:33:12.475 INFO:tasks.workunit.client.0.smithi019.stdout:8/13: read f0 [2623755,5012] 0 2024-09-12T22:33:12.475 INFO:tasks.workunit.client.0.smithi019.stdout:3/15: mknod c4 0 2024-09-12T22:33:12.476 INFO:tasks.workunit.client.0.smithi019.stdout:1/93: rename d3/d11/d16/l17 to d3/d1b/l1f 0 2024-09-12T22:33:12.476 INFO:tasks.workunit.client.0.smithi019.stdout:5/199: write d0/f48 [322804,43650] 0 2024-09-12T22:33:12.477 INFO:tasks.workunit.client.0.smithi019.stdout:2/102: creat d0/d5/f22 x:0 0 0 2024-09-12T22:33:12.477 INFO:tasks.workunit.client.0.smithi019.stdout:3/16: creat f5 x:0 0 0 2024-09-12T22:33:12.478 INFO:tasks.workunit.client.0.smithi019.stdout:2/103: stat d0 0 2024-09-12T22:33:12.478 INFO:tasks.workunit.client.0.smithi019.stdout:8/14: creat f3 x:0 0 0 2024-09-12T22:33:12.478 INFO:tasks.workunit.client.0.smithi019.stdout:6/96: mkdir d1b/d26/d27 0 2024-09-12T22:33:12.478 INFO:tasks.workunit.client.0.smithi019.stdout:9/44: dwrite fb [0,4194304] 0 2024-09-12T22:33:12.478 INFO:tasks.workunit.client.0.smithi019.stdout:1/94: symlink d3/d11/d16/l20 0 2024-09-12T22:33:12.480 INFO:tasks.workunit.client.0.smithi019.stdout:5/200: creat d0/f49 x:0 0 0 2024-09-12T22:33:12.480 INFO:tasks.workunit.client.0.smithi019.stdout:8/15: creat f4 x:0 0 0 2024-09-12T22:33:12.481 INFO:tasks.workunit.client.0.smithi019.stdout:1/95: chown d3/d11/d16 247 1 2024-09-12T22:33:12.482 INFO:tasks.workunit.client.0.smithi019.stdout:2/104: fsync d0/f1f 0 2024-09-12T22:33:12.482 INFO:tasks.workunit.client.0.smithi019.stdout:9/45: symlink dd/l11 0 2024-09-12T22:33:12.484 INFO:tasks.workunit.client.0.smithi019.stdout:5/201: mkdir d0/d7/d2d/d32/d4a 0 2024-09-12T22:33:12.484 INFO:tasks.workunit.client.0.smithi019.stdout:2/105: chown d0/d5 78 1 2024-09-12T22:33:12.489 INFO:tasks.workunit.client.0.smithi019.stdout:7/17: dwrite f5 [0,4194304] 0 2024-09-12T22:33:12.489 INFO:tasks.workunit.client.0.smithi019.stdout:4/61: dwrite d1/d8/f14 [0,4194304] 0 2024-09-12T22:33:12.490 INFO:tasks.workunit.client.0.smithi019.stdout:1/96: rename d3/fe to d3/d1b/f21 0 2024-09-12T22:33:12.491 INFO:tasks.workunit.client.0.smithi019.stdout:5/202: mkdir d0/dc/d39/d38/d4b 0 2024-09-12T22:33:12.494 INFO:tasks.workunit.client.0.smithi019.stdout:9/46: getdents dd 0 2024-09-12T22:33:12.494 INFO:tasks.workunit.client.0.smithi019.stdout:4/62: symlink d1/d4/l19 0 2024-09-12T22:33:12.495 INFO:tasks.workunit.client.0.smithi019.stdout:0/71: dwrite d1/f6 [0,4194304] 0 2024-09-12T22:33:12.496 INFO:tasks.workunit.client.0.smithi019.stdout:3/17: dwrite f5 [0,4194304] 0 2024-09-12T22:33:12.496 INFO:tasks.workunit.client.0.smithi019.stdout:2/106: rename d0/d5/d18/l1a to d0/l23 0 2024-09-12T22:33:12.497 INFO:tasks.workunit.client.0.smithi019.stdout:7/18: creat d6/f7 x:0 0 0 2024-09-12T22:33:12.497 INFO:tasks.workunit.client.0.smithi019.stdout:9/47: chown fa 1 1 2024-09-12T22:33:12.497 INFO:tasks.workunit.client.0.smithi019.stdout:6/97: dwrite d1b/f20 [0,4194304] 0 2024-09-12T22:33:12.498 INFO:tasks.workunit.client.0.smithi019.stdout:4/63: symlink d1/d8/l1a 0 2024-09-12T22:33:12.498 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:33:12.498 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:33:12.499 INFO:tasks.workunit.client.0.smithi019.stdout:7/19: mkdir d6/d8 0 2024-09-12T22:33:12.500 INFO:tasks.workunit.client.0.smithi019.stdout:6/98: chown f19 4 1 2024-09-12T22:33:12.500 INFO:tasks.workunit.client.0.smithi019.stdout:1/97: getdents d3 0 2024-09-12T22:33:12.500 INFO:tasks.workunit.client.0.smithi019.stdout:8/16: dwrite f3 [0,4194304] 0 2024-09-12T22:33:12.501 INFO:tasks.workunit.client.0.smithi019.stdout:6/99: chown l8 101681 1 2024-09-12T22:33:12.502 INFO:tasks.workunit.client.0.smithi019.stdout:7/20: read f1 [1474453,129994] 0 2024-09-12T22:33:12.504 INFO:tasks.workunit.client.0.smithi019.stdout:6/100: stat cf 0 2024-09-12T22:33:12.509 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:33:12.510 INFO:tasks.workunit.client.0.smithi019.stdout:5/203: dread d0/d7/f1c [0,4194304] 0 2024-09-12T22:33:12.513 INFO:tasks.workunit.client.0.smithi019.stdout:6/101: symlink d1b/l28 0 2024-09-12T22:33:12.515 INFO:tasks.workunit.client.0.smithi019.stdout:7/21: creat d6/d8/f9 x:0 0 0 2024-09-12T22:33:12.519 INFO:tasks.workunit.client.0.smithi019.stdout:3/18: dread f5 [0,4194304] 0 2024-09-12T22:33:12.520 INFO:tasks.workunit.client.0.smithi019.stdout:4/64: dread d1/d8/fb [0,4194304] 0 2024-09-12T22:33:12.521 INFO:tasks.workunit.client.0.smithi019.stdout:9/48: dwrite dd/fe [0,4194304] 0 2024-09-12T22:33:12.521 INFO:tasks.workunit.client.0.smithi019.stdout:8/17: dread f3 [0,4194304] 0 2024-09-12T22:33:12.521 INFO:tasks.workunit.client.0.smithi019.stdout:0/72: dwrite d1/d14/f17 [0,4194304] 0 2024-09-12T22:33:12.521 INFO:tasks.workunit.client.0.smithi019.stdout:7/22: write d6/f7 [668316,44555] 0 2024-09-12T22:33:12.522 INFO:tasks.workunit.client.0.smithi019.stdout:1/98: dread d3/f9 [4194304,4194304] 0 2024-09-12T22:33:12.527 INFO:tasks.workunit.client.0.smithi019.stdout:7/23: write d6/d8/f9 [987209,124756] 0 2024-09-12T22:33:12.528 INFO:tasks.workunit.client.0.smithi019.stdout:1/99: dread d3/f9 [4194304,4194304] 0 2024-09-12T22:33:12.533 INFO:tasks.workunit.client.0.smithi019.stdout:0/73: dread d1/fb [0,4194304] 0 2024-09-12T22:33:12.533 INFO:tasks.workunit.client.0.smithi019.stdout:0/74: chown d1/d14/f17 22953 1 2024-09-12T22:33:12.537 INFO:tasks.workunit.client.0.smithi019.stdout:5/204: mkdir d0/d7/d2d/d4c 0 2024-09-12T22:33:12.537 INFO:tasks.workunit.client.0.smithi019.stdout:6/102: symlink d1b/d26/l29 0 2024-09-12T22:33:12.537 INFO:tasks.workunit.client.0.smithi019.stdout:3/19: symlink l6 0 2024-09-12T22:33:12.538 INFO:tasks.workunit.client.0.smithi019.stdout:8/18: creat f5 x:0 0 0 2024-09-12T22:33:12.538 INFO:tasks.workunit.client.0.smithi019.stdout:4/65: creat d1/d11/d15/f1b x:0 0 0 2024-09-12T22:33:12.538 INFO:tasks.workunit.client.0.smithi019.stdout:0/75: mknod d1/d14/c18 0 2024-09-12T22:33:12.539 INFO:tasks.workunit.client.0.smithi019.stdout:8/19: chown f5 2 1 2024-09-12T22:33:12.539 INFO:tasks.workunit.client.0.smithi019.stdout:9/49: write f5 [3913805,38290] 0 2024-09-12T22:33:12.539 INFO:tasks.workunit.client.0.smithi019.stdout:5/205: rmdir d0/d7/d2d 39 2024-09-12T22:33:12.540 INFO:tasks.workunit.client.0.smithi019.stdout:6/103: fsync fb 0 2024-09-12T22:33:12.540 INFO:tasks.workunit.client.0.smithi019.stdout:9/50: unlink fa 0 2024-09-12T22:33:12.541 INFO:tasks.workunit.client.0.smithi019.stdout:0/76: write d1/d14/f17 [1029768,40793] 0 2024-09-12T22:33:12.541 INFO:tasks.workunit.client.0.smithi019.stdout:9/51: chown dd 5 1 2024-09-12T22:33:12.541 INFO:tasks.workunit.client.0.smithi019.stdout:8/20: chown f5 0 1 2024-09-12T22:33:12.543 INFO:tasks.workunit.client.0.smithi019.stdout:4/66: getdents d1/d11 0 2024-09-12T22:33:12.543 INFO:tasks.workunit.client.0.smithi019.stdout:9/52: creat dd/f12 x:0 0 0 2024-09-12T22:33:12.543 INFO:tasks.workunit.client.0.smithi019.stdout:6/104: chown d1b/f22 435688582 1 2024-09-12T22:33:12.543 INFO:tasks.workunit.client.0.smithi019.stdout:5/206: truncate d0/d7/f1d 4389195 0 2024-09-12T22:33:12.544 INFO:tasks.workunit.client.0.smithi019.stdout:0/77: write d1/fb [1582933,42808] 0 2024-09-12T22:33:12.545 INFO:tasks.workunit.client.0.smithi019.stdout:9/53: creat dd/d10/f13 x:0 0 0 2024-09-12T22:33:12.547 INFO:tasks.workunit.client.0.smithi019.stdout:4/67: rename d1/d11/d15/f1b to d1/d4/f1c 0 2024-09-12T22:33:12.548 INFO:tasks.workunit.client.0.smithi019.stdout:1/100: dwrite d3/d1b/f21 [0,4194304] 0 2024-09-12T22:33:12.548 INFO:tasks.workunit.client.0.smithi019.stdout:3/20: dwrite f2 [0,4194304] 0 2024-09-12T22:33:12.548 INFO:tasks.workunit.client.0.smithi019.stdout:9/54: chown dd/d10/f13 295204 1 2024-09-12T22:33:12.551 INFO:tasks.workunit.client.0.smithi019.stdout:8/21: dwrite f5 [0,4194304] 0 2024-09-12T22:33:12.552 INFO:tasks.workunit.client.0.smithi019.stdout:8/22: dread - f4 zero size 2024-09-12T22:33:12.553 INFO:tasks.workunit.client.0.smithi019.stdout:0/78: rename d1/d14/c18 to d1/c19 0 2024-09-12T22:33:12.553 INFO:tasks.workunit.client.0.smithi019.stdout:9/55: chown l1 44432 1 2024-09-12T22:33:12.554 INFO:tasks.workunit.client.0.smithi019.stdout:3/21: creat f7 x:0 0 0 2024-09-12T22:33:12.554 INFO:tasks.workunit.client.0.smithi019.stdout:1/101: symlink d3/d1b/l22 0 2024-09-12T22:33:12.556 INFO:tasks.workunit.client.0.smithi019.stdout:1/102: write d3/f14 [1238366,87916] 0 2024-09-12T22:33:12.558 INFO:tasks.workunit.client.0.smithi019.stdout:9/56: dread dd/fe [0,4194304] 0 2024-09-12T22:33:12.558 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:12.557+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:12.559 INFO:tasks.workunit.client.0.smithi019.stdout:9/57: dread fb [4194304,4194304] 0 2024-09-12T22:33:12.560 INFO:tasks.workunit.client.0.smithi019.stdout:9/58: fdatasync dd/fe 0 2024-09-12T22:33:12.560 INFO:tasks.workunit.client.0.smithi019.stdout:8/23: mknod c6 0 2024-09-12T22:33:12.561 INFO:tasks.workunit.client.0.smithi019.stdout:0/79: creat d1/f1a x:0 0 0 2024-09-12T22:33:12.561 INFO:tasks.workunit.client.0.smithi019.stdout:3/22: symlink l8 0 2024-09-12T22:33:12.561 INFO:tasks.workunit.client.0.smithi019.stdout:3/23: rmdir - no directory 2024-09-12T22:33:12.561 INFO:tasks.workunit.client.0.smithi019.stdout:8/24: truncate f4 665488 0 2024-09-12T22:33:12.562 INFO:tasks.workunit.client.0.smithi019.stdout:8/25: chown c6 15 1 2024-09-12T22:33:12.563 INFO:tasks.workunit.client.0.smithi019.stdout:1/103: rename d3/d11/d16/d19 to d3/d11/d16/d23 0 2024-09-12T22:33:12.564 INFO:tasks.workunit.client.0.smithi019.stdout:6/105: truncate fb 1063320 0 2024-09-12T22:33:12.565 INFO:tasks.workunit.client.0.smithi019.stdout:5/207: link d0/d7/d2d/d32/d36/l3b d0/d7/d2d/l4d 0 2024-09-12T22:33:12.565 INFO:tasks.workunit.client.0.smithi019.stdout:0/80: unlink d1/cf 0 2024-09-12T22:33:12.565 INFO:tasks.workunit.client.0.smithi019.stdout:4/68: getdents d1/d11/d15 0 2024-09-12T22:33:12.565 INFO:tasks.workunit.client.0.smithi019.stdout:3/24: link f7 f9 0 2024-09-12T22:33:12.565 INFO:tasks.workunit.client.0.smithi019.stdout:0/81: mkdir d1/d14/d1b 0 2024-09-12T22:33:12.566 INFO:tasks.workunit.client.0.smithi019.stdout:9/59: getdents dd/d10 0 2024-09-12T22:33:12.567 INFO:tasks.workunit.client.0.smithi019.stdout:9/60: chown l1 13387779 1 2024-09-12T22:33:12.569 INFO:tasks.workunit.client.0.smithi019.stdout:0/82: link d1/c4 d1/d14/d1b/c1c 0 2024-09-12T22:33:12.570 INFO:tasks.workunit.client.0.smithi019.stdout:9/61: getdents dd 0 2024-09-12T22:33:12.571 INFO:tasks.workunit.client.0.smithi019.stdout:0/83: stat d1/c11 0 2024-09-12T22:33:12.571 INFO:tasks.workunit.client.0.smithi019.stdout:9/62: stat l7 0 2024-09-12T22:33:12.572 INFO:tasks.workunit.client.0.smithi019.stdout:4/69: dread d1/d4/f13 [0,4194304] 0 2024-09-12T22:33:12.572 INFO:tasks.workunit.client.0.smithi019.stdout:0/84: stat d1/fd 0 2024-09-12T22:33:12.572 INFO:tasks.workunit.client.0.smithi019.stdout:3/25: dread f3 [0,4194304] 0 2024-09-12T22:33:12.573 INFO:tasks.workunit.client.0.smithi019.stdout:1/104: dwrite d3/fb [0,4194304] 0 2024-09-12T22:33:12.573 INFO:tasks.workunit.client.0.smithi019.stdout:8/26: dwrite f0 [0,4194304] 0 2024-09-12T22:33:12.573 INFO:tasks.workunit.client.0.smithi019.stdout:0/85: mkdir d1/d1d 0 2024-09-12T22:33:12.573 INFO:tasks.workunit.client.0.smithi019.stdout:9/63: dread - dd/d10/f13 zero size 2024-09-12T22:33:12.574 INFO:tasks.workunit.client.0.smithi019.stdout:8/27: fsync f4 0 2024-09-12T22:33:12.574 INFO:tasks.workunit.client.0.smithi019.stdout:4/70: write d1/d4/f1c [168092,16689] 0 2024-09-12T22:33:12.575 INFO:tasks.workunit.client.0.smithi019.stdout:1/105: read d3/d1b/f1d [116740,31026] 0 2024-09-12T22:33:12.575 INFO:tasks.workunit.client.0.smithi019.stdout:9/64: rename dd/f12 to dd/d10/f14 0 2024-09-12T22:33:12.576 INFO:tasks.workunit.client.0.smithi019.stdout:4/71: chown d1/l17 2054332499 1 2024-09-12T22:33:12.577 INFO:tasks.workunit.client.0.smithi019.stdout:1/106: fdatasync d3/d1b/f1d 0 2024-09-12T22:33:12.577 INFO:tasks.workunit.client.0.smithi019.stdout:9/65: fsync dd/fe 0 2024-09-12T22:33:12.579 INFO:tasks.workunit.client.0.smithi019.stdout:6/106: dwrite fb [0,4194304] 0 2024-09-12T22:33:12.580 INFO:tasks.workunit.client.0.smithi019.stdout:6/107: stat cf 0 2024-09-12T22:33:12.580 INFO:tasks.workunit.client.0.smithi019.stdout:9/66: unlink fb 0 2024-09-12T22:33:12.581 INFO:tasks.workunit.client.0.smithi019.stdout:1/107: write d3/f9 [11839032,125966] 0 2024-09-12T22:33:12.582 INFO:tasks.workunit.client.0.smithi019.stdout:6/108: mknod d1b/d26/c2a 0 2024-09-12T22:33:12.582 INFO:tasks.workunit.client.0.smithi019.stdout:0/86: dread d1/f6 [0,4194304] 0 2024-09-12T22:33:12.582 INFO:tasks.workunit.client.0.smithi019.stdout:9/67: mknod dd/d10/c15 0 2024-09-12T22:33:12.583 INFO:tasks.workunit.client.0.smithi019.stdout:3/26: dwrite f3 [0,4194304] 0 2024-09-12T22:33:12.583 INFO:tasks.workunit.client.0.smithi019.stdout:6/109: fdatasync d1b/f1e 0 2024-09-12T22:33:12.583 INFO:tasks.workunit.client.0.smithi019.stdout:0/87: chown d1/d14 4978854 1 2024-09-12T22:33:12.584 INFO:tasks.workunit.client.0.smithi019.stdout:2/107: sync 2024-09-12T22:33:12.584 INFO:tasks.workunit.client.0.smithi019.stdout:8/28: dwrite f5 [0,4194304] 0 2024-09-12T22:33:12.586 INFO:tasks.workunit.client.0.smithi019.stdout:1/108: creat d3/d11/d1c/f24 x:0 0 0 2024-09-12T22:33:12.587 INFO:tasks.workunit.client.0.smithi019.stdout:0/88: chown d1/c3 21 1 2024-09-12T22:33:12.587 INFO:tasks.workunit.client.0.smithi019.stdout:2/108: write d0/f1f [850126,65975] 0 2024-09-12T22:33:12.588 INFO:tasks.workunit.client.0.smithi019.stdout:1/109: symlink d3/d1b/l25 0 2024-09-12T22:33:12.589 INFO:tasks.workunit.client.0.smithi019.stdout:0/89: chown d1/ca 14 1 2024-09-12T22:33:12.590 INFO:tasks.workunit.client.0.smithi019.stdout:2/109: dread - d0/d5/d18/d1b/f1c zero size 2024-09-12T22:33:12.592 INFO:tasks.workunit.client.0.smithi019.stdout:4/72: dread d1/d4/f1c [0,4194304] 0 2024-09-12T22:33:12.592 INFO:tasks.workunit.client.0.smithi019.stdout:2/110: write d0/f1f [127377,33498] 0 2024-09-12T22:33:12.593 INFO:tasks.workunit.client.0.smithi019.stdout:0/90: rename d1/f6 to d1/d14/f1e 0 2024-09-12T22:33:12.593 INFO:tasks.workunit.client.0.smithi019.stdout:3/27: dread f3 [0,4194304] 0 2024-09-12T22:33:12.594 INFO:tasks.workunit.client.0.smithi019.stdout:8/29: dread f0 [0,4194304] 0 2024-09-12T22:33:12.594 INFO:tasks.workunit.client.0.smithi019.stdout:6/110: dwrite d1b/f20 [0,4194304] 0 2024-09-12T22:33:12.594 INFO:tasks.workunit.client.0.smithi019.stdout:4/73: readlink d1/d8/l1a 0 2024-09-12T22:33:12.594 INFO:tasks.workunit.client.0.smithi019.stdout:0/91: unlink d1/c4 0 2024-09-12T22:33:12.595 INFO:tasks.workunit.client.0.smithi019.stdout:9/68: dwrite dd/fe [4194304,4194304] 0 2024-09-12T22:33:12.595 INFO:tasks.workunit.client.0.smithi019.stdout:8/30: mkdir d7 0 2024-09-12T22:33:12.595 INFO:tasks.workunit.client.0.smithi019.stdout:2/111: creat d0/da/f24 x:0 0 0 2024-09-12T22:33:12.595 INFO:tasks.workunit.client.0.smithi019.stdout:3/28: symlink la 0 2024-09-12T22:33:12.596 INFO:tasks.workunit.client.0.smithi019.stdout:0/92: mkdir d1/d1f 0 2024-09-12T22:33:12.597 INFO:tasks.workunit.client.0.smithi019.stdout:4/74: write d1/d11/d15/f18 [743553,9329] 0 2024-09-12T22:33:12.597 INFO:tasks.workunit.client.0.smithi019.stdout:9/69: creat dd/f16 x:0 0 0 2024-09-12T22:33:12.597 INFO:tasks.workunit.client.0.smithi019.stdout:3/29: mknod cb 0 2024-09-12T22:33:12.598 INFO:tasks.workunit.client.0.smithi019.stdout:8/31: fdatasync f0 0 2024-09-12T22:33:12.598 INFO:tasks.workunit.client.0.smithi019.stdout:0/93: write d1/fb [506356,50035] 0 2024-09-12T22:33:12.599 INFO:tasks.workunit.client.0.smithi019.stdout:3/30: creat fc x:0 0 0 2024-09-12T22:33:12.599 INFO:tasks.workunit.client.0.smithi019.stdout:4/75: chown d1/le 923079 1 2024-09-12T22:33:12.600 INFO:tasks.workunit.client.0.smithi019.stdout:3/31: chown la 7634 1 2024-09-12T22:33:12.601 INFO:tasks.workunit.client.0.smithi019.stdout:9/70: getdents dd/d10 0 2024-09-12T22:33:12.601 INFO:tasks.workunit.client.0.smithi019.stdout:0/94: write d1/f1a [73662,4343] 0 2024-09-12T22:33:12.602 INFO:tasks.workunit.client.0.smithi019.stdout:4/76: chown d1/d11/d15/f18 36 1 2024-09-12T22:33:12.602 INFO:tasks.workunit.client.0.smithi019.stdout:2/112: link d0/da/c19 d0/da/c25 0 2024-09-12T22:33:12.603 INFO:tasks.workunit.client.0.smithi019.stdout:1/110: dwrite d3/d1b/f21 [4194304,4194304] 0 2024-09-12T22:33:12.604 INFO:tasks.workunit.client.0.smithi019.stdout:8/32: dread f4 [0,4194304] 0 2024-09-12T22:33:12.604 INFO:tasks.workunit.client.0.smithi019.stdout:2/113: chown d0/d5/d18 890 1 2024-09-12T22:33:12.604 INFO:tasks.workunit.client.0.smithi019.stdout:0/95: mknod d1/d14/d1b/c20 0 2024-09-12T22:33:12.605 INFO:tasks.workunit.client.0.smithi019.stdout:6/111: dwrite d1b/f20 [0,4194304] 0 2024-09-12T22:33:12.605 INFO:tasks.workunit.client.0.smithi019.stdout:4/77: write d1/d11/d15/f18 [512872,18959] 0 2024-09-12T22:33:12.605 INFO:tasks.workunit.client.0.smithi019.stdout:1/111: read d3/fb [1717972,12414] 0 2024-09-12T22:33:12.606 INFO:tasks.workunit.client.0.smithi019.stdout:8/33: mkdir d7/d8 0 2024-09-12T22:33:12.606 INFO:tasks.workunit.client.0.smithi019.stdout:2/114: stat d0/da/c19 0 2024-09-12T22:33:12.606 INFO:tasks.workunit.client.0.smithi019.stdout:4/78: fdatasync d1/d8/fb 0 2024-09-12T22:33:12.607 INFO:tasks.workunit.client.0.smithi019.stdout:0/96: rename d1/ca to d1/d14/c21 0 2024-09-12T22:33:12.607 INFO:tasks.workunit.client.0.smithi019.stdout:8/34: fdatasync f0 0 2024-09-12T22:33:12.607 INFO:tasks.workunit.client.0.smithi019.stdout:1/112: creat d3/d1b/f26 x:0 0 0 2024-09-12T22:33:12.607 INFO:tasks.workunit.client.0.smithi019.stdout:6/112: rename d1b/f1e to d1b/f2b 0 2024-09-12T22:33:12.609 INFO:tasks.workunit.client.0.smithi019.stdout:8/35: write f4 [1537221,23004] 0 2024-09-12T22:33:12.610 INFO:tasks.workunit.client.0.smithi019.stdout:1/113: creat d3/d1b/f27 x:0 0 0 2024-09-12T22:33:12.611 INFO:tasks.workunit.client.0.smithi019.stdout:2/115: creat d0/d5/f26 x:0 0 0 2024-09-12T22:33:12.614 INFO:tasks.workunit.client.0.smithi019.stdout:2/116: symlink d0/d5/d17/l27 0 2024-09-12T22:33:12.616 INFO:tasks.workunit.client.0.smithi019.stdout:6/113: dread f0 [0,4194304] 0 2024-09-12T22:33:12.620 INFO:tasks.workunit.client.0.smithi019.stdout:3/32: dwrite f9 [0,4194304] 0 2024-09-12T22:33:12.622 INFO:tasks.workunit.client.0.smithi019.stdout:0/97: dwrite d1/fb [0,4194304] 0 2024-09-12T22:33:12.624 INFO:tasks.workunit.client.0.smithi019.stdout:8/36: dwrite f4 [0,4194304] 0 2024-09-12T22:33:12.624 INFO:tasks.workunit.client.0.smithi019.stdout:2/117: truncate d0/f11 1146996 0 2024-09-12T22:33:12.627 INFO:tasks.workunit.client.0.smithi019.stdout:8/37: write f4 [230741,123927] 0 2024-09-12T22:33:12.627 INFO:tasks.workunit.client.0.smithi019.stdout:1/114: dwrite d3/d1b/f1d [0,4194304] 0 2024-09-12T22:33:12.627 INFO:tasks.workunit.client.0.smithi019.stdout:7/24: sync 2024-09-12T22:33:12.627 INFO:tasks.workunit.client.0.smithi019.stdout:3/33: getdents . 0 2024-09-12T22:33:12.627 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:33:12.628 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:33:12.628 INFO:tasks.workunit.client.0.smithi019.stdout:0/98: dread d1/fd [0,4194304] 0 2024-09-12T22:33:12.629 INFO:tasks.workunit.client.0.smithi019.stdout:3/34: mkdir dd 0 2024-09-12T22:33:12.629 INFO:tasks.workunit.client.0.smithi019.stdout:7/25: rmdir d6/d8 39 2024-09-12T22:33:12.629 INFO:tasks.workunit.client.0.smithi019.stdout:8/38: symlink d7/l9 0 2024-09-12T22:33:12.629 INFO:tasks.workunit.client.0.smithi019.stdout:3/35: chown f2 487 1 2024-09-12T22:33:12.629 INFO:tasks.workunit.client.0.smithi019.stdout:8/39: chown c1 5138207 1 2024-09-12T22:33:12.629 INFO:tasks.workunit.client.0.smithi019.stdout:6/114: dread f9 [0,4194304] 0 2024-09-12T22:33:12.629 INFO:tasks.workunit.client.0.smithi019.stdout:7/26: mknod d6/d8/ca 0 2024-09-12T22:33:12.630 INFO:tasks.workunit.client.0.smithi019.stdout:0/99: creat d1/d14/f22 x:0 0 0 2024-09-12T22:33:12.630 INFO:tasks.workunit.client.0.smithi019.stdout:8/40: fdatasync f3 0 2024-09-12T22:33:12.630 INFO:tasks.workunit.client.0.smithi019.stdout:3/36: symlink dd/le 0 2024-09-12T22:33:12.630 INFO:tasks.workunit.client.0.smithi019.stdout:6/115: link cc d1b/d26/c2c 0 2024-09-12T22:33:12.630 INFO:tasks.workunit.client.0.smithi019.stdout:7/27: mkdir d6/db 0 2024-09-12T22:33:12.631 INFO:tasks.workunit.client.0.smithi019.stdout:8/41: getdents d7/d8 0 2024-09-12T22:33:12.631 INFO:tasks.workunit.client.0.smithi019.stdout:6/116: mkdir d1b/d2d 0 2024-09-12T22:33:12.631 INFO:tasks.workunit.client.0.smithi019.stdout:7/28: unlink c2 0 2024-09-12T22:33:12.632 INFO:tasks.workunit.client.0.smithi019.stdout:3/37: link l8 dd/lf 0 2024-09-12T22:33:12.633 INFO:tasks.workunit.client.0.smithi019.stdout:3/38: link l6 dd/l10 0 2024-09-12T22:33:12.635 INFO:tasks.workunit.client.0.smithi019.stdout:3/39: rename f3 to dd/f11 0 2024-09-12T22:33:12.635 INFO:tasks.workunit.client.0.smithi019.stdout:0/100: dread d1/fb [0,4194304] 0 2024-09-12T22:33:12.639 INFO:tasks.workunit.client.0.smithi019.stdout:0/101: fsync d1/fd 0 2024-09-12T22:33:12.639 INFO:tasks.workunit.client.0.smithi019.stdout:8/42: dread f3 [0,4194304] 0 2024-09-12T22:33:12.640 INFO:tasks.workunit.client.0.smithi019.stdout:6/117: dread fb [0,4194304] 0 2024-09-12T22:33:12.640 INFO:tasks.workunit.client.0.smithi019.stdout:1/115: dwrite d3/d1b/f27 [0,4194304] 0 2024-09-12T22:33:12.641 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:33:12.641 INFO:tasks.workunit.client.0.smithi019.stdout:3/40: truncate f5 690495 0 2024-09-12T22:33:12.642 INFO:tasks.workunit.client.0.smithi019.stdout:1/116: creat d3/d11/d16/d23/f28 x:0 0 0 2024-09-12T22:33:12.642 INFO:tasks.workunit.client.0.smithi019.stdout:6/118: mknod d1b/d2d/c2e 0 2024-09-12T22:33:12.642 INFO:tasks.workunit.client.0.smithi019.stdout:3/41: mkdir dd/d12 0 2024-09-12T22:33:12.643 INFO:tasks.workunit.client.0.smithi019.stdout:1/117: dread - d3/d1b/f26 zero size 2024-09-12T22:33:12.644 INFO:tasks.workunit.client.0.smithi019.stdout:6/119: creat d1b/d26/d27/f2f x:0 0 0 2024-09-12T22:33:12.644 INFO:tasks.workunit.client.0.smithi019.stdout:1/118: symlink d3/l29 0 2024-09-12T22:33:12.645 INFO:tasks.workunit.client.0.smithi019.stdout:7/29: dwrite f1 [0,4194304] 0 2024-09-12T22:33:12.645 INFO:tasks.workunit.client.0.smithi019.stdout:6/120: chown c11 1388 1 2024-09-12T22:33:12.645 INFO:tasks.workunit.client.0.smithi019.stdout:6/121: stat f0 0 2024-09-12T22:33:12.645 INFO:tasks.workunit.client.0.smithi019.stdout:0/102: dread d1/fb [0,4194304] 0 2024-09-12T22:33:12.645 INFO:tasks.workunit.client.0.smithi019.stdout:8/43: dread f0 [0,4194304] 0 2024-09-12T22:33:12.646 INFO:tasks.workunit.client.0.smithi019.stdout:7/30: rename d6/d8 to d6/db/dc 0 2024-09-12T22:33:12.646 INFO:tasks.workunit.client.0.smithi019.stdout:8/44: unlink f5 0 2024-09-12T22:33:12.647 INFO:tasks.workunit.client.0.smithi019.stdout:0/103: symlink d1/d1d/l23 0 2024-09-12T22:33:12.647 INFO:tasks.workunit.client.0.smithi019.stdout:8/45: creat d7/fa x:0 0 0 2024-09-12T22:33:12.647 INFO:tasks.workunit.client.0.smithi019.stdout:7/31: rename f5 to d6/db/dc/fd 0 2024-09-12T22:33:12.649 INFO:tasks.workunit.client.0.smithi019.stdout:8/46: fsync f4 0 2024-09-12T22:33:12.649 INFO:tasks.workunit.client.0.smithi019.stdout:8/47: chown d7 13852311 1 2024-09-12T22:33:12.649 INFO:tasks.workunit.client.0.smithi019.stdout:0/104: chown d1/d14/d1b/c1c 7449248 1 2024-09-12T22:33:12.649 INFO:tasks.workunit.client.0.smithi019.stdout:8/48: mknod d7/d8/cb 0 2024-09-12T22:33:12.649 INFO:tasks.workunit.client.0.smithi019.stdout:7/32: read d6/db/dc/f9 [324948,96824] 0 2024-09-12T22:33:12.650 INFO:tasks.workunit.client.0.smithi019.stdout:0/105: read d1/fd [381293,76119] 0 2024-09-12T22:33:12.650 INFO:tasks.workunit.client.0.smithi019.stdout:8/49: fdatasync f3 0 2024-09-12T22:33:12.650 INFO:tasks.workunit.client.0.smithi019.stdout:0/106: unlink d1/fb 0 2024-09-12T22:33:12.650 INFO:tasks.workunit.client.0.smithi019.stdout:7/33: mknod d6/ce 0 2024-09-12T22:33:12.650 INFO:tasks.workunit.client.0.smithi019.stdout:8/50: creat d7/fc x:0 0 0 2024-09-12T22:33:12.651 INFO:tasks.workunit.client.0.smithi019.stdout:6/122: dread f3 [0,4194304] 0 2024-09-12T22:33:12.651 INFO:tasks.workunit.client.0.smithi019.stdout:7/34: creat d6/db/ff x:0 0 0 2024-09-12T22:33:12.651 INFO:tasks.workunit.client.0.smithi019.stdout:8/51: mkdir d7/d8/dd 0 2024-09-12T22:33:12.652 INFO:tasks.workunit.client.0.smithi019.stdout:8/52: stat d7 0 2024-09-12T22:33:12.652 INFO:tasks.workunit.client.0.smithi019.stdout:6/123: symlink d1b/l30 0 2024-09-12T22:33:12.652 INFO:tasks.workunit.client.0.smithi019.stdout:7/35: rename d6 to d6/db/d10 22 2024-09-12T22:33:12.652 INFO:tasks.workunit.client.0.smithi019.stdout:8/53: read f0 [3840998,126535] 0 2024-09-12T22:33:12.652 INFO:tasks.workunit.client.0.smithi019.stdout:6/124: mkdir d1b/d26/d31 0 2024-09-12T22:33:12.653 INFO:tasks.workunit.client.0.smithi019.stdout:8/54: chown d7/fa 242 1 2024-09-12T22:33:12.655 INFO:tasks.workunit.client.0.smithi019.stdout:6/125: truncate f0 2562490 0 2024-09-12T22:33:12.656 INFO:tasks.workunit.client.0.smithi019.stdout:8/55: mknod d7/d8/dd/ce 0 2024-09-12T22:33:12.657 INFO:tasks.workunit.client.0.smithi019.stdout:8/56: mkdir d7/d8/df 0 2024-09-12T22:33:12.657 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T22:33:12.658 INFO:tasks.workunit.client.0.smithi019.stdout:0/107: dwrite d1/fd [0,4194304] 0 2024-09-12T22:33:12.662 INFO:tasks.workunit.client.0.smithi019.stdout:0/108: write d1/d14/f17 [2299759,123465] 0 2024-09-12T22:33:12.662 INFO:tasks.workunit.client.0.smithi019.stdout:5/208: sync 2024-09-12T22:33:12.662 INFO:tasks.workunit.client.0.smithi019.stdout:9/71: sync 2024-09-12T22:33:12.662 INFO:tasks.workunit.client.0.smithi019.stdout:4/79: sync 2024-09-12T22:33:12.662 INFO:tasks.workunit.client.0.smithi019.stdout:2/118: sync 2024-09-12T22:33:12.662 INFO:tasks.workunit.client.0.smithi019.stdout:3/42: sync 2024-09-12T22:33:12.662 INFO:tasks.workunit.client.0.smithi019.stdout:7/36: dwrite f1 [0,4194304] 0 2024-09-12T22:33:12.662 INFO:tasks.workunit.client.0.smithi019.stdout:3/43: chown dd/f11 38448 1 2024-09-12T22:33:12.662 INFO:tasks.workunit.client.0.smithi019.stdout:9/72: mkdir dd/d10/d17 0 2024-09-12T22:33:12.662 INFO:tasks.workunit.client.0.smithi019.stdout:5/209: creat d0/dc/d39/f4e x:0 0 0 2024-09-12T22:33:12.662 INFO:tasks.workunit.client.0.smithi019.stdout:4/80: unlink d1/d4/f1c 0 2024-09-12T22:33:12.663 INFO:tasks.workunit.client.0.smithi019.stdout:5/210: chown d0 71689 1 2024-09-12T22:33:12.663 INFO:tasks.workunit.client.0.smithi019.stdout:7/37: read f1 [121126,117470] 0 2024-09-12T22:33:12.663 INFO:tasks.workunit.client.0.smithi019.stdout:2/119: write d0/d5/d17/f14 [3100788,26162] 0 2024-09-12T22:33:12.663 INFO:tasks.workunit.client.0.smithi019.stdout:4/81: fsync d1/d4/f13 0 2024-09-12T22:33:12.664 INFO:tasks.workunit.client.0.smithi019.stdout:7/38: mknod d6/db/dc/c11 0 2024-09-12T22:33:12.664 INFO:tasks.workunit.client.0.smithi019.stdout:1/119: sync 2024-09-12T22:33:12.664 INFO:tasks.workunit.client.0.smithi019.stdout:8/57: sync 2024-09-12T22:33:12.664 INFO:tasks.workunit.client.0.smithi019.stdout:5/211: link d0/d7/f1c d0/d7/d16/f4f 0 2024-09-12T22:33:12.665 INFO:tasks.workunit.client.0.smithi019.stdout:8/58: mknod d7/d8/df/c10 0 2024-09-12T22:33:12.666 INFO:tasks.workunit.client.0.smithi019.stdout:7/39: truncate d6/db/dc/f9 1387412 0 2024-09-12T22:33:12.666 INFO:tasks.workunit.client.0.smithi019.stdout:0/109: dread d1/d14/f17 [0,4194304] 0 2024-09-12T22:33:12.666 INFO:tasks.workunit.client.0.smithi019.stdout:5/212: write d0/dc/d39/d38/f3f [760026,90805] 0 2024-09-12T22:33:12.667 INFO:tasks.workunit.client.0.smithi019.stdout:1/120: truncate d3/d1b/f27 4694339 0 2024-09-12T22:33:12.667 INFO:tasks.workunit.client.0.smithi019.stdout:8/59: creat d7/d8/dd/f11 x:0 0 0 2024-09-12T22:33:12.668 INFO:tasks.workunit.client.0.smithi019.stdout:6/126: dread f0 [0,4194304] 0 2024-09-12T22:33:12.668 INFO:tasks.workunit.client.0.smithi019.stdout:1/121: chown d3/d11/d16 23 1 2024-09-12T22:33:12.668 INFO:tasks.workunit.client.0.smithi019.stdout:5/213: readlink d0/d7/d2d/l4d 0 2024-09-12T22:33:12.669 INFO:tasks.workunit.client.0.smithi019.stdout:7/40: unlink d6/db/ff 0 2024-09-12T22:33:12.669 INFO:tasks.workunit.client.0.smithi019.stdout:0/110: mknod d1/d1f/c24 0 2024-09-12T22:33:12.669 INFO:tasks.workunit.client.0.smithi019.stdout:7/41: readlink l0 0 2024-09-12T22:33:12.669 INFO:tasks.workunit.client.0.smithi019.stdout:4/82: dwrite d1/d8/f14 [0,4194304] 0 2024-09-12T22:33:12.671 INFO:tasks.workunit.client.0.smithi019.stdout:6/127: creat d1b/d2d/f32 x:0 0 0 2024-09-12T22:33:12.673 INFO:tasks.workunit.client.0.smithi019.stdout:2/120: dread d0/d5/d18/f20 [0,4194304] 0 2024-09-12T22:33:12.673 INFO:tasks.workunit.client.0.smithi019.stdout:4/83: chown d1/d8/l1a 407 1 2024-09-12T22:33:12.674 INFO:tasks.workunit.client.0.smithi019.stdout:7/42: rename l4 to d6/db/dc/l12 0 2024-09-12T22:33:12.675 INFO:tasks.workunit.client.0.smithi019.stdout:8/60: dread f3 [0,4194304] 0 2024-09-12T22:33:12.676 INFO:tasks.workunit.client.0.smithi019.stdout:6/128: rename cc to d1b/d26/c33 0 2024-09-12T22:33:12.676 INFO:tasks.workunit.client.0.smithi019.stdout:4/84: creat d1/d11/d15/f1d x:0 0 0 2024-09-12T22:33:12.677 INFO:tasks.workunit.client.0.smithi019.stdout:8/61: fdatasync d7/fc 0 2024-09-12T22:33:12.677 INFO:tasks.workunit.client.0.smithi019.stdout:7/43: chown d6/db/dc/fd 3948 1 2024-09-12T22:33:12.678 INFO:tasks.workunit.client.0.smithi019.stdout:6/129: write f19 [284593,86963] 0 2024-09-12T22:33:12.681 INFO:tasks.workunit.client.0.smithi019.stdout:1/122: dwrite d3/d1b/f26 [0,4194304] 0 2024-09-12T22:33:12.681 INFO:tasks.workunit.client.0.smithi019.stdout:8/62: creat d7/d8/dd/f12 x:0 0 0 2024-09-12T22:33:12.682 INFO:tasks.workunit.client.0.smithi019.stdout:6/130: symlink d1b/d2d/l34 0 2024-09-12T22:33:12.682 INFO:tasks.workunit.client.0.smithi019.stdout:5/214: dwrite d0/dc/d39/d38/f3f [0,4194304] 0 2024-09-12T22:33:12.683 INFO:tasks.workunit.client.0.smithi019.stdout:7/44: write d6/db/dc/fd [4022490,40369] 0 2024-09-12T22:33:12.683 INFO:tasks.workunit.client.0.smithi019.stdout:8/63: fdatasync d7/fa 0 2024-09-12T22:33:12.684 INFO:tasks.workunit.client.0.smithi019.stdout:0/111: dwrite d1/d14/f17 [0,4194304] 0 2024-09-12T22:33:12.684 INFO:tasks.workunit.client.0.smithi019.stdout:3/44: sync 2024-09-12T22:33:12.684 INFO:tasks.workunit.client.0.smithi019.stdout:9/73: sync 2024-09-12T22:33:12.684 INFO:tasks.workunit.client.0.smithi019.stdout:2/121: sync 2024-09-12T22:33:12.685 INFO:tasks.workunit.client.0.smithi019.stdout:1/123: unlink d3/l8 0 2024-09-12T22:33:12.686 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:12.685+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:12.686 INFO:tasks.workunit.client.0.smithi019.stdout:3/45: write f7 [1260939,19669] 0 2024-09-12T22:33:12.686 INFO:tasks.workunit.client.0.smithi019.stdout:2/122: dread - d0/d5/f22 zero size 2024-09-12T22:33:12.688 INFO:tasks.workunit.client.0.smithi019.stdout:0/112: creat d1/d1f/f25 x:0 0 0 2024-09-12T22:33:12.688 INFO:tasks.workunit.client.0.smithi019.stdout:1/124: read - d3/d11/d1c/f24 zero size 2024-09-12T22:33:12.689 INFO:tasks.workunit.client.0.smithi019.stdout:3/46: creat dd/f13 x:0 0 0 2024-09-12T22:33:12.690 INFO:tasks.workunit.client.0.smithi019.stdout:2/123: write d0/d5/f26 [881631,130816] 0 2024-09-12T22:33:12.690 INFO:tasks.workunit.client.0.smithi019.stdout:6/131: getdents d1b/d26/d27 0 2024-09-12T22:33:12.692 INFO:tasks.workunit.client.0.smithi019.stdout:4/85: dwrite d1/d11/d15/f18 [0,4194304] 0 2024-09-12T22:33:12.693 INFO:tasks.workunit.client.0.smithi019.stdout:3/47: creat dd/f14 x:0 0 0 2024-09-12T22:33:12.694 INFO:tasks.workunit.client.0.smithi019.stdout:1/125: dread - d3/d11/d16/d23/f28 zero size 2024-09-12T22:33:12.695 INFO:tasks.workunit.client.0.smithi019.stdout:6/132: write d1b/f2b [1189525,58772] 0 2024-09-12T22:33:12.696 INFO:tasks.workunit.client.0.smithi019.stdout:2/124: chown d0/d5/d17/fe 14 1 2024-09-12T22:33:12.698 INFO:tasks.workunit.client.0.smithi019.stdout:7/45: dread f1 [0,4194304] 0 2024-09-12T22:33:12.698 INFO:tasks.workunit.client.0.smithi019.stdout:3/48: write dd/f14 [191145,101269] 0 2024-09-12T22:33:12.700 INFO:tasks.workunit.client.0.smithi019.stdout:6/133: write fd [4263316,56016] 0 2024-09-12T22:33:12.701 INFO:tasks.workunit.client.0.smithi019.stdout:4/86: link d1/l17 d1/d8/l1e 0 2024-09-12T22:33:12.703 INFO:tasks.workunit.client.0.smithi019.stdout:9/74: dwrite dd/fe [8388608,4194304] 0 2024-09-12T22:33:12.703 INFO:tasks.workunit.client.0.smithi019.stdout:8/64: dwrite d7/d8/dd/f12 [0,4194304] 0 2024-09-12T22:33:12.703 INFO:tasks.workunit.client.0.smithi019.stdout:2/125: mknod d0/d5/d18/d1b/c28 0 2024-09-12T22:33:12.704 INFO:tasks.workunit.client.0.smithi019.stdout:8/65: dread - d7/fa zero size 2024-09-12T22:33:12.705 INFO:tasks.workunit.client.0.smithi019.stdout:6/134: read - d1b/d26/d27/f2f zero size 2024-09-12T22:33:12.705 INFO:tasks.workunit.client.0.smithi019.stdout:9/75: creat dd/f18 x:0 0 0 2024-09-12T22:33:12.706 INFO:tasks.workunit.client.0.smithi019.stdout:7/46: write d6/db/dc/f9 [540927,97173] 0 2024-09-12T22:33:12.706 INFO:tasks.workunit.client.0.smithi019.stdout:0/113: dwrite d1/d14/f17 [4194304,4194304] 0 2024-09-12T22:33:12.707 INFO:tasks.workunit.client.0.smithi019.stdout:3/49: dread f5 [0,4194304] 0 2024-09-12T22:33:12.708 INFO:tasks.workunit.client.0.smithi019.stdout:8/66: creat d7/f13 x:0 0 0 2024-09-12T22:33:12.708 INFO:tasks.workunit.client.0.smithi019.stdout:0/114: mkdir d1/d14/d26 0 2024-09-12T22:33:12.709 INFO:tasks.workunit.client.0.smithi019.stdout:7/47: mknod d6/db/c13 0 2024-09-12T22:33:12.709 INFO:tasks.workunit.client.0.smithi019.stdout:6/135: truncate d1b/f22 647826 0 2024-09-12T22:33:12.709 INFO:tasks.workunit.client.0.smithi019.stdout:9/76: rename f5 to dd/d10/f19 0 2024-09-12T22:33:12.710 INFO:tasks.workunit.client.0.smithi019.stdout:1/126: dwrite d3/d1b/f27 [0,4194304] 0 2024-09-12T22:33:12.712 INFO:tasks.workunit.client.0.smithi019.stdout:3/50: rename f9 to dd/d12/f15 0 2024-09-12T22:33:12.712 INFO:tasks.workunit.client.0.smithi019.stdout:7/48: mkdir d6/d14 0 2024-09-12T22:33:12.712 INFO:tasks.workunit.client.0.smithi019.stdout:9/77: symlink dd/l1a 0 2024-09-12T22:33:12.714 INFO:tasks.workunit.client.0.smithi019.stdout:0/115: getdents d1 0 2024-09-12T22:33:12.714 INFO:tasks.workunit.client.0.smithi019.stdout:4/87: dwrite d1/d4/f13 [0,4194304] 0 2024-09-12T22:33:12.714 INFO:tasks.workunit.client.0.smithi019.stdout:7/49: write f1 [2918456,63159] 0 2024-09-12T22:33:12.717 INFO:tasks.workunit.client.0.smithi019.stdout:9/78: write dd/f18 [633388,50626] 0 2024-09-12T22:33:12.717 INFO:tasks.workunit.client.0.smithi019.stdout:0/116: chown d1/d1d 0 1 2024-09-12T22:33:12.718 INFO:tasks.workunit.client.0.smithi019.stdout:5/215: dread d0/f6 [4194304,4194304] 0 2024-09-12T22:33:12.720 INFO:tasks.workunit.client.0.smithi019.stdout:4/88: mkdir d1/d11/d15/d1f 0 2024-09-12T22:33:12.722 INFO:tasks.workunit.client.0.smithi019.stdout:7/50: truncate d6/f7 774179 0 2024-09-12T22:33:12.722 INFO:tasks.workunit.client.0.smithi019.stdout:8/67: dwrite d7/fa [0,4194304] 0 2024-09-12T22:33:12.723 INFO:tasks.workunit.client.0.smithi019.stdout:5/216: write d0/f49 [909371,103730] 0 2024-09-12T22:33:12.723 INFO:tasks.workunit.client.0.smithi019.stdout:7/51: chown d6/d14 1631235166 1 2024-09-12T22:33:12.724 INFO:tasks.workunit.client.0.smithi019.stdout:4/89: fdatasync d1/d8/fb 0 2024-09-12T22:33:12.725 INFO:tasks.workunit.client.0.smithi019.stdout:3/51: dread dd/d12/f15 [0,4194304] 0 2024-09-12T22:33:12.725 INFO:tasks.workunit.client.0.smithi019.stdout:8/68: dread - d7/f13 zero size 2024-09-12T22:33:12.726 INFO:tasks.workunit.client.0.smithi019.stdout:7/52: write f1 [846335,95483] 0 2024-09-12T22:33:12.728 INFO:tasks.workunit.client.0.smithi019.stdout:2/126: dwrite d0/f11 [0,4194304] 0 2024-09-12T22:33:12.729 INFO:tasks.workunit.client.0.smithi019.stdout:8/69: chown f4 7017 1 2024-09-12T22:33:12.730 INFO:tasks.workunit.client.0.smithi019.stdout:3/52: creat dd/f16 x:0 0 0 2024-09-12T22:33:12.730 INFO:tasks.workunit.client.0.smithi019.stdout:6/136: dwrite f0 [0,4194304] 0 2024-09-12T22:33:12.731 INFO:tasks.workunit.client.0.smithi019.stdout:0/117: dread d1/d14/f17 [0,4194304] 0 2024-09-12T22:33:12.731 INFO:tasks.workunit.client.0.smithi019.stdout:7/53: write d6/db/dc/fd [1048421,15725] 0 2024-09-12T22:33:12.731 INFO:tasks.workunit.client.0.smithi019.stdout:9/79: dwrite dd/f16 [0,4194304] 0 2024-09-12T22:33:12.731 INFO:tasks.workunit.client.0.smithi019.stdout:2/127: unlink d0/d5/d17/l27 0 2024-09-12T22:33:12.734 INFO:tasks.workunit.client.0.smithi019.stdout:2/128: rmdir d0 39 2024-09-12T22:33:12.734 INFO:tasks.workunit.client.0.smithi019.stdout:8/70: write d7/d8/dd/f12 [3517745,46449] 0 2024-09-12T22:33:12.734 INFO:tasks.workunit.client.0.smithi019.stdout:0/118: write d1/d14/f17 [2337847,112108] 0 2024-09-12T22:33:12.734 INFO:tasks.workunit.client.0.smithi019.stdout:3/53: write dd/f16 [255121,108949] 0 2024-09-12T22:33:12.735 INFO:tasks.workunit.client.0.smithi019.stdout:1/127: sync 2024-09-12T22:33:12.737 INFO:tasks.workunit.client.0.smithi019.stdout:9/80: rename lc to dd/l1b 0 2024-09-12T22:33:12.737 INFO:tasks.workunit.client.0.smithi019.stdout:2/129: creat d0/da/f29 x:0 0 0 2024-09-12T22:33:12.738 INFO:tasks.workunit.client.0.smithi019.stdout:4/90: dwrite d1/d11/d15/f18 [0,4194304] 0 2024-09-12T22:33:12.738 INFO:tasks.workunit.client.0.smithi019.stdout:3/54: chown l8 3423478 1 2024-09-12T22:33:12.739 INFO:tasks.workunit.client.0.smithi019.stdout:5/217: truncate d0/f6 352076 0 2024-09-12T22:33:12.739 INFO:tasks.workunit.client.0.smithi019.stdout:1/128: creat d3/d11/d16/d23/f2a x:0 0 0 2024-09-12T22:33:12.741 INFO:tasks.workunit.client.0.smithi019.stdout:1/129: chown d3/d11/d1c/f24 107730850 1 2024-09-12T22:33:12.741 INFO:tasks.workunit.client.0.smithi019.stdout:3/55: write fc [575904,95031] 0 2024-09-12T22:33:12.743 INFO:tasks.workunit.client.0.smithi019.stdout:5/218: write d0/f1a [4538595,111531] 0 2024-09-12T22:33:12.743 INFO:tasks.workunit.client.0.smithi019.stdout:2/130: mknod d0/d5/d18/c2a 0 2024-09-12T22:33:12.743 INFO:tasks.workunit.client.0.smithi019.stdout:7/54: fsync d6/db/dc/fd 0 2024-09-12T22:33:12.744 INFO:tasks.workunit.client.0.smithi019.stdout:8/71: dwrite f4 [0,4194304] 0 2024-09-12T22:33:12.745 INFO:tasks.workunit.client.0.smithi019.stdout:2/131: dread - d0/da/f29 zero size 2024-09-12T22:33:12.745 INFO:tasks.workunit.client.0.smithi019.stdout:7/55: read f1 [2626523,81134] 0 2024-09-12T22:33:12.747 INFO:tasks.workunit.client.0.smithi019.stdout:6/137: dwrite d1b/f2b [0,4194304] 0 2024-09-12T22:33:12.747 INFO:tasks.workunit.client.0.smithi019.stdout:3/56: rename dd/f14 to dd/f17 0 2024-09-12T22:33:12.747 INFO:tasks.workunit.client.0.smithi019.stdout:7/56: stat d6/ce 0 2024-09-12T22:33:12.748 INFO:tasks.workunit.client.0.smithi019.stdout:4/91: truncate d1/d8/fb 6301250 0 2024-09-12T22:33:12.748 INFO:tasks.workunit.client.0.smithi019.stdout:5/219: creat d0/d7/d2d/d32/f50 x:0 0 0 2024-09-12T22:33:12.748 INFO:tasks.workunit.client.0.smithi019.stdout:8/72: mknod d7/d8/c14 0 2024-09-12T22:33:12.748 INFO:tasks.workunit.client.0.smithi019.stdout:0/119: dread d1/fd [0,4194304] 0 2024-09-12T22:33:12.749 INFO:tasks.workunit.client.0.smithi019.stdout:7/57: chown d6/f7 52277 1 2024-09-12T22:33:12.749 INFO:tasks.workunit.client.0.smithi019.stdout:2/132: rename d0/da/f24 to d0/d5/d18/d1b/f2b 0 2024-09-12T22:33:12.749 INFO:tasks.workunit.client.0.smithi019.stdout:6/138: write fb [617596,114536] 0 2024-09-12T22:33:12.750 INFO:tasks.workunit.client.0.smithi019.stdout:9/81: dread dd/fe [4194304,4194304] 0 2024-09-12T22:33:12.750 INFO:tasks.workunit.client.0.smithi019.stdout:0/120: write d1/d1f/f25 [568642,58205] 0 2024-09-12T22:33:12.751 INFO:tasks.workunit.client.0.smithi019.stdout:7/58: mkdir d6/d14/d15 0 2024-09-12T22:33:12.751 INFO:tasks.workunit.client.0.smithi019.stdout:3/57: rename f7 to dd/d12/f18 0 2024-09-12T22:33:12.751 INFO:tasks.workunit.client.0.smithi019.stdout:4/92: write d1/d4/f13 [1702035,16853] 0 2024-09-12T22:33:12.752 INFO:tasks.workunit.client.0.smithi019.stdout:6/139: fdatasync f3 0 2024-09-12T22:33:12.752 INFO:tasks.workunit.client.0.smithi019.stdout:5/220: write d0/d7/d16/d18/f26 [1200294,29410] 0 2024-09-12T22:33:12.753 INFO:tasks.workunit.client.0.smithi019.stdout:7/59: fsync d6/db/dc/f9 0 2024-09-12T22:33:12.753 INFO:tasks.workunit.client.0.smithi019.stdout:3/58: write dd/d12/f15 [2411751,114040] 0 2024-09-12T22:33:12.754 INFO:tasks.workunit.client.0.smithi019.stdout:9/82: symlink dd/l1c 0 2024-09-12T22:33:12.755 INFO:tasks.workunit.client.0.smithi019.stdout:2/133: truncate d0/da/fd 989919 0 2024-09-12T22:33:12.755 INFO:tasks.workunit.client.0.smithi019.stdout:4/93: creat d1/d8/f20 x:0 0 0 2024-09-12T22:33:12.756 INFO:tasks.workunit.client.0.smithi019.stdout:5/221: symlink d0/dc/d39/l51 0 2024-09-12T22:33:12.756 INFO:tasks.workunit.client.0.smithi019.stdout:1/130: dwrite d3/d11/d1c/f24 [0,4194304] 0 2024-09-12T22:33:12.756 INFO:tasks.workunit.client.0.smithi019.stdout:6/140: truncate d1b/f23 394066 0 2024-09-12T22:33:12.756 INFO:tasks.workunit.client.0.smithi019.stdout:3/59: write f2 [5785801,61419] 0 2024-09-12T22:33:12.756 INFO:tasks.workunit.client.0.smithi019.stdout:2/134: stat d0/d5/d17/fe 0 2024-09-12T22:33:12.757 INFO:tasks.workunit.client.0.smithi019.stdout:9/83: mknod dd/d10/d17/c1d 0 2024-09-12T22:33:12.757 INFO:tasks.workunit.client.0.smithi019.stdout:7/60: read d6/db/dc/fd [2115135,130231] 0 2024-09-12T22:33:12.757 INFO:tasks.workunit.client.0.smithi019.stdout:8/73: truncate d7/d8/dd/f12 3708996 0 2024-09-12T22:33:12.758 INFO:tasks.workunit.client.0.smithi019.stdout:3/60: truncate dd/f16 1145592 0 2024-09-12T22:33:12.758 INFO:tasks.workunit.client.0.smithi019.stdout:9/84: symlink dd/l1e 0 2024-09-12T22:33:12.758 INFO:tasks.workunit.client.0.smithi019.stdout:8/74: chown d7/l9 13 1 2024-09-12T22:33:12.758 INFO:tasks.workunit.client.0.smithi019.stdout:7/61: symlink d6/db/dc/l16 0 2024-09-12T22:33:12.759 INFO:tasks.workunit.client.0.smithi019.stdout:1/131: unlink d3/fb 0 2024-09-12T22:33:12.759 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:12.758+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:12.760 INFO:tasks.workunit.client.0.smithi019.stdout:8/75: chown f3 6753 1 2024-09-12T22:33:12.760 INFO:tasks.workunit.client.0.smithi019.stdout:2/135: truncate d0/da/fd 1187825 0 2024-09-12T22:33:12.762 INFO:tasks.workunit.client.0.smithi019.stdout:7/62: write d6/db/dc/f9 [1313152,87423] 0 2024-09-12T22:33:12.762 INFO:tasks.workunit.client.0.smithi019.stdout:8/76: truncate d7/f13 857573 0 2024-09-12T22:33:12.763 INFO:tasks.workunit.client.0.smithi019.stdout:9/85: getdents dd/d10/d17 0 2024-09-12T22:33:12.763 INFO:tasks.workunit.client.0.smithi019.stdout:2/136: dread - d0/d5/d18/d1b/f2b zero size 2024-09-12T22:33:12.763 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:33:12.764 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:33:12.764 INFO:tasks.workunit.client.0.smithi019.stdout:8/77: mknod d7/d8/c15 0 2024-09-12T22:33:12.765 INFO:tasks.workunit.client.0.smithi019.stdout:6/141: dread fb [0,4194304] 0 2024-09-12T22:33:12.766 INFO:tasks.workunit.client.0.smithi019.stdout:7/63: chown d6/db/dc/l12 6500109 1 2024-09-12T22:33:12.767 INFO:tasks.workunit.client.0.smithi019.stdout:8/78: write d7/fa [1020695,36014] 0 2024-09-12T22:33:12.767 INFO:tasks.workunit.client.0.smithi019.stdout:5/222: dwrite d0/d7/d16/f4f [0,4194304] 0 2024-09-12T22:33:12.769 INFO:tasks.workunit.client.0.smithi019.stdout:3/61: dwrite dd/f13 [0,4194304] 0 2024-09-12T22:33:12.772 INFO:tasks.workunit.client.0.smithi019.stdout:5/223: chown d0/f48 0 1 2024-09-12T22:33:12.772 INFO:tasks.workunit.client.0.smithi019.stdout:1/132: dread d3/d1b/f21 [0,4194304] 0 2024-09-12T22:33:12.773 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:33:12.774 INFO:tasks.workunit.client.0.smithi019.stdout:5/224: write d0/f2 [3231978,33179] 0 2024-09-12T22:33:12.774 INFO:tasks.workunit.client.0.smithi019.stdout:9/86: dwrite dd/f16 [0,4194304] 0 2024-09-12T22:33:12.776 INFO:tasks.workunit.client.0.smithi019.stdout:0/121: sync 2024-09-12T22:33:12.776 INFO:tasks.workunit.client.0.smithi019.stdout:4/94: sync 2024-09-12T22:33:12.776 INFO:tasks.workunit.client.0.smithi019.stdout:7/64: dread f1 [0,4194304] 0 2024-09-12T22:33:12.777 INFO:tasks.workunit.client.0.smithi019.stdout:9/87: dread - dd/d10/f13 zero size 2024-09-12T22:33:12.777 INFO:tasks.workunit.client.0.smithi019.stdout:1/133: chown d3/d11/d1c/f24 3 1 2024-09-12T22:33:12.777 INFO:tasks.workunit.client.0.smithi019.stdout:5/225: chown d0/d7/d2d/d32/c43 575636550 1 2024-09-12T22:33:12.777 INFO:tasks.workunit.client.0.smithi019.stdout:2/137: dwrite d0/d5/f22 [0,4194304] 0 2024-09-12T22:33:12.779 INFO:tasks.workunit.client.0.smithi019.stdout:9/88: creat dd/f1f x:0 0 0 2024-09-12T22:33:12.779 INFO:tasks.workunit.client.0.smithi019.stdout:0/122: chown d1/d14/d1b/c1c 1939 1 2024-09-12T22:33:12.780 INFO:tasks.workunit.client.0.smithi019.stdout:6/142: dread d1b/f22 [0,4194304] 0 2024-09-12T22:33:12.780 INFO:tasks.workunit.client.0.smithi019.stdout:5/226: rename d0/f48 to d0/d7/d16/d18/f52 0 2024-09-12T22:33:12.780 INFO:tasks.workunit.client.0.smithi019.stdout:9/89: dread - dd/d10/f14 zero size 2024-09-12T22:33:12.780 INFO:tasks.workunit.client.0.smithi019.stdout:4/95: creat d1/d11/d15/d1f/f21 x:0 0 0 2024-09-12T22:33:12.781 INFO:tasks.workunit.client.0.smithi019.stdout:2/138: fsync d0/d5/d18/f20 0 2024-09-12T22:33:12.781 INFO:tasks.workunit.client.0.smithi019.stdout:8/79: dwrite d7/d8/dd/f11 [0,4194304] 0 2024-09-12T22:33:12.781 INFO:tasks.workunit.client.0.smithi019.stdout:6/143: mkdir d1b/d2d/d35 0 2024-09-12T22:33:12.782 INFO:tasks.workunit.client.0.smithi019.stdout:0/123: creat d1/d1d/f27 x:0 0 0 2024-09-12T22:33:12.782 INFO:tasks.workunit.client.0.smithi019.stdout:4/96: mkdir d1/d22 0 2024-09-12T22:33:12.782 INFO:tasks.workunit.client.0.smithi019.stdout:8/80: fdatasync f0 0 2024-09-12T22:33:12.782 INFO:tasks.workunit.client.0.smithi019.stdout:2/139: mknod d0/da/c2c 0 2024-09-12T22:33:12.783 INFO:tasks.workunit.client.0.smithi019.stdout:9/90: rename dd/d10/f13 to dd/f20 0 2024-09-12T22:33:12.783 INFO:tasks.workunit.client.0.smithi019.stdout:7/65: dread f1 [0,4194304] 0 2024-09-12T22:33:12.784 INFO:tasks.workunit.client.0.smithi019.stdout:0/124: mknod d1/c28 0 2024-09-12T22:33:12.784 INFO:tasks.workunit.client.0.smithi019.stdout:5/227: symlink d0/dc/d39/d38/d4b/l53 0 2024-09-12T22:33:12.784 INFO:tasks.workunit.client.0.smithi019.stdout:2/140: fdatasync d0/d5/d17/f14 0 2024-09-12T22:33:12.784 INFO:tasks.workunit.client.0.smithi019.stdout:6/144: getdents d1b/d26/d27 0 2024-09-12T22:33:12.784 INFO:tasks.workunit.client.0.smithi019.stdout:7/66: fdatasync d6/db/dc/f9 0 2024-09-12T22:33:12.785 INFO:tasks.workunit.client.0.smithi019.stdout:2/141: stat d0/d5/d17/fe 0 2024-09-12T22:33:12.785 INFO:tasks.workunit.client.0.smithi019.stdout:8/81: rename d7/d8/c14 to d7/d8/dd/c16 0 2024-09-12T22:33:12.786 INFO:tasks.workunit.client.0.smithi019.stdout:0/125: write d1/d1f/f25 [816325,6159] 0 2024-09-12T22:33:12.786 INFO:tasks.workunit.client.0.smithi019.stdout:4/97: dread - d1/d11/d15/d1f/f21 zero size 2024-09-12T22:33:12.786 INFO:tasks.workunit.client.0.smithi019.stdout:8/82: rmdir d7 39 2024-09-12T22:33:12.787 INFO:tasks.workunit.client.0.smithi019.stdout:5/228: rename d0/d7/d16/f2b to d0/d7/d2d/f54 0 2024-09-12T22:33:12.787 INFO:tasks.workunit.client.0.smithi019.stdout:1/134: dread d3/f14 [0,4194304] 0 2024-09-12T22:33:12.788 INFO:tasks.workunit.client.0.smithi019.stdout:6/145: truncate d1b/d26/d27/f2f 283214 0 2024-09-12T22:33:12.788 INFO:tasks.workunit.client.0.smithi019.stdout:8/83: fsync d7/fa 0 2024-09-12T22:33:12.789 INFO:tasks.workunit.client.0.smithi019.stdout:5/229: unlink d0/dc/d24/f35 0 2024-09-12T22:33:12.789 INFO:tasks.workunit.client.0.smithi019.stdout:2/142: symlink d0/d5/d18/d1b/l2d 0 2024-09-12T22:33:12.791 INFO:tasks.workunit.client.0.smithi019.stdout:5/230: fsync d0/f2 0 2024-09-12T22:33:12.791 INFO:tasks.workunit.client.0.smithi019.stdout:2/143: fdatasync d0/d5/f10 0 2024-09-12T22:33:12.791 INFO:tasks.workunit.client.0.smithi019.stdout:6/146: rename f3 to d1b/d26/f36 0 2024-09-12T22:33:12.792 INFO:tasks.workunit.client.0.smithi019.stdout:8/84: link f4 d7/d8/df/f17 0 2024-09-12T22:33:12.793 INFO:tasks.workunit.client.0.smithi019.stdout:5/231: fsync d0/f1a 0 2024-09-12T22:33:12.794 INFO:tasks.workunit.client.0.smithi019.stdout:2/144: mknod d0/c2e 0 2024-09-12T22:33:12.794 INFO:tasks.workunit.client.0.smithi019.stdout:3/62: dread fc [0,4194304] 0 2024-09-12T22:33:12.794 INFO:tasks.workunit.client.0.smithi019.stdout:6/147: getdents d1b/d2d/d35 0 2024-09-12T22:33:12.795 INFO:tasks.workunit.client.0.smithi019.stdout:9/91: dwrite dd/f18 [0,4194304] 0 2024-09-12T22:33:12.796 INFO:tasks.workunit.client.0.smithi019.stdout:3/63: symlink dd/d12/l19 0 2024-09-12T22:33:12.797 INFO:tasks.workunit.client.0.smithi019.stdout:7/67: dwrite f1 [0,4194304] 0 2024-09-12T22:33:12.797 INFO:tasks.workunit.client.0.smithi019.stdout:5/232: creat d0/dc/d39/d38/f55 x:0 0 0 2024-09-12T22:33:12.797 INFO:tasks.workunit.client.0.smithi019.stdout:3/64: stat l0 0 2024-09-12T22:33:12.797 INFO:tasks.workunit.client.0.smithi019.stdout:6/148: creat d1b/f37 x:0 0 0 2024-09-12T22:33:12.798 INFO:tasks.workunit.client.0.smithi019.stdout:6/149: chown l8 29057290 1 2024-09-12T22:33:12.799 INFO:tasks.workunit.client.0.smithi019.stdout:9/92: symlink dd/d10/d17/l21 0 2024-09-12T22:33:12.799 INFO:tasks.workunit.client.0.smithi019.stdout:5/233: write d0/f1a [272226,46871] 0 2024-09-12T22:33:12.800 INFO:tasks.workunit.client.0.smithi019.stdout:1/135: dwrite d3/d11/d16/d23/f28 [0,4194304] 0 2024-09-12T22:33:12.800 INFO:tasks.workunit.client.0.smithi019.stdout:6/150: write f19 [1379024,30020] 0 2024-09-12T22:33:12.801 INFO:tasks.workunit.client.0.smithi019.stdout:3/65: write fc [1214803,93487] 0 2024-09-12T22:33:12.801 INFO:tasks.workunit.client.0.smithi019.stdout:5/234: chown d0/f49 7 1 2024-09-12T22:33:12.801 INFO:tasks.workunit.client.0.smithi019.stdout:7/68: truncate d6/db/dc/fd 2147258 0 2024-09-12T22:33:12.802 INFO:tasks.workunit.client.0.smithi019.stdout:0/126: fdatasync d1/d1f/f25 0 2024-09-12T22:33:12.803 INFO:tasks.workunit.client.0.smithi019.stdout:3/66: symlink dd/d12/l1a 0 2024-09-12T22:33:12.805 INFO:tasks.workunit.client.0.smithi019.stdout:4/98: truncate d1/d4/f13 953346 0 2024-09-12T22:33:12.806 INFO:tasks.workunit.client.0.smithi019.stdout:0/127: rename d1/d14/l16 to d1/l29 0 2024-09-12T22:33:12.806 INFO:tasks.workunit.client.0.smithi019.stdout:9/93: write dd/f18 [4703403,19370] 0 2024-09-12T22:33:12.807 INFO:tasks.workunit.client.0.smithi019.stdout:3/67: creat dd/f1b x:0 0 0 2024-09-12T22:33:12.807 INFO:tasks.workunit.client.0.smithi019.stdout:7/69: creat d6/d14/d15/f17 x:0 0 0 2024-09-12T22:33:12.807 INFO:tasks.workunit.client.0.smithi019.stdout:5/235: rename d0/d7/l30 to d0/d7/d2d/d4c/l56 0 2024-09-12T22:33:12.809 INFO:tasks.workunit.client.0.smithi019.stdout:9/94: mkdir dd/d10/d17/d22 0 2024-09-12T22:33:12.810 INFO:tasks.workunit.client.0.smithi019.stdout:7/70: creat d6/d14/d15/f18 x:0 0 0 2024-09-12T22:33:12.810 INFO:tasks.workunit.client.0.smithi019.stdout:6/151: dwrite f9 [0,4194304] 0 2024-09-12T22:33:12.810 INFO:tasks.workunit.client.0.smithi019.stdout:3/68: link dd/d12/l1a dd/l1c 0 2024-09-12T22:33:12.811 INFO:tasks.workunit.client.0.smithi019.stdout:9/95: rmdir dd/d10 39 2024-09-12T22:33:12.811 INFO:tasks.workunit.client.0.smithi019.stdout:1/136: dwrite d3/d11/d16/d23/f2a [0,4194304] 0 2024-09-12T22:33:12.812 INFO:tasks.workunit.client.0.smithi019.stdout:7/71: dread - d6/d14/d15/f17 zero size 2024-09-12T22:33:12.812 INFO:tasks.workunit.client.0.smithi019.stdout:3/69: mknod dd/c1d 0 2024-09-12T22:33:12.813 INFO:tasks.workunit.client.0.smithi019.stdout:1/137: chown d3/d11/d1c 6034 1 2024-09-12T22:33:12.814 INFO:tasks.workunit.client.0.smithi019.stdout:6/152: symlink d1b/l38 0 2024-09-12T22:33:12.814 INFO:tasks.workunit.client.0.smithi019.stdout:9/96: write dd/f16 [2991553,26593] 0 2024-09-12T22:33:12.814 INFO:tasks.workunit.client.0.smithi019.stdout:0/128: getdents d1/d14 0 2024-09-12T22:33:12.814 INFO:tasks.workunit.client.0.smithi019.stdout:3/70: readlink l6 0 2024-09-12T22:33:12.815 INFO:tasks.workunit.client.0.smithi019.stdout:5/236: dread d0/d7/d16/d18/f52 [0,4194304] 0 2024-09-12T22:33:12.815 INFO:tasks.workunit.client.0.smithi019.stdout:7/72: mknod d6/d14/c19 0 2024-09-12T22:33:12.815 INFO:tasks.workunit.client.0.smithi019.stdout:6/153: getdents d1b/d26/d27 0 2024-09-12T22:33:12.816 INFO:tasks.workunit.client.0.smithi019.stdout:0/129: write d1/f1a [530493,89750] 0 2024-09-12T22:33:12.817 INFO:tasks.workunit.client.0.smithi019.stdout:3/71: write fc [1978014,23025] 0 2024-09-12T22:33:12.817 INFO:tasks.workunit.client.0.smithi019.stdout:1/138: write d3/d1b/f27 [3049176,30314] 0 2024-09-12T22:33:12.817 INFO:tasks.workunit.client.0.smithi019.stdout:4/99: dwrite d1/d8/f10 [4194304,4194304] 0 2024-09-12T22:33:12.818 INFO:tasks.workunit.client.0.smithi019.stdout:8/85: sync 2024-09-12T22:33:12.818 INFO:tasks.workunit.client.0.smithi019.stdout:2/145: sync 2024-09-12T22:33:12.818 INFO:tasks.workunit.client.0.smithi019.stdout:7/73: mknod d6/d14/d15/c1a 0 2024-09-12T22:33:12.819 INFO:tasks.workunit.client.0.smithi019.stdout:3/72: chown dd/d12 1 1 2024-09-12T22:33:12.819 INFO:tasks.workunit.client.0.smithi019.stdout:6/154: mkdir d1b/d26/d39 0 2024-09-12T22:33:12.822 INFO:tasks.workunit.client.0.smithi019.stdout:4/100: write d1/d8/f14 [2868854,80781] 0 2024-09-12T22:33:12.822 INFO:tasks.workunit.client.0.smithi019.stdout:8/86: stat d7/d8/dd/f12 0 2024-09-12T22:33:12.822 INFO:tasks.workunit.client.0.smithi019.stdout:7/74: write f1 [764436,6166] 0 2024-09-12T22:33:12.822 INFO:tasks.workunit.client.0.smithi019.stdout:6/155: creat d1b/d26/f3a x:0 0 0 2024-09-12T22:33:12.822 INFO:tasks.workunit.client.0.smithi019.stdout:0/130: link d1/d1f/c24 d1/d1d/c2a 0 2024-09-12T22:33:12.823 INFO:tasks.workunit.client.0.smithi019.stdout:8/87: chown c2 141425 1 2024-09-12T22:33:12.823 INFO:tasks.workunit.client.0.smithi019.stdout:5/237: dread d0/f49 [0,4194304] 0 2024-09-12T22:33:12.824 INFO:tasks.workunit.client.0.smithi019.stdout:0/131: fdatasync d1/fd 0 2024-09-12T22:33:12.825 INFO:tasks.workunit.client.0.smithi019.stdout:7/75: creat d6/d14/d15/f1b x:0 0 0 2024-09-12T22:33:12.825 INFO:tasks.workunit.client.0.smithi019.stdout:9/97: dread dd/f16 [0,4194304] 0 2024-09-12T22:33:12.826 INFO:tasks.workunit.client.0.smithi019.stdout:0/132: read - d1/d14/f22 zero size 2024-09-12T22:33:12.826 INFO:tasks.workunit.client.0.smithi019.stdout:8/88: truncate d7/f13 1551711 0 2024-09-12T22:33:12.826 INFO:tasks.workunit.client.0.smithi019.stdout:5/238: unlink d0/dc/d39/d38/f46 0 2024-09-12T22:33:12.827 INFO:tasks.workunit.client.0.smithi019.stdout:7/76: rename d6/f7 to d6/db/f1c 0 2024-09-12T22:33:12.828 INFO:tasks.workunit.client.0.smithi019.stdout:9/98: mkdir dd/d10/d17/d23 0 2024-09-12T22:33:12.829 INFO:tasks.workunit.client.0.smithi019.stdout:0/133: write d1/d1f/f25 [730866,73763] 0 2024-09-12T22:33:12.829 INFO:tasks.workunit.client.0.smithi019.stdout:1/139: dwrite d3/d1b/f21 [0,4194304] 0 2024-09-12T22:33:12.829 INFO:tasks.workunit.client.0.smithi019.stdout:7/77: symlink d6/d14/d15/l1d 0 2024-09-12T22:33:12.830 INFO:tasks.workunit.client.0.smithi019.stdout:2/146: dread d0/f11 [0,4194304] 0 2024-09-12T22:33:12.830 INFO:tasks.workunit.client.0.smithi019.stdout:3/73: sync 2024-09-12T22:33:12.830 INFO:tasks.workunit.client.0.smithi019.stdout:6/156: sync 2024-09-12T22:33:12.832 INFO:tasks.workunit.client.0.smithi019.stdout:3/74: mkdir dd/d1e 0 2024-09-12T22:33:12.833 INFO:tasks.workunit.client.0.smithi019.stdout:9/99: write dd/f1f [973543,4257] 0 2024-09-12T22:33:12.833 INFO:tasks.workunit.client.0.smithi019.stdout:0/134: unlink d1/l9 0 2024-09-12T22:33:12.833 INFO:tasks.workunit.client.0.smithi019.stdout:2/147: rmdir d0/d5/d17 39 2024-09-12T22:33:12.834 INFO:tasks.workunit.client.0.smithi019.stdout:7/78: write d6/d14/d15/f18 [601145,75869] 0 2024-09-12T22:33:12.835 INFO:tasks.workunit.client.0.smithi019.stdout:3/75: unlink dd/f1b 0 2024-09-12T22:33:12.835 INFO:tasks.workunit.client.0.smithi019.stdout:0/135: readlink d1/l13 0 2024-09-12T22:33:12.838 INFO:tasks.workunit.client.0.smithi019.stdout:4/101: dread d1/d8/fb [0,4194304] 0 2024-09-12T22:33:12.838 INFO:tasks.workunit.client.0.smithi019.stdout:2/148: write d0/d5/d18/d1b/f1c [551658,66217] 0 2024-09-12T22:33:12.838 INFO:teuthology.orchestra.run.smithi019.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-12T22:33:12.839 INFO:tasks.workunit.client.0.smithi019.stdout:7/79: symlink d6/d14/l1e 0 2024-09-12T22:33:12.839 INFO:tasks.workunit.client.0.smithi019.stdout:6/157: dread d1b/d26/d27/f2f [0,4194304] 0 2024-09-12T22:33:12.840 INFO:tasks.workunit.client.0.smithi019.stdout:5/239: dwrite d0/f23 [0,4194304] 0 2024-09-12T22:33:12.841 INFO:tasks.workunit.client.0.smithi019.stdout:3/76: write dd/f13 [819865,78742] 0 2024-09-12T22:33:12.841 INFO:tasks.workunit.client.0.smithi019.stdout:8/89: dwrite d7/d8/dd/f12 [4194304,4194304] 0 2024-09-12T22:33:12.841 INFO:tasks.workunit.client.0.smithi019.stdout:0/136: dread - d1/d14/f22 zero size 2024-09-12T22:33:12.842 INFO:tasks.workunit.client.0.smithi019.stdout:7/80: write d6/db/dc/f9 [1667834,11761] 0 2024-09-12T22:33:12.843 INFO:tasks.workunit.client.0.smithi019.stdout:8/90: chown d7/fc 7 1 2024-09-12T22:33:12.843 INFO:tasks.workunit.client.0.smithi019.stdout:0/137: chown d1/d14/d1b/c1c 108059 1 2024-09-12T22:33:12.845 INFO:tasks.workunit.client.0.smithi019.stdout:6/158: symlink d1b/d26/d31/l3b 0 2024-09-12T22:33:12.845 INFO:tasks.workunit.client.0.smithi019.stdout:1/140: dwrite d3/d11/d16/d23/f2a [0,4194304] 0 2024-09-12T22:33:12.845 INFO:tasks.workunit.client.0.smithi019.stdout:2/149: link d0/d5/d18/c2a d0/da/c2f 0 2024-09-12T22:33:12.846 INFO:tasks.workunit.client.0.smithi019.stdout:3/77: rename l8 to dd/d1e/l1f 0 2024-09-12T22:33:12.846 INFO:tasks.workunit.client.0.smithi019.stdout:9/100: dread dd/fe [4194304,4194304] 0 2024-09-12T22:33:12.846 INFO:tasks.workunit.client.0.smithi019.stdout:5/240: write d0/f23 [352661,96272] 0 2024-09-12T22:33:12.846 INFO:tasks.workunit.client.0.smithi019.stdout:7/81: mknod d6/c1f 0 2024-09-12T22:33:12.847 INFO:tasks.workunit.client.0.smithi019.stdout:6/159: creat d1b/f3c x:0 0 0 2024-09-12T22:33:12.847 INFO:tasks.workunit.client.0.smithi019.stdout:0/138: fsync d1/d14/f1e 0 2024-09-12T22:33:12.849 INFO:tasks.workunit.client.0.smithi019.stdout:9/101: rename dd/fe to dd/d10/d17/f24 0 2024-09-12T22:33:12.850 INFO:tasks.workunit.client.0.smithi019.stdout:2/150: mknod d0/d5/c30 0 2024-09-12T22:33:12.850 INFO:tasks.workunit.client.0.smithi019.stdout:7/82: creat d6/db/f20 x:0 0 0 2024-09-12T22:33:12.851 INFO:tasks.workunit.client.0.smithi019.stdout:5/241: chown d0/dc/d39/d38/d4b 7815 1 2024-09-12T22:33:12.851 INFO:tasks.workunit.client.0.smithi019.stdout:4/102: dread d1/d8/f14 [0,4194304] 0 2024-09-12T22:33:12.851 INFO:tasks.workunit.client.0.smithi019.stdout:9/102: symlink dd/d10/d17/l25 0 2024-09-12T22:33:12.852 INFO:tasks.workunit.client.0.smithi019.stdout:2/151: stat d0/d5/d17/fe 0 2024-09-12T22:33:12.852 INFO:tasks.workunit.client.0.smithi019.stdout:8/91: dread f4 [0,4194304] 0 2024-09-12T22:33:12.852 INFO:tasks.workunit.client.0.smithi019.stdout:1/141: rename d3/lc to d3/d11/d1c/l2b 0 2024-09-12T22:33:12.853 INFO:tasks.workunit.client.0.smithi019.stdout:4/103: creat d1/d11/f23 x:0 0 0 2024-09-12T22:33:12.853 INFO:tasks.workunit.client.0.smithi019.stdout:6/160: dread f0 [0,4194304] 0 2024-09-12T22:33:12.854 INFO:tasks.workunit.client.0.smithi019.stdout:0/139: truncate d1/d14/f1e 2063883 0 2024-09-12T22:33:12.854 INFO:tasks.workunit.client.0.smithi019.stdout:1/142: readlink d3/d1b/l1f 0 2024-09-12T22:33:12.855 INFO:tasks.workunit.client.0.smithi019.stdout:4/104: link d1/d11/f23 d1/f24 0 2024-09-12T22:33:12.855 INFO:tasks.workunit.client.0.smithi019.stdout:6/161: creat d1b/d26/d31/f3d x:0 0 0 2024-09-12T22:33:12.855 INFO:tasks.workunit.client.0.smithi019.stdout:1/143: creat d3/d11/f2c x:0 0 0 2024-09-12T22:33:12.856 INFO:tasks.workunit.client.0.smithi019.stdout:8/92: getdents d7/d8 0 2024-09-12T22:33:12.856 INFO:tasks.workunit.client.0.smithi019.stdout:6/162: mkdir d1b/d26/d27/d3e 0 2024-09-12T22:33:12.857 INFO:tasks.workunit.client.0.smithi019.stdout:8/93: mknod d7/d8/dd/c18 0 2024-09-12T22:33:12.858 INFO:tasks.workunit.client.0.smithi019.stdout:4/105: getdents d1/d11 0 2024-09-12T22:33:12.858 INFO:tasks.workunit.client.0.smithi019.stdout:6/163: dread - d1b/f3c zero size 2024-09-12T22:33:12.861 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:12.859+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:12.861 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T22:33:12.862 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:33:12.862 INFO:tasks.workunit.client.0.smithi019.stdout:6/164: symlink d1b/d26/l3f 0 2024-09-12T22:33:12.863 INFO:tasks.workunit.client.0.smithi019.stdout:9/103: dwrite dd/d10/d17/f24 [0,4194304] 0 2024-09-12T22:33:12.863 INFO:tasks.workunit.client.0.smithi019.stdout:4/106: link d1/d8/fb d1/f25 0 2024-09-12T22:33:12.864 INFO:tasks.workunit.client.0.smithi019.stdout:4/107: mkdir d1/d22/d26 0 2024-09-12T22:33:12.865 INFO:tasks.workunit.client.0.smithi019.stdout:7/83: dwrite d6/db/dc/fd [0,4194304] 0 2024-09-12T22:33:12.867 INFO:tasks.workunit.client.0.smithi019.stdout:1/144: dwrite d3/f9 [0,4194304] 0 2024-09-12T22:33:12.868 INFO:tasks.workunit.client.0.smithi019.stdout:8/94: truncate d7/d8/dd/f12 6166832 0 2024-09-12T22:33:12.870 INFO:tasks.workunit.client.0.smithi019.stdout:4/108: link d1/d11/f23 d1/d22/f27 0 2024-09-12T22:33:12.870 INFO:tasks.workunit.client.0.smithi019.stdout:1/145: chown l2 61098 1 2024-09-12T22:33:12.871 INFO:tasks.workunit.client.0.smithi019.stdout:7/84: rename d6/db/f20 to d6/f21 0 2024-09-12T22:33:12.871 INFO:tasks.workunit.client.0.smithi019.stdout:8/95: creat d7/f19 x:0 0 0 2024-09-12T22:33:12.871 INFO:tasks.workunit.client.0.smithi019.stdout:7/85: chown c3 0 1 2024-09-12T22:33:12.872 INFO:tasks.workunit.client.0.smithi019.stdout:6/165: dread f9 [0,4194304] 0 2024-09-12T22:33:12.873 INFO:tasks.workunit.client.0.smithi019.stdout:8/96: rename f3 to d7/d8/df/f1a 0 2024-09-12T22:33:12.874 INFO:tasks.workunit.client.0.smithi019.stdout:9/104: dwrite dd/f20 [0,4194304] 0 2024-09-12T22:33:12.876 INFO:tasks.workunit.client.0.smithi019.stdout:9/105: symlink dd/d10/d17/l26 0 2024-09-12T22:33:12.876 INFO:tasks.workunit.client.0.smithi019.stdout:9/106: chown dd/d10/d17 296270 1 2024-09-12T22:33:12.877 INFO:tasks.workunit.client.0.smithi019.stdout:1/146: getdents d3/d11/d16 0 2024-09-12T22:33:12.877 INFO:tasks.workunit.client.0.smithi019.stdout:6/166: dread fb [0,4194304] 0 2024-09-12T22:33:12.877 INFO:tasks.workunit.client.0.smithi019.stdout:8/97: link f0 d7/d8/f1b 0 2024-09-12T22:33:12.877 INFO:tasks.workunit.client.0.smithi019.stdout:9/107: rename dd to dd/d10/d17/d22/d27 22 2024-09-12T22:33:12.877 INFO:tasks.workunit.client.0.smithi019.stdout:4/109: dread d1/d11/d15/f18 [0,4194304] 0 2024-09-12T22:33:12.878 INFO:tasks.workunit.client.0.smithi019.stdout:8/98: truncate d7/fc 555560 0 2024-09-12T22:33:12.878 INFO:tasks.workunit.client.0.smithi019.stdout:9/108: read - dd/d10/f14 zero size 2024-09-12T22:33:12.878 INFO:tasks.workunit.client.0.smithi019.stdout:1/147: creat d3/d11/d1c/f2d x:0 0 0 2024-09-12T22:33:12.878 INFO:tasks.workunit.client.0.smithi019.stdout:4/110: write d1/d11/d15/f1d [801192,28189] 0 2024-09-12T22:33:12.879 INFO:tasks.workunit.client.0.smithi019.stdout:8/99: chown f0 124459 1 2024-09-12T22:33:12.879 INFO:tasks.workunit.client.0.smithi019.stdout:1/148: creat d3/d11/d16/d23/f2e x:0 0 0 2024-09-12T22:33:12.881 INFO:tasks.workunit.client.0.smithi019.stdout:4/111: rename d1/d8/la to d1/l28 0 2024-09-12T22:33:12.881 INFO:tasks.workunit.client.0.smithi019.stdout:8/100: creat d7/d8/dd/f1c x:0 0 0 2024-09-12T22:33:12.881 INFO:tasks.workunit.client.0.smithi019.stdout:1/149: write d3/d1b/f26 [4916875,3483] 0 2024-09-12T22:33:12.882 INFO:tasks.workunit.client.0.smithi019.stdout:4/112: dread - d1/d22/f27 zero size 2024-09-12T22:33:12.883 INFO:tasks.workunit.client.0.smithi019.stdout:6/167: dwrite fb [0,4194304] 0 2024-09-12T22:33:12.885 INFO:tasks.workunit.client.0.smithi019.stdout:3/78: sync 2024-09-12T22:33:12.885 INFO:tasks.workunit.client.0.smithi019.stdout:0/140: sync 2024-09-12T22:33:12.886 INFO:tasks.workunit.client.0.smithi019.stdout:2/152: dread d0/d5/d17/f14 [0,4194304] 0 2024-09-12T22:33:12.886 INFO:tasks.workunit.client.0.smithi019.stdout:3/79: creat dd/f20 x:0 0 0 2024-09-12T22:33:12.886 INFO:tasks.workunit.client.0.smithi019.stdout:1/150: dread d3/d1b/f27 [0,4194304] 0 2024-09-12T22:33:12.887 INFO:tasks.workunit.client.0.smithi019.stdout:3/80: stat dd/l10 0 2024-09-12T22:33:12.887 INFO:tasks.workunit.client.0.smithi019.stdout:8/101: truncate f0 3105469 0 2024-09-12T22:33:12.887 INFO:tasks.workunit.client.0.smithi019.stdout:9/109: truncate dd/d10/d17/f24 11448472 0 2024-09-12T22:33:12.888 INFO:tasks.workunit.client.0.smithi019.stdout:6/168: write d1b/d26/d27/f2f [237003,29694] 0 2024-09-12T22:33:12.888 INFO:tasks.workunit.client.0.smithi019.stdout:4/113: write d1/d8/fb [5881918,102930] 0 2024-09-12T22:33:12.888 INFO:tasks.workunit.client.0.smithi019.stdout:3/81: fdatasync f2 0 2024-09-12T22:33:12.889 INFO:tasks.workunit.client.0.smithi019.stdout:2/153: rename d0/da/fd to d0/da/f31 0 2024-09-12T22:33:12.889 INFO:tasks.workunit.client.0.smithi019.stdout:7/86: dread d6/db/f1c [0,4194304] 0 2024-09-12T22:33:12.890 INFO:tasks.workunit.client.0.smithi019.stdout:6/169: readlink l8 0 2024-09-12T22:33:12.890 INFO:tasks.workunit.client.0.smithi019.stdout:9/110: chown dd/d10/f19 8160 1 2024-09-12T22:33:12.891 INFO:tasks.workunit.client.0.smithi019.stdout:4/114: creat d1/d22/d26/f29 x:0 0 0 2024-09-12T22:33:12.891 INFO:tasks.workunit.client.0.smithi019.stdout:6/170: symlink d1b/l40 0 2024-09-12T22:33:12.893 INFO:tasks.workunit.client.0.smithi019.stdout:2/154: write d0/f11 [2718097,118185] 0 2024-09-12T22:33:12.894 INFO:tasks.workunit.client.0.smithi019.stdout:6/171: chown l10 10229 1 2024-09-12T22:33:12.894 INFO:tasks.workunit.client.0.smithi019.stdout:4/115: fdatasync d1/d22/d26/f29 0 2024-09-12T22:33:12.894 INFO:tasks.workunit.client.0.smithi019.stdout:2/155: rmdir d0/da 39 2024-09-12T22:33:12.895 INFO:teuthology.orchestra.run.smithi019.stdout:osd.2: {} 2024-09-12T22:33:12.895 INFO:teuthology.orchestra.run.smithi019.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T22:33:12.895 INFO:tasks.workunit.client.0.smithi019.stdout:3/82: fsync dd/f20 0 2024-09-12T22:33:12.896 INFO:tasks.workunit.client.0.smithi019.stdout:0/141: dwrite d1/f1a [0,4194304] 0 2024-09-12T22:33:12.897 INFO:tasks.workunit.client.0.smithi019.stdout:8/102: dread d7/fa [0,4194304] 0 2024-09-12T22:33:12.898 INFO:tasks.workunit.client.0.smithi019.stdout:6/172: write d1b/f37 [65729,99169] 0 2024-09-12T22:33:12.898 INFO:tasks.workunit.client.0.smithi019.stdout:4/116: creat d1/d4/f2a x:0 0 0 2024-09-12T22:33:12.899 INFO:tasks.workunit.client.0.smithi019.stdout:2/156: mknod d0/d5/d18/c32 0 2024-09-12T22:33:12.899 INFO:tasks.workunit.client.0.smithi019.stdout:3/83: dread - dd/f20 zero size 2024-09-12T22:33:12.899 INFO:tasks.workunit.client.0.smithi019.stdout:0/142: unlink d1/c19 0 2024-09-12T22:33:12.900 INFO:tasks.workunit.client.0.smithi019.stdout:1/151: dwrite d3/d11/d1c/f2d [0,4194304] 0 2024-09-12T22:33:12.900 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:33:12.901 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:33:12.901 INFO:tasks.workunit.client.0.smithi019.stdout:6/173: stat d1b/d26/d31/f3d 0 2024-09-12T22:33:12.901 INFO:tasks.workunit.client.0.smithi019.stdout:4/117: creat d1/d11/d15/f2b x:0 0 0 2024-09-12T22:33:12.902 INFO:tasks.workunit.client.0.smithi019.stdout:0/143: dread - d1/d14/f22 zero size 2024-09-12T22:33:12.902 INFO:tasks.workunit.client.0.smithi019.stdout:6/174: unlink f9 0 2024-09-12T22:33:12.903 INFO:tasks.workunit.client.0.smithi019.stdout:7/87: dwrite d6/db/f1c [0,4194304] 0 2024-09-12T22:33:12.903 INFO:tasks.workunit.client.0.smithi019.stdout:9/111: dread dd/d10/d17/f24 [0,4194304] 0 2024-09-12T22:33:12.904 INFO:tasks.workunit.client.0.smithi019.stdout:4/118: mkdir d1/d22/d2c 0 2024-09-12T22:33:12.904 INFO:tasks.workunit.client.0.smithi019.stdout:1/152: write d3/d11/d1c/f24 [276719,72567] 0 2024-09-12T22:33:12.904 INFO:tasks.workunit.client.0.smithi019.stdout:8/103: link d7/d8/dd/f12 d7/f1d 0 2024-09-12T22:33:12.904 INFO:tasks.workunit.client.0.smithi019.stdout:1/153: readlink d3/l29 0 2024-09-12T22:33:12.904 INFO:tasks.workunit.client.0.smithi019.stdout:7/88: creat d6/d14/d15/f22 x:0 0 0 2024-09-12T22:33:12.905 INFO:tasks.workunit.client.0.smithi019.stdout:0/144: creat d1/d14/d1b/f2b x:0 0 0 2024-09-12T22:33:12.905 INFO:tasks.workunit.client.0.smithi019.stdout:8/104: symlink d7/d8/dd/l1e 0 2024-09-12T22:33:12.905 INFO:tasks.workunit.client.0.smithi019.stdout:0/145: chown d1/c3 596276 1 2024-09-12T22:33:12.906 INFO:tasks.workunit.client.0.smithi019.stdout:9/112: creat dd/d10/d17/d23/f28 x:0 0 0 2024-09-12T22:33:12.907 INFO:tasks.workunit.client.0.smithi019.stdout:4/119: link d1/l28 d1/d4/l2d 0 2024-09-12T22:33:12.907 INFO:tasks.workunit.client.0.smithi019.stdout:9/113: chown dd/d10/d17/c1d 67266328 1 2024-09-12T22:33:12.907 INFO:tasks.workunit.client.0.smithi019.stdout:0/146: dread - d1/d14/d1b/f2b zero size 2024-09-12T22:33:12.908 INFO:tasks.workunit.client.0.smithi019.stdout:2/157: dwrite d0/f11 [4194304,4194304] 0 2024-09-12T22:33:12.908 INFO:tasks.workunit.client.0.smithi019.stdout:8/105: creat d7/d8/df/f1f x:0 0 0 2024-09-12T22:33:12.909 INFO:tasks.workunit.client.0.smithi019.stdout:9/114: mknod dd/d10/d17/d22/c29 0 2024-09-12T22:33:12.910 INFO:tasks.workunit.client.0.smithi019.stdout:8/106: creat d7/d8/df/f20 x:0 0 0 2024-09-12T22:33:12.910 INFO:tasks.workunit.client.0.smithi019.stdout:2/158: chown d0/d5/d18/d1b/f2b 284 1 2024-09-12T22:33:12.910 INFO:tasks.workunit.client.0.smithi019.stdout:9/115: creat dd/d10/d17/d23/f2a x:0 0 0 2024-09-12T22:33:12.913 INFO:tasks.workunit.client.0.smithi019.stdout:5/242: sync 2024-09-12T22:33:12.913 INFO:tasks.workunit.client.0.smithi019.stdout:2/159: write d0/d5/d17/fe [2230724,42050] 0 2024-09-12T22:33:12.913 INFO:tasks.workunit.client.0.smithi019.stdout:5/243: fdatasync d0/f23 0 2024-09-12T22:33:12.916 INFO:tasks.workunit.client.0.smithi019.stdout:8/107: getdents d7 0 2024-09-12T22:33:12.916 INFO:tasks.workunit.client.0.smithi019.stdout:1/154: dwrite d3/d11/d16/d23/f2a [0,4194304] 0 2024-09-12T22:33:12.917 INFO:tasks.workunit.client.0.smithi019.stdout:0/147: dwrite d1/d14/f22 [0,4194304] 0 2024-09-12T22:33:12.917 INFO:tasks.workunit.client.0.smithi019.stdout:1/155: stat c0 0 2024-09-12T22:33:12.917 INFO:tasks.workunit.client.0.smithi019.stdout:4/120: truncate d1/d11/d15/f1d 118971 0 2024-09-12T22:33:12.918 INFO:tasks.workunit.client.0.smithi019.stdout:5/244: creat d0/d7/d16/d18/f57 x:0 0 0 2024-09-12T22:33:12.918 INFO:tasks.workunit.client.0.smithi019.stdout:8/108: creat d7/d8/dd/f21 x:0 0 0 2024-09-12T22:33:12.919 INFO:tasks.workunit.client.0.smithi019.stdout:1/156: write d3/d1b/f1d [4734443,4555] 0 2024-09-12T22:33:12.919 INFO:tasks.workunit.client.0.smithi019.stdout:0/148: creat d1/f2c x:0 0 0 2024-09-12T22:33:12.919 INFO:tasks.workunit.client.0.smithi019.stdout:8/109: symlink d7/l22 0 2024-09-12T22:33:12.920 INFO:tasks.workunit.client.0.smithi019.stdout:0/149: symlink d1/d1f/l2d 0 2024-09-12T22:33:12.920 INFO:tasks.workunit.client.0.smithi019.stdout:5/245: write d0/d7/d16/d18/f28 [1646468,89466] 0 2024-09-12T22:33:12.921 INFO:tasks.workunit.client.0.smithi019.stdout:0/150: write d1/f2c [109733,67996] 0 2024-09-12T22:33:12.922 INFO:tasks.workunit.client.0.smithi019.stdout:5/246: write d0/d7/d16/f45 [1016401,9217] 0 2024-09-12T22:33:12.922 INFO:tasks.workunit.client.0.smithi019.stdout:2/160: dwrite d0/f11 [4194304,4194304] 0 2024-09-12T22:33:12.922 INFO:tasks.workunit.client.0.smithi019.stdout:0/151: write d1/d14/f17 [1045244,90778] 0 2024-09-12T22:33:12.924 INFO:tasks.workunit.client.0.smithi019.stdout:5/247: symlink d0/d7/d2d/d32/l58 0 2024-09-12T22:33:12.925 INFO:tasks.workunit.client.0.smithi019.stdout:1/157: dread d3/d11/d1c/f2d [0,4194304] 0 2024-09-12T22:33:12.925 INFO:tasks.workunit.client.0.smithi019.stdout:2/161: mknod d0/da/c33 0 2024-09-12T22:33:12.925 INFO:tasks.workunit.client.0.smithi019.stdout:5/248: mknod d0/dc/c59 0 2024-09-12T22:33:12.926 INFO:tasks.workunit.client.0.smithi019.stdout:4/121: write d1/d4/f13 [748393,21266] 0 2024-09-12T22:33:12.926 INFO:tasks.workunit.client.0.smithi019.stdout:0/152: link d1/f1a d1/d14/d1b/f2e 0 2024-09-12T22:33:12.926 INFO:tasks.workunit.client.0.smithi019.stdout:0/153: readlink d1/l13 0 2024-09-12T22:33:12.927 INFO:tasks.workunit.client.0.smithi019.stdout:8/110: dread d7/f13 [0,4194304] 0 2024-09-12T22:33:12.927 INFO:tasks.workunit.client.0.smithi019.stdout:5/249: write d0/d7/d16/f45 [1346882,88834] 0 2024-09-12T22:33:12.928 INFO:tasks.workunit.client.0.smithi019.stdout:2/162: mknod d0/d5/d18/d1b/c34 0 2024-09-12T22:33:12.928 INFO:tasks.workunit.client.0.smithi019.stdout:0/154: creat d1/d1d/f2f x:0 0 0 2024-09-12T22:33:12.929 INFO:tasks.workunit.client.0.smithi019.stdout:4/122: link d1/d22/f27 d1/d11/d15/f2e 0 2024-09-12T22:33:12.929 INFO:tasks.workunit.client.0.smithi019.stdout:2/163: mknod d0/d5/d18/d1b/c35 0 2024-09-12T22:33:12.929 INFO:tasks.workunit.client.0.smithi019.stdout:8/111: write d7/f13 [1698759,81919] 0 2024-09-12T22:33:12.929 INFO:tasks.workunit.client.0.smithi019.stdout:5/250: write d0/d7/d16/d18/f28 [2300661,74404] 0 2024-09-12T22:33:12.929 INFO:tasks.workunit.client.0.smithi019.stdout:1/158: dread d3/d11/d16/d23/f2a [0,4194304] 0 2024-09-12T22:33:12.930 INFO:tasks.workunit.client.0.smithi019.stdout:5/251: fdatasync d0/d7/d2d/d32/f50 0 2024-09-12T22:33:12.930 INFO:tasks.workunit.client.0.smithi019.stdout:4/123: dread - d1/d11/d15/f2e zero size 2024-09-12T22:33:12.930 INFO:tasks.workunit.client.0.smithi019.stdout:8/112: write d7/d8/df/f1f [46678,15489] 0 2024-09-12T22:33:12.930 INFO:tasks.workunit.client.0.smithi019.stdout:2/164: mkdir d0/d5/d18/d1b/d36 0 2024-09-12T22:33:12.931 INFO:tasks.workunit.client.0.smithi019.stdout:2/165: dread - d0/da/f29 zero size 2024-09-12T22:33:12.931 INFO:tasks.workunit.client.0.smithi019.stdout:4/124: write d1/d8/f10 [5837399,45495] 0 2024-09-12T22:33:12.932 INFO:tasks.workunit.client.0.smithi019.stdout:8/113: symlink d7/d8/dd/l23 0 2024-09-12T22:33:12.932 INFO:tasks.workunit.client.0.smithi019.stdout:5/252: rename d0/d7/d16/d18/c13 to d0/d7/d2d/d32/c5a 0 2024-09-12T22:33:12.932 INFO:tasks.workunit.client.0.smithi019.stdout:2/166: read d0/d5/d18/f20 [725123,17333] 0 2024-09-12T22:33:12.933 INFO:tasks.workunit.client.0.smithi019.stdout:5/253: chown d0/d7/cf 111518477 1 2024-09-12T22:33:12.933 INFO:tasks.workunit.client.0.smithi019.stdout:4/125: symlink d1/d22/d2c/l2f 0 2024-09-12T22:33:12.933 INFO:tasks.workunit.client.0.smithi019.stdout:0/155: dread d1/d14/f22 [0,4194304] 0 2024-09-12T22:33:12.934 INFO:tasks.workunit.client.0.smithi019.stdout:8/114: truncate d7/d8/dd/f21 121245 0 2024-09-12T22:33:12.934 INFO:tasks.workunit.client.0.smithi019.stdout:4/126: mknod d1/d11/d15/c30 0 2024-09-12T22:33:12.934 INFO:tasks.workunit.client.0.smithi019.stdout:5/254: creat d0/d7/d3c/f5b x:0 0 0 2024-09-12T22:33:12.934 INFO:tasks.workunit.client.0.smithi019.stdout:8/115: symlink d7/d8/l24 0 2024-09-12T22:33:12.934 INFO:tasks.workunit.client.0.smithi019.stdout:5/255: creat d0/dc/d39/d38/f5c x:0 0 0 2024-09-12T22:33:12.935 INFO:tasks.workunit.client.0.smithi019.stdout:5/256: rmdir d0/d7/d3c 39 2024-09-12T22:33:12.935 INFO:tasks.workunit.client.0.smithi019.stdout:5/257: dread - d0/d7/d3c/f5b zero size 2024-09-12T22:33:12.935 INFO:tasks.workunit.client.0.smithi019.stdout:8/116: fsync d7/d8/df/f1f 0 2024-09-12T22:33:12.936 INFO:tasks.workunit.client.0.smithi019.stdout:1/159: truncate d3/d11/d16/d23/f2a 2371345 0 2024-09-12T22:33:12.936 INFO:tasks.workunit.client.0.smithi019.stdout:0/156: getdents d1/d14/d1b 0 2024-09-12T22:33:12.937 INFO:tasks.workunit.client.0.smithi019.stdout:5/258: write d0/d7/d16/d18/f28 [2174485,122504] 0 2024-09-12T22:33:12.937 INFO:tasks.workunit.client.0.smithi019.stdout:0/157: mknod d1/d14/d26/c30 0 2024-09-12T22:33:12.937 INFO:tasks.workunit.client.0.smithi019.stdout:1/160: link d3/d11/d16/l20 d3/d11/d1c/l2f 0 2024-09-12T22:33:12.938 INFO:tasks.workunit.client.0.smithi019.stdout:0/158: dread - d1/d1d/f2f zero size 2024-09-12T22:33:12.938 INFO:tasks.workunit.client.0.smithi019.stdout:5/259: readlink d0/dc/d39/d38/d4b/l53 0 2024-09-12T22:33:12.938 INFO:tasks.workunit.client.0.smithi019.stdout:8/117: dread d7/f13 [0,4194304] 0 2024-09-12T22:33:12.938 INFO:tasks.workunit.client.0.smithi019.stdout:1/161: creat d3/d11/d1c/f30 x:0 0 0 2024-09-12T22:33:12.941 INFO:tasks.workunit.client.0.smithi019.stdout:2/167: truncate d0/d5/f26 87328 0 2024-09-12T22:33:12.941 INFO:tasks.workunit.client.0.smithi019.stdout:4/127: truncate d1/f25 3445752 0 2024-09-12T22:33:12.941 INFO:tasks.workunit.client.0.smithi019.stdout:1/162: fdatasync d3/d11/d16/d23/f28 0 2024-09-12T22:33:12.941 INFO:tasks.workunit.client.0.smithi019.stdout:5/260: getdents d0/d7/d16 0 2024-09-12T22:33:12.941 INFO:tasks.workunit.client.0.smithi019.stdout:2/168: stat d0/d5/d18/c32 0 2024-09-12T22:33:12.941 INFO:tasks.workunit.client.0.smithi019.stdout:2/169: creat d0/da/f37 x:0 0 0 2024-09-12T22:33:12.942 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:33:12.942 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:33:12.942 INFO:teuthology.orchestra.run.smithi148.stdout: "complaint_time": 30, 2024-09-12T22:33:12.942 INFO:teuthology.orchestra.run.smithi148.stdout: "num_blocked_ops": 0 2024-09-12T22:33:12.942 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:33:12.942 INFO:tasks.workunit.client.0.smithi019.stdout:1/163: getdents d3/d1b 0 2024-09-12T22:33:12.943 INFO:tasks.workunit.client.0.smithi019.stdout:5/261: getdents d0 0 2024-09-12T22:33:12.943 INFO:tasks.workunit.client.0.smithi019.stdout:2/170: mknod d0/d5/c38 0 2024-09-12T22:33:12.943 INFO:tasks.workunit.client.0.smithi019.stdout:1/164: creat d3/f31 x:0 0 0 2024-09-12T22:33:12.944 INFO:tasks.workunit.client.0.smithi019.stdout:5/262: creat d0/dc/d24/f5d x:0 0 0 2024-09-12T22:33:12.944 INFO:tasks.workunit.client.0.smithi019.stdout:8/118: dwrite d7/fc [0,4194304] 0 2024-09-12T22:33:12.944 INFO:tasks.workunit.client.0.smithi019.stdout:2/171: truncate d0/f1f 1519447 0 2024-09-12T22:33:12.946 INFO:tasks.workunit.client.0.smithi019.stdout:1/165: link c0 d3/d1b/c32 0 2024-09-12T22:33:12.946 INFO:tasks.workunit.client.0.smithi019.stdout:4/128: dwrite d1/d8/f14 [0,4194304] 0 2024-09-12T22:33:12.947 INFO:tasks.workunit.client.0.smithi019.stdout:4/129: mkdir d1/d22/d31 0 2024-09-12T22:33:12.947 INFO:tasks.workunit.client.0.smithi019.stdout:1/166: rename d3/d11/d1c to d3/d33 0 2024-09-12T22:33:12.947 INFO:tasks.workunit.client.0.smithi019.stdout:0/159: truncate d1/d1f/f25 393547 0 2024-09-12T22:33:12.948 INFO:tasks.workunit.client.0.smithi019.stdout:4/130: rename d1/le to d1/l32 0 2024-09-12T22:33:12.949 INFO:tasks.workunit.client.0.smithi019.stdout:1/167: read d3/d1b/f21 [1166143,129850] 0 2024-09-12T22:33:12.949 INFO:tasks.workunit.client.0.smithi019.stdout:0/160: truncate d1/fd 4787916 0 2024-09-12T22:33:12.950 INFO:tasks.workunit.client.0.smithi019.stdout:1/168: chown d3/l15 3994 1 2024-09-12T22:33:12.950 INFO:tasks.workunit.client.0.smithi019.stdout:4/131: creat d1/d22/f33 x:0 0 0 2024-09-12T22:33:12.950 INFO:tasks.workunit.client.0.smithi019.stdout:0/161: symlink d1/d14/d1b/l31 0 2024-09-12T22:33:12.951 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:33:12.952 INFO:tasks.workunit.client.0.smithi019.stdout:2/172: read d0/d5/f10 [714928,95900] 0 2024-09-12T22:33:12.952 INFO:tasks.workunit.client.0.smithi019.stdout:4/132: mknod d1/d22/d2c/c34 0 2024-09-12T22:33:12.953 INFO:tasks.workunit.client.0.smithi019.stdout:1/169: fsync d3/d11/d16/d23/f2e 0 2024-09-12T22:33:12.953 INFO:tasks.workunit.client.0.smithi019.stdout:0/162: mkdir d1/d14/d32 0 2024-09-12T22:33:12.953 INFO:tasks.workunit.client.0.smithi019.stdout:5/263: dwrite d0/d7/f20 [0,4194304] 0 2024-09-12T22:33:12.953 INFO:tasks.workunit.client.0.smithi019.stdout:2/173: mkdir d0/d5/d18/d39 0 2024-09-12T22:33:12.953 INFO:tasks.workunit.client.0.smithi019.stdout:5/264: fdatasync d0/d7/d3c/f5b 0 2024-09-12T22:33:12.953 INFO:tasks.workunit.client.0.smithi019.stdout:0/163: write d1/d14/f17 [1852092,23920] 0 2024-09-12T22:33:12.953 INFO:tasks.workunit.client.0.smithi019.stdout:4/133: chown d1/d11/f23 4808 1 2024-09-12T22:33:12.954 INFO:tasks.workunit.client.0.smithi019.stdout:0/164: creat d1/d1f/f33 x:0 0 0 2024-09-12T22:33:12.954 INFO:tasks.workunit.client.0.smithi019.stdout:5/265: creat d0/d7/d2d/f5e x:0 0 0 2024-09-12T22:33:12.954 INFO:tasks.workunit.client.0.smithi019.stdout:2/174: creat d0/d5/f3a x:0 0 0 2024-09-12T22:33:12.954 INFO:tasks.workunit.client.0.smithi019.stdout:5/266: creat d0/dc/f5f x:0 0 0 2024-09-12T22:33:12.955 INFO:tasks.workunit.client.0.smithi019.stdout:2/175: write d0/d5/f10 [4762448,119529] 0 2024-09-12T22:33:12.955 INFO:tasks.workunit.client.0.smithi019.stdout:5/267: fdatasync d0/dc/f21 0 2024-09-12T22:33:12.956 INFO:tasks.workunit.client.0.smithi019.stdout:2/176: mkdir d0/d5/d18/d3b 0 2024-09-12T22:33:12.957 INFO:tasks.workunit.client.0.smithi019.stdout:5/268: truncate d0/d7/d2d/f5e 399782 0 2024-09-12T22:33:12.957 INFO:tasks.workunit.client.0.smithi019.stdout:1/170: dwrite d3/d1b/f1d [0,4194304] 0 2024-09-12T22:33:12.958 INFO:tasks.workunit.client.0.smithi019.stdout:2/177: symlink d0/d5/d18/d3b/l3c 0 2024-09-12T22:33:12.958 INFO:tasks.workunit.client.0.smithi019.stdout:0/165: dread d1/d14/f17 [4194304,4194304] 0 2024-09-12T22:33:12.959 INFO:tasks.workunit.client.0.smithi019.stdout:1/171: symlink d3/d1b/l34 0 2024-09-12T22:33:12.959 INFO:tasks.workunit.client.0.smithi019.stdout:5/269: write d0/dc/d39/d38/f55 [815541,130512] 0 2024-09-12T22:33:12.960 INFO:tasks.workunit.client.0.smithi019.stdout:2/178: write d0/f1f [2494510,85417] 0 2024-09-12T22:33:12.960 INFO:tasks.workunit.client.0.smithi019.stdout:1/172: creat d3/d11/f35 x:0 0 0 2024-09-12T22:33:12.961 INFO:tasks.workunit.client.0.smithi019.stdout:5/270: chown d0/d7/d2d/f54 4141 1 2024-09-12T22:33:12.961 INFO:tasks.workunit.client.0.smithi019.stdout:8/119: dwrite d7/f1d [4194304,4194304] 0 2024-09-12T22:33:12.962 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:12.960+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:12.962 INFO:tasks.workunit.client.0.smithi019.stdout:2/179: mkdir d0/d5/d18/d3d 0 2024-09-12T22:33:12.962 INFO:tasks.workunit.client.0.smithi019.stdout:1/173: rename d3/d11/d16/d23/f2e to d3/d11/f36 0 2024-09-12T22:33:12.963 INFO:tasks.workunit.client.0.smithi019.stdout:1/174: mknod d3/d11/d16/d23/c37 0 2024-09-12T22:33:12.963 INFO:tasks.workunit.client.0.smithi019.stdout:2/180: link d0/d5/d18/d1b/f1c d0/d5/d18/f3e 0 2024-09-12T22:33:12.964 INFO:tasks.workunit.client.0.smithi019.stdout:1/175: chown d3/d11 495581 1 2024-09-12T22:33:12.965 INFO:tasks.workunit.client.0.smithi019.stdout:2/181: creat d0/d5/d18/d3b/f3f x:0 0 0 2024-09-12T22:33:12.965 INFO:tasks.workunit.client.0.smithi019.stdout:1/176: stat d3/d11/d16/l20 0 2024-09-12T22:33:12.965 INFO:tasks.workunit.client.0.smithi019.stdout:2/182: chown d0/d5/f26 2858 1 2024-09-12T22:33:12.965 INFO:tasks.workunit.client.0.smithi019.stdout:1/177: creat d3/d11/d16/f38 x:0 0 0 2024-09-12T22:33:12.966 INFO:tasks.workunit.client.0.smithi019.stdout:1/178: chown d3/d11/d16 13 1 2024-09-12T22:33:12.967 INFO:tasks.workunit.client.0.smithi019.stdout:4/134: write d1/d8/fb [1579465,16412] 0 2024-09-12T22:33:12.967 INFO:tasks.workunit.client.0.smithi019.stdout:5/271: dwrite d0/d7/f1d [0,4194304] 0 2024-09-12T22:33:12.967 INFO:tasks.workunit.client.0.smithi019.stdout:1/179: dread - d3/d11/f35 zero size 2024-09-12T22:33:12.968 INFO:tasks.workunit.client.0.smithi019.stdout:7/89: sync 2024-09-12T22:33:12.968 INFO:tasks.workunit.client.0.smithi019.stdout:6/175: sync 2024-09-12T22:33:12.969 INFO:tasks.workunit.client.0.smithi019.stdout:9/116: sync 2024-09-12T22:33:12.969 INFO:tasks.workunit.client.0.smithi019.stdout:3/84: sync 2024-09-12T22:33:12.969 INFO:tasks.workunit.client.0.smithi019.stdout:8/120: truncate d7/d8/df/f1a 903483 0 2024-09-12T22:33:12.970 INFO:tasks.workunit.client.0.smithi019.stdout:5/272: mkdir d0/dc/d39/d38/d60 0 2024-09-12T22:33:12.970 INFO:tasks.workunit.client.0.smithi019.stdout:1/180: symlink d3/d1b/l39 0 2024-09-12T22:33:12.970 INFO:tasks.workunit.client.0.smithi019.stdout:9/117: symlink dd/d10/l2b 0 2024-09-12T22:33:12.970 INFO:tasks.workunit.client.0.smithi019.stdout:3/85: mknod dd/d12/c21 0 2024-09-12T22:33:12.971 INFO:tasks.workunit.client.0.smithi019.stdout:8/121: rmdir d7/d8 39 2024-09-12T22:33:12.971 INFO:tasks.workunit.client.0.smithi019.stdout:1/181: rmdir d3/d11 39 2024-09-12T22:33:12.972 INFO:tasks.workunit.client.0.smithi019.stdout:7/90: write d6/db/f1c [803088,1341] 0 2024-09-12T22:33:12.974 INFO:tasks.workunit.client.0.smithi019.stdout:9/118: write dd/f1f [1419126,29256] 0 2024-09-12T22:33:12.974 INFO:tasks.workunit.client.0.smithi019.stdout:8/122: read f0 [3096864,60255] 0 2024-09-12T22:33:12.974 INFO:tasks.workunit.client.0.smithi019.stdout:5/273: dread d0/d7/d16/d18/f52 [0,4194304] 0 2024-09-12T22:33:12.975 INFO:tasks.workunit.client.0.smithi019.stdout:0/166: dwrite d1/d14/f1e [0,4194304] 0 2024-09-12T22:33:12.975 INFO:tasks.workunit.client.0.smithi019.stdout:7/91: fdatasync d6/d14/d15/f18 0 2024-09-12T22:33:12.976 INFO:tasks.workunit.client.0.smithi019.stdout:9/119: chown l1 78370 1 2024-09-12T22:33:12.977 INFO:tasks.workunit.client.0.smithi019.stdout:0/167: creat d1/f34 x:0 0 0 2024-09-12T22:33:12.977 INFO:tasks.workunit.client.0.smithi019.stdout:1/182: symlink d3/d11/d16/l3a 0 2024-09-12T22:33:12.978 INFO:tasks.workunit.client.0.smithi019.stdout:7/92: mkdir d6/d14/d15/d23 0 2024-09-12T22:33:12.979 INFO:tasks.workunit.client.0.smithi019.stdout:2/183: dwrite d0/d5/f26 [0,4194304] 0 2024-09-12T22:33:12.979 INFO:tasks.workunit.client.0.smithi019.stdout:5/274: write d0/d7/d2d/d32/f50 [756848,96603] 0 2024-09-12T22:33:12.979 INFO:tasks.workunit.client.0.smithi019.stdout:1/183: fsync d3/d33/f30 0 2024-09-12T22:33:12.980 INFO:tasks.workunit.client.0.smithi019.stdout:0/168: write d1/d1f/f33 [975686,49412] 0 2024-09-12T22:33:12.980 INFO:tasks.workunit.client.0.smithi019.stdout:7/93: rmdir d6/db 39 2024-09-12T22:33:12.980 INFO:tasks.workunit.client.0.smithi019.stdout:9/120: mknod dd/d10/d17/d22/c2c 0 2024-09-12T22:33:12.981 INFO:tasks.workunit.client.0.smithi019.stdout:4/135: dwrite d1/d22/f27 [0,4194304] 0 2024-09-12T22:33:12.981 INFO:tasks.workunit.client.0.smithi019.stdout:7/94: readlink l0 0 2024-09-12T22:33:12.981 INFO:tasks.workunit.client.0.smithi019.stdout:9/121: readlink l1 0 2024-09-12T22:33:12.981 INFO:tasks.workunit.client.0.smithi019.stdout:2/184: mknod d0/da/c40 0 2024-09-12T22:33:12.982 INFO:tasks.workunit.client.0.smithi019.stdout:1/184: chown d3/d11/f2c 433057641 1 2024-09-12T22:33:12.983 INFO:tasks.workunit.client.0.smithi019.stdout:5/275: creat d0/d7/d2d/f61 x:0 0 0 2024-09-12T22:33:12.984 INFO:tasks.workunit.client.0.smithi019.stdout:0/169: write d1/d14/f22 [3829369,62194] 0 2024-09-12T22:33:12.985 INFO:tasks.workunit.client.0.smithi019.stdout:7/95: write d6/d14/d15/f17 [118076,41205] 0 2024-09-12T22:33:12.985 INFO:tasks.workunit.client.0.smithi019.stdout:5/276: dread - d0/d7/d16/f47 zero size 2024-09-12T22:33:12.986 INFO:tasks.workunit.client.0.smithi019.stdout:3/86: truncate dd/d12/f18 4112441 0 2024-09-12T22:33:12.986 INFO:tasks.workunit.client.0.smithi019.stdout:9/122: creat dd/d10/d17/d23/f2d x:0 0 0 2024-09-12T22:33:12.987 INFO:tasks.workunit.client.0.smithi019.stdout:5/277: unlink d0/d7/d2d/d32/l41 0 2024-09-12T22:33:12.987 INFO:tasks.workunit.client.0.smithi019.stdout:8/123: dwrite f4 [0,4194304] 0 2024-09-12T22:33:12.987 INFO:tasks.workunit.client.0.smithi019.stdout:7/96: fsync d6/db/f1c 0 2024-09-12T22:33:12.987 INFO:tasks.workunit.client.0.smithi019.stdout:0/170: creat d1/d14/d32/f35 x:0 0 0 2024-09-12T22:33:12.989 INFO:tasks.workunit.client.0.smithi019.stdout:5/278: readlink d0/dc/d39/l51 0 2024-09-12T22:33:12.990 INFO:tasks.workunit.client.0.smithi019.stdout:7/97: write d6/d14/d15/f22 [953700,37103] 0 2024-09-12T22:33:12.990 INFO:tasks.workunit.client.0.smithi019.stdout:8/124: fsync d7/d8/dd/f11 0 2024-09-12T22:33:12.993 INFO:tasks.workunit.client.0.smithi019.stdout:5/279: creat d0/dc/d39/d38/f62 x:0 0 0 2024-09-12T22:33:12.993 INFO:tasks.workunit.client.0.smithi019.stdout:8/125: fdatasync d7/d8/dd/f21 0 2024-09-12T22:33:12.994 INFO:tasks.workunit.client.0.smithi019.stdout:7/98: creat d6/d14/d15/f24 x:0 0 0 2024-09-12T22:33:12.994 INFO:tasks.workunit.client.0.smithi019.stdout:1/185: dwrite d3/d1b/f26 [4194304,4194304] 0 2024-09-12T22:33:12.996 INFO:tasks.workunit.client.0.smithi019.stdout:3/87: dwrite dd/f11 [0,4194304] 0 2024-09-12T22:33:12.997 INFO:tasks.workunit.client.0.smithi019.stdout:3/88: readlink l0 0 2024-09-12T22:33:12.997 INFO:tasks.workunit.client.0.smithi019.stdout:5/280: chown d0/dc/d39/d38/f5c 3235525 1 2024-09-12T22:33:12.998 INFO:tasks.workunit.client.0.smithi019.stdout:9/123: dwrite dd/d10/d17/d23/f28 [0,4194304] 0 2024-09-12T22:33:12.998 INFO:tasks.workunit.client.0.smithi019.stdout:1/186: creat d3/d11/d16/f3b x:0 0 0 2024-09-12T22:33:12.999 INFO:tasks.workunit.client.0.smithi019.stdout:3/89: rmdir dd 39 2024-09-12T22:33:12.999 INFO:tasks.workunit.client.0.smithi019.stdout:0/171: dwrite d1/d14/f17 [4194304,4194304] 0 2024-09-12T22:33:13.000 INFO:tasks.workunit.client.0.smithi019.stdout:6/176: dread fd [0,4194304] 0 2024-09-12T22:33:13.001 INFO:tasks.workunit.client.0.smithi019.stdout:8/126: getdents d7/d8/df 0 2024-09-12T22:33:13.001 INFO:tasks.workunit.client.0.smithi019.stdout:9/124: mkdir dd/d10/d17/d23/d2e 0 2024-09-12T22:33:13.001 INFO:tasks.workunit.client.0.smithi019.stdout:5/281: write d0/dc/d39/d38/f5c [996570,117094] 0 2024-09-12T22:33:13.001 INFO:tasks.workunit.client.0.smithi019.stdout:3/90: symlink dd/l22 0 2024-09-12T22:33:13.002 INFO:tasks.workunit.client.0.smithi019.stdout:3/91: readlink dd/le 0 2024-09-12T22:33:13.003 INFO:tasks.workunit.client.0.smithi019.stdout:0/172: rename d1/d1f/f25 to d1/d14/f36 0 2024-09-12T22:33:13.004 INFO:tasks.workunit.client.0.smithi019.stdout:5/282: write d0/dc/d39/d38/f3f [1074017,110779] 0 2024-09-12T22:33:13.005 INFO:tasks.workunit.client.0.smithi019.stdout:7/99: dread d6/d14/d15/f17 [0,4194304] 0 2024-09-12T22:33:13.007 INFO:tasks.workunit.client.0.smithi019.stdout:5/283: unlink d0/l25 0 2024-09-12T22:33:13.008 INFO:tasks.workunit.client.0.smithi019.stdout:7/100: symlink d6/d14/d15/l25 0 2024-09-12T22:33:13.010 INFO:tasks.workunit.client.0.smithi019.stdout:0/173: getdents d1/d1f 0 2024-09-12T22:33:13.012 INFO:tasks.workunit.client.0.smithi019.stdout:7/101: fdatasync d6/d14/d15/f18 0 2024-09-12T22:33:13.014 INFO:tasks.workunit.client.0.smithi019.stdout:1/187: dwrite d3/d11/d16/d23/f2a [0,4194304] 0 2024-09-12T22:33:13.014 INFO:tasks.workunit.client.0.smithi019.stdout:0/174: mknod d1/d14/d32/c37 0 2024-09-12T22:33:13.014 INFO:tasks.workunit.client.0.smithi019.stdout:6/177: dwrite d1b/d2d/f32 [0,4194304] 0 2024-09-12T22:33:13.015 INFO:tasks.workunit.client.0.smithi019.stdout:8/127: dwrite d7/d8/dd/f11 [0,4194304] 0 2024-09-12T22:33:13.015 INFO:tasks.workunit.client.0.smithi019.stdout:9/125: dwrite dd/d10/f19 [0,4194304] 0 2024-09-12T22:33:13.018 INFO:tasks.workunit.client.0.smithi019.stdout:1/188: mkdir d3/d11/d16/d3c 0 2024-09-12T22:33:13.018 INFO:tasks.workunit.client.0.smithi019.stdout:3/92: dwrite dd/f11 [4194304,4194304] 0 2024-09-12T22:33:13.018 INFO:tasks.workunit.client.0.smithi019.stdout:5/284: read d0/d7/d16/f45 [556411,92166] 0 2024-09-12T22:33:13.019 INFO:tasks.workunit.client.0.smithi019.stdout:9/126: getdents dd 0 2024-09-12T22:33:13.021 INFO:tasks.workunit.client.0.smithi019.stdout:1/189: creat d3/d11/f3d x:0 0 0 2024-09-12T22:33:13.022 INFO:tasks.workunit.client.0.smithi019.stdout:5/285: creat d0/dc/d39/f63 x:0 0 0 2024-09-12T22:33:13.022 INFO:tasks.workunit.client.0.smithi019.stdout:8/128: dread f0 [0,4194304] 0 2024-09-12T22:33:13.023 INFO:tasks.workunit.client.0.smithi019.stdout:7/102: read d6/db/dc/f9 [778880,27774] 0 2024-09-12T22:33:13.023 INFO:tasks.workunit.client.0.smithi019.stdout:8/129: creat d7/d8/f25 x:0 0 0 2024-09-12T22:33:13.024 INFO:tasks.workunit.client.0.smithi019.stdout:1/190: link d3/d11/d16/l3a d3/l3e 0 2024-09-12T22:33:13.024 INFO:tasks.workunit.client.0.smithi019.stdout:3/93: dread dd/f11 [4194304,4194304] 0 2024-09-12T22:33:13.025 INFO:tasks.workunit.client.0.smithi019.stdout:1/191: fdatasync d3/f31 0 2024-09-12T22:33:13.025 INFO:tasks.workunit.client.0.smithi019.stdout:8/130: symlink d7/d8/l26 0 2024-09-12T22:33:13.027 INFO:tasks.workunit.client.0.smithi019.stdout:1/192: chown d3/d1b/f1d 138458 1 2024-09-12T22:33:13.027 INFO:tasks.workunit.client.0.smithi019.stdout:0/175: dwrite d1/d1d/f27 [0,4194304] 0 2024-09-12T22:33:13.027 INFO:tasks.workunit.client.0.smithi019.stdout:2/185: sync 2024-09-12T22:33:13.027 INFO:tasks.workunit.client.0.smithi019.stdout:5/286: truncate d0/d7/d16/f4f 682049 0 2024-09-12T22:33:13.029 INFO:tasks.workunit.client.0.smithi019.stdout:9/127: dread dd/f16 [0,4194304] 0 2024-09-12T22:33:13.029 INFO:tasks.workunit.client.0.smithi019.stdout:5/287: mkdir d0/dc/d24/d64 0 2024-09-12T22:33:13.030 INFO:tasks.workunit.client.0.smithi019.stdout:0/176: write d1/d1f/f33 [262639,17114] 0 2024-09-12T22:33:13.030 INFO:tasks.workunit.client.0.smithi019.stdout:9/128: fdatasync dd/f20 0 2024-09-12T22:33:13.032 INFO:tasks.workunit.client.0.smithi019.stdout:0/177: read - d1/d1d/f2f zero size 2024-09-12T22:33:13.033 INFO:tasks.workunit.client.0.smithi019.stdout:5/288: unlink d0/d7/d2d/d32/f50 0 2024-09-12T22:33:13.034 INFO:tasks.workunit.client.0.smithi019.stdout:7/103: dwrite d6/db/dc/fd [4194304,4194304] 0 2024-09-12T22:33:13.035 INFO:tasks.workunit.client.0.smithi019.stdout:0/178: readlink d1/l29 0 2024-09-12T22:33:13.038 INFO:tasks.workunit.client.0.smithi019.stdout:3/94: dread dd/f17 [0,4194304] 0 2024-09-12T22:33:13.038 INFO:tasks.workunit.client.0.smithi019.stdout:8/131: dwrite d7/d8/dd/f11 [4194304,4194304] 0 2024-09-12T22:33:13.039 INFO:tasks.workunit.client.0.smithi019.stdout:0/179: dread - d1/d1d/f2f zero size 2024-09-12T22:33:13.039 INFO:tasks.workunit.client.0.smithi019.stdout:7/104: dread - d6/d14/d15/f1b zero size 2024-09-12T22:33:13.039 INFO:tasks.workunit.client.0.smithi019.stdout:1/193: dwrite d3/d1b/f1d [4194304,4194304] 0 2024-09-12T22:33:13.041 INFO:tasks.workunit.client.0.smithi019.stdout:5/289: write d0/d7/d16/d18/f26 [331475,24630] 0 2024-09-12T22:33:13.041 INFO:tasks.workunit.client.0.smithi019.stdout:7/105: rmdir d6 39 2024-09-12T22:33:13.041 INFO:tasks.workunit.client.0.smithi019.stdout:3/95: creat dd/d1e/f23 x:0 0 0 2024-09-12T22:33:13.041 INFO:tasks.workunit.client.0.smithi019.stdout:1/194: chown d3/d11/c12 0 1 2024-09-12T22:33:13.041 INFO:tasks.workunit.client.0.smithi019.stdout:4/136: dread d1/d8/f10 [0,4194304] 0 2024-09-12T22:33:13.042 INFO:tasks.workunit.client.0.smithi019.stdout:8/132: creat d7/f27 x:0 0 0 2024-09-12T22:33:13.042 INFO:tasks.workunit.client.0.smithi019.stdout:2/186: dwrite d0/d5/d18/f20 [4194304,4194304] 0 2024-09-12T22:33:13.043 INFO:tasks.workunit.client.0.smithi019.stdout:5/290: symlink d0/dc/d39/d38/d4b/l65 0 2024-09-12T22:33:13.044 INFO:tasks.workunit.client.0.smithi019.stdout:4/137: creat d1/d22/d2c/f35 x:0 0 0 2024-09-12T22:33:13.044 INFO:tasks.workunit.client.0.smithi019.stdout:9/129: dwrite dd/f18 [0,4194304] 0 2024-09-12T22:33:13.045 INFO:tasks.workunit.client.0.smithi019.stdout:1/195: getdents d3 0 2024-09-12T22:33:13.046 INFO:tasks.workunit.client.0.smithi019.stdout:7/106: mkdir d6/db/dc/d26 0 2024-09-12T22:33:13.046 INFO:tasks.workunit.client.0.smithi019.stdout:2/187: mkdir d0/d41 0 2024-09-12T22:33:13.047 INFO:tasks.workunit.client.0.smithi019.stdout:5/291: write d0/f49 [1206343,43579] 0 2024-09-12T22:33:13.047 INFO:tasks.workunit.client.0.smithi019.stdout:8/133: symlink d7/l28 0 2024-09-12T22:33:13.049 INFO:tasks.workunit.client.0.smithi019.stdout:7/107: mkdir d6/d14/d27 0 2024-09-12T22:33:13.050 INFO:tasks.workunit.client.0.smithi019.stdout:2/188: rename d0/d5/d18 to d0/d5/d18/d39/d42 22 2024-09-12T22:33:13.051 INFO:tasks.workunit.client.0.smithi019.stdout:7/108: unlink d6/d14/c19 0 2024-09-12T22:33:13.052 INFO:tasks.workunit.client.0.smithi019.stdout:7/109: readlink d6/db/dc/l16 0 2024-09-12T22:33:13.053 INFO:tasks.workunit.client.0.smithi019.stdout:0/180: dwrite d1/d1d/f27 [0,4194304] 0 2024-09-12T22:33:13.054 INFO:tasks.workunit.client.0.smithi019.stdout:4/138: dread d1/d8/f14 [0,4194304] 0 2024-09-12T22:33:13.054 INFO:tasks.workunit.client.0.smithi019.stdout:9/130: dread dd/f18 [0,4194304] 0 2024-09-12T22:33:13.054 INFO:tasks.workunit.client.0.smithi019.stdout:1/196: dwrite d3/d1b/f26 [4194304,4194304] 0 2024-09-12T22:33:13.054 INFO:tasks.workunit.client.0.smithi019.stdout:7/110: chown d6/d14/l1e 90 1 2024-09-12T22:33:13.054 INFO:tasks.workunit.client.0.smithi019.stdout:0/181: read d1/d14/f22 [3657889,67983] 0 2024-09-12T22:33:13.054 INFO:tasks.workunit.client.0.smithi019.stdout:4/139: mknod d1/d11/c36 0 2024-09-12T22:33:13.055 INFO:tasks.workunit.client.0.smithi019.stdout:1/197: dread - d3/d11/f2c zero size 2024-09-12T22:33:13.055 INFO:tasks.workunit.client.0.smithi019.stdout:9/131: rename dd/l1c to dd/d10/d17/d22/l2f 0 2024-09-12T22:33:13.056 INFO:tasks.workunit.client.0.smithi019.stdout:7/111: truncate d6/d14/d15/f24 699441 0 2024-09-12T22:33:13.057 INFO:tasks.workunit.client.0.smithi019.stdout:2/189: truncate d0/d5/d18/f20 840867 0 2024-09-12T22:33:13.058 INFO:tasks.workunit.client.0.smithi019.stdout:7/112: creat d6/d14/d15/f28 x:0 0 0 2024-09-12T22:33:13.058 INFO:tasks.workunit.client.0.smithi019.stdout:2/190: creat d0/d5/f43 x:0 0 0 2024-09-12T22:33:13.059 INFO:tasks.workunit.client.0.smithi019.stdout:3/96: sync 2024-09-12T22:33:13.059 INFO:tasks.workunit.client.0.smithi019.stdout:1/198: sync 2024-09-12T22:33:13.060 INFO:tasks.workunit.client.0.smithi019.stdout:7/113: mknod d6/c29 0 2024-09-12T22:33:13.060 INFO:tasks.workunit.client.0.smithi019.stdout:2/191: fdatasync d0/d5/f3a 0 2024-09-12T22:33:13.061 INFO:tasks.workunit.client.0.smithi019.stdout:1/199: rename d3/d33 to d3/d3f 0 2024-09-12T22:33:13.061 INFO:tasks.workunit.client.0.smithi019.stdout:7/114: mkdir d6/d14/d2a 0 2024-09-12T22:33:13.062 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:13.061+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:13.063 INFO:tasks.workunit.client.0.smithi019.stdout:7/115: stat d6 0 2024-09-12T22:33:13.063 INFO:tasks.workunit.client.0.smithi019.stdout:4/140: dwrite d1/d22/d2c/f35 [0,4194304] 0 2024-09-12T22:33:13.063 INFO:tasks.workunit.client.0.smithi019.stdout:0/182: dwrite d1/d14/d1b/f2b [0,4194304] 0 2024-09-12T22:33:13.063 INFO:tasks.workunit.client.0.smithi019.stdout:4/141: sync 2024-09-12T22:33:13.064 INFO:tasks.workunit.client.0.smithi019.stdout:0/183: stat d1/d1f/f33 0 2024-09-12T22:33:13.064 INFO:tasks.workunit.client.0.smithi019.stdout:1/200: chown d3/d11/d16/l20 536574354 1 2024-09-12T22:33:13.064 INFO:tasks.workunit.client.0.smithi019.stdout:2/192: creat d0/d5/d18/d39/f44 x:0 0 0 2024-09-12T22:33:13.064 INFO:tasks.workunit.client.0.smithi019.stdout:9/132: getdents dd/d10 0 2024-09-12T22:33:13.064 INFO:tasks.workunit.client.0.smithi019.stdout:4/142: dread - d1/d22/f33 zero size 2024-09-12T22:33:13.064 INFO:tasks.workunit.client.0.smithi019.stdout:2/193: sync 2024-09-12T22:33:13.064 INFO:tasks.workunit.client.0.smithi019.stdout:7/116: write d6/d14/d15/f28 [1005864,79654] 0 2024-09-12T22:33:13.065 INFO:tasks.workunit.client.0.smithi019.stdout:4/143: fsync d1/d11/d15/f2b 0 2024-09-12T22:33:13.065 INFO:tasks.workunit.client.0.smithi019.stdout:7/117: fdatasync d6/f21 0 2024-09-12T22:33:13.066 INFO:tasks.workunit.client.0.smithi019.stdout:2/194: rename d0/da/c25 to d0/d5/d18/d3d/c45 0 2024-09-12T22:33:13.066 INFO:tasks.workunit.client.0.smithi019.stdout:4/144: fsync d1/d8/f14 0 2024-09-12T22:33:13.067 INFO:tasks.workunit.client.0.smithi019.stdout:7/118: write d6/d14/d15/f22 [1541450,79834] 0 2024-09-12T22:33:13.068 INFO:tasks.workunit.client.0.smithi019.stdout:2/195: mknod d0/d5/d18/d39/c46 0 2024-09-12T22:33:13.068 INFO:tasks.workunit.client.0.smithi019.stdout:7/119: fsync d6/f21 0 2024-09-12T22:33:13.070 INFO:tasks.workunit.client.0.smithi019.stdout:1/201: dwrite d3/d11/d16/d23/f28 [0,4194304] 0 2024-09-12T22:33:13.070 INFO:tasks.workunit.client.0.smithi019.stdout:2/196: link d0/d5/d18/d39/c46 d0/d5/d18/d1b/d36/c47 0 2024-09-12T22:33:13.072 INFO:tasks.workunit.client.0.smithi019.stdout:1/202: truncate d3/d3f/f24 4940110 0 2024-09-12T22:33:13.074 INFO:tasks.workunit.client.0.smithi019.stdout:1/203: getdents d3/d11 0 2024-09-12T22:33:13.074 INFO:tasks.workunit.client.0.smithi019.stdout:4/145: dwrite d1/d11/d15/f18 [0,4194304] 0 2024-09-12T22:33:13.075 INFO:tasks.workunit.client.0.smithi019.stdout:0/184: write d1/d14/d1b/f2e [3452123,28295] 0 2024-09-12T22:33:13.075 INFO:tasks.workunit.client.0.smithi019.stdout:7/120: truncate d6/d14/d15/f28 236913 0 2024-09-12T22:33:13.076 INFO:tasks.workunit.client.0.smithi019.stdout:0/185: mknod d1/d1d/c38 0 2024-09-12T22:33:13.077 INFO:tasks.workunit.client.0.smithi019.stdout:7/121: mknod d6/d14/c2b 0 2024-09-12T22:33:13.078 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:33:13.078 INFO:teuthology.orchestra.run.smithi148.stdout: "size": 20, 2024-09-12T22:33:13.078 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 600, 2024-09-12T22:33:13.078 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [ 2024-09-12T22:33:13.078 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.078 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:99 3.1f 3:f83d65d8:::200.00000004:head [write 410964~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-09-12T22:33:13.078 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:04.385097+0000", 2024-09-12T22:33:13.078 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 8.6901399189999999, 2024-09-12T22:33:13.078 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.02283048, 2024-09-12T22:33:13.079 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:13.079 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:13.079 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:13.079 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:13.079 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.079 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:13.079 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385097+0000", 2024-09-12T22:33:13.079 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:13.079 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.079 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.079 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:13.079 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385097+0000", 2024-09-12T22:33:13.079 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:13.080 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.080 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.080 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:13.080 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385098+0000", 2024-09-12T22:33:13.080 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5699999999999999e-07 2024-09-12T22:33:13.080 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.080 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.080 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:13.080 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385100+0000", 2024-09-12T22:33:13.080 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9139999999999998e-06 2024-09-12T22:33:13.080 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.080 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.080 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:13.081 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385104+0000", 2024-09-12T22:33:13.081 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1910000000000002e-06 2024-09-12T22:33:13.081 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.081 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.081 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:13.081 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385107+0000", 2024-09-12T22:33:13.081 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.7939999999999998e-06 2024-09-12T22:33:13.081 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.081 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.081 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:13.081 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.401260+0000", 2024-09-12T22:33:13.081 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016153700999999999 2024-09-12T22:33:13.081 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.082 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.082 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:13.082 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.401337+0000", 2024-09-12T22:33:13.082 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.6470000000000005e-05 2024-09-12T22:33:13.082 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.082 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.082 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:13.082 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.401462+0000", 2024-09-12T22:33:13.082 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000125666 2024-09-12T22:33:13.082 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.082 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.082 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:13.083 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.404304+0000", 2024-09-12T22:33:13.083 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0028414809999999999 2024-09-12T22:33:13.083 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.083 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.083 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:13.083 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.407853+0000", 2024-09-12T22:33:13.083 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0035488310000000001 2024-09-12T22:33:13.083 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.083 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.083 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:13.083 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.407894+0000", 2024-09-12T22:33:13.084 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1455000000000002e-05 2024-09-12T22:33:13.084 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.084 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.084 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:13.084 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.407928+0000", 2024-09-12T22:33:13.084 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3720000000000002e-05 2024-09-12T22:33:13.084 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:13.084 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:13.084 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:13.084 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.084 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.084 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:100 3.1f 3:f83d65d8:::200.00000004:head [write 412367~1404 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-09-12T22:33:13.084 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:04.385111+0000", 2024-09-12T22:33:13.085 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 8.6901263110000002, 2024-09-12T22:33:13.085 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.022896741000000002, 2024-09-12T22:33:13.085 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:13.085 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:13.085 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:13.085 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:13.085 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.085 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:13.085 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385111+0000", 2024-09-12T22:33:13.085 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:13.085 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.085 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.085 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:13.086 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385111+0000", 2024-09-12T22:33:13.086 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:13.086 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.086 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.086 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:13.086 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385111+0000", 2024-09-12T22:33:13.086 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.22e-07 2024-09-12T22:33:13.086 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.086 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.086 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:13.086 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385113+0000", 2024-09-12T22:33:13.086 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7069999999999999e-06 2024-09-12T22:33:13.087 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.087 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.087 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:13.087 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385119+0000", 2024-09-12T22:33:13.087 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.2090000000000002e-06 2024-09-12T22:33:13.087 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.087 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.087 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:13.087 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385122+0000", 2024-09-12T22:33:13.087 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.033e-06 2024-09-12T22:33:13.087 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.087 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.087 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:13.088 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.401990+0000", 2024-09-12T22:33:13.088 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016867534 2024-09-12T22:33:13.088 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.088 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.088 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:13.088 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.402057+0000", 2024-09-12T22:33:13.088 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7118000000000004e-05 2024-09-12T22:33:13.088 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.088 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.088 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:13.088 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.402161+0000", 2024-09-12T22:33:13.088 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000103905 2024-09-12T22:33:13.088 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.088 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.089 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:13.089 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.404360+0000", 2024-09-12T22:33:13.089 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0021992940000000001 2024-09-12T22:33:13.089 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.089 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.089 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:13.089 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.407935+0000", 2024-09-12T22:33:13.089 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0035751630000000001 2024-09-12T22:33:13.089 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.089 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.089 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:13.089 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.407976+0000", 2024-09-12T22:33:13.089 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0376000000000001e-05 2024-09-12T22:33:13.090 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.090 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.090 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:13.090 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.408008+0000", 2024-09-12T22:33:13.090 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.218e-05 2024-09-12T22:33:13.090 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:13.090 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:13.090 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:13.090 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.090 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.090 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:101 3.1f 3:f83d65d8:::200.00000004:head [write 413771~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-09-12T22:33:13.090 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:04.385126+0000", 2024-09-12T22:33:13.090 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 8.6901113100000007, 2024-09-12T22:33:13.090 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.022964140000000001, 2024-09-12T22:33:13.091 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:13.091 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:13.091 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:13.091 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:13.091 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.091 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:13.091 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385126+0000", 2024-09-12T22:33:13.091 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:13.091 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.091 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.091 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:13.091 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385126+0000", 2024-09-12T22:33:13.091 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:13.092 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.092 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.092 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:13.092 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385126+0000", 2024-09-12T22:33:13.092 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.29e-07 2024-09-12T22:33:13.092 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.092 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.092 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:13.092 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385139+0000", 2024-09-12T22:33:13.092 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2877000000000001e-05 2024-09-12T22:33:13.092 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.092 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.092 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:13.092 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385144+0000", 2024-09-12T22:33:13.093 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9840000000000001e-06 2024-09-12T22:33:13.093 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.093 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.093 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:13.093 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385147+0000", 2024-09-12T22:33:13.093 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0750000000000002e-06 2024-09-12T22:33:13.093 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.093 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.093 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:13.093 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.402511+0000", 2024-09-12T22:33:13.093 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017363456999999999 2024-09-12T22:33:13.093 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.093 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.094 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:13.094 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.402587+0000", 2024-09-12T22:33:13.094 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.6128e-05 2024-09-12T22:33:13.094 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.094 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.094 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:13.094 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.402706+0000", 2024-09-12T22:33:13.094 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000119157 2024-09-12T22:33:13.094 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.094 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.094 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:13.094 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.404414+0000", 2024-09-12T22:33:13.094 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00170773 2024-09-12T22:33:13.095 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.095 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.095 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:13.095 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.408015+0000", 2024-09-12T22:33:13.095 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003601389 2024-09-12T22:33:13.095 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.095 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.095 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:13.095 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.408057+0000", 2024-09-12T22:33:13.095 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1548999999999998e-05 2024-09-12T22:33:13.095 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.095 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.095 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:13.095 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.408090+0000", 2024-09-12T22:33:13.096 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3565000000000001e-05 2024-09-12T22:33:13.096 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:13.096 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:13.096 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:13.096 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.096 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.096 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:102 3.1f 3:f83d65d8:::200.00000004:head [write 415176~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-09-12T22:33:13.096 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:04.385152+0000", 2024-09-12T22:33:13.096 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 8.6900849919999992, 2024-09-12T22:33:13.096 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.023015768999999998, 2024-09-12T22:33:13.096 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:13.096 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:13.096 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:13.097 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:13.097 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.097 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:13.097 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385152+0000", 2024-09-12T22:33:13.097 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:13.097 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.097 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.097 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:13.097 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385152+0000", 2024-09-12T22:33:13.097 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:13.097 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.097 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.097 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:13.098 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385155+0000", 2024-09-12T22:33:13.098 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4200000000000001e-06 2024-09-12T22:33:13.098 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.098 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.098 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:13.098 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385157+0000", 2024-09-12T22:33:13.098 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.8640000000000001e-06 2024-09-12T22:33:13.098 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.098 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.098 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:13.098 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385161+0000", 2024-09-12T22:33:13.098 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1590000000000003e-06 2024-09-12T22:33:13.099 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.099 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.099 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:13.099 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385164+0000", 2024-09-12T22:33:13.099 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8150000000000002e-06 2024-09-12T22:33:13.099 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.099 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.099 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:13.099 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.403160+0000", 2024-09-12T22:33:13.099 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017996174 2024-09-12T22:33:13.099 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.099 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.099 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:13.100 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.403229+0000", 2024-09-12T22:33:13.100 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.9301999999999995e-05 2024-09-12T22:33:13.100 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.100 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.100 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:13.100 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.403341+0000", 2024-09-12T22:33:13.100 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000112002 2024-09-12T22:33:13.100 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.100 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.100 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:13.100 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.405776+0000", 2024-09-12T22:33:13.100 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0024350079999999998 2024-09-12T22:33:13.100 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.101 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.101 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:13.101 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.408097+0000", 2024-09-12T22:33:13.101 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.002321086 2024-09-12T22:33:13.101 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.101 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.101 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:13.101 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.408137+0000", 2024-09-12T22:33:13.101 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9743999999999998e-05 2024-09-12T22:33:13.101 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.101 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.101 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:13.101 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.408168+0000", 2024-09-12T22:33:13.102 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.1195000000000002e-05 2024-09-12T22:33:13.102 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:13.102 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:13.102 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:13.102 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.102 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.102 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:103 3.1f 3:f83d65d8:::200.00000004:head [write 416575~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-09-12T22:33:13.102 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:04.385167+0000", 2024-09-12T22:33:13.102 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 8.6900704449999999, 2024-09-12T22:33:13.102 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.024972646000000001, 2024-09-12T22:33:13.102 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:13.102 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:13.102 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:13.103 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:13.103 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.103 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:13.103 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385167+0000", 2024-09-12T22:33:13.103 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:13.103 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.103 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.103 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:13.103 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385167+0000", 2024-09-12T22:33:13.103 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:13.103 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.103 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.103 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:13.103 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385167+0000", 2024-09-12T22:33:13.104 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.2100000000000001e-07 2024-09-12T22:33:13.104 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.104 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.104 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:13.104 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385176+0000", 2024-09-12T22:33:13.104 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.8249999999999994e-06 2024-09-12T22:33:13.104 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.104 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.104 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:13.104 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385182+0000", 2024-09-12T22:33:13.104 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0469999999999999e-06 2024-09-12T22:33:13.104 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.104 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.104 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:13.104 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385185+0000", 2024-09-12T22:33:13.105 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0570000000000001e-06 2024-09-12T22:33:13.105 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.105 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.105 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:13.105 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.403629+0000", 2024-09-12T22:33:13.105 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.018443838000000001 2024-09-12T22:33:13.105 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.105 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.105 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:13.105 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.403710+0000", 2024-09-12T22:33:13.105 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0851000000000002e-05 2024-09-12T22:33:13.105 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.105 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.105 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:13.106 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.403859+0000", 2024-09-12T22:33:13.106 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014873800000000001 2024-09-12T22:33:13.106 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.106 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.106 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:13.106 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.406967+0000", 2024-09-12T22:33:13.106 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0031080320000000002 2024-09-12T22:33:13.106 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.106 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.106 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:13.106 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410055+0000", 2024-09-12T22:33:13.106 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.003088698 2024-09-12T22:33:13.106 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.106 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.107 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:13.107 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410104+0000", 2024-09-12T22:33:13.107 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8469e-05 2024-09-12T22:33:13.107 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.107 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.107 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:13.107 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410140+0000", 2024-09-12T22:33:13.107 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.587e-05 2024-09-12T22:33:13.107 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:13.107 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:13.107 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:13.107 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.107 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.108 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:104 3.1f 3:f83d65d8:::200.00000004:head [write 417974~1421 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-09-12T22:33:13.108 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:04.385189+0000", 2024-09-12T22:33:13.108 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 8.6900482910000001, 2024-09-12T22:33:13.108 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.025034507000000001, 2024-09-12T22:33:13.108 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:13.108 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:13.108 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:13.108 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:13.108 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.108 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:13.108 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385189+0000", 2024-09-12T22:33:13.108 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:13.108 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.109 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.109 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:13.109 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385189+0000", 2024-09-12T22:33:13.109 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:13.109 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.109 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.109 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:13.109 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385189+0000", 2024-09-12T22:33:13.109 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5199999999999998e-07 2024-09-12T22:33:13.109 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.109 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.109 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:13.109 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385191+0000", 2024-09-12T22:33:13.110 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7489999999999999e-06 2024-09-12T22:33:13.110 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.110 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.110 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:13.110 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385194+0000", 2024-09-12T22:33:13.110 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.1039999999999998e-06 2024-09-12T22:33:13.110 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.110 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.110 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:13.110 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385197+0000", 2024-09-12T22:33:13.110 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.3740000000000001e-06 2024-09-12T22:33:13.110 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.110 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.111 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:13.111 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.404717+0000", 2024-09-12T22:33:13.111 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.019520056000000001 2024-09-12T22:33:13.111 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.111 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.111 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:13.111 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.404795+0000", 2024-09-12T22:33:13.111 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.818e-05 2024-09-12T22:33:13.111 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.111 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.111 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:13.111 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.404930+0000", 2024-09-12T22:33:13.111 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013531400000000001 2024-09-12T22:33:13.111 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.112 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.112 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:13.112 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.407028+0000", 2024-09-12T22:33:13.112 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0020980899999999999 2024-09-12T22:33:13.112 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.112 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.112 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:13.112 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410147+0000", 2024-09-12T22:33:13.112 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0031188710000000001 2024-09-12T22:33:13.112 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.112 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.112 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:13.113 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410190+0000", 2024-09-12T22:33:13.113 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2899999999999999e-05 2024-09-12T22:33:13.113 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.113 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.113 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:13.113 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410224+0000", 2024-09-12T22:33:13.113 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3617e-05 2024-09-12T22:33:13.113 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:13.113 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:13.113 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:13.113 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.113 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.113 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:105 3.1f 3:f83d65d8:::200.00000004:head [write 419395~1406 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-09-12T22:33:13.113 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:04.385200+0000", 2024-09-12T22:33:13.114 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 8.6900377360000007, 2024-09-12T22:33:13.114 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.025105683, 2024-09-12T22:33:13.114 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:13.114 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:13.114 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:13.114 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:13.114 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.114 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:13.114 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385200+0000", 2024-09-12T22:33:13.114 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:13.114 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.114 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.114 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:13.114 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385200+0000", 2024-09-12T22:33:13.114 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:13.115 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.115 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.115 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:13.115 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385200+0000", 2024-09-12T22:33:13.115 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.05e-07 2024-09-12T22:33:13.115 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.115 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.115 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:13.115 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385205+0000", 2024-09-12T22:33:13.115 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.6269999999999997e-06 2024-09-12T22:33:13.115 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.115 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.115 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:13.115 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385209+0000", 2024-09-12T22:33:13.116 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.439e-06 2024-09-12T22:33:13.116 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.116 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.116 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:13.116 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385211+0000", 2024-09-12T22:33:13.116 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5040000000000001e-06 2024-09-12T22:33:13.116 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.116 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.116 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:13.116 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.405286+0000", 2024-09-12T22:33:13.116 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.020074229999999998 2024-09-12T22:33:13.116 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.116 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.117 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:13.117 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.405359+0000", 2024-09-12T22:33:13.117 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3355000000000005e-05 2024-09-12T22:33:13.117 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.117 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.117 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:13.117 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.405471+0000", 2024-09-12T22:33:13.117 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000112175 2024-09-12T22:33:13.117 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.117 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.117 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:13.117 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.408223+0000", 2024-09-12T22:33:13.117 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0027517779999999999 2024-09-12T22:33:13.118 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.118 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.118 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:13.118 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410231+0000", 2024-09-12T22:33:13.118 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0020078190000000001 2024-09-12T22:33:13.118 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.118 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.118 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:13.118 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410273+0000", 2024-09-12T22:33:13.118 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2530000000000001e-05 2024-09-12T22:33:13.118 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.118 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.118 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:13.119 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410305+0000", 2024-09-12T22:33:13.119 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2020999999999997e-05 2024-09-12T22:33:13.119 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:13.119 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:13.119 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:13.119 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.119 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.119 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:106 3.1f 3:f83d65d8:::200.00000004:head [write 420801~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-09-12T22:33:13.119 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:04.385215+0000", 2024-09-12T22:33:13.119 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 8.6900224099999992, 2024-09-12T22:33:13.119 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.025168234000000001, 2024-09-12T22:33:13.119 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:13.119 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:13.120 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:13.120 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:13.120 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.120 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:13.120 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385215+0000", 2024-09-12T22:33:13.120 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:13.120 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.120 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.120 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:13.120 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385215+0000", 2024-09-12T22:33:13.120 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:13.120 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.120 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.120 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:13.121 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385215+0000", 2024-09-12T22:33:13.121 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.2600000000000001e-07 2024-09-12T22:33:13.121 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.121 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.121 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:13.121 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385217+0000", 2024-09-12T22:33:13.121 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7099999999999999e-06 2024-09-12T22:33:13.121 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.121 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.121 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:13.121 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385220+0000", 2024-09-12T22:33:13.121 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.004e-06 2024-09-12T22:33:13.122 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.122 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.122 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:13.122 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385223+0000", 2024-09-12T22:33:13.122 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.633e-06 2024-09-12T22:33:13.122 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.122 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.122 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:13.122 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.405826+0000", 2024-09-12T22:33:13.122 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.020603831999999999 2024-09-12T22:33:13.122 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.122 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.122 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:13.122 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.405898+0000", 2024-09-12T22:33:13.123 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1398999999999999e-05 2024-09-12T22:33:13.123 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.123 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.123 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:13.123 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.406011+0000", 2024-09-12T22:33:13.123 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000113411 2024-09-12T22:33:13.123 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.123 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.123 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:13.123 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.408285+0000", 2024-09-12T22:33:13.123 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.002273639 2024-09-12T22:33:13.123 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.123 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.124 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:13.124 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410313+0000", 2024-09-12T22:33:13.124 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0020280760000000002 2024-09-12T22:33:13.124 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.124 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.124 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:13.124 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410350+0000", 2024-09-12T22:33:13.124 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7307e-05 2024-09-12T22:33:13.124 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.124 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.124 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:13.124 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410383+0000", 2024-09-12T22:33:13.124 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2997000000000003e-05 2024-09-12T22:33:13.125 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:13.125 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:13.125 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:13.125 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.125 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.125 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:107 3.1f 3:f83d65d8:::200.00000004:head [write 422206~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-09-12T22:33:13.125 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:04.385226+0000", 2024-09-12T22:33:13.125 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 8.6900116750000009, 2024-09-12T22:33:13.125 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.025350256000000002, 2024-09-12T22:33:13.125 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:13.125 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:13.125 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:13.125 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:13.126 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.126 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:13.126 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385226+0000", 2024-09-12T22:33:13.126 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:13.126 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.126 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.126 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:13.126 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385226+0000", 2024-09-12T22:33:13.126 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:13.126 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.126 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.126 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:13.126 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385226+0000", 2024-09-12T22:33:13.127 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.2399999999999999e-07 2024-09-12T22:33:13.127 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.127 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.127 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:13.127 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385228+0000", 2024-09-12T22:33:13.127 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.508e-06 2024-09-12T22:33:13.127 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.127 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.127 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:13.127 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385235+0000", 2024-09-12T22:33:13.127 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.3169999999999998e-06 2024-09-12T22:33:13.127 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.127 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.127 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:13.128 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.385238+0000", 2024-09-12T22:33:13.128 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.9249999999999999e-06 2024-09-12T22:33:13.128 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.128 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.128 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:13.128 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.406376+0000", 2024-09-12T22:33:13.128 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.021138364999999999 2024-09-12T22:33:13.128 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.128 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.128 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:13.128 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.406451+0000", 2024-09-12T22:33:13.128 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4882000000000006e-05 2024-09-12T22:33:13.128 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.129 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.129 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:13.129 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.406590+0000", 2024-09-12T22:33:13.129 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000138627 2024-09-12T22:33:13.129 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.129 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.129 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:13.129 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410461+0000", 2024-09-12T22:33:13.129 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0038712109999999998 2024-09-12T22:33:13.129 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.129 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.129 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:13.129 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410493+0000", 2024-09-12T22:33:13.129 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2147999999999998e-05 2024-09-12T22:33:13.130 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.130 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.130 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:13.130 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410537+0000", 2024-09-12T22:33:13.130 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3792999999999999e-05 2024-09-12T22:33:13.130 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.130 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.130 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:13.130 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410576+0000", 2024-09-12T22:33:13.130 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9255999999999998e-05 2024-09-12T22:33:13.130 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:13.130 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:13.130 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:13.131 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.131 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.131 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4490.0:5682 4.3f 4:ff1ebe6d:::10000001a29.00000000:head [write 0~2106] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-12T22:33:13.131 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:04.386989+0000", 2024-09-12T22:33:13.131 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 8.6882487519999998, 2024-09-12T22:33:13.131 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.023595390000000001, 2024-09-12T22:33:13.131 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:13.131 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:13.131 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:13.131 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:33:13.131 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4490", 2024-09-12T22:33:13.131 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:13.131 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 5682 2024-09-12T22:33:13.131 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.132 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:13.132 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.132 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:13.132 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.386989+0000", 2024-09-12T22:33:13.132 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:13.132 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.132 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.132 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:13.132 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.386989+0000", 2024-09-12T22:33:13.132 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:13.132 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.132 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.132 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:13.132 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.386989+0000", 2024-09-12T22:33:13.133 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.8800000000000002e-07 2024-09-12T22:33:13.133 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.133 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.133 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:13.133 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.386994+0000", 2024-09-12T22:33:13.133 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4279999999999998e-06 2024-09-12T22:33:13.133 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.133 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.133 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:13.133 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.387001+0000", 2024-09-12T22:33:13.133 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.2320000000000004e-06 2024-09-12T22:33:13.133 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.133 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.134 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:13.134 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.387006+0000", 2024-09-12T22:33:13.134 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6589999999999998e-06 2024-09-12T22:33:13.134 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.134 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.134 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:13.134 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.407003+0000", 2024-09-12T22:33:13.134 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.019997635 2024-09-12T22:33:13.134 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.134 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.134 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:13.134 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.407134+0000", 2024-09-12T22:33:13.134 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013037899999999999 2024-09-12T22:33:13.134 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.135 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.135 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:13.135 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410469+0000", 2024-09-12T22:33:13.135 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0033353160000000001 2024-09-12T22:33:13.135 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.135 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.135 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:13.135 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410510+0000", 2024-09-12T22:33:13.135 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0553999999999998e-05 2024-09-12T22:33:13.135 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.135 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.135 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:13.135 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410584+0000", 2024-09-12T22:33:13.136 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4399000000000004e-05 2024-09-12T22:33:13.136 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:13.136 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:13.136 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:13.136 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.136 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.136 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:112 3.1f 3:f83d65d8:::200.00000004:head [write 449503~3460 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-09-12T22:33:13.136 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:04.393638+0000", 2024-09-12T22:33:13.136 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 8.6815989689999995, 2024-09-12T22:33:13.136 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.023344696000000002, 2024-09-12T22:33:13.136 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:13.136 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:13.136 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:13.137 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:13.137 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.137 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:13.137 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393638+0000", 2024-09-12T22:33:13.137 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:13.137 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.137 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.137 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:13.137 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393638+0000", 2024-09-12T22:33:13.137 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:13.137 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.137 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.137 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:13.137 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393639+0000", 2024-09-12T22:33:13.138 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.68e-07 2024-09-12T22:33:13.138 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.138 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.138 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:13.138 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393643+0000", 2024-09-12T22:33:13.138 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.98e-06 2024-09-12T22:33:13.138 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.138 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.138 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:13.138 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393650+0000", 2024-09-12T22:33:13.138 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.131e-06 2024-09-12T22:33:13.138 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.138 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.138 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:13.139 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393655+0000", 2024-09-12T22:33:13.139 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0270000000000003e-06 2024-09-12T22:33:13.139 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.139 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.139 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:13.139 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410618+0000", 2024-09-12T22:33:13.139 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016962600000000001 2024-09-12T22:33:13.139 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.139 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.139 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:13.139 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410679+0000", 2024-09-12T22:33:13.139 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.1014999999999998e-05 2024-09-12T22:33:13.139 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.140 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.140 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:13.140 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.410763+0000", 2024-09-12T22:33:13.140 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.4586000000000006e-05 2024-09-12T22:33:13.140 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.140 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.140 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:13.140 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.412605+0000", 2024-09-12T22:33:13.140 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001842036 2024-09-12T22:33:13.140 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.140 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.140 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:13.140 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.416894+0000", 2024-09-12T22:33:13.140 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0042887649999999999 2024-09-12T22:33:13.141 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.141 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.141 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:13.141 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.416947+0000", 2024-09-12T22:33:13.141 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2500999999999998e-05 2024-09-12T22:33:13.141 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.141 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.141 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:13.141 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.416983+0000", 2024-09-12T22:33:13.141 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.6486999999999998e-05 2024-09-12T22:33:13.141 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:13.141 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:13.141 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:13.142 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.142 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.142 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:113 3.1f 3:f83d65d8:::200.00000004:head [write 452963~1919 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-09-12T22:33:13.142 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:04.393838+0000", 2024-09-12T22:33:13.142 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 8.6813995669999997, 2024-09-12T22:33:13.142 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.023234016999999999, 2024-09-12T22:33:13.142 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:13.142 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:13.142 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:13.142 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:13.142 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.142 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:13.142 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393838+0000", 2024-09-12T22:33:13.143 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:13.143 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.143 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.143 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:13.143 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393838+0000", 2024-09-12T22:33:13.143 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:13.143 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.143 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.143 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:13.143 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393839+0000", 2024-09-12T22:33:13.143 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.9299999999999997e-07 2024-09-12T22:33:13.143 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.144 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.144 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:13.144 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393842+0000", 2024-09-12T22:33:13.144 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7759999999999999e-06 2024-09-12T22:33:13.144 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.144 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.144 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:13.144 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393850+0000", 2024-09-12T22:33:13.144 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.6590000000000007e-06 2024-09-12T22:33:13.144 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.144 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.144 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:13.144 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.393856+0000", 2024-09-12T22:33:13.145 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.1659999999999999e-06 2024-09-12T22:33:13.145 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.145 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.145 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:13.145 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.411099+0000", 2024-09-12T22:33:13.145 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017242785 2024-09-12T22:33:13.145 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.145 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.145 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:13.145 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.411172+0000", 2024-09-12T22:33:13.145 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.2552999999999995e-05 2024-09-12T22:33:13.145 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.146 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.146 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:13.146 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.411280+0000", 2024-09-12T22:33:13.146 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000108701 2024-09-12T22:33:13.146 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.146 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.146 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:13.146 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.413582+0000", 2024-09-12T22:33:13.146 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0023020290000000001 2024-09-12T22:33:13.146 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.146 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.146 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:13.146 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.417020+0000", 2024-09-12T22:33:13.147 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0034373860000000002 2024-09-12T22:33:13.147 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.147 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.147 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:13.147 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.417049+0000", 2024-09-12T22:33:13.147 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8986e-05 2024-09-12T22:33:13.147 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.147 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.147 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:13.147 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:04.417072+0000", 2024-09-12T22:33:13.147 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.3183000000000001e-05 2024-09-12T22:33:13.147 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:13.147 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:13.148 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:13.148 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.148 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.148 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4490.0:9866 4.b 4:d370243b:::10000002d48.00000000:head [write 0~1308] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:33:13.148 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:09.467883+0000", 2024-09-12T22:33:13.148 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 3.607354591, 2024-09-12T22:33:13.148 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.085024817000000003, 2024-09-12T22:33:13.148 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:13.148 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:13.148 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:13.148 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:33:13.149 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4490", 2024-09-12T22:33:13.149 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:13.149 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 9866 2024-09-12T22:33:13.149 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.149 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:13.149 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.149 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:13.149 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.467883+0000", 2024-09-12T22:33:13.149 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:13.149 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.149 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.149 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:13.150 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.467883+0000", 2024-09-12T22:33:13.150 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:13.150 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.150 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.150 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:13.150 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.467884+0000", 2024-09-12T22:33:13.150 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1800000000000005e-07 2024-09-12T22:33:13.150 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.150 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.150 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:13.150 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.467888+0000", 2024-09-12T22:33:13.150 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5959999999999997e-06 2024-09-12T22:33:13.151 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.151 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.151 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:13.151 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.467896+0000", 2024-09-12T22:33:13.151 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.8679999999999999e-06 2024-09-12T22:33:13.151 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.151 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.151 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:13.151 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.467901+0000", 2024-09-12T22:33:13.151 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9169999999999997e-06 2024-09-12T22:33:13.151 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.151 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.151 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:13.152 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.467944+0000", 2024-09-12T22:33:13.152 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3055e-05 2024-09-12T22:33:13.152 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.152 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.152 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:13.152 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.468011+0000", 2024-09-12T22:33:13.152 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7328000000000003e-05 2024-09-12T22:33:13.152 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.152 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.152 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:13.152 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.468078+0000", 2024-09-12T22:33:13.152 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7063999999999994e-05 2024-09-12T22:33:13.153 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.153 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.153 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:13.153 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.551406+0000", 2024-09-12T22:33:13.153 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.083327485000000007 2024-09-12T22:33:13.153 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.153 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.153 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:13.153 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.552822+0000", 2024-09-12T22:33:13.153 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001415929 2024-09-12T22:33:13.153 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.153 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.153 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:13.154 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.552863+0000", 2024-09-12T22:33:13.154 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0809000000000002e-05 2024-09-12T22:33:13.154 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.154 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.154 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:13.154 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.552908+0000", 2024-09-12T22:33:13.154 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5048e-05 2024-09-12T22:33:13.154 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:13.154 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:13.154 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:13.154 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.154 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.155 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4490.0:9867 4.16 4:6bd8f1b8:::10000002d49.00000000:head [write 0~1599] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:33:13.155 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:09.468760+0000", 2024-09-12T22:33:13.155 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 3.6064775820000001, 2024-09-12T22:33:13.155 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.086660499000000002, 2024-09-12T22:33:13.155 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:13.155 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:13.155 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:13.155 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:33:13.155 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4490", 2024-09-12T22:33:13.155 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:13.155 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 9867 2024-09-12T22:33:13.155 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.155 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:13.155 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.156 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:13.156 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.468760+0000", 2024-09-12T22:33:13.156 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:13.156 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.156 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.156 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:13.156 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.468760+0000", 2024-09-12T22:33:13.156 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:13.156 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.156 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.156 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:13.156 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.468761+0000", 2024-09-12T22:33:13.156 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4399999999999999e-07 2024-09-12T22:33:13.156 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.157 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.157 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:13.157 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.468765+0000", 2024-09-12T22:33:13.157 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3259999999999997e-06 2024-09-12T22:33:13.157 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.157 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.157 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:13.157 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.548969+0000", 2024-09-12T22:33:13.157 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.080204172000000004 2024-09-12T22:33:13.157 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.157 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.157 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:13.157 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.549001+0000", 2024-09-12T22:33:13.158 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.1464999999999998e-05 2024-09-12T22:33:13.158 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.158 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.158 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:13.158 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.549148+0000", 2024-09-12T22:33:13.158 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014749399999999999 2024-09-12T22:33:13.158 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.158 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.158 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:13.158 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.549379+0000", 2024-09-12T22:33:13.158 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000231091 2024-09-12T22:33:13.158 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.158 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.158 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:13.159 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.549518+0000", 2024-09-12T22:33:13.159 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013844899999999999 2024-09-12T22:33:13.159 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.159 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.159 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:13.159 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.552236+0000", 2024-09-12T22:33:13.159 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0027179869999999998 2024-09-12T22:33:13.159 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.159 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.159 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:13.159 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.555333+0000", 2024-09-12T22:33:13.159 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0030973559999999999 2024-09-12T22:33:13.159 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.160 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.160 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:13.160 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.555379+0000", 2024-09-12T22:33:13.160 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6236999999999998e-05 2024-09-12T22:33:13.160 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.160 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.160 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:13.160 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.555420+0000", 2024-09-12T22:33:13.160 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1177999999999998e-05 2024-09-12T22:33:13.161 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:13.161 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:13.161 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:13.161 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.161 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.161 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop_reply(client.4490.0:9866 4.b e53/18 ondisk, result = 0)", 2024-09-12T22:33:13.161 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:09.468826+0000", 2024-09-12T22:33:13.161 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 3.6064112870000002, 2024-09-12T22:33:13.161 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.082588348000000006, 2024-09-12T22:33:13.161 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:13.161 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:13.161 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:33:13.161 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:13.161 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.162 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:13.162 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.468826+0000", 2024-09-12T22:33:13.162 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:13.162 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.162 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.162 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:13.162 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.468826+0000", 2024-09-12T22:33:13.162 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:13.162 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.162 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.162 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:13.162 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.468827+0000", 2024-09-12T22:33:13.162 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3399999999999999e-07 2024-09-12T22:33:13.163 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.163 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.163 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:13.163 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.468830+0000", 2024-09-12T22:33:13.163 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.1559999999999999e-06 2024-09-12T22:33:13.163 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.163 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.163 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:13.163 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.548957+0000", 2024-09-12T22:33:13.163 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.080126852999999998 2024-09-12T22:33:13.163 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.163 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.163 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:13.163 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.548989+0000", 2024-09-12T22:33:13.164 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2409000000000001e-05 2024-09-12T22:33:13.164 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.164 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.164 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:13.164 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.551065+0000", 2024-09-12T22:33:13.164 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.002075871 2024-09-12T22:33:13.164 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.164 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.164 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:13.164 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.551398+0000", 2024-09-12T22:33:13.164 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00033339099999999999 2024-09-12T22:33:13.164 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.164 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.165 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:13.165 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.551414+0000", 2024-09-12T22:33:13.165 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6133999999999998e-05 2024-09-12T22:33:13.165 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:13.165 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:13.165 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:13.165 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.165 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.165 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4490.0:10437 4.2f 4:f6cd553b:::10000002fce.00000000:head [write 0~27313] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:33:13.165 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:10.050890+0000", 2024-09-12T22:33:13.165 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 3.024346891, 2024-09-12T22:33:13.165 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.056482601, 2024-09-12T22:33:13.166 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:13.166 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:13.166 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:13.166 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:33:13.166 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4490", 2024-09-12T22:33:13.166 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:13.166 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 10437 2024-09-12T22:33:13.166 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.166 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:13.166 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.166 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:13.166 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.050890+0000", 2024-09-12T22:33:13.166 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:13.167 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.167 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.167 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:13.167 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.050890+0000", 2024-09-12T22:33:13.167 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:13.167 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.167 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.167 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:13.167 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.050891+0000", 2024-09-12T22:33:13.167 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.6600000000000005e-07 2024-09-12T22:33:13.167 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.167 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.167 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:13.167 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.050906+0000", 2024-09-12T22:33:13.168 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4521e-05 2024-09-12T22:33:13.168 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.168 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.168 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:13.168 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.050915+0000", 2024-09-12T22:33:13.168 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.2569999999999996e-06 2024-09-12T22:33:13.168 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.168 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.168 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:13.168 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.050920+0000", 2024-09-12T22:33:13.168 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.724e-06 2024-09-12T22:33:13.168 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.168 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.169 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:13.169 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.050960+0000", 2024-09-12T22:33:13.169 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9999000000000001e-05 2024-09-12T22:33:13.169 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.169 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.169 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:13.169 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.051031+0000", 2024-09-12T22:33:13.169 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1007000000000006e-05 2024-09-12T22:33:13.169 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.169 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.169 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:13.169 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.107249+0000", 2024-09-12T22:33:13.169 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.056218432999999998 2024-09-12T22:33:13.169 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.170 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.170 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:13.170 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.107301+0000", 2024-09-12T22:33:13.170 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1289000000000003e-05 2024-09-12T22:33:13.170 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.170 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.170 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:13.170 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.107373+0000", 2024-09-12T22:33:13.170 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.2504999999999998e-05 2024-09-12T22:33:13.170 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:13.170 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:13.170 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:13.170 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.171 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.171 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4490.0:10439 4.12 4:483953cb:::10000002fd0.00000000:head [write 0~4842] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:33:13.171 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:10.052567+0000", 2024-09-12T22:33:13.171 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 3.0226706829999999, 2024-09-12T22:33:13.171 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.055835449000000002, 2024-09-12T22:33:13.171 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:13.171 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:13.171 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:13.171 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:33:13.171 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4490", 2024-09-12T22:33:13.171 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:13.171 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 10439 2024-09-12T22:33:13.171 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.172 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:13.172 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.172 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:13.172 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.052567+0000", 2024-09-12T22:33:13.172 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:13.172 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.172 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.172 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:13.172 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.052567+0000", 2024-09-12T22:33:13.172 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:13.172 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.172 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.172 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:13.173 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.052568+0000", 2024-09-12T22:33:13.173 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.3600000000000002e-07 2024-09-12T22:33:13.173 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.173 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.173 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:13.173 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.052591+0000", 2024-09-12T22:33:13.173 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.3110000000000001e-05 2024-09-12T22:33:13.173 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.173 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.173 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:13.173 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.106740+0000", 2024-09-12T22:33:13.173 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.054149315000000003 2024-09-12T22:33:13.173 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.174 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.174 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:13.174 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.106751+0000", 2024-09-12T22:33:13.174 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1056000000000001e-05 2024-09-12T22:33:13.174 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.174 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.174 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:13.174 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.106811+0000", 2024-09-12T22:33:13.174 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9515999999999997e-05 2024-09-12T22:33:13.174 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.174 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.174 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:13.174 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.106929+0000", 2024-09-12T22:33:13.175 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00011879000000000001 2024-09-12T22:33:13.175 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.175 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.175 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:13.175 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.108283+0000", 2024-09-12T22:33:13.175 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001354177 2024-09-12T22:33:13.175 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.175 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.175 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:13.175 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.108328+0000", 2024-09-12T22:33:13.175 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4931000000000001e-05 2024-09-12T22:33:13.175 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.175 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.176 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:13.176 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.108402+0000", 2024-09-12T22:33:13.176 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3718000000000001e-05 2024-09-12T22:33:13.176 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:13.176 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:13.176 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:13.176 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.176 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.176 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(client.4490.0:10445 4.3c e53/18 4:3d97251e:::10000002fd8.00000000:head v 53'154, mlcod=53'152)", 2024-09-12T22:33:13.176 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:10.058521+0000", 2024-09-12T22:33:13.176 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 3.0167163430000001, 2024-09-12T22:33:13.176 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.049310138000000003, 2024-09-12T22:33:13.176 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:13.177 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:13.177 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:13.177 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:13.177 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.177 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:13.177 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.058521+0000", 2024-09-12T22:33:13.177 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:13.177 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.177 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.177 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:13.177 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.058521+0000", 2024-09-12T22:33:13.177 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:13.177 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.178 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.178 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:13.178 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.058522+0000", 2024-09-12T22:33:13.178 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.1099999999999995e-07 2024-09-12T22:33:13.178 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.178 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.178 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:13.178 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.058530+0000", 2024-09-12T22:33:13.178 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.7290000000000006e-06 2024-09-12T22:33:13.178 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.178 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.178 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:13.178 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.106760+0000", 2024-09-12T22:33:13.178 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.048229384 2024-09-12T22:33:13.179 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.179 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.179 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:13.179 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.106770+0000", 2024-09-12T22:33:13.179 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0431999999999999e-05 2024-09-12T22:33:13.179 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.179 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.179 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:13.179 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.106823+0000", 2024-09-12T22:33:13.179 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2309999999999999e-05 2024-09-12T22:33:13.179 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.179 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.180 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:13.180 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.106841+0000", 2024-09-12T22:33:13.180 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.8218000000000001e-05 2024-09-12T22:33:13.180 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.180 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.180 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:13.180 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.107796+0000", 2024-09-12T22:33:13.180 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00095552600000000005 2024-09-12T22:33:13.180 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.180 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.180 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:13.180 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.107831+0000", 2024-09-12T22:33:13.180 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4928000000000002e-05 2024-09-12T22:33:13.181 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:13.181 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:13.181 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:13.181 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.181 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.181 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4490.0:11004 4.17 4:eafcd195:::10000003168.00000000:head [write 0~4194304 [2@2147258]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-12T22:33:13.181 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:12.866958+0000", 2024-09-12T22:33:13.181 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.208279714, 2024-09-12T22:33:13.181 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.023961489999999998, 2024-09-12T22:33:13.181 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:13.181 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:13.181 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:13.181 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:33:13.182 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4490", 2024-09-12T22:33:13.182 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:13.182 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 11004 2024-09-12T22:33:13.182 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.182 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:13.182 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.182 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:13.182 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:12.866958+0000", 2024-09-12T22:33:13.182 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:13.182 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.182 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.182 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:13.182 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:12.866958+0000", 2024-09-12T22:33:13.183 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:13.183 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.183 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.183 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:13.183 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:12.866959+0000", 2024-09-12T22:33:13.183 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.7199999999999997e-07 2024-09-12T22:33:13.183 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.183 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.183 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:13.183 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:12.875931+0000", 2024-09-12T22:33:13.183 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0089727810000000009 2024-09-12T22:33:13.183 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.183 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.183 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:13.184 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:12.875943+0000", 2024-09-12T22:33:13.184 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1868000000000001e-05 2024-09-12T22:33:13.184 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.184 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.184 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:13.184 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:12.875950+0000", 2024-09-12T22:33:13.184 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.5030000000000002e-06 2024-09-12T22:33:13.184 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.184 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.184 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:13.184 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:12.876018+0000", 2024-09-12T22:33:13.184 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7905999999999997e-05 2024-09-12T22:33:13.184 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.185 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.185 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:13.185 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:12.876102+0000", 2024-09-12T22:33:13.185 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.3926999999999998e-05 2024-09-12T22:33:13.185 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.185 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.185 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:13.185 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:12.876241+0000", 2024-09-12T22:33:13.185 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000139221 2024-09-12T22:33:13.185 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.185 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.185 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:13.186 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:12.885431+0000", 2024-09-12T22:33:13.186 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0091899200000000007 2024-09-12T22:33:13.186 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.186 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.186 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:13.186 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:12.890862+0000", 2024-09-12T22:33:13.186 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0054310549999999997 2024-09-12T22:33:13.186 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.186 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.186 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:13.186 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:12.890894+0000", 2024-09-12T22:33:13.186 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2570000000000002e-05 2024-09-12T22:33:13.186 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.187 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.187 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:13.187 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:12.890919+0000", 2024-09-12T22:33:13.187 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4867000000000001e-05 2024-09-12T22:33:13.187 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:13.187 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:13.187 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:13.187 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.187 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.187 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4490.0:11053 4.6 4:62f859fc:::100000031cc.00000001:head [write 0~4194304 [3@1972528]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-12T22:33:13.187 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:12.962287+0000", 2024-09-12T22:33:13.187 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.11295047599999999, 2024-09-12T22:33:13.187 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.024962995000000002, 2024-09-12T22:33:13.187 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:13.188 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:13.188 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:13.188 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:33:13.188 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4490", 2024-09-12T22:33:13.188 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:13.188 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 11053 2024-09-12T22:33:13.188 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.188 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:13.188 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.188 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:13.188 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:12.962287+0000", 2024-09-12T22:33:13.188 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:13.189 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.189 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.189 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:13.189 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:12.962287+0000", 2024-09-12T22:33:13.189 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:13.189 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.189 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.189 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:13.189 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:12.962288+0000", 2024-09-12T22:33:13.189 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1659999999999999e-06 2024-09-12T22:33:13.189 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.189 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.189 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:13.189 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:12.970206+0000", 2024-09-12T22:33:13.190 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.007918217 2024-09-12T22:33:13.190 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.190 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.190 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:13.190 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:12.970214+0000", 2024-09-12T22:33:13.190 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.1999999999999994e-06 2024-09-12T22:33:13.190 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.190 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.190 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:13.190 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:12.970221+0000", 2024-09-12T22:33:13.190 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.5610000000000004e-06 2024-09-12T22:33:13.190 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.190 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.190 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:13.191 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:12.970280+0000", 2024-09-12T22:33:13.191 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9333000000000003e-05 2024-09-12T22:33:13.191 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.191 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.191 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:13.191 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:12.970359+0000", 2024-09-12T22:33:13.191 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.8361000000000004e-05 2024-09-12T22:33:13.191 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.191 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.191 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:13.191 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:12.987139+0000", 2024-09-12T22:33:13.191 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.01678056 2024-09-12T22:33:13.191 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.191 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.192 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:13.192 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:12.987178+0000", 2024-09-12T22:33:13.192 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9155e-05 2024-09-12T22:33:13.192 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.192 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.192 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:13.192 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:12.987250+0000", 2024-09-12T22:33:13.192 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1441999999999998e-05 2024-09-12T22:33:13.192 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:13.192 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:13.192 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:13.192 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:13.192 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:13.193 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:33:13.195 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:33:13.195 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:13.193+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:13.220 INFO:tasks.workunit.client.0.smithi019.stdout:4/146: getdents d1/d8 0 2024-09-12T22:33:13.220 INFO:tasks.workunit.client.0.smithi019.stdout:2/197: dwrite d0/d5/f26 [4194304,4194304] 0 2024-09-12T22:33:13.220 INFO:tasks.workunit.client.0.smithi019.stdout:0/186: creat d1/d1f/f39 x:0 0 0 2024-09-12T22:33:13.220 INFO:tasks.workunit.client.0.smithi019.stdout:4/147: stat d1/d11/c36 0 2024-09-12T22:33:13.220 INFO:tasks.workunit.client.0.smithi019.stdout:7/122: mknod d6/db/dc/c2c 0 2024-09-12T22:33:13.220 INFO:tasks.workunit.client.0.smithi019.stdout:3/97: dwrite dd/d12/f15 [0,4194304] 0 2024-09-12T22:33:13.220 INFO:tasks.workunit.client.0.smithi019.stdout:0/187: mkdir d1/d14/d1b/d3a 0 2024-09-12T22:33:13.220 INFO:tasks.workunit.client.0.smithi019.stdout:2/198: creat d0/f48 x:0 0 0 2024-09-12T22:33:13.220 INFO:tasks.workunit.client.0.smithi019.stdout:5/292: dread d0/dc/d39/d38/f5c [0,4194304] 0 2024-09-12T22:33:13.221 INFO:tasks.workunit.client.0.smithi019.stdout:4/148: chown d1/d22/f33 19173936 1 2024-09-12T22:33:13.221 INFO:tasks.workunit.client.0.smithi019.stdout:7/123: dread - d6/d14/d15/f1b zero size 2024-09-12T22:33:13.221 INFO:tasks.workunit.client.0.smithi019.stdout:4/149: fdatasync d1/d8/fb 0 2024-09-12T22:33:13.221 INFO:tasks.workunit.client.0.smithi019.stdout:3/98: link dd/d12/f15 dd/d12/f24 0 2024-09-12T22:33:13.221 INFO:tasks.workunit.client.0.smithi019.stdout:5/293: symlink d0/dc/d39/l66 0 2024-09-12T22:33:13.221 INFO:tasks.workunit.client.0.smithi019.stdout:0/188: mknod d1/d14/d1b/d3a/c3b 0 2024-09-12T22:33:13.221 INFO:tasks.workunit.client.0.smithi019.stdout:7/124: write d6/db/dc/fd [2292386,110219] 0 2024-09-12T22:33:13.221 INFO:tasks.workunit.client.0.smithi019.stdout:3/99: rmdir dd/d12 39 2024-09-12T22:33:13.221 INFO:tasks.workunit.client.0.smithi019.stdout:5/294: read d0/f23 [513846,84454] 0 2024-09-12T22:33:13.221 INFO:tasks.workunit.client.0.smithi019.stdout:7/125: mkdir d6/d2d 0 2024-09-12T22:33:13.221 INFO:tasks.workunit.client.0.smithi019.stdout:3/100: write dd/d12/f24 [4583042,57201] 0 2024-09-12T22:33:13.221 INFO:tasks.workunit.client.0.smithi019.stdout:5/295: truncate d0/d7/d16/d18/f57 236442 0 2024-09-12T22:33:13.222 INFO:tasks.workunit.client.0.smithi019.stdout:3/101: readlink dd/d12/l1a 0 2024-09-12T22:33:13.222 INFO:tasks.workunit.client.0.smithi019.stdout:5/296: symlink d0/d7/d16/d18/l67 0 2024-09-12T22:33:13.222 INFO:tasks.workunit.client.0.smithi019.stdout:3/102: write dd/f17 [737090,90970] 0 2024-09-12T22:33:13.222 INFO:tasks.workunit.client.0.smithi019.stdout:3/103: readlink l0 0 2024-09-12T22:33:13.222 INFO:tasks.workunit.client.0.smithi019.stdout:5/297: symlink d0/d7/d16/d18/l68 0 2024-09-12T22:33:13.222 INFO:tasks.workunit.client.0.smithi019.stdout:3/104: chown dd/c1d 7048196 1 2024-09-12T22:33:13.222 INFO:tasks.workunit.client.0.smithi019.stdout:5/298: dread - d0/dc/d39/d38/f44 zero size 2024-09-12T22:33:13.222 INFO:tasks.workunit.client.0.smithi019.stdout:1/204: read d3/f14 [1316766,124128] 0 2024-09-12T22:33:13.222 INFO:tasks.workunit.client.0.smithi019.stdout:3/105: creat dd/d1e/f25 x:0 0 0 2024-09-12T22:33:13.222 INFO:tasks.workunit.client.0.smithi019.stdout:7/126: dwrite d6/db/f1c [0,4194304] 0 2024-09-12T22:33:13.222 INFO:tasks.workunit.client.0.smithi019.stdout:1/205: mknod d3/d11/d16/d23/c40 0 2024-09-12T22:33:13.222 INFO:tasks.workunit.client.0.smithi019.stdout:6/178: dread d1b/f2b [0,4194304] 0 2024-09-12T22:33:13.222 INFO:tasks.workunit.client.0.smithi019.stdout:5/299: chown d0/dc/d39/d38/d4b/l65 887707610 1 2024-09-12T22:33:13.223 INFO:tasks.workunit.client.0.smithi019.stdout:3/106: write dd/f16 [133507,111216] 0 2024-09-12T22:33:13.223 INFO:tasks.workunit.client.0.smithi019.stdout:7/127: write d6/db/f1c [1149567,33057] 0 2024-09-12T22:33:13.223 INFO:tasks.workunit.client.0.smithi019.stdout:4/150: dwrite d1/d11/d15/f1d [0,4194304] 0 2024-09-12T22:33:13.223 INFO:tasks.workunit.client.0.smithi019.stdout:1/206: creat d3/df/f41 x:0 0 0 2024-09-12T22:33:13.223 INFO:tasks.workunit.client.0.smithi019.stdout:5/300: fdatasync d0/d7/d16/f45 0 2024-09-12T22:33:13.223 INFO:tasks.workunit.client.0.smithi019.stdout:3/107: creat dd/f26 x:0 0 0 2024-09-12T22:33:13.223 INFO:tasks.workunit.client.0.smithi019.stdout:1/207: mknod d3/d11/c42 0 2024-09-12T22:33:13.223 INFO:tasks.workunit.client.0.smithi019.stdout:4/151: creat d1/d22/d26/f37 x:0 0 0 2024-09-12T22:33:13.223 INFO:tasks.workunit.client.0.smithi019.stdout:3/108: stat dd/d12/l19 0 2024-09-12T22:33:13.223 INFO:tasks.workunit.client.0.smithi019.stdout:7/128: write d6/f21 [672661,103854] 0 2024-09-12T22:33:13.223 INFO:tasks.workunit.client.0.smithi019.stdout:5/301: mkdir d0/d7/d16/d69 0 2024-09-12T22:33:13.223 INFO:tasks.workunit.client.0.smithi019.stdout:3/109: mknod dd/c27 0 2024-09-12T22:33:13.223 INFO:tasks.workunit.client.0.smithi019.stdout:4/152: truncate d1/d4/f13 1226831 0 2024-09-12T22:33:13.224 INFO:tasks.workunit.client.0.smithi019.stdout:1/208: rename d3/d11/d16/l3a to d3/df/l43 0 2024-09-12T22:33:13.224 INFO:tasks.workunit.client.0.smithi019.stdout:7/129: creat d6/db/dc/d26/f2e x:0 0 0 2024-09-12T22:33:13.224 INFO:tasks.workunit.client.0.smithi019.stdout:5/302: chown d0/dc/d39/d38/d4b/l65 2893 1 2024-09-12T22:33:13.224 INFO:tasks.workunit.client.0.smithi019.stdout:4/153: dread - d1/d11/d15/f2b zero size 2024-09-12T22:33:13.224 INFO:tasks.workunit.client.0.smithi019.stdout:6/179: dwrite d1b/f23 [0,4194304] 0 2024-09-12T22:33:13.224 INFO:tasks.workunit.client.0.smithi019.stdout:7/130: chown d6/d14/d27 1692742 1 2024-09-12T22:33:13.224 INFO:tasks.workunit.client.0.smithi019.stdout:6/180: read - d1b/d26/f3a zero size 2024-09-12T22:33:13.224 INFO:tasks.workunit.client.0.smithi019.stdout:3/110: creat dd/f28 x:0 0 0 2024-09-12T22:33:13.224 INFO:tasks.workunit.client.0.smithi019.stdout:4/154: write d1/d22/d26/f37 [961569,29092] 0 2024-09-12T22:33:13.224 INFO:tasks.workunit.client.0.smithi019.stdout:5/303: mkdir d0/d7/d2d/d32/d36/d6a 0 2024-09-12T22:33:13.224 INFO:tasks.workunit.client.0.smithi019.stdout:7/131: creat d6/db/dc/d26/f2f x:0 0 0 2024-09-12T22:33:13.224 INFO:tasks.workunit.client.0.smithi019.stdout:7/132: readlink l0 0 2024-09-12T22:33:13.225 INFO:tasks.workunit.client.0.smithi019.stdout:6/181: getdents d1b/d26 0 2024-09-12T22:33:13.225 INFO:tasks.workunit.client.0.smithi019.stdout:7/133: symlink d6/d2d/l30 0 2024-09-12T22:33:13.225 INFO:tasks.workunit.client.0.smithi019.stdout:5/304: fsync d0/d7/d16/d18/f57 0 2024-09-12T22:33:13.225 INFO:tasks.workunit.client.0.smithi019.stdout:1/209: dwrite d3/d3f/f24 [0,4194304] 0 2024-09-12T22:33:13.225 INFO:tasks.workunit.client.0.smithi019.stdout:8/134: dread d7/f1d [0,4194304] 0 2024-09-12T22:33:13.225 INFO:tasks.workunit.client.0.smithi019.stdout:3/111: truncate fc 1677640 0 2024-09-12T22:33:13.225 INFO:tasks.workunit.client.0.smithi019.stdout:5/305: write d0/dc/d39/d38/f62 [543940,7388] 0 2024-09-12T22:33:13.225 INFO:tasks.workunit.client.0.smithi019.stdout:7/134: creat d6/f31 x:0 0 0 2024-09-12T22:33:13.225 INFO:tasks.workunit.client.0.smithi019.stdout:3/112: fsync dd/f16 0 2024-09-12T22:33:13.225 INFO:tasks.workunit.client.0.smithi019.stdout:0/189: dread d1/d1f/f33 [0,4194304] 0 2024-09-12T22:33:13.225 INFO:tasks.workunit.client.0.smithi019.stdout:1/210: creat d3/d11/d16/d23/f44 x:0 0 0 2024-09-12T22:33:13.225 INFO:tasks.workunit.client.0.smithi019.stdout:3/113: fdatasync f5 0 2024-09-12T22:33:13.225 INFO:tasks.workunit.client.0.smithi019.stdout:8/135: creat d7/f29 x:0 0 0 2024-09-12T22:33:13.226 INFO:tasks.workunit.client.0.smithi019.stdout:1/211: read - d3/d11/f35 zero size 2024-09-12T22:33:13.226 INFO:tasks.workunit.client.0.smithi019.stdout:3/114: creat dd/d12/f29 x:0 0 0 2024-09-12T22:33:13.226 INFO:tasks.workunit.client.0.smithi019.stdout:8/136: creat d7/d8/dd/f2a x:0 0 0 2024-09-12T22:33:13.226 INFO:tasks.workunit.client.0.smithi019.stdout:7/135: link d6/db/dc/ca d6/d14/d15/d23/c32 0 2024-09-12T22:33:13.226 INFO:tasks.workunit.client.0.smithi019.stdout:0/190: getdents d1 0 2024-09-12T22:33:13.226 INFO:tasks.workunit.client.0.smithi019.stdout:9/133: dread dd/f1f [0,4194304] 0 2024-09-12T22:33:13.226 INFO:tasks.workunit.client.0.smithi019.stdout:1/212: chown d3/d1b/f21 0 1 2024-09-12T22:33:13.226 INFO:tasks.workunit.client.0.smithi019.stdout:0/191: symlink d1/l3c 0 2024-09-12T22:33:13.226 INFO:tasks.workunit.client.0.smithi019.stdout:7/136: rmdir d6/db/dc 39 2024-09-12T22:33:13.226 INFO:tasks.workunit.client.0.smithi019.stdout:1/213: creat d3/d11/d16/f45 x:0 0 0 2024-09-12T22:33:13.226 INFO:tasks.workunit.client.0.smithi019.stdout:5/306: dwrite d0/d7/d16/d18/f28 [0,4194304] 0 2024-09-12T22:33:13.226 INFO:tasks.workunit.client.0.smithi019.stdout:8/137: link d7/l9 d7/l2b 0 2024-09-12T22:33:13.226 INFO:tasks.workunit.client.0.smithi019.stdout:0/192: mkdir d1/d14/d32/d3d 0 2024-09-12T22:33:13.227 INFO:tasks.workunit.client.0.smithi019.stdout:9/134: link dd/l1b dd/d10/d17/l30 0 2024-09-12T22:33:13.227 INFO:tasks.workunit.client.0.smithi019.stdout:0/193: readlink d1/l29 0 2024-09-12T22:33:13.227 INFO:tasks.workunit.client.0.smithi019.stdout:1/214: read d3/d3f/f24 [2309834,53672] 0 2024-09-12T22:33:13.227 INFO:tasks.workunit.client.0.smithi019.stdout:5/307: symlink d0/d7/d16/d69/l6b 0 2024-09-12T22:33:13.227 INFO:tasks.workunit.client.0.smithi019.stdout:1/215: write d3/d11/f35 [139136,101198] 0 2024-09-12T22:33:13.227 INFO:tasks.workunit.client.0.smithi019.stdout:0/194: rename d1/l3c to d1/d1f/l3e 0 2024-09-12T22:33:13.227 INFO:tasks.workunit.client.0.smithi019.stdout:3/115: dread dd/f11 [0,4194304] 0 2024-09-12T22:33:13.227 INFO:tasks.workunit.client.0.smithi019.stdout:5/308: write d0/f2 [3636493,83053] 0 2024-09-12T22:33:13.227 INFO:tasks.workunit.client.0.smithi019.stdout:9/135: mkdir dd/d10/d17/d23/d2e/d31 0 2024-09-12T22:33:13.227 INFO:tasks.workunit.client.0.smithi019.stdout:2/199: dread d0/d5/d18/f3e [0,4194304] 0 2024-09-12T22:33:13.227 INFO:tasks.workunit.client.0.smithi019.stdout:5/309: symlink d0/dc/d39/d38/l6c 0 2024-09-12T22:33:13.227 INFO:tasks.workunit.client.0.smithi019.stdout:2/200: creat d0/d5/d18/d3b/f49 x:0 0 0 2024-09-12T22:33:13.227 INFO:tasks.workunit.client.0.smithi019.stdout:5/310: dread - d0/dc/d39/f4e zero size 2024-09-12T22:33:13.228 INFO:tasks.workunit.client.0.smithi019.stdout:2/201: write d0/d5/f22 [2826694,77097] 0 2024-09-12T22:33:13.228 INFO:tasks.workunit.client.0.smithi019.stdout:7/137: dread d6/d14/d15/f24 [0,4194304] 0 2024-09-12T22:33:13.228 INFO:tasks.workunit.client.0.smithi019.stdout:4/155: sync 2024-09-12T22:33:13.228 INFO:tasks.workunit.client.0.smithi019.stdout:6/182: sync 2024-09-12T22:33:13.228 INFO:tasks.workunit.client.0.smithi019.stdout:3/116: unlink fc 0 2024-09-12T22:33:13.228 INFO:tasks.workunit.client.0.smithi019.stdout:2/202: write d0/d5/d17/f14 [4373537,59892] 0 2024-09-12T22:33:13.228 INFO:tasks.workunit.client.0.smithi019.stdout:5/311: link d0/d7/d16/d18/l68 d0/d7/l6d 0 2024-09-12T22:33:13.228 INFO:tasks.workunit.client.0.smithi019.stdout:8/138: truncate d7/d8/dd/f12 3178601 0 2024-09-12T22:33:13.228 INFO:tasks.workunit.client.0.smithi019.stdout:9/136: dread dd/d10/f19 [0,4194304] 0 2024-09-12T22:33:13.228 INFO:tasks.workunit.client.0.smithi019.stdout:0/195: truncate d1/d14/f1e 1189789 0 2024-09-12T22:33:13.228 INFO:tasks.workunit.client.0.smithi019.stdout:1/216: dwrite d3/d11/d16/f3b [0,4194304] 0 2024-09-12T22:33:13.228 INFO:tasks.workunit.client.0.smithi019.stdout:1/217: chown d3/d1b 1 1 2024-09-12T22:33:13.228 INFO:tasks.workunit.client.0.smithi019.stdout:6/183: write d1b/f22 [99469,12095] 0 2024-09-12T22:33:13.229 INFO:tasks.workunit.client.0.smithi019.stdout:5/312: chown d0/d7/d16/d18/f28 7 1 2024-09-12T22:33:13.229 INFO:tasks.workunit.client.0.smithi019.stdout:2/203: chown d0/d5/d18/c2a 16203925 1 2024-09-12T22:33:13.229 INFO:tasks.workunit.client.0.smithi019.stdout:0/196: symlink d1/d14/l3f 0 2024-09-12T22:33:13.229 INFO:tasks.workunit.client.0.smithi019.stdout:9/137: symlink dd/d10/d17/d23/d2e/l32 0 2024-09-12T22:33:13.229 INFO:tasks.workunit.client.0.smithi019.stdout:5/313: write d0/dc/d39/d38/f44 [667081,60406] 0 2024-09-12T22:33:13.229 INFO:tasks.workunit.client.0.smithi019.stdout:8/139: link d7/f19 d7/f2c 0 2024-09-12T22:33:13.229 INFO:tasks.workunit.client.0.smithi019.stdout:7/138: dwrite d6/db/dc/fd [4194304,4194304] 0 2024-09-12T22:33:13.229 INFO:tasks.workunit.client.0.smithi019.stdout:9/138: fsync dd/f18 0 2024-09-12T22:33:13.229 INFO:tasks.workunit.client.0.smithi019.stdout:2/204: rename d0/f11 to d0/d5/d18/d1b/d36/f4a 0 2024-09-12T22:33:13.229 INFO:tasks.workunit.client.0.smithi019.stdout:4/156: dwrite d1/d11/d15/f2e [0,4194304] 0 2024-09-12T22:33:13.229 INFO:tasks.workunit.client.0.smithi019.stdout:3/117: dwrite dd/f28 [0,4194304] 0 2024-09-12T22:33:13.229 INFO:tasks.workunit.client.0.smithi019.stdout:8/140: write d7/f19 [1019703,37219] 0 2024-09-12T22:33:13.229 INFO:tasks.workunit.client.0.smithi019.stdout:9/139: chown dd/d10/d17/f24 276454 1 2024-09-12T22:33:13.230 INFO:tasks.workunit.client.0.smithi019.stdout:0/197: read d1/d14/f1e [41265,116707] 0 2024-09-12T22:33:13.230 INFO:tasks.workunit.client.0.smithi019.stdout:2/205: rmdir d0/da 39 2024-09-12T22:33:13.230 INFO:tasks.workunit.client.0.smithi019.stdout:7/139: creat d6/d14/d27/f33 x:0 0 0 2024-09-12T22:33:13.230 INFO:tasks.workunit.client.0.smithi019.stdout:4/157: mkdir d1/d4/d38 0 2024-09-12T22:33:13.230 INFO:tasks.workunit.client.0.smithi019.stdout:2/206: sync 2024-09-12T22:33:13.230 INFO:tasks.workunit.client.0.smithi019.stdout:1/218: dwrite d3/d1b/f26 [8388608,4194304] 0 2024-09-12T22:33:13.230 INFO:tasks.workunit.client.0.smithi019.stdout:0/198: mkdir d1/d14/d26/d40 0 2024-09-12T22:33:13.230 INFO:tasks.workunit.client.0.smithi019.stdout:6/184: dwrite d1b/f23 [0,4194304] 0 2024-09-12T22:33:13.230 INFO:tasks.workunit.client.0.smithi019.stdout:8/141: mkdir d7/d8/df/d2d 0 2024-09-12T22:33:13.230 INFO:tasks.workunit.client.0.smithi019.stdout:7/140: mkdir d6/db/d34 0 2024-09-12T22:33:13.230 INFO:tasks.workunit.client.0.smithi019.stdout:9/140: symlink dd/d10/d17/d23/d2e/l33 0 2024-09-12T22:33:13.230 INFO:tasks.workunit.client.0.smithi019.stdout:8/142: fsync d7/d8/f1b 0 2024-09-12T22:33:13.231 INFO:tasks.workunit.client.0.smithi019.stdout:8/143: sync 2024-09-12T22:33:13.231 INFO:tasks.workunit.client.0.smithi019.stdout:9/141: truncate dd/d10/f19 5042797 0 2024-09-12T22:33:13.231 INFO:tasks.workunit.client.0.smithi019.stdout:9/142: sync 2024-09-12T22:33:13.231 INFO:tasks.workunit.client.0.smithi019.stdout:3/118: dread dd/d12/f18 [0,4194304] 0 2024-09-12T22:33:13.231 INFO:tasks.workunit.client.0.smithi019.stdout:8/144: creat d7/d8/f2e x:0 0 0 2024-09-12T22:33:13.231 INFO:tasks.workunit.client.0.smithi019.stdout:7/141: mknod d6/c35 0 2024-09-12T22:33:13.231 INFO:tasks.workunit.client.0.smithi019.stdout:0/199: getdents d1/d14/d32 0 2024-09-12T22:33:13.231 INFO:tasks.workunit.client.0.smithi019.stdout:3/119: write f2 [2605910,127722] 0 2024-09-12T22:33:13.231 INFO:tasks.workunit.client.0.smithi019.stdout:8/145: mkdir d7/d2f 0 2024-09-12T22:33:13.231 INFO:tasks.workunit.client.0.smithi019.stdout:7/142: creat d6/db/dc/d26/f36 x:0 0 0 2024-09-12T22:33:13.231 INFO:tasks.workunit.client.0.smithi019.stdout:0/200: chown d1/c28 59318 1 2024-09-12T22:33:13.231 INFO:tasks.workunit.client.0.smithi019.stdout:2/207: dwrite d0/da/f29 [0,4194304] 0 2024-09-12T22:33:13.232 INFO:tasks.workunit.client.0.smithi019.stdout:1/219: dwrite d3/d1b/f26 [4194304,4194304] 0 2024-09-12T22:33:13.232 INFO:tasks.workunit.client.0.smithi019.stdout:4/158: dwrite d1/d11/f23 [0,4194304] 0 2024-09-12T22:33:13.232 INFO:tasks.workunit.client.0.smithi019.stdout:7/143: creat d6/d14/d27/f37 x:0 0 0 2024-09-12T22:33:13.232 INFO:tasks.workunit.client.0.smithi019.stdout:0/201: write d1/f2c [800219,10876] 0 2024-09-12T22:33:13.232 INFO:tasks.workunit.client.0.smithi019.stdout:6/185: dwrite f0 [0,4194304] 0 2024-09-12T22:33:13.232 INFO:tasks.workunit.client.0.smithi019.stdout:0/202: sync 2024-09-12T22:33:13.232 INFO:tasks.workunit.client.0.smithi019.stdout:8/146: truncate d7/d8/dd/f2a 499875 0 2024-09-12T22:33:13.232 INFO:tasks.workunit.client.0.smithi019.stdout:4/159: stat d1/d11/d15/f2b 0 2024-09-12T22:33:13.232 INFO:tasks.workunit.client.0.smithi019.stdout:1/220: fdatasync d3/d11/f36 0 2024-09-12T22:33:13.232 INFO:tasks.workunit.client.0.smithi019.stdout:6/186: chown fd 134498 1 2024-09-12T22:33:13.232 INFO:tasks.workunit.client.0.smithi019.stdout:9/143: dwrite dd/f20 [0,4194304] 0 2024-09-12T22:33:13.232 INFO:tasks.workunit.client.0.smithi019.stdout:9/144: sync 2024-09-12T22:33:13.232 INFO:tasks.workunit.client.0.smithi019.stdout:2/208: creat d0/d5/d18/d1b/f4b x:0 0 0 2024-09-12T22:33:13.233 INFO:tasks.workunit.client.0.smithi019.stdout:4/160: creat d1/d4/f39 x:0 0 0 2024-09-12T22:33:13.233 INFO:tasks.workunit.client.0.smithi019.stdout:1/221: symlink d3/df/l46 0 2024-09-12T22:33:13.233 INFO:tasks.workunit.client.0.smithi019.stdout:4/161: sync 2024-09-12T22:33:13.233 INFO:tasks.workunit.client.0.smithi019.stdout:2/209: creat d0/d5/d18/d1b/d36/f4c x:0 0 0 2024-09-12T22:33:13.233 INFO:tasks.workunit.client.0.smithi019.stdout:1/222: chown d3/f9 14052 1 2024-09-12T22:33:13.233 INFO:tasks.workunit.client.0.smithi019.stdout:4/162: symlink d1/d11/d15/d1f/l3a 0 2024-09-12T22:33:13.233 INFO:tasks.workunit.client.0.smithi019.stdout:9/145: creat dd/d10/d17/d23/d2e/d31/f34 x:0 0 0 2024-09-12T22:33:13.233 INFO:tasks.workunit.client.0.smithi019.stdout:3/120: dwrite f2 [0,4194304] 0 2024-09-12T22:33:13.233 INFO:tasks.workunit.client.0.smithi019.stdout:7/144: dread d6/db/dc/fd [4194304,4194304] 0 2024-09-12T22:33:13.233 INFO:tasks.workunit.client.0.smithi019.stdout:0/203: truncate d1/d1d/f27 4190187 0 2024-09-12T22:33:13.233 INFO:tasks.workunit.client.0.smithi019.stdout:9/146: mkdir dd/d10/d17/d23/d2e/d35 0 2024-09-12T22:33:13.233 INFO:tasks.workunit.client.0.smithi019.stdout:1/223: write d3/d1b/f1d [4271870,115711] 0 2024-09-12T22:33:13.233 INFO:tasks.workunit.client.0.smithi019.stdout:2/210: creat d0/d5/d18/d1b/f4d x:0 0 0 2024-09-12T22:33:13.234 INFO:tasks.workunit.client.0.smithi019.stdout:6/187: dread d1b/f2b [0,4194304] 0 2024-09-12T22:33:13.234 INFO:tasks.workunit.client.0.smithi019.stdout:0/204: chown d1/d1f/l2d 161335095 1 2024-09-12T22:33:13.234 INFO:tasks.workunit.client.0.smithi019.stdout:9/147: chown c8 109 1 2024-09-12T22:33:13.234 INFO:tasks.workunit.client.0.smithi019.stdout:7/145: creat d6/db/d34/f38 x:0 0 0 2024-09-12T22:33:13.234 INFO:tasks.workunit.client.0.smithi019.stdout:2/211: rename d0/d5/d18/d1b/d36 to d0/d5/d18/d1b/d36/d4e 22 2024-09-12T22:33:13.234 INFO:tasks.workunit.client.0.smithi019.stdout:1/224: write d3/d11/d16/d23/f44 [789213,50186] 0 2024-09-12T22:33:13.234 INFO:tasks.workunit.client.0.smithi019.stdout:6/188: write d1b/d26/d27/f2f [178921,78425] 0 2024-09-12T22:33:13.234 INFO:tasks.workunit.client.0.smithi019.stdout:0/205: creat d1/d1f/f41 x:0 0 0 2024-09-12T22:33:13.234 INFO:tasks.workunit.client.0.smithi019.stdout:9/148: mkdir dd/d10/d17/d36 0 2024-09-12T22:33:13.234 INFO:tasks.workunit.client.0.smithi019.stdout:6/189: stat l10 0 2024-09-12T22:33:13.234 INFO:tasks.workunit.client.0.smithi019.stdout:7/146: mknod d6/d14/d2a/c39 0 2024-09-12T22:33:13.234 INFO:tasks.workunit.client.0.smithi019.stdout:8/147: dwrite f0 [0,4194304] 0 2024-09-12T22:33:13.234 INFO:tasks.workunit.client.0.smithi019.stdout:0/206: write d1/d1f/f41 [403078,42844] 0 2024-09-12T22:33:13.235 INFO:tasks.workunit.client.0.smithi019.stdout:9/149: mkdir dd/d10/d17/d23/d37 0 2024-09-12T22:33:13.235 INFO:tasks.workunit.client.0.smithi019.stdout:4/163: dread d1/d22/f27 [0,4194304] 0 2024-09-12T22:33:13.235 INFO:tasks.workunit.client.0.smithi019.stdout:1/225: write d3/f31 [1027501,91537] 0 2024-09-12T22:33:13.235 INFO:tasks.workunit.client.0.smithi019.stdout:7/147: dread - d6/db/d34/f38 zero size 2024-09-12T22:33:13.235 INFO:tasks.workunit.client.0.smithi019.stdout:2/212: truncate d0/d5/d18/d1b/f4d 966398 0 2024-09-12T22:33:13.235 INFO:tasks.workunit.client.0.smithi019.stdout:7/148: sync 2024-09-12T22:33:13.235 INFO:tasks.workunit.client.0.smithi019.stdout:6/190: rename d1b/f23 to d1b/d26/d39/f41 0 2024-09-12T22:33:13.235 INFO:tasks.workunit.client.0.smithi019.stdout:8/148: creat d7/d8/df/d2d/f30 x:0 0 0 2024-09-12T22:33:13.235 INFO:tasks.workunit.client.0.smithi019.stdout:9/150: unlink dd/d10/l2b 0 2024-09-12T22:33:13.235 INFO:tasks.workunit.client.0.smithi019.stdout:1/226: creat d3/d11/f47 x:0 0 0 2024-09-12T22:33:13.235 INFO:tasks.workunit.client.0.smithi019.stdout:2/213: write d0/d5/d18/d39/f44 [906460,20367] 0 2024-09-12T22:33:13.235 INFO:tasks.workunit.client.0.smithi019.stdout:7/149: fsync d6/db/dc/f9 0 2024-09-12T22:33:13.235 INFO:tasks.workunit.client.0.smithi019.stdout:8/149: symlink d7/l31 0 2024-09-12T22:33:13.235 INFO:tasks.workunit.client.0.smithi019.stdout:1/227: creat d3/df/f48 x:0 0 0 2024-09-12T22:33:13.236 INFO:tasks.workunit.client.0.smithi019.stdout:2/214: dread - d0/d5/f3a zero size 2024-09-12T22:33:13.236 INFO:tasks.workunit.client.0.smithi019.stdout:0/207: link d1/d1f/l2d d1/d1f/l42 0 2024-09-12T22:33:13.236 INFO:tasks.workunit.client.0.smithi019.stdout:6/191: creat d1b/d2d/f42 x:0 0 0 2024-09-12T22:33:13.236 INFO:tasks.workunit.client.0.smithi019.stdout:0/208: readlink d1/d14/l3f 0 2024-09-12T22:33:13.236 INFO:tasks.workunit.client.0.smithi019.stdout:1/228: write d3/df/f48 [912748,30023] 0 2024-09-12T22:33:13.236 INFO:tasks.workunit.client.0.smithi019.stdout:8/150: mkdir d7/d8/d32 0 2024-09-12T22:33:13.236 INFO:tasks.workunit.client.0.smithi019.stdout:9/151: rmdir dd/d10/d17/d23/d2e/d35 0 2024-09-12T22:33:13.236 INFO:tasks.workunit.client.0.smithi019.stdout:7/150: link d6/db/f1c d6/db/f3a 0 2024-09-12T22:33:13.236 INFO:tasks.workunit.client.0.smithi019.stdout:1/229: symlink d3/d1b/l49 0 2024-09-12T22:33:13.236 INFO:tasks.workunit.client.0.smithi019.stdout:0/209: stat d1/d14/d1b/d3a/c3b 0 2024-09-12T22:33:13.236 INFO:tasks.workunit.client.0.smithi019.stdout:7/151: fsync d6/d14/d27/f33 0 2024-09-12T22:33:13.236 INFO:tasks.workunit.client.0.smithi019.stdout:4/164: dwrite d1/d8/f10 [8388608,4194304] 0 2024-09-12T22:33:13.236 INFO:tasks.workunit.client.0.smithi019.stdout:1/230: truncate d3/d11/f3d 21490 0 2024-09-12T22:33:13.237 INFO:tasks.workunit.client.0.smithi019.stdout:8/151: creat d7/d8/df/f33 x:0 0 0 2024-09-12T22:33:13.237 INFO:tasks.workunit.client.0.smithi019.stdout:9/152: rmdir dd/d10/d17/d23/d2e 39 2024-09-12T22:33:13.237 INFO:tasks.workunit.client.0.smithi019.stdout:6/192: link l12 d1b/l43 0 2024-09-12T22:33:13.237 INFO:tasks.workunit.client.0.smithi019.stdout:4/165: chown d1/d8/f20 68 1 2024-09-12T22:33:13.237 INFO:tasks.workunit.client.0.smithi019.stdout:0/210: link d1/d14/f22 d1/d14/d32/f43 0 2024-09-12T22:33:13.237 INFO:tasks.workunit.client.0.smithi019.stdout:1/231: symlink d3/l4a 0 2024-09-12T22:33:13.237 INFO:tasks.workunit.client.0.smithi019.stdout:7/152: creat d6/db/f3b x:0 0 0 2024-09-12T22:33:13.237 INFO:tasks.workunit.client.0.smithi019.stdout:5/314: dread d0/d7/d16/f45 [0,4194304] 0 2024-09-12T22:33:13.237 INFO:tasks.workunit.client.0.smithi019.stdout:6/193: fdatasync d1b/d26/d39/f41 0 2024-09-12T22:33:13.237 INFO:tasks.workunit.client.0.smithi019.stdout:2/215: dwrite d0/d5/d18/d3b/f3f [0,4194304] 0 2024-09-12T22:33:13.237 INFO:tasks.workunit.client.0.smithi019.stdout:3/121: fsync dd/f11 0 2024-09-12T22:33:13.237 INFO:tasks.workunit.client.0.smithi019.stdout:9/153: dread dd/f18 [0,4194304] 0 2024-09-12T22:33:13.237 INFO:tasks.workunit.client.0.smithi019.stdout:4/166: rmdir d1/d11/d15 39 2024-09-12T22:33:13.237 INFO:tasks.workunit.client.0.smithi019.stdout:0/211: creat d1/d14/d1b/f44 x:0 0 0 2024-09-12T22:33:13.238 INFO:tasks.workunit.client.0.smithi019.stdout:1/232: symlink d3/d11/d16/d3c/l4b 0 2024-09-12T22:33:13.238 INFO:tasks.workunit.client.0.smithi019.stdout:6/194: dread f0 [0,4194304] 0 2024-09-12T22:33:13.238 INFO:tasks.workunit.client.0.smithi019.stdout:4/167: getdents d1/d4/d38 0 2024-09-12T22:33:13.238 INFO:tasks.workunit.client.0.smithi019.stdout:3/122: creat dd/f2a x:0 0 0 2024-09-12T22:33:13.238 INFO:tasks.workunit.client.0.smithi019.stdout:0/212: dread d1/d1f/f33 [0,4194304] 0 2024-09-12T22:33:13.238 INFO:tasks.workunit.client.0.smithi019.stdout:9/154: creat dd/d10/d17/d23/d2e/f38 x:0 0 0 2024-09-12T22:33:13.238 INFO:tasks.workunit.client.0.smithi019.stdout:1/233: mknod d3/d11/c4c 0 2024-09-12T22:33:13.238 INFO:tasks.workunit.client.0.smithi019.stdout:6/195: chown d1b/d26/d27/d3e 56 1 2024-09-12T22:33:13.238 INFO:tasks.workunit.client.0.smithi019.stdout:8/152: dwrite d7/f1d [0,4194304] 0 2024-09-12T22:33:13.238 INFO:tasks.workunit.client.0.smithi019.stdout:3/123: unlink dd/c27 0 2024-09-12T22:33:13.238 INFO:tasks.workunit.client.0.smithi019.stdout:9/155: readlink dd/d10/d17/l26 0 2024-09-12T22:33:13.238 INFO:tasks.workunit.client.0.smithi019.stdout:7/153: dwrite d6/db/dc/f9 [0,4194304] 0 2024-09-12T22:33:13.238 INFO:tasks.workunit.client.0.smithi019.stdout:4/168: dread - d1/d11/d15/f2b zero size 2024-09-12T22:33:13.238 INFO:tasks.workunit.client.0.smithi019.stdout:6/196: stat d1b/d26/d27/f2f 0 2024-09-12T22:33:13.239 INFO:tasks.workunit.client.0.smithi019.stdout:2/216: dwrite d0/d5/d17/fe [4194304,4194304] 0 2024-09-12T22:33:13.239 INFO:tasks.workunit.client.0.smithi019.stdout:9/156: read dd/f18 [3318471,19966] 0 2024-09-12T22:33:13.239 INFO:tasks.workunit.client.0.smithi019.stdout:8/153: readlink d7/d8/dd/l1e 0 2024-09-12T22:33:13.239 INFO:tasks.workunit.client.0.smithi019.stdout:0/213: truncate d1/d1d/f2f 932769 0 2024-09-12T22:33:13.239 INFO:tasks.workunit.client.0.smithi019.stdout:3/124: write dd/f20 [875425,23605] 0 2024-09-12T22:33:13.239 INFO:tasks.workunit.client.0.smithi019.stdout:6/197: mkdir d1b/d2d/d44 0 2024-09-12T22:33:13.239 INFO:tasks.workunit.client.0.smithi019.stdout:4/169: write d1/f25 [1738224,72067] 0 2024-09-12T22:33:13.239 INFO:tasks.workunit.client.0.smithi019.stdout:8/154: readlink d7/l31 0 2024-09-12T22:33:13.239 INFO:tasks.workunit.client.0.smithi019.stdout:1/234: creat d3/f4d x:0 0 0 2024-09-12T22:33:13.239 INFO:tasks.workunit.client.0.smithi019.stdout:5/315: dwrite d0/d7/d16/f2a [0,4194304] 0 2024-09-12T22:33:13.239 INFO:tasks.workunit.client.0.smithi019.stdout:3/125: symlink dd/d1e/l2b 0 2024-09-12T22:33:13.239 INFO:tasks.workunit.client.0.smithi019.stdout:1/235: mknod d3/c4e 0 2024-09-12T22:33:13.239 INFO:tasks.workunit.client.0.smithi019.stdout:2/217: dread d0/d5/d18/f3e [0,4194304] 0 2024-09-12T22:33:13.239 INFO:tasks.workunit.client.0.smithi019.stdout:9/157: fsync dd/d10/f19 0 2024-09-12T22:33:13.240 INFO:tasks.workunit.client.0.smithi019.stdout:4/170: write d1/d11/d15/f1d [2743123,130677] 0 2024-09-12T22:33:13.240 INFO:tasks.workunit.client.0.smithi019.stdout:3/126: creat dd/d12/f2c x:0 0 0 2024-09-12T22:33:13.240 INFO:tasks.workunit.client.0.smithi019.stdout:2/218: dread - d0/d5/d18/d3b/f49 zero size 2024-09-12T22:33:13.240 INFO:tasks.workunit.client.0.smithi019.stdout:7/154: dread d6/db/f3a [0,4194304] 0 2024-09-12T22:33:13.240 INFO:tasks.workunit.client.0.smithi019.stdout:9/158: unlink dd/l11 0 2024-09-12T22:33:13.240 INFO:tasks.workunit.client.0.smithi019.stdout:8/155: getdents d7/d8/df/d2d 0 2024-09-12T22:33:13.240 INFO:tasks.workunit.client.0.smithi019.stdout:6/198: truncate d1b/f20 842546 0 2024-09-12T22:33:13.240 INFO:tasks.workunit.client.0.smithi019.stdout:9/159: fsync dd/d10/f19 0 2024-09-12T22:33:13.240 INFO:tasks.workunit.client.0.smithi019.stdout:0/214: dwrite d1/d1f/f41 [0,4194304] 0 2024-09-12T22:33:13.240 INFO:tasks.workunit.client.0.smithi019.stdout:4/171: creat d1/d4/d38/f3b x:0 0 0 2024-09-12T22:33:13.240 INFO:tasks.workunit.client.0.smithi019.stdout:3/127: symlink dd/d1e/l2d 0 2024-09-12T22:33:13.240 INFO:tasks.workunit.client.0.smithi019.stdout:6/199: rename d1b/f22 to d1b/f45 0 2024-09-12T22:33:13.240 INFO:tasks.workunit.client.0.smithi019.stdout:7/155: mknod d6/db/c3c 0 2024-09-12T22:33:13.240 INFO:tasks.workunit.client.0.smithi019.stdout:8/156: mkdir d7/d34 0 2024-09-12T22:33:13.241 INFO:tasks.workunit.client.0.smithi019.stdout:9/160: fdatasync dd/d10/d17/d23/f2a 0 2024-09-12T22:33:13.241 INFO:tasks.workunit.client.0.smithi019.stdout:4/172: unlink d1/d22/f27 0 2024-09-12T22:33:13.241 INFO:tasks.workunit.client.0.smithi019.stdout:7/156: dread - d6/d14/d27/f33 zero size 2024-09-12T22:33:13.241 INFO:tasks.workunit.client.0.smithi019.stdout:8/157: write d7/d8/df/f1f [588752,23310] 0 2024-09-12T22:33:13.241 INFO:tasks.workunit.client.0.smithi019.stdout:6/200: rmdir d1b/d26/d39 39 2024-09-12T22:33:13.241 INFO:tasks.workunit.client.0.smithi019.stdout:5/316: dwrite d0/dc/d39/d38/f44 [0,4194304] 0 2024-09-12T22:33:13.241 INFO:tasks.workunit.client.0.smithi019.stdout:4/173: truncate d1/d11/d15/d1f/f21 309394 0 2024-09-12T22:33:13.241 INFO:tasks.workunit.client.0.smithi019.stdout:7/157: rmdir d6/d14/d27 39 2024-09-12T22:33:13.241 INFO:tasks.workunit.client.0.smithi019.stdout:6/201: unlink fd 0 2024-09-12T22:33:13.241 INFO:tasks.workunit.client.0.smithi019.stdout:5/317: unlink d0/dc/d39/l66 0 2024-09-12T22:33:13.241 INFO:tasks.workunit.client.0.smithi019.stdout:3/128: getdents dd 0 2024-09-12T22:33:13.241 INFO:tasks.workunit.client.0.smithi019.stdout:7/158: dread - d6/d14/d27/f37 zero size 2024-09-12T22:33:13.241 INFO:tasks.workunit.client.0.smithi019.stdout:0/215: dread d1/d1d/f2f [0,4194304] 0 2024-09-12T22:33:13.241 INFO:tasks.workunit.client.0.smithi019.stdout:3/129: chown dd/d12/l1a 3545526 1 2024-09-12T22:33:13.242 INFO:tasks.workunit.client.0.smithi019.stdout:6/202: creat d1b/d26/d27/f46 x:0 0 0 2024-09-12T22:33:13.242 INFO:tasks.workunit.client.0.smithi019.stdout:5/318: creat d0/dc/d39/d38/f6e x:0 0 0 2024-09-12T22:33:13.242 INFO:tasks.workunit.client.0.smithi019.stdout:7/159: mkdir d6/d2d/d3d 0 2024-09-12T22:33:13.242 INFO:tasks.workunit.client.0.smithi019.stdout:9/161: dread dd/d10/f19 [0,4194304] 0 2024-09-12T22:33:13.242 INFO:tasks.workunit.client.0.smithi019.stdout:3/130: chown c4 551937 1 2024-09-12T22:33:13.242 INFO:tasks.workunit.client.0.smithi019.stdout:3/131: rmdir dd 39 2024-09-12T22:33:13.242 INFO:tasks.workunit.client.0.smithi019.stdout:9/162: write dd/f20 [1773052,16483] 0 2024-09-12T22:33:13.242 INFO:tasks.workunit.client.0.smithi019.stdout:1/236: dread d3/f31 [0,4194304] 0 2024-09-12T22:33:13.242 INFO:tasks.workunit.client.0.smithi019.stdout:5/319: unlink d0/d7/d2d/d32/c3e 0 2024-09-12T22:33:13.242 INFO:tasks.workunit.client.0.smithi019.stdout:8/158: dwrite d7/d8/df/f20 [0,4194304] 0 2024-09-12T22:33:13.242 INFO:tasks.workunit.client.0.smithi019.stdout:3/132: dread - dd/d12/f2c zero size 2024-09-12T22:33:13.242 INFO:tasks.workunit.client.0.smithi019.stdout:9/163: creat dd/d10/f39 x:0 0 0 2024-09-12T22:33:13.242 INFO:tasks.workunit.client.0.smithi019.stdout:1/237: creat d3/d11/f4f x:0 0 0 2024-09-12T22:33:13.246 INFO:tasks.workunit.client.0.smithi019.stdout:4/174: dwrite d1/d4/d38/f3b [0,4194304] 0 2024-09-12T22:33:13.246 INFO:tasks.workunit.client.0.smithi019.stdout:9/164: rmdir dd/d10/d17/d22 39 2024-09-12T22:33:13.246 INFO:tasks.workunit.client.0.smithi019.stdout:3/133: creat dd/d1e/f2e x:0 0 0 2024-09-12T22:33:13.246 INFO:tasks.workunit.client.0.smithi019.stdout:6/203: dwrite d1b/d26/d27/f46 [0,4194304] 0 2024-09-12T22:33:13.246 INFO:tasks.workunit.client.0.smithi019.stdout:5/320: creat d0/d7/d2d/d32/d4a/f6f x:0 0 0 2024-09-12T22:33:13.246 INFO:tasks.workunit.client.0.smithi019.stdout:7/160: dwrite d6/db/f3b [0,4194304] 0 2024-09-12T22:33:13.246 INFO:tasks.workunit.client.0.smithi019.stdout:3/134: mknod dd/c2f 0 2024-09-12T22:33:13.246 INFO:tasks.workunit.client.0.smithi019.stdout:6/204: mkdir d1b/d26/d27/d47 0 2024-09-12T22:33:13.246 INFO:tasks.workunit.client.0.smithi019.stdout:3/135: write f2 [7398838,19790] 0 2024-09-12T22:33:13.246 INFO:tasks.workunit.client.0.smithi019.stdout:7/161: creat d6/d2d/f3e x:0 0 0 2024-09-12T22:33:13.247 INFO:tasks.workunit.client.0.smithi019.stdout:6/205: chown c11 0 1 2024-09-12T22:33:13.247 INFO:tasks.workunit.client.0.smithi019.stdout:5/321: creat d0/d7/d16/f70 x:0 0 0 2024-09-12T22:33:13.247 INFO:tasks.workunit.client.0.smithi019.stdout:6/206: fsync f0 0 2024-09-12T22:33:13.247 INFO:tasks.workunit.client.0.smithi019.stdout:7/162: fsync d6/db/dc/d26/f2e 0 2024-09-12T22:33:13.247 INFO:tasks.workunit.client.0.smithi019.stdout:8/159: dwrite d7/d8/df/f1f [0,4194304] 0 2024-09-12T22:33:13.247 INFO:tasks.workunit.client.0.smithi019.stdout:1/238: dwrite d3/d11/f36 [0,4194304] 0 2024-09-12T22:33:13.247 INFO:tasks.workunit.client.0.smithi019.stdout:4/175: dread d1/d8/f14 [0,4194304] 0 2024-09-12T22:33:13.247 INFO:tasks.workunit.client.0.smithi019.stdout:5/322: stat d0/d7/d16/d18/c40 0 2024-09-12T22:33:13.247 INFO:tasks.workunit.client.0.smithi019.stdout:2/219: dread d0/d5/d18/d1b/d36/f4a [0,4194304] 0 2024-09-12T22:33:13.247 INFO:tasks.workunit.client.0.smithi019.stdout:0/216: sync 2024-09-12T22:33:13.247 INFO:tasks.workunit.client.0.smithi019.stdout:3/136: creat dd/d12/f30 x:0 0 0 2024-09-12T22:33:13.247 INFO:tasks.workunit.client.0.smithi019.stdout:4/176: read - d1/d8/f20 zero size 2024-09-12T22:33:13.247 INFO:tasks.workunit.client.0.smithi019.stdout:1/239: rename d3/d1b/l39 to d3/d11/d16/l50 0 2024-09-12T22:33:13.247 INFO:tasks.workunit.client.0.smithi019.stdout:1/240: dread - d3/f4d zero size 2024-09-12T22:33:13.248 INFO:tasks.workunit.client.0.smithi019.stdout:9/165: dwrite dd/f16 [0,4194304] 0 2024-09-12T22:33:13.248 INFO:tasks.workunit.client.0.smithi019.stdout:0/217: mkdir d1/d14/d26/d40/d45 0 2024-09-12T22:33:13.248 INFO:tasks.workunit.client.0.smithi019.stdout:3/137: creat dd/f31 x:0 0 0 2024-09-12T22:33:13.248 INFO:tasks.workunit.client.0.smithi019.stdout:9/166: write dd/f16 [1600621,4496] 0 2024-09-12T22:33:13.248 INFO:tasks.workunit.client.0.smithi019.stdout:5/323: rename d0/d7/d16/d18/f28 to d0/d7/d16/f71 0 2024-09-12T22:33:13.248 INFO:tasks.workunit.client.0.smithi019.stdout:0/218: unlink d1/d14/d32/c37 0 2024-09-12T22:33:13.248 INFO:tasks.workunit.client.0.smithi019.stdout:6/207: dwrite d1b/f37 [0,4194304] 0 2024-09-12T22:33:13.248 INFO:tasks.workunit.client.0.smithi019.stdout:8/160: dwrite d7/d8/dd/f2a [0,4194304] 0 2024-09-12T22:33:13.248 INFO:tasks.workunit.client.0.smithi019.stdout:9/167: symlink dd/d10/d17/l3a 0 2024-09-12T22:33:13.249 INFO:tasks.workunit.client.0.smithi019.stdout:6/208: creat d1b/d2d/f48 x:0 0 0 2024-09-12T22:33:13.249 INFO:tasks.workunit.client.0.smithi019.stdout:2/220: truncate d0/d5/d17/f14 178638 0 2024-09-12T22:33:13.249 INFO:tasks.workunit.client.0.smithi019.stdout:9/168: write dd/f16 [1977447,70518] 0 2024-09-12T22:33:13.249 INFO:tasks.workunit.client.0.smithi019.stdout:8/161: mknod d7/d8/c35 0 2024-09-12T22:33:13.250 INFO:tasks.workunit.client.0.smithi019.stdout:4/177: dwrite d1/f24 [0,4194304] 0 2024-09-12T22:33:13.252 INFO:tasks.workunit.client.0.smithi019.stdout:6/209: creat d1b/d26/d27/d3e/f49 x:0 0 0 2024-09-12T22:33:13.253 INFO:tasks.workunit.client.0.smithi019.stdout:8/162: creat d7/f36 x:0 0 0 2024-09-12T22:33:13.254 INFO:tasks.workunit.client.0.smithi019.stdout:4/178: read - d1/d11/d15/f2b zero size 2024-09-12T22:33:13.254 INFO:tasks.workunit.client.0.smithi019.stdout:1/241: dwrite d3/d11/d16/d23/f28 [0,4194304] 0 2024-09-12T22:33:13.255 INFO:tasks.workunit.client.0.smithi019.stdout:3/138: dread dd/d12/f24 [0,4194304] 0 2024-09-12T22:33:13.259 INFO:tasks.workunit.client.0.smithi019.stdout:4/179: mknod d1/d11/d15/d1f/c3c 0 2024-09-12T22:33:13.260 INFO:tasks.workunit.client.0.smithi019.stdout:5/324: dwrite d0/d7/d16/f47 [0,4194304] 0 2024-09-12T22:33:13.260 INFO:tasks.workunit.client.0.smithi019.stdout:2/221: dwrite d0/f48 [0,4194304] 0 2024-09-12T22:33:13.260 INFO:tasks.workunit.client.0.smithi019.stdout:1/242: getdents d3/d1b 0 2024-09-12T22:33:13.261 INFO:tasks.workunit.client.0.smithi019.stdout:8/163: truncate d7/d8/dd/f11 8840986 0 2024-09-12T22:33:13.261 INFO:tasks.workunit.client.0.smithi019.stdout:9/169: dwrite dd/d10/f19 [4194304,4194304] 0 2024-09-12T22:33:13.262 INFO:tasks.workunit.client.0.smithi019.stdout:2/222: mknod d0/d5/c4f 0 2024-09-12T22:33:13.262 INFO:tasks.workunit.client.0.smithi019.stdout:4/180: mknod d1/d11/d15/d1f/c3d 0 2024-09-12T22:33:13.262 INFO:tasks.workunit.client.0.smithi019.stdout:5/325: chown d0/f6 21890 1 2024-09-12T22:33:13.263 INFO:tasks.workunit.client.0.smithi019.stdout:8/164: link d7/d8/f1b d7/d8/f37 0 2024-09-12T22:33:13.264 INFO:tasks.workunit.client.0.smithi019.stdout:2/223: creat d0/da/f50 x:0 0 0 2024-09-12T22:33:13.264 INFO:tasks.workunit.client.0.smithi019.stdout:5/326: write d0/f23 [3555361,122667] 0 2024-09-12T22:33:13.264 INFO:tasks.workunit.client.0.smithi019.stdout:1/243: link d3/d11/d16/d23/c40 d3/d3f/c51 0 2024-09-12T22:33:13.264 INFO:tasks.workunit.client.0.smithi019.stdout:6/210: dwrite d1b/f3c [0,4194304] 0 2024-09-12T22:33:13.264 INFO:tasks.workunit.client.0.smithi019.stdout:4/181: chown d1/d11/d15/d1f/f21 27097 1 2024-09-12T22:33:13.265 INFO:tasks.workunit.client.0.smithi019.stdout:4/182: chown d1/d8 1 1 2024-09-12T22:33:13.265 INFO:tasks.workunit.client.0.smithi019.stdout:1/244: mknod d3/d11/d16/d23/c52 0 2024-09-12T22:33:13.266 INFO:tasks.workunit.client.0.smithi019.stdout:2/224: unlink d0/d5/f43 0 2024-09-12T22:33:13.266 INFO:tasks.workunit.client.0.smithi019.stdout:6/211: write d1b/f2b [4505898,38600] 0 2024-09-12T22:33:13.266 INFO:tasks.workunit.client.0.smithi019.stdout:8/165: creat d7/d34/f38 x:0 0 0 2024-09-12T22:33:13.267 INFO:tasks.workunit.client.0.smithi019.stdout:1/245: dread - d3/d11/f47 zero size 2024-09-12T22:33:13.267 INFO:tasks.workunit.client.0.smithi019.stdout:4/183: mknod d1/d22/c3e 0 2024-09-12T22:33:13.267 INFO:tasks.workunit.client.0.smithi019.stdout:5/327: chown d0/d7/d2d/d32/c5a 1267058512 1 2024-09-12T22:33:13.268 INFO:tasks.workunit.client.0.smithi019.stdout:1/246: rmdir d3/d1b 39 2024-09-12T22:33:13.268 INFO:tasks.workunit.client.0.smithi019.stdout:2/225: unlink d0/d5/d18/d1b/f2b 0 2024-09-12T22:33:13.268 INFO:tasks.workunit.client.0.smithi019.stdout:6/212: unlink d1b/d26/d31/f3d 0 2024-09-12T22:33:13.269 INFO:tasks.workunit.client.0.smithi019.stdout:0/219: sync 2024-09-12T22:33:13.269 INFO:tasks.workunit.client.0.smithi019.stdout:4/184: write d1/d8/f14 [541912,49923] 0 2024-09-12T22:33:13.269 INFO:tasks.workunit.client.0.smithi019.stdout:1/247: mkdir d3/d11/d53 0 2024-09-12T22:33:13.270 INFO:tasks.workunit.client.0.smithi019.stdout:2/226: stat d0/d5/d18/d1b/f4d 0 2024-09-12T22:33:13.272 INFO:tasks.workunit.client.0.smithi019.stdout:4/185: write d1/d4/f2a [979889,54424] 0 2024-09-12T22:33:13.273 INFO:tasks.workunit.client.0.smithi019.stdout:0/220: unlink d1/d1d/f27 0 2024-09-12T22:33:13.274 INFO:tasks.workunit.client.0.smithi019.stdout:9/170: dwrite dd/d10/d17/d23/f2d [0,4194304] 0 2024-09-12T22:33:13.275 INFO:tasks.workunit.client.0.smithi019.stdout:4/186: chown d1/d11/d15/d1f/c3d 5303896 1 2024-09-12T22:33:13.277 INFO:tasks.workunit.client.0.smithi019.stdout:5/328: dwrite d0/dc/f21 [4194304,4194304] 0 2024-09-12T22:33:13.277 INFO:tasks.workunit.client.0.smithi019.stdout:4/187: write d1/d8/f20 [507086,6080] 0 2024-09-12T22:33:13.278 INFO:tasks.workunit.client.0.smithi019.stdout:2/227: dread d0/d5/d18/d1b/d36/f4a [0,4194304] 0 2024-09-12T22:33:13.278 INFO:tasks.workunit.client.0.smithi019.stdout:4/188: fdatasync d1/d8/f10 0 2024-09-12T22:33:13.278 INFO:tasks.workunit.client.0.smithi019.stdout:1/248: dread d3/d11/f36 [0,4194304] 0 2024-09-12T22:33:13.279 INFO:tasks.workunit.client.0.smithi019.stdout:5/329: write d0/d7/d16/f70 [977863,94056] 0 2024-09-12T22:33:13.280 INFO:tasks.workunit.client.0.smithi019.stdout:2/228: write d0/d5/d18/d1b/f4b [500970,81332] 0 2024-09-12T22:33:13.281 INFO:tasks.workunit.client.0.smithi019.stdout:9/171: dread dd/f18 [0,4194304] 0 2024-09-12T22:33:13.282 INFO:tasks.workunit.client.0.smithi019.stdout:5/330: link d0/dc/d39/d38/l6c d0/d7/d2d/d32/d36/l72 0 2024-09-12T22:33:13.282 INFO:tasks.workunit.client.0.smithi019.stdout:8/166: write d7/d8/df/f1a [601525,45743] 0 2024-09-12T22:33:13.283 INFO:tasks.workunit.client.0.smithi019.stdout:9/172: rmdir dd/d10/d17/d23/d2e/d31 39 2024-09-12T22:33:13.286 INFO:tasks.workunit.client.0.smithi019.stdout:9/173: rename dd/d10/d17/d23/d2e/l33 to dd/d10/l3b 0 2024-09-12T22:33:13.287 INFO:tasks.workunit.client.0.smithi019.stdout:3/139: dread dd/f16 [0,4194304] 0 2024-09-12T22:33:13.287 INFO:tasks.workunit.client.0.smithi019.stdout:1/249: dwrite d3/d3f/f24 [0,4194304] 0 2024-09-12T22:33:13.288 INFO:tasks.workunit.client.0.smithi019.stdout:5/331: sync 2024-09-12T22:33:13.288 INFO:tasks.workunit.client.0.smithi019.stdout:6/213: dwrite d1b/f20 [0,4194304] 0 2024-09-12T22:33:13.288 INFO:tasks.workunit.client.0.smithi019.stdout:9/174: symlink dd/d10/d17/l3c 0 2024-09-12T22:33:13.289 INFO:tasks.workunit.client.0.smithi019.stdout:3/140: dread - dd/d12/f30 zero size 2024-09-12T22:33:13.289 INFO:tasks.workunit.client.0.smithi019.stdout:1/250: chown d3/d11/d16/d23/f28 0 1 2024-09-12T22:33:13.290 INFO:tasks.workunit.client.0.smithi019.stdout:3/141: mknod dd/d1e/c32 0 2024-09-12T22:33:13.290 INFO:tasks.workunit.client.0.smithi019.stdout:9/175: dread - dd/d10/d17/d23/d2e/d31/f34 zero size 2024-09-12T22:33:13.291 INFO:tasks.workunit.client.0.smithi019.stdout:6/214: link d1b/f45 d1b/d26/d39/f4a 0 2024-09-12T22:33:13.291 INFO:tasks.workunit.client.0.smithi019.stdout:1/251: mkdir d3/d11/d16/d23/d54 0 2024-09-12T22:33:13.291 INFO:tasks.workunit.client.0.smithi019.stdout:9/176: readlink dd/l1b 0 2024-09-12T22:33:13.292 INFO:tasks.workunit.client.0.smithi019.stdout:6/215: unlink c11 0 2024-09-12T22:33:13.292 INFO:tasks.workunit.client.0.smithi019.stdout:3/142: creat dd/f33 x:0 0 0 2024-09-12T22:33:13.292 INFO:tasks.workunit.client.0.smithi019.stdout:1/252: mkdir d3/d11/d16/d3c/d55 0 2024-09-12T22:33:13.293 INFO:tasks.workunit.client.0.smithi019.stdout:6/216: symlink d1b/d26/l4b 0 2024-09-12T22:33:13.293 INFO:tasks.workunit.client.0.smithi019.stdout:8/167: dread d7/f13 [0,4194304] 0 2024-09-12T22:33:13.294 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:13.293+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:13.295 INFO:tasks.workunit.client.0.smithi019.stdout:5/332: write d0/d7/f1c [1072737,13010] 0 2024-09-12T22:33:13.295 INFO:tasks.workunit.client.0.smithi019.stdout:9/177: getdents dd/d10/d17/d22 0 2024-09-12T22:33:13.295 INFO:tasks.workunit.client.0.smithi019.stdout:8/168: write d7/d8/dd/f21 [47668,21918] 0 2024-09-12T22:33:13.295 INFO:tasks.workunit.client.0.smithi019.stdout:9/178: rmdir dd 39 2024-09-12T22:33:13.295 INFO:tasks.workunit.client.0.smithi019.stdout:8/169: chown c6 332168141 1 2024-09-12T22:33:13.297 INFO:tasks.workunit.client.0.smithi019.stdout:9/179: symlink dd/d10/d17/l3d 0 2024-09-12T22:33:13.297 INFO:tasks.workunit.client.0.smithi019.stdout:6/217: dread d1b/f2b [4194304,4194304] 0 2024-09-12T22:33:13.297 INFO:tasks.workunit.client.0.smithi019.stdout:6/218: stat d1b 0 2024-09-12T22:33:13.298 INFO:tasks.workunit.client.0.smithi019.stdout:9/180: write dd/f18 [75682,9568] 0 2024-09-12T22:33:13.299 INFO:tasks.workunit.client.0.smithi019.stdout:6/219: write d1b/d26/d27/f2f [815937,111362] 0 2024-09-12T22:33:13.299 INFO:tasks.workunit.client.0.smithi019.stdout:1/253: dwrite d3/d11/f2c [0,4194304] 0 2024-09-12T22:33:13.300 INFO:tasks.workunit.client.0.smithi019.stdout:6/220: creat d1b/d26/d39/f4c x:0 0 0 2024-09-12T22:33:13.301 INFO:tasks.workunit.client.0.smithi019.stdout:6/221: chown d1b/d26/c33 2 1 2024-09-12T22:33:13.301 INFO:tasks.workunit.client.0.smithi019.stdout:2/229: dread d0/d5/d18/d1b/f4b [0,4194304] 0 2024-09-12T22:33:13.301 INFO:tasks.workunit.client.0.smithi019.stdout:9/181: read dd/d10/d17/d23/f28 [3159364,35857] 0 2024-09-12T22:33:13.303 INFO:tasks.workunit.client.0.smithi019.stdout:7/163: dread d6/db/dc/fd [0,4194304] 0 2024-09-12T22:33:13.303 INFO:tasks.workunit.client.0.smithi019.stdout:3/143: dread dd/f17 [0,4194304] 0 2024-09-12T22:33:13.304 INFO:tasks.workunit.client.0.smithi019.stdout:2/230: mknod d0/c51 0 2024-09-12T22:33:13.305 INFO:tasks.workunit.client.0.smithi019.stdout:6/222: write d1b/f45 [295104,8271] 0 2024-09-12T22:33:13.305 INFO:tasks.workunit.client.0.smithi019.stdout:7/164: chown d6/d14/d2a/c39 233160 1 2024-09-12T22:33:13.305 INFO:tasks.workunit.client.0.smithi019.stdout:3/144: dread - dd/f2a zero size 2024-09-12T22:33:13.307 INFO:tasks.workunit.client.0.smithi019.stdout:1/254: dwrite d3/d11/d16/f3b [0,4194304] 0 2024-09-12T22:33:13.307 INFO:tasks.workunit.client.0.smithi019.stdout:6/223: creat d1b/d26/d27/d3e/f4d x:0 0 0 2024-09-12T22:33:13.307 INFO:tasks.workunit.client.0.smithi019.stdout:7/165: unlink d6/db/dc/fd 0 2024-09-12T22:33:13.309 INFO:tasks.workunit.client.0.smithi019.stdout:8/170: truncate d7/f2c 1047117 0 2024-09-12T22:33:13.310 INFO:tasks.workunit.client.0.smithi019.stdout:9/182: dwrite dd/d10/d17/d23/f2d [0,4194304] 0 2024-09-12T22:33:13.310 INFO:tasks.workunit.client.0.smithi019.stdout:6/224: dread - d1b/d2d/f48 zero size 2024-09-12T22:33:13.310 INFO:tasks.workunit.client.0.smithi019.stdout:3/145: getdents dd/d1e 0 2024-09-12T22:33:13.311 INFO:tasks.workunit.client.0.smithi019.stdout:7/166: unlink d6/db/dc/l16 0 2024-09-12T22:33:13.312 INFO:tasks.workunit.client.0.smithi019.stdout:8/171: chown d7/d8/f2e 50 1 2024-09-12T22:33:13.312 INFO:tasks.workunit.client.0.smithi019.stdout:6/225: creat d1b/d26/d31/f4e x:0 0 0 2024-09-12T22:33:13.313 INFO:tasks.workunit.client.0.smithi019.stdout:9/183: creat dd/d10/d17/d22/f3e x:0 0 0 2024-09-12T22:33:13.313 INFO:tasks.workunit.client.0.smithi019.stdout:7/167: stat d6/db/dc/l12 0 2024-09-12T22:33:13.314 INFO:tasks.workunit.client.0.smithi019.stdout:3/146: creat dd/d1e/f34 x:0 0 0 2024-09-12T22:33:13.314 INFO:tasks.workunit.client.0.smithi019.stdout:8/172: mknod d7/d8/df/c39 0 2024-09-12T22:33:13.315 INFO:tasks.workunit.client.0.smithi019.stdout:2/231: dwrite d0/da/f37 [0,4194304] 0 2024-09-12T22:33:13.315 INFO:tasks.workunit.client.0.smithi019.stdout:2/232: sync 2024-09-12T22:33:13.315 INFO:tasks.workunit.client.0.smithi019.stdout:3/147: chown c1 5744836 1 2024-09-12T22:33:13.316 INFO:tasks.workunit.client.0.smithi019.stdout:8/173: read d7/d8/df/f1f [189265,50832] 0 2024-09-12T22:33:13.317 INFO:tasks.workunit.client.0.smithi019.stdout:5/333: dwrite d0/f6 [0,4194304] 0 2024-09-12T22:33:13.317 INFO:tasks.workunit.client.0.smithi019.stdout:7/168: creat d6/d14/d15/f3f x:0 0 0 2024-09-12T22:33:13.318 INFO:tasks.workunit.client.0.smithi019.stdout:2/233: mkdir d0/d5/d18/d52 0 2024-09-12T22:33:13.319 INFO:tasks.workunit.client.0.smithi019.stdout:1/255: dwrite d3/d11/f35 [0,4194304] 0 2024-09-12T22:33:13.319 INFO:tasks.workunit.client.0.smithi019.stdout:4/189: dread d1/f25 [0,4194304] 0 2024-09-12T22:33:13.319 INFO:tasks.workunit.client.0.smithi019.stdout:3/148: creat dd/d12/f35 x:0 0 0 2024-09-12T22:33:13.320 INFO:tasks.workunit.client.0.smithi019.stdout:7/169: fdatasync d6/d14/d27/f37 0 2024-09-12T22:33:13.321 INFO:tasks.workunit.client.0.smithi019.stdout:6/226: link d1b/c1d d1b/d26/d27/c4f 0 2024-09-12T22:33:13.321 INFO:tasks.workunit.client.0.smithi019.stdout:6/227: sync 2024-09-12T22:33:13.321 INFO:tasks.workunit.client.0.smithi019.stdout:3/149: chown dd/d1e/l2b 179 1 2024-09-12T22:33:13.321 INFO:tasks.workunit.client.0.smithi019.stdout:8/174: rename d7/d8/c15 to d7/c3a 0 2024-09-12T22:33:13.322 INFO:tasks.workunit.client.0.smithi019.stdout:2/234: write d0/d5/d18/f20 [350120,87665] 0 2024-09-12T22:33:13.324 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-09-12T22:33:13.324 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2024-09-12T22:33:13.324 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.324 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4490.0:11322 4.39 4:9f9fb2ef:::1000000325e.00000000:head [write 0~4194304 in=4194304b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-12T22:33:13.324 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:13.308105+0000", 2024-09-12T22:33:13.324 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.015433677, 2024-09-12T22:33:13.324 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.015453031000000001, 2024-09-12T22:33:13.324 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:13.324 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:13.325 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:33:13.325 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:13.325 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4490", 2024-09-12T22:33:13.325 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:13.325 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 11322 2024-09-12T22:33:13.325 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.325 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:13.325 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.325 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:13.325 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:13.308105+0000", 2024-09-12T22:33:13.325 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:13.325 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.326 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.326 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:13.326 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:13.308105+0000", 2024-09-12T22:33:13.326 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:13.326 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.326 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.326 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:13.326 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:13.308106+0000", 2024-09-12T22:33:13.326 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.407e-06 2024-09-12T22:33:13.326 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.326 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.326 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:13.326 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:13.313445+0000", 2024-09-12T22:33:13.327 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0053387230000000001 2024-09-12T22:33:13.327 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.327 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.327 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:13.327 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:13.313459+0000", 2024-09-12T22:33:13.327 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4411e-05 2024-09-12T22:33:13.327 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.327 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.327 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:13.327 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:13.313467+0000", 2024-09-12T22:33:13.327 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9920000000000007e-06 2024-09-12T22:33:13.327 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.327 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.327 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:13.328 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:13.313531+0000", 2024-09-12T22:33:13.328 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.3411999999999995e-05 2024-09-12T22:33:13.328 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.328 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.328 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:13.328 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:13.313629+0000", 2024-09-12T22:33:13.328 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.7985000000000005e-05 2024-09-12T22:33:13.328 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.328 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.328 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:13.328 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:13.313763+0000", 2024-09-12T22:33:13.328 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013402800000000001 2024-09-12T22:33:13.328 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.329 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.329 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:13.329 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:13.320606+0000", 2024-09-12T22:33:13.329 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0068433929999999997 2024-09-12T22:33:13.329 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:13.329 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:13.329 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:13.329 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:13.329 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2024-09-12T22:33:13.329 INFO:teuthology.orchestra.run.smithi163.stdout: "num_ops": 1 2024-09-12T22:33:13.329 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-09-12T22:33:13.330 INFO:tasks.workunit.client.0.smithi019.stdout:3/150: mkdir dd/d36 0 2024-09-12T22:33:13.331 INFO:tasks.workunit.client.0.smithi019.stdout:7/170: rename d6/d14/d15/l1d to d6/d14/d15/l40 0 2024-09-12T22:33:13.331 INFO:tasks.workunit.client.0.smithi019.stdout:9/184: dwrite dd/f1f [0,4194304] 0 2024-09-12T22:33:13.331 INFO:tasks.workunit.client.0.smithi019.stdout:8/175: unlink d7/d8/c35 0 2024-09-12T22:33:13.331 INFO:tasks.workunit.client.0.smithi019.stdout:6/228: rename d1b/c1d to d1b/d26/d27/c50 0 2024-09-12T22:33:13.331 INFO:tasks.workunit.client.0.smithi019.stdout:2/235: unlink d0/d5/d18/d1b/f1c 0 2024-09-12T22:33:13.331 INFO:tasks.workunit.client.0.smithi019.stdout:8/176: stat d7/d8/df/f20 0 2024-09-12T22:33:13.331 INFO:tasks.workunit.client.0.smithi019.stdout:4/190: rename d1/d11/c36 to d1/d11/d15/c3f 0 2024-09-12T22:33:13.331 INFO:tasks.workunit.client.0.smithi019.stdout:7/171: chown d6/db/dc/d26/f36 105602227 1 2024-09-12T22:33:13.331 INFO:tasks.workunit.client.0.smithi019.stdout:3/151: truncate dd/f17 1439441 0 2024-09-12T22:33:13.331 INFO:tasks.workunit.client.0.smithi019.stdout:7/172: fsync d6/db/f3b 0 2024-09-12T22:33:13.332 INFO:tasks.workunit.client.0.smithi019.stdout:6/229: getdents d1b/d2d 0 2024-09-12T22:33:13.332 INFO:tasks.workunit.client.0.smithi019.stdout:9/185: write dd/d10/d17/d23/d2e/d31/f34 [950030,1936] 0 2024-09-12T22:33:13.332 INFO:tasks.workunit.client.0.smithi019.stdout:2/236: write d0/d5/d17/fe [426,91269] 0 2024-09-12T22:33:13.332 INFO:tasks.workunit.client.0.smithi019.stdout:5/334: dwrite d0/dc/d39/d38/f5c [0,4194304] 0 2024-09-12T22:33:13.332 INFO:tasks.workunit.client.0.smithi019.stdout:3/152: write dd/d1e/f34 [17223,33272] 0 2024-09-12T22:33:13.333 INFO:tasks.workunit.client.0.smithi019.stdout:1/256: dwrite d3/d1b/f21 [8388608,4194304] 0 2024-09-12T22:33:13.333 INFO:tasks.workunit.client.0.smithi019.stdout:9/186: read - dd/d10/f39 zero size 2024-09-12T22:33:13.333 INFO:tasks.workunit.client.0.smithi019.stdout:7/173: unlink d6/d14/d27/f33 0 2024-09-12T22:33:13.334 INFO:tasks.workunit.client.0.smithi019.stdout:6/230: unlink d1b/l25 0 2024-09-12T22:33:13.334 INFO:tasks.workunit.client.0.smithi019.stdout:5/335: rmdir d0/d7/d2d/d32/d4a 39 2024-09-12T22:33:13.334 INFO:tasks.workunit.client.0.smithi019.stdout:7/174: dread - d6/db/d34/f38 zero size 2024-09-12T22:33:13.335 INFO:tasks.workunit.client.0.smithi019.stdout:3/153: link dd/d12/f35 dd/d1e/f37 0 2024-09-12T22:33:13.335 INFO:tasks.workunit.client.0.smithi019.stdout:9/187: rmdir dd/d10 39 2024-09-12T22:33:13.335 INFO:tasks.workunit.client.0.smithi019.stdout:6/231: mknod d1b/d26/d31/c51 0 2024-09-12T22:33:13.336 INFO:tasks.workunit.client.0.smithi019.stdout:5/336: write d0/dc/d39/f4e [933505,55223] 0 2024-09-12T22:33:13.336 INFO:tasks.workunit.client.0.smithi019.stdout:6/232: creat d1b/f52 x:0 0 0 2024-09-12T22:33:13.336 INFO:tasks.workunit.client.0.smithi019.stdout:7/175: dread - d6/db/dc/d26/f2f zero size 2024-09-12T22:33:13.337 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:33:13.338 INFO:tasks.workunit.client.0.smithi019.stdout:9/188: mkdir dd/d10/d17/d23/d2e/d31/d3f 0 2024-09-12T22:33:13.338 INFO:tasks.workunit.client.0.smithi019.stdout:5/337: chown d0/dc/d39/d38/f55 61 1 2024-09-12T22:33:13.338 INFO:tasks.workunit.client.0.smithi019.stdout:2/237: dread d0/da/f37 [0,4194304] 0 2024-09-12T22:33:13.339 INFO:tasks.workunit.client.0.smithi019.stdout:2/238: sync 2024-09-12T22:33:13.339 INFO:tasks.workunit.client.0.smithi019.stdout:0/221: dread d1/d14/d1b/f2e [0,4194304] 0 2024-09-12T22:33:13.339 INFO:tasks.workunit.client.0.smithi019.stdout:2/239: sync 2024-09-12T22:33:13.339 INFO:tasks.workunit.client.0.smithi019.stdout:9/189: mknod dd/d10/d17/c40 0 2024-09-12T22:33:13.340 INFO:tasks.workunit.client.0.smithi019.stdout:9/190: sync 2024-09-12T22:33:13.340 INFO:tasks.workunit.client.0.smithi019.stdout:5/338: creat d0/d7/d16/d18/f73 x:0 0 0 2024-09-12T22:33:13.341 INFO:tasks.workunit.client.0.smithi019.stdout:3/154: dread dd/d12/f18 [0,4194304] 0 2024-09-12T22:33:13.342 INFO:tasks.workunit.client.0.smithi019.stdout:2/240: mknod d0/d5/d17/c53 0 2024-09-12T22:33:13.342 INFO:tasks.workunit.client.0.smithi019.stdout:7/176: dread d6/db/f1c [0,4194304] 0 2024-09-12T22:33:13.343 INFO:tasks.workunit.client.0.smithi019.stdout:9/191: mknod dd/d10/d17/d23/c41 0 2024-09-12T22:33:13.344 INFO:tasks.workunit.client.0.smithi019.stdout:3/155: truncate dd/d1e/f25 643813 0 2024-09-12T22:33:13.344 INFO:tasks.workunit.client.0.smithi019.stdout:2/241: unlink d0/d5/d17/fe 0 2024-09-12T22:33:13.344 INFO:tasks.workunit.client.0.smithi019.stdout:6/233: dwrite d1b/d26/d39/f4a [0,4194304] 0 2024-09-12T22:33:13.344 INFO:tasks.workunit.client.0.smithi019.stdout:7/177: chown d6/db/dc/f9 127 1 2024-09-12T22:33:13.345 INFO:tasks.workunit.client.0.smithi019.stdout:9/192: mkdir dd/d10/d17/d22/d42 0 2024-09-12T22:33:13.349 INFO:tasks.workunit.client.0.smithi019.stdout:7/178: mkdir d6/d2d/d41 0 2024-09-12T22:33:13.349 INFO:tasks.workunit.client.0.smithi019.stdout:3/156: rmdir dd/d36 0 2024-09-12T22:33:13.350 INFO:tasks.workunit.client.0.smithi019.stdout:9/193: stat dd/d10/d17/l3c 0 2024-09-12T22:33:13.350 INFO:tasks.workunit.client.0.smithi019.stdout:6/234: write d1b/f2b [2827181,11671] 0 2024-09-12T22:33:13.350 INFO:tasks.workunit.client.0.smithi019.stdout:7/179: mkdir d6/db/d42 0 2024-09-12T22:33:13.350 INFO:tasks.workunit.client.0.smithi019.stdout:0/222: dwrite d1/d14/d1b/f2b [0,4194304] 0 2024-09-12T22:33:13.350 INFO:tasks.workunit.client.0.smithi019.stdout:6/235: creat d1b/d26/d39/f53 x:0 0 0 2024-09-12T22:33:13.350 INFO:tasks.workunit.client.0.smithi019.stdout:3/157: truncate dd/d1e/f37 977320 0 2024-09-12T22:33:13.350 INFO:tasks.workunit.client.0.smithi019.stdout:9/194: creat dd/d10/d17/d23/d37/f43 x:0 0 0 2024-09-12T22:33:13.350 INFO:tasks.workunit.client.0.smithi019.stdout:0/223: symlink d1/d14/d1b/l46 0 2024-09-12T22:33:13.350 INFO:tasks.workunit.client.0.smithi019.stdout:6/236: dread - d1b/d26/d27/d3e/f4d zero size 2024-09-12T22:33:13.350 INFO:tasks.workunit.client.0.smithi019.stdout:0/224: write d1/d14/d32/f35 [427228,100295] 0 2024-09-12T22:33:13.353 INFO:tasks.workunit.client.0.smithi019.stdout:6/237: link d1b/d26/d27/d3e/f49 d1b/d26/d27/f54 0 2024-09-12T22:33:13.354 INFO:tasks.workunit.client.0.smithi019.stdout:7/180: dwrite d6/db/f1c [0,4194304] 0 2024-09-12T22:33:13.354 INFO:tasks.workunit.client.0.smithi019.stdout:9/195: dwrite dd/f1f [0,4194304] 0 2024-09-12T22:33:13.355 INFO:tasks.workunit.client.0.smithi019.stdout:3/158: dread dd/d12/f15 [0,4194304] 0 2024-09-12T22:33:13.355 INFO:tasks.workunit.client.0.smithi019.stdout:7/181: creat d6/db/dc/f43 x:0 0 0 2024-09-12T22:33:13.356 INFO:tasks.workunit.client.0.smithi019.stdout:7/182: readlink l0 0 2024-09-12T22:33:13.356 INFO:tasks.workunit.client.0.smithi019.stdout:6/238: link d1b/d26/d39/f53 d1b/d2d/f55 0 2024-09-12T22:33:13.356 INFO:tasks.workunit.client.0.smithi019.stdout:5/339: read d0/dc/d39/f4e [39190,53889] 0 2024-09-12T22:33:13.356 INFO:tasks.workunit.client.0.smithi019.stdout:9/196: creat dd/f44 x:0 0 0 2024-09-12T22:33:13.357 INFO:tasks.workunit.client.0.smithi019.stdout:3/159: rename dd/le to dd/l38 0 2024-09-12T22:33:13.358 INFO:tasks.workunit.client.0.smithi019.stdout:5/340: creat d0/dc/f74 x:0 0 0 2024-09-12T22:33:13.358 INFO:tasks.workunit.client.0.smithi019.stdout:3/160: read - dd/d12/f2c zero size 2024-09-12T22:33:13.360 INFO:tasks.workunit.client.0.smithi019.stdout:0/225: truncate d1/d14/d1b/f2b 359516 0 2024-09-12T22:33:13.360 INFO:tasks.workunit.client.0.smithi019.stdout:5/341: rename d0/dc/d24/f5d to d0/f75 0 2024-09-12T22:33:13.361 INFO:tasks.workunit.client.0.smithi019.stdout:6/239: truncate f0 3365500 0 2024-09-12T22:33:13.361 INFO:tasks.workunit.client.0.smithi019.stdout:9/197: getdents dd/d10/d17/d23/d2e/d31/d3f 0 2024-09-12T22:33:13.361 INFO:tasks.workunit.client.0.smithi019.stdout:2/242: read d0/d5/d18/d3b/f3f [1515821,42967] 0 2024-09-12T22:33:13.361 INFO:tasks.workunit.client.0.smithi019.stdout:7/183: link d6/d14/d15/f22 d6/db/f44 0 2024-09-12T22:33:13.362 INFO:tasks.workunit.client.0.smithi019.stdout:8/177: dwrite d7/d8/f1b [0,4194304] 0 2024-09-12T22:33:13.362 INFO:tasks.workunit.client.0.smithi019.stdout:5/342: fsync d0/d7/f2e 0 2024-09-12T22:33:13.363 INFO:tasks.workunit.client.0.smithi019.stdout:6/240: rmdir d1b/d26/d27/d3e 39 2024-09-12T22:33:13.363 INFO:tasks.workunit.client.0.smithi019.stdout:2/243: write d0/d5/f3a [925492,119617] 0 2024-09-12T22:33:13.363 INFO:tasks.workunit.client.0.smithi019.stdout:9/198: truncate dd/f1f 4759274 0 2024-09-12T22:33:13.366 INFO:tasks.workunit.client.0.smithi019.stdout:8/178: creat d7/d8/df/f3b x:0 0 0 2024-09-12T22:33:13.368 INFO:tasks.workunit.client.0.smithi019.stdout:8/179: stat d7/c3a 0 2024-09-12T22:33:13.368 INFO:tasks.workunit.client.0.smithi019.stdout:3/161: dwrite dd/d1e/f2e [0,4194304] 0 2024-09-12T22:33:13.369 INFO:tasks.workunit.client.0.smithi019.stdout:9/199: mknod dd/d10/d17/d23/d2e/c45 0 2024-09-12T22:33:13.371 INFO:tasks.workunit.client.0.smithi019.stdout:9/200: rmdir dd/d10/d17/d22 39 2024-09-12T22:33:13.371 INFO:tasks.workunit.client.0.smithi019.stdout:8/180: mknod d7/d8/d32/c3c 0 2024-09-12T22:33:13.372 INFO:tasks.workunit.client.0.smithi019.stdout:3/162: symlink dd/d1e/l39 0 2024-09-12T22:33:13.372 INFO:tasks.workunit.client.0.smithi019.stdout:3/163: stat c4 0 2024-09-12T22:33:13.372 INFO:tasks.workunit.client.0.smithi019.stdout:2/244: link d0/da/c2f d0/d5/d18/d1b/c54 0 2024-09-12T22:33:13.374 INFO:tasks.workunit.client.0.smithi019.stdout:0/226: dwrite d1/d14/d32/f35 [0,4194304] 0 2024-09-12T22:33:13.374 INFO:tasks.workunit.client.0.smithi019.stdout:8/181: write d7/d8/df/d2d/f30 [675625,28173] 0 2024-09-12T22:33:13.375 INFO:tasks.workunit.client.0.smithi019.stdout:5/343: dwrite d0/dc/d39/d38/f55 [0,4194304] 0 2024-09-12T22:33:13.375 INFO:tasks.workunit.client.0.smithi019.stdout:2/245: creat d0/d5/d18/d1b/f55 x:0 0 0 2024-09-12T22:33:13.375 INFO:tasks.workunit.client.0.smithi019.stdout:3/164: rename dd/c2f to dd/d12/c3a 0 2024-09-12T22:33:13.375 INFO:tasks.workunit.client.0.smithi019.stdout:5/344: dread - d0/f75 zero size 2024-09-12T22:33:13.375 INFO:tasks.workunit.client.0.smithi019.stdout:0/227: mknod d1/d14/d26/c47 0 2024-09-12T22:33:13.376 INFO:tasks.workunit.client.0.smithi019.stdout:9/201: rename dd/d10/d17/d23/f28 to dd/d10/d17/d23/d2e/d31/f46 0 2024-09-12T22:33:13.376 INFO:tasks.workunit.client.0.smithi019.stdout:2/246: chown d0/d5/d18/d1b/c28 29437 1 2024-09-12T22:33:13.377 INFO:tasks.workunit.client.0.smithi019.stdout:8/182: mknod d7/d8/df/d2d/c3d 0 2024-09-12T22:33:13.377 INFO:tasks.workunit.client.0.smithi019.stdout:3/165: fsync dd/f33 0 2024-09-12T22:33:13.377 INFO:tasks.workunit.client.0.smithi019.stdout:0/228: rmdir d1/d14/d26 39 2024-09-12T22:33:13.378 INFO:tasks.workunit.client.0.smithi019.stdout:5/345: rename d0/d7/d16/f71 to d0/d7/d16/d69/f76 0 2024-09-12T22:33:13.378 INFO:tasks.workunit.client.0.smithi019.stdout:8/183: creat d7/d34/f3e x:0 0 0 2024-09-12T22:33:13.378 INFO:tasks.workunit.client.0.smithi019.stdout:4/191: dread d1/d22/d2c/f35 [0,4194304] 0 2024-09-12T22:33:13.378 INFO:tasks.workunit.client.0.smithi019.stdout:0/229: mknod d1/d14/d32/c48 0 2024-09-12T22:33:13.378 INFO:tasks.workunit.client.0.smithi019.stdout:3/166: creat dd/d12/f3b x:0 0 0 2024-09-12T22:33:13.378 INFO:tasks.workunit.client.0.smithi019.stdout:9/202: chown dd/d10/d17/c40 85390 1 2024-09-12T22:33:13.379 INFO:tasks.workunit.client.0.smithi019.stdout:0/230: read d1/f1a [478977,92559] 0 2024-09-12T22:33:13.379 INFO:tasks.workunit.client.0.smithi019.stdout:8/184: symlink d7/d8/df/d2d/l3f 0 2024-09-12T22:33:13.380 INFO:tasks.workunit.client.0.smithi019.stdout:4/192: creat d1/d22/d2c/f40 x:0 0 0 2024-09-12T22:33:13.380 INFO:tasks.workunit.client.0.smithi019.stdout:7/184: dwrite d6/d14/d15/f22 [0,4194304] 0 2024-09-12T22:33:13.381 INFO:tasks.workunit.client.0.smithi019.stdout:3/167: creat dd/d1e/f3c x:0 0 0 2024-09-12T22:33:13.382 INFO:tasks.workunit.client.0.smithi019.stdout:5/346: getdents d0/dc/d39/d38 0 2024-09-12T22:33:13.383 INFO:tasks.workunit.client.0.smithi019.stdout:3/168: chown f5 106448314 1 2024-09-12T22:33:13.383 INFO:tasks.workunit.client.0.smithi019.stdout:0/231: creat d1/f49 x:0 0 0 2024-09-12T22:33:13.384 INFO:tasks.workunit.client.0.smithi019.stdout:7/185: mkdir d6/d14/d45 0 2024-09-12T22:33:13.386 INFO:tasks.workunit.client.0.smithi019.stdout:1/257: dread d3/d1b/f1d [0,4194304] 0 2024-09-12T22:33:13.386 INFO:tasks.workunit.client.0.smithi019.stdout:6/241: dwrite d1b/d2d/f55 [0,4194304] 0 2024-09-12T22:33:13.386 INFO:tasks.workunit.client.0.smithi019.stdout:0/232: mknod d1/d14/d1b/d3a/c4a 0 2024-09-12T22:33:13.388 INFO:tasks.workunit.client.0.smithi019.stdout:7/186: fdatasync d6/d14/d15/f24 0 2024-09-12T22:33:13.388 INFO:tasks.workunit.client.0.smithi019.stdout:6/242: fdatasync d1b/f45 0 2024-09-12T22:33:13.388 INFO:tasks.workunit.client.0.smithi019.stdout:5/347: mknod d0/d7/d2d/d32/d4a/c77 0 2024-09-12T22:33:13.389 INFO:tasks.workunit.client.0.smithi019.stdout:0/233: fdatasync d1/f49 0 2024-09-12T22:33:13.389 INFO:tasks.workunit.client.0.smithi019.stdout:9/203: dread dd/d10/f19 [0,4194304] 0 2024-09-12T22:33:13.390 INFO:tasks.workunit.client.0.smithi019.stdout:7/187: mknod d6/db/c46 0 2024-09-12T22:33:13.390 INFO:tasks.workunit.client.0.smithi019.stdout:0/234: readlink d1/d14/l3f 0 2024-09-12T22:33:13.390 INFO:tasks.workunit.client.0.smithi019.stdout:1/258: truncate d3/d11/d16/f38 188481 0 2024-09-12T22:33:13.391 INFO:tasks.workunit.client.0.smithi019.stdout:8/185: dwrite d7/d8/dd/f12 [0,4194304] 0 2024-09-12T22:33:13.391 INFO:tasks.workunit.client.0.smithi019.stdout:5/348: write d0/dc/d39/d38/f3f [1787737,68774] 0 2024-09-12T22:33:13.392 INFO:tasks.workunit.client.0.smithi019.stdout:1/259: readlink d3/l10 0 2024-09-12T22:33:13.392 INFO:tasks.workunit.client.0.smithi019.stdout:7/188: readlink d6/db/dc/l12 0 2024-09-12T22:33:13.393 INFO:tasks.workunit.client.0.smithi019.stdout:5/349: read d0/d7/d16/f47 [524084,117295] 0 2024-09-12T22:33:13.394 INFO:tasks.workunit.client.0.smithi019.stdout:3/169: dwrite dd/f31 [0,4194304] 0 2024-09-12T22:33:13.395 INFO:tasks.workunit.client.0.smithi019.stdout:8/186: mknod d7/d8/df/c40 0 2024-09-12T22:33:13.395 INFO:tasks.workunit.client.0.smithi019.stdout:9/204: mkdir dd/d10/d17/d23/d2e/d31/d3f/d47 0 2024-09-12T22:33:13.395 INFO:tasks.workunit.client.0.smithi019.stdout:0/235: write d1/d1f/f33 [278620,97946] 0 2024-09-12T22:33:13.395 INFO:tasks.workunit.client.0.smithi019.stdout:1/260: fdatasync d3/d3f/f24 0 2024-09-12T22:33:13.395 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:13.394+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:13.396 INFO:tasks.workunit.client.0.smithi019.stdout:3/170: fdatasync dd/d1e/f37 0 2024-09-12T22:33:13.396 INFO:tasks.workunit.client.0.smithi019.stdout:7/189: truncate d6/d14/d15/f3f 773934 0 2024-09-12T22:33:13.397 INFO:tasks.workunit.client.0.smithi019.stdout:5/350: rmdir d0/dc/d39/d38/d60 0 2024-09-12T22:33:13.398 INFO:tasks.workunit.client.0.smithi019.stdout:0/236: write d1/d1d/f2f [142353,88062] 0 2024-09-12T22:33:13.398 INFO:tasks.workunit.client.0.smithi019.stdout:7/190: sync 2024-09-12T22:33:13.398 INFO:tasks.workunit.client.0.smithi019.stdout:3/171: write dd/f17 [726419,17716] 0 2024-09-12T22:33:13.399 INFO:tasks.workunit.client.0.smithi019.stdout:1/261: write d3/d11/d16/f45 [665028,39809] 0 2024-09-12T22:33:13.399 INFO:tasks.workunit.client.0.smithi019.stdout:6/243: dwrite d1b/d2d/f32 [0,4194304] 0 2024-09-12T22:33:13.401 INFO:tasks.workunit.client.0.smithi019.stdout:0/237: readlink d1/l13 0 2024-09-12T22:33:13.401 INFO:tasks.workunit.client.0.smithi019.stdout:5/351: chown d0/d7/d16/d18/f52 2394396 1 2024-09-12T22:33:13.401 INFO:tasks.workunit.client.0.smithi019.stdout:0/238: sync 2024-09-12T22:33:13.402 INFO:tasks.workunit.client.0.smithi019.stdout:6/244: write d1b/f3c [1556499,80768] 0 2024-09-12T22:33:13.402 INFO:tasks.workunit.client.0.smithi019.stdout:7/191: creat d6/d14/d15/f47 x:0 0 0 2024-09-12T22:33:13.404 INFO:tasks.workunit.client.0.smithi019.stdout:6/245: stat d1b/d26/f36 0 2024-09-12T22:33:13.404 INFO:tasks.workunit.client.0.smithi019.stdout:7/192: stat d6/db/d42 0 2024-09-12T22:33:13.405 INFO:tasks.workunit.client.0.smithi019.stdout:8/187: dread d7/d8/df/f1f [0,4194304] 0 2024-09-12T22:33:13.405 INFO:tasks.workunit.client.0.smithi019.stdout:3/172: chown dd/lf 792929 1 2024-09-12T22:33:13.405 INFO:tasks.workunit.client.0.smithi019.stdout:6/246: fdatasync d1b/d2d/f55 0 2024-09-12T22:33:13.406 INFO:tasks.workunit.client.0.smithi019.stdout:0/239: read d1/d14/d32/f43 [4172260,12612] 0 2024-09-12T22:33:13.406 INFO:tasks.workunit.client.0.smithi019.stdout:4/193: dread d1/d4/f13 [0,4194304] 0 2024-09-12T22:33:13.406 INFO:tasks.workunit.client.0.smithi019.stdout:1/262: link d3/d11/d16/d23/c37 d3/d11/d16/c56 0 2024-09-12T22:33:13.406 INFO:tasks.workunit.client.0.smithi019.stdout:1/263: sync 2024-09-12T22:33:13.407 INFO:tasks.workunit.client.0.smithi019.stdout:7/193: readlink d6/db/dc/l12 0 2024-09-12T22:33:13.407 INFO:tasks.workunit.client.0.smithi019.stdout:4/194: chown d1/d4 1 1 2024-09-12T22:33:13.408 INFO:tasks.workunit.client.0.smithi019.stdout:8/188: mkdir d7/d8/df/d41 0 2024-09-12T22:33:13.408 INFO:tasks.workunit.client.0.smithi019.stdout:3/173: read - dd/d12/f3b zero size 2024-09-12T22:33:13.408 INFO:tasks.workunit.client.0.smithi019.stdout:9/205: dwrite dd/d10/d17/d23/f2d [4194304,4194304] 0 2024-09-12T22:33:13.409 INFO:tasks.workunit.client.0.smithi019.stdout:2/247: dwrite d0/d5/d17/f14 [0,4194304] 0 2024-09-12T22:33:13.410 INFO:tasks.workunit.client.0.smithi019.stdout:0/240: creat d1/d14/d1b/f4b x:0 0 0 2024-09-12T22:33:13.410 INFO:tasks.workunit.client.0.smithi019.stdout:9/206: fdatasync dd/f1f 0 2024-09-12T22:33:13.411 INFO:tasks.workunit.client.0.smithi019.stdout:1/264: unlink d3/d11/d16/l50 0 2024-09-12T22:33:13.412 INFO:tasks.workunit.client.0.smithi019.stdout:5/352: dwrite d0/f37 [0,4194304] 0 2024-09-12T22:33:13.412 INFO:tasks.workunit.client.0.smithi019.stdout:3/174: chown dd/l10 91563 1 2024-09-12T22:33:13.412 INFO:tasks.workunit.client.0.smithi019.stdout:7/194: rename d6/db/dc/d26/f2e to d6/d2d/d41/f48 0 2024-09-12T22:33:13.412 INFO:tasks.workunit.client.0.smithi019.stdout:1/265: symlink d3/d3f/l57 0 2024-09-12T22:33:13.413 INFO:tasks.workunit.client.0.smithi019.stdout:0/241: dread d1/d14/d1b/f2b [0,4194304] 0 2024-09-12T22:33:13.413 INFO:tasks.workunit.client.0.smithi019.stdout:8/189: rmdir d7/d8/df/d41 0 2024-09-12T22:33:13.413 INFO:tasks.workunit.client.0.smithi019.stdout:9/207: symlink dd/d10/d17/d23/d2e/l48 0 2024-09-12T22:33:13.413 INFO:tasks.workunit.client.0.smithi019.stdout:3/175: unlink dd/l10 0 2024-09-12T22:33:13.414 INFO:tasks.workunit.client.0.smithi019.stdout:1/266: dread - d3/d3f/f30 zero size 2024-09-12T22:33:13.414 INFO:tasks.workunit.client.0.smithi019.stdout:6/247: dread d1b/d26/d39/f53 [0,4194304] 0 2024-09-12T22:33:13.414 INFO:tasks.workunit.client.0.smithi019.stdout:8/190: stat d7/d34 0 2024-09-12T22:33:13.414 INFO:tasks.workunit.client.0.smithi019.stdout:2/248: creat d0/d5/d18/f56 x:0 0 0 2024-09-12T22:33:13.415 INFO:tasks.workunit.client.0.smithi019.stdout:0/242: stat d1/d1d/c38 0 2024-09-12T22:33:13.415 INFO:tasks.workunit.client.0.smithi019.stdout:3/176: readlink l6 0 2024-09-12T22:33:13.415 INFO:tasks.workunit.client.0.smithi019.stdout:7/195: creat d6/db/f49 x:0 0 0 2024-09-12T22:33:13.417 INFO:tasks.workunit.client.0.smithi019.stdout:9/208: rmdir dd/d10/d17/d36 0 2024-09-12T22:33:13.417 INFO:tasks.workunit.client.0.smithi019.stdout:5/353: link d0/d7/d2d/d32/c43 d0/dc/c78 0 2024-09-12T22:33:13.417 INFO:tasks.workunit.client.0.smithi019.stdout:0/243: chown d1/d1d/c2a 22889634 1 2024-09-12T22:33:13.417 INFO:tasks.workunit.client.0.smithi019.stdout:8/191: dread - d7/f29 zero size 2024-09-12T22:33:13.417 INFO:tasks.workunit.client.0.smithi019.stdout:7/196: fdatasync d6/db/dc/f43 0 2024-09-12T22:33:13.417 INFO:tasks.workunit.client.0.smithi019.stdout:6/248: truncate d1b/d26/f3a 1001524 0 2024-09-12T22:33:13.418 INFO:tasks.workunit.client.0.smithi019.stdout:4/195: dwrite d1/d22/d26/f37 [0,4194304] 0 2024-09-12T22:33:13.418 INFO:tasks.workunit.client.0.smithi019.stdout:8/192: read - d7/d8/f25 zero size 2024-09-12T22:33:13.419 INFO:tasks.workunit.client.0.smithi019.stdout:6/249: creat d1b/f56 x:0 0 0 2024-09-12T22:33:13.419 INFO:tasks.workunit.client.0.smithi019.stdout:9/209: rmdir dd/d10/d17/d22 39 2024-09-12T22:33:13.419 INFO:tasks.workunit.client.0.smithi019.stdout:7/197: chown d6/db/dc/c2c 5530031 1 2024-09-12T22:33:13.420 INFO:tasks.workunit.client.0.smithi019.stdout:1/267: truncate d3/d11/f2c 3582063 0 2024-09-12T22:33:13.420 INFO:tasks.workunit.client.0.smithi019.stdout:2/249: write d0/d5/d18/d3b/f3f [2092188,39281] 0 2024-09-12T22:33:13.420 INFO:tasks.workunit.client.0.smithi019.stdout:4/196: mknod d1/d22/d2c/c41 0 2024-09-12T22:33:13.420 INFO:tasks.workunit.client.0.smithi019.stdout:5/354: truncate d0/dc/d39/f63 450427 0 2024-09-12T22:33:13.421 INFO:tasks.workunit.client.0.smithi019.stdout:4/197: chown d1/f25 4275 1 2024-09-12T22:33:13.421 INFO:tasks.workunit.client.0.smithi019.stdout:9/210: chown dd/d10/d17/l30 1 1 2024-09-12T22:33:13.421 INFO:tasks.workunit.client.0.smithi019.stdout:6/250: link d1b/f52 d1b/d2d/d35/f57 0 2024-09-12T22:33:13.421 INFO:tasks.workunit.client.0.smithi019.stdout:7/198: truncate d6/d14/d27/f37 903955 0 2024-09-12T22:33:13.421 INFO:tasks.workunit.client.0.smithi019.stdout:5/355: unlink d0/d7/d16/d69/f76 0 2024-09-12T22:33:13.422 INFO:tasks.workunit.client.0.smithi019.stdout:6/251: chown d1b/f3c 3 1 2024-09-12T22:33:13.422 INFO:tasks.workunit.client.0.smithi019.stdout:4/198: mknod d1/d22/d2c/c42 0 2024-09-12T22:33:13.423 INFO:tasks.workunit.client.0.smithi019.stdout:6/252: sync 2024-09-12T22:33:13.423 INFO:tasks.workunit.client.0.smithi019.stdout:1/268: mkdir d3/d3f/d58 0 2024-09-12T22:33:13.423 INFO:tasks.workunit.client.0.smithi019.stdout:8/193: truncate d7/d8/df/d2d/f30 705607 0 2024-09-12T22:33:13.423 INFO:tasks.workunit.client.0.smithi019.stdout:7/199: symlink d6/d2d/l4a 0 2024-09-12T22:33:13.423 INFO:tasks.workunit.client.0.smithi019.stdout:2/250: link d0/d5/d18/f56 d0/f57 0 2024-09-12T22:33:13.423 INFO:tasks.workunit.client.0.smithi019.stdout:4/199: creat d1/d22/d26/f43 x:0 0 0 2024-09-12T22:33:13.424 INFO:tasks.workunit.client.0.smithi019.stdout:3/177: read f5 [688226,98539] 0 2024-09-12T22:33:13.425 INFO:tasks.workunit.client.0.smithi019.stdout:5/356: dread d0/d7/d2d/f5e [0,4194304] 0 2024-09-12T22:33:13.425 INFO:tasks.workunit.client.0.smithi019.stdout:7/200: fdatasync d6/d14/d15/f24 0 2024-09-12T22:33:13.425 INFO:tasks.workunit.client.0.smithi019.stdout:4/200: mkdir d1/d4/d44 0 2024-09-12T22:33:13.425 INFO:tasks.workunit.client.0.smithi019.stdout:3/178: mknod dd/c3d 0 2024-09-12T22:33:13.426 INFO:tasks.workunit.client.0.smithi019.stdout:9/211: dread dd/f16 [0,4194304] 0 2024-09-12T22:33:13.426 INFO:tasks.workunit.client.0.smithi019.stdout:7/201: chown d6/d2d/f3e 15 1 2024-09-12T22:33:13.427 INFO:tasks.workunit.client.0.smithi019.stdout:1/269: link d3/d1b/l22 d3/d3f/l59 0 2024-09-12T22:33:13.427 INFO:tasks.workunit.client.0.smithi019.stdout:0/244: read d1/d14/f1e [870745,94775] 0 2024-09-12T22:33:13.427 INFO:tasks.workunit.client.0.smithi019.stdout:4/201: write d1/d11/d15/f1d [3082922,95049] 0 2024-09-12T22:33:13.427 INFO:tasks.workunit.client.0.smithi019.stdout:5/357: mknod d0/dc/d39/d38/c79 0 2024-09-12T22:33:13.429 INFO:tasks.workunit.client.0.smithi019.stdout:3/179: symlink dd/l3e 0 2024-09-12T22:33:13.429 INFO:tasks.workunit.client.0.smithi019.stdout:9/212: fsync dd/d10/d17/d23/d2e/d31/f34 0 2024-09-12T22:33:13.429 INFO:tasks.workunit.client.0.smithi019.stdout:8/194: write d7/f19 [1997702,62755] 0 2024-09-12T22:33:13.429 INFO:tasks.workunit.client.0.smithi019.stdout:6/253: dwrite d1b/f2b [0,4194304] 0 2024-09-12T22:33:13.429 INFO:tasks.workunit.client.0.smithi019.stdout:7/202: mkdir d6/d14/d27/d4b 0 2024-09-12T22:33:13.429 INFO:tasks.workunit.client.0.smithi019.stdout:5/358: chown d0/dc/d39/d38/f62 17 1 2024-09-12T22:33:13.430 INFO:tasks.workunit.client.0.smithi019.stdout:4/202: creat d1/d8/f45 x:0 0 0 2024-09-12T22:33:13.430 INFO:tasks.workunit.client.0.smithi019.stdout:0/245: symlink d1/d1f/l4c 0 2024-09-12T22:33:13.430 INFO:tasks.workunit.client.0.smithi019.stdout:2/251: getdents d0/d5/d18/d1b/d36 0 2024-09-12T22:33:13.431 INFO:tasks.workunit.client.0.smithi019.stdout:0/246: stat d1/d1f/f39 0 2024-09-12T22:33:13.431 INFO:tasks.workunit.client.0.smithi019.stdout:7/203: write d6/db/dc/f9 [1100419,87461] 0 2024-09-12T22:33:13.432 INFO:tasks.workunit.client.0.smithi019.stdout:3/180: write dd/d12/f18 [305910,130962] 0 2024-09-12T22:33:13.432 INFO:tasks.workunit.client.0.smithi019.stdout:6/254: write d1b/d2d/f32 [2944480,21642] 0 2024-09-12T22:33:13.432 INFO:tasks.workunit.client.0.smithi019.stdout:4/203: write d1/d4/d38/f3b [945480,30906] 0 2024-09-12T22:33:13.433 INFO:tasks.workunit.client.0.smithi019.stdout:9/213: creat dd/d10/d17/d23/f49 x:0 0 0 2024-09-12T22:33:13.433 INFO:tasks.workunit.client.0.smithi019.stdout:8/195: getdents d7 0 2024-09-12T22:33:13.433 INFO:tasks.workunit.client.0.smithi019.stdout:5/359: truncate d0/dc/d39/f63 1291658 0 2024-09-12T22:33:13.434 INFO:tasks.workunit.client.0.smithi019.stdout:0/247: write d1/f2c [1374840,125537] 0 2024-09-12T22:33:13.434 INFO:tasks.workunit.client.0.smithi019.stdout:8/196: chown c1 3 1 2024-09-12T22:33:13.434 INFO:tasks.workunit.client.0.smithi019.stdout:7/204: write d6/db/dc/f43 [640548,50423] 0 2024-09-12T22:33:13.434 INFO:tasks.workunit.client.0.smithi019.stdout:3/181: symlink dd/l3f 0 2024-09-12T22:33:13.434 INFO:tasks.workunit.client.0.smithi019.stdout:6/255: rmdir d1b/d2d/d44 0 2024-09-12T22:33:13.435 INFO:tasks.workunit.client.0.smithi019.stdout:7/205: rmdir d6/db 39 2024-09-12T22:33:13.435 INFO:tasks.workunit.client.0.smithi019.stdout:0/248: creat d1/f4d x:0 0 0 2024-09-12T22:33:13.435 INFO:tasks.workunit.client.0.smithi019.stdout:2/252: mknod d0/d5/d18/d52/c58 0 2024-09-12T22:33:13.435 INFO:tasks.workunit.client.0.smithi019.stdout:8/197: mkdir d7/d2f/d42 0 2024-09-12T22:33:13.436 INFO:tasks.workunit.client.0.smithi019.stdout:6/256: fsync d1b/f37 0 2024-09-12T22:33:13.436 INFO:tasks.workunit.client.0.smithi019.stdout:4/204: getdents d1/d4/d38 0 2024-09-12T22:33:13.436 INFO:tasks.workunit.client.0.smithi019.stdout:3/182: unlink dd/d12/f18 0 2024-09-12T22:33:13.436 INFO:tasks.workunit.client.0.smithi019.stdout:9/214: creat dd/d10/d17/d23/d2e/d31/d3f/d47/f4a x:0 0 0 2024-09-12T22:33:13.437 INFO:tasks.workunit.client.0.smithi019.stdout:8/198: dread - d7/d8/dd/f1c zero size 2024-09-12T22:33:13.437 INFO:tasks.workunit.client.0.smithi019.stdout:5/360: link d0/d7/d2d/d32/d4a/f6f d0/d7/d16/f7a 0 2024-09-12T22:33:13.437 INFO:tasks.workunit.client.0.smithi019.stdout:7/206: symlink d6/db/l4c 0 2024-09-12T22:33:13.438 INFO:tasks.workunit.client.0.smithi019.stdout:9/215: write dd/d10/d17/f24 [8142762,97767] 0 2024-09-12T22:33:13.438 INFO:tasks.workunit.client.0.smithi019.stdout:5/361: creat d0/d7/d2d/f7b x:0 0 0 2024-09-12T22:33:13.438 INFO:tasks.workunit.client.0.smithi019.stdout:3/183: chown dd/d12/c3a 2 1 2024-09-12T22:33:13.440 INFO:tasks.workunit.client.0.smithi019.stdout:5/362: readlink d0/d7/d2d/d32/d36/l72 0 2024-09-12T22:33:13.442 INFO:tasks.workunit.client.0.smithi019.stdout:5/363: unlink d0/dc/f21 0 2024-09-12T22:33:13.442 INFO:tasks.workunit.client.0.smithi019.stdout:4/205: dwrite d1/f25 [0,4194304] 0 2024-09-12T22:33:13.442 INFO:tasks.workunit.client.0.smithi019.stdout:2/253: dwrite d0/da/f50 [0,4194304] 0 2024-09-12T22:33:13.443 INFO:tasks.workunit.client.0.smithi019.stdout:4/206: fsync d1/d22/d26/f43 0 2024-09-12T22:33:13.444 INFO:tasks.workunit.client.0.smithi019.stdout:5/364: rmdir d0/dc/d39/d38/d4b 39 2024-09-12T22:33:13.444 INFO:tasks.workunit.client.0.smithi019.stdout:4/207: dread - d1/d22/d26/f29 zero size 2024-09-12T22:33:13.446 INFO:tasks.workunit.client.0.smithi019.stdout:4/208: mknod d1/d4/d38/c46 0 2024-09-12T22:33:13.446 INFO:tasks.workunit.client.0.smithi019.stdout:9/216: dwrite dd/d10/f19 [0,4194304] 0 2024-09-12T22:33:13.447 INFO:tasks.workunit.client.0.smithi019.stdout:4/209: mknod d1/d4/d44/c47 0 2024-09-12T22:33:13.448 INFO:tasks.workunit.client.0.smithi019.stdout:9/217: creat dd/d10/d17/d23/d2e/d31/d3f/f4b x:0 0 0 2024-09-12T22:33:13.449 INFO:tasks.workunit.client.0.smithi019.stdout:4/210: getdents d1/d22/d31 0 2024-09-12T22:33:13.449 INFO:tasks.workunit.client.0.smithi019.stdout:9/218: write dd/d10/d17/d23/f49 [504311,26292] 0 2024-09-12T22:33:13.450 INFO:tasks.workunit.client.0.smithi019.stdout:4/211: creat d1/d22/d26/f48 x:0 0 0 2024-09-12T22:33:13.450 INFO:tasks.workunit.client.0.smithi019.stdout:5/365: dwrite d0/d7/d2d/f54 [0,4194304] 0 2024-09-12T22:33:13.450 INFO:tasks.workunit.client.0.smithi019.stdout:9/219: chown dd/d10/d17/l26 5615380 1 2024-09-12T22:33:13.451 INFO:tasks.workunit.client.0.smithi019.stdout:4/212: write d1/d22/d26/f29 [388487,103437] 0 2024-09-12T22:33:13.452 INFO:tasks.workunit.client.0.smithi019.stdout:5/366: stat d0/dc/d24/l31 0 2024-09-12T22:33:13.453 INFO:tasks.workunit.client.0.smithi019.stdout:9/220: getdents dd 0 2024-09-12T22:33:13.454 INFO:tasks.workunit.client.0.smithi019.stdout:4/213: getdents d1/d11/d15/d1f 0 2024-09-12T22:33:13.454 INFO:tasks.workunit.client.0.smithi019.stdout:9/221: fsync dd/f16 0 2024-09-12T22:33:13.458 INFO:tasks.workunit.client.0.smithi019.stdout:4/214: dwrite d1/d22/d26/f29 [0,4194304] 0 2024-09-12T22:33:13.459 INFO:tasks.workunit.client.0.smithi019.stdout:4/215: dread - d1/d22/d26/f43 zero size 2024-09-12T22:33:13.459 INFO:tasks.workunit.client.0.smithi019.stdout:9/222: dwrite dd/d10/d17/d22/f3e [0,4194304] 0 2024-09-12T22:33:13.460 INFO:tasks.workunit.client.0.smithi019.stdout:6/257: sync 2024-09-12T22:33:13.460 INFO:tasks.workunit.client.0.smithi019.stdout:0/249: sync 2024-09-12T22:33:13.460 INFO:tasks.workunit.client.0.smithi019.stdout:3/184: sync 2024-09-12T22:33:13.460 INFO:tasks.workunit.client.0.smithi019.stdout:4/216: dread - d1/d8/f45 zero size 2024-09-12T22:33:13.461 INFO:tasks.workunit.client.0.smithi019.stdout:9/223: write dd/d10/d17/d23/f2a [69642,111192] 0 2024-09-12T22:33:13.463 INFO:tasks.workunit.client.0.smithi019.stdout:9/224: truncate dd/d10/f14 789929 0 2024-09-12T22:33:13.464 INFO:tasks.workunit.client.0.smithi019.stdout:9/225: stat dd/f18 0 2024-09-12T22:33:13.465 INFO:tasks.workunit.client.0.smithi019.stdout:4/217: write d1/d22/d2c/f35 [3043575,115320] 0 2024-09-12T22:33:13.465 INFO:tasks.workunit.client.0.smithi019.stdout:1/270: dread d3/d3f/f2d [0,4194304] 0 2024-09-12T22:33:13.466 INFO:tasks.workunit.client.0.smithi019.stdout:9/226: read dd/d10/d17/d23/f2a [127211,77853] 0 2024-09-12T22:33:13.466 INFO:tasks.workunit.client.0.smithi019.stdout:4/218: mkdir d1/d11/d15/d49 0 2024-09-12T22:33:13.466 INFO:tasks.workunit.client.0.smithi019.stdout:1/271: readlink d3/d1b/l34 0 2024-09-12T22:33:13.467 INFO:tasks.workunit.client.0.smithi019.stdout:9/227: creat dd/d10/f4c x:0 0 0 2024-09-12T22:33:13.467 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-09-12T22:33:13.467 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-09-12T22:33:13.467 INFO:teuthology.orchestra.run.smithi163.stdout: "complaint_time": 30, 2024-09-12T22:33:13.467 INFO:teuthology.orchestra.run.smithi163.stdout: "num_blocked_ops": 0 2024-09-12T22:33:13.467 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-09-12T22:33:13.468 INFO:tasks.workunit.client.0.smithi019.stdout:4/219: symlink d1/d22/d31/l4a 0 2024-09-12T22:33:13.468 INFO:tasks.workunit.client.0.smithi019.stdout:3/185: dread dd/d1e/f34 [0,4194304] 0 2024-09-12T22:33:13.468 INFO:tasks.workunit.client.0.smithi019.stdout:1/272: mknod d3/d11/d16/d3c/d55/c5a 0 2024-09-12T22:33:13.469 INFO:tasks.workunit.client.0.smithi019.stdout:9/228: rmdir dd/d10/d17/d23/d37 39 2024-09-12T22:33:13.469 INFO:tasks.workunit.client.0.smithi019.stdout:3/186: stat l6 0 2024-09-12T22:33:13.469 INFO:tasks.workunit.client.0.smithi019.stdout:1/273: dread - d3/d3f/f30 zero size 2024-09-12T22:33:13.469 INFO:tasks.workunit.client.0.smithi019.stdout:2/254: dread d0/d5/f3a [0,4194304] 0 2024-09-12T22:33:13.469 INFO:tasks.workunit.client.0.smithi019.stdout:9/229: rmdir dd/d10/d17/d23/d37 39 2024-09-12T22:33:13.469 INFO:tasks.workunit.client.0.smithi019.stdout:3/187: write dd/f28 [275294,14353] 0 2024-09-12T22:33:13.470 INFO:tasks.workunit.client.0.smithi019.stdout:1/274: creat d3/d11/d53/f5b x:0 0 0 2024-09-12T22:33:13.471 INFO:tasks.workunit.client.0.smithi019.stdout:7/207: sync 2024-09-12T22:33:13.471 INFO:tasks.workunit.client.0.smithi019.stdout:3/188: write dd/f26 [18795,56451] 0 2024-09-12T22:33:13.472 INFO:tasks.workunit.client.0.smithi019.stdout:1/275: mknod d3/d11/d53/c5c 0 2024-09-12T22:33:13.473 INFO:tasks.workunit.client.0.smithi019.stdout:9/230: getdents dd/d10/d17/d23/d2e/d31 0 2024-09-12T22:33:13.473 INFO:tasks.workunit.client.0.smithi019.stdout:7/208: creat d6/d14/d27/f4d x:0 0 0 2024-09-12T22:33:13.474 INFO:tasks.workunit.client.0.smithi019.stdout:1/276: write d3/df/f48 [641900,595] 0 2024-09-12T22:33:13.475 INFO:tasks.workunit.client.0.smithi019.stdout:4/220: dwrite d1/d22/d26/f43 [0,4194304] 0 2024-09-12T22:33:13.475 INFO:tasks.workunit.client.0.smithi019.stdout:3/189: getdents dd/d1e 0 2024-09-12T22:33:13.476 INFO:tasks.workunit.client.0.smithi019.stdout:6/258: dread d1b/d26/d27/f2f [0,4194304] 0 2024-09-12T22:33:13.476 INFO:tasks.workunit.client.0.smithi019.stdout:9/231: symlink dd/d10/d17/d23/d2e/d31/d3f/l4d 0 2024-09-12T22:33:13.476 INFO:tasks.workunit.client.0.smithi019.stdout:8/199: dread d7/d8/df/f17 [0,4194304] 0 2024-09-12T22:33:13.477 INFO:tasks.workunit.client.0.smithi019.stdout:7/209: write d6/d14/d15/f22 [1657556,71053] 0 2024-09-12T22:33:13.477 INFO:tasks.workunit.client.0.smithi019.stdout:2/255: dread d0/d5/d17/f14 [0,4194304] 0 2024-09-12T22:33:13.477 INFO:tasks.workunit.client.0.smithi019.stdout:4/221: rmdir d1/d11/d15 39 2024-09-12T22:33:13.478 INFO:tasks.workunit.client.0.smithi019.stdout:7/210: creat d6/d14/d27/f4e x:0 0 0 2024-09-12T22:33:13.478 INFO:tasks.workunit.client.0.smithi019.stdout:0/250: dread d1/f2c [0,4194304] 0 2024-09-12T22:33:13.478 INFO:tasks.workunit.client.0.smithi019.stdout:6/259: chown d1b/d26/d27/c50 11287 1 2024-09-12T22:33:13.478 INFO:tasks.workunit.client.0.smithi019.stdout:1/277: truncate d3/d11/d16/f45 1214726 0 2024-09-12T22:33:13.479 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:33:13.480 INFO:tasks.workunit.client.0.smithi019.stdout:9/232: rename dd/d10/d17/d23/d2e/f38 to dd/d10/d17/d23/d2e/d31/d3f/d47/f4e 0 2024-09-12T22:33:13.480 INFO:tasks.workunit.client.0.smithi019.stdout:1/278: unlink d3/df/l13 0 2024-09-12T22:33:13.481 INFO:tasks.workunit.client.0.smithi019.stdout:0/251: creat d1/d14/f4e x:0 0 0 2024-09-12T22:33:13.481 INFO:tasks.workunit.client.0.smithi019.stdout:0/252: symlink d1/d14/d32/l4f 0 2024-09-12T22:33:13.481 INFO:tasks.workunit.client.0.smithi019.stdout:9/233: getdents dd/d10/d17/d22/d42 0 2024-09-12T22:33:13.481 INFO:tasks.workunit.client.0.smithi019.stdout:5/367: dread d0/d7/d16/f4f [0,4194304] 0 2024-09-12T22:33:13.482 INFO:tasks.workunit.client.0.smithi019.stdout:0/253: creat d1/d14/d26/f50 x:0 0 0 2024-09-12T22:33:13.482 INFO:tasks.workunit.client.0.smithi019.stdout:9/234: getdents dd/d10/d17/d23 0 2024-09-12T22:33:13.483 INFO:tasks.workunit.client.0.smithi019.stdout:0/254: mkdir d1/d51 0 2024-09-12T22:33:13.483 INFO:tasks.workunit.client.0.smithi019.stdout:5/368: chown d0/dc/f5f 359859511 1 2024-09-12T22:33:13.485 INFO:tasks.workunit.client.0.smithi019.stdout:5/369: getdents d0/d7 0 2024-09-12T22:33:13.485 INFO:tasks.workunit.client.0.smithi019.stdout:1/279: dwrite d3/d11/f35 [0,4194304] 0 2024-09-12T22:33:13.485 INFO:tasks.workunit.client.0.smithi019.stdout:9/235: rename dd/d10/d17/d23/d2e/d31/d3f/d47/f4a to dd/d10/d17/d22/f4f 0 2024-09-12T22:33:13.486 INFO:tasks.workunit.client.0.smithi019.stdout:1/280: creat d3/d1b/f5d x:0 0 0 2024-09-12T22:33:13.486 INFO:tasks.workunit.client.0.smithi019.stdout:9/236: write dd/d10/f4c [719613,29572] 0 2024-09-12T22:33:13.486 INFO:tasks.workunit.client.0.smithi019.stdout:5/370: mknod d0/d7/d2d/d32/d36/d6a/c7c 0 2024-09-12T22:33:13.486 INFO:tasks.workunit.client.0.smithi019.stdout:1/281: dread - d3/df/f41 zero size 2024-09-12T22:33:13.487 INFO:tasks.workunit.client.0.smithi019.stdout:9/237: fdatasync dd/d10/d17/f24 0 2024-09-12T22:33:13.487 INFO:tasks.workunit.client.0.smithi019.stdout:1/282: mknod d3/df/c5e 0 2024-09-12T22:33:13.487 INFO:tasks.workunit.client.0.smithi019.stdout:5/371: mknod d0/d7/d2d/d32/c7d 0 2024-09-12T22:33:13.487 INFO:tasks.workunit.client.0.smithi019.stdout:9/238: symlink dd/d10/d17/d23/l50 0 2024-09-12T22:33:13.488 INFO:tasks.workunit.client.0.smithi019.stdout:2/256: chown d0/d5/d18/d1b/l2d 8101064 1 2024-09-12T22:33:13.488 INFO:tasks.workunit.client.0.smithi019.stdout:7/211: chown d6 331 1 2024-09-12T22:33:13.489 INFO:tasks.workunit.client.0.smithi019.stdout:4/222: symlink d1/d11/d15/d1f/l4b 0 2024-09-12T22:33:13.489 INFO:tasks.workunit.client.0.smithi019.stdout:1/283: rmdir d3/d11/d16/d3c/d55 39 2024-09-12T22:33:13.489 INFO:tasks.workunit.client.0.smithi019.stdout:2/257: symlink d0/d5/d18/d39/l59 0 2024-09-12T22:33:13.489 INFO:tasks.workunit.client.0.smithi019.stdout:6/260: write d1b/d2d/f42 [412404,52052] 0 2024-09-12T22:33:13.490 INFO:tasks.workunit.client.0.smithi019.stdout:9/239: read dd/f20 [1991200,42619] 0 2024-09-12T22:33:13.490 INFO:tasks.workunit.client.0.smithi019.stdout:8/200: dread d7/d8/df/f1a [0,4194304] 0 2024-09-12T22:33:13.491 INFO:tasks.workunit.client.0.smithi019.stdout:7/212: rename d6/db/c3c to d6/db/dc/c4f 0 2024-09-12T22:33:13.491 INFO:tasks.workunit.client.0.smithi019.stdout:5/372: write d0/d7/d16/f7a [776963,79098] 0 2024-09-12T22:33:13.491 INFO:tasks.workunit.client.0.smithi019.stdout:4/223: write d1/d8/f14 [4551096,117710] 0 2024-09-12T22:33:13.492 INFO:tasks.workunit.client.0.smithi019.stdout:1/284: creat d3/d3f/d58/f5f x:0 0 0 2024-09-12T22:33:13.492 INFO:tasks.workunit.client.0.smithi019.stdout:1/285: sync 2024-09-12T22:33:13.492 INFO:tasks.workunit.client.0.smithi019.stdout:7/213: write d6/db/f49 [738871,73504] 0 2024-09-12T22:33:13.493 INFO:tasks.workunit.client.0.smithi019.stdout:4/224: mkdir d1/d4c 0 2024-09-12T22:33:13.493 INFO:tasks.workunit.client.0.smithi019.stdout:3/190: dread dd/d12/f24 [0,4194304] 0 2024-09-12T22:33:13.493 INFO:tasks.workunit.client.0.smithi019.stdout:8/201: write f4 [2888277,19194] 0 2024-09-12T22:33:13.493 INFO:tasks.workunit.client.0.smithi019.stdout:5/373: creat d0/f7e x:0 0 0 2024-09-12T22:33:13.495 INFO:tasks.workunit.client.0.smithi019.stdout:7/214: chown d6/db/dc/f43 1045 1 2024-09-12T22:33:13.495 INFO:tasks.workunit.client.0.smithi019.stdout:9/240: symlink dd/d10/d17/d23/d2e/d31/d3f/d47/l51 0 2024-09-12T22:33:13.495 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:13.494+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:13.495 INFO:tasks.workunit.client.0.smithi019.stdout:8/202: mkdir d7/d8/d43 0 2024-09-12T22:33:13.496 INFO:tasks.workunit.client.0.smithi019.stdout:4/225: truncate d1/d22/d2c/f40 331087 0 2024-09-12T22:33:13.497 INFO:tasks.workunit.client.0.smithi019.stdout:7/215: creat d6/db/dc/d26/f50 x:0 0 0 2024-09-12T22:33:13.498 INFO:tasks.workunit.client.0.smithi019.stdout:9/241: mkdir dd/d10/d17/d23/d52 0 2024-09-12T22:33:13.499 INFO:tasks.workunit.client.0.smithi019.stdout:2/258: dwrite d0/da/f37 [0,4194304] 0 2024-09-12T22:33:13.500 INFO:tasks.workunit.client.0.smithi019.stdout:8/203: write d7/d8/df/d2d/f30 [1517860,54934] 0 2024-09-12T22:33:13.500 INFO:tasks.workunit.client.0.smithi019.stdout:7/216: symlink d6/d2d/d41/l51 0 2024-09-12T22:33:13.503 INFO:tasks.workunit.client.0.smithi019.stdout:6/261: dread f19 [0,4194304] 0 2024-09-12T22:33:13.503 INFO:tasks.workunit.client.0.smithi019.stdout:1/286: dwrite d3/f31 [0,4194304] 0 2024-09-12T22:33:13.505 INFO:tasks.workunit.client.0.smithi019.stdout:9/242: mkdir dd/d10/d17/d23/d52/d53 0 2024-09-12T22:33:13.505 INFO:tasks.workunit.client.0.smithi019.stdout:5/374: dwrite d0/d7/d16/f4f [0,4194304] 0 2024-09-12T22:33:13.506 INFO:tasks.workunit.client.0.smithi019.stdout:2/259: truncate d0/d5/d18/d1b/d36/f4a 8716798 0 2024-09-12T22:33:13.507 INFO:tasks.workunit.client.0.smithi019.stdout:1/287: creat d3/d11/d16/f60 x:0 0 0 2024-09-12T22:33:13.507 INFO:tasks.workunit.client.0.smithi019.stdout:6/262: creat d1b/d2d/d35/f58 x:0 0 0 2024-09-12T22:33:13.507 INFO:tasks.workunit.client.0.smithi019.stdout:9/243: stat dd/d10/d17/d22/f4f 0 2024-09-12T22:33:13.509 INFO:tasks.workunit.client.0.smithi019.stdout:4/226: dwrite d1/d8/f45 [0,4194304] 0 2024-09-12T22:33:13.510 INFO:tasks.workunit.client.0.smithi019.stdout:6/263: chown d1b/d2d/d35/f57 48 1 2024-09-12T22:33:13.513 INFO:tasks.workunit.client.0.smithi019.stdout:1/288: creat d3/d11/d16/d23/d54/f61 x:0 0 0 2024-09-12T22:33:13.513 INFO:tasks.workunit.client.0.smithi019.stdout:4/227: fdatasync d1/f25 0 2024-09-12T22:33:13.513 INFO:tasks.workunit.client.0.smithi019.stdout:2/260: write d0/d5/d18/d1b/d36/f4a [3997785,36239] 0 2024-09-12T22:33:13.513 INFO:tasks.workunit.client.0.smithi019.stdout:8/204: dread d7/f1d [0,4194304] 0 2024-09-12T22:33:13.513 INFO:tasks.workunit.client.0.smithi019.stdout:0/255: dread d1/d1f/f41 [0,4194304] 0 2024-09-12T22:33:13.513 INFO:tasks.workunit.client.0.smithi019.stdout:6/264: creat d1b/f59 x:0 0 0 2024-09-12T22:33:13.514 INFO:tasks.workunit.client.0.smithi019.stdout:0/256: dread - d1/f34 zero size 2024-09-12T22:33:13.514 INFO:tasks.workunit.client.0.smithi019.stdout:6/265: write d1b/f20 [394615,63523] 0 2024-09-12T22:33:13.514 INFO:tasks.workunit.client.0.smithi019.stdout:4/228: write d1/f25 [5218620,84616] 0 2024-09-12T22:33:13.514 INFO:tasks.workunit.client.0.smithi019.stdout:5/375: truncate d0/d7/d16/f47 107538 0 2024-09-12T22:33:13.515 INFO:tasks.workunit.client.0.smithi019.stdout:7/217: dwrite d6/d14/d15/f1b [0,4194304] 0 2024-09-12T22:33:13.516 INFO:tasks.workunit.client.0.smithi019.stdout:8/205: rename d7/c3a to d7/d34/c44 0 2024-09-12T22:33:13.517 INFO:tasks.workunit.client.0.smithi019.stdout:2/261: truncate d0/da/f37 4642043 0 2024-09-12T22:33:13.517 INFO:tasks.workunit.client.0.smithi019.stdout:7/218: fsync d6/d14/d15/f22 0 2024-09-12T22:33:13.517 INFO:tasks.workunit.client.0.smithi019.stdout:4/229: readlink d1/d11/l16 0 2024-09-12T22:33:13.518 INFO:tasks.workunit.client.0.smithi019.stdout:1/289: getdents d3/d11/d16/d23/d54 0 2024-09-12T22:33:13.518 INFO:tasks.workunit.client.0.smithi019.stdout:4/230: truncate d1/d22/f33 377122 0 2024-09-12T22:33:13.522 INFO:tasks.workunit.client.0.smithi019.stdout:3/191: dread f5 [0,4194304] 0 2024-09-12T22:33:13.523 INFO:tasks.workunit.client.0.smithi019.stdout:2/262: read d0/d5/f26 [1081655,77205] 0 2024-09-12T22:33:13.525 INFO:tasks.workunit.client.0.smithi019.stdout:9/244: dwrite dd/d10/d17/d23/d2e/d31/d3f/d47/f4e [0,4194304] 0 2024-09-12T22:33:13.527 INFO:tasks.workunit.client.0.smithi019.stdout:0/257: rename d1/f34 to d1/d14/d26/d40/f52 0 2024-09-12T22:33:13.527 INFO:tasks.workunit.client.0.smithi019.stdout:5/376: dwrite d0/dc/d39/d38/f3f [0,4194304] 0 2024-09-12T22:33:13.528 INFO:tasks.workunit.client.0.smithi019.stdout:0/258: write d1/d1f/f33 [1668657,93131] 0 2024-09-12T22:33:13.528 INFO:tasks.workunit.client.0.smithi019.stdout:4/231: dread d1/d8/f45 [0,4194304] 0 2024-09-12T22:33:13.529 INFO:tasks.workunit.client.0.smithi019.stdout:4/232: write d1/f25 [575079,98844] 0 2024-09-12T22:33:13.529 INFO:tasks.workunit.client.0.smithi019.stdout:4/233: chown d1/d4/d44 36715 1 2024-09-12T22:33:13.530 INFO:tasks.workunit.client.0.smithi019.stdout:5/377: dread d0/dc/d39/d38/f3f [0,4194304] 0 2024-09-12T22:33:13.533 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T22:33:13.540 INFO:tasks.workunit.client.0.smithi019.stdout:3/192: mkdir dd/d1e/d40 0 2024-09-12T22:33:13.540 INFO:tasks.workunit.client.0.smithi019.stdout:1/290: creat d3/d11/d16/d3c/d55/f62 x:0 0 0 2024-09-12T22:33:13.541 INFO:tasks.workunit.client.0.smithi019.stdout:4/234: chown d1/d4/l2d 3 1 2024-09-12T22:33:13.541 INFO:tasks.workunit.client.0.smithi019.stdout:8/206: mkdir d7/d8/dd/d45 0 2024-09-12T22:33:13.542 INFO:tasks.workunit.client.0.smithi019.stdout:7/219: rename d6/d2d/l30 to d6/db/l52 0 2024-09-12T22:33:13.542 INFO:tasks.workunit.client.0.smithi019.stdout:3/193: creat dd/d1e/d40/f41 x:0 0 0 2024-09-12T22:33:13.542 INFO:tasks.workunit.client.0.smithi019.stdout:4/235: stat d1/d22/d26/f29 0 2024-09-12T22:33:13.542 INFO:tasks.workunit.client.0.smithi019.stdout:9/245: getdents dd/d10/d17/d23/d37 0 2024-09-12T22:33:13.543 INFO:tasks.workunit.client.0.smithi019.stdout:1/291: truncate d3/d11/f2c 2066594 0 2024-09-12T22:33:13.543 INFO:tasks.workunit.client.0.smithi019.stdout:7/220: fdatasync d6/d14/d15/f22 0 2024-09-12T22:33:13.543 INFO:tasks.workunit.client.0.smithi019.stdout:8/207: chown d7/d34/f38 52422175 1 2024-09-12T22:33:13.544 INFO:tasks.workunit.client.0.smithi019.stdout:3/194: mknod dd/d1e/d40/c42 0 2024-09-12T22:33:13.546 INFO:tasks.workunit.client.0.smithi019.stdout:0/259: dwrite d1/d14/d26/d40/f52 [0,4194304] 0 2024-09-12T22:33:13.546 INFO:tasks.workunit.client.0.smithi019.stdout:5/378: link d0/d7/d2d/d32/c43 d0/d7/d2d/d32/d4a/c7f 0 2024-09-12T22:33:13.547 INFO:tasks.workunit.client.0.smithi019.stdout:7/221: mknod d6/d2d/d41/c53 0 2024-09-12T22:33:13.553 INFO:tasks.workunit.client.0.smithi019.stdout:9/246: mkdir dd/d10/d17/d23/d2e/d31/d54 0 2024-09-12T22:33:13.553 INFO:tasks.workunit.client.0.smithi019.stdout:3/195: dread - dd/d12/f3b zero size 2024-09-12T22:33:13.553 INFO:tasks.workunit.client.0.smithi019.stdout:4/236: dwrite d1/f24 [0,4194304] 0 2024-09-12T22:33:13.553 INFO:tasks.workunit.client.0.smithi019.stdout:3/196: fsync dd/f31 0 2024-09-12T22:33:13.553 INFO:tasks.workunit.client.0.smithi019.stdout:7/222: dread d6/d14/d15/f24 [0,4194304] 0 2024-09-12T22:33:13.557 INFO:tasks.workunit.client.0.smithi019.stdout:9/247: dwrite dd/d10/d17/d23/d37/f43 [0,4194304] 0 2024-09-12T22:33:13.558 INFO:tasks.workunit.client.0.smithi019.stdout:9/248: write dd/d10/f19 [6094521,86148] 0 2024-09-12T22:33:13.559 INFO:tasks.workunit.client.0.smithi019.stdout:5/379: symlink d0/d7/l80 0 2024-09-12T22:33:13.561 INFO:tasks.workunit.client.0.smithi019.stdout:6/266: sync 2024-09-12T22:33:13.563 INFO:tasks.workunit.client.0.smithi019.stdout:9/249: dread dd/d10/d17/d23/d37/f43 [0,4194304] 0 2024-09-12T22:33:13.564 INFO:tasks.workunit.client.0.smithi019.stdout:4/237: unlink d1/d11/d15/f1d 0 2024-09-12T22:33:13.569 INFO:tasks.workunit.client.0.smithi019.stdout:9/250: dread dd/d10/f19 [0,4194304] 0 2024-09-12T22:33:13.570 INFO:tasks.workunit.client.0.smithi019.stdout:9/251: chown dd 74875338 1 2024-09-12T22:33:13.572 INFO:tasks.workunit.client.0.smithi019.stdout:2/263: truncate d0/da/f50 1487494 0 2024-09-12T22:33:13.572 INFO:tasks.workunit.client.0.smithi019.stdout:8/208: mknod d7/d2f/d42/c46 0 2024-09-12T22:33:13.572 INFO:tasks.workunit.client.0.smithi019.stdout:7/223: write d6/d14/d15/f24 [447509,40491] 0 2024-09-12T22:33:13.572 INFO:tasks.workunit.client.0.smithi019.stdout:0/260: creat d1/d14/d32/d3d/f53 x:0 0 0 2024-09-12T22:33:13.573 INFO:tasks.workunit.client.0.smithi019.stdout:2/264: fdatasync d0/d5/d18/d39/f44 0 2024-09-12T22:33:13.573 INFO:tasks.workunit.client.0.smithi019.stdout:8/209: chown d7/d8/dd/f12 33 1 2024-09-12T22:33:13.573 INFO:tasks.workunit.client.0.smithi019.stdout:3/197: mknod dd/c43 0 2024-09-12T22:33:13.573 INFO:tasks.workunit.client.0.smithi019.stdout:3/198: readlink l6 0 2024-09-12T22:33:13.574 INFO:tasks.workunit.client.0.smithi019.stdout:4/238: readlink d1/l32 0 2024-09-12T22:33:13.575 INFO:tasks.workunit.client.0.smithi019.stdout:2/265: write d0/da/f31 [1441124,21618] 0 2024-09-12T22:33:13.575 INFO:tasks.workunit.client.0.smithi019.stdout:8/210: rmdir d7/d8/df/d2d 39 2024-09-12T22:33:13.575 INFO:tasks.workunit.client.0.smithi019.stdout:0/261: creat d1/d14/d26/d40/d45/f54 x:0 0 0 2024-09-12T22:33:13.575 INFO:tasks.workunit.client.0.smithi019.stdout:7/224: symlink d6/l54 0 2024-09-12T22:33:13.576 INFO:tasks.workunit.client.0.smithi019.stdout:2/266: fdatasync d0/d5/f3a 0 2024-09-12T22:33:13.576 INFO:tasks.workunit.client.0.smithi019.stdout:0/262: rmdir d1/d14/d32/d3d 39 2024-09-12T22:33:13.577 INFO:tasks.workunit.client.0.smithi019.stdout:9/252: link dd/d10/d17/d23/f49 dd/d10/d17/d22/d42/f55 0 2024-09-12T22:33:13.578 INFO:tasks.workunit.client.0.smithi019.stdout:3/199: link dd/d12/f30 dd/f44 0 2024-09-12T22:33:13.579 INFO:tasks.workunit.client.0.smithi019.stdout:7/225: mknod d6/d2d/d41/c55 0 2024-09-12T22:33:13.579 INFO:tasks.workunit.client.0.smithi019.stdout:3/200: dread - dd/d12/f30 zero size 2024-09-12T22:33:13.580 INFO:tasks.workunit.client.0.smithi019.stdout:9/253: write dd/d10/f4c [448813,64877] 0 2024-09-12T22:33:13.580 INFO:tasks.workunit.client.0.smithi019.stdout:1/292: truncate d3/d11/f2c 1330465 0 2024-09-12T22:33:13.581 INFO:tasks.workunit.client.0.smithi019.stdout:2/267: mknod d0/d5/d17/c5a 0 2024-09-12T22:33:13.581 INFO:tasks.workunit.client.0.smithi019.stdout:5/380: dread d0/dc/d39/d38/f44 [0,4194304] 0 2024-09-12T22:33:13.582 INFO:tasks.workunit.client.0.smithi019.stdout:3/201: write dd/f28 [4291468,121847] 0 2024-09-12T22:33:13.582 INFO:tasks.workunit.client.0.smithi019.stdout:0/263: fsync d1/d14/d32/f43 0 2024-09-12T22:33:13.582 INFO:tasks.workunit.client.0.smithi019.stdout:4/239: dwrite d1/d22/d26/f37 [0,4194304] 0 2024-09-12T22:33:13.584 INFO:tasks.workunit.client.0.smithi019.stdout:1/293: mkdir d3/d11/d63 0 2024-09-12T22:33:13.584 INFO:tasks.workunit.client.0.smithi019.stdout:5/381: rmdir d0/dc/d24 39 2024-09-12T22:33:13.585 INFO:tasks.workunit.client.0.smithi019.stdout:9/254: chown dd/d10/d17/d23/d2e/d31/d3f/d47 5281084 1 2024-09-12T22:33:13.585 INFO:tasks.workunit.client.0.smithi019.stdout:6/267: dread fb [0,4194304] 0 2024-09-12T22:33:13.585 INFO:tasks.workunit.client.0.smithi019.stdout:0/264: read - d1/d14/f4e zero size 2024-09-12T22:33:13.585 INFO:tasks.workunit.client.0.smithi019.stdout:7/226: link d6/d14/d27/f4e d6/d2d/d41/f56 0 2024-09-12T22:33:13.586 INFO:tasks.workunit.client.0.smithi019.stdout:8/211: dwrite d7/f2c [0,4194304] 0 2024-09-12T22:33:13.587 INFO:tasks.workunit.client.0.smithi019.stdout:2/268: getdents d0/d5/d17 0 2024-09-12T22:33:13.587 INFO:tasks.workunit.client.0.smithi019.stdout:6/268: readlink d1b/d26/l3f 0 2024-09-12T22:33:13.589 INFO:tasks.workunit.client.0.smithi019.stdout:8/212: write d7/d8/df/f17 [5075648,10961] 0 2024-09-12T22:33:13.589 INFO:tasks.workunit.client.0.smithi019.stdout:7/227: symlink d6/d14/d27/d4b/l57 0 2024-09-12T22:33:13.590 INFO:tasks.workunit.client.0.smithi019.stdout:4/240: dread d1/d11/d15/d1f/f21 [0,4194304] 0 2024-09-12T22:33:13.590 INFO:tasks.workunit.client.0.smithi019.stdout:1/294: link l2 d3/d11/l64 0 2024-09-12T22:33:13.591 INFO:tasks.workunit.client.0.smithi019.stdout:0/265: write d1/d14/f1e [1907544,1740] 0 2024-09-12T22:33:13.592 INFO:tasks.workunit.client.0.smithi019.stdout:7/228: fdatasync d6/db/dc/d26/f2f 0 2024-09-12T22:33:13.592 INFO:tasks.workunit.client.0.smithi019.stdout:3/202: dread dd/d12/f15 [0,4194304] 0 2024-09-12T22:33:13.592 INFO:tasks.workunit.client.0.smithi019.stdout:4/241: symlink d1/d22/d31/l4d 0 2024-09-12T22:33:13.593 INFO:tasks.workunit.client.0.smithi019.stdout:3/203: fdatasync dd/f28 0 2024-09-12T22:33:13.593 INFO:tasks.workunit.client.0.smithi019.stdout:0/266: symlink d1/d1d/l55 0 2024-09-12T22:33:13.594 INFO:tasks.workunit.client.0.smithi019.stdout:5/382: truncate d0/dc/d39/f4e 931190 0 2024-09-12T22:33:13.596 INFO:tasks.workunit.client.0.smithi019.stdout:7/229: symlink d6/d14/l58 0 2024-09-12T22:33:13.596 INFO:tasks.workunit.client.0.smithi019.stdout:0/267: creat d1/d51/f56 x:0 0 0 2024-09-12T22:33:13.597 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:13.595+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:13.597 INFO:tasks.workunit.client.0.smithi019.stdout:5/383: write d0/f49 [1761641,53404] 0 2024-09-12T22:33:13.597 INFO:tasks.workunit.client.0.smithi019.stdout:3/204: write dd/f20 [1617353,126398] 0 2024-09-12T22:33:13.597 INFO:tasks.workunit.client.0.smithi019.stdout:2/269: dwrite d0/d5/f3a [0,4194304] 0 2024-09-12T22:33:13.598 INFO:tasks.workunit.client.0.smithi019.stdout:0/268: truncate d1/d51/f56 412164 0 2024-09-12T22:33:13.599 INFO:tasks.workunit.client.0.smithi019.stdout:3/205: mknod dd/d1e/c45 0 2024-09-12T22:33:13.600 INFO:tasks.workunit.client.0.smithi019.stdout:7/230: dread d6/d14/d15/f28 [0,4194304] 0 2024-09-12T22:33:13.601 INFO:tasks.workunit.client.0.smithi019.stdout:2/270: rename d0/da/c19 to d0/da/c5b 0 2024-09-12T22:33:13.601 INFO:tasks.workunit.client.0.smithi019.stdout:8/213: dwrite d7/d8/df/f20 [0,4194304] 0 2024-09-12T22:33:13.601 INFO:tasks.workunit.client.0.smithi019.stdout:3/206: fdatasync dd/d1e/f37 0 2024-09-12T22:33:13.601 INFO:tasks.workunit.client.0.smithi019.stdout:5/384: truncate d0/d7/d3c/f5b 399236 0 2024-09-12T22:33:13.603 INFO:tasks.workunit.client.0.smithi019.stdout:7/231: creat d6/db/d42/f59 x:0 0 0 2024-09-12T22:33:13.603 INFO:tasks.workunit.client.0.smithi019.stdout:0/269: read d1/d14/f17 [399752,1083] 0 2024-09-12T22:33:13.603 INFO:tasks.workunit.client.0.smithi019.stdout:5/385: creat d0/d7/d16/d18/f81 x:0 0 0 2024-09-12T22:33:13.604 INFO:tasks.workunit.client.0.smithi019.stdout:2/271: rename d0/d5/d18/d52 to d0/d5/d18/d5c 0 2024-09-12T22:33:13.606 INFO:tasks.workunit.client.0.smithi019.stdout:5/386: mkdir d0/d7/d2d/d32/d36/d6a/d82 0 2024-09-12T22:33:13.611 INFO:tasks.workunit.client.0.smithi019.stdout:5/387: chown d0/dc/d39/d38/d4b/l53 116293313 1 2024-09-12T22:33:13.611 INFO:tasks.workunit.client.0.smithi019.stdout:7/232: dwrite d6/db/dc/f43 [0,4194304] 0 2024-09-12T22:33:13.611 INFO:tasks.workunit.client.0.smithi019.stdout:8/214: dwrite d7/f29 [0,4194304] 0 2024-09-12T22:33:13.612 INFO:tasks.workunit.client.0.smithi019.stdout:0/270: dwrite d1/fd [0,4194304] 0 2024-09-12T22:33:13.612 INFO:tasks.workunit.client.0.smithi019.stdout:7/233: fdatasync d6/d14/d27/f37 0 2024-09-12T22:33:13.614 INFO:tasks.workunit.client.0.smithi019.stdout:5/388: getdents d0/dc/d39/d38 0 2024-09-12T22:33:13.614 INFO:tasks.workunit.client.0.smithi019.stdout:7/234: creat d6/d14/d27/d4b/f5a x:0 0 0 2024-09-12T22:33:13.615 INFO:tasks.workunit.client.0.smithi019.stdout:0/271: truncate d1/d14/f36 1057405 0 2024-09-12T22:33:13.615 INFO:tasks.workunit.client.0.smithi019.stdout:5/389: dread - d0/d7/f2e zero size 2024-09-12T22:33:13.616 INFO:tasks.workunit.client.0.smithi019.stdout:5/390: fsync d0/d7/f1f 0 2024-09-12T22:33:13.617 INFO:tasks.workunit.client.0.smithi019.stdout:0/272: getdents d1/d14/d26/d40 0 2024-09-12T22:33:13.619 INFO:tasks.workunit.client.0.smithi019.stdout:8/215: dwrite d7/d8/df/f3b [0,4194304] 0 2024-09-12T22:33:13.619 INFO:tasks.workunit.client.0.smithi019.stdout:5/391: creat d0/d7/d2d/d4c/f83 x:0 0 0 2024-09-12T22:33:13.620 INFO:tasks.workunit.client.0.smithi019.stdout:8/216: symlink d7/d8/d32/l47 0 2024-09-12T22:33:13.621 INFO:tasks.workunit.client.0.smithi019.stdout:5/392: write d0/d7/d16/f2a [3051465,45591] 0 2024-09-12T22:33:13.622 INFO:tasks.workunit.client.0.smithi019.stdout:6/269: dread d1b/d26/d39/f4a [0,4194304] 0 2024-09-12T22:33:13.622 INFO:tasks.workunit.client.0.smithi019.stdout:9/255: dread dd/f18 [0,4194304] 0 2024-09-12T22:33:13.623 INFO:tasks.workunit.client.0.smithi019.stdout:7/235: dwrite d6/db/f3b [4194304,4194304] 0 2024-09-12T22:33:13.624 INFO:tasks.workunit.client.0.smithi019.stdout:6/270: rmdir d1b/d26/d27 39 2024-09-12T22:33:13.625 INFO:tasks.workunit.client.0.smithi019.stdout:8/217: getdents d7/d34 0 2024-09-12T22:33:13.625 INFO:tasks.workunit.client.0.smithi019.stdout:0/273: write d1/d14/d32/f43 [3647392,70293] 0 2024-09-12T22:33:13.625 INFO:tasks.workunit.client.0.smithi019.stdout:1/295: dread d3/f9 [0,4194304] 0 2024-09-12T22:33:13.627 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-09-12T22:33:13.627 INFO:teuthology.orchestra.run.smithi163.stdout: "size": 20, 2024-09-12T22:33:13.627 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 600, 2024-09-12T22:33:13.627 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2024-09-12T22:33:13.627 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.627 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-09-12T22:33:13.628 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:27.254459+0000", 2024-09-12T22:33:13.628 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 106.36904291, 2024-09-12T22:33:13.628 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.37816283899999997, 2024-09-12T22:33:13.628 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:13.628 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:13.628 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:13.628 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:13.628 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:33:13.629 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:33:13.629 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 1 2024-09-12T22:33:13.629 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.629 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:13.629 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.629 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:13.629 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254459+0000", 2024-09-12T22:33:13.629 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:13.629 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.629 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.629 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:13.629 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254459+0000", 2024-09-12T22:33:13.629 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:13.630 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.630 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.630 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:13.630 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254460+0000", 2024-09-12T22:33:13.630 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1739999999999999e-06 2024-09-12T22:33:13.630 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.630 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.630 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:13.630 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254472+0000", 2024-09-12T22:33:13.630 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2207e-05 2024-09-12T22:33:13.630 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.630 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.630 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:13.630 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254483+0000", 2024-09-12T22:33:13.631 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0631999999999999e-05 2024-09-12T22:33:13.631 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.631 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.631 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:13.631 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254492+0000", 2024-09-12T22:33:13.631 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3670000000000003e-06 2024-09-12T22:33:13.631 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.631 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.631 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:13.631 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254551+0000", 2024-09-12T22:33:13.631 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8687999999999998e-05 2024-09-12T22:33:13.632 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.632 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.632 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for peered", 2024-09-12T22:33:13.632 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254562+0000", 2024-09-12T22:33:13.632 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1249e-05 2024-09-12T22:33:13.632 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.632 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.632 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:13.632 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.631211+0000", 2024-09-12T22:33:13.632 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.376649018 2024-09-12T22:33:13.632 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.633 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.633 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:13.633 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.631345+0000", 2024-09-12T22:33:13.633 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013378700000000001 2024-09-12T22:33:13.633 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.633 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.633 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:33:13.633 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.631479+0000", 2024-09-12T22:33:13.633 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013352399999999999 2024-09-12T22:33:13.633 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.633 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.633 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:13.633 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632324+0000", 2024-09-12T22:33:13.634 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00084508100000000002 2024-09-12T22:33:13.634 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.634 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.634 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:13.634 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632548+0000", 2024-09-12T22:33:13.634 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000224329 2024-09-12T22:33:13.634 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.634 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.634 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:13.634 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632591+0000", 2024-09-12T22:33:13.634 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2564000000000001e-05 2024-09-12T22:33:13.634 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.634 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.634 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:13.635 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632622+0000", 2024-09-12T22:33:13.635 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1219e-05 2024-09-12T22:33:13.635 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:13.635 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:13.635 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:13.635 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.635 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.635 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:214 3.1d 3:bf8dcf43:::200.00000008:head [write 3204567~1421 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-09-12T22:33:13.635 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:09.385466+0000", 2024-09-12T22:33:13.635 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 4.2380356929999996, 2024-09-12T22:33:13.635 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.035431110000000002, 2024-09-12T22:33:13.635 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:13.635 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:13.636 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:13.636 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:13.636 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.637 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:13.637 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.385466+0000", 2024-09-12T22:33:13.637 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:13.637 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.637 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.637 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:13.637 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.385466+0000", 2024-09-12T22:33:13.637 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:13.637 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.637 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.638 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:13.638 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.385466+0000", 2024-09-12T22:33:13.638 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.4299999999999999e-07 2024-09-12T22:33:13.638 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.638 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.638 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:13.638 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.385469+0000", 2024-09-12T22:33:13.638 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7970000000000001e-06 2024-09-12T22:33:13.638 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.638 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.638 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:13.638 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.385476+0000", 2024-09-12T22:33:13.638 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6479999999999997e-06 2024-09-12T22:33:13.638 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.639 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.639 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:13.639 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.385483+0000", 2024-09-12T22:33:13.639 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9380000000000003e-06 2024-09-12T22:33:13.639 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.639 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.639 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:13.639 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.415728+0000", 2024-09-12T22:33:13.639 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.030244854000000002 2024-09-12T22:33:13.639 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.639 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.639 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:13.639 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.415776+0000", 2024-09-12T22:33:13.640 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8529999999999998e-05 2024-09-12T22:33:13.640 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.640 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.640 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:13.640 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.420783+0000", 2024-09-12T22:33:13.640 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0050064159999999996 2024-09-12T22:33:13.640 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.640 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.640 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:13.640 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.420831+0000", 2024-09-12T22:33:13.640 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8547999999999997e-05 2024-09-12T22:33:13.640 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.640 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.641 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:13.641 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.420897+0000", 2024-09-12T22:33:13.641 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6136000000000005e-05 2024-09-12T22:33:13.641 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:13.641 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:13.641 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:13.641 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.641 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.641 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4490.0:9871 4.35 4:ad66404a:::10000002d4d.00000000:head [write 0~6507] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:33:13.641 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:09.472309+0000", 2024-09-12T22:33:13.641 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 4.151192634, 2024-09-12T22:33:13.641 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.080251445000000005, 2024-09-12T22:33:13.641 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:13.642 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:13.642 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:13.642 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:13.642 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4490", 2024-09-12T22:33:13.642 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:13.642 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 9871 2024-09-12T22:33:13.642 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.642 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:13.642 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.642 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:13.642 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.472309+0000", 2024-09-12T22:33:13.642 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:13.642 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.642 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.643 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:13.643 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.472309+0000", 2024-09-12T22:33:13.643 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:13.643 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.643 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.643 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:13.643 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.472310+0000", 2024-09-12T22:33:13.643 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3799999999999996e-07 2024-09-12T22:33:13.643 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.643 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.643 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:13.643 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.472318+0000", 2024-09-12T22:33:13.644 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.8099999999999998e-06 2024-09-12T22:33:13.644 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.644 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.644 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:13.644 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.472328+0000", 2024-09-12T22:33:13.644 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0359e-05 2024-09-12T22:33:13.644 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.644 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.644 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:13.644 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.472334+0000", 2024-09-12T22:33:13.644 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.0109999999999997e-06 2024-09-12T22:33:13.644 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.644 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.645 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:13.645 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.472382+0000", 2024-09-12T22:33:13.645 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.7311000000000002e-05 2024-09-12T22:33:13.645 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.645 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.645 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:13.645 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.472497+0000", 2024-09-12T22:33:13.645 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011537800000000001 2024-09-12T22:33:13.645 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.645 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.645 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:13.645 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.472617+0000", 2024-09-12T22:33:13.645 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011989600000000001 2024-09-12T22:33:13.646 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.646 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.646 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:13.646 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473149+0000", 2024-09-12T22:33:13.646 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00053227999999999999 2024-09-12T22:33:13.646 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.646 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.646 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:13.646 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.552479+0000", 2024-09-12T22:33:13.646 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.079329541000000003 2024-09-12T22:33:13.646 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.646 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.646 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:13.646 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.552525+0000", 2024-09-12T22:33:13.647 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6421000000000002e-05 2024-09-12T22:33:13.647 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.647 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.647 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:13.647 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.552561+0000", 2024-09-12T22:33:13.647 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5599999999999998e-05 2024-09-12T22:33:13.647 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:13.647 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:13.647 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:13.647 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.647 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.647 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4490.0:9872 4.2c 4:3602c8d3:::10000002d4e.00000000:head [write 0~1178] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:33:13.647 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:09.473085+0000", 2024-09-12T22:33:13.648 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 4.1504173299999998, 2024-09-12T22:33:13.648 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.079631104999999994, 2024-09-12T22:33:13.648 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:13.648 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:13.648 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:13.648 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:13.648 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4490", 2024-09-12T22:33:13.648 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:13.648 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 9872 2024-09-12T22:33:13.648 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.648 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:13.648 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.649 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:13.649 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473085+0000", 2024-09-12T22:33:13.649 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:13.649 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.649 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.649 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:13.649 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473085+0000", 2024-09-12T22:33:13.649 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:13.649 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.649 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.649 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:13.649 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473085+0000", 2024-09-12T22:33:13.649 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3600000000000004e-07 2024-09-12T22:33:13.650 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.650 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.650 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:13.650 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473088+0000", 2024-09-12T22:33:13.650 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.005e-06 2024-09-12T22:33:13.650 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.650 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.650 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:13.650 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473095+0000", 2024-09-12T22:33:13.650 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3950000000000003e-06 2024-09-12T22:33:13.650 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.650 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.650 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:13.651 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473100+0000", 2024-09-12T22:33:13.651 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5460000000000002e-06 2024-09-12T22:33:13.651 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.651 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.651 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:13.651 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473138+0000", 2024-09-12T22:33:13.651 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8244999999999997e-05 2024-09-12T22:33:13.651 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.651 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.651 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:13.651 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473216+0000", 2024-09-12T22:33:13.651 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.7756000000000006e-05 2024-09-12T22:33:13.651 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.651 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.652 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:13.652 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473291+0000", 2024-09-12T22:33:13.652 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5110000000000004e-05 2024-09-12T22:33:13.652 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.652 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.652 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:13.652 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473736+0000", 2024-09-12T22:33:13.652 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00044486500000000002 2024-09-12T22:33:13.652 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.652 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.652 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:13.652 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.552637+0000", 2024-09-12T22:33:13.653 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.078900782000000003 2024-09-12T22:33:13.653 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.653 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.653 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:13.653 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.552680+0000", 2024-09-12T22:33:13.653 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3047999999999998e-05 2024-09-12T22:33:13.653 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.653 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.653 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:13.653 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.552716+0000", 2024-09-12T22:33:13.653 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5816999999999999e-05 2024-09-12T22:33:13.653 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:13.653 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:13.653 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:13.654 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.654 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.654 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4490.0:9873 4.2c 4:372c52ff:::10000002d4f.00000000:head [write 0~1230] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:33:13.654 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:09.473878+0000", 2024-09-12T22:33:13.654 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 4.1496238669999999, 2024-09-12T22:33:13.654 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.079036047999999998, 2024-09-12T22:33:13.654 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:13.654 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:13.654 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:13.654 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:13.654 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4490", 2024-09-12T22:33:13.654 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:13.655 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 9873 2024-09-12T22:33:13.655 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.655 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:13.655 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.655 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:13.655 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473878+0000", 2024-09-12T22:33:13.655 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:13.655 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.655 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.655 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:13.655 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473878+0000", 2024-09-12T22:33:13.655 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:13.655 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.655 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.656 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:13.656 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473879+0000", 2024-09-12T22:33:13.656 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9100000000000004e-07 2024-09-12T22:33:13.656 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.656 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.656 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:13.656 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473882+0000", 2024-09-12T22:33:13.656 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.405e-06 2024-09-12T22:33:13.656 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.656 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.656 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:13.656 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473889+0000", 2024-09-12T22:33:13.656 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7519999999999999e-06 2024-09-12T22:33:13.657 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.657 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.657 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:13.657 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473893+0000", 2024-09-12T22:33:13.657 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9310000000000001e-06 2024-09-12T22:33:13.657 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.657 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.657 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:13.657 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473922+0000", 2024-09-12T22:33:13.657 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9346999999999999e-05 2024-09-12T22:33:13.657 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.657 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.657 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:13.658 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474000+0000", 2024-09-12T22:33:13.658 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.7972000000000005e-05 2024-09-12T22:33:13.658 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.658 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.658 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:13.658 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474072+0000", 2024-09-12T22:33:13.658 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1960999999999998e-05 2024-09-12T22:33:13.658 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.658 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.658 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:13.658 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474470+0000", 2024-09-12T22:33:13.658 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00039803400000000002 2024-09-12T22:33:13.659 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.659 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.659 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:13.659 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.552814+0000", 2024-09-12T22:33:13.659 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.078344164999999993 2024-09-12T22:33:13.659 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.659 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.659 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:13.659 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.552875+0000", 2024-09-12T22:33:13.659 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1008999999999998e-05 2024-09-12T22:33:13.659 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.659 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.659 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:13.660 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.552914+0000", 2024-09-12T22:33:13.660 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8881000000000003e-05 2024-09-12T22:33:13.660 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:13.660 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:13.660 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:13.660 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.660 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.660 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4490.0:9874 4.1b 4:db19d96a:::10000002d50.00000000:head [write 0~1088] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:33:13.660 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:09.474673+0000", 2024-09-12T22:33:13.660 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 4.1488288740000003, 2024-09-12T22:33:13.660 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.080314317999999996, 2024-09-12T22:33:13.660 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:13.661 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:13.661 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:13.661 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:13.661 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4490", 2024-09-12T22:33:13.661 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:13.661 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 9874 2024-09-12T22:33:13.661 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.661 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:13.661 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.661 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:13.661 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474673+0000", 2024-09-12T22:33:13.661 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:13.661 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.661 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.662 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:13.662 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474673+0000", 2024-09-12T22:33:13.662 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:13.662 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.662 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.662 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:13.662 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474674+0000", 2024-09-12T22:33:13.662 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6199999999999998e-07 2024-09-12T22:33:13.662 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.662 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.662 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:13.662 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474677+0000", 2024-09-12T22:33:13.663 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.224e-06 2024-09-12T22:33:13.663 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.663 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.663 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:13.663 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474683+0000", 2024-09-12T22:33:13.663 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.3160000000000002e-06 2024-09-12T22:33:13.663 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.663 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.663 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:13.663 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474687+0000", 2024-09-12T22:33:13.663 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7869999999999999e-06 2024-09-12T22:33:13.663 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.663 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.663 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:13.664 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474730+0000", 2024-09-12T22:33:13.664 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3309000000000002e-05 2024-09-12T22:33:13.664 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.664 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.664 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:13.664 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474845+0000", 2024-09-12T22:33:13.664 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114306 2024-09-12T22:33:13.664 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.664 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.664 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:13.664 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474970+0000", 2024-09-12T22:33:13.664 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000125096 2024-09-12T22:33:13.665 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.665 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.665 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:13.665 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.475621+0000", 2024-09-12T22:33:13.665 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00065124900000000001 2024-09-12T22:33:13.665 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.665 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.665 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:13.665 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.554885+0000", 2024-09-12T22:33:13.665 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.079264055 2024-09-12T22:33:13.665 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.665 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.665 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:13.665 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.554942+0000", 2024-09-12T22:33:13.666 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7284000000000002e-05 2024-09-12T22:33:13.666 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.666 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.666 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:13.666 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.554987+0000", 2024-09-12T22:33:13.666 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5130000000000003e-05 2024-09-12T22:33:13.666 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:13.666 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:13.666 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:13.666 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.666 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.666 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4490.0:9890 4.1a 4:5b0facce:::10000002d60.00000000:head [write 0~3380] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:33:13.666 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:09.487873+0000", 2024-09-12T22:33:13.667 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 4.135628724, 2024-09-12T22:33:13.667 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.067101901000000005, 2024-09-12T22:33:13.667 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:13.667 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:13.667 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:13.667 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:13.667 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4490", 2024-09-12T22:33:13.667 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:13.667 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 9890 2024-09-12T22:33:13.667 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.667 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:13.667 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.668 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:13.668 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.487873+0000", 2024-09-12T22:33:13.668 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:13.668 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.668 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.668 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:13.668 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.487873+0000", 2024-09-12T22:33:13.668 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:13.668 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.668 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.668 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:13.668 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.487874+0000", 2024-09-12T22:33:13.668 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5499999999999997e-07 2024-09-12T22:33:13.669 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.669 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.669 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:13.669 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.487878+0000", 2024-09-12T22:33:13.669 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5229999999999997e-06 2024-09-12T22:33:13.669 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.669 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.669 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:13.669 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.487888+0000", 2024-09-12T22:33:13.669 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.4739999999999994e-06 2024-09-12T22:33:13.669 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.669 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.670 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:13.670 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.487893+0000", 2024-09-12T22:33:13.670 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5049999999999998e-06 2024-09-12T22:33:13.670 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.670 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.670 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:13.670 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.487935+0000", 2024-09-12T22:33:13.670 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1508999999999998e-05 2024-09-12T22:33:13.670 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.670 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.670 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:13.670 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.488018+0000", 2024-09-12T22:33:13.670 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.2593e-05 2024-09-12T22:33:13.670 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.671 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.671 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:13.671 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.488089+0000", 2024-09-12T22:33:13.671 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1261999999999996e-05 2024-09-12T22:33:13.671 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.671 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.671 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:13.671 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.488576+0000", 2024-09-12T22:33:13.671 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00048686200000000002 2024-09-12T22:33:13.671 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.671 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.671 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:13.671 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.554908+0000", 2024-09-12T22:33:13.672 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.066331958999999996 2024-09-12T22:33:13.672 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.672 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.672 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:13.672 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.554937+0000", 2024-09-12T22:33:13.672 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9162999999999998e-05 2024-09-12T22:33:13.672 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.672 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.672 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:13.672 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.554975+0000", 2024-09-12T22:33:13.672 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8296000000000001e-05 2024-09-12T22:33:13.672 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:13.672 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:13.673 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:13.673 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.673 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.673 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4490.0:9902 4.1a 4:5b620645:::10000002d6c.00000000:head [write 0~1540] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:33:13.673 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:09.498667+0000", 2024-09-12T22:33:13.673 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 4.1248349619999995, 2024-09-12T22:33:13.673 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.056727697000000001, 2024-09-12T22:33:13.673 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:13.673 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:13.673 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:13.673 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:13.673 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4490", 2024-09-12T22:33:13.673 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:13.674 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 9902 2024-09-12T22:33:13.674 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.674 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:13.674 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.674 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:13.674 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.498667+0000", 2024-09-12T22:33:13.674 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:13.674 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.674 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.674 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:13.674 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.498667+0000", 2024-09-12T22:33:13.674 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:13.674 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.674 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.675 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:13.675 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.498668+0000", 2024-09-12T22:33:13.675 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6799999999999999e-07 2024-09-12T22:33:13.675 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.675 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.675 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:13.675 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.498673+0000", 2024-09-12T22:33:13.675 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9389999999999996e-06 2024-09-12T22:33:13.675 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.675 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.675 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:13.675 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.498682+0000", 2024-09-12T22:33:13.675 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.5810000000000003e-06 2024-09-12T22:33:13.676 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.676 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.676 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:13.676 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.498688+0000", 2024-09-12T22:33:13.676 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4750000000000001e-06 2024-09-12T22:33:13.676 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.676 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.676 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:13.676 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.498733+0000", 2024-09-12T22:33:13.676 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5182000000000002e-05 2024-09-12T22:33:13.676 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.676 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.677 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:13.677 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.498844+0000", 2024-09-12T22:33:13.677 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011139800000000001 2024-09-12T22:33:13.677 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.677 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.677 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:13.677 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.498978+0000", 2024-09-12T22:33:13.677 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013347399999999999 2024-09-12T22:33:13.677 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.677 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.677 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:13.677 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.499453+0000", 2024-09-12T22:33:13.678 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000474986 2024-09-12T22:33:13.678 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.678 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.678 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:13.678 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.555348+0000", 2024-09-12T22:33:13.678 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.055895011000000001 2024-09-12T22:33:13.678 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.678 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.678 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:13.678 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.555373+0000", 2024-09-12T22:33:13.678 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5023000000000001e-05 2024-09-12T22:33:13.678 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.678 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.678 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:13.679 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.555395+0000", 2024-09-12T22:33:13.679 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1860000000000001e-05 2024-09-12T22:33:13.679 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:13.679 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:13.679 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:13.679 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.679 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.679 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4490.0:9904 4.1b 4:d91b240f:::10000002d6e.00000000:head [write 0~1086] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:33:13.679 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:09.500507+0000", 2024-09-12T22:33:13.679 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 4.1229953009999996, 2024-09-12T22:33:13.679 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.055162873000000001, 2024-09-12T22:33:13.679 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:13.679 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:13.680 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:13.680 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:13.680 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4490", 2024-09-12T22:33:13.680 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:13.680 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 9904 2024-09-12T22:33:13.680 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.680 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:13.680 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.680 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:13.680 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.500507+0000", 2024-09-12T22:33:13.680 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:13.680 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.680 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.680 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:13.681 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.500507+0000", 2024-09-12T22:33:13.681 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:13.681 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.681 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.681 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:13.681 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.500508+0000", 2024-09-12T22:33:13.681 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.844e-06 2024-09-12T22:33:13.681 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.681 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.681 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:13.681 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.500518+0000", 2024-09-12T22:33:13.681 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.9899999999999992e-06 2024-09-12T22:33:13.681 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.682 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.682 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:13.682 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.500546+0000", 2024-09-12T22:33:13.682 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7288999999999999e-05 2024-09-12T22:33:13.682 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.682 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.682 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:13.682 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.500559+0000", 2024-09-12T22:33:13.682 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.3499999999999999e-05 2024-09-12T22:33:13.682 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.682 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.682 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:13.682 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.500682+0000", 2024-09-12T22:33:13.683 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000122562 2024-09-12T22:33:13.683 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.683 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.683 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:13.683 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.500761+0000", 2024-09-12T22:33:13.683 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9005000000000007e-05 2024-09-12T22:33:13.683 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.683 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.683 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:13.683 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.500836+0000", 2024-09-12T22:33:13.684 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5393000000000001e-05 2024-09-12T22:33:13.684 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.684 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.684 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:13.684 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.501269+0000", 2024-09-12T22:33:13.684 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000432349 2024-09-12T22:33:13.684 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.684 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.684 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:13.684 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.555592+0000", 2024-09-12T22:33:13.684 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.054323313999999998 2024-09-12T22:33:13.684 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.684 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.685 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:13.685 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.555635+0000", 2024-09-12T22:33:13.685 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3170999999999997e-05 2024-09-12T22:33:13.685 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.685 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.685 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:13.685 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.555669+0000", 2024-09-12T22:33:13.685 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4455999999999997e-05 2024-09-12T22:33:13.685 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:13.685 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:13.685 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:13.686 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.686 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.686 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4490.0:9908 4.39 4:9cd81ca0:::10000002d72.00000000:head [write 0~2164] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:33:13.686 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:09.503732+0000", 2024-09-12T22:33:13.686 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 4.1197699419999996, 2024-09-12T22:33:13.686 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.051725401999999997, 2024-09-12T22:33:13.686 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:13.686 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:13.686 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:13.686 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:13.686 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4490", 2024-09-12T22:33:13.686 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:13.686 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 9908 2024-09-12T22:33:13.687 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.687 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:13.687 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.687 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:13.687 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.503732+0000", 2024-09-12T22:33:13.687 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:13.687 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.687 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.687 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:13.687 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.503732+0000", 2024-09-12T22:33:13.687 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:13.687 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.688 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.688 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:13.688 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.503733+0000", 2024-09-12T22:33:13.688 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4300000000000002e-07 2024-09-12T22:33:13.688 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.688 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.688 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:13.688 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.503737+0000", 2024-09-12T22:33:13.688 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6129999999999997e-06 2024-09-12T22:33:13.688 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.688 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.688 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:13.688 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.503746+0000", 2024-09-12T22:33:13.689 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.6260000000000001e-06 2024-09-12T22:33:13.689 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.689 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.689 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:13.689 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.503751+0000", 2024-09-12T22:33:13.689 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.293e-06 2024-09-12T22:33:13.689 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.689 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.689 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:13.689 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.503791+0000", 2024-09-12T22:33:13.689 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9484999999999999e-05 2024-09-12T22:33:13.689 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.689 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.690 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:13.690 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.503859+0000", 2024-09-12T22:33:13.690 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.8367000000000005e-05 2024-09-12T22:33:13.690 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.690 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.690 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:13.690 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.503929+0000", 2024-09-12T22:33:13.690 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.0431000000000004e-05 2024-09-12T22:33:13.690 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.690 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.690 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:13.690 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.504396+0000", 2024-09-12T22:33:13.690 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00046626799999999999 2024-09-12T22:33:13.690 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.691 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.691 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:13.691 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.555379+0000", 2024-09-12T22:33:13.691 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.050983524000000002 2024-09-12T22:33:13.691 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.691 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.691 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:13.691 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.555423+0000", 2024-09-12T22:33:13.691 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3996999999999999e-05 2024-09-12T22:33:13.691 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.691 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.691 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:13.691 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.555457+0000", 2024-09-12T22:33:13.692 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4054999999999998e-05 2024-09-12T22:33:13.692 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:13.692 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:13.692 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:13.692 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.692 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.692 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4490.0:9911 4.3a 4:5f6b4c9e:::10000002d75.00000000:head [write 0~1107] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:33:13.692 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:09.506443+0000", 2024-09-12T22:33:13.692 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 4.1170587230000004, 2024-09-12T22:33:13.692 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.049042281, 2024-09-12T22:33:13.692 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:13.693 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:13.693 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:13.693 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:13.693 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4490", 2024-09-12T22:33:13.693 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:13.693 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 9911 2024-09-12T22:33:13.693 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.693 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:13.693 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.693 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:13.693 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.506443+0000", 2024-09-12T22:33:13.693 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:13.693 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.693 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.694 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:13.694 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.506443+0000", 2024-09-12T22:33:13.694 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:13.694 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.694 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.694 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:13.694 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.506445+0000", 2024-09-12T22:33:13.694 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.99e-06 2024-09-12T22:33:13.694 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.694 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.694 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:13.694 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.506456+0000", 2024-09-12T22:33:13.694 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0516000000000001e-05 2024-09-12T22:33:13.695 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.695 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.695 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:13.695 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.506483+0000", 2024-09-12T22:33:13.695 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7793e-05 2024-09-12T22:33:13.695 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.695 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.695 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:13.695 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.506497+0000", 2024-09-12T22:33:13.695 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.3963e-05 2024-09-12T22:33:13.695 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.695 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.695 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:13.695 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.506601+0000", 2024-09-12T22:33:13.695 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000103787 2024-09-12T22:33:13.696 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.696 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.696 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:13.696 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.506705+0000", 2024-09-12T22:33:13.696 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00010416000000000001 2024-09-12T22:33:13.696 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.696 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.696 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:13.696 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.506793+0000", 2024-09-12T22:33:13.696 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8022999999999994e-05 2024-09-12T22:33:13.696 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.696 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.697 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:13.697 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.507806+0000", 2024-09-12T22:33:13.697 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.001012191 2024-09-12T22:33:13.697 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.697 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.697 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:13.697 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.555403+0000", 2024-09-12T22:33:13.697 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.047597439999999998 2024-09-12T22:33:13.697 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.697 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.697 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:13.697 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.555448+0000", 2024-09-12T22:33:13.697 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5408999999999998e-05 2024-09-12T22:33:13.698 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.698 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.698 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:13.698 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.555485+0000", 2024-09-12T22:33:13.698 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7008999999999998e-05 2024-09-12T22:33:13.698 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:13.698 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:13.698 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:13.698 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.698 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.698 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4490.0:10445 4.3c 4:3d97251e:::10000002fd8.00000000:head [write 0~8584] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:33:13.698 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:10.058142+0000", 2024-09-12T22:33:13.698 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 3.565360117, 2024-09-12T22:33:13.699 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.049867767, 2024-09-12T22:33:13.699 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:13.699 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:13.699 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:13.699 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:13.699 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4490", 2024-09-12T22:33:13.699 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:13.699 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 10445 2024-09-12T22:33:13.699 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.699 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:13.699 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.699 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:13.699 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:10.058142+0000", 2024-09-12T22:33:13.700 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:13.700 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.700 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.700 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:13.700 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:10.058142+0000", 2024-09-12T22:33:13.700 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:13.700 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.700 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.700 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:13.700 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:10.058142+0000", 2024-09-12T22:33:13.700 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.0900000000000001e-07 2024-09-12T22:33:13.700 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.700 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.700 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:13.701 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:10.058152+0000", 2024-09-12T22:33:13.701 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.1679999999999993e-06 2024-09-12T22:33:13.701 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.701 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.701 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:13.701 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:10.058160+0000", 2024-09-12T22:33:13.701 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.2609999999999993e-06 2024-09-12T22:33:13.701 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.701 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.701 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:13.701 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:10.058164+0000", 2024-09-12T22:33:13.701 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6650000000000002e-06 2024-09-12T22:33:13.701 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.701 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.702 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:13.702 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:10.058205+0000", 2024-09-12T22:33:13.702 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0982999999999997e-05 2024-09-12T22:33:13.702 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.702 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.702 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:13.702 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:10.058284+0000", 2024-09-12T22:33:13.702 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.8794999999999994e-05 2024-09-12T22:33:13.702 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.702 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.702 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:13.702 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:10.058359+0000", 2024-09-12T22:33:13.702 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4682000000000001e-05 2024-09-12T22:33:13.703 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.703 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.703 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:13.703 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:10.059005+0000", 2024-09-12T22:33:13.703 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00064605800000000003 2024-09-12T22:33:13.703 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.703 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.703 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:13.703 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:10.107942+0000", 2024-09-12T22:33:13.703 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.048936944000000003 2024-09-12T22:33:13.703 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.703 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.703 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:13.704 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:10.107984+0000", 2024-09-12T22:33:13.704 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2290000000000003e-05 2024-09-12T22:33:13.704 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.704 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.704 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:13.704 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:10.108010+0000", 2024-09-12T22:33:13.704 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5312000000000001e-05 2024-09-12T22:33:13.704 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:13.704 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:13.704 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:13.704 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.704 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.704 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4490.0:10449 4.38 4:1c7fbedb:::10000002fdc.00000000:head [write 0~161] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:33:13.705 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:10.061561+0000", 2024-09-12T22:33:13.705 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 3.5619409740000001, 2024-09-12T22:33:13.705 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.048732401000000002, 2024-09-12T22:33:13.705 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:13.705 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:13.705 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:13.705 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:13.705 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4490", 2024-09-12T22:33:13.705 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:13.705 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 10449 2024-09-12T22:33:13.705 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.705 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:13.705 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.706 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:13.706 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:10.061561+0000", 2024-09-12T22:33:13.706 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:13.706 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.706 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.706 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:13.706 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:10.061561+0000", 2024-09-12T22:33:13.706 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:13.706 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.706 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.706 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:13.706 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:10.061562+0000", 2024-09-12T22:33:13.706 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3799999999999996e-07 2024-09-12T22:33:13.706 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.707 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.707 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:13.707 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:10.061567+0000", 2024-09-12T22:33:13.707 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.361e-06 2024-09-12T22:33:13.707 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.707 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.707 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:13.707 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:10.061585+0000", 2024-09-12T22:33:13.707 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7430000000000001e-05 2024-09-12T22:33:13.707 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.707 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.707 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:13.707 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:10.061591+0000", 2024-09-12T22:33:13.707 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.0220000000000001e-06 2024-09-12T22:33:13.708 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.708 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.708 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:13.708 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:10.061643+0000", 2024-09-12T22:33:13.708 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2398000000000002e-05 2024-09-12T22:33:13.708 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.708 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.708 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:13.708 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:10.061742+0000", 2024-09-12T22:33:13.708 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.9338000000000003e-05 2024-09-12T22:33:13.708 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.708 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.708 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:13.709 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:10.061823+0000", 2024-09-12T22:33:13.709 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0575999999999996e-05 2024-09-12T22:33:13.709 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.709 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.709 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:13.709 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:10.062381+0000", 2024-09-12T22:33:13.709 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00055757799999999998 2024-09-12T22:33:13.709 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.709 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.709 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:13.709 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:10.110218+0000", 2024-09-12T22:33:13.709 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.047837017000000003 2024-09-12T22:33:13.709 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.709 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.710 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:13.710 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:10.110259+0000", 2024-09-12T22:33:13.710 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1017999999999999e-05 2024-09-12T22:33:13.710 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.710 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.710 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:13.710 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:10.110293+0000", 2024-09-12T22:33:13.710 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4724999999999997e-05 2024-09-12T22:33:13.710 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:13.710 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:13.710 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:13.710 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.710 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.711 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4490.0:10450 4.30 4:0e85899b:::10000002fdd.00000000:head [write 0~174] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:33:13.711 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:10.062261+0000", 2024-09-12T22:33:13.711 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 3.561240395, 2024-09-12T22:33:13.711 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.048021411999999999, 2024-09-12T22:33:13.711 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:13.711 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:13.711 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:13.711 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:13.711 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4490", 2024-09-12T22:33:13.711 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:13.711 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 10450 2024-09-12T22:33:13.711 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.711 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:13.712 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.712 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:13.712 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:10.062261+0000", 2024-09-12T22:33:13.712 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:13.712 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.712 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.712 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:13.712 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:10.062261+0000", 2024-09-12T22:33:13.712 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:13.712 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.712 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.712 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:13.712 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:10.062262+0000", 2024-09-12T22:33:13.713 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.1699999999999997e-07 2024-09-12T22:33:13.713 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.713 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.713 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:13.713 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:10.062267+0000", 2024-09-12T22:33:13.713 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6120000000000001e-06 2024-09-12T22:33:13.713 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.713 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.713 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:13.713 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:10.062279+0000", 2024-09-12T22:33:13.713 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1769e-05 2024-09-12T22:33:13.713 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.713 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.714 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:13.714 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:10.062286+0000", 2024-09-12T22:33:13.714 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2699999999999999e-06 2024-09-12T22:33:13.714 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.714 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.714 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:13.714 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:10.062337+0000", 2024-09-12T22:33:13.714 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1415999999999997e-05 2024-09-12T22:33:13.714 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.714 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.714 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:13.714 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:10.062469+0000", 2024-09-12T22:33:13.714 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013176799999999999 2024-09-12T22:33:13.715 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.715 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.715 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:13.715 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:10.062598+0000", 2024-09-12T22:33:13.715 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000128875 2024-09-12T22:33:13.715 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.715 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.715 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:13.715 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:10.063178+0000", 2024-09-12T22:33:13.715 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00058025199999999996 2024-09-12T22:33:13.715 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.715 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.715 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:13.715 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:10.110200+0000", 2024-09-12T22:33:13.715 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.047021687 2024-09-12T22:33:13.716 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.716 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.716 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:13.716 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:10.110248+0000", 2024-09-12T22:33:13.716 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.7596999999999998e-05 2024-09-12T22:33:13.716 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.716 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.716 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:13.716 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:10.110283+0000", 2024-09-12T22:33:13.716 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5349000000000003e-05 2024-09-12T22:33:13.716 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:13.716 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:13.716 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:13.717 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.717 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.717 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4490.0:10451 4.30 4:0d780bfe:::10000002fde.00000000:head [write 0~16925] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:33:13.717 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:10.063319+0000", 2024-09-12T22:33:13.717 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 3.5601825740000002, 2024-09-12T22:33:13.717 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.047088941000000002, 2024-09-12T22:33:13.717 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:13.717 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:13.717 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:13.717 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:13.717 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4490", 2024-09-12T22:33:13.717 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:13.717 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 10451 2024-09-12T22:33:13.718 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.718 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:13.718 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.718 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:13.718 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:10.063319+0000", 2024-09-12T22:33:13.718 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:13.718 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.718 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.718 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:13.718 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:10.063319+0000", 2024-09-12T22:33:13.718 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:13.718 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.718 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.718 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:13.719 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:10.063320+0000", 2024-09-12T22:33:13.719 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4499999999999996e-07 2024-09-12T22:33:13.719 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.719 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.719 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:13.719 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:10.063333+0000", 2024-09-12T22:33:13.719 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2716e-05 2024-09-12T22:33:13.719 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.719 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.719 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:13.719 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:10.063342+0000", 2024-09-12T22:33:13.719 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3950000000000007e-06 2024-09-12T22:33:13.719 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.719 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.720 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:13.720 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:10.063347+0000", 2024-09-12T22:33:13.720 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0549999999999999e-06 2024-09-12T22:33:13.720 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.720 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.720 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:13.720 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:10.063381+0000", 2024-09-12T22:33:13.720 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4051000000000003e-05 2024-09-12T22:33:13.720 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.720 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.720 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:13.720 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:10.063468+0000", 2024-09-12T22:33:13.721 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.7064000000000005e-05 2024-09-12T22:33:13.721 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.721 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.721 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:13.721 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:10.063544+0000", 2024-09-12T22:33:13.721 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5573000000000003e-05 2024-09-12T22:33:13.721 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.721 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.721 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:13.721 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:10.064028+0000", 2024-09-12T22:33:13.721 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00048376199999999999 2024-09-12T22:33:13.721 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.721 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.722 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:13.722 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:10.110333+0000", 2024-09-12T22:33:13.722 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.046305665000000003 2024-09-12T22:33:13.722 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.722 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.722 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:13.722 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:10.110375+0000", 2024-09-12T22:33:13.722 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1708000000000001e-05 2024-09-12T22:33:13.722 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.722 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.722 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:13.722 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:10.110408+0000", 2024-09-12T22:33:13.723 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3207000000000002e-05 2024-09-12T22:33:13.723 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:13.723 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:13.723 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:13.723 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.723 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.723 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4490.0:10452 4.1b 4:d88aa409:::10000002fdf.00000000:head [write 0~10135] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:33:13.723 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:10.064200+0000", 2024-09-12T22:33:13.723 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 3.5593017229999999, 2024-09-12T22:33:13.723 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.044458584000000002, 2024-09-12T22:33:13.723 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:13.723 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:13.723 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:13.724 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:13.724 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4490", 2024-09-12T22:33:13.724 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:13.724 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 10452 2024-09-12T22:33:13.724 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.724 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:13.724 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.724 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:13.724 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:10.064200+0000", 2024-09-12T22:33:13.724 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:13.724 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.724 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.725 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:13.725 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:10.064200+0000", 2024-09-12T22:33:13.725 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:13.725 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.725 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.725 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:13.725 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:10.064201+0000", 2024-09-12T22:33:13.725 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0550000000000001e-06 2024-09-12T22:33:13.725 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.725 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.725 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:13.725 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:10.064217+0000", 2024-09-12T22:33:13.725 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.5736e-05 2024-09-12T22:33:13.726 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.726 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.726 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:13.726 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:10.064232+0000", 2024-09-12T22:33:13.726 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4618e-05 2024-09-12T22:33:13.726 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.726 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.726 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:13.726 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:10.064241+0000", 2024-09-12T22:33:13.726 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.1870000000000003e-06 2024-09-12T22:33:13.727 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.727 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.727 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:13.727 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:10.064287+0000", 2024-09-12T22:33:13.727 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6099e-05 2024-09-12T22:33:13.727 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.727 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.727 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:13.727 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:10.064365+0000", 2024-09-12T22:33:13.727 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.7993999999999999e-05 2024-09-12T22:33:13.727 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.727 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.727 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:13.728 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:10.064442+0000", 2024-09-12T22:33:13.728 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6932000000000001e-05 2024-09-12T22:33:13.728 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.728 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.728 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:13.728 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:10.065033+0000", 2024-09-12T22:33:13.728 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00059116500000000005 2024-09-12T22:33:13.728 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.728 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.728 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:13.728 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:10.108573+0000", 2024-09-12T22:33:13.728 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.043539564000000003 2024-09-12T22:33:13.728 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.729 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.729 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:13.729 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:10.108621+0000", 2024-09-12T22:33:13.729 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8158999999999997e-05 2024-09-12T22:33:13.729 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.729 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.729 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:13.729 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:10.108659+0000", 2024-09-12T22:33:13.729 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8074999999999997e-05 2024-09-12T22:33:13.729 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:13.729 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:13.729 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:13.730 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.730 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.730 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4490.0:10455 4.3a 4:5e9e1ddd:::10000002fe2.00000000:head [write 0~320] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:33:13.730 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:10.066661+0000", 2024-09-12T22:33:13.730 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 3.5568410610000001, 2024-09-12T22:33:13.730 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.042802674999999998, 2024-09-12T22:33:13.730 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:13.730 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:13.730 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:13.730 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:13.730 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4490", 2024-09-12T22:33:13.730 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:13.730 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 10455 2024-09-12T22:33:13.731 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.731 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:13.731 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.731 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:13.731 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:10.066661+0000", 2024-09-12T22:33:13.731 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:13.731 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.731 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.731 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:13.731 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:10.066661+0000", 2024-09-12T22:33:13.731 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:13.731 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.731 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.731 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:13.732 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:10.066662+0000", 2024-09-12T22:33:13.732 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5799999999999998e-07 2024-09-12T22:33:13.732 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.732 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.732 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:13.732 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:10.066666+0000", 2024-09-12T22:33:13.732 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3490000000000002e-06 2024-09-12T22:33:13.732 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.732 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.732 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:13.732 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:10.066677+0000", 2024-09-12T22:33:13.732 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0611999999999999e-05 2024-09-12T22:33:13.732 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.732 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.733 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:13.733 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:10.066682+0000", 2024-09-12T22:33:13.733 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4099999999999999e-06 2024-09-12T22:33:13.733 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.733 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.733 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:13.733 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:10.066723+0000", 2024-09-12T22:33:13.733 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1325000000000002e-05 2024-09-12T22:33:13.733 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.733 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.733 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:13.733 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:10.066803+0000", 2024-09-12T22:33:13.733 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9414999999999998e-05 2024-09-12T22:33:13.734 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.734 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.734 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:13.734 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:10.066879+0000", 2024-09-12T22:33:13.734 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6192999999999994e-05 2024-09-12T22:33:13.734 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.734 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.734 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:13.734 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:10.067385+0000", 2024-09-12T22:33:13.734 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000506472 2024-09-12T22:33:13.734 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.734 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.734 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:13.735 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:10.109380+0000", 2024-09-12T22:33:13.735 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.041994612000000001 2024-09-12T22:33:13.735 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.735 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.735 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:13.735 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:10.109429+0000", 2024-09-12T22:33:13.735 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8896000000000001e-05 2024-09-12T22:33:13.735 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.735 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.735 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:13.735 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:10.109463+0000", 2024-09-12T22:33:13.735 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4533000000000003e-05 2024-09-12T22:33:13.735 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:13.736 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:13.736 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:13.736 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.736 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.736 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4490.0:10456 4.18 4:1a51b4e1:::10000002fe3.00000000:head [write 0~423] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:33:13.736 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:10.067372+0000", 2024-09-12T22:33:13.736 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 3.5561296549999999, 2024-09-12T22:33:13.736 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.043026702, 2024-09-12T22:33:13.736 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:13.736 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:13.736 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:13.736 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:13.736 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4490", 2024-09-12T22:33:13.737 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:13.737 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 10456 2024-09-12T22:33:13.737 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.737 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:13.737 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.737 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:13.737 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:10.067372+0000", 2024-09-12T22:33:13.737 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:13.737 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.737 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.737 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:13.737 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:10.067372+0000", 2024-09-12T22:33:13.737 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:13.738 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.738 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.738 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:13.738 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:10.067373+0000", 2024-09-12T22:33:13.738 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.0500000000000002e-07 2024-09-12T22:33:13.738 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.738 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.738 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:13.738 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:10.067378+0000", 2024-09-12T22:33:13.738 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2599999999999996e-06 2024-09-12T22:33:13.738 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.738 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.738 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:13.738 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:10.067389+0000", 2024-09-12T22:33:13.739 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0761000000000001e-05 2024-09-12T22:33:13.739 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.739 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.739 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:13.739 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:10.067398+0000", 2024-09-12T22:33:13.739 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.4409999999999993e-06 2024-09-12T22:33:13.739 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.739 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.739 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:13.739 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:10.067440+0000", 2024-09-12T22:33:13.739 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2378e-05 2024-09-12T22:33:13.739 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.739 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.739 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:13.740 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:10.067523+0000", 2024-09-12T22:33:13.740 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.2900999999999998e-05 2024-09-12T22:33:13.740 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.740 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.740 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:13.740 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:10.067604+0000", 2024-09-12T22:33:13.740 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0758000000000002e-05 2024-09-12T22:33:13.740 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.740 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.740 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:13.740 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:10.068064+0000", 2024-09-12T22:33:13.740 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00046060600000000001 2024-09-12T22:33:13.740 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.740 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.741 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:13.741 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:10.110321+0000", 2024-09-12T22:33:13.741 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.042257217 2024-09-12T22:33:13.741 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.741 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.741 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:13.741 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:10.110368+0000", 2024-09-12T22:33:13.741 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6329000000000003e-05 2024-09-12T22:33:13.741 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.741 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.741 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:13.741 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:10.110399+0000", 2024-09-12T22:33:13.741 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1146000000000003e-05 2024-09-12T22:33:13.742 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:13.742 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:13.742 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:13.742 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.742 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.742 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4490.0:11255 4.3c 4:3e92f261:::100000031f3.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-12T22:33:13.742 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:13.244819+0000", 2024-09-12T22:33:13.742 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.37868275600000001, 2024-09-12T22:33:13.742 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.038021423999999998, 2024-09-12T22:33:13.742 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:13.742 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:13.742 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:13.742 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:13.742 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4490", 2024-09-12T22:33:13.743 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:13.743 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 11255 2024-09-12T22:33:13.743 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.743 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:13.743 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.743 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:13.743 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:13.244819+0000", 2024-09-12T22:33:13.743 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:13.743 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.743 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.743 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:13.743 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:13.244819+0000", 2024-09-12T22:33:13.743 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:13.744 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.744 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.744 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:13.744 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:13.244821+0000", 2024-09-12T22:33:13.744 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.4440000000000001e-06 2024-09-12T22:33:13.744 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.744 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.744 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:13.744 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:13.250739+0000", 2024-09-12T22:33:13.744 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0059187049999999998 2024-09-12T22:33:13.744 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.744 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.744 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:13.745 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:13.250759+0000", 2024-09-12T22:33:13.745 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9885e-05 2024-09-12T22:33:13.745 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.745 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.745 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:13.745 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:13.250769+0000", 2024-09-12T22:33:13.745 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.6350000000000001e-06 2024-09-12T22:33:13.745 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.745 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.745 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:13.745 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:13.250821+0000", 2024-09-12T22:33:13.745 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2107000000000001e-05 2024-09-12T22:33:13.745 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.745 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.746 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:13.746 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:13.250890+0000", 2024-09-12T22:33:13.746 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9047999999999993e-05 2024-09-12T22:33:13.746 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.746 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.746 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:13.746 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:13.251009+0000", 2024-09-12T22:33:13.746 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011908000000000001 2024-09-12T22:33:13.746 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.746 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.746 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:13.746 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:13.256642+0000", 2024-09-12T22:33:13.746 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.005633234 2024-09-12T22:33:13.747 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.747 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.747 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:13.747 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:13.282779+0000", 2024-09-12T22:33:13.747 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.026136926000000001 2024-09-12T22:33:13.747 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.747 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.747 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:13.747 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:13.282815+0000", 2024-09-12T22:33:13.747 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6256e-05 2024-09-12T22:33:13.747 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.747 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.747 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:13.747 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:13.282841+0000", 2024-09-12T22:33:13.748 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5103999999999999e-05 2024-09-12T22:33:13.748 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:13.748 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:13.748 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:13.748 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.748 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.748 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4490.0:11328 4.39 4:9d207bac:::100000030d8.00000000:head [write 0~4194304 [2@352076]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-12T22:33:13.748 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:13.318187+0000", 2024-09-12T22:33:13.748 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.30531466800000001, 2024-09-12T22:33:13.748 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.037929084000000002, 2024-09-12T22:33:13.748 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:13.748 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:13.749 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:13.749 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:13.749 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4490", 2024-09-12T22:33:13.749 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:13.749 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 11328 2024-09-12T22:33:13.749 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.749 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:13.749 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.749 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:13.749 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:13.318187+0000", 2024-09-12T22:33:13.749 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:13.749 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.749 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.750 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:13.750 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:13.318187+0000", 2024-09-12T22:33:13.750 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:13.750 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.750 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.750 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:13.750 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:13.318188+0000", 2024-09-12T22:33:13.750 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.1200000000000002e-07 2024-09-12T22:33:13.750 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.750 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.750 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:13.750 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:13.325021+0000", 2024-09-12T22:33:13.750 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0068325160000000003 2024-09-12T22:33:13.750 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.751 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.751 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:13.751 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:13.325041+0000", 2024-09-12T22:33:13.751 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9998000000000001e-05 2024-09-12T22:33:13.751 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.751 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.751 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:13.751 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:13.325049+0000", 2024-09-12T22:33:13.751 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.8820000000000007e-06 2024-09-12T22:33:13.751 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.751 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.751 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:13.751 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:13.325127+0000", 2024-09-12T22:33:13.751 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.7620000000000006e-05 2024-09-12T22:33:13.752 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.752 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.752 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:13.752 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:13.325230+0000", 2024-09-12T22:33:13.752 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000102686 2024-09-12T22:33:13.752 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.752 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.752 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:13.752 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:13.325375+0000", 2024-09-12T22:33:13.752 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00014570300000000001 2024-09-12T22:33:13.752 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.752 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.752 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:13.752 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:13.332018+0000", 2024-09-12T22:33:13.753 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0066425420000000004 2024-09-12T22:33:13.753 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.753 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.753 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:13.753 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:13.356060+0000", 2024-09-12T22:33:13.753 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.024042424999999999 2024-09-12T22:33:13.753 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.753 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.753 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:13.753 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:13.356094+0000", 2024-09-12T22:33:13.753 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3785999999999998e-05 2024-09-12T22:33:13.753 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:13.757 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:13.757 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:13.757 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:13.356116+0000", 2024-09-12T22:33:13.757 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.2113999999999999e-05 2024-09-12T22:33:13.757 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:13.757 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:13.757 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:13.757 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:13.758 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:13.758 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-09-12T22:33:13.759 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:13.758+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:13.761 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:33:13.786 INFO:tasks.workunit.client.0.smithi019.stdout:0/274: write d1/d14/d26/d40/d45/f54 [966618,24668] 0 2024-09-12T22:33:13.786 INFO:tasks.workunit.client.0.smithi019.stdout:8/218: link d7/d8/df/f3b d7/d2f/f48 0 2024-09-12T22:33:13.787 INFO:tasks.workunit.client.0.smithi019.stdout:1/296: chown d3/d11/d16/d23/c37 106414 1 2024-09-12T22:33:13.787 INFO:tasks.workunit.client.0.smithi019.stdout:6/271: link d1b/d26/c33 d1b/d26/d31/c5a 0 2024-09-12T22:33:13.787 INFO:tasks.workunit.client.0.smithi019.stdout:1/297: symlink d3/d3f/d58/l65 0 2024-09-12T22:33:13.787 INFO:tasks.workunit.client.0.smithi019.stdout:8/219: creat d7/d2f/d42/f49 x:0 0 0 2024-09-12T22:33:13.787 INFO:tasks.workunit.client.0.smithi019.stdout:7/236: dwrite d6/db/f49 [0,4194304] 0 2024-09-12T22:33:13.787 INFO:tasks.workunit.client.0.smithi019.stdout:9/256: dwrite dd/f44 [0,4194304] 0 2024-09-12T22:33:13.787 INFO:tasks.workunit.client.0.smithi019.stdout:1/298: readlink d3/d11/d16/d23/l1e 0 2024-09-12T22:33:13.787 INFO:tasks.workunit.client.0.smithi019.stdout:7/237: symlink d6/d14/d27/l5b 0 2024-09-12T22:33:13.787 INFO:tasks.workunit.client.0.smithi019.stdout:6/272: dread - d1b/d26/d27/d3e/f49 zero size 2024-09-12T22:33:13.787 INFO:tasks.workunit.client.0.smithi019.stdout:7/238: mknod d6/db/c5c 0 2024-09-12T22:33:13.787 INFO:tasks.workunit.client.0.smithi019.stdout:8/220: link d7/d8/l24 d7/d8/dd/d45/l4a 0 2024-09-12T22:33:13.787 INFO:tasks.workunit.client.0.smithi019.stdout:1/299: creat d3/d11/d16/d3c/f66 x:0 0 0 2024-09-12T22:33:13.788 INFO:tasks.workunit.client.0.smithi019.stdout:7/239: link d6/d14/d15/f18 d6/d14/d45/f5d 0 2024-09-12T22:33:13.788 INFO:tasks.workunit.client.0.smithi019.stdout:6/273: link d1b/d2d/f42 d1b/d26/d27/f5b 0 2024-09-12T22:33:13.788 INFO:tasks.workunit.client.0.smithi019.stdout:0/275: dwrite d1/d14/d26/d40/f52 [0,4194304] 0 2024-09-12T22:33:13.788 INFO:tasks.workunit.client.0.smithi019.stdout:6/274: readlink d1b/l30 0 2024-09-12T22:33:13.788 INFO:tasks.workunit.client.0.smithi019.stdout:2/272: dread d0/f1f [0,4194304] 0 2024-09-12T22:33:13.788 INFO:tasks.workunit.client.0.smithi019.stdout:0/276: stat d1/d1d/l23 0 2024-09-12T22:33:13.788 INFO:tasks.workunit.client.0.smithi019.stdout:7/240: chown d6/d2d/d41/l51 292701 1 2024-09-12T22:33:13.788 INFO:tasks.workunit.client.0.smithi019.stdout:1/300: getdents d3/d11/d53 0 2024-09-12T22:33:13.788 INFO:tasks.workunit.client.0.smithi019.stdout:6/275: read d1b/d26/d39/f4a [3171512,108720] 0 2024-09-12T22:33:13.788 INFO:tasks.workunit.client.0.smithi019.stdout:4/242: sync 2024-09-12T22:33:13.788 INFO:tasks.workunit.client.0.smithi019.stdout:9/257: read dd/d10/d17/d23/f49 [152212,57522] 0 2024-09-12T22:33:13.788 INFO:tasks.workunit.client.0.smithi019.stdout:2/273: mkdir d0/d5/d18/d1b/d5d 0 2024-09-12T22:33:13.788 INFO:tasks.workunit.client.0.smithi019.stdout:0/277: creat d1/d1f/f57 x:0 0 0 2024-09-12T22:33:13.789 INFO:tasks.workunit.client.0.smithi019.stdout:6/276: creat d1b/d2d/d35/f5c x:0 0 0 2024-09-12T22:33:13.789 INFO:tasks.workunit.client.0.smithi019.stdout:1/301: chown d3/d11/d16/f38 7554533 1 2024-09-12T22:33:13.789 INFO:tasks.workunit.client.0.smithi019.stdout:2/274: mkdir d0/d5/d18/d1b/d5e 0 2024-09-12T22:33:13.789 INFO:tasks.workunit.client.0.smithi019.stdout:8/221: dwrite d7/d2f/d42/f49 [0,4194304] 0 2024-09-12T22:33:13.789 INFO:tasks.workunit.client.0.smithi019.stdout:9/258: symlink dd/d10/d17/d23/d2e/l56 0 2024-09-12T22:33:13.789 INFO:tasks.workunit.client.0.smithi019.stdout:4/243: dread d1/d22/f33 [0,4194304] 0 2024-09-12T22:33:13.789 INFO:tasks.workunit.client.0.smithi019.stdout:6/277: rename d1b/f59 to d1b/f5d 0 2024-09-12T22:33:13.789 INFO:tasks.workunit.client.0.smithi019.stdout:4/244: chown d1/d22/d2c 0 1 2024-09-12T22:33:13.789 INFO:tasks.workunit.client.0.smithi019.stdout:1/302: creat d3/d11/d53/f67 x:0 0 0 2024-09-12T22:33:13.789 INFO:tasks.workunit.client.0.smithi019.stdout:8/222: unlink d7/d8/dd/c18 0 2024-09-12T22:33:13.789 INFO:tasks.workunit.client.0.smithi019.stdout:7/241: dwrite d6/db/f3a [4194304,4194304] 0 2024-09-12T22:33:13.789 INFO:tasks.workunit.client.0.smithi019.stdout:6/278: mknod d1b/d26/c5e 0 2024-09-12T22:33:13.789 INFO:tasks.workunit.client.0.smithi019.stdout:2/275: creat d0/d5/d18/d3d/f5f x:0 0 0 2024-09-12T22:33:13.790 INFO:tasks.workunit.client.0.smithi019.stdout:0/278: getdents d1/d14/d26/d40 0 2024-09-12T22:33:13.790 INFO:tasks.workunit.client.0.smithi019.stdout:9/259: symlink dd/d10/d17/d23/d2e/l57 0 2024-09-12T22:33:13.790 INFO:tasks.workunit.client.0.smithi019.stdout:4/245: mkdir d1/d11/d15/d4e 0 2024-09-12T22:33:13.790 INFO:tasks.workunit.client.0.smithi019.stdout:0/279: unlink d1/f49 0 2024-09-12T22:33:13.790 INFO:tasks.workunit.client.0.smithi019.stdout:8/223: rename d7/fa to d7/d8/d32/f4b 0 2024-09-12T22:33:13.790 INFO:tasks.workunit.client.0.smithi019.stdout:7/242: creat d6/d14/d15/f5e x:0 0 0 2024-09-12T22:33:13.790 INFO:tasks.workunit.client.0.smithi019.stdout:2/276: mkdir d0/d5/d60 0 2024-09-12T22:33:13.790 INFO:tasks.workunit.client.0.smithi019.stdout:9/260: read dd/d10/d17/d23/f2d [7966889,69186] 0 2024-09-12T22:33:13.790 INFO:tasks.workunit.client.0.smithi019.stdout:3/207: dread f2 [0,4194304] 0 2024-09-12T22:33:13.790 INFO:tasks.workunit.client.0.smithi019.stdout:3/208: fsync f2 0 2024-09-12T22:33:13.790 INFO:tasks.workunit.client.0.smithi019.stdout:0/280: fsync d1/f1a 0 2024-09-12T22:33:13.790 INFO:tasks.workunit.client.0.smithi019.stdout:3/209: truncate dd/f44 72291 0 2024-09-12T22:33:13.790 INFO:tasks.workunit.client.0.smithi019.stdout:0/281: write d1/d1d/f2f [399720,115751] 0 2024-09-12T22:33:13.791 INFO:tasks.workunit.client.0.smithi019.stdout:3/210: truncate dd/f2a 645752 0 2024-09-12T22:33:13.791 INFO:tasks.workunit.client.0.smithi019.stdout:4/246: dread d1/d4/f2a [0,4194304] 0 2024-09-12T22:33:13.791 INFO:tasks.workunit.client.0.smithi019.stdout:0/282: truncate d1/f1a 1653469 0 2024-09-12T22:33:13.791 INFO:tasks.workunit.client.0.smithi019.stdout:4/247: mkdir d1/d22/d31/d4f 0 2024-09-12T22:33:13.791 INFO:tasks.workunit.client.0.smithi019.stdout:9/261: dwrite dd/d10/f14 [0,4194304] 0 2024-09-12T22:33:13.791 INFO:tasks.workunit.client.0.smithi019.stdout:6/279: getdents d1b 0 2024-09-12T22:33:13.791 INFO:tasks.workunit.client.0.smithi019.stdout:9/262: chown dd 275982634 1 2024-09-12T22:33:13.791 INFO:tasks.workunit.client.0.smithi019.stdout:1/303: dread d3/df/f48 [0,4194304] 0 2024-09-12T22:33:13.791 INFO:tasks.workunit.client.0.smithi019.stdout:2/277: dwrite d0/d5/d18/d3b/f49 [0,4194304] 0 2024-09-12T22:33:13.791 INFO:tasks.workunit.client.0.smithi019.stdout:3/211: truncate dd/d12/f35 1679160 0 2024-09-12T22:33:13.791 INFO:tasks.workunit.client.0.smithi019.stdout:4/248: truncate d1/d8/fb 5497256 0 2024-09-12T22:33:13.791 INFO:tasks.workunit.client.0.smithi019.stdout:2/278: write d0/d5/d18/d39/f44 [284542,23983] 0 2024-09-12T22:33:13.792 INFO:tasks.workunit.client.0.smithi019.stdout:6/280: mkdir d1b/d26/d31/d5f 0 2024-09-12T22:33:13.792 INFO:tasks.workunit.client.0.smithi019.stdout:9/263: rename dd to dd/d10/d17/d23/d2e/d58 22 2024-09-12T22:33:13.792 INFO:tasks.workunit.client.0.smithi019.stdout:1/304: link d3/d11/f35 d3/d1b/f68 0 2024-09-12T22:33:13.792 INFO:tasks.workunit.client.0.smithi019.stdout:0/283: getdents d1/d14/d26/d40 0 2024-09-12T22:33:13.792 INFO:tasks.workunit.client.0.smithi019.stdout:4/249: dread - d1/d11/d15/f2b zero size 2024-09-12T22:33:13.792 INFO:tasks.workunit.client.0.smithi019.stdout:9/264: chown dd/d10/d17 153 1 2024-09-12T22:33:13.792 INFO:tasks.workunit.client.0.smithi019.stdout:1/305: fdatasync d3/df/f41 0 2024-09-12T22:33:13.792 INFO:tasks.workunit.client.0.smithi019.stdout:3/212: link f2 dd/f46 0 2024-09-12T22:33:13.792 INFO:tasks.workunit.client.0.smithi019.stdout:2/279: write d0/d5/f10 [5926018,79363] 0 2024-09-12T22:33:13.792 INFO:tasks.workunit.client.0.smithi019.stdout:6/281: creat d1b/d2d/d35/f60 x:0 0 0 2024-09-12T22:33:13.792 INFO:tasks.workunit.client.0.smithi019.stdout:9/265: rmdir dd/d10/d17 39 2024-09-12T22:33:13.792 INFO:tasks.workunit.client.0.smithi019.stdout:4/250: write d1/d11/f23 [743915,47496] 0 2024-09-12T22:33:13.792 INFO:tasks.workunit.client.0.smithi019.stdout:3/213: fdatasync dd/f28 0 2024-09-12T22:33:13.793 INFO:tasks.workunit.client.0.smithi019.stdout:0/284: rename d1/d1d/l55 to d1/d14/d26/d40/l58 0 2024-09-12T22:33:13.793 INFO:tasks.workunit.client.0.smithi019.stdout:1/306: read - d3/d11/d16/d3c/d55/f62 zero size 2024-09-12T22:33:13.793 INFO:tasks.workunit.client.0.smithi019.stdout:1/307: sync 2024-09-12T22:33:13.793 INFO:tasks.workunit.client.0.smithi019.stdout:1/308: chown d3/d11/c4c 0 1 2024-09-12T22:33:13.793 INFO:tasks.workunit.client.0.smithi019.stdout:0/285: unlink d1/c28 0 2024-09-12T22:33:13.793 INFO:tasks.workunit.client.0.smithi019.stdout:6/282: rename d1b/d26/d27/d47 to d1b/d2d/d35/d61 0 2024-09-12T22:33:13.793 INFO:tasks.workunit.client.0.smithi019.stdout:4/251: mknod d1/d11/d15/d1f/c50 0 2024-09-12T22:33:13.793 INFO:tasks.workunit.client.0.smithi019.stdout:8/224: link d7/d2f/f48 d7/d8/f4c 0 2024-09-12T22:33:13.793 INFO:tasks.workunit.client.0.smithi019.stdout:3/214: write dd/d1e/f34 [388174,25340] 0 2024-09-12T22:33:13.793 INFO:tasks.workunit.client.0.smithi019.stdout:0/286: write d1/d1f/f57 [232380,58350] 0 2024-09-12T22:33:13.793 INFO:tasks.workunit.client.0.smithi019.stdout:7/243: dwrite d6/d2d/d41/f56 [0,4194304] 0 2024-09-12T22:33:13.793 INFO:tasks.workunit.client.0.smithi019.stdout:1/309: write d3/f9 [10929714,41546] 0 2024-09-12T22:33:13.793 INFO:tasks.workunit.client.0.smithi019.stdout:0/287: stat d1/d14/d32/l4f 0 2024-09-12T22:33:13.794 INFO:tasks.workunit.client.0.smithi019.stdout:6/283: truncate d1b/f45 3055088 0 2024-09-12T22:33:13.794 INFO:tasks.workunit.client.0.smithi019.stdout:5/393: dread d0/d7/d16/d18/f19 [0,4194304] 0 2024-09-12T22:33:13.794 INFO:tasks.workunit.client.0.smithi019.stdout:9/266: getdents dd/d10/d17 0 2024-09-12T22:33:13.794 INFO:tasks.workunit.client.0.smithi019.stdout:1/310: creat d3/f69 x:0 0 0 2024-09-12T22:33:13.794 INFO:tasks.workunit.client.0.smithi019.stdout:4/252: dread d1/d22/d2c/f40 [0,4194304] 0 2024-09-12T22:33:13.794 INFO:tasks.workunit.client.0.smithi019.stdout:5/394: stat d0/d7/d16 0 2024-09-12T22:33:13.794 INFO:tasks.workunit.client.0.smithi019.stdout:2/280: dwrite d0/d5/d18/f20 [0,4194304] 0 2024-09-12T22:33:13.794 INFO:tasks.workunit.client.0.smithi019.stdout:9/267: mknod dd/c59 0 2024-09-12T22:33:13.794 INFO:tasks.workunit.client.0.smithi019.stdout:6/284: creat d1b/d2d/d35/d61/f62 x:0 0 0 2024-09-12T22:33:13.794 INFO:tasks.workunit.client.0.smithi019.stdout:4/253: write d1/f25 [1182731,99167] 0 2024-09-12T22:33:13.794 INFO:tasks.workunit.client.0.smithi019.stdout:2/281: fdatasync d0/d5/f26 0 2024-09-12T22:33:13.794 INFO:tasks.workunit.client.0.smithi019.stdout:6/285: chown cf 21 1 2024-09-12T22:33:13.794 INFO:tasks.workunit.client.0.smithi019.stdout:0/288: link d1/d1f/l2d d1/d51/l59 0 2024-09-12T22:33:13.795 INFO:tasks.workunit.client.0.smithi019.stdout:1/311: truncate d3/d11/d16/d23/d54/f61 374486 0 2024-09-12T22:33:13.795 INFO:tasks.workunit.client.0.smithi019.stdout:7/244: dread d6/db/f1c [4194304,4194304] 0 2024-09-12T22:33:13.795 INFO:tasks.workunit.client.0.smithi019.stdout:5/395: creat d0/dc/f84 x:0 0 0 2024-09-12T22:33:13.795 INFO:tasks.workunit.client.0.smithi019.stdout:0/289: readlink d1/d14/d26/d40/l58 0 2024-09-12T22:33:13.795 INFO:tasks.workunit.client.0.smithi019.stdout:4/254: link d1/d22/d2c/c42 d1/c51 0 2024-09-12T22:33:13.795 INFO:tasks.workunit.client.0.smithi019.stdout:1/312: mknod d3/d11/d16/d3c/c6a 0 2024-09-12T22:33:13.795 INFO:tasks.workunit.client.0.smithi019.stdout:5/396: read d0/f23 [187232,109713] 0 2024-09-12T22:33:13.795 INFO:tasks.workunit.client.0.smithi019.stdout:4/255: read d1/d11/d15/f2e [1226007,94051] 0 2024-09-12T22:33:13.795 INFO:tasks.workunit.client.0.smithi019.stdout:7/245: getdents d6/d14/d27/d4b 0 2024-09-12T22:33:13.795 INFO:tasks.workunit.client.0.smithi019.stdout:5/397: dread - d0/d7/d2d/f61 zero size 2024-09-12T22:33:13.795 INFO:tasks.workunit.client.0.smithi019.stdout:1/313: mknod d3/d3f/d58/c6b 0 2024-09-12T22:33:13.795 INFO:tasks.workunit.client.0.smithi019.stdout:4/256: chown d1/d8/l1e 7 1 2024-09-12T22:33:13.795 INFO:tasks.workunit.client.0.smithi019.stdout:7/246: link d6/db/f3a d6/f5f 0 2024-09-12T22:33:13.795 INFO:tasks.workunit.client.0.smithi019.stdout:1/314: dread - d3/d11/d53/f5b zero size 2024-09-12T22:33:13.796 INFO:tasks.workunit.client.0.smithi019.stdout:2/282: dwrite d0/d5/d18/f20 [0,4194304] 0 2024-09-12T22:33:13.796 INFO:tasks.workunit.client.0.smithi019.stdout:7/247: chown d6/d14/d15/l25 189 1 2024-09-12T22:33:13.796 INFO:tasks.workunit.client.0.smithi019.stdout:3/215: truncate dd/d12/f15 2529536 0 2024-09-12T22:33:13.796 INFO:tasks.workunit.client.0.smithi019.stdout:8/225: truncate d7/f2c 2291987 0 2024-09-12T22:33:13.796 INFO:tasks.workunit.client.0.smithi019.stdout:1/315: creat d3/d11/d16/d23/f6c x:0 0 0 2024-09-12T22:33:13.796 INFO:tasks.workunit.client.0.smithi019.stdout:7/248: fsync d6/db/d42/f59 0 2024-09-12T22:33:13.796 INFO:tasks.workunit.client.0.smithi019.stdout:9/268: chown dd/d10 267 1 2024-09-12T22:33:13.796 INFO:tasks.workunit.client.0.smithi019.stdout:5/398: link d0/d7/d16/d69/l6b d0/d7/d16/d18/l85 0 2024-09-12T22:33:13.796 INFO:tasks.workunit.client.0.smithi019.stdout:3/216: truncate f5 651254 0 2024-09-12T22:33:13.796 INFO:tasks.workunit.client.0.smithi019.stdout:7/249: rmdir d6 39 2024-09-12T22:33:13.796 INFO:tasks.workunit.client.0.smithi019.stdout:8/226: symlink d7/d8/df/d2d/l4d 0 2024-09-12T22:33:13.796 INFO:tasks.workunit.client.0.smithi019.stdout:9/269: unlink dd/d10/d17/d23/f2a 0 2024-09-12T22:33:13.796 INFO:tasks.workunit.client.0.smithi019.stdout:8/227: truncate d7/d8/f2e 572876 0 2024-09-12T22:33:13.797 INFO:tasks.workunit.client.0.smithi019.stdout:7/250: fsync d6/f5f 0 2024-09-12T22:33:13.797 INFO:tasks.workunit.client.0.smithi019.stdout:6/286: dwrite d1b/d26/d27/d3e/f49 [0,4194304] 0 2024-09-12T22:33:13.797 INFO:tasks.workunit.client.0.smithi019.stdout:2/283: dread d0/da/f37 [0,4194304] 0 2024-09-12T22:33:13.797 INFO:tasks.workunit.client.0.smithi019.stdout:4/257: dwrite d1/d4/f2a [0,4194304] 0 2024-09-12T22:33:13.797 INFO:tasks.workunit.client.0.smithi019.stdout:9/270: creat dd/d10/d17/d23/d37/f5a x:0 0 0 2024-09-12T22:33:13.797 INFO:tasks.workunit.client.0.smithi019.stdout:6/287: write d1b/d2d/f32 [2069309,109449] 0 2024-09-12T22:33:13.797 INFO:tasks.workunit.client.0.smithi019.stdout:2/284: read d0/d5/d18/d3b/f49 [1169412,38690] 0 2024-09-12T22:33:13.797 INFO:tasks.workunit.client.0.smithi019.stdout:5/399: link d0/dc/f74 d0/d7/d16/d18/f86 0 2024-09-12T22:33:13.797 INFO:tasks.workunit.client.0.smithi019.stdout:9/271: creat dd/d10/d17/d23/d37/f5b x:0 0 0 2024-09-12T22:33:13.797 INFO:tasks.workunit.client.0.smithi019.stdout:7/251: link d6/f21 d6/d2d/f60 0 2024-09-12T22:33:13.797 INFO:tasks.workunit.client.0.smithi019.stdout:5/400: unlink d0/d7/f2e 0 2024-09-12T22:33:13.797 INFO:tasks.workunit.client.0.smithi019.stdout:9/272: chown dd/d10/d17/f24 133 1 2024-09-12T22:33:13.797 INFO:tasks.workunit.client.0.smithi019.stdout:3/217: truncate dd/d12/f24 3239454 0 2024-09-12T22:33:13.797 INFO:tasks.workunit.client.0.smithi019.stdout:4/258: getdents d1/d11/d15 0 2024-09-12T22:33:13.798 INFO:tasks.workunit.client.0.smithi019.stdout:7/252: fsync d6/f21 0 2024-09-12T22:33:13.798 INFO:tasks.workunit.client.0.smithi019.stdout:1/316: dread d3/d11/d16/f45 [0,4194304] 0 2024-09-12T22:33:13.798 INFO:tasks.workunit.client.0.smithi019.stdout:5/401: mkdir d0/d7/d2d/d4c/d87 0 2024-09-12T22:33:13.798 INFO:tasks.workunit.client.0.smithi019.stdout:3/218: write dd/d12/f29 [623719,120778] 0 2024-09-12T22:33:13.798 INFO:tasks.workunit.client.0.smithi019.stdout:1/317: creat d3/d11/d53/f6d x:0 0 0 2024-09-12T22:33:13.798 INFO:tasks.workunit.client.0.smithi019.stdout:2/285: dread d0/d5/d18/f20 [0,4194304] 0 2024-09-12T22:33:13.798 INFO:tasks.workunit.client.0.smithi019.stdout:8/228: dread d7/f19 [0,4194304] 0 2024-09-12T22:33:13.798 INFO:tasks.workunit.client.0.smithi019.stdout:5/402: symlink d0/dc/d24/l88 0 2024-09-12T22:33:13.798 INFO:tasks.workunit.client.0.smithi019.stdout:3/219: truncate dd/f44 867004 0 2024-09-12T22:33:13.798 INFO:tasks.workunit.client.0.smithi019.stdout:9/273: rename dd/d10/d17/d23/d37/f43 to dd/d10/d17/d23/d52/d53/f5c 0 2024-09-12T22:33:13.798 INFO:tasks.workunit.client.0.smithi019.stdout:5/403: sync 2024-09-12T22:33:13.798 INFO:tasks.workunit.client.0.smithi019.stdout:2/286: stat d0/d41 0 2024-09-12T22:33:13.798 INFO:tasks.workunit.client.0.smithi019.stdout:1/318: fsync d3/df/f48 0 2024-09-12T22:33:13.799 INFO:tasks.workunit.client.0.smithi019.stdout:3/220: creat dd/d1e/d40/f47 x:0 0 0 2024-09-12T22:33:13.799 INFO:tasks.workunit.client.0.smithi019.stdout:7/253: getdents d6/d14/d15/d23 0 2024-09-12T22:33:13.799 INFO:tasks.workunit.client.0.smithi019.stdout:8/229: write d7/d8/df/f33 [2667,64060] 0 2024-09-12T22:33:13.799 INFO:tasks.workunit.client.0.smithi019.stdout:5/404: chown d0/dc/d24/l31 26 1 2024-09-12T22:33:13.799 INFO:tasks.workunit.client.0.smithi019.stdout:4/259: dread d1/d22/d26/f43 [0,4194304] 0 2024-09-12T22:33:13.799 INFO:tasks.workunit.client.0.smithi019.stdout:9/274: mknod dd/d10/d17/d22/d42/c5d 0 2024-09-12T22:33:13.799 INFO:tasks.workunit.client.0.smithi019.stdout:3/221: write dd/f46 [7791938,73494] 0 2024-09-12T22:33:13.799 INFO:tasks.workunit.client.0.smithi019.stdout:2/287: link d0/d5/d18/d3b/f3f d0/d5/d18/d3d/f61 0 2024-09-12T22:33:13.799 INFO:tasks.workunit.client.0.smithi019.stdout:5/405: stat d0/dc/d39/f63 0 2024-09-12T22:33:13.799 INFO:tasks.workunit.client.0.smithi019.stdout:7/254: creat d6/db/d42/f61 x:0 0 0 2024-09-12T22:33:13.799 INFO:tasks.workunit.client.0.smithi019.stdout:1/319: getdents d3/df 0 2024-09-12T22:33:13.799 INFO:tasks.workunit.client.0.smithi019.stdout:8/230: chown d7/d8/df/d2d/l4d 497661 1 2024-09-12T22:33:13.800 INFO:tasks.workunit.client.0.smithi019.stdout:7/255: mkdir d6/d14/d15/d62 0 2024-09-12T22:33:13.800 INFO:tasks.workunit.client.0.smithi019.stdout:9/275: write dd/d10/d17/d23/f2d [5284230,85031] 0 2024-09-12T22:33:13.800 INFO:tasks.workunit.client.0.smithi019.stdout:1/320: mkdir d3/d6e 0 2024-09-12T22:33:13.800 INFO:tasks.workunit.client.0.smithi019.stdout:8/231: write d7/d8/dd/f2a [752825,113626] 0 2024-09-12T22:33:13.800 INFO:tasks.workunit.client.0.smithi019.stdout:5/406: mknod d0/d7/d2d/d4c/d87/c89 0 2024-09-12T22:33:13.800 INFO:tasks.workunit.client.0.smithi019.stdout:2/288: creat d0/d5/d18/d1b/d5e/f62 x:0 0 0 2024-09-12T22:33:13.800 INFO:tasks.workunit.client.0.smithi019.stdout:1/321: write d3/d1b/f26 [2346061,3617] 0 2024-09-12T22:33:13.800 INFO:tasks.workunit.client.0.smithi019.stdout:7/256: rename d6/d14/d27 to d6/db/dc/d63 0 2024-09-12T22:33:13.800 INFO:tasks.workunit.client.0.smithi019.stdout:3/222: dwrite f2 [8388608,4194304] 0 2024-09-12T22:33:13.800 INFO:tasks.workunit.client.0.smithi019.stdout:9/276: truncate dd/f1f 659157 0 2024-09-12T22:33:13.800 INFO:tasks.workunit.client.0.smithi019.stdout:1/322: creat d3/d3f/d58/f6f x:0 0 0 2024-09-12T22:33:13.800 INFO:tasks.workunit.client.0.smithi019.stdout:4/260: dwrite d1/d8/f20 [0,4194304] 0 2024-09-12T22:33:13.800 INFO:tasks.workunit.client.0.smithi019.stdout:5/407: rename d0/dc/d39/d38/l3a to d0/d7/d16/l8a 0 2024-09-12T22:33:13.801 INFO:tasks.workunit.client.0.smithi019.stdout:5/408: unlink d0/d7/d2d/d32/d36/l3b 0 2024-09-12T22:33:13.801 INFO:tasks.workunit.client.0.smithi019.stdout:9/277: mknod dd/d10/d17/d23/d2e/d31/d54/c5e 0 2024-09-12T22:33:13.801 INFO:tasks.workunit.client.0.smithi019.stdout:2/289: rename d0/d5/d18/d1b/d5e to d0/d5/d18/d5c/d63 0 2024-09-12T22:33:13.801 INFO:tasks.workunit.client.0.smithi019.stdout:1/323: creat d3/d11/d16/d3c/f70 x:0 0 0 2024-09-12T22:33:13.801 INFO:tasks.workunit.client.0.smithi019.stdout:4/261: truncate d1/d4/f13 338721 0 2024-09-12T22:33:13.801 INFO:tasks.workunit.client.0.smithi019.stdout:2/290: symlink d0/d41/l64 0 2024-09-12T22:33:13.801 INFO:tasks.workunit.client.0.smithi019.stdout:0/290: dread d1/d14/d32/f43 [0,4194304] 0 2024-09-12T22:33:13.801 INFO:tasks.workunit.client.0.smithi019.stdout:7/257: rename d6/d2d/f60 to d6/f64 0 2024-09-12T22:33:13.801 INFO:tasks.workunit.client.0.smithi019.stdout:9/278: mknod dd/d10/d17/d23/d2e/d31/d3f/d47/c5f 0 2024-09-12T22:33:13.801 INFO:tasks.workunit.client.0.smithi019.stdout:5/409: creat d0/dc/d39/d38/d4b/f8b x:0 0 0 2024-09-12T22:33:13.801 INFO:tasks.workunit.client.0.smithi019.stdout:3/223: dwrite dd/f31 [0,4194304] 0 2024-09-12T22:33:13.801 INFO:tasks.workunit.client.0.smithi019.stdout:2/291: creat d0/d5/d18/d39/f65 x:0 0 0 2024-09-12T22:33:13.802 INFO:tasks.workunit.client.0.smithi019.stdout:9/279: truncate dd/f18 5201001 0 2024-09-12T22:33:13.802 INFO:tasks.workunit.client.0.smithi019.stdout:7/258: chown d6/db/dc/d63/d4b/l57 328978076 1 2024-09-12T22:33:13.802 INFO:tasks.workunit.client.0.smithi019.stdout:0/291: fdatasync d1/f1a 0 2024-09-12T22:33:13.802 INFO:tasks.workunit.client.0.smithi019.stdout:8/232: dwrite d7/d8/f4c [0,4194304] 0 2024-09-12T22:33:13.802 INFO:tasks.workunit.client.0.smithi019.stdout:0/292: readlink d1/d14/d32/l4f 0 2024-09-12T22:33:13.802 INFO:tasks.workunit.client.0.smithi019.stdout:2/292: readlink d0/l23 0 2024-09-12T22:33:13.802 INFO:tasks.workunit.client.0.smithi019.stdout:8/233: chown d7/d8/dd/f1c 4 1 2024-09-12T22:33:13.802 INFO:tasks.workunit.client.0.smithi019.stdout:1/324: truncate d3/d11/d16/f3b 3157925 0 2024-09-12T22:33:13.802 INFO:tasks.workunit.client.0.smithi019.stdout:0/293: readlink d1/d14/d32/l4f 0 2024-09-12T22:33:13.802 INFO:tasks.workunit.client.0.smithi019.stdout:3/224: getdents dd 0 2024-09-12T22:33:13.802 INFO:tasks.workunit.client.0.smithi019.stdout:1/325: chown d3/df/f41 519712460 1 2024-09-12T22:33:13.802 INFO:tasks.workunit.client.0.smithi019.stdout:2/293: mknod d0/d5/d17/c66 0 2024-09-12T22:33:13.802 INFO:tasks.workunit.client.0.smithi019.stdout:9/280: write dd/d10/d17/d22/d42/f55 [1178779,102872] 0 2024-09-12T22:33:13.802 INFO:tasks.workunit.client.0.smithi019.stdout:1/326: chown d3/d3f/d58/c6b 1 1 2024-09-12T22:33:13.803 INFO:tasks.workunit.client.0.smithi019.stdout:5/410: mkdir d0/d7/d2d/d32/d36/d8c 0 2024-09-12T22:33:13.803 INFO:tasks.workunit.client.0.smithi019.stdout:2/294: mkdir d0/d5/d18/d5c/d67 0 2024-09-12T22:33:13.803 INFO:tasks.workunit.client.0.smithi019.stdout:1/327: chown d3/d3f/f2d 75486 1 2024-09-12T22:33:13.803 INFO:tasks.workunit.client.0.smithi019.stdout:9/281: symlink dd/d10/d17/d23/d2e/d31/d3f/d47/l60 0 2024-09-12T22:33:13.803 INFO:tasks.workunit.client.0.smithi019.stdout:3/225: creat dd/d12/f48 x:0 0 0 2024-09-12T22:33:13.803 INFO:tasks.workunit.client.0.smithi019.stdout:5/411: symlink d0/d7/d16/l8d 0 2024-09-12T22:33:13.803 INFO:tasks.workunit.client.0.smithi019.stdout:0/294: read d1/d1f/f33 [1544736,50170] 0 2024-09-12T22:33:13.803 INFO:tasks.workunit.client.0.smithi019.stdout:8/234: link d7/d8/dd/d45/l4a d7/d8/df/l4e 0 2024-09-12T22:33:13.803 INFO:tasks.workunit.client.0.smithi019.stdout:1/328: rmdir d3/d11/d16 39 2024-09-12T22:33:13.803 INFO:tasks.workunit.client.0.smithi019.stdout:1/329: chown d3/l29 4 1 2024-09-12T22:33:13.803 INFO:tasks.workunit.client.0.smithi019.stdout:5/412: fdatasync d0/dc/d39/d38/f5c 0 2024-09-12T22:33:13.803 INFO:tasks.workunit.client.0.smithi019.stdout:9/282: truncate dd/f1f 443681 0 2024-09-12T22:33:13.803 INFO:tasks.workunit.client.0.smithi019.stdout:0/295: creat d1/d14/d32/d3d/f5a x:0 0 0 2024-09-12T22:33:13.804 INFO:tasks.workunit.client.0.smithi019.stdout:8/235: rename d7/d8/d32 to d7/d8/dd/d4f 0 2024-09-12T22:33:13.804 INFO:tasks.workunit.client.0.smithi019.stdout:1/330: chown d3/df/l43 52 1 2024-09-12T22:33:13.804 INFO:tasks.workunit.client.0.smithi019.stdout:9/283: unlink dd/f44 0 2024-09-12T22:33:13.804 INFO:tasks.workunit.client.0.smithi019.stdout:9/284: chown dd 784 1 2024-09-12T22:33:13.804 INFO:tasks.workunit.client.0.smithi019.stdout:0/296: dread - d1/d14/d1b/f4b zero size 2024-09-12T22:33:13.804 INFO:tasks.workunit.client.0.smithi019.stdout:8/236: rename d7/l9 to d7/d8/dd/d45/l50 0 2024-09-12T22:33:13.804 INFO:tasks.workunit.client.0.smithi019.stdout:1/331: write d3/d11/f36 [866386,55795] 0 2024-09-12T22:33:13.804 INFO:tasks.workunit.client.0.smithi019.stdout:0/297: dread - d1/d14/d32/d3d/f53 zero size 2024-09-12T22:33:13.804 INFO:tasks.workunit.client.0.smithi019.stdout:9/285: read dd/d10/d17/d23/f49 [885416,68127] 0 2024-09-12T22:33:13.804 INFO:tasks.workunit.client.0.smithi019.stdout:5/413: dwrite d0/f37 [0,4194304] 0 2024-09-12T22:33:13.804 INFO:tasks.workunit.client.0.smithi019.stdout:0/298: truncate d1/f4d 191847 0 2024-09-12T22:33:13.804 INFO:tasks.workunit.client.0.smithi019.stdout:8/237: write d7/fc [2917990,130109] 0 2024-09-12T22:33:13.804 INFO:tasks.workunit.client.0.smithi019.stdout:9/286: write dd/d10/d17/d23/f49 [1857664,56712] 0 2024-09-12T22:33:13.804 INFO:tasks.workunit.client.0.smithi019.stdout:0/299: chown d1/d1f/l4c 195 1 2024-09-12T22:33:13.805 INFO:tasks.workunit.client.0.smithi019.stdout:5/414: truncate d0/d7/d16/f7a 923204 0 2024-09-12T22:33:13.805 INFO:tasks.workunit.client.0.smithi019.stdout:1/332: truncate d3/d1b/f26 6895893 0 2024-09-12T22:33:13.805 INFO:tasks.workunit.client.0.smithi019.stdout:8/238: creat d7/d34/f51 x:0 0 0 2024-09-12T22:33:13.805 INFO:tasks.workunit.client.0.smithi019.stdout:8/239: creat d7/d34/f52 x:0 0 0 2024-09-12T22:33:13.805 INFO:tasks.workunit.client.0.smithi019.stdout:5/415: chown d0/dc/d39/d38/d4b/l65 239 1 2024-09-12T22:33:13.805 INFO:tasks.workunit.client.0.smithi019.stdout:1/333: write d3/d11/d16/f60 [928729,121027] 0 2024-09-12T22:33:13.805 INFO:tasks.workunit.client.0.smithi019.stdout:5/416: getdents d0/d7/d16 0 2024-09-12T22:33:13.805 INFO:tasks.workunit.client.0.smithi019.stdout:6/288: dread d1b/f3c [0,4194304] 0 2024-09-12T22:33:13.805 INFO:tasks.workunit.client.0.smithi019.stdout:0/300: dwrite d1/d14/f17 [4194304,4194304] 0 2024-09-12T22:33:13.805 INFO:tasks.workunit.client.0.smithi019.stdout:8/240: dwrite d7/fc [0,4194304] 0 2024-09-12T22:33:13.805 INFO:tasks.workunit.client.0.smithi019.stdout:5/417: rename d0/d7/d2d/d32/l58 to d0/d7/d2d/d32/d36/l8e 0 2024-09-12T22:33:13.805 INFO:tasks.workunit.client.0.smithi019.stdout:4/262: sync 2024-09-12T22:33:13.805 INFO:tasks.workunit.client.0.smithi019.stdout:1/334: dwrite d3/d11/d53/f67 [0,4194304] 0 2024-09-12T22:33:13.805 INFO:tasks.workunit.client.0.smithi019.stdout:8/241: unlink d7/d2f/f48 0 2024-09-12T22:33:13.806 INFO:tasks.workunit.client.0.smithi019.stdout:0/301: mkdir d1/d1f/d5b 0 2024-09-12T22:33:13.806 INFO:tasks.workunit.client.0.smithi019.stdout:1/335: creat d3/d11/d16/d23/f71 x:0 0 0 2024-09-12T22:33:13.806 INFO:tasks.workunit.client.0.smithi019.stdout:6/289: link d1b/d26/c33 d1b/d26/d31/d5f/c63 0 2024-09-12T22:33:13.806 INFO:tasks.workunit.client.0.smithi019.stdout:6/290: creat d1b/d26/d27/d3e/f64 x:0 0 0 2024-09-12T22:33:13.806 INFO:tasks.workunit.client.0.smithi019.stdout:6/291: write d1b/d2d/d35/f5c [854446,100765] 0 2024-09-12T22:33:13.806 INFO:tasks.workunit.client.0.smithi019.stdout:4/263: truncate d1/d4/d38/f3b 2021181 0 2024-09-12T22:33:13.806 INFO:tasks.workunit.client.0.smithi019.stdout:8/242: dread d7/fc [0,4194304] 0 2024-09-12T22:33:13.806 INFO:tasks.workunit.client.0.smithi019.stdout:5/418: dread d0/dc/d39/d38/f62 [0,4194304] 0 2024-09-12T22:33:13.806 INFO:tasks.workunit.client.0.smithi019.stdout:6/292: write d1b/d26/d27/f54 [4683563,92956] 0 2024-09-12T22:33:13.806 INFO:tasks.workunit.client.0.smithi019.stdout:5/419: chown d0/d7/d16/d69 222579441 1 2024-09-12T22:33:13.806 INFO:tasks.workunit.client.0.smithi019.stdout:4/264: rename d1/d11/d15/f18 to d1/d11/d15/d1f/f52 0 2024-09-12T22:33:13.806 INFO:tasks.workunit.client.0.smithi019.stdout:6/293: write d1b/d26/d31/f4e [817948,105543] 0 2024-09-12T22:33:13.806 INFO:tasks.workunit.client.0.smithi019.stdout:8/243: mkdir d7/d8/df/d53 0 2024-09-12T22:33:13.806 INFO:tasks.workunit.client.0.smithi019.stdout:6/294: creat d1b/d26/d39/f65 x:0 0 0 2024-09-12T22:33:13.807 INFO:tasks.workunit.client.0.smithi019.stdout:4/265: getdents d1/d22/d31/d4f 0 2024-09-12T22:33:13.807 INFO:tasks.workunit.client.0.smithi019.stdout:6/295: readlink d1b/d26/d31/l3b 0 2024-09-12T22:33:13.807 INFO:tasks.workunit.client.0.smithi019.stdout:6/296: rmdir d1b/d2d 39 2024-09-12T22:33:13.807 INFO:tasks.workunit.client.0.smithi019.stdout:5/420: write d0/d7/d2d/f5e [724053,78922] 0 2024-09-12T22:33:13.807 INFO:tasks.workunit.client.0.smithi019.stdout:5/421: read d0/dc/d39/d38/f62 [528392,82551] 0 2024-09-12T22:33:13.807 INFO:tasks.workunit.client.0.smithi019.stdout:6/297: rename d1b/d26/d31/l3b to d1b/d2d/d35/l66 0 2024-09-12T22:33:13.807 INFO:tasks.workunit.client.0.smithi019.stdout:5/422: unlink d0/d7/d16/d18/l85 0 2024-09-12T22:33:13.807 INFO:tasks.workunit.client.0.smithi019.stdout:6/298: chown d1b/d26/l29 794652165 1 2024-09-12T22:33:13.807 INFO:tasks.workunit.client.0.smithi019.stdout:8/244: dwrite d7/d8/df/f1f [0,4194304] 0 2024-09-12T22:33:13.807 INFO:tasks.workunit.client.0.smithi019.stdout:6/299: write f19 [781242,69995] 0 2024-09-12T22:33:13.807 INFO:tasks.workunit.client.0.smithi019.stdout:5/423: mkdir d0/d7/d2d/d32/d36/d8c/d8f 0 2024-09-12T22:33:13.807 INFO:tasks.workunit.client.0.smithi019.stdout:6/300: stat c1a 0 2024-09-12T22:33:13.807 INFO:tasks.workunit.client.0.smithi019.stdout:8/245: mkdir d7/d8/df/d54 0 2024-09-12T22:33:13.808 INFO:tasks.workunit.client.0.smithi019.stdout:6/301: fdatasync f19 0 2024-09-12T22:33:13.808 INFO:tasks.workunit.client.0.smithi019.stdout:8/246: creat d7/d8/dd/f55 x:0 0 0 2024-09-12T22:33:13.808 INFO:tasks.workunit.client.0.smithi019.stdout:5/424: rename d0/d7/d2d/d32/d36/d6a/d82 to d0/d7/d90 0 2024-09-12T22:33:13.808 INFO:tasks.workunit.client.0.smithi019.stdout:8/247: truncate d7/d8/f1b 4213352 0 2024-09-12T22:33:13.808 INFO:tasks.workunit.client.0.smithi019.stdout:6/302: mkdir d1b/d26/d27/d67 0 2024-09-12T22:33:13.808 INFO:tasks.workunit.client.0.smithi019.stdout:5/425: creat d0/d7/d16/f91 x:0 0 0 2024-09-12T22:33:13.808 INFO:tasks.workunit.client.0.smithi019.stdout:5/426: fdatasync d0/f75 0 2024-09-12T22:33:13.808 INFO:tasks.workunit.client.0.smithi019.stdout:6/303: symlink d1b/d2d/d35/d61/l68 0 2024-09-12T22:33:13.808 INFO:tasks.workunit.client.0.smithi019.stdout:5/427: chown d0/dc/d39 386316603 1 2024-09-12T22:33:13.808 INFO:tasks.workunit.client.0.smithi019.stdout:8/248: chown d7/d8/dd/d45/l4a 11095 1 2024-09-12T22:33:13.808 INFO:tasks.workunit.client.0.smithi019.stdout:5/428: mknod d0/dc/d24/c92 0 2024-09-12T22:33:13.808 INFO:tasks.workunit.client.0.smithi019.stdout:6/304: link l12 d1b/d26/d39/l69 0 2024-09-12T22:33:13.808 INFO:tasks.workunit.client.0.smithi019.stdout:6/305: fsync d1b/d2d/d35/d61/f62 0 2024-09-12T22:33:13.808 INFO:tasks.workunit.client.0.smithi019.stdout:2/295: dread d0/d5/f10 [0,4194304] 0 2024-09-12T22:33:13.809 INFO:tasks.workunit.client.0.smithi019.stdout:6/306: read d1b/d26/d39/f4a [705981,35308] 0 2024-09-12T22:33:13.809 INFO:tasks.workunit.client.0.smithi019.stdout:6/307: chown d1b/d26/d27/d3e 0 1 2024-09-12T22:33:13.809 INFO:tasks.workunit.client.0.smithi019.stdout:2/296: fsync d0/d5/d18/d1b/f4d 0 2024-09-12T22:33:13.809 INFO:tasks.workunit.client.0.smithi019.stdout:2/297: fdatasync d0/d5/f26 0 2024-09-12T22:33:13.809 INFO:tasks.workunit.client.0.smithi019.stdout:5/429: truncate d0/f6 1365638 0 2024-09-12T22:33:13.812 INFO:tasks.workunit.client.0.smithi019.stdout:3/226: dread dd/d1e/f2e [0,4194304] 0 2024-09-12T22:33:13.812 INFO:tasks.workunit.client.0.smithi019.stdout:2/298: write d0/da/f29 [3259905,5254] 0 2024-09-12T22:33:13.812 INFO:tasks.workunit.client.0.smithi019.stdout:2/299: creat d0/d5/d18/d5c/f68 x:0 0 0 2024-09-12T22:33:13.812 INFO:tasks.workunit.client.0.smithi019.stdout:2/300: write d0/d5/f10 [3704305,125012] 0 2024-09-12T22:33:13.813 INFO:tasks.workunit.client.0.smithi019.stdout:6/308: dwrite d1b/d26/d39/f53 [0,4194304] 0 2024-09-12T22:33:13.813 INFO:tasks.workunit.client.0.smithi019.stdout:3/227: dread dd/f11 [8388608,4194304] 0 2024-09-12T22:33:13.813 INFO:tasks.workunit.client.0.smithi019.stdout:2/301: chown d0/d5/d18/d3b/f3f 373793904 1 2024-09-12T22:33:13.813 INFO:tasks.workunit.client.0.smithi019.stdout:5/430: dwrite d0/f7e [0,4194304] 0 2024-09-12T22:33:13.813 INFO:tasks.workunit.client.0.smithi019.stdout:6/309: rename d1b/d2d/d35 to d1b/d26/d39/d6a 0 2024-09-12T22:33:13.813 INFO:tasks.workunit.client.0.smithi019.stdout:3/228: write dd/d12/f48 [280850,25045] 0 2024-09-12T22:33:13.813 INFO:tasks.workunit.client.0.smithi019.stdout:2/302: rmdir d0/d5/d18/d39 39 2024-09-12T22:33:13.813 INFO:tasks.workunit.client.0.smithi019.stdout:5/431: readlink d0/d7/d16/d69/l6b 0 2024-09-12T22:33:13.813 INFO:tasks.workunit.client.0.smithi019.stdout:4/266: dread d1/d8/fb [4194304,4194304] 0 2024-09-12T22:33:13.813 INFO:tasks.workunit.client.0.smithi019.stdout:2/303: symlink d0/d5/d17/l69 0 2024-09-12T22:33:13.813 INFO:tasks.workunit.client.0.smithi019.stdout:5/432: stat d0/d7/d2d/l4d 0 2024-09-12T22:33:13.813 INFO:tasks.workunit.client.0.smithi019.stdout:6/310: creat d1b/d26/d39/d6a/d61/f6b x:0 0 0 2024-09-12T22:33:13.813 INFO:tasks.workunit.client.0.smithi019.stdout:3/229: link cb dd/d12/c49 0 2024-09-12T22:33:13.814 INFO:tasks.workunit.client.0.smithi019.stdout:6/311: stat d1b/d2d/c2e 0 2024-09-12T22:33:13.814 INFO:tasks.workunit.client.0.smithi019.stdout:2/304: mkdir d0/d5/d18/d5c/d63/d6a 0 2024-09-12T22:33:13.814 INFO:tasks.workunit.client.0.smithi019.stdout:6/312: write d1b/d26/f3a [199408,83028] 0 2024-09-12T22:33:13.814 INFO:tasks.workunit.client.0.smithi019.stdout:5/433: write d0/d7/d16/d18/f52 [341290,111248] 0 2024-09-12T22:33:13.814 INFO:tasks.workunit.client.0.smithi019.stdout:6/313: fdatasync d1b/d26/d27/f46 0 2024-09-12T22:33:13.814 INFO:tasks.workunit.client.0.smithi019.stdout:2/305: creat d0/d5/d18/d5c/d63/d6a/f6b x:0 0 0 2024-09-12T22:33:13.814 INFO:tasks.workunit.client.0.smithi019.stdout:6/314: dread - d1b/d26/d39/d6a/d61/f62 zero size 2024-09-12T22:33:13.814 INFO:tasks.workunit.client.0.smithi019.stdout:2/306: chown d0/d5/d18/c32 4 1 2024-09-12T22:33:13.814 INFO:tasks.workunit.client.0.smithi019.stdout:4/267: dwrite d1/d22/d26/f29 [0,4194304] 0 2024-09-12T22:33:13.814 INFO:tasks.workunit.client.0.smithi019.stdout:9/287: dread dd/f16 [0,4194304] 0 2024-09-12T22:33:13.814 INFO:tasks.workunit.client.0.smithi019.stdout:6/315: truncate d1b/d26/d27/f54 5461405 0 2024-09-12T22:33:13.814 INFO:tasks.workunit.client.0.smithi019.stdout:9/288: stat dd/d10/d17/d23/d52/d53 0 2024-09-12T22:33:13.814 INFO:tasks.workunit.client.0.smithi019.stdout:2/307: rename d0/d5/d18/d1b/c35 to d0/d41/c6c 0 2024-09-12T22:33:13.814 INFO:tasks.workunit.client.0.smithi019.stdout:3/230: dread dd/d12/f35 [0,4194304] 0 2024-09-12T22:33:13.815 INFO:tasks.workunit.client.0.smithi019.stdout:6/316: truncate d1b/d26/d27/f5b 316487 0 2024-09-12T22:33:13.815 INFO:tasks.workunit.client.0.smithi019.stdout:3/231: dread dd/f44 [0,4194304] 0 2024-09-12T22:33:13.815 INFO:tasks.workunit.client.0.smithi019.stdout:3/232: fdatasync f2 0 2024-09-12T22:33:13.815 INFO:tasks.workunit.client.0.smithi019.stdout:4/268: dread d1/d4/f13 [0,4194304] 0 2024-09-12T22:33:13.815 INFO:tasks.workunit.client.0.smithi019.stdout:4/269: chown d1/d11/d15/c3f 48570 1 2024-09-12T22:33:13.815 INFO:tasks.workunit.client.0.smithi019.stdout:4/270: chown d1/d8/fb 0 1 2024-09-12T22:33:13.816 INFO:tasks.workunit.client.0.smithi019.stdout:3/233: dwrite dd/d12/f48 [0,4194304] 0 2024-09-12T22:33:13.816 INFO:tasks.workunit.client.0.smithi019.stdout:4/271: creat d1/d22/d31/d4f/f53 x:0 0 0 2024-09-12T22:33:13.816 INFO:tasks.workunit.client.0.smithi019.stdout:4/272: read d1/d8/f20 [3248738,95] 0 2024-09-12T22:33:13.816 INFO:tasks.workunit.client.0.smithi019.stdout:2/308: dread d0/d5/d18/d39/f44 [0,4194304] 0 2024-09-12T22:33:13.817 INFO:tasks.workunit.client.0.smithi019.stdout:2/309: write d0/da/f29 [2084378,71641] 0 2024-09-12T22:33:13.818 INFO:tasks.workunit.client.0.smithi019.stdout:4/273: creat d1/d4/d44/f54 x:0 0 0 2024-09-12T22:33:13.819 INFO:tasks.workunit.client.0.smithi019.stdout:7/259: sync 2024-09-12T22:33:13.820 INFO:tasks.workunit.client.0.smithi019.stdout:3/234: dread dd/f31 [0,4194304] 0 2024-09-12T22:33:13.820 INFO:tasks.workunit.client.0.smithi019.stdout:7/260: dread - d6/d2d/d41/f48 zero size 2024-09-12T22:33:13.821 INFO:tasks.workunit.client.0.smithi019.stdout:4/274: symlink d1/d11/d15/d1f/l55 0 2024-09-12T22:33:13.821 INFO:tasks.workunit.client.0.smithi019.stdout:3/235: chown dd/d12/f29 7172430 1 2024-09-12T22:33:13.822 INFO:tasks.workunit.client.0.smithi019.stdout:6/317: dwrite d1b/d26/d27/f5b [0,4194304] 0 2024-09-12T22:33:13.823 INFO:tasks.workunit.client.0.smithi019.stdout:7/261: creat d6/d14/d15/d23/f65 x:0 0 0 2024-09-12T22:33:13.823 INFO:tasks.workunit.client.0.smithi019.stdout:4/275: mkdir d1/d11/d15/d1f/d56 0 2024-09-12T22:33:13.823 INFO:tasks.workunit.client.0.smithi019.stdout:3/236: creat dd/d1e/d40/f4a x:0 0 0 2024-09-12T22:33:13.825 INFO:tasks.workunit.client.0.smithi019.stdout:6/318: rename d1b/f52 to d1b/d26/f6c 0 2024-09-12T22:33:13.825 INFO:tasks.workunit.client.0.smithi019.stdout:3/237: chown dd/l3e 4 1 2024-09-12T22:33:13.825 INFO:tasks.workunit.client.0.smithi019.stdout:4/276: mkdir d1/d22/d57 0 2024-09-12T22:33:13.826 INFO:tasks.workunit.client.0.smithi019.stdout:2/310: dwrite d0/da/f50 [0,4194304] 0 2024-09-12T22:33:13.826 INFO:tasks.workunit.client.0.smithi019.stdout:6/319: fdatasync f0 0 2024-09-12T22:33:13.827 INFO:tasks.workunit.client.0.smithi019.stdout:4/277: write d1/d4/f39 [734207,63197] 0 2024-09-12T22:33:13.827 INFO:tasks.workunit.client.0.smithi019.stdout:7/262: rename d6/db/dc/c4f to d6/db/dc/d63/c66 0 2024-09-12T22:33:13.827 INFO:tasks.workunit.client.0.smithi019.stdout:6/320: rmdir d1b/d26/d27 39 2024-09-12T22:33:13.828 INFO:tasks.workunit.client.0.smithi019.stdout:7/263: stat d6/d2d 0 2024-09-12T22:33:13.828 INFO:tasks.workunit.client.0.smithi019.stdout:3/238: truncate dd/f20 33265 0 2024-09-12T22:33:13.829 INFO:tasks.workunit.client.0.smithi019.stdout:7/264: readlink d6/l54 0 2024-09-12T22:33:13.830 INFO:tasks.workunit.client.0.smithi019.stdout:6/321: write d1b/d26/d39/f4c [122078,5348] 0 2024-09-12T22:33:13.830 INFO:tasks.workunit.client.0.smithi019.stdout:2/311: link d0/d5/d18/d1b/c34 d0/d5/d60/c6d 0 2024-09-12T22:33:13.830 INFO:tasks.workunit.client.0.smithi019.stdout:5/434: dread d0/f2 [0,4194304] 0 2024-09-12T22:33:13.831 INFO:tasks.workunit.client.0.smithi019.stdout:9/289: dread dd/d10/d17/d23/d52/d53/f5c [0,4194304] 0 2024-09-12T22:33:13.831 INFO:tasks.workunit.client.0.smithi019.stdout:3/239: truncate dd/f11 10964191 0 2024-09-12T22:33:13.832 INFO:tasks.workunit.client.0.smithi019.stdout:3/240: chown dd/l3f 9364139 1 2024-09-12T22:33:13.832 INFO:tasks.workunit.client.0.smithi019.stdout:2/312: symlink d0/d5/d18/d5c/l6e 0 2024-09-12T22:33:13.833 INFO:tasks.workunit.client.0.smithi019.stdout:2/313: stat d0/d5/c4f 0 2024-09-12T22:33:13.833 INFO:tasks.workunit.client.0.smithi019.stdout:6/322: creat d1b/d26/d27/d3e/f6d x:0 0 0 2024-09-12T22:33:13.833 INFO:tasks.workunit.client.0.smithi019.stdout:3/241: rmdir dd 39 2024-09-12T22:33:13.833 INFO:tasks.workunit.client.0.smithi019.stdout:9/290: stat dd/d10/d17/d23/d2e/d31/d3f/d47/c5f 0 2024-09-12T22:33:13.833 INFO:tasks.workunit.client.0.smithi019.stdout:4/278: truncate d1/d4/f39 427918 0 2024-09-12T22:33:13.833 INFO:tasks.workunit.client.0.smithi019.stdout:4/279: chown d1 814080350 1 2024-09-12T22:33:13.834 INFO:tasks.workunit.client.0.smithi019.stdout:6/323: creat d1b/f6e x:0 0 0 2024-09-12T22:33:13.834 INFO:tasks.workunit.client.0.smithi019.stdout:3/242: stat dd/f46 0 2024-09-12T22:33:13.835 INFO:tasks.workunit.client.0.smithi019.stdout:6/324: stat d1b/d26/d31/c51 0 2024-09-12T22:33:13.835 INFO:tasks.workunit.client.0.smithi019.stdout:4/280: symlink d1/d11/d15/l58 0 2024-09-12T22:33:13.835 INFO:tasks.workunit.client.0.smithi019.stdout:3/243: fdatasync dd/f2a 0 2024-09-12T22:33:13.836 INFO:tasks.workunit.client.0.smithi019.stdout:1/336: sync 2024-09-12T22:33:13.836 INFO:tasks.workunit.client.0.smithi019.stdout:0/302: sync 2024-09-12T22:33:13.836 INFO:tasks.workunit.client.0.smithi019.stdout:8/249: sync 2024-09-12T22:33:13.836 INFO:tasks.workunit.client.0.smithi019.stdout:2/314: sync 2024-09-12T22:33:13.837 INFO:tasks.workunit.client.0.smithi019.stdout:7/265: dwrite d6/d14/d15/d23/f65 [0,4194304] 0 2024-09-12T22:33:13.838 INFO:tasks.workunit.client.0.smithi019.stdout:6/325: symlink d1b/d26/d31/l6f 0 2024-09-12T22:33:13.839 INFO:tasks.workunit.client.0.smithi019.stdout:0/303: unlink d1/d1d/f2f 0 2024-09-12T22:33:13.839 INFO:tasks.workunit.client.0.smithi019.stdout:8/250: write d7/f27 [447487,8715] 0 2024-09-12T22:33:13.840 INFO:tasks.workunit.client.0.smithi019.stdout:1/337: rmdir d3/d11/d16/d3c/d55 39 2024-09-12T22:33:13.841 INFO:tasks.workunit.client.0.smithi019.stdout:5/435: dwrite d0/d7/d16/d18/f19 [0,4194304] 0 2024-09-12T22:33:13.841 INFO:tasks.workunit.client.0.smithi019.stdout:7/266: symlink d6/d14/d15/l67 0 2024-09-12T22:33:13.841 INFO:tasks.workunit.client.0.smithi019.stdout:6/326: rmdir d1b/d2d 39 2024-09-12T22:33:13.842 INFO:tasks.workunit.client.0.smithi019.stdout:0/304: creat d1/d14/d26/f5c x:0 0 0 2024-09-12T22:33:13.843 INFO:tasks.workunit.client.0.smithi019.stdout:1/338: write d3/d11/d16/f38 [983694,96844] 0 2024-09-12T22:33:13.844 INFO:tasks.workunit.client.0.smithi019.stdout:6/327: fsync d1b/d26/d39/d6a/f58 0 2024-09-12T22:33:13.845 INFO:tasks.workunit.client.0.smithi019.stdout:8/251: rename d7/d8/dd/f12 to d7/d8/dd/f56 0 2024-09-12T22:33:13.845 INFO:tasks.workunit.client.0.smithi019.stdout:9/291: dwrite dd/d10/d17/d23/f2d [4194304,4194304] 0 2024-09-12T22:33:13.846 INFO:tasks.workunit.client.0.smithi019.stdout:5/436: write d0/f23 [1991177,10742] 0 2024-09-12T22:33:13.846 INFO:tasks.workunit.client.0.smithi019.stdout:7/267: getdents d6/d14/d2a 0 2024-09-12T22:33:13.846 INFO:tasks.workunit.client.0.smithi019.stdout:0/305: write d1/d14/d26/f50 [990716,74443] 0 2024-09-12T22:33:13.846 INFO:tasks.workunit.client.0.smithi019.stdout:6/328: mknod d1b/d26/c70 0 2024-09-12T22:33:13.847 INFO:tasks.workunit.client.0.smithi019.stdout:1/339: chown d3/l15 1048951 1 2024-09-12T22:33:13.848 INFO:tasks.workunit.client.0.smithi019.stdout:7/268: dread - d6/d14/d15/f5e zero size 2024-09-12T22:33:13.848 INFO:tasks.workunit.client.0.smithi019.stdout:5/437: symlink d0/d7/d2d/d32/d36/d6a/l93 0 2024-09-12T22:33:13.849 INFO:tasks.workunit.client.0.smithi019.stdout:6/329: write d1b/d26/d31/f4e [1535903,74203] 0 2024-09-12T22:33:13.849 INFO:tasks.workunit.client.0.smithi019.stdout:1/340: unlink d3/l10 0 2024-09-12T22:33:13.850 INFO:tasks.workunit.client.0.smithi019.stdout:9/292: rename dd/cf to dd/d10/d17/c61 0 2024-09-12T22:33:13.850 INFO:tasks.workunit.client.0.smithi019.stdout:0/306: write d1/d14/d32/d3d/f5a [159607,122678] 0 2024-09-12T22:33:13.850 INFO:tasks.workunit.client.0.smithi019.stdout:3/244: dwrite dd/f44 [0,4194304] 0 2024-09-12T22:33:13.850 INFO:tasks.workunit.client.0.smithi019.stdout:2/315: truncate d0/d5/d18/d1b/d36/f4a 5249135 0 2024-09-12T22:33:13.850 INFO:tasks.workunit.client.0.smithi019.stdout:5/438: mknod d0/dc/d39/c94 0 2024-09-12T22:33:13.852 INFO:tasks.workunit.client.0.smithi019.stdout:8/252: rename d7/d8/dd/d4f/l47 to d7/d8/d43/l57 0 2024-09-12T22:33:13.852 INFO:tasks.workunit.client.0.smithi019.stdout:7/269: mknod d6/db/c68 0 2024-09-12T22:33:13.852 INFO:tasks.workunit.client.0.smithi019.stdout:1/341: mknod d3/d11/d53/c72 0 2024-09-12T22:33:13.855 INFO:tasks.workunit.client.0.smithi019.stdout:4/281: sync 2024-09-12T22:33:13.855 INFO:tasks.workunit.client.0.smithi019.stdout:5/439: getdents d0/d7 0 2024-09-12T22:33:13.855 INFO:tasks.workunit.client.0.smithi019.stdout:1/342: chown d3/d3f 26522244 1 2024-09-12T22:33:13.855 INFO:tasks.workunit.client.0.smithi019.stdout:0/307: sync 2024-09-12T22:33:13.855 INFO:tasks.workunit.client.0.smithi019.stdout:6/330: getdents d1b/d26 0 2024-09-12T22:33:13.855 INFO:tasks.workunit.client.0.smithi019.stdout:7/270: mknod d6/db/d42/c69 0 2024-09-12T22:33:13.855 INFO:tasks.workunit.client.0.smithi019.stdout:9/293: symlink dd/d10/d17/l62 0 2024-09-12T22:33:13.856 INFO:tasks.workunit.client.0.smithi019.stdout:8/253: creat d7/d8/dd/f58 x:0 0 0 2024-09-12T22:33:13.858 INFO:tasks.workunit.client.0.smithi019.stdout:6/331: chown d1b/f5d 789668523 1 2024-09-12T22:33:13.858 INFO:tasks.workunit.client.0.smithi019.stdout:6/332: sync 2024-09-12T22:33:13.858 INFO:tasks.workunit.client.0.smithi019.stdout:4/282: creat d1/d11/d15/d4e/f59 x:0 0 0 2024-09-12T22:33:13.858 INFO:tasks.workunit.client.0.smithi019.stdout:7/271: mkdir d6/d14/d15/d62/d6a 0 2024-09-12T22:33:13.859 INFO:tasks.workunit.client.0.smithi019.stdout:0/308: dread - d1/d1f/f39 zero size 2024-09-12T22:33:13.859 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:13.858+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:13.862 INFO:tasks.workunit.client.0.smithi019.stdout:3/245: dwrite f2 [4194304,4194304] 0 2024-09-12T22:33:13.862 INFO:tasks.workunit.client.0.smithi019.stdout:5/440: dread d0/d7/d2d/f5e [0,4194304] 0 2024-09-12T22:33:13.862 INFO:tasks.workunit.client.0.smithi019.stdout:6/333: rename d1b/d2d/f32 to d1b/d26/d27/d67/f71 0 2024-09-12T22:33:13.862 INFO:tasks.workunit.client.0.smithi019.stdout:2/316: dwrite d0/d5/d18/d39/f65 [0,4194304] 0 2024-09-12T22:33:13.863 INFO:tasks.workunit.client.0.smithi019.stdout:0/309: symlink d1/d14/d26/d40/d45/l5d 0 2024-09-12T22:33:13.866 INFO:tasks.workunit.client.0.smithi019.stdout:0/310: fdatasync d1/d51/f56 0 2024-09-12T22:33:13.867 INFO:tasks.workunit.client.0.smithi019.stdout:3/246: write dd/f31 [2330722,112154] 0 2024-09-12T22:33:13.867 INFO:tasks.workunit.client.0.smithi019.stdout:8/254: dwrite d7/d8/f2e [0,4194304] 0 2024-09-12T22:33:13.869 INFO:tasks.workunit.client.0.smithi019.stdout:6/334: symlink d1b/d26/d31/d5f/l72 0 2024-09-12T22:33:13.870 INFO:tasks.workunit.client.0.smithi019.stdout:5/441: rename d0/d7/f1d to d0/dc/d39/d38/f95 0 2024-09-12T22:33:13.870 INFO:tasks.workunit.client.0.smithi019.stdout:4/283: dwrite d1/d4/f2a [0,4194304] 0 2024-09-12T22:33:13.871 INFO:tasks.workunit.client.0.smithi019.stdout:7/272: truncate d6/db/dc/d63/f4e 3003607 0 2024-09-12T22:33:13.872 INFO:tasks.workunit.client.0.smithi019.stdout:7/273: sync 2024-09-12T22:33:13.872 INFO:tasks.workunit.client.0.smithi019.stdout:6/335: rmdir d1b/d26/d31/d5f 39 2024-09-12T22:33:13.872 INFO:tasks.workunit.client.0.smithi019.stdout:8/255: creat d7/f59 x:0 0 0 2024-09-12T22:33:13.877 INFO:tasks.workunit.client.0.smithi019.stdout:0/311: read d1/d14/f1e [1758648,28251] 0 2024-09-12T22:33:13.877 INFO:tasks.workunit.client.0.smithi019.stdout:7/274: link d6/c29 d6/d14/d15/d62/d6a/c6b 0 2024-09-12T22:33:13.878 INFO:tasks.workunit.client.0.smithi019.stdout:3/247: dwrite f2 [0,4194304] 0 2024-09-12T22:33:13.878 INFO:tasks.workunit.client.0.smithi019.stdout:8/256: symlink d7/d8/df/d53/l5a 0 2024-09-12T22:33:13.879 INFO:tasks.workunit.client.0.smithi019.stdout:7/275: dread - d6/d2d/d41/f48 zero size 2024-09-12T22:33:13.879 INFO:tasks.workunit.client.0.smithi019.stdout:2/317: dwrite d0/d5/d18/d3b/f49 [0,4194304] 0 2024-09-12T22:33:13.880 INFO:tasks.workunit.client.0.smithi019.stdout:5/442: write d0/d7/d16/d18/f52 [837370,115469] 0 2024-09-12T22:33:13.880 INFO:tasks.workunit.client.0.smithi019.stdout:3/248: chown dd/f33 2165 1 2024-09-12T22:33:13.881 INFO:tasks.workunit.client.0.smithi019.stdout:6/336: getdents d1b/d26/d27/d67 0 2024-09-12T22:33:13.882 INFO:tasks.workunit.client.0.smithi019.stdout:4/284: dwrite d1/d8/f14 [0,4194304] 0 2024-09-12T22:33:13.882 INFO:tasks.workunit.client.0.smithi019.stdout:3/249: chown c1 2828114 1 2024-09-12T22:33:13.884 INFO:tasks.workunit.client.0.smithi019.stdout:7/276: symlink d6/db/d42/l6c 0 2024-09-12T22:33:13.884 INFO:tasks.workunit.client.0.smithi019.stdout:3/250: rmdir dd/d1e/d40 39 2024-09-12T22:33:13.885 INFO:tasks.workunit.client.0.smithi019.stdout:4/285: write d1/d22/d2c/f35 [99676,21799] 0 2024-09-12T22:33:13.885 INFO:tasks.workunit.client.0.smithi019.stdout:3/251: chown dd/f26 32052 1 2024-09-12T22:33:13.886 INFO:tasks.workunit.client.0.smithi019.stdout:2/318: rename d0/d5/d18/d5c/d63/d6a/f6b to d0/d5/d18/d5c/f6f 0 2024-09-12T22:33:13.887 INFO:tasks.workunit.client.0.smithi019.stdout:5/443: getdents d0/dc/d39/d38 0 2024-09-12T22:33:13.887 INFO:tasks.workunit.client.0.smithi019.stdout:7/277: creat d6/d14/d15/f6d x:0 0 0 2024-09-12T22:33:13.887 INFO:tasks.workunit.client.0.smithi019.stdout:0/312: truncate d1/d1f/f41 2502900 0 2024-09-12T22:33:13.888 INFO:tasks.workunit.client.0.smithi019.stdout:7/278: stat d6/l54 0 2024-09-12T22:33:13.888 INFO:tasks.workunit.client.0.smithi019.stdout:3/252: truncate dd/d12/f3b 1023535 0 2024-09-12T22:33:13.888 INFO:tasks.workunit.client.0.smithi019.stdout:4/286: unlink d1/d4/f39 0 2024-09-12T22:33:13.889 INFO:tasks.workunit.client.0.smithi019.stdout:8/257: dwrite d7/d8/f1b [4194304,4194304] 0 2024-09-12T22:33:13.890 INFO:tasks.workunit.client.0.smithi019.stdout:6/337: dread d1b/d2d/f42 [0,4194304] 0 2024-09-12T22:33:13.890 INFO:tasks.workunit.client.0.smithi019.stdout:7/279: rename d6/d14 to d6/d14/d15/d62/d6e 22 2024-09-12T22:33:13.891 INFO:tasks.workunit.client.0.smithi019.stdout:7/280: sync 2024-09-12T22:33:13.892 INFO:tasks.workunit.client.0.smithi019.stdout:0/313: mkdir d1/d14/d26/d40/d45/d5e 0 2024-09-12T22:33:13.892 INFO:tasks.workunit.client.0.smithi019.stdout:3/253: mknod dd/d12/c4b 0 2024-09-12T22:33:13.892 INFO:tasks.workunit.client.0.smithi019.stdout:6/338: chown d1b/d26/d39/d6a/f5c 23669 1 2024-09-12T22:33:13.892 INFO:tasks.workunit.client.0.smithi019.stdout:8/258: symlink d7/d8/l5b 0 2024-09-12T22:33:13.892 INFO:tasks.workunit.client.0.smithi019.stdout:7/281: fdatasync d6/db/d42/f61 0 2024-09-12T22:33:13.892 INFO:tasks.workunit.client.0.smithi019.stdout:4/287: mkdir d1/d11/d15/d4e/d5a 0 2024-09-12T22:33:13.893 INFO:tasks.workunit.client.0.smithi019.stdout:0/314: write d1/d14/f4e [522257,49049] 0 2024-09-12T22:33:13.893 INFO:tasks.workunit.client.0.smithi019.stdout:8/259: rmdir d7/d34 39 2024-09-12T22:33:13.893 INFO:tasks.workunit.client.0.smithi019.stdout:6/339: mknod d1b/d26/d31/c73 0 2024-09-12T22:33:13.894 INFO:tasks.workunit.client.0.smithi019.stdout:3/254: creat dd/d12/f4c x:0 0 0 2024-09-12T22:33:13.894 INFO:tasks.workunit.client.0.smithi019.stdout:3/255: chown l0 3 1 2024-09-12T22:33:13.895 INFO:tasks.workunit.client.0.smithi019.stdout:4/288: getdents d1/d11/d15/d49 0 2024-09-12T22:33:13.896 INFO:tasks.workunit.client.0.smithi019.stdout:0/315: creat d1/d14/d32/f5f x:0 0 0 2024-09-12T22:33:13.897 INFO:tasks.workunit.client.0.smithi019.stdout:6/340: truncate d1b/d26/d39/f53 4874548 0 2024-09-12T22:33:13.898 INFO:tasks.workunit.client.0.smithi019.stdout:2/319: dwrite d0/f57 [0,4194304] 0 2024-09-12T22:33:13.899 INFO:tasks.workunit.client.0.smithi019.stdout:0/316: symlink d1/d14/l60 0 2024-09-12T22:33:13.900 INFO:tasks.workunit.client.0.smithi019.stdout:6/341: write d1b/f3c [4994421,126947] 0 2024-09-12T22:33:13.901 INFO:tasks.workunit.client.0.smithi019.stdout:9/294: dread dd/d10/d17/f24 [0,4194304] 0 2024-09-12T22:33:13.902 INFO:tasks.workunit.client.0.smithi019.stdout:2/320: fdatasync d0/d5/d18/f3e 0 2024-09-12T22:33:13.903 INFO:tasks.workunit.client.0.smithi019.stdout:3/256: dread dd/f16 [0,4194304] 0 2024-09-12T22:33:13.903 INFO:tasks.workunit.client.0.smithi019.stdout:6/342: rename f19 to d1b/d26/f74 0 2024-09-12T22:33:13.903 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:33:13.904 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [ 2024-09-12T22:33:13.904 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.904 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4490.0:11763 4.15 4:a8f92ddf:::1000000323c.00000000:head [read 1048576~1048576] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-12T22:33:13.904 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:13.898034+0000", 2024-09-12T22:33:13.904 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.0049124320000000004, 2024-09-12T22:33:13.904 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.004930589, 2024-09-12T22:33:13.904 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:13.904 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:13.904 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:33:13.904 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:33:13.904 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4490", 2024-09-12T22:33:13.904 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:13.905 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 11763 2024-09-12T22:33:13.905 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.905 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:13.905 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.905 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:13.905 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.898034+0000", 2024-09-12T22:33:13.905 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:13.905 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.905 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.905 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:13.905 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.898034+0000", 2024-09-12T22:33:13.905 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:13.905 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.906 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.906 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:13.906 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.898034+0000", 2024-09-12T22:33:13.906 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9100000000000004e-07 2024-09-12T22:33:13.906 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.906 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.906 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:13.906 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.898037+0000", 2024-09-12T22:33:13.906 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.7099999999999999e-06 2024-09-12T22:33:13.906 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.906 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.906 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:13.906 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.898043+0000", 2024-09-12T22:33:13.907 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.947e-06 2024-09-12T22:33:13.907 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.907 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.907 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:13.907 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.898046+0000", 2024-09-12T22:33:13.907 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4599999999999999e-06 2024-09-12T22:33:13.907 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.907 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.907 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:13.907 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.898081+0000", 2024-09-12T22:33:13.907 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4276000000000002e-05 2024-09-12T22:33:13.907 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.907 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.908 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:13.908 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.898126+0000", 2024-09-12T22:33:13.908 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5775000000000001e-05 2024-09-12T22:33:13.908 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:13.908 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:13.908 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:13.908 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.908 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.908 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4490.0:11753 4.b 4:d02f5e4a:::10000003111.00000000:head [write 0~4194304 in=4194304b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-12T22:33:13.908 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:13.887275+0000", 2024-09-12T22:33:13.908 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.015671087, 2024-09-12T22:33:13.908 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.015760304999999999, 2024-09-12T22:33:13.908 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:13.909 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:13.909 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:33:13.909 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:33:13.909 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4490", 2024-09-12T22:33:13.909 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:13.909 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 11753 2024-09-12T22:33:13.909 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.909 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:13.909 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.909 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:13.909 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.887275+0000", 2024-09-12T22:33:13.909 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:13.909 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.910 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.910 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:13.910 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.887275+0000", 2024-09-12T22:33:13.910 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:13.910 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.910 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.910 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:13.910 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.887276+0000", 2024-09-12T22:33:13.910 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3399999999999999e-07 2024-09-12T22:33:13.910 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.910 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.910 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:13.910 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.893964+0000", 2024-09-12T22:33:13.911 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0066885499999999997 2024-09-12T22:33:13.911 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.911 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.911 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:13.911 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.893979+0000", 2024-09-12T22:33:13.911 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.5133000000000001e-05 2024-09-12T22:33:13.911 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.911 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.911 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:13.911 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.893989+0000", 2024-09-12T22:33:13.911 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.9299999999999998e-06 2024-09-12T22:33:13.911 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.911 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.911 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:13.912 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.894034+0000", 2024-09-12T22:33:13.912 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4425000000000002e-05 2024-09-12T22:33:13.912 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.912 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.912 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:13.912 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.894109+0000", 2024-09-12T22:33:13.912 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5201e-05 2024-09-12T22:33:13.912 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.912 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.912 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:13.912 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.894233+0000", 2024-09-12T22:33:13.913 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012408699999999999 2024-09-12T22:33:13.913 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:13.913 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:13.913 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:13.913 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.901539+0000", 2024-09-12T22:33:13.913 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0073062869999999999 2024-09-12T22:33:13.913 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:13.913 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:13.913 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:13.914 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:13.914 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-12T22:33:13.914 INFO:teuthology.orchestra.run.smithi148.stdout: "num_ops": 2 2024-09-12T22:33:13.914 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:33:13.915 INFO:tasks.workunit.client.0.smithi019.stdout:8/260: dwrite d7/d8/dd/f55 [0,4194304] 0 2024-09-12T22:33:13.915 INFO:tasks.workunit.client.0.smithi019.stdout:3/257: fdatasync dd/d12/f2c 0 2024-09-12T22:33:13.916 INFO:tasks.workunit.client.0.smithi019.stdout:9/295: mknod dd/d10/d17/d23/d2e/d31/c63 0 2024-09-12T22:33:13.916 INFO:tasks.workunit.client.0.smithi019.stdout:4/289: dwrite d1/d22/d26/f48 [0,4194304] 0 2024-09-12T22:33:13.916 INFO:tasks.workunit.client.0.smithi019.stdout:6/343: truncate d1b/d2d/f42 4839574 0 2024-09-12T22:33:13.916 INFO:tasks.workunit.client.0.smithi019.stdout:8/261: write d7/d8/df/f33 [7675,95895] 0 2024-09-12T22:33:13.916 INFO:tasks.workunit.client.0.smithi019.stdout:2/321: write d0/d5/d18/d1b/f4b [839091,85256] 0 2024-09-12T22:33:13.916 INFO:tasks.workunit.client.0.smithi019.stdout:4/290: chown d1/d22/d31 2 1 2024-09-12T22:33:13.916 INFO:tasks.workunit.client.0.smithi019.stdout:3/258: getdents dd/d1e/d40 0 2024-09-12T22:33:13.916 INFO:tasks.workunit.client.0.smithi019.stdout:0/317: write d1/d14/d1b/f2e [1755191,127672] 0 2024-09-12T22:33:13.916 INFO:tasks.workunit.client.0.smithi019.stdout:8/262: fsync d7/f2c 0 2024-09-12T22:33:13.916 INFO:tasks.workunit.client.0.smithi019.stdout:9/296: getdents dd/d10/d17/d23/d2e/d31 0 2024-09-12T22:33:13.916 INFO:tasks.workunit.client.0.smithi019.stdout:7/282: dwrite d6/db/dc/d63/f4e [0,4194304] 0 2024-09-12T22:33:13.916 INFO:tasks.workunit.client.0.smithi019.stdout:4/291: symlink d1/d11/d15/d1f/l5b 0 2024-09-12T22:33:13.916 INFO:tasks.workunit.client.0.smithi019.stdout:3/259: rmdir dd/d1e 39 2024-09-12T22:33:13.917 INFO:tasks.workunit.client.0.smithi019.stdout:6/344: creat d1b/d26/d31/f75 x:0 0 0 2024-09-12T22:33:13.917 INFO:tasks.workunit.client.0.smithi019.stdout:3/260: write dd/f31 [3850028,88758] 0 2024-09-12T22:33:13.918 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:33:13.919 INFO:tasks.workunit.client.0.smithi019.stdout:0/318: rename d1/d14/f17 to d1/d1f/d5b/f61 0 2024-09-12T22:33:13.919 INFO:tasks.workunit.client.0.smithi019.stdout:7/283: creat d6/db/dc/d63/d4b/f6f x:0 0 0 2024-09-12T22:33:13.919 INFO:tasks.workunit.client.0.smithi019.stdout:1/343: dread d3/f31 [0,4194304] 0 2024-09-12T22:33:13.919 INFO:tasks.workunit.client.0.smithi019.stdout:9/297: fsync dd/d10/d17/d23/d2e/d31/d3f/f4b 0 2024-09-12T22:33:13.920 INFO:tasks.workunit.client.0.smithi019.stdout:0/319: symlink d1/l62 0 2024-09-12T22:33:13.920 INFO:tasks.workunit.client.0.smithi019.stdout:2/322: dwrite d0/d5/d18/d1b/f55 [0,4194304] 0 2024-09-12T22:33:13.920 INFO:tasks.workunit.client.0.smithi019.stdout:7/284: creat d6/db/dc/f70 x:0 0 0 2024-09-12T22:33:13.921 INFO:tasks.workunit.client.0.smithi019.stdout:9/298: rmdir dd/d10/d17 39 2024-09-12T22:33:13.921 INFO:tasks.workunit.client.0.smithi019.stdout:6/345: chown d1b/d26/d39/d6a/f60 271654 1 2024-09-12T22:33:13.924 INFO:tasks.workunit.client.0.smithi019.stdout:7/285: write d6/db/dc/d63/f4e [1294300,35360] 0 2024-09-12T22:33:13.924 INFO:tasks.workunit.client.0.smithi019.stdout:8/263: dwrite d7/d8/df/f17 [0,4194304] 0 2024-09-12T22:33:13.925 INFO:tasks.workunit.client.0.smithi019.stdout:0/320: mknod d1/d14/d26/d40/d45/c63 0 2024-09-12T22:33:13.926 INFO:tasks.workunit.client.0.smithi019.stdout:6/346: mknod d1b/d26/d31/d5f/c76 0 2024-09-12T22:33:13.929 INFO:tasks.workunit.client.0.smithi019.stdout:7/286: rmdir d6/db/dc/d63/d4b 39 2024-09-12T22:33:13.929 INFO:tasks.workunit.client.0.smithi019.stdout:3/261: dwrite f2 [8388608,4194304] 0 2024-09-12T22:33:13.930 INFO:tasks.workunit.client.0.smithi019.stdout:0/321: mkdir d1/d14/d26/d40/d45/d5e/d64 0 2024-09-12T22:33:13.931 INFO:tasks.workunit.client.0.smithi019.stdout:3/262: readlink dd/l1c 0 2024-09-12T22:33:13.932 INFO:tasks.workunit.client.0.smithi019.stdout:7/287: fsync d6/d14/d15/f22 0 2024-09-12T22:33:13.933 INFO:tasks.workunit.client.0.smithi019.stdout:4/292: dwrite d1/d8/f45 [0,4194304] 0 2024-09-12T22:33:13.935 INFO:tasks.workunit.client.0.smithi019.stdout:2/323: dwrite d0/d5/d18/d39/f65 [0,4194304] 0 2024-09-12T22:33:13.935 INFO:tasks.workunit.client.0.smithi019.stdout:1/344: dwrite d3/d11/d16/d3c/d55/f62 [0,4194304] 0 2024-09-12T22:33:13.936 INFO:tasks.workunit.client.0.smithi019.stdout:8/264: truncate d7/d8/dd/f21 64067 0 2024-09-12T22:33:13.936 INFO:tasks.workunit.client.0.smithi019.stdout:4/293: chown d1/d22/f33 1829868542 1 2024-09-12T22:33:13.936 INFO:tasks.workunit.client.0.smithi019.stdout:3/263: creat dd/f4d x:0 0 0 2024-09-12T22:33:13.937 INFO:tasks.workunit.client.0.smithi019.stdout:7/288: creat d6/db/dc/f71 x:0 0 0 2024-09-12T22:33:13.937 INFO:tasks.workunit.client.0.smithi019.stdout:1/345: creat d3/d11/d16/f73 x:0 0 0 2024-09-12T22:33:13.938 INFO:tasks.workunit.client.0.smithi019.stdout:8/265: mknod d7/d2f/c5c 0 2024-09-12T22:33:13.939 INFO:tasks.workunit.client.0.smithi019.stdout:5/444: dread d0/d7/f20 [0,4194304] 0 2024-09-12T22:33:13.939 INFO:tasks.workunit.client.0.smithi019.stdout:1/346: stat d3/d11/d16/d23/c1a 0 2024-09-12T22:33:13.940 INFO:tasks.workunit.client.0.smithi019.stdout:3/264: link l0 dd/l4e 0 2024-09-12T22:33:13.940 INFO:tasks.workunit.client.0.smithi019.stdout:6/347: dwrite d1b/d26/d39/f53 [4194304,4194304] 0 2024-09-12T22:33:13.941 INFO:tasks.workunit.client.0.smithi019.stdout:1/347: stat d3/d11/d53/f5b 0 2024-09-12T22:33:13.942 INFO:tasks.workunit.client.0.smithi019.stdout:8/266: truncate d7/f19 2244646 0 2024-09-12T22:33:13.943 INFO:tasks.workunit.client.0.smithi019.stdout:6/348: mkdir d1b/d26/d27/d67/d77 0 2024-09-12T22:33:13.946 INFO:tasks.workunit.client.0.smithi019.stdout:1/348: write d3/d11/d16/d23/d54/f61 [592381,56362] 0 2024-09-12T22:33:13.949 INFO:tasks.workunit.client.0.smithi019.stdout:4/294: dwrite d1/d22/d26/f29 [0,4194304] 0 2024-09-12T22:33:13.949 INFO:tasks.workunit.client.0.smithi019.stdout:8/267: link d7/d8/dd/f11 d7/d8/df/d53/f5d 0 2024-09-12T22:33:13.949 INFO:tasks.workunit.client.0.smithi019.stdout:1/349: creat d3/d11/f74 x:0 0 0 2024-09-12T22:33:13.950 INFO:tasks.workunit.client.0.smithi019.stdout:7/289: dwrite d6/d2d/d41/f48 [0,4194304] 0 2024-09-12T22:33:13.950 INFO:tasks.workunit.client.0.smithi019.stdout:1/350: rmdir d3 39 2024-09-12T22:33:13.952 INFO:tasks.workunit.client.0.smithi019.stdout:3/265: dwrite dd/f26 [0,4194304] 0 2024-09-12T22:33:13.953 INFO:tasks.workunit.client.0.smithi019.stdout:1/351: write d3/d11/d53/f5b [910376,116872] 0 2024-09-12T22:33:13.953 INFO:tasks.workunit.client.0.smithi019.stdout:4/295: rename d1/d11/d15/d1f/l5b to d1/d4/d44/l5c 0 2024-09-12T22:33:13.954 INFO:tasks.workunit.client.0.smithi019.stdout:3/266: write dd/d1e/f2e [2132122,7943] 0 2024-09-12T22:33:13.955 INFO:tasks.workunit.client.0.smithi019.stdout:4/296: creat d1/d22/d57/f5d x:0 0 0 2024-09-12T22:33:13.956 INFO:tasks.workunit.client.0.smithi019.stdout:3/267: rename dd/d12/c21 to dd/d12/c4f 0 2024-09-12T22:33:13.957 INFO:tasks.workunit.client.0.smithi019.stdout:4/297: rename d1/d11/d15/d1f/f21 to d1/d4/d38/f5e 0 2024-09-12T22:33:13.961 INFO:tasks.workunit.client.0.smithi019.stdout:3/268: mknod dd/d1e/c50 0 2024-09-12T22:33:13.961 INFO:tasks.workunit.client.0.smithi019.stdout:1/352: dwrite d3/d1b/f5d [0,4194304] 0 2024-09-12T22:33:13.961 INFO:tasks.workunit.client.0.smithi019.stdout:3/269: chown dd/f28 262 1 2024-09-12T22:33:13.961 INFO:tasks.workunit.client.0.smithi019.stdout:3/270: fsync dd/d12/f48 0 2024-09-12T22:33:13.961 INFO:tasks.workunit.client.0.smithi019.stdout:4/298: getdents d1 0 2024-09-12T22:33:13.961 INFO:tasks.workunit.client.0.smithi019.stdout:1/353: fdatasync d3/df/f41 0 2024-09-12T22:33:13.962 INFO:tasks.workunit.client.0.smithi019.stdout:4/299: symlink d1/d4/d38/l5f 0 2024-09-12T22:33:13.962 INFO:tasks.workunit.client.0.smithi019.stdout:1/354: getdents d3/d11/d16/d3c/d55 0 2024-09-12T22:33:13.963 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:13.961+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:13.963 INFO:tasks.workunit.client.0.smithi019.stdout:4/300: read d1/d8/f20 [3596827,60738] 0 2024-09-12T22:33:13.963 INFO:tasks.workunit.client.0.smithi019.stdout:3/271: dread dd/f44 [0,4194304] 0 2024-09-12T22:33:13.964 INFO:tasks.workunit.client.0.smithi019.stdout:1/355: creat d3/d3f/d58/f75 x:0 0 0 2024-09-12T22:33:13.965 INFO:tasks.workunit.client.0.smithi019.stdout:1/356: mkdir d3/d11/d63/d76 0 2024-09-12T22:33:13.965 INFO:tasks.workunit.client.0.smithi019.stdout:1/357: dread - d3/d11/f74 zero size 2024-09-12T22:33:13.969 INFO:tasks.workunit.client.0.smithi019.stdout:8/268: dwrite d7/d8/df/f3b [0,4194304] 0 2024-09-12T22:33:13.969 INFO:tasks.workunit.client.0.smithi019.stdout:3/272: dwrite dd/d12/f3b [0,4194304] 0 2024-09-12T22:33:13.971 INFO:tasks.workunit.client.0.smithi019.stdout:8/269: mkdir d7/d5e 0 2024-09-12T22:33:13.972 INFO:tasks.workunit.client.0.smithi019.stdout:8/270: fsync d7/d8/f1b 0 2024-09-12T22:33:13.972 INFO:tasks.workunit.client.0.smithi019.stdout:0/322: dread d1/d1f/f33 [0,4194304] 0 2024-09-12T22:33:13.976 INFO:tasks.workunit.client.0.smithi019.stdout:1/358: dwrite d3/d1b/f1d [4194304,4194304] 0 2024-09-12T22:33:13.978 INFO:tasks.workunit.client.0.smithi019.stdout:3/273: dwrite dd/f11 [4194304,4194304] 0 2024-09-12T22:33:13.978 INFO:tasks.workunit.client.0.smithi019.stdout:1/359: truncate d3/df/f48 1318251 0 2024-09-12T22:33:13.981 INFO:tasks.workunit.client.0.smithi019.stdout:1/360: mkdir d3/d3f/d77 0 2024-09-12T22:33:13.983 INFO:tasks.workunit.client.0.smithi019.stdout:1/361: write d3/d11/f4f [86022,24820] 0 2024-09-12T22:33:13.983 INFO:tasks.workunit.client.0.smithi019.stdout:0/323: dwrite d1/d14/f1e [0,4194304] 0 2024-09-12T22:33:13.983 INFO:tasks.workunit.client.0.smithi019.stdout:8/271: dwrite d7/d34/f38 [0,4194304] 0 2024-09-12T22:33:13.985 INFO:tasks.workunit.client.0.smithi019.stdout:8/272: fdatasync d7/d8/dd/f2a 0 2024-09-12T22:33:13.986 INFO:tasks.workunit.client.0.smithi019.stdout:1/362: symlink d3/d11/d16/d23/d54/l78 0 2024-09-12T22:33:13.986 INFO:tasks.workunit.client.0.smithi019.stdout:3/274: dwrite dd/d1e/d40/f4a [0,4194304] 0 2024-09-12T22:33:13.988 INFO:tasks.workunit.client.0.smithi019.stdout:3/275: stat dd/d1e/f25 0 2024-09-12T22:33:13.988 INFO:tasks.workunit.client.0.smithi019.stdout:1/363: symlink d3/d11/d63/l79 0 2024-09-12T22:33:13.990 INFO:tasks.workunit.client.0.smithi019.stdout:3/276: dread - dd/d12/f2c zero size 2024-09-12T22:33:13.990 INFO:tasks.workunit.client.0.smithi019.stdout:3/277: fsync dd/d1e/f25 0 2024-09-12T22:33:13.991 INFO:tasks.workunit.client.0.smithi019.stdout:9/299: dread dd/f20 [0,4194304] 0 2024-09-12T22:33:13.991 INFO:tasks.workunit.client.0.smithi019.stdout:1/364: symlink d3/d11/d63/d76/l7a 0 2024-09-12T22:33:13.995 INFO:tasks.workunit.client.0.smithi019.stdout:1/365: mknod d3/d6e/c7b 0 2024-09-12T22:33:13.995 INFO:tasks.workunit.client.0.smithi019.stdout:9/300: mkdir dd/d10/d17/d23/d2e/d31/d64 0 2024-09-12T22:33:13.995 INFO:tasks.workunit.client.0.smithi019.stdout:8/273: dwrite d7/d8/df/f17 [0,4194304] 0 2024-09-12T22:33:13.996 INFO:tasks.workunit.client.0.smithi019.stdout:1/366: rename d3/d11/d16/d3c/d55/c5a to d3/d6e/c7c 0 2024-09-12T22:33:13.999 INFO:tasks.workunit.client.0.smithi019.stdout:6/349: sync 2024-09-12T22:33:13.999 INFO:tasks.workunit.client.0.smithi019.stdout:3/278: dwrite dd/f2a [0,4194304] 0 2024-09-12T22:33:14.000 INFO:tasks.workunit.client.0.smithi019.stdout:1/367: truncate d3/d11/d16/f38 2088235 0 2024-09-12T22:33:14.001 INFO:tasks.workunit.client.0.smithi019.stdout:8/274: dread d7/d8/dd/f55 [0,4194304] 0 2024-09-12T22:33:14.002 INFO:tasks.workunit.client.0.smithi019.stdout:3/279: truncate dd/d1e/d40/f41 423155 0 2024-09-12T22:33:14.002 INFO:tasks.workunit.client.0.smithi019.stdout:6/350: unlink d1b/d26/c5e 0 2024-09-12T22:33:14.002 INFO:tasks.workunit.client.0.smithi019.stdout:1/368: mkdir d3/d6e/d7d 0 2024-09-12T22:33:14.002 INFO:tasks.workunit.client.0.smithi019.stdout:8/275: chown d7/d34/c44 95 1 2024-09-12T22:33:14.003 INFO:tasks.workunit.client.0.smithi019.stdout:3/280: fdatasync dd/d12/f29 0 2024-09-12T22:33:14.003 INFO:tasks.workunit.client.0.smithi019.stdout:8/276: readlink d7/d8/df/l4e 0 2024-09-12T22:33:14.003 INFO:tasks.workunit.client.0.smithi019.stdout:1/369: mkdir d3/df/d7e 0 2024-09-12T22:33:14.004 INFO:tasks.workunit.client.0.smithi019.stdout:9/301: dwrite dd/d10/f19 [4194304,4194304] 0 2024-09-12T22:33:14.005 INFO:tasks.workunit.client.0.smithi019.stdout:8/277: write d7/f36 [633647,61232] 0 2024-09-12T22:33:14.005 INFO:tasks.workunit.client.0.smithi019.stdout:1/370: mkdir d3/d3f/d58/d7f 0 2024-09-12T22:33:14.006 INFO:tasks.workunit.client.0.smithi019.stdout:1/371: mknod d3/df/c80 0 2024-09-12T22:33:14.006 INFO:tasks.workunit.client.0.smithi019.stdout:8/278: creat d7/d34/f5f x:0 0 0 2024-09-12T22:33:14.007 INFO:tasks.workunit.client.0.smithi019.stdout:9/302: write dd/d10/d17/d23/d52/d53/f5c [3238821,41766] 0 2024-09-12T22:33:14.009 INFO:tasks.workunit.client.0.smithi019.stdout:3/281: dread dd/f2a [0,4194304] 0 2024-09-12T22:33:14.009 INFO:tasks.workunit.client.0.smithi019.stdout:9/303: mknod dd/d10/c65 0 2024-09-12T22:33:14.011 INFO:tasks.workunit.client.0.smithi019.stdout:5/445: dread d0/dc/d39/d38/f55 [0,4194304] 0 2024-09-12T22:33:14.011 INFO:tasks.workunit.client.0.smithi019.stdout:3/282: mknod dd/d12/c51 0 2024-09-12T22:33:14.011 INFO:tasks.workunit.client.0.smithi019.stdout:9/304: write dd/d10/d17/d23/d52/d53/f5c [94477,32489] 0 2024-09-12T22:33:14.013 INFO:tasks.workunit.client.0.smithi019.stdout:2/324: dread d0/d5/d18/d3d/f61 [0,4194304] 0 2024-09-12T22:33:14.013 INFO:tasks.workunit.client.0.smithi019.stdout:1/372: dwrite d3/d3f/d58/f5f [0,4194304] 0 2024-09-12T22:33:14.014 INFO:tasks.workunit.client.0.smithi019.stdout:5/446: symlink d0/d7/d90/l96 0 2024-09-12T22:33:14.014 INFO:tasks.workunit.client.0.smithi019.stdout:2/325: chown d0/l23 3184196 1 2024-09-12T22:33:14.015 INFO:tasks.workunit.client.0.smithi019.stdout:1/373: chown d3/d11/d16/f45 84 1 2024-09-12T22:33:14.016 INFO:tasks.workunit.client.0.smithi019.stdout:8/279: dwrite f4 [0,4194304] 0 2024-09-12T22:33:14.016 INFO:tasks.workunit.client.0.smithi019.stdout:9/305: getdents dd/d10/d17/d23/d2e 0 2024-09-12T22:33:14.018 INFO:tasks.workunit.client.0.smithi019.stdout:0/324: dread d1/d14/d26/d40/f52 [0,4194304] 0 2024-09-12T22:33:14.018 INFO:tasks.workunit.client.0.smithi019.stdout:1/374: fdatasync d3/d3f/f2d 0 2024-09-12T22:33:14.019 INFO:tasks.workunit.client.0.smithi019.stdout:6/351: dread d1b/d26/f74 [0,4194304] 0 2024-09-12T22:33:14.020 INFO:tasks.workunit.client.0.smithi019.stdout:2/326: link d0/d5/d60/c6d d0/d5/d60/c70 0 2024-09-12T22:33:14.021 INFO:tasks.workunit.client.0.smithi019.stdout:1/375: dread d3/d11/f4f [0,4194304] 0 2024-09-12T22:33:14.021 INFO:tasks.workunit.client.0.smithi019.stdout:6/352: creat d1b/d26/d27/d67/d77/f78 x:0 0 0 2024-09-12T22:33:14.021 INFO:tasks.workunit.client.0.smithi019.stdout:2/327: readlink d0/d5/d17/l69 0 2024-09-12T22:33:14.022 INFO:tasks.workunit.client.0.smithi019.stdout:5/447: dwrite d0/d7/d16/f7a [0,4194304] 0 2024-09-12T22:33:14.023 INFO:tasks.workunit.client.0.smithi019.stdout:6/353: creat d1b/d26/d27/d3e/f79 x:0 0 0 2024-09-12T22:33:14.023 INFO:tasks.workunit.client.0.smithi019.stdout:1/376: chown d3/df/f41 3804 1 2024-09-12T22:33:14.025 INFO:tasks.workunit.client.0.smithi019.stdout:9/306: truncate dd/d10/d17/d23/d52/d53/f5c 3575142 0 2024-09-12T22:33:14.027 INFO:tasks.workunit.client.0.smithi019.stdout:0/325: dwrite d1/d1f/d5b/f61 [0,4194304] 0 2024-09-12T22:33:14.028 INFO:tasks.workunit.client.0.smithi019.stdout:7/290: sync 2024-09-12T22:33:14.028 INFO:tasks.workunit.client.0.smithi019.stdout:4/301: sync 2024-09-12T22:33:14.029 INFO:tasks.workunit.client.0.smithi019.stdout:8/280: dwrite d7/f2c [0,4194304] 0 2024-09-12T22:33:14.030 INFO:tasks.workunit.client.0.smithi019.stdout:6/354: getdents d1b/d26/d39/d6a/d61 0 2024-09-12T22:33:14.031 INFO:tasks.workunit.client.0.smithi019.stdout:0/326: chown d1/d14/d1b/f2b 191661944 1 2024-09-12T22:33:14.031 INFO:tasks.workunit.client.0.smithi019.stdout:9/307: write dd/d10/d17/d23/d2e/d31/d3f/d47/f4e [3571287,15548] 0 2024-09-12T22:33:14.031 INFO:tasks.workunit.client.0.smithi019.stdout:7/291: unlink d6/d2d/f3e 0 2024-09-12T22:33:14.031 INFO:tasks.workunit.client.0.smithi019.stdout:2/328: dwrite d0/d5/d18/d39/f65 [0,4194304] 0 2024-09-12T22:33:14.032 INFO:tasks.workunit.client.0.smithi019.stdout:4/302: write d1/d8/f45 [4574995,28245] 0 2024-09-12T22:33:14.032 INFO:tasks.workunit.client.0.smithi019.stdout:0/327: dread - d1/d14/d1b/f44 zero size 2024-09-12T22:33:14.035 INFO:tasks.workunit.client.0.smithi019.stdout:4/303: creat d1/d11/d15/d1f/d56/f60 x:0 0 0 2024-09-12T22:33:14.035 INFO:tasks.workunit.client.0.smithi019.stdout:2/329: mkdir d0/d5/d60/d71 0 2024-09-12T22:33:14.035 INFO:tasks.workunit.client.0.smithi019.stdout:5/448: dwrite d0/dc/d39/d38/f55 [0,4194304] 0 2024-09-12T22:33:14.036 INFO:tasks.workunit.client.0.smithi019.stdout:9/308: creat dd/d10/d17/d23/d2e/d31/d64/f66 x:0 0 0 2024-09-12T22:33:14.037 INFO:tasks.workunit.client.0.smithi019.stdout:4/304: truncate d1/f24 4802642 0 2024-09-12T22:33:14.037 INFO:tasks.workunit.client.0.smithi019.stdout:2/330: symlink d0/d5/d60/d71/l72 0 2024-09-12T22:33:14.038 INFO:tasks.workunit.client.0.smithi019.stdout:4/305: fdatasync d1/d11/d15/f2e 0 2024-09-12T22:33:14.039 INFO:tasks.workunit.client.0.smithi019.stdout:5/449: mknod d0/d7/d16/d69/c97 0 2024-09-12T22:33:14.040 INFO:tasks.workunit.client.0.smithi019.stdout:4/306: truncate d1/d11/d15/f2e 5107252 0 2024-09-12T22:33:14.040 INFO:tasks.workunit.client.0.smithi019.stdout:8/281: dwrite d7/f59 [0,4194304] 0 2024-09-12T22:33:14.040 INFO:tasks.workunit.client.0.smithi019.stdout:4/307: chown d1/l32 5904 1 2024-09-12T22:33:14.041 INFO:tasks.workunit.client.0.smithi019.stdout:9/309: truncate dd/d10/d17/d23/d2e/d31/f34 536743 0 2024-09-12T22:33:14.041 INFO:tasks.workunit.client.0.smithi019.stdout:4/308: fsync d1/d11/d15/f2b 0 2024-09-12T22:33:14.041 INFO:tasks.workunit.client.0.smithi019.stdout:5/450: creat d0/d7/d90/f98 x:0 0 0 2024-09-12T22:33:14.042 INFO:tasks.workunit.client.0.smithi019.stdout:2/331: getdents d0 0 2024-09-12T22:33:14.042 INFO:tasks.workunit.client.0.smithi019.stdout:8/282: getdents d7/d8 0 2024-09-12T22:33:14.043 INFO:tasks.workunit.client.0.smithi019.stdout:2/332: mkdir d0/da/d73 0 2024-09-12T22:33:14.043 INFO:tasks.workunit.client.0.smithi019.stdout:9/310: mkdir dd/d10/d17/d23/d2e/d31/d3f/d67 0 2024-09-12T22:33:14.043 INFO:tasks.workunit.client.0.smithi019.stdout:0/328: dread d1/d51/f56 [0,4194304] 0 2024-09-12T22:33:14.044 INFO:tasks.workunit.client.0.smithi019.stdout:4/309: rename d1/d4/d38/c46 to d1/d11/d15/d49/c61 0 2024-09-12T22:33:14.044 INFO:tasks.workunit.client.0.smithi019.stdout:2/333: mkdir d0/d5/d60/d74 0 2024-09-12T22:33:14.044 INFO:tasks.workunit.client.0.smithi019.stdout:8/283: creat d7/d5e/f60 x:0 0 0 2024-09-12T22:33:14.045 INFO:tasks.workunit.client.0.smithi019.stdout:5/451: link d0/dc/d39/d38/f62 d0/dc/d39/d38/d4b/f99 0 2024-09-12T22:33:14.045 INFO:tasks.workunit.client.0.smithi019.stdout:0/329: creat d1/f65 x:0 0 0 2024-09-12T22:33:14.045 INFO:tasks.workunit.client.0.smithi019.stdout:9/311: symlink dd/d10/d17/d22/d42/l68 0 2024-09-12T22:33:14.046 INFO:tasks.workunit.client.0.smithi019.stdout:5/452: rmdir d0/d7/d16 39 2024-09-12T22:33:14.046 INFO:tasks.workunit.client.0.smithi019.stdout:8/284: fdatasync d7/d8/dd/f55 0 2024-09-12T22:33:14.047 INFO:tasks.workunit.client.0.smithi019.stdout:9/312: dread - dd/d10/d17/d22/f4f zero size 2024-09-12T22:33:14.047 INFO:tasks.workunit.client.0.smithi019.stdout:2/334: link d0/l23 d0/d5/d60/d74/l75 0 2024-09-12T22:33:14.048 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:33:14.048 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:33:14.048 INFO:teuthology.orchestra.run.smithi148.stdout: "complaint_time": 30, 2024-09-12T22:33:14.048 INFO:teuthology.orchestra.run.smithi148.stdout: "num_blocked_ops": 0 2024-09-12T22:33:14.048 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:33:14.049 INFO:tasks.workunit.client.0.smithi019.stdout:0/330: creat d1/d14/d26/d40/d45/d5e/f66 x:0 0 0 2024-09-12T22:33:14.049 INFO:tasks.workunit.client.0.smithi019.stdout:8/285: truncate d7/d34/f52 661029 0 2024-09-12T22:33:14.049 INFO:tasks.workunit.client.0.smithi019.stdout:8/286: chown d7 3391828 1 2024-09-12T22:33:14.049 INFO:tasks.workunit.client.0.smithi019.stdout:5/453: fdatasync d0/d7/d16/d18/f81 0 2024-09-12T22:33:14.049 INFO:tasks.workunit.client.0.smithi019.stdout:1/377: dread d3/d11/d16/f60 [0,4194304] 0 2024-09-12T22:33:14.049 INFO:tasks.workunit.client.0.smithi019.stdout:9/313: getdents dd 0 2024-09-12T22:33:14.050 INFO:tasks.workunit.client.0.smithi019.stdout:0/331: truncate d1/d14/d1b/f4b 474099 0 2024-09-12T22:33:14.050 INFO:tasks.workunit.client.0.smithi019.stdout:1/378: fsync d3/d1b/f5d 0 2024-09-12T22:33:14.050 INFO:tasks.workunit.client.0.smithi019.stdout:9/314: fdatasync dd/d10/f4c 0 2024-09-12T22:33:14.050 INFO:tasks.workunit.client.0.smithi019.stdout:8/287: creat d7/d8/dd/d4f/f61 x:0 0 0 2024-09-12T22:33:14.051 INFO:tasks.workunit.client.0.smithi019.stdout:4/310: dwrite d1/d11/d15/d1f/f52 [0,4194304] 0 2024-09-12T22:33:14.051 INFO:tasks.workunit.client.0.smithi019.stdout:2/335: link d0/d5/f22 d0/d5/d18/d5c/d63/d6a/f76 0 2024-09-12T22:33:14.051 INFO:tasks.workunit.client.0.smithi019.stdout:0/332: mkdir d1/d51/d67 0 2024-09-12T22:33:14.051 INFO:tasks.workunit.client.0.smithi019.stdout:1/379: mknod d3/c81 0 2024-09-12T22:33:14.051 INFO:tasks.workunit.client.0.smithi019.stdout:4/311: readlink d1/d8/l1a 0 2024-09-12T22:33:14.052 INFO:tasks.workunit.client.0.smithi019.stdout:8/288: unlink d7/d8/df/d2d/l3f 0 2024-09-12T22:33:14.052 INFO:tasks.workunit.client.0.smithi019.stdout:9/315: mkdir dd/d10/d17/d23/d52/d53/d69 0 2024-09-12T22:33:14.053 INFO:tasks.workunit.client.0.smithi019.stdout:2/336: mkdir d0/d5/d18/d5c/d67/d77 0 2024-09-12T22:33:14.053 INFO:tasks.workunit.client.0.smithi019.stdout:4/312: chown d1/d22/d26/f37 390 1 2024-09-12T22:33:14.053 INFO:tasks.workunit.client.0.smithi019.stdout:8/289: unlink d7/f27 0 2024-09-12T22:33:14.054 INFO:tasks.workunit.client.0.smithi019.stdout:4/313: symlink d1/d22/d31/l62 0 2024-09-12T22:33:14.054 INFO:tasks.workunit.client.0.smithi019.stdout:2/337: write d0/d5/d18/f20 [3271772,120514] 0 2024-09-12T22:33:14.054 INFO:tasks.workunit.client.0.smithi019.stdout:8/290: write d7/d8/df/f1a [460890,110204] 0 2024-09-12T22:33:14.055 INFO:tasks.workunit.client.0.smithi019.stdout:9/316: truncate dd/d10/d17/d22/f4f 698899 0 2024-09-12T22:33:14.056 INFO:tasks.workunit.client.0.smithi019.stdout:4/314: mknod d1/d11/d15/c63 0 2024-09-12T22:33:14.056 INFO:tasks.workunit.client.0.smithi019.stdout:2/338: fsync d0/d5/d17/f14 0 2024-09-12T22:33:14.058 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:33:14.059 INFO:tasks.workunit.client.0.smithi019.stdout:4/315: write d1/d22/d26/f29 [5231363,99116] 0 2024-09-12T22:33:14.059 INFO:tasks.workunit.client.0.smithi019.stdout:2/339: creat d0/d5/d18/d5c/f78 x:0 0 0 2024-09-12T22:33:14.060 INFO:tasks.workunit.client.0.smithi019.stdout:1/380: dwrite d3/d1b/f26 [0,4194304] 0 2024-09-12T22:33:14.061 INFO:tasks.workunit.client.0.smithi019.stdout:8/291: fdatasync d7/f59 0 2024-09-12T22:33:14.061 INFO:tasks.workunit.client.0.smithi019.stdout:3/283: sync 2024-09-12T22:33:14.061 INFO:tasks.workunit.client.0.smithi019.stdout:1/381: sync 2024-09-12T22:33:14.063 INFO:tasks.workunit.client.0.smithi019.stdout:1/382: truncate d3/d11/d16/d23/f71 489172 0 2024-09-12T22:33:14.063 INFO:tasks.workunit.client.0.smithi019.stdout:8/292: symlink d7/l62 0 2024-09-12T22:33:14.064 INFO:tasks.workunit.client.0.smithi019.stdout:2/340: write d0/d5/d18/d1b/d36/f4a [342104,117582] 0 2024-09-12T22:33:14.065 INFO:tasks.workunit.client.0.smithi019.stdout:3/284: rename dd/f44 to dd/d12/f52 0 2024-09-12T22:33:14.065 INFO:tasks.workunit.client.0.smithi019.stdout:1/383: fsync d3/d11/f47 0 2024-09-12T22:33:14.065 INFO:tasks.workunit.client.0.smithi019.stdout:8/293: chown d7/d8/dd/f58 6 1 2024-09-12T22:33:14.066 INFO:tasks.workunit.client.0.smithi019.stdout:1/384: readlink d3/d3f/d58/l65 0 2024-09-12T22:33:14.066 INFO:tasks.workunit.client.0.smithi019.stdout:2/341: rename d0/c15 to d0/d5/d18/d5c/d67/c79 0 2024-09-12T22:33:14.066 INFO:tasks.workunit.client.0.smithi019.stdout:1/385: creat d3/d11/d53/f82 x:0 0 0 2024-09-12T22:33:14.067 INFO:tasks.workunit.client.0.smithi019.stdout:1/386: rename d3/d11/f35 to d3/d11/d16/d3c/d55/f83 0 2024-09-12T22:33:14.068 INFO:tasks.workunit.client.0.smithi019.stdout:1/387: truncate d3/d3f/f30 1035360 0 2024-09-12T22:33:14.068 INFO:tasks.workunit.client.0.smithi019.stdout:2/342: creat d0/d5/d18/d5c/d63/d6a/f7a x:0 0 0 2024-09-12T22:33:14.069 INFO:tasks.workunit.client.0.smithi019.stdout:1/388: readlink d3/d11/d16/d23/d54/l78 0 2024-09-12T22:33:14.069 INFO:tasks.workunit.client.0.smithi019.stdout:2/343: write d0/d5/d18/f56 [4286938,40591] 0 2024-09-12T22:33:14.070 INFO:tasks.workunit.client.0.smithi019.stdout:1/389: dread - d3/d11/d53/f6d zero size 2024-09-12T22:33:14.070 INFO:tasks.workunit.client.0.smithi019.stdout:8/294: read d7/d8/df/f20 [1309497,117541] 0 2024-09-12T22:33:14.071 INFO:tasks.workunit.client.0.smithi019.stdout:1/390: chown d3/d1b/f1d 977134 1 2024-09-12T22:33:14.071 INFO:tasks.workunit.client.0.smithi019.stdout:8/295: rename d7/d2f to d7/d2f/d63 22 2024-09-12T22:33:14.071 INFO:tasks.workunit.client.0.smithi019.stdout:7/292: dread d6/d14/d15/f22 [0,4194304] 0 2024-09-12T22:33:14.071 INFO:tasks.workunit.client.0.smithi019.stdout:9/317: dread dd/d10/d17/d23/f49 [0,4194304] 0 2024-09-12T22:33:14.073 INFO:tasks.workunit.client.0.smithi019.stdout:8/296: rmdir d7/d8/df/d53 39 2024-09-12T22:33:14.073 INFO:tasks.workunit.client.0.smithi019.stdout:2/344: write d0/d5/d18/d5c/d63/d6a/f76 [4187457,67478] 0 2024-09-12T22:33:14.073 INFO:tasks.workunit.client.0.smithi019.stdout:8/297: stat d7/d2f/c5c 0 2024-09-12T22:33:14.073 INFO:tasks.workunit.client.0.smithi019.stdout:9/318: creat dd/d10/d17/d22/f6a x:0 0 0 2024-09-12T22:33:14.073 INFO:tasks.workunit.client.0.smithi019.stdout:7/293: creat d6/d14/d15/d23/f72 x:0 0 0 2024-09-12T22:33:14.073 INFO:tasks.workunit.client.0.smithi019.stdout:2/345: unlink d0/d5/d18/d1b/f55 0 2024-09-12T22:33:14.075 INFO:tasks.workunit.client.0.smithi019.stdout:8/298: stat d7/d8/dd/d4f/f4b 0 2024-09-12T22:33:14.075 INFO:tasks.workunit.client.0.smithi019.stdout:9/319: mkdir dd/d10/d6b 0 2024-09-12T22:33:14.075 INFO:tasks.workunit.client.0.smithi019.stdout:7/294: write d6/d14/d15/f22 [3227566,75507] 0 2024-09-12T22:33:14.075 INFO:tasks.workunit.client.0.smithi019.stdout:8/299: creat d7/d8/f64 x:0 0 0 2024-09-12T22:33:14.075 INFO:tasks.workunit.client.0.smithi019.stdout:6/355: dread d1b/d26/d39/f41 [0,4194304] 0 2024-09-12T22:33:14.076 INFO:tasks.workunit.client.0.smithi019.stdout:9/320: getdents dd 0 2024-09-12T22:33:14.076 INFO:tasks.workunit.client.0.smithi019.stdout:2/346: creat d0/d5/d18/d5c/d67/d77/f7b x:0 0 0 2024-09-12T22:33:14.076 INFO:tasks.workunit.client.0.smithi019.stdout:8/300: write d7/d8/f2e [2220182,120258] 0 2024-09-12T22:33:14.076 INFO:tasks.workunit.client.0.smithi019.stdout:7/295: rename d6/l54 to d6/d2d/d41/l73 0 2024-09-12T22:33:14.076 INFO:tasks.workunit.client.0.smithi019.stdout:1/391: dread d3/f14 [0,4194304] 0 2024-09-12T22:33:14.077 INFO:tasks.workunit.client.0.smithi019.stdout:7/296: mknod d6/d14/d15/d62/c74 0 2024-09-12T22:33:14.078 INFO:tasks.workunit.client.0.smithi019.stdout:8/301: getdents d7/d8/dd/d45 0 2024-09-12T22:33:14.078 INFO:tasks.workunit.client.0.smithi019.stdout:7/297: rmdir d6/d14/d15/d23 39 2024-09-12T22:33:14.078 INFO:tasks.workunit.client.0.smithi019.stdout:1/392: symlink d3/d11/d16/d23/d54/l84 0 2024-09-12T22:33:14.078 INFO:tasks.workunit.client.0.smithi019.stdout:8/302: dread - d7/d34/f3e zero size 2024-09-12T22:33:14.079 INFO:tasks.workunit.client.0.smithi019.stdout:6/356: dwrite d1b/f20 [4194304,4194304] 0 2024-09-12T22:33:14.080 INFO:tasks.workunit.client.0.smithi019.stdout:7/298: chown d6/d14/d15/d23/c32 250024 1 2024-09-12T22:33:14.081 INFO:tasks.workunit.client.0.smithi019.stdout:8/303: rename d7/d8/df/c40 to d7/d8/df/d2d/c65 0 2024-09-12T22:33:14.082 INFO:tasks.workunit.client.0.smithi019.stdout:6/357: chown d1b/d26/d31/c73 0 1 2024-09-12T22:33:14.082 INFO:tasks.workunit.client.0.smithi019.stdout:8/304: symlink d7/l66 0 2024-09-12T22:33:14.083 INFO:tasks.workunit.client.0.smithi019.stdout:6/358: write d1b/d26/d39/d6a/f60 [606231,12072] 0 2024-09-12T22:33:14.084 INFO:tasks.workunit.client.0.smithi019.stdout:0/333: sync 2024-09-12T22:33:14.084 INFO:tasks.workunit.client.0.smithi019.stdout:5/454: sync 2024-09-12T22:33:14.084 INFO:tasks.workunit.client.0.smithi019.stdout:4/316: sync 2024-09-12T22:33:14.084 INFO:tasks.workunit.client.0.smithi019.stdout:3/285: sync 2024-09-12T22:33:14.085 INFO:tasks.workunit.client.0.smithi019.stdout:1/393: dwrite d3/d11/d16/d3c/f70 [0,4194304] 0 2024-09-12T22:33:14.086 INFO:tasks.workunit.client.0.smithi019.stdout:5/455: readlink d0/d7/d2d/l4d 0 2024-09-12T22:33:14.087 INFO:tasks.workunit.client.0.smithi019.stdout:3/286: dread - dd/d1e/d40/f47 zero size 2024-09-12T22:33:14.087 INFO:tasks.workunit.client.0.smithi019.stdout:4/317: creat d1/d8/f64 x:0 0 0 2024-09-12T22:33:14.088 INFO:tasks.workunit.client.0.smithi019.stdout:1/394: creat d3/d11/d63/f85 x:0 0 0 2024-09-12T22:33:14.088 INFO:tasks.workunit.client.0.smithi019.stdout:0/334: creat d1/d14/d26/d40/d45/d5e/f68 x:0 0 0 2024-09-12T22:33:14.089 INFO:tasks.workunit.client.0.smithi019.stdout:5/456: write d0/d7/d16/d18/f52 [748841,20000] 0 2024-09-12T22:33:14.089 INFO:tasks.workunit.client.0.smithi019.stdout:1/395: readlink d3/d11/d16/d23/d54/l78 0 2024-09-12T22:33:14.090 INFO:tasks.workunit.client.0.smithi019.stdout:0/335: chown d1/d51/l59 744 1 2024-09-12T22:33:14.090 INFO:tasks.workunit.client.0.smithi019.stdout:9/321: dread dd/d10/d17/f24 [8388608,4194304] 0 2024-09-12T22:33:14.091 INFO:tasks.workunit.client.0.smithi019.stdout:5/457: mkdir d0/dc/d9a 0 2024-09-12T22:33:14.091 INFO:tasks.workunit.client.0.smithi019.stdout:1/396: chown d3/df/f41 115 1 2024-09-12T22:33:14.092 INFO:tasks.workunit.client.0.smithi019.stdout:0/336: mkdir d1/d14/d1b/d3a/d69 0 2024-09-12T22:33:14.092 INFO:tasks.workunit.client.0.smithi019.stdout:5/458: dread - d0/f75 zero size 2024-09-12T22:33:14.092 INFO:tasks.workunit.client.0.smithi019.stdout:6/359: dwrite d1b/f6e [0,4194304] 0 2024-09-12T22:33:14.092 INFO:tasks.workunit.client.0.smithi019.stdout:8/305: dwrite d7/d8/f2e [4194304,4194304] 0 2024-09-12T22:33:14.093 INFO:tasks.workunit.client.0.smithi019.stdout:1/397: creat d3/d11/d16/f86 x:0 0 0 2024-09-12T22:33:14.093 INFO:tasks.workunit.client.0.smithi019.stdout:0/337: rmdir d1/d14/d1b 39 2024-09-12T22:33:14.093 INFO:tasks.workunit.client.0.smithi019.stdout:5/459: symlink d0/dc/d9a/l9b 0 2024-09-12T22:33:14.094 INFO:tasks.workunit.client.0.smithi019.stdout:1/398: chown d3/d11/d63/d76 97 1 2024-09-12T22:33:14.094 INFO:tasks.workunit.client.0.smithi019.stdout:8/306: rename d7/f36 to d7/d8/dd/f67 0 2024-09-12T22:33:14.095 INFO:tasks.workunit.client.0.smithi019.stdout:9/322: dread dd/d10/d17/d22/d42/f55 [0,4194304] 0 2024-09-12T22:33:14.095 INFO:tasks.workunit.client.0.smithi019.stdout:6/360: truncate d1b/d26/d39/d6a/f60 881032 0 2024-09-12T22:33:14.095 INFO:tasks.workunit.client.0.smithi019.stdout:0/338: rename d1/d1f/f33 to d1/d14/d32/d3d/f6a 0 2024-09-12T22:33:14.096 INFO:tasks.workunit.client.0.smithi019.stdout:6/361: chown d1b/d26/d27/d3e/f79 398 1 2024-09-12T22:33:14.096 INFO:tasks.workunit.client.0.smithi019.stdout:1/399: creat d3/d6e/f87 x:0 0 0 2024-09-12T22:33:14.097 INFO:tasks.workunit.client.0.smithi019.stdout:6/362: mknod d1b/d2d/c7a 0 2024-09-12T22:33:14.098 INFO:tasks.workunit.client.0.smithi019.stdout:1/400: unlink d3/d1b/f26 0 2024-09-12T22:33:14.099 INFO:tasks.workunit.client.0.smithi019.stdout:6/363: mkdir d1b/d26/d27/d67/d77/d7b 0 2024-09-12T22:33:14.100 INFO:tasks.workunit.client.0.smithi019.stdout:1/401: fdatasync d3/d11/d16/f38 0 2024-09-12T22:33:14.101 INFO:tasks.workunit.client.0.smithi019.stdout:5/460: dwrite d0/d7/d16/d18/f57 [0,4194304] 0 2024-09-12T22:33:14.101 INFO:tasks.workunit.client.0.smithi019.stdout:8/307: dwrite d7/d34/f51 [0,4194304] 0 2024-09-12T22:33:14.101 INFO:tasks.workunit.client.0.smithi019.stdout:6/364: chown d1b/d26/d27/f54 59 1 2024-09-12T22:33:14.102 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:14.101+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:14.102 INFO:tasks.workunit.client.0.smithi019.stdout:0/339: dwrite d1/f1a [0,4194304] 0 2024-09-12T22:33:14.103 INFO:tasks.workunit.client.0.smithi019.stdout:1/402: symlink d3/df/d7e/l88 0 2024-09-12T22:33:14.103 INFO:tasks.workunit.client.0.smithi019.stdout:5/461: chown d0/dc/d39 6020214 1 2024-09-12T22:33:14.103 INFO:tasks.workunit.client.0.smithi019.stdout:5/462: stat d0/dc/d39/d38/f55 0 2024-09-12T22:33:14.103 INFO:tasks.workunit.client.0.smithi019.stdout:6/365: write d1b/d26/d27/d3e/f49 [1855469,97550] 0 2024-09-12T22:33:14.105 INFO:tasks.workunit.client.0.smithi019.stdout:1/403: mknod d3/d11/d16/d23/c89 0 2024-09-12T22:33:14.105 INFO:tasks.workunit.client.0.smithi019.stdout:3/287: truncate dd/f17 348908 0 2024-09-12T22:33:14.106 INFO:tasks.workunit.client.0.smithi019.stdout:1/404: write d3/d3f/f30 [40916,75278] 0 2024-09-12T22:33:14.107 INFO:tasks.workunit.client.0.smithi019.stdout:3/288: mknod dd/d12/c53 0 2024-09-12T22:33:14.108 INFO:tasks.workunit.client.0.smithi019.stdout:5/463: rename d0/d7/d90/l96 to d0/d7/d16/d69/l9c 0 2024-09-12T22:33:14.109 INFO:tasks.workunit.client.0.smithi019.stdout:1/405: write d3/f4d [859858,2650] 0 2024-09-12T22:33:14.110 INFO:tasks.workunit.client.0.smithi019.stdout:3/289: chown dd/d1e/f37 14399 1 2024-09-12T22:33:14.111 INFO:tasks.workunit.client.0.smithi019.stdout:8/308: dwrite d7/d8/df/f20 [4194304,4194304] 0 2024-09-12T22:33:14.112 INFO:tasks.workunit.client.0.smithi019.stdout:5/464: chown d0/dc/d39/d38/f6e 9 1 2024-09-12T22:33:14.113 INFO:tasks.workunit.client.0.smithi019.stdout:6/366: dwrite d1b/d26/d39/f41 [0,4194304] 0 2024-09-12T22:33:14.114 INFO:tasks.workunit.client.0.smithi019.stdout:3/290: unlink dd/d12/c49 0 2024-09-12T22:33:14.114 INFO:tasks.workunit.client.0.smithi019.stdout:5/465: rmdir d0/dc/d9a 39 2024-09-12T22:33:14.114 INFO:tasks.workunit.client.0.smithi019.stdout:6/367: symlink d1b/d2d/l7c 0 2024-09-12T22:33:14.115 INFO:tasks.workunit.client.0.smithi019.stdout:3/291: chown dd/d12 333 1 2024-09-12T22:33:14.115 INFO:tasks.workunit.client.0.smithi019.stdout:0/340: dwrite d1/d14/f22 [0,4194304] 0 2024-09-12T22:33:14.115 INFO:tasks.workunit.client.0.smithi019.stdout:1/406: rename d3/d3f/d58/f5f to d3/d11/d63/d76/f8a 0 2024-09-12T22:33:14.116 INFO:tasks.workunit.client.0.smithi019.stdout:5/466: unlink d0/dc/d39/d38/d4b/l53 0 2024-09-12T22:33:14.117 INFO:tasks.workunit.client.0.smithi019.stdout:0/341: dread - d1/d14/d1b/f44 zero size 2024-09-12T22:33:14.117 INFO:tasks.workunit.client.0.smithi019.stdout:1/407: creat d3/d6e/d7d/f8b x:0 0 0 2024-09-12T22:33:14.118 INFO:tasks.workunit.client.0.smithi019.stdout:8/309: dread d7/f19 [0,4194304] 0 2024-09-12T22:33:14.118 INFO:tasks.workunit.client.0.smithi019.stdout:3/292: getdents dd/d1e 0 2024-09-12T22:33:14.118 INFO:tasks.workunit.client.0.smithi019.stdout:1/408: dread - d3/d11/d53/f82 zero size 2024-09-12T22:33:14.118 INFO:tasks.workunit.client.0.smithi019.stdout:0/342: stat d1/d14/l3f 0 2024-09-12T22:33:14.119 INFO:tasks.workunit.client.0.smithi019.stdout:5/467: write d0/d7/d16/d18/f73 [944603,26420] 0 2024-09-12T22:33:14.119 INFO:tasks.workunit.client.0.smithi019.stdout:1/409: symlink d3/df/l8c 0 2024-09-12T22:33:14.120 INFO:tasks.workunit.client.0.smithi019.stdout:2/347: sync 2024-09-12T22:33:14.120 INFO:tasks.workunit.client.0.smithi019.stdout:4/318: sync 2024-09-12T22:33:14.120 INFO:tasks.workunit.client.0.smithi019.stdout:3/293: write dd/f13 [2694450,126732] 0 2024-09-12T22:33:14.121 INFO:tasks.workunit.client.0.smithi019.stdout:5/468: write d0/f7e [2976617,47498] 0 2024-09-12T22:33:14.122 INFO:tasks.workunit.client.0.smithi019.stdout:0/343: write d1/d14/d26/f50 [2038138,14819] 0 2024-09-12T22:33:14.122 INFO:tasks.workunit.client.0.smithi019.stdout:4/319: chown d1/l17 1440 1 2024-09-12T22:33:14.123 INFO:tasks.workunit.client.0.smithi019.stdout:2/348: write d0/d5/d18/d39/f44 [1021008,96764] 0 2024-09-12T22:33:14.123 INFO:tasks.workunit.client.0.smithi019.stdout:6/368: dwrite d1b/d26/d39/f65 [0,4194304] 0 2024-09-12T22:33:14.123 INFO:tasks.workunit.client.0.smithi019.stdout:1/410: truncate d3/d11/d16/f3b 3031770 0 2024-09-12T22:33:14.124 INFO:tasks.workunit.client.0.smithi019.stdout:0/344: truncate d1/d14/d32/f43 5039123 0 2024-09-12T22:33:14.125 INFO:tasks.workunit.client.0.smithi019.stdout:2/349: mkdir d0/da/d73/d7c 0 2024-09-12T22:33:14.125 INFO:tasks.workunit.client.0.smithi019.stdout:4/320: getdents d1/d22/d26 0 2024-09-12T22:33:14.125 INFO:tasks.workunit.client.0.smithi019.stdout:6/369: creat d1b/f7d x:0 0 0 2024-09-12T22:33:14.125 INFO:tasks.workunit.client.0.smithi019.stdout:0/345: chown d1/d14/d26/d40/d45/l5d 2 1 2024-09-12T22:33:14.125 INFO:tasks.workunit.client.0.smithi019.stdout:2/350: readlink d0/d5/d18/d3b/l3c 0 2024-09-12T22:33:14.126 INFO:tasks.workunit.client.0.smithi019.stdout:4/321: chown d1/d11/d15/d4e 61068817 1 2024-09-12T22:33:14.126 INFO:tasks.workunit.client.0.smithi019.stdout:4/322: dread - d1/d8/f64 zero size 2024-09-12T22:33:14.126 INFO:tasks.workunit.client.0.smithi019.stdout:0/346: unlink d1/d14/d32/d3d/f6a 0 2024-09-12T22:33:14.127 INFO:tasks.workunit.client.0.smithi019.stdout:6/370: getdents d1b/d2d 0 2024-09-12T22:33:14.127 INFO:tasks.workunit.client.0.smithi019.stdout:2/351: write d0/da/f50 [5004095,81787] 0 2024-09-12T22:33:14.127 INFO:tasks.workunit.client.0.smithi019.stdout:4/323: mkdir d1/d11/d15/d65 0 2024-09-12T22:33:14.129 INFO:tasks.workunit.client.0.smithi019.stdout:0/347: symlink d1/d14/d32/d3d/l6b 0 2024-09-12T22:33:14.130 INFO:tasks.workunit.client.0.smithi019.stdout:7/299: dread d6/db/f3b [0,4194304] 0 2024-09-12T22:33:14.130 INFO:tasks.workunit.client.0.smithi019.stdout:0/348: rmdir d1/d14/d32/d3d 39 2024-09-12T22:33:14.130 INFO:tasks.workunit.client.0.smithi019.stdout:4/324: truncate d1/d22/f33 879303 0 2024-09-12T22:33:14.131 INFO:tasks.workunit.client.0.smithi019.stdout:1/411: dwrite d3/d11/d16/d3c/d55/f62 [0,4194304] 0 2024-09-12T22:33:14.131 INFO:tasks.workunit.client.0.smithi019.stdout:0/349: creat d1/d51/f6c x:0 0 0 2024-09-12T22:33:14.131 INFO:tasks.workunit.client.0.smithi019.stdout:4/325: mknod d1/d22/d31/c66 0 2024-09-12T22:33:14.132 INFO:tasks.workunit.client.0.smithi019.stdout:7/300: getdents d6/d14/d15/d62 0 2024-09-12T22:33:14.132 INFO:tasks.workunit.client.0.smithi019.stdout:0/350: symlink d1/d14/d26/d40/l6d 0 2024-09-12T22:33:14.132 INFO:tasks.workunit.client.0.smithi019.stdout:4/326: fdatasync d1/d22/d2c/f40 0 2024-09-12T22:33:14.132 INFO:tasks.workunit.client.0.smithi019.stdout:1/412: write d3/d11/d53/f5b [1293249,40975] 0 2024-09-12T22:33:14.133 INFO:tasks.workunit.client.0.smithi019.stdout:1/413: write d3/d11/d16/f73 [311109,13096] 0 2024-09-12T22:33:14.133 INFO:tasks.workunit.client.0.smithi019.stdout:4/327: write d1/d11/d15/f2b [271597,19377] 0 2024-09-12T22:33:14.134 INFO:tasks.workunit.client.0.smithi019.stdout:1/414: write d3/f69 [3838,71021] 0 2024-09-12T22:33:14.136 INFO:tasks.workunit.client.0.smithi019.stdout:5/469: write d0/f6 [2236432,59886] 0 2024-09-12T22:33:14.136 INFO:tasks.workunit.client.0.smithi019.stdout:1/415: link d3/d11/d63/d76/l7a d3/d11/l8d 0 2024-09-12T22:33:14.137 INFO:tasks.workunit.client.0.smithi019.stdout:5/470: mkdir d0/d7/d16/d18/d9d 0 2024-09-12T22:33:14.138 INFO:tasks.workunit.client.0.smithi019.stdout:4/328: dread d1/d11/d15/d1f/f52 [0,4194304] 0 2024-09-12T22:33:14.138 INFO:tasks.workunit.client.0.smithi019.stdout:5/471: fdatasync d0/d7/d2d/f61 0 2024-09-12T22:33:14.138 INFO:tasks.workunit.client.0.smithi019.stdout:4/329: readlink d1/d11/d15/l58 0 2024-09-12T22:33:14.139 INFO:tasks.workunit.client.0.smithi019.stdout:4/330: stat d1/d22/d31/d4f 0 2024-09-12T22:33:14.139 INFO:tasks.workunit.client.0.smithi019.stdout:6/371: write f0 [1531862,60793] 0 2024-09-12T22:33:14.140 INFO:tasks.workunit.client.0.smithi019.stdout:4/331: rmdir d1/d22/d26 39 2024-09-12T22:33:14.142 INFO:tasks.workunit.client.0.smithi019.stdout:0/351: dread d1/d14/d1b/f4b [0,4194304] 0 2024-09-12T22:33:14.143 INFO:tasks.workunit.client.0.smithi019.stdout:9/323: dread dd/d10/d17/d23/d2e/d31/d3f/d47/f4e [0,4194304] 0 2024-09-12T22:33:14.144 INFO:tasks.workunit.client.0.smithi019.stdout:5/472: dread d0/dc/d39/d38/d4b/f99 [0,4194304] 0 2024-09-12T22:33:14.145 INFO:tasks.workunit.client.0.smithi019.stdout:1/416: dwrite d3/d6e/d7d/f8b [0,4194304] 0 2024-09-12T22:33:14.145 INFO:tasks.workunit.client.0.smithi019.stdout:9/324: write dd/d10/f19 [595157,23798] 0 2024-09-12T22:33:14.145 INFO:tasks.workunit.client.0.smithi019.stdout:0/352: truncate d1/d1f/f39 820719 0 2024-09-12T22:33:14.146 INFO:tasks.workunit.client.0.smithi019.stdout:7/301: sync 2024-09-12T22:33:14.147 INFO:tasks.workunit.client.0.smithi019.stdout:0/353: write d1/d14/d26/f50 [1194652,119058] 0 2024-09-12T22:33:14.148 INFO:tasks.workunit.client.0.smithi019.stdout:5/473: link d0/dc/d39/d38/f44 d0/d7/d16/d18/f9e 0 2024-09-12T22:33:14.149 INFO:tasks.workunit.client.0.smithi019.stdout:9/325: rename dd/d10/d17/d23/d52 to dd/d10/d17/d22/d6c 0 2024-09-12T22:33:14.149 INFO:tasks.workunit.client.0.smithi019.stdout:7/302: creat d6/d14/d15/d62/d6a/f75 x:0 0 0 2024-09-12T22:33:14.149 INFO:tasks.workunit.client.0.smithi019.stdout:4/332: dwrite d1/d4/d44/f54 [0,4194304] 0 2024-09-12T22:33:14.150 INFO:tasks.workunit.client.0.smithi019.stdout:0/354: creat d1/d14/d32/f6e x:0 0 0 2024-09-12T22:33:14.150 INFO:tasks.workunit.client.0.smithi019.stdout:9/326: readlink dd/d10/d17/l3c 0 2024-09-12T22:33:14.150 INFO:tasks.workunit.client.0.smithi019.stdout:5/474: creat d0/d7/d2d/d32/d36/d8c/d8f/f9f x:0 0 0 2024-09-12T22:33:14.151 INFO:tasks.workunit.client.0.smithi019.stdout:9/327: write dd/d10/f14 [800600,62646] 0 2024-09-12T22:33:14.151 INFO:tasks.workunit.client.0.smithi019.stdout:7/303: rename d6/d2d/d41/c53 to d6/d14/d2a/c76 0 2024-09-12T22:33:14.152 INFO:tasks.workunit.client.0.smithi019.stdout:1/417: read d3/df/f48 [415356,87730] 0 2024-09-12T22:33:14.152 INFO:tasks.workunit.client.0.smithi019.stdout:4/333: mknod d1/d11/d15/d65/c67 0 2024-09-12T22:33:14.152 INFO:tasks.workunit.client.0.smithi019.stdout:6/372: dread d1b/d26/f36 [0,4194304] 0 2024-09-12T22:33:14.152 INFO:tasks.workunit.client.0.smithi019.stdout:0/355: getdents d1/d14 0 2024-09-12T22:33:14.153 INFO:tasks.workunit.client.0.smithi019.stdout:7/304: mkdir d6/d2d/d77 0 2024-09-12T22:33:14.154 INFO:tasks.workunit.client.0.smithi019.stdout:5/475: chown d0/dc/d39/d38/d4b/f8b 579 1 2024-09-12T22:33:14.154 INFO:tasks.workunit.client.0.smithi019.stdout:6/373: write d1b/d2d/f48 [58830,61565] 0 2024-09-12T22:33:14.154 INFO:tasks.workunit.client.0.smithi019.stdout:9/328: creat dd/d10/d17/d23/d2e/d31/f6d x:0 0 0 2024-09-12T22:33:14.154 INFO:tasks.workunit.client.0.smithi019.stdout:0/356: write d1/d14/f1e [4113479,77011] 0 2024-09-12T22:33:14.155 INFO:tasks.workunit.client.0.smithi019.stdout:4/334: unlink d1/d22/d2c/c41 0 2024-09-12T22:33:14.155 INFO:tasks.workunit.client.0.smithi019.stdout:9/329: write dd/d10/f19 [4478123,29294] 0 2024-09-12T22:33:14.156 INFO:tasks.workunit.client.0.smithi019.stdout:4/335: chown d1/d22/c3e 8010 1 2024-09-12T22:33:14.157 INFO:tasks.workunit.client.0.smithi019.stdout:7/305: mknod d6/db/dc/d63/d4b/c78 0 2024-09-12T22:33:14.157 INFO:tasks.workunit.client.0.smithi019.stdout:0/357: fsync d1/d1f/f41 0 2024-09-12T22:33:14.157 INFO:tasks.workunit.client.0.smithi019.stdout:9/330: mkdir dd/d10/d17/d23/d2e/d31/d3f/d47/d6e 0 2024-09-12T22:33:14.157 INFO:tasks.workunit.client.0.smithi019.stdout:6/374: creat d1b/d26/f7e x:0 0 0 2024-09-12T22:33:14.158 INFO:tasks.workunit.client.0.smithi019.stdout:1/418: dread d3/df/f48 [0,4194304] 0 2024-09-12T22:33:14.159 INFO:tasks.workunit.client.0.smithi019.stdout:4/336: creat d1/d22/f68 x:0 0 0 2024-09-12T22:33:14.159 INFO:tasks.workunit.client.0.smithi019.stdout:3/294: dread dd/f11 [0,4194304] 0 2024-09-12T22:33:14.159 INFO:tasks.workunit.client.0.smithi019.stdout:9/331: fdatasync dd/d10/f4c 0 2024-09-12T22:33:14.159 INFO:tasks.workunit.client.0.smithi019.stdout:6/375: creat d1b/d26/d39/f7f x:0 0 0 2024-09-12T22:33:14.159 INFO:tasks.workunit.client.0.smithi019.stdout:6/376: sync 2024-09-12T22:33:14.160 INFO:tasks.workunit.client.0.smithi019.stdout:7/306: write d6/d14/d15/f5e [631374,38739] 0 2024-09-12T22:33:14.160 INFO:tasks.workunit.client.0.smithi019.stdout:1/419: creat d3/d1b/f8e x:0 0 0 2024-09-12T22:33:14.161 INFO:tasks.workunit.client.0.smithi019.stdout:9/332: write dd/d10/f4c [1482427,125663] 0 2024-09-12T22:33:14.161 INFO:tasks.workunit.client.0.smithi019.stdout:1/420: stat d3/d11/d16/f38 0 2024-09-12T22:33:14.161 INFO:tasks.workunit.client.0.smithi019.stdout:3/295: link dd/d1e/f34 dd/d1e/f54 0 2024-09-12T22:33:14.162 INFO:tasks.workunit.client.0.smithi019.stdout:5/476: dwrite d0/d7/d16/d18/f26 [0,4194304] 0 2024-09-12T22:33:14.165 INFO:tasks.workunit.client.0.smithi019.stdout:7/307: creat d6/d2d/d77/f79 x:0 0 0 2024-09-12T22:33:14.166 INFO:tasks.workunit.client.0.smithi019.stdout:1/421: dread - d3/d11/f47 zero size 2024-09-12T22:33:14.166 INFO:tasks.workunit.client.0.smithi019.stdout:2/352: dread d0/d5/d18/f56 [0,4194304] 0 2024-09-12T22:33:14.167 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:14.166+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:14.167 INFO:tasks.workunit.client.0.smithi019.stdout:0/358: dread d1/d1f/f39 [0,4194304] 0 2024-09-12T22:33:14.167 INFO:tasks.workunit.client.0.smithi019.stdout:9/333: write dd/d10/d17/d23/f49 [424312,77430] 0 2024-09-12T22:33:14.169 INFO:tasks.workunit.client.0.smithi019.stdout:2/353: chown d0/d5/d18/d39/f44 421708 1 2024-09-12T22:33:14.169 INFO:tasks.workunit.client.0.smithi019.stdout:4/337: dwrite d1/d11/d15/f2e [4194304,4194304] 0 2024-09-12T22:33:14.169 INFO:tasks.workunit.client.0.smithi019.stdout:8/310: dread d7/f1d [0,4194304] 0 2024-09-12T22:33:14.170 INFO:tasks.workunit.client.0.smithi019.stdout:5/477: mkdir d0/d7/d2d/d32/d36/d6a/da0 0 2024-09-12T22:33:14.172 INFO:tasks.workunit.client.0.smithi019.stdout:9/334: truncate dd/d10/f19 8941962 0 2024-09-12T22:33:14.172 INFO:tasks.workunit.client.0.smithi019.stdout:6/377: dwrite d1b/d26/d39/d6a/d61/f62 [0,4194304] 0 2024-09-12T22:33:14.172 INFO:tasks.workunit.client.0.smithi019.stdout:4/338: unlink d1/d4/d38/l5f 0 2024-09-12T22:33:14.173 INFO:tasks.workunit.client.0.smithi019.stdout:8/311: symlink d7/l68 0 2024-09-12T22:33:14.173 INFO:tasks.workunit.client.0.smithi019.stdout:1/422: getdents d3/d11/d16/d23/d54 0 2024-09-12T22:33:14.174 INFO:tasks.workunit.client.0.smithi019.stdout:3/296: dwrite dd/f11 [0,4194304] 0 2024-09-12T22:33:14.175 INFO:tasks.workunit.client.0.smithi019.stdout:4/339: mknod d1/d22/d26/c69 0 2024-09-12T22:33:14.176 INFO:tasks.workunit.client.0.smithi019.stdout:1/423: symlink d3/d11/d63/l8f 0 2024-09-12T22:33:14.177 INFO:tasks.workunit.client.0.smithi019.stdout:8/312: creat d7/d8/df/d53/f69 x:0 0 0 2024-09-12T22:33:14.178 INFO:tasks.workunit.client.0.smithi019.stdout:3/297: creat dd/d12/f55 x:0 0 0 2024-09-12T22:33:14.179 INFO:tasks.workunit.client.0.smithi019.stdout:0/359: dwrite d1/d14/d32/f6e [0,4194304] 0 2024-09-12T22:33:14.179 INFO:tasks.workunit.client.0.smithi019.stdout:7/308: dwrite d6/f21 [0,4194304] 0 2024-09-12T22:33:14.181 INFO:tasks.workunit.client.0.smithi019.stdout:4/340: symlink d1/d8/l6a 0 2024-09-12T22:33:14.182 INFO:tasks.workunit.client.0.smithi019.stdout:1/424: write d3/d11/d16/d23/f2a [3625368,60111] 0 2024-09-12T22:33:14.183 INFO:tasks.workunit.client.0.smithi019.stdout:5/478: read d0/f37 [974285,16384] 0 2024-09-12T22:33:14.184 INFO:tasks.workunit.client.0.smithi019.stdout:2/354: dread d0/d5/d18/d1b/f4d [0,4194304] 0 2024-09-12T22:33:14.184 INFO:tasks.workunit.client.0.smithi019.stdout:4/341: mkdir d1/d11/d15/d1f/d56/d6b 0 2024-09-12T22:33:14.184 INFO:tasks.workunit.client.0.smithi019.stdout:6/378: dwrite d1b/d2d/f42 [4194304,4194304] 0 2024-09-12T22:33:14.185 INFO:tasks.workunit.client.0.smithi019.stdout:1/425: mkdir d3/df/d7e/d90 0 2024-09-12T22:33:14.185 INFO:tasks.workunit.client.0.smithi019.stdout:3/298: getdents dd/d1e 0 2024-09-12T22:33:14.185 INFO:tasks.workunit.client.0.smithi019.stdout:7/309: rename d6/d14/d2a/c39 to d6/d2d/d77/c7a 0 2024-09-12T22:33:14.185 INFO:tasks.workunit.client.0.smithi019.stdout:8/313: getdents d7/d8/df/d54 0 2024-09-12T22:33:14.187 INFO:tasks.workunit.client.0.smithi019.stdout:4/342: write d1/d22/d2c/f35 [865441,64368] 0 2024-09-12T22:33:14.187 INFO:tasks.workunit.client.0.smithi019.stdout:3/299: dread - dd/f4d zero size 2024-09-12T22:33:14.188 INFO:tasks.workunit.client.0.smithi019.stdout:8/314: rename d7/d34/f51 to d7/d2f/d42/f6a 0 2024-09-12T22:33:14.190 INFO:tasks.workunit.client.0.smithi019.stdout:6/379: truncate d1b/d26/d39/d6a/f60 892468 0 2024-09-12T22:33:14.190 INFO:tasks.workunit.client.0.smithi019.stdout:4/343: unlink d1/d22/d2c/f40 0 2024-09-12T22:33:14.190 INFO:tasks.workunit.client.0.smithi019.stdout:1/426: getdents d3/d3f/d58 0 2024-09-12T22:33:14.190 INFO:tasks.workunit.client.0.smithi019.stdout:3/300: rmdir dd/d12 39 2024-09-12T22:33:14.191 INFO:tasks.workunit.client.0.smithi019.stdout:1/427: chown d3/l4a 1 1 2024-09-12T22:33:14.192 INFO:tasks.workunit.client.0.smithi019.stdout:9/335: dread dd/d10/d17/d23/d2e/d31/f34 [0,4194304] 0 2024-09-12T22:33:14.192 INFO:tasks.workunit.client.0.smithi019.stdout:0/360: dwrite d1/d14/d1b/f4b [0,4194304] 0 2024-09-12T22:33:14.193 INFO:tasks.workunit.client.0.smithi019.stdout:6/380: rename d1b/d26/d27/c4f to d1b/d26/d27/d3e/c80 0 2024-09-12T22:33:14.194 INFO:tasks.workunit.client.0.smithi019.stdout:3/301: chown dd/d1e/f25 14196400 1 2024-09-12T22:33:14.195 INFO:tasks.workunit.client.0.smithi019.stdout:5/479: dwrite d0/dc/f34 [0,4194304] 0 2024-09-12T22:33:14.195 INFO:tasks.workunit.client.0.smithi019.stdout:3/302: chown dd/d1e 1326851 1 2024-09-12T22:33:14.195 INFO:tasks.workunit.client.0.smithi019.stdout:1/428: rename d3/d6e/d7d to d3/d11/d63/d76/d91 0 2024-09-12T22:33:14.196 INFO:tasks.workunit.client.0.smithi019.stdout:6/381: fdatasync d1b/d26/d31/f75 0 2024-09-12T22:33:14.196 INFO:tasks.workunit.client.0.smithi019.stdout:0/361: mknod d1/d14/d26/d40/d45/c6f 0 2024-09-12T22:33:14.197 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:33:14.198 INFO:teuthology.orchestra.run.smithi148.stdout: "size": 20, 2024-09-12T22:33:14.198 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 600, 2024-09-12T22:33:14.198 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [ 2024-09-12T22:33:14.198 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.198 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4490.0:9866 4.b 4:d370243b:::10000002d48.00000000:head [write 0~1308] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:33:14.198 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:09.467883+0000", 2024-09-12T22:33:14.198 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 4.7274237130000003, 2024-09-12T22:33:14.198 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.085024817000000003, 2024-09-12T22:33:14.198 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:14.198 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:14.198 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:14.198 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:33:14.198 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4490", 2024-09-12T22:33:14.199 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:14.199 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 9866 2024-09-12T22:33:14.199 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.199 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:14.199 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.199 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:14.199 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.467883+0000", 2024-09-12T22:33:14.199 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:14.199 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.200 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.200 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:14.200 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.467883+0000", 2024-09-12T22:33:14.200 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:14.200 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.200 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.200 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:14.200 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.467884+0000", 2024-09-12T22:33:14.200 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1800000000000005e-07 2024-09-12T22:33:14.200 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.200 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.200 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:14.201 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.467888+0000", 2024-09-12T22:33:14.201 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5959999999999997e-06 2024-09-12T22:33:14.201 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.201 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.201 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:14.201 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.467896+0000", 2024-09-12T22:33:14.201 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.8679999999999999e-06 2024-09-12T22:33:14.201 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.201 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.201 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:14.201 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.467901+0000", 2024-09-12T22:33:14.202 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9169999999999997e-06 2024-09-12T22:33:14.202 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.202 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.202 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:14.202 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.467944+0000", 2024-09-12T22:33:14.202 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3055e-05 2024-09-12T22:33:14.202 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.202 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.202 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:14.202 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.468011+0000", 2024-09-12T22:33:14.203 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7328000000000003e-05 2024-09-12T22:33:14.203 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.203 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.203 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:14.203 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.468078+0000", 2024-09-12T22:33:14.203 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7063999999999994e-05 2024-09-12T22:33:14.203 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.203 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.203 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:14.203 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.551406+0000", 2024-09-12T22:33:14.203 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.083327485000000007 2024-09-12T22:33:14.203 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.204 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.204 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:14.204 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.552822+0000", 2024-09-12T22:33:14.204 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001415929 2024-09-12T22:33:14.204 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.204 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.204 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:14.204 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.552863+0000", 2024-09-12T22:33:14.204 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0809000000000002e-05 2024-09-12T22:33:14.204 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.205 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.205 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:14.205 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.552908+0000", 2024-09-12T22:33:14.205 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5048e-05 2024-09-12T22:33:14.205 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:14.205 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:14.205 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:14.205 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.205 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.205 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4490.0:9867 4.16 4:6bd8f1b8:::10000002d49.00000000:head [write 0~1599] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:33:14.206 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:09.468760+0000", 2024-09-12T22:33:14.206 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 4.7265467040000004, 2024-09-12T22:33:14.206 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.086660499000000002, 2024-09-12T22:33:14.206 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:14.206 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:14.206 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:14.206 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:33:14.206 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4490", 2024-09-12T22:33:14.206 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:14.206 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 9867 2024-09-12T22:33:14.206 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.207 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:14.207 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.207 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:14.207 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.468760+0000", 2024-09-12T22:33:14.207 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:14.207 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.207 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.207 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:14.207 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.468760+0000", 2024-09-12T22:33:14.207 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:14.207 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.208 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.208 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:14.208 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.468761+0000", 2024-09-12T22:33:14.208 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4399999999999999e-07 2024-09-12T22:33:14.208 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.208 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.208 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:14.208 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.468765+0000", 2024-09-12T22:33:14.209 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3259999999999997e-06 2024-09-12T22:33:14.209 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.209 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.209 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:14.209 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.548969+0000", 2024-09-12T22:33:14.209 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.080204172000000004 2024-09-12T22:33:14.209 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.209 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.209 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:14.209 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.549001+0000", 2024-09-12T22:33:14.209 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.1464999999999998e-05 2024-09-12T22:33:14.209 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.210 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.210 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:14.210 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.549148+0000", 2024-09-12T22:33:14.210 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014749399999999999 2024-09-12T22:33:14.210 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.210 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.210 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:14.210 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.549379+0000", 2024-09-12T22:33:14.210 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000231091 2024-09-12T22:33:14.210 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.210 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.210 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:14.210 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.549518+0000", 2024-09-12T22:33:14.210 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013844899999999999 2024-09-12T22:33:14.211 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.211 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.211 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:14.211 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.552236+0000", 2024-09-12T22:33:14.211 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0027179869999999998 2024-09-12T22:33:14.211 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.211 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.211 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:14.211 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.555333+0000", 2024-09-12T22:33:14.211 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0030973559999999999 2024-09-12T22:33:14.211 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.211 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.211 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:14.212 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.555379+0000", 2024-09-12T22:33:14.212 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6236999999999998e-05 2024-09-12T22:33:14.212 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.212 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.212 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:14.212 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.555420+0000", 2024-09-12T22:33:14.212 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1177999999999998e-05 2024-09-12T22:33:14.212 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:14.212 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:14.212 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:14.212 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.212 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.212 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop_reply(client.4490.0:9866 4.b e53/18 ondisk, result = 0)", 2024-09-12T22:33:14.213 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:09.468826+0000", 2024-09-12T22:33:14.213 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 4.7264804089999997, 2024-09-12T22:33:14.213 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.082588348000000006, 2024-09-12T22:33:14.213 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:14.213 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:14.213 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:33:14.213 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:14.213 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.213 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:14.213 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.468826+0000", 2024-09-12T22:33:14.213 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:14.213 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.213 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.214 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:14.214 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.468826+0000", 2024-09-12T22:33:14.214 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:14.214 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.214 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.214 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:14.214 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.468827+0000", 2024-09-12T22:33:14.214 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3399999999999999e-07 2024-09-12T22:33:14.214 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.214 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.214 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:14.214 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.468830+0000", 2024-09-12T22:33:14.214 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.1559999999999999e-06 2024-09-12T22:33:14.215 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.215 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.215 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:14.215 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.548957+0000", 2024-09-12T22:33:14.215 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.080126852999999998 2024-09-12T22:33:14.215 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.215 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.215 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:14.215 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.548989+0000", 2024-09-12T22:33:14.215 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2409000000000001e-05 2024-09-12T22:33:14.215 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.215 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.215 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:14.216 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.551065+0000", 2024-09-12T22:33:14.216 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.002075871 2024-09-12T22:33:14.216 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.216 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.216 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:14.216 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.551398+0000", 2024-09-12T22:33:14.216 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00033339099999999999 2024-09-12T22:33:14.216 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.216 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.216 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:14.216 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.551414+0000", 2024-09-12T22:33:14.216 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6133999999999998e-05 2024-09-12T22:33:14.216 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:14.217 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:14.217 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:14.217 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.217 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.217 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4490.0:10437 4.2f 4:f6cd553b:::10000002fce.00000000:head [write 0~27313] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:33:14.217 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:10.050890+0000", 2024-09-12T22:33:14.217 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 4.1444160129999998, 2024-09-12T22:33:14.217 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.056482601, 2024-09-12T22:33:14.217 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:14.217 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:14.217 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:14.217 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:33:14.217 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4490", 2024-09-12T22:33:14.218 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:14.218 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 10437 2024-09-12T22:33:14.218 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.218 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:14.218 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.218 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:14.218 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.050890+0000", 2024-09-12T22:33:14.218 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:14.218 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.218 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.218 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:14.218 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.050890+0000", 2024-09-12T22:33:14.218 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:14.219 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.219 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.219 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:14.219 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.050891+0000", 2024-09-12T22:33:14.219 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.6600000000000005e-07 2024-09-12T22:33:14.219 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.219 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.219 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:14.219 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.050906+0000", 2024-09-12T22:33:14.219 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4521e-05 2024-09-12T22:33:14.219 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.219 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.219 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:14.220 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.050915+0000", 2024-09-12T22:33:14.220 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.2569999999999996e-06 2024-09-12T22:33:14.220 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.220 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.220 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:14.220 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.050920+0000", 2024-09-12T22:33:14.220 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.724e-06 2024-09-12T22:33:14.220 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.220 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.220 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:14.220 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.050960+0000", 2024-09-12T22:33:14.220 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9999000000000001e-05 2024-09-12T22:33:14.220 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.221 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.221 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:14.221 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.051031+0000", 2024-09-12T22:33:14.221 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1007000000000006e-05 2024-09-12T22:33:14.221 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.221 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.221 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:14.221 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.107249+0000", 2024-09-12T22:33:14.221 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.056218432999999998 2024-09-12T22:33:14.221 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.221 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.221 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:14.221 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.107301+0000", 2024-09-12T22:33:14.222 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1289000000000003e-05 2024-09-12T22:33:14.222 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.222 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.222 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:14.222 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.107373+0000", 2024-09-12T22:33:14.222 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.2504999999999998e-05 2024-09-12T22:33:14.222 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:14.222 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:14.222 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:14.222 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.222 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.222 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4490.0:10439 4.12 4:483953cb:::10000002fd0.00000000:head [write 0~4842] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:33:14.222 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:10.052567+0000", 2024-09-12T22:33:14.222 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 4.1427398049999997, 2024-09-12T22:33:14.223 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.055835449000000002, 2024-09-12T22:33:14.223 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:14.223 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:14.223 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:14.223 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:33:14.223 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4490", 2024-09-12T22:33:14.223 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:14.223 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 10439 2024-09-12T22:33:14.223 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.223 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:14.223 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.223 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:14.223 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.052567+0000", 2024-09-12T22:33:14.224 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:14.224 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.224 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.224 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:14.224 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.052567+0000", 2024-09-12T22:33:14.224 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:14.224 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.224 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.224 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:14.224 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.052568+0000", 2024-09-12T22:33:14.224 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.3600000000000002e-07 2024-09-12T22:33:14.224 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.224 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.224 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:14.225 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.052591+0000", 2024-09-12T22:33:14.225 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.3110000000000001e-05 2024-09-12T22:33:14.225 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.225 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.225 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:14.225 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.106740+0000", 2024-09-12T22:33:14.225 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.054149315000000003 2024-09-12T22:33:14.225 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.225 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.225 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:14.225 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.106751+0000", 2024-09-12T22:33:14.225 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1056000000000001e-05 2024-09-12T22:33:14.225 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.226 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.226 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:14.226 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.106811+0000", 2024-09-12T22:33:14.226 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9515999999999997e-05 2024-09-12T22:33:14.226 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.226 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.226 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:14.226 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.106929+0000", 2024-09-12T22:33:14.226 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00011879000000000001 2024-09-12T22:33:14.226 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.226 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.226 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:14.226 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.108283+0000", 2024-09-12T22:33:14.226 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001354177 2024-09-12T22:33:14.227 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.227 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.227 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:14.227 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.108328+0000", 2024-09-12T22:33:14.227 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4931000000000001e-05 2024-09-12T22:33:14.227 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.227 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.227 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:14.227 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.108402+0000", 2024-09-12T22:33:14.227 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3718000000000001e-05 2024-09-12T22:33:14.227 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:14.227 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:14.227 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:14.227 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.228 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.228 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(client.4490.0:10445 4.3c e53/18 4:3d97251e:::10000002fd8.00000000:head v 53'154, mlcod=53'152)", 2024-09-12T22:33:14.228 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:10.058521+0000", 2024-09-12T22:33:14.228 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 4.136785465, 2024-09-12T22:33:14.228 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.049310138000000003, 2024-09-12T22:33:14.228 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:14.228 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:14.228 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:14.228 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:14.228 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.228 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:14.228 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.058521+0000", 2024-09-12T22:33:14.228 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:14.228 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.229 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.229 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:14.229 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.058521+0000", 2024-09-12T22:33:14.229 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:14.229 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.229 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.229 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:14.229 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.058522+0000", 2024-09-12T22:33:14.229 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.1099999999999995e-07 2024-09-12T22:33:14.229 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.229 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.229 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:14.229 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.058530+0000", 2024-09-12T22:33:14.230 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.7290000000000006e-06 2024-09-12T22:33:14.230 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.230 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.230 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:14.230 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.106760+0000", 2024-09-12T22:33:14.230 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.048229384 2024-09-12T22:33:14.230 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.230 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.230 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:14.230 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.106770+0000", 2024-09-12T22:33:14.230 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0431999999999999e-05 2024-09-12T22:33:14.230 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.230 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.230 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:14.231 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.106823+0000", 2024-09-12T22:33:14.231 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2309999999999999e-05 2024-09-12T22:33:14.231 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.231 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.231 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:14.231 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.106841+0000", 2024-09-12T22:33:14.231 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.8218000000000001e-05 2024-09-12T22:33:14.231 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.231 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.231 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:14.231 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.107796+0000", 2024-09-12T22:33:14.231 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00095552600000000005 2024-09-12T22:33:14.231 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.231 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.232 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:14.232 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.107831+0000", 2024-09-12T22:33:14.232 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4928000000000002e-05 2024-09-12T22:33:14.232 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:14.232 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:14.232 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:14.232 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.232 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.232 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4490.0:11253 4.33 4:cc24cad0:::100000031a4.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-12T22:33:14.232 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:13.240334+0000", 2024-09-12T22:33:14.232 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.95497210200000004, 2024-09-12T22:33:14.232 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.028021596999999999, 2024-09-12T22:33:14.232 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:14.233 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:14.233 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:14.233 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:33:14.233 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4490", 2024-09-12T22:33:14.233 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:14.233 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 11253 2024-09-12T22:33:14.233 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.233 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:14.233 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.233 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:14.233 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.240334+0000", 2024-09-12T22:33:14.233 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:14.233 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.234 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.234 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:14.234 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.240334+0000", 2024-09-12T22:33:14.234 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:14.234 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.234 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.234 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:14.234 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.240335+0000", 2024-09-12T22:33:14.234 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.51e-07 2024-09-12T22:33:14.234 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.234 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.234 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:14.234 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.248469+0000", 2024-09-12T22:33:14.234 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0081340460000000007 2024-09-12T22:33:14.235 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.235 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.235 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:14.235 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.248482+0000", 2024-09-12T22:33:14.235 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2813000000000001e-05 2024-09-12T22:33:14.235 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.235 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.235 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:14.235 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.248489+0000", 2024-09-12T22:33:14.235 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.9349999999999997e-06 2024-09-12T22:33:14.235 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.235 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.235 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:14.235 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.248597+0000", 2024-09-12T22:33:14.236 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000108403 2024-09-12T22:33:14.236 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.236 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.236 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:14.236 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.248705+0000", 2024-09-12T22:33:14.236 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000108032 2024-09-12T22:33:14.236 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.236 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.236 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:14.236 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.268206+0000", 2024-09-12T22:33:14.236 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.019501217000000001 2024-09-12T22:33:14.236 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.236 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.236 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:14.237 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.268261+0000", 2024-09-12T22:33:14.237 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5028999999999998e-05 2024-09-12T22:33:14.237 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.237 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.237 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:14.237 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.268356+0000", 2024-09-12T22:33:14.237 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.4571e-05 2024-09-12T22:33:14.237 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:14.237 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:14.237 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:14.237 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.237 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.237 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4490.0:11257 4.17 4:e9f3a865:::10000003294.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-12T22:33:14.238 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:13.248554+0000", 2024-09-12T22:33:14.238 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.94675204300000004, 2024-09-12T22:33:14.238 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.033281518000000003, 2024-09-12T22:33:14.238 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:14.238 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:14.238 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:14.238 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:33:14.238 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4490", 2024-09-12T22:33:14.238 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:14.238 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 11257 2024-09-12T22:33:14.238 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.238 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:14.238 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.238 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:14.239 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.248554+0000", 2024-09-12T22:33:14.239 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:14.239 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.239 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.239 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:14.239 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.248554+0000", 2024-09-12T22:33:14.239 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:14.239 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.239 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.239 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:14.239 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.248555+0000", 2024-09-12T22:33:14.239 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.6699999999999999e-07 2024-09-12T22:33:14.239 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.240 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.240 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:14.240 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.255560+0000", 2024-09-12T22:33:14.240 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0070048719999999997 2024-09-12T22:33:14.240 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.240 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.240 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:14.240 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.255571+0000", 2024-09-12T22:33:14.240 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1131999999999999e-05 2024-09-12T22:33:14.240 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.240 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.240 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:14.240 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.255577+0000", 2024-09-12T22:33:14.241 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.964e-06 2024-09-12T22:33:14.241 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.241 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.241 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:14.241 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.255637+0000", 2024-09-12T22:33:14.241 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0381999999999999e-05 2024-09-12T22:33:14.241 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.241 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.241 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:14.241 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.255814+0000", 2024-09-12T22:33:14.241 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00017719 2024-09-12T22:33:14.241 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.241 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.242 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:14.242 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.255935+0000", 2024-09-12T22:33:14.242 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000120414 2024-09-12T22:33:14.242 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.242 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.242 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:14.242 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.268536+0000", 2024-09-12T22:33:14.242 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.012601661 2024-09-12T22:33:14.242 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.242 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.242 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:14.242 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.281767+0000", 2024-09-12T22:33:14.242 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.013231002 2024-09-12T22:33:14.242 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.243 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.243 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:14.243 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.281805+0000", 2024-09-12T22:33:14.243 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7713999999999998e-05 2024-09-12T22:33:14.243 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.243 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.243 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:14.243 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.281836+0000", 2024-09-12T22:33:14.243 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.082e-05 2024-09-12T22:33:14.243 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:14.243 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:14.243 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:14.243 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.243 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.244 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(client.4490.0:11255 4.3c e54/18 4:3e92f261:::100000031f3.00000000:head v 54'159, mlcod=54'157)", 2024-09-12T22:33:14.244 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:13.251127+0000", 2024-09-12T22:33:14.244 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.944179502, 2024-09-12T22:33:14.244 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.031496546, 2024-09-12T22:33:14.244 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:14.244 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:14.244 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:14.244 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:14.244 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.244 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:14.244 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.251127+0000", 2024-09-12T22:33:14.244 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:14.244 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.245 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.245 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:14.245 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.251127+0000", 2024-09-12T22:33:14.245 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:14.245 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.245 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.245 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:14.245 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.251128+0000", 2024-09-12T22:33:14.245 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3120000000000001e-06 2024-09-12T22:33:14.245 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.245 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.245 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:14.246 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.259217+0000", 2024-09-12T22:33:14.246 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0080887700000000003 2024-09-12T22:33:14.246 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.246 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.246 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:14.246 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.259229+0000", 2024-09-12T22:33:14.246 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2279000000000001e-05 2024-09-12T22:33:14.246 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.246 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.246 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:14.246 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.259239+0000", 2024-09-12T22:33:14.246 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1549999999999996e-06 2024-09-12T22:33:14.246 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.247 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.247 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:14.247 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.259287+0000", 2024-09-12T22:33:14.247 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.7994999999999997e-05 2024-09-12T22:33:14.247 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.247 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.247 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:14.247 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.259304+0000", 2024-09-12T22:33:14.247 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.7615999999999999e-05 2024-09-12T22:33:14.247 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.247 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.247 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:14.247 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.282546+0000", 2024-09-12T22:33:14.248 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.023241693000000001 2024-09-12T22:33:14.248 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.248 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.248 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:14.248 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.282624+0000", 2024-09-12T22:33:14.248 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.7725999999999994e-05 2024-09-12T22:33:14.248 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:14.248 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:14.248 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:14.248 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.248 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.248 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4490.0:11259 4.1c 4:38b085a0:::1000000320b.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-12T22:33:14.248 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:13.255671+0000", 2024-09-12T22:33:14.249 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.93963511399999999, 2024-09-12T22:33:14.249 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.027087333000000002, 2024-09-12T22:33:14.249 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:14.249 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:14.249 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:14.249 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:33:14.249 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4490", 2024-09-12T22:33:14.249 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:14.249 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 11259 2024-09-12T22:33:14.249 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.249 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:14.249 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.250 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:14.250 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.255671+0000", 2024-09-12T22:33:14.250 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:14.250 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.250 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.250 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:14.250 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.255671+0000", 2024-09-12T22:33:14.250 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:14.250 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.250 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.250 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:14.250 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.255672+0000", 2024-09-12T22:33:14.250 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.6100000000000001e-07 2024-09-12T22:33:14.251 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.251 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.251 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:14.251 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.263129+0000", 2024-09-12T22:33:14.251 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0074570310000000002 2024-09-12T22:33:14.251 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.251 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.251 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:14.251 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.263142+0000", 2024-09-12T22:33:14.251 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3365e-05 2024-09-12T22:33:14.251 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.251 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.251 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:14.252 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.263149+0000", 2024-09-12T22:33:14.252 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.3550000000000001e-06 2024-09-12T22:33:14.252 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.252 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.252 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:14.252 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.263209+0000", 2024-09-12T22:33:14.252 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0124000000000002e-05 2024-09-12T22:33:14.252 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.252 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.252 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:14.252 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.263265+0000", 2024-09-12T22:33:14.252 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.6116999999999998e-05 2024-09-12T22:33:14.252 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.253 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.253 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:14.253 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.282639+0000", 2024-09-12T22:33:14.253 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.019374367 2024-09-12T22:33:14.253 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.253 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.253 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:14.253 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.282685+0000", 2024-09-12T22:33:14.253 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.545e-05 2024-09-12T22:33:14.253 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.253 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.253 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:14.253 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.282759+0000", 2024-09-12T22:33:14.253 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3962999999999996e-05 2024-09-12T22:33:14.254 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:14.254 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:14.254 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:14.254 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.254 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.254 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(client.4490.0:11328 4.39 e54/18 4:9d207bac:::100000030d8.00000000:head v 54'190, mlcod=54'187)", 2024-09-12T22:33:14.254 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:13.325537+0000", 2024-09-12T22:33:14.254 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.86976991999999997, 2024-09-12T22:33:14.254 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.030394470999999999, 2024-09-12T22:33:14.254 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:14.254 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:14.254 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:14.254 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:14.254 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.255 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:14.255 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.325537+0000", 2024-09-12T22:33:14.255 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:14.255 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.255 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.255 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:14.255 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.325537+0000", 2024-09-12T22:33:14.255 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:14.255 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.255 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.255 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:14.255 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.325538+0000", 2024-09-12T22:33:14.255 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1200000000000001e-06 2024-09-12T22:33:14.255 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.256 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.256 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:14.256 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.332579+0000", 2024-09-12T22:33:14.256 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0070413120000000001 2024-09-12T22:33:14.256 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.256 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.256 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:14.256 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.332595+0000", 2024-09-12T22:33:14.256 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6099e-05 2024-09-12T22:33:14.256 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.256 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.256 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:14.256 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.332601+0000", 2024-09-12T22:33:14.257 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0759999999999999e-06 2024-09-12T22:33:14.257 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.257 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.257 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:14.257 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.332653+0000", 2024-09-12T22:33:14.257 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1396000000000001e-05 2024-09-12T22:33:14.257 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.257 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.257 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:14.257 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.332676+0000", 2024-09-12T22:33:14.257 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.3325000000000001e-05 2024-09-12T22:33:14.257 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.257 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.257 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:14.258 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.355882+0000", 2024-09-12T22:33:14.258 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.023205594999999999 2024-09-12T22:33:14.258 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.258 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.258 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:14.258 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.355931+0000", 2024-09-12T22:33:14.258 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9548000000000001e-05 2024-09-12T22:33:14.258 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:14.260 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:14.260 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:14.260 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.261 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.261 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4490.0:11332 4.15 4:aa3d1398:::100000031e7.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-12T22:33:14.261 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:13.326786+0000", 2024-09-12T22:33:14.261 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.86852006699999995, 2024-09-12T22:33:14.261 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.029445604, 2024-09-12T22:33:14.261 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:14.261 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:14.261 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:14.261 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:33:14.261 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4490", 2024-09-12T22:33:14.261 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:14.261 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 11332 2024-09-12T22:33:14.261 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.262 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:14.262 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.262 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:14.262 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.326786+0000", 2024-09-12T22:33:14.262 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:14.262 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.262 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.262 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:14.262 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.326786+0000", 2024-09-12T22:33:14.262 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:14.262 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.262 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.262 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:14.262 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.326787+0000", 2024-09-12T22:33:14.263 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0600000000000001e-07 2024-09-12T22:33:14.263 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.263 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.263 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:14.263 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.334122+0000", 2024-09-12T22:33:14.263 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0073347040000000001 2024-09-12T22:33:14.263 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.263 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.263 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:14.263 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.334137+0000", 2024-09-12T22:33:14.263 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.5506999999999999e-05 2024-09-12T22:33:14.263 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.263 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.264 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:14.264 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.334153+0000", 2024-09-12T22:33:14.264 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6178999999999999e-05 2024-09-12T22:33:14.264 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.264 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.264 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:14.264 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.334229+0000", 2024-09-12T22:33:14.264 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5731999999999999e-05 2024-09-12T22:33:14.264 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.264 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.264 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:14.264 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.334324+0000", 2024-09-12T22:33:14.264 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.4969000000000005e-05 2024-09-12T22:33:14.264 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.265 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.265 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:14.265 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.356042+0000", 2024-09-12T22:33:14.265 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.021718286999999999 2024-09-12T22:33:14.265 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.265 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.265 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:14.265 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.356126+0000", 2024-09-12T22:33:14.265 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.3387999999999995e-05 2024-09-12T22:33:14.265 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.265 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.265 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:14.265 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.356232+0000", 2024-09-12T22:33:14.266 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000106432 2024-09-12T22:33:14.266 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:14.266 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:14.266 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:14.266 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.266 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.266 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(client.4490.0:11347 4.c e54/18 4:3257e780:::1000000321f.00000000:head v 54'190, mlcod=54'188)", 2024-09-12T22:33:14.266 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:13.353518+0000", 2024-09-12T22:33:14.266 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.84178889899999998, 2024-09-12T22:33:14.266 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.028334452999999999, 2024-09-12T22:33:14.266 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:14.266 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:14.266 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:14.266 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:14.267 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.267 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:14.267 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.353518+0000", 2024-09-12T22:33:14.267 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:14.267 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.267 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.267 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:14.267 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.353518+0000", 2024-09-12T22:33:14.267 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:14.267 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.267 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.267 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:14.267 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.353518+0000", 2024-09-12T22:33:14.267 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7000000000000004e-07 2024-09-12T22:33:14.268 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.268 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.268 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:14.268 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.359930+0000", 2024-09-12T22:33:14.268 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0064118760000000004 2024-09-12T22:33:14.268 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.268 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.268 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:14.268 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.359944+0000", 2024-09-12T22:33:14.268 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3701e-05 2024-09-12T22:33:14.268 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.268 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.268 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:14.269 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.359951+0000", 2024-09-12T22:33:14.269 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.8340000000000001e-06 2024-09-12T22:33:14.269 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.269 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.269 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:14.269 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.360001+0000", 2024-09-12T22:33:14.269 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0676000000000001e-05 2024-09-12T22:33:14.269 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.269 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.269 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:14.269 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.360018+0000", 2024-09-12T22:33:14.269 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6497000000000001e-05 2024-09-12T22:33:14.269 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.269 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.270 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:14.270 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.381793+0000", 2024-09-12T22:33:14.270 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.021774835999999999 2024-09-12T22:33:14.270 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.270 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.270 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:14.270 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.381852+0000", 2024-09-12T22:33:14.270 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9363000000000001e-05 2024-09-12T22:33:14.270 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:14.270 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:14.270 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:14.270 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.270 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.271 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4490.0:11351 4.3f 4:fd498422:::10000003188.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-12T22:33:14.271 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:13.354715+0000", 2024-09-12T22:33:14.271 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.840591651, 2024-09-12T22:33:14.271 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.043059568999999999, 2024-09-12T22:33:14.271 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:14.271 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:14.271 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:14.271 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:33:14.271 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4490", 2024-09-12T22:33:14.271 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:14.271 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 11351 2024-09-12T22:33:14.271 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.271 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:14.272 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.272 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:14.272 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.354715+0000", 2024-09-12T22:33:14.272 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:14.272 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.272 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.272 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:14.272 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.354715+0000", 2024-09-12T22:33:14.272 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:14.272 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.272 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.272 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:14.272 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.354716+0000", 2024-09-12T22:33:14.273 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.7600000000000006e-07 2024-09-12T22:33:14.273 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.273 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.273 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:14.273 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.361477+0000", 2024-09-12T22:33:14.273 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0067607090000000002 2024-09-12T22:33:14.273 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.273 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.273 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:14.273 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.361487+0000", 2024-09-12T22:33:14.273 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0249e-05 2024-09-12T22:33:14.273 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.273 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.273 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:14.274 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.361493+0000", 2024-09-12T22:33:14.274 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.4699999999999999e-06 2024-09-12T22:33:14.274 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.274 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.274 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:14.274 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.361544+0000", 2024-09-12T22:33:14.274 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1124e-05 2024-09-12T22:33:14.274 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.274 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.274 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:14.274 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.361604+0000", 2024-09-12T22:33:14.274 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9397000000000001e-05 2024-09-12T22:33:14.274 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.274 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.275 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:14.275 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.397601+0000", 2024-09-12T22:33:14.275 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.035996927999999997 2024-09-12T22:33:14.275 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.275 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.275 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:14.275 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.397646+0000", 2024-09-12T22:33:14.275 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5176000000000003e-05 2024-09-12T22:33:14.275 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.275 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.275 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:14.275 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.397774+0000", 2024-09-12T22:33:14.275 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012854000000000001 2024-09-12T22:33:14.276 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:14.276 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:14.276 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:14.276 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.276 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.276 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4490.0:11352 4.15 4:aa3d1398:::100000031e7.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-12T22:33:14.276 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:13.361513+0000", 2024-09-12T22:33:14.276 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.83379375099999997, 2024-09-12T22:33:14.276 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.028437150000000001, 2024-09-12T22:33:14.276 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:14.276 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:14.276 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:14.276 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:33:14.277 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4490", 2024-09-12T22:33:14.277 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:14.277 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 11352 2024-09-12T22:33:14.277 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.277 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:14.277 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.277 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:14.277 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.361513+0000", 2024-09-12T22:33:14.277 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:14.277 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.277 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.277 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:14.277 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.361513+0000", 2024-09-12T22:33:14.278 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:14.278 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.278 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.278 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:14.278 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.361514+0000", 2024-09-12T22:33:14.278 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.6899999999999996e-07 2024-09-12T22:33:14.278 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.278 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.278 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:14.278 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.365460+0000", 2024-09-12T22:33:14.278 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0039465469999999999 2024-09-12T22:33:14.278 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.278 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.278 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:14.279 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.365470+0000", 2024-09-12T22:33:14.279 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.8989999999999996e-06 2024-09-12T22:33:14.279 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.279 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.279 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:14.279 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.365475+0000", 2024-09-12T22:33:14.279 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3700000000000003e-06 2024-09-12T22:33:14.279 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.279 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.279 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:14.279 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.365542+0000", 2024-09-12T22:33:14.279 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.6964999999999993e-05 2024-09-12T22:33:14.279 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.280 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.280 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:14.280 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.365632+0000", 2024-09-12T22:33:14.280 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.9517000000000004e-05 2024-09-12T22:33:14.280 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.280 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.280 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:14.280 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.389862+0000", 2024-09-12T22:33:14.280 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.024229737000000001 2024-09-12T22:33:14.280 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.280 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.280 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:14.280 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.389898+0000", 2024-09-12T22:33:14.280 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.6050000000000002e-05 2024-09-12T22:33:14.281 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.281 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.281 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:14.281 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.389950+0000", 2024-09-12T22:33:14.281 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2196e-05 2024-09-12T22:33:14.281 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:14.281 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:14.281 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:14.281 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.281 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.281 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4490.0:11356 4.1c 4:38022ffc:::100000030c2.00000000:head [write 0~4194304 [2@3105469]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-12T22:33:14.281 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:13.365500+0000", 2024-09-12T22:33:14.281 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.82980624199999997, 2024-09-12T22:33:14.281 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.032492376000000003, 2024-09-12T22:33:14.282 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:14.282 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:14.282 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:14.282 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:33:14.282 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4490", 2024-09-12T22:33:14.282 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:14.282 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 11356 2024-09-12T22:33:14.282 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.282 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:14.282 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.282 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:14.282 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.365500+0000", 2024-09-12T22:33:14.282 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:14.283 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.283 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.283 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:14.283 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.365500+0000", 2024-09-12T22:33:14.283 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:14.283 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.283 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.283 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:14.283 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.365501+0000", 2024-09-12T22:33:14.283 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9800000000000003e-07 2024-09-12T22:33:14.283 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.283 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.283 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:14.283 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.369391+0000", 2024-09-12T22:33:14.284 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0038900760000000001 2024-09-12T22:33:14.284 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.284 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.284 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:14.284 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.369406+0000", 2024-09-12T22:33:14.284 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4827000000000001e-05 2024-09-12T22:33:14.284 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.284 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.284 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:14.284 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.369413+0000", 2024-09-12T22:33:14.284 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1019999999999999e-06 2024-09-12T22:33:14.284 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.285 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.285 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:14.285 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.369477+0000", 2024-09-12T22:33:14.285 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.3918999999999996e-05 2024-09-12T22:33:14.285 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.285 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.285 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:14.285 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.369593+0000", 2024-09-12T22:33:14.285 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000116144 2024-09-12T22:33:14.285 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.285 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.285 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:14.285 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.397854+0000", 2024-09-12T22:33:14.285 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.028261013000000001 2024-09-12T22:33:14.286 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.286 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.286 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:14.286 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.397915+0000", 2024-09-12T22:33:14.286 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.1245000000000001e-05 2024-09-12T22:33:14.286 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.286 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.286 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:14.286 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.397993+0000", 2024-09-12T22:33:14.286 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.7452000000000003e-05 2024-09-12T22:33:14.286 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:14.286 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:14.286 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:14.286 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.287 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.287 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4490.0:11359 4.2d 4:b71db9e4:::100000032d3.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-12T22:33:14.287 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:13.369516+0000", 2024-09-12T22:33:14.287 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.82579021600000002, 2024-09-12T22:33:14.287 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.028705683999999999, 2024-09-12T22:33:14.287 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:14.287 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:14.287 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:14.287 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:33:14.287 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4490", 2024-09-12T22:33:14.287 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:14.287 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 11359 2024-09-12T22:33:14.287 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.288 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:14.288 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.288 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:14.288 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.369516+0000", 2024-09-12T22:33:14.288 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:14.288 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.288 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.288 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:14.288 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.369516+0000", 2024-09-12T22:33:14.288 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:14.288 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.288 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.288 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:14.288 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.369517+0000", 2024-09-12T22:33:14.289 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1600000000000001e-07 2024-09-12T22:33:14.289 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.289 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.289 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:14.289 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.374753+0000", 2024-09-12T22:33:14.289 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0052357319999999999 2024-09-12T22:33:14.289 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.289 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.289 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:14.289 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.374765+0000", 2024-09-12T22:33:14.289 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2177999999999999e-05 2024-09-12T22:33:14.289 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.290 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.290 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:14.290 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.374771+0000", 2024-09-12T22:33:14.290 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.4130000000000003e-06 2024-09-12T22:33:14.290 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.290 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.290 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:14.290 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.374831+0000", 2024-09-12T22:33:14.290 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0236999999999999e-05 2024-09-12T22:33:14.290 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.290 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.290 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:14.290 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.374940+0000", 2024-09-12T22:33:14.291 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000108303 2024-09-12T22:33:14.291 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.291 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.291 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:14.291 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.398143+0000", 2024-09-12T22:33:14.291 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.023203002 2024-09-12T22:33:14.291 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.291 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.291 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:14.291 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.398176+0000", 2024-09-12T22:33:14.291 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3084999999999999e-05 2024-09-12T22:33:14.291 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.292 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.292 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:14.292 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.398222+0000", 2024-09-12T22:33:14.292 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6217999999999997e-05 2024-09-12T22:33:14.292 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:14.292 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:14.292 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:14.292 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.292 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.292 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4490.0:11772 4.0 4:0031f3d4:::100000033bc.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-12T22:33:14.292 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:13.906458+0000", 2024-09-12T22:33:14.292 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.28884805699999999, 2024-09-12T22:33:14.292 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.028086184, 2024-09-12T22:33:14.292 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:14.293 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:14.293 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:14.293 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:33:14.293 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4490", 2024-09-12T22:33:14.293 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:14.293 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 11772 2024-09-12T22:33:14.293 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.293 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:14.293 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.293 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:14.293 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.906458+0000", 2024-09-12T22:33:14.293 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:14.293 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.294 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.294 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:14.294 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.906458+0000", 2024-09-12T22:33:14.294 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:14.294 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.294 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.294 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:14.294 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.906460+0000", 2024-09-12T22:33:14.294 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0589999999999999e-06 2024-09-12T22:33:14.294 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.294 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.294 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:14.294 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.912897+0000", 2024-09-12T22:33:14.295 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.006437697 2024-09-12T22:33:14.295 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.295 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.295 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:14.295 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.912917+0000", 2024-09-12T22:33:14.295 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9383999999999999e-05 2024-09-12T22:33:14.295 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.295 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.295 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:14.295 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.912927+0000", 2024-09-12T22:33:14.295 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0176e-05 2024-09-12T22:33:14.295 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.295 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.295 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:14.296 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.912990+0000", 2024-09-12T22:33:14.296 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.3536999999999998e-05 2024-09-12T22:33:14.296 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.296 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.296 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:14.296 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.913144+0000", 2024-09-12T22:33:14.296 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00015340199999999999 2024-09-12T22:33:14.296 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.296 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.296 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:14.296 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.913292+0000", 2024-09-12T22:33:14.296 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014868800000000001 2024-09-12T22:33:14.296 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.297 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.297 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:14.297 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.920141+0000", 2024-09-12T22:33:14.297 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0068485880000000001 2024-09-12T22:33:14.297 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.297 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.297 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:14.297 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.934445+0000", 2024-09-12T22:33:14.297 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.014304320000000001 2024-09-12T22:33:14.297 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.297 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.297 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:14.297 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.934510+0000", 2024-09-12T22:33:14.297 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.4811e-05 2024-09-12T22:33:14.298 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.298 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.298 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:14.298 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.934545+0000", 2024-09-12T22:33:14.298 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4521999999999999e-05 2024-09-12T22:33:14.298 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:14.298 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:14.298 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:14.298 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.298 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.298 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4490.0:11780 4.11 4:884f2970:::1000000330f.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-12T22:33:14.298 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:13.921231+0000", 2024-09-12T22:33:14.298 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.274075823, 2024-09-12T22:33:14.298 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.030034333, 2024-09-12T22:33:14.299 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:14.299 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:14.299 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:14.299 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:33:14.299 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4490", 2024-09-12T22:33:14.299 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:14.299 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 11780 2024-09-12T22:33:14.299 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.299 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:14.299 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.299 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:14.299 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.921231+0000", 2024-09-12T22:33:14.299 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:14.300 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.300 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.300 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:14.300 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.921231+0000", 2024-09-12T22:33:14.300 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:14.300 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.300 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.300 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:14.300 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.921231+0000", 2024-09-12T22:33:14.300 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.8400000000000004e-07 2024-09-12T22:33:14.300 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.300 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.300 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:14.300 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.927735+0000", 2024-09-12T22:33:14.301 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0065040200000000001 2024-09-12T22:33:14.301 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.301 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.301 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:14.301 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.927760+0000", 2024-09-12T22:33:14.301 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.421e-05 2024-09-12T22:33:14.301 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.301 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.301 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:14.301 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.927770+0000", 2024-09-12T22:33:14.301 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0516000000000001e-05 2024-09-12T22:33:14.301 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.301 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.301 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:14.302 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.927867+0000", 2024-09-12T22:33:14.302 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.7182000000000006e-05 2024-09-12T22:33:14.302 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.302 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.302 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:14.302 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.928022+0000", 2024-09-12T22:33:14.302 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00015492300000000001 2024-09-12T22:33:14.302 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.302 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.302 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:14.302 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.928158+0000", 2024-09-12T22:33:14.302 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013529500000000001 2024-09-12T22:33:14.302 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.302 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.303 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:14.303 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.939710+0000", 2024-09-12T22:33:14.303 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011552801999999999 2024-09-12T22:33:14.303 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.303 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.303 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:14.303 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.951192+0000", 2024-09-12T22:33:14.303 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011482081999999999 2024-09-12T22:33:14.303 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.303 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.303 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:14.303 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.951231+0000", 2024-09-12T22:33:14.303 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.8121999999999999e-05 2024-09-12T22:33:14.304 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.304 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.304 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:14.304 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.951265+0000", 2024-09-12T22:33:14.304 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4496999999999999e-05 2024-09-12T22:33:14.304 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:14.304 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:14.304 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:14.304 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.304 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.304 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4490.0:11930 4.3f 4:fc0d2b13:::10000003140.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-12T22:33:14.304 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:14.117098+0000", 2024-09-12T22:33:14.304 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.078208712, 2024-09-12T22:33:14.305 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.026675870000000001, 2024-09-12T22:33:14.305 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:14.305 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:14.305 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:14.305 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:33:14.305 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4490", 2024-09-12T22:33:14.305 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:14.305 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 11930 2024-09-12T22:33:14.305 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.305 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:14.305 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.305 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:14.305 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:14.117098+0000", 2024-09-12T22:33:14.305 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:14.306 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.306 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.306 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:14.306 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:14.117098+0000", 2024-09-12T22:33:14.306 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:14.306 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.306 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.306 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:14.306 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:14.117098+0000", 2024-09-12T22:33:14.306 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.63e-07 2024-09-12T22:33:14.306 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.306 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.306 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:14.306 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:14.121269+0000", 2024-09-12T22:33:14.307 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0041708800000000001 2024-09-12T22:33:14.307 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.307 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.307 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:14.307 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:14.121286+0000", 2024-09-12T22:33:14.307 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6407000000000001e-05 2024-09-12T22:33:14.307 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.307 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.307 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:14.307 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:14.121291+0000", 2024-09-12T22:33:14.307 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8209999999999998e-06 2024-09-12T22:33:14.307 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.307 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.307 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:14.308 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:14.121353+0000", 2024-09-12T22:33:14.308 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.1628e-05 2024-09-12T22:33:14.308 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.308 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.308 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:14.308 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:14.121492+0000", 2024-09-12T22:33:14.308 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000139388 2024-09-12T22:33:14.308 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.308 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.308 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:14.308 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:14.143684+0000", 2024-09-12T22:33:14.308 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.022191710999999999 2024-09-12T22:33:14.308 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.309 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.309 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:14.309 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:14.143719+0000", 2024-09-12T22:33:14.309 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.5303999999999999e-05 2024-09-12T22:33:14.309 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:14.309 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:14.309 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:14.309 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:14.143774+0000", 2024-09-12T22:33:14.309 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4268000000000003e-05 2024-09-12T22:33:14.309 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:14.309 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:14.309 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:14.309 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:14.309 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:14.310 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:33:14.310 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:33:14.318 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:14.311+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:14.331 INFO:tasks.workunit.client.0.smithi019.stdout:0/362: stat d1/l62 0 2024-09-12T22:33:14.331 INFO:tasks.workunit.client.0.smithi019.stdout:3/303: mknod dd/d1e/c56 0 2024-09-12T22:33:14.332 INFO:tasks.workunit.client.0.smithi019.stdout:9/336: symlink dd/d10/d17/d23/d2e/d31/d3f/d47/d6e/l6f 0 2024-09-12T22:33:14.332 INFO:tasks.workunit.client.0.smithi019.stdout:0/363: chown d1/d51 21002 1 2024-09-12T22:33:14.332 INFO:tasks.workunit.client.0.smithi019.stdout:1/429: write d3/f31 [4999211,124239] 0 2024-09-12T22:33:14.332 INFO:tasks.workunit.client.0.smithi019.stdout:4/344: dwrite d1/d8/f64 [0,4194304] 0 2024-09-12T22:33:14.332 INFO:tasks.workunit.client.0.smithi019.stdout:9/337: fsync dd/d10/d17/d23/d2e/d31/f34 0 2024-09-12T22:33:14.332 INFO:tasks.workunit.client.0.smithi019.stdout:4/345: write d1/d22/d57/f5d [424507,92095] 0 2024-09-12T22:33:14.332 INFO:tasks.workunit.client.0.smithi019.stdout:9/338: chown dd/d10/d17/d23/d2e/c45 1371303 1 2024-09-12T22:33:14.332 INFO:tasks.workunit.client.0.smithi019.stdout:4/346: mknod d1/d22/d31/c6c 0 2024-09-12T22:33:14.332 INFO:tasks.workunit.client.0.smithi019.stdout:9/339: chown dd/d10/d17/d22/d42/f55 36288 1 2024-09-12T22:33:14.332 INFO:tasks.workunit.client.0.smithi019.stdout:6/382: dwrite d1b/d26/d39/d6a/f5c [0,4194304] 0 2024-09-12T22:33:14.332 INFO:tasks.workunit.client.0.smithi019.stdout:5/480: read d0/d7/d16/f47 [44710,95470] 0 2024-09-12T22:33:14.332 INFO:tasks.workunit.client.0.smithi019.stdout:0/364: dwrite d1/d14/d32/f6e [0,4194304] 0 2024-09-12T22:33:14.332 INFO:tasks.workunit.client.0.smithi019.stdout:6/383: symlink d1b/d2d/l81 0 2024-09-12T22:33:14.333 INFO:tasks.workunit.client.0.smithi019.stdout:0/365: stat d1/d14/d1b/l31 0 2024-09-12T22:33:14.333 INFO:tasks.workunit.client.0.smithi019.stdout:3/304: symlink dd/d1e/d40/l57 0 2024-09-12T22:33:14.333 INFO:tasks.workunit.client.0.smithi019.stdout:5/481: rename d0/dc/d24/l3d to d0/d7/d16/d69/la1 0 2024-09-12T22:33:14.333 INFO:tasks.workunit.client.0.smithi019.stdout:6/384: rename d1b/d26/f6c to d1b/d26/d39/f82 0 2024-09-12T22:33:14.333 INFO:tasks.workunit.client.0.smithi019.stdout:3/305: creat dd/d1e/f58 x:0 0 0 2024-09-12T22:33:14.333 INFO:tasks.workunit.client.0.smithi019.stdout:3/306: fdatasync dd/d1e/f25 0 2024-09-12T22:33:14.333 INFO:tasks.workunit.client.0.smithi019.stdout:4/347: dwrite d1/d22/d26/f43 [0,4194304] 0 2024-09-12T22:33:14.333 INFO:tasks.workunit.client.0.smithi019.stdout:9/340: dwrite dd/d10/d17/d23/f2d [0,4194304] 0 2024-09-12T22:33:14.333 INFO:tasks.workunit.client.0.smithi019.stdout:3/307: unlink dd/d1e/l2d 0 2024-09-12T22:33:14.333 INFO:tasks.workunit.client.0.smithi019.stdout:9/341: rmdir dd 39 2024-09-12T22:33:14.333 INFO:tasks.workunit.client.0.smithi019.stdout:6/385: read d1b/d26/d27/f2f [592625,35973] 0 2024-09-12T22:33:14.333 INFO:tasks.workunit.client.0.smithi019.stdout:4/348: rename d1/d11/d15/d1f/d56/f60 to d1/d22/d2c/f6d 0 2024-09-12T22:33:14.333 INFO:tasks.workunit.client.0.smithi019.stdout:9/342: rmdir dd 39 2024-09-12T22:33:14.334 INFO:tasks.workunit.client.0.smithi019.stdout:2/355: dread d0/f1f [0,4194304] 0 2024-09-12T22:33:14.334 INFO:tasks.workunit.client.0.smithi019.stdout:6/386: truncate d1b/d26/d27/d3e/f64 632283 0 2024-09-12T22:33:14.334 INFO:tasks.workunit.client.0.smithi019.stdout:4/349: truncate d1/d22/d2c/f35 5214508 0 2024-09-12T22:33:14.334 INFO:tasks.workunit.client.0.smithi019.stdout:9/343: unlink dd/d10/d17/d23/d2e/d31/d3f/d47/c5f 0 2024-09-12T22:33:14.334 INFO:tasks.workunit.client.0.smithi019.stdout:4/350: write d1/d11/f23 [7424272,115764] 0 2024-09-12T22:33:14.334 INFO:tasks.workunit.client.0.smithi019.stdout:9/344: fdatasync dd/d10/f19 0 2024-09-12T22:33:14.334 INFO:tasks.workunit.client.0.smithi019.stdout:8/315: dread d7/d8/df/d2d/f30 [0,4194304] 0 2024-09-12T22:33:14.334 INFO:tasks.workunit.client.0.smithi019.stdout:2/356: link d0/d5/d18/d3d/c45 d0/da/d73/d7c/c7d 0 2024-09-12T22:33:14.334 INFO:tasks.workunit.client.0.smithi019.stdout:3/308: dread dd/d1e/d40/f4a [0,4194304] 0 2024-09-12T22:33:14.334 INFO:tasks.workunit.client.0.smithi019.stdout:9/345: dread - dd/d10/d17/d23/d37/f5a zero size 2024-09-12T22:33:14.334 INFO:tasks.workunit.client.0.smithi019.stdout:1/430: dread d3/d11/d16/d23/d54/f61 [0,4194304] 0 2024-09-12T22:33:14.334 INFO:tasks.workunit.client.0.smithi019.stdout:8/316: dwrite d7/d8/df/f1a [0,4194304] 0 2024-09-12T22:33:14.334 INFO:tasks.workunit.client.0.smithi019.stdout:6/387: dread d1b/d26/d39/f4a [0,4194304] 0 2024-09-12T22:33:14.335 INFO:tasks.workunit.client.0.smithi019.stdout:9/346: dwrite dd/d10/f39 [0,4194304] 0 2024-09-12T22:33:14.335 INFO:tasks.workunit.client.0.smithi019.stdout:3/309: dwrite f2 [4194304,4194304] 0 2024-09-12T22:33:14.335 INFO:tasks.workunit.client.0.smithi019.stdout:5/482: truncate d0/d7/f1c 3574640 0 2024-09-12T22:33:14.335 INFO:tasks.workunit.client.0.smithi019.stdout:2/357: write d0/da/f37 [4960825,79567] 0 2024-09-12T22:33:14.335 INFO:tasks.workunit.client.0.smithi019.stdout:8/317: fdatasync d7/d8/dd/d4f/f4b 0 2024-09-12T22:33:14.335 INFO:tasks.workunit.client.0.smithi019.stdout:6/388: mkdir d1b/d26/d27/d3e/d83 0 2024-09-12T22:33:14.335 INFO:tasks.workunit.client.0.smithi019.stdout:9/347: mknod dd/d10/d17/d22/d6c/c70 0 2024-09-12T22:33:14.335 INFO:tasks.workunit.client.0.smithi019.stdout:5/483: truncate d0/d7/d16/d18/f86 679692 0 2024-09-12T22:33:14.335 INFO:tasks.workunit.client.0.smithi019.stdout:2/358: fsync d0/d5/d18/d5c/d63/d6a/f7a 0 2024-09-12T22:33:14.335 INFO:tasks.workunit.client.0.smithi019.stdout:1/431: dwrite d3/d11/d53/f6d [0,4194304] 0 2024-09-12T22:33:14.335 INFO:tasks.workunit.client.0.smithi019.stdout:6/389: rename d1b/d2d/l34 to d1b/d26/d27/d67/d77/d7b/l84 0 2024-09-12T22:33:14.335 INFO:tasks.workunit.client.0.smithi019.stdout:2/359: fdatasync d0/d5/f3a 0 2024-09-12T22:33:14.335 INFO:tasks.workunit.client.0.smithi019.stdout:7/310: dread d6/db/dc/d63/f4e [0,4194304] 0 2024-09-12T22:33:14.335 INFO:tasks.workunit.client.0.smithi019.stdout:5/484: mkdir d0/d7/d2d/d4c/d87/da2 0 2024-09-12T22:33:14.336 INFO:tasks.workunit.client.0.smithi019.stdout:1/432: write d3/d11/d16/d23/d54/f61 [810867,76892] 0 2024-09-12T22:33:14.336 INFO:tasks.workunit.client.0.smithi019.stdout:2/360: mkdir d0/d5/d60/d74/d7e 0 2024-09-12T22:33:14.336 INFO:tasks.workunit.client.0.smithi019.stdout:5/485: fsync d0/d7/d3c/f5b 0 2024-09-12T22:33:14.336 INFO:tasks.workunit.client.0.smithi019.stdout:8/318: dread d7/d8/df/f20 [4194304,4194304] 0 2024-09-12T22:33:14.336 INFO:tasks.workunit.client.0.smithi019.stdout:9/348: link dd/d10/d17/d22/f6a dd/d10/d17/d23/d2e/d31/d64/f71 0 2024-09-12T22:33:14.336 INFO:tasks.workunit.client.0.smithi019.stdout:2/361: chown d0/d5/d60 11354066 1 2024-09-12T22:33:14.336 INFO:tasks.workunit.client.0.smithi019.stdout:1/433: chown d3/d11/d16/d3c/l4b 214327 1 2024-09-12T22:33:14.336 INFO:tasks.workunit.client.0.smithi019.stdout:8/319: rmdir d7/d8/dd 39 2024-09-12T22:33:14.336 INFO:tasks.workunit.client.0.smithi019.stdout:9/349: mknod dd/d10/d17/d23/d37/c72 0 2024-09-12T22:33:14.336 INFO:tasks.workunit.client.0.smithi019.stdout:1/434: read d3/f14 [803385,818] 0 2024-09-12T22:33:14.336 INFO:tasks.workunit.client.0.smithi019.stdout:5/486: creat d0/dc/d39/d38/d4b/fa3 x:0 0 0 2024-09-12T22:33:14.336 INFO:tasks.workunit.client.0.smithi019.stdout:8/320: write d7/f19 [4937960,41695] 0 2024-09-12T22:33:14.336 INFO:tasks.workunit.client.0.smithi019.stdout:9/350: dread - dd/d10/d17/d22/f6a zero size 2024-09-12T22:33:14.337 INFO:tasks.workunit.client.0.smithi019.stdout:2/362: symlink d0/d5/d18/d1b/d5d/l7f 0 2024-09-12T22:33:14.337 INFO:tasks.workunit.client.0.smithi019.stdout:7/311: dwrite d6/f64 [4194304,4194304] 0 2024-09-12T22:33:14.337 INFO:tasks.workunit.client.0.smithi019.stdout:8/321: write d7/d34/f38 [3859079,4985] 0 2024-09-12T22:33:14.337 INFO:tasks.workunit.client.0.smithi019.stdout:2/363: chown d0/d5/d18/d1b/d5d 0 1 2024-09-12T22:33:14.337 INFO:tasks.workunit.client.0.smithi019.stdout:1/435: truncate d3/d11/d16/d23/f44 1484705 0 2024-09-12T22:33:14.337 INFO:tasks.workunit.client.0.smithi019.stdout:9/351: mkdir dd/d10/d17/d22/d6c/d53/d73 0 2024-09-12T22:33:14.337 INFO:tasks.workunit.client.0.smithi019.stdout:8/322: creat d7/d5e/f6b x:0 0 0 2024-09-12T22:33:14.337 INFO:tasks.workunit.client.0.smithi019.stdout:7/312: creat d6/db/d34/f7b x:0 0 0 2024-09-12T22:33:14.337 INFO:tasks.workunit.client.0.smithi019.stdout:1/436: chown d3/df/c5e 2021057885 1 2024-09-12T22:33:14.337 INFO:tasks.workunit.client.0.smithi019.stdout:6/390: dwrite d1b/d26/d39/f7f [0,4194304] 0 2024-09-12T22:33:14.337 INFO:tasks.workunit.client.0.smithi019.stdout:9/352: chown dd/d10/d17/d23/f2d 1006 1 2024-09-12T22:33:14.337 INFO:tasks.workunit.client.0.smithi019.stdout:2/364: unlink d0/d5/d18/d39/f65 0 2024-09-12T22:33:14.337 INFO:tasks.workunit.client.0.smithi019.stdout:8/323: symlink d7/d8/df/l6c 0 2024-09-12T22:33:14.337 INFO:tasks.workunit.client.0.smithi019.stdout:7/313: rename d6/d14/d15/d23 to d6/d14/d45/d7c 0 2024-09-12T22:33:14.338 INFO:tasks.workunit.client.0.smithi019.stdout:9/353: creat dd/d10/d17/d22/d6c/f74 x:0 0 0 2024-09-12T22:33:14.338 INFO:tasks.workunit.client.0.smithi019.stdout:9/354: dread - dd/d10/d17/d23/d37/f5a zero size 2024-09-12T22:33:14.338 INFO:tasks.workunit.client.0.smithi019.stdout:8/324: stat d7/l31 0 2024-09-12T22:33:14.338 INFO:tasks.workunit.client.0.smithi019.stdout:2/365: creat d0/d5/d18/d1b/d5d/f80 x:0 0 0 2024-09-12T22:33:14.338 INFO:tasks.workunit.client.0.smithi019.stdout:9/355: write dd/d10/d17/d23/d2e/d31/d3f/f4b [856076,19732] 0 2024-09-12T22:33:14.338 INFO:tasks.workunit.client.0.smithi019.stdout:0/366: sync 2024-09-12T22:33:14.338 INFO:tasks.workunit.client.0.smithi019.stdout:6/391: rename d1b/d26/d31/f75 to d1b/d26/d39/d6a/f85 0 2024-09-12T22:33:14.338 INFO:tasks.workunit.client.0.smithi019.stdout:7/314: unlink d6/db/dc/d63/f4d 0 2024-09-12T22:33:14.338 INFO:tasks.workunit.client.0.smithi019.stdout:8/325: readlink d7/l68 0 2024-09-12T22:33:14.338 INFO:tasks.workunit.client.0.smithi019.stdout:1/437: dwrite d3/d11/d63/d76/f8a [4194304,4194304] 0 2024-09-12T22:33:14.338 INFO:tasks.workunit.client.0.smithi019.stdout:7/315: write d6/db/d42/f61 [363321,9262] 0 2024-09-12T22:33:14.338 INFO:tasks.workunit.client.0.smithi019.stdout:1/438: dread - d3/df/f41 zero size 2024-09-12T22:33:14.338 INFO:tasks.workunit.client.0.smithi019.stdout:9/356: creat dd/d10/d17/d23/d2e/d31/d54/f75 x:0 0 0 2024-09-12T22:33:14.339 INFO:tasks.workunit.client.0.smithi019.stdout:0/367: getdents d1/d51 0 2024-09-12T22:33:14.339 INFO:tasks.workunit.client.0.smithi019.stdout:0/368: mknod d1/c70 0 2024-09-12T22:33:14.339 INFO:tasks.workunit.client.0.smithi019.stdout:8/326: getdents d7/d8/dd/d4f 0 2024-09-12T22:33:14.339 INFO:tasks.workunit.client.0.smithi019.stdout:9/357: dread - dd/d10/d17/d23/d2e/d31/d64/f66 zero size 2024-09-12T22:33:14.339 INFO:tasks.workunit.client.0.smithi019.stdout:0/369: chown d1/c70 1902 1 2024-09-12T22:33:14.339 INFO:tasks.workunit.client.0.smithi019.stdout:1/439: truncate d3/d11/d16/d3c/f66 462571 0 2024-09-12T22:33:14.339 INFO:tasks.workunit.client.0.smithi019.stdout:6/392: dwrite d1b/d26/f36 [0,4194304] 0 2024-09-12T22:33:14.339 INFO:tasks.workunit.client.0.smithi019.stdout:1/440: symlink d3/l92 0 2024-09-12T22:33:14.339 INFO:tasks.workunit.client.0.smithi019.stdout:9/358: mkdir dd/d10/d17/d76 0 2024-09-12T22:33:14.339 INFO:tasks.workunit.client.0.smithi019.stdout:0/370: mkdir d1/d14/d32/d71 0 2024-09-12T22:33:14.339 INFO:tasks.workunit.client.0.smithi019.stdout:9/359: getdents dd/d10/d17/d23/d2e/d31/d64 0 2024-09-12T22:33:14.339 INFO:tasks.workunit.client.0.smithi019.stdout:9/360: write dd/d10/f4c [684463,14352] 0 2024-09-12T22:33:14.339 INFO:tasks.workunit.client.0.smithi019.stdout:9/361: unlink dd/d10/d17/d23/f2d 0 2024-09-12T22:33:14.339 INFO:tasks.workunit.client.0.smithi019.stdout:9/362: write dd/d10/d17/d23/d2e/d31/d3f/d47/f4e [4826333,54013] 0 2024-09-12T22:33:14.340 INFO:tasks.workunit.client.0.smithi019.stdout:9/363: dread - dd/d10/d17/d23/d37/f5a zero size 2024-09-12T22:33:14.340 INFO:tasks.workunit.client.0.smithi019.stdout:6/393: getdents d1b/d26/d31 0 2024-09-12T22:33:14.340 INFO:tasks.workunit.client.0.smithi019.stdout:5/487: link d0/d7/d16/f4f d0/dc/d9a/fa4 0 2024-09-12T22:33:14.340 INFO:tasks.workunit.client.0.smithi019.stdout:9/364: mkdir dd/d10/d17/d22/d77 0 2024-09-12T22:33:14.340 INFO:tasks.workunit.client.0.smithi019.stdout:6/394: chown d1b/d26/c2a 227 1 2024-09-12T22:33:14.340 INFO:tasks.workunit.client.0.smithi019.stdout:5/488: mknod d0/d7/d2d/d32/d36/d6a/da0/ca5 0 2024-09-12T22:33:14.340 INFO:tasks.workunit.client.0.smithi019.stdout:9/365: getdents dd/d10/d17/d23/d2e/d31/d3f/d67 0 2024-09-12T22:33:14.340 INFO:tasks.workunit.client.0.smithi019.stdout:6/395: rename d1b/d26/d27/f46 to d1b/d26/d31/d5f/f86 0 2024-09-12T22:33:14.340 INFO:tasks.workunit.client.0.smithi019.stdout:5/489: chown d0/d7/d2d/d4c/l56 1282753 1 2024-09-12T22:33:14.340 INFO:tasks.workunit.client.0.smithi019.stdout:9/366: getdents dd/d10/d17/d22/d77 0 2024-09-12T22:33:14.340 INFO:tasks.workunit.client.0.smithi019.stdout:6/396: creat d1b/d26/d27/d3e/f87 x:0 0 0 2024-09-12T22:33:14.340 INFO:tasks.workunit.client.0.smithi019.stdout:5/490: mknod d0/dc/d39/d38/d4b/ca6 0 2024-09-12T22:33:14.340 INFO:tasks.workunit.client.0.smithi019.stdout:0/371: dread d1/d14/d26/f50 [0,4194304] 0 2024-09-12T22:33:14.341 INFO:tasks.workunit.client.0.smithi019.stdout:0/372: write d1/d51/f56 [341006,78417] 0 2024-09-12T22:33:14.341 INFO:tasks.workunit.client.0.smithi019.stdout:6/397: rename d1b/l38 to d1b/d26/d39/d6a/d61/l88 0 2024-09-12T22:33:14.341 INFO:tasks.workunit.client.0.smithi019.stdout:6/398: mkdir d1b/d26/d39/d89 0 2024-09-12T22:33:14.341 INFO:tasks.workunit.client.0.smithi019.stdout:0/373: write d1/d14/d1b/f44 [460985,75579] 0 2024-09-12T22:33:14.341 INFO:tasks.workunit.client.0.smithi019.stdout:4/351: sync 2024-09-12T22:33:14.341 INFO:tasks.workunit.client.0.smithi019.stdout:2/366: sync 2024-09-12T22:33:14.341 INFO:tasks.workunit.client.0.smithi019.stdout:1/441: sync 2024-09-12T22:33:14.341 INFO:tasks.workunit.client.0.smithi019.stdout:2/367: chown d0/d5/c4f 5131092 1 2024-09-12T22:33:14.341 INFO:tasks.workunit.client.0.smithi019.stdout:6/399: write d1b/d26/f7e [786634,33031] 0 2024-09-12T22:33:14.341 INFO:tasks.workunit.client.0.smithi019.stdout:1/442: creat d3/d3f/d58/f93 x:0 0 0 2024-09-12T22:33:14.341 INFO:tasks.workunit.client.0.smithi019.stdout:4/352: rename d1/d4/d44/f54 to d1/d22/d57/f6e 0 2024-09-12T22:33:14.341 INFO:tasks.workunit.client.0.smithi019.stdout:0/374: read d1/d14/d26/d40/d45/f54 [699861,62313] 0 2024-09-12T22:33:14.341 INFO:tasks.workunit.client.0.smithi019.stdout:6/400: rename d1b/d26 to d1b/d26/d31/d5f/d8a 22 2024-09-12T22:33:14.342 INFO:tasks.workunit.client.0.smithi019.stdout:1/443: mknod d3/df/d7e/c94 0 2024-09-12T22:33:14.342 INFO:tasks.workunit.client.0.smithi019.stdout:6/401: readlink l8 0 2024-09-12T22:33:14.342 INFO:tasks.workunit.client.0.smithi019.stdout:1/444: chown d3/d11/d63/d76 654026098 1 2024-09-12T22:33:14.342 INFO:tasks.workunit.client.0.smithi019.stdout:6/402: unlink d1b/d26/d39/f7f 0 2024-09-12T22:33:14.342 INFO:tasks.workunit.client.0.smithi019.stdout:1/445: mkdir d3/d11/d63/d76/d91/d95 0 2024-09-12T22:33:14.342 INFO:tasks.workunit.client.0.smithi019.stdout:0/375: truncate d1/d14/d26/d40/d45/f54 1988365 0 2024-09-12T22:33:14.342 INFO:tasks.workunit.client.0.smithi019.stdout:6/403: symlink d1b/d26/d39/d6a/l8b 0 2024-09-12T22:33:14.342 INFO:tasks.workunit.client.0.smithi019.stdout:1/446: readlink d3/d11/d63/l8f 0 2024-09-12T22:33:14.342 INFO:tasks.workunit.client.0.smithi019.stdout:1/447: chown d3/d11/d53/f67 97981 1 2024-09-12T22:33:14.342 INFO:tasks.workunit.client.0.smithi019.stdout:0/376: dread d1/f4d [0,4194304] 0 2024-09-12T22:33:14.342 INFO:tasks.workunit.client.0.smithi019.stdout:1/448: chown d3/df/l46 58636277 1 2024-09-12T22:33:14.342 INFO:tasks.workunit.client.0.smithi019.stdout:2/368: dwrite d0/d5/d18/d3d/f5f [0,4194304] 0 2024-09-12T22:33:14.342 INFO:tasks.workunit.client.0.smithi019.stdout:5/491: write d0/dc/f74 [858675,89924] 0 2024-09-12T22:33:14.342 INFO:tasks.workunit.client.0.smithi019.stdout:9/367: write dd/d10/d17/d22/d6c/d53/f5c [370922,104019] 0 2024-09-12T22:33:14.343 INFO:tasks.workunit.client.0.smithi019.stdout:3/310: dread dd/d12/f30 [0,4194304] 0 2024-09-12T22:33:14.343 INFO:tasks.workunit.client.0.smithi019.stdout:1/449: dread - d3/d3f/d58/f93 zero size 2024-09-12T22:33:14.343 INFO:tasks.workunit.client.0.smithi019.stdout:5/492: read - d0/d7/d16/f91 zero size 2024-09-12T22:33:14.343 INFO:tasks.workunit.client.0.smithi019.stdout:9/368: fsync dd/f20 0 2024-09-12T22:33:14.343 INFO:tasks.workunit.client.0.smithi019.stdout:3/311: rmdir dd/d1e 39 2024-09-12T22:33:14.343 INFO:tasks.workunit.client.0.smithi019.stdout:1/450: mkdir d3/df/d7e/d96 0 2024-09-12T22:33:14.343 INFO:tasks.workunit.client.0.smithi019.stdout:7/316: dread d6/f5f [0,4194304] 0 2024-09-12T22:33:14.343 INFO:tasks.workunit.client.0.smithi019.stdout:0/377: truncate d1/fd 2344554 0 2024-09-12T22:33:14.343 INFO:tasks.workunit.client.0.smithi019.stdout:3/312: unlink dd/d12/l1a 0 2024-09-12T22:33:14.343 INFO:tasks.workunit.client.0.smithi019.stdout:9/369: symlink dd/d10/d17/l78 0 2024-09-12T22:33:14.343 INFO:tasks.workunit.client.0.smithi019.stdout:6/404: dread d1b/d26/f7e [0,4194304] 0 2024-09-12T22:33:14.343 INFO:tasks.workunit.client.0.smithi019.stdout:6/405: rmdir d1b/d2d 39 2024-09-12T22:33:14.343 INFO:tasks.workunit.client.0.smithi019.stdout:3/313: truncate dd/f20 572185 0 2024-09-12T22:33:14.343 INFO:tasks.workunit.client.0.smithi019.stdout:2/369: dwrite d0/d5/d18/d1b/d36/f4c [0,4194304] 0 2024-09-12T22:33:14.344 INFO:tasks.workunit.client.0.smithi019.stdout:9/370: truncate dd/d10/d17/d23/d37/f5b 871576 0 2024-09-12T22:33:14.344 INFO:tasks.workunit.client.0.smithi019.stdout:3/314: chown dd/d12/f2c 733602459 1 2024-09-12T22:33:14.344 INFO:tasks.workunit.client.0.smithi019.stdout:6/406: rename d1b/f2b to d1b/d26/d27/d67/d77/d7b/f8c 0 2024-09-12T22:33:14.344 INFO:tasks.workunit.client.0.smithi019.stdout:9/371: creat dd/d10/d17/d22/d6c/f79 x:0 0 0 2024-09-12T22:33:14.344 INFO:tasks.workunit.client.0.smithi019.stdout:5/493: read d0/f23 [1524444,121719] 0 2024-09-12T22:33:14.344 INFO:tasks.workunit.client.0.smithi019.stdout:6/407: symlink d1b/d26/d39/d89/l8d 0 2024-09-12T22:33:14.344 INFO:tasks.workunit.client.0.smithi019.stdout:3/315: getdents dd/d1e/d40 0 2024-09-12T22:33:14.344 INFO:tasks.workunit.client.0.smithi019.stdout:0/378: dwrite d1/d1f/d5b/f61 [4194304,4194304] 0 2024-09-12T22:33:14.344 INFO:tasks.workunit.client.0.smithi019.stdout:5/494: unlink d0/dc/d39/d38/d4b/f8b 0 2024-09-12T22:33:14.344 INFO:tasks.workunit.client.0.smithi019.stdout:8/327: dread d7/d8/df/f20 [0,4194304] 0 2024-09-12T22:33:14.344 INFO:tasks.workunit.client.0.smithi019.stdout:5/495: chown d0/f2 11 1 2024-09-12T22:33:14.344 INFO:tasks.workunit.client.0.smithi019.stdout:9/372: symlink dd/d10/d17/d23/d2e/d31/d3f/d67/l7a 0 2024-09-12T22:33:14.344 INFO:tasks.workunit.client.0.smithi019.stdout:5/496: creat d0/dc/d39/fa7 x:0 0 0 2024-09-12T22:33:14.345 INFO:tasks.workunit.client.0.smithi019.stdout:3/316: unlink dd/d12/f52 0 2024-09-12T22:33:14.345 INFO:tasks.workunit.client.0.smithi019.stdout:9/373: read - dd/d10/d17/d23/d2e/d31/d54/f75 zero size 2024-09-12T22:33:14.345 INFO:tasks.workunit.client.0.smithi019.stdout:1/451: sync 2024-09-12T22:33:14.345 INFO:tasks.workunit.client.0.smithi019.stdout:8/328: dread d7/d8/df/d2d/f30 [0,4194304] 0 2024-09-12T22:33:14.345 INFO:tasks.workunit.client.0.smithi019.stdout:3/317: dread - dd/d1e/f23 zero size 2024-09-12T22:33:14.345 INFO:tasks.workunit.client.0.smithi019.stdout:6/408: dwrite d1b/f20 [0,4194304] 0 2024-09-12T22:33:14.345 INFO:tasks.workunit.client.0.smithi019.stdout:8/329: read - d7/d8/dd/f1c zero size 2024-09-12T22:33:14.345 INFO:tasks.workunit.client.0.smithi019.stdout:3/318: mknod dd/d12/c59 0 2024-09-12T22:33:14.345 INFO:tasks.workunit.client.0.smithi019.stdout:8/330: creat d7/d2f/f6d x:0 0 0 2024-09-12T22:33:14.345 INFO:tasks.workunit.client.0.smithi019.stdout:8/331: symlink d7/d8/df/d53/l6e 0 2024-09-12T22:33:14.345 INFO:tasks.workunit.client.0.smithi019.stdout:4/353: dread d1/d8/f10 [4194304,4194304] 0 2024-09-12T22:33:14.345 INFO:tasks.workunit.client.0.smithi019.stdout:8/332: creat d7/f6f x:0 0 0 2024-09-12T22:33:14.345 INFO:tasks.workunit.client.0.smithi019.stdout:9/374: dwrite dd/f18 [0,4194304] 0 2024-09-12T22:33:14.345 INFO:tasks.workunit.client.0.smithi019.stdout:3/319: write dd/f17 [169855,121256] 0 2024-09-12T22:33:14.346 INFO:tasks.workunit.client.0.smithi019.stdout:6/409: dread d1b/d26/d27/d3e/f64 [0,4194304] 0 2024-09-12T22:33:14.346 INFO:tasks.workunit.client.0.smithi019.stdout:2/370: dread d0/da/f31 [0,4194304] 0 2024-09-12T22:33:14.346 INFO:tasks.workunit.client.0.smithi019.stdout:4/354: read d1/d22/d2c/f35 [1555131,96358] 0 2024-09-12T22:33:14.346 INFO:tasks.workunit.client.0.smithi019.stdout:8/333: truncate d7/d34/f3e 58119 0 2024-09-12T22:33:14.346 INFO:tasks.workunit.client.0.smithi019.stdout:3/320: mkdir dd/d1e/d5a 0 2024-09-12T22:33:14.346 INFO:tasks.workunit.client.0.smithi019.stdout:4/355: stat d1/d8/l1e 0 2024-09-12T22:33:14.346 INFO:tasks.workunit.client.0.smithi019.stdout:6/410: write d1b/d26/d39/d6a/d61/f62 [4068432,10069] 0 2024-09-12T22:33:14.346 INFO:tasks.workunit.client.0.smithi019.stdout:9/375: fdatasync dd/d10/d17/d23/d2e/d31/f34 0 2024-09-12T22:33:14.346 INFO:tasks.workunit.client.0.smithi019.stdout:4/356: creat d1/d4/f6f x:0 0 0 2024-09-12T22:33:14.346 INFO:tasks.workunit.client.0.smithi019.stdout:8/334: write d7/d5e/f60 [988083,66219] 0 2024-09-12T22:33:14.346 INFO:tasks.workunit.client.0.smithi019.stdout:2/371: getdents d0/d5/d18/d5c/d67/d77 0 2024-09-12T22:33:14.346 INFO:tasks.workunit.client.0.smithi019.stdout:3/321: link dd/f16 dd/d1e/d5a/f5b 0 2024-09-12T22:33:14.346 INFO:tasks.workunit.client.0.smithi019.stdout:8/335: chown d7/d2f/f6d 12996 1 2024-09-12T22:33:14.346 INFO:tasks.workunit.client.0.smithi019.stdout:1/452: dwrite d3/d11/d16/f3b [0,4194304] 0 2024-09-12T22:33:14.347 INFO:tasks.workunit.client.0.smithi019.stdout:8/336: stat c2 0 2024-09-12T22:33:14.347 INFO:tasks.workunit.client.0.smithi019.stdout:3/322: chown la 497336 1 2024-09-12T22:33:14.347 INFO:tasks.workunit.client.0.smithi019.stdout:9/376: mknod dd/d10/d17/d22/d6c/d53/d69/c7b 0 2024-09-12T22:33:14.347 INFO:tasks.workunit.client.0.smithi019.stdout:2/372: symlink d0/d5/d18/d5c/d67/d77/l81 0 2024-09-12T22:33:14.347 INFO:tasks.workunit.client.0.smithi019.stdout:6/411: link d1b/d26/d39/d6a/l8b d1b/d26/d27/d3e/l8e 0 2024-09-12T22:33:14.347 INFO:tasks.workunit.client.0.smithi019.stdout:1/453: fsync d3/d11/d63/d76/d91/f8b 0 2024-09-12T22:33:14.347 INFO:tasks.workunit.client.0.smithi019.stdout:8/337: chown d7/d8/dd/f21 391857 1 2024-09-12T22:33:14.347 INFO:tasks.workunit.client.0.smithi019.stdout:1/454: chown d3/d11 547557210 1 2024-09-12T22:33:14.347 INFO:tasks.workunit.client.0.smithi019.stdout:3/323: symlink dd/d1e/l5c 0 2024-09-12T22:33:14.347 INFO:tasks.workunit.client.0.smithi019.stdout:3/324: write f2 [5975547,19404] 0 2024-09-12T22:33:14.347 INFO:tasks.workunit.client.0.smithi019.stdout:6/412: rename d1b/d26/d39/f4a to d1b/d26/d27/d67/d77/f8f 0 2024-09-12T22:33:14.347 INFO:tasks.workunit.client.0.smithi019.stdout:2/373: link d0/d5/d18/f20 d0/da/d73/d7c/f82 0 2024-09-12T22:33:14.347 INFO:tasks.workunit.client.0.smithi019.stdout:8/338: write d7/d34/f38 [1714906,72900] 0 2024-09-12T22:33:14.348 INFO:tasks.workunit.client.0.smithi019.stdout:1/455: creat d3/d11/d63/f97 x:0 0 0 2024-09-12T22:33:14.348 INFO:tasks.workunit.client.0.smithi019.stdout:9/377: rename l1 to dd/d10/d17/d23/d2e/d31/d54/l7c 0 2024-09-12T22:33:14.348 INFO:tasks.workunit.client.0.smithi019.stdout:3/325: mknod dd/c5d 0 2024-09-12T22:33:14.348 INFO:tasks.workunit.client.0.smithi019.stdout:1/456: readlink d3/d11/d16/d23/d54/l78 0 2024-09-12T22:33:14.348 INFO:tasks.workunit.client.0.smithi019.stdout:6/413: mkdir d1b/d26/d39/d89/d90 0 2024-09-12T22:33:14.348 INFO:tasks.workunit.client.0.smithi019.stdout:3/326: fsync dd/d1e/f37 0 2024-09-12T22:33:14.348 INFO:tasks.workunit.client.0.smithi019.stdout:9/378: unlink dd/d10/d17/c61 0 2024-09-12T22:33:14.348 INFO:tasks.workunit.client.0.smithi019.stdout:3/327: stat dd/f13 0 2024-09-12T22:33:14.348 INFO:tasks.workunit.client.0.smithi019.stdout:6/414: mkdir d1b/d26/d31/d5f/d91 0 2024-09-12T22:33:14.348 INFO:tasks.workunit.client.0.smithi019.stdout:1/457: rmdir d3/d11/d63/d76/d91/d95 0 2024-09-12T22:33:14.348 INFO:tasks.workunit.client.0.smithi019.stdout:3/328: fsync dd/d1e/f34 0 2024-09-12T22:33:14.348 INFO:tasks.workunit.client.0.smithi019.stdout:8/339: dread d7/d34/f52 [0,4194304] 0 2024-09-12T22:33:14.348 INFO:tasks.workunit.client.0.smithi019.stdout:6/415: creat d1b/d26/d39/d6a/f92 x:0 0 0 2024-09-12T22:33:14.348 INFO:tasks.workunit.client.0.smithi019.stdout:6/416: chown le 12465 1 2024-09-12T22:33:14.349 INFO:tasks.workunit.client.0.smithi019.stdout:1/458: rename d3/d11/d16/f45 to d3/df/d7e/d96/f98 0 2024-09-12T22:33:14.349 INFO:tasks.workunit.client.0.smithi019.stdout:2/374: dwrite d0/d5/d18/d5c/d67/d77/f7b [0,4194304] 0 2024-09-12T22:33:14.349 INFO:tasks.workunit.client.0.smithi019.stdout:1/459: stat d3/d6e 0 2024-09-12T22:33:14.349 INFO:tasks.workunit.client.0.smithi019.stdout:2/375: stat d0/d5/d18/d5c/d63/d6a/f7a 0 2024-09-12T22:33:14.349 INFO:tasks.workunit.client.0.smithi019.stdout:8/340: rename d7/d8/df/f1f to d7/d2f/d42/f70 0 2024-09-12T22:33:14.349 INFO:tasks.workunit.client.0.smithi019.stdout:1/460: creat d3/d11/d16/f99 x:0 0 0 2024-09-12T22:33:14.349 INFO:tasks.workunit.client.0.smithi019.stdout:8/341: readlink d7/d8/l26 0 2024-09-12T22:33:14.349 INFO:tasks.workunit.client.0.smithi019.stdout:2/376: dread - d0/d5/d18/d5c/f68 zero size 2024-09-12T22:33:14.349 INFO:tasks.workunit.client.0.smithi019.stdout:9/379: dwrite dd/d10/d17/d22/f4f [0,4194304] 0 2024-09-12T22:33:14.349 INFO:tasks.workunit.client.0.smithi019.stdout:2/377: read d0/f1f [524401,66087] 0 2024-09-12T22:33:14.349 INFO:tasks.workunit.client.0.smithi019.stdout:8/342: unlink d7/d8/df/f33 0 2024-09-12T22:33:14.349 INFO:tasks.workunit.client.0.smithi019.stdout:8/343: rmdir d7/d8/dd/d45 39 2024-09-12T22:33:14.349 INFO:tasks.workunit.client.0.smithi019.stdout:8/344: chown d7/l31 64074901 1 2024-09-12T22:33:14.349 INFO:tasks.workunit.client.0.smithi019.stdout:9/380: chown dd/d10/d17/d23/d2e/d31/d3f/d67/l7a 57242 1 2024-09-12T22:33:14.350 INFO:tasks.workunit.client.0.smithi019.stdout:7/317: dread d6/d2d/d41/f48 [0,4194304] 0 2024-09-12T22:33:14.350 INFO:tasks.workunit.client.0.smithi019.stdout:9/381: truncate dd/d10/f39 4892748 0 2024-09-12T22:33:14.350 INFO:tasks.workunit.client.0.smithi019.stdout:3/329: truncate dd/f11 11711720 0 2024-09-12T22:33:14.350 INFO:tasks.workunit.client.0.smithi019.stdout:8/345: link d7/d8/dd/f11 d7/d8/df/d54/f71 0 2024-09-12T22:33:14.350 INFO:tasks.workunit.client.0.smithi019.stdout:7/318: link d6/d14/d45/d7c/f72 d6/db/d42/f7d 0 2024-09-12T22:33:14.350 INFO:tasks.workunit.client.0.smithi019.stdout:3/330: sync 2024-09-12T22:33:14.350 INFO:tasks.workunit.client.0.smithi019.stdout:9/382: write dd/d10/d17/f24 [9762767,55237] 0 2024-09-12T22:33:14.350 INFO:tasks.workunit.client.0.smithi019.stdout:6/417: write d1b/d26/d39/f82 [608625,105673] 0 2024-09-12T22:33:14.350 INFO:tasks.workunit.client.0.smithi019.stdout:3/331: chown dd/d1e/c32 69 1 2024-09-12T22:33:14.350 INFO:tasks.workunit.client.0.smithi019.stdout:3/332: sync 2024-09-12T22:33:14.350 INFO:tasks.workunit.client.0.smithi019.stdout:6/418: symlink d1b/l93 0 2024-09-12T22:33:14.350 INFO:tasks.workunit.client.0.smithi019.stdout:7/319: truncate d6/db/d42/f61 957684 0 2024-09-12T22:33:14.350 INFO:tasks.workunit.client.0.smithi019.stdout:7/320: stat d6/d14/d15 0 2024-09-12T22:33:14.353 INFO:tasks.workunit.client.0.smithi019.stdout:8/346: dwrite d7/d8/df/d2d/f30 [0,4194304] 0 2024-09-12T22:33:14.353 INFO:tasks.workunit.client.0.smithi019.stdout:6/419: dwrite d1b/d26/d27/f2f [0,4194304] 0 2024-09-12T22:33:14.353 INFO:tasks.workunit.client.0.smithi019.stdout:2/378: truncate d0/da/f29 2074149 0 2024-09-12T22:33:14.353 INFO:tasks.workunit.client.0.smithi019.stdout:3/333: write dd/d12/f24 [1841297,111544] 0 2024-09-12T22:33:14.354 INFO:tasks.workunit.client.0.smithi019.stdout:9/383: truncate dd/d10/d17/d22/d42/f55 1650085 0 2024-09-12T22:33:14.354 INFO:tasks.workunit.client.0.smithi019.stdout:2/379: rmdir d0/d5/d18/d1b/d5d 39 2024-09-12T22:33:14.354 INFO:tasks.workunit.client.0.smithi019.stdout:8/347: dwrite d7/d8/df/f17 [0,4194304] 0 2024-09-12T22:33:14.354 INFO:tasks.workunit.client.0.smithi019.stdout:3/334: mknod dd/d1e/d5a/c5e 0 2024-09-12T22:33:14.354 INFO:tasks.workunit.client.0.smithi019.stdout:9/384: dread - dd/d10/d17/d23/d2e/d31/d54/f75 zero size 2024-09-12T22:33:14.354 INFO:tasks.workunit.client.0.smithi019.stdout:6/420: dwrite d1b/d26/d27/d3e/f79 [0,4194304] 0 2024-09-12T22:33:14.354 INFO:tasks.workunit.client.0.smithi019.stdout:2/380: unlink d0/d5/d18/d5c/d67/d77/l81 0 2024-09-12T22:33:14.354 INFO:tasks.workunit.client.0.smithi019.stdout:8/348: rename d7/d8/df/d2d/c3d to d7/d2f/c72 0 2024-09-12T22:33:14.354 INFO:tasks.workunit.client.0.smithi019.stdout:6/421: fsync d1b/d26/d39/f41 0 2024-09-12T22:33:14.354 INFO:tasks.workunit.client.0.smithi019.stdout:2/381: readlink d0/d5/d18/d5c/l6e 0 2024-09-12T22:33:14.354 INFO:tasks.workunit.client.0.smithi019.stdout:2/382: sync 2024-09-12T22:33:14.354 INFO:tasks.workunit.client.0.smithi019.stdout:9/385: mknod dd/d10/d17/d23/d2e/d31/d3f/d47/d6e/c7d 0 2024-09-12T22:33:14.354 INFO:tasks.workunit.client.0.smithi019.stdout:0/379: dread d1/d14/f1e [0,4194304] 0 2024-09-12T22:33:14.355 INFO:tasks.workunit.client.0.smithi019.stdout:0/380: readlink d1/d1f/l2d 0 2024-09-12T22:33:14.355 INFO:tasks.workunit.client.0.smithi019.stdout:6/422: fdatasync d1b/d26/d39/d6a/f57 0 2024-09-12T22:33:14.355 INFO:tasks.workunit.client.0.smithi019.stdout:8/349: rename d7/d8/df/f3b to d7/d8/f73 0 2024-09-12T22:33:14.355 INFO:tasks.workunit.client.0.smithi019.stdout:0/381: read d1/d14/f1e [3961340,100436] 0 2024-09-12T22:33:14.355 INFO:tasks.workunit.client.0.smithi019.stdout:6/423: symlink d1b/d26/d27/d3e/l94 0 2024-09-12T22:33:14.355 INFO:tasks.workunit.client.0.smithi019.stdout:2/383: truncate d0/d5/d18/d1b/d5d/f80 951729 0 2024-09-12T22:33:14.355 INFO:tasks.workunit.client.0.smithi019.stdout:5/497: dread d0/f7e [0,4194304] 0 2024-09-12T22:33:14.355 INFO:tasks.workunit.client.0.smithi019.stdout:8/350: rename d7/d8/dd/l1e to d7/d8/dd/d45/l74 0 2024-09-12T22:33:14.355 INFO:tasks.workunit.client.0.smithi019.stdout:0/382: truncate d1/d14/f4e 1018418 0 2024-09-12T22:33:14.355 INFO:tasks.workunit.client.0.smithi019.stdout:6/424: unlink d1b/d26/l4b 0 2024-09-12T22:33:14.355 INFO:tasks.workunit.client.0.smithi019.stdout:8/351: rmdir d7/d8/dd 39 2024-09-12T22:33:14.355 INFO:tasks.workunit.client.0.smithi019.stdout:5/498: mknod d0/dc/d39/d38/d4b/ca8 0 2024-09-12T22:33:14.355 INFO:tasks.workunit.client.0.smithi019.stdout:9/386: dwrite dd/f18 [0,4194304] 0 2024-09-12T22:33:14.355 INFO:tasks.workunit.client.0.smithi019.stdout:8/352: getdents d7/d34 0 2024-09-12T22:33:14.356 INFO:tasks.workunit.client.0.smithi019.stdout:4/357: dread d1/f25 [0,4194304] 0 2024-09-12T22:33:14.356 INFO:tasks.workunit.client.0.smithi019.stdout:9/387: mkdir dd/d10/d17/d23/d2e/d31/d7e 0 2024-09-12T22:33:14.356 INFO:tasks.workunit.client.0.smithi019.stdout:8/353: rmdir d7/d8/dd 39 2024-09-12T22:33:14.357 INFO:tasks.workunit.client.0.smithi019.stdout:5/499: link d0/dc/d9a/l9b d0/d7/d16/d18/d9d/la9 0 2024-09-12T22:33:14.357 INFO:tasks.workunit.client.0.smithi019.stdout:9/388: fdatasync dd/d10/f39 0 2024-09-12T22:33:14.358 INFO:tasks.workunit.client.0.smithi019.stdout:8/354: mkdir d7/d2f/d75 0 2024-09-12T22:33:14.358 INFO:tasks.workunit.client.0.smithi019.stdout:2/384: dwrite d0/da/f37 [0,4194304] 0 2024-09-12T22:33:14.358 INFO:tasks.workunit.client.0.smithi019.stdout:4/358: truncate d1/d8/f10 9170756 0 2024-09-12T22:33:14.359 INFO:tasks.workunit.client.0.smithi019.stdout:5/500: mknod d0/d7/d2d/d32/d36/d8c/caa 0 2024-09-12T22:33:14.359 INFO:tasks.workunit.client.0.smithi019.stdout:8/355: creat d7/d2f/d75/f76 x:0 0 0 2024-09-12T22:33:14.360 INFO:tasks.workunit.client.0.smithi019.stdout:9/389: mknod dd/d10/d17/d22/d42/c7f 0 2024-09-12T22:33:14.360 INFO:tasks.workunit.client.0.smithi019.stdout:4/359: mknod d1/d4c/c70 0 2024-09-12T22:33:14.361 INFO:tasks.workunit.client.0.smithi019.stdout:6/425: dwrite d1b/d26/d27/d67/d77/d7b/f8c [4194304,4194304] 0 2024-09-12T22:33:14.361 INFO:tasks.workunit.client.0.smithi019.stdout:5/501: chown d0/d7/d16/d69/c97 648340995 1 2024-09-12T22:33:14.361 INFO:tasks.workunit.client.0.smithi019.stdout:9/390: write dd/f18 [1170178,123888] 0 2024-09-12T22:33:14.362 INFO:tasks.workunit.client.0.smithi019.stdout:5/502: unlink d0/d7/d90/f98 0 2024-09-12T22:33:14.363 INFO:tasks.workunit.client.0.smithi019.stdout:8/356: rename d7/d8/l5b to d7/d8/df/d2d/l77 0 2024-09-12T22:33:14.370 INFO:tasks.workunit.client.0.smithi019.stdout:5/503: creat d0/dc/fab x:0 0 0 2024-09-12T22:33:14.370 INFO:tasks.workunit.client.0.smithi019.stdout:1/461: dread d3/d1b/f1d [4194304,4194304] 0 2024-09-12T22:33:14.370 INFO:tasks.workunit.client.0.smithi019.stdout:8/357: dwrite d7/d8/df/f20 [0,4194304] 0 2024-09-12T22:33:14.370 INFO:tasks.workunit.client.0.smithi019.stdout:1/462: write d3/d6e/f87 [482389,24319] 0 2024-09-12T22:33:14.370 INFO:tasks.workunit.client.0.smithi019.stdout:8/358: unlink c2 0 2024-09-12T22:33:14.372 INFO:tasks.workunit.client.0.smithi019.stdout:1/463: link d3/d1b/f27 d3/df/f9a 0 2024-09-12T22:33:14.373 INFO:tasks.workunit.client.0.smithi019.stdout:8/359: readlink d7/d8/dd/d45/l50 0 2024-09-12T22:33:14.373 INFO:tasks.workunit.client.0.smithi019.stdout:1/464: unlink d3/d11/d16/f73 0 2024-09-12T22:33:14.374 INFO:tasks.workunit.client.0.smithi019.stdout:8/360: truncate f0 5444443 0 2024-09-12T22:33:14.374 INFO:tasks.workunit.client.0.smithi019.stdout:6/426: truncate d1b/d26/d31/f4e 138125 0 2024-09-12T22:33:14.376 INFO:tasks.workunit.client.0.smithi019.stdout:6/427: write d1b/d26/d39/d6a/f85 [621329,57394] 0 2024-09-12T22:33:14.378 INFO:tasks.workunit.client.0.smithi019.stdout:2/385: dwrite d0/d5/d18/f20 [0,4194304] 0 2024-09-12T22:33:14.378 INFO:tasks.workunit.client.0.smithi019.stdout:6/428: mkdir d1b/d26/d27/d67/d77/d95 0 2024-09-12T22:33:14.378 INFO:tasks.workunit.client.0.smithi019.stdout:2/386: fdatasync d0/d5/d18/f3e 0 2024-09-12T22:33:14.379 INFO:tasks.workunit.client.0.smithi019.stdout:6/429: creat d1b/d26/f96 x:0 0 0 2024-09-12T22:33:14.379 INFO:tasks.workunit.client.0.smithi019.stdout:2/387: symlink d0/d5/d17/l83 0 2024-09-12T22:33:14.380 INFO:tasks.workunit.client.0.smithi019.stdout:1/465: dread d3/df/d7e/d96/f98 [0,4194304] 0 2024-09-12T22:33:14.380 INFO:tasks.workunit.client.0.smithi019.stdout:6/430: mkdir d1b/d26/d39/d6a/d97 0 2024-09-12T22:33:14.381 INFO:tasks.workunit.client.0.smithi019.stdout:1/466: chown d3/d11/d63/d76/l7a 531930991 1 2024-09-12T22:33:14.385 INFO:tasks.workunit.client.0.smithi019.stdout:6/431: dread d1b/d26/d39/d6a/f5c [0,4194304] 0 2024-09-12T22:33:14.387 INFO:tasks.workunit.client.0.smithi019.stdout:4/360: dread d1/d4/d38/f3b [0,4194304] 0 2024-09-12T22:33:14.387 INFO:tasks.workunit.client.0.smithi019.stdout:0/383: dread d1/d14/d32/f35 [0,4194304] 0 2024-09-12T22:33:14.388 INFO:tasks.workunit.client.0.smithi019.stdout:9/391: read dd/d10/d17/d23/f49 [524181,20198] 0 2024-09-12T22:33:14.389 INFO:tasks.workunit.client.0.smithi019.stdout:7/321: dread d6/db/dc/f43 [0,4194304] 0 2024-09-12T22:33:14.390 INFO:tasks.workunit.client.0.smithi019.stdout:0/384: write d1/d51/f56 [233901,36994] 0 2024-09-12T22:33:14.390 INFO:tasks.workunit.client.0.smithi019.stdout:5/504: dwrite d0/d7/d16/d18/f9e [4194304,4194304] 0 2024-09-12T22:33:14.390 INFO:tasks.workunit.client.0.smithi019.stdout:1/467: dwrite d3/d3f/f24 [0,4194304] 0 2024-09-12T22:33:14.391 INFO:tasks.workunit.client.0.smithi019.stdout:4/361: rename d1/d11/d15/d1f/l3a to d1/d8/l71 0 2024-09-12T22:33:14.391 INFO:tasks.workunit.client.0.smithi019.stdout:7/322: fdatasync d6/db/dc/d63/f37 0 2024-09-12T22:33:14.391 INFO:tasks.workunit.client.0.smithi019.stdout:3/335: dread dd/d1e/f2e [0,4194304] 0 2024-09-12T22:33:14.392 INFO:tasks.workunit.client.0.smithi019.stdout:7/323: sync 2024-09-12T22:33:14.392 INFO:tasks.workunit.client.0.smithi019.stdout:0/385: creat d1/d1f/d5b/f72 x:0 0 0 2024-09-12T22:33:14.392 INFO:tasks.workunit.client.0.smithi019.stdout:5/505: mknod d0/dc/d9a/cac 0 2024-09-12T22:33:14.392 INFO:tasks.workunit.client.0.smithi019.stdout:9/392: mkdir dd/d10/d17/d23/d2e/d31/d3f/d47/d6e/d80 0 2024-09-12T22:33:14.393 INFO:tasks.workunit.client.0.smithi019.stdout:7/324: dread - d6/db/dc/f71 zero size 2024-09-12T22:33:14.393 INFO:tasks.workunit.client.0.smithi019.stdout:1/468: mknod d3/d11/d63/d76/c9b 0 2024-09-12T22:33:14.393 INFO:tasks.workunit.client.0.smithi019.stdout:3/336: mkdir dd/d1e/d40/d5f 0 2024-09-12T22:33:14.394 INFO:tasks.workunit.client.0.smithi019.stdout:9/393: dread - dd/d10/d17/d23/d37/f5a zero size 2024-09-12T22:33:14.395 INFO:tasks.workunit.client.0.smithi019.stdout:4/362: getdents d1/d11/d15/d4e/d5a 0 2024-09-12T22:33:14.398 INFO:tasks.workunit.client.0.smithi019.stdout:3/337: creat dd/d1e/d5a/f60 x:0 0 0 2024-09-12T22:33:14.399 INFO:tasks.workunit.client.0.smithi019.stdout:4/363: creat d1/d4c/f72 x:0 0 0 2024-09-12T22:33:14.399 INFO:tasks.workunit.client.0.smithi019.stdout:1/469: truncate d3/df/f9a 3854386 0 2024-09-12T22:33:14.399 INFO:tasks.workunit.client.0.smithi019.stdout:9/394: creat dd/d10/d6b/f81 x:0 0 0 2024-09-12T22:33:14.399 INFO:tasks.workunit.client.0.smithi019.stdout:0/386: dwrite d1/d14/d26/f5c [0,4194304] 0 2024-09-12T22:33:14.400 INFO:tasks.workunit.client.0.smithi019.stdout:5/506: dwrite d0/f75 [0,4194304] 0 2024-09-12T22:33:14.401 INFO:tasks.workunit.client.0.smithi019.stdout:9/395: readlink dd/d10/l3b 0 2024-09-12T22:33:14.401 INFO:tasks.workunit.client.0.smithi019.stdout:4/364: creat d1/d4/d44/f73 x:0 0 0 2024-09-12T22:33:14.405 INFO:tasks.workunit.client.0.smithi019.stdout:1/470: creat d3/d11/d63/d76/f9c x:0 0 0 2024-09-12T22:33:14.405 INFO:tasks.workunit.client.0.smithi019.stdout:0/387: truncate d1/f4d 139569 0 2024-09-12T22:33:14.405 INFO:tasks.workunit.client.0.smithi019.stdout:3/338: getdents dd/d1e 0 2024-09-12T22:33:14.405 INFO:tasks.workunit.client.0.smithi019.stdout:1/471: readlink d3/d11/l8d 0 2024-09-12T22:33:14.405 INFO:tasks.workunit.client.0.smithi019.stdout:7/325: dwrite d6/d2d/d41/f56 [0,4194304] 0 2024-09-12T22:33:14.405 INFO:tasks.workunit.client.0.smithi019.stdout:5/507: getdents d0/d7/d2d/d32 0 2024-09-12T22:33:14.405 INFO:tasks.workunit.client.0.smithi019.stdout:9/396: mkdir dd/d10/d17/d23/d82 0 2024-09-12T22:33:14.406 INFO:tasks.workunit.client.0.smithi019.stdout:1/472: chown d3/d11/d16/f86 230 1 2024-09-12T22:33:14.406 INFO:tasks.workunit.client.0.smithi019.stdout:7/326: creat d6/d14/d45/f7e x:0 0 0 2024-09-12T22:33:14.406 INFO:tasks.workunit.client.0.smithi019.stdout:5/508: write d0/dc/d39/d38/f44 [538498,68209] 0 2024-09-12T22:33:14.407 INFO:tasks.workunit.client.0.smithi019.stdout:7/327: mkdir d6/db/dc/d63/d7f 0 2024-09-12T22:33:14.407 INFO:tasks.workunit.client.0.smithi019.stdout:4/365: read d1/d8/f20 [2595724,111100] 0 2024-09-12T22:33:14.407 INFO:tasks.workunit.client.0.smithi019.stdout:5/509: creat d0/d7/d2d/d32/d36/fad x:0 0 0 2024-09-12T22:33:14.407 INFO:tasks.workunit.client.0.smithi019.stdout:7/328: chown d6/db/dc/d63/d7f 0 1 2024-09-12T22:33:14.409 INFO:tasks.workunit.client.0.smithi019.stdout:4/366: link d1/d22/f68 d1/d4/d44/f74 0 2024-09-12T22:33:14.409 INFO:tasks.workunit.client.0.smithi019.stdout:7/329: truncate d6/db/d42/f59 147818 0 2024-09-12T22:33:14.410 INFO:tasks.workunit.client.0.smithi019.stdout:9/397: truncate dd/d10/d17/d23/d2e/d31/d64/f66 251651 0 2024-09-12T22:33:14.410 INFO:tasks.workunit.client.0.smithi019.stdout:7/330: write d6/f31 [1037375,35595] 0 2024-09-12T22:33:14.410 INFO:tasks.workunit.client.0.smithi019.stdout:7/331: mknod d6/db/dc/d63/d4b/c80 0 2024-09-12T22:33:14.410 INFO:tasks.workunit.client.0.smithi019.stdout:4/367: read - d1/d22/d2c/f6d zero size 2024-09-12T22:33:14.410 INFO:tasks.workunit.client.0.smithi019.stdout:7/332: write d6/db/d42/f61 [1253513,82229] 0 2024-09-12T22:33:14.411 INFO:tasks.workunit.client.0.smithi019.stdout:7/333: symlink d6/d14/d15/d62/d6a/l81 0 2024-09-12T22:33:14.411 INFO:tasks.workunit.client.0.smithi019.stdout:4/368: write d1/d22/d57/f6e [2483877,69472] 0 2024-09-12T22:33:14.412 INFO:tasks.workunit.client.0.smithi019.stdout:7/334: write d6/db/dc/d26/f36 [210991,101894] 0 2024-09-12T22:33:14.413 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:14.412+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:14.414 INFO:tasks.workunit.client.0.smithi019.stdout:7/335: truncate d6/d14/d45/d7c/f72 871562 0 2024-09-12T22:33:14.415 INFO:tasks.workunit.client.0.smithi019.stdout:4/369: dread d1/d4/f13 [0,4194304] 0 2024-09-12T22:33:14.416 INFO:tasks.workunit.client.0.smithi019.stdout:8/361: dread d7/fc [0,4194304] 0 2024-09-12T22:33:14.416 INFO:tasks.workunit.client.0.smithi019.stdout:4/370: rename d1/d11/d15/d4e to d1/d11/d15/d65/d75 0 2024-09-12T22:33:14.420 INFO:tasks.workunit.client.0.smithi019.stdout:8/362: dwrite d7/d34/f5f [0,4194304] 0 2024-09-12T22:33:14.421 INFO:tasks.workunit.client.0.smithi019.stdout:8/363: write d7/d34/f38 [2133059,72763] 0 2024-09-12T22:33:14.421 INFO:tasks.workunit.client.0.smithi019.stdout:8/364: readlink d7/l66 0 2024-09-12T22:33:14.421 INFO:tasks.workunit.client.0.smithi019.stdout:8/365: fsync d7/d8/f73 0 2024-09-12T22:33:14.428 INFO:tasks.workunit.client.0.smithi019.stdout:7/336: sync 2024-09-12T22:33:14.432 INFO:tasks.workunit.client.0.smithi019.stdout:7/337: dwrite d6/d14/d15/f6d [0,4194304] 0 2024-09-12T22:33:14.435 INFO:tasks.workunit.client.0.smithi019.stdout:7/338: dread d6/db/dc/f43 [0,4194304] 0 2024-09-12T22:33:14.436 INFO:tasks.workunit.client.0.smithi019.stdout:7/339: write d6/db/d34/f7b [271494,79012] 0 2024-09-12T22:33:14.436 INFO:tasks.workunit.client.0.smithi019.stdout:7/340: read - d6/db/dc/f70 zero size 2024-09-12T22:33:14.437 INFO:tasks.workunit.client.0.smithi019.stdout:7/341: sync 2024-09-12T22:33:14.438 INFO:tasks.workunit.client.0.smithi019.stdout:7/342: read - d6/d2d/d77/f79 zero size 2024-09-12T22:33:14.438 INFO:tasks.workunit.client.0.smithi019.stdout:5/510: dread d0/d7/d2d/d32/d4a/f6f [0,4194304] 0 2024-09-12T22:33:14.439 INFO:tasks.workunit.client.0.smithi019.stdout:7/343: getdents d6/db/dc/d63/d7f 0 2024-09-12T22:33:14.440 INFO:tasks.workunit.client.0.smithi019.stdout:5/511: mkdir d0/d7/d16/d18/dae 0 2024-09-12T22:33:14.440 INFO:tasks.workunit.client.0.smithi019.stdout:1/473: dread d3/d11/d63/d76/f8a [0,4194304] 0 2024-09-12T22:33:14.441 INFO:tasks.workunit.client.0.smithi019.stdout:7/344: rename d6/d14/d15/f3f to d6/d14/d2a/f82 0 2024-09-12T22:33:14.441 INFO:tasks.workunit.client.0.smithi019.stdout:5/512: dread - d0/d7/d2d/d32/d36/d8c/d8f/f9f zero size 2024-09-12T22:33:14.441 INFO:tasks.workunit.client.0.smithi019.stdout:7/345: creat d6/d2d/f83 x:0 0 0 2024-09-12T22:33:14.441 INFO:tasks.workunit.client.0.smithi019.stdout:1/474: write d3/d11/d16/d23/f44 [874500,108282] 0 2024-09-12T22:33:14.442 INFO:tasks.workunit.client.0.smithi019.stdout:5/513: creat d0/d7/d16/faf x:0 0 0 2024-09-12T22:33:14.442 INFO:tasks.workunit.client.0.smithi019.stdout:1/475: mknod d3/d3f/d58/d7f/c9d 0 2024-09-12T22:33:14.442 INFO:tasks.workunit.client.0.smithi019.stdout:5/514: write d0/d7/d16/d18/f73 [1906586,4373] 0 2024-09-12T22:33:14.443 INFO:tasks.workunit.client.0.smithi019.stdout:1/476: creat d3/df/d7e/d96/f9e x:0 0 0 2024-09-12T22:33:14.444 INFO:tasks.workunit.client.0.smithi019.stdout:5/515: truncate d0/d7/d16/f4f 3722192 0 2024-09-12T22:33:14.444 INFO:tasks.workunit.client.0.smithi019.stdout:1/477: write d3/d11/d16/f99 [1032843,14302] 0 2024-09-12T22:33:14.445 INFO:tasks.workunit.client.0.smithi019.stdout:1/478: fdatasync d3/d11/d16/d23/f2a 0 2024-09-12T22:33:14.446 INFO:tasks.workunit.client.0.smithi019.stdout:5/516: getdents d0 0 2024-09-12T22:33:14.446 INFO:tasks.workunit.client.0.smithi019.stdout:1/479: fdatasync d3/d11/f4f 0 2024-09-12T22:33:14.447 INFO:tasks.workunit.client.0.smithi019.stdout:7/346: dwrite d6/db/dc/d26/f36 [0,4194304] 0 2024-09-12T22:33:14.447 INFO:tasks.workunit.client.0.smithi019.stdout:5/517: rmdir d0/dc/d39/d38/d4b 39 2024-09-12T22:33:14.447 INFO:tasks.workunit.client.0.smithi019.stdout:7/347: mkdir d6/d2d/d3d/d84 0 2024-09-12T22:33:14.447 INFO:tasks.workunit.client.0.smithi019.stdout:7/348: read - d6/db/dc/d63/d4b/f5a zero size 2024-09-12T22:33:14.449 INFO:tasks.workunit.client.0.smithi019.stdout:1/480: link d3/df/d7e/d96/f98 d3/d11/d16/d23/d54/f9f 0 2024-09-12T22:33:14.449 INFO:tasks.workunit.client.0.smithi019.stdout:5/518: creat d0/d7/d3c/fb0 x:0 0 0 2024-09-12T22:33:14.450 INFO:tasks.workunit.client.0.smithi019.stdout:1/481: write d3/d11/d63/f97 [41201,63341] 0 2024-09-12T22:33:14.450 INFO:tasks.workunit.client.0.smithi019.stdout:5/519: mkdir d0/d7/d2d/d32/d4a/db1 0 2024-09-12T22:33:14.451 INFO:tasks.workunit.client.0.smithi019.stdout:1/482: mkdir d3/d11/d16/d3c/d55/da0 0 2024-09-12T22:33:14.451 INFO:tasks.workunit.client.0.smithi019.stdout:1/483: dread - d3/d11/f74 zero size 2024-09-12T22:33:14.453 INFO:tasks.workunit.client.0.smithi019.stdout:2/388: dwrite d0/da/f29 [0,4194304] 0 2024-09-12T22:33:14.456 INFO:tasks.workunit.client.0.smithi019.stdout:6/432: truncate d1b/d26/d27/f54 5057720 0 2024-09-12T22:33:14.456 INFO:tasks.workunit.client.0.smithi019.stdout:2/389: rename d0/d5/d17/l69 to d0/d5/d60/d74/d7e/l84 0 2024-09-12T22:33:14.456 INFO:tasks.workunit.client.0.smithi019.stdout:5/520: read d0/dc/d39/d38/f55 [424181,93069] 0 2024-09-12T22:33:14.456 INFO:tasks.workunit.client.0.smithi019.stdout:5/521: fdatasync d0/f6 0 2024-09-12T22:33:14.457 INFO:tasks.workunit.client.0.smithi019.stdout:2/390: write d0/da/d73/d7c/f82 [2797258,55919] 0 2024-09-12T22:33:14.458 INFO:tasks.workunit.client.0.smithi019.stdout:1/484: dwrite d3/d11/d16/d23/d54/f61 [0,4194304] 0 2024-09-12T22:33:14.458 INFO:tasks.workunit.client.0.smithi019.stdout:2/391: sync 2024-09-12T22:33:14.458 INFO:tasks.workunit.client.0.smithi019.stdout:2/392: chown d0/d41/l64 3286740 1 2024-09-12T22:33:14.458 INFO:tasks.workunit.client.0.smithi019.stdout:5/522: chown d0/dc/d39/f63 1001 1 2024-09-12T22:33:14.461 INFO:tasks.workunit.client.0.smithi019.stdout:5/523: mknod d0/d7/d2d/d32/d36/cb2 0 2024-09-12T22:33:14.461 INFO:tasks.workunit.client.0.smithi019.stdout:5/524: mknod d0/dc/d39/d38/d4b/cb3 0 2024-09-12T22:33:14.463 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-09-12T22:33:14.463 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2024-09-12T22:33:14.463 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.463 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1203 3.13 3:cb3d3880:::200.0000000d:head [write 998690~1911 [fadvise_dontneed] in=1911b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:14.464 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.395102+0000", 2024-09-12T22:33:14.464 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.059620671, 2024-09-12T22:33:14.464 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.059637426, 2024-09-12T22:33:14.464 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:14.464 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:14.465 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:33:14.465 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:14.465 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.465 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:14.465 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.395102+0000", 2024-09-12T22:33:14.465 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:14.466 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.466 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.466 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:14.466 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.395102+0000", 2024-09-12T22:33:14.466 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:14.467 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.467 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.467 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:14.467 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.395102+0000", 2024-09-12T22:33:14.468 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6199999999999998e-07 2024-09-12T22:33:14.468 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.468 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.468 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:14.468 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.395106+0000", 2024-09-12T22:33:14.469 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1640000000000003e-06 2024-09-12T22:33:14.469 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.469 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.469 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:14.469 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.395118+0000", 2024-09-12T22:33:14.470 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1644000000000001e-05 2024-09-12T22:33:14.470 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.470 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.471 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:14.471 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.395122+0000", 2024-09-12T22:33:14.471 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3089999999999997e-06 2024-09-12T22:33:14.471 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.471 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.471 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:14.471 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.454466+0000", 2024-09-12T22:33:14.471 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.059343946000000002 2024-09-12T22:33:14.471 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.471 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.471 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:14.471 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.454504+0000", 2024-09-12T22:33:14.471 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7379999999999998e-05 2024-09-12T22:33:14.472 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.472 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.472 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:14.472 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.454564+0000", 2024-09-12T22:33:14.472 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.0250000000000001e-05 2024-09-12T22:33:14.472 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:14.472 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:14.472 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:14.472 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.472 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.472 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1215 3.13 3.11cbcd3 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:14.472 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.405955+0000", 2024-09-12T22:33:14.472 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.048766919999999998, 2024-09-12T22:33:14.473 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.048822188000000002, 2024-09-12T22:33:14.473 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:14.473 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:14.473 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "queued for pg", 2024-09-12T22:33:14.473 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:14.473 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.473 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:14.473 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.405955+0000", 2024-09-12T22:33:14.473 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:14.473 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.473 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.473 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:14.473 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.405955+0000", 2024-09-12T22:33:14.474 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:14.474 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.474 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.474 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:14.474 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.405956+0000", 2024-09-12T22:33:14.474 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5499999999999998e-07 2024-09-12T22:33:14.474 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.474 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.474 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:14.474 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.405967+0000", 2024-09-12T22:33:14.474 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1319e-05 2024-09-12T22:33:14.474 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.474 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.475 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:14.475 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.405976+0000", 2024-09-12T22:33:14.475 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.0019999999999995e-06 2024-09-12T22:33:14.475 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.475 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.475 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:14.475 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.405984+0000", 2024-09-12T22:33:14.475 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9419999999999995e-06 2024-09-12T22:33:14.475 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:14.475 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:14.475 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:14.475 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.475 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.475 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1204 3.13 3.11cbcd3 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:14.476 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.395130+0000", 2024-09-12T22:33:14.476 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.059591755000000003, 2024-09-12T22:33:14.476 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.059672356000000003, 2024-09-12T22:33:14.476 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:14.476 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:14.476 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "queued for pg", 2024-09-12T22:33:14.476 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:14.476 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.476 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:14.476 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.395130+0000", 2024-09-12T22:33:14.476 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:14.476 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.476 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.477 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:14.477 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.395130+0000", 2024-09-12T22:33:14.477 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:14.477 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.477 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.477 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:14.477 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.395131+0000", 2024-09-12T22:33:14.477 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.41e-07 2024-09-12T22:33:14.477 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.477 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.477 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:14.477 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.395136+0000", 2024-09-12T22:33:14.477 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.673e-06 2024-09-12T22:33:14.477 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.478 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.478 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:14.478 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.395142+0000", 2024-09-12T22:33:14.478 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4749999999999998e-06 2024-09-12T22:33:14.478 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.478 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.478 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:14.478 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.395145+0000", 2024-09-12T22:33:14.478 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2799999999999999e-06 2024-09-12T22:33:14.478 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:14.478 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:14.478 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:14.478 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.479 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.479 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1224 3.13 3.11cbcd3 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:14.479 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.421269+0000", 2024-09-12T22:33:14.479 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.033453691000000001, 2024-09-12T22:33:14.479 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.033558525999999998, 2024-09-12T22:33:14.479 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:14.479 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:14.479 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "queued for pg", 2024-09-12T22:33:14.479 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:14.479 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.479 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:14.479 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.421269+0000", 2024-09-12T22:33:14.479 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:14.479 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.480 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.480 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:14.480 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.421269+0000", 2024-09-12T22:33:14.480 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:14.480 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.480 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.480 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:14.480 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.421269+0000", 2024-09-12T22:33:14.480 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.4499999999999996e-07 2024-09-12T22:33:14.480 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.480 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.480 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:14.480 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.421279+0000", 2024-09-12T22:33:14.481 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.533e-06 2024-09-12T22:33:14.481 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.481 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.481 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:14.481 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.421287+0000", 2024-09-12T22:33:14.481 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.4200000000000007e-06 2024-09-12T22:33:14.481 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.481 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.481 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:14.481 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.421294+0000", 2024-09-12T22:33:14.481 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.2550000000000003e-06 2024-09-12T22:33:14.481 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:14.481 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:14.481 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:14.482 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.482 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.482 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1225 3.13 3.11cbcd3 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:14.482 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.421303+0000", 2024-09-12T22:33:14.482 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.033419297000000001, 2024-09-12T22:33:14.482 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.033566985000000001, 2024-09-12T22:33:14.482 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:14.482 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:14.482 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "queued for pg", 2024-09-12T22:33:14.482 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:14.482 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.482 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:14.482 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.421303+0000", 2024-09-12T22:33:14.483 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:14.483 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.483 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.483 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:14.483 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.421303+0000", 2024-09-12T22:33:14.483 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:14.483 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.483 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.483 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:14.483 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.421303+0000", 2024-09-12T22:33:14.483 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8599999999999998e-07 2024-09-12T22:33:14.483 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.483 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.484 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:14.484 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.421307+0000", 2024-09-12T22:33:14.484 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0879999999999999e-06 2024-09-12T22:33:14.484 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.484 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.484 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:14.484 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.421314+0000", 2024-09-12T22:33:14.484 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1010000000000003e-06 2024-09-12T22:33:14.484 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.484 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.484 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:14.484 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.421319+0000", 2024-09-12T22:33:14.484 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7209999999999999e-06 2024-09-12T22:33:14.485 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:14.485 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:14.485 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:14.485 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.485 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.485 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1243 3.13 3.11cbcd3 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:14.485 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.444978+0000", 2024-09-12T22:33:14.485 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0097440200000000008, 2024-09-12T22:33:14.485 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0099412240000000002, 2024-09-12T22:33:14.485 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:14.485 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:14.485 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "queued for pg", 2024-09-12T22:33:14.485 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:14.486 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.486 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:14.486 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.444978+0000", 2024-09-12T22:33:14.486 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:14.486 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.486 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.486 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:14.486 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.444978+0000", 2024-09-12T22:33:14.486 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:14.486 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.486 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.486 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:14.486 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.444979+0000", 2024-09-12T22:33:14.486 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6599999999999995e-07 2024-09-12T22:33:14.487 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.487 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.487 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:14.487 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.444990+0000", 2024-09-12T22:33:14.487 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1419e-05 2024-09-12T22:33:14.487 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.487 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.487 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:14.487 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.444998+0000", 2024-09-12T22:33:14.487 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.7749999999999993e-06 2024-09-12T22:33:14.487 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.487 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.487 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:14.487 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.445003+0000", 2024-09-12T22:33:14.488 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8740000000000003e-06 2024-09-12T22:33:14.488 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:14.488 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:14.488 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:14.488 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.488 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.488 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1205 3.13 3.11cbcd3 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:14.488 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.396389+0000", 2024-09-12T22:33:14.488 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.058333279000000002, 2024-09-12T22:33:14.488 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.058579533000000003, 2024-09-12T22:33:14.488 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:14.488 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:14.488 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "queued for pg", 2024-09-12T22:33:14.489 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:14.489 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.489 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:14.489 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.396389+0000", 2024-09-12T22:33:14.489 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:14.489 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.489 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.489 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:14.489 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.396389+0000", 2024-09-12T22:33:14.489 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:14.489 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.489 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.489 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:14.489 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.396390+0000", 2024-09-12T22:33:14.490 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1200000000000002e-07 2024-09-12T22:33:14.490 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.490 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.490 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:14.490 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.396394+0000", 2024-09-12T22:33:14.490 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6240000000000001e-06 2024-09-12T22:33:14.490 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.490 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.490 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:14.490 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.396404+0000", 2024-09-12T22:33:14.490 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.2529999999999993e-06 2024-09-12T22:33:14.490 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.490 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.491 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:14.491 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.396410+0000", 2024-09-12T22:33:14.491 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7819999999999996e-06 2024-09-12T22:33:14.491 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:14.491 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:14.491 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:14.491 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.491 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.491 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1244 3.13 3.11cbcd3 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:14.491 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.445229+0000", 2024-09-12T22:33:14.491 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0094927889999999997, 2024-09-12T22:33:14.491 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0097843619999999996, 2024-09-12T22:33:14.491 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:14.492 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:14.492 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "queued for pg", 2024-09-12T22:33:14.492 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:14.492 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.492 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:14.492 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.445229+0000", 2024-09-12T22:33:14.492 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:14.492 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.492 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.492 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:14.492 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.445229+0000", 2024-09-12T22:33:14.492 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:14.492 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.493 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.493 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:14.493 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.445230+0000", 2024-09-12T22:33:14.493 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8400000000000004e-07 2024-09-12T22:33:14.493 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.493 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.493 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:14.493 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.445235+0000", 2024-09-12T22:33:14.493 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.203e-06 2024-09-12T22:33:14.493 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.493 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.493 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:14.493 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.445242+0000", 2024-09-12T22:33:14.493 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.8220000000000001e-06 2024-09-12T22:33:14.494 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.494 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.494 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:14.494 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.445247+0000", 2024-09-12T22:33:14.494 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4900000000000002e-06 2024-09-12T22:33:14.494 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:14.494 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:14.494 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:14.494 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.494 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.494 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1206 3.13 3.11cbcd3 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:14.494 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.396420+0000", 2024-09-12T22:33:14.494 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.058301867, 2024-09-12T22:33:14.495 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.058623768999999999, 2024-09-12T22:33:14.495 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:14.495 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:14.495 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "queued for pg", 2024-09-12T22:33:14.495 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:14.495 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.495 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:14.495 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.396420+0000", 2024-09-12T22:33:14.495 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:14.495 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.495 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.495 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:14.495 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.396420+0000", 2024-09-12T22:33:14.495 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:14.496 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.496 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.496 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:14.496 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.396421+0000", 2024-09-12T22:33:14.496 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9900000000000002e-07 2024-09-12T22:33:14.496 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.496 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.496 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:14.496 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.396425+0000", 2024-09-12T22:33:14.496 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4769999999999997e-06 2024-09-12T22:33:14.496 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.496 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.496 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:14.496 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.396430+0000", 2024-09-12T22:33:14.497 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1800000000000004e-06 2024-09-12T22:33:14.497 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.497 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.497 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:14.497 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.396434+0000", 2024-09-12T22:33:14.497 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3299999999999999e-06 2024-09-12T22:33:14.497 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:14.497 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:14.497 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:14.497 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.497 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.497 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1207 3.13 3.11cbcd3 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:14.497 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.396498+0000", 2024-09-12T22:33:14.498 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.058224432, 2024-09-12T22:33:14.498 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.058573310000000003, 2024-09-12T22:33:14.498 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:14.498 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:14.498 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "queued for pg", 2024-09-12T22:33:14.498 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:14.498 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.498 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:14.498 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.396498+0000", 2024-09-12T22:33:14.498 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:14.498 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.498 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.498 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:14.498 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.396498+0000", 2024-09-12T22:33:14.499 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:14.499 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.499 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.499 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:14.499 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.396498+0000", 2024-09-12T22:33:14.499 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.82e-07 2024-09-12T22:33:14.499 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.499 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.499 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:14.499 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.396501+0000", 2024-09-12T22:33:14.499 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7659999999999999e-06 2024-09-12T22:33:14.499 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.499 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.500 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:14.500 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.396509+0000", 2024-09-12T22:33:14.500 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3629999999999994e-06 2024-09-12T22:33:14.500 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.500 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.500 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:14.500 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.396514+0000", 2024-09-12T22:33:14.500 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2889999999999999e-06 2024-09-12T22:33:14.500 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:14.500 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:14.501 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:14.501 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.501 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.501 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1216 3.13 3.11cbcd3 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:14.501 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.409812+0000", 2024-09-12T22:33:14.501 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.044910564, 2024-09-12T22:33:14.501 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.045283293000000002, 2024-09-12T22:33:14.501 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:14.501 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:14.501 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "queued for pg", 2024-09-12T22:33:14.501 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:14.501 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.501 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:14.502 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.409812+0000", 2024-09-12T22:33:14.502 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:14.502 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.502 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.502 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:14.502 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.409812+0000", 2024-09-12T22:33:14.502 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:14.502 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.502 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.502 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:14.502 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.409812+0000", 2024-09-12T22:33:14.502 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9100000000000003e-07 2024-09-12T22:33:14.502 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.502 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.503 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:14.503 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.409821+0000", 2024-09-12T22:33:14.503 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.9490000000000002e-06 2024-09-12T22:33:14.503 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.503 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.503 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:14.503 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.409828+0000", 2024-09-12T22:33:14.503 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.2670000000000003e-06 2024-09-12T22:33:14.503 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.503 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.503 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:14.503 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.409832+0000", 2024-09-12T22:33:14.503 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4909999999999999e-06 2024-09-12T22:33:14.504 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:14.504 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:14.504 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:14.504 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.504 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.504 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1217 3.13 3.11cbcd3 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:14.504 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.410054+0000", 2024-09-12T22:33:14.504 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.044668707000000002, 2024-09-12T22:33:14.504 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.045064818, 2024-09-12T22:33:14.504 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:14.504 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:14.504 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "queued for pg", 2024-09-12T22:33:14.504 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:14.504 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.505 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:14.505 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.410054+0000", 2024-09-12T22:33:14.505 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:14.505 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.505 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.505 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:14.505 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.410054+0000", 2024-09-12T22:33:14.505 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:14.505 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.505 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.505 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:14.505 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.410054+0000", 2024-09-12T22:33:14.505 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8800000000000002e-07 2024-09-12T22:33:14.506 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.506 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.506 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:14.506 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.410058+0000", 2024-09-12T22:33:14.506 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6490000000000001e-06 2024-09-12T22:33:14.506 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.506 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.506 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:14.506 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.410064+0000", 2024-09-12T22:33:14.506 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1109999999999996e-06 2024-09-12T22:33:14.506 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.506 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.506 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:14.506 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.410068+0000", 2024-09-12T22:33:14.507 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8759999999999998e-06 2024-09-12T22:33:14.507 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:14.507 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:14.507 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:14.507 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.507 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.507 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1235 3.13 3.11cbcd3 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:14.507 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.435456+0000", 2024-09-12T22:33:14.507 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.019266268, 2024-09-12T22:33:14.507 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.019685866999999999, 2024-09-12T22:33:14.507 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:14.507 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:14.507 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "queued for pg", 2024-09-12T22:33:14.508 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:14.508 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.508 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:14.508 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.435456+0000", 2024-09-12T22:33:14.508 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:14.508 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.508 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.508 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:14.508 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.435456+0000", 2024-09-12T22:33:14.508 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:14.508 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.508 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.508 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:14.508 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.435457+0000", 2024-09-12T22:33:14.509 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6400000000000002e-07 2024-09-12T22:33:14.509 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.509 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.509 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:14.509 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.435460+0000", 2024-09-12T22:33:14.509 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9670000000000001e-06 2024-09-12T22:33:14.509 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.509 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.509 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:14.509 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.435467+0000", 2024-09-12T22:33:14.509 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6990000000000003e-06 2024-09-12T22:33:14.509 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.509 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.510 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:14.510 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.435471+0000", 2024-09-12T22:33:14.510 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.267e-06 2024-09-12T22:33:14.510 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:14.510 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:14.510 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:14.510 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.510 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.510 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1250 4.1b 4.8f9cd1db (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:14.510 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.446502+0000", 2024-09-12T22:33:14.510 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0082201719999999995, 2024-09-12T22:33:14.510 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0086630249999999995, 2024-09-12T22:33:14.510 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:14.510 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:14.511 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "queued for pg", 2024-09-12T22:33:14.511 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:14.511 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.511 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:14.511 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.446502+0000", 2024-09-12T22:33:14.511 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:14.511 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.511 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.511 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:14.511 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.446502+0000", 2024-09-12T22:33:14.511 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:14.511 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.511 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.512 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:14.512 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.446503+0000", 2024-09-12T22:33:14.512 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.54e-07 2024-09-12T22:33:14.512 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.512 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.512 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:14.512 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.446511+0000", 2024-09-12T22:33:14.512 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.4149999999999999e-06 2024-09-12T22:33:14.512 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.512 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.512 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:14.512 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.446521+0000", 2024-09-12T22:33:14.512 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0098000000000001e-05 2024-09-12T22:33:14.513 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.513 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.513 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:14.513 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.446528+0000", 2024-09-12T22:33:14.513 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.2099999999999998e-06 2024-09-12T22:33:14.513 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:14.513 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:14.513 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:14.513 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.513 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.513 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1236 3.13 3.11cbcd3 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:14.513 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.435727+0000", 2024-09-12T22:33:14.513 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.018994833999999999, 2024-09-12T22:33:14.513 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.019461281, 2024-09-12T22:33:14.514 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:14.514 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:14.514 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "queued for pg", 2024-09-12T22:33:14.514 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:14.514 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.514 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:14.514 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.435727+0000", 2024-09-12T22:33:14.514 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:14.514 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.514 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.514 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:14.514 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.435727+0000", 2024-09-12T22:33:14.514 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:14.514 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.515 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.515 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:14.515 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.435728+0000", 2024-09-12T22:33:14.515 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8699999999999995e-07 2024-09-12T22:33:14.515 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.515 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.515 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:14.515 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.435731+0000", 2024-09-12T22:33:14.515 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7939999999999998e-06 2024-09-12T22:33:14.515 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.515 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.515 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:14.515 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.435736+0000", 2024-09-12T22:33:14.516 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.5389999999999998e-06 2024-09-12T22:33:14.516 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.516 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.516 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:14.516 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.435740+0000", 2024-09-12T22:33:14.516 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9999999999999998e-06 2024-09-12T22:33:14.516 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:14.516 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:14.516 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:14.516 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.516 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.516 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4490.0:12220 4.2b 4.66bfdaab (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-12T22:33:14.516 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.391333+0000", 2024-09-12T22:33:14.516 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.063389101000000003, 2024-09-12T22:33:14.517 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.063879158000000005, 2024-09-12T22:33:14.517 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:14.517 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:14.517 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "queued for pg", 2024-09-12T22:33:14.517 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:14.517 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4490", 2024-09-12T22:33:14.517 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:14.517 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 12220 2024-09-12T22:33:14.517 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.517 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:14.517 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.517 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:14.517 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.391333+0000", 2024-09-12T22:33:14.518 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:14.518 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.518 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.518 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:14.518 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.391333+0000", 2024-09-12T22:33:14.518 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:14.518 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.518 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.518 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:14.518 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.391334+0000", 2024-09-12T22:33:14.518 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3099999999999997e-07 2024-09-12T22:33:14.518 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.518 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.518 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:14.519 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398373+0000", 2024-09-12T22:33:14.519 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0070386670000000002 2024-09-12T22:33:14.519 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.519 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.519 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:14.519 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398384+0000", 2024-09-12T22:33:14.519 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1338999999999999e-05 2024-09-12T22:33:14.519 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.519 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.519 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:14.519 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398389+0000", 2024-09-12T22:33:14.519 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3650000000000003e-06 2024-09-12T22:33:14.519 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:14.519 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:14.520 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:14.520 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.520 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.520 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1226 3.13 3.11cbcd3 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:14.520 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.422971+0000", 2024-09-12T22:33:14.520 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.031751699000000001, 2024-09-12T22:33:14.520 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.032271091000000002, 2024-09-12T22:33:14.520 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:14.520 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:14.520 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "queued for pg", 2024-09-12T22:33:14.520 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:14.520 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.520 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:14.521 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.422971+0000", 2024-09-12T22:33:14.521 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:14.521 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.521 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.521 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:14.521 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.422971+0000", 2024-09-12T22:33:14.521 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:14.521 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.521 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.521 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:14.521 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.422971+0000", 2024-09-12T22:33:14.521 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.1699999999999997e-07 2024-09-12T22:33:14.521 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.521 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.522 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:14.522 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.422975+0000", 2024-09-12T22:33:14.522 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2650000000000001e-06 2024-09-12T22:33:14.522 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.522 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.522 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:14.522 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.422981+0000", 2024-09-12T22:33:14.522 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7379999999999997e-06 2024-09-12T22:33:14.522 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.522 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.522 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:14.522 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.422986+0000", 2024-09-12T22:33:14.522 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5220000000000001e-06 2024-09-12T22:33:14.523 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:14.523 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:14.523 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:14.523 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.523 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.523 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1208 3.13 3.11cbcd3 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:14.523 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.398459+0000", 2024-09-12T22:33:14.523 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.056263535000000003, 2024-09-12T22:33:14.523 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.056806954, 2024-09-12T22:33:14.523 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:14.523 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:14.523 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "queued for pg", 2024-09-12T22:33:14.523 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:14.523 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.524 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:14.524 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398459+0000", 2024-09-12T22:33:14.524 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:14.524 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.524 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.524 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:14.524 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398459+0000", 2024-09-12T22:33:14.524 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:14.524 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.524 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.524 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:14.524 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398459+0000", 2024-09-12T22:33:14.524 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8100000000000003e-07 2024-09-12T22:33:14.525 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.525 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.525 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:14.525 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398462+0000", 2024-09-12T22:33:14.525 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3700000000000002e-06 2024-09-12T22:33:14.525 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.525 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.525 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:14.525 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398469+0000", 2024-09-12T22:33:14.525 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2320000000000004e-06 2024-09-12T22:33:14.525 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.525 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.525 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:14.525 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398472+0000", 2024-09-12T22:33:14.526 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.658e-06 2024-09-12T22:33:14.526 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:14.526 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:14.526 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:14.526 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.526 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.526 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1227 3.13 3.11cbcd3 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:14.526 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.423028+0000", 2024-09-12T22:33:14.526 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.031694714999999998, 2024-09-12T22:33:14.526 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.032261513999999998, 2024-09-12T22:33:14.526 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:14.526 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:14.526 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "queued for pg", 2024-09-12T22:33:14.526 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:14.527 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.527 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:14.527 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423028+0000", 2024-09-12T22:33:14.527 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:14.527 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.527 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.527 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:14.527 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423028+0000", 2024-09-12T22:33:14.527 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:14.527 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.527 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.527 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:14.527 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423028+0000", 2024-09-12T22:33:14.528 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1699999999999998e-07 2024-09-12T22:33:14.528 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.528 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.528 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:14.528 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423031+0000", 2024-09-12T22:33:14.528 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8499999999999998e-06 2024-09-12T22:33:14.528 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.528 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.528 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:14.528 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423036+0000", 2024-09-12T22:33:14.528 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9479999999999999e-06 2024-09-12T22:33:14.528 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.528 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.529 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:14.529 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423039+0000", 2024-09-12T22:33:14.529 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4929999999999998e-06 2024-09-12T22:33:14.529 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:14.529 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:14.529 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:14.529 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.529 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.529 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1209 3.13 3.11cbcd3 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:14.529 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.398677+0000", 2024-09-12T22:33:14.529 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.056044978000000002, 2024-09-12T22:33:14.529 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.056655353999999998, 2024-09-12T22:33:14.529 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:14.529 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:14.530 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "queued for pg", 2024-09-12T22:33:14.530 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:14.530 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.530 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:14.530 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398677+0000", 2024-09-12T22:33:14.530 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:14.530 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.530 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.530 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:14.530 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398677+0000", 2024-09-12T22:33:14.530 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:14.530 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.530 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.531 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:14.531 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398678+0000", 2024-09-12T22:33:14.531 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5199999999999995e-07 2024-09-12T22:33:14.531 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.531 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.531 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:14.531 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398686+0000", 2024-09-12T22:33:14.531 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0579999999999998e-06 2024-09-12T22:33:14.531 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.531 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.531 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:14.531 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398695+0000", 2024-09-12T22:33:14.531 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.1409999999999994e-06 2024-09-12T22:33:14.531 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.532 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.532 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:14.532 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398703+0000", 2024-09-12T22:33:14.532 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4379999999999998e-06 2024-09-12T22:33:14.532 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:14.532 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:14.532 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:14.532 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.532 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.532 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1228 3.13 3.11cbcd3 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:14.532 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.423305+0000", 2024-09-12T22:33:14.532 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.031417351000000003, 2024-09-12T22:33:14.532 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.032077934000000002, 2024-09-12T22:33:14.533 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:14.533 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:14.533 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "queued for pg", 2024-09-12T22:33:14.533 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:14.533 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.533 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:14.533 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423305+0000", 2024-09-12T22:33:14.533 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:14.533 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.533 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.533 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:14.533 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423305+0000", 2024-09-12T22:33:14.533 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:14.533 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.534 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.534 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:14.534 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423306+0000", 2024-09-12T22:33:14.534 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4899999999999995e-07 2024-09-12T22:33:14.534 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.534 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.534 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:14.534 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423311+0000", 2024-09-12T22:33:14.534 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7459999999999997e-06 2024-09-12T22:33:14.534 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.534 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.534 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:14.534 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423316+0000", 2024-09-12T22:33:14.534 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0239999999999997e-06 2024-09-12T22:33:14.535 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.535 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.535 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:14.535 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423320+0000", 2024-09-12T22:33:14.535 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.67e-06 2024-09-12T22:33:14.535 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:14.535 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:14.535 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:14.535 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.535 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.535 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1237 3.13 3.11cbcd3 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:14.535 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.438215+0000", 2024-09-12T22:33:14.535 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.016507569999999999, 2024-09-12T22:33:14.535 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.017195592999999999, 2024-09-12T22:33:14.536 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:14.536 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:14.536 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "queued for pg", 2024-09-12T22:33:14.536 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:14.536 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.536 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:14.536 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.438215+0000", 2024-09-12T22:33:14.536 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:14.536 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.536 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.536 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:14.536 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.438215+0000", 2024-09-12T22:33:14.536 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:14.537 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.537 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.537 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:14.537 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.438215+0000", 2024-09-12T22:33:14.537 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1699999999999998e-07 2024-09-12T22:33:14.537 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.537 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.537 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:14.537 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.438218+0000", 2024-09-12T22:33:14.537 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0539999999999999e-06 2024-09-12T22:33:14.537 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.537 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.537 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:14.537 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.438225+0000", 2024-09-12T22:33:14.538 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9059999999999996e-06 2024-09-12T22:33:14.538 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.538 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.538 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:14.538 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.438229+0000", 2024-09-12T22:33:14.538 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9659999999999998e-06 2024-09-12T22:33:14.538 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:14.538 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:14.538 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:14.538 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.538 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.538 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1210 3.13 3.11cbcd3 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:14.538 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.398713+0000", 2024-09-12T22:33:14.539 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.056009654999999998, 2024-09-12T22:33:14.539 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.056725211999999997, 2024-09-12T22:33:14.539 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:14.539 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:14.539 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "queued for pg", 2024-09-12T22:33:14.539 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:14.539 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.539 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:14.539 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398713+0000", 2024-09-12T22:33:14.539 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:14.540 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.540 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.540 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:14.540 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398713+0000", 2024-09-12T22:33:14.540 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:14.540 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.540 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.540 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:14.540 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398713+0000", 2024-09-12T22:33:14.540 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7599999999999998e-07 2024-09-12T22:33:14.540 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.540 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.540 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:14.540 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398718+0000", 2024-09-12T22:33:14.541 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8169999999999998e-06 2024-09-12T22:33:14.541 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.541 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.541 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:14.541 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398722+0000", 2024-09-12T22:33:14.541 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5249999999999999e-06 2024-09-12T22:33:14.541 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.541 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.541 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:14.541 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398726+0000", 2024-09-12T22:33:14.541 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5650000000000002e-06 2024-09-12T22:33:14.541 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:14.541 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:14.541 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:14.542 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.542 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.542 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1229 3.13 3.11cbcd3 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:14.542 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.423606+0000", 2024-09-12T22:33:14.542 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.031116339999999999, 2024-09-12T22:33:14.542 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.031876854000000003, 2024-09-12T22:33:14.542 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:14.542 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:14.542 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "queued for pg", 2024-09-12T22:33:14.542 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:14.542 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.542 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:14.542 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423606+0000", 2024-09-12T22:33:14.543 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:14.543 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.543 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.543 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:14.543 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423606+0000", 2024-09-12T22:33:14.543 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:14.543 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.543 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.543 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:14.543 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423606+0000", 2024-09-12T22:33:14.543 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.7e-07 2024-09-12T22:33:14.543 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.543 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.544 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:14.544 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423609+0000", 2024-09-12T22:33:14.544 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5339999999999998e-06 2024-09-12T22:33:14.544 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.544 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.544 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:14.544 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423614+0000", 2024-09-12T22:33:14.544 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.69e-06 2024-09-12T22:33:14.544 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.544 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.544 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:14.544 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423617+0000", 2024-09-12T22:33:14.544 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4300000000000002e-06 2024-09-12T22:33:14.545 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:14.545 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:14.545 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:14.545 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.545 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.545 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1238 3.13 3.11cbcd3 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:14.545 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.438257+0000", 2024-09-12T22:33:14.545 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.016465422, 2024-09-12T22:33:14.545 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.017273060999999999, 2024-09-12T22:33:14.545 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:14.545 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:14.545 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "queued for pg", 2024-09-12T22:33:14.545 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:14.545 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.546 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:14.546 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.438257+0000", 2024-09-12T22:33:14.546 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:14.546 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.546 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.546 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:14.547 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.438257+0000", 2024-09-12T22:33:14.547 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:14.547 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.547 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.547 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:14.547 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.438257+0000", 2024-09-12T22:33:14.547 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9800000000000003e-07 2024-09-12T22:33:14.547 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.547 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.547 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:14.547 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.438264+0000", 2024-09-12T22:33:14.547 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.8210000000000004e-06 2024-09-12T22:33:14.547 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.548 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.548 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:14.548 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.438271+0000", 2024-09-12T22:33:14.548 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1829999999999997e-06 2024-09-12T22:33:14.548 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.548 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.548 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:14.548 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.438278+0000", 2024-09-12T22:33:14.548 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9179999999999997e-06 2024-09-12T22:33:14.548 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:14.548 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:14.548 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:14.548 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.548 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.549 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1252 3.13 3.11cbcd3 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:14.549 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.449321+0000", 2024-09-12T22:33:14.549 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0054013719999999998, 2024-09-12T22:33:14.549 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.006239947, 2024-09-12T22:33:14.549 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:14.549 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:14.549 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "queued for pg", 2024-09-12T22:33:14.549 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:14.549 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.549 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:14.549 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.449321+0000", 2024-09-12T22:33:14.549 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:14.549 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.550 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.550 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:14.550 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.449321+0000", 2024-09-12T22:33:14.550 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:14.550 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.550 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.550 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:14.550 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.449322+0000", 2024-09-12T22:33:14.550 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0330000000000001e-06 2024-09-12T22:33:14.550 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.550 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.550 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:14.550 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.449357+0000", 2024-09-12T22:33:14.551 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4935999999999999e-05 2024-09-12T22:33:14.551 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.551 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.551 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:14.551 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.449367+0000", 2024-09-12T22:33:14.551 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.9480000000000003e-06 2024-09-12T22:33:14.551 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.551 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.551 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:14.551 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.449374+0000", 2024-09-12T22:33:14.551 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.737e-06 2024-09-12T22:33:14.551 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:14.551 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:14.551 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:14.552 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.552 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.552 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1218 3.13 3.11cbcd3 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:14.552 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.413553+0000", 2024-09-12T22:33:14.552 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.041169362000000001, 2024-09-12T22:33:14.552 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.042031790999999999, 2024-09-12T22:33:14.552 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:14.552 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:14.552 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "queued for pg", 2024-09-12T22:33:14.552 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:14.552 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.552 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:14.552 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.413553+0000", 2024-09-12T22:33:14.553 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:14.553 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.553 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.553 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:14.553 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.413553+0000", 2024-09-12T22:33:14.553 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:14.553 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.553 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.553 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:14.553 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.413555+0000", 2024-09-12T22:33:14.553 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.2469999999999998e-06 2024-09-12T22:33:14.553 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.553 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.553 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:14.554 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.413565+0000", 2024-09-12T22:33:14.554 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0273e-05 2024-09-12T22:33:14.554 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.554 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.554 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:14.554 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.413574+0000", 2024-09-12T22:33:14.554 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.4780000000000008e-06 2024-09-12T22:33:14.554 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.554 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.554 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:14.554 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.413579+0000", 2024-09-12T22:33:14.554 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8550000000000001e-06 2024-09-12T22:33:14.554 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:14.554 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:14.555 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:14.555 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.555 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.555 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1230 3.13 3.11cbcd3 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:14.555 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.423911+0000", 2024-09-12T22:33:14.555 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.030811495000000001, 2024-09-12T22:33:14.555 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.031697242, 2024-09-12T22:33:14.555 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:14.555 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:14.555 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "queued for pg", 2024-09-12T22:33:14.555 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:14.555 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.555 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:14.555 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423911+0000", 2024-09-12T22:33:14.556 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:14.556 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.556 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.556 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:14.556 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423911+0000", 2024-09-12T22:33:14.556 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:14.556 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.556 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.556 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:14.556 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423911+0000", 2024-09-12T22:33:14.556 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3799999999999998e-07 2024-09-12T22:33:14.556 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.556 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.557 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:14.557 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423919+0000", 2024-09-12T22:33:14.557 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.8329999999999994e-06 2024-09-12T22:33:14.557 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.557 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.557 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:14.557 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423924+0000", 2024-09-12T22:33:14.557 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3449999999999996e-06 2024-09-12T22:33:14.557 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.557 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.557 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:14.557 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423928+0000", 2024-09-12T22:33:14.557 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2339999999999999e-06 2024-09-12T22:33:14.558 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:14.558 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:14.558 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:14.558 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.558 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.558 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1239 3.13 3.11cbcd3 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:14.558 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.438960+0000", 2024-09-12T22:33:14.558 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.015761774999999999, 2024-09-12T22:33:14.558 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.016670963, 2024-09-12T22:33:14.558 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:14.558 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:14.558 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "queued for pg", 2024-09-12T22:33:14.558 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:14.559 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.559 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:14.559 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.438960+0000", 2024-09-12T22:33:14.559 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:14.559 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.559 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.559 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:14.559 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.438960+0000", 2024-09-12T22:33:14.559 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:14.559 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.559 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.559 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:14.559 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.438965+0000", 2024-09-12T22:33:14.559 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8679999999999998e-06 2024-09-12T22:33:14.560 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.560 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.560 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:14.560 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.438970+0000", 2024-09-12T22:33:14.560 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2590000000000002e-06 2024-09-12T22:33:14.560 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.560 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.560 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:14.560 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.438978+0000", 2024-09-12T22:33:14.560 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.1859999999999992e-06 2024-09-12T22:33:14.560 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.560 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.560 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:14.561 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.438983+0000", 2024-09-12T22:33:14.561 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2889999999999997e-06 2024-09-12T22:33:14.561 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:14.561 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:14.561 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:14.561 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.561 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.561 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1253 3.13 3.11cbcd3 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:14.561 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.449390+0000", 2024-09-12T22:33:14.561 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0053325289999999999, 2024-09-12T22:33:14.561 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.006265217, 2024-09-12T22:33:14.561 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:14.561 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:14.561 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "queued for pg", 2024-09-12T22:33:14.562 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:14.562 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.562 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:14.562 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.449390+0000", 2024-09-12T22:33:14.562 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:14.562 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.562 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.562 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:14.562 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.449390+0000", 2024-09-12T22:33:14.562 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:14.562 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.562 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.562 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:14.563 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.449390+0000", 2024-09-12T22:33:14.563 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4799999999999998e-07 2024-09-12T22:33:14.563 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.563 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.563 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:14.563 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.449394+0000", 2024-09-12T22:33:14.563 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4060000000000001e-06 2024-09-12T22:33:14.563 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.563 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.563 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:14.563 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.449401+0000", 2024-09-12T22:33:14.563 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.114e-06 2024-09-12T22:33:14.563 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.563 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.564 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:14.564 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.449407+0000", 2024-09-12T22:33:14.564 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7300000000000002e-06 2024-09-12T22:33:14.564 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:14.564 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:14.564 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:14.564 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.564 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.564 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1254 3.13 3.11cbcd3 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:14.564 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.449416+0000", 2024-09-12T22:33:14.564 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0053062669999999999, 2024-09-12T22:33:14.564 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0062618980000000001, 2024-09-12T22:33:14.564 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:14.565 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:14.565 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "queued for pg", 2024-09-12T22:33:14.565 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:14.565 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.565 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:14.565 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.449416+0000", 2024-09-12T22:33:14.565 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:14.565 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.565 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.565 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:14.565 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.449416+0000", 2024-09-12T22:33:14.565 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:14.565 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.566 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.566 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:14.566 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.449417+0000", 2024-09-12T22:33:14.566 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8899999999999999e-07 2024-09-12T22:33:14.566 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.566 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.566 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:14.566 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.449423+0000", 2024-09-12T22:33:14.566 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5899999999999996e-06 2024-09-12T22:33:14.566 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.566 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.566 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:14.566 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.449431+0000", 2024-09-12T22:33:14.566 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3880000000000002e-06 2024-09-12T22:33:14.567 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.567 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.567 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:14.567 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.449436+0000", 2024-09-12T22:33:14.567 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3210000000000004e-06 2024-09-12T22:33:14.567 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:14.567 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:14.567 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:14.567 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.568 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.568 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1211 3.13 3.11cbcd3 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:14.568 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.400122+0000", 2024-09-12T22:33:14.568 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.054599937000000001, 2024-09-12T22:33:14.568 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.055582584999999997, 2024-09-12T22:33:14.568 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:14.568 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:14.568 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "queued for pg", 2024-09-12T22:33:14.568 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:14.568 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.568 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:14.568 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.400122+0000", 2024-09-12T22:33:14.568 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:14.568 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.569 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.569 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:14.569 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.400122+0000", 2024-09-12T22:33:14.569 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:14.569 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.569 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.569 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:14.569 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.400123+0000", 2024-09-12T22:33:14.569 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2500000000000005e-07 2024-09-12T22:33:14.569 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.569 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.569 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:14.569 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.400129+0000", 2024-09-12T22:33:14.570 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.319e-06 2024-09-12T22:33:14.570 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.570 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.570 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:14.570 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.400139+0000", 2024-09-12T22:33:14.570 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.5200000000000003e-06 2024-09-12T22:33:14.570 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.570 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.570 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:14.571 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.400143+0000", 2024-09-12T22:33:14.571 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.437e-06 2024-09-12T22:33:14.571 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:14.571 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:14.571 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:14.571 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.571 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.571 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1219 3.13 3.11cbcd3 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:14.571 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.413851+0000", 2024-09-12T22:33:14.571 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.040871338, 2024-09-12T22:33:14.571 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.041898287999999999, 2024-09-12T22:33:14.571 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:14.572 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:14.572 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "queued for pg", 2024-09-12T22:33:14.572 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:14.572 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.572 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:14.572 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.413851+0000", 2024-09-12T22:33:14.572 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:14.572 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.572 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.572 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:14.572 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.413851+0000", 2024-09-12T22:33:14.572 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:14.572 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.573 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.573 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:14.573 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.413851+0000", 2024-09-12T22:33:14.573 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.63e-07 2024-09-12T22:33:14.573 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.573 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.573 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:14.573 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.413854+0000", 2024-09-12T22:33:14.573 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.7350000000000001e-06 2024-09-12T22:33:14.573 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.573 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.573 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:14.573 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.413859+0000", 2024-09-12T22:33:14.574 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1619999999999999e-06 2024-09-12T22:33:14.574 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.574 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.574 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:14.574 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.413863+0000", 2024-09-12T22:33:14.574 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4829999999999999e-06 2024-09-12T22:33:14.574 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:14.574 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:14.574 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:14.574 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.574 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.574 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1220 3.13 3.11cbcd3 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:14.574 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.414122+0000", 2024-09-12T22:33:14.574 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.040599917999999999, 2024-09-12T22:33:14.575 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.041668917, 2024-09-12T22:33:14.575 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:14.575 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:14.575 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "queued for pg", 2024-09-12T22:33:14.575 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:14.575 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.575 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:14.575 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.414122+0000", 2024-09-12T22:33:14.575 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:14.575 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.575 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.575 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:14.575 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.414122+0000", 2024-09-12T22:33:14.576 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:14.576 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.576 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.576 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:14.576 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.414123+0000", 2024-09-12T22:33:14.576 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2099999999999996e-07 2024-09-12T22:33:14.576 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.576 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.576 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:14.576 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.414141+0000", 2024-09-12T22:33:14.576 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.7467999999999999e-05 2024-09-12T22:33:14.576 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.576 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.576 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:14.577 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.414153+0000", 2024-09-12T22:33:14.577 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2432000000000001e-05 2024-09-12T22:33:14.577 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.577 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.577 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:14.577 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.414158+0000", 2024-09-12T22:33:14.577 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9010000000000002e-06 2024-09-12T22:33:14.577 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:14.577 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:14.577 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:14.577 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.577 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.577 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4490.0:12257 4.13 4.f0b4cad3 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-12T22:33:14.578 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.450077+0000", 2024-09-12T22:33:14.578 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0046454699999999996, 2024-09-12T22:33:14.578 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0057384430000000002, 2024-09-12T22:33:14.578 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:14.578 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:14.578 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "queued for pg", 2024-09-12T22:33:14.578 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:14.578 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4490", 2024-09-12T22:33:14.578 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:14.578 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 12257 2024-09-12T22:33:14.578 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.578 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:14.578 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.578 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:14.579 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.450077+0000", 2024-09-12T22:33:14.579 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:14.579 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.579 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.579 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:14.579 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.450077+0000", 2024-09-12T22:33:14.579 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:14.579 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.579 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.579 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:14.579 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.450077+0000", 2024-09-12T22:33:14.579 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8599999999999998e-07 2024-09-12T22:33:14.579 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.579 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.580 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:14.580 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.450137+0000", 2024-09-12T22:33:14.580 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9311000000000002e-05 2024-09-12T22:33:14.580 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.580 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.580 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:14.580 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.450146+0000", 2024-09-12T22:33:14.580 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.5259999999999999e-06 2024-09-12T22:33:14.580 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.580 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.580 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:14.580 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.450153+0000", 2024-09-12T22:33:14.580 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4010000000000002e-06 2024-09-12T22:33:14.581 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:14.581 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:14.581 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:14.581 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.581 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.581 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1240 3.13 3.11cbcd3 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:14.581 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.440167+0000", 2024-09-12T22:33:14.581 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.014555007999999999, 2024-09-12T22:33:14.581 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.015686641000000001, 2024-09-12T22:33:14.581 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:14.581 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:14.581 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "queued for pg", 2024-09-12T22:33:14.581 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:14.581 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.582 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:14.582 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.440167+0000", 2024-09-12T22:33:14.582 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:14.582 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.582 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.582 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:14.582 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.440167+0000", 2024-09-12T22:33:14.582 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:14.582 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.582 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.582 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:14.582 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.440168+0000", 2024-09-12T22:33:14.582 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3399999999999999e-07 2024-09-12T22:33:14.583 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.583 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.583 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:14.583 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.440173+0000", 2024-09-12T22:33:14.583 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2429999999999996e-06 2024-09-12T22:33:14.583 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.583 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.583 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:14.583 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.440180+0000", 2024-09-12T22:33:14.583 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1119999999999998e-06 2024-09-12T22:33:14.583 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.583 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.583 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:14.583 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.440185+0000", 2024-09-12T22:33:14.584 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4440000000000001e-06 2024-09-12T22:33:14.584 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:14.584 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:14.584 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:14.584 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.584 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.584 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1212 3.13 3.11cbcd3 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:14.584 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.401707+0000", 2024-09-12T22:33:14.584 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.053015732000000003, 2024-09-12T22:33:14.584 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.054193369999999998, 2024-09-12T22:33:14.584 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:14.584 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:14.584 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "queued for pg", 2024-09-12T22:33:14.584 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:14.585 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.585 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:14.585 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.401707+0000", 2024-09-12T22:33:14.585 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:14.585 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.585 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.585 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:14.585 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.401707+0000", 2024-09-12T22:33:14.585 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:14.585 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.585 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.585 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:14.585 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.401707+0000", 2024-09-12T22:33:14.586 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7700000000000004e-07 2024-09-12T22:33:14.586 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.586 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.586 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:14.586 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.401713+0000", 2024-09-12T22:33:14.586 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6609999999999997e-06 2024-09-12T22:33:14.586 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.586 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.586 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:14.586 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.401726+0000", 2024-09-12T22:33:14.586 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.3088000000000001e-05 2024-09-12T22:33:14.586 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.586 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.586 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:14.587 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.401741+0000", 2024-09-12T22:33:14.587 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.5424e-05 2024-09-12T22:33:14.587 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:14.587 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:14.587 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:14.587 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.587 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.587 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1221 3.13 3.11cbcd3 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:14.587 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.417396+0000", 2024-09-12T22:33:14.587 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.037326207, 2024-09-12T22:33:14.587 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.038549660999999999, 2024-09-12T22:33:14.587 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:14.587 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:14.588 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "queued for pg", 2024-09-12T22:33:14.588 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:14.588 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.588 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:14.588 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.417396+0000", 2024-09-12T22:33:14.588 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:14.588 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.588 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.588 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:14.588 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.417396+0000", 2024-09-12T22:33:14.588 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:14.588 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.588 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.588 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:14.589 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.417397+0000", 2024-09-12T22:33:14.589 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7199999999999998e-07 2024-09-12T22:33:14.589 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.589 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.589 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:14.589 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.417403+0000", 2024-09-12T22:33:14.589 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8490000000000002e-06 2024-09-12T22:33:14.589 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.589 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.589 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:14.589 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.417412+0000", 2024-09-12T22:33:14.589 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.0089999999999996e-06 2024-09-12T22:33:14.589 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.590 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.590 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:14.590 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.417418+0000", 2024-09-12T22:33:14.590 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4400000000000002e-06 2024-09-12T22:33:14.590 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:14.590 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:14.590 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:14.590 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.590 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.590 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1241 3.13 3.11cbcd3 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:14.590 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.440784+0000", 2024-09-12T22:33:14.590 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.013938692000000001, 2024-09-12T22:33:14.590 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.015192778000000001, 2024-09-12T22:33:14.590 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:14.591 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:14.591 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "queued for pg", 2024-09-12T22:33:14.591 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:14.591 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.591 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:14.591 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.440784+0000", 2024-09-12T22:33:14.591 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:14.591 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.591 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.591 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:14.591 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.440784+0000", 2024-09-12T22:33:14.591 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:14.591 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.592 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.592 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:14.592 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.440784+0000", 2024-09-12T22:33:14.592 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4899999999999995e-07 2024-09-12T22:33:14.592 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.592 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.592 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:14.592 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.440790+0000", 2024-09-12T22:33:14.592 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.0599999999999996e-06 2024-09-12T22:33:14.592 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.592 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.592 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:14.592 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.440797+0000", 2024-09-12T22:33:14.592 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9959999999999996e-06 2024-09-12T22:33:14.593 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.593 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.593 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:14.593 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.440802+0000", 2024-09-12T22:33:14.593 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8790000000000002e-06 2024-09-12T22:33:14.593 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:14.593 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:14.593 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:14.593 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.593 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.593 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1213 3.13 3.11cbcd3 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:14.593 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.403250+0000", 2024-09-12T22:33:14.593 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.051472204000000001, 2024-09-12T22:33:14.594 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.052750142999999999, 2024-09-12T22:33:14.594 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:14.594 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:14.594 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "queued for pg", 2024-09-12T22:33:14.594 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:14.594 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.594 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:14.594 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403250+0000", 2024-09-12T22:33:14.594 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:14.594 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.594 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.594 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:14.594 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403250+0000", 2024-09-12T22:33:14.594 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:14.595 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.595 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.595 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:14.595 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403251+0000", 2024-09-12T22:33:14.595 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.37e-07 2024-09-12T22:33:14.595 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.595 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.595 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:14.595 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403258+0000", 2024-09-12T22:33:14.595 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.25e-06 2024-09-12T22:33:14.595 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.595 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.595 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:14.596 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403269+0000", 2024-09-12T22:33:14.596 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0509000000000001e-05 2024-09-12T22:33:14.596 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.596 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.596 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:14.596 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403274+0000", 2024-09-12T22:33:14.596 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1290000000000004e-06 2024-09-12T22:33:14.596 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:14.596 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:14.596 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:14.596 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.596 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.596 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1232 3.13 3.11cbcd3 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:14.596 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.427763+0000", 2024-09-12T22:33:14.597 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.026959376, 2024-09-12T22:33:14.597 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.028260747999999999, 2024-09-12T22:33:14.597 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:14.597 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:14.597 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "queued for pg", 2024-09-12T22:33:14.597 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:14.597 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.597 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:14.597 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.427763+0000", 2024-09-12T22:33:14.597 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:14.597 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.597 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.597 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:14.598 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.427763+0000", 2024-09-12T22:33:14.598 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:14.598 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.598 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.598 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:14.598 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.427764+0000", 2024-09-12T22:33:14.598 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4700000000000001e-07 2024-09-12T22:33:14.598 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.598 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.598 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:14.598 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.427767+0000", 2024-09-12T22:33:14.598 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.6389999999999998e-06 2024-09-12T22:33:14.598 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.598 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.599 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:14.599 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.427776+0000", 2024-09-12T22:33:14.599 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5029999999999997e-06 2024-09-12T22:33:14.599 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.599 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.599 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:14.599 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.427780+0000", 2024-09-12T22:33:14.599 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5900000000000001e-06 2024-09-12T22:33:14.599 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:14.599 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:14.599 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:14.599 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.599 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.599 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1222 3.13 3.11cbcd3 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:14.600 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.418859+0000", 2024-09-12T22:33:14.600 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.035863750999999999, 2024-09-12T22:33:14.600 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.037188980000000003, 2024-09-12T22:33:14.600 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:14.600 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:14.600 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "queued for pg", 2024-09-12T22:33:14.600 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:14.600 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.600 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:14.601 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.418859+0000", 2024-09-12T22:33:14.601 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:14.601 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.601 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.601 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:14.601 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.418859+0000", 2024-09-12T22:33:14.601 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:14.601 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.601 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.601 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:14.601 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.418862+0000", 2024-09-12T22:33:14.601 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5609999999999999e-06 2024-09-12T22:33:14.601 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.601 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.602 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:14.602 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.418866+0000", 2024-09-12T22:33:14.602 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9339999999999999e-06 2024-09-12T22:33:14.602 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.602 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.602 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:14.602 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.418876+0000", 2024-09-12T22:33:14.602 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.8409999999999995e-06 2024-09-12T22:33:14.602 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.602 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.602 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:14.602 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.418880+0000", 2024-09-12T22:33:14.602 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5199999999999999e-06 2024-09-12T22:33:14.603 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:14.603 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:14.603 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:14.603 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.603 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.603 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1233 3.13 3.11cbcd3 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:14.603 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.427792+0000", 2024-09-12T22:33:14.603 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.026930204999999999, 2024-09-12T22:33:14.603 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.028278912999999999, 2024-09-12T22:33:14.603 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:14.603 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:14.603 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "queued for pg", 2024-09-12T22:33:14.603 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:14.604 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.604 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:14.604 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.427792+0000", 2024-09-12T22:33:14.604 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:14.604 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.604 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.604 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:14.604 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.427792+0000", 2024-09-12T22:33:14.604 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:14.604 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.604 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.604 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:14.604 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.427792+0000", 2024-09-12T22:33:14.605 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5999999999999999e-07 2024-09-12T22:33:14.605 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.605 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.605 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:14.605 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.427795+0000", 2024-09-12T22:33:14.605 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1440000000000001e-06 2024-09-12T22:33:14.605 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.605 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.605 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:14.605 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.427799+0000", 2024-09-12T22:33:14.605 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6419999999999998e-06 2024-09-12T22:33:14.605 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.605 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.605 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:14.606 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.427802+0000", 2024-09-12T22:33:14.606 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2200000000000001e-06 2024-09-12T22:33:14.606 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:14.606 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:14.606 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:14.606 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.606 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.606 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1255 3.13 3.11cbcd3 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:14.606 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.451317+0000", 2024-09-12T22:33:14.606 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.0034052050000000001, 2024-09-12T22:33:14.606 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0047786629999999998, 2024-09-12T22:33:14.606 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:14.606 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:14.606 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "queued for pg", 2024-09-12T22:33:14.607 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:14.607 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.607 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:14.607 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.451317+0000", 2024-09-12T22:33:14.607 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:14.607 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.607 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.607 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:14.607 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.451317+0000", 2024-09-12T22:33:14.607 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:14.607 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.607 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.607 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:14.608 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.451318+0000", 2024-09-12T22:33:14.608 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.9800000000000002e-07 2024-09-12T22:33:14.608 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.608 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.608 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:14.608 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.451330+0000", 2024-09-12T22:33:14.608 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2364999999999999e-05 2024-09-12T22:33:14.608 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.608 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.608 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:14.608 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.451338+0000", 2024-09-12T22:33:14.608 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3669999999999999e-06 2024-09-12T22:33:14.608 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.609 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.609 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:14.609 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.451342+0000", 2024-09-12T22:33:14.609 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1450000000000001e-06 2024-09-12T22:33:14.609 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:14.609 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:14.609 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:14.609 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.609 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.609 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1198 3.13 3:cb3d3880:::200.0000000d:head [write 972006~13700 [fadvise_dontneed] in=13700b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:14.609 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.392951+0000", 2024-09-12T22:33:14.609 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.061770954000000003, 2024-09-12T22:33:14.609 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.063170690000000002, 2024-09-12T22:33:14.609 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:14.610 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:14.610 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:33:14.610 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:14.610 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.610 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:14.610 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.392951+0000", 2024-09-12T22:33:14.610 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:14.610 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.610 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.610 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:14.610 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.392951+0000", 2024-09-12T22:33:14.610 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:14.610 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.610 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.611 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:14.611 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.392952+0000", 2024-09-12T22:33:14.611 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7400000000000003e-07 2024-09-12T22:33:14.611 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.611 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.611 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:14.611 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.392984+0000", 2024-09-12T22:33:14.611 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1893000000000001e-05 2024-09-12T22:33:14.611 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.611 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.611 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:14.611 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.392992+0000", 2024-09-12T22:33:14.611 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.2060000000000007e-06 2024-09-12T22:33:14.611 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.612 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.612 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:14.612 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.392998+0000", 2024-09-12T22:33:14.612 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.2219999999999999e-06 2024-09-12T22:33:14.612 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.612 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.612 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:14.612 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.452307+0000", 2024-09-12T22:33:14.612 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.059308212999999999 2024-09-12T22:33:14.612 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.612 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.612 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:14.612 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.452348+0000", 2024-09-12T22:33:14.613 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1403000000000003e-05 2024-09-12T22:33:14.613 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.613 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.613 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:14.613 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.452409+0000", 2024-09-12T22:33:14.613 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.0611e-05 2024-09-12T22:33:14.613 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.613 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.613 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:14.613 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.454104+0000", 2024-09-12T22:33:14.613 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0016954660000000001 2024-09-12T22:33:14.613 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:14.613 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:14.613 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:14.614 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.614 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.614 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1199 3.13 3:cb3d3880:::200.0000000d:head [write 985706~1918 [fadvise_dontneed] in=1918b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:14.614 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.393174+0000", 2024-09-12T22:33:14.614 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.061548459, 2024-09-12T22:33:14.614 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.062986424999999999, 2024-09-12T22:33:14.614 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:14.614 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:14.614 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:33:14.614 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:14.614 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.614 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:14.614 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.393174+0000", 2024-09-12T22:33:14.614 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:14.615 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.615 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.615 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:14.615 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.393174+0000", 2024-09-12T22:33:14.615 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:14.615 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.615 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.615 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:14.615 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.393174+0000", 2024-09-12T22:33:14.615 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6000000000000003e-07 2024-09-12T22:33:14.615 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.615 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.615 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:14.615 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.393178+0000", 2024-09-12T22:33:14.616 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5389999999999999e-06 2024-09-12T22:33:14.616 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.616 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.616 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:14.616 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.393186+0000", 2024-09-12T22:33:14.616 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.1070000000000005e-06 2024-09-12T22:33:14.616 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.616 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.616 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:14.616 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.393190+0000", 2024-09-12T22:33:14.616 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2919999999999997e-06 2024-09-12T22:33:14.616 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.616 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.617 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:14.617 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.452785+0000", 2024-09-12T22:33:14.617 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.05959424 2024-09-12T22:33:14.617 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.617 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.617 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:14.617 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.452830+0000", 2024-09-12T22:33:14.617 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5847999999999999e-05 2024-09-12T22:33:14.617 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.617 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.617 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:14.617 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.452894+0000", 2024-09-12T22:33:14.617 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.3744000000000005e-05 2024-09-12T22:33:14.617 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.618 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.618 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:14.618 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.455314+0000", 2024-09-12T22:33:14.618 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0024195140000000002 2024-09-12T22:33:14.618 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:14.618 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:14.618 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:14.618 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.618 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.618 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1234 3.13 3.11cbcd3 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:14.618 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.430971+0000", 2024-09-12T22:33:14.618 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.023750799, 2024-09-12T22:33:14.618 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.025223406, 2024-09-12T22:33:14.619 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:14.619 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:14.619 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "queued for pg", 2024-09-12T22:33:14.619 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:14.619 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.619 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:14.619 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.430971+0000", 2024-09-12T22:33:14.619 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:14.619 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.619 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.619 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:14.619 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.430971+0000", 2024-09-12T22:33:14.619 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:14.619 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.620 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.620 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:14.620 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.430972+0000", 2024-09-12T22:33:14.620 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.035e-06 2024-09-12T22:33:14.620 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.620 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.620 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:14.620 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.430977+0000", 2024-09-12T22:33:14.620 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8369999999999996e-06 2024-09-12T22:33:14.620 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.620 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.620 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:14.620 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.430988+0000", 2024-09-12T22:33:14.620 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0540000000000001e-05 2024-09-12T22:33:14.621 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.621 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.621 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:14.621 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.430997+0000", 2024-09-12T22:33:14.621 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.6410000000000008e-06 2024-09-12T22:33:14.621 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:14.621 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:14.621 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:14.621 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.621 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.621 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1200 3.13 3:cb3d3880:::200.0000000d:head [write 987624~5700 [fadvise_dontneed] in=5700b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:14.621 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.393356+0000", 2024-09-12T22:33:14.621 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.061366425000000002, 2024-09-12T22:33:14.622 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.062863821, 2024-09-12T22:33:14.622 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:14.622 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:14.622 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:33:14.622 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:14.622 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.622 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:14.622 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.393356+0000", 2024-09-12T22:33:14.622 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:14.622 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.622 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.622 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:14.622 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.393356+0000", 2024-09-12T22:33:14.622 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:14.623 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.623 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.623 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:14.623 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.393356+0000", 2024-09-12T22:33:14.623 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8299999999999997e-07 2024-09-12T22:33:14.623 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.623 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.623 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:14.623 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.393361+0000", 2024-09-12T22:33:14.623 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0699999999999997e-06 2024-09-12T22:33:14.623 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.623 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.623 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:14.623 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.393367+0000", 2024-09-12T22:33:14.624 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6930000000000004e-06 2024-09-12T22:33:14.624 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.624 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.624 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:14.624 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.393371+0000", 2024-09-12T22:33:14.624 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.002e-06 2024-09-12T22:33:14.624 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.624 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.624 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:14.624 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.453244+0000", 2024-09-12T22:33:14.624 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.059873007999999998 2024-09-12T22:33:14.624 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.624 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.625 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:14.625 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.453284+0000", 2024-09-12T22:33:14.625 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.032e-05 2024-09-12T22:33:14.625 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.625 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.625 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:14.625 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.453363+0000", 2024-09-12T22:33:14.625 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.8184999999999998e-05 2024-09-12T22:33:14.625 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.625 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.625 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:14.625 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.455318+0000", 2024-09-12T22:33:14.625 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0019556719999999999 2024-09-12T22:33:14.625 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:14.626 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:14.626 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:14.626 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.626 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.626 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1214 3.13 3.11cbcd3 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:14.626 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.403674+0000", 2024-09-12T22:33:14.626 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.051048283999999999, 2024-09-12T22:33:14.626 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.052589163000000001, 2024-09-12T22:33:14.626 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:14.626 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:14.626 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "queued for pg", 2024-09-12T22:33:14.626 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:14.626 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.626 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:14.627 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403674+0000", 2024-09-12T22:33:14.627 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:14.627 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.627 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.627 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:14.627 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403674+0000", 2024-09-12T22:33:14.627 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:14.627 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.627 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.627 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:14.627 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403674+0000", 2024-09-12T22:33:14.627 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.7700000000000005e-07 2024-09-12T22:33:14.627 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.627 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.628 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:14.628 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403678+0000", 2024-09-12T22:33:14.628 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2009999999999999e-06 2024-09-12T22:33:14.628 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.628 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.628 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:14.628 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403686+0000", 2024-09-12T22:33:14.628 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5690000000000005e-06 2024-09-12T22:33:14.628 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.628 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.628 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:14.628 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403690+0000", 2024-09-12T22:33:14.628 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.233e-06 2024-09-12T22:33:14.629 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:14.629 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:14.629 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:14.629 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.629 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.629 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1256 3.13 3.11cbcd3 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:14.629 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.452637+0000", 2024-09-12T22:33:14.629 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.002085136, 2024-09-12T22:33:14.629 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0036709210000000002, 2024-09-12T22:33:14.629 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:14.629 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:14.629 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "queued for pg", 2024-09-12T22:33:14.629 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:14.629 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.630 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:14.630 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.452637+0000", 2024-09-12T22:33:14.630 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:14.630 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.630 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.630 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:14.630 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.452637+0000", 2024-09-12T22:33:14.630 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:14.630 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.630 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.630 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:14.630 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.452638+0000", 2024-09-12T22:33:14.630 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7599999999999997e-07 2024-09-12T22:33:14.630 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.631 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.631 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:14.631 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.452646+0000", 2024-09-12T22:33:14.631 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0730000000000005e-06 2024-09-12T22:33:14.631 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.631 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.631 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:14.631 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.452653+0000", 2024-09-12T22:33:14.631 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6329999999999996e-06 2024-09-12T22:33:14.631 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.631 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.631 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:14.631 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.452658+0000", 2024-09-12T22:33:14.632 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3880000000000002e-06 2024-09-12T22:33:14.632 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:14.632 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:14.632 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:14.632 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.632 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.632 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1201 3.13 3:cb3d3880:::200.0000000d:head [write 993324~2420 [fadvise_dontneed] in=2420b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:14.632 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.393377+0000", 2024-09-12T22:33:14.632 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.061345196999999997, 2024-09-12T22:33:14.632 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.062969003999999995, 2024-09-12T22:33:14.632 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:14.632 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:14.632 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:33:14.633 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:14.633 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.633 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:14.633 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.393377+0000", 2024-09-12T22:33:14.633 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:14.633 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.633 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.633 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:14.633 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.393377+0000", 2024-09-12T22:33:14.633 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:14.633 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.633 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.633 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:14.633 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.393377+0000", 2024-09-12T22:33:14.634 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8799999999999998e-07 2024-09-12T22:33:14.634 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.634 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.634 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:14.634 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.393435+0000", 2024-09-12T22:33:14.634 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7082e-05 2024-09-12T22:33:14.634 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.634 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.634 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:14.634 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.393472+0000", 2024-09-12T22:33:14.634 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7688999999999998e-05 2024-09-12T22:33:14.634 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.634 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.635 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:14.635 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.393544+0000", 2024-09-12T22:33:14.635 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2057999999999993e-05 2024-09-12T22:33:14.635 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.635 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.635 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:14.635 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.453623+0000", 2024-09-12T22:33:14.635 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.060078669000000001 2024-09-12T22:33:14.635 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.635 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.635 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:14.635 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.453661+0000", 2024-09-12T22:33:14.635 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7571999999999999e-05 2024-09-12T22:33:14.635 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.636 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.636 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:14.636 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.453724+0000", 2024-09-12T22:33:14.636 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.3489000000000001e-05 2024-09-12T22:33:14.636 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.636 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.636 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:14.636 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.456265+0000", 2024-09-12T22:33:14.636 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0025412690000000001 2024-09-12T22:33:14.636 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:14.636 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:14.636 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:14.636 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.637 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.637 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1202 3.13 3:cb3d3880:::200.0000000d:head [write 995744~2946 [fadvise_dontneed] in=2946b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:14.637 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.393556+0000", 2024-09-12T22:33:14.637 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.061166265999999997, 2024-09-12T22:33:14.637 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.062847345999999998, 2024-09-12T22:33:14.637 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:14.637 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:14.637 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:33:14.637 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:14.637 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.637 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:14.637 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.393556+0000", 2024-09-12T22:33:14.637 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:14.638 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.638 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.638 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:14.638 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.393556+0000", 2024-09-12T22:33:14.638 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:14.638 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.638 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.638 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:14.638 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.393556+0000", 2024-09-12T22:33:14.638 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1800000000000001e-07 2024-09-12T22:33:14.638 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.638 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.638 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:14.638 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.393562+0000", 2024-09-12T22:33:14.639 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3399999999999997e-06 2024-09-12T22:33:14.639 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.639 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.639 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:14.639 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.393568+0000", 2024-09-12T22:33:14.639 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.0809999999999999e-06 2024-09-12T22:33:14.639 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.639 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.639 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:14.639 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.393571+0000", 2024-09-12T22:33:14.639 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.444e-06 2024-09-12T22:33:14.639 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.639 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.639 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:14.640 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.454120+0000", 2024-09-12T22:33:14.640 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.060548593999999997 2024-09-12T22:33:14.640 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.640 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.640 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:14.640 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.454167+0000", 2024-09-12T22:33:14.640 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.7228999999999998e-05 2024-09-12T22:33:14.640 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.640 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.640 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:14.640 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.454236+0000", 2024-09-12T22:33:14.640 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.8677000000000007e-05 2024-09-12T22:33:14.640 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.641 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.641 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:14.641 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.456271+0000", 2024-09-12T22:33:14.641 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0020349460000000002 2024-09-12T22:33:14.641 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:14.641 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:14.641 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:14.641 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.641 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.641 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1257 3.13 3.11cbcd3 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:14.641 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.455540+0000", 2024-09-12T22:33:14.641 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 4294967295.9991822, 2024-09-12T22:33:14.641 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00093232099999999995, 2024-09-12T22:33:14.642 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:14.642 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:14.642 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "queued for pg", 2024-09-12T22:33:14.642 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:14.642 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.642 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:14.642 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.455540+0000", 2024-09-12T22:33:14.642 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:14.642 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.642 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.642 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:14.642 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.455540+0000", 2024-09-12T22:33:14.642 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:14.642 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.643 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.643 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:14.643 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.455541+0000", 2024-09-12T22:33:14.643 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6000000000000003e-07 2024-09-12T22:33:14.643 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.643 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.643 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:14.643 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.455549+0000", 2024-09-12T22:33:14.643 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.4489999999999999e-06 2024-09-12T22:33:14.643 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.643 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.643 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:14.643 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.455557+0000", 2024-09-12T22:33:14.643 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.2139999999999996e-06 2024-09-12T22:33:14.644 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.644 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.644 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:14.644 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.455562+0000", 2024-09-12T22:33:14.644 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9490000000000004e-06 2024-09-12T22:33:14.644 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:14.644 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:14.644 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:14.644 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.644 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.644 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1223 3.13 3.11cbcd3 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:14.644 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.420111+0000", 2024-09-12T22:33:14.644 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.034611132000000003, 2024-09-12T22:33:14.645 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.036386430999999997, 2024-09-12T22:33:14.645 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:14.645 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:14.645 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "queued for pg", 2024-09-12T22:33:14.645 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:14.645 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.645 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:14.645 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.420111+0000", 2024-09-12T22:33:14.645 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:14.645 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.645 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.645 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:14.645 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.420111+0000", 2024-09-12T22:33:14.646 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:14.646 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.646 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.646 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:14.646 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.420112+0000", 2024-09-12T22:33:14.646 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.2900000000000002e-07 2024-09-12T22:33:14.646 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.646 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.646 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:14.646 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.420116+0000", 2024-09-12T22:33:14.646 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.67e-06 2024-09-12T22:33:14.647 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.647 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.647 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:14.647 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.420125+0000", 2024-09-12T22:33:14.647 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.0890000000000006e-06 2024-09-12T22:33:14.647 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:14.647 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:14.647 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:14.647 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.420131+0000", 2024-09-12T22:33:14.647 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4269999999999996e-06 2024-09-12T22:33:14.648 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:14.648 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:14.648 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:14.648 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:14.648 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2024-09-12T22:33:14.648 INFO:teuthology.orchestra.run.smithi163.stdout: "num_ops": 54 2024-09-12T22:33:14.648 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-09-12T22:33:14.649 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:14.648+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:14.650 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:33:14.655 INFO:tasks.workunit.client.0.smithi019.stdout:1/485: dwrite d3/d11/d53/f5b [0,4194304] 0 2024-09-12T22:33:14.655 INFO:tasks.workunit.client.0.smithi019.stdout:5/525: rename d0/dc/f84 to d0/d7/d2d/d32/d36/fb4 0 2024-09-12T22:33:14.656 INFO:tasks.workunit.client.0.smithi019.stdout:1/486: chown d3/c4e 16091 1 2024-09-12T22:33:14.656 INFO:tasks.workunit.client.0.smithi019.stdout:1/487: sync 2024-09-12T22:33:14.656 INFO:tasks.workunit.client.0.smithi019.stdout:5/526: fdatasync d0/f6 0 2024-09-12T22:33:14.656 INFO:tasks.workunit.client.0.smithi019.stdout:1/488: dwrite d3/d11/d63/f85 [0,4194304] 0 2024-09-12T22:33:14.656 INFO:tasks.workunit.client.0.smithi019.stdout:5/527: dwrite d0/dc/d39/d38/f95 [4194304,4194304] 0 2024-09-12T22:33:14.656 INFO:tasks.workunit.client.0.smithi019.stdout:5/528: chown d0/d7/d2d/d4c/l56 33373994 1 2024-09-12T22:33:14.656 INFO:tasks.workunit.client.0.smithi019.stdout:5/529: write d0/dc/d39/d38/f6e [1003840,3342] 0 2024-09-12T22:33:14.656 INFO:tasks.workunit.client.0.smithi019.stdout:5/530: mkdir d0/d7/d2d/d32/d36/d8c/db5 0 2024-09-12T22:33:14.656 INFO:tasks.workunit.client.0.smithi019.stdout:3/339: write dd/d12/f35 [2440030,81174] 0 2024-09-12T22:33:14.656 INFO:tasks.workunit.client.0.smithi019.stdout:3/340: creat dd/d1e/f61 x:0 0 0 2024-09-12T22:33:14.656 INFO:tasks.workunit.client.0.smithi019.stdout:6/433: dread d1b/d26/d39/d6a/f85 [0,4194304] 0 2024-09-12T22:33:14.656 INFO:tasks.workunit.client.0.smithi019.stdout:9/398: write dd/d10/d17/d23/f49 [410537,434] 0 2024-09-12T22:33:14.657 INFO:tasks.workunit.client.0.smithi019.stdout:0/388: dwrite d1/d14/f36 [0,4194304] 0 2024-09-12T22:33:14.657 INFO:tasks.workunit.client.0.smithi019.stdout:9/399: mkdir dd/d10/d17/d22/d83 0 2024-09-12T22:33:14.657 INFO:tasks.workunit.client.0.smithi019.stdout:6/434: mkdir d1b/d26/d27/d3e/d83/d98 0 2024-09-12T22:33:14.657 INFO:tasks.workunit.client.0.smithi019.stdout:9/400: symlink dd/d10/d17/d23/d2e/d31/d3f/d67/l84 0 2024-09-12T22:33:14.657 INFO:tasks.workunit.client.0.smithi019.stdout:6/435: symlink d1b/d26/d27/d67/d77/d95/l99 0 2024-09-12T22:33:14.657 INFO:tasks.workunit.client.0.smithi019.stdout:9/401: dwrite dd/d10/d17/d23/d37/f5a [0,4194304] 0 2024-09-12T22:33:14.657 INFO:tasks.workunit.client.0.smithi019.stdout:9/402: dread - dd/d10/d17/d22/d6c/f79 zero size 2024-09-12T22:33:14.657 INFO:tasks.workunit.client.0.smithi019.stdout:4/371: write d1/d22/f33 [192141,18395] 0 2024-09-12T22:33:14.657 INFO:tasks.workunit.client.0.smithi019.stdout:5/531: dread d0/d7/d16/d18/f26 [0,4194304] 0 2024-09-12T22:33:14.657 INFO:tasks.workunit.client.0.smithi019.stdout:9/403: dwrite dd/d10/d17/d22/d42/f55 [0,4194304] 0 2024-09-12T22:33:14.657 INFO:tasks.workunit.client.0.smithi019.stdout:4/372: dwrite d1/d22/d26/f43 [0,4194304] 0 2024-09-12T22:33:14.657 INFO:tasks.workunit.client.0.smithi019.stdout:5/532: symlink d0/d7/d16/d18/lb6 0 2024-09-12T22:33:14.657 INFO:tasks.workunit.client.0.smithi019.stdout:4/373: mknod d1/d11/d15/d1f/d56/d6b/c76 0 2024-09-12T22:33:14.657 INFO:tasks.workunit.client.0.smithi019.stdout:5/533: chown d0/dc/d39/f4e 817150351 1 2024-09-12T22:33:14.658 INFO:tasks.workunit.client.0.smithi019.stdout:9/404: getdents dd/d10/d17/d23/d2e/d31/d54 0 2024-09-12T22:33:14.658 INFO:tasks.workunit.client.0.smithi019.stdout:8/366: truncate d7/f1d 2254407 0 2024-09-12T22:33:14.658 INFO:tasks.workunit.client.0.smithi019.stdout:8/367: read d7/f29 [3223707,63146] 0 2024-09-12T22:33:14.658 INFO:tasks.workunit.client.0.smithi019.stdout:8/368: truncate d7/d8/f1b 5088378 0 2024-09-12T22:33:14.658 INFO:tasks.workunit.client.0.smithi019.stdout:7/349: truncate d6/d2d/d41/f48 242809 0 2024-09-12T22:33:14.658 INFO:tasks.workunit.client.0.smithi019.stdout:7/350: read d6/db/dc/d26/f36 [3524590,119819] 0 2024-09-12T22:33:14.658 INFO:tasks.workunit.client.0.smithi019.stdout:2/393: truncate d0/d5/d18/d3d/f5f 1743919 0 2024-09-12T22:33:14.658 INFO:tasks.workunit.client.0.smithi019.stdout:1/489: write d3/df/f48 [2088863,18104] 0 2024-09-12T22:33:14.658 INFO:tasks.workunit.client.0.smithi019.stdout:7/351: link d6/db/l52 d6/db/dc/d26/l85 0 2024-09-12T22:33:14.658 INFO:tasks.workunit.client.0.smithi019.stdout:6/436: truncate d1b/d2d/f55 7573598 0 2024-09-12T22:33:14.658 INFO:tasks.workunit.client.0.smithi019.stdout:4/374: read d1/d4/f2a [4188702,92264] 0 2024-09-12T22:33:14.658 INFO:tasks.workunit.client.0.smithi019.stdout:5/534: truncate d0/dc/f34 1957229 0 2024-09-12T22:33:14.658 INFO:tasks.workunit.client.0.smithi019.stdout:1/490: rename d3/d11/d63/l8f to d3/d3f/d58/la1 0 2024-09-12T22:33:14.658 INFO:tasks.workunit.client.0.smithi019.stdout:1/491: unlink d3/c81 0 2024-09-12T22:33:14.659 INFO:tasks.workunit.client.0.smithi019.stdout:1/492: sync 2024-09-12T22:33:14.659 INFO:tasks.workunit.client.0.smithi019.stdout:9/405: truncate dd/d10/d17/d22/f4f 4053861 0 2024-09-12T22:33:14.659 INFO:tasks.workunit.client.0.smithi019.stdout:0/389: dread d1/d14/d26/d40/d45/f54 [0,4194304] 0 2024-09-12T22:33:14.659 INFO:tasks.workunit.client.0.smithi019.stdout:5/535: rename d0/d7/d2d/f61 to d0/d7/d2d/d32/d36/d6a/da0/fb7 0 2024-09-12T22:33:14.659 INFO:tasks.workunit.client.0.smithi019.stdout:2/394: dwrite d0/d5/d18/f56 [0,4194304] 0 2024-09-12T22:33:14.659 INFO:tasks.workunit.client.0.smithi019.stdout:6/437: dread d1b/d26/f74 [0,4194304] 0 2024-09-12T22:33:14.659 INFO:tasks.workunit.client.0.smithi019.stdout:8/369: write f0 [53593,105890] 0 2024-09-12T22:33:14.659 INFO:tasks.workunit.client.0.smithi019.stdout:3/341: dwrite dd/d1e/f37 [0,4194304] 0 2024-09-12T22:33:14.659 INFO:tasks.workunit.client.0.smithi019.stdout:0/390: mkdir d1/d1f/d5b/d73 0 2024-09-12T22:33:14.659 INFO:tasks.workunit.client.0.smithi019.stdout:5/536: chown d0/f75 15 1 2024-09-12T22:33:14.659 INFO:tasks.workunit.client.0.smithi019.stdout:7/352: dwrite d6/d14/d2a/f82 [0,4194304] 0 2024-09-12T22:33:14.659 INFO:tasks.workunit.client.0.smithi019.stdout:9/406: fsync dd/d10/d17/d23/d2e/d31/d3f/d47/f4e 0 2024-09-12T22:33:14.659 INFO:tasks.workunit.client.0.smithi019.stdout:2/395: fdatasync d0/d5/d18/d1b/d36/f4c 0 2024-09-12T22:33:14.659 INFO:tasks.workunit.client.0.smithi019.stdout:4/375: dwrite d1/d22/d26/f43 [0,4194304] 0 2024-09-12T22:33:14.660 INFO:tasks.workunit.client.0.smithi019.stdout:7/353: write d6/db/dc/d26/f50 [856332,72086] 0 2024-09-12T22:33:14.660 INFO:tasks.workunit.client.0.smithi019.stdout:0/391: chown d1/d14/d1b/d3a 3 1 2024-09-12T22:33:14.660 INFO:teuthology.orchestra.run.smithi019.stderr:noscrub is unset 2024-09-12T22:33:14.662 INFO:tasks.workunit.client.0.smithi019.stdout:2/396: chown d0/da/f31 7 1 2024-09-12T22:33:14.663 INFO:tasks.workunit.client.0.smithi019.stdout:1/493: dwrite d3/d11/d63/d76/f9c [0,4194304] 0 2024-09-12T22:33:14.663 INFO:tasks.workunit.client.0.smithi019.stdout:2/397: fdatasync d0/d5/d18/d1b/f4b 0 2024-09-12T22:33:14.663 INFO:tasks.workunit.client.0.smithi019.stdout:2/398: stat d0/d5/d18/d5c/l6e 0 2024-09-12T22:33:14.663 INFO:tasks.workunit.client.0.smithi019.stdout:6/438: dwrite d1b/d26/d39/f41 [0,4194304] 0 2024-09-12T22:33:14.663 INFO:tasks.workunit.client.0.smithi019.stdout:4/376: unlink d1/d22/d31/d4f/f53 0 2024-09-12T22:33:14.663 INFO:tasks.workunit.client.0.smithi019.stdout:5/537: fdatasync d0/dc/d39/f4e 0 2024-09-12T22:33:14.663 INFO:tasks.workunit.client.0.smithi019.stdout:1/494: mknod d3/df/d7e/ca2 0 2024-09-12T22:33:14.663 INFO:tasks.workunit.client.0.smithi019.stdout:7/354: truncate d6/d14/d45/f5d 261457 0 2024-09-12T22:33:14.663 INFO:tasks.workunit.client.0.smithi019.stdout:3/342: write dd/f28 [1410471,17428] 0 2024-09-12T22:33:14.663 INFO:tasks.workunit.client.0.smithi019.stdout:2/399: chown d0/d5/d18/d1b/d36/c47 2149875 1 2024-09-12T22:33:14.663 INFO:tasks.workunit.client.0.smithi019.stdout:9/407: write dd/d10/d17/d23/d2e/d31/f46 [2086291,3146] 0 2024-09-12T22:33:14.663 INFO:tasks.workunit.client.0.smithi019.stdout:9/408: write dd/d10/d17/d23/d2e/d31/f46 [5231047,71437] 0 2024-09-12T22:33:14.663 INFO:tasks.workunit.client.0.smithi019.stdout:0/392: dwrite d1/d14/d26/f50 [0,4194304] 0 2024-09-12T22:33:14.664 INFO:tasks.workunit.client.0.smithi019.stdout:6/439: link d1b/l93 d1b/d26/d31/l9a 0 2024-09-12T22:33:14.664 INFO:tasks.workunit.client.0.smithi019.stdout:1/495: symlink d3/df/d7e/d96/la3 0 2024-09-12T22:33:14.664 INFO:tasks.workunit.client.0.smithi019.stdout:2/400: mkdir d0/d5/d18/d5c/d85 0 2024-09-12T22:33:14.664 INFO:tasks.workunit.client.0.smithi019.stdout:5/538: rename d0/dc to d0/d7/d2d/d32/d36/d8c/db8 0 2024-09-12T22:33:14.664 INFO:tasks.workunit.client.0.smithi019.stdout:7/355: creat d6/d14/d15/d62/f86 x:0 0 0 2024-09-12T22:33:14.664 INFO:tasks.workunit.client.0.smithi019.stdout:3/343: write dd/f33 [947858,22400] 0 2024-09-12T22:33:14.664 INFO:tasks.workunit.client.0.smithi019.stdout:5/539: mkdir d0/db9 0 2024-09-12T22:33:14.677 INFO:tasks.workunit.client.0.smithi019.stdout:9/409: link c8 dd/d10/d6b/c85 0 2024-09-12T22:33:14.677 INFO:tasks.workunit.client.0.smithi019.stdout:3/344: chown dd/d12/f29 26004 1 2024-09-12T22:33:14.678 INFO:tasks.workunit.client.0.smithi019.stdout:1/496: mkdir d3/df/d7e/d90/da4 0 2024-09-12T22:33:14.678 INFO:tasks.workunit.client.0.smithi019.stdout:2/401: write d0/d5/d18/d5c/f68 [940249,82691] 0 2024-09-12T22:33:14.678 INFO:tasks.workunit.client.0.smithi019.stdout:3/345: mkdir dd/d12/d62 0 2024-09-12T22:33:14.678 INFO:tasks.workunit.client.0.smithi019.stdout:1/497: chown d3/d1b/l22 1775084 1 2024-09-12T22:33:14.678 INFO:tasks.workunit.client.0.smithi019.stdout:8/370: sync 2024-09-12T22:33:14.678 INFO:tasks.workunit.client.0.smithi019.stdout:7/356: link d6/db/dc/f9 d6/d14/d15/d62/f87 0 2024-09-12T22:33:14.678 INFO:tasks.workunit.client.0.smithi019.stdout:1/498: creat d3/df/d7e/d96/fa5 x:0 0 0 2024-09-12T22:33:14.678 INFO:tasks.workunit.client.0.smithi019.stdout:6/440: dwrite d1b/f6e [0,4194304] 0 2024-09-12T22:33:14.678 INFO:tasks.workunit.client.0.smithi019.stdout:8/371: rename d7/d8/df to d7/d34/d78 0 2024-09-12T22:33:14.678 INFO:tasks.workunit.client.0.smithi019.stdout:8/372: chown c6 710733378 1 2024-09-12T22:33:14.678 INFO:tasks.workunit.client.0.smithi019.stdout:6/441: creat d1b/d26/d31/f9b x:0 0 0 2024-09-12T22:33:14.678 INFO:tasks.workunit.client.0.smithi019.stdout:9/410: dwrite dd/d10/d17/d23/d2e/d31/d3f/f4b [0,4194304] 0 2024-09-12T22:33:14.678 INFO:tasks.workunit.client.0.smithi019.stdout:1/499: rename d3/df/f9a to d3/d11/d16/d3c/fa6 0 2024-09-12T22:33:14.678 INFO:tasks.workunit.client.0.smithi019.stdout:8/373: write d7/f19 [4424399,78832] 0 2024-09-12T22:33:14.679 INFO:tasks.workunit.client.0.smithi019.stdout:1/500: write d3/d1b/f21 [3558677,92548] 0 2024-09-12T22:33:14.679 INFO:tasks.workunit.client.0.smithi019.stdout:6/442: creat d1b/d26/d31/d5f/f9c x:0 0 0 2024-09-12T22:33:14.679 INFO:tasks.workunit.client.0.smithi019.stdout:9/411: chown dd/d10/d17/d23/c41 0 1 2024-09-12T22:33:14.679 INFO:tasks.workunit.client.0.smithi019.stdout:1/501: write d3/d11/d16/d3c/d55/f62 [1730797,16143] 0 2024-09-12T22:33:14.679 INFO:tasks.workunit.client.0.smithi019.stdout:7/357: dwrite d6/d14/d45/f7e [0,4194304] 0 2024-09-12T22:33:14.679 INFO:tasks.workunit.client.0.smithi019.stdout:6/443: rename d1b/f56 to d1b/d2d/f9d 0 2024-09-12T22:33:14.679 INFO:tasks.workunit.client.0.smithi019.stdout:1/502: rmdir d3 39 2024-09-12T22:33:14.679 INFO:tasks.workunit.client.0.smithi019.stdout:8/374: dwrite d7/d8/f37 [0,4194304] 0 2024-09-12T22:33:14.679 INFO:tasks.workunit.client.0.smithi019.stdout:7/358: dwrite f1 [0,4194304] 0 2024-09-12T22:33:14.679 INFO:tasks.workunit.client.0.smithi019.stdout:8/375: creat d7/d34/d78/d2d/f79 x:0 0 0 2024-09-12T22:33:14.679 INFO:tasks.workunit.client.0.smithi019.stdout:8/376: write d7/d5e/f6b [202052,122736] 0 2024-09-12T22:33:14.679 INFO:tasks.workunit.client.0.smithi019.stdout:8/377: write d7/d8/f2e [3148745,25135] 0 2024-09-12T22:33:14.679 INFO:tasks.workunit.client.0.smithi019.stdout:8/378: truncate d7/d2f/d75/f76 961505 0 2024-09-12T22:33:14.680 INFO:tasks.workunit.client.0.smithi019.stdout:6/444: dread d1b/d26/d39/f82 [0,4194304] 0 2024-09-12T22:33:14.680 INFO:tasks.workunit.client.0.smithi019.stdout:6/445: write d1b/d26/d27/d3e/f79 [3893737,86366] 0 2024-09-12T22:33:14.680 INFO:tasks.workunit.client.0.smithi019.stdout:6/446: stat d1b/f5d 0 2024-09-12T22:33:14.680 INFO:tasks.workunit.client.0.smithi019.stdout:9/412: dread dd/f1f [0,4194304] 0 2024-09-12T22:33:14.680 INFO:tasks.workunit.client.0.smithi019.stdout:8/379: dwrite d7/d8/dd/f58 [0,4194304] 0 2024-09-12T22:33:14.680 INFO:tasks.workunit.client.0.smithi019.stdout:6/447: dwrite d1b/f3c [0,4194304] 0 2024-09-12T22:33:14.680 INFO:tasks.workunit.client.0.smithi019.stdout:9/413: dwrite dd/d10/f39 [0,4194304] 0 2024-09-12T22:33:14.680 INFO:tasks.workunit.client.0.smithi019.stdout:4/377: truncate d1/d22/d26/f29 3855615 0 2024-09-12T22:33:14.680 INFO:tasks.workunit.client.0.smithi019.stdout:0/393: truncate d1/d14/d1b/f44 227831 0 2024-09-12T22:33:14.680 INFO:tasks.workunit.client.0.smithi019.stdout:7/359: mknod d6/d2d/d3d/d84/c88 0 2024-09-12T22:33:14.680 INFO:tasks.workunit.client.0.smithi019.stdout:8/380: rename f4 to d7/d34/f7a 0 2024-09-12T22:33:14.680 INFO:tasks.workunit.client.0.smithi019.stdout:9/414: mknod dd/d10/d6b/c86 0 2024-09-12T22:33:14.680 INFO:tasks.workunit.client.0.smithi019.stdout:1/503: link d3/df/d7e/d96/la3 d3/d3f/d58/d7f/la7 0 2024-09-12T22:33:14.681 INFO:tasks.workunit.client.0.smithi019.stdout:0/394: mknod d1/d14/d32/d71/c74 0 2024-09-12T22:33:14.681 INFO:tasks.workunit.client.0.smithi019.stdout:7/360: creat d6/d2d/d77/f89 x:0 0 0 2024-09-12T22:33:14.681 INFO:tasks.workunit.client.0.smithi019.stdout:1/504: chown d3/d11/d53/f82 18 1 2024-09-12T22:33:14.681 INFO:tasks.workunit.client.0.smithi019.stdout:0/395: mkdir d1/d14/d32/d71/d75 0 2024-09-12T22:33:14.681 INFO:tasks.workunit.client.0.smithi019.stdout:1/505: write d3/d1b/f21 [12038604,88448] 0 2024-09-12T22:33:14.681 INFO:tasks.workunit.client.0.smithi019.stdout:4/378: dwrite d1/d22/d26/f48 [0,4194304] 0 2024-09-12T22:33:14.681 INFO:tasks.workunit.client.0.smithi019.stdout:9/415: dwrite dd/d10/f14 [0,4194304] 0 2024-09-12T22:33:14.681 INFO:tasks.workunit.client.0.smithi019.stdout:1/506: dread - d3/df/d7e/d96/f9e zero size 2024-09-12T22:33:14.681 INFO:tasks.workunit.client.0.smithi019.stdout:6/448: truncate d1b/f3c 730342 0 2024-09-12T22:33:14.681 INFO:tasks.workunit.client.0.smithi019.stdout:4/379: chown d1/l28 499316 1 2024-09-12T22:33:14.681 INFO:tasks.workunit.client.0.smithi019.stdout:9/416: chown dd/d10/d17/d22 31487645 1 2024-09-12T22:33:14.681 INFO:tasks.workunit.client.0.smithi019.stdout:3/346: dread f2 [0,4194304] 0 2024-09-12T22:33:14.681 INFO:tasks.workunit.client.0.smithi019.stdout:6/449: readlink d1b/d26/d31/d5f/l72 0 2024-09-12T22:33:14.681 INFO:tasks.workunit.client.0.smithi019.stdout:3/347: chown l6 1714476 1 2024-09-12T22:33:14.682 INFO:tasks.workunit.client.0.smithi019.stdout:0/396: dwrite d1/d14/f4e [0,4194304] 0 2024-09-12T22:33:14.682 INFO:tasks.workunit.client.0.smithi019.stdout:1/507: symlink d3/d11/d63/d76/d91/la8 0 2024-09-12T22:33:14.682 INFO:tasks.workunit.client.0.smithi019.stdout:6/450: creat d1b/d26/d39/d6a/f9e x:0 0 0 2024-09-12T22:33:14.682 INFO:tasks.workunit.client.0.smithi019.stdout:3/348: mknod dd/c63 0 2024-09-12T22:33:14.682 INFO:tasks.workunit.client.0.smithi019.stdout:0/397: fdatasync d1/f4d 0 2024-09-12T22:33:14.682 INFO:tasks.workunit.client.0.smithi019.stdout:4/380: chown d1/d22/d2c/c42 12 1 2024-09-12T22:33:14.682 INFO:tasks.workunit.client.0.smithi019.stdout:4/381: fdatasync d1/d4/f6f 0 2024-09-12T22:33:14.682 INFO:tasks.workunit.client.0.smithi019.stdout:6/451: mknod d1b/d26/d31/d5f/c9f 0 2024-09-12T22:33:14.682 INFO:tasks.workunit.client.0.smithi019.stdout:2/402: dread d0/d5/d18/d1b/d36/f4c [0,4194304] 0 2024-09-12T22:33:14.682 INFO:tasks.workunit.client.0.smithi019.stdout:9/417: dwrite dd/d10/d17/d22/f3e [0,4194304] 0 2024-09-12T22:33:14.682 INFO:tasks.workunit.client.0.smithi019.stdout:0/398: link d1/d51/f56 d1/d1d/f76 0 2024-09-12T22:33:14.682 INFO:tasks.workunit.client.0.smithi019.stdout:3/349: link dd/d12/f3b dd/d1e/d5a/f64 0 2024-09-12T22:33:14.682 INFO:tasks.workunit.client.0.smithi019.stdout:6/452: creat d1b/d26/d39/fa0 x:0 0 0 2024-09-12T22:33:14.683 INFO:tasks.workunit.client.0.smithi019.stdout:2/403: rename d0/d5/d18/d3d to d0/d5/d18/d1b/d5d/d86 0 2024-09-12T22:33:14.683 INFO:tasks.workunit.client.0.smithi019.stdout:5/540: dread d0/d7/d2d/d32/d36/d8c/db8/d9a/fa4 [0,4194304] 0 2024-09-12T22:33:14.683 INFO:tasks.workunit.client.0.smithi019.stdout:2/404: creat d0/d5/d60/d74/d7e/f87 x:0 0 0 2024-09-12T22:33:14.683 INFO:tasks.workunit.client.0.smithi019.stdout:4/382: dwrite d1/d22/d57/f5d [0,4194304] 0 2024-09-12T22:33:14.683 INFO:tasks.workunit.client.0.smithi019.stdout:6/453: link d1b/d26/d31/l6f d1b/d26/d27/d67/d77/d95/la1 0 2024-09-12T22:33:14.683 INFO:tasks.workunit.client.0.smithi019.stdout:0/399: dwrite d1/d14/f36 [0,4194304] 0 2024-09-12T22:33:14.683 INFO:tasks.workunit.client.0.smithi019.stdout:4/383: mkdir d1/d4/d38/d77 0 2024-09-12T22:33:14.683 INFO:tasks.workunit.client.0.smithi019.stdout:4/384: readlink d1/l28 0 2024-09-12T22:33:14.683 INFO:tasks.workunit.client.0.smithi019.stdout:9/418: dwrite dd/d10/d17/d23/d37/f5b [0,4194304] 0 2024-09-12T22:33:14.683 INFO:tasks.workunit.client.0.smithi019.stdout:6/454: write d1b/d26/d39/d6a/f92 [861373,1574] 0 2024-09-12T22:33:14.683 INFO:tasks.workunit.client.0.smithi019.stdout:0/400: chown d1/d1f/d5b/d73 39602593 1 2024-09-12T22:33:14.683 INFO:tasks.workunit.client.0.smithi019.stdout:5/541: dwrite d0/d7/f1f [0,4194304] 0 2024-09-12T22:33:14.683 INFO:tasks.workunit.client.0.smithi019.stdout:0/401: creat d1/d1f/f77 x:0 0 0 2024-09-12T22:33:14.683 INFO:tasks.workunit.client.0.smithi019.stdout:6/455: rename d1b/l30 to d1b/d26/d27/d67/d77/la2 0 2024-09-12T22:33:14.684 INFO:tasks.workunit.client.0.smithi019.stdout:3/350: dwrite dd/d1e/d5a/f64 [0,4194304] 0 2024-09-12T22:33:14.684 INFO:tasks.workunit.client.0.smithi019.stdout:0/402: chown d1/d14/d26/d40/d45/c6f 380492 1 2024-09-12T22:33:14.684 INFO:tasks.workunit.client.0.smithi019.stdout:3/351: stat dd/d1e/d5a/f64 0 2024-09-12T22:33:14.684 INFO:tasks.workunit.client.0.smithi019.stdout:0/403: fsync d1/d14/f4e 0 2024-09-12T22:33:14.684 INFO:tasks.workunit.client.0.smithi019.stdout:6/456: creat d1b/d26/d27/d67/d77/d95/fa3 x:0 0 0 2024-09-12T22:33:14.684 INFO:tasks.workunit.client.0.smithi019.stdout:5/542: rename d0/d7/d3c to d0/d7/d2d/d32/d36/d8c/db8/d39/d38/dba 0 2024-09-12T22:33:14.684 INFO:tasks.workunit.client.0.smithi019.stdout:6/457: unlink cf 0 2024-09-12T22:33:14.684 INFO:tasks.workunit.client.0.smithi019.stdout:3/352: unlink dd/d1e/c45 0 2024-09-12T22:33:14.684 INFO:tasks.workunit.client.0.smithi019.stdout:5/543: mkdir d0/d7/d2d/d32/d4a/dbb 0 2024-09-12T22:33:14.684 INFO:tasks.workunit.client.0.smithi019.stdout:6/458: symlink d1b/d26/d27/d67/d77/d7b/la4 0 2024-09-12T22:33:14.684 INFO:tasks.workunit.client.0.smithi019.stdout:3/353: rename dd/d1e/f61 to dd/d12/f65 0 2024-09-12T22:33:14.684 INFO:tasks.workunit.client.0.smithi019.stdout:3/354: chown l6 2125031194 1 2024-09-12T22:33:14.684 INFO:tasks.workunit.client.0.smithi019.stdout:6/459: rename d1b/d26/d27/f2f to d1b/d26/d27/d3e/d83/d98/fa5 0 2024-09-12T22:33:14.685 INFO:tasks.workunit.client.0.smithi019.stdout:4/385: write d1/d4/f13 [629564,61085] 0 2024-09-12T22:33:14.685 INFO:tasks.workunit.client.0.smithi019.stdout:4/386: chown d1/d4/d44/f74 5242 1 2024-09-12T22:33:14.685 INFO:tasks.workunit.client.0.smithi019.stdout:3/355: fdatasync dd/f20 0 2024-09-12T22:33:14.685 INFO:tasks.workunit.client.0.smithi019.stdout:6/460: unlink d1b/d26/d39/d6a/f9e 0 2024-09-12T22:33:14.685 INFO:tasks.workunit.client.0.smithi019.stdout:5/544: rename d0/d7/d16/d18/f9e to d0/d7/d2d/d32/d36/d8c/db8/fbc 0 2024-09-12T22:33:14.685 INFO:tasks.workunit.client.0.smithi019.stdout:6/461: write d1b/d26/d27/d67/d77/d7b/f8c [9278855,13748] 0 2024-09-12T22:33:14.685 INFO:tasks.workunit.client.0.smithi019.stdout:3/356: read dd/d12/f29 [132364,61709] 0 2024-09-12T22:33:14.685 INFO:tasks.workunit.client.0.smithi019.stdout:9/419: dwrite dd/d10/d17/d22/d42/f55 [4194304,4194304] 0 2024-09-12T22:33:14.685 INFO:tasks.workunit.client.0.smithi019.stdout:8/381: dread d7/d34/d78/f20 [4194304,4194304] 0 2024-09-12T22:33:14.685 INFO:tasks.workunit.client.0.smithi019.stdout:9/420: mkdir dd/d10/d17/d23/d82/d87 0 2024-09-12T22:33:14.685 INFO:tasks.workunit.client.0.smithi019.stdout:9/421: stat dd/d10/d17/d22/c29 0 2024-09-12T22:33:14.685 INFO:tasks.workunit.client.0.smithi019.stdout:8/382: write d7/d34/d78/f20 [2076219,42267] 0 2024-09-12T22:33:14.685 INFO:tasks.workunit.client.0.smithi019.stdout:8/383: dread - d7/f6f zero size 2024-09-12T22:33:14.685 INFO:tasks.workunit.client.0.smithi019.stdout:2/405: sync 2024-09-12T22:33:14.686 INFO:tasks.workunit.client.0.smithi019.stdout:7/361: sync 2024-09-12T22:33:14.686 INFO:tasks.workunit.client.0.smithi019.stdout:8/384: symlink d7/d8/dd/d4f/l7b 0 2024-09-12T22:33:14.686 INFO:tasks.workunit.client.0.smithi019.stdout:2/406: read - d0/d5/d60/d74/d7e/f87 zero size 2024-09-12T22:33:14.686 INFO:tasks.workunit.client.0.smithi019.stdout:8/385: chown d7/d34/f38 6736462 1 2024-09-12T22:33:14.686 INFO:tasks.workunit.client.0.smithi019.stdout:8/386: write d7/f2c [1417643,72903] 0 2024-09-12T22:33:14.686 INFO:tasks.workunit.client.0.smithi019.stdout:2/407: symlink d0/d5/d18/d5c/d63/l88 0 2024-09-12T22:33:14.686 INFO:tasks.workunit.client.0.smithi019.stdout:4/387: write d1/d4/d38/f5e [1262857,8030] 0 2024-09-12T22:33:14.686 INFO:tasks.workunit.client.0.smithi019.stdout:8/387: readlink d7/d34/d78/d2d/l4d 0 2024-09-12T22:33:14.686 INFO:tasks.workunit.client.0.smithi019.stdout:8/388: unlink d7/d34/d78/f1a 0 2024-09-12T22:33:14.686 INFO:tasks.workunit.client.0.smithi019.stdout:5/545: dwrite d0/d7/f1c [0,4194304] 0 2024-09-12T22:33:14.686 INFO:tasks.workunit.client.0.smithi019.stdout:8/389: dread f0 [0,4194304] 0 2024-09-12T22:33:14.686 INFO:tasks.workunit.client.0.smithi019.stdout:5/546: getdents d0/d7/d2d 0 2024-09-12T22:33:14.686 INFO:tasks.workunit.client.0.smithi019.stdout:4/388: dwrite d1/d11/d15/d1f/f52 [4194304,4194304] 0 2024-09-12T22:33:14.687 INFO:tasks.workunit.client.0.smithi019.stdout:8/390: truncate d7/d34/f52 1386234 0 2024-09-12T22:33:14.687 INFO:tasks.workunit.client.0.smithi019.stdout:4/389: write d1/d22/f68 [935782,73889] 0 2024-09-12T22:33:14.687 INFO:tasks.workunit.client.0.smithi019.stdout:4/390: write d1/d11/d15/f2e [1871844,24268] 0 2024-09-12T22:33:14.687 INFO:tasks.workunit.client.0.smithi019.stdout:4/391: truncate d1/d8/fb 5874914 0 2024-09-12T22:33:14.687 INFO:tasks.workunit.client.0.smithi019.stdout:4/392: link d1/d22/d26/f29 d1/d11/d15/f78 0 2024-09-12T22:33:14.687 INFO:tasks.workunit.client.0.smithi019.stdout:4/393: mkdir d1/d11/d15/d65/d75/d5a/d79 0 2024-09-12T22:33:14.687 INFO:tasks.workunit.client.0.smithi019.stdout:0/404: dread d1/d14/d32/f6e [0,4194304] 0 2024-09-12T22:33:14.687 INFO:tasks.workunit.client.0.smithi019.stdout:3/357: dread dd/d1e/d40/f4a [0,4194304] 0 2024-09-12T22:33:14.687 INFO:tasks.workunit.client.0.smithi019.stdout:0/405: mknod d1/d14/d32/c78 0 2024-09-12T22:33:14.687 INFO:tasks.workunit.client.0.smithi019.stdout:4/394: dwrite d1/d22/f33 [0,4194304] 0 2024-09-12T22:33:14.687 INFO:tasks.workunit.client.0.smithi019.stdout:9/422: sync 2024-09-12T22:33:14.687 INFO:tasks.workunit.client.0.smithi019.stdout:1/508: sync 2024-09-12T22:33:14.687 INFO:tasks.workunit.client.0.smithi019.stdout:5/547: sync 2024-09-12T22:33:14.687 INFO:tasks.workunit.client.0.smithi019.stdout:3/358: creat dd/d1e/d40/d5f/f66 x:0 0 0 2024-09-12T22:33:14.688 INFO:tasks.workunit.client.0.smithi019.stdout:0/406: mknod d1/d14/d32/d71/c79 0 2024-09-12T22:33:14.688 INFO:tasks.workunit.client.0.smithi019.stdout:1/509: chown d3/d11/c4c 342448 1 2024-09-12T22:33:14.688 INFO:tasks.workunit.client.0.smithi019.stdout:4/395: rename d1/l17 to d1/d11/d15/d65/l7a 0 2024-09-12T22:33:14.688 INFO:tasks.workunit.client.0.smithi019.stdout:4/396: mkdir d1/d8/d7b 0 2024-09-12T22:33:14.688 INFO:tasks.workunit.client.0.smithi019.stdout:1/510: read - d3/d3f/d58/f93 zero size 2024-09-12T22:33:14.688 INFO:tasks.workunit.client.0.smithi019.stdout:8/391: read d7/d8/dd/d4f/f4b [3929871,73059] 0 2024-09-12T22:33:14.688 INFO:tasks.workunit.client.0.smithi019.stdout:0/407: write d1/f4d [465191,626] 0 2024-09-12T22:33:14.688 INFO:tasks.workunit.client.0.smithi019.stdout:4/397: write d1/f25 [1490249,89458] 0 2024-09-12T22:33:14.688 INFO:tasks.workunit.client.0.smithi019.stdout:9/423: dread dd/d10/d17/d23/d2e/d31/d64/f66 [0,4194304] 0 2024-09-12T22:33:14.688 INFO:tasks.workunit.client.0.smithi019.stdout:1/511: rename d3/d11/d16/d23 to d3/d6e/da9 0 2024-09-12T22:33:14.688 INFO:tasks.workunit.client.0.smithi019.stdout:8/392: fdatasync d7/d8/dd/f21 0 2024-09-12T22:33:14.691 INFO:tasks.workunit.client.0.smithi019.stdout:4/398: fsync d1/d11/d15/f78 0 2024-09-12T22:33:14.691 INFO:tasks.workunit.client.0.smithi019.stdout:3/359: dwrite dd/d12/f55 [0,4194304] 0 2024-09-12T22:33:14.691 INFO:tasks.workunit.client.0.smithi019.stdout:0/408: rename d1/d14/d1b/l31 to d1/d1f/d5b/l7a 0 2024-09-12T22:33:14.691 INFO:tasks.workunit.client.0.smithi019.stdout:9/424: symlink dd/d10/d17/d22/d77/l88 0 2024-09-12T22:33:14.691 INFO:tasks.workunit.client.0.smithi019.stdout:8/393: chown d7/d34/d78/d54/f71 143448 1 2024-09-12T22:33:14.691 INFO:tasks.workunit.client.0.smithi019.stdout:4/399: creat d1/d22/d26/f7c x:0 0 0 2024-09-12T22:33:14.691 INFO:tasks.workunit.client.0.smithi019.stdout:3/360: write dd/d1e/f37 [5199636,116141] 0 2024-09-12T22:33:14.691 INFO:tasks.workunit.client.0.smithi019.stdout:9/425: write dd/d10/d6b/f81 [49172,51560] 0 2024-09-12T22:33:14.691 INFO:tasks.workunit.client.0.smithi019.stdout:8/394: write d7/d2f/d42/f49 [3228404,44483] 0 2024-09-12T22:33:14.691 INFO:tasks.workunit.client.0.smithi019.stdout:4/400: creat d1/d11/d15/d65/d75/d5a/d79/f7d x:0 0 0 2024-09-12T22:33:14.691 INFO:tasks.workunit.client.0.smithi019.stdout:3/361: read - dd/d12/f65 zero size 2024-09-12T22:33:14.691 INFO:tasks.workunit.client.0.smithi019.stdout:8/395: chown d7/d5e/f60 411069808 1 2024-09-12T22:33:14.692 INFO:tasks.workunit.client.0.smithi019.stdout:1/512: dwrite d3/d11/d16/f38 [0,4194304] 0 2024-09-12T22:33:14.692 INFO:tasks.workunit.client.0.smithi019.stdout:4/401: write d1/d4/d44/f74 [246008,105152] 0 2024-09-12T22:33:14.692 INFO:tasks.workunit.client.0.smithi019.stdout:0/409: dwrite d1/f4d [0,4194304] 0 2024-09-12T22:33:14.692 INFO:tasks.workunit.client.0.smithi019.stdout:1/513: symlink d3/d1b/laa 0 2024-09-12T22:33:14.692 INFO:tasks.workunit.client.0.smithi019.stdout:4/402: mkdir d1/d11/d15/d1f/d56/d6b/d7e 0 2024-09-12T22:33:14.692 INFO:tasks.workunit.client.0.smithi019.stdout:0/410: mknod d1/d14/d1b/c7b 0 2024-09-12T22:33:14.692 INFO:tasks.workunit.client.0.smithi019.stdout:1/514: creat d3/df/d7e/d90/fab x:0 0 0 2024-09-12T22:33:14.692 INFO:tasks.workunit.client.0.smithi019.stdout:4/403: fsync d1/d22/d26/f43 0 2024-09-12T22:33:14.692 INFO:tasks.workunit.client.0.smithi019.stdout:1/515: chown d3/df/d7e/ca2 511643 1 2024-09-12T22:33:14.692 INFO:tasks.workunit.client.0.smithi019.stdout:0/411: chown d1/d1f/l2d 20584426 1 2024-09-12T22:33:14.692 INFO:tasks.workunit.client.0.smithi019.stdout:1/516: readlink d3/l92 0 2024-09-12T22:33:14.692 INFO:tasks.workunit.client.0.smithi019.stdout:4/404: rename d1/d4/d44/c47 to d1/d8/c7f 0 2024-09-12T22:33:14.693 INFO:tasks.workunit.client.0.smithi019.stdout:0/412: mknod d1/d51/d67/c7c 0 2024-09-12T22:33:14.693 INFO:tasks.workunit.client.0.smithi019.stdout:1/517: creat d3/d11/d16/d3c/fac x:0 0 0 2024-09-12T22:33:14.694 INFO:tasks.workunit.client.0.smithi019.stdout:4/405: mknod d1/d11/d15/d65/d75/d5a/c80 0 2024-09-12T22:33:14.694 INFO:tasks.workunit.client.0.smithi019.stdout:0/413: write d1/d14/f1e [4207687,28031] 0 2024-09-12T22:33:14.694 INFO:tasks.workunit.client.0.smithi019.stdout:5/548: dread d0/d7/d2d/d32/d36/d8c/db8/d39/d38/f6e [0,4194304] 0 2024-09-12T22:33:14.694 INFO:tasks.workunit.client.0.smithi019.stdout:1/518: symlink d3/d11/d63/d76/d91/lad 0 2024-09-12T22:33:14.694 INFO:tasks.workunit.client.0.smithi019.stdout:4/406: fsync d1/d11/d15/d65/d75/f59 0 2024-09-12T22:33:14.694 INFO:tasks.workunit.client.0.smithi019.stdout:6/462: dread d1b/d26/d39/f65 [0,4194304] 0 2024-09-12T22:33:14.694 INFO:tasks.workunit.client.0.smithi019.stdout:5/549: creat d0/db9/fbd x:0 0 0 2024-09-12T22:33:14.694 INFO:tasks.workunit.client.0.smithi019.stdout:7/362: dread d6/d14/d15/f22 [0,4194304] 0 2024-09-12T22:33:14.695 INFO:tasks.workunit.client.0.smithi019.stdout:0/414: dread - d1/d14/d26/d40/d45/d5e/f68 zero size 2024-09-12T22:33:14.695 INFO:tasks.workunit.client.0.smithi019.stdout:7/363: dread - d6/d14/d15/d62/f86 zero size 2024-09-12T22:33:14.695 INFO:tasks.workunit.client.0.smithi019.stdout:6/463: creat d1b/d26/d39/d6a/d97/fa6 x:0 0 0 2024-09-12T22:33:14.696 INFO:tasks.workunit.client.0.smithi019.stdout:7/364: readlink d6/d14/l58 0 2024-09-12T22:33:14.696 INFO:tasks.workunit.client.0.smithi019.stdout:0/415: unlink d1/d14/d1b/d3a/c3b 0 2024-09-12T22:33:14.697 INFO:tasks.workunit.client.0.smithi019.stdout:7/365: mknod d6/d2d/d3d/d84/c8a 0 2024-09-12T22:33:14.697 INFO:tasks.workunit.client.0.smithi019.stdout:6/464: symlink d1b/d26/d27/d67/d77/la7 0 2024-09-12T22:33:14.697 INFO:tasks.workunit.client.0.smithi019.stdout:0/416: rename d1/d14/l3f to d1/d1f/d5b/l7d 0 2024-09-12T22:33:14.698 INFO:tasks.workunit.client.0.smithi019.stdout:4/407: read d1/d22/d57/f6e [140383,96920] 0 2024-09-12T22:33:14.699 INFO:tasks.workunit.client.0.smithi019.stdout:7/366: mkdir d6/d14/d15/d8b 0 2024-09-12T22:33:14.699 INFO:tasks.workunit.client.0.smithi019.stdout:6/465: unlink d1b/d26/d27/d67/f71 0 2024-09-12T22:33:14.699 INFO:tasks.workunit.client.0.smithi019.stdout:1/519: dwrite d3/df/f41 [0,4194304] 0 2024-09-12T22:33:14.699 INFO:tasks.workunit.client.0.smithi019.stdout:4/408: unlink d1/l7 0 2024-09-12T22:33:14.699 INFO:tasks.workunit.client.0.smithi019.stdout:2/408: dread d0/d5/d18/d3b/f3f [0,4194304] 0 2024-09-12T22:33:14.700 INFO:tasks.workunit.client.0.smithi019.stdout:1/520: write d3/f14 [257073,45450] 0 2024-09-12T22:33:14.700 INFO:tasks.workunit.client.0.smithi019.stdout:7/367: unlink d6/db/dc/d63/f4e 0 2024-09-12T22:33:14.701 INFO:tasks.workunit.client.0.smithi019.stdout:6/466: chown d1b/d26/d27/d67/d77/d95/la1 0 1 2024-09-12T22:33:14.701 INFO:tasks.workunit.client.0.smithi019.stdout:2/409: creat d0/d5/d18/d39/f89 x:0 0 0 2024-09-12T22:33:14.701 INFO:tasks.workunit.client.0.smithi019.stdout:4/409: write d1/d22/d2c/f6d [327413,9405] 0 2024-09-12T22:33:14.701 INFO:tasks.workunit.client.0.smithi019.stdout:7/368: chown d6/db/f49 50271 1 2024-09-12T22:33:14.702 INFO:tasks.workunit.client.0.smithi019.stdout:1/521: chown d3/d6e/da9/f71 51 1 2024-09-12T22:33:14.702 INFO:tasks.workunit.client.0.smithi019.stdout:4/410: mkdir d1/d11/d15/d81 0 2024-09-12T22:33:14.702 INFO:tasks.workunit.client.0.smithi019.stdout:7/369: rename d6/db/dc/d63/l5b to d6/d2d/d41/l8c 0 2024-09-12T22:33:14.704 INFO:tasks.workunit.client.0.smithi019.stdout:4/411: mknod d1/d11/d15/d65/c82 0 2024-09-12T22:33:14.704 INFO:tasks.workunit.client.0.smithi019.stdout:3/362: write dd/f11 [9351561,73773] 0 2024-09-12T22:33:14.704 INFO:tasks.workunit.client.0.smithi019.stdout:7/370: write d6/db/dc/d63/d4b/f6f [511536,75642] 0 2024-09-12T22:33:14.706 INFO:tasks.workunit.client.0.smithi019.stdout:7/371: chown d6/f5f 0 1 2024-09-12T22:33:14.706 INFO:tasks.workunit.client.0.smithi019.stdout:4/412: creat d1/d4/d38/f83 x:0 0 0 2024-09-12T22:33:14.706 INFO:tasks.workunit.client.0.smithi019.stdout:3/363: fdatasync dd/d1e/f23 0 2024-09-12T22:33:14.707 INFO:tasks.workunit.client.0.smithi019.stdout:6/467: dwrite d1b/f6e [0,4194304] 0 2024-09-12T22:33:14.707 INFO:tasks.workunit.client.0.smithi019.stdout:2/410: dwrite d0/d5/d18/d1b/f4b [0,4194304] 0 2024-09-12T22:33:14.708 INFO:tasks.workunit.client.0.smithi019.stdout:0/417: write d1/d14/d26/f50 [1778729,75826] 0 2024-09-12T22:33:14.708 INFO:tasks.workunit.client.0.smithi019.stdout:3/364: write dd/f4d [225110,51560] 0 2024-09-12T22:33:14.710 INFO:tasks.workunit.client.0.smithi019.stdout:6/468: write d1b/d26/d27/d3e/f79 [4809109,111361] 0 2024-09-12T22:33:14.710 INFO:tasks.workunit.client.0.smithi019.stdout:4/413: getdents d1/d4/d44 0 2024-09-12T22:33:14.710 INFO:tasks.workunit.client.0.smithi019.stdout:0/418: chown d1/d14/d32/c78 507354576 1 2024-09-12T22:33:14.711 INFO:tasks.workunit.client.0.smithi019.stdout:2/411: creat d0/d5/d18/d3b/f8a x:0 0 0 2024-09-12T22:33:14.711 INFO:tasks.workunit.client.0.smithi019.stdout:3/365: write dd/f46 [8058892,33715] 0 2024-09-12T22:33:14.713 INFO:tasks.workunit.client.0.smithi019.stdout:6/469: mkdir d1b/d26/d31/d5f/da8 0 2024-09-12T22:33:14.713 INFO:tasks.workunit.client.0.smithi019.stdout:4/414: creat d1/d11/d15/d1f/f84 x:0 0 0 2024-09-12T22:33:14.714 INFO:tasks.workunit.client.0.smithi019.stdout:2/412: mknod d0/d5/d17/c8b 0 2024-09-12T22:33:14.714 INFO:tasks.workunit.client.0.smithi019.stdout:4/415: chown d1/d4/d38 0 1 2024-09-12T22:33:14.714 INFO:tasks.workunit.client.0.smithi019.stdout:9/426: sync 2024-09-12T22:33:14.714 INFO:tasks.workunit.client.0.smithi019.stdout:2/413: creat d0/d5/f8c x:0 0 0 2024-09-12T22:33:14.714 INFO:tasks.workunit.client.0.smithi019.stdout:4/416: write d1/d4c/f72 [550221,77390] 0 2024-09-12T22:33:14.715 INFO:tasks.workunit.client.0.smithi019.stdout:9/427: fsync dd/d10/d17/d23/d2e/d31/d64/f66 0 2024-09-12T22:33:14.715 INFO:tasks.workunit.client.0.smithi019.stdout:4/417: fsync d1/d11/d15/d65/d75/f59 0 2024-09-12T22:33:14.716 INFO:tasks.workunit.client.0.smithi019.stdout:3/366: dwrite dd/d1e/f25 [0,4194304] 0 2024-09-12T22:33:14.717 INFO:tasks.workunit.client.0.smithi019.stdout:4/418: mkdir d1/d22/d31/d85 0 2024-09-12T22:33:14.717 INFO:tasks.workunit.client.0.smithi019.stdout:7/372: dread d6/d14/d15/f28 [0,4194304] 0 2024-09-12T22:33:14.717 INFO:tasks.workunit.client.0.smithi019.stdout:9/428: write dd/d10/d17/d23/d2e/d31/f6d [113762,17664] 0 2024-09-12T22:33:14.717 INFO:tasks.workunit.client.0.smithi019.stdout:6/470: dwrite d1b/d2d/f42 [0,4194304] 0 2024-09-12T22:33:14.718 INFO:tasks.workunit.client.0.smithi019.stdout:5/550: dread d0/d7/d16/f45 [0,4194304] 0 2024-09-12T22:33:14.718 INFO:tasks.workunit.client.0.smithi019.stdout:3/367: stat dd/f2a 0 2024-09-12T22:33:14.719 INFO:tasks.workunit.client.0.smithi019.stdout:9/429: chown dd/d10/d17/d22/d6c/c70 61941006 1 2024-09-12T22:33:14.719 INFO:tasks.workunit.client.0.smithi019.stdout:0/419: truncate d1/d14/d26/f50 590655 0 2024-09-12T22:33:14.721 INFO:tasks.workunit.client.0.smithi019.stdout:5/551: readlink d0/d7/d2d/d32/d36/l8e 0 2024-09-12T22:33:14.721 INFO:tasks.workunit.client.0.smithi019.stdout:9/430: stat dd/d10/d17/d23/d2e/d31/c63 0 2024-09-12T22:33:14.721 INFO:tasks.workunit.client.0.smithi019.stdout:3/368: link dd/d12/f29 dd/d1e/f67 0 2024-09-12T22:33:14.722 INFO:tasks.workunit.client.0.smithi019.stdout:0/420: chown d1/d14/d1b/c20 203562 1 2024-09-12T22:33:14.722 INFO:tasks.workunit.client.0.smithi019.stdout:3/369: chown dd/d1e/d40/d5f 11534598 1 2024-09-12T22:33:14.723 INFO:tasks.workunit.client.0.smithi019.stdout:1/522: sync 2024-09-12T22:33:14.723 INFO:tasks.workunit.client.0.smithi019.stdout:2/414: sync 2024-09-12T22:33:14.723 INFO:tasks.workunit.client.0.smithi019.stdout:0/421: mknod d1/d14/d26/d40/c7e 0 2024-09-12T22:33:14.723 INFO:tasks.workunit.client.0.smithi019.stdout:2/415: chown d0/d5/d18/d39 1 1 2024-09-12T22:33:14.723 INFO:tasks.workunit.client.0.smithi019.stdout:0/422: stat d1/c11 0 2024-09-12T22:33:14.724 INFO:tasks.workunit.client.0.smithi019.stdout:7/373: dwrite d6/d14/d15/f1b [4194304,4194304] 0 2024-09-12T22:33:14.724 INFO:tasks.workunit.client.0.smithi019.stdout:1/523: chown d3/d11/d63/d76/f8a 1133 1 2024-09-12T22:33:14.725 INFO:tasks.workunit.client.0.smithi019.stdout:1/524: stat d3/l4a 0 2024-09-12T22:33:14.725 INFO:tasks.workunit.client.0.smithi019.stdout:0/423: write d1/d1f/d5b/f72 [231462,26176] 0 2024-09-12T22:33:14.726 INFO:tasks.workunit.client.0.smithi019.stdout:2/416: chown d0/d5/d18/d1b/d36/c47 126014 1 2024-09-12T22:33:14.726 INFO:tasks.workunit.client.0.smithi019.stdout:7/374: creat d6/db/dc/f8d x:0 0 0 2024-09-12T22:33:14.727 INFO:tasks.workunit.client.0.smithi019.stdout:1/525: dread - d3/df/d7e/d90/fab zero size 2024-09-12T22:33:14.728 INFO:tasks.workunit.client.0.smithi019.stdout:1/526: readlink d3/d11/l8d 0 2024-09-12T22:33:14.729 INFO:tasks.workunit.client.0.smithi019.stdout:5/552: dwrite d0/f37 [0,4194304] 0 2024-09-12T22:33:14.729 INFO:tasks.workunit.client.0.smithi019.stdout:7/375: write d6/d14/d15/f24 [1683592,77831] 0 2024-09-12T22:33:14.729 INFO:tasks.workunit.client.0.smithi019.stdout:5/553: sync 2024-09-12T22:33:14.731 INFO:tasks.workunit.client.0.smithi019.stdout:3/370: dwrite dd/d1e/d5a/f64 [4194304,4194304] 0 2024-09-12T22:33:14.731 INFO:tasks.workunit.client.0.smithi019.stdout:2/417: mkdir d0/d5/d18/d1b/d8d 0 2024-09-12T22:33:14.731 INFO:tasks.workunit.client.0.smithi019.stdout:0/424: dread d1/d14/d26/d40/d45/f54 [0,4194304] 0 2024-09-12T22:33:14.732 INFO:tasks.workunit.client.0.smithi019.stdout:3/371: readlink dd/d1e/l2b 0 2024-09-12T22:33:14.732 INFO:tasks.workunit.client.0.smithi019.stdout:0/425: stat d1/d51/f56 0 2024-09-12T22:33:14.733 INFO:tasks.workunit.client.0.smithi019.stdout:5/554: link d0/d7/d2d/d32/d36/d6a/da0/fb7 d0/d7/d16/d18/fbe 0 2024-09-12T22:33:14.733 INFO:tasks.workunit.client.0.smithi019.stdout:2/418: mknod d0/d5/d18/d1b/c8e 0 2024-09-12T22:33:14.734 INFO:tasks.workunit.client.0.smithi019.stdout:3/372: unlink dd/d1e/d40/f47 0 2024-09-12T22:33:14.735 INFO:tasks.workunit.client.0.smithi019.stdout:0/426: getdents d1/d14 0 2024-09-12T22:33:14.735 INFO:tasks.workunit.client.0.smithi019.stdout:3/373: fsync dd/d1e/d5a/f60 0 2024-09-12T22:33:14.736 INFO:tasks.workunit.client.0.smithi019.stdout:0/427: fsync d1/d51/f6c 0 2024-09-12T22:33:14.737 INFO:tasks.workunit.client.0.smithi019.stdout:1/527: dwrite d3/df/f41 [0,4194304] 0 2024-09-12T22:33:14.738 INFO:tasks.workunit.client.0.smithi019.stdout:5/555: rename d0/d7/d2d/d32/d36/cb2 to d0/d7/d2d/d32/d36/d8c/db8/d39/d38/cbf 0 2024-09-12T22:33:14.738 INFO:tasks.workunit.client.0.smithi019.stdout:1/528: read d3/d11/d16/f38 [275636,53838] 0 2024-09-12T22:33:14.740 INFO:tasks.workunit.client.0.smithi019.stdout:0/428: getdents d1/d14/d32 0 2024-09-12T22:33:14.740 INFO:tasks.workunit.client.0.smithi019.stdout:9/431: dread dd/d10/f4c [0,4194304] 0 2024-09-12T22:33:14.742 INFO:tasks.workunit.client.0.smithi019.stdout:5/556: creat d0/d7/d2d/d32/d36/d8c/db8/d24/d64/fc0 x:0 0 0 2024-09-12T22:33:14.742 INFO:tasks.workunit.client.0.smithi019.stdout:2/419: dwrite d0/d5/d18/d1b/d5d/d86/f61 [0,4194304] 0 2024-09-12T22:33:14.743 INFO:tasks.workunit.client.0.smithi019.stdout:3/374: dwrite dd/d1e/f23 [0,4194304] 0 2024-09-12T22:33:14.745 INFO:tasks.workunit.client.0.smithi019.stdout:2/420: mknod d0/d5/d18/d5c/d67/d77/c8f 0 2024-09-12T22:33:14.746 INFO:tasks.workunit.client.0.smithi019.stdout:0/429: read d1/d14/d1b/f2e [1179873,45589] 0 2024-09-12T22:33:14.748 INFO:tasks.workunit.client.0.smithi019.stdout:2/421: mkdir d0/d5/d18/d1b/d5d/d86/d90 0 2024-09-12T22:33:14.748 INFO:tasks.workunit.client.0.smithi019.stdout:0/430: unlink d1/l62 0 2024-09-12T22:33:14.748 INFO:tasks.workunit.client.0.smithi019.stdout:9/432: dwrite dd/d10/d6b/f81 [0,4194304] 0 2024-09-12T22:33:14.749 INFO:tasks.workunit.client.0.smithi019.stdout:2/422: mkdir d0/d5/d17/d91 0 2024-09-12T22:33:14.749 INFO:tasks.workunit.client.0.smithi019.stdout:6/471: fsync d1b/d2d/f42 0 2024-09-12T22:33:14.749 INFO:tasks.workunit.client.0.smithi019.stdout:7/376: write d6/d14/d45/f5d [185846,110401] 0 2024-09-12T22:33:14.750 INFO:tasks.workunit.client.0.smithi019.stdout:1/529: read d3/f14 [1153087,91582] 0 2024-09-12T22:33:14.750 INFO:tasks.workunit.client.0.smithi019.stdout:5/557: dwrite d0/f2 [0,4194304] 0 2024-09-12T22:33:14.750 INFO:tasks.workunit.client.0.smithi019.stdout:0/431: rename d1/d14/d26/d40/l6d to d1/d1f/l7f 0 2024-09-12T22:33:14.751 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:14.750+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:14.751 INFO:tasks.workunit.client.0.smithi019.stdout:7/377: chown d6/db/f1c 3049 1 2024-09-12T22:33:14.752 INFO:tasks.workunit.client.0.smithi019.stdout:1/530: fdatasync d3/d11/d16/d3c/d55/f62 0 2024-09-12T22:33:14.752 INFO:tasks.workunit.client.0.smithi019.stdout:0/432: mknod d1/d1d/c80 0 2024-09-12T22:33:14.752 INFO:tasks.workunit.client.0.smithi019.stdout:2/423: getdents d0/d5/d18/d1b/d8d 0 2024-09-12T22:33:14.752 INFO:tasks.workunit.client.0.smithi019.stdout:9/433: rename dd/d10/f19 to dd/d10/d17/d23/d2e/d31/d3f/d47/d6e/f89 0 2024-09-12T22:33:14.753 INFO:tasks.workunit.client.0.smithi019.stdout:6/472: getdents d1b/d26/d27/d67/d77 0 2024-09-12T22:33:14.753 INFO:tasks.workunit.client.0.smithi019.stdout:1/531: fsync d3/d1b/f68 0 2024-09-12T22:33:14.753 INFO:tasks.workunit.client.0.smithi019.stdout:2/424: readlink d0/d5/d18/d5c/d63/l88 0 2024-09-12T22:33:14.754 INFO:tasks.workunit.client.0.smithi019.stdout:5/558: creat d0/d7/d2d/d32/d36/d8c/db8/d39/fc1 x:0 0 0 2024-09-12T22:33:14.754 INFO:tasks.workunit.client.0.smithi019.stdout:0/433: write d1/d1f/f77 [536163,23829] 0 2024-09-12T22:33:14.754 INFO:tasks.workunit.client.0.smithi019.stdout:7/378: truncate d6/d14/d15/d62/f86 965744 0 2024-09-12T22:33:14.754 INFO:tasks.workunit.client.0.smithi019.stdout:6/473: dread - d1b/f5d zero size 2024-09-12T22:33:14.754 INFO:tasks.workunit.client.0.smithi019.stdout:5/559: readlink d0/d7/d2d/l4d 0 2024-09-12T22:33:14.755 INFO:tasks.workunit.client.0.smithi019.stdout:9/434: rename dd/f1f to dd/d10/d17/d23/d2e/d31/d3f/d47/d6e/f8a 0 2024-09-12T22:33:14.755 INFO:tasks.workunit.client.0.smithi019.stdout:7/379: mkdir d6/d2d/d77/d8e 0 2024-09-12T22:33:14.755 INFO:tasks.workunit.client.0.smithi019.stdout:6/474: mknod d1b/d26/d27/d67/d77/d95/ca9 0 2024-09-12T22:33:14.756 INFO:tasks.workunit.client.0.smithi019.stdout:5/560: write d0/db9/fbd [179643,31401] 0 2024-09-12T22:33:14.756 INFO:tasks.workunit.client.0.smithi019.stdout:7/380: rmdir d6/db/d34 39 2024-09-12T22:33:14.756 INFO:tasks.workunit.client.0.smithi019.stdout:0/434: link d1/d14/d32/c48 d1/d14/d26/c81 0 2024-09-12T22:33:14.756 INFO:tasks.workunit.client.0.smithi019.stdout:9/435: mkdir dd/d10/d17/d23/d2e/d31/d54/d8b 0 2024-09-12T22:33:14.758 INFO:tasks.workunit.client.0.smithi019.stdout:5/561: unlink d0/d7/d2d/f5e 0 2024-09-12T22:33:14.760 INFO:tasks.workunit.client.0.smithi019.stdout:6/475: truncate d1b/d26/d27/d3e/f64 785423 0 2024-09-12T22:33:14.761 INFO:tasks.workunit.client.0.smithi019.stdout:2/425: dwrite d0/d5/d60/d74/d7e/f87 [0,4194304] 0 2024-09-12T22:33:14.762 INFO:tasks.workunit.client.0.smithi019.stdout:9/436: chown dd/d10/d17/d23/d2e/d31/d3f/d47/d6e/l6f 961998 1 2024-09-12T22:33:14.762 INFO:tasks.workunit.client.0.smithi019.stdout:1/532: dwrite d3/d11/d16/f3b [4194304,4194304] 0 2024-09-12T22:33:14.762 INFO:tasks.workunit.client.0.smithi019.stdout:6/476: chown d1b/d26/d39/f53 4167238 1 2024-09-12T22:33:14.763 INFO:tasks.workunit.client.0.smithi019.stdout:0/435: dread d1/f4d [0,4194304] 0 2024-09-12T22:33:14.763 INFO:tasks.workunit.client.0.smithi019.stdout:9/437: stat dd/d10/d17/d23/d2e/d31/d64/f71 0 2024-09-12T22:33:14.764 INFO:tasks.workunit.client.0.smithi019.stdout:2/426: rename d0/d5/f8c to d0/d5/d18/d1b/d8d/f92 0 2024-09-12T22:33:14.764 INFO:tasks.workunit.client.0.smithi019.stdout:6/477: mknod d1b/d26/d27/d67/caa 0 2024-09-12T22:33:14.765 INFO:tasks.workunit.client.0.smithi019.stdout:2/427: rmdir d0/d5/d18/d1b/d5d 39 2024-09-12T22:33:14.765 INFO:tasks.workunit.client.0.smithi019.stdout:6/478: rename c1a to d1b/d26/d31/d5f/cab 0 2024-09-12T22:33:14.768 INFO:tasks.workunit.client.0.smithi019.stdout:9/438: dwrite dd/d10/d17/d23/d37/f5a [0,4194304] 0 2024-09-12T22:33:14.770 INFO:tasks.workunit.client.0.smithi019.stdout:9/439: creat dd/d10/d17/d23/d2e/d31/d7e/f8c x:0 0 0 2024-09-12T22:33:14.771 INFO:tasks.workunit.client.0.smithi019.stdout:9/440: write dd/d10/d17/d22/d42/f55 [4281248,120728] 0 2024-09-12T22:33:14.772 INFO:tasks.workunit.client.0.smithi019.stdout:9/441: creat dd/d10/d17/d23/d2e/d31/d3f/d47/d6e/d80/f8d x:0 0 0 2024-09-12T22:33:14.773 INFO:tasks.workunit.client.0.smithi019.stdout:9/442: symlink dd/d10/d17/d23/d2e/d31/d3f/d67/l8e 0 2024-09-12T22:33:14.775 INFO:tasks.workunit.client.0.smithi019.stdout:9/443: fdatasync dd/d10/d17/d23/d2e/d31/f6d 0 2024-09-12T22:33:14.775 INFO:tasks.workunit.client.0.smithi019.stdout:7/381: dread d6/d2d/d41/f48 [0,4194304] 0 2024-09-12T22:33:14.775 INFO:tasks.workunit.client.0.smithi019.stdout:9/444: chown dd 212592 1 2024-09-12T22:33:14.775 INFO:tasks.workunit.client.0.smithi019.stdout:8/396: dread d7/d34/d78/d53/f5d [4194304,4194304] 0 2024-09-12T22:33:14.776 INFO:tasks.workunit.client.0.smithi019.stdout:9/445: chown dd/d10/d17/d23/d2e/d31/d3f/d67/l84 211729965 1 2024-09-12T22:33:14.776 INFO:tasks.workunit.client.0.smithi019.stdout:7/382: getdents d6/db/d42 0 2024-09-12T22:33:14.777 INFO:tasks.workunit.client.0.smithi019.stdout:9/446: mknod dd/d10/d17/d23/d2e/d31/d3f/d67/c8f 0 2024-09-12T22:33:14.777 INFO:tasks.workunit.client.0.smithi019.stdout:7/383: write d6/db/d34/f7b [1061507,127977] 0 2024-09-12T22:33:14.778 INFO:tasks.workunit.client.0.smithi019.stdout:7/384: readlink l0 0 2024-09-12T22:33:14.778 INFO:tasks.workunit.client.0.smithi019.stdout:9/447: mknod dd/d10/d6b/c90 0 2024-09-12T22:33:14.778 INFO:tasks.workunit.client.0.smithi019.stdout:7/385: mkdir d6/d2d/d8f 0 2024-09-12T22:33:14.779 INFO:tasks.workunit.client.0.smithi019.stdout:0/436: sync 2024-09-12T22:33:14.779 INFO:tasks.workunit.client.0.smithi019.stdout:7/386: fsync d6/db/dc/f70 0 2024-09-12T22:33:14.779 INFO:tasks.workunit.client.0.smithi019.stdout:9/448: symlink dd/d10/l91 0 2024-09-12T22:33:14.779 INFO:tasks.workunit.client.0.smithi019.stdout:7/387: creat d6/db/d34/f90 x:0 0 0 2024-09-12T22:33:14.779 INFO:tasks.workunit.client.0.smithi019.stdout:0/437: creat d1/d14/d32/d71/d75/f82 x:0 0 0 2024-09-12T22:33:14.780 INFO:tasks.workunit.client.0.smithi019.stdout:9/449: rename dd/d10/f4c to dd/d10/d17/d23/d2e/f92 0 2024-09-12T22:33:14.781 INFO:tasks.workunit.client.0.smithi019.stdout:7/388: link d6/db/dc/f70 d6/d14/d15/d62/f91 0 2024-09-12T22:33:14.781 INFO:tasks.workunit.client.0.smithi019.stdout:0/438: rename d1/d51/d67 to d1/d1f/d5b/d83 0 2024-09-12T22:33:14.781 INFO:tasks.workunit.client.0.smithi019.stdout:7/389: chown d6/d14/d15/f24 168670097 1 2024-09-12T22:33:14.782 INFO:tasks.workunit.client.0.smithi019.stdout:0/439: readlink d1/d14/d26/d40/l58 0 2024-09-12T22:33:14.782 INFO:tasks.workunit.client.0.smithi019.stdout:4/419: dread d1/d8/f20 [0,4194304] 0 2024-09-12T22:33:14.784 INFO:tasks.workunit.client.0.smithi019.stdout:4/420: stat d1/d4 0 2024-09-12T22:33:14.784 INFO:tasks.workunit.client.0.smithi019.stdout:8/397: read d7/d5e/f6b [145648,21305] 0 2024-09-12T22:33:14.785 INFO:tasks.workunit.client.0.smithi019.stdout:5/562: mkdir d0/d7/d2d/dc2 0 2024-09-12T22:33:14.785 INFO:tasks.workunit.client.0.smithi019.stdout:0/440: truncate d1/d51/f56 1246292 0 2024-09-12T22:33:14.785 INFO:tasks.workunit.client.0.smithi019.stdout:8/398: creat d7/d34/f7c x:0 0 0 2024-09-12T22:33:14.785 INFO:tasks.workunit.client.0.smithi019.stdout:3/375: dread dd/f16 [0,4194304] 0 2024-09-12T22:33:14.785 INFO:tasks.workunit.client.0.smithi019.stdout:5/563: unlink d0/d7/d2d/d32/d36/fb4 0 2024-09-12T22:33:14.786 INFO:tasks.workunit.client.0.smithi019.stdout:4/421: rename d1/d4/d44/f73 to d1/d11/f86 0 2024-09-12T22:33:14.786 INFO:tasks.workunit.client.0.smithi019.stdout:8/399: creat d7/d8/f7d x:0 0 0 2024-09-12T22:33:14.786 INFO:tasks.workunit.client.0.smithi019.stdout:0/441: truncate d1/d14/d1b/f2b 591741 0 2024-09-12T22:33:14.787 INFO:tasks.workunit.client.0.smithi019.stdout:5/564: mkdir d0/d7/d16/d18/dc3 0 2024-09-12T22:33:14.788 INFO:tasks.workunit.client.0.smithi019.stdout:4/422: write d1/d4/d44/f74 [1449647,29575] 0 2024-09-12T22:33:14.788 INFO:tasks.workunit.client.0.smithi019.stdout:6/479: write d1b/d26/d27/f54 [199331,52857] 0 2024-09-12T22:33:14.788 INFO:tasks.workunit.client.0.smithi019.stdout:2/428: dread d0/da/f31 [0,4194304] 0 2024-09-12T22:33:14.789 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-09-12T22:33:14.789 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-09-12T22:33:14.789 INFO:teuthology.orchestra.run.smithi163.stdout: "complaint_time": 30, 2024-09-12T22:33:14.789 INFO:teuthology.orchestra.run.smithi163.stdout: "num_blocked_ops": 0 2024-09-12T22:33:14.789 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-09-12T22:33:14.790 INFO:tasks.workunit.client.0.smithi019.stdout:0/442: fdatasync d1/d14/d1b/f4b 0 2024-09-12T22:33:14.790 INFO:tasks.workunit.client.0.smithi019.stdout:4/423: readlink d1/d4/l19 0 2024-09-12T22:33:14.790 INFO:tasks.workunit.client.0.smithi019.stdout:1/533: dread d3/d6e/da9/f44 [0,4194304] 0 2024-09-12T22:33:14.790 INFO:tasks.workunit.client.0.smithi019.stdout:7/390: dwrite d6/db/f44 [0,4194304] 0 2024-09-12T22:33:14.791 INFO:tasks.workunit.client.0.smithi019.stdout:4/424: chown d1/d22/d31 11443 1 2024-09-12T22:33:14.792 INFO:tasks.workunit.client.0.smithi019.stdout:6/480: write d1b/d26/d39/f65 [3185105,88848] 0 2024-09-12T22:33:14.793 INFO:tasks.workunit.client.0.smithi019.stdout:9/450: creat dd/d10/d17/d23/d2e/f93 x:0 0 0 2024-09-12T22:33:14.794 INFO:tasks.workunit.client.0.smithi019.stdout:2/429: creat d0/d5/d18/d5c/d67/f93 x:0 0 0 2024-09-12T22:33:14.795 INFO:tasks.workunit.client.0.smithi019.stdout:5/565: symlink d0/d7/d16/d18/dc3/lc4 0 2024-09-12T22:33:14.795 INFO:tasks.workunit.client.0.smithi019.stdout:3/376: dwrite dd/d1e/d5a/f5b [0,4194304] 0 2024-09-12T22:33:14.796 INFO:tasks.workunit.client.0.smithi019.stdout:9/451: rmdir dd/d10 39 2024-09-12T22:33:14.796 INFO:tasks.workunit.client.0.smithi019.stdout:6/481: chown d1b/d26/d39/d6a/f60 12 1 2024-09-12T22:33:14.796 INFO:tasks.workunit.client.0.smithi019.stdout:8/400: dread d7/d8/dd/f58 [0,4194304] 0 2024-09-12T22:33:14.797 INFO:tasks.workunit.client.0.smithi019.stdout:7/391: creat d6/db/f92 x:0 0 0 2024-09-12T22:33:14.797 INFO:tasks.workunit.client.0.smithi019.stdout:5/566: write d0/f2 [4246526,116913] 0 2024-09-12T22:33:14.797 INFO:tasks.workunit.client.0.smithi019.stdout:2/430: chown d0/d5/d18/d1b/c28 1451816690 1 2024-09-12T22:33:14.798 INFO:tasks.workunit.client.0.smithi019.stdout:3/377: mkdir dd/d1e/d5a/d68 0 2024-09-12T22:33:14.799 INFO:tasks.workunit.client.0.smithi019.stdout:6/482: chown d1b/d26/d27/d3e/f49 65201 1 2024-09-12T22:33:14.799 INFO:tasks.workunit.client.0.smithi019.stdout:5/567: creat d0/db9/fc5 x:0 0 0 2024-09-12T22:33:14.799 INFO:tasks.workunit.client.0.smithi019.stdout:9/452: symlink dd/d10/d17/d22/l94 0 2024-09-12T22:33:14.800 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:33:14.801 INFO:tasks.workunit.client.0.smithi019.stdout:7/392: rename c3 to d6/d14/d15/d8b/c93 0 2024-09-12T22:33:14.801 INFO:tasks.workunit.client.0.smithi019.stdout:1/534: dwrite d3/d3f/d58/f93 [0,4194304] 0 2024-09-12T22:33:14.801 INFO:tasks.workunit.client.0.smithi019.stdout:8/401: rename d7/d8/dd/l23 to d7/d8/dd/l7e 0 2024-09-12T22:33:14.802 INFO:tasks.workunit.client.0.smithi019.stdout:2/431: write d0/d5/d18/d5c/d63/d6a/f76 [4926332,101455] 0 2024-09-12T22:33:14.802 INFO:tasks.workunit.client.0.smithi019.stdout:6/483: mkdir d1b/d26/d27/d3e/d83/dac 0 2024-09-12T22:33:14.802 INFO:tasks.workunit.client.0.smithi019.stdout:0/443: dwrite d1/d14/d26/d40/d45/d5e/f68 [0,4194304] 0 2024-09-12T22:33:14.802 INFO:tasks.workunit.client.0.smithi019.stdout:3/378: rmdir dd/d1e/d5a/d68 0 2024-09-12T22:33:14.802 INFO:tasks.workunit.client.0.smithi019.stdout:3/379: sync 2024-09-12T22:33:14.803 INFO:tasks.workunit.client.0.smithi019.stdout:5/568: readlink d0/d7/d2d/d32/d36/d8c/db8/l17 0 2024-09-12T22:33:14.803 INFO:tasks.workunit.client.0.smithi019.stdout:9/453: creat dd/d10/d17/d22/f95 x:0 0 0 2024-09-12T22:33:14.804 INFO:tasks.workunit.client.0.smithi019.stdout:1/535: unlink d3/d6e/da9/c89 0 2024-09-12T22:33:14.804 INFO:tasks.workunit.client.0.smithi019.stdout:3/380: chown f2 36 1 2024-09-12T22:33:14.805 INFO:tasks.workunit.client.0.smithi019.stdout:0/444: fdatasync d1/d14/d1b/f4b 0 2024-09-12T22:33:14.805 INFO:tasks.workunit.client.0.smithi019.stdout:8/402: mknod d7/d8/c7f 0 2024-09-12T22:33:14.805 INFO:tasks.workunit.client.0.smithi019.stdout:6/484: creat d1b/d26/d31/d5f/fad x:0 0 0 2024-09-12T22:33:14.805 INFO:tasks.workunit.client.0.smithi019.stdout:9/454: fsync dd/d10/d17/d22/d6c/f74 0 2024-09-12T22:33:14.805 INFO:tasks.workunit.client.0.smithi019.stdout:3/381: write dd/d12/f4c [900882,15223] 0 2024-09-12T22:33:14.805 INFO:tasks.workunit.client.0.smithi019.stdout:8/403: creat d7/d8/dd/d4f/f80 x:0 0 0 2024-09-12T22:33:14.806 INFO:tasks.workunit.client.0.smithi019.stdout:1/536: creat d3/d11/fae x:0 0 0 2024-09-12T22:33:14.806 INFO:tasks.workunit.client.0.smithi019.stdout:6/485: write d1b/d26/d31/d5f/fad [227696,30658] 0 2024-09-12T22:33:14.806 INFO:tasks.workunit.client.0.smithi019.stdout:3/382: chown dd/f33 3949561 1 2024-09-12T22:33:14.806 INFO:tasks.workunit.client.0.smithi019.stdout:0/445: mkdir d1/d14/d26/d40/d45/d5e/d84 0 2024-09-12T22:33:14.807 INFO:tasks.workunit.client.0.smithi019.stdout:1/537: write d3/d11/f47 [83120,9986] 0 2024-09-12T22:33:14.807 INFO:tasks.workunit.client.0.smithi019.stdout:9/455: fsync dd/d10/d17/d23/d2e/f92 0 2024-09-12T22:33:14.807 INFO:tasks.workunit.client.0.smithi019.stdout:0/446: fsync d1/fd 0 2024-09-12T22:33:14.808 INFO:tasks.workunit.client.0.smithi019.stdout:3/383: creat dd/f69 x:0 0 0 2024-09-12T22:33:14.808 INFO:tasks.workunit.client.0.smithi019.stdout:1/538: fsync d3/d1b/f68 0 2024-09-12T22:33:14.809 INFO:tasks.workunit.client.0.smithi019.stdout:3/384: mkdir dd/d12/d62/d6a 0 2024-09-12T22:33:14.809 INFO:tasks.workunit.client.0.smithi019.stdout:1/539: mknod d3/d6e/caf 0 2024-09-12T22:33:14.810 INFO:tasks.workunit.client.0.smithi019.stdout:1/540: chown d3/d11/d16/f86 159 1 2024-09-12T22:33:14.810 INFO:tasks.workunit.client.0.smithi019.stdout:3/385: write dd/d12/f30 [109523,99756] 0 2024-09-12T22:33:14.810 INFO:tasks.workunit.client.0.smithi019.stdout:6/486: dread d1b/d2d/f42 [0,4194304] 0 2024-09-12T22:33:14.811 INFO:tasks.workunit.client.0.smithi019.stdout:7/393: write d6/d2d/d41/f56 [336517,71320] 0 2024-09-12T22:33:14.811 INFO:tasks.workunit.client.0.smithi019.stdout:5/569: write d0/d7/d2d/d32/d36/d8c/db8/f34 [1643387,88336] 0 2024-09-12T22:33:14.812 INFO:tasks.workunit.client.0.smithi019.stdout:3/386: creat dd/d1e/d5a/f6b x:0 0 0 2024-09-12T22:33:14.812 INFO:tasks.workunit.client.0.smithi019.stdout:6/487: chown d1b/d26/d27/f54 71 1 2024-09-12T22:33:14.812 INFO:tasks.workunit.client.0.smithi019.stdout:5/570: write d0/d7/f1c [4014192,44898] 0 2024-09-12T22:33:14.813 INFO:tasks.workunit.client.0.smithi019.stdout:7/394: getdents d6/db/dc/d63 0 2024-09-12T22:33:14.814 INFO:tasks.workunit.client.0.smithi019.stdout:0/447: dwrite d1/d14/d32/d3d/f5a [0,4194304] 0 2024-09-12T22:33:14.814 INFO:tasks.workunit.client.0.smithi019.stdout:6/488: read - d1b/d26/d27/d3e/f6d zero size 2024-09-12T22:33:14.815 INFO:tasks.workunit.client.0.smithi019.stdout:8/404: read d7/d34/f7a [2559919,116312] 0 2024-09-12T22:33:14.815 INFO:tasks.workunit.client.0.smithi019.stdout:7/395: unlink d6/d14/c2b 0 2024-09-12T22:33:14.815 INFO:tasks.workunit.client.0.smithi019.stdout:3/387: truncate dd/d1e/d40/d5f/f66 811286 0 2024-09-12T22:33:14.817 INFO:tasks.workunit.client.0.smithi019.stdout:0/448: chown d1/d14/d26/d40/d45/d5e/d64 0 1 2024-09-12T22:33:14.818 INFO:tasks.workunit.client.0.smithi019.stdout:1/541: dwrite d3/f9 [8388608,4194304] 0 2024-09-12T22:33:15.389 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T22:33:15.391 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:15.389+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:15.393 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-09-12T22:33:15.396 INFO:teuthology.orchestra.run.smithi163.stdout: "size": 20, 2024-09-12T22:33:15.396 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 600, 2024-09-12T22:33:15.396 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2024-09-12T22:33:15.396 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.396 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-09-12T22:33:15.396 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:27.254459+0000", 2024-09-12T22:33:15.396 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 107.685434324, 2024-09-12T22:33:15.397 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.37816283899999997, 2024-09-12T22:33:15.397 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:15.397 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:15.397 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:15.397 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:15.397 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:33:15.397 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:33:15.397 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 1 2024-09-12T22:33:15.397 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.397 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:15.398 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.398 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:15.398 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254459+0000", 2024-09-12T22:33:15.398 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:15.398 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.398 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.398 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:15.398 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254459+0000", 2024-09-12T22:33:15.398 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:15.398 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.398 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.398 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:15.398 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254460+0000", 2024-09-12T22:33:15.399 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1739999999999999e-06 2024-09-12T22:33:15.399 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.399 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.399 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:15.399 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254472+0000", 2024-09-12T22:33:15.399 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2207e-05 2024-09-12T22:33:15.399 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.399 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.399 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:15.399 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254483+0000", 2024-09-12T22:33:15.399 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0631999999999999e-05 2024-09-12T22:33:15.399 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.399 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.399 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:15.400 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254492+0000", 2024-09-12T22:33:15.400 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3670000000000003e-06 2024-09-12T22:33:15.400 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.400 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.400 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:15.400 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254551+0000", 2024-09-12T22:33:15.400 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8687999999999998e-05 2024-09-12T22:33:15.401 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.401 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.401 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for peered", 2024-09-12T22:33:15.401 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254562+0000", 2024-09-12T22:33:15.401 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1249e-05 2024-09-12T22:33:15.401 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.401 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.401 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:15.401 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.631211+0000", 2024-09-12T22:33:15.401 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.376649018 2024-09-12T22:33:15.401 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.401 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.401 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:15.402 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.631345+0000", 2024-09-12T22:33:15.402 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013378700000000001 2024-09-12T22:33:15.402 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.402 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.402 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:33:15.402 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.631479+0000", 2024-09-12T22:33:15.402 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013352399999999999 2024-09-12T22:33:15.402 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.402 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.402 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:15.402 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632324+0000", 2024-09-12T22:33:15.402 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00084508100000000002 2024-09-12T22:33:15.402 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.402 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.403 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:15.403 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632548+0000", 2024-09-12T22:33:15.403 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000224329 2024-09-12T22:33:15.403 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.403 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.403 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:15.403 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632591+0000", 2024-09-12T22:33:15.403 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2564000000000001e-05 2024-09-12T22:33:15.403 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.403 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.403 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:15.403 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632622+0000", 2024-09-12T22:33:15.403 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1219e-05 2024-09-12T22:33:15.404 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:15.404 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:15.404 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:15.404 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.404 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.404 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4490.0:9871 4.35 4:ad66404a:::10000002d4d.00000000:head [write 0~6507] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:33:15.404 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:09.472309+0000", 2024-09-12T22:33:15.404 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 5.467584048, 2024-09-12T22:33:15.404 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.080251445000000005, 2024-09-12T22:33:15.404 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:15.404 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:15.404 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:15.404 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:15.405 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4490", 2024-09-12T22:33:15.405 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:15.405 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 9871 2024-09-12T22:33:15.405 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.405 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:15.405 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.405 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:15.405 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.472309+0000", 2024-09-12T22:33:15.405 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:15.405 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.405 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.405 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:15.405 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.472309+0000", 2024-09-12T22:33:15.405 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:15.406 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.406 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.406 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:15.406 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.472310+0000", 2024-09-12T22:33:15.406 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3799999999999996e-07 2024-09-12T22:33:15.406 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.406 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.406 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:15.406 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.472318+0000", 2024-09-12T22:33:15.406 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.8099999999999998e-06 2024-09-12T22:33:15.406 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.406 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.406 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:15.407 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.472328+0000", 2024-09-12T22:33:15.407 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0359e-05 2024-09-12T22:33:15.407 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.407 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.407 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:15.407 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.472334+0000", 2024-09-12T22:33:15.407 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.0109999999999997e-06 2024-09-12T22:33:15.407 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.407 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.407 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:15.407 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.472382+0000", 2024-09-12T22:33:15.407 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.7311000000000002e-05 2024-09-12T22:33:15.407 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.407 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.408 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:15.408 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.472497+0000", 2024-09-12T22:33:15.408 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011537800000000001 2024-09-12T22:33:15.408 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.408 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.408 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:15.408 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.472617+0000", 2024-09-12T22:33:15.408 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011989600000000001 2024-09-12T22:33:15.408 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.408 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.408 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:15.408 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473149+0000", 2024-09-12T22:33:15.408 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00053227999999999999 2024-09-12T22:33:15.409 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.409 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.409 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:15.409 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.552479+0000", 2024-09-12T22:33:15.409 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.079329541000000003 2024-09-12T22:33:15.409 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.409 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.409 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:15.409 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.552525+0000", 2024-09-12T22:33:15.409 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6421000000000002e-05 2024-09-12T22:33:15.409 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.409 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.409 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:15.409 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.552561+0000", 2024-09-12T22:33:15.410 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5599999999999998e-05 2024-09-12T22:33:15.410 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:15.410 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:15.410 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:15.410 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.410 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.410 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4490.0:9872 4.2c 4:3602c8d3:::10000002d4e.00000000:head [write 0~1178] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:33:15.410 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:09.473085+0000", 2024-09-12T22:33:15.410 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 5.4668087439999997, 2024-09-12T22:33:15.410 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.079631104999999994, 2024-09-12T22:33:15.410 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:15.410 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:15.410 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:15.411 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:15.411 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4490", 2024-09-12T22:33:15.411 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:15.411 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 9872 2024-09-12T22:33:15.411 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.411 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:15.411 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.411 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:15.411 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473085+0000", 2024-09-12T22:33:15.411 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:15.411 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.411 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.411 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:15.412 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473085+0000", 2024-09-12T22:33:15.412 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:15.412 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.412 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.412 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:15.412 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473085+0000", 2024-09-12T22:33:15.412 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3600000000000004e-07 2024-09-12T22:33:15.412 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.412 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.412 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:15.412 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473088+0000", 2024-09-12T22:33:15.412 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.005e-06 2024-09-12T22:33:15.412 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.413 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.413 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:15.413 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473095+0000", 2024-09-12T22:33:15.413 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3950000000000003e-06 2024-09-12T22:33:15.413 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.413 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.413 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:15.413 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473100+0000", 2024-09-12T22:33:15.413 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5460000000000002e-06 2024-09-12T22:33:15.413 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.413 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.413 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:15.413 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473138+0000", 2024-09-12T22:33:15.414 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8244999999999997e-05 2024-09-12T22:33:15.414 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.414 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.414 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:15.414 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473216+0000", 2024-09-12T22:33:15.414 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.7756000000000006e-05 2024-09-12T22:33:15.414 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.414 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.414 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:15.414 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473291+0000", 2024-09-12T22:33:15.414 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5110000000000004e-05 2024-09-12T22:33:15.414 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.414 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.414 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:15.415 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473736+0000", 2024-09-12T22:33:15.415 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00044486500000000002 2024-09-12T22:33:15.415 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.415 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.415 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:15.415 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.552637+0000", 2024-09-12T22:33:15.415 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.078900782000000003 2024-09-12T22:33:15.415 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.415 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.415 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:15.415 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.552680+0000", 2024-09-12T22:33:15.415 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3047999999999998e-05 2024-09-12T22:33:15.415 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.416 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.416 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:15.416 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.552716+0000", 2024-09-12T22:33:15.416 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5816999999999999e-05 2024-09-12T22:33:15.416 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:15.416 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:15.416 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:15.416 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.416 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.416 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4490.0:9873 4.2c 4:372c52ff:::10000002d4f.00000000:head [write 0~1230] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:33:15.416 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:09.473878+0000", 2024-09-12T22:33:15.416 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 5.4660152809999998, 2024-09-12T22:33:15.416 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.079036047999999998, 2024-09-12T22:33:15.417 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:15.417 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:15.417 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:15.417 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:15.417 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4490", 2024-09-12T22:33:15.417 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:15.417 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 9873 2024-09-12T22:33:15.417 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.417 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:15.417 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.417 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:15.417 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473878+0000", 2024-09-12T22:33:15.417 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:15.417 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.418 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.418 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:15.418 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473878+0000", 2024-09-12T22:33:15.418 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:15.418 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.418 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.418 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:15.418 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473879+0000", 2024-09-12T22:33:15.418 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9100000000000004e-07 2024-09-12T22:33:15.418 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.418 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.418 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:15.418 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473882+0000", 2024-09-12T22:33:15.419 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.405e-06 2024-09-12T22:33:15.419 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.419 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.419 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:15.419 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473889+0000", 2024-09-12T22:33:15.419 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7519999999999999e-06 2024-09-12T22:33:15.419 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.419 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.419 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:15.419 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473893+0000", 2024-09-12T22:33:15.419 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9310000000000001e-06 2024-09-12T22:33:15.419 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.419 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.419 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:15.420 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473922+0000", 2024-09-12T22:33:15.420 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9346999999999999e-05 2024-09-12T22:33:15.420 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.420 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.420 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:15.420 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474000+0000", 2024-09-12T22:33:15.420 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.7972000000000005e-05 2024-09-12T22:33:15.420 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.420 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.420 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:15.420 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474072+0000", 2024-09-12T22:33:15.420 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1960999999999998e-05 2024-09-12T22:33:15.420 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.421 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.421 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:15.421 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474470+0000", 2024-09-12T22:33:15.421 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00039803400000000002 2024-09-12T22:33:15.421 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.421 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.421 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:15.421 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.552814+0000", 2024-09-12T22:33:15.421 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.078344164999999993 2024-09-12T22:33:15.421 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.421 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.421 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:15.421 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.552875+0000", 2024-09-12T22:33:15.421 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1008999999999998e-05 2024-09-12T22:33:15.422 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.422 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.422 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:15.422 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.552914+0000", 2024-09-12T22:33:15.422 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8881000000000003e-05 2024-09-12T22:33:15.422 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:15.422 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:15.422 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:15.422 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.422 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.422 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4490.0:9874 4.1b 4:db19d96a:::10000002d50.00000000:head [write 0~1088] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:33:15.422 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:09.474673+0000", 2024-09-12T22:33:15.422 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 5.4652202880000003, 2024-09-12T22:33:15.423 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.080314317999999996, 2024-09-12T22:33:15.423 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:15.423 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:15.423 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:15.423 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:15.423 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4490", 2024-09-12T22:33:15.423 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:15.423 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 9874 2024-09-12T22:33:15.423 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.423 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:15.423 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.423 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:15.423 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474673+0000", 2024-09-12T22:33:15.423 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:15.424 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.424 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.424 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:15.424 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474673+0000", 2024-09-12T22:33:15.424 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:15.424 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.424 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.424 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:15.424 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474674+0000", 2024-09-12T22:33:15.424 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6199999999999998e-07 2024-09-12T22:33:15.424 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.424 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.424 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:15.425 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474677+0000", 2024-09-12T22:33:15.425 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.224e-06 2024-09-12T22:33:15.425 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.425 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.425 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:15.425 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474683+0000", 2024-09-12T22:33:15.425 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.3160000000000002e-06 2024-09-12T22:33:15.425 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.425 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.425 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:15.426 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474687+0000", 2024-09-12T22:33:15.426 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7869999999999999e-06 2024-09-12T22:33:15.426 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.426 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.426 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:15.426 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474730+0000", 2024-09-12T22:33:15.426 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3309000000000002e-05 2024-09-12T22:33:15.426 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.426 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.426 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:15.426 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474845+0000", 2024-09-12T22:33:15.426 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114306 2024-09-12T22:33:15.426 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.426 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.427 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:15.427 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474970+0000", 2024-09-12T22:33:15.427 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000125096 2024-09-12T22:33:15.427 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.427 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.427 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:15.427 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.475621+0000", 2024-09-12T22:33:15.427 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00065124900000000001 2024-09-12T22:33:15.427 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.427 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.427 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:15.427 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.554885+0000", 2024-09-12T22:33:15.427 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.079264055 2024-09-12T22:33:15.428 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.428 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.428 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:15.428 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.554942+0000", 2024-09-12T22:33:15.428 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7284000000000002e-05 2024-09-12T22:33:15.428 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.428 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.428 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:15.428 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.554987+0000", 2024-09-12T22:33:15.428 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5130000000000003e-05 2024-09-12T22:33:15.428 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:15.428 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:15.428 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:15.429 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.429 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.429 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4490.0:12220 4.2b 4:d55bfd66:::10000003169.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-12T22:33:15.429 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.391333+0000", 2024-09-12T22:33:15.429 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.54856014500000005, 2024-09-12T22:33:15.429 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.088669550999999999, 2024-09-12T22:33:15.429 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:15.429 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:15.429 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:15.429 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:15.429 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4490", 2024-09-12T22:33:15.429 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:15.429 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 12220 2024-09-12T22:33:15.429 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.430 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:15.430 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.430 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:15.430 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.391333+0000", 2024-09-12T22:33:15.430 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:15.430 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.430 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.430 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:15.430 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.391333+0000", 2024-09-12T22:33:15.430 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:15.430 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.430 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.430 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:15.431 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.391334+0000", 2024-09-12T22:33:15.431 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3099999999999997e-07 2024-09-12T22:33:15.431 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.431 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.432 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:15.432 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398373+0000", 2024-09-12T22:33:15.432 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0070386670000000002 2024-09-12T22:33:15.432 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.432 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.432 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:15.432 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398384+0000", 2024-09-12T22:33:15.432 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1338999999999999e-05 2024-09-12T22:33:15.432 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.432 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.433 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:15.433 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398389+0000", 2024-09-12T22:33:15.433 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3650000000000003e-06 2024-09-12T22:33:15.433 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.433 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.433 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:15.433 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.456308+0000", 2024-09-12T22:33:15.433 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.057918931 2024-09-12T22:33:15.433 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.433 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.433 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:15.433 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.456425+0000", 2024-09-12T22:33:15.433 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000116452 2024-09-12T22:33:15.434 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.434 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.434 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:15.434 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.456536+0000", 2024-09-12T22:33:15.434 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000111839 2024-09-12T22:33:15.434 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.434 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.434 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:15.434 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.465335+0000", 2024-09-12T22:33:15.434 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0087984980000000001 2024-09-12T22:33:15.434 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.434 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.434 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:15.434 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.479950+0000", 2024-09-12T22:33:15.435 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.01461552 2024-09-12T22:33:15.435 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.435 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.435 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:15.435 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.479983+0000", 2024-09-12T22:33:15.435 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2126999999999999e-05 2024-09-12T22:33:15.435 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.435 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.435 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:15.435 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.480003+0000", 2024-09-12T22:33:15.435 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0081999999999998e-05 2024-09-12T22:33:15.435 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:15.435 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:15.435 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:15.436 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.436 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.436 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1208 3.13 3:cb3d3880:::200.0000000d:head [write 1009846~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:15.436 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.398459+0000", 2024-09-12T22:33:15.436 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.54143457900000003, 2024-09-12T22:33:15.436 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.078093931000000005, 2024-09-12T22:33:15.436 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:15.436 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:15.436 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:15.436 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:15.436 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.436 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:15.436 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398459+0000", 2024-09-12T22:33:15.437 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:15.437 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.437 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.437 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:15.437 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398459+0000", 2024-09-12T22:33:15.437 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:15.437 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.437 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.437 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:15.437 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398459+0000", 2024-09-12T22:33:15.437 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8100000000000003e-07 2024-09-12T22:33:15.437 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.437 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.437 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:15.438 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398462+0000", 2024-09-12T22:33:15.438 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3700000000000002e-06 2024-09-12T22:33:15.438 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.438 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.438 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:15.438 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398469+0000", 2024-09-12T22:33:15.438 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2320000000000004e-06 2024-09-12T22:33:15.438 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.438 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.438 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:15.438 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398472+0000", 2024-09-12T22:33:15.438 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.658e-06 2024-09-12T22:33:15.438 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.438 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.439 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:15.439 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.456690+0000", 2024-09-12T22:33:15.439 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.058217615 2024-09-12T22:33:15.439 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.439 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.439 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:15.439 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.456731+0000", 2024-09-12T22:33:15.439 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0815000000000001e-05 2024-09-12T22:33:15.439 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.439 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.439 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:15.439 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.456793+0000", 2024-09-12T22:33:15.439 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1796000000000003e-05 2024-09-12T22:33:15.439 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.440 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.440 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:15.440 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.461412+0000", 2024-09-12T22:33:15.440 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0046188560000000002 2024-09-12T22:33:15.440 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.440 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.440 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:15.440 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476429+0000", 2024-09-12T22:33:15.440 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.015017943000000001 2024-09-12T22:33:15.440 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.440 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.440 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:15.440 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476499+0000", 2024-09-12T22:33:15.441 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9047000000000005e-05 2024-09-12T22:33:15.441 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.441 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.441 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:15.441 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476553+0000", 2024-09-12T22:33:15.441 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4117999999999999e-05 2024-09-12T22:33:15.441 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:15.441 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:15.441 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:15.441 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.441 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.441 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1209 3.13 3:cb3d3880:::200.0000000d:head [write 1011245~5867 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:15.441 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.398677+0000", 2024-09-12T22:33:15.442 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.54121602199999996, 2024-09-12T22:33:15.442 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.077995698000000002, 2024-09-12T22:33:15.442 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:15.442 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:15.442 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:15.442 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:15.442 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.442 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:15.442 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398677+0000", 2024-09-12T22:33:15.442 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:15.442 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.442 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.443 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:15.443 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398677+0000", 2024-09-12T22:33:15.443 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:15.443 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.443 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.443 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:15.443 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398678+0000", 2024-09-12T22:33:15.443 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5199999999999995e-07 2024-09-12T22:33:15.443 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.443 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.443 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:15.443 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398686+0000", 2024-09-12T22:33:15.443 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0579999999999998e-06 2024-09-12T22:33:15.443 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.444 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.444 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:15.444 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398695+0000", 2024-09-12T22:33:15.444 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.1409999999999994e-06 2024-09-12T22:33:15.444 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.444 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.444 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:15.444 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398703+0000", 2024-09-12T22:33:15.444 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4379999999999998e-06 2024-09-12T22:33:15.444 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.444 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.444 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:15.444 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.457051+0000", 2024-09-12T22:33:15.445 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.058348358000000003 2024-09-12T22:33:15.445 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.445 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.445 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:15.445 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.457096+0000", 2024-09-12T22:33:15.445 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4428000000000002e-05 2024-09-12T22:33:15.445 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.445 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.445 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:15.445 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.457162+0000", 2024-09-12T22:33:15.445 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6298999999999997e-05 2024-09-12T22:33:15.445 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.445 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.445 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:15.446 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.461416+0000", 2024-09-12T22:33:15.446 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0042539980000000002 2024-09-12T22:33:15.446 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.446 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.446 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:15.446 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476610+0000", 2024-09-12T22:33:15.446 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.015193879 2024-09-12T22:33:15.446 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.446 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.446 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:15.446 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476640+0000", 2024-09-12T22:33:15.446 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0648000000000002e-05 2024-09-12T22:33:15.446 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.446 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.447 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:15.447 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476673+0000", 2024-09-12T22:33:15.447 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2598999999999997e-05 2024-09-12T22:33:15.447 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:15.447 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:15.447 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:15.447 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.447 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.447 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1210 3.13 3:cb3d3880:::200.0000000d:head [write 1017112~1958 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:15.447 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.398713+0000", 2024-09-12T22:33:15.447 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.54118069899999999, 2024-09-12T22:33:15.447 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.078118317000000007, 2024-09-12T22:33:15.447 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:15.447 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:15.448 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:15.448 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:15.448 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.448 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:15.448 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398713+0000", 2024-09-12T22:33:15.448 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:15.448 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.448 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.448 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:15.448 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398713+0000", 2024-09-12T22:33:15.448 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:15.448 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.448 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.448 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:15.449 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398713+0000", 2024-09-12T22:33:15.449 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7599999999999998e-07 2024-09-12T22:33:15.449 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.449 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.449 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:15.449 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398718+0000", 2024-09-12T22:33:15.449 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8169999999999998e-06 2024-09-12T22:33:15.449 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.449 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.449 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:15.449 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398722+0000", 2024-09-12T22:33:15.449 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5249999999999999e-06 2024-09-12T22:33:15.449 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.450 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.450 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:15.450 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398726+0000", 2024-09-12T22:33:15.450 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5650000000000002e-06 2024-09-12T22:33:15.450 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.450 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.450 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:15.450 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.457644+0000", 2024-09-12T22:33:15.450 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.058918521000000001 2024-09-12T22:33:15.450 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.450 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.450 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:15.450 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.457724+0000", 2024-09-12T22:33:15.450 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9408999999999998e-05 2024-09-12T22:33:15.451 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.451 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.451 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:15.451 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.457821+0000", 2024-09-12T22:33:15.451 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.7015000000000005e-05 2024-09-12T22:33:15.451 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.451 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.451 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:15.451 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.461419+0000", 2024-09-12T22:33:15.451 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0035985309999999999 2024-09-12T22:33:15.451 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.451 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.451 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:15.451 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476726+0000", 2024-09-12T22:33:15.451 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.015306804 2024-09-12T22:33:15.452 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.452 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.452 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:15.452 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476787+0000", 2024-09-12T22:33:15.452 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1062000000000006e-05 2024-09-12T22:33:15.452 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.452 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.452 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:15.452 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476831+0000", 2024-09-12T22:33:15.452 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3692000000000001e-05 2024-09-12T22:33:15.452 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:15.452 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:15.452 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:15.452 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.453 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.453 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1211 3.13 3:cb3d3880:::200.0000000d:head [write 1019070~5873 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:15.453 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.400122+0000", 2024-09-12T22:33:15.453 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.53977098099999998, 2024-09-12T22:33:15.453 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.076797146999999996, 2024-09-12T22:33:15.453 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:15.453 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:15.453 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:15.453 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:15.453 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.453 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:15.453 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.400122+0000", 2024-09-12T22:33:15.453 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:15.453 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.454 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.454 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:15.454 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.400122+0000", 2024-09-12T22:33:15.454 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:15.454 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.454 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.454 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:15.454 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.400123+0000", 2024-09-12T22:33:15.454 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2500000000000005e-07 2024-09-12T22:33:15.454 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.454 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.454 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:15.454 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.400129+0000", 2024-09-12T22:33:15.455 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.319e-06 2024-09-12T22:33:15.455 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.455 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.455 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:15.455 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.400139+0000", 2024-09-12T22:33:15.455 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.5200000000000003e-06 2024-09-12T22:33:15.455 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.455 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.455 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:15.455 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.400143+0000", 2024-09-12T22:33:15.455 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.437e-06 2024-09-12T22:33:15.455 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.456 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.456 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:15.456 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.458159+0000", 2024-09-12T22:33:15.456 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.058015960999999998 2024-09-12T22:33:15.456 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.456 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.456 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:15.456 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.458201+0000", 2024-09-12T22:33:15.456 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1693000000000002e-05 2024-09-12T22:33:15.456 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.456 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.456 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:15.456 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.458267+0000", 2024-09-12T22:33:15.456 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5687999999999999e-05 2024-09-12T22:33:15.457 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.457 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.457 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:15.457 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.461423+0000", 2024-09-12T22:33:15.457 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0031560730000000001 2024-09-12T22:33:15.457 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.457 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.457 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:15.457 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476868+0000", 2024-09-12T22:33:15.457 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.015445108000000001 2024-09-12T22:33:15.457 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.457 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.457 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:15.458 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476897+0000", 2024-09-12T22:33:15.458 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9433000000000001e-05 2024-09-12T22:33:15.458 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.458 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.458 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:15.458 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476919+0000", 2024-09-12T22:33:15.458 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.2189999999999999e-05 2024-09-12T22:33:15.458 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:15.458 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:15.458 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:15.458 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.458 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.458 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1212 3.13 3:cb3d3880:::200.0000000d:head [write 1024943~3866 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:15.458 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.401707+0000", 2024-09-12T22:33:15.459 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.53818677599999998, 2024-09-12T22:33:15.459 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.075386625999999998, 2024-09-12T22:33:15.459 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:15.459 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:15.459 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:15.459 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:15.459 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.459 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:15.459 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.401707+0000", 2024-09-12T22:33:15.459 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:15.459 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.459 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.459 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:15.459 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.401707+0000", 2024-09-12T22:33:15.460 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:15.460 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.460 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.460 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:15.460 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.401707+0000", 2024-09-12T22:33:15.460 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7700000000000004e-07 2024-09-12T22:33:15.460 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.460 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.460 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:15.460 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.401713+0000", 2024-09-12T22:33:15.460 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6609999999999997e-06 2024-09-12T22:33:15.460 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.460 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.460 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:15.461 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.401726+0000", 2024-09-12T22:33:15.461 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.3088000000000001e-05 2024-09-12T22:33:15.461 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.461 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.461 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:15.461 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.401741+0000", 2024-09-12T22:33:15.461 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.5424e-05 2024-09-12T22:33:15.461 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.461 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.461 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:15.461 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.458853+0000", 2024-09-12T22:33:15.461 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.057111157000000003 2024-09-12T22:33:15.461 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.461 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.462 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:15.462 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.458898+0000", 2024-09-12T22:33:15.462 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5633999999999997e-05 2024-09-12T22:33:15.462 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.462 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.462 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:15.462 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.458972+0000", 2024-09-12T22:33:15.462 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3441000000000004e-05 2024-09-12T22:33:15.462 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.462 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.462 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:15.462 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.461426+0000", 2024-09-12T22:33:15.462 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0024542660000000001 2024-09-12T22:33:15.462 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.463 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.463 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:15.463 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476985+0000", 2024-09-12T22:33:15.463 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.015559513000000001 2024-09-12T22:33:15.463 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.463 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.463 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:15.463 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.477044+0000", 2024-09-12T22:33:15.463 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8156999999999999e-05 2024-09-12T22:33:15.463 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.463 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.463 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:15.463 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.477093+0000", 2024-09-12T22:33:15.463 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9607999999999997e-05 2024-09-12T22:33:15.464 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:15.464 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:15.464 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:15.464 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.464 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.464 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1213 3.13 3:cb3d3880:::200.0000000d:head [write 1028809~6329 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:15.464 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.403250+0000", 2024-09-12T22:33:15.464 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.53664324799999996, 2024-09-12T22:33:15.464 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.073936215999999999, 2024-09-12T22:33:15.464 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:15.464 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:15.464 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:15.464 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:15.464 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.465 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:15.465 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403250+0000", 2024-09-12T22:33:15.465 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:15.465 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.465 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.465 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:15.465 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403250+0000", 2024-09-12T22:33:15.465 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:15.465 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.465 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.465 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:15.465 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403251+0000", 2024-09-12T22:33:15.465 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.37e-07 2024-09-12T22:33:15.465 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.466 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.466 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:15.466 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403258+0000", 2024-09-12T22:33:15.466 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.25e-06 2024-09-12T22:33:15.466 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.466 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.466 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:15.466 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403269+0000", 2024-09-12T22:33:15.466 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0509000000000001e-05 2024-09-12T22:33:15.466 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.466 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.466 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:15.466 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403274+0000", 2024-09-12T22:33:15.466 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1290000000000004e-06 2024-09-12T22:33:15.467 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.467 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.467 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:15.467 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.459796+0000", 2024-09-12T22:33:15.467 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.056522020999999999 2024-09-12T22:33:15.467 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.467 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.467 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:15.467 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.459845+0000", 2024-09-12T22:33:15.467 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8884999999999997e-05 2024-09-12T22:33:15.467 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.467 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.467 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:15.467 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.459920+0000", 2024-09-12T22:33:15.468 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5318e-05 2024-09-12T22:33:15.468 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.468 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.468 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:15.468 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.466542+0000", 2024-09-12T22:33:15.468 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0066223139999999998 2024-09-12T22:33:15.468 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.468 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.468 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:15.468 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.477137+0000", 2024-09-12T22:33:15.468 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010594717 2024-09-12T22:33:15.468 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.468 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.469 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:15.469 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.477165+0000", 2024-09-12T22:33:15.469 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8262000000000001e-05 2024-09-12T22:33:15.469 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.469 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.469 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:15.469 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.477186+0000", 2024-09-12T22:33:15.469 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1073999999999998e-05 2024-09-12T22:33:15.469 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:15.469 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:15.469 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:15.469 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.469 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.469 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1214 3.13 3:cb3d3880:::200.0000000d:head [write 1035138~2606 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:15.470 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.403674+0000", 2024-09-12T22:33:15.470 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.53621932800000005, 2024-09-12T22:33:15.470 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.073643204000000004, 2024-09-12T22:33:15.470 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:15.470 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:15.470 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:15.470 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:15.470 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.470 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:15.470 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403674+0000", 2024-09-12T22:33:15.470 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:15.470 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.470 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.470 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:15.471 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403674+0000", 2024-09-12T22:33:15.471 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:15.471 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.471 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.471 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:15.471 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403674+0000", 2024-09-12T22:33:15.471 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.7700000000000005e-07 2024-09-12T22:33:15.471 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.471 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.471 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:15.471 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403678+0000", 2024-09-12T22:33:15.471 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2009999999999999e-06 2024-09-12T22:33:15.471 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.472 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.472 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:15.472 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403686+0000", 2024-09-12T22:33:15.472 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5690000000000005e-06 2024-09-12T22:33:15.472 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.472 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.472 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:15.472 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403690+0000", 2024-09-12T22:33:15.472 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.233e-06 2024-09-12T22:33:15.472 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.473 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.473 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:15.473 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.460445+0000", 2024-09-12T22:33:15.473 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.056754412999999997 2024-09-12T22:33:15.473 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.473 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.473 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:15.473 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.460495+0000", 2024-09-12T22:33:15.473 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0238999999999998e-05 2024-09-12T22:33:15.473 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.473 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.473 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:15.473 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.460566+0000", 2024-09-12T22:33:15.473 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1159000000000001e-05 2024-09-12T22:33:15.474 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.474 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.474 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:15.474 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.466546+0000", 2024-09-12T22:33:15.474 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0059798910000000002 2024-09-12T22:33:15.474 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.474 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.474 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:15.474 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.477232+0000", 2024-09-12T22:33:15.474 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010686084 2024-09-12T22:33:15.474 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.475 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.475 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:15.475 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.477280+0000", 2024-09-12T22:33:15.475 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.7719999999999997e-05 2024-09-12T22:33:15.475 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.475 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.475 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:15.475 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.477317+0000", 2024-09-12T22:33:15.475 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7218000000000002e-05 2024-09-12T22:33:15.475 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:15.475 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:15.475 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:15.476 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.476 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.476 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1223 3.13 3:cb3d3880:::200.0000000d:head [write 1090497~1913 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:15.476 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.420111+0000", 2024-09-12T22:33:15.476 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.51978217599999998, 2024-09-12T22:33:15.476 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.071634583000000002, 2024-09-12T22:33:15.476 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:15.476 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:15.476 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:15.476 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:15.476 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.476 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:15.477 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.420111+0000", 2024-09-12T22:33:15.477 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:15.477 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.477 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.477 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:15.477 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.420111+0000", 2024-09-12T22:33:15.477 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:15.477 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.477 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.477 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:15.477 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.420112+0000", 2024-09-12T22:33:15.478 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.2900000000000002e-07 2024-09-12T22:33:15.478 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.478 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.478 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:15.478 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.420116+0000", 2024-09-12T22:33:15.478 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.67e-06 2024-09-12T22:33:15.478 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.478 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.478 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:15.478 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.420125+0000", 2024-09-12T22:33:15.478 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.0890000000000006e-06 2024-09-12T22:33:15.478 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.478 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.479 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:15.479 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.420131+0000", 2024-09-12T22:33:15.479 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4269999999999996e-06 2024-09-12T22:33:15.479 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.479 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.479 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:15.479 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.465358+0000", 2024-09-12T22:33:15.479 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.045227030000000001 2024-09-12T22:33:15.479 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.479 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.479 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:15.479 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.465439+0000", 2024-09-12T22:33:15.479 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0901000000000004e-05 2024-09-12T22:33:15.480 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.480 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.480 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:15.480 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.465571+0000", 2024-09-12T22:33:15.480 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000131705 2024-09-12T22:33:15.480 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.480 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.480 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:15.480 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.469496+0000", 2024-09-12T22:33:15.480 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.003925418 2024-09-12T22:33:15.480 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.480 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.480 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:15.480 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.491669+0000", 2024-09-12T22:33:15.481 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.022172335000000001 2024-09-12T22:33:15.481 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.481 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.481 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:15.481 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.491714+0000", 2024-09-12T22:33:15.481 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5417000000000002e-05 2024-09-12T22:33:15.481 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.481 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.481 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:15.481 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.491746+0000", 2024-09-12T22:33:15.481 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1662000000000003e-05 2024-09-12T22:33:15.481 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:15.481 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:15.481 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:15.482 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.482 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.482 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1225 3.13 3:cb3d3880:::200.0000000d:head [write 1097316~1932 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:15.482 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.421303+0000", 2024-09-12T22:33:15.482 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.51859034100000001, 2024-09-12T22:33:15.482 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.074934770999999997, 2024-09-12T22:33:15.482 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:15.482 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:15.482 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:15.482 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:15.482 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.482 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:15.482 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.421303+0000", 2024-09-12T22:33:15.482 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:15.482 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.483 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.483 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:15.483 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.421303+0000", 2024-09-12T22:33:15.483 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:15.483 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.483 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.483 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:15.483 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.421303+0000", 2024-09-12T22:33:15.483 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8599999999999998e-07 2024-09-12T22:33:15.483 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.483 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.483 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:15.483 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.421307+0000", 2024-09-12T22:33:15.484 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0879999999999999e-06 2024-09-12T22:33:15.484 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.484 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.484 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:15.484 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.421314+0000", 2024-09-12T22:33:15.484 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1010000000000003e-06 2024-09-12T22:33:15.484 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.484 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.484 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:15.484 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.421319+0000", 2024-09-12T22:33:15.484 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7209999999999999e-06 2024-09-12T22:33:15.484 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.484 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.484 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:15.485 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.466620+0000", 2024-09-12T22:33:15.485 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.045301044999999998 2024-09-12T22:33:15.485 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.485 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.485 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:15.485 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.466703+0000", 2024-09-12T22:33:15.485 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3011999999999997e-05 2024-09-12T22:33:15.485 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.485 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.485 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:15.485 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.466826+0000", 2024-09-12T22:33:15.485 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000122824 2024-09-12T22:33:15.485 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.485 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.486 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:15.486 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.472359+0000", 2024-09-12T22:33:15.486 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0055323009999999999 2024-09-12T22:33:15.486 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.486 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.486 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:15.486 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496142+0000", 2024-09-12T22:33:15.486 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.023783696999999999 2024-09-12T22:33:15.486 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.486 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.486 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:15.486 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496194+0000", 2024-09-12T22:33:15.486 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1350000000000001e-05 2024-09-12T22:33:15.487 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.487 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.487 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:15.487 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496238+0000", 2024-09-12T22:33:15.487 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4146000000000001e-05 2024-09-12T22:33:15.487 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:15.487 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:15.487 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:15.487 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.487 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.487 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1226 3.13 3:cb3d3880:::200.0000000d:head [write 1099248~1973 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:15.487 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.422971+0000", 2024-09-12T22:33:15.487 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.51692274299999996, 2024-09-12T22:33:15.487 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.073363063000000006, 2024-09-12T22:33:15.488 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:15.488 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:15.488 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:15.488 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:15.488 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.488 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:15.488 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.422971+0000", 2024-09-12T22:33:15.488 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:15.488 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.488 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.488 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:15.488 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.422971+0000", 2024-09-12T22:33:15.488 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:15.488 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.489 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.489 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:15.489 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.422971+0000", 2024-09-12T22:33:15.489 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.1699999999999997e-07 2024-09-12T22:33:15.489 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.489 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.489 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:15.489 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.422975+0000", 2024-09-12T22:33:15.489 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2650000000000001e-06 2024-09-12T22:33:15.489 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.489 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.489 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:15.489 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.422981+0000", 2024-09-12T22:33:15.489 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7379999999999997e-06 2024-09-12T22:33:15.490 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.490 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.490 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:15.490 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.422986+0000", 2024-09-12T22:33:15.490 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5220000000000001e-06 2024-09-12T22:33:15.490 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.490 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.490 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:15.490 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.467340+0000", 2024-09-12T22:33:15.490 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.044353985999999998 2024-09-12T22:33:15.490 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.490 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.490 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:15.490 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.467412+0000", 2024-09-12T22:33:15.491 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1982000000000003e-05 2024-09-12T22:33:15.491 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.491 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.491 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:15.491 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.467493+0000", 2024-09-12T22:33:15.491 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0829999999999997e-05 2024-09-12T22:33:15.491 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.491 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.491 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:15.491 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.472364+0000", 2024-09-12T22:33:15.491 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0048713189999999998 2024-09-12T22:33:15.491 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.491 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.491 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:15.492 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496271+0000", 2024-09-12T22:33:15.492 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.023906808000000002 2024-09-12T22:33:15.492 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.492 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.492 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:15.492 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496300+0000", 2024-09-12T22:33:15.492 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9315e-05 2024-09-12T22:33:15.492 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.492 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.492 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:15.492 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496334+0000", 2024-09-12T22:33:15.492 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3481e-05 2024-09-12T22:33:15.492 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:15.492 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:15.493 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:15.493 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.493 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.493 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1227 3.13 3:cb3d3880:::200.0000000d:head [write 1101221~1922 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:15.493 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.423028+0000", 2024-09-12T22:33:15.493 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.51686575899999998, 2024-09-12T22:33:15.493 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.073444802000000003, 2024-09-12T22:33:15.493 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:15.493 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:15.493 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:15.493 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:15.493 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.493 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:15.493 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423028+0000", 2024-09-12T22:33:15.494 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:15.494 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.494 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.494 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:15.494 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423028+0000", 2024-09-12T22:33:15.494 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:15.494 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.494 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.494 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:15.494 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423028+0000", 2024-09-12T22:33:15.494 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1699999999999998e-07 2024-09-12T22:33:15.494 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.494 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.494 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:15.495 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423031+0000", 2024-09-12T22:33:15.495 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8499999999999998e-06 2024-09-12T22:33:15.495 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.495 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.495 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:15.495 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423036+0000", 2024-09-12T22:33:15.495 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9479999999999999e-06 2024-09-12T22:33:15.495 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.495 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.495 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:15.495 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423039+0000", 2024-09-12T22:33:15.495 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4929999999999998e-06 2024-09-12T22:33:15.495 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.495 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.496 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:15.496 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.467785+0000", 2024-09-12T22:33:15.496 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.044745957000000003 2024-09-12T22:33:15.496 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.496 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.496 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:15.496 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.467838+0000", 2024-09-12T22:33:15.496 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2596999999999998e-05 2024-09-12T22:33:15.496 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.496 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.496 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:15.496 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.467915+0000", 2024-09-12T22:33:15.496 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6744999999999998e-05 2024-09-12T22:33:15.497 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.497 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.497 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:15.497 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.472368+0000", 2024-09-12T22:33:15.497 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0044534730000000003 2024-09-12T22:33:15.497 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.497 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.497 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:15.497 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496382+0000", 2024-09-12T22:33:15.497 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.024014111000000001 2024-09-12T22:33:15.497 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.497 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.497 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:15.497 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496443+0000", 2024-09-12T22:33:15.498 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.0547000000000002e-05 2024-09-12T22:33:15.498 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.498 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.498 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:15.498 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496472+0000", 2024-09-12T22:33:15.498 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9564e-05 2024-09-12T22:33:15.498 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:15.498 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:15.498 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:15.498 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.498 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.498 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1228 3.13 3:cb3d3880:::200.0000000d:head [write 1103143~2423 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:15.498 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.423305+0000", 2024-09-12T22:33:15.498 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.51658839499999998, 2024-09-12T22:33:15.499 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.073251160999999995, 2024-09-12T22:33:15.499 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:15.499 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:15.499 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:15.499 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:15.499 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.499 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:15.499 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423305+0000", 2024-09-12T22:33:15.499 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:15.499 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.499 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.499 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:15.499 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423305+0000", 2024-09-12T22:33:15.499 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:15.500 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.500 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.500 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:15.500 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423306+0000", 2024-09-12T22:33:15.500 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4899999999999995e-07 2024-09-12T22:33:15.500 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.500 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.500 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:15.500 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423311+0000", 2024-09-12T22:33:15.500 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7459999999999997e-06 2024-09-12T22:33:15.500 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.500 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.500 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:15.501 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423316+0000", 2024-09-12T22:33:15.501 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0239999999999997e-06 2024-09-12T22:33:15.501 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.501 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.501 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:15.501 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423320+0000", 2024-09-12T22:33:15.501 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.67e-06 2024-09-12T22:33:15.501 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.501 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.501 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:15.502 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.468252+0000", 2024-09-12T22:33:15.502 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.044932262000000001 2024-09-12T22:33:15.502 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.502 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.502 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:15.502 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.468293+0000", 2024-09-12T22:33:15.502 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0368999999999999e-05 2024-09-12T22:33:15.502 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.502 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.502 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:15.502 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.468357+0000", 2024-09-12T22:33:15.502 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4287000000000003e-05 2024-09-12T22:33:15.502 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.503 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.503 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:15.503 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.472371+0000", 2024-09-12T22:33:15.503 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0040144350000000002 2024-09-12T22:33:15.503 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.503 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.503 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:15.503 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496507+0000", 2024-09-12T22:33:15.503 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.024135961000000001 2024-09-12T22:33:15.503 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.503 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.503 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:15.503 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496537+0000", 2024-09-12T22:33:15.504 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9611000000000002e-05 2024-09-12T22:33:15.504 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.504 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.504 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:15.504 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496556+0000", 2024-09-12T22:33:15.504 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9147000000000002e-05 2024-09-12T22:33:15.504 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:15.504 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:15.504 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:15.504 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.504 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.504 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1229 3.13 3:cb3d3880:::200.0000000d:head [write 1105566~1911 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:15.504 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.423606+0000", 2024-09-12T22:33:15.504 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.51628738399999996, 2024-09-12T22:33:15.505 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.073027876000000005, 2024-09-12T22:33:15.505 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:15.505 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:15.505 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:15.505 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:15.505 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.505 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:15.505 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423606+0000", 2024-09-12T22:33:15.505 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:15.505 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.505 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.505 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:15.505 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423606+0000", 2024-09-12T22:33:15.505 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:15.506 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.506 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.506 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:15.506 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423606+0000", 2024-09-12T22:33:15.506 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.7e-07 2024-09-12T22:33:15.506 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.506 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.506 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:15.506 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423609+0000", 2024-09-12T22:33:15.506 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5339999999999998e-06 2024-09-12T22:33:15.506 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.506 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.506 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:15.506 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423614+0000", 2024-09-12T22:33:15.507 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.69e-06 2024-09-12T22:33:15.507 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.507 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.507 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:15.507 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423617+0000", 2024-09-12T22:33:15.507 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4300000000000002e-06 2024-09-12T22:33:15.507 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.507 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.507 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:15.507 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.468606+0000", 2024-09-12T22:33:15.507 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.044988606 2024-09-12T22:33:15.507 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.507 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.507 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:15.508 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.468649+0000", 2024-09-12T22:33:15.508 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3414000000000001e-05 2024-09-12T22:33:15.508 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.508 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.508 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:15.508 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.468714+0000", 2024-09-12T22:33:15.508 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4857000000000006e-05 2024-09-12T22:33:15.508 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.508 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.508 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:15.508 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.472375+0000", 2024-09-12T22:33:15.508 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0036607330000000002 2024-09-12T22:33:15.508 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.508 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.509 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:15.509 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496585+0000", 2024-09-12T22:33:15.509 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.024210835 2024-09-12T22:33:15.509 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.509 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.509 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:15.509 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496612+0000", 2024-09-12T22:33:15.509 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6999999999999999e-05 2024-09-12T22:33:15.509 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.509 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.509 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:15.509 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496634+0000", 2024-09-12T22:33:15.509 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1307000000000001e-05 2024-09-12T22:33:15.509 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:15.509 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:15.510 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:15.510 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.510 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.510 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1230 3.13 3:cb3d3880:::200.0000000d:head [write 1107477~6537 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:15.510 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.423911+0000", 2024-09-12T22:33:15.510 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 0.51598253900000002, 2024-09-12T22:33:15.510 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.072794530999999996, 2024-09-12T22:33:15.510 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:15.510 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:15.510 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:15.510 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:15.510 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.510 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:15.511 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423911+0000", 2024-09-12T22:33:15.511 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:15.511 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.511 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.511 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:15.511 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423911+0000", 2024-09-12T22:33:15.511 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:15.511 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.511 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.511 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:15.511 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423911+0000", 2024-09-12T22:33:15.511 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3799999999999998e-07 2024-09-12T22:33:15.511 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.511 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.512 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:15.512 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423919+0000", 2024-09-12T22:33:15.512 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.8329999999999994e-06 2024-09-12T22:33:15.512 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.512 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.512 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:15.512 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423924+0000", 2024-09-12T22:33:15.512 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3449999999999996e-06 2024-09-12T22:33:15.512 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.512 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.512 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:15.512 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423928+0000", 2024-09-12T22:33:15.512 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2339999999999999e-06 2024-09-12T22:33:15.512 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.513 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.513 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:15.513 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.469042+0000", 2024-09-12T22:33:15.513 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.045114888999999998 2024-09-12T22:33:15.513 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.513 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.513 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:15.513 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.469092+0000", 2024-09-12T22:33:15.513 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9289000000000002e-05 2024-09-12T22:33:15.513 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.513 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.513 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:15.513 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.469163+0000", 2024-09-12T22:33:15.513 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1222000000000004e-05 2024-09-12T22:33:15.514 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.514 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.514 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:15.514 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.472379+0000", 2024-09-12T22:33:15.514 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0032156419999999999 2024-09-12T22:33:15.514 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.514 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.514 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:15.514 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496661+0000", 2024-09-12T22:33:15.514 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.024281857 2024-09-12T22:33:15.514 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.514 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.514 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:15.514 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496687+0000", 2024-09-12T22:33:15.515 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6551e-05 2024-09-12T22:33:15.515 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:15.515 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:15.515 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:15.515 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496705+0000", 2024-09-12T22:33:15.515 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.8230999999999999e-05 2024-09-12T22:33:15.515 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:15.515 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:15.515 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:15.515 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:15.515 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:15.515 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-09-12T22:33:15.516 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:33:15.524 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:15.518+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:15.620 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~29s 2024-09-12T22:33:15.621 INFO:tasks.workunit.client.0.smithi019.stdout:7/396: symlink d6/d14/d15/d62/d6a/l94 0 2024-09-12T22:33:15.621 INFO:tasks.workunit.client.0.smithi019.stdout:8/405: link d7/d34/c44 d7/d34/c81 0 2024-09-12T22:33:15.621 INFO:tasks.workunit.client.0.smithi019.stdout:3/388: link dd/c3d dd/c6c 0 2024-09-12T22:33:15.621 INFO:tasks.workunit.client.0.smithi019.stdout:1/542: mknod d3/d6e/da9/cb0 0 2024-09-12T22:33:15.621 INFO:tasks.workunit.client.0.smithi019.stdout:5/571: dwrite d0/f23 [0,4194304] 0 2024-09-12T22:33:15.621 INFO:tasks.workunit.client.0.smithi019.stdout:8/406: truncate d7/d2f/d42/f70 4895464 0 2024-09-12T22:33:15.621 INFO:tasks.workunit.client.0.smithi019.stdout:3/389: link dd/c43 dd/d1e/d5a/c6d 0 2024-09-12T22:33:15.621 INFO:tasks.workunit.client.0.smithi019.stdout:1/543: creat d3/d3f/d58/fb1 x:0 0 0 2024-09-12T22:33:15.622 INFO:tasks.workunit.client.0.smithi019.stdout:8/407: chown d7/d8/dd/d45/l50 545 1 2024-09-12T22:33:15.622 INFO:tasks.workunit.client.0.smithi019.stdout:6/489: dwrite d1b/d26/d39/f41 [0,4194304] 0 2024-09-12T22:33:15.622 INFO:tasks.workunit.client.0.smithi019.stdout:3/390: fsync dd/f16 0 2024-09-12T22:33:15.622 INFO:tasks.workunit.client.0.smithi019.stdout:1/544: chown d3/d6e/da9/cb0 42 1 2024-09-12T22:33:15.622 INFO:tasks.workunit.client.0.smithi019.stdout:8/408: truncate d7/d8/f7d 933660 0 2024-09-12T22:33:15.622 INFO:tasks.workunit.client.0.smithi019.stdout:8/409: stat d7/d8/dd/f2a 0 2024-09-12T22:33:15.622 INFO:tasks.workunit.client.0.smithi019.stdout:8/410: mkdir d7/d34/d78/d82 0 2024-09-12T22:33:15.622 INFO:tasks.workunit.client.0.smithi019.stdout:8/411: write d7/f13 [939095,100219] 0 2024-09-12T22:33:15.622 INFO:tasks.workunit.client.0.smithi019.stdout:3/391: dwrite dd/f33 [0,4194304] 0 2024-09-12T22:33:15.622 INFO:tasks.workunit.client.0.smithi019.stdout:8/412: creat d7/d34/d78/d2d/f83 x:0 0 0 2024-09-12T22:33:15.622 INFO:tasks.workunit.client.0.smithi019.stdout:8/413: write d7/d8/f1b [5229427,64309] 0 2024-09-12T22:33:15.622 INFO:tasks.workunit.client.0.smithi019.stdout:7/397: write d6/db/f1c [1569430,87459] 0 2024-09-12T22:33:15.622 INFO:tasks.workunit.client.0.smithi019.stdout:8/414: mkdir d7/d34/d78/d2d/d84 0 2024-09-12T22:33:15.623 INFO:tasks.workunit.client.0.smithi019.stdout:6/490: dread d1b/d26/d27/d3e/f64 [0,4194304] 0 2024-09-12T22:33:15.623 INFO:tasks.workunit.client.0.smithi019.stdout:6/491: unlink f0 0 2024-09-12T22:33:15.623 INFO:tasks.workunit.client.0.smithi019.stdout:7/398: chown d6/db/dc/d63/d4b 0 1 2024-09-12T22:33:15.623 INFO:tasks.workunit.client.0.smithi019.stdout:8/415: mknod d7/d8/dd/c85 0 2024-09-12T22:33:15.623 INFO:tasks.workunit.client.0.smithi019.stdout:6/492: rmdir d1b 39 2024-09-12T22:33:15.623 INFO:tasks.workunit.client.0.smithi019.stdout:3/392: dwrite dd/f11 [4194304,4194304] 0 2024-09-12T22:33:15.623 INFO:tasks.workunit.client.0.smithi019.stdout:1/545: read d3/d1b/f5d [4057146,115729] 0 2024-09-12T22:33:15.623 INFO:tasks.workunit.client.0.smithi019.stdout:7/399: unlink d6/d14/d15/d62/f86 0 2024-09-12T22:33:15.623 INFO:tasks.workunit.client.0.smithi019.stdout:8/416: truncate d7/d8/f4c 4067973 0 2024-09-12T22:33:15.623 INFO:tasks.workunit.client.0.smithi019.stdout:0/449: sync 2024-09-12T22:33:15.623 INFO:tasks.workunit.client.0.smithi019.stdout:6/493: sync 2024-09-12T22:33:15.623 INFO:tasks.workunit.client.0.smithi019.stdout:1/546: symlink d3/d3f/d77/lb2 0 2024-09-12T22:33:15.623 INFO:tasks.workunit.client.0.smithi019.stdout:0/450: mkdir d1/d14/d32/d71/d85 0 2024-09-12T22:33:15.623 INFO:tasks.workunit.client.0.smithi019.stdout:7/400: creat d6/db/dc/d63/d7f/f95 x:0 0 0 2024-09-12T22:33:15.624 INFO:tasks.workunit.client.0.smithi019.stdout:8/417: mknod d7/c86 0 2024-09-12T22:33:15.624 INFO:tasks.workunit.client.0.smithi019.stdout:1/547: chown d3/d6e/da9/d54 1196905 1 2024-09-12T22:33:15.624 INFO:tasks.workunit.client.0.smithi019.stdout:0/451: fdatasync d1/f1a 0 2024-09-12T22:33:15.624 INFO:tasks.workunit.client.0.smithi019.stdout:8/418: mkdir d7/d8/d43/d87 0 2024-09-12T22:33:15.624 INFO:tasks.workunit.client.0.smithi019.stdout:7/401: rename d6/f64 to d6/d2d/d41/f96 0 2024-09-12T22:33:15.624 INFO:tasks.workunit.client.0.smithi019.stdout:8/419: chown d7/d34/d78/c10 119610 1 2024-09-12T22:33:15.624 INFO:tasks.workunit.client.0.smithi019.stdout:0/452: symlink d1/d14/d32/d71/d85/l86 0 2024-09-12T22:33:15.624 INFO:tasks.workunit.client.0.smithi019.stdout:1/548: link d3/d1b/l22 d3/d3f/d58/lb3 0 2024-09-12T22:33:15.624 INFO:tasks.workunit.client.0.smithi019.stdout:8/420: write d7/f59 [1479210,22536] 0 2024-09-12T22:33:15.624 INFO:tasks.workunit.client.0.smithi019.stdout:1/549: fsync d3/d11/f2c 0 2024-09-12T22:33:15.624 INFO:tasks.workunit.client.0.smithi019.stdout:1/550: creat d3/d11/fb4 x:0 0 0 2024-09-12T22:33:15.624 INFO:tasks.workunit.client.0.smithi019.stdout:8/421: link d7/d2f/d42/c46 d7/d8/dd/d45/c88 0 2024-09-12T22:33:15.624 INFO:tasks.workunit.client.0.smithi019.stdout:5/572: sync 2024-09-12T22:33:15.625 INFO:tasks.workunit.client.0.smithi019.stdout:6/494: sync 2024-09-12T22:33:15.625 INFO:tasks.workunit.client.0.smithi019.stdout:1/551: write d3/d6e/da9/f6c [717424,104320] 0 2024-09-12T22:33:15.625 INFO:tasks.workunit.client.0.smithi019.stdout:8/422: mknod d7/d34/d78/c89 0 2024-09-12T22:33:15.625 INFO:tasks.workunit.client.0.smithi019.stdout:2/432: dread d0/da/f50 [0,4194304] 0 2024-09-12T22:33:15.625 INFO:tasks.workunit.client.0.smithi019.stdout:5/573: creat d0/d7/d2d/d4c/fc6 x:0 0 0 2024-09-12T22:33:15.625 INFO:tasks.workunit.client.0.smithi019.stdout:7/402: dwrite d6/d2d/d77/f89 [0,4194304] 0 2024-09-12T22:33:15.625 INFO:tasks.workunit.client.0.smithi019.stdout:1/552: mknod d3/d1b/cb5 0 2024-09-12T22:33:15.625 INFO:tasks.workunit.client.0.smithi019.stdout:7/403: chown d6/d14/d15/f28 226501609 1 2024-09-12T22:33:15.625 INFO:tasks.workunit.client.0.smithi019.stdout:8/423: mknod d7/d34/d78/d82/c8a 0 2024-09-12T22:33:15.625 INFO:tasks.workunit.client.0.smithi019.stdout:1/553: write d3/d11/f4f [255435,119344] 0 2024-09-12T22:33:15.625 INFO:tasks.workunit.client.0.smithi019.stdout:5/574: fsync d0/d7/f20 0 2024-09-12T22:33:15.625 INFO:tasks.workunit.client.0.smithi019.stdout:8/424: fsync d7/d5e/f6b 0 2024-09-12T22:33:15.625 INFO:tasks.workunit.client.0.smithi019.stdout:7/404: creat d6/d2d/d3d/d84/f97 x:0 0 0 2024-09-12T22:33:15.626 INFO:tasks.workunit.client.0.smithi019.stdout:3/393: truncate dd/d12/f15 1409913 0 2024-09-12T22:33:15.626 INFO:tasks.workunit.client.0.smithi019.stdout:8/425: mkdir d7/d34/d78/d2d/d84/d8b 0 2024-09-12T22:33:15.626 INFO:tasks.workunit.client.0.smithi019.stdout:6/495: dwrite d1b/d26/d27/d3e/f64 [0,4194304] 0 2024-09-12T22:33:15.626 INFO:tasks.workunit.client.0.smithi019.stdout:1/554: link d3/d11/d16/d3c/d55/f62 d3/df/d7e/d90/da4/fb6 0 2024-09-12T22:33:15.626 INFO:tasks.workunit.client.0.smithi019.stdout:5/575: mkdir d0/d7/d2d/d32/d36/d8c/db8/d39/d38/dba/dc7 0 2024-09-12T22:33:15.626 INFO:tasks.workunit.client.0.smithi019.stdout:2/433: dwrite d0/d5/d18/d3b/f8a [0,4194304] 0 2024-09-12T22:33:15.626 INFO:tasks.workunit.client.0.smithi019.stdout:4/425: dread d1/d8/f64 [0,4194304] 0 2024-09-12T22:33:15.626 INFO:tasks.workunit.client.0.smithi019.stdout:8/426: chown d7/d34/d78/d82/c8a 7297234 1 2024-09-12T22:33:15.626 INFO:tasks.workunit.client.0.smithi019.stdout:0/453: truncate d1/d14/d26/d40/d45/f54 1099847 0 2024-09-12T22:33:15.626 INFO:tasks.workunit.client.0.smithi019.stdout:7/405: creat d6/d14/d15/f98 x:0 0 0 2024-09-12T22:33:15.626 INFO:tasks.workunit.client.0.smithi019.stdout:2/434: creat d0/d5/d18/d39/f94 x:0 0 0 2024-09-12T22:33:15.626 INFO:tasks.workunit.client.0.smithi019.stdout:1/555: rename d3/d11 to d3/df/d7e/db7 0 2024-09-12T22:33:15.626 INFO:tasks.workunit.client.0.smithi019.stdout:0/454: symlink d1/d14/l87 0 2024-09-12T22:33:15.626 INFO:tasks.workunit.client.0.smithi019.stdout:4/426: write d1/d4/d38/f83 [776842,91633] 0 2024-09-12T22:33:15.627 INFO:tasks.workunit.client.0.smithi019.stdout:9/456: dread dd/d10/d17/d23/d2e/d31/d3f/f4b [0,4194304] 0 2024-09-12T22:33:15.627 INFO:tasks.workunit.client.0.smithi019.stdout:7/406: stat d6/db/dc/d63/d4b/f6f 0 2024-09-12T22:33:15.627 INFO:tasks.workunit.client.0.smithi019.stdout:8/427: write d7/d8/dd/f67 [510671,129249] 0 2024-09-12T22:33:15.627 INFO:tasks.workunit.client.0.smithi019.stdout:2/435: chown d0/d5/d18/d39/c46 1870 1 2024-09-12T22:33:15.627 INFO:tasks.workunit.client.0.smithi019.stdout:1/556: chown d3/df/d7e/db7/d53/f5b 1584611294 1 2024-09-12T22:33:15.627 INFO:tasks.workunit.client.0.smithi019.stdout:0/455: write d1/f65 [263788,47076] 0 2024-09-12T22:33:15.627 INFO:tasks.workunit.client.0.smithi019.stdout:5/576: fsync d0/d7/d2d/d32/d36/d8c/db8/d39/d38/f3f 0 2024-09-12T22:33:15.627 INFO:tasks.workunit.client.0.smithi019.stdout:9/457: rmdir dd/d10/d17/d23/d2e/d31 39 2024-09-12T22:33:15.627 INFO:tasks.workunit.client.0.smithi019.stdout:8/428: stat d7/d8/dd 0 2024-09-12T22:33:15.627 INFO:tasks.workunit.client.0.smithi019.stdout:4/427: rename d1/d22/d26/f29 to d1/d22/d57/f87 0 2024-09-12T22:33:15.627 INFO:tasks.workunit.client.0.smithi019.stdout:3/394: dwrite dd/d1e/f54 [0,4194304] 0 2024-09-12T22:33:15.627 INFO:tasks.workunit.client.0.smithi019.stdout:1/557: mkdir d3/df/d7e/db7/d16/d3c/db8 0 2024-09-12T22:33:15.627 INFO:tasks.workunit.client.0.smithi019.stdout:9/458: symlink dd/d10/d17/d23/d2e/d31/d3f/d47/d6e/l96 0 2024-09-12T22:33:15.628 INFO:tasks.workunit.client.0.smithi019.stdout:1/558: fdatasync d3/d6e/da9/d54/f61 0 2024-09-12T22:33:15.628 INFO:tasks.workunit.client.0.smithi019.stdout:3/395: getdents dd/d1e/d40/d5f 0 2024-09-12T22:33:15.628 INFO:tasks.workunit.client.0.smithi019.stdout:1/559: chown d3/df/d7e/db7/d16/d3c 112264114 1 2024-09-12T22:33:15.628 INFO:tasks.workunit.client.0.smithi019.stdout:1/560: chown d3/d6e/da9/f44 106 1 2024-09-12T22:33:15.628 INFO:tasks.workunit.client.0.smithi019.stdout:1/561: readlink d3/d3f/l57 0 2024-09-12T22:33:15.628 INFO:tasks.workunit.client.0.smithi019.stdout:7/407: truncate d6/db/f1c 7842462 0 2024-09-12T22:33:15.628 INFO:tasks.workunit.client.0.smithi019.stdout:4/428: truncate d1/d22/d26/f48 1675784 0 2024-09-12T22:33:15.628 INFO:tasks.workunit.client.0.smithi019.stdout:7/408: mkdir d6/d14/d2a/d99 0 2024-09-12T22:33:15.628 INFO:tasks.workunit.client.0.smithi019.stdout:1/562: symlink d3/d3f/d58/lb9 0 2024-09-12T22:33:15.628 INFO:tasks.workunit.client.0.smithi019.stdout:4/429: rename d1/f25 to d1/d4/f88 0 2024-09-12T22:33:15.628 INFO:tasks.workunit.client.0.smithi019.stdout:4/430: readlink d1/d8/l6a 0 2024-09-12T22:33:15.628 INFO:tasks.workunit.client.0.smithi019.stdout:1/563: creat d3/d3f/d77/fba x:0 0 0 2024-09-12T22:33:15.628 INFO:tasks.workunit.client.0.smithi019.stdout:3/396: dwrite dd/d1e/d5a/f6b [0,4194304] 0 2024-09-12T22:33:15.628 INFO:tasks.workunit.client.0.smithi019.stdout:9/459: dwrite dd/d10/d17/d23/d2e/d31/f34 [0,4194304] 0 2024-09-12T22:33:15.629 INFO:tasks.workunit.client.0.smithi019.stdout:4/431: truncate d1/d4/d38/f5e 1899735 0 2024-09-12T22:33:15.629 INFO:tasks.workunit.client.0.smithi019.stdout:3/397: mkdir dd/d1e/d40/d6e 0 2024-09-12T22:33:15.629 INFO:tasks.workunit.client.0.smithi019.stdout:9/460: read - dd/d10/d17/d23/d2e/d31/d54/f75 zero size 2024-09-12T22:33:15.629 INFO:tasks.workunit.client.0.smithi019.stdout:1/564: rename d3/df/d7e/db7/d53/c5c to d3/df/d7e/db7/d63/d76/d91/cbb 0 2024-09-12T22:33:15.629 INFO:tasks.workunit.client.0.smithi019.stdout:9/461: chown dd/d10/d17/d23/d2e/f92 6094 1 2024-09-12T22:33:15.629 INFO:tasks.workunit.client.0.smithi019.stdout:4/432: mknod d1/d11/d15/d65/d75/d5a/d79/c89 0 2024-09-12T22:33:15.629 INFO:tasks.workunit.client.0.smithi019.stdout:7/409: dwrite d6/d14/d45/f7e [4194304,4194304] 0 2024-09-12T22:33:15.629 INFO:tasks.workunit.client.0.smithi019.stdout:4/433: truncate d1/d22/d26/f43 570866 0 2024-09-12T22:33:15.629 INFO:tasks.workunit.client.0.smithi019.stdout:9/462: truncate dd/d10/d17/d22/f4f 822719 0 2024-09-12T22:33:15.629 INFO:tasks.workunit.client.0.smithi019.stdout:9/463: rmdir dd 39 2024-09-12T22:33:15.629 INFO:tasks.workunit.client.0.smithi019.stdout:4/434: dread - d1/d11/d15/d1f/f84 zero size 2024-09-12T22:33:15.629 INFO:tasks.workunit.client.0.smithi019.stdout:9/464: symlink dd/d10/d17/d22/d77/l97 0 2024-09-12T22:33:15.630 INFO:tasks.workunit.client.0.smithi019.stdout:4/435: getdents d1/d22/d57 0 2024-09-12T22:33:15.630 INFO:tasks.workunit.client.0.smithi019.stdout:7/410: dwrite d6/d2d/f83 [0,4194304] 0 2024-09-12T22:33:15.630 INFO:tasks.workunit.client.0.smithi019.stdout:7/411: sync 2024-09-12T22:33:15.630 INFO:tasks.workunit.client.0.smithi019.stdout:4/436: unlink d1/d22/d2c/c42 0 2024-09-12T22:33:15.630 INFO:tasks.workunit.client.0.smithi019.stdout:7/412: read d6/d2d/d41/f48 [147328,85811] 0 2024-09-12T22:33:15.630 INFO:tasks.workunit.client.0.smithi019.stdout:7/413: sync 2024-09-12T22:33:15.630 INFO:tasks.workunit.client.0.smithi019.stdout:9/465: truncate dd/d10/d17/d22/d6c/f74 787555 0 2024-09-12T22:33:15.630 INFO:tasks.workunit.client.0.smithi019.stdout:3/398: dwrite dd/d12/f24 [0,4194304] 0 2024-09-12T22:33:15.630 INFO:tasks.workunit.client.0.smithi019.stdout:4/437: creat d1/d11/d15/d65/d75/d5a/d79/f8a x:0 0 0 2024-09-12T22:33:15.630 INFO:tasks.workunit.client.0.smithi019.stdout:9/466: mknod dd/d10/d17/d22/d77/c98 0 2024-09-12T22:33:15.630 INFO:tasks.workunit.client.0.smithi019.stdout:3/399: read dd/d12/f30 [2071576,10229] 0 2024-09-12T22:33:15.630 INFO:tasks.workunit.client.0.smithi019.stdout:3/400: rename dd/d12/f15 to dd/d1e/d40/f6f 0 2024-09-12T22:33:15.630 INFO:tasks.workunit.client.0.smithi019.stdout:3/401: mkdir dd/d1e/d40/d6e/d70 0 2024-09-12T22:33:15.630 INFO:tasks.workunit.client.0.smithi019.stdout:7/414: truncate d6/d14/d45/d7c/f65 2518369 0 2024-09-12T22:33:15.631 INFO:tasks.workunit.client.0.smithi019.stdout:3/402: sync 2024-09-12T22:33:15.631 INFO:tasks.workunit.client.0.smithi019.stdout:4/438: write d1/d22/d26/f43 [566279,46077] 0 2024-09-12T22:33:15.631 INFO:tasks.workunit.client.0.smithi019.stdout:7/415: write d6/db/dc/d63/d7f/f95 [351151,69811] 0 2024-09-12T22:33:15.631 INFO:tasks.workunit.client.0.smithi019.stdout:9/467: dwrite dd/f18 [4194304,4194304] 0 2024-09-12T22:33:15.631 INFO:tasks.workunit.client.0.smithi019.stdout:4/439: creat d1/d11/d15/d65/d75/d5a/f8b x:0 0 0 2024-09-12T22:33:15.631 INFO:tasks.workunit.client.0.smithi019.stdout:7/416: link d6/d14/d2a/f82 d6/d2d/d41/f9a 0 2024-09-12T22:33:15.631 INFO:tasks.workunit.client.0.smithi019.stdout:4/440: fsync d1/d4/f6f 0 2024-09-12T22:33:15.631 INFO:tasks.workunit.client.0.smithi019.stdout:9/468: unlink dd/d10/d17/l3a 0 2024-09-12T22:33:15.631 INFO:tasks.workunit.client.0.smithi019.stdout:7/417: symlink d6/d14/d15/l9b 0 2024-09-12T22:33:15.631 INFO:tasks.workunit.client.0.smithi019.stdout:7/418: write d6/d14/d2a/f82 [2743393,64431] 0 2024-09-12T22:33:15.631 INFO:tasks.workunit.client.0.smithi019.stdout:7/419: mknod d6/db/d34/c9c 0 2024-09-12T22:33:15.631 INFO:tasks.workunit.client.0.smithi019.stdout:9/469: dwrite dd/f16 [4194304,4194304] 0 2024-09-12T22:33:15.631 INFO:tasks.workunit.client.0.smithi019.stdout:7/420: truncate d6/d14/d45/d7c/f65 2522401 0 2024-09-12T22:33:15.631 INFO:tasks.workunit.client.0.smithi019.stdout:4/441: dwrite d1/d11/d15/f78 [4194304,4194304] 0 2024-09-12T22:33:15.632 INFO:tasks.workunit.client.0.smithi019.stdout:0/456: dread d1/d14/d32/f35 [0,4194304] 0 2024-09-12T22:33:15.632 INFO:tasks.workunit.client.0.smithi019.stdout:0/457: sync 2024-09-12T22:33:15.632 INFO:tasks.workunit.client.0.smithi019.stdout:5/577: dread d0/d7/d2d/f54 [0,4194304] 0 2024-09-12T22:33:15.632 INFO:tasks.workunit.client.0.smithi019.stdout:4/442: creat d1/d11/d15/d65/f8c x:0 0 0 2024-09-12T22:33:15.632 INFO:tasks.workunit.client.0.smithi019.stdout:7/421: write d6/d14/d15/d62/d6a/f75 [546467,7474] 0 2024-09-12T22:33:15.632 INFO:tasks.workunit.client.0.smithi019.stdout:5/578: fsync d0/d7/d16/d18/f73 0 2024-09-12T22:33:15.632 INFO:tasks.workunit.client.0.smithi019.stdout:4/443: chown d1/d4/d38/f5e 22313063 1 2024-09-12T22:33:15.632 INFO:tasks.workunit.client.0.smithi019.stdout:7/422: rename d6/d2d/d3d/d84/f97 to d6/db/dc/d63/d7f/f9d 0 2024-09-12T22:33:15.632 INFO:tasks.workunit.client.0.smithi019.stdout:8/429: dread d7/f59 [0,4194304] 0 2024-09-12T22:33:15.632 INFO:tasks.workunit.client.0.smithi019.stdout:4/444: symlink d1/d22/d31/d4f/l8d 0 2024-09-12T22:33:15.632 INFO:tasks.workunit.client.0.smithi019.stdout:4/445: chown d1/d22/d57 13506 1 2024-09-12T22:33:15.632 INFO:tasks.workunit.client.0.smithi019.stdout:0/458: dwrite d1/d14/d1b/f4b [0,4194304] 0 2024-09-12T22:33:15.632 INFO:tasks.workunit.client.0.smithi019.stdout:4/446: fdatasync d1/d8/f14 0 2024-09-12T22:33:15.633 INFO:tasks.workunit.client.0.smithi019.stdout:4/447: readlink d1/d8/l6a 0 2024-09-12T22:33:15.633 INFO:tasks.workunit.client.0.smithi019.stdout:4/448: symlink d1/d11/d15/d81/l8e 0 2024-09-12T22:33:15.633 INFO:tasks.workunit.client.0.smithi019.stdout:8/430: dwrite d7/d34/f38 [0,4194304] 0 2024-09-12T22:33:15.633 INFO:tasks.workunit.client.0.smithi019.stdout:0/459: dread d1/d1f/f77 [0,4194304] 0 2024-09-12T22:33:15.633 INFO:tasks.workunit.client.0.smithi019.stdout:7/423: truncate d6/d2d/f83 1691172 0 2024-09-12T22:33:15.633 INFO:tasks.workunit.client.0.smithi019.stdout:8/431: chown d7/d8/dd/f2a 695811708 1 2024-09-12T22:33:15.633 INFO:tasks.workunit.client.0.smithi019.stdout:7/424: readlink d6/d14/d15/l67 0 2024-09-12T22:33:15.633 INFO:tasks.workunit.client.0.smithi019.stdout:8/432: write d7/d8/f2e [4084179,121224] 0 2024-09-12T22:33:15.633 INFO:tasks.workunit.client.0.smithi019.stdout:0/460: rmdir d1/d14/d1b/d3a/d69 0 2024-09-12T22:33:15.633 INFO:tasks.workunit.client.0.smithi019.stdout:8/433: dread - d7/d34/d78/d2d/f79 zero size 2024-09-12T22:33:15.633 INFO:tasks.workunit.client.0.smithi019.stdout:0/461: rename d1/d14/c21 to d1/c88 0 2024-09-12T22:33:15.633 INFO:tasks.workunit.client.0.smithi019.stdout:8/434: symlink d7/d34/l8c 0 2024-09-12T22:33:15.633 INFO:tasks.workunit.client.0.smithi019.stdout:4/449: truncate d1/d11/d15/d1f/f52 7515538 0 2024-09-12T22:33:15.634 INFO:tasks.workunit.client.0.smithi019.stdout:8/435: stat d7/d34/d78/c39 0 2024-09-12T22:33:15.634 INFO:tasks.workunit.client.0.smithi019.stdout:4/450: rmdir d1/d22/d26 39 2024-09-12T22:33:15.634 INFO:tasks.workunit.client.0.smithi019.stdout:3/403: dread dd/f26 [0,4194304] 0 2024-09-12T22:33:15.634 INFO:tasks.workunit.client.0.smithi019.stdout:8/436: creat d7/d34/d78/d82/f8d x:0 0 0 2024-09-12T22:33:15.634 INFO:tasks.workunit.client.0.smithi019.stdout:5/579: read d0/d7/d16/f2a [1327178,59027] 0 2024-09-12T22:33:15.634 INFO:tasks.workunit.client.0.smithi019.stdout:4/451: symlink d1/d4/d44/l8f 0 2024-09-12T22:33:15.634 INFO:tasks.workunit.client.0.smithi019.stdout:7/425: dwrite d6/f31 [0,4194304] 0 2024-09-12T22:33:15.634 INFO:tasks.workunit.client.0.smithi019.stdout:1/565: dread d3/f4d [0,4194304] 0 2024-09-12T22:33:15.634 INFO:tasks.workunit.client.0.smithi019.stdout:5/580: creat d0/d7/d2d/d32/d36/d8c/db8/d39/d38/dba/fc8 x:0 0 0 2024-09-12T22:33:15.634 INFO:tasks.workunit.client.0.smithi019.stdout:0/462: dwrite d1/d14/f36 [0,4194304] 0 2024-09-12T22:33:15.634 INFO:tasks.workunit.client.0.smithi019.stdout:8/437: rename d7/d8/dd/l7e to d7/d8/l8e 0 2024-09-12T22:33:15.634 INFO:tasks.workunit.client.0.smithi019.stdout:4/452: write d1/d11/d15/d1f/f52 [2364283,120815] 0 2024-09-12T22:33:15.634 INFO:tasks.workunit.client.0.smithi019.stdout:1/566: unlink d3/df/d7e/d90/da4/fb6 0 2024-09-12T22:33:15.634 INFO:tasks.workunit.client.0.smithi019.stdout:5/581: chown d0/d7/d2d/d32/d36/d6a/da0/fb7 6857133 1 2024-09-12T22:33:15.635 INFO:tasks.workunit.client.0.smithi019.stdout:8/438: truncate d7/d34/d78/d2d/f83 415793 0 2024-09-12T22:33:15.635 INFO:tasks.workunit.client.0.smithi019.stdout:8/439: creat d7/d8/d43/f8f x:0 0 0 2024-09-12T22:33:15.635 INFO:tasks.workunit.client.0.smithi019.stdout:3/404: dread dd/d1e/d40/f41 [0,4194304] 0 2024-09-12T22:33:15.635 INFO:tasks.workunit.client.0.smithi019.stdout:5/582: write d0/d7/d2d/d32/d36/d8c/db8/d39/d38/f95 [26874,11475] 0 2024-09-12T22:33:15.635 INFO:tasks.workunit.client.0.smithi019.stdout:6/496: dread d1b/d26/d27/d3e/f49 [0,4194304] 0 2024-09-12T22:33:15.635 INFO:tasks.workunit.client.0.smithi019.stdout:9/470: fdatasync dd/f18 0 2024-09-12T22:33:15.635 INFO:tasks.workunit.client.0.smithi019.stdout:0/463: read d1/d1d/f76 [1091885,84486] 0 2024-09-12T22:33:15.635 INFO:tasks.workunit.client.0.smithi019.stdout:5/583: rename d0/d7/d16/f70 to d0/d7/d16/d69/fc9 0 2024-09-12T22:33:15.635 INFO:tasks.workunit.client.0.smithi019.stdout:0/464: rmdir d1/d14/d1b 39 2024-09-12T22:33:15.635 INFO:tasks.workunit.client.0.smithi019.stdout:9/471: fdatasync dd/d10/d17/d23/d37/f5a 0 2024-09-12T22:33:15.635 INFO:tasks.workunit.client.0.smithi019.stdout:1/567: dwrite d3/d3f/d58/f6f [0,4194304] 0 2024-09-12T22:33:15.635 INFO:tasks.workunit.client.0.smithi019.stdout:4/453: dread d1/d22/d57/f87 [4194304,4194304] 0 2024-09-12T22:33:15.635 INFO:tasks.workunit.client.0.smithi019.stdout:2/436: dread d0/d5/f26 [0,4194304] 0 2024-09-12T22:33:15.635 INFO:tasks.workunit.client.0.smithi019.stdout:9/472: write dd/d10/d17/d23/f49 [1771584,14693] 0 2024-09-12T22:33:15.636 INFO:tasks.workunit.client.0.smithi019.stdout:6/497: truncate d1b/d26/d27/d67/d77/f8f 1478637 0 2024-09-12T22:33:15.636 INFO:tasks.workunit.client.0.smithi019.stdout:5/584: getdents d0/d7/d2d/d32/d36/d8c/db8/d9a 0 2024-09-12T22:33:15.636 INFO:tasks.workunit.client.0.smithi019.stdout:9/473: rename dd/l1e to dd/d10/d17/d23/d2e/l99 0 2024-09-12T22:33:15.636 INFO:tasks.workunit.client.0.smithi019.stdout:6/498: write d1b/d26/d27/d67/d77/f78 [389057,107861] 0 2024-09-12T22:33:15.636 INFO:tasks.workunit.client.0.smithi019.stdout:5/585: fsync d0/d7/d2d/d32/d36/d8c/db8/d39/d38/f55 0 2024-09-12T22:33:15.636 INFO:tasks.workunit.client.0.smithi019.stdout:0/465: dwrite d1/d14/d26/f50 [0,4194304] 0 2024-09-12T22:33:15.636 INFO:tasks.workunit.client.0.smithi019.stdout:6/499: mknod d1b/d26/d39/d89/d90/cae 0 2024-09-12T22:33:15.636 INFO:tasks.workunit.client.0.smithi019.stdout:0/466: stat d1/d14/d26/c81 0 2024-09-12T22:33:15.636 INFO:tasks.workunit.client.0.smithi019.stdout:4/454: dwrite d1/d22/d26/f37 [0,4194304] 0 2024-09-12T22:33:15.636 INFO:tasks.workunit.client.0.smithi019.stdout:5/586: symlink d0/d7/d2d/d32/d36/d8c/db8/d24/lca 0 2024-09-12T22:33:15.636 INFO:tasks.workunit.client.0.smithi019.stdout:6/500: dread - d1b/d26/d31/f9b zero size 2024-09-12T22:33:15.636 INFO:tasks.workunit.client.0.smithi019.stdout:0/467: write d1/d14/d1b/f4b [209344,27929] 0 2024-09-12T22:33:15.636 INFO:tasks.workunit.client.0.smithi019.stdout:4/455: symlink d1/d11/d15/d1f/l90 0 2024-09-12T22:33:15.637 INFO:tasks.workunit.client.0.smithi019.stdout:0/468: stat d1/fd 0 2024-09-12T22:33:15.637 INFO:tasks.workunit.client.0.smithi019.stdout:6/501: mknod d1b/d26/d27/d67/d77/d95/caf 0 2024-09-12T22:33:15.637 INFO:tasks.workunit.client.0.smithi019.stdout:5/587: symlink d0/d7/d2d/d4c/d87/lcb 0 2024-09-12T22:33:15.637 INFO:tasks.workunit.client.0.smithi019.stdout:0/469: write d1/d51/f56 [2163180,36605] 0 2024-09-12T22:33:15.637 INFO:tasks.workunit.client.0.smithi019.stdout:6/502: creat d1b/d26/d27/d67/d77/d95/fb0 x:0 0 0 2024-09-12T22:33:15.637 INFO:tasks.workunit.client.0.smithi019.stdout:9/474: truncate dd/d10/d17/d23/d37/f5b 2273343 0 2024-09-12T22:33:15.637 INFO:tasks.workunit.client.0.smithi019.stdout:0/470: mkdir d1/d14/d32/d89 0 2024-09-12T22:33:15.637 INFO:tasks.workunit.client.0.smithi019.stdout:5/588: creat d0/d7/d2d/d32/d36/d8c/db5/fcc x:0 0 0 2024-09-12T22:33:15.637 INFO:tasks.workunit.client.0.smithi019.stdout:9/475: write dd/f18 [1978215,54915] 0 2024-09-12T22:33:15.637 INFO:tasks.workunit.client.0.smithi019.stdout:6/503: creat d1b/d26/d39/d6a/fb1 x:0 0 0 2024-09-12T22:33:15.637 INFO:tasks.workunit.client.0.smithi019.stdout:6/504: chown d1b/d26/d27/d3e/d83/dac 46669 1 2024-09-12T22:33:15.637 INFO:tasks.workunit.client.0.smithi019.stdout:8/440: dwrite d7/d8/f73 [0,4194304] 0 2024-09-12T22:33:15.637 INFO:tasks.workunit.client.0.smithi019.stdout:5/589: dread - d0/d7/d2d/d32/d36/d8c/db8/fab zero size 2024-09-12T22:33:15.638 INFO:tasks.workunit.client.0.smithi019.stdout:9/476: chown dd/d10/d17/d23/d2e/d31/d54 12755505 1 2024-09-12T22:33:15.638 INFO:tasks.workunit.client.0.smithi019.stdout:6/505: creat d1b/d26/d27/d67/d77/d95/fb2 x:0 0 0 2024-09-12T22:33:15.638 INFO:tasks.workunit.client.0.smithi019.stdout:5/590: mkdir d0/d7/d2d/d32/dcd 0 2024-09-12T22:33:15.638 INFO:tasks.workunit.client.0.smithi019.stdout:0/471: truncate d1/d1f/d5b/f61 9220219 0 2024-09-12T22:33:15.638 INFO:tasks.workunit.client.0.smithi019.stdout:9/477: unlink dd/d10/d17/d22/d42/c7f 0 2024-09-12T22:33:15.638 INFO:tasks.workunit.client.0.smithi019.stdout:8/441: creat d7/d34/d78/d2d/d84/d8b/f90 x:0 0 0 2024-09-12T22:33:15.638 INFO:tasks.workunit.client.0.smithi019.stdout:6/506: readlink d1b/d26/d39/d6a/l66 0 2024-09-12T22:33:15.638 INFO:tasks.workunit.client.0.smithi019.stdout:0/472: chown d1/c7 109964 1 2024-09-12T22:33:15.638 INFO:tasks.workunit.client.0.smithi019.stdout:9/478: rename dd/f16 to dd/d10/d17/d22/f9a 0 2024-09-12T22:33:15.638 INFO:tasks.workunit.client.0.smithi019.stdout:6/507: readlink d1b/d26/d31/d5f/l72 0 2024-09-12T22:33:15.638 INFO:tasks.workunit.client.0.smithi019.stdout:7/426: sync 2024-09-12T22:33:15.638 INFO:tasks.workunit.client.0.smithi019.stdout:1/568: sync 2024-09-12T22:33:15.638 INFO:tasks.workunit.client.0.smithi019.stdout:8/442: truncate d7/d34/f52 1648711 0 2024-09-12T22:33:15.639 INFO:tasks.workunit.client.0.smithi019.stdout:6/508: chown d1b/d26/d39/d6a/l66 62139792 1 2024-09-12T22:33:15.639 INFO:tasks.workunit.client.0.smithi019.stdout:5/591: rename d0/d7/d16/d18/d9d/la9 to d0/d7/d16/lce 0 2024-09-12T22:33:15.639 INFO:tasks.workunit.client.0.smithi019.stdout:1/569: fsync d3/d3f/f2d 0 2024-09-12T22:33:15.639 INFO:tasks.workunit.client.0.smithi019.stdout:0/473: write d1/d1f/f41 [2187862,123104] 0 2024-09-12T22:33:15.639 INFO:tasks.workunit.client.0.smithi019.stdout:1/570: mknod d3/df/cbc 0 2024-09-12T22:33:15.639 INFO:tasks.workunit.client.0.smithi019.stdout:7/427: rename d6/db/dc/d26 to d6/d14/d15/d9e 0 2024-09-12T22:33:15.639 INFO:tasks.workunit.client.0.smithi019.stdout:0/474: write d1/d1f/f57 [319625,10464] 0 2024-09-12T22:33:15.639 INFO:tasks.workunit.client.0.smithi019.stdout:5/592: rename d0/d7/d2d/d32/d36/d8c/db8/d24/l88 to d0/d7/d2d/d4c/lcf 0 2024-09-12T22:33:15.639 INFO:tasks.workunit.client.0.smithi019.stdout:0/475: rmdir d1/d14/d26/d40/d45 39 2024-09-12T22:33:15.639 INFO:tasks.workunit.client.0.smithi019.stdout:2/437: dread d0/f1f [0,4194304] 0 2024-09-12T22:33:15.639 INFO:tasks.workunit.client.0.smithi019.stdout:7/428: write d6/d14/d15/f24 [271550,64781] 0 2024-09-12T22:33:15.639 INFO:tasks.workunit.client.0.smithi019.stdout:1/571: mkdir d3/df/d7e/db7/d16/d3c/dbd 0 2024-09-12T22:33:15.639 INFO:tasks.workunit.client.0.smithi019.stdout:9/479: write dd/d10/d17/d23/d2e/d31/d3f/d47/d6e/f8a [531953,103600] 0 2024-09-12T22:33:15.639 INFO:tasks.workunit.client.0.smithi019.stdout:5/593: fdatasync d0/f49 0 2024-09-12T22:33:15.640 INFO:tasks.workunit.client.0.smithi019.stdout:6/509: truncate fb 198150 0 2024-09-12T22:33:15.640 INFO:tasks.workunit.client.0.smithi019.stdout:8/443: dwrite d7/f6f [0,4194304] 0 2024-09-12T22:33:15.640 INFO:tasks.workunit.client.0.smithi019.stdout:6/510: dread - d1b/d26/d39/d6a/d97/fa6 zero size 2024-09-12T22:33:15.640 INFO:tasks.workunit.client.0.smithi019.stdout:4/456: dread d1/d22/d26/f48 [0,4194304] 0 2024-09-12T22:33:15.640 INFO:tasks.workunit.client.0.smithi019.stdout:6/511: readlink d1b/d26/d39/d6a/l66 0 2024-09-12T22:33:15.640 INFO:tasks.workunit.client.0.smithi019.stdout:1/572: rename d3/df/c80 to d3/df/d7e/db7/cbe 0 2024-09-12T22:33:15.640 INFO:tasks.workunit.client.0.smithi019.stdout:2/438: rename d0/d41 to d0/d5/d18/d5c/d85/d95 0 2024-09-12T22:33:15.640 INFO:tasks.workunit.client.0.smithi019.stdout:1/573: fsync d3/d3f/f30 0 2024-09-12T22:33:15.640 INFO:tasks.workunit.client.0.smithi019.stdout:7/429: dread d6/db/d42/f59 [0,4194304] 0 2024-09-12T22:33:15.640 INFO:tasks.workunit.client.0.smithi019.stdout:8/444: rename d7/f2c to d7/d5e/f91 0 2024-09-12T22:33:15.640 INFO:tasks.workunit.client.0.smithi019.stdout:1/574: fdatasync d3/df/d7e/db7/d63/d76/d91/f8b 0 2024-09-12T22:33:15.640 INFO:tasks.workunit.client.0.smithi019.stdout:4/457: link d1/d11/d15/d49/c61 d1/d4c/c91 0 2024-09-12T22:33:15.640 INFO:tasks.workunit.client.0.smithi019.stdout:8/445: unlink d7/d34/f5f 0 2024-09-12T22:33:15.641 INFO:tasks.workunit.client.0.smithi019.stdout:2/439: unlink d0/d5/d18/f3e 0 2024-09-12T22:33:15.641 INFO:tasks.workunit.client.0.smithi019.stdout:5/594: dwrite d0/d7/d2d/d32/d36/d8c/db8/d39/f63 [0,4194304] 0 2024-09-12T22:33:15.641 INFO:tasks.workunit.client.0.smithi019.stdout:4/458: creat d1/d11/d15/d81/f92 x:0 0 0 2024-09-12T22:33:15.641 INFO:tasks.workunit.client.0.smithi019.stdout:6/512: dwrite d1b/d26/d27/d3e/f64 [0,4194304] 0 2024-09-12T22:33:15.641 INFO:tasks.workunit.client.0.smithi019.stdout:9/480: dwrite dd/d10/d17/d23/d2e/d31/d3f/d47/d6e/f8a [0,4194304] 0 2024-09-12T22:33:15.641 INFO:tasks.workunit.client.0.smithi019.stdout:1/575: mknod d3/df/d7e/db7/d16/d3c/dbd/cbf 0 2024-09-12T22:33:15.641 INFO:tasks.workunit.client.0.smithi019.stdout:5/595: chown d0/d7/d2d/d4c/f83 12751 1 2024-09-12T22:33:15.641 INFO:tasks.workunit.client.0.smithi019.stdout:4/459: mknod d1/d11/d15/d65/c93 0 2024-09-12T22:33:15.641 INFO:tasks.workunit.client.0.smithi019.stdout:1/576: unlink d3/d3f/f24 0 2024-09-12T22:33:15.641 INFO:tasks.workunit.client.0.smithi019.stdout:8/446: getdents d7/d8/dd 0 2024-09-12T22:33:15.641 INFO:tasks.workunit.client.0.smithi019.stdout:6/513: write d1b/d26/d39/d6a/f92 [716590,55606] 0 2024-09-12T22:33:15.641 INFO:tasks.workunit.client.0.smithi019.stdout:4/460: unlink d1/d22/c3e 0 2024-09-12T22:33:15.641 INFO:tasks.workunit.client.0.smithi019.stdout:3/405: dread dd/f31 [0,4194304] 0 2024-09-12T22:33:15.641 INFO:tasks.workunit.client.0.smithi019.stdout:1/577: chown d3/d6e/caf 402108175 1 2024-09-12T22:33:15.642 INFO:tasks.workunit.client.0.smithi019.stdout:9/481: write dd/d10/d17/d22/f6a [512323,56293] 0 2024-09-12T22:33:15.642 INFO:tasks.workunit.client.0.smithi019.stdout:7/430: dwrite d6/d2d/d41/f48 [0,4194304] 0 2024-09-12T22:33:15.642 INFO:tasks.workunit.client.0.smithi019.stdout:8/447: creat d7/d2f/d42/f92 x:0 0 0 2024-09-12T22:33:15.642 INFO:tasks.workunit.client.0.smithi019.stdout:4/461: creat d1/d4/d38/f94 x:0 0 0 2024-09-12T22:33:15.642 INFO:tasks.workunit.client.0.smithi019.stdout:5/596: write d0/d7/d2d/d32/d36/d8c/db8/d39/d38/dba/fc8 [700296,61392] 0 2024-09-12T22:33:15.642 INFO:tasks.workunit.client.0.smithi019.stdout:8/448: creat d7/d2f/d42/f93 x:0 0 0 2024-09-12T22:33:15.642 INFO:tasks.workunit.client.0.smithi019.stdout:1/578: fsync d3/d6e/da9/f44 0 2024-09-12T22:33:15.642 INFO:tasks.workunit.client.0.smithi019.stdout:2/440: dwrite d0/d5/d18/d3b/f49 [4194304,4194304] 0 2024-09-12T22:33:15.642 INFO:tasks.workunit.client.0.smithi019.stdout:1/579: creat d3/df/d7e/fc0 x:0 0 0 2024-09-12T22:33:15.642 INFO:tasks.workunit.client.0.smithi019.stdout:2/441: creat d0/d5/d60/d74/d7e/f96 x:0 0 0 2024-09-12T22:33:15.642 INFO:tasks.workunit.client.0.smithi019.stdout:1/580: chown d3/l4a 3463 1 2024-09-12T22:33:15.642 INFO:tasks.workunit.client.0.smithi019.stdout:3/406: dwrite dd/f17 [0,4194304] 0 2024-09-12T22:33:15.642 INFO:tasks.workunit.client.0.smithi019.stdout:1/581: write d3/d3f/d58/f93 [537560,88340] 0 2024-09-12T22:33:15.643 INFO:tasks.workunit.client.0.smithi019.stdout:4/462: dwrite d1/d8/f45 [0,4194304] 0 2024-09-12T22:33:15.643 INFO:tasks.workunit.client.0.smithi019.stdout:7/431: dwrite d6/db/dc/f43 [0,4194304] 0 2024-09-12T22:33:15.643 INFO:tasks.workunit.client.0.smithi019.stdout:0/476: dread d1/d14/f4e [0,4194304] 0 2024-09-12T22:33:15.643 INFO:tasks.workunit.client.0.smithi019.stdout:2/442: chown d0/d5/d18/d39/f94 1 1 2024-09-12T22:33:15.643 INFO:tasks.workunit.client.0.smithi019.stdout:5/597: dread d0/d7/d2d/f54 [0,4194304] 0 2024-09-12T22:33:15.643 INFO:tasks.workunit.client.0.smithi019.stdout:7/432: dread - d6/d2d/d77/f79 zero size 2024-09-12T22:33:15.643 INFO:tasks.workunit.client.0.smithi019.stdout:2/443: fsync d0/d5/d18/d39/f94 0 2024-09-12T22:33:15.643 INFO:tasks.workunit.client.0.smithi019.stdout:4/463: write d1/f24 [6413804,25288] 0 2024-09-12T22:33:15.643 INFO:tasks.workunit.client.0.smithi019.stdout:2/444: creat d0/d5/d18/d39/f97 x:0 0 0 2024-09-12T22:33:15.643 INFO:tasks.workunit.client.0.smithi019.stdout:0/477: mknod d1/d14/d32/d89/c8a 0 2024-09-12T22:33:15.643 INFO:tasks.workunit.client.0.smithi019.stdout:7/433: link d6/db/dc/f71 d6/d14/d15/d62/f9f 0 2024-09-12T22:33:15.643 INFO:tasks.workunit.client.0.smithi019.stdout:0/478: creat d1/d1f/f8b x:0 0 0 2024-09-12T22:33:15.643 INFO:tasks.workunit.client.0.smithi019.stdout:0/479: mkdir d1/d14/d1b/d3a/d8c 0 2024-09-12T22:33:15.643 INFO:tasks.workunit.client.0.smithi019.stdout:5/598: truncate d0/d7/d2d/d32/d36/d8c/db8/d39/d38/f44 4744201 0 2024-09-12T22:33:15.644 INFO:tasks.workunit.client.0.smithi019.stdout:4/464: dwrite d1/d11/f86 [0,4194304] 0 2024-09-12T22:33:15.644 INFO:tasks.workunit.client.0.smithi019.stdout:5/599: mkdir d0/dd0 0 2024-09-12T22:33:15.644 INFO:tasks.workunit.client.0.smithi019.stdout:4/465: creat d1/d4/d44/f95 x:0 0 0 2024-09-12T22:33:15.644 INFO:tasks.workunit.client.0.smithi019.stdout:4/466: readlink d1/d22/d31/l62 0 2024-09-12T22:33:15.644 INFO:tasks.workunit.client.0.smithi019.stdout:2/445: dwrite d0/d5/f26 [4194304,4194304] 0 2024-09-12T22:33:15.644 INFO:tasks.workunit.client.0.smithi019.stdout:0/480: dwrite d1/d14/d32/f35 [0,4194304] 0 2024-09-12T22:33:15.644 INFO:tasks.workunit.client.0.smithi019.stdout:2/446: rename d0/d5/f26 to d0/d5/d18/d5c/d85/f98 0 2024-09-12T22:33:15.644 INFO:tasks.workunit.client.0.smithi019.stdout:0/481: unlink d1/d14/d26/c30 0 2024-09-12T22:33:15.644 INFO:tasks.workunit.client.0.smithi019.stdout:2/447: creat d0/da/f99 x:0 0 0 2024-09-12T22:33:15.644 INFO:tasks.workunit.client.0.smithi019.stdout:0/482: mknod d1/d14/d26/d40/d45/c8d 0 2024-09-12T22:33:15.644 INFO:tasks.workunit.client.0.smithi019.stdout:6/514: dread d1b/f3c [0,4194304] 0 2024-09-12T22:33:15.644 INFO:tasks.workunit.client.0.smithi019.stdout:2/448: chown d0/d5/d18/d1b/d5d/f80 1496 1 2024-09-12T22:33:15.644 INFO:tasks.workunit.client.0.smithi019.stdout:6/515: stat d1b/d26/d39/d6a/f58 0 2024-09-12T22:33:15.645 INFO:tasks.workunit.client.0.smithi019.stdout:6/516: symlink d1b/d26/d39/lb3 0 2024-09-12T22:33:15.645 INFO:tasks.workunit.client.0.smithi019.stdout:6/517: chown d1b/d26/d39/l69 0 1 2024-09-12T22:33:15.645 INFO:tasks.workunit.client.0.smithi019.stdout:0/483: dread d1/d14/f36 [0,4194304] 0 2024-09-12T22:33:15.645 INFO:tasks.workunit.client.0.smithi019.stdout:6/518: truncate d1b/d26/f96 1032760 0 2024-09-12T22:33:15.645 INFO:tasks.workunit.client.0.smithi019.stdout:6/519: dread - d1b/d26/d39/fa0 zero size 2024-09-12T22:33:15.645 INFO:tasks.workunit.client.0.smithi019.stdout:2/449: dwrite d0/da/d73/d7c/f82 [0,4194304] 0 2024-09-12T22:33:15.645 INFO:tasks.workunit.client.0.smithi019.stdout:6/520: mkdir d1b/db4 0 2024-09-12T22:33:15.645 INFO:tasks.workunit.client.0.smithi019.stdout:8/449: sync 2024-09-12T22:33:15.645 INFO:tasks.workunit.client.0.smithi019.stdout:0/484: sync 2024-09-12T22:33:15.645 INFO:tasks.workunit.client.0.smithi019.stdout:8/450: write d7/d8/f4c [3760960,89917] 0 2024-09-12T22:33:15.645 INFO:tasks.workunit.client.0.smithi019.stdout:0/485: creat d1/d14/d32/d89/f8e x:0 0 0 2024-09-12T22:33:15.645 INFO:tasks.workunit.client.0.smithi019.stdout:6/521: dwrite d1b/f20 [4194304,4194304] 0 2024-09-12T22:33:15.645 INFO:tasks.workunit.client.0.smithi019.stdout:8/451: write d7/d34/d78/f17 [5929890,57612] 0 2024-09-12T22:33:15.646 INFO:tasks.workunit.client.0.smithi019.stdout:8/452: readlink d7/d34/d78/l6c 0 2024-09-12T22:33:15.646 INFO:tasks.workunit.client.0.smithi019.stdout:2/450: truncate d0/da/d73/d7c/f82 789199 0 2024-09-12T22:33:15.646 INFO:tasks.workunit.client.0.smithi019.stdout:6/522: creat d1b/fb5 x:0 0 0 2024-09-12T22:33:15.646 INFO:tasks.workunit.client.0.smithi019.stdout:8/453: rename c1 to d7/d8/dd/c94 0 2024-09-12T22:33:15.646 INFO:tasks.workunit.client.0.smithi019.stdout:6/523: fdatasync d1b/d26/d39/d6a/f57 0 2024-09-12T22:33:15.646 INFO:tasks.workunit.client.0.smithi019.stdout:0/486: fsync d1/d14/d32/d89/f8e 0 2024-09-12T22:33:15.646 INFO:tasks.workunit.client.0.smithi019.stdout:8/454: readlink d7/d34/d78/l6c 0 2024-09-12T22:33:15.646 INFO:tasks.workunit.client.0.smithi019.stdout:2/451: stat d0/d5/d18/d5c/d85/d95/c6c 0 2024-09-12T22:33:15.646 INFO:tasks.workunit.client.0.smithi019.stdout:8/455: rmdir d7 39 2024-09-12T22:33:15.646 INFO:tasks.workunit.client.0.smithi019.stdout:2/452: unlink d0/da/f31 0 2024-09-12T22:33:15.646 INFO:tasks.workunit.client.0.smithi019.stdout:5/600: dread d0/f7e [0,4194304] 0 2024-09-12T22:33:15.646 INFO:tasks.workunit.client.0.smithi019.stdout:8/456: getdents d7/d34 0 2024-09-12T22:33:15.646 INFO:tasks.workunit.client.0.smithi019.stdout:8/457: creat d7/d34/d78/d54/f95 x:0 0 0 2024-09-12T22:33:15.647 INFO:tasks.workunit.client.0.smithi019.stdout:6/524: read d1b/d26/d39/d6a/d61/f62 [1249886,118348] 0 2024-09-12T22:33:15.647 INFO:tasks.workunit.client.0.smithi019.stdout:5/601: rename d0/d7/d2d/d32/d36/d8c/db8/d39/d38/cbf to d0/d7/d2d/cd1 0 2024-09-12T22:33:15.647 INFO:tasks.workunit.client.0.smithi019.stdout:2/453: read d0/d5/d18/d1b/d5d/f80 [410822,99379] 0 2024-09-12T22:33:15.647 INFO:tasks.workunit.client.0.smithi019.stdout:0/487: dwrite d1/f2c [0,4194304] 0 2024-09-12T22:33:15.647 INFO:tasks.workunit.client.0.smithi019.stdout:9/482: dread dd/f20 [0,4194304] 0 2024-09-12T22:33:15.647 INFO:tasks.workunit.client.0.smithi019.stdout:1/582: dread d3/d1b/f1d [4194304,4194304] 0 2024-09-12T22:33:15.647 INFO:tasks.workunit.client.0.smithi019.stdout:2/454: readlink d0/d5/d18/d5c/l6e 0 2024-09-12T22:33:15.647 INFO:tasks.workunit.client.0.smithi019.stdout:6/525: mkdir d1b/d26/d27/db6 0 2024-09-12T22:33:15.647 INFO:tasks.workunit.client.0.smithi019.stdout:0/488: unlink d1/d1d/l23 0 2024-09-12T22:33:15.647 INFO:tasks.workunit.client.0.smithi019.stdout:5/602: write d0/d7/d2d/d32/d36/d8c/db8/d39/d38/dba/fc8 [117755,84448] 0 2024-09-12T22:33:15.647 INFO:tasks.workunit.client.0.smithi019.stdout:6/526: read - d1b/f7d zero size 2024-09-12T22:33:15.647 INFO:tasks.workunit.client.0.smithi019.stdout:9/483: chown dd/d10/d17/d23/d2e/d31/d3f/f4b 0 1 2024-09-12T22:33:15.647 INFO:tasks.workunit.client.0.smithi019.stdout:2/455: fsync d0/d5/d18/d1b/d5d/d86/f61 0 2024-09-12T22:33:15.647 INFO:tasks.workunit.client.0.smithi019.stdout:0/489: fsync d1/d14/d32/f6e 0 2024-09-12T22:33:15.648 INFO:tasks.workunit.client.0.smithi019.stdout:9/484: fsync dd/d10/d17/d22/f3e 0 2024-09-12T22:33:15.648 INFO:tasks.workunit.client.0.smithi019.stdout:2/456: creat d0/d5/d18/d1b/d36/f9a x:0 0 0 2024-09-12T22:33:15.648 INFO:tasks.workunit.client.0.smithi019.stdout:6/527: rename d1b/l28 to d1b/d26/d39/d89/d90/lb7 0 2024-09-12T22:33:15.648 INFO:tasks.workunit.client.0.smithi019.stdout:9/485: chown dd/d10/d17/d23/d37 367514414 1 2024-09-12T22:33:15.648 INFO:tasks.workunit.client.0.smithi019.stdout:3/407: dread dd/f13 [0,4194304] 0 2024-09-12T22:33:15.648 INFO:tasks.workunit.client.0.smithi019.stdout:8/458: dwrite d7/d8/f4c [0,4194304] 0 2024-09-12T22:33:15.648 INFO:tasks.workunit.client.0.smithi019.stdout:6/528: creat d1b/d26/d27/d3e/d83/d98/fb8 x:0 0 0 2024-09-12T22:33:15.648 INFO:tasks.workunit.client.0.smithi019.stdout:8/459: stat d7/d34/d78/c89 0 2024-09-12T22:33:15.648 INFO:tasks.workunit.client.0.smithi019.stdout:3/408: fdatasync dd/d1e/f34 0 2024-09-12T22:33:15.648 INFO:tasks.workunit.client.0.smithi019.stdout:7/434: dread d6/f21 [4194304,4194304] 0 2024-09-12T22:33:15.648 INFO:tasks.workunit.client.0.smithi019.stdout:2/457: link d0/d5/d18/d39/f97 d0/d5/d18/d3b/f9b 0 2024-09-12T22:33:15.648 INFO:tasks.workunit.client.0.smithi019.stdout:1/583: sync 2024-09-12T22:33:15.648 INFO:tasks.workunit.client.0.smithi019.stdout:6/529: unlink d1b/d26/d39/d6a/d61/f6b 0 2024-09-12T22:33:15.649 INFO:tasks.workunit.client.0.smithi019.stdout:8/460: sync 2024-09-12T22:33:15.649 INFO:tasks.workunit.client.0.smithi019.stdout:7/435: fdatasync d6/db/f92 0 2024-09-12T22:33:15.649 INFO:tasks.workunit.client.0.smithi019.stdout:3/409: write dd/d1e/d5a/f5b [2229089,80166] 0 2024-09-12T22:33:15.649 INFO:tasks.workunit.client.0.smithi019.stdout:5/603: dwrite d0/d7/d2d/d32/d36/d8c/db8/d39/d38/f5c [4194304,4194304] 0 2024-09-12T22:33:15.649 INFO:tasks.workunit.client.0.smithi019.stdout:2/458: mkdir d0/d5/d17/d91/d9c 0 2024-09-12T22:33:15.649 INFO:tasks.workunit.client.0.smithi019.stdout:0/490: dwrite d1/d1f/f57 [0,4194304] 0 2024-09-12T22:33:15.649 INFO:tasks.workunit.client.0.smithi019.stdout:5/604: mkdir d0/d7/d2d/d4c/d87/dd2 0 2024-09-12T22:33:15.649 INFO:tasks.workunit.client.0.smithi019.stdout:9/486: dwrite dd/d10/d17/d23/d2e/f92 [0,4194304] 0 2024-09-12T22:33:15.649 INFO:tasks.workunit.client.0.smithi019.stdout:7/436: mkdir d6/db/dc/d63/d7f/da0 0 2024-09-12T22:33:15.649 INFO:tasks.workunit.client.0.smithi019.stdout:2/459: creat d0/d5/d60/f9d x:0 0 0 2024-09-12T22:33:15.649 INFO:tasks.workunit.client.0.smithi019.stdout:4/467: dread d1/d22/d57/f6e [0,4194304] 0 2024-09-12T22:33:15.649 INFO:tasks.workunit.client.0.smithi019.stdout:5/605: stat d0/d7/d2d/d32/d36/d8c/db8/d39/d38/d4b/ca8 0 2024-09-12T22:33:15.649 INFO:tasks.workunit.client.0.smithi019.stdout:2/460: creat d0/d5/d60/d74/f9e x:0 0 0 2024-09-12T22:33:15.649 INFO:tasks.workunit.client.0.smithi019.stdout:7/437: write d6/d14/d45/f7e [1394748,18245] 0 2024-09-12T22:33:15.650 INFO:tasks.workunit.client.0.smithi019.stdout:8/461: dwrite d7/f13 [0,4194304] 0 2024-09-12T22:33:15.650 INFO:tasks.workunit.client.0.smithi019.stdout:4/468: fdatasync d1/d11/d15/f2e 0 2024-09-12T22:33:15.650 INFO:tasks.workunit.client.0.smithi019.stdout:1/584: dwrite d3/df/d7e/db7/d16/f99 [0,4194304] 0 2024-09-12T22:33:15.650 INFO:tasks.workunit.client.0.smithi019.stdout:3/410: dwrite dd/d12/f48 [0,4194304] 0 2024-09-12T22:33:15.650 INFO:tasks.workunit.client.0.smithi019.stdout:2/461: mknod d0/d5/d18/d1b/d8d/c9f 0 2024-09-12T22:33:15.650 INFO:tasks.workunit.client.0.smithi019.stdout:6/530: dwrite d1b/d26/d39/d6a/f60 [0,4194304] 0 2024-09-12T22:33:15.650 INFO:tasks.workunit.client.0.smithi019.stdout:4/469: mknod d1/d22/d2c/c96 0 2024-09-12T22:33:15.650 INFO:tasks.workunit.client.0.smithi019.stdout:0/491: dwrite d1/d14/d32/f5f [0,4194304] 0 2024-09-12T22:33:15.650 INFO:tasks.workunit.client.0.smithi019.stdout:8/462: chown d7/d8/d43/f8f 2 1 2024-09-12T22:33:15.650 INFO:tasks.workunit.client.0.smithi019.stdout:2/462: mkdir d0/d5/d60/da0 0 2024-09-12T22:33:15.650 INFO:tasks.workunit.client.0.smithi019.stdout:4/470: mknod d1/d11/d15/d1f/c97 0 2024-09-12T22:33:15.650 INFO:tasks.workunit.client.0.smithi019.stdout:7/438: write d6/d14/d15/d62/d6a/f75 [154620,10651] 0 2024-09-12T22:33:15.650 INFO:tasks.workunit.client.0.smithi019.stdout:9/487: dread dd/d10/d17/d23/d2e/f92 [0,4194304] 0 2024-09-12T22:33:15.650 INFO:tasks.workunit.client.0.smithi019.stdout:0/492: chown d1/d14/f36 0 1 2024-09-12T22:33:15.651 INFO:tasks.workunit.client.0.smithi019.stdout:3/411: chown dd/d1e/d40/f41 80 1 2024-09-12T22:33:15.651 INFO:tasks.workunit.client.0.smithi019.stdout:8/463: symlink d7/d34/d78/d53/l96 0 2024-09-12T22:33:15.651 INFO:tasks.workunit.client.0.smithi019.stdout:1/585: creat d3/df/d7e/db7/d16/d3c/d55/da0/fc1 x:0 0 0 2024-09-12T22:33:15.651 INFO:tasks.workunit.client.0.smithi019.stdout:9/488: rmdir dd/d10/d17/d23 39 2024-09-12T22:33:15.651 INFO:tasks.workunit.client.0.smithi019.stdout:3/412: unlink dd/f28 0 2024-09-12T22:33:15.651 INFO:tasks.workunit.client.0.smithi019.stdout:0/493: write d1/d1f/d5b/f61 [7313867,105950] 0 2024-09-12T22:33:15.651 INFO:tasks.workunit.client.0.smithi019.stdout:5/606: dwrite d0/d7/d16/d18/f86 [0,4194304] 0 2024-09-12T22:33:15.651 INFO:tasks.workunit.client.0.smithi019.stdout:6/531: getdents d1b/d26/d39/d6a/d61 0 2024-09-12T22:33:15.651 INFO:tasks.workunit.client.0.smithi019.stdout:9/489: chown dd/l1b 572203 1 2024-09-12T22:33:15.651 INFO:tasks.workunit.client.0.smithi019.stdout:1/586: stat d3/d1b/l49 0 2024-09-12T22:33:15.651 INFO:tasks.workunit.client.0.smithi019.stdout:7/439: creat d6/d2d/d3d/fa1 x:0 0 0 2024-09-12T22:33:15.651 INFO:tasks.workunit.client.0.smithi019.stdout:2/463: getdents d0/d5/d17/d91 0 2024-09-12T22:33:15.651 INFO:tasks.workunit.client.0.smithi019.stdout:8/464: creat d7/d8/dd/d4f/f97 x:0 0 0 2024-09-12T22:33:15.652 INFO:tasks.workunit.client.0.smithi019.stdout:3/413: mknod dd/d1e/d40/d6e/c71 0 2024-09-12T22:33:15.652 INFO:tasks.workunit.client.0.smithi019.stdout:2/464: fdatasync d0/f48 0 2024-09-12T22:33:15.652 INFO:tasks.workunit.client.0.smithi019.stdout:6/532: mknod d1b/d26/d31/cb9 0 2024-09-12T22:33:15.652 INFO:tasks.workunit.client.0.smithi019.stdout:9/490: symlink dd/d10/d17/d23/d2e/d31/d7e/l9b 0 2024-09-12T22:33:15.652 INFO:tasks.workunit.client.0.smithi019.stdout:0/494: getdents d1/d14/d26/d40 0 2024-09-12T22:33:15.652 INFO:tasks.workunit.client.0.smithi019.stdout:8/465: read - d7/d34/d78/d54/f95 zero size 2024-09-12T22:33:15.652 INFO:tasks.workunit.client.0.smithi019.stdout:3/414: symlink dd/d12/d62/d6a/l72 0 2024-09-12T22:33:15.652 INFO:tasks.workunit.client.0.smithi019.stdout:9/491: chown dd/d10/d17/d23/d2e/d31/d3f/d67/c8f 1192 1 2024-09-12T22:33:15.652 INFO:tasks.workunit.client.0.smithi019.stdout:0/495: fdatasync d1/d14/d32/f35 0 2024-09-12T22:33:15.652 INFO:tasks.workunit.client.0.smithi019.stdout:3/415: write dd/d1e/f54 [2834952,69897] 0 2024-09-12T22:33:15.652 INFO:tasks.workunit.client.0.smithi019.stdout:5/607: dwrite d0/d7/d16/d18/f57 [0,4194304] 0 2024-09-12T22:33:15.652 INFO:tasks.workunit.client.0.smithi019.stdout:9/492: creat dd/d10/d17/d22/d6c/d53/d69/f9c x:0 0 0 2024-09-12T22:33:15.652 INFO:tasks.workunit.client.0.smithi019.stdout:7/440: dwrite d6/d14/d15/d62/d6a/f75 [0,4194304] 0 2024-09-12T22:33:15.653 INFO:tasks.workunit.client.0.smithi019.stdout:6/533: dwrite d1b/d2d/f48 [0,4194304] 0 2024-09-12T22:33:15.653 INFO:tasks.workunit.client.0.smithi019.stdout:2/465: dwrite d0/d5/d18/f56 [0,4194304] 0 2024-09-12T22:33:15.653 INFO:tasks.workunit.client.0.smithi019.stdout:5/608: link d0/d7/d16/f2a d0/d7/d2d/fd3 0 2024-09-12T22:33:15.653 INFO:tasks.workunit.client.0.smithi019.stdout:7/441: fdatasync d6/d14/d15/f6d 0 2024-09-12T22:33:15.653 INFO:tasks.workunit.client.0.smithi019.stdout:2/466: chown d0/da/f37 443 1 2024-09-12T22:33:15.653 INFO:tasks.workunit.client.0.smithi019.stdout:2/467: chown d0/d5/d17/d91/d9c 252 1 2024-09-12T22:33:15.653 INFO:tasks.workunit.client.0.smithi019.stdout:7/442: creat d6/d2d/d3d/d84/fa2 x:0 0 0 2024-09-12T22:33:15.653 INFO:tasks.workunit.client.0.smithi019.stdout:8/466: dwrite d7/d8/dd/f55 [4194304,4194304] 0 2024-09-12T22:33:15.653 INFO:tasks.workunit.client.0.smithi019.stdout:2/468: dread - d0/d5/d18/d3b/f9b zero size 2024-09-12T22:33:15.653 INFO:tasks.workunit.client.0.smithi019.stdout:1/587: truncate d3/df/d7e/db7/d16/f3b 3185568 0 2024-09-12T22:33:15.653 INFO:tasks.workunit.client.0.smithi019.stdout:0/496: truncate d1/f2c 620203 0 2024-09-12T22:33:15.653 INFO:tasks.workunit.client.0.smithi019.stdout:7/443: unlink d6/db/dc/d63/d4b/c80 0 2024-09-12T22:33:15.653 INFO:tasks.workunit.client.0.smithi019.stdout:3/416: write dd/f20 [1597664,52156] 0 2024-09-12T22:33:15.654 INFO:tasks.workunit.client.0.smithi019.stdout:8/467: chown d7/d34/d78/c10 19 1 2024-09-12T22:33:15.654 INFO:tasks.workunit.client.0.smithi019.stdout:1/588: mknod d3/d3f/d58/d7f/cc2 0 2024-09-12T22:33:15.654 INFO:tasks.workunit.client.0.smithi019.stdout:9/493: dwrite dd/d10/d17/d22/d6c/d53/f5c [0,4194304] 0 2024-09-12T22:33:15.654 INFO:tasks.workunit.client.0.smithi019.stdout:6/534: dwrite d1b/d26/d39/f41 [0,4194304] 0 2024-09-12T22:33:15.654 INFO:tasks.workunit.client.0.smithi019.stdout:7/444: symlink d6/d14/d15/d62/la3 0 2024-09-12T22:33:15.654 INFO:tasks.workunit.client.0.smithi019.stdout:8/468: write d7/d8/f2e [8974986,115811] 0 2024-09-12T22:33:15.654 INFO:tasks.workunit.client.0.smithi019.stdout:3/417: mknod dd/c73 0 2024-09-12T22:33:15.654 INFO:tasks.workunit.client.0.smithi019.stdout:1/589: unlink d3/d6e/da9/c40 0 2024-09-12T22:33:15.654 INFO:tasks.workunit.client.0.smithi019.stdout:7/445: unlink d6/db/f49 0 2024-09-12T22:33:15.654 INFO:tasks.workunit.client.0.smithi019.stdout:6/535: symlink d1b/d26/d27/d3e/d83/d98/lba 0 2024-09-12T22:33:15.654 INFO:tasks.workunit.client.0.smithi019.stdout:3/418: mkdir dd/d12/d62/d74 0 2024-09-12T22:33:15.654 INFO:tasks.workunit.client.0.smithi019.stdout:9/494: getdents dd 0 2024-09-12T22:33:15.654 INFO:tasks.workunit.client.0.smithi019.stdout:8/469: getdents d7/d34/d78/d54 0 2024-09-12T22:33:15.654 INFO:tasks.workunit.client.0.smithi019.stdout:1/590: mkdir d3/df/d7e/db7/d53/dc3 0 2024-09-12T22:33:15.655 INFO:tasks.workunit.client.0.smithi019.stdout:8/470: truncate d7/f1d 845971 0 2024-09-12T22:33:15.655 INFO:tasks.workunit.client.0.smithi019.stdout:0/497: dwrite d1/d1f/d5b/f61 [4194304,4194304] 0 2024-09-12T22:33:15.655 INFO:tasks.workunit.client.0.smithi019.stdout:2/469: dwrite d0/d5/d18/d5c/f78 [0,4194304] 0 2024-09-12T22:33:15.655 INFO:tasks.workunit.client.0.smithi019.stdout:2/470: symlink d0/d5/d60/d74/d7e/la1 0 2024-09-12T22:33:15.655 INFO:tasks.workunit.client.0.smithi019.stdout:3/419: dwrite dd/d1e/d40/f4a [0,4194304] 0 2024-09-12T22:33:15.655 INFO:tasks.workunit.client.0.smithi019.stdout:9/495: dwrite dd/d10/d17/d22/f95 [0,4194304] 0 2024-09-12T22:33:15.655 INFO:tasks.workunit.client.0.smithi019.stdout:2/471: chown d0/d5/d18/c2a 10786 1 2024-09-12T22:33:15.655 INFO:tasks.workunit.client.0.smithi019.stdout:6/536: dwrite d1b/d26/d27/d67/d77/d95/fb2 [0,4194304] 0 2024-09-12T22:33:15.655 INFO:tasks.workunit.client.0.smithi019.stdout:8/471: dread d7/f13 [0,4194304] 0 2024-09-12T22:33:15.655 INFO:tasks.workunit.client.0.smithi019.stdout:7/446: rename d6/db to d6/d14/d2a/da4 0 2024-09-12T22:33:15.655 INFO:tasks.workunit.client.0.smithi019.stdout:3/420: write dd/d1e/f3c [786013,20529] 0 2024-09-12T22:33:15.655 INFO:tasks.workunit.client.0.smithi019.stdout:0/498: dwrite d1/d14/f1e [0,4194304] 0 2024-09-12T22:33:15.655 INFO:tasks.workunit.client.0.smithi019.stdout:8/472: read - d7/d8/f64 zero size 2024-09-12T22:33:15.656 INFO:tasks.workunit.client.0.smithi019.stdout:1/591: rename d3/df/d7e/db7/d53 to d3/df/d7e/db7/d16/d3c/dbd/dc4 0 2024-09-12T22:33:15.656 INFO:tasks.workunit.client.0.smithi019.stdout:7/447: mknod d6/d14/d45/d7c/ca5 0 2024-09-12T22:33:15.656 INFO:tasks.workunit.client.0.smithi019.stdout:3/421: mknod dd/d1e/d40/d5f/c75 0 2024-09-12T22:33:15.656 INFO:tasks.workunit.client.0.smithi019.stdout:0/499: symlink d1/d14/d26/l8f 0 2024-09-12T22:33:15.656 INFO:tasks.workunit.client.0.smithi019.stdout:9/496: getdents dd/d10/d17/d22/d6c 0 2024-09-12T22:33:15.656 INFO:tasks.workunit.client.0.smithi019.stdout:8/473: chown d7/d2f/d42/f6a 969873350 1 2024-09-12T22:33:15.656 INFO:tasks.workunit.client.0.smithi019.stdout:0/500: readlink d1/d14/d32/l4f 0 2024-09-12T22:33:15.656 INFO:tasks.workunit.client.0.smithi019.stdout:2/472: truncate d0/f57 1634564 0 2024-09-12T22:33:15.656 INFO:tasks.workunit.client.0.smithi019.stdout:1/592: getdents d3/df/d7e/d90/da4 0 2024-09-12T22:33:15.656 INFO:tasks.workunit.client.0.smithi019.stdout:6/537: dwrite d1b/d2d/f48 [0,4194304] 0 2024-09-12T22:33:15.656 INFO:tasks.workunit.client.0.smithi019.stdout:9/497: mkdir dd/d10/d17/d22/d6c/d53/d69/d9d 0 2024-09-12T22:33:15.656 INFO:tasks.workunit.client.0.smithi019.stdout:2/473: creat d0/d5/d60/d74/fa2 x:0 0 0 2024-09-12T22:33:15.656 INFO:tasks.workunit.client.0.smithi019.stdout:0/501: creat d1/d14/d1b/d3a/d8c/f90 x:0 0 0 2024-09-12T22:33:15.656 INFO:tasks.workunit.client.0.smithi019.stdout:1/593: mknod d3/df/d7e/cc5 0 2024-09-12T22:33:15.657 INFO:tasks.workunit.client.0.smithi019.stdout:9/498: write dd/d10/d17/d22/f6a [12470,11591] 0 2024-09-12T22:33:15.657 INFO:tasks.workunit.client.0.smithi019.stdout:6/538: read - d1b/d26/d27/d3e/f6d zero size 2024-09-12T22:33:15.657 INFO:tasks.workunit.client.0.smithi019.stdout:0/502: mkdir d1/d14/d26/d40/d91 0 2024-09-12T22:33:15.657 INFO:tasks.workunit.client.0.smithi019.stdout:1/594: chown d3/d3f/l2f 0 1 2024-09-12T22:33:15.657 INFO:tasks.workunit.client.0.smithi019.stdout:6/539: symlink d1b/d26/d39/d89/lbb 0 2024-09-12T22:33:15.657 INFO:tasks.workunit.client.0.smithi019.stdout:0/503: write d1/d1d/f76 [291510,94524] 0 2024-09-12T22:33:15.657 INFO:tasks.workunit.client.0.smithi019.stdout:9/499: dread - dd/d10/d17/d22/d6c/d53/d69/f9c zero size 2024-09-12T22:33:15.657 INFO:tasks.workunit.client.0.smithi019.stdout:1/595: mkdir d3/d3f/d58/dc6 0 2024-09-12T22:33:15.657 INFO:tasks.workunit.client.0.smithi019.stdout:0/504: creat d1/d14/f92 x:0 0 0 2024-09-12T22:33:15.657 INFO:tasks.workunit.client.0.smithi019.stdout:6/540: read - d1b/d26/d27/d67/d77/d95/fa3 zero size 2024-09-12T22:33:15.657 INFO:tasks.workunit.client.0.smithi019.stdout:6/541: mknod d1b/cbc 0 2024-09-12T22:33:15.657 INFO:tasks.workunit.client.0.smithi019.stdout:0/505: dread - d1/d14/d32/d89/f8e zero size 2024-09-12T22:33:15.657 INFO:tasks.workunit.client.0.smithi019.stdout:6/542: write d1b/f7d [567904,3968] 0 2024-09-12T22:33:15.658 INFO:tasks.workunit.client.0.smithi019.stdout:8/474: truncate d7/f19 21532 0 2024-09-12T22:33:15.658 INFO:tasks.workunit.client.0.smithi019.stdout:4/471: dread d1/d22/d57/f5d [0,4194304] 0 2024-09-12T22:33:15.658 INFO:tasks.workunit.client.0.smithi019.stdout:8/475: mkdir d7/d2f/d42/d98 0 2024-09-12T22:33:15.658 INFO:tasks.workunit.client.0.smithi019.stdout:6/543: rmdir d1b/d26/d27/d3e/d83/dac 0 2024-09-12T22:33:15.658 INFO:tasks.workunit.client.0.smithi019.stdout:4/472: rename d1/d4c/c91 to d1/d22/c98 0 2024-09-12T22:33:15.658 INFO:tasks.workunit.client.0.smithi019.stdout:8/476: getdents d7/d2f/d75 0 2024-09-12T22:33:15.658 INFO:tasks.workunit.client.0.smithi019.stdout:6/544: creat d1b/d26/d27/d3e/d83/fbd x:0 0 0 2024-09-12T22:33:15.658 INFO:tasks.workunit.client.0.smithi019.stdout:4/473: fdatasync d1/d8/f64 0 2024-09-12T22:33:15.658 INFO:tasks.workunit.client.0.smithi019.stdout:7/448: truncate d6/d2d/d77/f89 1518629 0 2024-09-12T22:33:15.658 INFO:tasks.workunit.client.0.smithi019.stdout:8/477: fdatasync d7/f1d 0 2024-09-12T22:33:15.658 INFO:tasks.workunit.client.0.smithi019.stdout:1/596: getdents d3/d3f/d58 0 2024-09-12T22:33:15.658 INFO:tasks.workunit.client.0.smithi019.stdout:6/545: chown d1b/d26/d39/f41 0 1 2024-09-12T22:33:15.658 INFO:tasks.workunit.client.0.smithi019.stdout:4/474: getdents d1/d22/d31 0 2024-09-12T22:33:15.659 INFO:tasks.workunit.client.0.smithi019.stdout:6/546: sync 2024-09-12T22:33:15.659 INFO:tasks.workunit.client.0.smithi019.stdout:8/478: mknod d7/d2f/d75/c99 0 2024-09-12T22:33:15.659 INFO:tasks.workunit.client.0.smithi019.stdout:8/479: creat d7/d8/d43/f9a x:0 0 0 2024-09-12T22:33:15.659 INFO:tasks.workunit.client.0.smithi019.stdout:6/547: symlink d1b/d26/d27/lbe 0 2024-09-12T22:33:15.659 INFO:tasks.workunit.client.0.smithi019.stdout:8/480: read d7/d8/f2e [4135280,35649] 0 2024-09-12T22:33:15.659 INFO:tasks.workunit.client.0.smithi019.stdout:8/481: write d7/d34/d78/d2d/f79 [767806,53517] 0 2024-09-12T22:33:15.659 INFO:tasks.workunit.client.0.smithi019.stdout:1/597: dwrite d3/d6e/da9/f28 [0,4194304] 0 2024-09-12T22:33:15.659 INFO:tasks.workunit.client.0.smithi019.stdout:8/482: read d7/d5e/f60 [154871,47295] 0 2024-09-12T22:33:15.659 INFO:tasks.workunit.client.0.smithi019.stdout:8/483: creat d7/d2f/d75/f9b x:0 0 0 2024-09-12T22:33:15.659 INFO:tasks.workunit.client.0.smithi019.stdout:0/506: truncate d1/d14/d26/d40/f52 1681876 0 2024-09-12T22:33:15.659 INFO:tasks.workunit.client.0.smithi019.stdout:7/449: dread d6/d14/d15/d9e/f50 [0,4194304] 0 2024-09-12T22:33:15.659 INFO:tasks.workunit.client.0.smithi019.stdout:0/507: write d1/d14/d32/f43 [1491417,22078] 0 2024-09-12T22:33:15.659 INFO:tasks.workunit.client.0.smithi019.stdout:7/450: rmdir d6/d14/d2a/da4/dc/d63/d7f 39 2024-09-12T22:33:15.659 INFO:tasks.workunit.client.0.smithi019.stdout:0/508: symlink d1/d14/d1b/d3a/d8c/l93 0 2024-09-12T22:33:15.660 INFO:tasks.workunit.client.0.smithi019.stdout:7/451: rename d6/f31 to d6/d14/d45/fa6 0 2024-09-12T22:33:15.660 INFO:tasks.workunit.client.0.smithi019.stdout:7/452: readlink d6/d14/d2a/da4/d42/l6c 0 2024-09-12T22:33:15.660 INFO:tasks.workunit.client.0.smithi019.stdout:0/509: dread - d1/d14/d26/d40/d45/d5e/f66 zero size 2024-09-12T22:33:15.660 INFO:tasks.workunit.client.0.smithi019.stdout:1/598: dwrite d3/df/d7e/db7/d16/f86 [0,4194304] 0 2024-09-12T22:33:15.660 INFO:tasks.workunit.client.0.smithi019.stdout:7/453: dwrite d6/d14/d2a/da4/d34/f7b [0,4194304] 0 2024-09-12T22:33:15.660 INFO:tasks.workunit.client.0.smithi019.stdout:7/454: read - d6/d14/d15/d62/f91 zero size 2024-09-12T22:33:15.660 INFO:tasks.workunit.client.0.smithi019.stdout:7/455: write d6/d14/d2a/da4/dc/f43 [520969,4984] 0 2024-09-12T22:33:15.660 INFO:tasks.workunit.client.0.smithi019.stdout:6/548: write d1b/d26/d39/f53 [1138452,83634] 0 2024-09-12T22:33:15.660 INFO:tasks.workunit.client.0.smithi019.stdout:7/456: mknod d6/d14/d2a/da4/dc/d63/ca7 0 2024-09-12T22:33:15.660 INFO:tasks.workunit.client.0.smithi019.stdout:7/457: symlink d6/d14/d15/la8 0 2024-09-12T22:33:15.660 INFO:tasks.workunit.client.0.smithi019.stdout:6/549: creat d1b/d26/d27/d67/d77/d7b/fbf x:0 0 0 2024-09-12T22:33:15.660 INFO:tasks.workunit.client.0.smithi019.stdout:7/458: mknod d6/d2d/d3d/ca9 0 2024-09-12T22:33:15.660 INFO:tasks.workunit.client.0.smithi019.stdout:6/550: unlink d1b/d26/d39/lb3 0 2024-09-12T22:33:15.661 INFO:tasks.workunit.client.0.smithi019.stdout:6/551: write d1b/f7d [1104558,71832] 0 2024-09-12T22:33:15.661 INFO:tasks.workunit.client.0.smithi019.stdout:7/459: creat d6/d14/d2a/da4/d42/faa x:0 0 0 2024-09-12T22:33:15.661 INFO:tasks.workunit.client.0.smithi019.stdout:7/460: fdatasync d6/d2d/d77/f79 0 2024-09-12T22:33:15.661 INFO:tasks.workunit.client.0.smithi019.stdout:6/552: creat d1b/d2d/fc0 x:0 0 0 2024-09-12T22:33:15.661 INFO:tasks.workunit.client.0.smithi019.stdout:7/461: readlink d6/d14/d15/d62/d6a/l81 0 2024-09-12T22:33:15.661 INFO:tasks.workunit.client.0.smithi019.stdout:6/553: fsync d1b/d26/d39/d6a/f60 0 2024-09-12T22:33:15.661 INFO:tasks.workunit.client.0.smithi019.stdout:1/599: truncate d3/df/d7e/db7/f36 1419635 0 2024-09-12T22:33:15.661 INFO:tasks.workunit.client.0.smithi019.stdout:6/554: chown d1b/d2d/f55 8 1 2024-09-12T22:33:15.661 INFO:tasks.workunit.client.0.smithi019.stdout:7/462: mkdir d6/d2d/d41/dab 0 2024-09-12T22:33:15.661 INFO:tasks.workunit.client.0.smithi019.stdout:1/600: mknod d3/d3f/d58/dc6/cc7 0 2024-09-12T22:33:15.661 INFO:tasks.workunit.client.0.smithi019.stdout:6/555: rename d1b/d2d/c2e to d1b/d2d/cc1 0 2024-09-12T22:33:15.661 INFO:tasks.workunit.client.0.smithi019.stdout:7/463: readlink d6/d14/d2a/da4/l52 0 2024-09-12T22:33:15.661 INFO:tasks.workunit.client.0.smithi019.stdout:1/601: dread - d3/df/d7e/db7/d16/d3c/d55/da0/fc1 zero size 2024-09-12T22:33:15.661 INFO:tasks.workunit.client.0.smithi019.stdout:6/556: symlink d1b/d26/lc2 0 2024-09-12T22:33:15.662 INFO:tasks.workunit.client.0.smithi019.stdout:8/484: dread d7/d34/f52 [0,4194304] 0 2024-09-12T22:33:15.662 INFO:tasks.workunit.client.0.smithi019.stdout:8/485: chown d7/d8/l26 63152463 1 2024-09-12T22:33:15.662 INFO:tasks.workunit.client.0.smithi019.stdout:6/557: mkdir d1b/d26/d31/d5f/da8/dc3 0 2024-09-12T22:33:15.662 INFO:tasks.workunit.client.0.smithi019.stdout:6/558: readlink d1b/d26/d39/d6a/l66 0 2024-09-12T22:33:15.662 INFO:tasks.workunit.client.0.smithi019.stdout:8/486: mknod d7/d8/dd/d4f/c9c 0 2024-09-12T22:33:15.662 INFO:tasks.workunit.client.0.smithi019.stdout:8/487: write d7/f6f [490813,101834] 0 2024-09-12T22:33:15.662 INFO:tasks.workunit.client.0.smithi019.stdout:6/559: mknod d1b/d26/d31/d5f/da8/dc3/cc4 0 2024-09-12T22:33:15.662 INFO:tasks.workunit.client.0.smithi019.stdout:8/488: write d7/fc [1006814,78331] 0 2024-09-12T22:33:15.662 INFO:tasks.workunit.client.0.smithi019.stdout:6/560: creat d1b/d26/d31/d5f/da8/dc3/fc5 x:0 0 0 2024-09-12T22:33:15.662 INFO:tasks.workunit.client.0.smithi019.stdout:6/561: rmdir d1b 39 2024-09-12T22:33:15.662 INFO:tasks.workunit.client.0.smithi019.stdout:1/602: dwrite d3/df/d7e/db7/d16/d3c/dbd/dc4/f5b [0,4194304] 0 2024-09-12T22:33:15.662 INFO:tasks.workunit.client.0.smithi019.stdout:8/489: creat d7/d34/d78/d2d/d84/f9d x:0 0 0 2024-09-12T22:33:15.662 INFO:tasks.workunit.client.0.smithi019.stdout:1/603: write d3/df/d7e/db7/f74 [936231,106509] 0 2024-09-12T22:33:15.663 INFO:tasks.workunit.client.0.smithi019.stdout:7/464: rename d6/d14/d15/l40 to d6/d14/d2a/da4/dc/d63/lac 0 2024-09-12T22:33:15.663 INFO:tasks.workunit.client.0.smithi019.stdout:7/465: creat d6/d14/d2a/fad x:0 0 0 2024-09-12T22:33:15.663 INFO:tasks.workunit.client.0.smithi019.stdout:0/510: dread d1/d14/d1b/f44 [0,4194304] 0 2024-09-12T22:33:15.663 INFO:tasks.workunit.client.0.smithi019.stdout:1/604: getdents d3/df/d7e/db7/d16/d3c/d55/da0 0 2024-09-12T22:33:15.663 INFO:tasks.workunit.client.0.smithi019.stdout:0/511: mkdir d1/d14/d1b/d94 0 2024-09-12T22:33:15.663 INFO:tasks.workunit.client.0.smithi019.stdout:7/466: mkdir d6/d14/d2a/da4/d34/dae 0 2024-09-12T22:33:15.663 INFO:tasks.workunit.client.0.smithi019.stdout:1/605: chown d3/d6e/da9/l1e 7 1 2024-09-12T22:33:15.663 INFO:tasks.workunit.client.0.smithi019.stdout:1/606: write d3/d1b/f21 [9686206,57424] 0 2024-09-12T22:33:15.663 INFO:tasks.workunit.client.0.smithi019.stdout:6/562: dwrite d1b/d26/d27/d3e/f49 [0,4194304] 0 2024-09-12T22:33:15.663 INFO:tasks.workunit.client.0.smithi019.stdout:7/467: rename d6/d14/d2a/da4/dc/d63/d7f to d6/d2d/d8f/daf 0 2024-09-12T22:33:15.663 INFO:tasks.workunit.client.0.smithi019.stdout:6/563: symlink d1b/d26/d31/d5f/lc6 0 2024-09-12T22:33:15.663 INFO:tasks.workunit.client.0.smithi019.stdout:7/468: unlink d6/d14/d15/d62/d6a/l81 0 2024-09-12T22:33:15.663 INFO:tasks.workunit.client.0.smithi019.stdout:6/564: chown d1b/d26/d27/d67/d77/la7 680545 1 2024-09-12T22:33:15.663 INFO:tasks.workunit.client.0.smithi019.stdout:0/512: dwrite d1/d1f/f57 [0,4194304] 0 2024-09-12T22:33:15.664 INFO:tasks.workunit.client.0.smithi019.stdout:0/513: creat d1/d14/d26/d40/f95 x:0 0 0 2024-09-12T22:33:15.664 INFO:tasks.workunit.client.0.smithi019.stdout:0/514: unlink d1/d14/d32/d3d/l6b 0 2024-09-12T22:33:15.664 INFO:tasks.workunit.client.0.smithi019.stdout:0/515: fdatasync d1/d14/d26/d40/f52 0 2024-09-12T22:33:15.664 INFO:tasks.workunit.client.0.smithi019.stdout:0/516: read - d1/d14/f92 zero size 2024-09-12T22:33:15.664 INFO:tasks.workunit.client.0.smithi019.stdout:0/517: mknod d1/d14/d32/c96 0 2024-09-12T22:33:15.664 INFO:tasks.workunit.client.0.smithi019.stdout:0/518: rename d1/d14/d32/c48 to d1/d1d/c97 0 2024-09-12T22:33:15.664 INFO:tasks.workunit.client.0.smithi019.stdout:1/607: dwrite d3/df/d7e/db7/d16/d3c/fa6 [0,4194304] 0 2024-09-12T22:33:15.664 INFO:tasks.workunit.client.0.smithi019.stdout:0/519: creat d1/d14/d26/d40/d45/d5e/f98 x:0 0 0 2024-09-12T22:33:15.664 INFO:tasks.workunit.client.0.smithi019.stdout:1/608: link d3/df/l8c d3/df/d7e/db7/d63/d76/d91/lc8 0 2024-09-12T22:33:15.664 INFO:tasks.workunit.client.0.smithi019.stdout:0/520: rmdir d1/d1f/d5b/d73 0 2024-09-12T22:33:15.664 INFO:tasks.workunit.client.0.smithi019.stdout:8/490: dread d7/d8/dd/f56 [0,4194304] 0 2024-09-12T22:33:15.664 INFO:tasks.workunit.client.0.smithi019.stdout:1/609: fsync d3/df/d7e/db7/d16/f38 0 2024-09-12T22:33:15.664 INFO:tasks.workunit.client.0.smithi019.stdout:8/491: dwrite d7/d34/d78/d82/f8d [0,4194304] 0 2024-09-12T22:33:15.665 INFO:tasks.workunit.client.0.smithi019.stdout:3/422: dread f5 [0,4194304] 0 2024-09-12T22:33:15.665 INFO:tasks.workunit.client.0.smithi019.stdout:1/610: read d3/f31 [1352045,121488] 0 2024-09-12T22:33:15.665 INFO:tasks.workunit.client.0.smithi019.stdout:0/521: dread d1/d1f/d5b/f72 [0,4194304] 0 2024-09-12T22:33:15.665 INFO:tasks.workunit.client.0.smithi019.stdout:4/475: dread d1/d11/f23 [0,4194304] 0 2024-09-12T22:33:15.665 INFO:tasks.workunit.client.0.smithi019.stdout:1/611: chown d3/d6e/f87 12 1 2024-09-12T22:33:15.665 INFO:tasks.workunit.client.0.smithi019.stdout:1/612: unlink d3/d3f/f2d 0 2024-09-12T22:33:15.665 INFO:tasks.workunit.client.0.smithi019.stdout:0/522: creat d1/d14/d32/d71/d85/f99 x:0 0 0 2024-09-12T22:33:15.665 INFO:tasks.workunit.client.0.smithi019.stdout:8/492: write d7/d34/d78/d54/f71 [5632121,110866] 0 2024-09-12T22:33:15.665 INFO:tasks.workunit.client.0.smithi019.stdout:6/565: dread d1b/d26/d27/d67/d77/d7b/f8c [4194304,4194304] 0 2024-09-12T22:33:15.665 INFO:tasks.workunit.client.0.smithi019.stdout:0/523: rmdir d1/d14/d1b 39 2024-09-12T22:33:15.665 INFO:tasks.workunit.client.0.smithi019.stdout:0/524: stat d1/d1d/c2a 0 2024-09-12T22:33:15.665 INFO:tasks.workunit.client.0.smithi019.stdout:8/493: write d7/d34/d78/d2d/f30 [1190329,7542] 0 2024-09-12T22:33:15.665 INFO:tasks.workunit.client.0.smithi019.stdout:3/423: dread dd/d12/f4c [0,4194304] 0 2024-09-12T22:33:15.665 INFO:tasks.workunit.client.0.smithi019.stdout:4/476: dwrite d1/d11/d15/d65/f8c [0,4194304] 0 2024-09-12T22:33:15.666 INFO:tasks.workunit.client.0.smithi019.stdout:6/566: truncate d1b/d26/d27/d67/d77/f8f 1140760 0 2024-09-12T22:33:15.666 INFO:tasks.workunit.client.0.smithi019.stdout:6/567: readlink d1b/l43 0 2024-09-12T22:33:15.666 INFO:tasks.workunit.client.0.smithi019.stdout:4/477: write d1/d11/d15/d81/f92 [726346,62095] 0 2024-09-12T22:33:15.666 INFO:tasks.workunit.client.0.smithi019.stdout:4/478: chown d1/d11/d15/d65/d75 1 1 2024-09-12T22:33:15.666 INFO:tasks.workunit.client.0.smithi019.stdout:0/525: dwrite d1/f65 [0,4194304] 0 2024-09-12T22:33:15.666 INFO:tasks.workunit.client.0.smithi019.stdout:8/494: dwrite d7/f59 [0,4194304] 0 2024-09-12T22:33:15.666 INFO:tasks.workunit.client.0.smithi019.stdout:3/424: truncate dd/f13 1619007 0 2024-09-12T22:33:15.666 INFO:tasks.workunit.client.0.smithi019.stdout:8/495: creat d7/d8/d43/f9e x:0 0 0 2024-09-12T22:33:15.666 INFO:tasks.workunit.client.0.smithi019.stdout:6/568: dwrite d1b/d2d/f48 [0,4194304] 0 2024-09-12T22:33:15.666 INFO:tasks.workunit.client.0.smithi019.stdout:5/609: dread d0/d7/d16/f7a [0,4194304] 0 2024-09-12T22:33:15.666 INFO:tasks.workunit.client.0.smithi019.stdout:8/496: creat d7/d8/d43/f9f x:0 0 0 2024-09-12T22:33:15.666 INFO:tasks.workunit.client.0.smithi019.stdout:5/610: stat d0/d7/d16/f4f 0 2024-09-12T22:33:15.666 INFO:tasks.workunit.client.0.smithi019.stdout:8/497: symlink d7/d2f/d42/la0 0 2024-09-12T22:33:15.667 INFO:tasks.workunit.client.0.smithi019.stdout:6/569: rename d1b/d26/d31/c5a to d1b/d26/d39/d6a/cc7 0 2024-09-12T22:33:15.667 INFO:tasks.workunit.client.0.smithi019.stdout:5/611: dread - d0/d7/d16/d18/fbe zero size 2024-09-12T22:33:15.667 INFO:tasks.workunit.client.0.smithi019.stdout:5/612: fsync d0/f49 0 2024-09-12T22:33:15.667 INFO:tasks.workunit.client.0.smithi019.stdout:6/570: rename d1b/d26/d39/f53 to d1b/d26/d31/d5f/d91/fc8 0 2024-09-12T22:33:15.667 INFO:tasks.workunit.client.0.smithi019.stdout:4/479: dread d1/d11/d15/f2e [4194304,4194304] 0 2024-09-12T22:33:15.667 INFO:tasks.workunit.client.0.smithi019.stdout:5/613: rmdir d0/d7/d2d/d32/d36/d8c/db8/d39/d38/dba 39 2024-09-12T22:33:15.667 INFO:tasks.workunit.client.0.smithi019.stdout:6/571: mknod d1b/d26/d39/cc9 0 2024-09-12T22:33:15.667 INFO:tasks.workunit.client.0.smithi019.stdout:4/480: chown d1/d4/d38/f3b 746630 1 2024-09-12T22:33:15.667 INFO:tasks.workunit.client.0.smithi019.stdout:5/614: truncate d0/d7/d2d/d32/d36/d8c/d8f/f9f 1019406 0 2024-09-12T22:33:15.667 INFO:tasks.workunit.client.0.smithi019.stdout:1/613: dread d3/df/d7e/db7/d63/d76/f9c [0,4194304] 0 2024-09-12T22:33:15.667 INFO:tasks.workunit.client.0.smithi019.stdout:6/572: rmdir d1b/d26/d27/db6 0 2024-09-12T22:33:15.667 INFO:tasks.workunit.client.0.smithi019.stdout:4/481: creat d1/d11/f99 x:0 0 0 2024-09-12T22:33:15.667 INFO:tasks.workunit.client.0.smithi019.stdout:5/615: write d0/f37 [3514320,116690] 0 2024-09-12T22:33:15.667 INFO:tasks.workunit.client.0.smithi019.stdout:1/614: rmdir d3/df/d7e 39 2024-09-12T22:33:15.668 INFO:tasks.workunit.client.0.smithi019.stdout:4/482: mknod d1/d22/d31/c9a 0 2024-09-12T22:33:15.668 INFO:tasks.workunit.client.0.smithi019.stdout:5/616: creat d0/d7/d16/d69/fd4 x:0 0 0 2024-09-12T22:33:15.668 INFO:tasks.workunit.client.0.smithi019.stdout:1/615: mkdir d3/df/d7e/dc9 0 2024-09-12T22:33:15.668 INFO:tasks.workunit.client.0.smithi019.stdout:1/616: stat d3/d1b/f27 0 2024-09-12T22:33:15.668 INFO:tasks.workunit.client.0.smithi019.stdout:7/469: dread d6/d14/d15/f22 [0,4194304] 0 2024-09-12T22:33:15.668 INFO:tasks.workunit.client.0.smithi019.stdout:4/483: dwrite d1/d4/d44/f74 [0,4194304] 0 2024-09-12T22:33:15.668 INFO:tasks.workunit.client.0.smithi019.stdout:2/474: dread d0/d5/d18/d1b/d5d/d86/f61 [0,4194304] 0 2024-09-12T22:33:15.668 INFO:tasks.workunit.client.0.smithi019.stdout:6/573: dwrite fb [0,4194304] 0 2024-09-12T22:33:15.668 INFO:tasks.workunit.client.0.smithi019.stdout:2/475: stat d0/d5/d60/d74/f9e 0 2024-09-12T22:33:15.668 INFO:tasks.workunit.client.0.smithi019.stdout:4/484: write d1/d4/d38/f83 [1817222,101909] 0 2024-09-12T22:33:15.668 INFO:tasks.workunit.client.0.smithi019.stdout:2/476: stat d0/d5/d18/d5c/d85/d95/c6c 0 2024-09-12T22:33:15.668 INFO:tasks.workunit.client.0.smithi019.stdout:2/477: stat d0/d5/d18/d3b/f9b 0 2024-09-12T22:33:15.668 INFO:tasks.workunit.client.0.smithi019.stdout:4/485: symlink d1/d11/d15/l9b 0 2024-09-12T22:33:15.669 INFO:tasks.workunit.client.0.smithi019.stdout:2/478: chown d0/d5/d18/d39/f94 3 1 2024-09-12T22:33:15.669 INFO:tasks.workunit.client.0.smithi019.stdout:4/486: chown d1/d4/d44/l8f 393536 1 2024-09-12T22:33:15.669 INFO:tasks.workunit.client.0.smithi019.stdout:7/470: write d6/d14/d2a/da4/dc/f9 [1541801,63063] 0 2024-09-12T22:33:15.669 INFO:tasks.workunit.client.0.smithi019.stdout:1/617: dread d3/d6e/da9/f6c [0,4194304] 0 2024-09-12T22:33:15.669 INFO:tasks.workunit.client.0.smithi019.stdout:4/487: truncate d1/d11/d15/f78 8552732 0 2024-09-12T22:33:15.669 INFO:tasks.workunit.client.0.smithi019.stdout:1/618: truncate d3/f69 877045 0 2024-09-12T22:33:15.669 INFO:tasks.workunit.client.0.smithi019.stdout:7/471: write d6/d14/d2a/da4/d34/f90 [436740,55274] 0 2024-09-12T22:33:15.669 INFO:tasks.workunit.client.0.smithi019.stdout:9/500: dread dd/d10/d17/d22/d42/f55 [0,4194304] 0 2024-09-12T22:33:15.669 INFO:tasks.workunit.client.0.smithi019.stdout:4/488: write d1/d11/d15/d65/d75/f59 [416503,3467] 0 2024-09-12T22:33:15.669 INFO:tasks.workunit.client.0.smithi019.stdout:7/472: mkdir d6/d14/d45/db0 0 2024-09-12T22:33:15.669 INFO:tasks.workunit.client.0.smithi019.stdout:1/619: chown d3/df/d7e/db7/d16/d3c/dbd/dc4/f6d 12 1 2024-09-12T22:33:15.669 INFO:tasks.workunit.client.0.smithi019.stdout:4/489: write d1/d11/d15/d81/f92 [1600593,33222] 0 2024-09-12T22:33:15.669 INFO:tasks.workunit.client.0.smithi019.stdout:4/490: chown d1/d22/d31 82290562 1 2024-09-12T22:33:15.669 INFO:tasks.workunit.client.0.smithi019.stdout:7/473: creat d6/d14/d2a/da4/fb1 x:0 0 0 2024-09-12T22:33:15.670 INFO:tasks.workunit.client.0.smithi019.stdout:7/474: dread - d6/d2d/d77/f79 zero size 2024-09-12T22:33:15.670 INFO:tasks.workunit.client.0.smithi019.stdout:0/526: dread d1/d14/d32/d3d/f5a [0,4194304] 0 2024-09-12T22:33:15.670 INFO:tasks.workunit.client.0.smithi019.stdout:4/491: mknod d1/d11/d15/d1f/d56/d6b/c9c 0 2024-09-12T22:33:15.670 INFO:tasks.workunit.client.0.smithi019.stdout:1/620: read d3/df/d7e/db7/d16/f38 [1418267,29169] 0 2024-09-12T22:33:15.670 INFO:tasks.workunit.client.0.smithi019.stdout:7/475: write d6/d14/d2a/da4/dc/d63/f37 [1179817,28475] 0 2024-09-12T22:33:15.670 INFO:tasks.workunit.client.0.smithi019.stdout:0/527: creat d1/d14/d26/d40/f9a x:0 0 0 2024-09-12T22:33:15.670 INFO:tasks.workunit.client.0.smithi019.stdout:1/621: getdents d3/df/d7e/db7/d63/d76/d91 0 2024-09-12T22:33:15.670 INFO:tasks.workunit.client.0.smithi019.stdout:0/528: fdatasync d1/d14/d26/d40/d45/f54 0 2024-09-12T22:33:15.670 INFO:tasks.workunit.client.0.smithi019.stdout:9/501: truncate dd/d10/d17/d23/d2e/d31/f46 2524186 0 2024-09-12T22:33:15.670 INFO:tasks.workunit.client.0.smithi019.stdout:7/476: link d6/d14/d15/d9e/f2f d6/fb2 0 2024-09-12T22:33:15.670 INFO:tasks.workunit.client.0.smithi019.stdout:9/502: creat dd/f9e x:0 0 0 2024-09-12T22:33:15.670 INFO:tasks.workunit.client.0.smithi019.stdout:0/529: rmdir d1/d14/d26 39 2024-09-12T22:33:15.670 INFO:tasks.workunit.client.0.smithi019.stdout:4/492: fdatasync d1/d22/f68 0 2024-09-12T22:33:15.671 INFO:tasks.workunit.client.0.smithi019.stdout:3/425: dread dd/d12/f30 [0,4194304] 0 2024-09-12T22:33:15.671 INFO:tasks.workunit.client.0.smithi019.stdout:7/477: dwrite d6/d14/d15/f5e [0,4194304] 0 2024-09-12T22:33:15.671 INFO:tasks.workunit.client.0.smithi019.stdout:0/530: dwrite d1/d14/d26/f5c [0,4194304] 0 2024-09-12T22:33:15.671 INFO:tasks.workunit.client.0.smithi019.stdout:9/503: mknod dd/d10/d17/d22/d6c/d53/d73/c9f 0 2024-09-12T22:33:15.671 INFO:tasks.workunit.client.0.smithi019.stdout:3/426: write dd/d12/f30 [4364932,42728] 0 2024-09-12T22:33:15.671 INFO:tasks.workunit.client.0.smithi019.stdout:3/427: write dd/d1e/f37 [3208152,74462] 0 2024-09-12T22:33:15.671 INFO:tasks.workunit.client.0.smithi019.stdout:3/428: chown dd/d12/d62/d6a 6 1 2024-09-12T22:33:15.671 INFO:tasks.workunit.client.0.smithi019.stdout:9/504: unlink dd/d10/d17/c1d 0 2024-09-12T22:33:15.671 INFO:tasks.workunit.client.0.smithi019.stdout:0/531: rmdir d1/d14/d26/d40/d45/d5e/d64 0 2024-09-12T22:33:15.671 INFO:tasks.workunit.client.0.smithi019.stdout:4/493: dread d1/d22/f68 [0,4194304] 0 2024-09-12T22:33:15.672 INFO:tasks.workunit.client.0.smithi019.stdout:7/478: dread d6/d14/d15/d62/d6a/f75 [0,4194304] 0 2024-09-12T22:33:15.672 INFO:tasks.workunit.client.0.smithi019.stdout:9/505: symlink dd/d10/d17/d22/d6c/la0 0 2024-09-12T22:33:15.672 INFO:tasks.workunit.client.0.smithi019.stdout:3/429: creat dd/d12/d62/d74/f76 x:0 0 0 2024-09-12T22:33:15.672 INFO:tasks.workunit.client.0.smithi019.stdout:7/479: chown d6/d2d/f83 28 1 2024-09-12T22:33:15.672 INFO:tasks.workunit.client.0.smithi019.stdout:4/494: readlink d1/d8/l1e 0 2024-09-12T22:33:15.672 INFO:tasks.workunit.client.0.smithi019.stdout:0/532: fsync d1/d14/d26/d40/d45/d5e/f68 0 2024-09-12T22:33:15.672 INFO:tasks.workunit.client.0.smithi019.stdout:9/506: fdatasync dd/d10/d17/d22/f4f 0 2024-09-12T22:33:15.672 INFO:tasks.workunit.client.0.smithi019.stdout:4/495: chown d1/d11/d15/d1f/d56/d6b/d7e 214 1 2024-09-12T22:33:15.672 INFO:tasks.workunit.client.0.smithi019.stdout:9/507: symlink dd/d10/d17/d22/la1 0 2024-09-12T22:33:15.672 INFO:tasks.workunit.client.0.smithi019.stdout:7/480: creat d6/d14/d2a/da4/dc/d63/fb3 x:0 0 0 2024-09-12T22:33:15.672 INFO:tasks.workunit.client.0.smithi019.stdout:4/496: link d1/d11/d15/l9b d1/d11/d15/d65/l9d 0 2024-09-12T22:33:15.672 INFO:tasks.workunit.client.0.smithi019.stdout:9/508: unlink dd/d10/d17/d22/f4f 0 2024-09-12T22:33:15.672 INFO:tasks.workunit.client.0.smithi019.stdout:8/498: dread d7/d2f/d42/f49 [0,4194304] 0 2024-09-12T22:33:15.673 INFO:tasks.workunit.client.0.smithi019.stdout:4/497: chown d1/d11/d15/d1f/d56/d6b/d7e 249 1 2024-09-12T22:33:15.673 INFO:tasks.workunit.client.0.smithi019.stdout:8/499: write d7/f59 [4372707,7492] 0 2024-09-12T22:33:15.673 INFO:tasks.workunit.client.0.smithi019.stdout:9/509: creat dd/d10/d17/d23/d2e/d31/d3f/fa2 x:0 0 0 2024-09-12T22:33:15.673 INFO:tasks.workunit.client.0.smithi019.stdout:4/498: rename d1/d22/c98 to d1/d4/c9e 0 2024-09-12T22:33:15.673 INFO:tasks.workunit.client.0.smithi019.stdout:9/510: rmdir dd/d10/d17 39 2024-09-12T22:33:15.673 INFO:tasks.workunit.client.0.smithi019.stdout:0/533: dwrite d1/d14/d1b/f2b [0,4194304] 0 2024-09-12T22:33:15.673 INFO:tasks.workunit.client.0.smithi019.stdout:8/500: getdents d7/d8/dd/d4f 0 2024-09-12T22:33:15.673 INFO:tasks.workunit.client.0.smithi019.stdout:0/534: dread d1/d14/d1b/f44 [0,4194304] 0 2024-09-12T22:33:15.673 INFO:tasks.workunit.client.0.smithi019.stdout:4/499: truncate d1/d11/d15/d65/d75/d5a/d79/f8a 418206 0 2024-09-12T22:33:15.673 INFO:tasks.workunit.client.0.smithi019.stdout:4/500: creat d1/d11/d15/d81/f9f x:0 0 0 2024-09-12T22:33:15.673 INFO:tasks.workunit.client.0.smithi019.stdout:0/535: write d1/d1f/f39 [1299647,130700] 0 2024-09-12T22:33:15.673 INFO:tasks.workunit.client.0.smithi019.stdout:4/501: rename d1/f24 to d1/d4/fa0 0 2024-09-12T22:33:15.673 INFO:tasks.workunit.client.0.smithi019.stdout:4/502: mkdir d1/d22/d26/da1 0 2024-09-12T22:33:15.674 INFO:tasks.workunit.client.0.smithi019.stdout:0/536: rename d1/d14/d1b/c7b to d1/d14/d1b/d3a/d8c/c9b 0 2024-09-12T22:33:15.674 INFO:tasks.workunit.client.0.smithi019.stdout:9/511: dwrite dd/d10/d17/d22/d6c/d53/f5c [0,4194304] 0 2024-09-12T22:33:15.674 INFO:tasks.workunit.client.0.smithi019.stdout:8/501: dwrite d7/d8/dd/d4f/f80 [0,4194304] 0 2024-09-12T22:33:15.674 INFO:tasks.workunit.client.0.smithi019.stdout:4/503: write d1/d22/f33 [4071628,92384] 0 2024-09-12T22:33:15.674 INFO:tasks.workunit.client.0.smithi019.stdout:0/537: chown d1/d14/d26/d40/d45/d5e/f98 137283 1 2024-09-12T22:33:15.674 INFO:tasks.workunit.client.0.smithi019.stdout:4/504: symlink d1/d4c/la2 0 2024-09-12T22:33:15.674 INFO:tasks.workunit.client.0.smithi019.stdout:9/512: truncate dd/f20 1506021 0 2024-09-12T22:33:15.674 INFO:tasks.workunit.client.0.smithi019.stdout:0/538: mkdir d1/d14/d32/d9c 0 2024-09-12T22:33:15.674 INFO:tasks.workunit.client.0.smithi019.stdout:4/505: truncate d1/d11/d15/d81/f9f 1042666 0 2024-09-12T22:33:15.674 INFO:tasks.workunit.client.0.smithi019.stdout:9/513: chown dd/d10/d17/d23/d2e/d31/d54/l7c 15779496 1 2024-09-12T22:33:15.674 INFO:tasks.workunit.client.0.smithi019.stdout:9/514: creat dd/d10/d17/d22/fa3 x:0 0 0 2024-09-12T22:33:15.675 INFO:tasks.workunit.client.0.smithi019.stdout:6/574: dread d1b/d26/f36 [0,4194304] 0 2024-09-12T22:33:15.675 INFO:tasks.workunit.client.0.smithi019.stdout:8/502: dwrite d7/d34/f38 [4194304,4194304] 0 2024-09-12T22:33:15.675 INFO:tasks.workunit.client.0.smithi019.stdout:6/575: rename d1b/d26/d39/d6a/fb1 to d1b/d26/d31/d5f/d91/fca 0 2024-09-12T22:33:15.675 INFO:tasks.workunit.client.0.smithi019.stdout:8/503: truncate d7/d34/d78/d2d/f83 97053 0 2024-09-12T22:33:15.675 INFO:tasks.workunit.client.0.smithi019.stdout:5/617: dread d0/d7/d2d/d32/d36/d8c/db8/d39/f63 [0,4194304] 0 2024-09-12T22:33:15.675 INFO:tasks.workunit.client.0.smithi019.stdout:8/504: chown d7/d8/d43/f9a 1 1 2024-09-12T22:33:15.675 INFO:tasks.workunit.client.0.smithi019.stdout:9/515: dwrite dd/d10/d17/d22/d42/f55 [0,4194304] 0 2024-09-12T22:33:15.675 INFO:tasks.workunit.client.0.smithi019.stdout:5/618: write d0/d7/d2d/d32/d36/d8c/db8/d39/d38/dba/f5b [61607,79] 0 2024-09-12T22:33:15.676 INFO:tasks.workunit.client.0.smithi019.stdout:6/576: dwrite d1b/d26/d39/d6a/f85 [0,4194304] 0 2024-09-12T22:33:15.676 INFO:tasks.workunit.client.0.smithi019.stdout:9/516: chown dd/d10/d17/d22/c2c 27064346 1 2024-09-12T22:33:15.676 INFO:tasks.workunit.client.0.smithi019.stdout:5/619: stat d0/d7/d2d/d32/dcd 0 2024-09-12T22:33:15.676 INFO:tasks.workunit.client.0.smithi019.stdout:2/479: dread d0/d5/d18/d5c/d85/f98 [0,4194304] 0 2024-09-12T22:33:15.676 INFO:tasks.workunit.client.0.smithi019.stdout:2/480: dread - d0/d5/d18/d39/f94 zero size 2024-09-12T22:33:15.676 INFO:tasks.workunit.client.0.smithi019.stdout:9/517: mknod dd/d10/d17/d23/d2e/d31/d3f/ca4 0 2024-09-12T22:33:15.676 INFO:tasks.workunit.client.0.smithi019.stdout:5/620: chown d0/d7/d2d/d32/d36/d8c/db8/d39/d38/l6c 1865674749 1 2024-09-12T22:33:15.677 INFO:tasks.workunit.client.0.smithi019.stdout:8/505: truncate d7/d34/d78/d54/f71 6096340 0 2024-09-12T22:33:15.678 INFO:tasks.workunit.client.0.smithi019.stdout:8/506: write d7/d34/f7a [2669529,7954] 0 2024-09-12T22:33:15.678 INFO:tasks.workunit.client.0.smithi019.stdout:5/621: mkdir d0/d7/d2d/d32/d4a/dbb/dd5 0 2024-09-12T22:33:15.679 INFO:tasks.workunit.client.0.smithi019.stdout:5/622: write d0/d7/d2d/d32/d36/d8c/db8/d9a/fa4 [3873694,118850] 0 2024-09-12T22:33:15.679 INFO:tasks.workunit.client.0.smithi019.stdout:5/623: write d0/f37 [4615282,73543] 0 2024-09-12T22:33:15.679 INFO:tasks.workunit.client.0.smithi019.stdout:1/622: dread d3/f9 [8388608,4194304] 0 2024-09-12T22:33:15.679 INFO:tasks.workunit.client.0.smithi019.stdout:9/518: truncate dd/f18 5706517 0 2024-09-12T22:33:15.679 INFO:tasks.workunit.client.0.smithi019.stdout:8/507: truncate d7/d8/dd/f55 4338563 0 2024-09-12T22:33:15.679 INFO:tasks.workunit.client.0.smithi019.stdout:3/430: dread dd/d1e/f23 [0,4194304] 0 2024-09-12T22:33:15.680 INFO:tasks.workunit.client.0.smithi019.stdout:8/508: creat d7/d8/dd/d4f/fa1 x:0 0 0 2024-09-12T22:33:15.680 INFO:tasks.workunit.client.0.smithi019.stdout:8/509: creat d7/d2f/fa2 x:0 0 0 2024-09-12T22:33:15.680 INFO:tasks.workunit.client.0.smithi019.stdout:3/431: mknod dd/c77 0 2024-09-12T22:33:15.680 INFO:tasks.workunit.client.0.smithi019.stdout:6/577: dread d1b/d26/f96 [0,4194304] 0 2024-09-12T22:33:15.680 INFO:tasks.workunit.client.0.smithi019.stdout:6/578: rmdir d1b/d26/d31/d5f 39 2024-09-12T22:33:15.680 INFO:tasks.workunit.client.0.smithi019.stdout:9/519: dwrite dd/d10/f14 [0,4194304] 0 2024-09-12T22:33:15.681 INFO:tasks.workunit.client.0.smithi019.stdout:2/481: sync 2024-09-12T22:33:15.681 INFO:tasks.workunit.client.0.smithi019.stdout:1/623: dwrite d3/df/d7e/db7/f2c [0,4194304] 0 2024-09-12T22:33:15.681 INFO:tasks.workunit.client.0.smithi019.stdout:6/579: read - d1b/d26/d27/d3e/f87 zero size 2024-09-12T22:33:15.681 INFO:tasks.workunit.client.0.smithi019.stdout:1/624: fsync d3/df/d7e/db7/d16/d3c/f70 0 2024-09-12T22:33:15.681 INFO:tasks.workunit.client.0.smithi019.stdout:2/482: rename d0/da/c2f to d0/d5/d60/d74/d7e/ca3 0 2024-09-12T22:33:15.682 INFO:tasks.workunit.client.0.smithi019.stdout:6/580: symlink d1b/d26/d31/d5f/da8/lcb 0 2024-09-12T22:33:15.682 INFO:tasks.workunit.client.0.smithi019.stdout:1/625: chown d3/d1b/c32 630612 1 2024-09-12T22:33:15.682 INFO:tasks.workunit.client.0.smithi019.stdout:3/432: dwrite dd/f46 [8388608,4194304] 0 2024-09-12T22:33:15.682 INFO:tasks.workunit.client.0.smithi019.stdout:5/624: dread d0/d7/d16/d69/fc9 [0,4194304] 0 2024-09-12T22:33:15.682 INFO:tasks.workunit.client.0.smithi019.stdout:2/483: write d0/d5/d18/d39/f44 [1171153,48367] 0 2024-09-12T22:33:15.682 INFO:tasks.workunit.client.0.smithi019.stdout:1/626: rmdir d3/d3f/d77 39 2024-09-12T22:33:15.683 INFO:tasks.workunit.client.0.smithi019.stdout:3/433: mkdir dd/d12/d62/d78 0 2024-09-12T22:33:15.683 INFO:tasks.workunit.client.0.smithi019.stdout:1/627: mknod d3/cca 0 2024-09-12T22:33:15.683 INFO:tasks.workunit.client.0.smithi019.stdout:2/484: creat d0/da/fa4 x:0 0 0 2024-09-12T22:33:15.683 INFO:tasks.workunit.client.0.smithi019.stdout:9/520: dwrite dd/f20 [0,4194304] 0 2024-09-12T22:33:15.683 INFO:tasks.workunit.client.0.smithi019.stdout:8/510: dwrite d7/d34/d78/d53/f5d [4194304,4194304] 0 2024-09-12T22:33:15.683 INFO:tasks.workunit.client.0.smithi019.stdout:5/625: getdents d0/d7/d90 0 2024-09-12T22:33:15.683 INFO:tasks.workunit.client.0.smithi019.stdout:2/485: mknod d0/d5/d18/d1b/d5d/ca5 0 2024-09-12T22:33:15.683 INFO:tasks.workunit.client.0.smithi019.stdout:6/581: dread d1b/d2d/f48 [0,4194304] 0 2024-09-12T22:33:15.683 INFO:tasks.workunit.client.0.smithi019.stdout:7/481: dread d6/d2d/d41/f96 [4194304,4194304] 0 2024-09-12T22:33:15.684 INFO:tasks.workunit.client.0.smithi019.stdout:5/626: chown d0/d7/d2d/d32/d36/d8c/db8/c59 12 1 2024-09-12T22:33:15.684 INFO:tasks.workunit.client.0.smithi019.stdout:8/511: read - d7/d34/d78/d2d/d84/d8b/f90 zero size 2024-09-12T22:33:15.684 INFO:tasks.workunit.client.0.smithi019.stdout:6/582: creat d1b/d2d/fcc x:0 0 0 2024-09-12T22:33:15.684 INFO:tasks.workunit.client.0.smithi019.stdout:2/486: creat d0/d5/d18/d5c/d85/fa6 x:0 0 0 2024-09-12T22:33:15.684 INFO:tasks.workunit.client.0.smithi019.stdout:9/521: creat dd/d10/d17/d22/d6c/d53/d69/d9d/fa5 x:0 0 0 2024-09-12T22:33:15.684 INFO:tasks.workunit.client.0.smithi019.stdout:8/512: chown d7/d8/c7f 747 1 2024-09-12T22:33:15.684 INFO:tasks.workunit.client.0.smithi019.stdout:5/627: truncate d0/f49 348887 0 2024-09-12T22:33:15.685 INFO:tasks.workunit.client.0.smithi019.stdout:6/583: fsync d1b/d26/d27/d3e/d83/d98/fa5 0 2024-09-12T22:33:15.685 INFO:tasks.workunit.client.0.smithi019.stdout:7/482: rmdir d6/d14/d2a/da4/d34/dae 0 2024-09-12T22:33:15.685 INFO:tasks.workunit.client.0.smithi019.stdout:2/487: mknod d0/d5/d18/d5c/d67/d77/ca7 0 2024-09-12T22:33:15.685 INFO:tasks.workunit.client.0.smithi019.stdout:8/513: write d7/d8/dd/d4f/f4b [3402493,95132] 0 2024-09-12T22:33:15.686 INFO:tasks.workunit.client.0.smithi019.stdout:9/522: mknod dd/d10/d17/d23/d2e/d31/d3f/ca6 0 2024-09-12T22:33:15.686 INFO:tasks.workunit.client.0.smithi019.stdout:5/628: creat d0/d7/d2d/dc2/fd6 x:0 0 0 2024-09-12T22:33:15.686 INFO:tasks.workunit.client.0.smithi019.stdout:1/628: dwrite d3/f14 [0,4194304] 0 2024-09-12T22:33:15.686 INFO:tasks.workunit.client.0.smithi019.stdout:3/434: truncate dd/d1e/f25 1898409 0 2024-09-12T22:33:15.686 INFO:tasks.workunit.client.0.smithi019.stdout:5/629: mkdir d0/dd7 0 2024-09-12T22:33:15.686 INFO:tasks.workunit.client.0.smithi019.stdout:7/483: symlink d6/d14/d2a/da4/dc/d63/d4b/lb4 0 2024-09-12T22:33:15.686 INFO:tasks.workunit.client.0.smithi019.stdout:6/584: write d1b/d26/d39/d6a/f85 [1764876,65414] 0 2024-09-12T22:33:15.687 INFO:tasks.workunit.client.0.smithi019.stdout:8/514: creat d7/d34/d78/d82/fa3 x:0 0 0 2024-09-12T22:33:15.687 INFO:tasks.workunit.client.0.smithi019.stdout:8/515: stat c6 0 2024-09-12T22:33:15.687 INFO:tasks.workunit.client.0.smithi019.stdout:9/523: creat dd/d10/d17/d23/d2e/d31/d64/fa7 x:0 0 0 2024-09-12T22:33:15.687 INFO:tasks.workunit.client.0.smithi019.stdout:3/435: symlink dd/d1e/d40/d6e/l79 0 2024-09-12T22:33:15.687 INFO:tasks.workunit.client.0.smithi019.stdout:1/629: creat d3/df/fcb x:0 0 0 2024-09-12T22:33:15.687 INFO:tasks.workunit.client.0.smithi019.stdout:2/488: dwrite d0/d5/d18/d3b/f8a [0,4194304] 0 2024-09-12T22:33:15.687 INFO:tasks.workunit.client.0.smithi019.stdout:9/524: symlink dd/d10/la8 0 2024-09-12T22:33:15.688 INFO:tasks.workunit.client.0.smithi019.stdout:4/506: dread d1/d11/d15/f78 [4194304,4194304] 0 2024-09-12T22:33:15.688 INFO:tasks.workunit.client.0.smithi019.stdout:8/516: creat d7/d8/dd/fa4 x:0 0 0 2024-09-12T22:33:15.688 INFO:tasks.workunit.client.0.smithi019.stdout:1/630: truncate d3/d6e/da9/f44 581089 0 2024-09-12T22:33:15.688 INFO:tasks.workunit.client.0.smithi019.stdout:1/631: sync 2024-09-12T22:33:15.688 INFO:tasks.workunit.client.0.smithi019.stdout:2/489: dread - d0/d5/d60/d74/fa2 zero size 2024-09-12T22:33:15.688 INFO:tasks.workunit.client.0.smithi019.stdout:4/507: dread - d1/d11/f99 zero size 2024-09-12T22:33:15.688 INFO:tasks.workunit.client.0.smithi019.stdout:8/517: creat d7/d2f/fa5 x:0 0 0 2024-09-12T22:33:15.688 INFO:tasks.workunit.client.0.smithi019.stdout:6/585: dwrite d1b/f37 [0,4194304] 0 2024-09-12T22:33:15.689 INFO:tasks.workunit.client.0.smithi019.stdout:9/525: rename dd/d10/d6b to dd/d10/d17/d22/d6c/da9 0 2024-09-12T22:33:15.689 INFO:tasks.workunit.client.0.smithi019.stdout:4/508: symlink d1/d22/d57/la3 0 2024-09-12T22:33:15.689 INFO:tasks.workunit.client.0.smithi019.stdout:8/518: write d7/d8/dd/d4f/fa1 [408693,58420] 0 2024-09-12T22:33:15.689 INFO:tasks.workunit.client.0.smithi019.stdout:1/632: write d3/df/d7e/db7/d16/d3c/dbd/dc4/f6d [1963167,43743] 0 2024-09-12T22:33:15.689 INFO:tasks.workunit.client.0.smithi019.stdout:6/586: write d1b/d26/d39/f65 [5188918,102800] 0 2024-09-12T22:33:15.689 INFO:tasks.workunit.client.0.smithi019.stdout:1/633: fsync d3/df/f48 0 2024-09-12T22:33:15.689 INFO:tasks.workunit.client.0.smithi019.stdout:4/509: unlink d1/d22/d31/l4a 0 2024-09-12T22:33:15.689 INFO:tasks.workunit.client.0.smithi019.stdout:0/539: dread d1/d14/f4e [0,4194304] 0 2024-09-12T22:33:15.689 INFO:tasks.workunit.client.0.smithi019.stdout:6/587: creat d1b/d26/d39/d89/fcd x:0 0 0 2024-09-12T22:33:15.690 INFO:tasks.workunit.client.0.smithi019.stdout:1/634: mknod d3/d6e/ccc 0 2024-09-12T22:33:15.690 INFO:tasks.workunit.client.0.smithi019.stdout:4/510: creat d1/d11/d15/d1f/fa4 x:0 0 0 2024-09-12T22:33:15.690 INFO:tasks.workunit.client.0.smithi019.stdout:1/635: unlink d3/d6e/ccc 0 2024-09-12T22:33:15.690 INFO:tasks.workunit.client.0.smithi019.stdout:6/588: creat d1b/d26/d27/fce x:0 0 0 2024-09-12T22:33:15.690 INFO:tasks.workunit.client.0.smithi019.stdout:2/490: dwrite d0/d5/d18/d5c/f6f [0,4194304] 0 2024-09-12T22:33:15.690 INFO:tasks.workunit.client.0.smithi019.stdout:1/636: fsync d3/d6e/da9/f28 0 2024-09-12T22:33:15.690 INFO:tasks.workunit.client.0.smithi019.stdout:2/491: readlink d0/d5/d60/d71/l72 0 2024-09-12T22:33:15.691 INFO:tasks.workunit.client.0.smithi019.stdout:9/526: dwrite dd/d10/d17/d23/f49 [4194304,4194304] 0 2024-09-12T22:33:15.691 INFO:tasks.workunit.client.0.smithi019.stdout:1/637: write d3/d1b/f27 [3732563,62524] 0 2024-09-12T22:33:15.691 INFO:tasks.workunit.client.0.smithi019.stdout:2/492: fsync d0/d5/d18/d5c/d63/d6a/f76 0 2024-09-12T22:33:15.691 INFO:tasks.workunit.client.0.smithi019.stdout:1/638: mkdir d3/d3f/d77/dcd 0 2024-09-12T22:33:15.691 INFO:tasks.workunit.client.0.smithi019.stdout:9/527: dread - dd/d10/d17/d23/d2e/d31/d3f/d47/d6e/d80/f8d zero size 2024-09-12T22:33:15.691 INFO:tasks.workunit.client.0.smithi019.stdout:2/493: unlink d0/d5/d60/c70 0 2024-09-12T22:33:15.692 INFO:tasks.workunit.client.0.smithi019.stdout:1/639: mkdir d3/df/d7e/db7/d16/d3c/dce 0 2024-09-12T22:33:15.692 INFO:tasks.workunit.client.0.smithi019.stdout:2/494: write d0/f1f [275536,73554] 0 2024-09-12T22:33:15.692 INFO:tasks.workunit.client.0.smithi019.stdout:4/511: dwrite d1/d4/f88 [0,4194304] 0 2024-09-12T22:33:15.692 INFO:tasks.workunit.client.0.smithi019.stdout:9/528: write dd/d10/f39 [3008126,36149] 0 2024-09-12T22:33:15.692 INFO:tasks.workunit.client.0.smithi019.stdout:1/640: chown d3/d3f/d58/f93 3438 1 2024-09-12T22:33:15.693 INFO:tasks.workunit.client.0.smithi019.stdout:4/512: fdatasync d1/d11/d15/f2e 0 2024-09-12T22:33:15.693 INFO:tasks.workunit.client.0.smithi019.stdout:2/495: readlink d0/d5/d18/d1b/d5d/l7f 0 2024-09-12T22:33:15.693 INFO:tasks.workunit.client.0.smithi019.stdout:1/641: unlink d3/l5 0 2024-09-12T22:33:15.693 INFO:tasks.workunit.client.0.smithi019.stdout:2/496: truncate d0/d5/d60/f9d 242237 0 2024-09-12T22:33:15.693 INFO:tasks.workunit.client.0.smithi019.stdout:4/513: getdents d1 0 2024-09-12T22:33:15.693 INFO:tasks.workunit.client.0.smithi019.stdout:9/529: truncate dd/d10/d17/d23/d2e/d31/f46 1157766 0 2024-09-12T22:33:15.694 INFO:tasks.workunit.client.0.smithi019.stdout:2/497: symlink d0/d5/d60/la8 0 2024-09-12T22:33:15.694 INFO:tasks.workunit.client.0.smithi019.stdout:1/642: write d3/d6e/da9/f6c [335298,13442] 0 2024-09-12T22:33:15.694 INFO:tasks.workunit.client.0.smithi019.stdout:4/514: creat d1/d4c/fa5 x:0 0 0 2024-09-12T22:33:15.694 INFO:tasks.workunit.client.0.smithi019.stdout:2/498: unlink d0/da/fa4 0 2024-09-12T22:33:15.694 INFO:tasks.workunit.client.0.smithi019.stdout:1/643: creat d3/d6e/fcf x:0 0 0 2024-09-12T22:33:15.694 INFO:tasks.workunit.client.0.smithi019.stdout:4/515: mkdir d1/d4/da6 0 2024-09-12T22:33:15.695 INFO:tasks.workunit.client.0.smithi019.stdout:2/499: fdatasync d0/d5/d18/d1b/d5d/d86/f61 0 2024-09-12T22:33:15.695 INFO:tasks.workunit.client.0.smithi019.stdout:4/516: chown d1/d4/d38/f94 14610 1 2024-09-12T22:33:15.695 INFO:tasks.workunit.client.0.smithi019.stdout:1/644: write d3/d6e/da9/f28 [2843002,117958] 0 2024-09-12T22:33:15.695 INFO:tasks.workunit.client.0.smithi019.stdout:9/530: getdents dd/d10/d17/d23/d2e/d31/d64 0 2024-09-12T22:33:15.696 INFO:tasks.workunit.client.0.smithi019.stdout:5/630: write d0/d7/d2d/d32/d36/d8c/db8/d39/d38/f44 [3446880,88078] 0 2024-09-12T22:33:15.696 INFO:tasks.workunit.client.0.smithi019.stdout:3/436: write dd/d12/f29 [1174185,43597] 0 2024-09-12T22:33:15.696 INFO:tasks.workunit.client.0.smithi019.stdout:2/500: readlink d0/d5/d18/d1b/l2d 0 2024-09-12T22:33:15.696 INFO:tasks.workunit.client.0.smithi019.stdout:5/631: sync 2024-09-12T22:33:15.696 INFO:tasks.workunit.client.0.smithi019.stdout:1/645: mknod d3/d3f/d77/cd0 0 2024-09-12T22:33:15.696 INFO:tasks.workunit.client.0.smithi019.stdout:2/501: rmdir d0/d5/d60/d74 39 2024-09-12T22:33:15.696 INFO:tasks.workunit.client.0.smithi019.stdout:9/531: fsync dd/d10/d17/d22/d6c/f79 0 2024-09-12T22:33:15.696 INFO:tasks.workunit.client.0.smithi019.stdout:4/517: symlink d1/d11/d15/d1f/d56/d6b/d7e/la7 0 2024-09-12T22:33:15.697 INFO:tasks.workunit.client.0.smithi019.stdout:1/646: dread - d3/df/d7e/d90/fab zero size 2024-09-12T22:33:15.697 INFO:tasks.workunit.client.0.smithi019.stdout:3/437: rename dd/f46 to dd/d12/f7a 0 2024-09-12T22:33:15.697 INFO:tasks.workunit.client.0.smithi019.stdout:2/502: creat d0/d5/fa9 x:0 0 0 2024-09-12T22:33:15.697 INFO:tasks.workunit.client.0.smithi019.stdout:4/518: mkdir d1/d11/d15/d1f/da8 0 2024-09-12T22:33:15.697 INFO:tasks.workunit.client.0.smithi019.stdout:1/647: fdatasync d3/d1b/f21 0 2024-09-12T22:33:15.697 INFO:tasks.workunit.client.0.smithi019.stdout:9/532: rmdir dd/d10/d17/d23/d2e/d31/d3f/d47 39 2024-09-12T22:33:15.697 INFO:tasks.workunit.client.0.smithi019.stdout:5/632: write d0/d7/d2d/d32/d36/d8c/db8/d39/d38/f6e [1939992,10155] 0 2024-09-12T22:33:15.698 INFO:tasks.workunit.client.0.smithi019.stdout:2/503: creat d0/d5/d60/d71/faa x:0 0 0 2024-09-12T22:33:15.698 INFO:tasks.workunit.client.0.smithi019.stdout:4/519: mkdir d1/d11/d15/d1f/d56/da9 0 2024-09-12T22:33:15.698 INFO:tasks.workunit.client.0.smithi019.stdout:9/533: write dd/d10/d17/d23/d2e/d31/f6d [516104,40631] 0 2024-09-12T22:33:15.698 INFO:tasks.workunit.client.0.smithi019.stdout:3/438: link dd/l3e dd/l7b 0 2024-09-12T22:33:15.698 INFO:tasks.workunit.client.0.smithi019.stdout:5/633: rmdir d0/d7/d2d/d32/d4a/db1 0 2024-09-12T22:33:15.698 INFO:tasks.workunit.client.0.smithi019.stdout:3/439: stat dd/d1e/d40/d6e/l79 0 2024-09-12T22:33:15.698 INFO:tasks.workunit.client.0.smithi019.stdout:2/504: rename d0/d5/d18/d1b/f4b to d0/d5/d60/fab 0 2024-09-12T22:33:15.699 INFO:tasks.workunit.client.0.smithi019.stdout:5/634: write d0/d7/d16/faf [685870,68155] 0 2024-09-12T22:33:15.699 INFO:tasks.workunit.client.0.smithi019.stdout:3/440: creat dd/d12/d62/d6a/f7c x:0 0 0 2024-09-12T22:33:15.699 INFO:tasks.workunit.client.0.smithi019.stdout:5/635: mkdir d0/d7/d16/d18/d9d/dd8 0 2024-09-12T22:33:15.699 INFO:tasks.workunit.client.0.smithi019.stdout:4/520: link d1/d11/d15/d1f/d56/d6b/c76 d1/d11/d15/d1f/da8/caa 0 2024-09-12T22:33:15.699 INFO:tasks.workunit.client.0.smithi019.stdout:7/484: dread d6/d2d/f83 [0,4194304] 0 2024-09-12T22:33:15.699 INFO:tasks.workunit.client.0.smithi019.stdout:3/441: creat dd/d12/d62/d6a/f7d x:0 0 0 2024-09-12T22:33:15.699 INFO:tasks.workunit.client.0.smithi019.stdout:5/636: chown d0/f23 0 1 2024-09-12T22:33:15.699 INFO:tasks.workunit.client.0.smithi019.stdout:7/485: unlink d6/d14/d2a/da4/dc/d63/ca7 0 2024-09-12T22:33:15.699 INFO:tasks.workunit.client.0.smithi019.stdout:3/442: creat dd/d1e/f7e x:0 0 0 2024-09-12T22:33:15.699 INFO:tasks.workunit.client.0.smithi019.stdout:3/443: chown dd/d12/c4b 1030036721 1 2024-09-12T22:33:15.699 INFO:tasks.workunit.client.0.smithi019.stdout:5/637: rmdir d0/d7/d2d/d32/d36/d8c/db8/d39/d38/dba 39 2024-09-12T22:33:15.700 INFO:tasks.workunit.client.0.smithi019.stdout:7/486: write d6/d14/d2a/da4/d42/f59 [82115,52951] 0 2024-09-12T22:33:15.700 INFO:tasks.workunit.client.0.smithi019.stdout:3/444: chown dd/d1e/d40/d6e/c71 105 1 2024-09-12T22:33:15.700 INFO:tasks.workunit.client.0.smithi019.stdout:5/638: unlink d0/d7/d16/d18/fbe 0 2024-09-12T22:33:15.700 INFO:tasks.workunit.client.0.smithi019.stdout:4/521: dwrite d1/d22/d2c/f6d [0,4194304] 0 2024-09-12T22:33:15.700 INFO:tasks.workunit.client.0.smithi019.stdout:3/445: creat dd/d1e/d5a/f7f x:0 0 0 2024-09-12T22:33:15.700 INFO:tasks.workunit.client.0.smithi019.stdout:0/540: dwrite d1/fd [0,4194304] 0 2024-09-12T22:33:15.700 INFO:tasks.workunit.client.0.smithi019.stdout:0/541: sync 2024-09-12T22:33:15.700 INFO:tasks.workunit.client.0.smithi019.stdout:7/487: rename d6/d14/d15/d62/d6a/l94 to d6/d2d/d77/d8e/lb5 0 2024-09-12T22:33:15.700 INFO:tasks.workunit.client.0.smithi019.stdout:5/639: write d0/d7/d2d/d32/d36/d8c/d8f/f9f [1801532,14546] 0 2024-09-12T22:33:15.700 INFO:tasks.workunit.client.0.smithi019.stdout:3/446: rename dd to dd/d12/d62/d6a/d80 22 2024-09-12T22:33:15.700 INFO:tasks.workunit.client.0.smithi019.stdout:4/522: creat d1/d22/d31/d85/fab x:0 0 0 2024-09-12T22:33:15.701 INFO:tasks.workunit.client.0.smithi019.stdout:3/447: sync 2024-09-12T22:33:15.701 INFO:tasks.workunit.client.0.smithi019.stdout:5/640: fdatasync d0/d7/d2d/d4c/fc6 0 2024-09-12T22:33:15.701 INFO:tasks.workunit.client.0.smithi019.stdout:7/488: fsync d6/d14/d2a/da4/dc/d63/d4b/f6f 0 2024-09-12T22:33:15.701 INFO:tasks.workunit.client.0.smithi019.stdout:0/542: dread d1/d14/d32/f43 [4194304,4194304] 0 2024-09-12T22:33:15.701 INFO:tasks.workunit.client.0.smithi019.stdout:7/489: symlink d6/d2d/d77/d8e/lb6 0 2024-09-12T22:33:15.701 INFO:tasks.workunit.client.0.smithi019.stdout:4/523: dread d1/d11/d15/f2e [0,4194304] 0 2024-09-12T22:33:15.701 INFO:tasks.workunit.client.0.smithi019.stdout:7/490: stat d6/d14/d2a/da4 0 2024-09-12T22:33:15.701 INFO:tasks.workunit.client.0.smithi019.stdout:1/648: dread d3/d3f/d58/f93 [0,4194304] 0 2024-09-12T22:33:15.701 INFO:tasks.workunit.client.0.smithi019.stdout:0/543: truncate d1/d14/d1b/f2b 1402890 0 2024-09-12T22:33:15.701 INFO:tasks.workunit.client.0.smithi019.stdout:1/649: write d3/df/d7e/fc0 [331727,55770] 0 2024-09-12T22:33:15.702 INFO:tasks.workunit.client.0.smithi019.stdout:7/491: getdents d6/d2d/d8f/daf 0 2024-09-12T22:33:15.702 INFO:tasks.workunit.client.0.smithi019.stdout:5/641: dwrite d0/d7/f1f [0,4194304] 0 2024-09-12T22:33:15.702 INFO:tasks.workunit.client.0.smithi019.stdout:6/589: dread d1b/d26/d27/d3e/f64 [0,4194304] 0 2024-09-12T22:33:15.702 INFO:tasks.workunit.client.0.smithi019.stdout:1/650: creat d3/df/d7e/db7/d16/d3c/d55/da0/fd1 x:0 0 0 2024-09-12T22:33:15.702 INFO:tasks.workunit.client.0.smithi019.stdout:7/492: mkdir d6/d2d/d8f/daf/da0/db7 0 2024-09-12T22:33:15.702 INFO:tasks.workunit.client.0.smithi019.stdout:4/524: dwrite d1/d11/f23 [4194304,4194304] 0 2024-09-12T22:33:15.702 INFO:tasks.workunit.client.0.smithi019.stdout:6/590: rmdir d1b/d26/d39 39 2024-09-12T22:33:15.702 INFO:tasks.workunit.client.0.smithi019.stdout:8/519: dread d7/d8/f2e [4194304,4194304] 0 2024-09-12T22:33:15.702 INFO:tasks.workunit.client.0.smithi019.stdout:0/544: link d1/d1f/d5b/l7a d1/d14/d26/d40/d45/d5e/d84/l9d 0 2024-09-12T22:33:15.702 INFO:tasks.workunit.client.0.smithi019.stdout:4/525: mkdir d1/d11/d15/d1f/d56/dac 0 2024-09-12T22:33:15.703 INFO:tasks.workunit.client.0.smithi019.stdout:3/448: dread dd/d12/f29 [0,4194304] 0 2024-09-12T22:33:15.703 INFO:tasks.workunit.client.0.smithi019.stdout:8/520: dread - d7/d2f/d75/f9b zero size 2024-09-12T22:33:15.703 INFO:tasks.workunit.client.0.smithi019.stdout:7/493: rename d6/d14/d2a/da4/dc/d63/fb3 to d6/d2d/d77/fb8 0 2024-09-12T22:33:15.703 INFO:tasks.workunit.client.0.smithi019.stdout:6/591: creat d1b/d26/d39/d89/d90/fcf x:0 0 0 2024-09-12T22:33:15.703 INFO:tasks.workunit.client.0.smithi019.stdout:6/592: sync 2024-09-12T22:33:15.703 INFO:tasks.workunit.client.0.smithi019.stdout:2/505: dread d0/d5/d60/fab [0,4194304] 0 2024-09-12T22:33:15.703 INFO:tasks.workunit.client.0.smithi019.stdout:5/642: dwrite d0/d7/d16/f7a [4194304,4194304] 0 2024-09-12T22:33:15.703 INFO:tasks.workunit.client.0.smithi019.stdout:0/545: rename d1/d14/d26/f5c to d1/d14/d26/d40/d45/d5e/d84/f9e 0 2024-09-12T22:33:15.703 INFO:tasks.workunit.client.0.smithi019.stdout:8/521: fdatasync d7/d34/d78/d2d/d84/f9d 0 2024-09-12T22:33:15.703 INFO:tasks.workunit.client.0.smithi019.stdout:7/494: creat d6/d14/d45/db0/fb9 x:0 0 0 2024-09-12T22:33:15.703 INFO:tasks.workunit.client.0.smithi019.stdout:4/526: creat d1/d4/d44/fad x:0 0 0 2024-09-12T22:33:15.704 INFO:tasks.workunit.client.0.smithi019.stdout:6/593: creat d1b/d26/d39/d6a/d61/fd0 x:0 0 0 2024-09-12T22:33:15.704 INFO:tasks.workunit.client.0.smithi019.stdout:5/643: fsync d0/d7/d16/d18/f52 0 2024-09-12T22:33:15.704 INFO:tasks.workunit.client.0.smithi019.stdout:9/534: dread dd/d10/d17/f24 [0,4194304] 0 2024-09-12T22:33:15.704 INFO:tasks.workunit.client.0.smithi019.stdout:0/546: read d1/d1f/f41 [2386447,124200] 0 2024-09-12T22:33:15.704 INFO:tasks.workunit.client.0.smithi019.stdout:3/449: write f5 [233730,118337] 0 2024-09-12T22:33:15.704 INFO:tasks.workunit.client.0.smithi019.stdout:7/495: write d6/d14/d2a/da4/f3b [7446120,59965] 0 2024-09-12T22:33:15.704 INFO:tasks.workunit.client.0.smithi019.stdout:8/522: creat d7/d34/d78/d54/fa6 x:0 0 0 2024-09-12T22:33:15.704 INFO:tasks.workunit.client.0.smithi019.stdout:4/527: symlink d1/d4/da6/lae 0 2024-09-12T22:33:15.704 INFO:tasks.workunit.client.0.smithi019.stdout:8/523: sync 2024-09-12T22:33:15.705 INFO:tasks.workunit.client.0.smithi019.stdout:3/450: chown dd/f2a 10919 1 2024-09-12T22:33:15.705 INFO:tasks.workunit.client.0.smithi019.stdout:1/651: dwrite d3/df/d7e/db7/d16/d3c/f66 [0,4194304] 0 2024-09-12T22:33:15.705 INFO:tasks.workunit.client.0.smithi019.stdout:6/594: creat d1b/d26/d27/d3e/d83/d98/fd1 x:0 0 0 2024-09-12T22:33:15.705 INFO:tasks.workunit.client.0.smithi019.stdout:5/644: mkdir d0/d7/d2d/d32/d36/d8c/db8/d39/d38/d4b/dd9 0 2024-09-12T22:33:15.705 INFO:tasks.workunit.client.0.smithi019.stdout:4/528: write d1/d4/f2a [698245,16733] 0 2024-09-12T22:33:15.705 INFO:tasks.workunit.client.0.smithi019.stdout:0/547: rename d1/d14/d32/d71/d75/f82 to d1/d14/d26/d40/d45/f9f 0 2024-09-12T22:33:15.705 INFO:tasks.workunit.client.0.smithi019.stdout:3/451: unlink dd/d12/d62/d74/f76 0 2024-09-12T22:33:15.705 INFO:tasks.workunit.client.0.smithi019.stdout:7/496: mknod d6/d2d/d8f/daf/da0/db7/cba 0 2024-09-12T22:33:15.706 INFO:tasks.workunit.client.0.smithi019.stdout:6/595: creat d1b/db4/fd2 x:0 0 0 2024-09-12T22:33:15.706 INFO:tasks.workunit.client.0.smithi019.stdout:9/535: truncate dd/d10/d17/d22/d6c/f74 1697853 0 2024-09-12T22:33:15.706 INFO:tasks.workunit.client.0.smithi019.stdout:5/645: symlink d0/d7/d2d/lda 0 2024-09-12T22:33:15.706 INFO:tasks.workunit.client.0.smithi019.stdout:1/652: chown d3/df/d7e/db7/d16/d3c/d55/da0/fc1 3 1 2024-09-12T22:33:15.706 INFO:tasks.workunit.client.0.smithi019.stdout:2/506: dwrite d0/d5/d18/d39/f44 [0,4194304] 0 2024-09-12T22:33:15.706 INFO:tasks.workunit.client.0.smithi019.stdout:6/596: dread - d1b/d26/d39/d6a/d97/fa6 zero size 2024-09-12T22:33:15.706 INFO:tasks.workunit.client.0.smithi019.stdout:3/452: write dd/d1e/f54 [4737955,23411] 0 2024-09-12T22:33:15.706 INFO:tasks.workunit.client.0.smithi019.stdout:4/529: rename d1/l32 to d1/d11/d15/d1f/d56/d6b/d7e/laf 0 2024-09-12T22:33:15.706 INFO:tasks.workunit.client.0.smithi019.stdout:9/536: creat dd/d10/d17/d23/d2e/d31/d64/faa x:0 0 0 2024-09-12T22:33:15.706 INFO:tasks.workunit.client.0.smithi019.stdout:7/497: link d6/d14/d45/fa6 d6/d2d/d77/d8e/fbb 0 2024-09-12T22:33:15.706 INFO:tasks.workunit.client.0.smithi019.stdout:2/507: dread - d0/d5/d18/d5c/d67/f93 zero size 2024-09-12T22:33:15.706 INFO:tasks.workunit.client.0.smithi019.stdout:3/453: chown dd/d1e/d5a/f5b 6682169 1 2024-09-12T22:33:15.707 INFO:tasks.workunit.client.0.smithi019.stdout:5/646: unlink d0/d7/d2d/d32/d36/d8c/db8/d24/c92 0 2024-09-12T22:33:15.707 INFO:tasks.workunit.client.0.smithi019.stdout:2/508: fsync d0/d5/d60/d71/faa 0 2024-09-12T22:33:15.707 INFO:tasks.workunit.client.0.smithi019.stdout:7/498: rmdir d6/d2d/d8f/daf 39 2024-09-12T22:33:15.707 INFO:tasks.workunit.client.0.smithi019.stdout:1/653: read d3/d3f/d58/f6f [1801673,96849] 0 2024-09-12T22:33:15.707 INFO:tasks.workunit.client.0.smithi019.stdout:0/548: dread d1/d14/d26/d40/d45/d5e/d84/f9e [0,4194304] 0 2024-09-12T22:33:15.707 INFO:tasks.workunit.client.0.smithi019.stdout:7/499: fdatasync d6/d14/d2a/da4/dc/d63/f37 0 2024-09-12T22:33:15.707 INFO:tasks.workunit.client.0.smithi019.stdout:3/454: write dd/f17 [4473464,7499] 0 2024-09-12T22:33:15.707 INFO:tasks.workunit.client.0.smithi019.stdout:5/647: creat d0/d7/d2d/d32/d36/d8c/db8/d9a/fdb x:0 0 0 2024-09-12T22:33:15.707 INFO:tasks.workunit.client.0.smithi019.stdout:2/509: write d0/d5/d60/d74/fa2 [274963,91915] 0 2024-09-12T22:33:15.707 INFO:tasks.workunit.client.0.smithi019.stdout:3/455: fdatasync dd/d1e/d5a/f5b 0 2024-09-12T22:33:15.707 INFO:tasks.workunit.client.0.smithi019.stdout:6/597: dwrite d1b/d26/d27/d3e/f79 [4194304,4194304] 0 2024-09-12T22:33:15.707 INFO:tasks.workunit.client.0.smithi019.stdout:6/598: sync 2024-09-12T22:33:15.707 INFO:tasks.workunit.client.0.smithi019.stdout:5/648: mkdir d0/d7/d2d/d32/d36/ddc 0 2024-09-12T22:33:15.708 INFO:tasks.workunit.client.0.smithi019.stdout:4/530: rename d1/d11/d15/d65 to d1/d4c/db0 0 2024-09-12T22:33:15.708 INFO:tasks.workunit.client.0.smithi019.stdout:7/500: write d6/d14/d2a/da4/dc/d63/d4b/f5a [793326,110410] 0 2024-09-12T22:33:15.708 INFO:tasks.workunit.client.0.smithi019.stdout:0/549: getdents d1/d14/d26 0 2024-09-12T22:33:15.708 INFO:tasks.workunit.client.0.smithi019.stdout:4/531: chown d1/d22/d26/f7c 6 1 2024-09-12T22:33:15.708 INFO:tasks.workunit.client.0.smithi019.stdout:5/649: creat d0/d7/d16/d18/d9d/fdd x:0 0 0 2024-09-12T22:33:15.708 INFO:tasks.workunit.client.0.smithi019.stdout:1/654: dwrite d3/f14 [0,4194304] 0 2024-09-12T22:33:15.708 INFO:tasks.workunit.client.0.smithi019.stdout:0/550: mknod d1/d14/d26/d40/d45/d5e/d84/ca0 0 2024-09-12T22:33:15.708 INFO:tasks.workunit.client.0.smithi019.stdout:3/456: link dd/d1e/d5a/f6b dd/f81 0 2024-09-12T22:33:15.708 INFO:tasks.workunit.client.0.smithi019.stdout:6/599: link d1b/d26/d27/d3e/d83/d98/fa5 d1b/db4/fd3 0 2024-09-12T22:33:15.708 INFO:tasks.workunit.client.0.smithi019.stdout:3/457: unlink dd/d1e/f37 0 2024-09-12T22:33:15.708 INFO:tasks.workunit.client.0.smithi019.stdout:4/532: rename d1/d11/d15/d1f/fa4 to d1/d11/d15/d49/fb1 0 2024-09-12T22:33:15.708 INFO:tasks.workunit.client.0.smithi019.stdout:5/650: write d0/d7/d2d/d32/d36/d8c/db8/d39/d38/f55 [2998156,78157] 0 2024-09-12T22:33:15.708 INFO:tasks.workunit.client.0.smithi019.stdout:6/600: dread - d1b/d26/d27/d3e/d83/d98/fd1 zero size 2024-09-12T22:33:15.709 INFO:tasks.workunit.client.0.smithi019.stdout:1/655: link d3/d1b/l49 d3/df/d7e/db7/d16/d3c/dbd/dc4/ld2 0 2024-09-12T22:33:15.709 INFO:tasks.workunit.client.0.smithi019.stdout:2/510: dwrite d0/d5/d18/d1b/d36/f4c [0,4194304] 0 2024-09-12T22:33:15.709 INFO:tasks.workunit.client.0.smithi019.stdout:4/533: fsync d1/d8/f14 0 2024-09-12T22:33:15.709 INFO:tasks.workunit.client.0.smithi019.stdout:5/651: stat d0/f75 0 2024-09-12T22:33:15.709 INFO:tasks.workunit.client.0.smithi019.stdout:1/656: readlink d3/df/l46 0 2024-09-12T22:33:15.709 INFO:tasks.workunit.client.0.smithi019.stdout:5/652: readlink d0/l29 0 2024-09-12T22:33:15.709 INFO:tasks.workunit.client.0.smithi019.stdout:0/551: dread d1/d14/d1b/f2b [0,4194304] 0 2024-09-12T22:33:15.709 INFO:tasks.workunit.client.0.smithi019.stdout:2/511: rmdir d0/d5/d60/d71 39 2024-09-12T22:33:15.709 INFO:tasks.workunit.client.0.smithi019.stdout:5/653: unlink d0/d7/d16/f47 0 2024-09-12T22:33:15.709 INFO:tasks.workunit.client.0.smithi019.stdout:7/501: dread d6/d14/d45/d7c/f72 [0,4194304] 0 2024-09-12T22:33:15.710 INFO:tasks.workunit.client.0.smithi019.stdout:4/534: rename d1/d11/d15/f78 to d1/d4/fb2 0 2024-09-12T22:33:15.710 INFO:tasks.workunit.client.0.smithi019.stdout:2/512: readlink d0/d5/d18/d39/l59 0 2024-09-12T22:33:15.710 INFO:tasks.workunit.client.0.smithi019.stdout:0/552: write d1/d1f/f41 [675088,98122] 0 2024-09-12T22:33:15.710 INFO:tasks.workunit.client.0.smithi019.stdout:7/502: symlink d6/d2d/d3d/d84/lbc 0 2024-09-12T22:33:15.710 INFO:tasks.workunit.client.0.smithi019.stdout:2/513: mkdir d0/d5/d18/d1b/d8d/dac 0 2024-09-12T22:33:15.710 INFO:tasks.workunit.client.0.smithi019.stdout:3/458: dread dd/d12/f4c [0,4194304] 0 2024-09-12T22:33:15.710 INFO:tasks.workunit.client.0.smithi019.stdout:0/553: write d1/d14/f4e [499561,113881] 0 2024-09-12T22:33:15.710 INFO:tasks.workunit.client.0.smithi019.stdout:8/524: dread d7/d34/d78/d82/f8d [0,4194304] 0 2024-09-12T22:33:15.710 INFO:tasks.workunit.client.0.smithi019.stdout:6/601: dwrite d1b/d26/d39/fa0 [0,4194304] 0 2024-09-12T22:33:15.710 INFO:tasks.workunit.client.0.smithi019.stdout:2/514: fdatasync d0/d5/f3a 0 2024-09-12T22:33:15.711 INFO:tasks.workunit.client.0.smithi019.stdout:5/654: rename d0/d7/d2d/d32/d36/d6a to d0/d7/d2d/d32/d36/d8c/db8/d39/d38/d4b/dde 0 2024-09-12T22:33:15.711 INFO:tasks.workunit.client.0.smithi019.stdout:4/535: write d1/d22/d26/f48 [2210724,108561] 0 2024-09-12T22:33:15.711 INFO:tasks.workunit.client.0.smithi019.stdout:7/503: truncate d6/d14/d2a/fad 800729 0 2024-09-12T22:33:15.711 INFO:tasks.workunit.client.0.smithi019.stdout:3/459: fdatasync dd/d1e/d40/f4a 0 2024-09-12T22:33:15.711 INFO:tasks.workunit.client.0.smithi019.stdout:0/554: symlink d1/d14/d32/d71/d85/la1 0 2024-09-12T22:33:15.711 INFO:tasks.workunit.client.0.smithi019.stdout:5/655: rmdir d0/d7/d2d 39 2024-09-12T22:33:15.712 INFO:tasks.workunit.client.0.smithi019.stdout:4/536: creat d1/d22/d2c/fb3 x:0 0 0 2024-09-12T22:33:15.712 INFO:tasks.workunit.client.0.smithi019.stdout:0/555: stat d1/d14/d32/l4f 0 2024-09-12T22:33:15.712 INFO:tasks.workunit.client.0.smithi019.stdout:3/460: write dd/d1e/d5a/f5b [2576519,34356] 0 2024-09-12T22:33:15.712 INFO:tasks.workunit.client.0.smithi019.stdout:7/504: write d6/d14/d15/d62/f9f [683186,73635] 0 2024-09-12T22:33:15.712 INFO:tasks.workunit.client.0.smithi019.stdout:4/537: write d1/d4c/f72 [84022,82081] 0 2024-09-12T22:33:15.712 INFO:tasks.workunit.client.0.smithi019.stdout:3/461: mkdir dd/d1e/d82 0 2024-09-12T22:33:15.713 INFO:tasks.workunit.client.0.smithi019.stdout:2/515: truncate d0/d5/d18/d5c/d63/d6a/f76 620955 0 2024-09-12T22:33:15.713 INFO:tasks.workunit.client.0.smithi019.stdout:5/656: fdatasync d0/d7/d2d/d32/d36/d8c/db8/d39/d38/dba/fb0 0 2024-09-12T22:33:15.713 INFO:tasks.workunit.client.0.smithi019.stdout:8/525: dwrite d7/d8/f73 [0,4194304] 0 2024-09-12T22:33:15.713 INFO:tasks.workunit.client.0.smithi019.stdout:9/537: dread dd/d10/d17/d22/f95 [0,4194304] 0 2024-09-12T22:33:15.713 INFO:tasks.workunit.client.0.smithi019.stdout:4/538: chown d1/d22/d26/f37 1249924 1 2024-09-12T22:33:15.713 INFO:tasks.workunit.client.0.smithi019.stdout:7/505: write d6/d2d/d3d/d84/fa2 [670916,90412] 0 2024-09-12T22:33:15.713 INFO:tasks.workunit.client.0.smithi019.stdout:7/506: sync 2024-09-12T22:33:15.713 INFO:tasks.workunit.client.0.smithi019.stdout:8/526: creat d7/d8/fa7 x:0 0 0 2024-09-12T22:33:15.714 INFO:tasks.workunit.client.0.smithi019.stdout:6/602: dwrite d1b/d26/f36 [0,4194304] 0 2024-09-12T22:33:15.714 INFO:tasks.workunit.client.0.smithi019.stdout:9/538: symlink dd/d10/d17/d22/d42/lab 0 2024-09-12T22:33:15.714 INFO:tasks.workunit.client.0.smithi019.stdout:5/657: fdatasync d0/d7/d2d/d32/d36/d8c/db8/d39/d38/dba/fc8 0 2024-09-12T22:33:15.714 INFO:tasks.workunit.client.0.smithi019.stdout:2/516: truncate d0/d5/d18/d39/f94 921105 0 2024-09-12T22:33:15.714 INFO:tasks.workunit.client.0.smithi019.stdout:3/462: read dd/d1e/f34 [1873266,72658] 0 2024-09-12T22:33:15.714 INFO:tasks.workunit.client.0.smithi019.stdout:6/603: stat d1b/d26/d27/d67/caa 0 2024-09-12T22:33:15.714 INFO:tasks.workunit.client.0.smithi019.stdout:4/539: mkdir d1/d4c/db0/d75/d5a/d79/db4 0 2024-09-12T22:33:15.714 INFO:tasks.workunit.client.0.smithi019.stdout:8/527: unlink d7/d2f/d42/f6a 0 2024-09-12T22:33:15.714 INFO:tasks.workunit.client.0.smithi019.stdout:0/556: dread d1/d14/d26/d40/d45/d5e/d84/f9e [0,4194304] 0 2024-09-12T22:33:15.714 INFO:tasks.workunit.client.0.smithi019.stdout:7/507: rename d6/d14/d15/f24 to d6/d14/d15/d8b/fbd 0 2024-09-12T22:33:15.715 INFO:tasks.workunit.client.0.smithi019.stdout:6/604: fsync d1b/d26/d39/d6a/d61/fd0 0 2024-09-12T22:33:15.715 INFO:tasks.workunit.client.0.smithi019.stdout:2/517: chown d0/d5/d18/d5c/l6e 6 1 2024-09-12T22:33:15.715 INFO:tasks.workunit.client.0.smithi019.stdout:3/463: readlink dd/l7b 0 2024-09-12T22:33:15.715 INFO:tasks.workunit.client.0.smithi019.stdout:4/540: rmdir d1/d11/d15/d81 39 2024-09-12T22:33:15.715 INFO:tasks.workunit.client.0.smithi019.stdout:5/658: rename d0/d7/d2d/d32/d36 to d0/d7/d2d/d32/d36/d8c/db5/ddf 22 2024-09-12T22:33:15.715 INFO:tasks.workunit.client.0.smithi019.stdout:8/528: unlink d7/l28 0 2024-09-12T22:33:15.715 INFO:tasks.workunit.client.0.smithi019.stdout:0/557: write d1/d14/d26/d40/f9a [382351,14059] 0 2024-09-12T22:33:15.715 INFO:tasks.workunit.client.0.smithi019.stdout:8/529: sync 2024-09-12T22:33:15.715 INFO:tasks.workunit.client.0.smithi019.stdout:9/539: creat dd/d10/d17/d23/d2e/d31/d3f/d67/fac x:0 0 0 2024-09-12T22:33:15.715 INFO:tasks.workunit.client.0.smithi019.stdout:6/605: mkdir d1b/d26/d39/d6a/d61/dd4 0 2024-09-12T22:33:15.715 INFO:tasks.workunit.client.0.smithi019.stdout:3/464: symlink dd/d12/l83 0 2024-09-12T22:33:15.715 INFO:tasks.workunit.client.0.smithi019.stdout:9/540: creat dd/d10/d17/d22/d6c/d53/d69/fad x:0 0 0 2024-09-12T22:33:15.716 INFO:tasks.workunit.client.0.smithi019.stdout:8/530: fsync d7/d2f/d42/f49 0 2024-09-12T22:33:15.716 INFO:tasks.workunit.client.0.smithi019.stdout:5/659: mknod d0/d7/d2d/d32/d36/d8c/db8/d39/d38/dba/dc7/ce0 0 2024-09-12T22:33:15.716 INFO:tasks.workunit.client.0.smithi019.stdout:6/606: write d1b/d26/d31/d5f/f86 [1567239,18093] 0 2024-09-12T22:33:15.716 INFO:tasks.workunit.client.0.smithi019.stdout:8/531: rmdir d7/d34/d78/d82 39 2024-09-12T22:33:15.716 INFO:tasks.workunit.client.0.smithi019.stdout:9/541: write dd/d10/d17/d22/d6c/d53/d69/fad [915471,47337] 0 2024-09-12T22:33:15.716 INFO:tasks.workunit.client.0.smithi019.stdout:4/541: write d1/d8/f10 [4661998,15197] 0 2024-09-12T22:33:15.716 INFO:tasks.workunit.client.0.smithi019.stdout:1/657: dread d3/d3f/d58/f6f [0,4194304] 0 2024-09-12T22:33:15.716 INFO:tasks.workunit.client.0.smithi019.stdout:3/465: truncate dd/f4d 7504 0 2024-09-12T22:33:15.716 INFO:tasks.workunit.client.0.smithi019.stdout:2/518: dwrite d0/da/f37 [4194304,4194304] 0 2024-09-12T22:33:15.717 INFO:tasks.workunit.client.0.smithi019.stdout:5/660: rename d0/d7/d16/d69/fc9 to d0/d7/d2d/d32/d4a/dbb/dd5/fe1 0 2024-09-12T22:33:15.717 INFO:tasks.workunit.client.0.smithi019.stdout:3/466: chown dd/d12/d62/d6a 4159345 1 2024-09-12T22:33:15.717 INFO:tasks.workunit.client.0.smithi019.stdout:1/658: mkdir d3/d1b/dd3 0 2024-09-12T22:33:15.717 INFO:tasks.workunit.client.0.smithi019.stdout:8/532: truncate d7/d34/d78/d2d/f79 1309549 0 2024-09-12T22:33:15.717 INFO:tasks.workunit.client.0.smithi019.stdout:4/542: fdatasync d1/d4c/db0/d75/d5a/f8b 0 2024-09-12T22:33:15.717 INFO:tasks.workunit.client.0.smithi019.stdout:0/558: dwrite d1/d14/f22 [0,4194304] 0 2024-09-12T22:33:15.717 INFO:tasks.workunit.client.0.smithi019.stdout:2/519: chown d0/d5/d18/d1b/d8d/f92 63 1 2024-09-12T22:33:15.717 INFO:tasks.workunit.client.0.smithi019.stdout:6/607: dread d1b/d2d/f48 [0,4194304] 0 2024-09-12T22:33:15.717 INFO:tasks.workunit.client.0.smithi019.stdout:8/533: mkdir d7/d34/d78/d53/da8 0 2024-09-12T22:33:15.717 INFO:tasks.workunit.client.0.smithi019.stdout:5/661: fdatasync d0/d7/d2d/d32/d36/d8c/db8/d39/fa7 0 2024-09-12T22:33:15.717 INFO:tasks.workunit.client.0.smithi019.stdout:4/543: symlink d1/d22/d57/lb5 0 2024-09-12T22:33:15.718 INFO:tasks.workunit.client.0.smithi019.stdout:1/659: symlink d3/df/d7e/db7/d16/d3c/dbd/ld4 0 2024-09-12T22:33:15.718 INFO:tasks.workunit.client.0.smithi019.stdout:3/467: dread dd/d1e/f67 [0,4194304] 0 2024-09-12T22:33:15.718 INFO:tasks.workunit.client.0.smithi019.stdout:8/534: mknod d7/d2f/d42/ca9 0 2024-09-12T22:33:15.718 INFO:tasks.workunit.client.0.smithi019.stdout:2/520: write d0/d5/f10 [5223618,99920] 0 2024-09-12T22:33:15.718 INFO:tasks.workunit.client.0.smithi019.stdout:0/559: mkdir d1/d14/d26/d40/d45/d5e/da2 0 2024-09-12T22:33:15.718 INFO:tasks.workunit.client.0.smithi019.stdout:6/608: dread - d1b/d26/d39/d6a/d61/fd0 zero size 2024-09-12T22:33:15.718 INFO:tasks.workunit.client.0.smithi019.stdout:4/544: creat d1/d4c/fb6 x:0 0 0 2024-09-12T22:33:15.718 INFO:tasks.workunit.client.0.smithi019.stdout:1/660: write d3/df/d7e/db7/d63/f85 [2616199,97712] 0 2024-09-12T22:33:15.718 INFO:tasks.workunit.client.0.smithi019.stdout:0/560: mkdir d1/d14/d1b/d3a/d8c/da3 0 2024-09-12T22:33:15.718 INFO:tasks.workunit.client.0.smithi019.stdout:8/535: write d7/d8/d43/f9f [905924,84952] 0 2024-09-12T22:33:15.718 INFO:tasks.workunit.client.0.smithi019.stdout:6/609: symlink d1b/d26/d27/d3e/d83/d98/ld5 0 2024-09-12T22:33:15.719 INFO:tasks.workunit.client.0.smithi019.stdout:3/468: rename dd/l22 to dd/d12/l84 0 2024-09-12T22:33:15.719 INFO:tasks.workunit.client.0.smithi019.stdout:9/542: dwrite dd/d10/d17/d23/d2e/d31/f46 [0,4194304] 0 2024-09-12T22:33:15.719 INFO:tasks.workunit.client.0.smithi019.stdout:4/545: dread - d1/d22/d31/d85/fab zero size 2024-09-12T22:33:15.719 INFO:tasks.workunit.client.0.smithi019.stdout:3/469: fdatasync dd/f16 0 2024-09-12T22:33:15.719 INFO:tasks.workunit.client.0.smithi019.stdout:8/536: write d7/d34/d78/f20 [1502056,102509] 0 2024-09-12T22:33:15.719 INFO:tasks.workunit.client.0.smithi019.stdout:6/610: chown d1b/d26/d27/d67/d77/d95/fa3 1575433 1 2024-09-12T22:33:15.719 INFO:tasks.workunit.client.0.smithi019.stdout:3/470: rename dd/l38 to dd/d12/d62/d6a/l85 0 2024-09-12T22:33:15.719 INFO:tasks.workunit.client.0.smithi019.stdout:6/611: fsync d1b/d26/d39/f41 0 2024-09-12T22:33:15.719 INFO:tasks.workunit.client.0.smithi019.stdout:9/543: rename dd/d10/d17/d23/d2e/d31/d3f/d47/f4e to dd/d10/d17/d22/fae 0 2024-09-12T22:33:15.719 INFO:tasks.workunit.client.0.smithi019.stdout:1/661: dread d3/d3f/f30 [0,4194304] 0 2024-09-12T22:33:15.719 INFO:tasks.workunit.client.0.smithi019.stdout:1/662: stat d3/l29 0 2024-09-12T22:33:15.720 INFO:tasks.workunit.client.0.smithi019.stdout:6/612: rename d1b/d26/d27/d67/d77/d95 to d1b/d26/d31/dd6 0 2024-09-12T22:33:15.720 INFO:tasks.workunit.client.0.smithi019.stdout:9/544: mkdir dd/d10/d17/d23/d2e/d31/d3f/d47/d6e/daf 0 2024-09-12T22:33:15.720 INFO:tasks.workunit.client.0.smithi019.stdout:2/521: write d0/d5/d18/d3b/f9b [818688,28615] 0 2024-09-12T22:33:15.720 INFO:tasks.workunit.client.0.smithi019.stdout:1/663: write d3/d6e/fcf [475492,122704] 0 2024-09-12T22:33:15.720 INFO:tasks.workunit.client.0.smithi019.stdout:4/546: dwrite d1/d4c/db0/d75/f59 [0,4194304] 0 2024-09-12T22:33:15.720 INFO:tasks.workunit.client.0.smithi019.stdout:6/613: read - d1b/d26/d31/f9b zero size 2024-09-12T22:33:15.720 INFO:tasks.workunit.client.0.smithi019.stdout:4/547: write d1/d22/d57/f5d [4901068,56821] 0 2024-09-12T22:33:15.720 INFO:tasks.workunit.client.0.smithi019.stdout:9/545: write dd/d10/d17/d22/fae [3160953,118733] 0 2024-09-12T22:33:15.720 INFO:tasks.workunit.client.0.smithi019.stdout:1/664: read d3/df/d7e/db7/d63/d76/f9c [302394,120188] 0 2024-09-12T22:33:15.721 INFO:tasks.workunit.client.0.smithi019.stdout:9/546: readlink dd/l1b 0 2024-09-12T22:33:15.721 INFO:tasks.workunit.client.0.smithi019.stdout:4/548: dread - d1/d4/d38/f94 zero size 2024-09-12T22:33:15.721 INFO:tasks.workunit.client.0.smithi019.stdout:6/614: truncate d1b/d26/d31/dd6/fa3 837582 0 2024-09-12T22:33:15.721 INFO:tasks.workunit.client.0.smithi019.stdout:0/561: dwrite d1/d14/d1b/f44 [0,4194304] 0 2024-09-12T22:33:15.721 INFO:tasks.workunit.client.0.smithi019.stdout:7/508: dread d6/d14/d15/d9e/f36 [0,4194304] 0 2024-09-12T22:33:15.721 INFO:tasks.workunit.client.0.smithi019.stdout:6/615: chown d1b/d26/d39/l69 235694 1 2024-09-12T22:33:15.721 INFO:tasks.workunit.client.0.smithi019.stdout:9/547: unlink dd/d10/d17/d22/f6a 0 2024-09-12T22:33:15.722 INFO:tasks.workunit.client.0.smithi019.stdout:0/562: unlink d1/d14/d32/f6e 0 2024-09-12T22:33:15.722 INFO:tasks.workunit.client.0.smithi019.stdout:1/665: rmdir d3/df/d7e/d90/da4 0 2024-09-12T22:33:15.722 INFO:tasks.workunit.client.0.smithi019.stdout:7/509: stat d6/d2d/d77/f89 0 2024-09-12T22:33:15.722 INFO:tasks.workunit.client.0.smithi019.stdout:6/616: write d1b/d26/d39/f4c [508428,46084] 0 2024-09-12T22:33:15.722 INFO:tasks.workunit.client.0.smithi019.stdout:6/617: creat d1b/d26/d27/d3e/d83/fd7 x:0 0 0 2024-09-12T22:33:15.722 INFO:tasks.workunit.client.0.smithi019.stdout:7/510: creat d6/d2d/d41/fbe x:0 0 0 2024-09-12T22:33:15.722 INFO:tasks.workunit.client.0.smithi019.stdout:9/548: rename dd/d10/d17/l78 to dd/d10/d17/d23/d2e/d31/d3f/d47/d6e/daf/lb0 0 2024-09-12T22:33:15.722 INFO:tasks.workunit.client.0.smithi019.stdout:7/511: mkdir d6/d2d/d77/dbf 0 2024-09-12T22:33:15.722 INFO:tasks.workunit.client.0.smithi019.stdout:0/563: rename d1/d1f/d5b/d83/c7c to d1/d14/d26/d40/d45/d5e/d84/ca4 0 2024-09-12T22:33:15.722 INFO:tasks.workunit.client.0.smithi019.stdout:4/549: dwrite d1/d4/f13 [0,4194304] 0 2024-09-12T22:33:15.722 INFO:tasks.workunit.client.0.smithi019.stdout:2/522: dwrite d0/d5/d18/d5c/d63/d6a/f76 [0,4194304] 0 2024-09-12T22:33:15.722 INFO:tasks.workunit.client.0.smithi019.stdout:7/512: fdatasync d6/d14/d15/f5e 0 2024-09-12T22:33:15.723 INFO:tasks.workunit.client.0.smithi019.stdout:7/513: symlink d6/d14/d2a/da4/d34/lc0 0 2024-09-12T22:33:15.723 INFO:tasks.workunit.client.0.smithi019.stdout:4/550: symlink d1/d22/d31/d4f/lb7 0 2024-09-12T22:33:15.723 INFO:tasks.workunit.client.0.smithi019.stdout:6/618: dread d1b/d26/f36 [0,4194304] 0 2024-09-12T22:33:15.723 INFO:tasks.workunit.client.0.smithi019.stdout:9/549: link dd/d10/d17/l3d dd/d10/d17/d23/d2e/lb1 0 2024-09-12T22:33:15.723 INFO:tasks.workunit.client.0.smithi019.stdout:2/523: fdatasync d0/d5/d18/d5c/d63/f62 0 2024-09-12T22:33:15.723 INFO:tasks.workunit.client.0.smithi019.stdout:7/514: fdatasync d6/d14/d15/f98 0 2024-09-12T22:33:15.723 INFO:tasks.workunit.client.0.smithi019.stdout:4/551: chown d1/d22/d31/d4f 849 1 2024-09-12T22:33:15.723 INFO:tasks.workunit.client.0.smithi019.stdout:1/666: dwrite d3/df/d7e/db7/d63/d76/d91/f8b [0,4194304] 0 2024-09-12T22:33:15.723 INFO:tasks.workunit.client.0.smithi019.stdout:9/550: chown dd/d10/d17/d23/d37 628133 1 2024-09-12T22:33:15.723 INFO:tasks.workunit.client.0.smithi019.stdout:1/667: chown d3/d6e/caf 3 1 2024-09-12T22:33:15.723 INFO:tasks.workunit.client.0.smithi019.stdout:6/619: rename d1b/d26/f36 to d1b/d26/d27/d3e/d83/d98/fd8 0 2024-09-12T22:33:15.723 INFO:tasks.workunit.client.0.smithi019.stdout:4/552: truncate d1/d22/d26/f48 2403176 0 2024-09-12T22:33:15.723 INFO:tasks.workunit.client.0.smithi019.stdout:0/564: fdatasync d1/d14/d1b/f44 0 2024-09-12T22:33:15.724 INFO:tasks.workunit.client.0.smithi019.stdout:2/524: creat d0/d5/d18/d5c/fad x:0 0 0 2024-09-12T22:33:15.724 INFO:tasks.workunit.client.0.smithi019.stdout:4/553: dread - d1/d4c/fb6 zero size 2024-09-12T22:33:15.724 INFO:tasks.workunit.client.0.smithi019.stdout:6/620: unlink d1b/d26/c2c 0 2024-09-12T22:33:15.724 INFO:tasks.workunit.client.0.smithi019.stdout:0/565: creat d1/d1f/d5b/fa5 x:0 0 0 2024-09-12T22:33:15.724 INFO:tasks.workunit.client.0.smithi019.stdout:1/668: dread - d3/df/d7e/db7/d16/d3c/d55/da0/fc1 zero size 2024-09-12T22:33:15.724 INFO:tasks.workunit.client.0.smithi019.stdout:7/515: rename d6/d14/d15/f1b to d6/d2d/d8f/daf/fc1 0 2024-09-12T22:33:15.725 INFO:tasks.workunit.client.0.smithi019.stdout:1/669: sync 2024-09-12T22:33:15.725 INFO:tasks.workunit.client.0.smithi019.stdout:4/554: write d1/d4/f6f [732786,38402] 0 2024-09-12T22:33:15.725 INFO:tasks.workunit.client.0.smithi019.stdout:6/621: write d1b/d26/d31/dd6/fb0 [294416,10457] 0 2024-09-12T22:33:15.725 INFO:tasks.workunit.client.0.smithi019.stdout:2/525: getdents d0/d5/d18/d5c/d67 0 2024-09-12T22:33:15.725 INFO:tasks.workunit.client.0.smithi019.stdout:5/662: dread d0/d7/d2d/d32/d36/d8c/db8/d39/d38/f3f [0,4194304] 0 2024-09-12T22:33:15.725 INFO:tasks.workunit.client.0.smithi019.stdout:1/670: mknod d3/df/d7e/db7/d16/d3c/dbd/dc4/cd5 0 2024-09-12T22:33:15.726 INFO:tasks.workunit.client.0.smithi019.stdout:6/622: creat d1b/d26/d39/d6a/d97/fd9 x:0 0 0 2024-09-12T22:33:15.726 INFO:tasks.workunit.client.0.smithi019.stdout:9/551: dwrite dd/d10/d17/d22/fae [0,4194304] 0 2024-09-12T22:33:15.726 INFO:tasks.workunit.client.0.smithi019.stdout:6/623: write d1b/d26/d27/d67/d77/f78 [462035,115877] 0 2024-09-12T22:33:15.726 INFO:tasks.workunit.client.0.smithi019.stdout:0/566: write d1/d14/d26/d40/d45/f54 [1703098,116759] 0 2024-09-12T22:33:15.726 INFO:tasks.workunit.client.0.smithi019.stdout:7/516: dwrite d6/d14/d2a/f82 [0,4194304] 0 2024-09-12T22:33:15.727 INFO:tasks.workunit.client.0.smithi019.stdout:5/663: write d0/d7/d2d/d32/d36/d8c/db8/d39/d38/dba/fc8 [422487,30355] 0 2024-09-12T22:33:15.727 INFO:tasks.workunit.client.0.smithi019.stdout:4/555: dwrite d1/d11/f23 [0,4194304] 0 2024-09-12T22:33:15.727 INFO:tasks.workunit.client.0.smithi019.stdout:6/624: fsync d1b/d26/d31/dd6/fa3 0 2024-09-12T22:33:15.727 INFO:tasks.workunit.client.0.smithi019.stdout:4/556: fdatasync d1/d4/f88 0 2024-09-12T22:33:15.727 INFO:tasks.workunit.client.0.smithi019.stdout:0/567: creat d1/d14/fa6 x:0 0 0 2024-09-12T22:33:15.727 INFO:tasks.workunit.client.0.smithi019.stdout:8/537: dread d7/d34/d78/f20 [4194304,4194304] 0 2024-09-12T22:33:15.727 INFO:tasks.workunit.client.0.smithi019.stdout:5/664: mknod d0/d7/d90/ce2 0 2024-09-12T22:33:15.728 INFO:tasks.workunit.client.0.smithi019.stdout:9/552: link dd/d10/d17/d22/d6c/d53/d69/c7b dd/d10/d17/d22/cb2 0 2024-09-12T22:33:15.728 INFO:tasks.workunit.client.0.smithi019.stdout:2/526: dwrite d0/d5/d18/d1b/f4d [0,4194304] 0 2024-09-12T22:33:15.728 INFO:tasks.workunit.client.0.smithi019.stdout:0/568: fsync d1/d14/d32/f35 0 2024-09-12T22:33:15.728 INFO:tasks.workunit.client.0.smithi019.stdout:3/471: dread dd/d1e/f54 [0,4194304] 0 2024-09-12T22:33:15.728 INFO:tasks.workunit.client.0.smithi019.stdout:6/625: creat d1b/d26/fda x:0 0 0 2024-09-12T22:33:15.728 INFO:tasks.workunit.client.0.smithi019.stdout:7/517: link d6/d2d/d77/f89 d6/d14/d15/d62/d6a/fc2 0 2024-09-12T22:33:15.728 INFO:tasks.workunit.client.0.smithi019.stdout:2/527: fsync d0/d5/d60/fab 0 2024-09-12T22:33:15.729 INFO:tasks.workunit.client.0.smithi019.stdout:9/553: getdents dd/d10/d17/d22/d6c/d53/d73 0 2024-09-12T22:33:15.729 INFO:tasks.workunit.client.0.smithi019.stdout:3/472: creat dd/d12/d62/d6a/f86 x:0 0 0 2024-09-12T22:33:15.729 INFO:tasks.workunit.client.0.smithi019.stdout:6/626: truncate d1b/d26/f7e 1270542 0 2024-09-12T22:33:15.729 INFO:tasks.workunit.client.0.smithi019.stdout:8/538: truncate d7/d8/dd/f2a 7586 0 2024-09-12T22:33:15.729 INFO:tasks.workunit.client.0.smithi019.stdout:3/473: stat dd/d1e/d40/c42 0 2024-09-12T22:33:15.729 INFO:tasks.workunit.client.0.smithi019.stdout:0/569: dwrite d1/d14/f4e [0,4194304] 0 2024-09-12T22:33:15.730 INFO:tasks.workunit.client.0.smithi019.stdout:0/570: chown d1/d14/d26/d40/f95 18 1 2024-09-12T22:33:15.730 INFO:tasks.workunit.client.0.smithi019.stdout:4/557: truncate d1/d22/d26/f43 134268 0 2024-09-12T22:33:15.730 INFO:tasks.workunit.client.0.smithi019.stdout:2/528: dwrite d0/d5/d18/d39/f89 [0,4194304] 0 2024-09-12T22:33:15.730 INFO:tasks.workunit.client.0.smithi019.stdout:0/571: write d1/d14/fa6 [947613,5103] 0 2024-09-12T22:33:15.730 INFO:tasks.workunit.client.0.smithi019.stdout:0/572: write d1/d14/d1b/f2e [1660184,83699] 0 2024-09-12T22:33:15.730 INFO:tasks.workunit.client.0.smithi019.stdout:9/554: dwrite dd/d10/d17/d23/d2e/d31/d3f/d47/d6e/d80/f8d [0,4194304] 0 2024-09-12T22:33:15.730 INFO:tasks.workunit.client.0.smithi019.stdout:3/474: dwrite dd/d1e/d5a/f7f [0,4194304] 0 2024-09-12T22:33:15.731 INFO:tasks.workunit.client.0.smithi019.stdout:9/555: dread - dd/d10/d17/d23/d2e/d31/d54/f75 zero size 2024-09-12T22:33:15.731 INFO:tasks.workunit.client.0.smithi019.stdout:7/518: symlink d6/d14/d2a/da4/dc/d63/d4b/lc3 0 2024-09-12T22:33:15.731 INFO:tasks.workunit.client.0.smithi019.stdout:8/539: mkdir d7/d34/d78/d53/daa 0 2024-09-12T22:33:15.731 INFO:tasks.workunit.client.0.smithi019.stdout:6/627: unlink d1b/d26/d27/d3e/d83/d98/fd8 0 2024-09-12T22:33:15.731 INFO:tasks.workunit.client.0.smithi019.stdout:9/556: unlink dd/d10/c65 0 2024-09-12T22:33:15.731 INFO:tasks.workunit.client.0.smithi019.stdout:8/540: fsync d7/d5e/f6b 0 2024-09-12T22:33:15.732 INFO:tasks.workunit.client.0.smithi019.stdout:0/573: link d1/d14/d32/d89/c8a d1/d14/d26/d40/d45/d5e/da2/ca7 0 2024-09-12T22:33:15.732 INFO:tasks.workunit.client.0.smithi019.stdout:7/519: write d6/d2d/d41/fbe [667404,13268] 0 2024-09-12T22:33:15.732 INFO:tasks.workunit.client.0.smithi019.stdout:4/558: link d1/d11/d15/d49/c61 d1/d11/d15/d1f/d56/cb8 0 2024-09-12T22:33:15.732 INFO:tasks.workunit.client.0.smithi019.stdout:9/557: creat dd/d10/d17/d23/d2e/d31/d54/d8b/fb3 x:0 0 0 2024-09-12T22:33:15.732 INFO:tasks.workunit.client.0.smithi019.stdout:0/574: creat d1/d14/d1b/d3a/fa8 x:0 0 0 2024-09-12T22:33:15.732 INFO:tasks.workunit.client.0.smithi019.stdout:8/541: rename d7/d8/f37 to d7/d8/fab 0 2024-09-12T22:33:15.733 INFO:tasks.workunit.client.0.smithi019.stdout:9/558: fsync dd/d10/d17/d22/f3e 0 2024-09-12T22:33:15.733 INFO:tasks.workunit.client.0.smithi019.stdout:3/475: dwrite dd/f31 [0,4194304] 0 2024-09-12T22:33:15.733 INFO:tasks.workunit.client.0.smithi019.stdout:9/559: symlink dd/d10/d17/d23/d2e/d31/d3f/d47/d6e/d80/lb4 0 2024-09-12T22:33:15.733 INFO:tasks.workunit.client.0.smithi019.stdout:3/476: chown dd/d1e/l2b 1611 1 2024-09-12T22:33:15.733 INFO:tasks.workunit.client.0.smithi019.stdout:9/560: creat dd/d10/d17/d22/d77/fb5 x:0 0 0 2024-09-12T22:33:15.733 INFO:tasks.workunit.client.0.smithi019.stdout:3/477: creat dd/d1e/d82/f87 x:0 0 0 2024-09-12T22:33:15.733 INFO:tasks.workunit.client.0.smithi019.stdout:8/542: dwrite d7/d8/d43/f8f [0,4194304] 0 2024-09-12T22:33:15.734 INFO:tasks.workunit.client.0.smithi019.stdout:8/543: fdatasync d7/d34/d78/d54/fa6 0 2024-09-12T22:33:15.734 INFO:tasks.workunit.client.0.smithi019.stdout:3/478: creat dd/d12/d62/f88 x:0 0 0 2024-09-12T22:33:15.734 INFO:tasks.workunit.client.0.smithi019.stdout:5/665: dread d0/d7/d16/f2a [0,4194304] 0 2024-09-12T22:33:15.734 INFO:tasks.workunit.client.0.smithi019.stdout:9/561: rename dd/d10/d17/d22/d6c/f74 to dd/d10/d17/d23/d2e/d31/d3f/fb6 0 2024-09-12T22:33:15.734 INFO:tasks.workunit.client.0.smithi019.stdout:3/479: fdatasync dd/f11 0 2024-09-12T22:33:15.734 INFO:tasks.workunit.client.0.smithi019.stdout:8/544: chown d7/d2f/c72 16469572 1 2024-09-12T22:33:15.734 INFO:tasks.workunit.client.0.smithi019.stdout:1/671: dread d3/df/d7e/db7/d63/f85 [0,4194304] 0 2024-09-12T22:33:15.735 INFO:tasks.workunit.client.0.smithi019.stdout:3/480: creat dd/d1e/d82/f89 x:0 0 0 2024-09-12T22:33:15.735 INFO:tasks.workunit.client.0.smithi019.stdout:9/562: write dd/d10/d17/d23/d2e/d31/d3f/d47/d6e/d80/f8d [3460274,80160] 0 2024-09-12T22:33:15.735 INFO:tasks.workunit.client.0.smithi019.stdout:8/545: symlink d7/d34/d78/lac 0 2024-09-12T22:33:15.735 INFO:tasks.workunit.client.0.smithi019.stdout:3/481: truncate dd/d12/f29 1686861 0 2024-09-12T22:33:15.735 INFO:tasks.workunit.client.0.smithi019.stdout:8/546: write d7/d2f/d42/f93 [50442,11161] 0 2024-09-12T22:33:15.735 INFO:tasks.workunit.client.0.smithi019.stdout:8/547: write d7/d8/f7d [1533235,55305] 0 2024-09-12T22:33:15.735 INFO:tasks.workunit.client.0.smithi019.stdout:5/666: dwrite d0/f7e [0,4194304] 0 2024-09-12T22:33:15.736 INFO:tasks.workunit.client.0.smithi019.stdout:8/548: dread - d7/d2f/f6d zero size 2024-09-12T22:33:15.736 INFO:tasks.workunit.client.0.smithi019.stdout:4/559: dread d1/d4/d38/f3b [0,4194304] 0 2024-09-12T22:33:15.736 INFO:tasks.workunit.client.0.smithi019.stdout:8/549: dread - d7/d8/fa7 zero size 2024-09-12T22:33:15.736 INFO:tasks.workunit.client.0.smithi019.stdout:2/529: dread d0/d5/d18/d5c/f78 [0,4194304] 0 2024-09-12T22:33:15.736 INFO:tasks.workunit.client.0.smithi019.stdout:8/550: chown d7/d34/d78/l4e 12028 1 2024-09-12T22:33:15.736 INFO:tasks.workunit.client.0.smithi019.stdout:8/551: readlink d7/l62 0 2024-09-12T22:33:15.736 INFO:tasks.workunit.client.0.smithi019.stdout:2/530: write d0/d5/d18/d5c/d63/f62 [970216,105675] 0 2024-09-12T22:33:15.737 INFO:tasks.workunit.client.0.smithi019.stdout:1/672: creat d3/df/d7e/db7/d16/d3c/d55/fd6 x:0 0 0 2024-09-12T22:33:15.737 INFO:tasks.workunit.client.0.smithi019.stdout:9/563: write dd/d10/d17/d22/f95 [2099548,55098] 0 2024-09-12T22:33:15.737 INFO:tasks.workunit.client.0.smithi019.stdout:4/560: dwrite d1/d22/d31/d85/fab [0,4194304] 0 2024-09-12T22:33:15.737 INFO:tasks.workunit.client.0.smithi019.stdout:1/673: truncate d3/df/d7e/db7/d63/d76/f9c 4767068 0 2024-09-12T22:33:15.737 INFO:tasks.workunit.client.0.smithi019.stdout:3/482: rename dd/d12/d62/d6a/l72 to dd/d12/d62/d74/l8a 0 2024-09-12T22:33:15.737 INFO:tasks.workunit.client.0.smithi019.stdout:7/520: getdents d6/d14/d2a/da4/dc/d63/d4b 0 2024-09-12T22:33:15.737 INFO:tasks.workunit.client.0.smithi019.stdout:6/628: truncate d1b/d26/d39/d6a/f92 299265 0 2024-09-12T22:33:15.737 INFO:tasks.workunit.client.0.smithi019.stdout:4/561: mknod d1/d4c/db0/d75/d5a/d79/cb9 0 2024-09-12T22:33:15.738 INFO:tasks.workunit.client.0.smithi019.stdout:6/629: truncate fb 5183181 0 2024-09-12T22:33:15.738 INFO:tasks.workunit.client.0.smithi019.stdout:8/552: write d7/d8/f1b [1002533,26665] 0 2024-09-12T22:33:15.738 INFO:tasks.workunit.client.0.smithi019.stdout:9/564: write dd/d10/d17/d22/f9a [82623,79209] 0 2024-09-12T22:33:15.738 INFO:tasks.workunit.client.0.smithi019.stdout:5/667: symlink d0/d7/d2d/d32/d36/d8c/db8/d39/d38/le3 0 2024-09-12T22:33:15.738 INFO:tasks.workunit.client.0.smithi019.stdout:2/531: unlink d0/da/c5b 0 2024-09-12T22:33:15.738 INFO:tasks.workunit.client.0.smithi019.stdout:1/674: unlink l2 0 2024-09-12T22:33:15.739 INFO:tasks.workunit.client.0.smithi019.stdout:3/483: creat dd/d12/d62/d78/f8b x:0 0 0 2024-09-12T22:33:15.739 INFO:tasks.workunit.client.0.smithi019.stdout:6/630: creat d1b/fdb x:0 0 0 2024-09-12T22:33:15.739 INFO:tasks.workunit.client.0.smithi019.stdout:8/553: creat d7/d8/d43/d87/fad x:0 0 0 2024-09-12T22:33:15.739 INFO:tasks.workunit.client.0.smithi019.stdout:5/668: readlink d0/d7/d2d/d4c/d87/lcb 0 2024-09-12T22:33:15.739 INFO:tasks.workunit.client.0.smithi019.stdout:9/565: symlink dd/d10/d17/d23/lb7 0 2024-09-12T22:33:15.739 INFO:tasks.workunit.client.0.smithi019.stdout:4/562: symlink d1/d11/d15/d81/lba 0 2024-09-12T22:33:15.740 INFO:tasks.workunit.client.0.smithi019.stdout:1/675: fsync d3/df/d7e/db7/d16/d3c/dbd/dc4/f82 0 2024-09-12T22:33:15.740 INFO:tasks.workunit.client.0.smithi019.stdout:3/484: readlink dd/d1e/l39 0 2024-09-12T22:33:15.740 INFO:tasks.workunit.client.0.smithi019.stdout:8/554: symlink d7/d34/d78/d53/da8/lae 0 2024-09-12T22:33:15.740 INFO:tasks.workunit.client.0.smithi019.stdout:9/566: mknod dd/d10/d17/d23/d2e/d31/d7e/cb8 0 2024-09-12T22:33:15.740 INFO:tasks.workunit.client.0.smithi019.stdout:4/563: mkdir d1/d4c/db0/d75/d5a/d79/db4/dbb 0 2024-09-12T22:33:15.741 INFO:tasks.workunit.client.0.smithi019.stdout:5/669: creat d0/d7/d2d/d32/d36/d8c/db8/fe4 x:0 0 0 2024-09-12T22:33:15.741 INFO:tasks.workunit.client.0.smithi019.stdout:7/521: dwrite d6/d2d/d41/f9a [0,4194304] 0 2024-09-12T22:33:15.741 INFO:tasks.workunit.client.0.smithi019.stdout:8/555: mkdir d7/d2f/d42/d98/daf 0 2024-09-12T22:33:15.741 INFO:tasks.workunit.client.0.smithi019.stdout:7/522: fdatasync d6/d2d/d8f/daf/f95 0 2024-09-12T22:33:15.741 INFO:tasks.workunit.client.0.smithi019.stdout:2/532: dwrite d0/d5/d18/d5c/d63/d6a/f76 [0,4194304] 0 2024-09-12T22:33:15.746 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:15.620+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:15.749 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:33:15.749 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [ 2024-09-12T22:33:15.749 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:15.749 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(client.4490.0:13280 4.c e55/18 4:3083e1fe:::100000031e1.00000000:head v 55'200, mlcod=55'198)", 2024-09-12T22:33:15.749 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:15.643300+0000", 2024-09-12T22:33:15.750 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.016368509999999999, 2024-09-12T22:33:15.750 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016386611999999998, 2024-09-12T22:33:15.750 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:15.750 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:15.750 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:33:15.750 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:15.751 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:15.751 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:15.751 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.643300+0000", 2024-09-12T22:33:15.751 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:15.751 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:15.751 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:15.752 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:15.752 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.643300+0000", 2024-09-12T22:33:15.752 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:15.752 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:15.752 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:15.752 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:15.753 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.643301+0000", 2024-09-12T22:33:15.754 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.3900000000000004e-07 2024-09-12T22:33:15.754 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:15.754 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:15.754 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:15.754 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.650159+0000", 2024-09-12T22:33:15.754 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.006857765 2024-09-12T22:33:15.754 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:15.754 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:15.754 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:15.754 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.650193+0000", 2024-09-12T22:33:15.754 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4236999999999998e-05 2024-09-12T22:33:15.754 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:15.754 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:15.755 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:15.755 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.650209+0000", 2024-09-12T22:33:15.755 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6271999999999999e-05 2024-09-12T22:33:15.755 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:15.755 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:15.755 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:15.755 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.650280+0000", 2024-09-12T22:33:15.755 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.0613999999999998e-05 2024-09-12T22:33:15.755 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:15.755 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:15.755 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:15.755 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.650299+0000", 2024-09-12T22:33:15.755 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.9323000000000001e-05 2024-09-12T22:33:15.755 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:15.756 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:15.756 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:15.756 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:15.756 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:15.756 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4490.0:13287 4.26 4:67aa8e4f:::100000031c5.00000000:head [write 0~4194304 [2@931190] in=4194304b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-12T22:33:15.756 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:15.642959+0000", 2024-09-12T22:33:15.756 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.016709399, 2024-09-12T22:33:15.756 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016767977, 2024-09-12T22:33:15.756 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:15.756 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:15.756 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "waiting for sub ops", 2024-09-12T22:33:15.756 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:33:15.757 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4490", 2024-09-12T22:33:15.757 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:15.757 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 13287 2024-09-12T22:33:15.757 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:15.757 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:15.757 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:15.757 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:15.757 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.642959+0000", 2024-09-12T22:33:15.757 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:15.757 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:15.757 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:15.757 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:15.757 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.642959+0000", 2024-09-12T22:33:15.757 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:15.758 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:15.758 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:15.758 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:15.758 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.642960+0000", 2024-09-12T22:33:15.758 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.2500000000000004e-07 2024-09-12T22:33:15.758 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:15.758 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:15.758 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:15.758 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.650470+0000", 2024-09-12T22:33:15.758 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0075095700000000001 2024-09-12T22:33:15.758 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:15.758 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:15.758 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:15.759 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.650484+0000", 2024-09-12T22:33:15.759 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4112e-05 2024-09-12T22:33:15.759 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:15.759 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:15.759 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:15.759 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.650492+0000", 2024-09-12T22:33:15.759 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0059999999999992e-06 2024-09-12T22:33:15.759 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:15.759 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:15.759 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:15.759 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.650544+0000", 2024-09-12T22:33:15.759 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2153e-05 2024-09-12T22:33:15.759 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:15.760 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:15.760 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:15.760 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.650616+0000", 2024-09-12T22:33:15.760 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1977999999999994e-05 2024-09-12T22:33:15.760 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:15.760 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:15.760 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:15.760 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.650757+0000", 2024-09-12T22:33:15.760 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014110699999999999 2024-09-12T22:33:15.760 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:15.760 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:15.760 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:15.760 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:15.761 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:15.761 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4490.0:13292 4.26 4:64d06d53:::100000033ee.00000000:head [read 1048576~1048576] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e55)", 2024-09-12T22:33:15.761 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:15.650686+0000", 2024-09-12T22:33:15.761 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.0089823249999999993, 2024-09-12T22:33:15.761 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0090831650000000007, 2024-09-12T22:33:15.761 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:15.761 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:15.761 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:33:15.761 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:33:15.761 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4490", 2024-09-12T22:33:15.761 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:15.761 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 13292 2024-09-12T22:33:15.761 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:15.762 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:15.762 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:15.762 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:15.762 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.650686+0000", 2024-09-12T22:33:15.762 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:15.762 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:15.762 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:15.762 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:15.762 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.650686+0000", 2024-09-12T22:33:15.762 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:15.762 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:15.762 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:15.762 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:15.762 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.650687+0000", 2024-09-12T22:33:15.763 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0800000000000005e-07 2024-09-12T22:33:15.763 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:15.763 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:15.763 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:15.763 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.650689+0000", 2024-09-12T22:33:15.763 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.458e-06 2024-09-12T22:33:15.763 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:15.763 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:15.763 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:15.763 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.650697+0000", 2024-09-12T22:33:15.763 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4789999999999999e-06 2024-09-12T22:33:15.763 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:15.763 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:15.764 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:15.764 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.650702+0000", 2024-09-12T22:33:15.764 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9649999999999999e-06 2024-09-12T22:33:15.764 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:15.764 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:15.764 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:15.764 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.655520+0000", 2024-09-12T22:33:15.764 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0048183109999999996 2024-09-12T22:33:15.764 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:15.764 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:15.764 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:15.764 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.655570+0000", 2024-09-12T22:33:15.764 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0036e-05 2024-09-12T22:33:15.764 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:15.765 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:15.765 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:15.765 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:15.765 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:15.765 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:1772 3.18 3:1e8917d7:::200.0000000e:head [write 4132162~7781 [fadvise_dontneed] in=7781b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e55)", 2024-09-12T22:33:15.765 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:15.654160+0000", 2024-09-12T22:33:15.765 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.0055086149999999997, 2024-09-12T22:33:15.765 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0056485909999999997, 2024-09-12T22:33:15.765 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:15.765 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:15.765 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:33:15.765 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:15.765 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:15.766 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:15.766 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.654160+0000", 2024-09-12T22:33:15.766 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:15.766 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:15.766 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:15.766 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:15.766 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.654160+0000", 2024-09-12T22:33:15.766 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:15.766 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:15.766 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:15.766 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:15.766 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.654162+0000", 2024-09-12T22:33:15.766 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6559999999999999e-06 2024-09-12T22:33:15.767 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:15.767 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:15.767 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:15.767 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.654176+0000", 2024-09-12T22:33:15.767 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4085e-05 2024-09-12T22:33:15.767 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:15.767 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:15.767 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:15.767 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.654192+0000", 2024-09-12T22:33:15.767 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.5818999999999999e-05 2024-09-12T22:33:15.767 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:15.767 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:15.767 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:15.767 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.654202+0000", 2024-09-12T22:33:15.768 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0166999999999999e-05 2024-09-12T22:33:15.768 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:15.768 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:15.768 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:15.768 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.654279+0000", 2024-09-12T22:33:15.768 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.7145999999999996e-05 2024-09-12T22:33:15.768 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:15.768 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:15.768 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:15.768 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.654396+0000", 2024-09-12T22:33:15.768 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000116975 2024-09-12T22:33:15.768 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:15.768 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:15.769 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:15.769 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:15.769 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:15.769 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:1773 3.18 3:1e8917d7:::200.0000000e:head [write 4139943~8448 [fadvise_dontneed] in=8448b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e55)", 2024-09-12T22:33:15.769 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:15.655653+0000", 2024-09-12T22:33:15.769 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.0040162799999999997, 2024-09-12T22:33:15.769 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0041963139999999996, 2024-09-12T22:33:15.769 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:15.769 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:15.769 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:33:15.769 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:15.769 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:15.769 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:15.769 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.655653+0000", 2024-09-12T22:33:15.770 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:15.770 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:15.770 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:15.770 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:15.770 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.655653+0000", 2024-09-12T22:33:15.770 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:15.770 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:15.770 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:15.770 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:15.770 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.655653+0000", 2024-09-12T22:33:15.770 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.7900000000000007e-07 2024-09-12T22:33:15.770 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:15.770 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:15.771 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:15.771 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.655664+0000", 2024-09-12T22:33:15.771 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.031e-05 2024-09-12T22:33:15.771 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:15.771 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:15.771 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:15.771 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.655682+0000", 2024-09-12T22:33:15.771 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.8164000000000001e-05 2024-09-12T22:33:15.771 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:15.772 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:15.772 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:15.772 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.655688+0000", 2024-09-12T22:33:15.772 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0789999999999997e-06 2024-09-12T22:33:15.772 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:15.772 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:15.772 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:15.772 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.655733+0000", 2024-09-12T22:33:15.772 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4814999999999997e-05 2024-09-12T22:33:15.772 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:15.772 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:15.772 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:15.772 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.655779+0000", 2024-09-12T22:33:15.773 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5779000000000003e-05 2024-09-12T22:33:15.773 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:15.773 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:15.773 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:15.773 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:15.773 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:15.773 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4490.0:13293 4.12 4:4b7d712e:::100000030d9.00000000:head [write 0~4194304 [3@3445752] in=4194304b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-12T22:33:15.773 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:15.652185+0000", 2024-09-12T22:33:15.773 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.0074834480000000002, 2024-09-12T22:33:15.773 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0076969819999999998, 2024-09-12T22:33:15.773 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:15.773 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:15.773 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:33:15.773 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:33:15.774 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4490", 2024-09-12T22:33:15.774 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:15.774 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 13293 2024-09-12T22:33:15.774 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:15.774 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:15.774 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:15.774 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:15.774 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.652185+0000", 2024-09-12T22:33:15.774 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:15.774 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:15.774 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:15.774 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:15.774 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.652185+0000", 2024-09-12T22:33:15.776 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:15.776 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:15.776 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:15.776 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:15.776 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.652187+0000", 2024-09-12T22:33:15.776 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4470000000000001e-06 2024-09-12T22:33:15.776 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:15.777 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:15.777 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:15.777 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.657096+0000", 2024-09-12T22:33:15.777 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.004909432 2024-09-12T22:33:15.777 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:15.777 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:15.777 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:15.777 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.657106+0000", 2024-09-12T22:33:15.777 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.2860000000000005e-06 2024-09-12T22:33:15.777 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:15.777 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:15.777 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:15.777 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.657110+0000", 2024-09-12T22:33:15.778 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2610000000000004e-06 2024-09-12T22:33:15.778 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:15.778 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:15.778 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:15.778 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.657160+0000", 2024-09-12T22:33:15.778 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0130000000000003e-05 2024-09-12T22:33:15.778 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:15.778 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:15.778 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:15.778 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.657207+0000", 2024-09-12T22:33:15.778 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.7552000000000001e-05 2024-09-12T22:33:15.778 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:15.778 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:15.779 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:15.779 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:15.779 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:15.779 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4490.0:13295 4.15 4:a8300f0b:::10000003308.00000000:head [read 1048576~1048576] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e55)", 2024-09-12T22:33:15.779 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:15.657123+0000", 2024-09-12T22:33:15.779 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.0025461949999999998, 2024-09-12T22:33:15.779 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00279444, 2024-09-12T22:33:15.779 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:15.779 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:15.779 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:33:15.779 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:33:15.779 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4490", 2024-09-12T22:33:15.779 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:15.780 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 13295 2024-09-12T22:33:15.780 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:15.780 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:15.780 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:15.780 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:15.780 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.657123+0000", 2024-09-12T22:33:15.780 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:15.780 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:15.780 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:15.780 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:15.780 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.657123+0000", 2024-09-12T22:33:15.780 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:15.780 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:15.780 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:15.781 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:15.781 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.657123+0000", 2024-09-12T22:33:15.781 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9299999999999998e-07 2024-09-12T22:33:15.781 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:15.781 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:15.781 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:15.781 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.657125+0000", 2024-09-12T22:33:15.781 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.0109999999999999e-06 2024-09-12T22:33:15.781 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:15.781 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:15.781 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:15.781 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.657129+0000", 2024-09-12T22:33:15.781 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1119999999999998e-06 2024-09-12T22:33:15.782 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:15.782 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:15.782 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:15.782 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.657133+0000", 2024-09-12T22:33:15.782 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.6389999999999998e-06 2024-09-12T22:33:15.782 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:15.782 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:15.782 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:15.782 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.657201+0000", 2024-09-12T22:33:15.782 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.8246999999999999e-05 2024-09-12T22:33:15.782 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:15.782 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:15.782 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:15.782 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.657246+0000", 2024-09-12T22:33:15.783 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4530999999999998e-05 2024-09-12T22:33:15.783 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:15.783 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:15.783 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:15.783 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:15.783 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:15.783 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:1774 3.18 3:1e8917d7:::200.0000000e:head [write 4148391~3917 [fadvise_dontneed] in=3917b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e55)", 2024-09-12T22:33:15.783 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:15.658170+0000", 2024-09-12T22:33:15.783 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.0014991830000000001, 2024-09-12T22:33:15.783 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0017835780000000001, 2024-09-12T22:33:15.783 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:15.783 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:15.783 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:33:15.784 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:15.784 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:15.784 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:15.784 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.658170+0000", 2024-09-12T22:33:15.784 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:15.784 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:15.784 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:15.784 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:15.784 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.658170+0000", 2024-09-12T22:33:15.784 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:15.784 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:15.784 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:15.784 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:15.785 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.658171+0000", 2024-09-12T22:33:15.785 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1200000000000001e-06 2024-09-12T22:33:15.785 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:15.785 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:15.785 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:15.785 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.658178+0000", 2024-09-12T22:33:15.785 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.6499999999999996e-06 2024-09-12T22:33:15.785 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:15.785 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:15.785 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:15.785 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.658191+0000", 2024-09-12T22:33:15.785 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2218000000000001e-05 2024-09-12T22:33:15.785 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:15.785 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:15.786 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:15.786 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.658196+0000", 2024-09-12T22:33:15.786 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2279999999999998e-06 2024-09-12T22:33:15.786 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:15.786 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:15.786 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:15.786 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.658239+0000", 2024-09-12T22:33:15.786 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3198999999999998e-05 2024-09-12T22:33:15.786 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:15.786 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:15.786 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:15.786 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.658283+0000", 2024-09-12T22:33:15.786 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4221999999999998e-05 2024-09-12T22:33:15.787 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:15.787 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:15.787 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:15.787 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:15.787 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-09-12T22:33:15.787 INFO:teuthology.orchestra.run.smithi148.stdout: "num_ops": 8 2024-09-12T22:33:15.787 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:33:15.788 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:33:15.788 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:15.745+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:15.812 INFO:tasks.workunit.client.0.smithi019.stdout:8/556: stat d7/d8/dd/f55 0 2024-09-12T22:33:15.812 INFO:tasks.workunit.client.0.smithi019.stdout:5/670: creat d0/d7/d2d/d32/d36/d8c/db8/d39/d38/d4b/dde/fe5 x:0 0 0 2024-09-12T22:33:15.812 INFO:tasks.workunit.client.0.smithi019.stdout:1/676: dwrite d3/d6e/da9/f2a [0,4194304] 0 2024-09-12T22:33:15.812 INFO:tasks.workunit.client.0.smithi019.stdout:7/523: symlink d6/d14/d2a/da4/dc/d63/lc4 0 2024-09-12T22:33:15.813 INFO:tasks.workunit.client.0.smithi019.stdout:8/557: symlink d7/d2f/d75/lb0 0 2024-09-12T22:33:15.813 INFO:tasks.workunit.client.0.smithi019.stdout:1/677: chown d3/df/d7e/db7/d16/d3c 2042 1 2024-09-12T22:33:15.813 INFO:tasks.workunit.client.0.smithi019.stdout:0/575: sync 2024-09-12T22:33:15.813 INFO:tasks.workunit.client.0.smithi019.stdout:7/524: creat d6/d14/fc5 x:0 0 0 2024-09-12T22:33:15.813 INFO:tasks.workunit.client.0.smithi019.stdout:5/671: rmdir d0/d7/d2d/d32/d36/d8c/db8/d39/d38/dba 39 2024-09-12T22:33:15.813 INFO:tasks.workunit.client.0.smithi019.stdout:4/564: dwrite d1/d11/d15/d81/f9f [0,4194304] 0 2024-09-12T22:33:15.813 INFO:tasks.workunit.client.0.smithi019.stdout:7/525: chown d6/d14 7596 1 2024-09-12T22:33:15.813 INFO:tasks.workunit.client.0.smithi019.stdout:7/526: creat d6/d14/d45/db0/fc6 x:0 0 0 2024-09-12T22:33:15.813 INFO:tasks.workunit.client.0.smithi019.stdout:5/672: rmdir d0/d7/d2d/d32/d4a/dbb/dd5 39 2024-09-12T22:33:15.813 INFO:tasks.workunit.client.0.smithi019.stdout:1/678: mknod d3/df/d7e/db7/d16/d3c/dce/cd7 0 2024-09-12T22:33:15.813 INFO:tasks.workunit.client.0.smithi019.stdout:4/565: creat d1/d11/d15/d1f/d56/fbc x:0 0 0 2024-09-12T22:33:15.813 INFO:tasks.workunit.client.0.smithi019.stdout:2/533: dwrite d0/d5/d18/d3b/f8a [0,4194304] 0 2024-09-12T22:33:15.813 INFO:tasks.workunit.client.0.smithi019.stdout:4/566: chown d1/d8/f64 101787 1 2024-09-12T22:33:15.814 INFO:tasks.workunit.client.0.smithi019.stdout:7/527: fsync d6/d14/d45/fa6 0 2024-09-12T22:33:15.814 INFO:tasks.workunit.client.0.smithi019.stdout:4/567: chown d1/d8/l1e 1 1 2024-09-12T22:33:15.814 INFO:tasks.workunit.client.0.smithi019.stdout:1/679: truncate d3/df/d7e/db7/d16/d3c/fac 530764 0 2024-09-12T22:33:15.814 INFO:tasks.workunit.client.0.smithi019.stdout:2/534: getdents d0/d5/d18 0 2024-09-12T22:33:15.814 INFO:tasks.workunit.client.0.smithi019.stdout:7/528: link d6/d14/d2a/da4/l52 d6/d14/d15/d9e/lc7 0 2024-09-12T22:33:15.814 INFO:tasks.workunit.client.0.smithi019.stdout:4/568: read - d1/d11/f99 zero size 2024-09-12T22:33:15.814 INFO:tasks.workunit.client.0.smithi019.stdout:8/558: dwrite d7/d8/dd/d4f/f80 [0,4194304] 0 2024-09-12T22:33:15.814 INFO:tasks.workunit.client.0.smithi019.stdout:1/680: symlink d3/df/d7e/ld8 0 2024-09-12T22:33:15.814 INFO:tasks.workunit.client.0.smithi019.stdout:7/529: mknod d6/d14/d15/cc8 0 2024-09-12T22:33:15.814 INFO:tasks.workunit.client.0.smithi019.stdout:2/535: symlink d0/d5/d18/d1b/lae 0 2024-09-12T22:33:15.814 INFO:tasks.workunit.client.0.smithi019.stdout:8/559: write d7/d8/d43/d87/fad [193066,52444] 0 2024-09-12T22:33:15.814 INFO:tasks.workunit.client.0.smithi019.stdout:1/681: truncate d3/d1b/f1d 8406802 0 2024-09-12T22:33:15.814 INFO:tasks.workunit.client.0.smithi019.stdout:2/536: write d0/d5/d60/f9d [1274202,5259] 0 2024-09-12T22:33:15.815 INFO:tasks.workunit.client.0.smithi019.stdout:5/673: dwrite d0/d7/d2d/d32/d36/d8c/db8/d39/d38/d4b/f99 [0,4194304] 0 2024-09-12T22:33:15.815 INFO:tasks.workunit.client.0.smithi019.stdout:7/530: rename d6/d14/d2a/da4/d34/c9c to d6/d14/d2a/cc9 0 2024-09-12T22:33:15.815 INFO:tasks.workunit.client.0.smithi019.stdout:1/682: rmdir d3/d6e/da9/d54 39 2024-09-12T22:33:15.815 INFO:tasks.workunit.client.0.smithi019.stdout:1/683: stat d3/d3f/d58/la1 0 2024-09-12T22:33:15.815 INFO:tasks.workunit.client.0.smithi019.stdout:2/537: creat d0/da/d73/faf x:0 0 0 2024-09-12T22:33:15.815 INFO:tasks.workunit.client.0.smithi019.stdout:7/531: mkdir d6/d14/d45/dca 0 2024-09-12T22:33:15.815 INFO:tasks.workunit.client.0.smithi019.stdout:4/569: dwrite d1/d11/d15/d81/f9f [0,4194304] 0 2024-09-12T22:33:15.815 INFO:tasks.workunit.client.0.smithi019.stdout:7/532: creat d6/d2d/d77/fcb x:0 0 0 2024-09-12T22:33:15.815 INFO:tasks.workunit.client.0.smithi019.stdout:5/674: unlink d0/d7/d2d/d32/d36/d8c/db8/f5f 0 2024-09-12T22:33:15.815 INFO:tasks.workunit.client.0.smithi019.stdout:1/684: mkdir d3/df/d7e/db7/d63/d76/dd9 0 2024-09-12T22:33:15.815 INFO:tasks.workunit.client.0.smithi019.stdout:4/570: symlink d1/d22/d57/lbd 0 2024-09-12T22:33:15.815 INFO:tasks.workunit.client.0.smithi019.stdout:5/675: mkdir d0/d7/de6 0 2024-09-12T22:33:15.815 INFO:tasks.workunit.client.0.smithi019.stdout:6/631: dread d1b/db4/fd3 [0,4194304] 0 2024-09-12T22:33:15.816 INFO:tasks.workunit.client.0.smithi019.stdout:5/676: creat d0/d7/d16/fe7 x:0 0 0 2024-09-12T22:33:15.816 INFO:tasks.workunit.client.0.smithi019.stdout:1/685: getdents d3/df/d7e/db7 0 2024-09-12T22:33:15.816 INFO:tasks.workunit.client.0.smithi019.stdout:8/560: dread d7/d5e/f91 [0,4194304] 0 2024-09-12T22:33:15.816 INFO:tasks.workunit.client.0.smithi019.stdout:8/561: chown d7/d8/dd/d4f 1713126 1 2024-09-12T22:33:15.816 INFO:tasks.workunit.client.0.smithi019.stdout:5/677: symlink d0/d7/d2d/d32/dcd/le8 0 2024-09-12T22:33:15.816 INFO:tasks.workunit.client.0.smithi019.stdout:6/632: link d1b/d2d/f9d d1b/d26/d39/d6a/d97/fdc 0 2024-09-12T22:33:15.816 INFO:tasks.workunit.client.0.smithi019.stdout:1/686: unlink d3/df/d7e/d96/f9e 0 2024-09-12T22:33:15.816 INFO:tasks.workunit.client.0.smithi019.stdout:4/571: read d1/d8/fb [575184,5111] 0 2024-09-12T22:33:15.816 INFO:tasks.workunit.client.0.smithi019.stdout:8/562: chown d7/d34/d78/d2d/d84 2609656 1 2024-09-12T22:33:15.816 INFO:tasks.workunit.client.0.smithi019.stdout:2/538: read d0/d5/d17/f14 [335557,54535] 0 2024-09-12T22:33:15.816 INFO:tasks.workunit.client.0.smithi019.stdout:7/533: dwrite d6/d14/d15/f18 [0,4194304] 0 2024-09-12T22:33:15.816 INFO:tasks.workunit.client.0.smithi019.stdout:8/563: dread - d7/d2f/f6d zero size 2024-09-12T22:33:15.816 INFO:tasks.workunit.client.0.smithi019.stdout:2/539: dread - d0/d5/d60/d71/faa zero size 2024-09-12T22:33:15.817 INFO:tasks.workunit.client.0.smithi019.stdout:4/572: creat d1/d8/d7b/fbe x:0 0 0 2024-09-12T22:33:15.817 INFO:tasks.workunit.client.0.smithi019.stdout:8/564: fdatasync d7/f19 0 2024-09-12T22:33:15.817 INFO:tasks.workunit.client.0.smithi019.stdout:6/633: getdents d1b/d26/d39/d89 0 2024-09-12T22:33:15.817 INFO:tasks.workunit.client.0.smithi019.stdout:8/565: symlink d7/d34/lb1 0 2024-09-12T22:33:15.817 INFO:tasks.workunit.client.0.smithi019.stdout:2/540: creat d0/d5/d17/d91/d9c/fb0 x:0 0 0 2024-09-12T22:33:15.817 INFO:tasks.workunit.client.0.smithi019.stdout:8/566: creat d7/d8/d43/d87/fb2 x:0 0 0 2024-09-12T22:33:15.817 INFO:tasks.workunit.client.0.smithi019.stdout:3/485: dread dd/f26 [0,4194304] 0 2024-09-12T22:33:15.817 INFO:tasks.workunit.client.0.smithi019.stdout:1/687: dwrite d3/df/d7e/db7/d16/d3c/dbd/dc4/f67 [0,4194304] 0 2024-09-12T22:33:15.817 INFO:tasks.workunit.client.0.smithi019.stdout:1/688: fsync d3/d1b/f21 0 2024-09-12T22:33:15.817 INFO:tasks.workunit.client.0.smithi019.stdout:8/567: symlink d7/lb3 0 2024-09-12T22:33:15.817 INFO:tasks.workunit.client.0.smithi019.stdout:8/568: stat d7/f59 0 2024-09-12T22:33:15.817 INFO:tasks.workunit.client.0.smithi019.stdout:3/486: mknod dd/d1e/c8c 0 2024-09-12T22:33:15.817 INFO:tasks.workunit.client.0.smithi019.stdout:4/573: dwrite d1/d8/f20 [0,4194304] 0 2024-09-12T22:33:15.818 INFO:tasks.workunit.client.0.smithi019.stdout:3/487: symlink dd/l8d 0 2024-09-12T22:33:15.818 INFO:tasks.workunit.client.0.smithi019.stdout:4/574: fdatasync d1/d4c/db0/d75/d5a/f8b 0 2024-09-12T22:33:15.818 INFO:tasks.workunit.client.0.smithi019.stdout:8/569: rmdir d7/d2f/d42/d98/daf 0 2024-09-12T22:33:15.818 INFO:tasks.workunit.client.0.smithi019.stdout:3/488: creat dd/d1e/d5a/f8e x:0 0 0 2024-09-12T22:33:15.818 INFO:tasks.workunit.client.0.smithi019.stdout:9/567: dread dd/f18 [0,4194304] 0 2024-09-12T22:33:15.818 INFO:tasks.workunit.client.0.smithi019.stdout:4/575: mkdir d1/d4/d38/dbf 0 2024-09-12T22:33:15.818 INFO:tasks.workunit.client.0.smithi019.stdout:5/678: dwrite d0/d7/d2d/d32/d36/d8c/db8/d39/f4e [0,4194304] 0 2024-09-12T22:33:15.818 INFO:tasks.workunit.client.0.smithi019.stdout:8/570: rename d7/lb3 to d7/lb4 0 2024-09-12T22:33:15.818 INFO:tasks.workunit.client.0.smithi019.stdout:3/489: write dd/d1e/f2e [1581683,42199] 0 2024-09-12T22:33:15.818 INFO:tasks.workunit.client.0.smithi019.stdout:0/576: dread d1/fd [0,4194304] 0 2024-09-12T22:33:15.818 INFO:tasks.workunit.client.0.smithi019.stdout:9/568: write dd/d10/d17/d22/d6c/d53/d69/d9d/fa5 [285172,110156] 0 2024-09-12T22:33:15.818 INFO:tasks.workunit.client.0.smithi019.stdout:8/571: fsync d7/d34/f7c 0 2024-09-12T22:33:15.818 INFO:tasks.workunit.client.0.smithi019.stdout:1/689: dwrite d3/d3f/d58/fb1 [0,4194304] 0 2024-09-12T22:33:15.818 INFO:tasks.workunit.client.0.smithi019.stdout:3/490: creat dd/d1e/d82/f8f x:0 0 0 2024-09-12T22:33:15.819 INFO:tasks.workunit.client.0.smithi019.stdout:0/577: unlink d1/d14/d32/d71/c74 0 2024-09-12T22:33:15.819 INFO:tasks.workunit.client.0.smithi019.stdout:1/690: mkdir d3/df/d7e/d90/dda 0 2024-09-12T22:33:15.819 INFO:tasks.workunit.client.0.smithi019.stdout:8/572: symlink d7/d34/d78/lb5 0 2024-09-12T22:33:15.819 INFO:tasks.workunit.client.0.smithi019.stdout:4/576: dwrite d1/d4/f88 [0,4194304] 0 2024-09-12T22:33:15.819 INFO:tasks.workunit.client.0.smithi019.stdout:9/569: symlink dd/d10/d17/d23/d2e/d31/d3f/d67/lb9 0 2024-09-12T22:33:15.819 INFO:tasks.workunit.client.0.smithi019.stdout:1/691: mknod d3/d3f/d58/d7f/cdb 0 2024-09-12T22:33:15.819 INFO:tasks.workunit.client.0.smithi019.stdout:0/578: readlink d1/d1f/l3e 0 2024-09-12T22:33:15.819 INFO:tasks.workunit.client.0.smithi019.stdout:4/577: creat d1/d8/fc0 x:0 0 0 2024-09-12T22:33:15.819 INFO:tasks.workunit.client.0.smithi019.stdout:0/579: creat d1/fa9 x:0 0 0 2024-09-12T22:33:15.819 INFO:tasks.workunit.client.0.smithi019.stdout:5/679: dwrite d0/d7/d2d/d32/d36/d8c/db5/fcc [0,4194304] 0 2024-09-12T22:33:15.819 INFO:tasks.workunit.client.0.smithi019.stdout:0/580: fdatasync d1/d1f/f41 0 2024-09-12T22:33:15.819 INFO:tasks.workunit.client.0.smithi019.stdout:2/541: sync 2024-09-12T22:33:15.819 INFO:tasks.workunit.client.0.smithi019.stdout:8/573: rename d7/d34/f3e to d7/d8/d43/d87/fb6 0 2024-09-12T22:33:15.820 INFO:tasks.workunit.client.0.smithi019.stdout:4/578: dread - d1/d11/d15/d49/fb1 zero size 2024-09-12T22:33:15.820 INFO:tasks.workunit.client.0.smithi019.stdout:8/574: fsync d7/d2f/fa5 0 2024-09-12T22:33:15.820 INFO:tasks.workunit.client.0.smithi019.stdout:9/570: dread - dd/d10/d17/d23/d2e/d31/d64/fa7 zero size 2024-09-12T22:33:15.820 INFO:tasks.workunit.client.0.smithi019.stdout:3/491: dwrite dd/d12/f65 [0,4194304] 0 2024-09-12T22:33:15.820 INFO:tasks.workunit.client.0.smithi019.stdout:2/542: chown d0/da/d73/d7c 58873 1 2024-09-12T22:33:15.820 INFO:tasks.workunit.client.0.smithi019.stdout:3/492: readlink la 0 2024-09-12T22:33:15.820 INFO:tasks.workunit.client.0.smithi019.stdout:8/575: chown d7/d34/f7c 16245 1 2024-09-12T22:33:15.820 INFO:tasks.workunit.client.0.smithi019.stdout:4/579: write d1/d4/f13 [1780828,65945] 0 2024-09-12T22:33:15.820 INFO:tasks.workunit.client.0.smithi019.stdout:5/680: link d0/d7/d2d/d32/d36/d8c/db8/f34 d0/db9/fe9 0 2024-09-12T22:33:15.820 INFO:tasks.workunit.client.0.smithi019.stdout:3/493: chown dd/d12/d62/d74 91952 1 2024-09-12T22:33:15.820 INFO:tasks.workunit.client.0.smithi019.stdout:0/581: chown d1/d14/d1b/d3a/fa8 1603875 1 2024-09-12T22:33:15.820 INFO:tasks.workunit.client.0.smithi019.stdout:2/543: creat d0/d5/d18/d5c/d85/fb1 x:0 0 0 2024-09-12T22:33:15.820 INFO:tasks.workunit.client.0.smithi019.stdout:8/576: fdatasync d7/d8/f73 0 2024-09-12T22:33:15.820 INFO:tasks.workunit.client.0.smithi019.stdout:9/571: stat dd/d10/d17/d23/d2e/l32 0 2024-09-12T22:33:15.821 INFO:tasks.workunit.client.0.smithi019.stdout:3/494: creat dd/d1e/d40/f90 x:0 0 0 2024-09-12T22:33:15.821 INFO:tasks.workunit.client.0.smithi019.stdout:5/681: creat d0/d7/d2d/d32/d36/d8c/fea x:0 0 0 2024-09-12T22:33:15.821 INFO:tasks.workunit.client.0.smithi019.stdout:1/692: dwrite d3/df/d7e/db7/f3d [0,4194304] 0 2024-09-12T22:33:15.821 INFO:tasks.workunit.client.0.smithi019.stdout:3/495: dread - dd/d1e/d5a/f60 zero size 2024-09-12T22:33:15.821 INFO:tasks.workunit.client.0.smithi019.stdout:0/582: write d1/d14/d1b/f2e [2400487,88179] 0 2024-09-12T22:33:15.821 INFO:tasks.workunit.client.0.smithi019.stdout:8/577: mknod d7/d34/d78/d53/daa/cb7 0 2024-09-12T22:33:15.821 INFO:tasks.workunit.client.0.smithi019.stdout:9/572: rename dd/d10/d17/d23/d2e/l56 to dd/d10/d17/d22/d42/lba 0 2024-09-12T22:33:15.821 INFO:tasks.workunit.client.0.smithi019.stdout:1/693: chown d3/df/d7e/db7/d16/d3c/dbd/cbf 14 1 2024-09-12T22:33:15.821 INFO:tasks.workunit.client.0.smithi019.stdout:8/578: write d7/d34/d78/d2d/d84/f9d [565714,28335] 0 2024-09-12T22:33:15.821 INFO:tasks.workunit.client.0.smithi019.stdout:3/496: creat dd/f91 x:0 0 0 2024-09-12T22:33:15.821 INFO:tasks.workunit.client.0.smithi019.stdout:5/682: link d0/d7/d16/d69/fd4 d0/d7/d2d/d32/d36/d8c/db8/d39/d38/d4b/feb 0 2024-09-12T22:33:15.821 INFO:tasks.workunit.client.0.smithi019.stdout:9/573: mknod dd/d10/d17/d22/cbb 0 2024-09-12T22:33:15.821 INFO:tasks.workunit.client.0.smithi019.stdout:0/583: link d1/d14/d26/d40/d45/c63 d1/d14/d1b/d3a/caa 0 2024-09-12T22:33:15.822 INFO:tasks.workunit.client.0.smithi019.stdout:8/579: truncate d7/d8/f64 613169 0 2024-09-12T22:33:15.822 INFO:tasks.workunit.client.0.smithi019.stdout:3/497: mknod dd/d1e/d40/d5f/c92 0 2024-09-12T22:33:15.822 INFO:tasks.workunit.client.0.smithi019.stdout:8/580: creat d7/d34/d78/d54/fb8 x:0 0 0 2024-09-12T22:33:15.822 INFO:tasks.workunit.client.0.smithi019.stdout:1/694: truncate d3/d6e/da9/d54/f61 3210407 0 2024-09-12T22:33:15.822 INFO:tasks.workunit.client.0.smithi019.stdout:0/584: truncate d1/d1f/d5b/f72 629798 0 2024-09-12T22:33:15.822 INFO:tasks.workunit.client.0.smithi019.stdout:9/574: write dd/d10/d17/d23/d2e/d31/d3f/f4b [2664180,82409] 0 2024-09-12T22:33:15.822 INFO:tasks.workunit.client.0.smithi019.stdout:8/581: stat d7/d34/d78/d2d/d84/d8b/f90 0 2024-09-12T22:33:15.822 INFO:tasks.workunit.client.0.smithi019.stdout:2/544: truncate d0/d5/d18/d39/f44 351270 0 2024-09-12T22:33:15.822 INFO:tasks.workunit.client.0.smithi019.stdout:3/498: symlink dd/d1e/d40/d6e/d70/l93 0 2024-09-12T22:33:15.822 INFO:tasks.workunit.client.0.smithi019.stdout:0/585: mkdir d1/d1f/d5b/d83/dab 0 2024-09-12T22:33:15.822 INFO:tasks.workunit.client.0.smithi019.stdout:2/545: write d0/d5/fa9 [189917,41842] 0 2024-09-12T22:33:15.822 INFO:tasks.workunit.client.0.smithi019.stdout:1/695: symlink d3/df/d7e/db7/d16/ldc 0 2024-09-12T22:33:15.822 INFO:tasks.workunit.client.0.smithi019.stdout:8/582: creat d7/d8/d43/fb9 x:0 0 0 2024-09-12T22:33:15.822 INFO:tasks.workunit.client.0.smithi019.stdout:3/499: rename dd/f20 to dd/d1e/d5a/f94 0 2024-09-12T22:33:15.823 INFO:tasks.workunit.client.0.smithi019.stdout:2/546: readlink d0/l23 0 2024-09-12T22:33:15.823 INFO:tasks.workunit.client.0.smithi019.stdout:4/580: dread d1/d22/d26/f48 [0,4194304] 0 2024-09-12T22:33:15.823 INFO:tasks.workunit.client.0.smithi019.stdout:8/583: mknod d7/d2f/d42/cba 0 2024-09-12T22:33:15.823 INFO:tasks.workunit.client.0.smithi019.stdout:9/575: rename dd/d10/d17/d23/d2e/d31/d64 to dd/d10/d17/d23/d2e/d31/d7e/dbc 0 2024-09-12T22:33:15.823 INFO:tasks.workunit.client.0.smithi019.stdout:3/500: mkdir dd/d95 0 2024-09-12T22:33:15.823 INFO:tasks.workunit.client.0.smithi019.stdout:2/547: fdatasync d0/da/d73/d7c/f82 0 2024-09-12T22:33:15.823 INFO:tasks.workunit.client.0.smithi019.stdout:4/581: truncate d1/d4/d44/fad 259097 0 2024-09-12T22:33:15.823 INFO:tasks.workunit.client.0.smithi019.stdout:3/501: write dd/f17 [2251816,76196] 0 2024-09-12T22:33:15.823 INFO:tasks.workunit.client.0.smithi019.stdout:2/548: mknod d0/d5/d18/d5c/d85/cb2 0 2024-09-12T22:33:15.823 INFO:tasks.workunit.client.0.smithi019.stdout:6/634: dread d1b/d26/d39/d6a/f85 [0,4194304] 0 2024-09-12T22:33:15.823 INFO:tasks.workunit.client.0.smithi019.stdout:4/582: rename d1/d4c/db0 to d1/d4c/db0/d75/d5a/dc1 22 2024-09-12T22:33:15.823 INFO:tasks.workunit.client.0.smithi019.stdout:7/534: dread d6/d14/d2a/da4/dc/f43 [0,4194304] 0 2024-09-12T22:33:15.823 INFO:tasks.workunit.client.0.smithi019.stdout:0/586: dwrite d1/d1f/d5b/fa5 [0,4194304] 0 2024-09-12T22:33:15.823 INFO:tasks.workunit.client.0.smithi019.stdout:8/584: dwrite d7/d8/fa7 [0,4194304] 0 2024-09-12T22:33:15.824 INFO:tasks.workunit.client.0.smithi019.stdout:6/635: chown d1b/d26/d39/fa0 569 1 2024-09-12T22:33:15.824 INFO:tasks.workunit.client.0.smithi019.stdout:9/576: dwrite dd/d10/d17/d22/f9a [0,4194304] 0 2024-09-12T22:33:15.824 INFO:tasks.workunit.client.0.smithi019.stdout:2/549: link d0/d5/f3a d0/d5/d18/d5c/d67/d77/fb3 0 2024-09-12T22:33:15.824 INFO:tasks.workunit.client.0.smithi019.stdout:6/636: fdatasync d1b/d2d/fcc 0 2024-09-12T22:33:15.824 INFO:tasks.workunit.client.0.smithi019.stdout:8/585: truncate d7/d2f/f6d 490158 0 2024-09-12T22:33:15.824 INFO:tasks.workunit.client.0.smithi019.stdout:0/587: unlink d1/d14/d1b/c20 0 2024-09-12T22:33:15.824 INFO:tasks.workunit.client.0.smithi019.stdout:2/550: stat d0/d5/d60/c6d 0 2024-09-12T22:33:15.824 INFO:tasks.workunit.client.0.smithi019.stdout:6/637: mknod d1b/d26/d27/d3e/d83/cdd 0 2024-09-12T22:33:15.824 INFO:tasks.workunit.client.0.smithi019.stdout:9/577: mkdir dd/d10/d17/d22/d6c/d53/d69/d9d/dbd 0 2024-09-12T22:33:15.824 INFO:tasks.workunit.client.0.smithi019.stdout:0/588: creat d1/d1f/d5b/d83/fac x:0 0 0 2024-09-12T22:33:15.824 INFO:tasks.workunit.client.0.smithi019.stdout:2/551: chown d0/da/f50 57 1 2024-09-12T22:33:15.824 INFO:tasks.workunit.client.0.smithi019.stdout:6/638: chown d1b/d26/d27/d67 354329764 1 2024-09-12T22:33:15.824 INFO:tasks.workunit.client.0.smithi019.stdout:4/583: dwrite d1/d11/d15/f2b [0,4194304] 0 2024-09-12T22:33:15.825 INFO:tasks.workunit.client.0.smithi019.stdout:2/552: getdents d0/d5/d18/d5c/d67 0 2024-09-12T22:33:15.825 INFO:tasks.workunit.client.0.smithi019.stdout:6/639: getdents d1b/d26/d39/d6a 0 2024-09-12T22:33:15.825 INFO:tasks.workunit.client.0.smithi019.stdout:4/584: mkdir d1/d11/d15/d1f/d56/d6b/dc2 0 2024-09-12T22:33:15.825 INFO:tasks.workunit.client.0.smithi019.stdout:8/586: dwrite d7/d8/f25 [0,4194304] 0 2024-09-12T22:33:15.825 INFO:tasks.workunit.client.0.smithi019.stdout:6/640: creat d1b/d26/d39/fde x:0 0 0 2024-09-12T22:33:15.825 INFO:tasks.workunit.client.0.smithi019.stdout:8/587: dread - d7/d8/d43/f9e zero size 2024-09-12T22:33:15.825 INFO:tasks.workunit.client.0.smithi019.stdout:0/589: getdents d1/d1f/d5b/d83 0 2024-09-12T22:33:15.825 INFO:tasks.workunit.client.0.smithi019.stdout:6/641: creat d1b/d26/d31/dd6/fdf x:0 0 0 2024-09-12T22:33:15.825 INFO:tasks.workunit.client.0.smithi019.stdout:0/590: mkdir d1/d14/dad 0 2024-09-12T22:33:15.825 INFO:tasks.workunit.client.0.smithi019.stdout:8/588: rename d7/d8/fa7 to d7/d8/dd/fbb 0 2024-09-12T22:33:15.825 INFO:tasks.workunit.client.0.smithi019.stdout:0/591: mkdir d1/d14/d1b/d3a/d8c/dae 0 2024-09-12T22:33:15.825 INFO:tasks.workunit.client.0.smithi019.stdout:5/683: sync 2024-09-12T22:33:15.825 INFO:tasks.workunit.client.0.smithi019.stdout:1/696: sync 2024-09-12T22:33:15.825 INFO:tasks.workunit.client.0.smithi019.stdout:3/502: sync 2024-09-12T22:33:15.826 INFO:tasks.workunit.client.0.smithi019.stdout:7/535: sync 2024-09-12T22:33:15.826 INFO:tasks.workunit.client.0.smithi019.stdout:4/585: dwrite d1/d4/fb2 [4194304,4194304] 0 2024-09-12T22:33:15.826 INFO:tasks.workunit.client.0.smithi019.stdout:6/642: dwrite d1b/d2d/f42 [0,4194304] 0 2024-09-12T22:33:15.826 INFO:tasks.workunit.client.0.smithi019.stdout:3/503: write dd/d12/d62/d6a/f7c [293670,62716] 0 2024-09-12T22:33:15.826 INFO:tasks.workunit.client.0.smithi019.stdout:5/684: mkdir d0/d7/d2d/d32/d36/d8c/db8/d39/d38/d4b/dde/dec 0 2024-09-12T22:33:15.826 INFO:tasks.workunit.client.0.smithi019.stdout:7/536: truncate d6/d14/d2a/da4/d42/f7d 962995 0 2024-09-12T22:33:15.826 INFO:tasks.workunit.client.0.smithi019.stdout:4/586: write d1/d4/d38/f94 [68576,105054] 0 2024-09-12T22:33:15.826 INFO:tasks.workunit.client.0.smithi019.stdout:0/592: dwrite d1/f65 [0,4194304] 0 2024-09-12T22:33:15.826 INFO:tasks.workunit.client.0.smithi019.stdout:3/504: chown dd/d1e/l1f 0 1 2024-09-12T22:33:15.826 INFO:tasks.workunit.client.0.smithi019.stdout:0/593: write d1/d1f/f41 [2745376,62085] 0 2024-09-12T22:33:15.826 INFO:tasks.workunit.client.0.smithi019.stdout:6/643: mknod d1b/d26/d27/d3e/d83/ce0 0 2024-09-12T22:33:15.826 INFO:tasks.workunit.client.0.smithi019.stdout:4/587: symlink d1/d11/d15/d49/lc3 0 2024-09-12T22:33:15.826 INFO:tasks.workunit.client.0.smithi019.stdout:7/537: symlink d6/d14/d2a/da4/d42/lcc 0 2024-09-12T22:33:15.826 INFO:tasks.workunit.client.0.smithi019.stdout:3/505: symlink dd/d95/l96 0 2024-09-12T22:33:15.827 INFO:tasks.workunit.client.0.smithi019.stdout:6/644: chown d1b/d26/d27/d67/caa 15184 1 2024-09-12T22:33:15.827 INFO:tasks.workunit.client.0.smithi019.stdout:0/594: creat d1/d14/d1b/d3a/d8c/dae/faf x:0 0 0 2024-09-12T22:33:15.827 INFO:tasks.workunit.client.0.smithi019.stdout:3/506: mknod dd/d1e/c97 0 2024-09-12T22:33:15.827 INFO:tasks.workunit.client.0.smithi019.stdout:6/645: mkdir d1b/d26/d27/d67/de1 0 2024-09-12T22:33:15.827 INFO:tasks.workunit.client.0.smithi019.stdout:1/697: dwrite d3/df/d7e/db7/d16/d3c/f70 [4194304,4194304] 0 2024-09-12T22:33:15.827 INFO:tasks.workunit.client.0.smithi019.stdout:0/595: symlink d1/d1f/d5b/lb0 0 2024-09-12T22:33:15.827 INFO:tasks.workunit.client.0.smithi019.stdout:3/507: mkdir dd/d12/d62/d78/d98 0 2024-09-12T22:33:15.827 INFO:tasks.workunit.client.0.smithi019.stdout:1/698: chown d3/df/d7e/db7/l64 3 1 2024-09-12T22:33:15.827 INFO:tasks.workunit.client.0.smithi019.stdout:0/596: dread - d1/d14/d1b/d3a/d8c/f90 zero size 2024-09-12T22:33:15.827 INFO:tasks.workunit.client.0.smithi019.stdout:3/508: fsync dd/d1e/d40/d5f/f66 0 2024-09-12T22:33:15.827 INFO:tasks.workunit.client.0.smithi019.stdout:0/597: mknod d1/d1f/d5b/d83/cb1 0 2024-09-12T22:33:15.827 INFO:tasks.workunit.client.0.smithi019.stdout:1/699: creat d3/df/d7e/db7/d16/d3c/dbd/fdd x:0 0 0 2024-09-12T22:33:15.827 INFO:tasks.workunit.client.0.smithi019.stdout:0/598: link d1/d1f/l2d d1/d14/lb2 0 2024-09-12T22:33:15.828 INFO:tasks.workunit.client.0.smithi019.stdout:1/700: getdents d3/df 0 2024-09-12T22:33:15.828 INFO:tasks.workunit.client.0.smithi019.stdout:0/599: truncate d1/fa9 291095 0 2024-09-12T22:33:15.828 INFO:tasks.workunit.client.0.smithi019.stdout:6/646: dwrite d1b/d26/f7e [0,4194304] 0 2024-09-12T22:33:15.828 INFO:tasks.workunit.client.0.smithi019.stdout:1/701: dread - d3/d1b/f8e zero size 2024-09-12T22:33:15.828 INFO:tasks.workunit.client.0.smithi019.stdout:0/600: getdents d1/d14/d32/d71/d75 0 2024-09-12T22:33:15.828 INFO:tasks.workunit.client.0.smithi019.stdout:0/601: stat d1/c88 0 2024-09-12T22:33:15.828 INFO:tasks.workunit.client.0.smithi019.stdout:0/602: symlink d1/d51/lb3 0 2024-09-12T22:33:15.828 INFO:tasks.workunit.client.0.smithi019.stdout:8/589: dread f0 [4194304,4194304] 0 2024-09-12T22:33:15.828 INFO:tasks.workunit.client.0.smithi019.stdout:8/590: fdatasync d7/d8/dd/d4f/f61 0 2024-09-12T22:33:15.828 INFO:tasks.workunit.client.0.smithi019.stdout:8/591: fdatasync d7/d8/dd/d4f/f97 0 2024-09-12T22:33:15.828 INFO:tasks.workunit.client.0.smithi019.stdout:4/588: truncate d1/d11/d15/f2e 214981 0 2024-09-12T22:33:15.828 INFO:tasks.workunit.client.0.smithi019.stdout:4/589: rename d1/d11/d15/d1f/d56/d6b to d1/d4/d38/dc4 0 2024-09-12T22:33:15.828 INFO:tasks.workunit.client.0.smithi019.stdout:8/592: rename d7/d34/d78/d2d/l77 to d7/d8/dd/lbc 0 2024-09-12T22:33:15.829 INFO:tasks.workunit.client.0.smithi019.stdout:8/593: chown d7/d34/d78/d54/f71 31330 1 2024-09-12T22:33:15.829 INFO:tasks.workunit.client.0.smithi019.stdout:6/647: dread d1b/d26/d27/d3e/f49 [4194304,4194304] 0 2024-09-12T22:33:15.829 INFO:tasks.workunit.client.0.smithi019.stdout:4/590: dwrite d1/d22/d26/f37 [0,4194304] 0 2024-09-12T22:33:15.829 INFO:tasks.workunit.client.0.smithi019.stdout:6/648: truncate d1b/d26/d31/d5f/fad 1115660 0 2024-09-12T22:33:15.829 INFO:tasks.workunit.client.0.smithi019.stdout:8/594: dread d7/d34/d78/d2d/d84/f9d [0,4194304] 0 2024-09-12T22:33:15.829 INFO:tasks.workunit.client.0.smithi019.stdout:4/591: rename d1/d22/d2c/c96 to d1/d22/d31/d85/cc5 0 2024-09-12T22:33:15.829 INFO:tasks.workunit.client.0.smithi019.stdout:8/595: fsync d7/d34/d78/d54/fa6 0 2024-09-12T22:33:15.829 INFO:tasks.workunit.client.0.smithi019.stdout:4/592: creat d1/d11/d15/d1f/da8/fc6 x:0 0 0 2024-09-12T22:33:15.829 INFO:tasks.workunit.client.0.smithi019.stdout:1/702: write d3/df/d7e/db7/d16/f38 [954157,126238] 0 2024-09-12T22:33:15.829 INFO:tasks.workunit.client.0.smithi019.stdout:1/703: mknod d3/d3f/d58/d7f/cde 0 2024-09-12T22:33:15.829 INFO:tasks.workunit.client.0.smithi019.stdout:4/593: rename d1/d22/d31/d4f/lb7 to d1/d4/d38/dbf/lc7 0 2024-09-12T22:33:15.829 INFO:tasks.workunit.client.0.smithi019.stdout:1/704: write d3/df/f41 [2487572,53066] 0 2024-09-12T22:33:15.829 INFO:tasks.workunit.client.0.smithi019.stdout:4/594: fdatasync d1/d4/d38/f5e 0 2024-09-12T22:33:15.829 INFO:tasks.workunit.client.0.smithi019.stdout:7/538: dread d6/d14/d15/f17 [0,4194304] 0 2024-09-12T22:33:15.830 INFO:tasks.workunit.client.0.smithi019.stdout:4/595: chown d1/d11/d15/d1f/l90 26 1 2024-09-12T22:33:15.830 INFO:tasks.workunit.client.0.smithi019.stdout:1/705: creat d3/d3f/d77/dcd/fdf x:0 0 0 2024-09-12T22:33:15.830 INFO:tasks.workunit.client.0.smithi019.stdout:7/539: dread - d6/d2d/d8f/daf/f9d zero size 2024-09-12T22:33:15.830 INFO:tasks.workunit.client.0.smithi019.stdout:4/596: mknod d1/d11/d15/d1f/d56/cc8 0 2024-09-12T22:33:15.830 INFO:tasks.workunit.client.0.smithi019.stdout:1/706: chown d3/df/d7e/d96/la3 4846 1 2024-09-12T22:33:15.830 INFO:tasks.workunit.client.0.smithi019.stdout:6/649: truncate d1b/d26/d27/d67/d77/f78 289156 0 2024-09-12T22:33:15.830 INFO:tasks.workunit.client.0.smithi019.stdout:5/685: dread d0/d7/d16/f45 [0,4194304] 0 2024-09-12T22:33:15.830 INFO:tasks.workunit.client.0.smithi019.stdout:7/540: chown d6/c1f 20104123 1 2024-09-12T22:33:15.830 INFO:tasks.workunit.client.0.smithi019.stdout:4/597: fdatasync d1/d4c/fa5 0 2024-09-12T22:33:15.830 INFO:tasks.workunit.client.0.smithi019.stdout:8/596: dwrite d7/d8/dd/f67 [0,4194304] 0 2024-09-12T22:33:15.830 INFO:tasks.workunit.client.0.smithi019.stdout:1/707: creat d3/d1b/dd3/fe0 x:0 0 0 2024-09-12T22:33:15.830 INFO:tasks.workunit.client.0.smithi019.stdout:5/686: symlink d0/d7/d2d/d32/dcd/led 0 2024-09-12T22:33:15.830 INFO:tasks.workunit.client.0.smithi019.stdout:7/541: write d6/d14/d15/f98 [476189,77051] 0 2024-09-12T22:33:15.830 INFO:tasks.workunit.client.0.smithi019.stdout:8/597: dread - d7/d34/d78/d53/f69 zero size 2024-09-12T22:33:15.831 INFO:tasks.workunit.client.0.smithi019.stdout:0/603: dread d1/d14/d26/d40/d45/f54 [0,4194304] 0 2024-09-12T22:33:15.831 INFO:tasks.workunit.client.0.smithi019.stdout:7/542: write d6/d2d/d41/fbe [852445,22079] 0 2024-09-12T22:33:15.831 INFO:tasks.workunit.client.0.smithi019.stdout:8/598: creat d7/d34/d78/d2d/d84/d8b/fbd x:0 0 0 2024-09-12T22:33:15.831 INFO:tasks.workunit.client.0.smithi019.stdout:0/604: mknod d1/d14/d26/d40/d45/d5e/cb4 0 2024-09-12T22:33:15.831 INFO:tasks.workunit.client.0.smithi019.stdout:7/543: write d6/d2d/d8f/daf/f95 [1415800,102949] 0 2024-09-12T22:33:15.831 INFO:tasks.workunit.client.0.smithi019.stdout:1/708: write d3/df/d7e/db7/d16/d3c/fa6 [1128234,106547] 0 2024-09-12T22:33:15.831 INFO:tasks.workunit.client.0.smithi019.stdout:2/553: sync 2024-09-12T22:33:15.831 INFO:tasks.workunit.client.0.smithi019.stdout:9/578: sync 2024-09-12T22:33:15.831 INFO:tasks.workunit.client.0.smithi019.stdout:8/599: rename d7/d2f/d42/f70 to d7/d2f/d75/fbe 0 2024-09-12T22:33:15.831 INFO:tasks.workunit.client.0.smithi019.stdout:9/579: fdatasync dd/f9e 0 2024-09-12T22:33:15.831 INFO:tasks.workunit.client.0.smithi019.stdout:7/544: creat d6/d14/d45/fcd x:0 0 0 2024-09-12T22:33:15.831 INFO:tasks.workunit.client.0.smithi019.stdout:0/605: creat d1/d14/d1b/d3a/d8c/dae/fb5 x:0 0 0 2024-09-12T22:33:15.831 INFO:tasks.workunit.client.0.smithi019.stdout:7/545: readlink d6/d14/d2a/da4/d42/l6c 0 2024-09-12T22:33:15.832 INFO:tasks.workunit.client.0.smithi019.stdout:8/600: write d7/d34/d78/d2d/d84/d8b/f90 [867,18426] 0 2024-09-12T22:33:15.832 INFO:tasks.workunit.client.0.smithi019.stdout:2/554: rename d0/da/f99 to d0/d5/fb4 0 2024-09-12T22:33:15.832 INFO:tasks.workunit.client.0.smithi019.stdout:0/606: creat d1/d14/d26/d40/d45/d5e/d84/fb6 x:0 0 0 2024-09-12T22:33:15.832 INFO:tasks.workunit.client.0.smithi019.stdout:9/580: link dd/d10/d17/d23/d2e/f93 dd/d10/d17/d22/d6c/d53/fbe 0 2024-09-12T22:33:15.832 INFO:tasks.workunit.client.0.smithi019.stdout:0/607: unlink d1/d1d/c38 0 2024-09-12T22:33:15.832 INFO:tasks.workunit.client.0.smithi019.stdout:2/555: mkdir d0/d5/d60/d74/d7e/db5 0 2024-09-12T22:33:15.832 INFO:tasks.workunit.client.0.smithi019.stdout:0/608: unlink d1/d1f/d5b/fa5 0 2024-09-12T22:33:15.832 INFO:tasks.workunit.client.0.smithi019.stdout:9/581: getdents dd 0 2024-09-12T22:33:15.832 INFO:tasks.workunit.client.0.smithi019.stdout:1/709: dwrite d3/f4d [0,4194304] 0 2024-09-12T22:33:15.832 INFO:tasks.workunit.client.0.smithi019.stdout:5/687: write d0/f49 [468991,99497] 0 2024-09-12T22:33:15.832 INFO:tasks.workunit.client.0.smithi019.stdout:2/556: getdents d0/d5/d18/d1b/d8d 0 2024-09-12T22:33:15.832 INFO:tasks.workunit.client.0.smithi019.stdout:0/609: getdents d1/d1f 0 2024-09-12T22:33:15.832 INFO:tasks.workunit.client.0.smithi019.stdout:2/557: stat d0/da/f37 0 2024-09-12T22:33:15.832 INFO:tasks.workunit.client.0.smithi019.stdout:8/601: write d7/d5e/f91 [269056,95312] 0 2024-09-12T22:33:15.833 INFO:tasks.workunit.client.0.smithi019.stdout:1/710: chown d3/df/d7e/db7/d16/d3c/dbd/dc4 52686742 1 2024-09-12T22:33:15.833 INFO:tasks.workunit.client.0.smithi019.stdout:5/688: truncate d0/db9/fbd 1220289 0 2024-09-12T22:33:15.833 INFO:tasks.workunit.client.0.smithi019.stdout:9/582: rename dd/d10/d17/d23/d2e/d31/d7e/cb8 to dd/d10/d17/d23/d2e/d31/cbf 0 2024-09-12T22:33:15.833 INFO:tasks.workunit.client.0.smithi019.stdout:2/558: mkdir d0/da/d73/db6 0 2024-09-12T22:33:15.833 INFO:tasks.workunit.client.0.smithi019.stdout:0/610: mknod d1/d14/d1b/d3a/d8c/dae/cb7 0 2024-09-12T22:33:15.833 INFO:tasks.workunit.client.0.smithi019.stdout:8/602: creat d7/d8/d43/fbf x:0 0 0 2024-09-12T22:33:15.833 INFO:tasks.workunit.client.0.smithi019.stdout:9/583: chown dd/d10/d17 194 1 2024-09-12T22:33:15.833 INFO:tasks.workunit.client.0.smithi019.stdout:1/711: mkdir d3/df/d7e/db7/d63/d76/d91/de1 0 2024-09-12T22:33:15.833 INFO:tasks.workunit.client.0.smithi019.stdout:5/689: symlink d0/d7/d2d/d32/d4a/lee 0 2024-09-12T22:33:15.833 INFO:tasks.workunit.client.0.smithi019.stdout:8/603: dread - d7/d34/d78/d53/f69 zero size 2024-09-12T22:33:15.833 INFO:tasks.workunit.client.0.smithi019.stdout:0/611: symlink d1/d14/d1b/d3a/d8c/dae/lb8 0 2024-09-12T22:33:15.833 INFO:tasks.workunit.client.0.smithi019.stdout:2/559: rename d0/da/d73/faf to d0/d5/d18/d1b/d5d/d86/d90/fb7 0 2024-09-12T22:33:15.833 INFO:tasks.workunit.client.0.smithi019.stdout:1/712: symlink d3/df/d7e/db7/d63/d76/le2 0 2024-09-12T22:33:15.833 INFO:tasks.workunit.client.0.smithi019.stdout:8/604: mknod d7/d2f/d75/cc0 0 2024-09-12T22:33:15.834 INFO:tasks.workunit.client.0.smithi019.stdout:9/584: truncate dd/d10/d17/d22/f3e 1541521 0 2024-09-12T22:33:15.834 INFO:tasks.workunit.client.0.smithi019.stdout:0/612: symlink d1/d14/d32/d71/d75/lb9 0 2024-09-12T22:33:15.834 INFO:tasks.workunit.client.0.smithi019.stdout:2/560: symlink d0/d5/d18/d1b/d8d/lb8 0 2024-09-12T22:33:15.834 INFO:tasks.workunit.client.0.smithi019.stdout:5/690: rename d0/d7/d2d/lda to d0/d7/d2d/d32/d36/d8c/db8/lef 0 2024-09-12T22:33:15.834 INFO:tasks.workunit.client.0.smithi019.stdout:2/561: symlink d0/d5/d60/d71/lb9 0 2024-09-12T22:33:15.834 INFO:tasks.workunit.client.0.smithi019.stdout:9/585: dread - dd/d10/d17/d23/d2e/d31/d7e/f8c zero size 2024-09-12T22:33:15.834 INFO:tasks.workunit.client.0.smithi019.stdout:5/691: readlink d0/d7/d2d/d32/d36/d8c/db8/d24/lca 0 2024-09-12T22:33:15.834 INFO:tasks.workunit.client.0.smithi019.stdout:0/613: write d1/d14/d32/d89/f8e [939396,102327] 0 2024-09-12T22:33:15.834 INFO:tasks.workunit.client.0.smithi019.stdout:2/562: creat d0/d5/d60/d71/fba x:0 0 0 2024-09-12T22:33:15.834 INFO:tasks.workunit.client.0.smithi019.stdout:0/614: fsync d1/d14/d1b/f2b 0 2024-09-12T22:33:15.834 INFO:tasks.workunit.client.0.smithi019.stdout:5/692: mknod d0/d7/d2d/d32/d36/d8c/d8f/cf0 0 2024-09-12T22:33:15.834 INFO:tasks.workunit.client.0.smithi019.stdout:2/563: mknod d0/d5/d18/d5c/d67/cbb 0 2024-09-12T22:33:15.834 INFO:tasks.workunit.client.0.smithi019.stdout:8/605: dwrite d7/d8/f1b [4194304,4194304] 0 2024-09-12T22:33:15.835 INFO:tasks.workunit.client.0.smithi019.stdout:0/615: creat d1/d14/d26/d40/fba x:0 0 0 2024-09-12T22:33:15.835 INFO:tasks.workunit.client.0.smithi019.stdout:8/606: truncate d7/f29 4910776 0 2024-09-12T22:33:15.835 INFO:tasks.workunit.client.0.smithi019.stdout:4/598: dread d1/d4/f2a [0,4194304] 0 2024-09-12T22:33:15.835 INFO:tasks.workunit.client.0.smithi019.stdout:8/607: rmdir d7/d34/d78/d2d 39 2024-09-12T22:33:15.835 INFO:tasks.workunit.client.0.smithi019.stdout:4/599: readlink d1/d22/d2c/l2f 0 2024-09-12T22:33:15.835 INFO:tasks.workunit.client.0.smithi019.stdout:5/693: link d0/d7/d2d/d32/d36/d8c/db8/l17 d0/d7/d2d/d32/d4a/dbb/lf1 0 2024-09-12T22:33:15.835 INFO:tasks.workunit.client.0.smithi019.stdout:2/564: mknod d0/d5/d18/d1b/cbc 0 2024-09-12T22:33:15.835 INFO:tasks.workunit.client.0.smithi019.stdout:5/694: mknod d0/d7/d16/d69/cf2 0 2024-09-12T22:33:15.835 INFO:tasks.workunit.client.0.smithi019.stdout:3/509: sync 2024-09-12T22:33:15.835 INFO:tasks.workunit.client.0.smithi019.stdout:6/650: sync 2024-09-12T22:33:15.835 INFO:tasks.workunit.client.0.smithi019.stdout:0/616: read d1/d14/d32/d89/f8e [515039,25844] 0 2024-09-12T22:33:15.835 INFO:tasks.workunit.client.0.smithi019.stdout:2/565: getdents d0/d5/d60/d71 0 2024-09-12T22:33:15.835 INFO:tasks.workunit.client.0.smithi019.stdout:0/617: rmdir d1/d14/d1b/d3a/d8c 39 2024-09-12T22:33:15.836 INFO:teuthology.orchestra.run.smithi019.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-12T22:33:15.839 INFO:tasks.workunit.client.0.smithi019.stdout:6/651: write d1b/d26/d27/d3e/d83/d98/fd1 [850555,78526] 0 2024-09-12T22:33:15.840 INFO:tasks.workunit.client.0.smithi019.stdout:2/566: stat d0/d5/d60/d71/l72 0 2024-09-12T22:33:15.840 INFO:tasks.workunit.client.0.smithi019.stdout:3/510: getdents dd/d1e/d5a 0 2024-09-12T22:33:15.840 INFO:tasks.workunit.client.0.smithi019.stdout:5/695: mkdir d0/d7/d2d/d32/d36/d8c/db8/d39/d38/dba/dc7/df3 0 2024-09-12T22:33:15.840 INFO:tasks.workunit.client.0.smithi019.stdout:8/608: dwrite d7/d2f/d42/f93 [0,4194304] 0 2024-09-12T22:33:15.840 INFO:tasks.workunit.client.0.smithi019.stdout:4/600: dwrite d1/d8/f45 [0,4194304] 0 2024-09-12T22:33:15.840 INFO:tasks.workunit.client.0.smithi019.stdout:1/713: dread d3/f31 [0,4194304] 0 2024-09-12T22:33:15.840 INFO:tasks.workunit.client.0.smithi019.stdout:9/586: dread dd/d10/d17/d23/d37/f5b [0,4194304] 0 2024-09-12T22:33:15.840 INFO:tasks.workunit.client.0.smithi019.stdout:8/609: chown d7/d2f/f6d 63755741 1 2024-09-12T22:33:15.840 INFO:tasks.workunit.client.0.smithi019.stdout:2/567: creat d0/d5/d18/d39/fbd x:0 0 0 2024-09-12T22:33:15.840 INFO:tasks.workunit.client.0.smithi019.stdout:0/618: mknod d1/d14/d1b/d3a/d8c/cbb 0 2024-09-12T22:33:15.840 INFO:tasks.workunit.client.0.smithi019.stdout:5/696: write d0/d7/d2d/d32/d36/d8c/db8/fbc [1298362,34494] 0 2024-09-12T22:33:15.840 INFO:tasks.workunit.client.0.smithi019.stdout:8/610: rmdir d7/d5e 39 2024-09-12T22:33:15.841 INFO:tasks.workunit.client.0.smithi019.stdout:4/601: creat d1/d4/d38/dc4/dc2/fc9 x:0 0 0 2024-09-12T22:33:15.841 INFO:tasks.workunit.client.0.smithi019.stdout:7/546: sync 2024-09-12T22:33:15.841 INFO:tasks.workunit.client.0.smithi019.stdout:1/714: getdents d3/d3f/d77/dcd 0 2024-09-12T22:33:15.841 INFO:tasks.workunit.client.0.smithi019.stdout:8/611: creat d7/d8/d43/fc1 x:0 0 0 2024-09-12T22:33:15.841 INFO:tasks.workunit.client.0.smithi019.stdout:9/587: mkdir dd/d10/d17/d23/d2e/d31/d3f/dc0 0 2024-09-12T22:33:15.841 INFO:tasks.workunit.client.0.smithi019.stdout:2/568: read d0/d5/d60/f9d [1098978,122983] 0 2024-09-12T22:33:15.841 INFO:tasks.workunit.client.0.smithi019.stdout:4/602: write d1/d11/d15/d1f/f84 [381388,16876] 0 2024-09-12T22:33:15.841 INFO:tasks.workunit.client.0.smithi019.stdout:6/652: dwrite d1b/d26/d31/d5f/f86 [0,4194304] 0 2024-09-12T22:33:15.841 INFO:tasks.workunit.client.0.smithi019.stdout:8/612: readlink d7/d34/d78/l6c 0 2024-09-12T22:33:15.841 INFO:tasks.workunit.client.0.smithi019.stdout:3/511: dwrite dd/d12/d62/d6a/f7d [0,4194304] 0 2024-09-12T22:33:15.841 INFO:tasks.workunit.client.0.smithi019.stdout:2/569: mknod d0/d5/d18/d5c/d85/cbe 0 2024-09-12T22:33:15.841 INFO:tasks.workunit.client.0.smithi019.stdout:8/613: read - d7/d34/d78/d53/f69 zero size 2024-09-12T22:33:15.841 INFO:tasks.workunit.client.0.smithi019.stdout:4/603: creat d1/d4/d38/dbf/fca x:0 0 0 2024-09-12T22:33:15.842 INFO:tasks.workunit.client.0.smithi019.stdout:6/653: mkdir d1b/d26/de2 0 2024-09-12T22:33:15.842 INFO:tasks.workunit.client.0.smithi019.stdout:2/570: fsync d0/da/f37 0 2024-09-12T22:33:15.842 INFO:tasks.workunit.client.0.smithi019.stdout:5/697: truncate d0/d7/d16/f7a 6294678 0 2024-09-12T22:33:15.842 INFO:tasks.workunit.client.0.smithi019.stdout:4/604: fsync d1/d4c/db0/d75/d5a/f8b 0 2024-09-12T22:33:15.842 INFO:tasks.workunit.client.0.smithi019.stdout:1/715: dwrite d3/d3f/d77/fba [0,4194304] 0 2024-09-12T22:33:15.842 INFO:tasks.workunit.client.0.smithi019.stdout:6/654: rename d1b/d26/d31/d5f/da8/dc3/fc5 to d1b/fe3 0 2024-09-12T22:33:15.842 INFO:tasks.workunit.client.0.smithi019.stdout:5/698: truncate d0/d7/d2d/dc2/fd6 170553 0 2024-09-12T22:33:15.842 INFO:tasks.workunit.client.0.smithi019.stdout:6/655: symlink d1b/d26/d27/le4 0 2024-09-12T22:33:15.842 INFO:tasks.workunit.client.0.smithi019.stdout:5/699: creat d0/d7/d2d/d32/d36/d8c/db8/d24/ff4 x:0 0 0 2024-09-12T22:33:15.842 INFO:tasks.workunit.client.0.smithi019.stdout:2/571: dwrite d0/d5/d18/d5c/fad [0,4194304] 0 2024-09-12T22:33:15.842 INFO:tasks.workunit.client.0.smithi019.stdout:5/700: mknod d0/d7/d2d/d32/d4a/dbb/dd5/cf5 0 2024-09-12T22:33:15.842 INFO:tasks.workunit.client.0.smithi019.stdout:5/701: fdatasync d0/f49 0 2024-09-12T22:33:15.842 INFO:tasks.workunit.client.0.smithi019.stdout:2/572: write d0/d5/d18/d5c/d85/fa6 [937884,80237] 0 2024-09-12T22:33:15.842 INFO:tasks.workunit.client.0.smithi019.stdout:2/573: write d0/d5/d18/d5c/d85/fa6 [236587,40108] 0 2024-09-12T22:33:15.843 INFO:tasks.workunit.client.0.smithi019.stdout:5/702: mkdir d0/d7/d2d/d32/d36/d8c/db8/d39/d38/dba/dc7/df6 0 2024-09-12T22:33:15.843 INFO:tasks.workunit.client.0.smithi019.stdout:4/605: write d1/d4/d38/f3b [1091736,42169] 0 2024-09-12T22:33:15.843 INFO:tasks.workunit.client.0.smithi019.stdout:5/703: dread - d0/d7/d2d/d32/d36/d8c/db8/fe4 zero size 2024-09-12T22:33:15.843 INFO:tasks.workunit.client.0.smithi019.stdout:2/574: chown d0/d5/d18/d5c/d85/cbe 227467996 1 2024-09-12T22:33:15.843 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T22:33:15.844 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:33:15.848 INFO:tasks.workunit.client.0.smithi019.stdout:8/614: dread d7/d5e/f60 [0,4194304] 0 2024-09-12T22:33:15.848 INFO:tasks.workunit.client.0.smithi019.stdout:6/656: dread d1b/d26/f74 [0,4194304] 0 2024-09-12T22:33:15.848 INFO:tasks.workunit.client.0.smithi019.stdout:6/657: unlink l8 0 2024-09-12T22:33:15.848 INFO:tasks.workunit.client.0.smithi019.stdout:8/615: read d7/f1d [553877,92080] 0 2024-09-12T22:33:15.848 INFO:tasks.workunit.client.0.smithi019.stdout:6/658: write d1b/d26/d39/f4c [442846,110577] 0 2024-09-12T22:33:15.848 INFO:tasks.workunit.client.0.smithi019.stdout:6/659: chown d1b 15939087 1 2024-09-12T22:33:15.848 INFO:tasks.workunit.client.0.smithi019.stdout:8/616: mkdir d7/d8/d43/d87/dc2 0 2024-09-12T22:33:15.848 INFO:tasks.workunit.client.0.smithi019.stdout:5/704: dwrite d0/d7/d2d/d32/d36/d8c/db8/d39/d38/f95 [0,4194304] 0 2024-09-12T22:33:15.848 INFO:tasks.workunit.client.0.smithi019.stdout:6/660: chown d1b/d26/d39/d6a/f57 939548 1 2024-09-12T22:33:15.848 INFO:tasks.workunit.client.0.smithi019.stdout:6/661: mkdir d1b/d26/de2/de5 0 2024-09-12T22:33:15.848 INFO:tasks.workunit.client.0.smithi019.stdout:2/575: dread d0/d5/d18/d5c/f68 [0,4194304] 0 2024-09-12T22:33:15.849 INFO:tasks.workunit.client.0.smithi019.stdout:2/576: write d0/d5/d60/d74/d7e/f87 [2517424,121332] 0 2024-09-12T22:33:15.849 INFO:tasks.workunit.client.0.smithi019.stdout:0/619: dread d1/d14/d26/f50 [0,4194304] 0 2024-09-12T22:33:15.849 INFO:tasks.workunit.client.0.smithi019.stdout:5/705: dwrite d0/d7/d2d/d32/d36/d8c/db8/d39/d38/dba/fb0 [0,4194304] 0 2024-09-12T22:33:15.849 INFO:tasks.workunit.client.0.smithi019.stdout:8/617: write d7/d34/d78/d2d/f83 [185186,129857] 0 2024-09-12T22:33:15.849 INFO:tasks.workunit.client.0.smithi019.stdout:2/577: symlink d0/d5/d17/lbf 0 2024-09-12T22:33:15.849 INFO:tasks.workunit.client.0.smithi019.stdout:6/662: dwrite d1b/d26/d27/fce [0,4194304] 0 2024-09-12T22:33:15.849 INFO:tasks.workunit.client.0.smithi019.stdout:7/547: dread d6/d2d/d41/f48 [0,4194304] 0 2024-09-12T22:33:15.849 INFO:tasks.workunit.client.0.smithi019.stdout:8/618: creat d7/d34/d78/d2d/fc3 x:0 0 0 2024-09-12T22:33:15.849 INFO:tasks.workunit.client.0.smithi019.stdout:8/619: fsync d7/d8/dd/f67 0 2024-09-12T22:33:15.849 INFO:tasks.workunit.client.0.smithi019.stdout:6/663: rename d1b/d26/d39/d89/d90/cae to d1b/d26/d39/d6a/d61/ce6 0 2024-09-12T22:33:15.849 INFO:tasks.workunit.client.0.smithi019.stdout:7/548: truncate d6/d14/d2a/fad 1447295 0 2024-09-12T22:33:15.849 INFO:tasks.workunit.client.0.smithi019.stdout:5/706: read d0/d7/d2d/dc2/fd6 [124563,125158] 0 2024-09-12T22:33:15.849 INFO:tasks.workunit.client.0.smithi019.stdout:6/664: write fb [436367,35401] 0 2024-09-12T22:33:15.849 INFO:tasks.workunit.client.0.smithi019.stdout:9/588: dread dd/d10/d17/d22/d6c/d53/f5c [0,4194304] 0 2024-09-12T22:33:15.850 INFO:tasks.workunit.client.0.smithi019.stdout:8/620: rmdir d7/d34/d78/d2d 39 2024-09-12T22:33:15.850 INFO:tasks.workunit.client.0.smithi019.stdout:7/549: mknod d6/d2d/cce 0 2024-09-12T22:33:15.850 INFO:tasks.workunit.client.0.smithi019.stdout:6/665: fsync d1b/d26/d31/dd6/fb2 0 2024-09-12T22:33:15.850 INFO:tasks.workunit.client.0.smithi019.stdout:2/578: dwrite d0/d5/d18/d5c/f6f [0,4194304] 0 2024-09-12T22:33:15.850 INFO:tasks.workunit.client.0.smithi019.stdout:9/589: dread - dd/d10/d17/d23/d2e/d31/d54/d8b/fb3 zero size 2024-09-12T22:33:15.850 INFO:tasks.workunit.client.0.smithi019.stdout:5/707: mkdir d0/d7/d2d/d32/d36/d8c/db8/d39/df7 0 2024-09-12T22:33:15.850 INFO:tasks.workunit.client.0.smithi019.stdout:6/666: mkdir d1b/d26/d31/d5f/d91/de7 0 2024-09-12T22:33:15.850 INFO:tasks.workunit.client.0.smithi019.stdout:7/550: mkdir d6/dcf 0 2024-09-12T22:33:15.850 INFO:tasks.workunit.client.0.smithi019.stdout:2/579: mknod d0/d5/d18/d1b/d36/cc0 0 2024-09-12T22:33:15.850 INFO:tasks.workunit.client.0.smithi019.stdout:9/590: fdatasync dd/d10/d17/d22/d6c/d53/d69/f9c 0 2024-09-12T22:33:15.850 INFO:tasks.workunit.client.0.smithi019.stdout:2/580: fsync d0/d5/f22 0 2024-09-12T22:33:15.850 INFO:tasks.workunit.client.0.smithi019.stdout:5/708: dread - d0/d7/d2d/f7b zero size 2024-09-12T22:33:15.850 INFO:tasks.workunit.client.0.smithi019.stdout:6/667: write d1b/d26/d39/f41 [2226366,107682] 0 2024-09-12T22:33:15.850 INFO:tasks.workunit.client.0.smithi019.stdout:2/581: mknod d0/d5/d18/d5c/cc1 0 2024-09-12T22:33:15.851 INFO:tasks.workunit.client.0.smithi019.stdout:7/551: write d6/d14/d15/d9e/f50 [1783551,91945] 0 2024-09-12T22:33:15.851 INFO:tasks.workunit.client.0.smithi019.stdout:5/709: write d0/d7/d16/d18/f26 [1174401,66368] 0 2024-09-12T22:33:15.851 INFO:tasks.workunit.client.0.smithi019.stdout:6/668: write d1b/f5d [448454,104347] 0 2024-09-12T22:33:15.851 INFO:tasks.workunit.client.0.smithi019.stdout:4/606: dread d1/d8/f10 [0,4194304] 0 2024-09-12T22:33:15.851 INFO:tasks.workunit.client.0.smithi019.stdout:2/582: creat d0/d5/d18/d5c/d85/fc2 x:0 0 0 2024-09-12T22:33:15.851 INFO:tasks.workunit.client.0.smithi019.stdout:6/669: chown d1b/d26/d39/fa0 4 1 2024-09-12T22:33:15.851 INFO:teuthology.orchestra.run.smithi019.stdout:osd.2: {} 2024-09-12T22:33:15.852 INFO:teuthology.orchestra.run.smithi019.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T22:33:15.852 INFO:tasks.workunit.client.0.smithi019.stdout:3/512: dread dd/d12/f48 [0,4194304] 0 2024-09-12T22:33:15.853 INFO:tasks.workunit.client.0.smithi019.stdout:4/607: creat d1/d11/d15/d1f/d56/dac/fcb x:0 0 0 2024-09-12T22:33:15.853 INFO:tasks.workunit.client.0.smithi019.stdout:9/591: dwrite dd/d10/d17/d22/d77/fb5 [0,4194304] 0 2024-09-12T22:33:15.853 INFO:tasks.workunit.client.0.smithi019.stdout:3/513: fdatasync dd/d12/f35 0 2024-09-12T22:33:15.853 INFO:tasks.workunit.client.0.smithi019.stdout:6/670: write d1b/d26/d31/d5f/d91/fca [1042807,92063] 0 2024-09-12T22:33:15.853 INFO:tasks.workunit.client.0.smithi019.stdout:7/552: dread d6/d2d/d41/f48 [0,4194304] 0 2024-09-12T22:33:15.853 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:33:15.854 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:33:15.855 INFO:tasks.workunit.client.0.smithi019.stdout:2/583: read d0/da/d73/d7c/f82 [510451,120125] 0 2024-09-12T22:33:15.855 INFO:tasks.workunit.client.0.smithi019.stdout:3/514: fsync dd/f17 0 2024-09-12T22:33:15.855 INFO:tasks.workunit.client.0.smithi019.stdout:1/716: dread d3/df/d7e/db7/d16/d3c/fa6 [0,4194304] 0 2024-09-12T22:33:15.855 INFO:tasks.workunit.client.0.smithi019.stdout:4/608: dread - d1/d8/d7b/fbe zero size 2024-09-12T22:33:15.856 INFO:tasks.workunit.client.0.smithi019.stdout:5/710: link d0/d7/d2d/d32/d4a/f6f d0/d7/d16/d18/d9d/dd8/ff8 0 2024-09-12T22:33:15.856 INFO:tasks.workunit.client.0.smithi019.stdout:4/609: stat d1/d4c/db0/c67 0 2024-09-12T22:33:15.856 INFO:tasks.workunit.client.0.smithi019.stdout:7/553: chown d6/d14/d15/d62/f91 2825 1 2024-09-12T22:33:15.856 INFO:tasks.workunit.client.0.smithi019.stdout:9/592: mknod dd/d10/d17/d76/cc1 0 2024-09-12T22:33:15.856 INFO:tasks.workunit.client.0.smithi019.stdout:5/711: write d0/d7/d16/d18/f81 [828918,12797] 0 2024-09-12T22:33:15.856 INFO:tasks.workunit.client.0.smithi019.stdout:6/671: getdents d1b/d26/d39/d6a/d61/dd4 0 2024-09-12T22:33:15.856 INFO:tasks.workunit.client.0.smithi019.stdout:7/554: chown d6/d14/d15/f17 27594860 1 2024-09-12T22:33:15.856 INFO:tasks.workunit.client.0.smithi019.stdout:6/672: fdatasync d1b/d26/d39/d6a/f60 0 2024-09-12T22:33:15.856 INFO:tasks.workunit.client.0.smithi019.stdout:9/593: fsync dd/d10/d17/d23/d2e/d31/d7e/f8c 0 2024-09-12T22:33:15.856 INFO:tasks.workunit.client.0.smithi019.stdout:7/555: chown d6/d14/d2a/da4/d42 21933 1 2024-09-12T22:33:15.856 INFO:tasks.workunit.client.0.smithi019.stdout:2/584: write d0/d5/f3a [565699,2781] 0 2024-09-12T22:33:15.857 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:15.851+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:15.857 INFO:tasks.workunit.client.0.smithi019.stdout:4/610: truncate d1/d8/f20 2111010 0 2024-09-12T22:33:15.857 INFO:tasks.workunit.client.0.smithi019.stdout:6/673: chown d1b/d26/d27/d3e/l8e 1282241 1 2024-09-12T22:33:15.858 INFO:tasks.workunit.client.0.smithi019.stdout:5/712: dread d0/f49 [0,4194304] 0 2024-09-12T22:33:15.858 INFO:tasks.workunit.client.0.smithi019.stdout:3/515: dwrite dd/d12/f29 [0,4194304] 0 2024-09-12T22:33:15.858 INFO:tasks.workunit.client.0.smithi019.stdout:4/611: creat d1/d4/d44/fcc x:0 0 0 2024-09-12T22:33:15.858 INFO:tasks.workunit.client.0.smithi019.stdout:1/717: dwrite d3/df/d7e/db7/f2c [4194304,4194304] 0 2024-09-12T22:33:15.859 INFO:tasks.workunit.client.0.smithi019.stdout:6/674: write d1b/d26/d27/f5b [2539433,46653] 0 2024-09-12T22:33:15.860 INFO:tasks.workunit.client.0.smithi019.stdout:2/585: truncate d0/d5/d18/d39/fbd 802393 0 2024-09-12T22:33:15.862 INFO:tasks.workunit.client.0.smithi019.stdout:4/612: creat d1/d4/d38/d77/fcd x:0 0 0 2024-09-12T22:33:15.863 INFO:tasks.workunit.client.0.smithi019.stdout:6/675: getdents d1b/d26/d27/d67/de1 0 2024-09-12T22:33:15.863 INFO:tasks.workunit.client.0.smithi019.stdout:4/613: rmdir d1/d22/d2c 39 2024-09-12T22:33:15.864 INFO:tasks.workunit.client.0.smithi019.stdout:3/516: rename dd/d12/d62/d6a/f7c to dd/d1e/d5a/f99 0 2024-09-12T22:33:15.868 INFO:tasks.workunit.client.0.smithi019.stdout:6/676: write d1b/d26/d27/d3e/d83/fbd [515528,51610] 0 2024-09-12T22:33:15.868 INFO:tasks.workunit.client.0.smithi019.stdout:4/614: mkdir d1/d11/d15/d1f/d56/da9/dce 0 2024-09-12T22:33:15.869 INFO:tasks.workunit.client.0.smithi019.stdout:0/620: dread d1/d14/d26/d40/d45/d5e/d84/f9e [0,4194304] 0 2024-09-12T22:33:15.869 INFO:tasks.workunit.client.0.smithi019.stdout:7/556: dwrite d6/d14/d15/d62/f87 [4194304,4194304] 0 2024-09-12T22:33:15.870 INFO:tasks.workunit.client.0.smithi019.stdout:1/718: dwrite d3/d1b/f1d [0,4194304] 0 2024-09-12T22:33:15.872 INFO:tasks.workunit.client.0.smithi019.stdout:5/713: dwrite d0/d7/d16/f4f [0,4194304] 0 2024-09-12T22:33:15.872 INFO:tasks.workunit.client.0.smithi019.stdout:8/621: dread d7/d34/d78/d53/f5d [0,4194304] 0 2024-09-12T22:33:15.872 INFO:tasks.workunit.client.0.smithi019.stdout:6/677: creat d1b/d26/d39/d89/d90/fe8 x:0 0 0 2024-09-12T22:33:15.873 INFO:tasks.workunit.client.0.smithi019.stdout:0/621: write d1/d1f/f39 [2140007,86561] 0 2024-09-12T22:33:15.873 INFO:tasks.workunit.client.0.smithi019.stdout:7/557: rename d6/d14/d15/c1a to d6/d2d/d77/cd0 0 2024-09-12T22:33:15.873 INFO:tasks.workunit.client.0.smithi019.stdout:8/622: stat d7/d2f/c5c 0 2024-09-12T22:33:15.874 INFO:tasks.workunit.client.0.smithi019.stdout:2/586: dread d0/d5/d18/d5c/f6f [0,4194304] 0 2024-09-12T22:33:15.874 INFO:tasks.workunit.client.0.smithi019.stdout:1/719: creat d3/df/d7e/dc9/fe3 x:0 0 0 2024-09-12T22:33:15.876 INFO:tasks.workunit.client.0.smithi019.stdout:6/678: write d1b/d26/f7e [3808052,88485] 0 2024-09-12T22:33:15.877 INFO:tasks.workunit.client.0.smithi019.stdout:7/558: chown d6/d2d/d8f/daf/fc1 0 1 2024-09-12T22:33:15.877 INFO:tasks.workunit.client.0.smithi019.stdout:8/623: mkdir d7/d34/dc4 0 2024-09-12T22:33:15.877 INFO:tasks.workunit.client.0.smithi019.stdout:0/622: truncate d1/d14/d1b/f2e 4227043 0 2024-09-12T22:33:15.878 INFO:tasks.workunit.client.0.smithi019.stdout:6/679: read - d1b/db4/fd2 zero size 2024-09-12T22:33:15.878 INFO:tasks.workunit.client.0.smithi019.stdout:1/720: fdatasync d3/df/d7e/db7/d16/d3c/d55/da0/fd1 0 2024-09-12T22:33:15.879 INFO:tasks.workunit.client.0.smithi019.stdout:8/624: unlink d7/d2f/d75/c99 0 2024-09-12T22:33:15.879 INFO:tasks.workunit.client.0.smithi019.stdout:0/623: creat d1/d14/d1b/fbc x:0 0 0 2024-09-12T22:33:15.880 INFO:tasks.workunit.client.0.smithi019.stdout:2/587: link d0/d5/d18/d1b/d5d/ca5 d0/d5/d60/d71/cc3 0 2024-09-12T22:33:15.880 INFO:tasks.workunit.client.0.smithi019.stdout:3/517: dwrite dd/d12/f35 [0,4194304] 0 2024-09-12T22:33:15.880 INFO:tasks.workunit.client.0.smithi019.stdout:4/615: dwrite d1/d22/d26/f7c [0,4194304] 0 2024-09-12T22:33:15.882 INFO:tasks.workunit.client.0.smithi019.stdout:1/721: mkdir d3/df/d7e/db7/d16/d3c/dbd/de4 0 2024-09-12T22:33:15.882 INFO:tasks.workunit.client.0.smithi019.stdout:8/625: write d7/d8/dd/d4f/f61 [977845,122750] 0 2024-09-12T22:33:15.882 INFO:tasks.workunit.client.0.smithi019.stdout:3/518: rename dd/d1e/f2e to dd/d1e/d40/d5f/f9a 0 2024-09-12T22:33:15.883 INFO:tasks.workunit.client.0.smithi019.stdout:2/588: rmdir d0/da/d73/db6 0 2024-09-12T22:33:15.884 INFO:tasks.workunit.client.0.smithi019.stdout:0/624: rename d1/d14/d32/d3d/f5a to d1/d14/dad/fbd 0 2024-09-12T22:33:15.884 INFO:tasks.workunit.client.0.smithi019.stdout:1/722: mknod d3/d3f/d58/dc6/ce5 0 2024-09-12T22:33:15.884 INFO:tasks.workunit.client.0.smithi019.stdout:3/519: write dd/d1e/d40/f4a [77834,41107] 0 2024-09-12T22:33:15.885 INFO:tasks.workunit.client.0.smithi019.stdout:3/520: fdatasync dd/f91 0 2024-09-12T22:33:15.885 INFO:tasks.workunit.client.0.smithi019.stdout:8/626: write d7/d8/dd/d4f/f61 [49103,99927] 0 2024-09-12T22:33:15.885 INFO:tasks.workunit.client.0.smithi019.stdout:2/589: creat d0/d5/d18/d5c/d67/d77/fc4 x:0 0 0 2024-09-12T22:33:15.885 INFO:tasks.workunit.client.0.smithi019.stdout:1/723: chown d3/df/d7e/db7/f4f 21 1 2024-09-12T22:33:15.886 INFO:tasks.workunit.client.0.smithi019.stdout:3/521: fdatasync dd/d1e/d40/f90 0 2024-09-12T22:33:15.886 INFO:tasks.workunit.client.0.smithi019.stdout:2/590: symlink d0/da/lc5 0 2024-09-12T22:33:15.887 INFO:tasks.workunit.client.0.smithi019.stdout:3/522: creat dd/d1e/d82/f9b x:0 0 0 2024-09-12T22:33:15.888 INFO:tasks.workunit.client.0.smithi019.stdout:2/591: unlink d0/d5/c4f 0 2024-09-12T22:33:15.890 INFO:tasks.workunit.client.0.smithi019.stdout:6/680: dwrite d1b/d26/d27/f54 [0,4194304] 0 2024-09-12T22:33:15.891 INFO:tasks.workunit.client.0.smithi019.stdout:0/625: rename d1/d14/d32 to d1/d1f/d5b/d83/dab/dbe 0 2024-09-12T22:33:15.892 INFO:tasks.workunit.client.0.smithi019.stdout:3/523: rename c1 to dd/d12/d62/d74/c9c 0 2024-09-12T22:33:15.894 INFO:tasks.workunit.client.0.smithi019.stdout:1/724: dwrite d3/df/d7e/d96/fa5 [0,4194304] 0 2024-09-12T22:33:15.894 INFO:tasks.workunit.client.0.smithi019.stdout:3/524: symlink dd/d12/d62/d74/l9d 0 2024-09-12T22:33:15.895 INFO:tasks.workunit.client.0.smithi019.stdout:1/725: readlink d3/d1b/l25 0 2024-09-12T22:33:15.895 INFO:tasks.workunit.client.0.smithi019.stdout:3/525: mknod dd/d1e/c9e 0 2024-09-12T22:33:15.897 INFO:tasks.workunit.client.0.smithi019.stdout:3/526: symlink dd/d1e/d40/d6e/l9f 0 2024-09-12T22:33:15.897 INFO:tasks.workunit.client.0.smithi019.stdout:1/726: dread - d3/df/d7e/db7/d16/d3c/d55/da0/fc1 zero size 2024-09-12T22:33:15.898 INFO:tasks.workunit.client.0.smithi019.stdout:8/627: dread d7/d8/dd/d4f/fa1 [0,4194304] 0 2024-09-12T22:33:15.899 INFO:tasks.workunit.client.0.smithi019.stdout:3/527: unlink dd/d12/d62/d6a/f7d 0 2024-09-12T22:33:15.900 INFO:tasks.workunit.client.0.smithi019.stdout:0/626: dwrite d1/d14/d1b/d3a/d8c/dae/fb5 [0,4194304] 0 2024-09-12T22:33:15.900 INFO:tasks.workunit.client.0.smithi019.stdout:1/727: rename d3/d1b to d3/df/d7e/db7/d16/d3c/dbd/de6 0 2024-09-12T22:33:15.900 INFO:tasks.workunit.client.0.smithi019.stdout:3/528: unlink dd/c73 0 2024-09-12T22:33:15.900 INFO:tasks.workunit.client.0.smithi019.stdout:3/529: chown dd/d12/c51 0 1 2024-09-12T22:33:15.901 INFO:tasks.workunit.client.0.smithi019.stdout:1/728: fdatasync d3/df/d7e/db7/d16/d3c/fac 0 2024-09-12T22:33:15.901 INFO:tasks.workunit.client.0.smithi019.stdout:0/627: read - d1/d1f/d5b/d83/dab/dbe/d71/d85/f99 zero size 2024-09-12T22:33:15.902 INFO:tasks.workunit.client.0.smithi019.stdout:3/530: mknod dd/d1e/d40/d5f/ca0 0 2024-09-12T22:33:15.902 INFO:tasks.workunit.client.0.smithi019.stdout:0/628: mkdir d1/d1f/d5b/dbf 0 2024-09-12T22:33:15.903 INFO:tasks.workunit.client.0.smithi019.stdout:1/729: rmdir d3/df/d7e/db7/d16/d3c/db8 0 2024-09-12T22:33:15.903 INFO:tasks.workunit.client.0.smithi019.stdout:0/629: mkdir d1/d14/dad/dc0 0 2024-09-12T22:33:15.904 INFO:tasks.workunit.client.0.smithi019.stdout:1/730: chown d3/d3f/l57 3741391 1 2024-09-12T22:33:15.905 INFO:tasks.workunit.client.0.smithi019.stdout:1/731: mkdir d3/df/d7e/db7/d63/de7 0 2024-09-12T22:33:15.906 INFO:tasks.workunit.client.0.smithi019.stdout:1/732: creat d3/df/d7e/db7/d16/d3c/dbd/de6/fe8 x:0 0 0 2024-09-12T22:33:15.908 INFO:tasks.workunit.client.0.smithi019.stdout:1/733: dread d3/d6e/da9/f71 [0,4194304] 0 2024-09-12T22:33:15.909 INFO:tasks.workunit.client.0.smithi019.stdout:9/594: dread dd/d10/f14 [0,4194304] 0 2024-09-12T22:33:15.909 INFO:tasks.workunit.client.0.smithi019.stdout:1/734: rename d3/d3f/d58/d7f/cc2 to d3/d3f/d58/ce9 0 2024-09-12T22:33:15.910 INFO:tasks.workunit.client.0.smithi019.stdout:1/735: readlink d3/df/d7e/db7/d16/d3c/dbd/ld4 0 2024-09-12T22:33:15.911 INFO:tasks.workunit.client.0.smithi019.stdout:5/714: dread d0/d7/d2d/d32/d4a/f6f [0,4194304] 0 2024-09-12T22:33:15.913 INFO:tasks.workunit.client.0.smithi019.stdout:1/736: truncate d3/df/f48 1930695 0 2024-09-12T22:33:15.913 INFO:tasks.workunit.client.0.smithi019.stdout:2/592: dread d0/f1f [0,4194304] 0 2024-09-12T22:33:15.913 INFO:tasks.workunit.client.0.smithi019.stdout:6/681: dread d1b/f7d [0,4194304] 0 2024-09-12T22:33:15.913 INFO:tasks.workunit.client.0.smithi019.stdout:1/737: chown c0 44192 1 2024-09-12T22:33:15.914 INFO:tasks.workunit.client.0.smithi019.stdout:2/593: creat d0/d5/d17/fc6 x:0 0 0 2024-09-12T22:33:15.915 INFO:tasks.workunit.client.0.smithi019.stdout:1/738: rename d3/df/d7e/cc5 to d3/df/cea 0 2024-09-12T22:33:15.916 INFO:tasks.workunit.client.0.smithi019.stdout:6/682: link d1b/d26/d27/d67/d77/d7b/l84 d1b/d26/d27/d67/le9 0 2024-09-12T22:33:15.918 INFO:tasks.workunit.client.0.smithi019.stdout:8/628: write d7/f1d [1726832,23078] 0 2024-09-12T22:33:15.919 INFO:tasks.workunit.client.0.smithi019.stdout:5/715: dwrite d0/d7/d2d/d32/d36/d8c/d8f/f9f [0,4194304] 0 2024-09-12T22:33:15.920 INFO:tasks.workunit.client.0.smithi019.stdout:6/683: getdents d1b/d26/d27 0 2024-09-12T22:33:15.920 INFO:tasks.workunit.client.0.smithi019.stdout:8/629: write d7/d5e/f91 [1374001,3968] 0 2024-09-12T22:33:15.921 INFO:tasks.workunit.client.0.smithi019.stdout:4/616: dread d1/d22/f68 [0,4194304] 0 2024-09-12T22:33:15.922 INFO:tasks.workunit.client.0.smithi019.stdout:1/739: dwrite d3/d3f/d77/fba [0,4194304] 0 2024-09-12T22:33:15.923 INFO:tasks.workunit.client.0.smithi019.stdout:6/684: truncate d1b/d26/d31/dd6/fb0 1014016 0 2024-09-12T22:33:15.923 INFO:tasks.workunit.client.0.smithi019.stdout:0/630: truncate d1/d14/d1b/d3a/d8c/dae/fb5 2513521 0 2024-09-12T22:33:15.924 INFO:tasks.workunit.client.0.smithi019.stdout:5/716: rename d0/d7/d2d/d32/d36/d8c/caa to d0/d7/d16/d18/d9d/cf9 0 2024-09-12T22:33:15.925 INFO:tasks.workunit.client.0.smithi019.stdout:4/617: creat d1/fcf x:0 0 0 2024-09-12T22:33:15.926 INFO:tasks.workunit.client.0.smithi019.stdout:6/685: chown d1b/d26/d27/f5b 1448794 1 2024-09-12T22:33:15.926 INFO:tasks.workunit.client.0.smithi019.stdout:0/631: chown d1/d14/f22 2 1 2024-09-12T22:33:15.926 INFO:tasks.workunit.client.0.smithi019.stdout:4/618: rmdir d1/d22 39 2024-09-12T22:33:15.926 INFO:tasks.workunit.client.0.smithi019.stdout:8/630: truncate d7/d8/d43/d87/fb2 393313 0 2024-09-12T22:33:15.926 INFO:tasks.workunit.client.0.smithi019.stdout:5/717: creat d0/d7/d2d/d32/d36/d8c/db8/d24/ffa x:0 0 0 2024-09-12T22:33:15.926 INFO:tasks.workunit.client.0.smithi019.stdout:1/740: mkdir d3/df/d7e/db7/d16/d3c/dbd/dc4/deb 0 2024-09-12T22:33:15.927 INFO:tasks.workunit.client.0.smithi019.stdout:4/619: mkdir d1/d8/dd0 0 2024-09-12T22:33:15.927 INFO:tasks.workunit.client.0.smithi019.stdout:1/741: fsync d3/d6e/f87 0 2024-09-12T22:33:15.927 INFO:tasks.workunit.client.0.smithi019.stdout:6/686: link d1b/d26/d27/d3e/d83/d98/fd1 d1b/db4/fea 0 2024-09-12T22:33:15.928 INFO:tasks.workunit.client.0.smithi019.stdout:8/631: write d7/d34/d78/d2d/f79 [466609,117798] 0 2024-09-12T22:33:15.929 INFO:tasks.workunit.client.0.smithi019.stdout:5/718: fdatasync d0/d7/d2d/d32/d4a/dbb/dd5/fe1 0 2024-09-12T22:33:15.929 INFO:tasks.workunit.client.0.smithi019.stdout:6/687: mknod d1b/d2d/ceb 0 2024-09-12T22:33:15.929 INFO:tasks.workunit.client.0.smithi019.stdout:4/620: fdatasync d1/d4c/fa5 0 2024-09-12T22:33:15.929 INFO:tasks.workunit.client.0.smithi019.stdout:0/632: symlink d1/d14/d26/d40/d45/d5e/d84/lc1 0 2024-09-12T22:33:15.932 INFO:tasks.workunit.client.0.smithi019.stdout:8/632: read d7/d34/f38 [227596,38513] 0 2024-09-12T22:33:15.932 INFO:tasks.workunit.client.0.smithi019.stdout:7/559: dread d6/d14/d15/d62/f87 [0,4194304] 0 2024-09-12T22:33:15.932 INFO:tasks.workunit.client.0.smithi019.stdout:4/621: creat d1/d4/d38/dbf/fd1 x:0 0 0 2024-09-12T22:33:15.933 INFO:tasks.workunit.client.0.smithi019.stdout:1/742: mkdir d3/df/d7e/db7/d16/d3c/dbd/dc4/deb/dec 0 2024-09-12T22:33:15.933 INFO:tasks.workunit.client.0.smithi019.stdout:6/688: mkdir d1b/d26/d31/dec 0 2024-09-12T22:33:15.933 INFO:tasks.workunit.client.0.smithi019.stdout:0/633: stat d1/d1f/d5b/d83/dab/dbe/c78 0 2024-09-12T22:33:15.933 INFO:tasks.workunit.client.0.smithi019.stdout:5/719: getdents d0/d7/d90 0 2024-09-12T22:33:15.933 INFO:tasks.workunit.client.0.smithi019.stdout:4/622: creat d1/d22/fd2 x:0 0 0 2024-09-12T22:33:15.933 INFO:tasks.workunit.client.0.smithi019.stdout:6/689: getdents d1b/d26/d31/dec 0 2024-09-12T22:33:15.933 INFO:tasks.workunit.client.0.smithi019.stdout:7/560: unlink d6/d14/d2a/da4/dc/d63/d4b/f6f 0 2024-09-12T22:33:15.933 INFO:tasks.workunit.client.0.smithi019.stdout:8/633: rename d7/d34/d78/d2d/d84/d8b to d7/d8/dd/d45/dc5 0 2024-09-12T22:33:15.933 INFO:tasks.workunit.client.0.smithi019.stdout:5/720: dread - d0/d7/d2d/d32/d36/d8c/db8/d39/fa7 zero size 2024-09-12T22:33:15.934 INFO:tasks.workunit.client.0.smithi019.stdout:8/634: chown d7/d34 5 1 2024-09-12T22:33:15.935 INFO:tasks.workunit.client.0.smithi019.stdout:6/690: creat d1b/d26/d27/d3e/d83/d98/fed x:0 0 0 2024-09-12T22:33:15.935 INFO:tasks.workunit.client.0.smithi019.stdout:8/635: creat d7/d34/d78/d53/daa/fc6 x:0 0 0 2024-09-12T22:33:15.935 INFO:tasks.workunit.client.0.smithi019.stdout:4/623: rename d1/d11/d15/d1f/c97 to d1/d11/d15/d1f/d56/da9/dce/cd3 0 2024-09-12T22:33:15.935 INFO:tasks.workunit.client.0.smithi019.stdout:6/691: truncate d1b/d26/d31/f9b 879300 0 2024-09-12T22:33:15.935 INFO:tasks.workunit.client.0.smithi019.stdout:4/624: stat d1/d4c/db0/d75/d5a/d79/f7d 0 2024-09-12T22:33:15.936 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:33:15.936 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:33:15.936 INFO:tasks.workunit.client.0.smithi019.stdout:6/692: truncate d1b/f7d 1380714 0 2024-09-12T22:33:15.937 INFO:tasks.workunit.client.0.smithi019.stdout:4/625: chown d1/d4/d38/d77/fcd 1 1 2024-09-12T22:33:15.937 INFO:tasks.workunit.client.0.smithi019.stdout:6/693: fdatasync d1b/d26/d27/d67/d77/f8f 0 2024-09-12T22:33:15.938 INFO:tasks.workunit.client.0.smithi019.stdout:7/561: dwrite d6/d14/d2a/da4/f3b [8388608,4194304] 0 2024-09-12T22:33:15.938 INFO:tasks.workunit.client.0.smithi019.stdout:4/626: link d1/d22/d26/f37 d1/d11/fd4 0 2024-09-12T22:33:15.938 INFO:tasks.workunit.client.0.smithi019.stdout:8/636: truncate d7/f6f 1465183 0 2024-09-12T22:33:15.939 INFO:tasks.workunit.client.0.smithi019.stdout:7/562: mknod d6/d2d/d8f/daf/cd1 0 2024-09-12T22:33:15.939 INFO:tasks.workunit.client.0.smithi019.stdout:4/627: mkdir d1/d11/d15/d1f/d56/dd5 0 2024-09-12T22:33:15.940 INFO:tasks.workunit.client.0.smithi019.stdout:4/628: creat d1/d11/d15/d1f/d56/dac/fd6 x:0 0 0 2024-09-12T22:33:15.941 INFO:tasks.workunit.client.0.smithi019.stdout:4/629: readlink d1/d11/d15/d1f/l4b 0 2024-09-12T22:33:15.943 INFO:tasks.workunit.client.0.smithi019.stdout:8/637: truncate d7/d8/dd/f56 638336 0 2024-09-12T22:33:15.944 INFO:tasks.workunit.client.0.smithi019.stdout:4/630: truncate d1/d22/d2c/fb3 813264 0 2024-09-12T22:33:15.944 INFO:tasks.workunit.client.0.smithi019.stdout:3/531: dread dd/f2a [0,4194304] 0 2024-09-12T22:33:15.946 INFO:tasks.workunit.client.0.smithi019.stdout:3/532: creat dd/d1e/d40/d6e/fa1 x:0 0 0 2024-09-12T22:33:15.946 INFO:tasks.workunit.client.0.smithi019.stdout:7/563: dwrite d6/d14/d15/f22 [0,4194304] 0 2024-09-12T22:33:15.946 INFO:tasks.workunit.client.0.smithi019.stdout:4/631: rename d1/d4c/db0/l7a to d1/d4/d38/dbf/ld7 0 2024-09-12T22:33:15.947 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:33:15.948 INFO:tasks.workunit.client.0.smithi019.stdout:7/564: mkdir d6/dd2 0 2024-09-12T22:33:15.948 INFO:tasks.workunit.client.0.smithi019.stdout:3/533: rename dd/c3d to dd/d1e/d40/d5f/ca2 0 2024-09-12T22:33:15.948 INFO:tasks.workunit.client.0.smithi019.stdout:4/632: symlink d1/d4c/db0/d75/d5a/ld8 0 2024-09-12T22:33:15.949 INFO:tasks.workunit.client.0.smithi019.stdout:4/633: stat d1/d4c/db0/d75 0 2024-09-12T22:33:15.951 INFO:tasks.workunit.client.0.smithi019.stdout:8/638: dwrite d7/d8/dd/d4f/f61 [0,4194304] 0 2024-09-12T22:33:15.952 INFO:tasks.workunit.client.0.smithi019.stdout:8/639: readlink d7/d34/l8c 0 2024-09-12T22:33:15.954 INFO:tasks.workunit.client.0.smithi019.stdout:6/694: dread d1b/d26/d27/d3e/d83/d98/fa5 [0,4194304] 0 2024-09-12T22:33:15.955 INFO:tasks.workunit.client.0.smithi019.stdout:2/594: dread d0/d5/f10 [0,4194304] 0 2024-09-12T22:33:15.955 INFO:tasks.workunit.client.0.smithi019.stdout:8/640: fdatasync d7/d8/dd/f11 0 2024-09-12T22:33:15.957 INFO:tasks.workunit.client.0.smithi019.stdout:3/534: dwrite dd/d1e/d40/f90 [0,4194304] 0 2024-09-12T22:33:15.959 INFO:tasks.workunit.client.0.smithi019.stdout:4/634: dwrite d1/d11/d15/d81/f92 [0,4194304] 0 2024-09-12T22:33:15.959 INFO:tasks.workunit.client.0.smithi019.stdout:7/565: dwrite d6/fb2 [0,4194304] 0 2024-09-12T22:33:15.959 INFO:tasks.workunit.client.0.smithi019.stdout:6/695: link d1b/d2d/fcc d1b/fee 0 2024-09-12T22:33:15.959 INFO:tasks.workunit.client.0.smithi019.stdout:3/535: readlink dd/d12/l84 0 2024-09-12T22:33:15.961 INFO:tasks.workunit.client.0.smithi019.stdout:7/566: dread - d6/d14/d15/d62/f91 zero size 2024-09-12T22:33:15.962 INFO:tasks.workunit.client.0.smithi019.stdout:6/696: write d1b/d26/d27/d3e/d83/d98/fa5 [1011024,99043] 0 2024-09-12T22:33:15.963 INFO:tasks.workunit.client.0.smithi019.stdout:4/635: link d1/d11/d15/d1f/l4b d1/d22/d31/d85/ld9 0 2024-09-12T22:33:15.964 INFO:tasks.workunit.client.0.smithi019.stdout:6/697: creat d1b/d26/d31/dd6/fef x:0 0 0 2024-09-12T22:33:15.965 INFO:tasks.workunit.client.0.smithi019.stdout:4/636: creat d1/d8/d7b/fda x:0 0 0 2024-09-12T22:33:15.965 INFO:tasks.workunit.client.0.smithi019.stdout:3/536: truncate dd/d12/f48 771775 0 2024-09-12T22:33:15.966 INFO:tasks.workunit.client.0.smithi019.stdout:8/641: dwrite d7/d8/f7d [0,4194304] 0 2024-09-12T22:33:15.966 INFO:tasks.workunit.client.0.smithi019.stdout:2/595: dwrite d0/d5/d18/d39/f94 [0,4194304] 0 2024-09-12T22:33:15.967 INFO:tasks.workunit.client.0.smithi019.stdout:6/698: creat d1b/d26/d39/d89/d90/ff0 x:0 0 0 2024-09-12T22:33:15.968 INFO:tasks.workunit.client.0.smithi019.stdout:5/721: dread d0/d7/d2d/d32/d36/d8c/db8/d39/f4e [0,4194304] 0 2024-09-12T22:33:15.969 INFO:tasks.workunit.client.0.smithi019.stdout:8/642: mkdir d7/d2f/d75/dc7 0 2024-09-12T22:33:15.969 INFO:tasks.workunit.client.0.smithi019.stdout:3/537: write dd/d1e/d40/f90 [77447,86149] 0 2024-09-12T22:33:15.969 INFO:tasks.workunit.client.0.smithi019.stdout:8/643: readlink d7/d8/l24 0 2024-09-12T22:33:15.970 INFO:tasks.workunit.client.0.smithi019.stdout:5/722: mkdir d0/d7/d16/d18/dfb 0 2024-09-12T22:33:15.970 INFO:tasks.workunit.client.0.smithi019.stdout:3/538: readlink dd/d12/l83 0 2024-09-12T22:33:15.972 INFO:tasks.workunit.client.0.smithi019.stdout:7/567: dwrite d6/d14/d45/db0/fc6 [0,4194304] 0 2024-09-12T22:33:15.972 INFO:tasks.workunit.client.0.smithi019.stdout:9/595: sync 2024-09-12T22:33:15.972 INFO:tasks.workunit.client.0.smithi019.stdout:3/539: write dd/f11 [12735055,123656] 0 2024-09-12T22:33:15.973 INFO:tasks.workunit.client.0.smithi019.stdout:7/568: mknod d6/d14/d15/d62/cd3 0 2024-09-12T22:33:15.974 INFO:tasks.workunit.client.0.smithi019.stdout:7/569: creat d6/d2d/d8f/daf/da0/fd4 x:0 0 0 2024-09-12T22:33:15.975 INFO:tasks.workunit.client.0.smithi019.stdout:3/540: mknod dd/ca3 0 2024-09-12T22:33:15.976 INFO:tasks.workunit.client.0.smithi019.stdout:5/723: read d0/d7/d2d/d32/d36/d8c/db8/d9a/fa4 [1074664,101775] 0 2024-09-12T22:33:15.977 INFO:tasks.workunit.client.0.smithi019.stdout:8/644: dwrite f0 [4194304,4194304] 0 2024-09-12T22:33:15.977 INFO:tasks.workunit.client.0.smithi019.stdout:7/570: mknod d6/d2d/d8f/cd5 0 2024-09-12T22:33:15.979 INFO:tasks.workunit.client.0.smithi019.stdout:3/541: write dd/d12/d62/d78/f8b [306062,27758] 0 2024-09-12T22:33:15.979 INFO:tasks.workunit.client.0.smithi019.stdout:6/699: dread d1b/d26/d27/d67/d77/f78 [0,4194304] 0 2024-09-12T22:33:15.979 INFO:tasks.workunit.client.0.smithi019.stdout:5/724: creat d0/d7/d2d/d32/dcd/ffc x:0 0 0 2024-09-12T22:33:15.980 INFO:tasks.workunit.client.0.smithi019.stdout:6/700: dread - d1b/d26/d31/dd6/fdf zero size 2024-09-12T22:33:15.980 INFO:tasks.workunit.client.0.smithi019.stdout:3/542: write dd/d12/f2c [8088,54543] 0 2024-09-12T22:33:15.980 INFO:tasks.workunit.client.0.smithi019.stdout:9/596: dwrite dd/d10/d17/d22/d6c/d53/d69/f9c [0,4194304] 0 2024-09-12T22:33:15.980 INFO:tasks.workunit.client.0.smithi019.stdout:9/597: dread - dd/d10/d17/d22/fa3 zero size 2024-09-12T22:33:15.981 INFO:tasks.workunit.client.0.smithi019.stdout:7/571: link d6/d14/d2a/da4/dc/d63/d4b/l57 d6/d2d/d8f/daf/ld6 0 2024-09-12T22:33:15.982 INFO:tasks.workunit.client.0.smithi019.stdout:3/543: dread dd/d1e/d40/f41 [0,4194304] 0 2024-09-12T22:33:15.982 INFO:tasks.workunit.client.0.smithi019.stdout:9/598: stat dd/d10/d17/d23/d2e/d31/d3f/d47/d6e/d80/lb4 0 2024-09-12T22:33:15.982 INFO:tasks.workunit.client.0.smithi019.stdout:4/637: truncate d1/d4/d38/f3b 1767556 0 2024-09-12T22:33:15.983 INFO:tasks.workunit.client.0.smithi019.stdout:4/638: chown d1/d22/d2c 2033559 1 2024-09-12T22:33:15.984 INFO:tasks.workunit.client.0.smithi019.stdout:3/544: link dd/d1e/d40/f6f dd/d95/fa4 0 2024-09-12T22:33:15.984 INFO:tasks.workunit.client.0.smithi019.stdout:9/599: chown dd/d10/d17/d23/d2e/d31/d3f/d47/d6e/c7d 0 1 2024-09-12T22:33:15.984 INFO:tasks.workunit.client.0.smithi019.stdout:3/545: fdatasync dd/f33 0 2024-09-12T22:33:15.984 INFO:tasks.workunit.client.0.smithi019.stdout:4/639: creat d1/d11/d15/d1f/fdb x:0 0 0 2024-09-12T22:33:15.985 INFO:tasks.workunit.client.0.smithi019.stdout:3/546: mknod dd/ca5 0 2024-09-12T22:33:15.986 INFO:tasks.workunit.client.0.smithi019.stdout:4/640: truncate d1/d4c/db0/d75/d5a/f8b 805647 0 2024-09-12T22:33:15.986 INFO:tasks.workunit.client.0.smithi019.stdout:3/547: mkdir dd/d1e/d40/da6 0 2024-09-12T22:33:15.986 INFO:tasks.workunit.client.0.smithi019.stdout:4/641: fsync d1/d11/fd4 0 2024-09-12T22:33:15.986 INFO:tasks.workunit.client.0.smithi019.stdout:3/548: symlink dd/d1e/d40/la7 0 2024-09-12T22:33:15.988 INFO:tasks.workunit.client.0.smithi019.stdout:3/549: read dd/d12/f30 [3880648,49812] 0 2024-09-12T22:33:15.988 INFO:tasks.workunit.client.0.smithi019.stdout:4/642: chown d1/d8/f20 12304 1 2024-09-12T22:33:15.988 INFO:tasks.workunit.client.0.smithi019.stdout:3/550: chown dd/d1e/d82/f87 545 1 2024-09-12T22:33:15.989 INFO:tasks.workunit.client.0.smithi019.stdout:4/643: write d1/d8/d7b/fda [1014075,100974] 0 2024-09-12T22:33:15.990 INFO:tasks.workunit.client.0.smithi019.stdout:9/600: dwrite dd/d10/d17/d23/d2e/d31/d3f/d47/d6e/f8a [0,4194304] 0 2024-09-12T22:33:15.992 INFO:tasks.workunit.client.0.smithi019.stdout:9/601: write dd/d10/d17/d22/d6c/da9/f81 [847091,49839] 0 2024-09-12T22:33:15.993 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:15.992+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:15.994 INFO:tasks.workunit.client.0.smithi019.stdout:4/644: dwrite d1/d4c/db0/d75/d5a/d79/f8a [0,4194304] 0 2024-09-12T22:33:15.995 INFO:tasks.workunit.client.0.smithi019.stdout:3/551: read dd/f33 [3863165,97395] 0 2024-09-12T22:33:15.997 INFO:tasks.workunit.client.0.smithi019.stdout:3/552: symlink dd/d1e/d40/d6e/la8 0 2024-09-12T22:33:15.997 INFO:tasks.workunit.client.0.smithi019.stdout:4/645: truncate d1/d22/d26/f48 2652935 0 2024-09-12T22:33:15.998 INFO:tasks.workunit.client.0.smithi019.stdout:4/646: fdatasync d1/d22/d31/d85/fab 0 2024-09-12T22:33:15.998 INFO:tasks.workunit.client.0.smithi019.stdout:9/602: dwrite dd/d10/d17/d23/d2e/d31/d3f/d67/fac [0,4194304] 0 2024-09-12T22:33:15.998 INFO:tasks.workunit.client.0.smithi019.stdout:3/553: mknod dd/d1e/d40/da6/ca9 0 2024-09-12T22:33:15.999 INFO:tasks.workunit.client.0.smithi019.stdout:3/554: stat dd/d12/f24 0 2024-09-12T22:33:16.000 INFO:tasks.workunit.client.0.smithi019.stdout:9/603: rename dd/d10/d17/d22/d6c/da9 to dd/dc2 0 2024-09-12T22:33:16.000 INFO:tasks.workunit.client.0.smithi019.stdout:3/555: rename dd/d95 to dd/d12/d62/d74/daa 0 2024-09-12T22:33:16.002 INFO:tasks.workunit.client.0.smithi019.stdout:3/556: write dd/f26 [3183207,58998] 0 2024-09-12T22:33:16.003 INFO:tasks.workunit.client.0.smithi019.stdout:3/557: rename dd/l3e to dd/d1e/d40/d5f/lab 0 2024-09-12T22:33:16.003 INFO:tasks.workunit.client.0.smithi019.stdout:3/558: chown dd/d1e/d5a 50508193 1 2024-09-12T22:33:16.003 INFO:tasks.workunit.client.0.smithi019.stdout:3/559: creat dd/d12/d62/fac x:0 0 0 2024-09-12T22:33:16.004 INFO:tasks.workunit.client.0.smithi019.stdout:3/560: symlink dd/lad 0 2024-09-12T22:33:16.004 INFO:tasks.workunit.client.0.smithi019.stdout:3/561: chown dd/d12/d62/d74/daa/l96 93464 1 2024-09-12T22:33:16.005 INFO:tasks.workunit.client.0.smithi019.stdout:3/562: truncate dd/d12/f30 4928809 0 2024-09-12T22:33:16.011 INFO:tasks.workunit.client.0.smithi019.stdout:4/647: truncate d1/d4c/db0/d75/d5a/f8b 720355 0 2024-09-12T22:33:16.011 INFO:tasks.workunit.client.0.smithi019.stdout:3/563: creat dd/d12/d62/d78/fae x:0 0 0 2024-09-12T22:33:16.011 INFO:tasks.workunit.client.0.smithi019.stdout:9/604: chown dd/d10/d17/d22/f95 5 1 2024-09-12T22:33:16.011 INFO:tasks.workunit.client.0.smithi019.stdout:4/648: symlink d1/d4/d38/dbf/ldc 0 2024-09-12T22:33:16.011 INFO:tasks.workunit.client.0.smithi019.stdout:2/596: dread d0/d5/d18/f56 [0,4194304] 0 2024-09-12T22:33:16.011 INFO:tasks.workunit.client.0.smithi019.stdout:9/605: creat dd/d10/d17/d22/d6c/d53/d69/d9d/fc3 x:0 0 0 2024-09-12T22:33:16.012 INFO:tasks.workunit.client.0.smithi019.stdout:2/597: truncate d0/d5/f3a 4989954 0 2024-09-12T22:33:16.012 INFO:tasks.workunit.client.0.smithi019.stdout:9/606: creat dd/d10/d17/d22/d42/fc4 x:0 0 0 2024-09-12T22:33:16.012 INFO:tasks.workunit.client.0.smithi019.stdout:2/598: creat d0/d5/d18/d1b/d5d/d86/d90/fc7 x:0 0 0 2024-09-12T22:33:16.012 INFO:tasks.workunit.client.0.smithi019.stdout:2/599: rename d0/d5/d18/d3b/f9b to d0/d5/d60/d71/fc8 0 2024-09-12T22:33:16.012 INFO:tasks.workunit.client.0.smithi019.stdout:2/600: readlink d0/d5/d60/d74/l75 0 2024-09-12T22:33:16.014 INFO:tasks.workunit.client.0.smithi019.stdout:2/601: write d0/da/f29 [2464098,117847] 0 2024-09-12T22:33:16.015 INFO:tasks.workunit.client.0.smithi019.stdout:2/602: write d0/d5/d18/d5c/d67/d77/fc4 [62296,80137] 0 2024-09-12T22:33:16.015 INFO:tasks.workunit.client.0.smithi019.stdout:3/564: dwrite dd/d1e/d40/f6f [4194304,4194304] 0 2024-09-12T22:33:16.017 INFO:tasks.workunit.client.0.smithi019.stdout:3/565: symlink dd/d12/d62/d74/laf 0 2024-09-12T22:33:16.017 INFO:tasks.workunit.client.0.smithi019.stdout:2/603: creat d0/d5/d18/d5c/d67/d77/fc9 x:0 0 0 2024-09-12T22:33:16.017 INFO:tasks.workunit.client.0.smithi019.stdout:8/645: dread d7/d34/f7a [0,4194304] 0 2024-09-12T22:33:16.017 INFO:tasks.workunit.client.0.smithi019.stdout:2/604: symlink d0/da/lca 0 2024-09-12T22:33:16.018 INFO:tasks.workunit.client.0.smithi019.stdout:8/646: mkdir d7/d5e/dc8 0 2024-09-12T22:33:16.019 INFO:tasks.workunit.client.0.smithi019.stdout:2/605: stat d0/d5/d18/d5c/d63/d6a/f76 0 2024-09-12T22:33:16.020 INFO:tasks.workunit.client.0.smithi019.stdout:2/606: rename d0/da/d73/d7c to d0/da/d73/dcb 0 2024-09-12T22:33:16.021 INFO:tasks.workunit.client.0.smithi019.stdout:2/607: mknod d0/d5/d17/d91/d9c/ccc 0 2024-09-12T22:33:16.022 INFO:tasks.workunit.client.0.smithi019.stdout:7/572: dread d6/d2d/d41/f56 [0,4194304] 0 2024-09-12T22:33:16.022 INFO:tasks.workunit.client.0.smithi019.stdout:5/725: dread d0/d7/f20 [0,4194304] 0 2024-09-12T22:33:16.022 INFO:tasks.workunit.client.0.smithi019.stdout:3/566: dread dd/d12/d62/d78/f8b [0,4194304] 0 2024-09-12T22:33:16.023 INFO:tasks.workunit.client.0.smithi019.stdout:7/573: mknod d6/d14/d15/d8b/cd7 0 2024-09-12T22:33:16.023 INFO:tasks.workunit.client.0.smithi019.stdout:5/726: mknod d0/d7/d16/d18/dc3/cfd 0 2024-09-12T22:33:16.024 INFO:tasks.workunit.client.0.smithi019.stdout:7/574: dread - d6/d14/d2a/da4/d42/faa zero size 2024-09-12T22:33:16.026 INFO:tasks.workunit.client.0.smithi019.stdout:7/575: write d6/d14/d2a/da4/f3b [520677,99369] 0 2024-09-12T22:33:16.027 INFO:tasks.workunit.client.0.smithi019.stdout:2/608: dwrite d0/d5/d18/d1b/d5d/d86/d90/fc7 [0,4194304] 0 2024-09-12T22:33:16.028 INFO:tasks.workunit.client.0.smithi019.stdout:7/576: rename d6/d14/d15/l9b to d6/d2d/d8f/daf/da0/ld8 0 2024-09-12T22:33:16.028 INFO:tasks.workunit.client.0.smithi019.stdout:2/609: chown d0/d5/d17/c8b 1 1 2024-09-12T22:33:16.029 INFO:tasks.workunit.client.0.smithi019.stdout:7/577: symlink d6/d2d/d41/ld9 0 2024-09-12T22:33:16.030 INFO:tasks.workunit.client.0.smithi019.stdout:7/578: creat d6/d14/d2a/da4/d34/fda x:0 0 0 2024-09-12T22:33:16.031 INFO:tasks.workunit.client.0.smithi019.stdout:7/579: readlink d6/d2d/d77/d8e/lb6 0 2024-09-12T22:33:16.031 INFO:tasks.workunit.client.0.smithi019.stdout:2/610: rename d0/d5/d18/d5c/d63/d6a/f76 to d0/da/d73/dcb/fcd 0 2024-09-12T22:33:16.032 INFO:tasks.workunit.client.0.smithi019.stdout:2/611: fdatasync d0/d5/d18/d5c/d67/d77/f7b 0 2024-09-12T22:33:16.032 INFO:tasks.workunit.client.0.smithi019.stdout:0/634: sync 2024-09-12T22:33:16.032 INFO:tasks.workunit.client.0.smithi019.stdout:1/743: sync 2024-09-12T22:33:16.033 INFO:tasks.workunit.client.0.smithi019.stdout:2/612: readlink d0/d5/d60/d74/l75 0 2024-09-12T22:33:16.033 INFO:tasks.workunit.client.0.smithi019.stdout:0/635: creat d1/d14/d26/d40/d45/fc2 x:0 0 0 2024-09-12T22:33:16.035 INFO:tasks.workunit.client.0.smithi019.stdout:1/744: dread d3/d6e/da9/f71 [0,4194304] 0 2024-09-12T22:33:16.035 INFO:tasks.workunit.client.0.smithi019.stdout:2/613: symlink d0/d5/lce 0 2024-09-12T22:33:16.035 INFO:tasks.workunit.client.0.smithi019.stdout:9/607: dread dd/f20 [0,4194304] 0 2024-09-12T22:33:16.035 INFO:tasks.workunit.client.0.smithi019.stdout:0/636: symlink d1/d14/d26/d40/d45/lc3 0 2024-09-12T22:33:16.035 INFO:tasks.workunit.client.0.smithi019.stdout:2/614: readlink d0/d5/d60/d71/l72 0 2024-09-12T22:33:16.036 INFO:tasks.workunit.client.0.smithi019.stdout:9/608: symlink dd/dc2/lc5 0 2024-09-12T22:33:16.036 INFO:tasks.workunit.client.0.smithi019.stdout:1/745: write d3/df/fcb [934151,56129] 0 2024-09-12T22:33:16.037 INFO:tasks.workunit.client.0.smithi019.stdout:2/615: rmdir d0/d5/d60/da0 0 2024-09-12T22:33:16.037 INFO:tasks.workunit.client.0.smithi019.stdout:9/609: rmdir dd/d10/d17/d23/d2e 39 2024-09-12T22:33:16.037 INFO:tasks.workunit.client.0.smithi019.stdout:1/746: fsync d3/df/d7e/db7/d63/f85 0 2024-09-12T22:33:16.038 INFO:tasks.workunit.client.0.smithi019.stdout:2/616: unlink d0/d5/d18/d1b/d36/f9a 0 2024-09-12T22:33:16.038 INFO:tasks.workunit.client.0.smithi019.stdout:7/580: dread d6/d2d/d8f/daf/f95 [0,4194304] 0 2024-09-12T22:33:16.039 INFO:tasks.workunit.client.0.smithi019.stdout:2/617: readlink d0/d5/d60/d74/d7e/la1 0 2024-09-12T22:33:16.039 INFO:tasks.workunit.client.0.smithi019.stdout:9/610: creat dd/d10/d17/d23/d2e/d31/d3f/d47/d6e/d80/fc6 x:0 0 0 2024-09-12T22:33:16.040 INFO:tasks.workunit.client.0.smithi019.stdout:2/618: creat d0/fcf x:0 0 0 2024-09-12T22:33:16.040 INFO:tasks.workunit.client.0.smithi019.stdout:1/747: write d3/df/f48 [1548251,115084] 0 2024-09-12T22:33:16.041 INFO:tasks.workunit.client.0.smithi019.stdout:9/611: creat dd/d10/d17/d22/d77/fc7 x:0 0 0 2024-09-12T22:33:16.041 INFO:tasks.workunit.client.0.smithi019.stdout:7/581: rename d6/d14/d2a/da4/dc/d63/c66 to d6/dd2/cdb 0 2024-09-12T22:33:16.042 INFO:tasks.workunit.client.0.smithi019.stdout:1/748: fdatasync d3/df/d7e/d96/fa5 0 2024-09-12T22:33:16.042 INFO:tasks.workunit.client.0.smithi019.stdout:7/582: rename d6/d14/d45/fa6 to d6/dcf/fdc 0 2024-09-12T22:33:16.042 INFO:tasks.workunit.client.0.smithi019.stdout:9/612: chown dd/d10/d17/d23/d2e/c45 3018041 1 2024-09-12T22:33:16.042 INFO:tasks.workunit.client.0.smithi019.stdout:1/749: write d3/df/d7e/db7/d16/d3c/fac [1553696,53407] 0 2024-09-12T22:33:16.043 INFO:tasks.workunit.client.0.smithi019.stdout:7/583: write d6/d2d/d3d/fa1 [561019,67558] 0 2024-09-12T22:33:16.044 INFO:tasks.workunit.client.0.smithi019.stdout:9/613: write dd/d10/d17/f24 [6807447,12161] 0 2024-09-12T22:33:16.044 INFO:tasks.workunit.client.0.smithi019.stdout:1/750: mkdir d3/d3f/d58/d7f/ded 0 2024-09-12T22:33:16.045 INFO:tasks.workunit.client.0.smithi019.stdout:1/751: creat d3/d3f/d77/dcd/fee x:0 0 0 2024-09-12T22:33:16.045 INFO:tasks.workunit.client.0.smithi019.stdout:9/614: creat dd/d10/d17/d22/d6c/d53/d69/d9d/fc8 x:0 0 0 2024-09-12T22:33:16.046 INFO:tasks.workunit.client.0.smithi019.stdout:9/615: readlink dd/d10/l91 0 2024-09-12T22:33:16.046 INFO:tasks.workunit.client.0.smithi019.stdout:1/752: fdatasync d3/f9 0 2024-09-12T22:33:16.046 INFO:tasks.workunit.client.0.smithi019.stdout:5/727: dread d0/d7/d2d/d32/d36/d8c/db8/d39/f63 [0,4194304] 0 2024-09-12T22:33:16.047 INFO:tasks.workunit.client.0.smithi019.stdout:9/616: write dd/d10/d17/d23/d2e/d31/f6d [1508322,120199] 0 2024-09-12T22:33:16.047 INFO:tasks.workunit.client.0.smithi019.stdout:7/584: dread d6/d14/d15/f22 [0,4194304] 0 2024-09-12T22:33:16.047 INFO:tasks.workunit.client.0.smithi019.stdout:1/753: write d3/df/d7e/db7/d16/d3c/dbd/de6/f5d [1901356,81217] 0 2024-09-12T22:33:16.048 INFO:tasks.workunit.client.0.smithi019.stdout:4/649: dread d1/d22/f33 [0,4194304] 0 2024-09-12T22:33:16.049 INFO:tasks.workunit.client.0.smithi019.stdout:7/585: rename d6/ce to d6/d14/d45/db0/cdd 0 2024-09-12T22:33:16.049 INFO:tasks.workunit.client.0.smithi019.stdout:9/617: write dd/d10/d17/d23/d2e/d31/d54/f75 [861198,57769] 0 2024-09-12T22:33:16.049 INFO:tasks.workunit.client.0.smithi019.stdout:1/754: mknod d3/df/d7e/db7/d16/d3c/cef 0 2024-09-12T22:33:16.050 INFO:tasks.workunit.client.0.smithi019.stdout:5/728: rename d0/d7/d2d/d32/d36/d8c/db8/d39/d38/dba/fb0 to d0/d7/d2d/d32/d36/d8c/db8/d24/d64/ffe 0 2024-09-12T22:33:16.050 INFO:tasks.workunit.client.0.smithi019.stdout:1/755: stat d3/d3f/d58/d7f/cdb 0 2024-09-12T22:33:16.050 INFO:tasks.workunit.client.0.smithi019.stdout:4/650: rename d1/d4/d38/dc4/d7e to d1/d4/d38/d77/ddd 0 2024-09-12T22:33:16.050 INFO:tasks.workunit.client.0.smithi019.stdout:9/618: creat dd/d10/d17/d22/d6c/d53/d69/fc9 x:0 0 0 2024-09-12T22:33:16.051 INFO:tasks.workunit.client.0.smithi019.stdout:5/729: unlink d0/d7/d16/f45 0 2024-09-12T22:33:16.052 INFO:tasks.workunit.client.0.smithi019.stdout:9/619: unlink dd/d10/d17/d23/d2e/l48 0 2024-09-12T22:33:16.053 INFO:tasks.workunit.client.0.smithi019.stdout:5/730: mknod d0/d7/d2d/d32/d4a/dbb/dd5/cff 0 2024-09-12T22:33:16.053 INFO:tasks.workunit.client.0.smithi019.stdout:7/586: fsync d6/d14/d45/d7c/f72 0 2024-09-12T22:33:16.054 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:16.052+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:16.054 INFO:tasks.workunit.client.0.smithi019.stdout:7/587: fdatasync d6/dcf/fdc 0 2024-09-12T22:33:16.054 INFO:tasks.workunit.client.0.smithi019.stdout:3/567: dread dd/f16 [0,4194304] 0 2024-09-12T22:33:16.055 INFO:tasks.workunit.client.0.smithi019.stdout:5/731: mknod d0/d7/d2d/d32/d36/d8c/db8/d24/c100 0 2024-09-12T22:33:16.055 INFO:tasks.workunit.client.0.smithi019.stdout:8/647: sync 2024-09-12T22:33:16.055 INFO:tasks.workunit.client.0.smithi019.stdout:6/701: sync 2024-09-12T22:33:16.055 INFO:tasks.workunit.client.0.smithi019.stdout:1/756: sync 2024-09-12T22:33:16.056 INFO:tasks.workunit.client.0.smithi019.stdout:7/588: mkdir d6/d2d/d77/dbf/dde 0 2024-09-12T22:33:16.056 INFO:tasks.workunit.client.0.smithi019.stdout:4/651: dwrite d1/d22/d2c/f6d [0,4194304] 0 2024-09-12T22:33:16.057 INFO:tasks.workunit.client.0.smithi019.stdout:6/702: dread - d1b/db4/fd2 zero size 2024-09-12T22:33:16.058 INFO:tasks.workunit.client.0.smithi019.stdout:1/757: mknod d3/d6e/da9/cf0 0 2024-09-12T22:33:16.059 INFO:tasks.workunit.client.0.smithi019.stdout:7/589: read d6/d14/d2a/da4/d42/f61 [989992,124959] 0 2024-09-12T22:33:16.059 INFO:tasks.workunit.client.0.smithi019.stdout:1/758: fsync d3/f69 0 2024-09-12T22:33:16.060 INFO:tasks.workunit.client.0.smithi019.stdout:5/732: write d0/d7/d2d/d32/d36/d8c/db8/d39/d38/d4b/feb [185519,56218] 0 2024-09-12T22:33:16.060 INFO:tasks.workunit.client.0.smithi019.stdout:9/620: dwrite dd/d10/d17/d22/d42/fc4 [0,4194304] 0 2024-09-12T22:33:16.062 INFO:tasks.workunit.client.0.smithi019.stdout:6/703: symlink d1b/d26/d27/d3e/d83/d98/lf1 0 2024-09-12T22:33:16.063 INFO:tasks.workunit.client.0.smithi019.stdout:4/652: getdents d1/d4c/db0/d75/d5a/d79/db4 0 2024-09-12T22:33:16.063 INFO:tasks.workunit.client.0.smithi019.stdout:6/704: rmdir d1b/d26/d27/d3e 39 2024-09-12T22:33:16.063 INFO:tasks.workunit.client.0.smithi019.stdout:3/568: dwrite dd/d1e/f23 [0,4194304] 0 2024-09-12T22:33:16.064 INFO:tasks.workunit.client.0.smithi019.stdout:6/705: mkdir d1b/d26/de2/df2 0 2024-09-12T22:33:16.064 INFO:tasks.workunit.client.0.smithi019.stdout:5/733: creat d0/d7/d2d/d32/d36/d8c/db8/d39/d38/d4b/dde/da0/f101 x:0 0 0 2024-09-12T22:33:16.065 INFO:tasks.workunit.client.0.smithi019.stdout:3/569: unlink dd/d1e/d40/d5f/c92 0 2024-09-12T22:33:16.067 INFO:tasks.workunit.client.0.smithi019.stdout:2/619: sync 2024-09-12T22:33:16.067 INFO:tasks.workunit.client.0.smithi019.stdout:0/637: sync 2024-09-12T22:33:16.067 INFO:tasks.workunit.client.0.smithi019.stdout:4/653: sync 2024-09-12T22:33:16.068 INFO:tasks.workunit.client.0.smithi019.stdout:3/570: symlink dd/d1e/lb0 0 2024-09-12T22:33:16.069 INFO:tasks.workunit.client.0.smithi019.stdout:1/759: dwrite d3/f31 [4194304,4194304] 0 2024-09-12T22:33:16.069 INFO:tasks.workunit.client.0.smithi019.stdout:2/620: fdatasync d0/d5/d17/f14 0 2024-09-12T22:33:16.070 INFO:tasks.workunit.client.0.smithi019.stdout:0/638: unlink d1/d1f/d5b/d83/dab/dbe/c96 0 2024-09-12T22:33:16.070 INFO:tasks.workunit.client.0.smithi019.stdout:9/621: dwrite dd/d10/f14 [0,4194304] 0 2024-09-12T22:33:16.070 INFO:tasks.workunit.client.0.smithi019.stdout:4/654: creat d1/d4/d38/dc4/dc2/fde x:0 0 0 2024-09-12T22:33:16.070 INFO:tasks.workunit.client.0.smithi019.stdout:3/571: unlink dd/d1e/f54 0 2024-09-12T22:33:16.071 INFO:tasks.workunit.client.0.smithi019.stdout:0/639: chown d1/fd 6762 1 2024-09-12T22:33:16.071 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:33:16.072 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:33:16.073 INFO:tasks.workunit.client.0.smithi019.stdout:5/734: link d0/d7/d2d/d32/d36/d8c/db8/d24/c2c d0/d7/d16/d18/d9d/dd8/c102 0 2024-09-12T22:33:16.073 INFO:tasks.workunit.client.0.smithi019.stdout:9/622: fdatasync dd/d10/d17/d22/d6c/d53/d69/f9c 0 2024-09-12T22:33:16.073 INFO:tasks.workunit.client.0.smithi019.stdout:1/760: mkdir d3/df/d7e/db7/d16/d3c/dbd/dc4/dc3/df1 0 2024-09-12T22:33:16.073 INFO:tasks.workunit.client.0.smithi019.stdout:2/621: link d0/d5/d17/c5a d0/d5/d18/d5c/cd0 0 2024-09-12T22:33:16.073 INFO:tasks.workunit.client.0.smithi019.stdout:6/706: dwrite d1b/d26/f74 [0,4194304] 0 2024-09-12T22:33:16.074 INFO:tasks.workunit.client.0.smithi019.stdout:5/735: getdents d0/d7/de6 0 2024-09-12T22:33:16.075 INFO:tasks.workunit.client.0.smithi019.stdout:6/707: symlink d1b/d26/d39/lf3 0 2024-09-12T22:33:16.075 INFO:tasks.workunit.client.0.smithi019.stdout:9/623: write dd/d10/d17/d23/d2e/f92 [45277,107201] 0 2024-09-12T22:33:16.077 INFO:tasks.workunit.client.0.smithi019.stdout:5/736: truncate d0/d7/d2d/d4c/fc6 65302 0 2024-09-12T22:33:16.077 INFO:tasks.workunit.client.0.smithi019.stdout:1/761: mkdir d3/df/d7e/db7/d16/d3c/dbd/dc4/dc3/df1/df2 0 2024-09-12T22:33:16.078 INFO:tasks.workunit.client.0.smithi019.stdout:3/572: dwrite dd/d12/f24 [0,4194304] 0 2024-09-12T22:33:16.079 INFO:tasks.workunit.client.0.smithi019.stdout:1/762: write d3/df/d7e/db7/f2c [3496059,10433] 0 2024-09-12T22:33:16.079 INFO:tasks.workunit.client.0.smithi019.stdout:3/573: fsync dd/f17 0 2024-09-12T22:33:16.083 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:33:16.084 INFO:tasks.workunit.client.0.smithi019.stdout:1/763: rename d3/df/d7e/db7/d63/d76/le2 to d3/df/d7e/db7/d16/d3c/dbd/lf3 0 2024-09-12T22:33:16.084 INFO:tasks.workunit.client.0.smithi019.stdout:6/708: dwrite d1b/f3c [0,4194304] 0 2024-09-12T22:33:16.085 INFO:tasks.workunit.client.0.smithi019.stdout:9/624: dwrite dd/d10/d17/d23/d2e/d31/d3f/d67/fac [0,4194304] 0 2024-09-12T22:33:16.085 INFO:tasks.workunit.client.0.smithi019.stdout:5/737: truncate d0/d7/d2d/d32/d36/d8c/db8/d39/d38/d4b/dde/fe5 900935 0 2024-09-12T22:33:16.085 INFO:tasks.workunit.client.0.smithi019.stdout:6/709: symlink d1b/d26/de2/de5/lf4 0 2024-09-12T22:33:16.085 INFO:tasks.workunit.client.0.smithi019.stdout:9/625: mkdir dd/d10/d17/d76/dca 0 2024-09-12T22:33:16.086 INFO:tasks.workunit.client.0.smithi019.stdout:6/710: chown d1b/d26/d39/d89/d90 123461 1 2024-09-12T22:33:16.086 INFO:tasks.workunit.client.0.smithi019.stdout:9/626: unlink dd/d10/d17/d22/d42/c5d 0 2024-09-12T22:33:16.088 INFO:tasks.workunit.client.0.smithi019.stdout:1/764: write d3/d6e/da9/f44 [235132,85235] 0 2024-09-12T22:33:16.088 INFO:tasks.workunit.client.0.smithi019.stdout:3/574: write dd/f81 [358911,94052] 0 2024-09-12T22:33:16.089 INFO:tasks.workunit.client.0.smithi019.stdout:9/627: truncate dd/d10/d17/d22/d6c/d53/f5c 5111344 0 2024-09-12T22:33:16.090 INFO:tasks.workunit.client.0.smithi019.stdout:5/738: dread d0/d7/d16/f7a [0,4194304] 0 2024-09-12T22:33:16.090 INFO:tasks.workunit.client.0.smithi019.stdout:3/575: chown dd/d1e/d40/d5f/c75 20 1 2024-09-12T22:33:16.091 INFO:tasks.workunit.client.0.smithi019.stdout:3/576: chown dd/d1e/c50 18 1 2024-09-12T22:33:16.093 INFO:tasks.workunit.client.0.smithi019.stdout:3/577: stat dd/d12/d62/d78/d98 0 2024-09-12T22:33:16.093 INFO:tasks.workunit.client.0.smithi019.stdout:6/711: dwrite d1b/d26/d39/f82 [0,4194304] 0 2024-09-12T22:33:16.093 INFO:tasks.workunit.client.0.smithi019.stdout:5/739: rename d0/d7/d2d/d32/d36/d8c/db8/d24/d64/fc0 to d0/d7/d16/d18/dae/f103 0 2024-09-12T22:33:16.093 INFO:tasks.workunit.client.0.smithi019.stdout:6/712: rmdir d1b/d26/d31/d5f/da8/dc3 39 2024-09-12T22:33:16.094 INFO:tasks.workunit.client.0.smithi019.stdout:1/765: truncate d3/df/d7e/db7/d16/d3c/f66 1130591 0 2024-09-12T22:33:16.094 INFO:tasks.workunit.client.0.smithi019.stdout:3/578: link dd/d12/d62/d74/daa/fa4 dd/d12/d62/d78/fb1 0 2024-09-12T22:33:16.095 INFO:tasks.workunit.client.0.smithi019.stdout:9/628: truncate dd/d10/d17/d23/d2e/d31/f6d 1474309 0 2024-09-12T22:33:16.096 INFO:tasks.workunit.client.0.smithi019.stdout:9/629: mkdir dd/dcb 0 2024-09-12T22:33:16.096 INFO:tasks.workunit.client.0.smithi019.stdout:3/579: fdatasync dd/d1e/d5a/f5b 0 2024-09-12T22:33:16.097 INFO:tasks.workunit.client.0.smithi019.stdout:4/655: sync 2024-09-12T22:33:16.097 INFO:tasks.workunit.client.0.smithi019.stdout:0/640: sync 2024-09-12T22:33:16.097 INFO:tasks.workunit.client.0.smithi019.stdout:0/641: fdatasync d1/f1a 0 2024-09-12T22:33:16.097 INFO:tasks.workunit.client.0.smithi019.stdout:3/580: link dd/l8d dd/d12/d62/lb2 0 2024-09-12T22:33:16.098 INFO:tasks.workunit.client.0.smithi019.stdout:9/630: unlink dd/d10/d17/d23/d2e/d31/d54/c5e 0 2024-09-12T22:33:16.098 INFO:tasks.workunit.client.0.smithi019.stdout:4/656: truncate d1/fcf 170386 0 2024-09-12T22:33:16.098 INFO:tasks.workunit.client.0.smithi019.stdout:3/581: fdatasync dd/d12/f3b 0 2024-09-12T22:33:16.099 INFO:tasks.workunit.client.0.smithi019.stdout:5/740: dwrite d0/d7/d16/d18/f26 [0,4194304] 0 2024-09-12T22:33:16.100 INFO:tasks.workunit.client.0.smithi019.stdout:0/642: mknod d1/d1f/d5b/d83/dab/dbe/d9c/cc4 0 2024-09-12T22:33:16.101 INFO:tasks.workunit.client.0.smithi019.stdout:4/657: truncate d1/d8/fc0 177946 0 2024-09-12T22:33:16.101 INFO:tasks.workunit.client.0.smithi019.stdout:5/741: mkdir d0/dd0/d104 0 2024-09-12T22:33:16.101 INFO:tasks.workunit.client.0.smithi019.stdout:3/582: write dd/d1e/d5a/f99 [131627,87405] 0 2024-09-12T22:33:16.102 INFO:tasks.workunit.client.0.smithi019.stdout:4/658: readlink d1/d11/d15/d49/lc3 0 2024-09-12T22:33:16.102 INFO:tasks.workunit.client.0.smithi019.stdout:1/766: dwrite d3/df/d7e/db7/d16/f60 [0,4194304] 0 2024-09-12T22:33:16.103 INFO:tasks.workunit.client.0.smithi019.stdout:3/583: write dd/d1e/d40/f4a [4178322,66598] 0 2024-09-12T22:33:16.103 INFO:tasks.workunit.client.0.smithi019.stdout:1/767: dread - d3/d3f/d77/dcd/fee zero size 2024-09-12T22:33:16.103 INFO:tasks.workunit.client.0.smithi019.stdout:0/643: creat d1/d1f/d5b/d83/dab/dbe/d89/fc5 x:0 0 0 2024-09-12T22:33:16.104 INFO:tasks.workunit.client.0.smithi019.stdout:3/584: chown dd/d12/f7a 3 1 2024-09-12T22:33:16.104 INFO:tasks.workunit.client.0.smithi019.stdout:1/768: mknod d3/d3f/d77/cf4 0 2024-09-12T22:33:16.105 INFO:tasks.workunit.client.0.smithi019.stdout:5/742: getdents d0/d7/d2d/d4c/d87 0 2024-09-12T22:33:16.106 INFO:tasks.workunit.client.0.smithi019.stdout:0/644: getdents d1 0 2024-09-12T22:33:16.107 INFO:tasks.workunit.client.0.smithi019.stdout:4/659: dread d1/d11/d15/d81/f92 [0,4194304] 0 2024-09-12T22:33:16.108 INFO:tasks.workunit.client.0.smithi019.stdout:0/645: mkdir d1/d1f/d5b/d83/dab/dbe/dc6 0 2024-09-12T22:33:16.108 INFO:tasks.workunit.client.0.smithi019.stdout:5/743: truncate d0/d7/d2d/d32/d36/d8c/db8/d39/fa7 414420 0 2024-09-12T22:33:16.108 INFO:tasks.workunit.client.0.smithi019.stdout:4/660: creat d1/d11/fdf x:0 0 0 2024-09-12T22:33:16.108 INFO:tasks.workunit.client.0.smithi019.stdout:5/744: sync 2024-09-12T22:33:16.110 INFO:tasks.workunit.client.0.smithi019.stdout:4/661: creat d1/d11/d15/d1f/d56/dac/fe0 x:0 0 0 2024-09-12T22:33:16.110 INFO:tasks.workunit.client.0.smithi019.stdout:5/745: symlink d0/d7/d16/d18/d9d/l105 0 2024-09-12T22:33:16.112 INFO:tasks.workunit.client.0.smithi019.stdout:1/769: dwrite d3/df/d7e/db7/d63/f97 [0,4194304] 0 2024-09-12T22:33:16.112 INFO:tasks.workunit.client.0.smithi019.stdout:4/662: mknod d1/d4c/db0/d75/d5a/ce1 0 2024-09-12T22:33:16.112 INFO:tasks.workunit.client.0.smithi019.stdout:5/746: write d0/d7/d16/d18/dae/f103 [646377,113845] 0 2024-09-12T22:33:16.113 INFO:tasks.workunit.client.0.smithi019.stdout:4/663: truncate d1/d8/f14 5389729 0 2024-09-12T22:33:16.114 INFO:tasks.workunit.client.0.smithi019.stdout:0/646: write d1/d14/d1b/f2b [1916870,32767] 0 2024-09-12T22:33:16.114 INFO:tasks.workunit.client.0.smithi019.stdout:7/590: dread d6/d14/d15/d62/d6a/fc2 [0,4194304] 0 2024-09-12T22:33:16.114 INFO:tasks.workunit.client.0.smithi019.stdout:3/585: dread dd/d1e/d5a/f99 [0,4194304] 0 2024-09-12T22:33:16.115 INFO:tasks.workunit.client.0.smithi019.stdout:5/747: unlink d0/d7/d2d/d32/d36/d8c/db8/d24/ffa 0 2024-09-12T22:33:16.116 INFO:tasks.workunit.client.0.smithi019.stdout:0/647: mkdir d1/d1f/d5b/d83/dc7 0 2024-09-12T22:33:16.116 INFO:tasks.workunit.client.0.smithi019.stdout:7/591: unlink d6/d2d/d8f/daf/ld6 0 2024-09-12T22:33:16.116 INFO:tasks.workunit.client.0.smithi019.stdout:4/664: rename d1/d11/d15/d1f/l90 to d1/d4c/db0/d75/le2 0 2024-09-12T22:33:16.116 INFO:tasks.workunit.client.0.smithi019.stdout:3/586: mknod dd/d1e/cb3 0 2024-09-12T22:33:16.116 INFO:tasks.workunit.client.0.smithi019.stdout:5/748: readlink d0/d7/d2d/d32/dcd/le8 0 2024-09-12T22:33:16.117 INFO:tasks.workunit.client.0.smithi019.stdout:4/665: chown d1/d22/f68 7083 1 2024-09-12T22:33:16.117 INFO:tasks.workunit.client.0.smithi019.stdout:7/592: dread - d6/d14/d2a/da4/dc/f8d zero size 2024-09-12T22:33:16.117 INFO:tasks.workunit.client.0.smithi019.stdout:3/587: unlink dd/c1d 0 2024-09-12T22:33:16.118 INFO:tasks.workunit.client.0.smithi019.stdout:5/749: fsync d0/d7/d2d/d32/d36/d8c/fea 0 2024-09-12T22:33:16.118 INFO:tasks.workunit.client.0.smithi019.stdout:4/666: mkdir d1/d22/d31/de3 0 2024-09-12T22:33:16.118 INFO:tasks.workunit.client.0.smithi019.stdout:7/593: fsync d6/d14/d2a/da4/fb1 0 2024-09-12T22:33:16.120 INFO:tasks.workunit.client.0.smithi019.stdout:5/750: symlink d0/d7/d2d/d32/d4a/dbb/dd5/l106 0 2024-09-12T22:33:16.121 INFO:tasks.workunit.client.0.smithi019.stdout:8/648: dread d7/d8/f73 [0,4194304] 0 2024-09-12T22:33:16.122 INFO:tasks.workunit.client.0.smithi019.stdout:5/751: write d0/d7/d2d/d32/d36/d8c/db8/d39/d38/dba/fc8 [259750,80163] 0 2024-09-12T22:33:16.122 INFO:tasks.workunit.client.0.smithi019.stdout:8/649: creat d7/d34/fc9 x:0 0 0 2024-09-12T22:33:16.125 INFO:tasks.workunit.client.0.smithi019.stdout:3/588: dwrite dd/d1e/d82/f89 [0,4194304] 0 2024-09-12T22:33:16.125 INFO:tasks.workunit.client.0.smithi019.stdout:8/650: unlink d7/d8/dd/f58 0 2024-09-12T22:33:16.125 INFO:tasks.workunit.client.0.smithi019.stdout:5/752: creat d0/d7/d2d/d32/d36/d8c/db8/d39/d38/dba/f107 x:0 0 0 2024-09-12T22:33:16.125 INFO:tasks.workunit.client.0.smithi019.stdout:8/651: dread - d7/d34/d78/d54/f95 zero size 2024-09-12T22:33:16.125 INFO:tasks.workunit.client.0.smithi019.stdout:3/589: rename l6 to dd/d12/d62/d6a/lb4 0 2024-09-12T22:33:16.126 INFO:tasks.workunit.client.0.smithi019.stdout:7/594: dread d6/d14/d2a/da4/dc/d63/f37 [0,4194304] 0 2024-09-12T22:33:16.127 INFO:tasks.workunit.client.0.smithi019.stdout:8/652: symlink d7/d5e/dc8/lca 0 2024-09-12T22:33:16.128 INFO:tasks.workunit.client.0.smithi019.stdout:5/753: write d0/d7/d2d/d32/d4a/dbb/dd5/fe1 [1506870,35018] 0 2024-09-12T22:33:16.129 INFO:tasks.workunit.client.0.smithi019.stdout:8/653: rename d7/d8/f64 to d7/d5e/fcb 0 2024-09-12T22:33:16.129 INFO:tasks.workunit.client.0.smithi019.stdout:7/595: truncate d6/d2d/d77/f79 408036 0 2024-09-12T22:33:16.130 INFO:tasks.workunit.client.0.smithi019.stdout:2/622: dread d0/d5/d18/d1b/d5d/d86/f61 [0,4194304] 0 2024-09-12T22:33:16.130 INFO:tasks.workunit.client.0.smithi019.stdout:4/667: dwrite d1/d22/d26/f43 [0,4194304] 0 2024-09-12T22:33:16.130 INFO:tasks.workunit.client.0.smithi019.stdout:6/713: dread d1b/f45 [0,4194304] 0 2024-09-12T22:33:16.131 INFO:tasks.workunit.client.0.smithi019.stdout:8/654: write d7/d8/f2e [3723292,37015] 0 2024-09-12T22:33:16.131 INFO:tasks.workunit.client.0.smithi019.stdout:5/754: getdents d0/d7/d2d/d4c/d87/da2 0 2024-09-12T22:33:16.131 INFO:tasks.workunit.client.0.smithi019.stdout:4/668: readlink d1/d4/d38/dbf/ldc 0 2024-09-12T22:33:16.132 INFO:tasks.workunit.client.0.smithi019.stdout:8/655: chown d7/d8/dd/f1c 34276078 1 2024-09-12T22:33:16.134 INFO:tasks.workunit.client.0.smithi019.stdout:5/755: rmdir d0/d7/d2d/d32/d36/d8c/db5 39 2024-09-12T22:33:16.134 INFO:tasks.workunit.client.0.smithi019.stdout:2/623: rename d0/da/c33 to d0/d5/d18/d1b/d5d/d86/cd1 0 2024-09-12T22:33:16.134 INFO:tasks.workunit.client.0.smithi019.stdout:8/656: symlink d7/d2f/d42/lcc 0 2024-09-12T22:33:16.135 INFO:tasks.workunit.client.0.smithi019.stdout:6/714: link d1b/d26/d31/dd6/caf d1b/d26/d31/d5f/da8/cf5 0 2024-09-12T22:33:16.136 INFO:tasks.workunit.client.0.smithi019.stdout:8/657: mknod d7/d34/d78/d2d/d84/ccd 0 2024-09-12T22:33:16.137 INFO:tasks.workunit.client.0.smithi019.stdout:5/756: mknod d0/d7/d2d/d32/d36/d8c/c108 0 2024-09-12T22:33:16.137 INFO:tasks.workunit.client.0.smithi019.stdout:2/624: rename d0/d5/d18 to d0/d5/d18/d1b/d5d/dd2 22 2024-09-12T22:33:16.139 INFO:tasks.workunit.client.0.smithi019.stdout:7/596: dwrite d6/d14/d2a/da4/dc/d63/d4b/f5a [0,4194304] 0 2024-09-12T22:33:16.139 INFO:tasks.workunit.client.0.smithi019.stdout:5/757: write d0/f37 [2543236,79598] 0 2024-09-12T22:33:16.139 INFO:tasks.workunit.client.0.smithi019.stdout:9/631: dread dd/d10/d17/d22/fae [0,4194304] 0 2024-09-12T22:33:16.139 INFO:tasks.workunit.client.0.smithi019.stdout:2/625: creat d0/da/d73/fd3 x:0 0 0 2024-09-12T22:33:16.140 INFO:tasks.workunit.client.0.smithi019.stdout:4/669: dwrite d1/d4/d38/f83 [0,4194304] 0 2024-09-12T22:33:16.142 INFO:tasks.workunit.client.0.smithi019.stdout:4/670: creat d1/d4/d38/d77/fe4 x:0 0 0 2024-09-12T22:33:16.142 INFO:tasks.workunit.client.0.smithi019.stdout:5/758: write d0/d7/d2d/d32/d36/d8c/fea [522816,121579] 0 2024-09-12T22:33:16.142 INFO:tasks.workunit.client.0.smithi019.stdout:2/626: fsync d0/da/d73/dcb/fcd 0 2024-09-12T22:33:16.142 INFO:tasks.workunit.client.0.smithi019.stdout:9/632: mkdir dd/d10/d17/d76/dcc 0 2024-09-12T22:33:16.143 INFO:tasks.workunit.client.0.smithi019.stdout:5/759: rmdir d0/d7/d2d 39 2024-09-12T22:33:16.143 INFO:tasks.workunit.client.0.smithi019.stdout:4/671: chown d1/d11/fdf 63 1 2024-09-12T22:33:16.143 INFO:tasks.workunit.client.0.smithi019.stdout:2/627: creat d0/da/fd4 x:0 0 0 2024-09-12T22:33:16.145 INFO:tasks.workunit.client.0.smithi019.stdout:4/672: dread - d1/d11/d15/d1f/d56/dac/fd6 zero size 2024-09-12T22:33:16.145 INFO:tasks.workunit.client.0.smithi019.stdout:2/628: fdatasync d0/d5/d18/f56 0 2024-09-12T22:33:16.146 INFO:tasks.workunit.client.0.smithi019.stdout:9/633: mknod dd/d10/d17/d23/d2e/d31/d3f/d47/d6e/daf/ccd 0 2024-09-12T22:33:16.148 INFO:tasks.workunit.client.0.smithi019.stdout:7/597: dwrite d6/d14/d15/d9e/f50 [0,4194304] 0 2024-09-12T22:33:16.148 INFO:tasks.workunit.client.0.smithi019.stdout:9/634: chown dd/d10/d17/d23/d2e/f93 7875 1 2024-09-12T22:33:16.148 INFO:tasks.workunit.client.0.smithi019.stdout:9/635: sync 2024-09-12T22:33:16.148 INFO:tasks.workunit.client.0.smithi019.stdout:4/673: truncate d1/d4/d38/f3b 879090 0 2024-09-12T22:33:16.149 INFO:tasks.workunit.client.0.smithi019.stdout:7/598: chown d6/d2d/d41/ld9 122000301 1 2024-09-12T22:33:16.149 INFO:tasks.workunit.client.0.smithi019.stdout:2/629: dread d0/d5/d18/f56 [0,4194304] 0 2024-09-12T22:33:16.149 INFO:tasks.workunit.client.0.smithi019.stdout:8/658: rename d7/d34/d78/d2d/d84 to d7/d8/d43/d87/dc2/dce 0 2024-09-12T22:33:16.150 INFO:tasks.workunit.client.0.smithi019.stdout:6/715: truncate d1b/d26/d39/f82 1437621 0 2024-09-12T22:33:16.150 INFO:tasks.workunit.client.0.smithi019.stdout:4/674: truncate d1/d22/fd2 687858 0 2024-09-12T22:33:16.150 INFO:tasks.workunit.client.0.smithi019.stdout:7/599: symlink d6/d14/d15/ldf 0 2024-09-12T22:33:16.151 INFO:tasks.workunit.client.0.smithi019.stdout:4/675: chown d1/d4/d38 0 1 2024-09-12T22:33:16.151 INFO:tasks.workunit.client.0.smithi019.stdout:2/630: symlink d0/d5/d17/d91/ld5 0 2024-09-12T22:33:16.151 INFO:tasks.workunit.client.0.smithi019.stdout:5/760: rename d0/d7/d16/d18/dc3/lc4 to d0/d7/d2d/d32/d36/d8c/db8/d39/d38/dba/dc7/df3/l109 0 2024-09-12T22:33:16.151 INFO:tasks.workunit.client.0.smithi019.stdout:9/636: creat dd/d10/d17/d22/d6c/d53/d73/fce x:0 0 0 2024-09-12T22:33:16.153 INFO:tasks.workunit.client.0.smithi019.stdout:8/659: creat d7/d2f/d75/dc7/fcf x:0 0 0 2024-09-12T22:33:16.153 INFO:tasks.workunit.client.0.smithi019.stdout:7/600: mkdir d6/d2d/de0 0 2024-09-12T22:33:16.157 INFO:tasks.workunit.client.0.smithi019.stdout:2/631: mkdir d0/d5/dd6 0 2024-09-12T22:33:16.157 INFO:tasks.workunit.client.0.smithi019.stdout:8/660: chown d7/d34/d78/d2d 108471313 1 2024-09-12T22:33:16.157 INFO:tasks.workunit.client.0.smithi019.stdout:9/637: rmdir dd/d10/d17/d22/d83 0 2024-09-12T22:33:16.157 INFO:tasks.workunit.client.0.smithi019.stdout:2/632: readlink d0/d5/d18/d1b/d5d/l7f 0 2024-09-12T22:33:16.157 INFO:tasks.workunit.client.0.smithi019.stdout:7/601: rename d6/d2d/cce to d6/d14/d15/d62/d6a/ce1 0 2024-09-12T22:33:16.158 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:16.155+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:16.158 INFO:tasks.workunit.client.0.smithi019.stdout:3/590: dread dd/d12/f55 [0,4194304] 0 2024-09-12T22:33:16.159 INFO:tasks.workunit.client.0.smithi019.stdout:1/770: dread d3/df/d7e/db7/d16/f38 [0,4194304] 0 2024-09-12T22:33:16.160 INFO:tasks.workunit.client.0.smithi019.stdout:0/648: dread d1/d14/d26/f50 [0,4194304] 0 2024-09-12T22:33:16.161 INFO:tasks.workunit.client.0.smithi019.stdout:6/716: dwrite d1b/d26/f96 [0,4194304] 0 2024-09-12T22:33:16.161 INFO:tasks.workunit.client.0.smithi019.stdout:5/761: dread d0/d7/d16/faf [0,4194304] 0 2024-09-12T22:33:16.161 INFO:tasks.workunit.client.0.smithi019.stdout:4/676: dwrite d1/d4/d38/dc4/dc2/fc9 [0,4194304] 0 2024-09-12T22:33:16.162 INFO:tasks.workunit.client.0.smithi019.stdout:7/602: write d6/d14/d45/db0/fc6 [3640318,60093] 0 2024-09-12T22:33:16.162 INFO:tasks.workunit.client.0.smithi019.stdout:3/591: write dd/d1e/d40/d5f/f66 [733540,108520] 0 2024-09-12T22:33:16.162 INFO:tasks.workunit.client.0.smithi019.stdout:1/771: creat d3/d6e/da9/d54/ff5 x:0 0 0 2024-09-12T22:33:16.164 INFO:tasks.workunit.client.0.smithi019.stdout:0/649: symlink d1/d14/d26/d40/d45/lc8 0 2024-09-12T22:33:16.164 INFO:tasks.workunit.client.0.smithi019.stdout:7/603: dread - d6/d14/d15/d62/f91 zero size 2024-09-12T22:33:16.166 INFO:tasks.workunit.client.0.smithi019.stdout:1/772: dread - d3/df/d7e/db7/d16/d3c/dbd/de6/dd3/fe0 zero size 2024-09-12T22:33:16.166 INFO:tasks.workunit.client.0.smithi019.stdout:5/762: creat d0/d7/d16/d18/dc3/f10a x:0 0 0 2024-09-12T22:33:16.167 INFO:tasks.workunit.client.0.smithi019.stdout:7/604: truncate d6/d2d/d8f/daf/f9d 1012579 0 2024-09-12T22:33:16.167 INFO:tasks.workunit.client.0.smithi019.stdout:6/717: mknod d1b/d26/d27/d3e/d83/d98/cf6 0 2024-09-12T22:33:16.167 INFO:tasks.workunit.client.0.smithi019.stdout:0/650: mkdir d1/d14/d1b/dc9 0 2024-09-12T22:33:16.169 INFO:tasks.workunit.client.0.smithi019.stdout:7/605: symlink d6/dcf/le2 0 2024-09-12T22:33:16.169 INFO:tasks.workunit.client.0.smithi019.stdout:3/592: getdents dd/d1e/d40 0 2024-09-12T22:33:16.169 INFO:tasks.workunit.client.0.smithi019.stdout:2/633: read d0/d5/d18/d5c/d67/d77/fb3 [5290,8677] 0 2024-09-12T22:33:16.169 INFO:tasks.workunit.client.0.smithi019.stdout:4/677: dwrite d1/d8/f64 [0,4194304] 0 2024-09-12T22:33:16.169 INFO:tasks.workunit.client.0.smithi019.stdout:6/718: fdatasync d1b/d26/d31/d5f/d91/fc8 0 2024-09-12T22:33:16.170 INFO:tasks.workunit.client.0.smithi019.stdout:3/593: symlink dd/d1e/d40/d5f/lb5 0 2024-09-12T22:33:16.171 INFO:tasks.workunit.client.0.smithi019.stdout:1/773: rename d3/df/d7e/db7/d16/f86 to d3/df/d7e/db7/d63/ff6 0 2024-09-12T22:33:16.173 INFO:tasks.workunit.client.0.smithi019.stdout:3/594: creat dd/d12/d62/d78/d98/fb6 x:0 0 0 2024-09-12T22:33:16.174 INFO:tasks.workunit.client.0.smithi019.stdout:1/774: fsync d3/df/d7e/db7/d16/d3c/f70 0 2024-09-12T22:33:16.176 INFO:tasks.workunit.client.0.smithi019.stdout:3/595: chown dd/d12/f24 4 1 2024-09-12T22:33:16.177 INFO:tasks.workunit.client.0.smithi019.stdout:6/719: dwrite d1b/d2d/f55 [4194304,4194304] 0 2024-09-12T22:33:16.177 INFO:tasks.workunit.client.0.smithi019.stdout:0/651: dwrite d1/d14/d1b/fbc [0,4194304] 0 2024-09-12T22:33:16.178 INFO:tasks.workunit.client.0.smithi019.stdout:2/634: dwrite d0/f48 [4194304,4194304] 0 2024-09-12T22:33:16.179 INFO:tasks.workunit.client.0.smithi019.stdout:6/720: rmdir d1b/d26/d31/d5f/d91 39 2024-09-12T22:33:16.179 INFO:tasks.workunit.client.0.smithi019.stdout:3/596: creat dd/d12/d62/d74/daa/fb7 x:0 0 0 2024-09-12T22:33:16.180 INFO:tasks.workunit.client.0.smithi019.stdout:7/606: truncate f1 1378170 0 2024-09-12T22:33:16.181 INFO:tasks.workunit.client.0.smithi019.stdout:5/763: truncate d0/d7/d2d/d32/d4a/dbb/dd5/fe1 570309 0 2024-09-12T22:33:16.181 INFO:tasks.workunit.client.0.smithi019.stdout:0/652: chown d1/d1f/d5b/d83/dab/dbe/d71/d85/f99 1 1 2024-09-12T22:33:16.182 INFO:tasks.workunit.client.0.smithi019.stdout:3/597: rmdir dd/d1e/d40/d5f 39 2024-09-12T22:33:16.182 INFO:tasks.workunit.client.0.smithi019.stdout:3/598: sync 2024-09-12T22:33:16.183 INFO:tasks.workunit.client.0.smithi019.stdout:7/607: symlink d6/d14/d15/d9e/le3 0 2024-09-12T22:33:16.183 INFO:tasks.workunit.client.0.smithi019.stdout:6/721: creat d1b/d26/ff7 x:0 0 0 2024-09-12T22:33:16.183 INFO:tasks.workunit.client.0.smithi019.stdout:0/653: creat d1/d14/d1b/d94/fca x:0 0 0 2024-09-12T22:33:16.185 INFO:tasks.workunit.client.0.smithi019.stdout:5/764: symlink d0/d7/d2d/d32/d4a/dbb/dd5/l10b 0 2024-09-12T22:33:16.185 INFO:tasks.workunit.client.0.smithi019.stdout:7/608: readlink d6/d2d/d41/ld9 0 2024-09-12T22:33:16.185 INFO:tasks.workunit.client.0.smithi019.stdout:3/599: read - dd/d12/d62/d78/fae zero size 2024-09-12T22:33:16.186 INFO:tasks.workunit.client.0.smithi019.stdout:6/722: write d1b/d2d/fc0 [1031034,40641] 0 2024-09-12T22:33:16.186 INFO:tasks.workunit.client.0.smithi019.stdout:4/678: dwrite d1/d11/d15/f2e [0,4194304] 0 2024-09-12T22:33:16.187 INFO:tasks.workunit.client.0.smithi019.stdout:7/609: symlink d6/d14/d2a/le4 0 2024-09-12T22:33:16.188 INFO:tasks.workunit.client.0.smithi019.stdout:4/679: creat d1/d4/d44/fe5 x:0 0 0 2024-09-12T22:33:16.188 INFO:tasks.workunit.client.0.smithi019.stdout:3/600: creat dd/d1e/d40/fb8 x:0 0 0 2024-09-12T22:33:16.189 INFO:tasks.workunit.client.0.smithi019.stdout:7/610: write d6/d14/d45/fcd [104951,96733] 0 2024-09-12T22:33:16.190 INFO:tasks.workunit.client.0.smithi019.stdout:3/601: fsync dd/f2a 0 2024-09-12T22:33:16.190 INFO:tasks.workunit.client.0.smithi019.stdout:2/635: dwrite d0/d5/d18/d39/f44 [0,4194304] 0 2024-09-12T22:33:16.190 INFO:tasks.workunit.client.0.smithi019.stdout:4/680: write d1/d22/d57/f87 [9566565,121644] 0 2024-09-12T22:33:16.191 INFO:tasks.workunit.client.0.smithi019.stdout:7/611: creat d6/d14/d45/fe5 x:0 0 0 2024-09-12T22:33:16.191 INFO:tasks.workunit.client.0.smithi019.stdout:3/602: chown dd/d1e/f25 445 1 2024-09-12T22:33:16.192 INFO:tasks.workunit.client.0.smithi019.stdout:4/681: symlink d1/d11/le6 0 2024-09-12T22:33:16.192 INFO:tasks.workunit.client.0.smithi019.stdout:2/636: rename d0/d5/d17/l83 to d0/d5/d18/ld7 0 2024-09-12T22:33:16.192 INFO:tasks.workunit.client.0.smithi019.stdout:7/612: rmdir d6/d2d/d3d/d84 39 2024-09-12T22:33:16.194 INFO:tasks.workunit.client.0.smithi019.stdout:4/682: symlink d1/d11/d15/d1f/da8/le7 0 2024-09-12T22:33:16.194 INFO:tasks.workunit.client.0.smithi019.stdout:2/637: creat d0/d5/d60/fd8 x:0 0 0 2024-09-12T22:33:16.194 INFO:tasks.workunit.client.0.smithi019.stdout:2/638: stat d0/da/fd4 0 2024-09-12T22:33:16.195 INFO:tasks.workunit.client.0.smithi019.stdout:4/683: chown d1/d4c/db0/d75/d5a/ce1 32 1 2024-09-12T22:33:16.195 INFO:tasks.workunit.client.0.smithi019.stdout:5/765: dwrite d0/d7/d2d/d32/d36/d8c/db8/d39/f4e [0,4194304] 0 2024-09-12T22:33:16.196 INFO:tasks.workunit.client.0.smithi019.stdout:4/684: mknod d1/d22/d31/de3/ce8 0 2024-09-12T22:33:16.197 INFO:tasks.workunit.client.0.smithi019.stdout:4/685: mknod d1/d11/d15/d81/ce9 0 2024-09-12T22:33:16.198 INFO:tasks.workunit.client.0.smithi019.stdout:5/766: link d0/d7/d2d/d32/d36/d8c/db8/d24/d64/ffe d0/d7/d2d/d32/d36/d8c/db8/d39/d38/dba/dc7/df6/f10c 0 2024-09-12T22:33:16.199 INFO:tasks.workunit.client.0.smithi019.stdout:4/686: read d1/d22/f68 [1833939,97013] 0 2024-09-12T22:33:16.199 INFO:tasks.workunit.client.0.smithi019.stdout:9/638: dread dd/d10/d17/d23/d2e/d31/f34 [0,4194304] 0 2024-09-12T22:33:16.200 INFO:tasks.workunit.client.0.smithi019.stdout:4/687: symlink d1/d4/d38/dbf/lea 0 2024-09-12T22:33:16.201 INFO:tasks.workunit.client.0.smithi019.stdout:9/639: read dd/d10/d17/d22/d6c/d53/d69/fad [697396,56750] 0 2024-09-12T22:33:16.202 INFO:tasks.workunit.client.0.smithi019.stdout:3/603: truncate dd/d1e/d40/f90 3370332 0 2024-09-12T22:33:16.202 INFO:tasks.workunit.client.0.smithi019.stdout:7/613: truncate d6/d14/d45/db0/fc6 4052141 0 2024-09-12T22:33:16.204 INFO:tasks.workunit.client.0.smithi019.stdout:8/661: dread d7/d2f/d42/f93 [0,4194304] 0 2024-09-12T22:33:16.205 INFO:tasks.workunit.client.0.smithi019.stdout:2/639: dread d0/d5/d60/d71/fc8 [0,4194304] 0 2024-09-12T22:33:16.207 INFO:tasks.workunit.client.0.smithi019.stdout:5/767: dwrite d0/f1a [4194304,4194304] 0 2024-09-12T22:33:16.208 INFO:tasks.workunit.client.0.smithi019.stdout:8/662: fsync d7/d8/d43/d87/fb6 0 2024-09-12T22:33:16.208 INFO:tasks.workunit.client.0.smithi019.stdout:6/723: dwrite d1b/d26/d27/d67/d77/f8f [0,4194304] 0 2024-09-12T22:33:16.210 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:33:16.210 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:33:16.210 INFO:tasks.workunit.client.0.smithi019.stdout:5/768: write d0/d7/d2d/d32/d36/d8c/db8/fab [241117,107212] 0 2024-09-12T22:33:16.211 INFO:tasks.workunit.client.0.smithi019.stdout:8/663: creat d7/d2f/d75/fd0 x:0 0 0 2024-09-12T22:33:16.211 INFO:tasks.workunit.client.0.smithi019.stdout:6/724: write d1b/f6e [2459884,127437] 0 2024-09-12T22:33:16.213 INFO:tasks.workunit.client.0.smithi019.stdout:5/769: write d0/f6 [840612,105071] 0 2024-09-12T22:33:16.214 INFO:tasks.workunit.client.0.smithi019.stdout:8/664: creat d7/d2f/d42/fd1 x:0 0 0 2024-09-12T22:33:16.214 INFO:tasks.workunit.client.0.smithi019.stdout:3/604: dwrite dd/d1e/f34 [0,4194304] 0 2024-09-12T22:33:16.216 INFO:tasks.workunit.client.0.smithi019.stdout:9/640: dwrite dd/d10/d17/d22/d6c/d53/d69/d9d/fa5 [0,4194304] 0 2024-09-12T22:33:16.216 INFO:tasks.workunit.client.0.smithi019.stdout:1/775: dread d3/d3f/d58/fb1 [0,4194304] 0 2024-09-12T22:33:16.217 INFO:tasks.workunit.client.0.smithi019.stdout:7/614: truncate d6/d14/d2a/fad 211194 0 2024-09-12T22:33:16.217 INFO:tasks.workunit.client.0.smithi019.stdout:5/770: symlink d0/d7/d2d/dc2/l10d 0 2024-09-12T22:33:16.217 INFO:tasks.workunit.client.0.smithi019.stdout:2/640: dwrite d0/d5/d18/d3b/f49 [0,4194304] 0 2024-09-12T22:33:16.217 INFO:tasks.workunit.client.0.smithi019.stdout:6/725: mknod d1b/d26/d31/d5f/da8/dc3/cf8 0 2024-09-12T22:33:16.218 INFO:tasks.workunit.client.0.smithi019.stdout:9/641: chown dd/d10/d17/d22/d77 119201571 1 2024-09-12T22:33:16.218 INFO:tasks.workunit.client.0.smithi019.stdout:8/665: mknod d7/d8/d43/d87/cd2 0 2024-09-12T22:33:16.219 INFO:tasks.workunit.client.0.smithi019.stdout:5/771: symlink d0/d7/d16/d18/l10e 0 2024-09-12T22:33:16.219 INFO:tasks.workunit.client.0.smithi019.stdout:2/641: creat d0/d5/d60/d71/fd9 x:0 0 0 2024-09-12T22:33:16.220 INFO:tasks.workunit.client.0.smithi019.stdout:6/726: write d1b/d26/d39/d6a/d97/fa6 [128921,71929] 0 2024-09-12T22:33:16.220 INFO:tasks.workunit.client.0.smithi019.stdout:8/666: unlink d7/d5e/dc8/lca 0 2024-09-12T22:33:16.221 INFO:tasks.workunit.client.0.smithi019.stdout:6/727: fsync d1b/d26/d39/d89/d90/ff0 0 2024-09-12T22:33:16.222 INFO:tasks.workunit.client.0.smithi019.stdout:2/642: creat d0/d5/d18/d1b/d8d/fda x:0 0 0 2024-09-12T22:33:16.223 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:33:16.224 INFO:tasks.workunit.client.0.smithi019.stdout:6/728: symlink d1b/d26/d39/d6a/d61/lf9 0 2024-09-12T22:33:16.224 INFO:tasks.workunit.client.0.smithi019.stdout:3/605: dwrite dd/d12/d62/d74/daa/fb7 [0,4194304] 0 2024-09-12T22:33:16.225 INFO:tasks.workunit.client.0.smithi019.stdout:3/606: creat dd/d12/d62/d74/daa/fb9 x:0 0 0 2024-09-12T22:33:16.225 INFO:tasks.workunit.client.0.smithi019.stdout:2/643: creat d0/d5/d18/d5c/d63/d6a/fdb x:0 0 0 2024-09-12T22:33:16.227 INFO:tasks.workunit.client.0.smithi019.stdout:6/729: link d1b/d26/d39/d6a/d61/fd0 d1b/d26/d31/d5f/d91/de7/ffa 0 2024-09-12T22:33:16.228 INFO:tasks.workunit.client.0.smithi019.stdout:2/644: chown d0/d5/d18/d5c/d67/d77/f7b 16036 1 2024-09-12T22:33:16.228 INFO:tasks.workunit.client.0.smithi019.stdout:3/607: mkdir dd/d1e/d40/da6/dba 0 2024-09-12T22:33:16.229 INFO:tasks.workunit.client.0.smithi019.stdout:9/642: dwrite dd/d10/d17/d22/d6c/d53/d69/fc9 [0,4194304] 0 2024-09-12T22:33:16.229 INFO:tasks.workunit.client.0.smithi019.stdout:2/645: readlink d0/d5/d18/d3b/l3c 0 2024-09-12T22:33:16.230 INFO:tasks.workunit.client.0.smithi019.stdout:2/646: symlink d0/d5/d18/d1b/d8d/dac/ldc 0 2024-09-12T22:33:16.231 INFO:tasks.workunit.client.0.smithi019.stdout:1/776: truncate d3/df/d7e/db7/f3d 730690 0 2024-09-12T22:33:16.231 INFO:tasks.workunit.client.0.smithi019.stdout:6/730: read d1b/f20 [2555446,97395] 0 2024-09-12T22:33:16.231 INFO:tasks.workunit.client.0.smithi019.stdout:2/647: chown d0/d5/d17/d91/ld5 7 1 2024-09-12T22:33:16.232 INFO:tasks.workunit.client.0.smithi019.stdout:6/731: mknod d1b/d26/d31/cfb 0 2024-09-12T22:33:16.232 INFO:tasks.workunit.client.0.smithi019.stdout:9/643: write dd/d10/d17/d23/d2e/d31/d3f/d47/d6e/f89 [6394533,51957] 0 2024-09-12T22:33:16.232 INFO:tasks.workunit.client.0.smithi019.stdout:1/777: readlink d3/df/d7e/db7/l8d 0 2024-09-12T22:33:16.233 INFO:tasks.workunit.client.0.smithi019.stdout:6/732: mknod d1b/d26/cfc 0 2024-09-12T22:33:16.233 INFO:tasks.workunit.client.0.smithi019.stdout:2/648: rename d0/d5/d18/d5c/d63/l88 to d0/ldd 0 2024-09-12T22:33:16.234 INFO:tasks.workunit.client.0.smithi019.stdout:2/649: write d0/d5/d18/d1b/d36/f4a [4699884,426] 0 2024-09-12T22:33:16.235 INFO:tasks.workunit.client.0.smithi019.stdout:9/644: write dd/d10/d17/d22/d6c/d53/d69/d9d/fa5 [3737709,120609] 0 2024-09-12T22:33:16.236 INFO:tasks.workunit.client.0.smithi019.stdout:1/778: dread - d3/df/d7e/db7/d16/d3c/dbd/dc4/f82 zero size 2024-09-12T22:33:16.238 INFO:tasks.workunit.client.0.smithi019.stdout:6/733: dwrite d1b/fe3 [0,4194304] 0 2024-09-12T22:33:16.238 INFO:tasks.workunit.client.0.smithi019.stdout:1/779: rename d3/df/d7e/db7/fb4 to d3/df/d7e/db7/d16/d3c/dce/ff7 0 2024-09-12T22:33:16.238 INFO:tasks.workunit.client.0.smithi019.stdout:0/654: dread d1/d14/f1e [0,4194304] 0 2024-09-12T22:33:16.240 INFO:tasks.workunit.client.0.smithi019.stdout:3/608: dread dd/d12/f2c [0,4194304] 0 2024-09-12T22:33:16.240 INFO:tasks.workunit.client.0.smithi019.stdout:9/645: read dd/d10/d17/d22/d6c/d53/d69/f9c [1284757,100178] 0 2024-09-12T22:33:16.240 INFO:tasks.workunit.client.0.smithi019.stdout:0/655: creat d1/d1f/d5b/d83/dab/dbe/d9c/fcb x:0 0 0 2024-09-12T22:33:16.241 INFO:tasks.workunit.client.0.smithi019.stdout:3/609: read - dd/d12/d62/d6a/f86 zero size 2024-09-12T22:33:16.241 INFO:tasks.workunit.client.0.smithi019.stdout:0/656: dread - d1/d14/d1b/d3a/fa8 zero size 2024-09-12T22:33:16.242 INFO:tasks.workunit.client.0.smithi019.stdout:1/780: truncate d3/df/d7e/db7/d16/d3c/d55/f62 2755398 0 2024-09-12T22:33:16.242 INFO:tasks.workunit.client.0.smithi019.stdout:3/610: chown dd/d1e/d40/d6e 12477 1 2024-09-12T22:33:16.242 INFO:tasks.workunit.client.0.smithi019.stdout:0/657: dread - d1/d14/d26/d40/fba zero size 2024-09-12T22:33:16.242 INFO:tasks.workunit.client.0.smithi019.stdout:9/646: write dd/d10/d17/d23/d2e/d31/d3f/d47/d6e/f89 [8375104,99043] 0 2024-09-12T22:33:16.243 INFO:tasks.workunit.client.0.smithi019.stdout:1/781: chown d3/d3f/d58/lb9 2466129 1 2024-09-12T22:33:16.243 INFO:tasks.workunit.client.0.smithi019.stdout:3/611: dread dd/d12/f2c [0,4194304] 0 2024-09-12T22:33:16.243 INFO:tasks.workunit.client.0.smithi019.stdout:0/658: mkdir d1/d14/dad/dcc 0 2024-09-12T22:33:16.243 INFO:tasks.workunit.client.0.smithi019.stdout:9/647: mknod dd/d10/d17/d23/d2e/d31/d3f/d67/ccf 0 2024-09-12T22:33:16.244 INFO:tasks.workunit.client.0.smithi019.stdout:5/772: dread d0/d7/d16/d18/dae/f103 [0,4194304] 0 2024-09-12T22:33:16.244 INFO:tasks.workunit.client.0.smithi019.stdout:1/782: stat d3/df/d7e/db7/d16/d3c/dbd/dc4/f6d 0 2024-09-12T22:33:16.244 INFO:tasks.workunit.client.0.smithi019.stdout:3/612: write dd/d1e/d40/fb8 [560231,48923] 0 2024-09-12T22:33:16.245 INFO:tasks.workunit.client.0.smithi019.stdout:5/773: rmdir d0/d7/d2d/d32 39 2024-09-12T22:33:16.245 INFO:tasks.workunit.client.0.smithi019.stdout:6/734: dread d1b/d26/d39/d6a/f92 [0,4194304] 0 2024-09-12T22:33:16.245 INFO:tasks.workunit.client.0.smithi019.stdout:1/783: write d3/d3f/d58/f6f [3038307,63555] 0 2024-09-12T22:33:16.245 INFO:tasks.workunit.client.0.smithi019.stdout:9/648: creat dd/d10/d17/d23/d2e/d31/d3f/d47/fd0 x:0 0 0 2024-09-12T22:33:16.246 INFO:tasks.workunit.client.0.smithi019.stdout:6/735: dread - d1b/d26/d31/dd6/fef zero size 2024-09-12T22:33:16.246 INFO:tasks.workunit.client.0.smithi019.stdout:3/613: link dd/d12/d62/fac dd/d1e/d5a/fbb 0 2024-09-12T22:33:16.247 INFO:tasks.workunit.client.0.smithi019.stdout:9/649: write dd/d10/d17/d23/d2e/d31/d54/f75 [284106,23222] 0 2024-09-12T22:33:16.247 INFO:tasks.workunit.client.0.smithi019.stdout:6/736: mknod d1b/cfd 0 2024-09-12T22:33:16.248 INFO:tasks.workunit.client.0.smithi019.stdout:1/784: write d3/df/d7e/db7/d16/d3c/dbd/dc4/f6d [4366772,117906] 0 2024-09-12T22:33:16.248 INFO:tasks.workunit.client.0.smithi019.stdout:5/774: fsync d0/d7/d2d/d32/d36/d8c/db8/d39/d38/dba/dc7/df6/f10c 0 2024-09-12T22:33:16.248 INFO:tasks.workunit.client.0.smithi019.stdout:3/614: write dd/d1e/d40/f6f [5562057,116189] 0 2024-09-12T22:33:16.248 INFO:tasks.workunit.client.0.smithi019.stdout:6/737: fsync d1b/d26/d39/d89/d90/ff0 0 2024-09-12T22:33:16.248 INFO:tasks.workunit.client.0.smithi019.stdout:3/615: readlink dd/d12/d62/d74/daa/l96 0 2024-09-12T22:33:16.249 INFO:tasks.workunit.client.0.smithi019.stdout:6/738: fdatasync d1b/db4/fd2 0 2024-09-12T22:33:16.250 INFO:tasks.workunit.client.0.smithi019.stdout:3/616: creat dd/d12/d62/d6a/fbc x:0 0 0 2024-09-12T22:33:16.250 INFO:tasks.workunit.client.0.smithi019.stdout:9/650: rename dd/d10/d17/d23/d2e/d31/d3f/d67/c8f to dd/d10/d17/d23/d2e/d31/d3f/d47/d6e/daf/cd1 0 2024-09-12T22:33:16.250 INFO:tasks.workunit.client.0.smithi019.stdout:3/617: creat dd/d12/fbd x:0 0 0 2024-09-12T22:33:16.251 INFO:tasks.workunit.client.0.smithi019.stdout:3/618: mkdir dd/d12/dbe 0 2024-09-12T22:33:16.251 INFO:tasks.workunit.client.0.smithi019.stdout:9/651: truncate dd/d10/d17/d23/d37/f5a 67651 0 2024-09-12T22:33:16.252 INFO:tasks.workunit.client.0.smithi019.stdout:3/619: mknod dd/d1e/d40/cbf 0 2024-09-12T22:33:16.252 INFO:tasks.workunit.client.0.smithi019.stdout:9/652: creat dd/d10/d17/d22/fd2 x:0 0 0 2024-09-12T22:33:16.253 INFO:tasks.workunit.client.0.smithi019.stdout:3/620: dread - dd/d12/d62/d78/d98/fb6 zero size 2024-09-12T22:33:16.254 INFO:tasks.workunit.client.0.smithi019.stdout:1/785: dread d3/df/d7e/fc0 [0,4194304] 0 2024-09-12T22:33:16.255 INFO:tasks.workunit.client.0.smithi019.stdout:9/653: rmdir dd/d10/d17/d23/d2e/d31/d3f/d67 39 2024-09-12T22:33:16.255 INFO:tasks.workunit.client.0.smithi019.stdout:1/786: write d3/df/f48 [737244,17938] 0 2024-09-12T22:33:16.255 INFO:tasks.workunit.client.0.smithi019.stdout:3/621: truncate dd/d12/d62/d6a/f86 971063 0 2024-09-12T22:33:16.256 INFO:tasks.workunit.client.0.smithi019.stdout:9/654: truncate dd/d10/d17/d22/fd2 667916 0 2024-09-12T22:33:16.257 INFO:tasks.workunit.client.0.smithi019.stdout:1/787: creat d3/df/d7e/db7/d16/d3c/dbd/de4/ff8 x:0 0 0 2024-09-12T22:33:16.258 INFO:tasks.workunit.client.0.smithi019.stdout:9/655: mknod dd/d10/d17/d22/d6c/d53/d69/d9d/cd3 0 2024-09-12T22:33:16.258 INFO:tasks.workunit.client.0.smithi019.stdout:1/788: mknod d3/df/d7e/db7/d63/d76/cf9 0 2024-09-12T22:33:16.259 INFO:tasks.workunit.client.0.smithi019.stdout:9/656: fsync dd/d10/d17/d23/d2e/d31/d3f/d47/fd0 0 2024-09-12T22:33:16.259 INFO:tasks.workunit.client.0.smithi019.stdout:3/622: dread dd/d1e/d82/f89 [0,4194304] 0 2024-09-12T22:33:16.260 INFO:tasks.workunit.client.0.smithi019.stdout:1/789: creat d3/df/d7e/db7/d16/d3c/dbd/dc4/ffa x:0 0 0 2024-09-12T22:33:16.260 INFO:tasks.workunit.client.0.smithi019.stdout:1/790: write d3/f69 [1875754,8593] 0 2024-09-12T22:33:16.261 INFO:tasks.workunit.client.0.smithi019.stdout:3/623: symlink dd/d1e/d40/lc0 0 2024-09-12T22:33:16.261 INFO:tasks.workunit.client.0.smithi019.stdout:1/791: readlink d3/df/d7e/db7/d16/l20 0 2024-09-12T22:33:16.262 INFO:tasks.workunit.client.0.smithi019.stdout:9/657: creat dd/d10/d17/d23/d2e/d31/d3f/d67/fd4 x:0 0 0 2024-09-12T22:33:16.262 INFO:tasks.workunit.client.0.smithi019.stdout:9/658: symlink dd/d10/d17/d23/ld5 0 2024-09-12T22:33:16.264 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:16.263+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:16.265 INFO:tasks.workunit.client.0.smithi019.stdout:9/659: readlink dd/d10/d17/d23/d2e/l99 0 2024-09-12T22:33:16.265 INFO:tasks.workunit.client.0.smithi019.stdout:4/688: sync 2024-09-12T22:33:16.266 INFO:tasks.workunit.client.0.smithi019.stdout:2/650: dread d0/d5/d18/d39/f94 [0,4194304] 0 2024-09-12T22:33:16.266 INFO:tasks.workunit.client.0.smithi019.stdout:9/660: chown dd/dcb 0 1 2024-09-12T22:33:16.266 INFO:tasks.workunit.client.0.smithi019.stdout:3/624: dwrite f5 [0,4194304] 0 2024-09-12T22:33:16.267 INFO:tasks.workunit.client.0.smithi019.stdout:4/689: mknod d1/d11/d15/d1f/d56/ceb 0 2024-09-12T22:33:16.267 INFO:tasks.workunit.client.0.smithi019.stdout:9/661: fdatasync dd/d10/d17/d23/d2e/d31/d3f/f4b 0 2024-09-12T22:33:16.268 INFO:tasks.workunit.client.0.smithi019.stdout:3/625: truncate dd/d12/f2c 1037355 0 2024-09-12T22:33:16.269 INFO:tasks.workunit.client.0.smithi019.stdout:9/662: fsync dd/f20 0 2024-09-12T22:33:16.269 INFO:tasks.workunit.client.0.smithi019.stdout:4/690: stat d1/d4c/db0/d75/d5a 0 2024-09-12T22:33:16.269 INFO:tasks.workunit.client.0.smithi019.stdout:1/792: dwrite d3/df/d7e/db7/d16/d3c/d55/f62 [0,4194304] 0 2024-09-12T22:33:16.271 INFO:tasks.workunit.client.0.smithi019.stdout:4/691: unlink d1/d4/d38/f3b 0 2024-09-12T22:33:16.272 INFO:tasks.workunit.client.0.smithi019.stdout:9/663: rename dd/d10/d17/l30 to dd/d10/d17/d22/d6c/d53/d69/d9d/ld6 0 2024-09-12T22:33:16.272 INFO:tasks.workunit.client.0.smithi019.stdout:4/692: mkdir d1/d4/dec 0 2024-09-12T22:33:16.273 INFO:tasks.workunit.client.0.smithi019.stdout:2/651: dwrite d0/d5/d60/f9d [0,4194304] 0 2024-09-12T22:33:16.274 INFO:tasks.workunit.client.0.smithi019.stdout:4/693: chown d1/d4/d38/dbf/ld7 40 1 2024-09-12T22:33:16.274 INFO:tasks.workunit.client.0.smithi019.stdout:9/664: creat dd/d10/d17/d76/dcc/fd7 x:0 0 0 2024-09-12T22:33:16.275 INFO:tasks.workunit.client.0.smithi019.stdout:2/652: dread - d0/d5/d60/d74/f9e zero size 2024-09-12T22:33:16.275 INFO:tasks.workunit.client.0.smithi019.stdout:4/694: dread - d1/d11/d15/d1f/d56/dac/fcb zero size 2024-09-12T22:33:16.276 INFO:tasks.workunit.client.0.smithi019.stdout:5/775: dread d0/d7/d2d/d32/d36/d8c/db8/d39/d38/f55 [0,4194304] 0 2024-09-12T22:33:16.276 INFO:tasks.workunit.client.0.smithi019.stdout:4/695: fsync d1/d4/f88 0 2024-09-12T22:33:16.276 INFO:tasks.workunit.client.0.smithi019.stdout:2/653: dread - d0/d5/d18/d5c/d63/d6a/fdb zero size 2024-09-12T22:33:16.278 INFO:tasks.workunit.client.0.smithi019.stdout:2/654: dread - d0/d5/d18/d5c/d67/f93 zero size 2024-09-12T22:33:16.278 INFO:tasks.workunit.client.0.smithi019.stdout:4/696: rename d1/l28 to d1/d8/d7b/led 0 2024-09-12T22:33:16.278 INFO:tasks.workunit.client.0.smithi019.stdout:2/655: chown d0/d5/d18/d39/f94 2 1 2024-09-12T22:33:16.279 INFO:tasks.workunit.client.0.smithi019.stdout:0/659: dread d1/f4d [0,4194304] 0 2024-09-12T22:33:16.279 INFO:tasks.workunit.client.0.smithi019.stdout:4/697: write d1/d22/d57/f6e [3899374,13329] 0 2024-09-12T22:33:16.280 INFO:tasks.workunit.client.0.smithi019.stdout:0/660: chown d1/d14/d26/d40 2 1 2024-09-12T22:33:16.281 INFO:tasks.workunit.client.0.smithi019.stdout:9/665: dwrite dd/d10/d17/d23/d2e/d31/d3f/d47/d6e/d80/f8d [4194304,4194304] 0 2024-09-12T22:33:16.281 INFO:tasks.workunit.client.0.smithi019.stdout:2/656: creat d0/d5/d60/d74/d7e/db5/fde x:0 0 0 2024-09-12T22:33:16.282 INFO:tasks.workunit.client.0.smithi019.stdout:4/698: chown d1/d22/d57/la3 7551340 1 2024-09-12T22:33:16.282 INFO:tasks.workunit.client.0.smithi019.stdout:0/661: fsync d1/d1f/d5b/d83/dab/dbe/d89/fc5 0 2024-09-12T22:33:16.282 INFO:tasks.workunit.client.0.smithi019.stdout:2/657: chown d0/d5/d18/d5c/d85/d95/c6c 472781609 1 2024-09-12T22:33:16.282 INFO:tasks.workunit.client.0.smithi019.stdout:0/662: mknod d1/d1f/d5b/dbf/ccd 0 2024-09-12T22:33:16.285 INFO:tasks.workunit.client.0.smithi019.stdout:0/663: creat d1/d1f/d5b/d83/dab/dbe/dc6/fce x:0 0 0 2024-09-12T22:33:16.285 INFO:tasks.workunit.client.0.smithi019.stdout:6/739: dread d1b/db4/fd3 [0,4194304] 0 2024-09-12T22:33:16.285 INFO:tasks.workunit.client.0.smithi019.stdout:0/664: chown d1/d1f/f77 0 1 2024-09-12T22:33:16.286 INFO:tasks.workunit.client.0.smithi019.stdout:4/699: dread d1/d11/d15/d81/f92 [0,4194304] 0 2024-09-12T22:33:16.286 INFO:tasks.workunit.client.0.smithi019.stdout:0/665: mknod d1/d14/d1b/d94/ccf 0 2024-09-12T22:33:16.287 INFO:tasks.workunit.client.0.smithi019.stdout:4/700: read d1/d4/f6f [156466,112207] 0 2024-09-12T22:33:16.288 INFO:tasks.workunit.client.0.smithi019.stdout:2/658: dwrite d0/d5/d17/d91/d9c/fb0 [0,4194304] 0 2024-09-12T22:33:16.288 INFO:tasks.workunit.client.0.smithi019.stdout:0/666: truncate d1/d14/d26/d40/f52 2104032 0 2024-09-12T22:33:16.290 INFO:tasks.workunit.client.0.smithi019.stdout:0/667: getdents d1/d14/d26 0 2024-09-12T22:33:16.291 INFO:tasks.workunit.client.0.smithi019.stdout:4/701: link d1/d11/d15/d1f/d56/da9/dce/cd3 d1/d4c/db0/d75/d5a/d79/db4/cee 0 2024-09-12T22:33:16.291 INFO:tasks.workunit.client.0.smithi019.stdout:0/668: chown d1/d1f/d5b/d83/dab/dbe/d89/fc5 0 1 2024-09-12T22:33:16.293 INFO:tasks.workunit.client.0.smithi019.stdout:0/669: dread - d1/d14/d26/d40/fba zero size 2024-09-12T22:33:16.295 INFO:tasks.workunit.client.0.smithi019.stdout:2/659: dwrite d0/d5/d60/d71/fd9 [0,4194304] 0 2024-09-12T22:33:16.297 INFO:tasks.workunit.client.0.smithi019.stdout:0/670: fdatasync d1/d14/d26/d40/d45/d5e/f98 0 2024-09-12T22:33:16.297 INFO:tasks.workunit.client.0.smithi019.stdout:6/740: dwrite d1b/d26/d39/d6a/f92 [0,4194304] 0 2024-09-12T22:33:16.297 INFO:tasks.workunit.client.0.smithi019.stdout:2/660: chown d0/d5/d18/d5c/d67/d77 31 1 2024-09-12T22:33:16.297 INFO:tasks.workunit.client.0.smithi019.stdout:9/666: dread dd/d10/d17/d23/d2e/d31/d7e/dbc/f71 [0,4194304] 0 2024-09-12T22:33:16.299 INFO:tasks.workunit.client.0.smithi019.stdout:4/702: dwrite d1/d4c/fb6 [0,4194304] 0 2024-09-12T22:33:16.299 INFO:tasks.workunit.client.0.smithi019.stdout:0/671: creat d1/d14/d26/d40/d45/d5e/da2/fd0 x:0 0 0 2024-09-12T22:33:16.299 INFO:tasks.workunit.client.0.smithi019.stdout:9/667: symlink dd/d10/d17/d22/d6c/d53/d69/d9d/ld8 0 2024-09-12T22:33:16.301 INFO:tasks.workunit.client.0.smithi019.stdout:4/703: rename d1/d11/d15/d1f/d56/fbc to d1/d11/d15/d1f/d56/da9/dce/fef 0 2024-09-12T22:33:16.301 INFO:tasks.workunit.client.0.smithi019.stdout:9/668: mknod dd/d10/d17/d22/d6c/d53/d69/cd9 0 2024-09-12T22:33:16.302 INFO:tasks.workunit.client.0.smithi019.stdout:0/672: write d1/f4d [2381793,66588] 0 2024-09-12T22:33:16.303 INFO:tasks.workunit.client.0.smithi019.stdout:4/704: creat d1/d22/d31/d4f/ff0 x:0 0 0 2024-09-12T22:33:16.303 INFO:tasks.workunit.client.0.smithi019.stdout:0/673: creat d1/d14/d26/fd1 x:0 0 0 2024-09-12T22:33:16.304 INFO:tasks.workunit.client.0.smithi019.stdout:6/741: dwrite d1b/d26/d27/d3e/d83/d98/fb8 [0,4194304] 0 2024-09-12T22:33:16.305 INFO:tasks.workunit.client.0.smithi019.stdout:4/705: unlink d1/d22/d57/lb5 0 2024-09-12T22:33:16.305 INFO:tasks.workunit.client.0.smithi019.stdout:6/742: mknod d1b/d26/d27/d3e/d83/cfe 0 2024-09-12T22:33:16.306 INFO:tasks.workunit.client.0.smithi019.stdout:6/743: fsync d1b/f45 0 2024-09-12T22:33:16.306 INFO:tasks.workunit.client.0.smithi019.stdout:8/667: sync 2024-09-12T22:33:16.307 INFO:tasks.workunit.client.0.smithi019.stdout:7/615: sync 2024-09-12T22:33:16.307 INFO:tasks.workunit.client.0.smithi019.stdout:8/668: chown d7/d34/f52 29196 1 2024-09-12T22:33:16.307 INFO:tasks.workunit.client.0.smithi019.stdout:7/616: creat d6/d2d/fe6 x:0 0 0 2024-09-12T22:33:16.308 INFO:tasks.workunit.client.0.smithi019.stdout:8/669: creat d7/d2f/fd3 x:0 0 0 2024-09-12T22:33:16.308 INFO:tasks.workunit.client.0.smithi019.stdout:0/674: truncate d1/d14/d1b/f2b 174530 0 2024-09-12T22:33:16.309 INFO:tasks.workunit.client.0.smithi019.stdout:4/706: read d1/d4c/db0/d75/d5a/d79/f8a [2051613,16336] 0 2024-09-12T22:33:16.310 INFO:tasks.workunit.client.0.smithi019.stdout:7/617: creat d6/d2d/de0/fe7 x:0 0 0 2024-09-12T22:33:16.310 INFO:tasks.workunit.client.0.smithi019.stdout:9/669: dwrite dd/d10/d17/d22/d42/fc4 [0,4194304] 0 2024-09-12T22:33:16.310 INFO:tasks.workunit.client.0.smithi019.stdout:3/626: dread dd/d1e/d40/f4a [0,4194304] 0 2024-09-12T22:33:16.311 INFO:tasks.workunit.client.0.smithi019.stdout:8/670: symlink d7/d34/d78/ld4 0 2024-09-12T22:33:16.311 INFO:tasks.workunit.client.0.smithi019.stdout:0/675: write d1/fd [1321031,22843] 0 2024-09-12T22:33:16.312 INFO:tasks.workunit.client.0.smithi019.stdout:9/670: fsync dd/d10/d17/d22/d6c/d53/d73/fce 0 2024-09-12T22:33:16.312 INFO:tasks.workunit.client.0.smithi019.stdout:4/707: write d1/d4/d38/d77/fe4 [291608,119727] 0 2024-09-12T22:33:16.312 INFO:tasks.workunit.client.0.smithi019.stdout:8/671: fsync d7/d8/d43/d87/fb6 0 2024-09-12T22:33:16.313 INFO:tasks.workunit.client.0.smithi019.stdout:3/627: creat dd/d12/fc1 x:0 0 0 2024-09-12T22:33:16.314 INFO:tasks.workunit.client.0.smithi019.stdout:6/744: dwrite d1b/f6e [4194304,4194304] 0 2024-09-12T22:33:16.314 INFO:tasks.workunit.client.0.smithi019.stdout:0/676: mknod d1/d1f/d5b/d83/dab/cd2 0 2024-09-12T22:33:16.314 INFO:tasks.workunit.client.0.smithi019.stdout:4/708: unlink d1/d22/d31/de3/ce8 0 2024-09-12T22:33:16.314 INFO:tasks.workunit.client.0.smithi019.stdout:3/628: mknod dd/d12/d62/cc2 0 2024-09-12T22:33:16.314 INFO:tasks.workunit.client.0.smithi019.stdout:8/672: mknod d7/d34/d78/d53/cd5 0 2024-09-12T22:33:16.314 INFO:tasks.workunit.client.0.smithi019.stdout:9/671: chown dd/d10/d17/d23/d2e/f93 160721117 1 2024-09-12T22:33:16.315 INFO:tasks.workunit.client.0.smithi019.stdout:6/745: fsync d1b/d26/d31/dd6/fef 0 2024-09-12T22:33:16.315 INFO:tasks.workunit.client.0.smithi019.stdout:0/677: mknod d1/d14/dad/dcc/cd3 0 2024-09-12T22:33:16.315 INFO:tasks.workunit.client.0.smithi019.stdout:4/709: dread - d1/d11/d15/d1f/fdb zero size 2024-09-12T22:33:16.315 INFO:tasks.workunit.client.0.smithi019.stdout:6/746: creat d1b/fff x:0 0 0 2024-09-12T22:33:16.316 INFO:tasks.workunit.client.0.smithi019.stdout:4/710: creat d1/d22/d26/da1/ff1 x:0 0 0 2024-09-12T22:33:16.316 INFO:tasks.workunit.client.0.smithi019.stdout:0/678: creat d1/d14/d26/d40/d91/fd4 x:0 0 0 2024-09-12T22:33:16.317 INFO:tasks.workunit.client.0.smithi019.stdout:6/747: creat d1b/db4/f100 x:0 0 0 2024-09-12T22:33:16.317 INFO:tasks.workunit.client.0.smithi019.stdout:9/672: mknod dd/d10/d17/d22/d77/cda 0 2024-09-12T22:33:16.318 INFO:tasks.workunit.client.0.smithi019.stdout:4/711: mkdir d1/d22/d57/df2 0 2024-09-12T22:33:16.318 INFO:tasks.workunit.client.0.smithi019.stdout:0/679: chown d1/d1f/d5b/d83 60631439 1 2024-09-12T22:33:16.318 INFO:tasks.workunit.client.0.smithi019.stdout:9/673: mkdir dd/d10/d17/d23/ddb 0 2024-09-12T22:33:16.319 INFO:tasks.workunit.client.0.smithi019.stdout:0/680: write d1/fd [4235140,127073] 0 2024-09-12T22:33:16.320 INFO:tasks.workunit.client.0.smithi019.stdout:4/712: rename d1/d4/f6f to d1/d11/d15/d1f/ff3 0 2024-09-12T22:33:16.320 INFO:tasks.workunit.client.0.smithi019.stdout:3/629: dwrite dd/d1e/d5a/f6b [4194304,4194304] 0 2024-09-12T22:33:16.322 INFO:tasks.workunit.client.0.smithi019.stdout:0/681: creat d1/d14/d26/d40/d45/fd5 x:0 0 0 2024-09-12T22:33:16.322 INFO:tasks.workunit.client.0.smithi019.stdout:4/713: symlink d1/d4/da6/lf4 0 2024-09-12T22:33:16.323 INFO:tasks.workunit.client.0.smithi019.stdout:4/714: creat d1/d22/d31/de3/ff5 x:0 0 0 2024-09-12T22:33:16.323 INFO:tasks.workunit.client.0.smithi019.stdout:0/682: getdents d1/d14/dad/dc0 0 2024-09-12T22:33:16.324 INFO:tasks.workunit.client.0.smithi019.stdout:4/715: rmdir d1/d4/d38 39 2024-09-12T22:33:16.324 INFO:tasks.workunit.client.0.smithi019.stdout:6/748: dwrite d1b/d26/d31/f9b [0,4194304] 0 2024-09-12T22:33:16.324 INFO:tasks.workunit.client.0.smithi019.stdout:0/683: creat d1/d1f/d5b/d83/dab/dbe/d89/fd6 x:0 0 0 2024-09-12T22:33:16.325 INFO:tasks.workunit.client.0.smithi019.stdout:4/716: write d1/d22/f33 [338255,3082] 0 2024-09-12T22:33:16.325 INFO:tasks.workunit.client.0.smithi019.stdout:6/749: symlink d1b/d26/d31/d5f/da8/dc3/l101 0 2024-09-12T22:33:16.326 INFO:tasks.workunit.client.0.smithi019.stdout:0/684: creat d1/d14/dad/dc0/fd7 x:0 0 0 2024-09-12T22:33:16.326 INFO:tasks.workunit.client.0.smithi019.stdout:4/717: symlink d1/d11/d15/lf6 0 2024-09-12T22:33:16.326 INFO:tasks.workunit.client.0.smithi019.stdout:0/685: chown d1/d14/d26/c47 18864433 1 2024-09-12T22:33:16.327 INFO:tasks.workunit.client.0.smithi019.stdout:4/718: link d1/d11/d15/d1f/l55 d1/d8/dd0/lf7 0 2024-09-12T22:33:16.328 INFO:tasks.workunit.client.0.smithi019.stdout:0/686: dread - d1/d14/d26/d40/d45/d5e/d84/fb6 zero size 2024-09-12T22:33:16.328 INFO:tasks.workunit.client.0.smithi019.stdout:4/719: chown d1/d8/f45 1399231115 1 2024-09-12T22:33:16.328 INFO:tasks.workunit.client.0.smithi019.stdout:0/687: creat d1/d51/fd8 x:0 0 0 2024-09-12T22:33:16.329 INFO:tasks.workunit.client.0.smithi019.stdout:4/720: creat d1/d11/d15/d49/ff8 x:0 0 0 2024-09-12T22:33:16.329 INFO:tasks.workunit.client.0.smithi019.stdout:0/688: fsync d1/d1f/d5b/d83/dab/dbe/d3d/f53 0 2024-09-12T22:33:16.330 INFO:tasks.workunit.client.0.smithi019.stdout:4/721: creat d1/d22/d57/df2/ff9 x:0 0 0 2024-09-12T22:33:16.330 INFO:tasks.workunit.client.0.smithi019.stdout:0/689: dread - d1/d1f/d5b/d83/dab/dbe/d89/fd6 zero size 2024-09-12T22:33:16.331 INFO:tasks.workunit.client.0.smithi019.stdout:5/776: sync 2024-09-12T22:33:16.331 INFO:tasks.workunit.client.0.smithi019.stdout:1/793: sync 2024-09-12T22:33:16.331 INFO:tasks.workunit.client.0.smithi019.stdout:2/661: sync 2024-09-12T22:33:16.331 INFO:tasks.workunit.client.0.smithi019.stdout:8/673: sync 2024-09-12T22:33:16.331 INFO:tasks.workunit.client.0.smithi019.stdout:0/690: write d1/d14/d26/fd1 [307832,75651] 0 2024-09-12T22:33:16.332 INFO:tasks.workunit.client.0.smithi019.stdout:5/777: creat d0/d7/d16/d18/dc3/f10f x:0 0 0 2024-09-12T22:33:16.332 INFO:tasks.workunit.client.0.smithi019.stdout:2/662: symlink d0/d5/d18/d5c/d67/ldf 0 2024-09-12T22:33:16.332 INFO:tasks.workunit.client.0.smithi019.stdout:0/691: mkdir d1/d1f/d5b/d83/dd9 0 2024-09-12T22:33:16.333 INFO:tasks.workunit.client.0.smithi019.stdout:2/663: rmdir d0 39 2024-09-12T22:33:16.334 INFO:tasks.workunit.client.0.smithi019.stdout:0/692: write d1/d14/d1b/d3a/d8c/f90 [288410,108684] 0 2024-09-12T22:33:16.334 INFO:tasks.workunit.client.0.smithi019.stdout:5/778: creat d0/d7/d2d/d4c/d87/da2/f110 x:0 0 0 2024-09-12T22:33:16.334 INFO:tasks.workunit.client.0.smithi019.stdout:2/664: symlink d0/d5/le0 0 2024-09-12T22:33:16.335 INFO:tasks.workunit.client.0.smithi019.stdout:5/779: mknod d0/d7/d16/d18/dae/c111 0 2024-09-12T22:33:16.336 INFO:tasks.workunit.client.0.smithi019.stdout:2/665: mknod d0/d5/d18/d5c/d63/ce1 0 2024-09-12T22:33:16.336 INFO:tasks.workunit.client.0.smithi019.stdout:0/693: link d1/d14/d1b/f4b d1/fda 0 2024-09-12T22:33:16.336 INFO:tasks.workunit.client.0.smithi019.stdout:9/674: truncate dd/d10/d17/d22/d6c/d53/f5c 672257 0 2024-09-12T22:33:16.336 INFO:tasks.workunit.client.0.smithi019.stdout:2/666: stat d0/da/f29 0 2024-09-12T22:33:16.336 INFO:tasks.workunit.client.0.smithi019.stdout:0/694: readlink d1/d1f/d5b/d83/dab/dbe/d71/d85/l86 0 2024-09-12T22:33:16.337 INFO:tasks.workunit.client.0.smithi019.stdout:9/675: truncate dd/d10/d17/d22/d6c/d53/d73/fce 525754 0 2024-09-12T22:33:16.337 INFO:tasks.workunit.client.0.smithi019.stdout:0/695: write d1/d14/d1b/d3a/d8c/f90 [1381122,27543] 0 2024-09-12T22:33:16.338 INFO:tasks.workunit.client.0.smithi019.stdout:4/722: fsync d1/d22/d57/df2/ff9 0 2024-09-12T22:33:16.338 INFO:tasks.workunit.client.0.smithi019.stdout:0/696: chown d1/d1f/l42 0 1 2024-09-12T22:33:16.339 INFO:tasks.workunit.client.0.smithi019.stdout:9/676: rmdir dd/d10/d17/d23/d2e/d31/d3f/d47/d6e 39 2024-09-12T22:33:16.339 INFO:tasks.workunit.client.0.smithi019.stdout:4/723: write d1/d4/d38/f94 [254048,105077] 0 2024-09-12T22:33:16.340 INFO:tasks.workunit.client.0.smithi019.stdout:0/697: rmdir d1/d1f/d5b/d83/dab/dbe/dc6 39 2024-09-12T22:33:16.340 INFO:tasks.workunit.client.0.smithi019.stdout:4/724: chown d1/d22/d57/df2 105788 1 2024-09-12T22:33:16.341 INFO:tasks.workunit.client.0.smithi019.stdout:2/667: dwrite d0/d5/d18/d3b/f49 [0,4194304] 0 2024-09-12T22:33:16.341 INFO:tasks.workunit.client.0.smithi019.stdout:0/698: chown d1/d1d/c97 66 1 2024-09-12T22:33:16.342 INFO:tasks.workunit.client.0.smithi019.stdout:4/725: write d1/d22/d31/de3/ff5 [147789,105632] 0 2024-09-12T22:33:16.342 INFO:tasks.workunit.client.0.smithi019.stdout:9/677: dread dd/d10/d17/d22/d6c/d53/d73/fce [0,4194304] 0 2024-09-12T22:33:16.342 INFO:tasks.workunit.client.0.smithi019.stdout:0/699: stat d1/d1f/d5b/d83/dab/dbe/d71 0 2024-09-12T22:33:16.344 INFO:tasks.workunit.client.0.smithi019.stdout:4/726: creat d1/d4c/db0/d75/ffa x:0 0 0 2024-09-12T22:33:16.344 INFO:tasks.workunit.client.0.smithi019.stdout:9/678: creat dd/d10/d17/d76/dcc/fdc x:0 0 0 2024-09-12T22:33:16.344 INFO:tasks.workunit.client.0.smithi019.stdout:0/700: symlink d1/d14/d26/d40/d45/d5e/d84/ldb 0 2024-09-12T22:33:16.344 INFO:tasks.workunit.client.0.smithi019.stdout:4/727: mkdir d1/d8/dfb 0 2024-09-12T22:33:16.345 INFO:tasks.workunit.client.0.smithi019.stdout:9/679: unlink dd/d10/d17/d22/d6c/d53/d69/d9d/ld6 0 2024-09-12T22:33:16.346 INFO:tasks.workunit.client.0.smithi019.stdout:4/728: truncate d1/d22/d26/da1/ff1 1034617 0 2024-09-12T22:33:16.346 INFO:tasks.workunit.client.0.smithi019.stdout:0/701: rename d1/d14/d26/d40/d45/c8d to d1/d1f/d5b/d83/dab/dbe/d71/d85/cdc 0 2024-09-12T22:33:16.347 INFO:tasks.workunit.client.0.smithi019.stdout:9/680: rmdir dd/d10/d17/d22/d6c 39 2024-09-12T22:33:16.347 INFO:tasks.workunit.client.0.smithi019.stdout:7/618: dread d6/d14/d2a/da4/f3b [4194304,4194304] 0 2024-09-12T22:33:16.348 INFO:tasks.workunit.client.0.smithi019.stdout:2/668: dwrite d0/d5/d18/d1b/d36/f4c [0,4194304] 0 2024-09-12T22:33:16.349 INFO:tasks.workunit.client.0.smithi019.stdout:8/674: dread d7/f6f [0,4194304] 0 2024-09-12T22:33:16.350 INFO:tasks.workunit.client.0.smithi019.stdout:5/780: sync 2024-09-12T22:33:16.350 INFO:tasks.workunit.client.0.smithi019.stdout:2/669: sync 2024-09-12T22:33:16.350 INFO:tasks.workunit.client.0.smithi019.stdout:7/619: symlink d6/d14/d2a/da4/d34/le8 0 2024-09-12T22:33:16.350 INFO:tasks.workunit.client.0.smithi019.stdout:8/675: dread - d7/d2f/d42/fd1 zero size 2024-09-12T22:33:16.352 INFO:tasks.workunit.client.0.smithi019.stdout:9/681: truncate dd/d10/d17/d22/d6c/d53/d69/fad 1550462 0 2024-09-12T22:33:16.352 INFO:tasks.workunit.client.0.smithi019.stdout:6/750: dread d1b/d26/d27/d3e/d83/d98/fd1 [0,4194304] 0 2024-09-12T22:33:16.354 INFO:tasks.workunit.client.0.smithi019.stdout:7/620: symlink d6/d2d/d41/le9 0 2024-09-12T22:33:16.355 INFO:tasks.workunit.client.0.smithi019.stdout:2/670: creat d0/d5/dd6/fe2 x:0 0 0 2024-09-12T22:33:16.355 INFO:tasks.workunit.client.0.smithi019.stdout:6/751: mkdir d1b/d102 0 2024-09-12T22:33:16.355 INFO:tasks.workunit.client.0.smithi019.stdout:6/752: sync 2024-09-12T22:33:16.355 INFO:tasks.workunit.client.0.smithi019.stdout:0/702: dwrite d1/d14/d1b/d94/fca [0,4194304] 0 2024-09-12T22:33:16.356 INFO:tasks.workunit.client.0.smithi019.stdout:4/729: dwrite d1/d4/d38/d77/fcd [0,4194304] 0 2024-09-12T22:33:16.357 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:16.356+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:16.358 INFO:tasks.workunit.client.0.smithi019.stdout:2/671: write d0/d5/d17/f14 [3848838,103474] 0 2024-09-12T22:33:16.358 INFO:tasks.workunit.client.0.smithi019.stdout:0/703: fdatasync d1/f2c 0 2024-09-12T22:33:16.358 INFO:tasks.workunit.client.0.smithi019.stdout:7/621: fsync d6/d14/d15/d62/d6a/fc2 0 2024-09-12T22:33:16.360 INFO:tasks.workunit.client.0.smithi019.stdout:3/630: dread dd/f13 [0,4194304] 0 2024-09-12T22:33:16.360 INFO:tasks.workunit.client.0.smithi019.stdout:9/682: truncate dd/d10/d17/d23/d2e/d31/f6d 133501 0 2024-09-12T22:33:16.360 INFO:tasks.workunit.client.0.smithi019.stdout:6/753: read d1b/d26/d31/d5f/fad [388064,101161] 0 2024-09-12T22:33:16.360 INFO:tasks.workunit.client.0.smithi019.stdout:8/676: truncate d7/d8/fab 1575477 0 2024-09-12T22:33:16.362 INFO:tasks.workunit.client.0.smithi019.stdout:4/730: read - d1/d4c/db0/d75/d5a/d79/f7d zero size 2024-09-12T22:33:16.362 INFO:tasks.workunit.client.0.smithi019.stdout:2/672: dread - d0/d5/d18/d1b/d5d/d86/d90/fb7 zero size 2024-09-12T22:33:16.362 INFO:tasks.workunit.client.0.smithi019.stdout:7/622: creat d6/d2d/de0/fea x:0 0 0 2024-09-12T22:33:16.364 INFO:tasks.workunit.client.0.smithi019.stdout:5/781: dwrite d0/d7/d16/d18/dae/f103 [0,4194304] 0 2024-09-12T22:33:16.364 INFO:tasks.workunit.client.0.smithi019.stdout:3/631: rename dd/d12/c51 to dd/d12/d62/d74/cc3 0 2024-09-12T22:33:16.364 INFO:tasks.workunit.client.0.smithi019.stdout:0/704: mknod d1/d1f/d5b/d83/dab/dbe/d71/d85/cdd 0 2024-09-12T22:33:16.365 INFO:tasks.workunit.client.0.smithi019.stdout:8/677: truncate d7/d8/d43/d87/fb6 923247 0 2024-09-12T22:33:16.367 INFO:tasks.workunit.client.0.smithi019.stdout:9/683: unlink dd/d10/d17/d23/d2e/d31/d3f/d67/l7a 0 2024-09-12T22:33:16.367 INFO:tasks.workunit.client.0.smithi019.stdout:7/623: creat d6/d14/d2a/da4/d42/feb x:0 0 0 2024-09-12T22:33:16.367 INFO:tasks.workunit.client.0.smithi019.stdout:5/782: read - d0/d7/d2d/d4c/d87/da2/f110 zero size 2024-09-12T22:33:16.367 INFO:tasks.workunit.client.0.smithi019.stdout:4/731: mkdir d1/d8/dfb/dfc 0 2024-09-12T22:33:16.367 INFO:tasks.workunit.client.0.smithi019.stdout:9/684: stat dd/d10/d17/d23/lb7 0 2024-09-12T22:33:16.368 INFO:tasks.workunit.client.0.smithi019.stdout:2/673: creat d0/fe3 x:0 0 0 2024-09-12T22:33:16.369 INFO:tasks.workunit.client.0.smithi019.stdout:3/632: write dd/d1e/d40/d5f/f66 [1754255,15225] 0 2024-09-12T22:33:16.369 INFO:tasks.workunit.client.0.smithi019.stdout:0/705: dread - d1/d1f/d5b/d83/dab/dbe/dc6/fce zero size 2024-09-12T22:33:16.370 INFO:tasks.workunit.client.0.smithi019.stdout:4/732: dread - d1/d22/d57/df2/ff9 zero size 2024-09-12T22:33:16.370 INFO:tasks.workunit.client.0.smithi019.stdout:7/624: rmdir d6/d14/d2a/da4/dc/d63 39 2024-09-12T22:33:16.370 INFO:tasks.workunit.client.0.smithi019.stdout:4/733: stat d1/d22/d31 0 2024-09-12T22:33:16.370 INFO:tasks.workunit.client.0.smithi019.stdout:3/633: creat dd/d1e/d40/d6e/fc4 x:0 0 0 2024-09-12T22:33:16.371 INFO:tasks.workunit.client.0.smithi019.stdout:6/754: dwrite d1b/d26/fda [0,4194304] 0 2024-09-12T22:33:16.372 INFO:tasks.workunit.client.0.smithi019.stdout:7/625: chown d6/d2d/d41/l8c 1208 1 2024-09-12T22:33:16.372 INFO:tasks.workunit.client.0.smithi019.stdout:2/674: link d0/d5/d18/d5c/d85/fc2 d0/d5/fe4 0 2024-09-12T22:33:16.372 INFO:tasks.workunit.client.0.smithi019.stdout:0/706: symlink d1/d1f/d5b/d83/dab/dbe/lde 0 2024-09-12T22:33:16.372 INFO:tasks.workunit.client.0.smithi019.stdout:3/634: rmdir dd/d12/d62/d78 39 2024-09-12T22:33:16.374 INFO:tasks.workunit.client.0.smithi019.stdout:1/794: dread d3/df/d7e/db7/d16/d3c/dbd/de6/f68 [0,4194304] 0 2024-09-12T22:33:16.374 INFO:tasks.workunit.client.0.smithi019.stdout:7/626: rmdir d6/d2d/de0 39 2024-09-12T22:33:16.374 INFO:tasks.workunit.client.0.smithi019.stdout:3/635: unlink dd/d1e/d40/d5f/c75 0 2024-09-12T22:33:16.374 INFO:tasks.workunit.client.0.smithi019.stdout:6/755: creat d1b/d26/d27/d67/f103 x:0 0 0 2024-09-12T22:33:16.374 INFO:tasks.workunit.client.0.smithi019.stdout:4/734: rename d1/d11/d15/d81/lba to d1/d4/d38/dbf/lfd 0 2024-09-12T22:33:16.375 INFO:tasks.workunit.client.0.smithi019.stdout:3/636: sync 2024-09-12T22:33:16.375 INFO:tasks.workunit.client.0.smithi019.stdout:7/627: creat d6/d2d/d77/fec x:0 0 0 2024-09-12T22:33:16.376 INFO:tasks.workunit.client.0.smithi019.stdout:3/637: dread - dd/d1e/d40/d6e/fc4 zero size 2024-09-12T22:33:16.377 INFO:tasks.workunit.client.0.smithi019.stdout:0/707: getdents d1/d1d 0 2024-09-12T22:33:16.377 INFO:tasks.workunit.client.0.smithi019.stdout:5/783: dwrite d0/d7/d2d/fd3 [0,4194304] 0 2024-09-12T22:33:16.377 INFO:tasks.workunit.client.0.smithi019.stdout:1/795: rename d3/l18 to d3/df/d7e/db7/d16/d3c/dbd/de6/lfb 0 2024-09-12T22:33:16.377 INFO:tasks.workunit.client.0.smithi019.stdout:2/675: read d0/d5/d18/d5c/d67/d77/fb3 [1342050,2668] 0 2024-09-12T22:33:16.378 INFO:tasks.workunit.client.0.smithi019.stdout:3/638: creat dd/d12/dbe/fc5 x:0 0 0 2024-09-12T22:33:16.379 INFO:tasks.workunit.client.0.smithi019.stdout:8/678: dwrite d7/d8/dd/f21 [0,4194304] 0 2024-09-12T22:33:16.379 INFO:tasks.workunit.client.0.smithi019.stdout:0/708: mkdir d1/d14/d26/d40/d45/d5e/ddf 0 2024-09-12T22:33:16.379 INFO:tasks.workunit.client.0.smithi019.stdout:7/628: rename d6/d2d/de0/fe7 to d6/d2d/d77/dbf/dde/fed 0 2024-09-12T22:33:16.380 INFO:tasks.workunit.client.0.smithi019.stdout:5/784: symlink d0/d7/d16/d18/d9d/l112 0 2024-09-12T22:33:16.380 INFO:tasks.workunit.client.0.smithi019.stdout:3/639: symlink dd/d1e/d40/lc6 0 2024-09-12T22:33:16.381 INFO:tasks.workunit.client.0.smithi019.stdout:0/709: mkdir d1/d1f/d5b/d83/de0 0 2024-09-12T22:33:16.381 INFO:tasks.workunit.client.0.smithi019.stdout:1/796: chown d3/df/d7e/db7/d16/f3b 3373895 1 2024-09-12T22:33:16.382 INFO:tasks.workunit.client.0.smithi019.stdout:8/679: truncate d7/d8/dd/f1c 589302 0 2024-09-12T22:33:16.382 INFO:tasks.workunit.client.0.smithi019.stdout:2/676: link d0/da/lc5 d0/d5/d18/d1b/d36/le5 0 2024-09-12T22:33:16.382 INFO:tasks.workunit.client.0.smithi019.stdout:7/629: write d6/d14/d2a/da4/d42/faa [943942,49752] 0 2024-09-12T22:33:16.382 INFO:tasks.workunit.client.0.smithi019.stdout:3/640: write dd/d12/f35 [3726642,25759] 0 2024-09-12T22:33:16.383 INFO:tasks.workunit.client.0.smithi019.stdout:8/680: creat d7/d34/d78/d53/da8/fd6 x:0 0 0 2024-09-12T22:33:16.383 INFO:tasks.workunit.client.0.smithi019.stdout:0/710: mknod d1/d1f/d5b/d83/dab/ce1 0 2024-09-12T22:33:16.383 INFO:tasks.workunit.client.0.smithi019.stdout:2/677: creat d0/d5/d17/fe6 x:0 0 0 2024-09-12T22:33:16.383 INFO:tasks.workunit.client.0.smithi019.stdout:7/630: creat d6/d14/d15/d8b/fee x:0 0 0 2024-09-12T22:33:16.383 INFO:tasks.workunit.client.0.smithi019.stdout:3/641: symlink dd/d1e/d40/da6/lc7 0 2024-09-12T22:33:16.384 INFO:tasks.workunit.client.0.smithi019.stdout:3/642: fsync dd/d1e/d40/f6f 0 2024-09-12T22:33:16.385 INFO:tasks.workunit.client.0.smithi019.stdout:8/681: creat d7/d34/d78/fd7 x:0 0 0 2024-09-12T22:33:16.385 INFO:tasks.workunit.client.0.smithi019.stdout:5/785: mknod d0/d7/d2d/d32/d36/d8c/db8/d39/d38/d4b/dde/dec/c113 0 2024-09-12T22:33:16.385 INFO:tasks.workunit.client.0.smithi019.stdout:0/711: write d1/d1f/d5b/d83/dab/dbe/d89/fd6 [733711,111389] 0 2024-09-12T22:33:16.385 INFO:tasks.workunit.client.0.smithi019.stdout:7/631: mknod d6/d14/d2a/da4/d34/cef 0 2024-09-12T22:33:16.386 INFO:tasks.workunit.client.0.smithi019.stdout:3/643: write dd/f11 [8274303,87053] 0 2024-09-12T22:33:16.386 INFO:tasks.workunit.client.0.smithi019.stdout:8/682: unlink d7/d34/d78/d53/daa/cb7 0 2024-09-12T22:33:16.387 INFO:tasks.workunit.client.0.smithi019.stdout:7/632: mkdir d6/d14/df0 0 2024-09-12T22:33:16.388 INFO:tasks.workunit.client.0.smithi019.stdout:7/633: chown d6/d2d 110593773 1 2024-09-12T22:33:16.389 INFO:tasks.workunit.client.0.smithi019.stdout:2/678: dread d0/d5/d18/d1b/d36/f4c [0,4194304] 0 2024-09-12T22:33:16.391 INFO:tasks.workunit.client.0.smithi019.stdout:2/679: creat d0/fe7 x:0 0 0 2024-09-12T22:33:16.391 INFO:tasks.workunit.client.0.smithi019.stdout:0/712: dread d1/f4d [0,4194304] 0 2024-09-12T22:33:16.392 INFO:tasks.workunit.client.0.smithi019.stdout:7/634: link d6/dd2/cdb d6/d14/d2a/da4/dc/d63/cf1 0 2024-09-12T22:33:16.392 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:33:16.392 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:33:16.393 INFO:tasks.workunit.client.0.smithi019.stdout:2/680: creat d0/d5/d18/d39/fe8 x:0 0 0 2024-09-12T22:33:16.393 INFO:tasks.workunit.client.0.smithi019.stdout:0/713: creat d1/d51/fe2 x:0 0 0 2024-09-12T22:33:16.393 INFO:tasks.workunit.client.0.smithi019.stdout:7/635: dread - d6/d2d/d77/fb8 zero size 2024-09-12T22:33:16.394 INFO:tasks.workunit.client.0.smithi019.stdout:5/786: dwrite d0/d7/d2d/d32/d36/d8c/db8/d39/d38/f44 [0,4194304] 0 2024-09-12T22:33:16.394 INFO:tasks.workunit.client.0.smithi019.stdout:0/714: stat d1/d14/f4e 0 2024-09-12T22:33:16.394 INFO:tasks.workunit.client.0.smithi019.stdout:2/681: mknod d0/d5/d18/d1b/d8d/dac/ce9 0 2024-09-12T22:33:16.395 INFO:tasks.workunit.client.0.smithi019.stdout:7/636: rmdir d6/d14/d15/d62 39 2024-09-12T22:33:16.395 INFO:tasks.workunit.client.0.smithi019.stdout:3/644: dwrite dd/d12/d62/d78/f8b [0,4194304] 0 2024-09-12T22:33:16.396 INFO:tasks.workunit.client.0.smithi019.stdout:0/715: readlink d1/d14/d26/d40/d45/d5e/d84/l9d 0 2024-09-12T22:33:16.396 INFO:tasks.workunit.client.0.smithi019.stdout:7/637: symlink d6/d2d/d8f/daf/lf2 0 2024-09-12T22:33:16.396 INFO:tasks.workunit.client.0.smithi019.stdout:5/787: mkdir d0/d7/d2d/d32/d36/d8c/db8/d39/d38/d4b/dde/d114 0 2024-09-12T22:33:16.397 INFO:tasks.workunit.client.0.smithi019.stdout:0/716: rmdir d1/d14/d1b 39 2024-09-12T22:33:16.397 INFO:tasks.workunit.client.0.smithi019.stdout:7/638: write d6/d2d/de0/fea [112533,17378] 0 2024-09-12T22:33:16.398 INFO:tasks.workunit.client.0.smithi019.stdout:3/645: link dd/d12/l84 dd/d1e/d40/lc8 0 2024-09-12T22:33:16.398 INFO:tasks.workunit.client.0.smithi019.stdout:0/717: mknod d1/d1f/d5b/dbf/ce3 0 2024-09-12T22:33:16.400 INFO:tasks.workunit.client.0.smithi019.stdout:1/797: truncate d3/df/d7e/db7/d16/d3c/dbd/de6/f27 3732340 0 2024-09-12T22:33:16.400 INFO:tasks.workunit.client.0.smithi019.stdout:5/788: link d0/d7/d2d/d32/d36/d8c/db8/fab d0/d7/d16/d18/f115 0 2024-09-12T22:33:16.401 INFO:tasks.workunit.client.0.smithi019.stdout:7/639: getdents d6/d14/d2a/da4 0 2024-09-12T22:33:16.401 INFO:tasks.workunit.client.0.smithi019.stdout:2/682: dread d0/d5/d60/d71/fd9 [0,4194304] 0 2024-09-12T22:33:16.401 INFO:tasks.workunit.client.0.smithi019.stdout:5/789: stat d0/db9/fbd 0 2024-09-12T22:33:16.401 INFO:tasks.workunit.client.0.smithi019.stdout:3/646: rename dd/d1e/d40/la7 to dd/d12/d62/d78/d98/lc9 0 2024-09-12T22:33:16.402 INFO:tasks.workunit.client.0.smithi019.stdout:0/718: creat d1/d1f/d5b/d83/de0/fe4 x:0 0 0 2024-09-12T22:33:16.402 INFO:tasks.workunit.client.0.smithi019.stdout:7/640: stat d6/d2d/d77 0 2024-09-12T22:33:16.403 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:33:16.403 INFO:tasks.workunit.client.0.smithi019.stdout:1/798: rename d3/df/d7e/d96/la3 to d3/d3f/d77/dcd/lfc 0 2024-09-12T22:33:16.404 INFO:tasks.workunit.client.0.smithi019.stdout:2/683: read d0/d5/d60/d71/fd9 [3160215,129911] 0 2024-09-12T22:33:16.404 INFO:tasks.workunit.client.0.smithi019.stdout:5/790: getdents d0/d7/d2d/d32/d36/ddc 0 2024-09-12T22:33:16.405 INFO:tasks.workunit.client.0.smithi019.stdout:0/719: rename d1/d14/fa6 to d1/d14/d1b/fe5 0 2024-09-12T22:33:16.405 INFO:tasks.workunit.client.0.smithi019.stdout:3/647: link dd/l8d dd/d1e/d40/da6/lca 0 2024-09-12T22:33:16.406 INFO:tasks.workunit.client.0.smithi019.stdout:0/720: write d1/d14/d1b/d94/fca [417218,1819] 0 2024-09-12T22:33:16.406 INFO:tasks.workunit.client.0.smithi019.stdout:2/684: chown d0/d5/d18/d1b/d5d/d86/cd1 10 1 2024-09-12T22:33:16.408 INFO:tasks.workunit.client.0.smithi019.stdout:0/721: mkdir d1/d1f/d5b/d83/dab/dbe/d71/d75/de6 0 2024-09-12T22:33:16.409 INFO:tasks.workunit.client.0.smithi019.stdout:2/685: rename d0/d5/d18/d1b/d36/cc0 to d0/d5/cea 0 2024-09-12T22:33:16.410 INFO:tasks.workunit.client.0.smithi019.stdout:1/799: dwrite d3/d6e/da9/f28 [0,4194304] 0 2024-09-12T22:33:16.411 INFO:tasks.workunit.client.0.smithi019.stdout:9/685: dread dd/d10/d17/d23/d2e/d31/d3f/d47/d6e/f89 [0,4194304] 0 2024-09-12T22:33:16.411 INFO:tasks.workunit.client.0.smithi019.stdout:0/722: stat d1/d1f/d5b/d83/dab/dbe/f5f 0 2024-09-12T22:33:16.412 INFO:tasks.workunit.client.0.smithi019.stdout:2/686: dread - d0/d5/d18/d39/fe8 zero size 2024-09-12T22:33:16.413 INFO:tasks.workunit.client.0.smithi019.stdout:2/687: sync 2024-09-12T22:33:16.413 INFO:tasks.workunit.client.0.smithi019.stdout:3/648: dwrite dd/d1e/d40/d5f/f66 [0,4194304] 0 2024-09-12T22:33:16.413 INFO:tasks.workunit.client.0.smithi019.stdout:0/723: read - d1/d14/d1b/d3a/d8c/dae/faf zero size 2024-09-12T22:33:16.414 INFO:tasks.workunit.client.0.smithi019.stdout:2/688: chown d0/d5/f10 449088528 1 2024-09-12T22:33:16.414 INFO:tasks.workunit.client.0.smithi019.stdout:3/649: chown dd/l4e 69 1 2024-09-12T22:33:16.414 INFO:tasks.workunit.client.0.smithi019.stdout:1/800: getdents d3/df/d7e/d90 0 2024-09-12T22:33:16.415 INFO:tasks.workunit.client.0.smithi019.stdout:9/686: mkdir dd/d10/d17/d23/d2e/d31/d7e/dbc/ddd 0 2024-09-12T22:33:16.415 INFO:tasks.workunit.client.0.smithi019.stdout:0/724: creat d1/d14/dad/fe7 x:0 0 0 2024-09-12T22:33:16.415 INFO:tasks.workunit.client.0.smithi019.stdout:3/650: dread - dd/d1e/f58 zero size 2024-09-12T22:33:16.416 INFO:tasks.workunit.client.0.smithi019.stdout:8/683: dread d7/d8/dd/fbb [0,4194304] 0 2024-09-12T22:33:16.417 INFO:tasks.workunit.client.0.smithi019.stdout:9/687: mkdir dd/d10/d17/d23/d2e/d31/d7e/dbc/ddd/dde 0 2024-09-12T22:33:16.421 INFO:tasks.workunit.client.0.smithi019.stdout:3/651: mknod dd/d12/d62/d74/daa/ccb 0 2024-09-12T22:33:16.421 INFO:tasks.workunit.client.0.smithi019.stdout:8/684: write d7/f59 [775112,85086] 0 2024-09-12T22:33:16.421 INFO:tasks.workunit.client.0.smithi019.stdout:1/801: creat d3/df/d7e/db7/d16/d3c/ffd x:0 0 0 2024-09-12T22:33:16.421 INFO:tasks.workunit.client.0.smithi019.stdout:3/652: unlink dd/d1e/d40/lc0 0 2024-09-12T22:33:16.421 INFO:tasks.workunit.client.0.smithi019.stdout:7/641: dread d6/d2d/d77/f89 [0,4194304] 0 2024-09-12T22:33:16.421 INFO:tasks.workunit.client.0.smithi019.stdout:0/725: truncate d1/d1f/d5b/d83/dab/dbe/d71/d85/f99 1045910 0 2024-09-12T22:33:16.422 INFO:tasks.workunit.client.0.smithi019.stdout:9/688: write dd/d10/d17/d23/d2e/f92 [819786,116941] 0 2024-09-12T22:33:16.422 INFO:tasks.workunit.client.0.smithi019.stdout:6/756: dread d1b/d26/d27/fce [0,4194304] 0 2024-09-12T22:33:16.422 INFO:tasks.workunit.client.0.smithi019.stdout:7/642: stat d6/d2d/d77/fec 0 2024-09-12T22:33:16.422 INFO:tasks.workunit.client.0.smithi019.stdout:3/653: creat dd/d12/d62/d6a/fcc x:0 0 0 2024-09-12T22:33:16.422 INFO:tasks.workunit.client.0.smithi019.stdout:0/726: fdatasync d1/d14/d26/d40/d45/fd5 0 2024-09-12T22:33:16.423 INFO:tasks.workunit.client.0.smithi019.stdout:2/689: dwrite d0/d5/f3a [4194304,4194304] 0 2024-09-12T22:33:16.424 INFO:tasks.workunit.client.0.smithi019.stdout:8/685: dread d7/d8/dd/d45/dc5/f90 [0,4194304] 0 2024-09-12T22:33:16.424 INFO:tasks.workunit.client.0.smithi019.stdout:9/689: chown dd/d10/d17/d22/d6c/d53/d69/cd9 95084 1 2024-09-12T22:33:16.424 INFO:tasks.workunit.client.0.smithi019.stdout:3/654: dread - dd/d12/d62/d6a/fbc zero size 2024-09-12T22:33:16.424 INFO:tasks.workunit.client.0.smithi019.stdout:7/643: mknod d6/dcf/cf3 0 2024-09-12T22:33:16.425 INFO:tasks.workunit.client.0.smithi019.stdout:8/686: creat d7/d8/d43/d87/fd8 x:0 0 0 2024-09-12T22:33:16.426 INFO:tasks.workunit.client.0.smithi019.stdout:9/690: mkdir dd/d10/d17/d23/d2e/d31/d54/d8b/ddf 0 2024-09-12T22:33:16.426 INFO:tasks.workunit.client.0.smithi019.stdout:0/727: creat d1/d1f/d5b/d83/dab/dbe/fe8 x:0 0 0 2024-09-12T22:33:16.426 INFO:tasks.workunit.client.0.smithi019.stdout:7/644: mknod d6/d14/d2a/d99/cf4 0 2024-09-12T22:33:16.427 INFO:tasks.workunit.client.0.smithi019.stdout:2/690: getdents d0/d5/d60/d74 0 2024-09-12T22:33:16.427 INFO:tasks.workunit.client.0.smithi019.stdout:3/655: link dd/d1e/d40/da6/lc7 dd/d1e/lcd 0 2024-09-12T22:33:16.428 INFO:tasks.workunit.client.0.smithi019.stdout:0/728: write d1/d14/d26/d40/d45/d5e/f66 [243972,81124] 0 2024-09-12T22:33:16.430 INFO:tasks.workunit.client.0.smithi019.stdout:2/691: symlink d0/d5/d18/d5c/d67/d77/leb 0 2024-09-12T22:33:16.431 INFO:tasks.workunit.client.0.smithi019.stdout:6/757: dwrite d1b/d26/d31/d5f/f86 [4194304,4194304] 0 2024-09-12T22:33:16.431 INFO:tasks.workunit.client.0.smithi019.stdout:3/656: write dd/d12/f29 [1447239,30934] 0 2024-09-12T22:33:16.432 INFO:tasks.workunit.client.0.smithi019.stdout:0/729: write d1/d51/fe2 [1032253,95143] 0 2024-09-12T22:33:16.432 INFO:tasks.workunit.client.0.smithi019.stdout:4/735: dread d1/d22/d31/d85/fab [0,4194304] 0 2024-09-12T22:33:16.433 INFO:tasks.workunit.client.0.smithi019.stdout:2/692: symlink d0/d5/d18/d5c/d67/lec 0 2024-09-12T22:33:16.433 INFO:tasks.workunit.client.0.smithi019.stdout:9/691: dwrite dd/f9e [0,4194304] 0 2024-09-12T22:33:16.434 INFO:tasks.workunit.client.0.smithi019.stdout:3/657: write dd/d1e/d5a/f60 [587704,65900] 0 2024-09-12T22:33:16.435 INFO:tasks.workunit.client.0.smithi019.stdout:2/693: dread - d0/d5/d60/fd8 zero size 2024-09-12T22:33:16.435 INFO:tasks.workunit.client.0.smithi019.stdout:8/687: read d7/d2f/d42/f93 [2036146,5370] 0 2024-09-12T22:33:16.436 INFO:tasks.workunit.client.0.smithi019.stdout:8/688: sync 2024-09-12T22:33:16.436 INFO:tasks.workunit.client.0.smithi019.stdout:7/645: dwrite d6/d14/d2a/da4/d34/f7b [4194304,4194304] 0 2024-09-12T22:33:16.436 INFO:tasks.workunit.client.0.smithi019.stdout:8/689: stat d7/d2f/d42/f92 0 2024-09-12T22:33:16.437 INFO:tasks.workunit.client.0.smithi019.stdout:0/730: truncate d1/f1a 1008531 0 2024-09-12T22:33:16.437 INFO:tasks.workunit.client.0.smithi019.stdout:6/758: rename d1b/d26/d27/d67/d77/f78 to d1b/d26/d39/d89/f104 0 2024-09-12T22:33:16.437 INFO:tasks.workunit.client.0.smithi019.stdout:2/694: creat d0/d5/d17/d91/d9c/fed x:0 0 0 2024-09-12T22:33:16.438 INFO:tasks.workunit.client.0.smithi019.stdout:9/692: symlink dd/d10/d17/d23/d2e/d31/d3f/d47/d6e/d80/le0 0 2024-09-12T22:33:16.439 INFO:tasks.workunit.client.0.smithi019.stdout:8/690: readlink d7/l2b 0 2024-09-12T22:33:16.439 INFO:tasks.workunit.client.0.smithi019.stdout:3/658: creat dd/d12/d62/fce x:0 0 0 2024-09-12T22:33:16.439 INFO:tasks.workunit.client.0.smithi019.stdout:7/646: write d6/d14/d2a/da4/dc/f43 [3189068,5587] 0 2024-09-12T22:33:16.439 INFO:tasks.workunit.client.0.smithi019.stdout:8/691: fdatasync d7/d2f/d42/f92 0 2024-09-12T22:33:16.440 INFO:tasks.workunit.client.0.smithi019.stdout:9/693: write dd/d10/d17/d22/d77/fc7 [328756,61623] 0 2024-09-12T22:33:16.440 INFO:tasks.workunit.client.0.smithi019.stdout:6/759: unlink d1b/d26/d27/le4 0 2024-09-12T22:33:16.440 INFO:tasks.workunit.client.0.smithi019.stdout:7/647: chown d6/d2d/d3d/ca9 173361 1 2024-09-12T22:33:16.441 INFO:tasks.workunit.client.0.smithi019.stdout:7/648: readlink d6/d14/d15/d9e/lc7 0 2024-09-12T22:33:16.441 INFO:tasks.workunit.client.0.smithi019.stdout:8/692: symlink d7/d8/dd/d45/dc5/ld9 0 2024-09-12T22:33:16.442 INFO:tasks.workunit.client.0.smithi019.stdout:3/659: rename dd/d12/d62/d74/daa/fb9 to dd/d1e/d5a/fcf 0 2024-09-12T22:33:16.443 INFO:tasks.workunit.client.0.smithi019.stdout:7/649: chown d6/d14/d2a/f82 20 1 2024-09-12T22:33:16.444 INFO:tasks.workunit.client.0.smithi019.stdout:8/693: write d7/d8/f4c [1749965,112748] 0 2024-09-12T22:33:16.444 INFO:tasks.workunit.client.0.smithi019.stdout:2/695: dread d0/d5/d18/d3b/f49 [0,4194304] 0 2024-09-12T22:33:16.445 INFO:tasks.workunit.client.0.smithi019.stdout:6/760: rename d1b/d26/d39/d6a/f60 to d1b/d26/d39/f105 0 2024-09-12T22:33:16.445 INFO:tasks.workunit.client.0.smithi019.stdout:7/650: mknod d6/d2d/d77/cf5 0 2024-09-12T22:33:16.446 INFO:tasks.workunit.client.0.smithi019.stdout:8/694: mknod d7/d2f/d75/cda 0 2024-09-12T22:33:16.447 INFO:tasks.workunit.client.0.smithi019.stdout:2/696: stat d0/d5/cea 0 2024-09-12T22:33:16.448 INFO:tasks.workunit.client.0.smithi019.stdout:6/761: symlink d1b/d102/l106 0 2024-09-12T22:33:16.448 INFO:tasks.workunit.client.0.smithi019.stdout:7/651: mknod d6/cf6 0 2024-09-12T22:33:16.448 INFO:tasks.workunit.client.0.smithi019.stdout:0/731: dwrite d1/d51/f56 [0,4194304] 0 2024-09-12T22:33:16.449 INFO:tasks.workunit.client.0.smithi019.stdout:8/695: write d7/d8/f73 [364819,7842] 0 2024-09-12T22:33:16.449 INFO:tasks.workunit.client.0.smithi019.stdout:4/736: dwrite d1/d8/f20 [0,4194304] 0 2024-09-12T22:33:16.451 INFO:tasks.workunit.client.0.smithi019.stdout:8/696: mkdir d7/d2f/ddb 0 2024-09-12T22:33:16.452 INFO:tasks.workunit.client.0.smithi019.stdout:3/660: dwrite dd/d1e/d5a/f94 [0,4194304] 0 2024-09-12T22:33:16.452 INFO:tasks.workunit.client.0.smithi019.stdout:8/697: fsync d7/d5e/f60 0 2024-09-12T22:33:16.453 INFO:tasks.workunit.client.0.smithi019.stdout:0/732: link d1/c7 d1/d1f/d5b/d83/dab/dbe/d71/d85/ce9 0 2024-09-12T22:33:16.454 INFO:tasks.workunit.client.0.smithi019.stdout:8/698: chown d7/d34/d78/d53 9907940 1 2024-09-12T22:33:16.455 INFO:tasks.workunit.client.0.smithi019.stdout:0/733: creat d1/d14/d26/d40/fea x:0 0 0 2024-09-12T22:33:16.455 INFO:tasks.workunit.client.0.smithi019.stdout:8/699: creat d7/d2f/d75/dc7/fdc x:0 0 0 2024-09-12T22:33:16.458 INFO:tasks.workunit.client.0.smithi019.stdout:8/700: unlink d7/l22 0 2024-09-12T22:33:16.458 INFO:tasks.workunit.client.0.smithi019.stdout:0/734: mknod d1/d14/dad/dc0/ceb 0 2024-09-12T22:33:16.458 INFO:tasks.workunit.client.0.smithi019.stdout:6/762: dwrite d1b/d26/d27/d3e/d83/d98/fed [0,4194304] 0 2024-09-12T22:33:16.458 INFO:tasks.workunit.client.0.smithi019.stdout:0/735: write d1/d14/f4e [4934487,79508] 0 2024-09-12T22:33:16.459 INFO:tasks.workunit.client.0.smithi019.stdout:8/701: symlink d7/d34/d78/ldd 0 2024-09-12T22:33:16.460 INFO:tasks.workunit.client.0.smithi019.stdout:8/702: dread - d7/d34/d78/d53/f69 zero size 2024-09-12T22:33:16.460 INFO:tasks.workunit.client.0.smithi019.stdout:2/697: read d0/d5/fa9 [226812,85587] 0 2024-09-12T22:33:16.460 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:16.458+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:16.461 INFO:tasks.workunit.client.0.smithi019.stdout:6/763: rename d1b/d26/d27/d3e/d83/d98/lba to d1b/d26/d27/d67/d77/l107 0 2024-09-12T22:33:16.462 INFO:tasks.workunit.client.0.smithi019.stdout:6/764: sync 2024-09-12T22:33:16.462 INFO:tasks.workunit.client.0.smithi019.stdout:8/703: mknod d7/d2f/d75/dc7/cde 0 2024-09-12T22:33:16.462 INFO:tasks.workunit.client.0.smithi019.stdout:2/698: unlink d0/fe3 0 2024-09-12T22:33:16.462 INFO:tasks.workunit.client.0.smithi019.stdout:3/661: truncate dd/f26 3601620 0 2024-09-12T22:33:16.463 INFO:tasks.workunit.client.0.smithi019.stdout:5/791: dread d0/f2 [0,4194304] 0 2024-09-12T22:33:16.463 INFO:tasks.workunit.client.0.smithi019.stdout:6/765: chown l10 59284 1 2024-09-12T22:33:16.463 INFO:tasks.workunit.client.0.smithi019.stdout:4/737: truncate d1/d11/d15/f2e 198652 0 2024-09-12T22:33:16.463 INFO:tasks.workunit.client.0.smithi019.stdout:2/699: fdatasync d0/d5/f3a 0 2024-09-12T22:33:16.464 INFO:tasks.workunit.client.0.smithi019.stdout:8/704: write d7/d2f/d42/f93 [3894534,15444] 0 2024-09-12T22:33:16.464 INFO:tasks.workunit.client.0.smithi019.stdout:4/738: symlink d1/d4c/db0/d75/lfe 0 2024-09-12T22:33:16.465 INFO:tasks.workunit.client.0.smithi019.stdout:2/700: rmdir d0/d5/d17 39 2024-09-12T22:33:16.465 INFO:tasks.workunit.client.0.smithi019.stdout:5/792: chown d0/d7/d2d/d32/d36/l72 2619333 1 2024-09-12T22:33:16.466 INFO:tasks.workunit.client.0.smithi019.stdout:8/705: mknod d7/d2f/ddb/cdf 0 2024-09-12T22:33:16.467 INFO:tasks.workunit.client.0.smithi019.stdout:8/706: chown d7/c86 7511 1 2024-09-12T22:33:16.467 INFO:tasks.workunit.client.0.smithi019.stdout:2/701: write d0/d5/d18/f20 [676364,37928] 0 2024-09-12T22:33:16.468 INFO:tasks.workunit.client.0.smithi019.stdout:0/736: dwrite d1/d14/d1b/d3a/fa8 [0,4194304] 0 2024-09-12T22:33:16.468 INFO:tasks.workunit.client.0.smithi019.stdout:5/793: write d0/d7/d16/f91 [70765,125614] 0 2024-09-12T22:33:16.469 INFO:tasks.workunit.client.0.smithi019.stdout:1/802: dread d3/df/d7e/db7/d16/f60 [0,4194304] 0 2024-09-12T22:33:16.471 INFO:tasks.workunit.client.0.smithi019.stdout:2/702: mkdir d0/d5/d18/d5c/d67/dee 0 2024-09-12T22:33:16.471 INFO:tasks.workunit.client.0.smithi019.stdout:0/737: unlink d1/d51/lb3 0 2024-09-12T22:33:16.471 INFO:tasks.workunit.client.0.smithi019.stdout:1/803: creat d3/d3f/d58/dc6/ffe x:0 0 0 2024-09-12T22:33:16.472 INFO:tasks.workunit.client.0.smithi019.stdout:3/662: dwrite dd/d1e/f3c [0,4194304] 0 2024-09-12T22:33:16.473 INFO:tasks.workunit.client.0.smithi019.stdout:6/766: write d1b/d26/d39/d6a/d61/fd0 [406903,64447] 0 2024-09-12T22:33:16.475 INFO:tasks.workunit.client.0.smithi019.stdout:3/663: chown dd/d12/f35 1379 1 2024-09-12T22:33:16.477 INFO:tasks.workunit.client.0.smithi019.stdout:1/804: symlink d3/df/d7e/db7/d63/d76/d91/lff 0 2024-09-12T22:33:16.477 INFO:tasks.workunit.client.0.smithi019.stdout:4/739: dwrite d1/d11/d15/d1f/ff3 [0,4194304] 0 2024-09-12T22:33:16.478 INFO:tasks.workunit.client.0.smithi019.stdout:5/794: dread - d0/d7/d2d/d32/d36/d8c/db8/d39/d38/d4b/dde/da0/fb7 zero size 2024-09-12T22:33:16.480 INFO:tasks.workunit.client.0.smithi019.stdout:8/707: dwrite d7/d34/d78/d54/f71 [8388608,4194304] 0 2024-09-12T22:33:16.480 INFO:tasks.workunit.client.0.smithi019.stdout:6/767: creat d1b/d26/d31/dec/f108 x:0 0 0 2024-09-12T22:33:16.480 INFO:tasks.workunit.client.0.smithi019.stdout:3/664: write dd/d1e/d82/f87 [1001030,74433] 0 2024-09-12T22:33:16.481 INFO:tasks.workunit.client.0.smithi019.stdout:0/738: rename d1/d1f/d5b/d83/dab/dbe/d89/f8e to d1/d1f/d5b/d83/dab/dbe/d9c/fec 0 2024-09-12T22:33:16.482 INFO:tasks.workunit.client.0.smithi019.stdout:3/665: stat dd/d1e/d5a/f8e 0 2024-09-12T22:33:16.482 INFO:tasks.workunit.client.0.smithi019.stdout:5/795: mknod d0/d7/d2d/d4c/d87/dd2/c116 0 2024-09-12T22:33:16.482 INFO:tasks.workunit.client.0.smithi019.stdout:6/768: unlink d1b/d26/d27/d3e/d83/d98/fd1 0 2024-09-12T22:33:16.482 INFO:tasks.workunit.client.0.smithi019.stdout:2/703: dwrite d0/f48 [0,4194304] 0 2024-09-12T22:33:16.483 INFO:tasks.workunit.client.0.smithi019.stdout:3/666: write dd/d12/dbe/fc5 [231427,20324] 0 2024-09-12T22:33:16.484 INFO:tasks.workunit.client.0.smithi019.stdout:2/704: creat d0/d5/d60/fef x:0 0 0 2024-09-12T22:33:16.485 INFO:tasks.workunit.client.0.smithi019.stdout:0/739: link d1/d14/d1b/f2b d1/d1f/d5b/d83/dab/dbe/dc6/fed 0 2024-09-12T22:33:16.486 INFO:tasks.workunit.client.0.smithi019.stdout:1/805: dwrite d3/df/d7e/db7/d16/f99 [0,4194304] 0 2024-09-12T22:33:16.487 INFO:tasks.workunit.client.0.smithi019.stdout:2/705: chown d0/f48 0 1 2024-09-12T22:33:16.488 INFO:tasks.workunit.client.0.smithi019.stdout:8/708: dwrite d7/d8/d43/fb9 [0,4194304] 0 2024-09-12T22:33:16.489 INFO:tasks.workunit.client.0.smithi019.stdout:0/740: link d1/f2c d1/d14/d26/d40/fee 0 2024-09-12T22:33:16.489 INFO:tasks.workunit.client.0.smithi019.stdout:1/806: mknod d3/df/d7e/db7/d16/d3c/c100 0 2024-09-12T22:33:16.489 INFO:tasks.workunit.client.0.smithi019.stdout:6/769: dwrite d1b/d26/d31/dec/f108 [0,4194304] 0 2024-09-12T22:33:16.490 INFO:tasks.workunit.client.0.smithi019.stdout:8/709: creat d7/d8/d43/d87/fe0 x:0 0 0 2024-09-12T22:33:16.492 INFO:tasks.workunit.client.0.smithi019.stdout:1/807: mkdir d3/d3f/d58/d101 0 2024-09-12T22:33:16.493 INFO:tasks.workunit.client.0.smithi019.stdout:6/770: creat d1b/d26/d27/d67/de1/f109 x:0 0 0 2024-09-12T22:33:16.493 INFO:tasks.workunit.client.0.smithi019.stdout:8/710: creat d7/d8/dd/d45/fe1 x:0 0 0 2024-09-12T22:33:16.493 INFO:tasks.workunit.client.0.smithi019.stdout:2/706: rename d0/d5/d18/d1b/d5d/d86/c45 to d0/d5/d17/d91/cf0 0 2024-09-12T22:33:16.493 INFO:tasks.workunit.client.0.smithi019.stdout:5/796: read d0/d7/f1c [1870807,34878] 0 2024-09-12T22:33:16.496 INFO:tasks.workunit.client.0.smithi019.stdout:2/707: write d0/d5/d18/d1b/d8d/fda [1010857,53690] 0 2024-09-12T22:33:16.496 INFO:tasks.workunit.client.0.smithi019.stdout:6/771: creat d1b/d26/d39/d89/d90/f10a x:0 0 0 2024-09-12T22:33:16.497 INFO:tasks.workunit.client.0.smithi019.stdout:1/808: truncate d3/df/d7e/db7/d16/f3b 3616468 0 2024-09-12T22:33:16.497 INFO:tasks.workunit.client.0.smithi019.stdout:2/708: dread - d0/fcf zero size 2024-09-12T22:33:16.497 INFO:tasks.workunit.client.0.smithi019.stdout:8/711: truncate d7/d2f/fd3 904756 0 2024-09-12T22:33:16.498 INFO:tasks.workunit.client.0.smithi019.stdout:6/772: write d1b/f7d [870698,109812] 0 2024-09-12T22:33:16.498 INFO:tasks.workunit.client.0.smithi019.stdout:1/809: stat d3/d3f/d58/la1 0 2024-09-12T22:33:16.498 INFO:tasks.workunit.client.0.smithi019.stdout:2/709: chown d0/da/fd4 32 1 2024-09-12T22:33:16.499 INFO:tasks.workunit.client.0.smithi019.stdout:8/712: read d7/d8/dd/f21 [1413949,82627] 0 2024-09-12T22:33:16.499 INFO:tasks.workunit.client.0.smithi019.stdout:5/797: truncate d0/d7/d2d/d32/d4a/f6f 5990638 0 2024-09-12T22:33:16.499 INFO:tasks.workunit.client.0.smithi019.stdout:6/773: fsync d1b/d26/d39/f4c 0 2024-09-12T22:33:16.499 INFO:tasks.workunit.client.0.smithi019.stdout:0/741: dwrite d1/d14/d26/d40/fea [0,4194304] 0 2024-09-12T22:33:16.500 INFO:tasks.workunit.client.0.smithi019.stdout:2/710: symlink d0/d5/d18/d1b/d36/lf1 0 2024-09-12T22:33:16.500 INFO:tasks.workunit.client.0.smithi019.stdout:6/774: write d1b/f3c [185493,115366] 0 2024-09-12T22:33:16.501 INFO:tasks.workunit.client.0.smithi019.stdout:8/713: chown d7/d34/d78/d54/f95 261356881 1 2024-09-12T22:33:16.502 INFO:tasks.workunit.client.0.smithi019.stdout:1/810: truncate d3/df/d7e/db7/d16/d3c/d55/fd6 247187 0 2024-09-12T22:33:16.502 INFO:tasks.workunit.client.0.smithi019.stdout:8/714: unlink d7/d2f/fd3 0 2024-09-12T22:33:16.503 INFO:tasks.workunit.client.0.smithi019.stdout:2/711: mkdir d0/d5/d17/d91/d9c/df2 0 2024-09-12T22:33:16.503 INFO:tasks.workunit.client.0.smithi019.stdout:5/798: rename d0/d7/d2d/d32/d4a/lee to d0/d7/d2d/d4c/l117 0 2024-09-12T22:33:16.504 INFO:tasks.workunit.client.0.smithi019.stdout:6/775: link d1b/d26/d31/f9b d1b/d26/d39/d6a/f10b 0 2024-09-12T22:33:16.504 INFO:tasks.workunit.client.0.smithi019.stdout:1/811: symlink d3/d3f/d77/dcd/l102 0 2024-09-12T22:33:16.504 INFO:tasks.workunit.client.0.smithi019.stdout:2/712: read - d0/d5/dd6/fe2 zero size 2024-09-12T22:33:16.505 INFO:tasks.workunit.client.0.smithi019.stdout:5/799: mkdir d0/db9/d118 0 2024-09-12T22:33:16.505 INFO:tasks.workunit.client.0.smithi019.stdout:6/776: readlink d1b/d102/l106 0 2024-09-12T22:33:16.505 INFO:tasks.workunit.client.0.smithi019.stdout:9/694: dread dd/dc2/f81 [0,4194304] 0 2024-09-12T22:33:16.506 INFO:tasks.workunit.client.0.smithi019.stdout:1/812: creat d3/d3f/d77/dcd/f103 x:0 0 0 2024-09-12T22:33:16.506 INFO:tasks.workunit.client.0.smithi019.stdout:2/713: rmdir d0/d5/d17/d91/d9c 39 2024-09-12T22:33:16.507 INFO:tasks.workunit.client.0.smithi019.stdout:0/742: write d1/f1a [530572,44595] 0 2024-09-12T22:33:16.508 INFO:tasks.workunit.client.0.smithi019.stdout:6/777: rename d1b/d26/d39/f4c to d1b/d26/d31/f10c 0 2024-09-12T22:33:16.509 INFO:tasks.workunit.client.0.smithi019.stdout:0/743: read d1/f4d [2832979,75586] 0 2024-09-12T22:33:16.509 INFO:tasks.workunit.client.0.smithi019.stdout:9/695: read - dd/d10/d17/d22/d6c/d53/fbe zero size 2024-09-12T22:33:16.510 INFO:tasks.workunit.client.0.smithi019.stdout:8/715: dwrite d7/d8/dd/f1c [0,4194304] 0 2024-09-12T22:33:16.510 INFO:tasks.workunit.client.0.smithi019.stdout:6/778: mknod d1b/d26/de2/df2/c10d 0 2024-09-12T22:33:16.511 INFO:tasks.workunit.client.0.smithi019.stdout:1/813: rename d3/df/d7e/db7/d63/d76/d91/cbb to d3/d3f/c104 0 2024-09-12T22:33:16.512 INFO:tasks.workunit.client.0.smithi019.stdout:8/716: symlink d7/d34/le2 0 2024-09-12T22:33:16.512 INFO:tasks.workunit.client.0.smithi019.stdout:0/744: rmdir d1/d14/d26/d40/d45/d5e/d84 39 2024-09-12T22:33:16.512 INFO:tasks.workunit.client.0.smithi019.stdout:6/779: dread - d1b/db4/f100 zero size 2024-09-12T22:33:16.513 INFO:tasks.workunit.client.0.smithi019.stdout:5/800: dwrite d0/d7/d2d/d32/d36/d8c/d8f/f9f [0,4194304] 0 2024-09-12T22:33:16.514 INFO:tasks.workunit.client.0.smithi019.stdout:8/717: truncate d7/d2f/d42/fd1 616662 0 2024-09-12T22:33:16.515 INFO:tasks.workunit.client.0.smithi019.stdout:6/780: unlink d1b/d26/fda 0 2024-09-12T22:33:16.516 INFO:tasks.workunit.client.0.smithi019.stdout:0/745: write d1/d14/d1b/d3a/fa8 [3050466,64525] 0 2024-09-12T22:33:16.516 INFO:tasks.workunit.client.0.smithi019.stdout:2/714: dwrite d0/d5/d60/d74/d7e/f87 [0,4194304] 0 2024-09-12T22:33:16.518 INFO:tasks.workunit.client.0.smithi019.stdout:9/696: truncate dd/d10/d17/d22/d6c/d53/d69/f9c 22341 0 2024-09-12T22:33:16.518 INFO:tasks.workunit.client.0.smithi019.stdout:7/652: dread d6/d14/d2a/da4/f3b [0,4194304] 0 2024-09-12T22:33:16.521 INFO:tasks.workunit.client.0.smithi019.stdout:6/781: creat d1b/d26/d31/f10e x:0 0 0 2024-09-12T22:33:16.523 INFO:tasks.workunit.client.0.smithi019.stdout:7/653: rmdir d6/d2d/d3d 39 2024-09-12T22:33:16.523 INFO:tasks.workunit.client.0.smithi019.stdout:5/801: mkdir d0/d7/d2d/d32/d36/d8c/db8/d39/d38/d4b/dde/d114/d119 0 2024-09-12T22:33:16.523 INFO:tasks.workunit.client.0.smithi019.stdout:0/746: rename d1/d14/d26/d40/fea to d1/d14/d1b/d3a/d8c/fef 0 2024-09-12T22:33:16.525 INFO:tasks.workunit.client.0.smithi019.stdout:5/802: unlink d0/f75 0 2024-09-12T22:33:16.525 INFO:tasks.workunit.client.0.smithi019.stdout:2/715: link d0/f1f d0/d5/ff3 0 2024-09-12T22:33:16.526 INFO:tasks.workunit.client.0.smithi019.stdout:0/747: creat d1/d1d/ff0 x:0 0 0 2024-09-12T22:33:16.527 INFO:tasks.workunit.client.0.smithi019.stdout:1/814: dwrite d3/df/d7e/db7/d16/d3c/dbd/fdd [0,4194304] 0 2024-09-12T22:33:16.527 INFO:tasks.workunit.client.0.smithi019.stdout:8/718: dwrite d7/d2f/d42/f92 [0,4194304] 0 2024-09-12T22:33:16.532 INFO:tasks.workunit.client.0.smithi019.stdout:0/748: creat d1/d1f/d5b/ff1 x:0 0 0 2024-09-12T22:33:16.532 INFO:tasks.workunit.client.0.smithi019.stdout:7/654: truncate d6/d2d/d77/d8e/fbb 2657644 0 2024-09-12T22:33:16.532 INFO:tasks.workunit.client.0.smithi019.stdout:6/782: dwrite d1b/fe3 [0,4194304] 0 2024-09-12T22:33:16.533 INFO:tasks.workunit.client.0.smithi019.stdout:8/719: rename d7/d34/d78/d53/f69 to d7/d34/d78/d53/fe3 0 2024-09-12T22:33:16.533 INFO:tasks.workunit.client.0.smithi019.stdout:5/803: creat d0/d7/d2d/d32/d36/d8c/db5/f11a x:0 0 0 2024-09-12T22:33:16.533 INFO:tasks.workunit.client.0.smithi019.stdout:9/697: dwrite dd/d10/d17/d22/fae [0,4194304] 0 2024-09-12T22:33:16.534 INFO:tasks.workunit.client.0.smithi019.stdout:2/716: truncate d0/d5/d18/d5c/d67/d77/fc9 734712 0 2024-09-12T22:33:16.534 INFO:tasks.workunit.client.0.smithi019.stdout:8/720: chown d7/d8/d43/d87/fad 1377215 1 2024-09-12T22:33:16.535 INFO:tasks.workunit.client.0.smithi019.stdout:6/783: mknod d1b/d26/d39/d89/c10f 0 2024-09-12T22:33:16.535 INFO:tasks.workunit.client.0.smithi019.stdout:5/804: truncate d0/f6 2569974 0 2024-09-12T22:33:16.535 INFO:tasks.workunit.client.0.smithi019.stdout:9/698: write dd/d10/d17/d22/fa3 [579498,3405] 0 2024-09-12T22:33:16.536 INFO:tasks.workunit.client.0.smithi019.stdout:4/740: dread d1/d22/d57/f87 [0,4194304] 0 2024-09-12T22:33:16.538 INFO:tasks.workunit.client.0.smithi019.stdout:0/749: rename d1/d14/d26/d40/d45/d5e/d84/ca4 to d1/d14/d26/d40/d91/cf2 0 2024-09-12T22:33:16.538 INFO:tasks.workunit.client.0.smithi019.stdout:2/717: fsync d0/d5/d60/d74/d7e/f87 0 2024-09-12T22:33:16.539 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:33:16.539 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:33:16.539 INFO:tasks.workunit.client.0.smithi019.stdout:0/750: stat d1/d14/d1b/d3a/c4a 0 2024-09-12T22:33:16.540 INFO:tasks.workunit.client.0.smithi019.stdout:9/699: symlink dd/d10/d17/d23/d2e/d31/d3f/d47/le1 0 2024-09-12T22:33:16.540 INFO:tasks.workunit.client.0.smithi019.stdout:4/741: mkdir d1/d11/dff 0 2024-09-12T22:33:16.540 INFO:tasks.workunit.client.0.smithi019.stdout:8/721: getdents d7/d2f/ddb 0 2024-09-12T22:33:16.542 INFO:tasks.workunit.client.0.smithi019.stdout:0/751: write d1/d14/f1e [289597,90809] 0 2024-09-12T22:33:16.543 INFO:tasks.workunit.client.0.smithi019.stdout:8/722: unlink d7/d2f/fa2 0 2024-09-12T22:33:16.543 INFO:tasks.workunit.client.0.smithi019.stdout:7/655: dwrite d6/d14/d2a/da4/d34/f90 [0,4194304] 0 2024-09-12T22:33:16.544 INFO:tasks.workunit.client.0.smithi019.stdout:6/784: write d1b/d26/d39/d89/f104 [247856,27403] 0 2024-09-12T22:33:16.545 INFO:tasks.workunit.client.0.smithi019.stdout:2/718: getdents d0/d5/d18/d5c/d85/d95 0 2024-09-12T22:33:16.545 INFO:tasks.workunit.client.0.smithi019.stdout:4/742: getdents d1/d8/dfb 0 2024-09-12T22:33:16.546 INFO:tasks.workunit.client.0.smithi019.stdout:0/752: chown d1/d14/d26/d40/d45/d5e/da2/fd0 21057972 1 2024-09-12T22:33:16.547 INFO:tasks.workunit.client.0.smithi019.stdout:5/805: dwrite d0/d7/d2d/d32/d36/d8c/db8/fbc [4194304,4194304] 0 2024-09-12T22:33:16.547 INFO:tasks.workunit.client.0.smithi019.stdout:4/743: rmdir d1/d4c/db0/d75/d5a/d79/db4 39 2024-09-12T22:33:16.548 INFO:tasks.workunit.client.0.smithi019.stdout:9/700: dread dd/d10/d17/d23/d2e/d31/d7e/dbc/f66 [0,4194304] 0 2024-09-12T22:33:16.548 INFO:tasks.workunit.client.0.smithi019.stdout:0/753: creat d1/d14/d26/d40/d45/ff3 x:0 0 0 2024-09-12T22:33:16.550 INFO:tasks.workunit.client.0.smithi019.stdout:0/754: write d1/d14/dad/fbd [2937268,19273] 0 2024-09-12T22:33:16.550 INFO:tasks.workunit.client.0.smithi019.stdout:3/667: dread dd/d12/f7a [4194304,4194304] 0 2024-09-12T22:33:16.552 INFO:tasks.workunit.client.0.smithi019.stdout:9/701: fdatasync dd/d10/d17/d22/d6c/d53/f5c 0 2024-09-12T22:33:16.552 INFO:tasks.workunit.client.0.smithi019.stdout:8/723: dwrite d7/d8/d43/f9a [0,4194304] 0 2024-09-12T22:33:16.552 INFO:tasks.workunit.client.0.smithi019.stdout:3/668: stat dd/d1e/c9e 0 2024-09-12T22:33:16.552 INFO:tasks.workunit.client.0.smithi019.stdout:5/806: creat d0/d7/d2d/d32/d36/d8c/db8/d24/d64/f11b x:0 0 0 2024-09-12T22:33:16.554 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:33:16.555 INFO:tasks.workunit.client.0.smithi019.stdout:6/785: dwrite d1b/d26/f96 [0,4194304] 0 2024-09-12T22:33:16.555 INFO:tasks.workunit.client.0.smithi019.stdout:0/755: mkdir d1/d14/d1b/d3a/df4 0 2024-09-12T22:33:16.555 INFO:tasks.workunit.client.0.smithi019.stdout:3/669: chown dd/d12/f24 74501257 1 2024-09-12T22:33:16.555 INFO:tasks.workunit.client.0.smithi019.stdout:9/702: stat dd/d10/d17/d23/d2e/d31/d3f/l4d 0 2024-09-12T22:33:16.555 INFO:tasks.workunit.client.0.smithi019.stdout:8/724: truncate d7/d2f/d42/fd1 695360 0 2024-09-12T22:33:16.555 INFO:tasks.workunit.client.0.smithi019.stdout:3/670: stat dd/d1e/d40/da6 0 2024-09-12T22:33:16.556 INFO:tasks.workunit.client.0.smithi019.stdout:6/786: symlink d1b/d26/d31/dd6/l110 0 2024-09-12T22:33:16.557 INFO:tasks.workunit.client.0.smithi019.stdout:3/671: mknod dd/d1e/cd0 0 2024-09-12T22:33:16.558 INFO:tasks.workunit.client.0.smithi019.stdout:4/744: dwrite d1/d22/d2c/f35 [4194304,4194304] 0 2024-09-12T22:33:16.559 INFO:tasks.workunit.client.0.smithi019.stdout:9/703: truncate dd/d10/d17/d22/f3e 1048967 0 2024-09-12T22:33:16.559 INFO:tasks.workunit.client.0.smithi019.stdout:6/787: fsync d1b/d26/d31/f4e 0 2024-09-12T22:33:16.560 INFO:tasks.workunit.client.0.smithi019.stdout:3/672: write dd/d1e/d82/f89 [2378099,102434] 0 2024-09-12T22:33:16.562 INFO:tasks.workunit.client.0.smithi019.stdout:9/704: mkdir dd/d10/d17/d23/d2e/d31/d7e/dbc/ddd/de2 0 2024-09-12T22:33:16.562 INFO:tasks.workunit.client.0.smithi019.stdout:6/788: creat d1b/d26/d31/d5f/f111 x:0 0 0 2024-09-12T22:33:16.563 INFO:tasks.workunit.client.0.smithi019.stdout:4/745: rename d1/d22/fd2 to d1/d4c/db0/d75/d5a/d79/db4/f100 0 2024-09-12T22:33:16.564 INFO:tasks.workunit.client.0.smithi019.stdout:3/673: creat dd/d12/d62/d6a/fd1 x:0 0 0 2024-09-12T22:33:16.564 INFO:tasks.workunit.client.0.smithi019.stdout:5/807: dwrite d0/d7/d2d/d32/d36/d8c/db8/d24/ff4 [0,4194304] 0 2024-09-12T22:33:16.564 INFO:tasks.workunit.client.0.smithi019.stdout:8/725: dwrite d7/f29 [0,4194304] 0 2024-09-12T22:33:16.565 INFO:tasks.workunit.client.0.smithi019.stdout:9/705: write dd/f9e [1090291,13705] 0 2024-09-12T22:33:16.565 INFO:tasks.workunit.client.0.smithi019.stdout:3/674: chown dd/d1e/d40/da6/dba 14 1 2024-09-12T22:33:16.565 INFO:tasks.workunit.client.0.smithi019.stdout:4/746: mkdir d1/d22/d31/d101 0 2024-09-12T22:33:16.565 INFO:tasks.workunit.client.0.smithi019.stdout:8/726: rmdir d7/d8/d43 39 2024-09-12T22:33:16.566 INFO:tasks.workunit.client.0.smithi019.stdout:5/808: write d0/d7/d16/f91 [145261,111764] 0 2024-09-12T22:33:16.567 INFO:tasks.workunit.client.0.smithi019.stdout:3/675: creat dd/d12/d62/d74/daa/fd2 x:0 0 0 2024-09-12T22:33:16.567 INFO:tasks.workunit.client.0.smithi019.stdout:4/747: rename d1/c51 to d1/d4/d38/dbf/c102 0 2024-09-12T22:33:16.568 INFO:tasks.workunit.client.0.smithi019.stdout:4/748: chown d1/d11/f23 863918 1 2024-09-12T22:33:16.568 INFO:tasks.workunit.client.0.smithi019.stdout:3/676: creat dd/d1e/d40/fd3 x:0 0 0 2024-09-12T22:33:16.569 INFO:tasks.workunit.client.0.smithi019.stdout:3/677: rmdir dd/d12/d62/d74 39 2024-09-12T22:33:16.570 INFO:tasks.workunit.client.0.smithi019.stdout:3/678: write dd/d12/fc1 [674398,84121] 0 2024-09-12T22:33:16.570 INFO:tasks.workunit.client.0.smithi019.stdout:4/749: mknod d1/d4/d38/d77/ddd/c103 0 2024-09-12T22:33:16.571 INFO:tasks.workunit.client.0.smithi019.stdout:3/679: truncate dd/d1e/d40/fd3 185317 0 2024-09-12T22:33:16.571 INFO:tasks.workunit.client.0.smithi019.stdout:3/680: read f2 [11397984,121894] 0 2024-09-12T22:33:16.572 INFO:tasks.workunit.client.0.smithi019.stdout:3/681: mkdir dd/d1e/d40/d5f/dd4 0 2024-09-12T22:33:16.572 INFO:tasks.workunit.client.0.smithi019.stdout:4/750: dread - d1/d4/d38/dbf/fca zero size 2024-09-12T22:33:16.573 INFO:tasks.workunit.client.0.smithi019.stdout:4/751: mknod d1/c104 0 2024-09-12T22:33:16.574 INFO:tasks.workunit.client.0.smithi019.stdout:3/682: getdents dd/d12/d62/d78/d98 0 2024-09-12T22:33:16.575 INFO:tasks.workunit.client.0.smithi019.stdout:4/752: rename d1/d11/d15/d1f/f84 to d1/d4/da6/f105 0 2024-09-12T22:33:16.576 INFO:tasks.workunit.client.0.smithi019.stdout:4/753: creat d1/d22/d31/d101/f106 x:0 0 0 2024-09-12T22:33:16.576 INFO:tasks.workunit.client.0.smithi019.stdout:4/754: mkdir d1/d22/d2c/d107 0 2024-09-12T22:33:16.577 INFO:tasks.workunit.client.0.smithi019.stdout:2/719: dread d0/d5/d60/d71/fc8 [0,4194304] 0 2024-09-12T22:33:16.577 INFO:tasks.workunit.client.0.smithi019.stdout:3/683: dread dd/d1e/f3c [0,4194304] 0 2024-09-12T22:33:16.577 INFO:tasks.workunit.client.0.smithi019.stdout:8/727: truncate d7/d2f/d75/f76 912128 0 2024-09-12T22:33:16.577 INFO:tasks.workunit.client.0.smithi019.stdout:8/728: stat d7/d8/dd/f21 0 2024-09-12T22:33:16.578 INFO:tasks.workunit.client.0.smithi019.stdout:9/706: truncate dd/d10/d17/d22/f3e 1901454 0 2024-09-12T22:33:16.578 INFO:tasks.workunit.client.0.smithi019.stdout:3/684: dread - dd/d12/d62/d6a/fbc zero size 2024-09-12T22:33:16.578 INFO:tasks.workunit.client.0.smithi019.stdout:2/720: creat d0/d5/d18/d39/ff4 x:0 0 0 2024-09-12T22:33:16.578 INFO:tasks.workunit.client.0.smithi019.stdout:3/685: read dd/f11 [9807667,20390] 0 2024-09-12T22:33:16.579 INFO:tasks.workunit.client.0.smithi019.stdout:2/721: creat d0/d5/dd6/ff5 x:0 0 0 2024-09-12T22:33:16.579 INFO:tasks.workunit.client.0.smithi019.stdout:9/707: fdatasync dd/d10/d17/d23/d2e/d31/d3f/f4b 0 2024-09-12T22:33:16.579 INFO:tasks.workunit.client.0.smithi019.stdout:3/686: dread - dd/d12/d62/d78/d98/fb6 zero size 2024-09-12T22:33:16.580 INFO:tasks.workunit.client.0.smithi019.stdout:9/708: dread - dd/d10/d17/d23/d2e/d31/d3f/fa2 zero size 2024-09-12T22:33:16.581 INFO:tasks.workunit.client.0.smithi019.stdout:3/687: unlink dd/d1e/c56 0 2024-09-12T22:33:16.581 INFO:tasks.workunit.client.0.smithi019.stdout:9/709: dread - dd/d10/d17/d76/dcc/fd7 zero size 2024-09-12T22:33:16.581 INFO:tasks.workunit.client.0.smithi019.stdout:3/688: write dd/d12/d62/d78/d98/fb6 [585546,50357] 0 2024-09-12T22:33:16.582 INFO:tasks.workunit.client.0.smithi019.stdout:9/710: rmdir dd/d10/d17/d22/d6c/d53/d69 39 2024-09-12T22:33:16.583 INFO:tasks.workunit.client.0.smithi019.stdout:3/689: write dd/d1e/d82/f87 [1884733,18381] 0 2024-09-12T22:33:16.583 INFO:tasks.workunit.client.0.smithi019.stdout:3/690: write dd/d12/d62/d78/f8b [1556104,78346] 0 2024-09-12T22:33:16.583 INFO:tasks.workunit.client.0.smithi019.stdout:1/815: sync 2024-09-12T22:33:16.585 INFO:tasks.workunit.client.0.smithi019.stdout:3/691: dwrite dd/f16 [0,4194304] 0 2024-09-12T22:33:16.586 INFO:tasks.workunit.client.0.smithi019.stdout:3/692: stat dd/d12/c53 0 2024-09-12T22:33:16.588 INFO:tasks.workunit.client.0.smithi019.stdout:3/693: link dd/f33 dd/d1e/fd5 0 2024-09-12T22:33:16.589 INFO:tasks.workunit.client.0.smithi019.stdout:8/729: write d7/d8/fab [797941,116652] 0 2024-09-12T22:33:16.589 INFO:tasks.workunit.client.0.smithi019.stdout:3/694: creat dd/d1e/d40/fd6 x:0 0 0 2024-09-12T22:33:16.590 INFO:tasks.workunit.client.0.smithi019.stdout:8/730: stat d7/d8/l8e 0 2024-09-12T22:33:16.591 INFO:tasks.workunit.client.0.smithi019.stdout:3/695: write dd/f4d [424489,115141] 0 2024-09-12T22:33:16.593 INFO:tasks.workunit.client.0.smithi019.stdout:3/696: write dd/d1e/d82/f89 [2094963,111153] 0 2024-09-12T22:33:16.594 INFO:tasks.workunit.client.0.smithi019.stdout:8/731: dwrite d7/d8/f73 [0,4194304] 0 2024-09-12T22:33:16.594 INFO:tasks.workunit.client.0.smithi019.stdout:3/697: creat dd/d12/d62/d78/fd7 x:0 0 0 2024-09-12T22:33:16.596 INFO:tasks.workunit.client.0.smithi019.stdout:8/732: link d7/d8/dd/f67 d7/d34/d78/d54/fe4 0 2024-09-12T22:33:16.597 INFO:tasks.workunit.client.0.smithi019.stdout:8/733: rename d7/d8/f25 to d7/d34/d78/d54/fe5 0 2024-09-12T22:33:16.598 INFO:tasks.workunit.client.0.smithi019.stdout:3/698: dread dd/d1e/d5a/f94 [0,4194304] 0 2024-09-12T22:33:16.599 INFO:tasks.workunit.client.0.smithi019.stdout:8/734: rmdir d7/d8/d43/d87 39 2024-09-12T22:33:16.599 INFO:tasks.workunit.client.0.smithi019.stdout:3/699: mkdir dd/d12/d62/dd8 0 2024-09-12T22:33:16.600 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:16.599+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:16.600 INFO:tasks.workunit.client.0.smithi019.stdout:8/735: creat d7/d2f/d42/d98/fe6 x:0 0 0 2024-09-12T22:33:16.601 INFO:tasks.workunit.client.0.smithi019.stdout:3/700: readlink dd/d12/d62/d74/l8a 0 2024-09-12T22:33:16.601 INFO:tasks.workunit.client.0.smithi019.stdout:8/736: chown d7/d8/d43/f9f 496 1 2024-09-12T22:33:16.601 INFO:tasks.workunit.client.0.smithi019.stdout:8/737: mknod d7/d34/d78/d82/ce7 0 2024-09-12T22:33:16.605 INFO:tasks.workunit.client.0.smithi019.stdout:3/701: dwrite dd/d1e/f3c [0,4194304] 0 2024-09-12T22:33:16.608 INFO:tasks.workunit.client.0.smithi019.stdout:8/738: dwrite d7/d34/d78/d54/f95 [0,4194304] 0 2024-09-12T22:33:16.608 INFO:tasks.workunit.client.0.smithi019.stdout:3/702: write dd/d12/f30 [3004317,109732] 0 2024-09-12T22:33:16.608 INFO:tasks.workunit.client.0.smithi019.stdout:3/703: write dd/d12/f65 [2079509,22315] 0 2024-09-12T22:33:16.608 INFO:tasks.workunit.client.0.smithi019.stdout:3/704: write dd/f2a [2432250,8489] 0 2024-09-12T22:33:16.609 INFO:tasks.workunit.client.0.smithi019.stdout:8/739: symlink d7/d2f/d75/dc7/le8 0 2024-09-12T22:33:16.610 INFO:tasks.workunit.client.0.smithi019.stdout:3/705: write dd/d12/d62/d78/f8b [510201,53454] 0 2024-09-12T22:33:16.611 INFO:tasks.workunit.client.0.smithi019.stdout:1/816: dread d3/df/d7e/db7/d63/ff6 [0,4194304] 0 2024-09-12T22:33:16.611 INFO:tasks.workunit.client.0.smithi019.stdout:3/706: fsync dd/d12/f7a 0 2024-09-12T22:33:16.611 INFO:tasks.workunit.client.0.smithi019.stdout:8/740: link d7/d34/d78/d53/da8/fd6 d7/d2f/fe9 0 2024-09-12T22:33:16.612 INFO:tasks.workunit.client.0.smithi019.stdout:3/707: truncate dd/f33 4698640 0 2024-09-12T22:33:16.612 INFO:tasks.workunit.client.0.smithi019.stdout:1/817: link d3/d3f/d58/f93 d3/d3f/d58/d101/f105 0 2024-09-12T22:33:16.613 INFO:tasks.workunit.client.0.smithi019.stdout:1/818: write d3/df/d7e/db7/f2c [8937293,93390] 0 2024-09-12T22:33:16.614 INFO:tasks.workunit.client.0.smithi019.stdout:5/809: dread d0/d7/d16/d18/f19 [0,4194304] 0 2024-09-12T22:33:16.614 INFO:tasks.workunit.client.0.smithi019.stdout:1/819: write d3/df/d7e/db7/f4f [365896,72144] 0 2024-09-12T22:33:16.616 INFO:tasks.workunit.client.0.smithi019.stdout:5/810: symlink d0/d7/d2d/d32/d36/d8c/db8/d39/d38/l11c 0 2024-09-12T22:33:16.617 INFO:tasks.workunit.client.0.smithi019.stdout:8/741: dwrite d7/d8/dd/d45/fe1 [0,4194304] 0 2024-09-12T22:33:16.618 INFO:tasks.workunit.client.0.smithi019.stdout:8/742: mknod d7/d2f/d42/cea 0 2024-09-12T22:33:16.618 INFO:tasks.workunit.client.0.smithi019.stdout:5/811: mknod d0/d7/d2d/d32/d36/d8c/db8/d39/c11d 0 2024-09-12T22:33:16.619 INFO:tasks.workunit.client.0.smithi019.stdout:3/708: dwrite dd/d1e/f3c [0,4194304] 0 2024-09-12T22:33:16.620 INFO:tasks.workunit.client.0.smithi019.stdout:8/743: write d7/d2f/d42/f92 [3330939,27579] 0 2024-09-12T22:33:16.620 INFO:tasks.workunit.client.0.smithi019.stdout:5/812: chown d0/d7/d16/d18/dae/c111 155550 1 2024-09-12T22:33:16.620 INFO:tasks.workunit.client.0.smithi019.stdout:1/820: dread d3/df/d7e/db7/d16/f60 [0,4194304] 0 2024-09-12T22:33:16.621 INFO:tasks.workunit.client.0.smithi019.stdout:3/709: truncate dd/d1e/d40/fb8 951707 0 2024-09-12T22:33:16.621 INFO:tasks.workunit.client.0.smithi019.stdout:8/744: creat d7/d2f/d42/feb x:0 0 0 2024-09-12T22:33:16.621 INFO:tasks.workunit.client.0.smithi019.stdout:5/813: readlink d0/d7/d16/d69/l9c 0 2024-09-12T22:33:16.625 INFO:tasks.workunit.client.0.smithi019.stdout:8/745: dread - d7/d8/dd/d45/dc5/fbd zero size 2024-09-12T22:33:16.625 INFO:tasks.workunit.client.0.smithi019.stdout:7/656: sync 2024-09-12T22:33:16.625 INFO:tasks.workunit.client.0.smithi019.stdout:9/711: sync 2024-09-12T22:33:16.625 INFO:tasks.workunit.client.0.smithi019.stdout:4/755: sync 2024-09-12T22:33:16.625 INFO:tasks.workunit.client.0.smithi019.stdout:2/722: sync 2024-09-12T22:33:16.625 INFO:tasks.workunit.client.0.smithi019.stdout:6/789: sync 2024-09-12T22:33:16.625 INFO:tasks.workunit.client.0.smithi019.stdout:0/756: sync 2024-09-12T22:33:16.625 INFO:tasks.workunit.client.0.smithi019.stdout:8/746: write d7/d5e/f6b [827521,74107] 0 2024-09-12T22:33:16.625 INFO:tasks.workunit.client.0.smithi019.stdout:6/790: chown d1b/d26/d27 4 1 2024-09-12T22:33:16.626 INFO:tasks.workunit.client.0.smithi019.stdout:2/723: mknod d0/d5/d17/d91/cf6 0 2024-09-12T22:33:16.627 INFO:tasks.workunit.client.0.smithi019.stdout:1/821: link d3/df/d7e/db7/d16/d3c/dbd/de6/f27 d3/df/d7e/d90/dda/f106 0 2024-09-12T22:33:16.627 INFO:tasks.workunit.client.0.smithi019.stdout:5/814: getdents d0/d7/d2d/d32/d36/d8c/db8/d39/d38/d4b/dde 0 2024-09-12T22:33:16.627 INFO:tasks.workunit.client.0.smithi019.stdout:7/657: mknod d6/d14/d45/d7c/cf7 0 2024-09-12T22:33:16.628 INFO:tasks.workunit.client.0.smithi019.stdout:9/712: mkdir dd/d10/d17/d22/d6c/d53/de3 0 2024-09-12T22:33:16.628 INFO:tasks.workunit.client.0.smithi019.stdout:6/791: fsync d1b/d26/d39/d89/d90/ff0 0 2024-09-12T22:33:16.628 INFO:tasks.workunit.client.0.smithi019.stdout:8/747: creat d7/d34/d78/d53/da8/fec x:0 0 0 2024-09-12T22:33:16.628 INFO:tasks.workunit.client.0.smithi019.stdout:3/710: dread dd/f16 [0,4194304] 0 2024-09-12T22:33:16.628 INFO:tasks.workunit.client.0.smithi019.stdout:4/756: link d1/d11/d15/d1f/f52 d1/d11/f108 0 2024-09-12T22:33:16.628 INFO:tasks.workunit.client.0.smithi019.stdout:1/822: symlink d3/l107 0 2024-09-12T22:33:16.628 INFO:tasks.workunit.client.0.smithi019.stdout:2/724: creat d0/d5/d60/d74/d7e/ff7 x:0 0 0 2024-09-12T22:33:16.629 INFO:tasks.workunit.client.0.smithi019.stdout:8/748: truncate d7/d2f/fe9 547861 0 2024-09-12T22:33:16.629 INFO:tasks.workunit.client.0.smithi019.stdout:5/815: write d0/d7/d2d/d32/d36/d8c/db8/d39/fc1 [824908,72198] 0 2024-09-12T22:33:16.629 INFO:tasks.workunit.client.0.smithi019.stdout:7/658: fdatasync d6/d14/d2a/da4/d34/f7b 0 2024-09-12T22:33:16.630 INFO:tasks.workunit.client.0.smithi019.stdout:3/711: write dd/d12/d62/d78/d98/fb6 [213815,49061] 0 2024-09-12T22:33:16.631 INFO:tasks.workunit.client.0.smithi019.stdout:6/792: truncate d1b/d26/d31/dd6/fa3 198438 0 2024-09-12T22:33:16.631 INFO:tasks.workunit.client.0.smithi019.stdout:5/816: chown d0/d7/d2d/d32/d36/d8c/db8/d24/d64 393523 1 2024-09-12T22:33:16.631 INFO:tasks.workunit.client.0.smithi019.stdout:3/712: rmdir dd/d12/d62 39 2024-09-12T22:33:16.632 INFO:tasks.workunit.client.0.smithi019.stdout:8/749: creat d7/d34/d78/d53/fed x:0 0 0 2024-09-12T22:33:16.632 INFO:tasks.workunit.client.0.smithi019.stdout:5/817: chown d0 12 1 2024-09-12T22:33:16.632 INFO:tasks.workunit.client.0.smithi019.stdout:2/725: rename d0/d5/d18/d1b/d5d/d86/f61 to d0/d5/d60/ff8 0 2024-09-12T22:33:16.633 INFO:tasks.workunit.client.0.smithi019.stdout:3/713: write dd/d12/f35 [3564753,100028] 0 2024-09-12T22:33:16.634 INFO:tasks.workunit.client.0.smithi019.stdout:2/726: read d0/da/f50 [4617633,66258] 0 2024-09-12T22:33:16.635 INFO:tasks.workunit.client.0.smithi019.stdout:7/659: write d6/d14/d45/db0/fc6 [3351646,79640] 0 2024-09-12T22:33:16.635 INFO:tasks.workunit.client.0.smithi019.stdout:4/757: dwrite d1/d4c/f72 [0,4194304] 0 2024-09-12T22:33:16.635 INFO:tasks.workunit.client.0.smithi019.stdout:6/793: rename d1b/d26/d31/f10e to d1b/d26/d31/d5f/d91/de7/f112 0 2024-09-12T22:33:16.636 INFO:tasks.workunit.client.0.smithi019.stdout:2/727: dread - d0/d5/d60/d71/faa zero size 2024-09-12T22:33:16.636 INFO:tasks.workunit.client.0.smithi019.stdout:5/818: truncate d0/f1a 2042971 0 2024-09-12T22:33:16.637 INFO:tasks.workunit.client.0.smithi019.stdout:8/750: rename d7/d5e/f6b to d7/d8/dd/d45/dc5/fee 0 2024-09-12T22:33:16.637 INFO:tasks.workunit.client.0.smithi019.stdout:0/757: sync 2024-09-12T22:33:16.638 INFO:tasks.workunit.client.0.smithi019.stdout:7/660: mkdir d6/d14/d45/dca/df8 0 2024-09-12T22:33:16.641 INFO:tasks.workunit.client.0.smithi019.stdout:4/758: write d1/d22/f33 [805149,28402] 0 2024-09-12T22:33:16.641 INFO:tasks.workunit.client.0.smithi019.stdout:9/713: dwrite dd/d10/d17/d23/d2e/d31/d7e/dbc/f71 [0,4194304] 0 2024-09-12T22:33:16.641 INFO:tasks.workunit.client.0.smithi019.stdout:0/758: write d1/d14/d26/d40/f95 [37654,94066] 0 2024-09-12T22:33:16.643 INFO:tasks.workunit.client.0.smithi019.stdout:2/728: getdents d0/d5/d18/d3b 0 2024-09-12T22:33:16.645 INFO:tasks.workunit.client.0.smithi019.stdout:0/759: mknod d1/d51/cf5 0 2024-09-12T22:33:16.646 INFO:tasks.workunit.client.0.smithi019.stdout:8/751: getdents d7/d8/dd 0 2024-09-12T22:33:16.646 INFO:tasks.workunit.client.0.smithi019.stdout:3/714: dwrite dd/d12/f7a [8388608,4194304] 0 2024-09-12T22:33:16.646 INFO:tasks.workunit.client.0.smithi019.stdout:4/759: creat d1/d22/d2c/f109 x:0 0 0 2024-09-12T22:33:16.646 INFO:tasks.workunit.client.0.smithi019.stdout:2/729: mkdir d0/d5/d18/d3b/df9 0 2024-09-12T22:33:16.647 INFO:tasks.workunit.client.0.smithi019.stdout:8/752: mkdir d7/d8/dd/def 0 2024-09-12T22:33:16.648 INFO:tasks.workunit.client.0.smithi019.stdout:6/794: dwrite d1b/d2d/f48 [0,4194304] 0 2024-09-12T22:33:16.651 INFO:tasks.workunit.client.0.smithi019.stdout:4/760: read - d1/d11/d15/d1f/d56/dac/fcb zero size 2024-09-12T22:33:16.651 INFO:tasks.workunit.client.0.smithi019.stdout:0/760: write d1/d14/d1b/d3a/d8c/dae/faf [856265,55576] 0 2024-09-12T22:33:16.654 INFO:tasks.workunit.client.0.smithi019.stdout:2/730: truncate d0/d5/d18/d1b/d5d/d86/d90/fb7 112302 0 2024-09-12T22:33:16.655 INFO:tasks.workunit.client.0.smithi019.stdout:5/819: dwrite d0/d7/d16/d69/fd4 [0,4194304] 0 2024-09-12T22:33:16.655 INFO:tasks.workunit.client.0.smithi019.stdout:8/753: dread - d7/d34/d78/d53/da8/fec zero size 2024-09-12T22:33:16.656 INFO:tasks.workunit.client.0.smithi019.stdout:0/761: mknod d1/d14/d1b/cf6 0 2024-09-12T22:33:16.656 INFO:tasks.workunit.client.0.smithi019.stdout:9/714: rename dd/d10/d17/d23/d2e/d31/d3f/d47/fd0 to dd/d10/d17/d22/d6c/d53/d69/d9d/dbd/fe4 0 2024-09-12T22:33:16.656 INFO:tasks.workunit.client.0.smithi019.stdout:8/754: mknod d7/d2f/cf0 0 2024-09-12T22:33:16.658 INFO:tasks.workunit.client.0.smithi019.stdout:0/762: chown d1/f4d 2 1 2024-09-12T22:33:16.658 INFO:tasks.workunit.client.0.smithi019.stdout:7/661: dwrite d6/d14/d2a/da4/dc/d63/d4b/f5a [4194304,4194304] 0 2024-09-12T22:33:16.659 INFO:tasks.workunit.client.0.smithi019.stdout:5/820: write d0/d7/d2d/d32/d36/d8c/fea [1138675,66577] 0 2024-09-12T22:33:16.660 INFO:tasks.workunit.client.0.smithi019.stdout:3/715: dwrite dd/d1e/d40/d5f/f9a [0,4194304] 0 2024-09-12T22:33:16.661 INFO:tasks.workunit.client.0.smithi019.stdout:2/731: link d0/da/c2c d0/d5/d18/d5c/d85/cfa 0 2024-09-12T22:33:16.661 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:16.660+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:16.661 INFO:tasks.workunit.client.0.smithi019.stdout:5/821: chown d0/d7/d2d/d32/d36/ddc 87040719 1 2024-09-12T22:33:16.661 INFO:tasks.workunit.client.0.smithi019.stdout:7/662: chown d6/d14/d2a/da4/d42/lcc 209624 1 2024-09-12T22:33:16.662 INFO:tasks.workunit.client.0.smithi019.stdout:9/715: creat dd/d10/d17/d22/d42/fe5 x:0 0 0 2024-09-12T22:33:16.662 INFO:tasks.workunit.client.0.smithi019.stdout:3/716: chown dd/d1e/d5a/f6b 101728319 1 2024-09-12T22:33:16.663 INFO:tasks.workunit.client.0.smithi019.stdout:0/763: unlink d1/d14/dad/dc0/fd7 0 2024-09-12T22:33:16.663 INFO:tasks.workunit.client.0.smithi019.stdout:4/761: dwrite d1/d8/f45 [4194304,4194304] 0 2024-09-12T22:33:16.664 INFO:tasks.workunit.client.0.smithi019.stdout:0/764: fsync d1/f1a 0 2024-09-12T22:33:16.664 INFO:tasks.workunit.client.0.smithi019.stdout:0/765: sync 2024-09-12T22:33:16.665 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T22:33:16.666 INFO:tasks.workunit.client.0.smithi019.stdout:1/823: dread d3/df/d7e/db7/d16/d3c/dbd/de6/f5d [0,4194304] 0 2024-09-12T22:33:16.666 INFO:tasks.workunit.client.0.smithi019.stdout:5/822: readlink d0/d7/d2d/d32/d36/d8c/db8/d24/lca 0 2024-09-12T22:33:16.667 INFO:tasks.workunit.client.0.smithi019.stdout:4/762: readlink d1/d4/d44/l5c 0 2024-09-12T22:33:16.670 INFO:tasks.workunit.client.0.smithi019.stdout:9/716: mknod dd/d10/d17/d22/d6c/d53/ce6 0 2024-09-12T22:33:16.670 INFO:tasks.workunit.client.0.smithi019.stdout:7/663: rename d6/d2d/d77/fb8 to d6/d14/d2a/da4/d34/ff9 0 2024-09-12T22:33:16.670 INFO:tasks.workunit.client.0.smithi019.stdout:8/755: dwrite d7/d8/d43/d87/fd8 [0,4194304] 0 2024-09-12T22:33:16.670 INFO:tasks.workunit.client.0.smithi019.stdout:1/824: write d3/df/d7e/d90/fab [321145,49351] 0 2024-09-12T22:33:16.670 INFO:tasks.workunit.client.0.smithi019.stdout:0/766: write d1/d14/d26/d40/d45/d5e/f98 [244335,104622] 0 2024-09-12T22:33:16.671 INFO:tasks.workunit.client.0.smithi019.stdout:4/763: creat d1/d8/dfb/dfc/f10a x:0 0 0 2024-09-12T22:33:16.672 INFO:tasks.workunit.client.0.smithi019.stdout:3/717: dread dd/d1e/d5a/f5b [0,4194304] 0 2024-09-12T22:33:16.673 INFO:tasks.workunit.client.0.smithi019.stdout:9/717: chown dd/d10/d17/d23/d2e/d31/d3f/d67/fac 631964 1 2024-09-12T22:33:16.674 INFO:tasks.workunit.client.0.smithi019.stdout:4/764: fsync d1/d11/d15/d1f/ff3 0 2024-09-12T22:33:16.674 INFO:tasks.workunit.client.0.smithi019.stdout:5/823: mknod d0/d7/d2d/d32/d36/d8c/db8/d39/df7/c11e 0 2024-09-12T22:33:16.674 INFO:tasks.workunit.client.0.smithi019.stdout:2/732: dwrite d0/d5/d18/d5c/d67/d77/fc4 [0,4194304] 0 2024-09-12T22:33:16.674 INFO:tasks.workunit.client.0.smithi019.stdout:0/767: symlink d1/d14/dad/dcc/lf7 0 2024-09-12T22:33:16.675 INFO:tasks.workunit.client.0.smithi019.stdout:1/825: rename d3/df/d7e/db7/d16/d3c/fac to d3/d3f/d77/f108 0 2024-09-12T22:33:16.676 INFO:tasks.workunit.client.0.smithi019.stdout:3/718: fdatasync dd/d1e/d40/f90 0 2024-09-12T22:33:16.677 INFO:tasks.workunit.client.0.smithi019.stdout:8/756: getdents d7/d8/dd 0 2024-09-12T22:33:16.677 INFO:tasks.workunit.client.0.smithi019.stdout:4/765: creat d1/d11/f10b x:0 0 0 2024-09-12T22:33:16.677 INFO:tasks.workunit.client.0.smithi019.stdout:5/824: chown d0/d7/d2d/d32/d36/d8c/db8 23 1 2024-09-12T22:33:16.678 INFO:tasks.workunit.client.0.smithi019.stdout:4/766: mkdir d1/d8/dfb/d10c 0 2024-09-12T22:33:16.679 INFO:tasks.workunit.client.0.smithi019.stdout:9/718: write dd/d10/d17/d23/d2e/d31/d7e/dbc/fa7 [864456,88464] 0 2024-09-12T22:33:16.679 INFO:tasks.workunit.client.0.smithi019.stdout:1/826: creat d3/df/d7e/db7/d16/d3c/dbd/de4/f109 x:0 0 0 2024-09-12T22:33:16.680 INFO:tasks.workunit.client.0.smithi019.stdout:4/767: chown d1/d22/d31/d4f/l8d 2182208 1 2024-09-12T22:33:16.680 INFO:tasks.workunit.client.0.smithi019.stdout:9/719: creat dd/fe7 x:0 0 0 2024-09-12T22:33:16.682 INFO:tasks.workunit.client.0.smithi019.stdout:1/827: chown d3/df/d7e/db7/d16/d3c/dbd/de6/f21 29 1 2024-09-12T22:33:16.682 INFO:tasks.workunit.client.0.smithi019.stdout:4/768: symlink d1/d4/dec/l10d 0 2024-09-12T22:33:16.683 INFO:tasks.workunit.client.0.smithi019.stdout:9/720: stat dd/d10/d17/d23/d2e/d31/d7e/dbc/ddd/de2 0 2024-09-12T22:33:16.683 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:33:16.683 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:33:16.684 INFO:tasks.workunit.client.0.smithi019.stdout:0/768: dwrite d1/d14/d26/d40/d45/d5e/d84/f9e [0,4194304] 0 2024-09-12T22:33:16.684 INFO:tasks.workunit.client.0.smithi019.stdout:4/769: symlink d1/d4/d38/dc4/dc2/l10e 0 2024-09-12T22:33:16.684 INFO:tasks.workunit.client.0.smithi019.stdout:5/825: dread d0/d7/d2d/d32/d36/d8c/db8/d24/ff4 [0,4194304] 0 2024-09-12T22:33:16.686 INFO:tasks.workunit.client.0.smithi019.stdout:1/828: rename d3/df/d7e/db7/f2c to d3/df/d7e/db7/d16/d3c/dbd/dc4/dc3/f10a 0 2024-09-12T22:33:16.686 INFO:tasks.workunit.client.0.smithi019.stdout:4/770: unlink d1/d11/d15/d1f/d56/dac/fcb 0 2024-09-12T22:33:16.687 INFO:tasks.workunit.client.0.smithi019.stdout:5/826: chown d0/d7/d2d/d32/c43 434108888 1 2024-09-12T22:33:16.688 INFO:tasks.workunit.client.0.smithi019.stdout:4/771: rmdir d1/d22/d57 39 2024-09-12T22:33:16.688 INFO:tasks.workunit.client.0.smithi019.stdout:0/769: getdents d1/d14/d26/d40/d45/d5e/ddf 0 2024-09-12T22:33:16.689 INFO:tasks.workunit.client.0.smithi019.stdout:5/827: mknod d0/d7/d2d/d32/d36/d8c/db8/d39/d38/dba/dc7/df6/c11f 0 2024-09-12T22:33:16.690 INFO:tasks.workunit.client.0.smithi019.stdout:9/721: read dd/d10/d17/d23/d37/f5b [723473,124776] 0 2024-09-12T22:33:16.690 INFO:tasks.workunit.client.0.smithi019.stdout:4/772: symlink d1/d8/l10f 0 2024-09-12T22:33:16.690 INFO:tasks.workunit.client.0.smithi019.stdout:0/770: fsync d1/d1f/d5b/d83/fac 0 2024-09-12T22:33:16.690 INFO:tasks.workunit.client.0.smithi019.stdout:5/828: mkdir d0/db9/d120 0 2024-09-12T22:33:16.691 INFO:tasks.workunit.client.0.smithi019.stdout:9/722: fdatasync dd/d10/d17/d76/dcc/fd7 0 2024-09-12T22:33:16.691 INFO:tasks.workunit.client.0.smithi019.stdout:5/829: fdatasync d0/f37 0 2024-09-12T22:33:16.693 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:33:16.693 INFO:tasks.workunit.client.0.smithi019.stdout:0/771: mkdir d1/d14/d26/d40/d45/d5e/df8 0 2024-09-12T22:33:16.693 INFO:tasks.workunit.client.0.smithi019.stdout:1/829: dwrite d3/df/d7e/db7/f47 [0,4194304] 0 2024-09-12T22:33:16.694 INFO:tasks.workunit.client.0.smithi019.stdout:5/830: mknod d0/d7/d2d/d32/d36/d8c/db8/d24/c121 0 2024-09-12T22:33:16.694 INFO:tasks.workunit.client.0.smithi019.stdout:1/830: chown d3/df/d7e/db7/d63/de7 16413 1 2024-09-12T22:33:16.694 INFO:tasks.workunit.client.0.smithi019.stdout:9/723: read dd/d10/f14 [3818690,121995] 0 2024-09-12T22:33:16.695 INFO:tasks.workunit.client.0.smithi019.stdout:0/772: write d1/d14/d26/d40/d45/fd5 [14617,35678] 0 2024-09-12T22:33:16.695 INFO:tasks.workunit.client.0.smithi019.stdout:1/831: dread - d3/df/d7e/db7/d16/d3c/ffd zero size 2024-09-12T22:33:16.696 INFO:tasks.workunit.client.0.smithi019.stdout:9/724: write dd/d10/d17/d76/dcc/fdc [708172,48930] 0 2024-09-12T22:33:16.696 INFO:tasks.workunit.client.0.smithi019.stdout:0/773: mknod d1/d1f/d5b/dbf/cf9 0 2024-09-12T22:33:16.697 INFO:tasks.workunit.client.0.smithi019.stdout:4/773: dwrite d1/d22/d31/d4f/ff0 [0,4194304] 0 2024-09-12T22:33:16.698 INFO:tasks.workunit.client.0.smithi019.stdout:0/774: fsync d1/d14/dad/fe7 0 2024-09-12T22:33:16.698 INFO:tasks.workunit.client.0.smithi019.stdout:2/733: sync 2024-09-12T22:33:16.698 INFO:tasks.workunit.client.0.smithi019.stdout:3/719: sync 2024-09-12T22:33:16.698 INFO:tasks.workunit.client.0.smithi019.stdout:9/725: rmdir dd/d10/d17/d23/d2e/d31 39 2024-09-12T22:33:16.699 INFO:tasks.workunit.client.0.smithi019.stdout:4/774: creat d1/d11/d15/d1f/da8/f110 x:0 0 0 2024-09-12T22:33:16.699 INFO:tasks.workunit.client.0.smithi019.stdout:2/734: chown d0/da/f37 2397 1 2024-09-12T22:33:16.701 INFO:tasks.workunit.client.0.smithi019.stdout:2/735: rmdir d0/d5/d17 39 2024-09-12T22:33:16.702 INFO:tasks.workunit.client.0.smithi019.stdout:3/720: symlink dd/d12/d62/dd8/ld9 0 2024-09-12T22:33:16.702 INFO:tasks.workunit.client.0.smithi019.stdout:9/726: read - dd/d10/d17/d22/d6c/f79 zero size 2024-09-12T22:33:16.702 INFO:tasks.workunit.client.0.smithi019.stdout:0/775: chown d1/d1f/d5b/d83/dab/dbe/d9c/fec 1432 1 2024-09-12T22:33:16.703 INFO:tasks.workunit.client.0.smithi019.stdout:1/832: creat d3/df/d7e/db7/d16/d3c/dbd/de6/f10b x:0 0 0 2024-09-12T22:33:16.703 INFO:tasks.workunit.client.0.smithi019.stdout:6/795: dread d1b/d26/d31/dd6/fb2 [0,4194304] 0 2024-09-12T22:33:16.704 INFO:tasks.workunit.client.0.smithi019.stdout:4/775: write d1/d11/d15/d49/ff8 [60527,67464] 0 2024-09-12T22:33:16.705 INFO:tasks.workunit.client.0.smithi019.stdout:5/831: dwrite d0/d7/d2d/d32/d36/d8c/db8/d39/d38/d4b/f99 [0,4194304] 0 2024-09-12T22:33:16.705 INFO:tasks.workunit.client.0.smithi019.stdout:2/736: write d0/da/d73/dcb/f82 [46926,12741] 0 2024-09-12T22:33:16.706 INFO:tasks.workunit.client.0.smithi019.stdout:0/776: dread - d1/d14/d26/d40/d91/fd4 zero size 2024-09-12T22:33:16.706 INFO:tasks.workunit.client.0.smithi019.stdout:9/727: fsync dd/d10/d17/d22/d77/fb5 0 2024-09-12T22:33:16.706 INFO:tasks.workunit.client.0.smithi019.stdout:3/721: link dd/d1e/d40/d5f/lb5 dd/d1e/d40/lda 0 2024-09-12T22:33:16.706 INFO:tasks.workunit.client.0.smithi019.stdout:1/833: dread - d3/df/d7e/db7/d16/d3c/dce/ff7 zero size 2024-09-12T22:33:16.706 INFO:tasks.workunit.client.0.smithi019.stdout:6/796: chown d1b/d26/d27/d67/d77/f8f 63 1 2024-09-12T22:33:16.707 INFO:tasks.workunit.client.0.smithi019.stdout:4/776: readlink d1/d4c/db0/d75/d5a/ld8 0 2024-09-12T22:33:16.707 INFO:tasks.workunit.client.0.smithi019.stdout:3/722: symlink dd/d1e/d5a/ldb 0 2024-09-12T22:33:16.707 INFO:tasks.workunit.client.0.smithi019.stdout:3/723: readlink l0 0 2024-09-12T22:33:16.707 INFO:tasks.workunit.client.0.smithi019.stdout:6/797: read - d1b/d26/d39/fde zero size 2024-09-12T22:33:16.708 INFO:tasks.workunit.client.0.smithi019.stdout:2/737: creat d0/d5/d17/d91/d9c/ffb x:0 0 0 2024-09-12T22:33:16.708 INFO:tasks.workunit.client.0.smithi019.stdout:9/728: mkdir dd/d10/d17/d22/d6c/d53/d69/d9d/dbd/de8 0 2024-09-12T22:33:16.709 INFO:tasks.workunit.client.0.smithi019.stdout:0/777: getdents d1/d1f/d5b 0 2024-09-12T22:33:16.709 INFO:tasks.workunit.client.0.smithi019.stdout:3/724: creat dd/fdc x:0 0 0 2024-09-12T22:33:16.710 INFO:tasks.workunit.client.0.smithi019.stdout:2/738: chown d0/d5/d18/d5c/d85/d95/l64 888795 1 2024-09-12T22:33:16.711 INFO:tasks.workunit.client.0.smithi019.stdout:5/832: rename d0/d7/d2d/d4c/l117 to d0/d7/d2d/d32/d36/d8c/db8/d39/d38/d4b/dd9/l122 0 2024-09-12T22:33:16.711 INFO:tasks.workunit.client.0.smithi019.stdout:2/739: fdatasync d0/d5/d60/d74/f9e 0 2024-09-12T22:33:16.711 INFO:tasks.workunit.client.0.smithi019.stdout:3/725: mknod dd/d1e/d40/d6e/d70/cdd 0 2024-09-12T22:33:16.712 INFO:tasks.workunit.client.0.smithi019.stdout:6/798: getdents d1b/d26/d31/d5f/da8 0 2024-09-12T22:33:16.713 INFO:tasks.workunit.client.0.smithi019.stdout:6/799: chown d1b/d2d/ceb 4167 1 2024-09-12T22:33:16.713 INFO:tasks.workunit.client.0.smithi019.stdout:2/740: unlink d0/d5/d18/d1b/l2d 0 2024-09-12T22:33:16.715 INFO:tasks.workunit.client.0.smithi019.stdout:6/800: dread - d1b/d2d/fcc zero size 2024-09-12T22:33:16.717 INFO:tasks.workunit.client.0.smithi019.stdout:8/757: dread d7/d8/dd/d4f/f61 [0,4194304] 0 2024-09-12T22:33:16.717 INFO:tasks.workunit.client.0.smithi019.stdout:4/777: dread d1/d4/fa0 [0,4194304] 0 2024-09-12T22:33:16.717 INFO:tasks.workunit.client.0.smithi019.stdout:2/741: rename d0/d5/fb4 to d0/d5/d60/d71/ffc 0 2024-09-12T22:33:16.717 INFO:tasks.workunit.client.0.smithi019.stdout:6/801: mkdir d1b/d113 0 2024-09-12T22:33:16.718 INFO:tasks.workunit.client.0.smithi019.stdout:7/664: dread d6/d14/d15/d9e/f36 [0,4194304] 0 2024-09-12T22:33:16.718 INFO:tasks.workunit.client.0.smithi019.stdout:4/778: creat d1/d8/dfb/f111 x:0 0 0 2024-09-12T22:33:16.718 INFO:tasks.workunit.client.0.smithi019.stdout:2/742: write d0/d5/d17/f14 [3255959,99502] 0 2024-09-12T22:33:16.719 INFO:tasks.workunit.client.0.smithi019.stdout:8/758: stat d7/d34/d78/d54/fe4 0 2024-09-12T22:33:16.719 INFO:tasks.workunit.client.0.smithi019.stdout:1/834: dread d3/d6e/f87 [0,4194304] 0 2024-09-12T22:33:16.720 INFO:tasks.workunit.client.0.smithi019.stdout:3/726: dwrite dd/d1e/d5a/f6b [0,4194304] 0 2024-09-12T22:33:16.720 INFO:tasks.workunit.client.0.smithi019.stdout:1/835: unlink d3/d3f/d58/la1 0 2024-09-12T22:33:16.721 INFO:tasks.workunit.client.0.smithi019.stdout:2/743: write d0/d5/d18/d5c/d85/fa6 [1338045,67836] 0 2024-09-12T22:33:16.721 INFO:tasks.workunit.client.0.smithi019.stdout:8/759: mknod d7/d8/dd/cf1 0 2024-09-12T22:33:16.722 INFO:tasks.workunit.client.0.smithi019.stdout:1/836: stat d3/l15 0 2024-09-12T22:33:16.724 INFO:tasks.workunit.client.0.smithi019.stdout:3/727: mkdir dd/d12/d62/d78/dde 0 2024-09-12T22:33:16.726 INFO:tasks.workunit.client.0.smithi019.stdout:8/760: rmdir d7/d34/dc4 0 2024-09-12T22:33:16.726 INFO:tasks.workunit.client.0.smithi019.stdout:2/744: read d0/d5/d18/d1b/d5d/f80 [124300,51230] 0 2024-09-12T22:33:16.727 INFO:tasks.workunit.client.0.smithi019.stdout:6/802: dwrite d1b/d26/d31/dd6/fdf [0,4194304] 0 2024-09-12T22:33:16.727 INFO:tasks.workunit.client.0.smithi019.stdout:8/761: creat d7/d2f/ff2 x:0 0 0 2024-09-12T22:33:16.728 INFO:tasks.workunit.client.0.smithi019.stdout:8/762: readlink d7/l2b 0 2024-09-12T22:33:16.729 INFO:tasks.workunit.client.0.smithi019.stdout:3/728: rename dd/l1c to dd/d1e/d40/d6e/ldf 0 2024-09-12T22:33:16.729 INFO:tasks.workunit.client.0.smithi019.stdout:4/779: dwrite d1/d11/d15/d1f/d56/da9/dce/fef [0,4194304] 0 2024-09-12T22:33:16.730 INFO:tasks.workunit.client.0.smithi019.stdout:2/745: creat d0/d5/d18/d3b/df9/ffd x:0 0 0 2024-09-12T22:33:16.730 INFO:tasks.workunit.client.0.smithi019.stdout:8/763: symlink d7/d8/d43/d87/lf3 0 2024-09-12T22:33:16.730 INFO:tasks.workunit.client.0.smithi019.stdout:6/803: truncate d1b/d26/d27/d67/f103 367540 0 2024-09-12T22:33:16.730 INFO:tasks.workunit.client.0.smithi019.stdout:3/729: readlink dd/d12/d62/dd8/ld9 0 2024-09-12T22:33:16.731 INFO:tasks.workunit.client.0.smithi019.stdout:2/746: creat d0/d5/d18/d5c/d67/d77/ffe x:0 0 0 2024-09-12T22:33:16.731 INFO:tasks.workunit.client.0.smithi019.stdout:6/804: write d1b/d26/d27/d67/de1/f109 [980587,37580] 0 2024-09-12T22:33:16.732 INFO:tasks.workunit.client.0.smithi019.stdout:4/780: rename d1/d4/f2a to d1/d22/d31/d101/f112 0 2024-09-12T22:33:16.733 INFO:tasks.workunit.client.0.smithi019.stdout:6/805: dread - d1b/fb5 zero size 2024-09-12T22:33:16.733 INFO:tasks.workunit.client.0.smithi019.stdout:1/837: write d3/d6e/da9/f71 [269411,114664] 0 2024-09-12T22:33:16.736 INFO:tasks.workunit.client.0.smithi019.stdout:4/781: link d1/d22/d26/f7c d1/d8/dd0/f113 0 2024-09-12T22:33:16.736 INFO:tasks.workunit.client.0.smithi019.stdout:6/806: creat d1b/d26/d27/d3e/f114 x:0 0 0 2024-09-12T22:33:16.737 INFO:tasks.workunit.client.0.smithi019.stdout:9/729: dread dd/d10/d17/d23/d2e/d31/d3f/d47/d6e/f8a [0,4194304] 0 2024-09-12T22:33:16.738 INFO:tasks.workunit.client.0.smithi019.stdout:6/807: dread - d1b/d26/d27/d3e/f114 zero size 2024-09-12T22:33:16.739 INFO:tasks.workunit.client.0.smithi019.stdout:3/730: dwrite dd/d1e/d40/d5f/f66 [0,4194304] 0 2024-09-12T22:33:16.739 INFO:tasks.workunit.client.0.smithi019.stdout:7/665: sync 2024-09-12T22:33:16.739 INFO:tasks.workunit.client.0.smithi019.stdout:4/782: dread d1/d11/d15/d49/ff8 [0,4194304] 0 2024-09-12T22:33:16.740 INFO:tasks.workunit.client.0.smithi019.stdout:0/778: dread d1/d1f/d5b/f61 [0,4194304] 0 2024-09-12T22:33:16.741 INFO:tasks.workunit.client.0.smithi019.stdout:2/747: write d0/d5/d18/d5c/d85/fc2 [662988,71020] 0 2024-09-12T22:33:16.741 INFO:tasks.workunit.client.0.smithi019.stdout:3/731: chown dd/d1e/d5a/f60 5020073 1 2024-09-12T22:33:16.741 INFO:tasks.workunit.client.0.smithi019.stdout:9/730: write dd/d10/d17/d22/d77/fb5 [3800875,96465] 0 2024-09-12T22:33:16.742 INFO:tasks.workunit.client.0.smithi019.stdout:5/833: dread d0/d7/d16/d18/dae/f103 [0,4194304] 0 2024-09-12T22:33:16.743 INFO:tasks.workunit.client.0.smithi019.stdout:2/748: write d0/d5/d18/d1b/d36/f4a [2385768,43641] 0 2024-09-12T22:33:16.745 INFO:tasks.workunit.client.0.smithi019.stdout:9/731: rmdir dd/d10/d17/d23/d2e/d31/d54/d8b 39 2024-09-12T22:33:16.746 INFO:tasks.workunit.client.0.smithi019.stdout:3/732: link dd/l4e dd/d12/le0 0 2024-09-12T22:33:16.747 INFO:tasks.workunit.client.0.smithi019.stdout:1/838: dwrite d3/df/d7e/db7/d16/d3c/dbd/de6/f27 [0,4194304] 0 2024-09-12T22:33:16.749 INFO:tasks.workunit.client.0.smithi019.stdout:7/666: dread d6/d14/d2a/da4/dc/f71 [0,4194304] 0 2024-09-12T22:33:16.749 INFO:tasks.workunit.client.0.smithi019.stdout:8/764: dread d7/d5e/f91 [0,4194304] 0 2024-09-12T22:33:16.750 INFO:tasks.workunit.client.0.smithi019.stdout:3/733: mknod dd/d12/d62/d74/ce1 0 2024-09-12T22:33:16.750 INFO:tasks.workunit.client.0.smithi019.stdout:2/749: chown d0/d5/d18/d1b/d5d/ca5 0 1 2024-09-12T22:33:16.752 INFO:tasks.workunit.client.0.smithi019.stdout:9/732: mknod dd/d10/d17/d23/d2e/d31/d7e/dbc/ce9 0 2024-09-12T22:33:16.752 INFO:tasks.workunit.client.0.smithi019.stdout:0/779: dwrite d1/d51/f56 [0,4194304] 0 2024-09-12T22:33:16.754 INFO:tasks.workunit.client.0.smithi019.stdout:3/734: write dd/d1e/d40/d6e/fa1 [386562,18642] 0 2024-09-12T22:33:16.755 INFO:tasks.workunit.client.0.smithi019.stdout:6/808: dwrite d1b/d26/d39/d6a/f85 [4194304,4194304] 0 2024-09-12T22:33:16.755 INFO:tasks.workunit.client.0.smithi019.stdout:7/667: mknod d6/d14/d2a/da4/dc/d63/d4b/cfa 0 2024-09-12T22:33:16.756 INFO:tasks.workunit.client.0.smithi019.stdout:5/834: write d0/d7/d2d/d32/d36/d8c/db8/d39/d38/d4b/dde/da0/fb7 [461194,113033] 0 2024-09-12T22:33:16.757 INFO:tasks.workunit.client.0.smithi019.stdout:9/733: write dd/d10/d17/d23/d2e/d31/f46 [190438,83242] 0 2024-09-12T22:33:16.757 INFO:tasks.workunit.client.0.smithi019.stdout:4/783: dwrite d1/d22/d26/f48 [0,4194304] 0 2024-09-12T22:33:16.759 INFO:tasks.workunit.client.0.smithi019.stdout:0/780: creat d1/d14/d26/d40/d45/d5e/ffa x:0 0 0 2024-09-12T22:33:16.761 INFO:tasks.workunit.client.0.smithi019.stdout:7/668: write d6/d14/d15/d62/d6a/f75 [2903406,87557] 0 2024-09-12T22:33:16.761 INFO:tasks.workunit.client.0.smithi019.stdout:2/750: rename d0/d5/d18/d1b/d5d/d86/d90/fb7 to d0/d5/d18/d1b/d8d/fff 0 2024-09-12T22:33:16.761 INFO:tasks.workunit.client.0.smithi019.stdout:5/835: truncate d0/db9/fe9 40531 0 2024-09-12T22:33:16.761 INFO:tasks.workunit.client.0.smithi019.stdout:4/784: dread - d1/d22/d31/d101/f106 zero size 2024-09-12T22:33:16.762 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:16.760+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:16.763 INFO:tasks.workunit.client.0.smithi019.stdout:1/839: dwrite d3/df/d7e/db7/d16/d3c/dbd/fdd [0,4194304] 0 2024-09-12T22:33:16.764 INFO:tasks.workunit.client.0.smithi019.stdout:9/734: write dd/d10/d17/d23/d2e/d31/f46 [5022858,129902] 0 2024-09-12T22:33:16.764 INFO:tasks.workunit.client.0.smithi019.stdout:3/735: dwrite dd/d1e/d40/fb8 [0,4194304] 0 2024-09-12T22:33:16.764 INFO:tasks.workunit.client.0.smithi019.stdout:5/836: write d0/f6 [1727196,114331] 0 2024-09-12T22:33:16.764 INFO:tasks.workunit.client.0.smithi019.stdout:6/809: rename d1b/d26/d27/d67/d77/d7b/fbf to d1b/d26/f115 0 2024-09-12T22:33:16.765 INFO:tasks.workunit.client.0.smithi019.stdout:7/669: creat d6/d14/d15/d9e/ffb x:0 0 0 2024-09-12T22:33:16.765 INFO:tasks.workunit.client.0.smithi019.stdout:0/781: chown d1/d14/d26/d40/d45/d5e/da2/ca7 251348042 1 2024-09-12T22:33:16.766 INFO:tasks.workunit.client.0.smithi019.stdout:3/736: chown dd/d12/l83 1216 1 2024-09-12T22:33:16.766 INFO:tasks.workunit.client.0.smithi019.stdout:1/840: mknod d3/d3f/d58/d7f/c10c 0 2024-09-12T22:33:16.766 INFO:tasks.workunit.client.0.smithi019.stdout:4/785: rename d1/d4/d38/dc4/c76 to d1/d22/d31/de3/c114 0 2024-09-12T22:33:16.768 INFO:tasks.workunit.client.0.smithi019.stdout:8/765: dwrite d7/d2f/d75/f76 [0,4194304] 0 2024-09-12T22:33:16.768 INFO:tasks.workunit.client.0.smithi019.stdout:6/810: symlink d1b/d26/d27/d67/d77/d7b/l116 0 2024-09-12T22:33:16.771 INFO:tasks.workunit.client.0.smithi019.stdout:7/670: fsync d6/d14/d2a/fad 0 2024-09-12T22:33:16.771 INFO:tasks.workunit.client.0.smithi019.stdout:3/737: symlink dd/d12/d62/le2 0 2024-09-12T22:33:16.771 INFO:tasks.workunit.client.0.smithi019.stdout:5/837: stat d0/d7/d2d/d32/d36/d8c/db8/d39/d38/f62 0 2024-09-12T22:33:16.771 INFO:tasks.workunit.client.0.smithi019.stdout:4/786: symlink d1/d22/l115 0 2024-09-12T22:33:16.774 INFO:tasks.workunit.client.0.smithi019.stdout:2/751: dwrite d0/d5/d60/d71/ffc [0,4194304] 0 2024-09-12T22:33:16.775 INFO:tasks.workunit.client.0.smithi019.stdout:7/671: mkdir d6/d2d/d41/dfc 0 2024-09-12T22:33:16.776 INFO:tasks.workunit.client.0.smithi019.stdout:3/738: symlink dd/d12/le3 0 2024-09-12T22:33:16.777 INFO:tasks.workunit.client.0.smithi019.stdout:5/838: mknod d0/d7/d2d/d32/d36/d8c/db8/d9a/c123 0 2024-09-12T22:33:16.777 INFO:tasks.workunit.client.0.smithi019.stdout:8/766: truncate d7/d34/f7a 374218 0 2024-09-12T22:33:16.778 INFO:tasks.workunit.client.0.smithi019.stdout:0/782: dwrite d1/d14/d1b/d3a/d8c/f90 [0,4194304] 0 2024-09-12T22:33:16.778 INFO:tasks.workunit.client.0.smithi019.stdout:3/739: readlink dd/d1e/d40/lc6 0 2024-09-12T22:33:16.779 INFO:tasks.workunit.client.0.smithi019.stdout:4/787: write d1/d11/d15/d49/fb1 [896132,85662] 0 2024-09-12T22:33:16.781 INFO:tasks.workunit.client.0.smithi019.stdout:9/735: dwrite dd/d10/d17/d23/d2e/d31/d3f/d67/fac [0,4194304] 0 2024-09-12T22:33:16.782 INFO:tasks.workunit.client.0.smithi019.stdout:2/752: rename d0/da/c2c to d0/d5/d18/d1b/d5d/c100 0 2024-09-12T22:33:16.782 INFO:tasks.workunit.client.0.smithi019.stdout:4/788: mknod d1/d8/d7b/c116 0 2024-09-12T22:33:16.783 INFO:tasks.workunit.client.0.smithi019.stdout:3/740: truncate dd/d12/f3b 2738796 0 2024-09-12T22:33:16.783 INFO:tasks.workunit.client.0.smithi019.stdout:1/841: dwrite d3/d6e/da9/f6c [0,4194304] 0 2024-09-12T22:33:16.784 INFO:tasks.workunit.client.0.smithi019.stdout:2/753: write d0/d5/d18/d5c/f78 [4479435,26233] 0 2024-09-12T22:33:16.784 INFO:tasks.workunit.client.0.smithi019.stdout:0/783: rename d1/d1f/d5b/d83/dab/dbe/d71/d85/cdd to d1/d14/d26/d40/d45/cfb 0 2024-09-12T22:33:16.784 INFO:tasks.workunit.client.0.smithi019.stdout:4/789: write d1/d4c/db0/d75/ffa [381557,130591] 0 2024-09-12T22:33:16.785 INFO:tasks.workunit.client.0.smithi019.stdout:0/784: read - d1/d1f/f8b zero size 2024-09-12T22:33:16.786 INFO:tasks.workunit.client.0.smithi019.stdout:1/842: mknod d3/df/d7e/d90/c10d 0 2024-09-12T22:33:16.787 INFO:tasks.workunit.client.0.smithi019.stdout:0/785: mkdir d1/d1f/d5b/d83/dab/dbe/dfc 0 2024-09-12T22:33:16.787 INFO:tasks.workunit.client.0.smithi019.stdout:4/790: creat d1/d4/f117 x:0 0 0 2024-09-12T22:33:16.787 INFO:tasks.workunit.client.0.smithi019.stdout:9/736: link dd/d10/d17/d23/d2e/d31/d3f/d47/d6e/f89 dd/d10/d17/d23/fea 0 2024-09-12T22:33:16.787 INFO:tasks.workunit.client.0.smithi019.stdout:3/741: getdents dd 0 2024-09-12T22:33:16.789 INFO:tasks.workunit.client.0.smithi019.stdout:9/737: mkdir dd/deb 0 2024-09-12T22:33:16.789 INFO:tasks.workunit.client.0.smithi019.stdout:3/742: write dd/d1e/d40/d5f/f66 [149788,117153] 0 2024-09-12T22:33:16.790 INFO:tasks.workunit.client.0.smithi019.stdout:8/767: read d7/d8/d43/d87/fad [60274,29362] 0 2024-09-12T22:33:16.791 INFO:tasks.workunit.client.0.smithi019.stdout:9/738: mknod dd/d10/d17/d22/d6c/d53/de3/cec 0 2024-09-12T22:33:16.791 INFO:tasks.workunit.client.0.smithi019.stdout:3/743: getdents dd/d1e/d40/da6/dba 0 2024-09-12T22:33:16.791 INFO:tasks.workunit.client.0.smithi019.stdout:4/791: rename d1/d22/d2c/c34 to d1/d11/d15/c118 0 2024-09-12T22:33:16.791 INFO:tasks.workunit.client.0.smithi019.stdout:8/768: creat d7/d34/d78/ff4 x:0 0 0 2024-09-12T22:33:16.792 INFO:tasks.workunit.client.0.smithi019.stdout:4/792: fdatasync d1/d22/d57/f6e 0 2024-09-12T22:33:16.792 INFO:tasks.workunit.client.0.smithi019.stdout:6/811: truncate d1b/d26/d27/fce 4056283 0 2024-09-12T22:33:16.793 INFO:tasks.workunit.client.0.smithi019.stdout:6/812: chown d1b/d26/d31/d5f 286208 1 2024-09-12T22:33:16.793 INFO:tasks.workunit.client.0.smithi019.stdout:4/793: mkdir d1/d4c/db0/d75/d5a/d79/d119 0 2024-09-12T22:33:16.794 INFO:tasks.workunit.client.0.smithi019.stdout:9/739: rename dd/d10/d17/d22/d6c/d53/d69/d9d/ld8 to dd/d10/d17/d22/d6c/d53/d69/led 0 2024-09-12T22:33:16.794 INFO:tasks.workunit.client.0.smithi019.stdout:8/769: chown d7/d8/dd/d4f/f80 186979082 1 2024-09-12T22:33:16.794 INFO:tasks.workunit.client.0.smithi019.stdout:6/813: creat d1b/d26/d27/d67/de1/f117 x:0 0 0 2024-09-12T22:33:16.794 INFO:tasks.workunit.client.0.smithi019.stdout:4/794: write d1/d8/d7b/fda [443385,108286] 0 2024-09-12T22:33:16.795 INFO:tasks.workunit.client.0.smithi019.stdout:9/740: fdatasync dd/d10/d17/d23/d2e/d31/d7e/dbc/faa 0 2024-09-12T22:33:16.795 INFO:tasks.workunit.client.0.smithi019.stdout:6/814: creat d1b/d26/d39/d6a/f118 x:0 0 0 2024-09-12T22:33:16.795 INFO:tasks.workunit.client.0.smithi019.stdout:4/795: mknod d1/d4/d44/c11a 0 2024-09-12T22:33:16.796 INFO:tasks.workunit.client.0.smithi019.stdout:9/741: symlink dd/lee 0 2024-09-12T22:33:16.796 INFO:tasks.workunit.client.0.smithi019.stdout:6/815: creat d1b/d2d/f119 x:0 0 0 2024-09-12T22:33:16.796 INFO:tasks.workunit.client.0.smithi019.stdout:4/796: chown d1/d8/dfb/dfc/f10a 73424466 1 2024-09-12T22:33:16.797 INFO:tasks.workunit.client.0.smithi019.stdout:9/742: chown dd/d10/d17/d23/d2e/l99 400 1 2024-09-12T22:33:16.797 INFO:tasks.workunit.client.0.smithi019.stdout:5/839: sync 2024-09-12T22:33:16.798 INFO:tasks.workunit.client.0.smithi019.stdout:8/770: sync 2024-09-12T22:33:16.798 INFO:tasks.workunit.client.0.smithi019.stdout:6/816: creat d1b/d26/d39/d6a/d61/f11a x:0 0 0 2024-09-12T22:33:16.799 INFO:tasks.workunit.client.0.smithi019.stdout:5/840: chown d0/d7/d2d/dc2/fd6 127 1 2024-09-12T22:33:16.800 INFO:tasks.workunit.client.0.smithi019.stdout:6/817: write d1b/f3c [874870,116801] 0 2024-09-12T22:33:16.800 INFO:tasks.workunit.client.0.smithi019.stdout:9/743: creat dd/d10/d17/d23/d2e/d31/d3f/d67/fef x:0 0 0 2024-09-12T22:33:16.801 INFO:tasks.workunit.client.0.smithi019.stdout:6/818: rmdir d1b/d26/de2 39 2024-09-12T22:33:16.802 INFO:tasks.workunit.client.0.smithi019.stdout:5/841: unlink d0/d7/d16/d69/la1 0 2024-09-12T22:33:16.803 INFO:tasks.workunit.client.0.smithi019.stdout:4/797: dwrite d1/d4/f13 [0,4194304] 0 2024-09-12T22:33:16.804 INFO:tasks.workunit.client.0.smithi019.stdout:9/744: sync 2024-09-12T22:33:16.805 INFO:tasks.workunit.client.0.smithi019.stdout:4/798: write d1/d8/dfb/f111 [557915,7172] 0 2024-09-12T22:33:16.805 INFO:tasks.workunit.client.0.smithi019.stdout:2/754: dread d0/d5/d18/d5c/f78 [0,4194304] 0 2024-09-12T22:33:16.806 INFO:tasks.workunit.client.0.smithi019.stdout:8/771: dwrite d7/d34/d78/d2d/f83 [0,4194304] 0 2024-09-12T22:33:16.808 INFO:tasks.workunit.client.0.smithi019.stdout:1/843: write d3/d3f/d58/d101/f105 [3569753,8160] 0 2024-09-12T22:33:16.809 INFO:tasks.workunit.client.0.smithi019.stdout:3/744: truncate dd/d1e/f23 1704840 0 2024-09-12T22:33:16.811 INFO:tasks.workunit.client.0.smithi019.stdout:8/772: fdatasync d7/d2f/d75/f76 0 2024-09-12T22:33:16.812 INFO:tasks.workunit.client.0.smithi019.stdout:6/819: rename d1b/d26/d27/d67/de1 to d1b/d2d/d11b 0 2024-09-12T22:33:16.814 INFO:tasks.workunit.client.0.smithi019.stdout:2/755: mknod d0/d5/d18/d1b/d5d/d86/c101 0 2024-09-12T22:33:16.814 INFO:tasks.workunit.client.0.smithi019.stdout:5/842: dwrite d0/d7/d16/d18/f52 [0,4194304] 0 2024-09-12T22:33:16.815 INFO:tasks.workunit.client.0.smithi019.stdout:4/799: read d1/d11/f86 [554000,119256] 0 2024-09-12T22:33:16.815 INFO:tasks.workunit.client.0.smithi019.stdout:2/756: dread - d0/d5/d18/d5c/d85/fb1 zero size 2024-09-12T22:33:16.817 INFO:tasks.workunit.client.0.smithi019.stdout:9/745: link dd/d10/d17/d22/d42/lba dd/d10/d17/d23/d2e/d31/d54/d8b/ddf/lf0 0 2024-09-12T22:33:16.817 INFO:tasks.workunit.client.0.smithi019.stdout:1/844: rename d3/df/d7e/db7/d16/d3c/dbd/dc4/dc3/df1/df2 to d3/df/d10e 0 2024-09-12T22:33:16.817 INFO:tasks.workunit.client.0.smithi019.stdout:9/746: sync 2024-09-12T22:33:16.818 INFO:tasks.workunit.client.0.smithi019.stdout:2/757: chown d0/d5/d18/d5c/d85/d95 174681232 1 2024-09-12T22:33:16.818 INFO:tasks.workunit.client.0.smithi019.stdout:2/758: sync 2024-09-12T22:33:16.818 INFO:tasks.workunit.client.0.smithi019.stdout:1/845: chown d3/c4e 287351608 1 2024-09-12T22:33:16.819 INFO:tasks.workunit.client.0.smithi019.stdout:3/745: dread dd/d1e/d40/fb8 [0,4194304] 0 2024-09-12T22:33:16.820 INFO:tasks.workunit.client.0.smithi019.stdout:8/773: truncate d7/d34/d78/d54/fe5 1773675 0 2024-09-12T22:33:16.820 INFO:tasks.workunit.client.0.smithi019.stdout:4/800: link d1/d4/d38/dc4/dc2/fc9 d1/d22/d31/f11b 0 2024-09-12T22:33:16.821 INFO:tasks.workunit.client.0.smithi019.stdout:3/746: symlink dd/d1e/d82/le4 0 2024-09-12T22:33:16.822 INFO:tasks.workunit.client.0.smithi019.stdout:6/820: dwrite d1b/d26/f74 [0,4194304] 0 2024-09-12T22:33:16.822 INFO:tasks.workunit.client.0.smithi019.stdout:2/759: write d0/d5/d18/d5c/fad [3255067,15234] 0 2024-09-12T22:33:16.822 INFO:tasks.workunit.client.0.smithi019.stdout:5/843: dwrite d0/d7/d16/f2a [0,4194304] 0 2024-09-12T22:33:16.824 INFO:tasks.workunit.client.0.smithi019.stdout:1/846: getdents d3/d3f 0 2024-09-12T22:33:16.824 INFO:tasks.workunit.client.0.smithi019.stdout:3/747: symlink dd/d12/d62/dd8/le5 0 2024-09-12T22:33:16.824 INFO:tasks.workunit.client.0.smithi019.stdout:7/672: dread d6/d14/d2a/da4/f44 [0,4194304] 0 2024-09-12T22:33:16.824 INFO:tasks.workunit.client.0.smithi019.stdout:8/774: link d7/d5e/fcb d7/d2f/d75/ff5 0 2024-09-12T22:33:16.824 INFO:tasks.workunit.client.0.smithi019.stdout:0/786: dread d1/d14/d1b/d3a/d8c/dae/fb5 [0,4194304] 0 2024-09-12T22:33:16.825 INFO:tasks.workunit.client.0.smithi019.stdout:2/760: mknod d0/d5/d17/d91/d9c/c102 0 2024-09-12T22:33:16.825 INFO:tasks.workunit.client.0.smithi019.stdout:3/748: read - dd/d12/d62/d6a/fd1 zero size 2024-09-12T22:33:16.825 INFO:tasks.workunit.client.0.smithi019.stdout:5/844: fdatasync d0/d7/d2d/d32/d36/d8c/db5/f11a 0 2024-09-12T22:33:16.829 INFO:tasks.workunit.client.0.smithi019.stdout:7/673: mknod d6/d14/d45/cfd 0 2024-09-12T22:33:16.829 INFO:tasks.workunit.client.0.smithi019.stdout:8/775: chown d7/d34/d78/d53/da8/lae 517286376 1 2024-09-12T22:33:16.829 INFO:tasks.workunit.client.0.smithi019.stdout:3/749: mkdir dd/d1e/de6 0 2024-09-12T22:33:16.829 INFO:tasks.workunit.client.0.smithi019.stdout:0/787: truncate d1/d14/d26/d40/d91/fd4 155626 0 2024-09-12T22:33:16.829 INFO:tasks.workunit.client.0.smithi019.stdout:2/761: link d0/d5/d18/d5c/f6f d0/d5/d60/d74/d7e/f103 0 2024-09-12T22:33:16.830 INFO:tasks.workunit.client.0.smithi019.stdout:3/750: readlink dd/d1e/l2b 0 2024-09-12T22:33:16.830 INFO:tasks.workunit.client.0.smithi019.stdout:7/674: symlink d6/d14/d2a/da4/dc/d63/lfe 0 2024-09-12T22:33:16.830 INFO:tasks.workunit.client.0.smithi019.stdout:1/847: rename d3/d3f/d77/cf4 to d3/df/d7e/db7/d16/d3c/d55/da0/c10f 0 2024-09-12T22:33:16.831 INFO:tasks.workunit.client.0.smithi019.stdout:9/747: write dd/d10/d17/d23/d2e/d31/d3f/d47/d6e/f89 [67174,86709] 0 2024-09-12T22:33:16.831 INFO:tasks.workunit.client.0.smithi019.stdout:4/801: write d1/d22/d26/f7c [2444205,86300] 0 2024-09-12T22:33:16.831 INFO:tasks.workunit.client.0.smithi019.stdout:6/821: dwrite d1b/d26/d27/f5b [4194304,4194304] 0 2024-09-12T22:33:16.831 INFO:tasks.workunit.client.0.smithi019.stdout:3/751: chown dd/d12/d62/d74/laf 21529 1 2024-09-12T22:33:16.832 INFO:tasks.workunit.client.0.smithi019.stdout:3/752: sync 2024-09-12T22:33:16.833 INFO:tasks.workunit.client.0.smithi019.stdout:2/762: mkdir d0/da/d73/d104 0 2024-09-12T22:33:16.833 INFO:tasks.workunit.client.0.smithi019.stdout:8/776: write d7/f1d [1146016,101954] 0 2024-09-12T22:33:16.833 INFO:tasks.workunit.client.0.smithi019.stdout:4/802: readlink d1/d8/l1a 0 2024-09-12T22:33:16.834 INFO:tasks.workunit.client.0.smithi019.stdout:1/848: chown d3/df/f48 1979 1 2024-09-12T22:33:16.834 INFO:tasks.workunit.client.0.smithi019.stdout:6/822: creat d1b/d2d/f11c x:0 0 0 2024-09-12T22:33:16.835 INFO:tasks.workunit.client.0.smithi019.stdout:5/845: dwrite d0/d7/d16/d18/f52 [0,4194304] 0 2024-09-12T22:33:16.835 INFO:tasks.workunit.client.0.smithi019.stdout:3/753: mknod dd/d12/ce7 0 2024-09-12T22:33:16.836 INFO:tasks.workunit.client.0.smithi019.stdout:2/763: readlink d0/d5/d18/d5c/d85/d95/l64 0 2024-09-12T22:33:16.836 INFO:tasks.workunit.client.0.smithi019.stdout:4/803: creat d1/d11/d15/d1f/d56/f11c x:0 0 0 2024-09-12T22:33:16.838 INFO:tasks.workunit.client.0.smithi019.stdout:4/804: mkdir d1/d22/d2c/d11d 0 2024-09-12T22:33:16.839 INFO:tasks.workunit.client.0.smithi019.stdout:5/846: mknod d0/d7/d2d/d32/d4a/dbb/dd5/c124 0 2024-09-12T22:33:16.839 INFO:tasks.workunit.client.0.smithi019.stdout:9/748: rename dd/d10/d17/d22/d77/l88 to dd/d10/d17/d23/d2e/d31/d3f/dc0/lf1 0 2024-09-12T22:33:16.839 INFO:tasks.workunit.client.0.smithi019.stdout:1/849: fdatasync d3/df/d7e/db7/d16/d3c/dbd/de6/f10b 0 2024-09-12T22:33:16.839 INFO:tasks.workunit.client.0.smithi019.stdout:8/777: link d7/d34/le2 d7/d8/d43/d87/dc2/dce/lf6 0 2024-09-12T22:33:16.840 INFO:tasks.workunit.client.0.smithi019.stdout:4/805: mknod d1/d8/dfb/c11e 0 2024-09-12T22:33:16.841 INFO:tasks.workunit.client.0.smithi019.stdout:0/788: dwrite d1/d14/d26/d40/d91/fd4 [0,4194304] 0 2024-09-12T22:33:16.841 INFO:tasks.workunit.client.0.smithi019.stdout:2/764: getdents d0/d5 0 2024-09-12T22:33:16.842 INFO:tasks.workunit.client.0.smithi019.stdout:8/778: chown d7/d8/dd/d45/dc5/f90 0 1 2024-09-12T22:33:16.843 INFO:tasks.workunit.client.0.smithi019.stdout:0/789: write d1/d14/d26/d40/f95 [1146923,20469] 0 2024-09-12T22:33:16.844 INFO:tasks.workunit.client.0.smithi019.stdout:1/850: getdents d3/df/d10e 0 2024-09-12T22:33:16.844 INFO:tasks.workunit.client.0.smithi019.stdout:4/806: rename d1/d4/d38/d77 to d1/d22/d2c/d107/d11f 0 2024-09-12T22:33:16.844 INFO:tasks.workunit.client.0.smithi019.stdout:2/765: rename d0/d5/d60/d71/lb9 to d0/d5/d60/d71/l105 0 2024-09-12T22:33:16.845 INFO:tasks.workunit.client.0.smithi019.stdout:4/807: creat d1/d22/d57/f120 x:0 0 0 2024-09-12T22:33:16.845 INFO:tasks.workunit.client.0.smithi019.stdout:5/847: link d0/d7/d16/d18/d9d/cf9 d0/d7/d2d/d32/d36/d8c/db8/d9a/c125 0 2024-09-12T22:33:16.846 INFO:tasks.workunit.client.0.smithi019.stdout:6/823: dwrite d1b/d26/d39/d6a/d97/fa6 [0,4194304] 0 2024-09-12T22:33:16.847 INFO:tasks.workunit.client.0.smithi019.stdout:0/790: rename d1/d14/d1b/f44 to d1/d1f/d5b/d83/dab/dbe/dfc/ffd 0 2024-09-12T22:33:16.847 INFO:tasks.workunit.client.0.smithi019.stdout:4/808: truncate d1/d4/d38/dbf/fca 828210 0 2024-09-12T22:33:16.849 INFO:tasks.workunit.client.0.smithi019.stdout:1/851: rename d3/df/d7e/db7/d16/d3c/dce/ff7 to d3/df/d7e/d90/f110 0 2024-09-12T22:33:16.849 INFO:tasks.workunit.client.0.smithi019.stdout:2/766: dread d0/d5/d18/d5c/d67/d77/fc9 [0,4194304] 0 2024-09-12T22:33:16.849 INFO:tasks.workunit.client.0.smithi019.stdout:8/779: write d7/d2f/fe9 [941823,109240] 0 2024-09-12T22:33:16.849 INFO:tasks.workunit.client.0.smithi019.stdout:5/848: rmdir d0/d7/d2d/d32/d36/d8c/db8/d39/d38/dba/dc7 39 2024-09-12T22:33:16.850 INFO:tasks.workunit.client.0.smithi019.stdout:6/824: rename d1b/d26/d31/f9b to d1b/d26/d39/d6a/d97/f11d 0 2024-09-12T22:33:16.850 INFO:tasks.workunit.client.0.smithi019.stdout:8/780: fdatasync d7/d5e/fcb 0 2024-09-12T22:33:16.850 INFO:tasks.workunit.client.0.smithi019.stdout:5/849: fsync d0/f1a 0 2024-09-12T22:33:16.851 INFO:tasks.workunit.client.0.smithi019.stdout:1/852: mkdir d3/df/d7e/db7/d111 0 2024-09-12T22:33:16.851 INFO:tasks.workunit.client.0.smithi019.stdout:2/767: mknod d0/d5/d18/d5c/d63/c106 0 2024-09-12T22:33:16.852 INFO:tasks.workunit.client.0.smithi019.stdout:8/781: readlink d7/d8/l26 0 2024-09-12T22:33:16.852 INFO:tasks.workunit.client.0.smithi019.stdout:6/825: fdatasync d1b/d26/f115 0 2024-09-12T22:33:16.852 INFO:tasks.workunit.client.0.smithi019.stdout:0/791: chown d1/d1f/d5b/d83/dab/dbe/d89/fc5 4 1 2024-09-12T22:33:16.853 INFO:tasks.workunit.client.0.smithi019.stdout:5/850: chown d0/d7/de6 1452 1 2024-09-12T22:33:16.854 INFO:tasks.workunit.client.0.smithi019.stdout:1/853: read d3/d6e/da9/d54/f9f [960638,26335] 0 2024-09-12T22:33:16.854 INFO:tasks.workunit.client.0.smithi019.stdout:8/782: mkdir d7/d8/dd/df7 0 2024-09-12T22:33:16.854 INFO:tasks.workunit.client.0.smithi019.stdout:0/792: creat d1/d14/d1b/d94/ffe x:0 0 0 2024-09-12T22:33:16.855 INFO:tasks.workunit.client.0.smithi019.stdout:2/768: rename d0/d5/d60/d74/l75 to d0/d5/d18/d5c/d63/d6a/l107 0 2024-09-12T22:33:16.855 INFO:tasks.workunit.client.0.smithi019.stdout:6/826: truncate d1b/d26/d39/d6a/f10b 4854156 0 2024-09-12T22:33:16.855 INFO:tasks.workunit.client.0.smithi019.stdout:7/675: dread d6/d14/d15/d62/d6a/fc2 [0,4194304] 0 2024-09-12T22:33:16.856 INFO:tasks.workunit.client.0.smithi019.stdout:0/793: write d1/d14/f4e [3519656,126903] 0 2024-09-12T22:33:16.856 INFO:tasks.workunit.client.0.smithi019.stdout:1/854: creat d3/df/d7e/db7/d111/f112 x:0 0 0 2024-09-12T22:33:16.856 INFO:tasks.workunit.client.0.smithi019.stdout:5/851: creat d0/d7/d2d/d32/d36/d8c/db8/d39/d38/d4b/dd9/f126 x:0 0 0 2024-09-12T22:33:16.856 INFO:tasks.workunit.client.0.smithi019.stdout:6/827: creat d1b/d26/d31/dd6/f11e x:0 0 0 2024-09-12T22:33:16.856 INFO:tasks.workunit.client.0.smithi019.stdout:7/676: chown d6/d2d/d77/cf5 111 1 2024-09-12T22:33:16.857 INFO:tasks.workunit.client.0.smithi019.stdout:2/769: mkdir d0/d5/d18/d1b/d5d/d86/d108 0 2024-09-12T22:33:16.857 INFO:tasks.workunit.client.0.smithi019.stdout:1/855: chown d3/d3f/d58/f93 1134509 1 2024-09-12T22:33:16.857 INFO:tasks.workunit.client.0.smithi019.stdout:5/852: write d0/f7e [4389022,84590] 0 2024-09-12T22:33:16.858 INFO:tasks.workunit.client.0.smithi019.stdout:7/677: read - d6/d2d/fe6 zero size 2024-09-12T22:33:16.858 INFO:tasks.workunit.client.0.smithi019.stdout:0/794: symlink d1/d1f/d5b/d83/dab/dbe/d89/lff 0 2024-09-12T22:33:16.859 INFO:tasks.workunit.client.0.smithi019.stdout:6/828: read d1b/f37 [2077960,101423] 0 2024-09-12T22:33:16.859 INFO:tasks.workunit.client.0.smithi019.stdout:5/853: mkdir d0/d7/d2d/d4c/d127 0 2024-09-12T22:33:16.861 INFO:tasks.workunit.client.0.smithi019.stdout:7/678: write d6/d14/d2a/da4/d34/f38 [175750,47229] 0 2024-09-12T22:33:16.861 INFO:tasks.workunit.client.0.smithi019.stdout:5/854: readlink d0/d7/d16/d18/l68 0 2024-09-12T22:33:16.862 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:16.861+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:16.862 INFO:tasks.workunit.client.0.smithi019.stdout:6/829: creat d1b/f11f x:0 0 0 2024-09-12T22:33:16.863 INFO:tasks.workunit.client.0.smithi019.stdout:1/856: link d3/df/f41 d3/df/d7e/db7/d16/d3c/dce/f113 0 2024-09-12T22:33:16.863 INFO:tasks.workunit.client.0.smithi019.stdout:8/783: dwrite d7/d8/dd/fbb [0,4194304] 0 2024-09-12T22:33:16.865 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:33:16.865 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:33:16.865 INFO:tasks.workunit.client.0.smithi019.stdout:6/830: rmdir d1b/d26/d39/d89/d90 39 2024-09-12T22:33:16.865 INFO:tasks.workunit.client.0.smithi019.stdout:1/857: stat d3/df/d7e/c94 0 2024-09-12T22:33:16.866 INFO:tasks.workunit.client.0.smithi019.stdout:8/784: creat d7/d34/d78/d2d/ff8 x:0 0 0 2024-09-12T22:33:16.866 INFO:tasks.workunit.client.0.smithi019.stdout:5/855: creat d0/d7/d2d/d32/d36/d8c/db8/d39/d38/d4b/dd9/f128 x:0 0 0 2024-09-12T22:33:16.867 INFO:tasks.workunit.client.0.smithi019.stdout:2/770: dwrite d0/fe7 [0,4194304] 0 2024-09-12T22:33:16.868 INFO:tasks.workunit.client.0.smithi019.stdout:0/795: dwrite d1/fd [0,4194304] 0 2024-09-12T22:33:16.869 INFO:tasks.workunit.client.0.smithi019.stdout:8/785: mkdir d7/d2f/d42/d98/df9 0 2024-09-12T22:33:16.873 INFO:tasks.workunit.client.0.smithi019.stdout:8/786: chown d7/d8/dd/f21 3 1 2024-09-12T22:33:16.873 INFO:tasks.workunit.client.0.smithi019.stdout:7/679: write f1 [800113,113745] 0 2024-09-12T22:33:16.875 INFO:tasks.workunit.client.0.smithi019.stdout:0/796: symlink d1/d14/d1b/d3a/l100 0 2024-09-12T22:33:16.876 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:33:16.876 INFO:tasks.workunit.client.0.smithi019.stdout:6/831: read d1b/d26/d39/d6a/f85 [2197864,42772] 0 2024-09-12T22:33:16.876 INFO:tasks.workunit.client.0.smithi019.stdout:7/680: mkdir d6/d14/d2a/da4/dc/d63/dff 0 2024-09-12T22:33:16.877 INFO:tasks.workunit.client.0.smithi019.stdout:0/797: unlink d1/d14/d1b/f2e 0 2024-09-12T22:33:16.878 INFO:tasks.workunit.client.0.smithi019.stdout:7/681: stat d6/dcf/fdc 0 2024-09-12T22:33:16.879 INFO:tasks.workunit.client.0.smithi019.stdout:1/858: dwrite d3/d3f/d58/f6f [0,4194304] 0 2024-09-12T22:33:16.882 INFO:tasks.workunit.client.0.smithi019.stdout:7/682: fsync d6/d14/d15/f28 0 2024-09-12T22:33:16.882 INFO:tasks.workunit.client.0.smithi019.stdout:5/856: dwrite d0/d7/d2d/d32/d36/d8c/db8/d24/d64/f11b [0,4194304] 0 2024-09-12T22:33:16.886 INFO:tasks.workunit.client.0.smithi019.stdout:1/859: creat d3/df/d7e/d90/f114 x:0 0 0 2024-09-12T22:33:16.887 INFO:tasks.workunit.client.0.smithi019.stdout:7/683: symlink d6/d14/d45/dca/df8/l100 0 2024-09-12T22:33:16.887 INFO:tasks.workunit.client.0.smithi019.stdout:0/798: truncate d1/d14/d26/d40/d45/d5e/d84/fb6 47843 0 2024-09-12T22:33:16.887 INFO:tasks.workunit.client.0.smithi019.stdout:8/787: dwrite d7/d34/d78/d2d/f30 [0,4194304] 0 2024-09-12T22:33:16.889 INFO:tasks.workunit.client.0.smithi019.stdout:5/857: write d0/d7/d2d/d32/d36/d8c/db8/d39/fc1 [341903,16343] 0 2024-09-12T22:33:16.889 INFO:tasks.workunit.client.0.smithi019.stdout:1/860: mkdir d3/df/d7e/db7/d115 0 2024-09-12T22:33:16.890 INFO:tasks.workunit.client.0.smithi019.stdout:8/788: fdatasync d7/d5e/fcb 0 2024-09-12T22:33:16.890 INFO:tasks.workunit.client.0.smithi019.stdout:0/799: mknod d1/d51/c101 0 2024-09-12T22:33:16.891 INFO:tasks.workunit.client.0.smithi019.stdout:6/832: dwrite d1b/f5d [0,4194304] 0 2024-09-12T22:33:16.891 INFO:tasks.workunit.client.0.smithi019.stdout:7/684: symlink d6/d14/df0/l101 0 2024-09-12T22:33:16.892 INFO:tasks.workunit.client.0.smithi019.stdout:8/789: dread - d7/d2f/d75/dc7/fdc zero size 2024-09-12T22:33:16.892 INFO:tasks.workunit.client.0.smithi019.stdout:0/800: fsync d1/d14/d1b/d3a/fa8 0 2024-09-12T22:33:16.894 INFO:tasks.workunit.client.0.smithi019.stdout:7/685: unlink d6/d14/d45/d7c/f65 0 2024-09-12T22:33:16.894 INFO:tasks.workunit.client.0.smithi019.stdout:3/754: dread dd/d1e/d40/f90 [0,4194304] 0 2024-09-12T22:33:16.895 INFO:tasks.workunit.client.0.smithi019.stdout:0/801: rename d1/d1d/c80 to d1/d14/d26/d40/d45/d5e/ddf/c102 0 2024-09-12T22:33:16.895 INFO:tasks.workunit.client.0.smithi019.stdout:8/790: symlink d7/d34/d78/d53/da8/lfa 0 2024-09-12T22:33:16.896 INFO:tasks.workunit.client.0.smithi019.stdout:0/802: mkdir d1/d14/dad/dc0/d103 0 2024-09-12T22:33:16.896 INFO:tasks.workunit.client.0.smithi019.stdout:3/755: creat dd/d12/d62/d78/dde/fe8 x:0 0 0 2024-09-12T22:33:16.897 INFO:tasks.workunit.client.0.smithi019.stdout:8/791: creat d7/d34/d78/d54/ffb x:0 0 0 2024-09-12T22:33:16.899 INFO:tasks.workunit.client.0.smithi019.stdout:7/686: write d6/d14/d2a/da4/dc/f70 [780055,102748] 0 2024-09-12T22:33:16.899 INFO:tasks.workunit.client.0.smithi019.stdout:5/858: dread d0/d7/d2d/d32/d36/d8c/db8/d39/d38/d4b/dde/da0/fb7 [0,4194304] 0 2024-09-12T22:33:16.899 INFO:tasks.workunit.client.0.smithi019.stdout:6/833: dwrite d1b/fe3 [0,4194304] 0 2024-09-12T22:33:16.900 INFO:tasks.workunit.client.0.smithi019.stdout:8/792: truncate d7/d34/d78/d53/fed 329237 0 2024-09-12T22:33:16.900 INFO:tasks.workunit.client.0.smithi019.stdout:1/861: read d3/d6e/da9/d54/f61 [579018,103002] 0 2024-09-12T22:33:16.901 INFO:tasks.workunit.client.0.smithi019.stdout:6/834: fsync d1b/d26/d31/dd6/fb2 0 2024-09-12T22:33:16.902 INFO:tasks.workunit.client.0.smithi019.stdout:8/793: fsync d7/d8/dd/f56 0 2024-09-12T22:33:16.903 INFO:tasks.workunit.client.0.smithi019.stdout:8/794: chown d7/l66 2 1 2024-09-12T22:33:16.904 INFO:tasks.workunit.client.0.smithi019.stdout:1/862: unlink d3/df/d7e/db7/d16/d3c/dbd/de6/dd3/fe0 0 2024-09-12T22:33:16.905 INFO:tasks.workunit.client.0.smithi019.stdout:8/795: stat d7/d8/d43/d87/cd2 0 2024-09-12T22:33:16.905 INFO:tasks.workunit.client.0.smithi019.stdout:0/803: dwrite d1/d14/d26/d40/d45/d5e/f68 [0,4194304] 0 2024-09-12T22:33:16.905 INFO:tasks.workunit.client.0.smithi019.stdout:5/859: creat d0/d7/d2d/d32/d36/d8c/db8/d39/d38/dba/dc7/df6/f129 x:0 0 0 2024-09-12T22:33:16.907 INFO:tasks.workunit.client.0.smithi019.stdout:9/749: dread dd/d10/f39 [0,4194304] 0 2024-09-12T22:33:16.908 INFO:tasks.workunit.client.0.smithi019.stdout:1/863: creat d3/df/d7e/db7/d63/d76/d91/f116 x:0 0 0 2024-09-12T22:33:16.908 INFO:tasks.workunit.client.0.smithi019.stdout:0/804: creat d1/d14/d1b/dc9/f104 x:0 0 0 2024-09-12T22:33:16.908 INFO:tasks.workunit.client.0.smithi019.stdout:9/750: readlink dd/d10/d17/l62 0 2024-09-12T22:33:16.911 INFO:tasks.workunit.client.0.smithi019.stdout:6/835: dwrite d1b/fe3 [0,4194304] 0 2024-09-12T22:33:16.911 INFO:tasks.workunit.client.0.smithi019.stdout:8/796: link d7/d34/d78/f17 d7/d8/d43/ffc 0 2024-09-12T22:33:16.911 INFO:tasks.workunit.client.0.smithi019.stdout:5/860: rename d0/d7/d2d/d32/d36/l8e to d0/d7/d2d/l12a 0 2024-09-12T22:33:16.913 INFO:tasks.workunit.client.0.smithi019.stdout:1/864: symlink d3/df/d7e/db7/d16/d3c/d55/da0/l117 0 2024-09-12T22:33:16.914 INFO:tasks.workunit.client.0.smithi019.stdout:4/809: dread d1/d4c/fb6 [0,4194304] 0 2024-09-12T22:33:16.914 INFO:tasks.workunit.client.0.smithi019.stdout:0/805: symlink d1/d14/d26/d40/d45/d5e/df8/l105 0 2024-09-12T22:33:16.914 INFO:tasks.workunit.client.0.smithi019.stdout:9/751: creat dd/d10/d17/d23/d2e/d31/d54/d8b/ddf/ff2 x:0 0 0 2024-09-12T22:33:16.914 INFO:tasks.workunit.client.0.smithi019.stdout:5/861: readlink d0/d7/d2d/d32/d36/d8c/db8/d9a/l9b 0 2024-09-12T22:33:16.915 INFO:tasks.workunit.client.0.smithi019.stdout:8/797: chown d7/d2f/d75/dc7/cde 58 1 2024-09-12T22:33:16.916 INFO:tasks.workunit.client.0.smithi019.stdout:1/865: write d3/d6e/da9/f28 [1550723,25210] 0 2024-09-12T22:33:16.916 INFO:tasks.workunit.client.0.smithi019.stdout:0/806: write d1/d14/d1b/fe5 [1790737,84549] 0 2024-09-12T22:33:16.916 INFO:tasks.workunit.client.0.smithi019.stdout:2/771: dread d0/d5/d18/d1b/d5d/d86/d90/fc7 [0,4194304] 0 2024-09-12T22:33:16.916 INFO:tasks.workunit.client.0.smithi019.stdout:5/862: readlink d0/d7/d2d/d4c/lcf 0 2024-09-12T22:33:16.917 INFO:tasks.workunit.client.0.smithi019.stdout:9/752: mkdir dd/d10/d17/d22/d77/df3 0 2024-09-12T22:33:16.917 INFO:tasks.workunit.client.0.smithi019.stdout:6/836: rename d1b/d26/d31/dec/f108 to d1b/d26/d31/d5f/da8/f120 0 2024-09-12T22:33:16.917 INFO:tasks.workunit.client.0.smithi019.stdout:2/772: mkdir d0/d5/d18/d5c/d67/d109 0 2024-09-12T22:33:16.918 INFO:tasks.workunit.client.0.smithi019.stdout:8/798: rename d7/d34/d78/c39 to d7/d34/d78/d53/daa/cfd 0 2024-09-12T22:33:16.918 INFO:tasks.workunit.client.0.smithi019.stdout:0/807: mkdir d1/d1f/d5b/d83/dab/dbe/d106 0 2024-09-12T22:33:16.920 INFO:tasks.workunit.client.0.smithi019.stdout:8/799: symlink d7/d8/dd/d45/lfe 0 2024-09-12T22:33:16.920 INFO:tasks.workunit.client.0.smithi019.stdout:0/808: chown d1/d14/d26/d40/d45/ff3 231735 1 2024-09-12T22:33:16.921 INFO:tasks.workunit.client.0.smithi019.stdout:8/800: mkdir d7/d5e/dff 0 2024-09-12T22:33:16.922 INFO:tasks.workunit.client.0.smithi019.stdout:1/866: truncate d3/df/d7e/db7/d16/d3c/dbd/de6/f10b 921783 0 2024-09-12T22:33:16.922 INFO:tasks.workunit.client.0.smithi019.stdout:9/753: truncate dd/d10/d17/d22/d6c/d53/d69/f9c 876231 0 2024-09-12T22:33:16.923 INFO:tasks.workunit.client.0.smithi019.stdout:2/773: rename d0/d5/d18/d5c/d63/f62 to d0/d5/d18/d1b/d5d/d86/d108/f10a 0 2024-09-12T22:33:16.925 INFO:tasks.workunit.client.0.smithi019.stdout:6/837: dwrite d1b/d26/f96 [4194304,4194304] 0 2024-09-12T22:33:16.925 INFO:tasks.workunit.client.0.smithi019.stdout:1/867: mknod d3/df/d7e/db7/d16/d3c/dbd/dc4/dc3/c118 0 2024-09-12T22:33:16.926 INFO:tasks.workunit.client.0.smithi019.stdout:0/809: read d1/d1f/f57 [2274163,5210] 0 2024-09-12T22:33:16.926 INFO:tasks.workunit.client.0.smithi019.stdout:8/801: rename d7/d2f/d75/dc7/le8 to d7/d34/d78/d54/l100 0 2024-09-12T22:33:16.927 INFO:tasks.workunit.client.0.smithi019.stdout:5/863: dwrite d0/d7/d16/d18/f86 [4194304,4194304] 0 2024-09-12T22:33:16.930 INFO:tasks.workunit.client.0.smithi019.stdout:6/838: creat d1b/d26/de2/df2/f121 x:0 0 0 2024-09-12T22:33:16.930 INFO:tasks.workunit.client.0.smithi019.stdout:5/864: write d0/d7/d16/d18/f52 [5056977,5185] 0 2024-09-12T22:33:16.930 INFO:tasks.workunit.client.0.smithi019.stdout:6/839: stat d1b/d26 0 2024-09-12T22:33:16.931 INFO:tasks.workunit.client.0.smithi019.stdout:0/810: rename d1/d1f/d5b/d83/dab/dbe/d9c/fec to d1/d1f/d5b/dbf/f107 0 2024-09-12T22:33:16.933 INFO:tasks.workunit.client.0.smithi019.stdout:9/754: dread dd/d10/d17/d23/d2e/d31/d3f/fb6 [0,4194304] 0 2024-09-12T22:33:16.935 INFO:tasks.workunit.client.0.smithi019.stdout:0/811: creat d1/d1f/d5b/d83/dab/f108 x:0 0 0 2024-09-12T22:33:16.936 INFO:tasks.workunit.client.0.smithi019.stdout:5/865: rename d0/d7/d16/d18 to d0/d7/d2d/d32/d36/d8c/db8/d39/d38/d4b/dde/da0/d12b 0 2024-09-12T22:33:16.937 INFO:tasks.workunit.client.0.smithi019.stdout:1/868: dwrite d3/df/d7e/db7/d16/f38 [0,4194304] 0 2024-09-12T22:33:16.937 INFO:tasks.workunit.client.0.smithi019.stdout:8/802: dwrite d7/d8/d43/d87/fad [0,4194304] 0 2024-09-12T22:33:16.939 INFO:tasks.workunit.client.0.smithi019.stdout:6/840: truncate d1b/d26/d27/d3e/d83/d98/fed 3680643 0 2024-09-12T22:33:16.940 INFO:tasks.workunit.client.0.smithi019.stdout:1/869: chown d3/df/d7e/db7/d16/d3c/dbd/de6/f68 506267 1 2024-09-12T22:33:16.940 INFO:tasks.workunit.client.0.smithi019.stdout:8/803: getdents d7 0 2024-09-12T22:33:16.942 INFO:tasks.workunit.client.0.smithi019.stdout:6/841: rmdir d1b/d26/d27 39 2024-09-12T22:33:16.943 INFO:tasks.workunit.client.0.smithi019.stdout:7/687: dread d6/d14/d2a/da4/f3a [0,4194304] 0 2024-09-12T22:33:16.944 INFO:tasks.workunit.client.0.smithi019.stdout:9/755: dwrite dd/d10/d17/d23/d2e/d31/d54/f75 [0,4194304] 0 2024-09-12T22:33:16.945 INFO:tasks.workunit.client.0.smithi019.stdout:6/842: write d1b/d26/d39/d6a/f58 [993803,93335] 0 2024-09-12T22:33:16.948 INFO:tasks.workunit.client.0.smithi019.stdout:9/756: symlink dd/dcb/lf4 0 2024-09-12T22:33:16.949 INFO:tasks.workunit.client.0.smithi019.stdout:1/870: dread d3/d3f/d58/f6f [0,4194304] 0 2024-09-12T22:33:16.949 INFO:tasks.workunit.client.0.smithi019.stdout:9/757: fsync dd/d10/d17/d23/fea 0 2024-09-12T22:33:16.950 INFO:tasks.workunit.client.0.smithi019.stdout:6/843: creat d1b/d26/d39/d89/d90/f122 x:0 0 0 2024-09-12T22:33:16.951 INFO:tasks.workunit.client.0.smithi019.stdout:9/758: write dd/d10/d17/d22/d77/fb5 [445379,26861] 0 2024-09-12T22:33:16.951 INFO:tasks.workunit.client.0.smithi019.stdout:8/804: dwrite d7/d34/d78/d54/fa6 [0,4194304] 0 2024-09-12T22:33:16.952 INFO:tasks.workunit.client.0.smithi019.stdout:6/844: mkdir d1b/d26/d123 0 2024-09-12T22:33:16.953 INFO:tasks.workunit.client.0.smithi019.stdout:5/866: dread d0/d7/d2d/d32/d36/d8c/db8/d39/d38/d4b/dde/fe5 [0,4194304] 0 2024-09-12T22:33:16.953 INFO:tasks.workunit.client.0.smithi019.stdout:8/805: chown d7/d8/dd/d45/dc5/fbd 33386324 1 2024-09-12T22:33:16.954 INFO:tasks.workunit.client.0.smithi019.stdout:9/759: truncate dd/d10/d17/d22/f3e 1513967 0 2024-09-12T22:33:16.954 INFO:tasks.workunit.client.0.smithi019.stdout:3/756: sync 2024-09-12T22:33:16.955 INFO:tasks.workunit.client.0.smithi019.stdout:5/867: chown d0/d7/d2d/d32/d4a/f6f 153 1 2024-09-12T22:33:16.956 INFO:tasks.workunit.client.0.smithi019.stdout:2/774: dread d0/d5/ff3 [0,4194304] 0 2024-09-12T22:33:16.957 INFO:tasks.workunit.client.0.smithi019.stdout:3/757: stat dd/d12/d62/d78/d98/lc9 0 2024-09-12T22:33:16.957 INFO:tasks.workunit.client.0.smithi019.stdout:1/871: dread d3/df/d7e/db7/d16/d3c/d55/fd6 [0,4194304] 0 2024-09-12T22:33:16.959 INFO:tasks.workunit.client.0.smithi019.stdout:3/758: write dd/d12/f65 [4284000,41235] 0 2024-09-12T22:33:16.960 INFO:tasks.workunit.client.0.smithi019.stdout:5/868: link d0/d7/d16/lce d0/d7/d16/l12c 0 2024-09-12T22:33:16.961 INFO:tasks.workunit.client.0.smithi019.stdout:6/845: dwrite d1b/f37 [0,4194304] 0 2024-09-12T22:33:16.962 INFO:tasks.workunit.client.0.smithi019.stdout:2/775: mkdir d0/d5/d18/d1b/d5d/d86/d10b 0 2024-09-12T22:33:16.962 INFO:tasks.workunit.client.0.smithi019.stdout:3/759: symlink dd/le9 0 2024-09-12T22:33:16.962 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:16.961+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:16.964 INFO:tasks.workunit.client.0.smithi019.stdout:6/846: creat d1b/d26/de2/df2/f124 x:0 0 0 2024-09-12T22:33:16.965 INFO:tasks.workunit.client.0.smithi019.stdout:2/776: dread - d0/d5/d18/d3b/df9/ffd zero size 2024-09-12T22:33:16.965 INFO:tasks.workunit.client.0.smithi019.stdout:8/806: dread d7/d34/d78/d2d/f79 [0,4194304] 0 2024-09-12T22:33:16.966 INFO:tasks.workunit.client.0.smithi019.stdout:5/869: link d0/f49 d0/d7/d16/f12d 0 2024-09-12T22:33:16.966 INFO:tasks.workunit.client.0.smithi019.stdout:9/760: dwrite dd/d10/d17/d22/d6c/d53/d69/fad [0,4194304] 0 2024-09-12T22:33:16.966 INFO:tasks.workunit.client.0.smithi019.stdout:1/872: write d3/df/d7e/db7/d16/f3b [3498982,35690] 0 2024-09-12T22:33:16.967 INFO:tasks.workunit.client.0.smithi019.stdout:3/760: write dd/d1e/d82/f89 [1804025,114268] 0 2024-09-12T22:33:16.968 INFO:tasks.workunit.client.0.smithi019.stdout:8/807: write d7/d2f/d75/f9b [718366,49217] 0 2024-09-12T22:33:16.969 INFO:tasks.workunit.client.0.smithi019.stdout:2/777: rename d0/d5/d17/c21 to d0/d5/d18/d39/c10c 0 2024-09-12T22:33:16.969 INFO:tasks.workunit.client.0.smithi019.stdout:5/870: write d0/d7/d2d/d32/d36/d8c/db8/d24/d64/f11b [3943411,104871] 0 2024-09-12T22:33:16.970 INFO:tasks.workunit.client.0.smithi019.stdout:1/873: fsync d3/df/d7e/d96/f98 0 2024-09-12T22:33:16.972 INFO:tasks.workunit.client.0.smithi019.stdout:0/812: dread d1/f4d [0,4194304] 0 2024-09-12T22:33:16.972 INFO:tasks.workunit.client.0.smithi019.stdout:3/761: creat dd/d1e/d40/da6/dba/fea x:0 0 0 2024-09-12T22:33:16.972 INFO:tasks.workunit.client.0.smithi019.stdout:8/808: getdents d7/d2f/d42/d98/df9 0 2024-09-12T22:33:16.973 INFO:tasks.workunit.client.0.smithi019.stdout:5/871: rename d0/d7/d2d to d0/d7/d2d/d32/d36/d8c/db8/d39/df7/d12e 22 2024-09-12T22:33:16.974 INFO:tasks.workunit.client.0.smithi019.stdout:6/847: dwrite d1b/d26/d39/f65 [0,4194304] 0 2024-09-12T22:33:16.975 INFO:tasks.workunit.client.0.smithi019.stdout:0/813: mknod d1/d1f/d5b/d83/dc7/c109 0 2024-09-12T22:33:16.976 INFO:tasks.workunit.client.0.smithi019.stdout:6/848: fdatasync d1b/d26/d39/d89/d90/ff0 0 2024-09-12T22:33:16.977 INFO:tasks.workunit.client.0.smithi019.stdout:5/872: readlink d0/d7/d2d/d32/d36/d8c/db8/lef 0 2024-09-12T22:33:16.977 INFO:tasks.workunit.client.0.smithi019.stdout:3/762: rename dd/d1e/l2b to dd/d1e/d40/da6/leb 0 2024-09-12T22:33:16.978 INFO:tasks.workunit.client.0.smithi019.stdout:0/814: creat d1/d14/d1b/d94/f10a x:0 0 0 2024-09-12T22:33:16.978 INFO:tasks.workunit.client.0.smithi019.stdout:1/874: dread d3/df/d7e/db7/d16/d3c/dbd/de6/f10b [0,4194304] 0 2024-09-12T22:33:16.978 INFO:tasks.workunit.client.0.smithi019.stdout:1/875: truncate d3/f69 1914805 0 2024-09-12T22:33:16.979 INFO:tasks.workunit.client.0.smithi019.stdout:2/778: dread d0/d5/d18/d1b/d5d/d86/d90/fc7 [0,4194304] 0 2024-09-12T22:33:16.980 INFO:tasks.workunit.client.0.smithi019.stdout:0/815: read d1/d14/d26/d40/f9a [137738,128139] 0 2024-09-12T22:33:16.980 INFO:tasks.workunit.client.0.smithi019.stdout:7/688: dread d6/d14/d45/f7e [0,4194304] 0 2024-09-12T22:33:16.982 INFO:tasks.workunit.client.0.smithi019.stdout:0/816: stat d1/d1f/d5b/d83/dab/dbe/d71/c79 0 2024-09-12T22:33:16.982 INFO:tasks.workunit.client.0.smithi019.stdout:2/779: write d0/d5/d18/d3b/f8a [4454659,98496] 0 2024-09-12T22:33:16.982 INFO:tasks.workunit.client.0.smithi019.stdout:5/873: link d0/d7/d2d/d32/c5a d0/d7/d2d/d32/d36/d8c/db8/d39/d38/dba/c12f 0 2024-09-12T22:33:16.983 INFO:tasks.workunit.client.0.smithi019.stdout:1/876: creat d3/df/d7e/db7/d63/d76/d91/de1/f119 x:0 0 0 2024-09-12T22:33:16.984 INFO:tasks.workunit.client.0.smithi019.stdout:7/689: creat d6/d14/f102 x:0 0 0 2024-09-12T22:33:16.984 INFO:tasks.workunit.client.0.smithi019.stdout:6/849: dwrite d1b/d26/d39/d6a/f92 [0,4194304] 0 2024-09-12T22:33:16.986 INFO:tasks.workunit.client.0.smithi019.stdout:1/877: write d3/df/d7e/db7/fae [636347,24005] 0 2024-09-12T22:33:16.986 INFO:tasks.workunit.client.0.smithi019.stdout:7/690: mkdir d6/d14/d15/d8b/d103 0 2024-09-12T22:33:16.986 INFO:tasks.workunit.client.0.smithi019.stdout:2/780: mkdir d0/d5/d18/d1b/d5d/d86/d90/d10d 0 2024-09-12T22:33:16.988 INFO:tasks.workunit.client.0.smithi019.stdout:5/874: creat d0/d7/d2d/d4c/d127/f130 x:0 0 0 2024-09-12T22:33:16.988 INFO:tasks.workunit.client.0.smithi019.stdout:1/878: chown d3/df/f41 141447 1 2024-09-12T22:33:16.988 INFO:tasks.workunit.client.0.smithi019.stdout:6/850: truncate d1b/d26/de2/df2/f121 708581 0 2024-09-12T22:33:16.988 INFO:tasks.workunit.client.0.smithi019.stdout:0/817: link d1/d1f/d5b/d83/dab/dbe/d71/d85/la1 d1/d1f/d5b/d83/dab/dbe/d3d/l10b 0 2024-09-12T22:33:16.990 INFO:tasks.workunit.client.0.smithi019.stdout:1/879: creat d3/df/d7e/db7/d16/d3c/dbd/de6/f11a x:0 0 0 2024-09-12T22:33:16.990 INFO:tasks.workunit.client.0.smithi019.stdout:6/851: write d1b/d26/d39/d6a/d61/f62 [393535,59637] 0 2024-09-12T22:33:16.990 INFO:tasks.workunit.client.0.smithi019.stdout:5/875: symlink d0/d7/d2d/d32/d36/d8c/db8/d39/d38/d4b/dde/da0/d12b/dfb/l131 0 2024-09-12T22:33:16.990 INFO:tasks.workunit.client.0.smithi019.stdout:2/781: truncate d0/d5/d18/d5c/d67/d77/fc4 4301983 0 2024-09-12T22:33:16.990 INFO:tasks.workunit.client.0.smithi019.stdout:0/818: fdatasync d1/d1f/d5b/d83/dab/dbe/dfc/ffd 0 2024-09-12T22:33:16.990 INFO:tasks.workunit.client.0.smithi019.stdout:5/876: dread - d0/db9/fc5 zero size 2024-09-12T22:33:16.991 INFO:tasks.workunit.client.0.smithi019.stdout:6/852: creat d1b/d26/d39/f125 x:0 0 0 2024-09-12T22:33:16.991 INFO:tasks.workunit.client.0.smithi019.stdout:1/880: symlink d3/df/d7e/db7/d63/d76/d91/l11b 0 2024-09-12T22:33:16.991 INFO:tasks.workunit.client.0.smithi019.stdout:3/763: dread dd/d12/f4c [0,4194304] 0 2024-09-12T22:33:16.991 INFO:tasks.workunit.client.0.smithi019.stdout:0/819: rmdir d1/d14/dad/dc0/d103 0 2024-09-12T22:33:16.992 INFO:tasks.workunit.client.0.smithi019.stdout:5/877: dread - d0/d7/d2d/d32/dcd/ffc zero size 2024-09-12T22:33:16.993 INFO:tasks.workunit.client.0.smithi019.stdout:6/853: mkdir d1b/d26/d31/d5f/da8/dc3/d126 0 2024-09-12T22:33:16.993 INFO:tasks.workunit.client.0.smithi019.stdout:0/820: write d1/d1f/d5b/d83/dab/dbe/f43 [4563934,109852] 0 2024-09-12T22:33:16.994 INFO:tasks.workunit.client.0.smithi019.stdout:1/881: link d3/df/d7e/db7/fae d3/df/d7e/db7/d16/d3c/dbd/de6/dd3/f11c 0 2024-09-12T22:33:16.994 INFO:tasks.workunit.client.0.smithi019.stdout:6/854: truncate d1b/d2d/fc0 1838140 0 2024-09-12T22:33:16.995 INFO:tasks.workunit.client.0.smithi019.stdout:2/782: dread d0/d5/d18/d5c/f78 [0,4194304] 0 2024-09-12T22:33:16.995 INFO:tasks.workunit.client.0.smithi019.stdout:1/882: chown d3/df/d7e/d90/f114 264 1 2024-09-12T22:33:16.996 INFO:tasks.workunit.client.0.smithi019.stdout:5/878: fsync d0/d7/d2d/d32/d36/d8c/db8/d39/d38/d4b/dde/da0/d12b/f115 0 2024-09-12T22:33:16.996 INFO:tasks.workunit.client.0.smithi019.stdout:2/783: fdatasync d0/d5/d60/d74/d7e/db5/fde 0 2024-09-12T22:33:16.996 INFO:tasks.workunit.client.0.smithi019.stdout:6/855: rename d1b/d26/ff7 to d1b/d26/d39/d89/f127 0 2024-09-12T22:33:16.997 INFO:tasks.workunit.client.0.smithi019.stdout:2/784: symlink d0/d5/d18/d1b/d8d/l10e 0 2024-09-12T22:33:16.998 INFO:tasks.workunit.client.0.smithi019.stdout:1/883: creat d3/df/d7e/db7/d16/d3c/dbd/de6/f11d x:0 0 0 2024-09-12T22:33:16.998 INFO:tasks.workunit.client.0.smithi019.stdout:6/856: rmdir d1b/d26/d39/d89 39 2024-09-12T22:33:16.998 INFO:tasks.workunit.client.0.smithi019.stdout:9/761: dread dd/d10/d17/d22/d6c/d53/d69/d9d/fa5 [0,4194304] 0 2024-09-12T22:33:16.999 INFO:tasks.workunit.client.0.smithi019.stdout:2/785: write d0/d5/d60/fab [541206,20593] 0 2024-09-12T22:33:16.999 INFO:tasks.workunit.client.0.smithi019.stdout:1/884: read d3/d3f/d77/f108 [804746,8616] 0 2024-09-12T22:33:16.999 INFO:tasks.workunit.client.0.smithi019.stdout:9/762: write dd/d10/d17/d23/d2e/d31/f46 [3386694,7256] 0 2024-09-12T22:33:16.999 INFO:tasks.workunit.client.0.smithi019.stdout:2/786: readlink d0/d5/d60/d74/d7e/la1 0 2024-09-12T22:33:17.000 INFO:tasks.workunit.client.0.smithi019.stdout:9/763: stat dd/d10/d17/d22/d42/fc4 0 2024-09-12T22:33:17.002 INFO:tasks.workunit.client.0.smithi019.stdout:2/787: mkdir d0/d5/d18/d1b/d8d/dac/d10f 0 2024-09-12T22:33:17.003 INFO:tasks.workunit.client.0.smithi019.stdout:9/764: rename dd/d10/d17/f24 to dd/d10/d17/d22/d42/ff5 0 2024-09-12T22:33:17.003 INFO:tasks.workunit.client.0.smithi019.stdout:1/885: dread d3/d6e/da9/f71 [0,4194304] 0 2024-09-12T22:33:17.004 INFO:tasks.workunit.client.0.smithi019.stdout:6/857: dwrite d1b/db4/f100 [0,4194304] 0 2024-09-12T22:33:17.006 INFO:tasks.workunit.client.0.smithi019.stdout:1/886: link d3/df/d7e/db7/d16/d3c/dbd/de6/f11a d3/d3f/d58/d7f/ded/f11e 0 2024-09-12T22:33:17.006 INFO:tasks.workunit.client.0.smithi019.stdout:6/858: rename d1b/d26/d31/d5f/cab to d1b/d26/d123/c128 0 2024-09-12T22:33:17.008 INFO:tasks.workunit.client.0.smithi019.stdout:6/859: mkdir d1b/d2d/d129 0 2024-09-12T22:33:17.008 INFO:tasks.workunit.client.0.smithi019.stdout:2/788: dwrite d0/d5/fa9 [0,4194304] 0 2024-09-12T22:33:17.008 INFO:tasks.workunit.client.0.smithi019.stdout:1/887: dread - d3/df/d7e/db7/d16/d3c/dbd/dc4/ffa zero size 2024-09-12T22:33:17.009 INFO:tasks.workunit.client.0.smithi019.stdout:8/809: dread d7/d8/dd/f67 [0,4194304] 0 2024-09-12T22:33:17.009 INFO:tasks.workunit.client.0.smithi019.stdout:2/789: symlink d0/d5/d18/d5c/d85/d95/l110 0 2024-09-12T22:33:17.010 INFO:tasks.workunit.client.0.smithi019.stdout:6/860: truncate d1b/d26/d39/d6a/d97/f11d 5252454 0 2024-09-12T22:33:17.010 INFO:tasks.workunit.client.0.smithi019.stdout:1/888: fdatasync d3/df/d7e/db7/d16/d3c/d55/f83 0 2024-09-12T22:33:17.010 INFO:tasks.workunit.client.0.smithi019.stdout:8/810: creat d7/d34/d78/d54/f101 x:0 0 0 2024-09-12T22:33:17.011 INFO:tasks.workunit.client.0.smithi019.stdout:2/790: read - d0/d5/d60/d74/d7e/db5/fde zero size 2024-09-12T22:33:17.011 INFO:tasks.workunit.client.0.smithi019.stdout:1/889: stat d3/df/d7e/db7 0 2024-09-12T22:33:17.012 INFO:tasks.workunit.client.0.smithi019.stdout:6/861: rename d1b/d26/d31/dd6/fa3 to d1b/d26/d31/d5f/f12a 0 2024-09-12T22:33:17.012 INFO:tasks.workunit.client.0.smithi019.stdout:1/890: link d3/d3f/f30 d3/df/f11f 0 2024-09-12T22:33:17.014 INFO:tasks.workunit.client.0.smithi019.stdout:6/862: chown d1b/l93 15 1 2024-09-12T22:33:17.014 INFO:tasks.workunit.client.0.smithi019.stdout:2/791: dread d0/d5/d18/d39/fbd [0,4194304] 0 2024-09-12T22:33:17.015 INFO:tasks.workunit.client.0.smithi019.stdout:1/891: rename d3/df/d7e/db7/c12 to d3/df/d7e/db7/d16/d3c/dbd/de4/c120 0 2024-09-12T22:33:17.015 INFO:tasks.workunit.client.0.smithi019.stdout:6/863: truncate d1b/d26/d27/d3e/d83/fd7 105712 0 2024-09-12T22:33:17.015 INFO:tasks.workunit.client.0.smithi019.stdout:2/792: truncate d0/d5/d18/d5c/d67/d77/ffe 201837 0 2024-09-12T22:33:17.016 INFO:tasks.workunit.client.0.smithi019.stdout:6/864: fdatasync d1b/f3c 0 2024-09-12T22:33:17.016 INFO:tasks.workunit.client.0.smithi019.stdout:1/892: fsync d3/df/d7e/db7/d63/f85 0 2024-09-12T22:33:17.016 INFO:tasks.workunit.client.0.smithi019.stdout:6/865: readlink d1b/d26/d27/d3e/l94 0 2024-09-12T22:33:17.017 INFO:tasks.workunit.client.0.smithi019.stdout:8/811: truncate d7/d8/dd/f1c 929609 0 2024-09-12T22:33:17.017 INFO:tasks.workunit.client.0.smithi019.stdout:1/893: link d3/df/d7e/db7/d63/ff6 d3/d3f/d77/dcd/f121 0 2024-09-12T22:33:17.017 INFO:tasks.workunit.client.0.smithi019.stdout:6/866: read d1b/d26/d31/d5f/d91/fca [1018095,4166] 0 2024-09-12T22:33:17.018 INFO:tasks.workunit.client.0.smithi019.stdout:1/894: chown d3/d3f/c104 178 1 2024-09-12T22:33:17.018 INFO:tasks.workunit.client.0.smithi019.stdout:6/867: readlink d1b/d26/d27/d67/d77/d7b/l116 0 2024-09-12T22:33:17.021 INFO:tasks.workunit.client.0.smithi019.stdout:1/895: dread - d3/df/d7e/db7/d16/d3c/d55/da0/fc1 zero size 2024-09-12T22:33:17.022 INFO:tasks.workunit.client.0.smithi019.stdout:2/793: dwrite d0/d5/d18/d5c/d63/d6a/fdb [0,4194304] 0 2024-09-12T22:33:17.022 INFO:tasks.workunit.client.0.smithi019.stdout:6/868: getdents d1b/d26/d27/d3e/d83 0 2024-09-12T22:33:17.023 INFO:tasks.workunit.client.0.smithi019.stdout:6/869: symlink d1b/d113/l12b 0 2024-09-12T22:33:17.023 INFO:tasks.workunit.client.0.smithi019.stdout:8/812: dwrite d7/d8/dd/d45/dc5/f90 [0,4194304] 0 2024-09-12T22:33:17.024 INFO:tasks.workunit.client.0.smithi019.stdout:4/810: sync 2024-09-12T22:33:17.024 INFO:tasks.workunit.client.0.smithi019.stdout:6/870: read - d1b/d2d/f9d zero size 2024-09-12T22:33:17.025 INFO:tasks.workunit.client.0.smithi019.stdout:8/813: creat d7/d2f/d42/d98/f102 x:0 0 0 2024-09-12T22:33:17.026 INFO:tasks.workunit.client.0.smithi019.stdout:4/811: write d1/d22/d31/d101/f106 [41007,97676] 0 2024-09-12T22:33:17.028 INFO:tasks.workunit.client.0.smithi019.stdout:6/871: rename d1b/d26/d27/d3e/f114 to d1b/d26/d31/d5f/da8/f12c 0 2024-09-12T22:33:17.030 INFO:tasks.workunit.client.0.smithi019.stdout:4/812: mknod d1/d4c/db0/d75/d5a/d79/c121 0 2024-09-12T22:33:17.031 INFO:tasks.workunit.client.0.smithi019.stdout:2/794: dwrite d0/d5/d60/d74/d7e/f87 [0,4194304] 0 2024-09-12T22:33:17.031 INFO:tasks.workunit.client.0.smithi019.stdout:6/872: stat d1b/d26/d39/d6a/d61/ce6 0 2024-09-12T22:33:17.032 INFO:tasks.workunit.client.0.smithi019.stdout:6/873: dread - d1b/fee zero size 2024-09-12T22:33:17.033 INFO:tasks.workunit.client.0.smithi019.stdout:3/764: dread dd/d12/f29 [0,4194304] 0 2024-09-12T22:33:17.038 INFO:tasks.workunit.client.0.smithi019.stdout:8/814: dwrite d7/d8/dd/d45/fe1 [4194304,4194304] 0 2024-09-12T22:33:17.038 INFO:tasks.workunit.client.0.smithi019.stdout:8/815: dread - d7/d2f/d42/d98/f102 zero size 2024-09-12T22:33:17.038 INFO:tasks.workunit.client.0.smithi019.stdout:4/813: read d1/d22/d2c/d107/d11f/fcd [1178890,63168] 0 2024-09-12T22:33:17.038 INFO:tasks.workunit.client.0.smithi019.stdout:2/795: creat d0/d5/d17/d91/d9c/df2/f111 x:0 0 0 2024-09-12T22:33:17.038 INFO:tasks.workunit.client.0.smithi019.stdout:8/816: link d7/d34/d78/d54/f101 d7/d34/d78/d82/f103 0 2024-09-12T22:33:17.038 INFO:tasks.workunit.client.0.smithi019.stdout:4/814: truncate d1/d11/fdf 41644 0 2024-09-12T22:33:17.038 INFO:tasks.workunit.client.0.smithi019.stdout:8/817: chown d7/d34/d78/d53 386529185 1 2024-09-12T22:33:17.039 INFO:tasks.workunit.client.0.smithi019.stdout:4/815: chown d1/d22/d31/d101/f112 32 1 2024-09-12T22:33:17.039 INFO:tasks.workunit.client.0.smithi019.stdout:4/816: dread - d1/d11/f10b zero size 2024-09-12T22:33:17.042 INFO:tasks.workunit.client.0.smithi019.stdout:8/818: dread d7/d2f/d75/ff5 [0,4194304] 0 2024-09-12T22:33:17.042 INFO:tasks.workunit.client.0.smithi019.stdout:6/874: dwrite d1b/d26/d39/d6a/f5c [0,4194304] 0 2024-09-12T22:33:17.042 INFO:tasks.workunit.client.0.smithi019.stdout:3/765: truncate dd/d12/d62/d74/daa/fb7 707411 0 2024-09-12T22:33:17.042 INFO:tasks.workunit.client.0.smithi019.stdout:4/817: write d1/d4/d44/f74 [3191239,11919] 0 2024-09-12T22:33:17.043 INFO:tasks.workunit.client.0.smithi019.stdout:8/819: fdatasync d7/d8/dd/f56 0 2024-09-12T22:33:17.043 INFO:tasks.workunit.client.0.smithi019.stdout:2/796: dwrite d0/d5/d17/d91/d9c/fb0 [0,4194304] 0 2024-09-12T22:33:17.045 INFO:tasks.workunit.client.0.smithi019.stdout:8/820: fdatasync d7/d8/f7d 0 2024-09-12T22:33:17.046 INFO:tasks.workunit.client.0.smithi019.stdout:3/766: rename dd/d12/d62/d74/daa/fa4 to dd/d12/d62/d74/fec 0 2024-09-12T22:33:17.046 INFO:tasks.workunit.client.0.smithi019.stdout:6/875: link fb d1b/d26/d27/d67/d77/d7b/f12d 0 2024-09-12T22:33:17.046 INFO:tasks.workunit.client.0.smithi019.stdout:2/797: rename d0/da to d0/d5/d60/d74/d7e/d112 0 2024-09-12T22:33:17.049 INFO:tasks.workunit.client.0.smithi019.stdout:3/767: rename dd/d1e/d5a/c6d to dd/d12/d62/d74/ced 0 2024-09-12T22:33:17.049 INFO:tasks.workunit.client.0.smithi019.stdout:3/768: chown dd/d1e/l39 14 1 2024-09-12T22:33:17.050 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:33:17.050 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:33:17.052 INFO:tasks.workunit.client.0.smithi019.stdout:4/818: dwrite d1/d8/d7b/fda [0,4194304] 0 2024-09-12T22:33:17.052 INFO:tasks.workunit.client.0.smithi019.stdout:1/896: dread d3/df/d7e/db7/d16/d3c/dbd/de6/f5d [0,4194304] 0 2024-09-12T22:33:17.054 INFO:tasks.workunit.client.0.smithi019.stdout:1/897: write d3/df/d7e/db7/f36 [2277502,115242] 0 2024-09-12T22:33:17.056 INFO:tasks.workunit.client.0.smithi019.stdout:7/691: sync 2024-09-12T22:33:17.056 INFO:tasks.workunit.client.0.smithi019.stdout:0/821: sync 2024-09-12T22:33:17.056 INFO:tasks.workunit.client.0.smithi019.stdout:9/765: sync 2024-09-12T22:33:17.057 INFO:tasks.workunit.client.0.smithi019.stdout:6/876: sync 2024-09-12T22:33:17.057 INFO:tasks.workunit.client.0.smithi019.stdout:5/879: sync 2024-09-12T22:33:17.057 INFO:tasks.workunit.client.0.smithi019.stdout:7/692: rmdir d6/d2d/de0 39 2024-09-12T22:33:17.057 INFO:tasks.workunit.client.0.smithi019.stdout:6/877: dread - d1b/d26/de2/df2/f124 zero size 2024-09-12T22:33:17.058 INFO:tasks.workunit.client.0.smithi019.stdout:7/693: creat d6/d2d/d77/dbf/dde/f104 x:0 0 0 2024-09-12T22:33:17.059 INFO:tasks.workunit.client.0.smithi019.stdout:9/766: creat dd/d10/d17/d23/d2e/d31/d3f/ff6 x:0 0 0 2024-09-12T22:33:17.060 INFO:tasks.workunit.client.0.smithi019.stdout:7/694: unlink d6/cf6 0 2024-09-12T22:33:17.063 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:33:17.064 INFO:tasks.workunit.client.0.smithi019.stdout:7/695: dread - d6/d14/d2a/da4/d34/ff9 zero size 2024-09-12T22:33:17.065 INFO:tasks.workunit.client.0.smithi019.stdout:0/822: dwrite d1/d14/d1b/d3a/d8c/dae/faf [0,4194304] 0 2024-09-12T22:33:17.066 INFO:tasks.workunit.client.0.smithi019.stdout:7/696: mkdir d6/d2d/d77/dbf/dde/d105 0 2024-09-12T22:33:17.066 INFO:tasks.workunit.client.0.smithi019.stdout:6/878: dwrite d1b/d26/d31/d5f/f9c [0,4194304] 0 2024-09-12T22:33:17.067 INFO:tasks.workunit.client.0.smithi019.stdout:7/697: write d6/d14/d45/fcd [804491,117845] 0 2024-09-12T22:33:17.067 INFO:tasks.workunit.client.0.smithi019.stdout:6/879: chown d1b/d26/d31/d5f/fad 65699 1 2024-09-12T22:33:17.069 INFO:tasks.workunit.client.0.smithi019.stdout:9/767: dwrite dd/d10/d17/d22/fd2 [0,4194304] 0 2024-09-12T22:33:17.071 INFO:tasks.workunit.client.0.smithi019.stdout:7/698: write d6/d14/d2a/da4/f3b [3249721,65535] 0 2024-09-12T22:33:17.071 INFO:tasks.workunit.client.0.smithi019.stdout:9/768: mknod dd/cf7 0 2024-09-12T22:33:17.074 INFO:tasks.workunit.client.0.smithi019.stdout:7/699: write d6/d14/d45/fe5 [359005,66738] 0 2024-09-12T22:33:17.075 INFO:tasks.workunit.client.0.smithi019.stdout:8/821: dread d7/d8/f7d [0,4194304] 0 2024-09-12T22:33:17.076 INFO:tasks.workunit.client.0.smithi019.stdout:7/700: mknod d6/d14/d45/c106 0 2024-09-12T22:33:17.076 INFO:tasks.workunit.client.0.smithi019.stdout:0/823: dwrite d1/d1f/d5b/d83/dab/dbe/d89/fd6 [0,4194304] 0 2024-09-12T22:33:17.076 INFO:tasks.workunit.client.0.smithi019.stdout:8/822: readlink d7/l2b 0 2024-09-12T22:33:17.078 INFO:tasks.workunit.client.0.smithi019.stdout:7/701: chown d6/d14/d2a/da4/l52 358824574 1 2024-09-12T22:33:17.078 INFO:tasks.workunit.client.0.smithi019.stdout:6/880: dwrite d1b/d26/d27/f54 [4194304,4194304] 0 2024-09-12T22:33:17.078 INFO:tasks.workunit.client.0.smithi019.stdout:7/702: sync 2024-09-12T22:33:17.078 INFO:tasks.workunit.client.0.smithi019.stdout:8/823: dread - d7/d34/d78/d53/fe3 zero size 2024-09-12T22:33:17.079 INFO:tasks.workunit.client.0.smithi019.stdout:0/824: creat d1/d1f/d5b/d83/dab/dbe/d3d/f10c x:0 0 0 2024-09-12T22:33:17.079 INFO:tasks.workunit.client.0.smithi019.stdout:8/824: stat d7/d2f/c72 0 2024-09-12T22:33:17.079 INFO:tasks.workunit.client.0.smithi019.stdout:6/881: stat d1b/d26/d31/dd6/fef 0 2024-09-12T22:33:17.079 INFO:tasks.workunit.client.0.smithi019.stdout:7/703: dread - d6/d14/d2a/da4/d42/feb zero size 2024-09-12T22:33:17.079 INFO:tasks.workunit.client.0.smithi019.stdout:6/882: rmdir d1b/d102 39 2024-09-12T22:33:17.079 INFO:tasks.workunit.client.0.smithi019.stdout:0/825: dread - d1/d14/d1b/d94/f10a zero size 2024-09-12T22:33:17.080 INFO:tasks.workunit.client.0.smithi019.stdout:4/819: dread d1/d8/fb [4194304,4194304] 0 2024-09-12T22:33:17.080 INFO:tasks.workunit.client.0.smithi019.stdout:8/825: write d7/d34/d78/d82/fa3 [446335,73860] 0 2024-09-12T22:33:17.081 INFO:tasks.workunit.client.0.smithi019.stdout:6/883: mkdir d1b/d2d/d129/d12e 0 2024-09-12T22:33:17.081 INFO:tasks.workunit.client.0.smithi019.stdout:7/704: creat d6/d14/d15/f107 x:0 0 0 2024-09-12T22:33:17.082 INFO:tasks.workunit.client.0.smithi019.stdout:4/820: truncate d1/d8/dfb/dfc/f10a 577489 0 2024-09-12T22:33:17.082 INFO:tasks.workunit.client.0.smithi019.stdout:6/884: unlink d1b/c1c 0 2024-09-12T22:33:17.082 INFO:tasks.workunit.client.0.smithi019.stdout:8/826: write d7/d34/d78/d54/fa6 [4838366,87221] 0 2024-09-12T22:33:17.083 INFO:tasks.workunit.client.0.smithi019.stdout:4/821: truncate d1/d4c/fb6 4352664 0 2024-09-12T22:33:17.084 INFO:tasks.workunit.client.0.smithi019.stdout:6/885: readlink d1b/d26/d27/d67/d77/d7b/la4 0 2024-09-12T22:33:17.084 INFO:tasks.workunit.client.0.smithi019.stdout:4/822: symlink d1/d11/dff/l122 0 2024-09-12T22:33:17.085 INFO:tasks.workunit.client.0.smithi019.stdout:6/886: unlink d1b/d26/d39/d89/d90/fcf 0 2024-09-12T22:33:17.085 INFO:tasks.workunit.client.0.smithi019.stdout:6/887: dread - d1b/fff zero size 2024-09-12T22:33:17.086 INFO:tasks.workunit.client.0.smithi019.stdout:6/888: fsync d1b/d26/d31/d5f/d91/fca 0 2024-09-12T22:33:17.086 INFO:tasks.workunit.client.0.smithi019.stdout:4/823: getdents d1/d11/d15/d1f/d56/da9 0 2024-09-12T22:33:17.087 INFO:tasks.workunit.client.0.smithi019.stdout:6/889: mkdir d1b/d26/d27/d12f 0 2024-09-12T22:33:17.088 INFO:tasks.workunit.client.0.smithi019.stdout:2/798: dread d0/d5/d60/d71/ffc [0,4194304] 0 2024-09-12T22:33:17.088 INFO:tasks.workunit.client.0.smithi019.stdout:6/890: truncate d1b/d26/d39/d6a/f58 1462465 0 2024-09-12T22:33:17.091 INFO:tasks.workunit.client.0.smithi019.stdout:4/824: read d1/d4c/db0/d75/d5a/d79/db4/f100 [361531,78681] 0 2024-09-12T22:33:17.091 INFO:tasks.workunit.client.0.smithi019.stdout:3/769: dread dd/f31 [0,4194304] 0 2024-09-12T22:33:17.092 INFO:tasks.workunit.client.0.smithi019.stdout:3/770: rmdir dd/d12/d62 39 2024-09-12T22:33:17.094 INFO:tasks.workunit.client.0.smithi019.stdout:4/825: rename d1/d8/c7f to d1/d4c/db0/d75/d5a/d79/c123 0 2024-09-12T22:33:17.094 INFO:tasks.workunit.client.0.smithi019.stdout:9/769: truncate dd/d10/d17/d23/d2e/d31/f34 3121889 0 2024-09-12T22:33:17.095 INFO:tasks.workunit.client.0.smithi019.stdout:2/799: dwrite d0/d5/f10 [0,4194304] 0 2024-09-12T22:33:17.095 INFO:tasks.workunit.client.0.smithi019.stdout:0/826: truncate d1/d14/d1b/d3a/d8c/f90 1885293 0 2024-09-12T22:33:17.095 INFO:tasks.workunit.client.0.smithi019.stdout:6/891: truncate d1b/d26/d27/d3e/d83/d98/fb8 11783 0 2024-09-12T22:33:17.096 INFO:tasks.workunit.client.0.smithi019.stdout:4/826: write d1/d22/d31/d101/f106 [230073,64402] 0 2024-09-12T22:33:17.097 INFO:tasks.workunit.client.0.smithi019.stdout:6/892: chown d1b/d26/d27/c50 0 1 2024-09-12T22:33:17.097 INFO:tasks.workunit.client.0.smithi019.stdout:9/770: chown dd/d10/d17/d23/d2e/d31/d7e/dbc/faa 2 1 2024-09-12T22:33:17.097 INFO:tasks.workunit.client.0.smithi019.stdout:2/800: write d0/d5/d18/f56 [1895925,87977] 0 2024-09-12T22:33:17.098 INFO:tasks.workunit.client.0.smithi019.stdout:0/827: creat d1/d1f/d5b/d83/dab/dbe/dfc/f10d x:0 0 0 2024-09-12T22:33:17.099 INFO:tasks.workunit.client.0.smithi019.stdout:4/827: symlink d1/d11/d15/d1f/d56/da9/dce/l124 0 2024-09-12T22:33:17.099 INFO:tasks.workunit.client.0.smithi019.stdout:6/893: read - d1b/d26/d39/d89/f127 zero size 2024-09-12T22:33:17.100 INFO:tasks.workunit.client.0.smithi019.stdout:6/894: stat d1b 0 2024-09-12T22:33:17.100 INFO:tasks.workunit.client.0.smithi019.stdout:4/828: rmdir d1/d4 39 2024-09-12T22:33:17.100 INFO:tasks.workunit.client.0.smithi019.stdout:2/801: chown d0/d5/d60/d74/f9e 8253 1 2024-09-12T22:33:17.101 INFO:tasks.workunit.client.0.smithi019.stdout:0/828: fdatasync d1/d14/d26/d40/fba 0 2024-09-12T22:33:17.101 INFO:tasks.workunit.client.0.smithi019.stdout:7/705: dwrite d6/d14/d2a/fad [0,4194304] 0 2024-09-12T22:33:17.103 INFO:tasks.workunit.client.0.smithi019.stdout:6/895: fdatasync d1b/d26/d39/d89/fcd 0 2024-09-12T22:33:17.103 INFO:tasks.workunit.client.0.smithi019.stdout:4/829: mknod d1/d8/c125 0 2024-09-12T22:33:17.103 INFO:tasks.workunit.client.0.smithi019.stdout:1/898: dread d3/df/d7e/db7/d16/d3c/d55/f83 [0,4194304] 0 2024-09-12T22:33:17.103 INFO:tasks.workunit.client.0.smithi019.stdout:7/706: mknod d6/d14/d2a/da4/c108 0 2024-09-12T22:33:17.103 INFO:tasks.workunit.client.0.smithi019.stdout:9/771: truncate dd/d10/d17/d23/d2e/d31/d3f/ff6 785448 0 2024-09-12T22:33:17.104 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:17.103+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:17.105 INFO:tasks.workunit.client.0.smithi019.stdout:6/896: symlink d1b/d26/de2/df2/l130 0 2024-09-12T22:33:17.105 INFO:tasks.workunit.client.0.smithi019.stdout:4/830: fsync d1/d22/d31/d4f/ff0 0 2024-09-12T22:33:17.105 INFO:tasks.workunit.client.0.smithi019.stdout:7/707: fdatasync d6/d14/d2a/da4/dc/f8d 0 2024-09-12T22:33:17.105 INFO:tasks.workunit.client.0.smithi019.stdout:9/772: mkdir dd/dcb/df8 0 2024-09-12T22:33:17.105 INFO:tasks.workunit.client.0.smithi019.stdout:2/802: truncate d0/d5/d60/d74/d7e/d112/fd4 462550 0 2024-09-12T22:33:17.105 INFO:tasks.workunit.client.0.smithi019.stdout:6/897: fdatasync d1b/d26/d27/f54 0 2024-09-12T22:33:17.107 INFO:tasks.workunit.client.0.smithi019.stdout:1/899: creat d3/df/d7e/db7/d16/d3c/dbd/dc4/dc3/df1/f122 x:0 0 0 2024-09-12T22:33:17.107 INFO:tasks.workunit.client.0.smithi019.stdout:4/831: mkdir d1/d22/d31/d126 0 2024-09-12T22:33:17.107 INFO:tasks.workunit.client.0.smithi019.stdout:7/708: chown d6/d14/d15/d9e/f2f 0 1 2024-09-12T22:33:17.108 INFO:tasks.workunit.client.0.smithi019.stdout:6/898: mkdir d1b/db4/d131 0 2024-09-12T22:33:17.108 INFO:tasks.workunit.client.0.smithi019.stdout:2/803: mkdir d0/d5/d18/d1b/d113 0 2024-09-12T22:33:17.109 INFO:tasks.workunit.client.0.smithi019.stdout:9/773: creat dd/d10/d17/d22/d6c/d53/d69/d9d/dbd/de8/ff9 x:0 0 0 2024-09-12T22:33:17.109 INFO:tasks.workunit.client.0.smithi019.stdout:5/880: dread d0/d7/d2d/d32/d36/d8c/db8/fbc [0,4194304] 0 2024-09-12T22:33:17.109 INFO:tasks.workunit.client.0.smithi019.stdout:4/832: write d1/d22/d31/d4f/ff0 [4103284,82117] 0 2024-09-12T22:33:17.110 INFO:tasks.workunit.client.0.smithi019.stdout:1/900: fdatasync d3/df/d7e/db7/d16/d3c/dbd/dc4/dc3/df1/f122 0 2024-09-12T22:33:17.111 INFO:tasks.workunit.client.0.smithi019.stdout:6/899: stat d1b/d26/d39/f65 0 2024-09-12T22:33:17.111 INFO:tasks.workunit.client.0.smithi019.stdout:7/709: rename d6/d14/d15/cc8 to d6/d2d/d77/d8e/c109 0 2024-09-12T22:33:17.111 INFO:tasks.workunit.client.0.smithi019.stdout:1/901: mkdir d3/d3f/d123 0 2024-09-12T22:33:17.112 INFO:tasks.workunit.client.0.smithi019.stdout:1/902: unlink d3/c4e 0 2024-09-12T22:33:17.113 INFO:tasks.workunit.client.0.smithi019.stdout:2/804: dread d0/d5/d18/d39/fbd [0,4194304] 0 2024-09-12T22:33:17.113 INFO:tasks.workunit.client.0.smithi019.stdout:6/900: creat d1b/d26/d39/d6a/d61/f132 x:0 0 0 2024-09-12T22:33:17.113 INFO:tasks.workunit.client.0.smithi019.stdout:0/829: truncate d1/d14/d1b/d3a/d8c/f90 2860221 0 2024-09-12T22:33:17.113 INFO:tasks.workunit.client.0.smithi019.stdout:2/805: sync 2024-09-12T22:33:17.113 INFO:tasks.workunit.client.0.smithi019.stdout:7/710: creat d6/d14/d2a/da4/d42/f10a x:0 0 0 2024-09-12T22:33:17.114 INFO:tasks.workunit.client.0.smithi019.stdout:6/901: fsync d1b/f11f 0 2024-09-12T22:33:17.114 INFO:tasks.workunit.client.0.smithi019.stdout:5/881: chown d0/d7/d2d/d32/d36/d8c/db8/d39/d38/d4b/dde/da0/d12b/c40 1 1 2024-09-12T22:33:17.115 INFO:tasks.workunit.client.0.smithi019.stdout:4/833: read d1/d11/d15/d49/fb1 [639390,64539] 0 2024-09-12T22:33:17.117 INFO:tasks.workunit.client.0.smithi019.stdout:3/771: dread dd/f2a [0,4194304] 0 2024-09-12T22:33:17.117 INFO:tasks.workunit.client.0.smithi019.stdout:7/711: creat d6/d2d/d8f/daf/f10b x:0 0 0 2024-09-12T22:33:17.119 INFO:tasks.workunit.client.0.smithi019.stdout:2/806: write d0/d5/d18/d5c/f6f [4935121,23592] 0 2024-09-12T22:33:17.119 INFO:tasks.workunit.client.0.smithi019.stdout:8/827: dread d7/d2f/d42/f49 [0,4194304] 0 2024-09-12T22:33:17.119 INFO:tasks.workunit.client.0.smithi019.stdout:1/903: write d3/df/d7e/db7/d16/d3c/dbd/dc4/f5b [5041395,14179] 0 2024-09-12T22:33:17.120 INFO:tasks.workunit.client.0.smithi019.stdout:4/834: write d1/d4/d44/fcc [177167,17488] 0 2024-09-12T22:33:17.121 INFO:tasks.workunit.client.0.smithi019.stdout:9/774: dwrite dd/d10/d17/d22/d6c/d53/d69/fc9 [0,4194304] 0 2024-09-12T22:33:17.121 INFO:tasks.workunit.client.0.smithi019.stdout:0/830: truncate d1/d1f/d5b/d83/dab/dbe/d3d/f10c 684790 0 2024-09-12T22:33:17.123 INFO:tasks.workunit.client.0.smithi019.stdout:5/882: rename d0/d7/d2d/d32/d36/d8c/db8/d39/d38/f3f to d0/d7/d2d/d32/d36/d8c/db8/d39/d38/d4b/dde/da0/d12b/dfb/f132 0 2024-09-12T22:33:17.124 INFO:tasks.workunit.client.0.smithi019.stdout:4/835: readlink d1/d11/d15/d1f/l55 0 2024-09-12T22:33:17.124 INFO:tasks.workunit.client.0.smithi019.stdout:8/828: mkdir d7/d8/dd/def/d104 0 2024-09-12T22:33:17.126 INFO:tasks.workunit.client.0.smithi019.stdout:5/883: chown d0/d7/d2d/dc2/l10d 793 1 2024-09-12T22:33:17.128 INFO:tasks.workunit.client.0.smithi019.stdout:0/831: truncate d1/d14/d26/d40/d45/d5e/da2/fd0 304881 0 2024-09-12T22:33:17.128 INFO:tasks.workunit.client.0.smithi019.stdout:8/829: unlink d7/d8/d43/l57 0 2024-09-12T22:33:17.129 INFO:tasks.workunit.client.0.smithi019.stdout:1/904: rename d3/d3f/d58/d101/f105 to d3/df/d7e/db7/d16/d3c/dce/f124 0 2024-09-12T22:33:17.131 INFO:tasks.workunit.client.0.smithi019.stdout:2/807: dwrite d0/f1f [0,4194304] 0 2024-09-12T22:33:17.132 INFO:tasks.workunit.client.0.smithi019.stdout:6/902: dwrite d1b/d26/d39/f82 [0,4194304] 0 2024-09-12T22:33:17.132 INFO:tasks.workunit.client.0.smithi019.stdout:7/712: dwrite d6/d14/d2a/da4/dc/d63/f37 [0,4194304] 0 2024-09-12T22:33:17.132 INFO:tasks.workunit.client.0.smithi019.stdout:4/836: mknod d1/d4c/db0/d75/d5a/d79/db4/c127 0 2024-09-12T22:33:17.135 INFO:tasks.workunit.client.0.smithi019.stdout:6/903: unlink d1b/d26/d39/d6a/f92 0 2024-09-12T22:33:17.135 INFO:tasks.workunit.client.0.smithi019.stdout:9/775: dwrite dd/d10/d17/d23/d2e/f93 [0,4194304] 0 2024-09-12T22:33:17.136 INFO:tasks.workunit.client.0.smithi019.stdout:8/830: truncate d7/d34/d78/ff4 340152 0 2024-09-12T22:33:17.137 INFO:tasks.workunit.client.0.smithi019.stdout:1/905: truncate d3/df/d7e/db7/d63/d76/d91/de1/f119 332670 0 2024-09-12T22:33:17.137 INFO:tasks.workunit.client.0.smithi019.stdout:5/884: rename d0/d7/d2d/d32/d36/d8c/db8/d39/d38/d4b/dde/da0/d12b/d9d/dd8 to d0/db9/d120/d133 0 2024-09-12T22:33:17.137 INFO:tasks.workunit.client.0.smithi019.stdout:6/904: creat d1b/d26/d31/dd6/f133 x:0 0 0 2024-09-12T22:33:17.139 INFO:tasks.workunit.client.0.smithi019.stdout:1/906: write d3/f31 [50932,112909] 0 2024-09-12T22:33:17.142 INFO:tasks.workunit.client.0.smithi019.stdout:8/831: symlink d7/d2f/ddb/l105 0 2024-09-12T22:33:17.143 INFO:tasks.workunit.client.0.smithi019.stdout:7/713: dwrite d6/d2d/d77/fec [0,4194304] 0 2024-09-12T22:33:17.144 INFO:tasks.workunit.client.0.smithi019.stdout:8/832: mkdir d7/d34/d106 0 2024-09-12T22:33:17.145 INFO:tasks.workunit.client.0.smithi019.stdout:9/776: rename dd/d10/d17/d23/d2e/d31/d3f/d47/d6e/f89 to dd/d10/d17/d22/ffa 0 2024-09-12T22:33:17.145 INFO:tasks.workunit.client.0.smithi019.stdout:0/832: read d1/f1a [570531,130809] 0 2024-09-12T22:33:17.146 INFO:tasks.workunit.client.0.smithi019.stdout:6/905: link d1b/d26/d39/d6a/d61/lf9 d1b/d26/d31/dec/l134 0 2024-09-12T22:33:17.146 INFO:tasks.workunit.client.0.smithi019.stdout:5/885: chown d0/d7/d2d/d32/d36/d8c/db8/d39/d38/d4b/dde/da0/d12b/dc3/f10a 15120 1 2024-09-12T22:33:17.146 INFO:tasks.workunit.client.0.smithi019.stdout:6/906: sync 2024-09-12T22:33:17.146 INFO:tasks.workunit.client.0.smithi019.stdout:1/907: creat d3/df/d7e/db7/d16/d3c/dbd/dc4/dc3/df1/f125 x:0 0 0 2024-09-12T22:33:17.147 INFO:tasks.workunit.client.0.smithi019.stdout:7/714: fsync d6/d14/d15/f28 0 2024-09-12T22:33:17.147 INFO:tasks.workunit.client.0.smithi019.stdout:4/837: dwrite d1/d4/d38/f5e [0,4194304] 0 2024-09-12T22:33:17.148 INFO:tasks.workunit.client.0.smithi019.stdout:8/833: unlink d7/d2f/ddb/l105 0 2024-09-12T22:33:17.150 INFO:tasks.workunit.client.0.smithi019.stdout:0/833: unlink d1/d1f/l42 0 2024-09-12T22:33:17.150 INFO:tasks.workunit.client.0.smithi019.stdout:1/908: mkdir d3/df/d7e/db7/d16/d126 0 2024-09-12T22:33:17.151 INFO:tasks.workunit.client.0.smithi019.stdout:4/838: symlink d1/d22/d26/da1/l128 0 2024-09-12T22:33:17.151 INFO:tasks.workunit.client.0.smithi019.stdout:9/777: write dd/d10/d17/d23/d2e/d31/d7e/dbc/f71 [2009,5109] 0 2024-09-12T22:33:17.151 INFO:tasks.workunit.client.0.smithi019.stdout:7/715: fsync d6/d2d/d77/f79 0 2024-09-12T22:33:17.151 INFO:tasks.workunit.client.0.smithi019.stdout:6/907: rename d1b/f20 to d1b/d26/d31/d5f/d91/f135 0 2024-09-12T22:33:17.151 INFO:tasks.workunit.client.0.smithi019.stdout:0/834: symlink d1/d1f/d5b/d83/de0/l10e 0 2024-09-12T22:33:17.152 INFO:tasks.workunit.client.0.smithi019.stdout:1/909: creat d3/d3f/d58/d101/f127 x:0 0 0 2024-09-12T22:33:17.152 INFO:tasks.workunit.client.0.smithi019.stdout:4/839: creat d1/d22/d57/df2/f129 x:0 0 0 2024-09-12T22:33:17.152 INFO:tasks.workunit.client.0.smithi019.stdout:6/908: readlink d1b/d2d/l7c 0 2024-09-12T22:33:17.152 INFO:tasks.workunit.client.0.smithi019.stdout:0/835: stat d1/c10 0 2024-09-12T22:33:17.153 INFO:tasks.workunit.client.0.smithi019.stdout:6/909: unlink d1b/d2d/f42 0 2024-09-12T22:33:17.153 INFO:tasks.workunit.client.0.smithi019.stdout:0/836: mkdir d1/d14/dad/d10f 0 2024-09-12T22:33:17.155 INFO:tasks.workunit.client.0.smithi019.stdout:1/910: write d3/df/d7e/db7/d16/d3c/dbd/de6/f27 [1106841,88264] 0 2024-09-12T22:33:17.155 INFO:tasks.workunit.client.0.smithi019.stdout:4/840: rename d1/d11/d15/d1f/l55 to d1/d22/d31/d85/l12a 0 2024-09-12T22:33:17.156 INFO:tasks.workunit.client.0.smithi019.stdout:0/837: truncate d1/d14/f92 917263 0 2024-09-12T22:33:17.156 INFO:tasks.workunit.client.0.smithi019.stdout:5/886: truncate d0/d7/d2d/d32/d36/d8c/db8/d39/d38/d4b/dde/da0/d12b/dc3/f10a 249686 0 2024-09-12T22:33:17.157 INFO:tasks.workunit.client.0.smithi019.stdout:9/778: link dd/d10/d17/d23/d2e/d31/d7e/dbc/f71 dd/d10/d17/d23/d2e/d31/d3f/dc0/ffb 0 2024-09-12T22:33:17.157 INFO:tasks.workunit.client.0.smithi019.stdout:4/841: creat d1/d8/dfb/f12b x:0 0 0 2024-09-12T22:33:17.157 INFO:tasks.workunit.client.0.smithi019.stdout:1/911: mkdir d3/df/d7e/db7/d63/de7/d128 0 2024-09-12T22:33:17.158 INFO:tasks.workunit.client.0.smithi019.stdout:1/912: sync 2024-09-12T22:33:17.158 INFO:tasks.workunit.client.0.smithi019.stdout:6/910: rename d1b/d26/d39/d6a/f5c to d1b/d26/d31/d5f/f136 0 2024-09-12T22:33:17.158 INFO:tasks.workunit.client.0.smithi019.stdout:3/772: dread dd/d1e/d40/f90 [0,4194304] 0 2024-09-12T22:33:17.159 INFO:tasks.workunit.client.0.smithi019.stdout:4/842: chown d1/d4 62558 1 2024-09-12T22:33:17.159 INFO:tasks.workunit.client.0.smithi019.stdout:0/838: mkdir d1/d14/d110 0 2024-09-12T22:33:17.159 INFO:tasks.workunit.client.0.smithi019.stdout:9/779: mkdir dd/deb/dfc 0 2024-09-12T22:33:17.160 INFO:tasks.workunit.client.0.smithi019.stdout:3/773: chown dd/d1e/d40/d6e/fa1 7 1 2024-09-12T22:33:17.160 INFO:tasks.workunit.client.0.smithi019.stdout:6/911: fsync d1b/d26/d27/d3e/d83/d98/fa5 0 2024-09-12T22:33:17.162 INFO:tasks.workunit.client.0.smithi019.stdout:1/913: unlink d3/df/d7e/db7/d63/d76/d91/de1/f119 0 2024-09-12T22:33:17.164 INFO:tasks.workunit.client.0.smithi019.stdout:0/839: rename d1/d14/d26/d40/d45/d5e/d84/fb6 to d1/d14/d1b/d94/f111 0 2024-09-12T22:33:17.165 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:17.164+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:17.165 INFO:tasks.workunit.client.0.smithi019.stdout:2/808: dread d0/d5/d18/d3b/f49 [4194304,4194304] 0 2024-09-12T22:33:17.166 INFO:tasks.workunit.client.0.smithi019.stdout:2/809: sync 2024-09-12T22:33:17.166 INFO:tasks.workunit.client.0.smithi019.stdout:6/912: creat d1b/d26/d39/d89/f137 x:0 0 0 2024-09-12T22:33:17.170 INFO:tasks.workunit.client.0.smithi019.stdout:5/887: dwrite d0/d7/d2d/d32/d36/d8c/db8/d39/d38/dba/f5b [0,4194304] 0 2024-09-12T22:33:17.171 INFO:tasks.workunit.client.0.smithi019.stdout:0/840: mkdir d1/d14/d26/d40/d45/d5e/df8/d112 0 2024-09-12T22:33:17.172 INFO:tasks.workunit.client.0.smithi019.stdout:9/780: dwrite dd/d10/d17/d22/d42/f55 [4194304,4194304] 0 2024-09-12T22:33:17.172 INFO:tasks.workunit.client.0.smithi019.stdout:6/913: rmdir d1b/d26/d31/dd6 39 2024-09-12T22:33:17.173 INFO:tasks.workunit.client.0.smithi019.stdout:1/914: rename d3/df/d7e/db7/d16/d3c/ffd to d3/df/d7e/db7/d16/d126/f129 0 2024-09-12T22:33:17.173 INFO:tasks.workunit.client.0.smithi019.stdout:7/716: dread d6/dcf/fdc [0,4194304] 0 2024-09-12T22:33:17.173 INFO:tasks.workunit.client.0.smithi019.stdout:4/843: dwrite d1/d22/d31/d101/f112 [0,4194304] 0 2024-09-12T22:33:17.175 INFO:tasks.workunit.client.0.smithi019.stdout:0/841: symlink d1/d14/d1b/d94/l113 0 2024-09-12T22:33:17.175 INFO:tasks.workunit.client.0.smithi019.stdout:8/834: dwrite d7/d8/dd/f1c [0,4194304] 0 2024-09-12T22:33:17.176 INFO:tasks.workunit.client.0.smithi019.stdout:4/844: write d1/d11/fdf [482827,93463] 0 2024-09-12T22:33:17.176 INFO:tasks.workunit.client.0.smithi019.stdout:9/781: mknod dd/d10/d17/d22/d6c/cfd 0 2024-09-12T22:33:17.176 INFO:tasks.workunit.client.0.smithi019.stdout:7/717: creat d6/d14/d15/d62/f10c x:0 0 0 2024-09-12T22:33:17.177 INFO:tasks.workunit.client.0.smithi019.stdout:4/845: readlink d1/d11/d15/lf6 0 2024-09-12T22:33:17.178 INFO:tasks.workunit.client.0.smithi019.stdout:8/835: write d7/d8/d43/f8f [3772404,51553] 0 2024-09-12T22:33:17.178 INFO:tasks.workunit.client.0.smithi019.stdout:5/888: read - d0/d7/d2d/d32/d36/d8c/db8/d39/d38/d4b/dde/da0/d12b/dc3/f10f zero size 2024-09-12T22:33:17.178 INFO:tasks.workunit.client.0.smithi019.stdout:1/915: chown d3/df/d7e/db7/d16/d3c/dbd/de6/f68 0 1 2024-09-12T22:33:17.179 INFO:tasks.workunit.client.0.smithi019.stdout:6/914: rename d1b/db4/fd3 to d1b/d26/d39/f138 0 2024-09-12T22:33:17.180 INFO:tasks.workunit.client.0.smithi019.stdout:0/842: mknod d1/d1f/d5b/d83/dab/dbe/d106/c114 0 2024-09-12T22:33:17.180 INFO:tasks.workunit.client.0.smithi019.stdout:5/889: read - d0/d7/d16/fe7 zero size 2024-09-12T22:33:17.180 INFO:tasks.workunit.client.0.smithi019.stdout:2/810: dwrite d0/d5/d18/d5c/d85/fa6 [0,4194304] 0 2024-09-12T22:33:17.180 INFO:tasks.workunit.client.0.smithi019.stdout:4/846: rmdir d1/d22/d31/d85 39 2024-09-12T22:33:17.181 INFO:tasks.workunit.client.0.smithi019.stdout:3/774: dread dd/f13 [0,4194304] 0 2024-09-12T22:33:17.181 INFO:tasks.workunit.client.0.smithi019.stdout:8/836: rename d7/d8/dd/fbb to d7/d34/f107 0 2024-09-12T22:33:17.181 INFO:tasks.workunit.client.0.smithi019.stdout:9/782: symlink dd/d10/d17/d23/d2e/d31/d7e/lfe 0 2024-09-12T22:33:17.182 INFO:tasks.workunit.client.0.smithi019.stdout:8/837: sync 2024-09-12T22:33:17.182 INFO:tasks.workunit.client.0.smithi019.stdout:7/718: readlink d6/d14/d2a/da4/dc/d63/d4b/l57 0 2024-09-12T22:33:17.182 INFO:tasks.workunit.client.0.smithi019.stdout:6/915: mkdir d1b/d26/d39/d89/d90/d139 0 2024-09-12T22:33:17.183 INFO:tasks.workunit.client.0.smithi019.stdout:0/843: write d1/d51/fe2 [1345213,113355] 0 2024-09-12T22:33:17.183 INFO:tasks.workunit.client.0.smithi019.stdout:5/890: symlink d0/dd0/d104/l134 0 2024-09-12T22:33:17.183 INFO:tasks.workunit.client.0.smithi019.stdout:1/916: truncate d3/d3f/d58/dc6/ffe 822838 0 2024-09-12T22:33:17.184 INFO:tasks.workunit.client.0.smithi019.stdout:6/916: mknod d1b/d26/d31/c13a 0 2024-09-12T22:33:17.185 INFO:tasks.workunit.client.0.smithi019.stdout:8/838: getdents d7/d34/d106 0 2024-09-12T22:33:17.186 INFO:tasks.workunit.client.0.smithi019.stdout:2/811: symlink d0/d5/d60/d74/d7e/d112/d73/l114 0 2024-09-12T22:33:17.186 INFO:tasks.workunit.client.0.smithi019.stdout:5/891: mkdir d0/db9/d120/d135 0 2024-09-12T22:33:17.186 INFO:tasks.workunit.client.0.smithi019.stdout:0/844: write d1/d1f/d5b/d83/dab/dbe/fe8 [423042,63813] 0 2024-09-12T22:33:17.188 INFO:tasks.workunit.client.0.smithi019.stdout:6/917: mknod d1b/d26/d39/d89/c13b 0 2024-09-12T22:33:17.188 INFO:tasks.workunit.client.0.smithi019.stdout:8/839: chown d7/d34/d78/d54/fe5 14754390 1 2024-09-12T22:33:17.189 INFO:tasks.workunit.client.0.smithi019.stdout:0/845: stat d1/d14/d26/d40/d45/d5e/f66 0 2024-09-12T22:33:17.189 INFO:tasks.workunit.client.0.smithi019.stdout:3/775: dwrite dd/f2a [0,4194304] 0 2024-09-12T22:33:17.190 INFO:tasks.workunit.client.0.smithi019.stdout:6/918: rmdir d1b/d26/d31/dec 39 2024-09-12T22:33:17.192 INFO:tasks.workunit.client.0.smithi019.stdout:8/840: write d7/d8/fab [2117227,14328] 0 2024-09-12T22:33:17.192 INFO:tasks.workunit.client.0.smithi019.stdout:2/812: mknod d0/d5/d18/d1b/d5d/d86/d10b/c115 0 2024-09-12T22:33:17.192 INFO:tasks.workunit.client.0.smithi019.stdout:4/847: dwrite d1/d22/d2c/f35 [0,4194304] 0 2024-09-12T22:33:17.194 INFO:tasks.workunit.client.0.smithi019.stdout:3/776: write dd/d1e/d40/da6/dba/fea [327228,56987] 0 2024-09-12T22:33:17.194 INFO:tasks.workunit.client.0.smithi019.stdout:5/892: rename d0/d7/d2d/f54 to d0/d7/d2d/d32/d36/d8c/db8/d39/d38/dba/f136 0 2024-09-12T22:33:17.194 INFO:tasks.workunit.client.0.smithi019.stdout:8/841: chown d7/d2f/d42/la0 1374 1 2024-09-12T22:33:17.194 INFO:tasks.workunit.client.0.smithi019.stdout:8/842: sync 2024-09-12T22:33:17.194 INFO:tasks.workunit.client.0.smithi019.stdout:1/917: dwrite d3/d3f/d58/f6f [0,4194304] 0 2024-09-12T22:33:17.197 INFO:tasks.workunit.client.0.smithi019.stdout:0/846: truncate d1/d14/d1b/d3a/fa8 3452054 0 2024-09-12T22:33:17.197 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:33:17.197 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:33:17.198 INFO:tasks.workunit.client.0.smithi019.stdout:8/843: mkdir d7/d34/d78/d53/d108 0 2024-09-12T22:33:17.198 INFO:tasks.workunit.client.0.smithi019.stdout:8/844: write d7/d34/fc9 [61333,90823] 0 2024-09-12T22:33:17.201 INFO:tasks.workunit.client.0.smithi019.stdout:1/918: dwrite d3/df/d7e/db7/d16/d3c/dbd/de6/f8e [0,4194304] 0 2024-09-12T22:33:17.204 INFO:tasks.workunit.client.0.smithi019.stdout:4/848: read d1/d11/d15/d1f/d56/da9/dce/fef [880273,42567] 0 2024-09-12T22:33:17.204 INFO:tasks.workunit.client.0.smithi019.stdout:0/847: dwrite d1/d1f/d5b/d83/dab/dbe/dfc/f10d [0,4194304] 0 2024-09-12T22:33:17.205 INFO:tasks.workunit.client.0.smithi019.stdout:1/919: link d3/df/d7e/db7/d16/d3c/dbd/de4/ff8 d3/d3f/d77/f12a 0 2024-09-12T22:33:17.205 INFO:tasks.workunit.client.0.smithi019.stdout:4/849: fdatasync d1/d11/d15/d1f/d56/dac/fd6 0 2024-09-12T22:33:17.206 INFO:tasks.workunit.client.0.smithi019.stdout:1/920: chown d3/d3f/d58/dc6/ffe 2010 1 2024-09-12T22:33:17.206 INFO:tasks.workunit.client.0.smithi019.stdout:6/919: getdents d1b/d26/d39/d89 0 2024-09-12T22:33:17.207 INFO:tasks.workunit.client.0.smithi019.stdout:2/813: truncate d0/d5/d18/d5c/d85/fc2 399805 0 2024-09-12T22:33:17.207 INFO:tasks.workunit.client.0.smithi019.stdout:1/921: stat d3/d6e/da9/l1e 0 2024-09-12T22:33:17.209 INFO:tasks.workunit.client.0.smithi019.stdout:6/920: mkdir d1b/db4/d131/d13c 0 2024-09-12T22:33:17.209 INFO:tasks.workunit.client.0.smithi019.stdout:2/814: mknod d0/d5/d17/d91/d9c/c116 0 2024-09-12T22:33:17.210 INFO:tasks.workunit.client.0.smithi019.stdout:2/815: unlink d0/f1f 0 2024-09-12T22:33:17.211 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:33:17.212 INFO:tasks.workunit.client.0.smithi019.stdout:6/921: chown d1b/d26/d39/d89/d90/f122 1 1 2024-09-12T22:33:17.212 INFO:tasks.workunit.client.0.smithi019.stdout:3/777: dread dd/d12/f2c [0,4194304] 0 2024-09-12T22:33:17.212 INFO:tasks.workunit.client.0.smithi019.stdout:0/848: dwrite d1/d1f/f8b [0,4194304] 0 2024-09-12T22:33:17.212 INFO:tasks.workunit.client.0.smithi019.stdout:8/845: dwrite d7/d34/d78/d82/f103 [0,4194304] 0 2024-09-12T22:33:17.213 INFO:tasks.workunit.client.0.smithi019.stdout:8/846: fdatasync d7/d2f/d75/dc7/fcf 0 2024-09-12T22:33:17.214 INFO:tasks.workunit.client.0.smithi019.stdout:3/778: write dd/d12/d62/d78/d98/fb6 [303385,8182] 0 2024-09-12T22:33:17.214 INFO:tasks.workunit.client.0.smithi019.stdout:6/922: rename d1b/d26/de2/de5/lf4 to d1b/l13d 0 2024-09-12T22:33:17.214 INFO:tasks.workunit.client.0.smithi019.stdout:0/849: mknod d1/d14/d1b/d3a/df4/c115 0 2024-09-12T22:33:17.215 INFO:tasks.workunit.client.0.smithi019.stdout:2/816: rename d0/d5/d18/d5c/d85/d95/c6c to d0/d5/d18/d5c/d67/d77/c117 0 2024-09-12T22:33:17.215 INFO:tasks.workunit.client.0.smithi019.stdout:8/847: mkdir d7/d34/d78/d53/d108/d109 0 2024-09-12T22:33:17.216 INFO:tasks.workunit.client.0.smithi019.stdout:4/850: write d1/d11/d15/f2e [74890,83770] 0 2024-09-12T22:33:17.216 INFO:tasks.workunit.client.0.smithi019.stdout:0/850: rmdir d1/d14/dad/dcc 39 2024-09-12T22:33:17.217 INFO:tasks.workunit.client.0.smithi019.stdout:3/779: rename dd/d12/d62/d78/fae to dd/d1e/fee 0 2024-09-12T22:33:17.218 INFO:tasks.workunit.client.0.smithi019.stdout:8/848: mkdir d7/d8/d43/d87/dc2/d10a 0 2024-09-12T22:33:17.218 INFO:tasks.workunit.client.0.smithi019.stdout:4/851: write d1/d11/f10b [975752,96680] 0 2024-09-12T22:33:17.219 INFO:tasks.workunit.client.0.smithi019.stdout:4/852: creat d1/d11/d15/d1f/d56/da9/dce/f12c x:0 0 0 2024-09-12T22:33:17.220 INFO:tasks.workunit.client.0.smithi019.stdout:6/923: dwrite d1b/d26/f3a [0,4194304] 0 2024-09-12T22:33:17.221 INFO:tasks.workunit.client.0.smithi019.stdout:6/924: rmdir d1b/d26/d39/d6a/d61 39 2024-09-12T22:33:17.222 INFO:tasks.workunit.client.0.smithi019.stdout:6/925: stat d1b/c21 0 2024-09-12T22:33:17.222 INFO:tasks.workunit.client.0.smithi019.stdout:6/926: rmdir d1b/db4/d131 39 2024-09-12T22:33:17.224 INFO:tasks.workunit.client.0.smithi019.stdout:6/927: link d1b/d26/d39/d89/d90/fe8 d1b/d26/de2/df2/f13e 0 2024-09-12T22:33:17.225 INFO:tasks.workunit.client.0.smithi019.stdout:6/928: chown d1b/d26/d31/d5f/da8/f12c 1291 1 2024-09-12T22:33:17.226 INFO:tasks.workunit.client.0.smithi019.stdout:6/929: getdents d1b/d26 0 2024-09-12T22:33:17.227 INFO:tasks.workunit.client.0.smithi019.stdout:6/930: mknod d1b/d26/d39/c13f 0 2024-09-12T22:33:17.232 INFO:tasks.workunit.client.0.smithi019.stdout:9/783: dread dd/dc2/f81 [0,4194304] 0 2024-09-12T22:33:17.236 INFO:tasks.workunit.client.0.smithi019.stdout:0/851: write d1/d14/d1b/d3a/fa8 [3026530,83362] 0 2024-09-12T22:33:17.242 INFO:tasks.workunit.client.0.smithi019.stdout:9/784: dwrite dd/d10/d17/d23/d2e/d31/d7e/dbc/f71 [4194304,4194304] 0 2024-09-12T22:33:17.242 INFO:tasks.workunit.client.0.smithi019.stdout:9/785: creat dd/d10/d17/d22/d77/fff x:0 0 0 2024-09-12T22:33:17.242 INFO:tasks.workunit.client.0.smithi019.stdout:7/719: dread d6/d14/d2a/da4/dc/f9 [4194304,4194304] 0 2024-09-12T22:33:17.242 INFO:tasks.workunit.client.0.smithi019.stdout:1/922: sync 2024-09-12T22:33:17.242 INFO:tasks.workunit.client.0.smithi019.stdout:9/786: write dd/d10/d17/d22/d77/fb5 [1074637,107124] 0 2024-09-12T22:33:17.243 INFO:tasks.workunit.client.0.smithi019.stdout:7/720: creat d6/d14/d15/f10d x:0 0 0 2024-09-12T22:33:17.244 INFO:tasks.workunit.client.0.smithi019.stdout:9/787: dread - dd/d10/d17/d22/d6c/f79 zero size 2024-09-12T22:33:17.244 INFO:tasks.workunit.client.0.smithi019.stdout:1/923: creat d3/df/d7e/db7/d63/d76/d91/de1/f12b x:0 0 0 2024-09-12T22:33:17.245 INFO:tasks.workunit.client.0.smithi019.stdout:9/788: mknod dd/d10/d17/d22/c100 0 2024-09-12T22:33:17.247 INFO:tasks.workunit.client.0.smithi019.stdout:7/721: truncate d6/d14/d2a/da4/dc/f71 240975 0 2024-09-12T22:33:17.247 INFO:tasks.workunit.client.0.smithi019.stdout:9/789: truncate dd/d10/d17/d23/d2e/d31/d54/f75 4527634 0 2024-09-12T22:33:17.250 INFO:tasks.workunit.client.0.smithi019.stdout:1/924: dwrite d3/df/d7e/db7/d16/d3c/d55/da0/fc1 [0,4194304] 0 2024-09-12T22:33:17.252 INFO:tasks.workunit.client.0.smithi019.stdout:5/893: dread d0/d7/d2d/d32/d36/d8c/db8/d24/ff4 [0,4194304] 0 2024-09-12T22:33:17.252 INFO:tasks.workunit.client.0.smithi019.stdout:1/925: truncate d3/df/d7e/d96/fa5 4925426 0 2024-09-12T22:33:17.253 INFO:tasks.workunit.client.0.smithi019.stdout:9/790: dwrite dd/d10/d17/d22/d42/f55 [4194304,4194304] 0 2024-09-12T22:33:17.253 INFO:tasks.workunit.client.0.smithi019.stdout:3/780: dread dd/f16 [0,4194304] 0 2024-09-12T22:33:17.253 INFO:tasks.workunit.client.0.smithi019.stdout:5/894: chown d0/d7/d16/l12c 125 1 2024-09-12T22:33:17.254 INFO:tasks.workunit.client.0.smithi019.stdout:1/926: creat d3/d3f/d58/d7f/ded/f12c x:0 0 0 2024-09-12T22:33:17.256 INFO:tasks.workunit.client.0.smithi019.stdout:5/895: fdatasync d0/d7/d2d/d32/d36/d8c/db8/d39/d38/d4b/feb 0 2024-09-12T22:33:17.257 INFO:tasks.workunit.client.0.smithi019.stdout:4/853: sync 2024-09-12T22:33:17.257 INFO:tasks.workunit.client.0.smithi019.stdout:8/849: sync 2024-09-12T22:33:17.257 INFO:tasks.workunit.client.0.smithi019.stdout:3/781: link dd/d12/d62/d6a/lb4 dd/lef 0 2024-09-12T22:33:17.258 INFO:tasks.workunit.client.0.smithi019.stdout:6/931: dread d1b/d26/d39/d6a/d97/f11d [0,4194304] 0 2024-09-12T22:33:17.259 INFO:tasks.workunit.client.0.smithi019.stdout:2/817: dread d0/d5/d18/d3b/f3f [0,4194304] 0 2024-09-12T22:33:17.259 INFO:tasks.workunit.client.0.smithi019.stdout:8/850: unlink d7/d5e/fcb 0 2024-09-12T22:33:17.259 INFO:tasks.workunit.client.0.smithi019.stdout:6/932: write d1b/d26/d39/d89/d90/f10a [344964,128157] 0 2024-09-12T22:33:17.260 INFO:tasks.workunit.client.0.smithi019.stdout:7/722: dread d6/d14/d15/f17 [0,4194304] 0 2024-09-12T22:33:17.260 INFO:tasks.workunit.client.0.smithi019.stdout:8/851: write d7/d8/d43/d87/fb2 [820312,11580] 0 2024-09-12T22:33:17.260 INFO:tasks.workunit.client.0.smithi019.stdout:3/782: link dd/d12/d62/d74/l9d dd/d12/d62/d74/lf0 0 2024-09-12T22:33:17.261 INFO:tasks.workunit.client.0.smithi019.stdout:9/791: read dd/d10/d17/d23/d2e/d31/d3f/d47/d6e/f8a [3088148,7354] 0 2024-09-12T22:33:17.262 INFO:tasks.workunit.client.0.smithi019.stdout:2/818: creat d0/d5/d18/d1b/d5d/d86/f118 x:0 0 0 2024-09-12T22:33:17.262 INFO:tasks.workunit.client.0.smithi019.stdout:6/933: rmdir d1b/d26/d27/d3e/d83 39 2024-09-12T22:33:17.263 INFO:tasks.workunit.client.0.smithi019.stdout:7/723: creat d6/d14/d15/d62/f10e x:0 0 0 2024-09-12T22:33:17.264 INFO:tasks.workunit.client.0.smithi019.stdout:3/783: creat dd/d1e/d40/d6e/d70/ff1 x:0 0 0 2024-09-12T22:33:17.264 INFO:tasks.workunit.client.0.smithi019.stdout:1/927: dwrite d3/df/d7e/db7/d16/d3c/dbd/dc4/ffa [0,4194304] 0 2024-09-12T22:33:17.265 INFO:tasks.workunit.client.0.smithi019.stdout:8/852: dread d7/d34/fc9 [0,4194304] 0 2024-09-12T22:33:17.265 INFO:tasks.workunit.client.0.smithi019.stdout:9/792: unlink dd/d10/d17/d23/d2e/d31/d3f/f4b 0 2024-09-12T22:33:17.265 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:17.264+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:17.267 INFO:tasks.workunit.client.0.smithi019.stdout:2/819: rename d0/d5/c30 to d0/d5/d60/d71/c119 0 2024-09-12T22:33:17.267 INFO:tasks.workunit.client.0.smithi019.stdout:5/896: dwrite d0/d7/d2d/d32/d36/d8c/db8/d39/d38/d4b/dde/da0/d12b/f73 [0,4194304] 0 2024-09-12T22:33:17.268 INFO:tasks.workunit.client.0.smithi019.stdout:7/724: chown d6/d14/d2a/da4/fb1 1482 1 2024-09-12T22:33:17.269 INFO:tasks.workunit.client.0.smithi019.stdout:6/934: link d1b/d26/d39/l69 d1b/d26/d39/d6a/d61/dd4/l140 0 2024-09-12T22:33:17.269 INFO:tasks.workunit.client.0.smithi019.stdout:2/820: stat d0/d5/d17/d91/ld5 0 2024-09-12T22:33:17.270 INFO:tasks.workunit.client.0.smithi019.stdout:8/853: getdents d7/d8/dd/def 0 2024-09-12T22:33:17.270 INFO:tasks.workunit.client.0.smithi019.stdout:1/928: creat d3/df/d7e/db7/d16/d3c/dbd/de6/dd3/f12d x:0 0 0 2024-09-12T22:33:17.271 INFO:tasks.workunit.client.0.smithi019.stdout:6/935: mkdir d1b/d141 0 2024-09-12T22:33:17.272 INFO:tasks.workunit.client.0.smithi019.stdout:2/821: fdatasync d0/d5/dd6/fe2 0 2024-09-12T22:33:17.273 INFO:tasks.workunit.client.0.smithi019.stdout:7/725: rename d6/d14/d2a/da4/dc/d63/d4b/cfa to d6/d14/d45/d7c/c10f 0 2024-09-12T22:33:17.274 INFO:tasks.workunit.client.0.smithi019.stdout:6/936: rename d1b/f3c to d1b/d102/f142 0 2024-09-12T22:33:17.274 INFO:tasks.workunit.client.0.smithi019.stdout:7/726: chown d6/d14/d2a/da4/d42 49 1 2024-09-12T22:33:17.274 INFO:tasks.workunit.client.0.smithi019.stdout:9/793: dwrite dd/d10/d17/d23/d2e/d31/d3f/fa2 [0,4194304] 0 2024-09-12T22:33:17.275 INFO:tasks.workunit.client.0.smithi019.stdout:7/727: stat d6/d14/d15/d9e/le3 0 2024-09-12T22:33:17.275 INFO:tasks.workunit.client.0.smithi019.stdout:7/728: creat d6/d14/d15/d8b/d103/f110 x:0 0 0 2024-09-12T22:33:17.277 INFO:tasks.workunit.client.0.smithi019.stdout:7/729: write d6/d14/d15/d8b/d103/f110 [857351,38915] 0 2024-09-12T22:33:17.278 INFO:tasks.workunit.client.0.smithi019.stdout:7/730: stat d6/d14/d15/f10d 0 2024-09-12T22:33:17.278 INFO:tasks.workunit.client.0.smithi019.stdout:2/822: stat d0/d5/d60/d71/c119 0 2024-09-12T22:33:17.278 INFO:tasks.workunit.client.0.smithi019.stdout:8/854: truncate d7/d8/dd/d45/dc5/f90 3211986 0 2024-09-12T22:33:17.278 INFO:tasks.workunit.client.0.smithi019.stdout:6/937: truncate d1b/d26/d39/d6a/f85 4919837 0 2024-09-12T22:33:17.279 INFO:tasks.workunit.client.0.smithi019.stdout:8/855: dread - d7/d34/d78/fd7 zero size 2024-09-12T22:33:17.279 INFO:tasks.workunit.client.0.smithi019.stdout:2/823: chown d0/d5/d60/d74/d7e/f103 1181 1 2024-09-12T22:33:17.280 INFO:tasks.workunit.client.0.smithi019.stdout:8/856: unlink d7/d8/dd/f55 0 2024-09-12T22:33:17.280 INFO:tasks.workunit.client.0.smithi019.stdout:4/854: dread d1/d11/f108 [4194304,4194304] 0 2024-09-12T22:33:17.281 INFO:tasks.workunit.client.0.smithi019.stdout:2/824: mknod d0/d5/d60/d74/d7e/d112/d73/dcb/c11a 0 2024-09-12T22:33:17.282 INFO:tasks.workunit.client.0.smithi019.stdout:7/731: read d6/d14/d2a/da4/dc/f71 [113534,64192] 0 2024-09-12T22:33:17.282 INFO:tasks.workunit.client.0.smithi019.stdout:4/855: symlink d1/d4/d38/l12d 0 2024-09-12T22:33:17.283 INFO:tasks.workunit.client.0.smithi019.stdout:2/825: truncate d0/d5/dd6/fe2 810598 0 2024-09-12T22:33:17.284 INFO:tasks.workunit.client.0.smithi019.stdout:4/856: mknod d1/d11/d15/d1f/c12e 0 2024-09-12T22:33:17.286 INFO:tasks.workunit.client.0.smithi019.stdout:7/732: read d6/d2d/d77/d8e/fbb [1259376,124482] 0 2024-09-12T22:33:17.286 INFO:tasks.workunit.client.0.smithi019.stdout:0/852: dread d1/f65 [0,4194304] 0 2024-09-12T22:33:17.286 INFO:tasks.workunit.client.0.smithi019.stdout:6/938: dwrite d1b/f11f [0,4194304] 0 2024-09-12T22:33:17.286 INFO:tasks.workunit.client.0.smithi019.stdout:4/857: mknod d1/d22/d31/d101/c12f 0 2024-09-12T22:33:17.286 INFO:tasks.workunit.client.0.smithi019.stdout:0/853: mkdir d1/d14/d116 0 2024-09-12T22:33:17.286 INFO:tasks.workunit.client.0.smithi019.stdout:7/733: mkdir d6/d2d/d77/dbf/dde/d105/d111 0 2024-09-12T22:33:17.287 INFO:tasks.workunit.client.0.smithi019.stdout:6/939: mknod d1b/d26/d39/d89/d90/c143 0 2024-09-12T22:33:17.287 INFO:tasks.workunit.client.0.smithi019.stdout:4/858: creat d1/d11/f130 x:0 0 0 2024-09-12T22:33:17.287 INFO:tasks.workunit.client.0.smithi019.stdout:0/854: creat d1/d14/d1b/d3a/d8c/dae/f117 x:0 0 0 2024-09-12T22:33:17.287 INFO:tasks.workunit.client.0.smithi019.stdout:6/940: creat d1b/d26/d39/d89/f144 x:0 0 0 2024-09-12T22:33:17.287 INFO:tasks.workunit.client.0.smithi019.stdout:7/734: mknod d6/d14/d2a/da4/dc/c112 0 2024-09-12T22:33:17.288 INFO:tasks.workunit.client.0.smithi019.stdout:6/941: mkdir d1b/d26/d145 0 2024-09-12T22:33:17.288 INFO:tasks.workunit.client.0.smithi019.stdout:0/855: mknod d1/d1f/d5b/d83/dab/dbe/d106/c118 0 2024-09-12T22:33:17.288 INFO:tasks.workunit.client.0.smithi019.stdout:7/735: mkdir d6/d14/d2a/da4/dc/d113 0 2024-09-12T22:33:17.289 INFO:tasks.workunit.client.0.smithi019.stdout:0/856: write d1/d14/d26/d40/f95 [1507724,26725] 0 2024-09-12T22:33:17.290 INFO:tasks.workunit.client.0.smithi019.stdout:7/736: truncate d6/d2d/d77/d8e/fbb 585724 0 2024-09-12T22:33:17.291 INFO:tasks.workunit.client.0.smithi019.stdout:0/857: dread d1/d14/d1b/d94/f111 [0,4194304] 0 2024-09-12T22:33:17.292 INFO:tasks.workunit.client.0.smithi019.stdout:0/858: readlink d1/d1f/l4c 0 2024-09-12T22:33:17.292 INFO:tasks.workunit.client.0.smithi019.stdout:0/859: stat d1/d14/d1b/cf6 0 2024-09-12T22:33:17.294 INFO:tasks.workunit.client.0.smithi019.stdout:6/942: write d1b/d26/d39/d6a/d97/fa6 [81929,32494] 0 2024-09-12T22:33:17.296 INFO:tasks.workunit.client.0.smithi019.stdout:0/860: rename d1/d14/d26/d40/d45/cfb to d1/d1f/d5b/d83/dab/dbe/dfc/c119 0 2024-09-12T22:33:17.296 INFO:tasks.workunit.client.0.smithi019.stdout:7/737: dwrite d6/d14/d2a/da4/dc/f70 [0,4194304] 0 2024-09-12T22:33:17.297 INFO:tasks.workunit.client.0.smithi019.stdout:6/943: truncate d1b/d26/d27/d3e/f49 4611631 0 2024-09-12T22:33:17.302 INFO:tasks.workunit.client.0.smithi019.stdout:0/861: dwrite d1/d1f/d5b/f72 [0,4194304] 0 2024-09-12T22:33:17.303 INFO:tasks.workunit.client.0.smithi019.stdout:7/738: dwrite f1 [0,4194304] 0 2024-09-12T22:33:17.303 INFO:tasks.workunit.client.0.smithi019.stdout:5/897: dread d0/d7/d2d/d32/d36/d8c/db8/d24/d64/ffe [0,4194304] 0 2024-09-12T22:33:17.304 INFO:tasks.workunit.client.0.smithi019.stdout:0/862: write d1/d14/d26/d40/d45/fd5 [582391,30796] 0 2024-09-12T22:33:17.304 INFO:tasks.workunit.client.0.smithi019.stdout:7/739: dread - d6/d14/d2a/da4/d34/ff9 zero size 2024-09-12T22:33:17.305 INFO:tasks.workunit.client.0.smithi019.stdout:6/944: dwrite d1b/d26/d27/d3e/d83/fd7 [0,4194304] 0 2024-09-12T22:33:17.308 INFO:tasks.workunit.client.0.smithi019.stdout:0/863: mkdir d1/d14/d26/d40/d45/d5e/df8/d11a 0 2024-09-12T22:33:17.308 INFO:tasks.workunit.client.0.smithi019.stdout:5/898: chown d0/d7/d2d/d32/d4a/dbb/lf1 6248270 1 2024-09-12T22:33:17.308 INFO:tasks.workunit.client.0.smithi019.stdout:7/740: chown d6/d14/d2a/da4/dc/d63/lac 9 1 2024-09-12T22:33:17.308 INFO:tasks.workunit.client.0.smithi019.stdout:1/929: dread d3/d3f/d58/f93 [0,4194304] 0 2024-09-12T22:33:17.308 INFO:tasks.workunit.client.0.smithi019.stdout:9/794: sync 2024-09-12T22:33:17.308 INFO:tasks.workunit.client.0.smithi019.stdout:2/826: sync 2024-09-12T22:33:17.308 INFO:tasks.workunit.client.0.smithi019.stdout:6/945: creat d1b/db4/f146 x:0 0 0 2024-09-12T22:33:17.309 INFO:tasks.workunit.client.0.smithi019.stdout:1/930: chown d3/d3f/d58/l65 38 1 2024-09-12T22:33:17.309 INFO:tasks.workunit.client.0.smithi019.stdout:0/864: fsync d1/d1f/d5b/d83/dab/dbe/f43 0 2024-09-12T22:33:17.309 INFO:tasks.workunit.client.0.smithi019.stdout:7/741: symlink d6/d14/d15/d9e/l114 0 2024-09-12T22:33:17.310 INFO:tasks.workunit.client.0.smithi019.stdout:7/742: readlink l0 0 2024-09-12T22:33:17.310 INFO:tasks.workunit.client.0.smithi019.stdout:2/827: fdatasync d0/d5/d60/d74/d7e/f96 0 2024-09-12T22:33:17.310 INFO:tasks.workunit.client.0.smithi019.stdout:9/795: dread - dd/d10/d17/d23/d2e/d31/d3f/d67/fd4 zero size 2024-09-12T22:33:17.310 INFO:tasks.workunit.client.0.smithi019.stdout:6/946: chown d1b/d26/d39/d89/f137 13362421 1 2024-09-12T22:33:17.311 INFO:tasks.workunit.client.0.smithi019.stdout:1/931: mknod d3/df/d7e/db7/d16/d3c/d55/da0/c12e 0 2024-09-12T22:33:17.311 INFO:tasks.workunit.client.0.smithi019.stdout:6/947: chown d1b/d26/d39/d89/d90 62359110 1 2024-09-12T22:33:17.314 INFO:tasks.workunit.client.0.smithi019.stdout:1/932: symlink d3/df/d10e/l12f 0 2024-09-12T22:33:17.315 INFO:tasks.workunit.client.0.smithi019.stdout:6/948: write d1b/d26/d39/d6a/d61/f62 [4673291,30275] 0 2024-09-12T22:33:17.315 INFO:tasks.workunit.client.0.smithi019.stdout:5/899: truncate d0/d7/d2d/d32/d36/d8c/db8/d39/d38/d4b/feb 3988207 0 2024-09-12T22:33:17.315 INFO:tasks.workunit.client.0.smithi019.stdout:3/784: dread dd/d1e/d40/fb8 [0,4194304] 0 2024-09-12T22:33:17.315 INFO:tasks.workunit.client.0.smithi019.stdout:7/743: link d6/d14/d2a/da4/dc/d63/f37 d6/d2d/de0/f115 0 2024-09-12T22:33:17.316 INFO:tasks.workunit.client.0.smithi019.stdout:9/796: link dd/d10/d17/d23/d2e/d31/d7e/lfe dd/d10/d17/d23/d2e/d31/d7e/l101 0 2024-09-12T22:33:17.316 INFO:tasks.workunit.client.0.smithi019.stdout:3/785: chown dd/d1e/fd5 162437261 1 2024-09-12T22:33:17.317 INFO:tasks.workunit.client.0.smithi019.stdout:6/949: getdents d1b/d26/d27/d3e 0 2024-09-12T22:33:17.317 INFO:tasks.workunit.client.0.smithi019.stdout:9/797: chown dd/d10/d17/d23/fea 23 1 2024-09-12T22:33:17.317 INFO:tasks.workunit.client.0.smithi019.stdout:3/786: rmdir dd/d1e/d40/d5f 39 2024-09-12T22:33:17.317 INFO:tasks.workunit.client.0.smithi019.stdout:2/828: dwrite d0/d5/d18/d5c/d67/d77/fc4 [0,4194304] 0 2024-09-12T22:33:17.318 INFO:tasks.workunit.client.0.smithi019.stdout:3/787: write dd/d12/f7a [7576721,98363] 0 2024-09-12T22:33:17.318 INFO:tasks.workunit.client.0.smithi019.stdout:9/798: fsync dd/d10/d17/d23/d2e/d31/d3f/d67/fd4 0 2024-09-12T22:33:17.320 INFO:tasks.workunit.client.0.smithi019.stdout:5/900: dread d0/db9/fe9 [0,4194304] 0 2024-09-12T22:33:17.320 INFO:tasks.workunit.client.0.smithi019.stdout:3/788: chown dd/d1e/d82/f9b 14 1 2024-09-12T22:33:17.320 INFO:tasks.workunit.client.0.smithi019.stdout:2/829: write d0/d5/d18/d5c/d67/d77/fb3 [4291662,113523] 0 2024-09-12T22:33:17.320 INFO:tasks.workunit.client.0.smithi019.stdout:9/799: chown dd/dc2/f81 0 1 2024-09-12T22:33:17.322 INFO:tasks.workunit.client.0.smithi019.stdout:2/830: write d0/fe7 [547355,6118] 0 2024-09-12T22:33:17.323 INFO:tasks.workunit.client.0.smithi019.stdout:7/744: dwrite d6/d14/d15/d9e/f2f [0,4194304] 0 2024-09-12T22:33:17.323 INFO:tasks.workunit.client.0.smithi019.stdout:9/800: readlink dd/d10/d17/d23/d2e/d31/d3f/d47/le1 0 2024-09-12T22:33:17.324 INFO:tasks.workunit.client.0.smithi019.stdout:5/901: creat d0/d7/d2d/d32/d36/d8c/db8/d9a/f137 x:0 0 0 2024-09-12T22:33:17.325 INFO:tasks.workunit.client.0.smithi019.stdout:8/857: dread d7/d34/f107 [0,4194304] 0 2024-09-12T22:33:17.326 INFO:tasks.workunit.client.0.smithi019.stdout:7/745: dread - d6/d14/d15/d8b/fee zero size 2024-09-12T22:33:17.326 INFO:tasks.workunit.client.0.smithi019.stdout:2/831: chown d0/d5/d60/d74/d7e/d112/fd4 138677 1 2024-09-12T22:33:17.327 INFO:tasks.workunit.client.0.smithi019.stdout:1/933: write d3/df/d7e/db7/d16/d3c/dce/f113 [4816368,126095] 0 2024-09-12T22:33:17.327 INFO:tasks.workunit.client.0.smithi019.stdout:6/950: dwrite d1b/d26/d31/d5f/d91/de7/f112 [0,4194304] 0 2024-09-12T22:33:17.328 INFO:tasks.workunit.client.0.smithi019.stdout:9/801: write dd/d10/d17/d23/d2e/d31/d3f/dc0/ffb [6082119,100109] 0 2024-09-12T22:33:17.329 INFO:tasks.workunit.client.0.smithi019.stdout:7/746: mknod d6/d14/d15/d62/c116 0 2024-09-12T22:33:17.329 INFO:tasks.workunit.client.0.smithi019.stdout:5/902: write d0/d7/d2d/d32/d36/d8c/db5/fcc [113068,69085] 0 2024-09-12T22:33:17.330 INFO:tasks.workunit.client.0.smithi019.stdout:2/832: mknod d0/d5/d17/d91/c11b 0 2024-09-12T22:33:17.331 INFO:tasks.workunit.client.0.smithi019.stdout:3/789: dwrite dd/d12/fc1 [0,4194304] 0 2024-09-12T22:33:17.331 INFO:tasks.workunit.client.0.smithi019.stdout:6/951: write d1b/d26/d39/d6a/d97/fa6 [1520061,9928] 0 2024-09-12T22:33:17.331 INFO:tasks.workunit.client.0.smithi019.stdout:2/833: dread - d0/d5/d17/fe6 zero size 2024-09-12T22:33:17.331 INFO:tasks.workunit.client.0.smithi019.stdout:1/934: getdents d3/d3f/d123 0 2024-09-12T22:33:17.332 INFO:tasks.workunit.client.0.smithi019.stdout:1/935: stat d3/l15 0 2024-09-12T22:33:17.334 INFO:tasks.workunit.client.0.smithi019.stdout:1/936: sync 2024-09-12T22:33:17.334 INFO:tasks.workunit.client.0.smithi019.stdout:6/952: unlink d1b/d26/d39/fa0 0 2024-09-12T22:33:17.334 INFO:tasks.workunit.client.0.smithi019.stdout:5/903: write d0/d7/d2d/d32/d36/d8c/db8/d39/d38/f62 [4808733,126782] 0 2024-09-12T22:33:17.335 INFO:tasks.workunit.client.0.smithi019.stdout:1/937: fsync d3/f4d 0 2024-09-12T22:33:17.335 INFO:tasks.workunit.client.0.smithi019.stdout:3/790: write dd/d1e/d40/da6/dba/fea [1359987,65631] 0 2024-09-12T22:33:17.335 INFO:tasks.workunit.client.0.smithi019.stdout:5/904: chown d0/f37 285 1 2024-09-12T22:33:17.336 INFO:tasks.workunit.client.0.smithi019.stdout:5/905: fsync d0/f1a 0 2024-09-12T22:33:17.336 INFO:tasks.workunit.client.0.smithi019.stdout:3/791: creat dd/d1e/d40/d6e/d70/ff2 x:0 0 0 2024-09-12T22:33:17.337 INFO:tasks.workunit.client.0.smithi019.stdout:6/953: creat d1b/d26/d39/d6a/d61/dd4/f147 x:0 0 0 2024-09-12T22:33:17.337 INFO:tasks.workunit.client.0.smithi019.stdout:1/938: creat d3/df/d7e/db7/d16/d3c/dbd/dc4/f130 x:0 0 0 2024-09-12T22:33:17.338 INFO:tasks.workunit.client.0.smithi019.stdout:3/792: mknod dd/d12/d62/cf3 0 2024-09-12T22:33:17.340 INFO:tasks.workunit.client.0.smithi019.stdout:6/954: readlink d1b/d26/d39/d6a/d61/dd4/l140 0 2024-09-12T22:33:17.340 INFO:tasks.workunit.client.0.smithi019.stdout:9/802: dwrite dd/d10/d17/d22/d77/fc7 [0,4194304] 0 2024-09-12T22:33:17.340 INFO:tasks.workunit.client.0.smithi019.stdout:2/834: dwrite d0/d5/d18/d5c/d85/f98 [0,4194304] 0 2024-09-12T22:33:17.341 INFO:tasks.workunit.client.0.smithi019.stdout:2/835: fdatasync d0/fe7 0 2024-09-12T22:33:17.342 INFO:tasks.workunit.client.0.smithi019.stdout:5/906: link d0/d7/d2d/d32/d36/d8c/db8/d39/c94 d0/d7/d2d/d32/dcd/c138 0 2024-09-12T22:33:17.342 INFO:tasks.workunit.client.0.smithi019.stdout:8/858: dwrite d7/d8/d43/ffc [0,4194304] 0 2024-09-12T22:33:17.344 INFO:tasks.workunit.client.0.smithi019.stdout:1/939: truncate d3/df/d7e/db7/d16/d3c/dbd/de6/f11d 403111 0 2024-09-12T22:33:17.344 INFO:tasks.workunit.client.0.smithi019.stdout:9/803: creat dd/d10/d17/d22/d6c/d53/d69/f102 x:0 0 0 2024-09-12T22:33:17.344 INFO:tasks.workunit.client.0.smithi019.stdout:8/859: unlink d7/d2f/d42/f93 0 2024-09-12T22:33:17.344 INFO:tasks.workunit.client.0.smithi019.stdout:2/836: symlink d0/d5/d18/d1b/d5d/d86/l11c 0 2024-09-12T22:33:17.344 INFO:tasks.workunit.client.0.smithi019.stdout:2/837: sync 2024-09-12T22:33:17.345 INFO:tasks.workunit.client.0.smithi019.stdout:6/955: read d1b/d2d/fc0 [565973,81944] 0 2024-09-12T22:33:17.346 INFO:tasks.workunit.client.0.smithi019.stdout:1/940: write d3/df/d7e/db7/f4f [21820,59232] 0 2024-09-12T22:33:17.347 INFO:tasks.workunit.client.0.smithi019.stdout:9/804: write dd/d10/d17/d22/d6c/d53/d69/d9d/dbd/de8/ff9 [912046,48403] 0 2024-09-12T22:33:17.347 INFO:tasks.workunit.client.0.smithi019.stdout:6/956: unlink d1b/fb5 0 2024-09-12T22:33:17.350 INFO:tasks.workunit.client.0.smithi019.stdout:1/941: creat d3/df/d10e/f131 x:0 0 0 2024-09-12T22:33:17.350 INFO:tasks.workunit.client.0.smithi019.stdout:4/859: dread d1/d22/f68 [0,4194304] 0 2024-09-12T22:33:17.350 INFO:tasks.workunit.client.0.smithi019.stdout:2/838: getdents d0/d5/d17/d91 0 2024-09-12T22:33:17.350 INFO:tasks.workunit.client.0.smithi019.stdout:4/860: write d1/d4/f117 [614219,79358] 0 2024-09-12T22:33:17.350 INFO:tasks.workunit.client.0.smithi019.stdout:1/942: creat d3/df/d7e/db7/d63/f132 x:0 0 0 2024-09-12T22:33:17.350 INFO:tasks.workunit.client.0.smithi019.stdout:9/805: mkdir dd/d10/d17/d22/d6c/d53/d103 0 2024-09-12T22:33:17.350 INFO:tasks.workunit.client.0.smithi019.stdout:2/839: dread - d0/d5/d18/d1b/d8d/f92 zero size 2024-09-12T22:33:17.350 INFO:tasks.workunit.client.0.smithi019.stdout:4/861: mknod d1/d22/d57/c131 0 2024-09-12T22:33:17.351 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:33:17.351 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:33:17.352 INFO:tasks.workunit.client.0.smithi019.stdout:1/943: mknod d3/df/d7e/db7/d16/d3c/d55/da0/c133 0 2024-09-12T22:33:17.352 INFO:tasks.workunit.client.0.smithi019.stdout:2/840: unlink d0/d5/d18/d1b/d5d/l7f 0 2024-09-12T22:33:17.352 INFO:tasks.workunit.client.0.smithi019.stdout:2/841: fsync d0/d5/d18/d5c/fad 0 2024-09-12T22:33:17.352 INFO:tasks.workunit.client.0.smithi019.stdout:4/862: truncate d1/d8/fb 3906132 0 2024-09-12T22:33:17.353 INFO:tasks.workunit.client.0.smithi019.stdout:9/806: rename dd/d10/d17/d23/d2e/d31/d7e/l101 to dd/d10/d17/d23/d2e/d31/d7e/dbc/ddd/l104 0 2024-09-12T22:33:17.353 INFO:tasks.workunit.client.0.smithi019.stdout:2/842: fdatasync d0/d5/d18/d5c/f78 0 2024-09-12T22:33:17.354 INFO:tasks.workunit.client.0.smithi019.stdout:6/957: dwrite d1b/d26/d31/d5f/d91/de7/f112 [0,4194304] 0 2024-09-12T22:33:17.354 INFO:tasks.workunit.client.0.smithi019.stdout:8/860: truncate d7/d8/dd/f1c 1404299 0 2024-09-12T22:33:17.354 INFO:tasks.workunit.client.0.smithi019.stdout:5/907: truncate d0/d7/d2d/d32/d36/d8c/db8/d39/f63 64303 0 2024-09-12T22:33:17.356 INFO:tasks.workunit.client.0.smithi019.stdout:0/865: dread d1/d1f/d5b/d83/dab/dbe/dfc/ffd [0,4194304] 0 2024-09-12T22:33:17.357 INFO:tasks.workunit.client.0.smithi019.stdout:2/843: chown d0/d5/d18/d39/fbd 1675 1 2024-09-12T22:33:17.357 INFO:tasks.workunit.client.0.smithi019.stdout:4/863: getdents d1/d11/d15/d1f/d56/da9/dce 0 2024-09-12T22:33:17.358 INFO:tasks.workunit.client.0.smithi019.stdout:6/958: fdatasync d1b/d26/d27/d3e/d83/fd7 0 2024-09-12T22:33:17.358 INFO:tasks.workunit.client.0.smithi019.stdout:5/908: readlink d0/d7/d2d/d32/d36/d8c/db8/d39/d38/l6c 0 2024-09-12T22:33:17.359 INFO:tasks.workunit.client.0.smithi019.stdout:4/864: symlink d1/d11/d15/d1f/d56/da9/dce/l132 0 2024-09-12T22:33:17.359 INFO:tasks.workunit.client.0.smithi019.stdout:0/866: unlink d1/d1f/d5b/d83/dab/dbe/d71/d75/lb9 0 2024-09-12T22:33:17.359 INFO:tasks.workunit.client.0.smithi019.stdout:6/959: fdatasync d1b/d26/d27/d3e/d83/d98/fb8 0 2024-09-12T22:33:17.359 INFO:tasks.workunit.client.0.smithi019.stdout:5/909: mkdir d0/d7/d2d/d32/d36/d8c/d139 0 2024-09-12T22:33:17.360 INFO:tasks.workunit.client.0.smithi019.stdout:4/865: readlink d1/d4c/db0/d75/d5a/ld8 0 2024-09-12T22:33:17.360 INFO:tasks.workunit.client.0.smithi019.stdout:6/960: chown d1b/d26/d39/d6a/d61/dd4/l140 6 1 2024-09-12T22:33:17.361 INFO:tasks.workunit.client.0.smithi019.stdout:4/866: mknod d1/d8/dfb/d10c/c133 0 2024-09-12T22:33:17.361 INFO:tasks.workunit.client.0.smithi019.stdout:9/807: dread dd/d10/d17/d22/fae [4194304,4194304] 0 2024-09-12T22:33:17.363 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:33:17.364 INFO:tasks.workunit.client.0.smithi019.stdout:6/961: creat d1b/d26/d31/d5f/f148 x:0 0 0 2024-09-12T22:33:17.364 INFO:tasks.workunit.client.0.smithi019.stdout:2/844: truncate d0/d5/d18/d5c/f68 833264 0 2024-09-12T22:33:17.365 INFO:tasks.workunit.client.0.smithi019.stdout:9/808: write dd/d10/d17/d23/d2e/d31/d3f/d67/fac [1982416,3056] 0 2024-09-12T22:33:17.365 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:17.364+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:17.366 INFO:tasks.workunit.client.0.smithi019.stdout:2/845: mkdir d0/d5/d18/d1b/d5d/d86/d10b/d11d 0 2024-09-12T22:33:17.366 INFO:tasks.workunit.client.0.smithi019.stdout:0/867: dwrite d1/d51/fe2 [0,4194304] 0 2024-09-12T22:33:17.367 INFO:tasks.workunit.client.0.smithi019.stdout:5/910: dwrite d0/d7/d2d/d32/dcd/ffc [0,4194304] 0 2024-09-12T22:33:17.367 INFO:tasks.workunit.client.0.smithi019.stdout:4/867: dread d1/d11/f23 [0,4194304] 0 2024-09-12T22:33:17.368 INFO:tasks.workunit.client.0.smithi019.stdout:1/944: dread d3/df/d7e/db7/d63/ff6 [0,4194304] 0 2024-09-12T22:33:17.370 INFO:tasks.workunit.client.0.smithi019.stdout:0/868: creat d1/d14/d26/d40/d45/f11b x:0 0 0 2024-09-12T22:33:17.370 INFO:tasks.workunit.client.0.smithi019.stdout:9/809: chown dd/d10/d17/d23/d2e/d31/d3f/d47/d6e/f8a 23095 1 2024-09-12T22:33:17.372 INFO:tasks.workunit.client.0.smithi019.stdout:4/868: creat d1/d8/dfb/dfc/f134 x:0 0 0 2024-09-12T22:33:17.372 INFO:tasks.workunit.client.0.smithi019.stdout:0/869: fsync d1/d14/d26/d40/d45/d5e/f98 0 2024-09-12T22:33:17.372 INFO:tasks.workunit.client.0.smithi019.stdout:1/945: rmdir d3/d3f/d77/dcd 39 2024-09-12T22:33:17.373 INFO:tasks.workunit.client.0.smithi019.stdout:4/869: unlink d1/d22/d26/da1/l128 0 2024-09-12T22:33:17.373 INFO:tasks.workunit.client.0.smithi019.stdout:9/810: write dd/d10/d17/d23/f49 [1800777,50435] 0 2024-09-12T22:33:17.374 INFO:tasks.workunit.client.0.smithi019.stdout:0/870: symlink d1/d1f/d5b/d83/dab/dbe/d71/d75/l11c 0 2024-09-12T22:33:17.374 INFO:tasks.workunit.client.0.smithi019.stdout:9/811: rmdir dd/d10/d17/d23/d2e/d31/d54/d8b/ddf 39 2024-09-12T22:33:17.375 INFO:tasks.workunit.client.0.smithi019.stdout:2/846: dread d0/d5/d18/d3b/f3f [0,4194304] 0 2024-09-12T22:33:17.375 INFO:tasks.workunit.client.0.smithi019.stdout:0/871: write d1/d1d/ff0 [91589,102830] 0 2024-09-12T22:33:17.375 INFO:tasks.workunit.client.0.smithi019.stdout:5/911: dread d0/d7/d2d/d32/d36/d8c/db8/d39/d38/d4b/dde/da0/d12b/dc3/f10a [0,4194304] 0 2024-09-12T22:33:17.376 INFO:tasks.workunit.client.0.smithi019.stdout:0/872: write d1/d14/d26/d40/d45/d5e/ffa [189150,19082] 0 2024-09-12T22:33:17.376 INFO:tasks.workunit.client.0.smithi019.stdout:4/870: dread d1/d4/d38/dbf/fca [0,4194304] 0 2024-09-12T22:33:17.376 INFO:tasks.workunit.client.0.smithi019.stdout:9/812: getdents dd/d10/d17/d23/d2e/d31/d7e 0 2024-09-12T22:33:17.377 INFO:tasks.workunit.client.0.smithi019.stdout:5/912: unlink d0/d7/d2d/d32/d36/d8c/db8/d9a/fdb 0 2024-09-12T22:33:17.377 INFO:tasks.workunit.client.0.smithi019.stdout:2/847: truncate d0/d5/d18/d1b/d5d/f80 1901282 0 2024-09-12T22:33:17.377 INFO:tasks.workunit.client.0.smithi019.stdout:4/871: symlink d1/d22/d26/l135 0 2024-09-12T22:33:17.377 INFO:tasks.workunit.client.0.smithi019.stdout:0/873: mknod d1/d14/d116/c11d 0 2024-09-12T22:33:17.378 INFO:tasks.workunit.client.0.smithi019.stdout:5/913: fdatasync d0/d7/d2d/d32/d36/d8c/db8/f74 0 2024-09-12T22:33:17.379 INFO:tasks.workunit.client.0.smithi019.stdout:0/874: mknod d1/d1f/d5b/d83/dd9/c11e 0 2024-09-12T22:33:17.380 INFO:tasks.workunit.client.0.smithi019.stdout:2/848: dread d0/d5/d18/d39/fbd [0,4194304] 0 2024-09-12T22:33:17.382 INFO:tasks.workunit.client.0.smithi019.stdout:0/875: getdents d1/d14/d1b/d3a/d8c/da3 0 2024-09-12T22:33:17.383 INFO:tasks.workunit.client.0.smithi019.stdout:2/849: symlink d0/d5/d18/d5c/d85/d95/l11e 0 2024-09-12T22:33:17.383 INFO:tasks.workunit.client.0.smithi019.stdout:9/813: dwrite dd/d10/d17/d22/fae [0,4194304] 0 2024-09-12T22:33:17.384 INFO:tasks.workunit.client.0.smithi019.stdout:4/872: dwrite d1/d11/d15/d1f/d56/da9/dce/f12c [0,4194304] 0 2024-09-12T22:33:17.386 INFO:tasks.workunit.client.0.smithi019.stdout:2/850: write d0/d5/d60/d74/d7e/db5/fde [446386,22312] 0 2024-09-12T22:33:17.386 INFO:tasks.workunit.client.0.smithi019.stdout:4/873: creat d1/d22/d2c/f136 x:0 0 0 2024-09-12T22:33:17.386 INFO:tasks.workunit.client.0.smithi019.stdout:2/851: sync 2024-09-12T22:33:17.389 INFO:tasks.workunit.client.0.smithi019.stdout:2/852: read - d0/d5/d60/fef zero size 2024-09-12T22:33:17.389 INFO:tasks.workunit.client.0.smithi019.stdout:0/876: dwrite d1/f65 [0,4194304] 0 2024-09-12T22:33:17.390 INFO:tasks.workunit.client.0.smithi019.stdout:4/874: getdents d1/d22/d2c/d107/d11f/ddd 0 2024-09-12T22:33:17.391 INFO:tasks.workunit.client.0.smithi019.stdout:7/747: dread d6/d14/d2a/da4/f1c [4194304,4194304] 0 2024-09-12T22:33:17.391 INFO:tasks.workunit.client.0.smithi019.stdout:4/875: chown d1/d22/d2c/d107/d11f/fe4 410297055 1 2024-09-12T22:33:17.391 INFO:tasks.workunit.client.0.smithi019.stdout:0/877: symlink d1/d1f/d5b/d83/dab/dbe/d106/l11f 0 2024-09-12T22:33:17.392 INFO:tasks.workunit.client.0.smithi019.stdout:7/748: creat d6/d14/d15/d8b/f117 x:0 0 0 2024-09-12T22:33:17.392 INFO:tasks.workunit.client.0.smithi019.stdout:4/876: creat d1/d22/d2c/d107/d11f/f137 x:0 0 0 2024-09-12T22:33:17.393 INFO:tasks.workunit.client.0.smithi019.stdout:7/749: mknod d6/d2d/d8f/daf/da0/c118 0 2024-09-12T22:33:17.393 INFO:tasks.workunit.client.0.smithi019.stdout:0/878: write d1/d14/d1b/d3a/d8c/dae/faf [3965492,63717] 0 2024-09-12T22:33:17.393 INFO:tasks.workunit.client.0.smithi019.stdout:5/914: dread d0/d7/d2d/d32/d36/d8c/db8/d39/d38/d4b/dde/da0/d12b/f115 [0,4194304] 0 2024-09-12T22:33:17.394 INFO:tasks.workunit.client.0.smithi019.stdout:4/877: creat d1/d4c/db0/d75/d5a/f138 x:0 0 0 2024-09-12T22:33:17.394 INFO:tasks.workunit.client.0.smithi019.stdout:3/793: dread dd/d12/d62/d78/fb1 [4194304,4194304] 0 2024-09-12T22:33:17.394 INFO:tasks.workunit.client.0.smithi019.stdout:7/750: creat d6/d14/f119 x:0 0 0 2024-09-12T22:33:17.395 INFO:tasks.workunit.client.0.smithi019.stdout:5/915: chown d0/d7/d2d/d4c/d87/dd2/c116 1 1 2024-09-12T22:33:17.395 INFO:tasks.workunit.client.0.smithi019.stdout:7/751: mkdir d6/d14/d45/d7c/d11a 0 2024-09-12T22:33:17.396 INFO:tasks.workunit.client.0.smithi019.stdout:0/879: truncate d1/d1f/d5b/d83/dab/dbe/d89/fc5 603620 0 2024-09-12T22:33:17.397 INFO:tasks.workunit.client.0.smithi019.stdout:4/878: rename d1/d4c/db0/d75/d5a/f8b to d1/d22/f139 0 2024-09-12T22:33:17.397 INFO:tasks.workunit.client.0.smithi019.stdout:2/853: truncate d0/d5/d18/d3b/f3f 728149 0 2024-09-12T22:33:17.397 INFO:tasks.workunit.client.0.smithi019.stdout:7/752: symlink d6/d2d/d8f/daf/l11b 0 2024-09-12T22:33:17.398 INFO:tasks.workunit.client.0.smithi019.stdout:4/879: rmdir d1/d8 39 2024-09-12T22:33:17.398 INFO:tasks.workunit.client.0.smithi019.stdout:5/916: creat d0/d7/d2d/d32/d36/d8c/db8/d39/d38/d4b/dd9/f13a x:0 0 0 2024-09-12T22:33:17.399 INFO:tasks.workunit.client.0.smithi019.stdout:0/880: truncate d1/f2c 977806 0 2024-09-12T22:33:17.399 INFO:tasks.workunit.client.0.smithi019.stdout:7/753: chown d6/d2d/l4a 22931 1 2024-09-12T22:33:17.399 INFO:tasks.workunit.client.0.smithi019.stdout:2/854: chown d0/d5/d18/d39/fe8 3662 1 2024-09-12T22:33:17.400 INFO:tasks.workunit.client.0.smithi019.stdout:8/861: dread d7/d2f/d42/f92 [0,4194304] 0 2024-09-12T22:33:17.401 INFO:tasks.workunit.client.0.smithi019.stdout:3/794: dwrite dd/fdc [0,4194304] 0 2024-09-12T22:33:17.401 INFO:tasks.workunit.client.0.smithi019.stdout:7/754: chown d6/d14/d15/d62/d6a 1452354 1 2024-09-12T22:33:17.402 INFO:tasks.workunit.client.0.smithi019.stdout:0/881: mkdir d1/d1f/d5b/d83/dab/dbe/dfc/d120 0 2024-09-12T22:33:17.402 INFO:tasks.workunit.client.0.smithi019.stdout:5/917: getdents d0/d7 0 2024-09-12T22:33:17.403 INFO:tasks.workunit.client.0.smithi019.stdout:7/755: creat d6/d2d/de0/f11c x:0 0 0 2024-09-12T22:33:17.403 INFO:tasks.workunit.client.0.smithi019.stdout:3/795: fdatasync dd/f31 0 2024-09-12T22:33:17.403 INFO:tasks.workunit.client.0.smithi019.stdout:7/756: readlink l0 0 2024-09-12T22:33:17.403 INFO:tasks.workunit.client.0.smithi019.stdout:2/855: mknod d0/d5/d18/d1b/d5d/d86/d10b/d11d/c11f 0 2024-09-12T22:33:17.404 INFO:tasks.workunit.client.0.smithi019.stdout:8/862: mkdir d7/d2f/d42/d98/df9/d10b 0 2024-09-12T22:33:17.405 INFO:tasks.workunit.client.0.smithi019.stdout:0/882: rmdir d1/d14/dad/d10f 0 2024-09-12T22:33:17.405 INFO:tasks.workunit.client.0.smithi019.stdout:7/757: symlink d6/d14/d2a/da4/dc/d63/dff/l11d 0 2024-09-12T22:33:17.405 INFO:tasks.workunit.client.0.smithi019.stdout:5/918: chown d0/d7/d2d/d32/d36/d8c/db8/d39/d38/d4b/dde/da0/d12b/l68 1645789 1 2024-09-12T22:33:17.406 INFO:tasks.workunit.client.0.smithi019.stdout:4/880: dwrite d1/d4/da6/f105 [0,4194304] 0 2024-09-12T22:33:17.407 INFO:tasks.workunit.client.0.smithi019.stdout:7/758: rmdir d6/d14/d2a 39 2024-09-12T22:33:17.408 INFO:tasks.workunit.client.0.smithi019.stdout:4/881: rmdir d1/d4/da6 39 2024-09-12T22:33:17.408 INFO:tasks.workunit.client.0.smithi019.stdout:2/856: link d0/d5/d18/d5c/d67/d77/fb3 d0/d5/d18/d5c/d67/d77/f120 0 2024-09-12T22:33:17.408 INFO:tasks.workunit.client.0.smithi019.stdout:4/882: sync 2024-09-12T22:33:17.409 INFO:tasks.workunit.client.0.smithi019.stdout:7/759: stat d6/d14/d45/dca/df8 0 2024-09-12T22:33:17.409 INFO:tasks.workunit.client.0.smithi019.stdout:5/919: dread - d0/d7/d2d/d32/d36/d8c/db8/d39/d38/d4b/dde/da0/d12b/d9d/fdd zero size 2024-09-12T22:33:17.410 INFO:tasks.workunit.client.0.smithi019.stdout:0/883: read d1/d51/f56 [1874726,69102] 0 2024-09-12T22:33:17.410 INFO:tasks.workunit.client.0.smithi019.stdout:2/857: chown d0/d5/d60/d74/d7e/ca3 27038265 1 2024-09-12T22:33:17.411 INFO:tasks.workunit.client.0.smithi019.stdout:6/962: dread d1b/f45 [0,4194304] 0 2024-09-12T22:33:17.411 INFO:tasks.workunit.client.0.smithi019.stdout:8/863: dwrite d7/d2f/d75/f9b [0,4194304] 0 2024-09-12T22:33:17.412 INFO:tasks.workunit.client.0.smithi019.stdout:0/884: write d1/d1f/f8b [3515859,51770] 0 2024-09-12T22:33:17.412 INFO:tasks.workunit.client.0.smithi019.stdout:7/760: creat d6/d14/d2a/da4/dc/d113/f11e x:0 0 0 2024-09-12T22:33:17.413 INFO:tasks.workunit.client.0.smithi019.stdout:2/858: mknod d0/d5/d18/d1b/d8d/c121 0 2024-09-12T22:33:17.413 INFO:tasks.workunit.client.0.smithi019.stdout:8/864: chown d7/d8/d43/fbf 18 1 2024-09-12T22:33:17.413 INFO:tasks.workunit.client.0.smithi019.stdout:6/963: fdatasync d1b/d26/d31/f10c 0 2024-09-12T22:33:17.414 INFO:tasks.workunit.client.0.smithi019.stdout:8/865: write d7/f29 [3156511,8967] 0 2024-09-12T22:33:17.414 INFO:tasks.workunit.client.0.smithi019.stdout:0/885: rename d1/d14/dad/fbd to d1/d1f/d5b/d83/dd9/f121 0 2024-09-12T22:33:17.414 INFO:tasks.workunit.client.0.smithi019.stdout:2/859: stat d0/d5/d60/d74/d7e/d112/d73/dcb/f82 0 2024-09-12T22:33:17.415 INFO:tasks.workunit.client.0.smithi019.stdout:7/761: link d6/d2d/f83 d6/d14/d2a/da4/dc/d63/f11f 0 2024-09-12T22:33:17.415 INFO:tasks.workunit.client.0.smithi019.stdout:8/866: dread d7/d34/fc9 [0,4194304] 0 2024-09-12T22:33:17.417 INFO:tasks.workunit.client.0.smithi019.stdout:6/964: truncate d1b/d26/d31/dd6/fb2 509670 0 2024-09-12T22:33:17.417 INFO:tasks.workunit.client.0.smithi019.stdout:8/867: write d7/f19 [1103125,120132] 0 2024-09-12T22:33:17.417 INFO:tasks.workunit.client.0.smithi019.stdout:1/946: dread d3/df/d7e/db7/d16/d3c/dbd/de6/f21 [8388608,4194304] 0 2024-09-12T22:33:17.417 INFO:tasks.workunit.client.0.smithi019.stdout:6/965: readlink l10 0 2024-09-12T22:33:17.418 INFO:tasks.workunit.client.0.smithi019.stdout:0/886: rename d1/d1f/d5b/d83/dab/dbe/d3d to d1/d14/d1b/d3a/d122 0 2024-09-12T22:33:17.418 INFO:tasks.workunit.client.0.smithi019.stdout:2/860: write d0/d5/d18/d5c/d67/d77/ffe [1061304,126784] 0 2024-09-12T22:33:17.419 INFO:tasks.workunit.client.0.smithi019.stdout:6/966: chown d1b/d26/d31/d5f/f111 6905 1 2024-09-12T22:33:17.419 INFO:tasks.workunit.client.0.smithi019.stdout:8/868: creat d7/d8/dd/def/d104/f10c x:0 0 0 2024-09-12T22:33:17.420 INFO:tasks.workunit.client.0.smithi019.stdout:2/861: write d0/d5/d18/d5c/fad [4797592,97477] 0 2024-09-12T22:33:17.421 INFO:tasks.workunit.client.0.smithi019.stdout:0/887: chown d1/d1f/d5b/d83/dab/dbe/d71/d75/l11c 663049963 1 2024-09-12T22:33:17.421 INFO:tasks.workunit.client.0.smithi019.stdout:8/869: dread - d7/d8/d43/d87/fe0 zero size 2024-09-12T22:33:17.422 INFO:tasks.workunit.client.0.smithi019.stdout:6/967: truncate d1b/d26/d39/d6a/d97/fdc 618574 0 2024-09-12T22:33:17.423 INFO:tasks.workunit.client.0.smithi019.stdout:1/947: dread d3/d6e/f87 [0,4194304] 0 2024-09-12T22:33:17.423 INFO:tasks.workunit.client.0.smithi019.stdout:7/762: dwrite d6/d14/d2a/da4/d34/fda [0,4194304] 0 2024-09-12T22:33:17.423 INFO:tasks.workunit.client.0.smithi019.stdout:8/870: rmdir d7/d34/d78/d53/daa 39 2024-09-12T22:33:17.424 INFO:tasks.workunit.client.0.smithi019.stdout:1/948: unlink d3/df/l8c 0 2024-09-12T22:33:17.424 INFO:tasks.workunit.client.0.smithi019.stdout:2/862: link d0/d5/d60/la8 d0/d5/d18/l122 0 2024-09-12T22:33:17.424 INFO:tasks.workunit.client.0.smithi019.stdout:7/763: chown d6/d14/d15/d8b/cd7 19 1 2024-09-12T22:33:17.425 INFO:tasks.workunit.client.0.smithi019.stdout:6/968: rename d1b/d26/d31/dd6/f133 to d1b/d26/d27/d67/d77/d7b/f149 0 2024-09-12T22:33:17.425 INFO:tasks.workunit.client.0.smithi019.stdout:2/863: mknod d0/d5/d18/d5c/d63/d6a/c123 0 2024-09-12T22:33:17.427 INFO:tasks.workunit.client.0.smithi019.stdout:6/969: chown d1b/fe3 23 1 2024-09-12T22:33:17.427 INFO:tasks.workunit.client.0.smithi019.stdout:7/764: write d6/d14/d15/d8b/f117 [387084,105350] 0 2024-09-12T22:33:17.427 INFO:tasks.workunit.client.0.smithi019.stdout:2/864: mkdir d0/d5/d18/d1b/d8d/dac/d124 0 2024-09-12T22:33:17.427 INFO:tasks.workunit.client.0.smithi019.stdout:7/765: creat d6/d14/d2a/d99/f120 x:0 0 0 2024-09-12T22:33:17.428 INFO:tasks.workunit.client.0.smithi019.stdout:8/871: dread d7/d34/d78/d54/f101 [0,4194304] 0 2024-09-12T22:33:17.428 INFO:tasks.workunit.client.0.smithi019.stdout:6/970: write d1b/d26/d39/fde [543318,127245] 0 2024-09-12T22:33:17.428 INFO:tasks.workunit.client.0.smithi019.stdout:2/865: chown d0/d5/d60/d74/d7e/d112/d73 121326 1 2024-09-12T22:33:17.429 INFO:tasks.workunit.client.0.smithi019.stdout:7/766: mkdir d6/d2d/d77/d121 0 2024-09-12T22:33:17.429 INFO:tasks.workunit.client.0.smithi019.stdout:1/949: read d3/d6e/da9/d54/f9f [823016,31656] 0 2024-09-12T22:33:17.431 INFO:tasks.workunit.client.0.smithi019.stdout:2/866: stat d0/d5/d18/d5c/f68 0 2024-09-12T22:33:17.431 INFO:tasks.workunit.client.0.smithi019.stdout:9/814: dread dd/d10/d17/d22/d6c/d53/d69/fc9 [0,4194304] 0 2024-09-12T22:33:17.431 INFO:tasks.workunit.client.0.smithi019.stdout:8/872: mkdir d7/d8/d43/d87/dc2/dce/d10d 0 2024-09-12T22:33:17.431 INFO:tasks.workunit.client.0.smithi019.stdout:7/767: fdatasync d6/d2d/f83 0 2024-09-12T22:33:17.432 INFO:tasks.workunit.client.0.smithi019.stdout:7/768: readlink d6/d14/d15/l25 0 2024-09-12T22:33:17.433 INFO:tasks.workunit.client.0.smithi019.stdout:1/950: unlink d3/df/d7e/db7/d63/d76/l7a 0 2024-09-12T22:33:17.433 INFO:tasks.workunit.client.0.smithi019.stdout:8/873: chown d7/d8/dd/d45/dc5/fbd 54 1 2024-09-12T22:33:17.433 INFO:tasks.workunit.client.0.smithi019.stdout:9/815: chown dd/d10/d17/d76/dcc/fd7 5888265 1 2024-09-12T22:33:17.433 INFO:tasks.workunit.client.0.smithi019.stdout:7/769: chown d6/d2d/d77/f89 477287 1 2024-09-12T22:33:17.435 INFO:tasks.workunit.client.0.smithi019.stdout:6/971: dwrite d1b/d2d/f55 [8388608,4194304] 0 2024-09-12T22:33:17.436 INFO:tasks.workunit.client.0.smithi019.stdout:7/770: write d6/d14/d2a/d99/f120 [799471,101623] 0 2024-09-12T22:33:17.437 INFO:tasks.workunit.client.0.smithi019.stdout:3/796: dread dd/d1e/f67 [0,4194304] 0 2024-09-12T22:33:17.439 INFO:tasks.workunit.client.0.smithi019.stdout:9/816: truncate dd/d10/d17/d22/d6c/d53/d69/d9d/fc3 276334 0 2024-09-12T22:33:17.440 INFO:tasks.workunit.client.0.smithi019.stdout:6/972: chown d1b/d26/d31/dd6/ca9 0 1 2024-09-12T22:33:17.440 INFO:tasks.workunit.client.0.smithi019.stdout:7/771: creat d6/d2d/d77/dbf/f122 x:0 0 0 2024-09-12T22:33:17.441 INFO:tasks.workunit.client.0.smithi019.stdout:3/797: link dd/f2a dd/d1e/d40/da6/dba/ff4 0 2024-09-12T22:33:17.441 INFO:tasks.workunit.client.0.smithi019.stdout:6/973: write d1b/d26/d39/d6a/d61/f132 [642306,51613] 0 2024-09-12T22:33:17.442 INFO:tasks.workunit.client.0.smithi019.stdout:1/951: dwrite d3/df/d7e/db7/d16/d3c/dbd/de6/fe8 [0,4194304] 0 2024-09-12T22:33:17.442 INFO:tasks.workunit.client.0.smithi019.stdout:9/817: link dd/d10/d17/d22/f95 dd/d10/d17/d22/d6c/d53/de3/f105 0 2024-09-12T22:33:17.442 INFO:tasks.workunit.client.0.smithi019.stdout:3/798: write dd/d1e/f3c [1317007,34553] 0 2024-09-12T22:33:17.443 INFO:tasks.workunit.client.0.smithi019.stdout:6/974: unlink d1b/d26/d31/d5f/d91/de7/ffa 0 2024-09-12T22:33:17.444 INFO:tasks.workunit.client.0.smithi019.stdout:6/975: chown d1b/d26/d31/d5f/d91 0 1 2024-09-12T22:33:17.444 INFO:tasks.workunit.client.0.smithi019.stdout:1/952: rename d3/d3f/d77/dcd to d3/d3f/d58/d7f/d134 0 2024-09-12T22:33:17.444 INFO:tasks.workunit.client.0.smithi019.stdout:9/818: mkdir dd/d10/d17/d23/d2e/d31/d7e/dbc/d106 0 2024-09-12T22:33:17.449 INFO:tasks.workunit.client.0.smithi019.stdout:9/819: write dd/fe7 [395347,89887] 0 2024-09-12T22:33:17.449 INFO:tasks.workunit.client.0.smithi019.stdout:9/820: chown dd/d10/d17/d23/d2e/d31/d3f/d47/d6e/daf/cd1 52 1 2024-09-12T22:33:17.450 INFO:tasks.workunit.client.0.smithi019.stdout:9/821: creat dd/d10/d17/d76/dca/f107 x:0 0 0 2024-09-12T22:33:17.450 INFO:tasks.workunit.client.0.smithi019.stdout:1/953: dwrite d3/d3f/d58/d7f/d134/fdf [0,4194304] 0 2024-09-12T22:33:17.452 INFO:tasks.workunit.client.0.smithi019.stdout:4/883: dread d1/d4c/db0/d75/f59 [0,4194304] 0 2024-09-12T22:33:17.452 INFO:tasks.workunit.client.0.smithi019.stdout:1/954: creat d3/d3f/d58/dc6/f135 x:0 0 0 2024-09-12T22:33:17.453 INFO:tasks.workunit.client.0.smithi019.stdout:6/976: write d1b/d26/d31/d5f/f12a [1208470,32502] 0 2024-09-12T22:33:17.453 INFO:tasks.workunit.client.0.smithi019.stdout:9/822: readlink dd/d10/d17/d23/d2e/d31/d54/d8b/ddf/lf0 0 2024-09-12T22:33:17.454 INFO:tasks.workunit.client.0.smithi019.stdout:4/884: mknod d1/d11/d15/c13a 0 2024-09-12T22:33:17.454 INFO:tasks.workunit.client.0.smithi019.stdout:1/955: creat d3/df/d7e/db7/f136 x:0 0 0 2024-09-12T22:33:17.455 INFO:tasks.workunit.client.0.smithi019.stdout:4/885: dread - d1/d11/d15/d1f/da8/f110 zero size 2024-09-12T22:33:17.455 INFO:tasks.workunit.client.0.smithi019.stdout:8/874: dread d7/d8/f7d [0,4194304] 0 2024-09-12T22:33:17.456 INFO:tasks.workunit.client.0.smithi019.stdout:8/875: mknod d7/d8/dd/df7/c10e 0 2024-09-12T22:33:17.457 INFO:tasks.workunit.client.0.smithi019.stdout:6/977: link d1b/d26/d27/d3e/d83/d98/fa5 d1b/d26/d31/d5f/d91/f14a 0 2024-09-12T22:33:17.458 INFO:tasks.workunit.client.0.smithi019.stdout:8/876: creat d7/d34/d106/f10f x:0 0 0 2024-09-12T22:33:17.458 INFO:tasks.workunit.client.0.smithi019.stdout:6/978: dread - d1b/d26/d39/d89/d90/f122 zero size 2024-09-12T22:33:17.458 INFO:tasks.workunit.client.0.smithi019.stdout:4/886: link d1/d4c/db0/d75/d5a/d79/c89 d1/d8/dd0/c13b 0 2024-09-12T22:33:17.458 INFO:tasks.workunit.client.0.smithi019.stdout:5/920: dread d0/d7/d2d/d32/d36/d8c/db8/d9a/fa4 [0,4194304] 0 2024-09-12T22:33:17.458 INFO:tasks.workunit.client.0.smithi019.stdout:8/877: chown d7/d8/f7d 10206 1 2024-09-12T22:33:17.459 INFO:tasks.workunit.client.0.smithi019.stdout:4/887: mkdir d1/d11/d15/d1f/d13c 0 2024-09-12T22:33:17.459 INFO:tasks.workunit.client.0.smithi019.stdout:5/921: creat d0/d7/d2d/d32/d36/d8c/f13b x:0 0 0 2024-09-12T22:33:17.460 INFO:tasks.workunit.client.0.smithi019.stdout:6/979: fsync d1b/d26/d31/d5f/d91/f14a 0 2024-09-12T22:33:17.461 INFO:tasks.workunit.client.0.smithi019.stdout:8/878: fsync d7/d34/d106/f10f 0 2024-09-12T22:33:17.462 INFO:tasks.workunit.client.0.smithi019.stdout:0/888: dread d1/d14/d1b/d3a/d8c/fef [0,4194304] 0 2024-09-12T22:33:17.463 INFO:tasks.workunit.client.0.smithi019.stdout:1/956: truncate d3/df/d7e/db7/d16/d3c/dbd/de6/dd3/f12d 661377 0 2024-09-12T22:33:17.463 INFO:tasks.workunit.client.0.smithi019.stdout:0/889: write d1/d14/d1b/fbc [416605,13131] 0 2024-09-12T22:33:17.464 INFO:tasks.workunit.client.0.smithi019.stdout:1/957: mkdir d3/df/d7e/db7/d16/d3c/dbd/dc4/dc3/df1/d137 0 2024-09-12T22:33:17.465 INFO:tasks.workunit.client.0.smithi019.stdout:3/799: sync 2024-09-12T22:33:17.465 INFO:tasks.workunit.client.0.smithi019.stdout:8/879: sync 2024-09-12T22:33:17.466 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:17.465+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:17.466 INFO:tasks.workunit.client.0.smithi019.stdout:8/880: truncate d7/d8/f4c 4369085 0 2024-09-12T22:33:17.466 INFO:tasks.workunit.client.0.smithi019.stdout:3/800: creat dd/d12/d62/d74/daa/ff5 x:0 0 0 2024-09-12T22:33:17.467 INFO:tasks.workunit.client.0.smithi019.stdout:3/801: write dd/d1e/f67 [905929,53740] 0 2024-09-12T22:33:17.468 INFO:tasks.workunit.client.0.smithi019.stdout:5/922: dread d0/d7/d16/f91 [0,4194304] 0 2024-09-12T22:33:17.469 INFO:tasks.workunit.client.0.smithi019.stdout:0/890: dwrite d1/d1f/d5b/d83/dab/dbe/dfc/ffd [0,4194304] 0 2024-09-12T22:33:17.469 INFO:tasks.workunit.client.0.smithi019.stdout:3/802: rmdir dd/d1e/d40/d5f/dd4 0 2024-09-12T22:33:17.471 INFO:tasks.workunit.client.0.smithi019.stdout:5/923: chown d0/d7/d2d/d32/d36/d8c/db8/d39/d38/dba/f107 0 1 2024-09-12T22:33:17.471 INFO:tasks.workunit.client.0.smithi019.stdout:4/888: sync 2024-09-12T22:33:17.471 INFO:tasks.workunit.client.0.smithi019.stdout:2/867: dread d0/fe7 [0,4194304] 0 2024-09-12T22:33:17.472 INFO:tasks.workunit.client.0.smithi019.stdout:1/958: write d3/df/d7e/db7/d16/d3c/dbd/de6/f11a [33354,46935] 0 2024-09-12T22:33:17.474 INFO:tasks.workunit.client.0.smithi019.stdout:5/924: symlink d0/d7/d2d/d32/dcd/l13c 0 2024-09-12T22:33:17.474 INFO:tasks.workunit.client.0.smithi019.stdout:2/868: write d0/d5/d60/d71/faa [68208,35116] 0 2024-09-12T22:33:17.474 INFO:tasks.workunit.client.0.smithi019.stdout:4/889: mknod d1/d11/d15/d1f/d56/dac/c13d 0 2024-09-12T22:33:17.474 INFO:tasks.workunit.client.0.smithi019.stdout:1/959: fsync d3/f9 0 2024-09-12T22:33:17.475 INFO:tasks.workunit.client.0.smithi019.stdout:4/890: write d1/d11/f86 [957297,72568] 0 2024-09-12T22:33:17.476 INFO:tasks.workunit.client.0.smithi019.stdout:0/891: dwrite d1/fd [0,4194304] 0 2024-09-12T22:33:17.477 INFO:tasks.workunit.client.0.smithi019.stdout:5/925: symlink d0/d7/d2d/d32/d36/d8c/db8/d39/df7/l13d 0 2024-09-12T22:33:17.478 INFO:tasks.workunit.client.0.smithi019.stdout:6/980: dwrite d1b/d26/d27/d3e/f49 [0,4194304] 0 2024-09-12T22:33:17.478 INFO:tasks.workunit.client.0.smithi019.stdout:1/960: rename d3/d3f/d77/f108 to d3/d3f/d77/f138 0 2024-09-12T22:33:17.479 INFO:tasks.workunit.client.0.smithi019.stdout:4/891: getdents d1/d11/d15 0 2024-09-12T22:33:17.480 INFO:tasks.workunit.client.0.smithi019.stdout:1/961: creat d3/d3f/d58/f139 x:0 0 0 2024-09-12T22:33:17.480 INFO:tasks.workunit.client.0.smithi019.stdout:0/892: link d1/d14/d1b/d3a/d8c/dae/lb8 d1/d14/d116/l123 0 2024-09-12T22:33:17.481 INFO:tasks.workunit.client.0.smithi019.stdout:5/926: creat d0/d7/d2d/d32/d36/d8c/db8/d39/d38/dba/dc7/df3/f13e x:0 0 0 2024-09-12T22:33:17.481 INFO:tasks.workunit.client.0.smithi019.stdout:0/893: creat d1/d14/d26/d40/d45/f124 x:0 0 0 2024-09-12T22:33:17.482 INFO:tasks.workunit.client.0.smithi019.stdout:7/772: dread d6/d2d/d8f/daf/fc1 [4194304,4194304] 0 2024-09-12T22:33:17.483 INFO:tasks.workunit.client.0.smithi019.stdout:1/962: getdents d3/df/d7e/db7/d16/d3c/dbd/de4 0 2024-09-12T22:33:17.483 INFO:tasks.workunit.client.0.smithi019.stdout:5/927: getdents d0/db9 0 2024-09-12T22:33:17.484 INFO:tasks.workunit.client.0.smithi019.stdout:0/894: mknod d1/d14/dad/dcc/c125 0 2024-09-12T22:33:17.484 INFO:tasks.workunit.client.0.smithi019.stdout:0/895: sync 2024-09-12T22:33:17.485 INFO:tasks.workunit.client.0.smithi019.stdout:7/773: fdatasync d6/d14/d2a/da4/d42/f61 0 2024-09-12T22:33:17.485 INFO:tasks.workunit.client.0.smithi019.stdout:6/981: dwrite d1b/d26/de2/df2/f121 [0,4194304] 0 2024-09-12T22:33:17.485 INFO:tasks.workunit.client.0.smithi019.stdout:1/963: creat d3/d6e/da9/d54/f13a x:0 0 0 2024-09-12T22:33:17.486 INFO:tasks.workunit.client.0.smithi019.stdout:5/928: creat d0/d7/f13f x:0 0 0 2024-09-12T22:33:17.487 INFO:tasks.workunit.client.0.smithi019.stdout:9/823: dread dd/d10/d17/d22/d6c/d53/d69/d9d/fa5 [0,4194304] 0 2024-09-12T22:33:17.488 INFO:tasks.workunit.client.0.smithi019.stdout:1/964: symlink d3/d3f/d58/d7f/ded/l13b 0 2024-09-12T22:33:17.488 INFO:tasks.workunit.client.0.smithi019.stdout:6/982: unlink d1b/d26/d39/c13f 0 2024-09-12T22:33:17.488 INFO:tasks.workunit.client.0.smithi019.stdout:9/824: dread - dd/d10/d17/d22/d42/fe5 zero size 2024-09-12T22:33:17.489 INFO:tasks.workunit.client.0.smithi019.stdout:1/965: mknod d3/df/d7e/db7/d16/d3c/dbd/dc4/dc3/c13c 0 2024-09-12T22:33:17.489 INFO:tasks.workunit.client.0.smithi019.stdout:9/825: creat dd/deb/f108 x:0 0 0 2024-09-12T22:33:17.490 INFO:tasks.workunit.client.0.smithi019.stdout:6/983: mknod d1b/d26/d31/d5f/da8/dc3/d126/c14b 0 2024-09-12T22:33:17.490 INFO:tasks.workunit.client.0.smithi019.stdout:1/966: readlink d3/l107 0 2024-09-12T22:33:17.492 INFO:tasks.workunit.client.0.smithi019.stdout:1/967: fsync d3/df/d7e/fc0 0 2024-09-12T22:33:17.492 INFO:tasks.workunit.client.0.smithi019.stdout:6/984: mknod d1b/d26/d27/d67/d77/d7b/c14c 0 2024-09-12T22:33:17.492 INFO:tasks.workunit.client.0.smithi019.stdout:9/826: mknod dd/d10/d17/d23/d2e/d31/d3f/d47/d6e/daf/c109 0 2024-09-12T22:33:17.493 INFO:tasks.workunit.client.0.smithi019.stdout:0/896: dwrite d1/d1f/d5b/dbf/f107 [0,4194304] 0 2024-09-12T22:33:17.493 INFO:tasks.workunit.client.0.smithi019.stdout:6/985: fsync d1b/d26/d31/d5f/d91/f135 0 2024-09-12T22:33:17.494 INFO:tasks.workunit.client.0.smithi019.stdout:1/968: chown d3/df/d7e/db7/d16/d3c/dbd/de6/f68 265846948 1 2024-09-12T22:33:17.494 INFO:tasks.workunit.client.0.smithi019.stdout:6/986: chown d1b/d26/de2/df2/f13e 9174 1 2024-09-12T22:33:17.495 INFO:tasks.workunit.client.0.smithi019.stdout:9/827: link dd/d10/d17/d22/cbb dd/deb/c10a 0 2024-09-12T22:33:17.495 INFO:tasks.workunit.client.0.smithi019.stdout:0/897: getdents d1/d14/d26/d40/d45/d5e/df8/d112 0 2024-09-12T22:33:17.495 INFO:tasks.workunit.client.0.smithi019.stdout:1/969: mknod d3/df/d7e/db7/d16/d3c/dbd/dc4/dc3/df1/d137/c13d 0 2024-09-12T22:33:17.496 INFO:tasks.workunit.client.0.smithi019.stdout:0/898: chown d1/d1f/d5b/f72 836 1 2024-09-12T22:33:17.496 INFO:tasks.workunit.client.0.smithi019.stdout:6/987: creat d1b/db4/d131/d13c/f14d x:0 0 0 2024-09-12T22:33:17.498 INFO:tasks.workunit.client.0.smithi019.stdout:8/881: dread d7/d8/d43/fb9 [0,4194304] 0 2024-09-12T22:33:17.498 INFO:tasks.workunit.client.0.smithi019.stdout:0/899: fsync d1/d14/d1b/d3a/d122/f53 0 2024-09-12T22:33:17.498 INFO:tasks.workunit.client.0.smithi019.stdout:6/988: stat d1b/d26/de2/df2/f121 0 2024-09-12T22:33:17.498 INFO:tasks.workunit.client.0.smithi019.stdout:9/828: unlink dd/d10/d17/d23/d2e/d31/d3f/l4d 0 2024-09-12T22:33:17.498 INFO:tasks.workunit.client.0.smithi019.stdout:8/882: unlink d7/d8/f4c 0 2024-09-12T22:33:17.498 INFO:tasks.workunit.client.0.smithi019.stdout:1/970: rename d3/df/d7e/ca2 to d3/df/d7e/db7/d16/d3c/dbd/de4/c13e 0 2024-09-12T22:33:17.499 INFO:tasks.workunit.client.0.smithi019.stdout:6/989: stat d1b/d26/d31/d5f/da8/dc3 0 2024-09-12T22:33:17.499 INFO:tasks.workunit.client.0.smithi019.stdout:3/803: dread dd/f17 [0,4194304] 0 2024-09-12T22:33:17.499 INFO:tasks.workunit.client.0.smithi019.stdout:9/829: mkdir dd/d10/d17/d23/d10b 0 2024-09-12T22:33:17.499 INFO:tasks.workunit.client.0.smithi019.stdout:8/883: fdatasync d7/d34/d78/d54/fa6 0 2024-09-12T22:33:17.500 INFO:tasks.workunit.client.0.smithi019.stdout:0/900: write d1/d14/d26/d40/d45/f9f [1031792,73730] 0 2024-09-12T22:33:17.500 INFO:tasks.workunit.client.0.smithi019.stdout:6/990: dread - d1b/d26/d31/d5f/f148 zero size 2024-09-12T22:33:17.501 INFO:tasks.workunit.client.0.smithi019.stdout:2/869: dread d0/d5/d18/d1b/d36/f4c [0,4194304] 0 2024-09-12T22:33:17.501 INFO:tasks.workunit.client.0.smithi019.stdout:3/804: chown dd/d1e/d40/da6/lc7 432567 1 2024-09-12T22:33:17.502 INFO:tasks.workunit.client.0.smithi019.stdout:0/901: mkdir d1/d14/d26/d40/d91/d126 0 2024-09-12T22:33:17.502 INFO:tasks.workunit.client.0.smithi019.stdout:3/805: mknod dd/d12/d62/d74/cf6 0 2024-09-12T22:33:17.502 INFO:tasks.workunit.client.0.smithi019.stdout:1/971: rename d3/df/d7e/db7/d16/d3c/dbd/dc4/dc3/df1/d137/c13d to d3/d3f/d58/dc6/c13f 0 2024-09-12T22:33:17.503 INFO:tasks.workunit.client.0.smithi019.stdout:2/870: chown d0/d5/d18/d1b/d8d/fff 66416 1 2024-09-12T22:33:17.503 INFO:tasks.workunit.client.0.smithi019.stdout:0/902: fsync d1/d14/d26/d40/d45/d5e/f66 0 2024-09-12T22:33:17.503 INFO:tasks.workunit.client.0.smithi019.stdout:9/830: rename dd/d10/d17/d22/d6c/d53/fbe to dd/d10/d17/d23/d2e/d31/d3f/dc0/f10c 0 2024-09-12T22:33:17.504 INFO:tasks.workunit.client.0.smithi019.stdout:9/831: sync 2024-09-12T22:33:17.504 INFO:tasks.workunit.client.0.smithi019.stdout:2/871: chown d0/d5/d18/d39/f44 463 1 2024-09-12T22:33:17.504 INFO:tasks.workunit.client.0.smithi019.stdout:5/929: creat d0/d7/d2d/d32/d36/d8c/db5/f140 x:0 0 0 2024-09-12T22:33:17.504 INFO:tasks.workunit.client.0.smithi019.stdout:0/903: creat d1/d1f/d5b/d83/dd9/f127 x:0 0 0 2024-09-12T22:33:17.505 INFO:tasks.workunit.client.0.smithi019.stdout:3/806: rename dd/d1e/d40/d6e/l79 to dd/d12/d62/d78/d98/lf7 0 2024-09-12T22:33:17.505 INFO:tasks.workunit.client.0.smithi019.stdout:2/872: chown d0/d5/d17/f14 12871 1 2024-09-12T22:33:17.506 INFO:tasks.workunit.client.0.smithi019.stdout:5/930: chown d0/d7/f1f 1 1 2024-09-12T22:33:17.506 INFO:tasks.workunit.client.0.smithi019.stdout:0/904: read - d1/d14/d1b/d3a/d122/f53 zero size 2024-09-12T22:33:17.506 INFO:tasks.workunit.client.0.smithi019.stdout:9/832: read dd/d10/d17/d22/d6c/d53/d69/f9c [463009,58717] 0 2024-09-12T22:33:17.507 INFO:tasks.workunit.client.0.smithi019.stdout:2/873: chown d0/d5/d18/d5c/d85/d95/l110 23241 1 2024-09-12T22:33:17.507 INFO:tasks.workunit.client.0.smithi019.stdout:5/931: dread - d0/d7/f13f zero size 2024-09-12T22:33:17.507 INFO:tasks.workunit.client.0.smithi019.stdout:3/807: link dd/d1e/fee dd/d12/d62/d74/ff8 0 2024-09-12T22:33:17.508 INFO:tasks.workunit.client.0.smithi019.stdout:3/808: dread - dd/d1e/d40/d6e/fc4 zero size 2024-09-12T22:33:17.508 INFO:tasks.workunit.client.0.smithi019.stdout:0/905: mknod d1/d14/d26/d40/d45/d5e/df8/d112/c128 0 2024-09-12T22:33:17.508 INFO:tasks.workunit.client.0.smithi019.stdout:6/991: dwrite d1b/d26/d39/d89/f127 [0,4194304] 0 2024-09-12T22:33:17.509 INFO:tasks.workunit.client.0.smithi019.stdout:9/833: fsync dd/d10/d17/d23/d2e/d31/d7e/dbc/faa 0 2024-09-12T22:33:17.510 INFO:tasks.workunit.client.0.smithi019.stdout:8/884: truncate d7/f19 1165034 0 2024-09-12T22:33:17.511 INFO:tasks.workunit.client.0.smithi019.stdout:8/885: readlink d7/lb4 0 2024-09-12T22:33:17.511 INFO:tasks.workunit.client.0.smithi019.stdout:0/906: creat d1/d14/d1b/d3a/d8c/da3/f129 x:0 0 0 2024-09-12T22:33:17.512 INFO:tasks.workunit.client.0.smithi019.stdout:6/992: read d1b/d26/d39/f41 [2838659,105117] 0 2024-09-12T22:33:17.512 INFO:tasks.workunit.client.0.smithi019.stdout:9/834: readlink dd/d10/d17/d23/d2e/d31/d3f/d67/l84 0 2024-09-12T22:33:17.512 INFO:tasks.workunit.client.0.smithi019.stdout:0/907: fdatasync d1/d14/d1b/d94/ffe 0 2024-09-12T22:33:17.513 INFO:tasks.workunit.client.0.smithi019.stdout:3/809: creat dd/d1e/d40/d6e/d70/ff9 x:0 0 0 2024-09-12T22:33:17.513 INFO:tasks.workunit.client.0.smithi019.stdout:6/993: mknod d1b/d26/d123/c14e 0 2024-09-12T22:33:17.514 INFO:tasks.workunit.client.0.smithi019.stdout:0/908: mkdir d1/d14/d1b/d12a 0 2024-09-12T22:33:17.514 INFO:tasks.workunit.client.0.smithi019.stdout:3/810: chown dd/d12/c3a 2 1 2024-09-12T22:33:17.515 INFO:tasks.workunit.client.0.smithi019.stdout:8/886: read d7/d2f/d75/fbe [4386302,19512] 0 2024-09-12T22:33:17.515 INFO:tasks.workunit.client.0.smithi019.stdout:0/909: chown d1/d14/d26/d40/d45/d5e/da2/ca7 6 1 2024-09-12T22:33:17.515 INFO:tasks.workunit.client.0.smithi019.stdout:3/811: creat dd/d12/d62/d74/daa/ffa x:0 0 0 2024-09-12T22:33:17.515 INFO:tasks.workunit.client.0.smithi019.stdout:8/887: creat d7/f110 x:0 0 0 2024-09-12T22:33:17.515 INFO:tasks.workunit.client.0.smithi019.stdout:2/874: dread d0/d5/d60/d74/d7e/d112/d73/dcb/f82 [0,4194304] 0 2024-09-12T22:33:17.516 INFO:tasks.workunit.client.0.smithi019.stdout:9/835: dread dd/d10/d17/d22/fae [0,4194304] 0 2024-09-12T22:33:17.517 INFO:tasks.workunit.client.0.smithi019.stdout:9/836: readlink dd/d10/d17/l3d 0 2024-09-12T22:33:17.517 INFO:tasks.workunit.client.0.smithi019.stdout:2/875: mknod d0/d5/d18/d1b/d5d/c125 0 2024-09-12T22:33:17.518 INFO:tasks.workunit.client.0.smithi019.stdout:0/910: read d1/d14/d26/d40/d45/d5e/f68 [3675253,125100] 0 2024-09-12T22:33:17.518 INFO:tasks.workunit.client.0.smithi019.stdout:0/911: sync 2024-09-12T22:33:17.518 INFO:tasks.workunit.client.0.smithi019.stdout:9/837: fsync dd/d10/d17/d22/d6c/d53/d69/fad 0 2024-09-12T22:33:17.519 INFO:tasks.workunit.client.0.smithi019.stdout:2/876: creat d0/d5/d17/d91/d9c/df2/f126 x:0 0 0 2024-09-12T22:33:17.520 INFO:tasks.workunit.client.0.smithi019.stdout:6/994: write d1b/d2d/fcc [237249,65179] 0 2024-09-12T22:33:17.521 INFO:tasks.workunit.client.0.smithi019.stdout:0/912: creat d1/d14/d1b/d3a/d8c/dae/f12b x:0 0 0 2024-09-12T22:33:17.521 INFO:tasks.workunit.client.0.smithi019.stdout:2/877: fsync d0/d5/d18/d39/f94 0 2024-09-12T22:33:17.521 INFO:tasks.workunit.client.0.smithi019.stdout:9/838: write dd/d10/d17/d23/d2e/d31/d3f/ff6 [1714547,128775] 0 2024-09-12T22:33:17.522 INFO:tasks.workunit.client.0.smithi019.stdout:3/812: dwrite dd/d12/d62/d6a/fcc [0,4194304] 0 2024-09-12T22:33:17.523 INFO:tasks.workunit.client.0.smithi019.stdout:9/839: chown c8 399421 1 2024-09-12T22:33:17.523 INFO:tasks.workunit.client.0.smithi019.stdout:8/888: symlink d7/l111 0 2024-09-12T22:33:17.531 INFO:teuthology.orchestra.run.smithi019.stderr:nodeep-scrub is unset 2024-09-12T22:33:17.534 INFO:tasks.workunit.client.0.smithi019.stdout:3/813: dwrite f5 [4194304,4194304] 0 2024-09-12T22:33:17.535 INFO:tasks.workunit.client.0.smithi019.stdout:0/913: dwrite d1/d14/d1b/d94/f111 [0,4194304] 0 2024-09-12T22:33:17.536 INFO:tasks.workunit.client.0.smithi019.stdout:4/892: dread d1/d4c/db0/d75/d5a/d79/f8a [0,4194304] 0 2024-09-12T22:33:17.537 INFO:tasks.workunit.client.0.smithi019.stdout:8/889: dwrite d7/d8/dd/f11 [12582912,4194304] 0 2024-09-12T22:33:17.537 INFO:tasks.workunit.client.0.smithi019.stdout:7/774: dread d6/d2d/d41/f56 [0,4194304] 0 2024-09-12T22:33:17.539 INFO:tasks.workunit.client.0.smithi019.stdout:7/775: write d6/d14/d45/fe5 [1089508,14888] 0 2024-09-12T22:33:17.539 INFO:tasks.workunit.client.0.smithi019.stdout:0/914: creat d1/d14/d26/d40/d45/d5e/da2/f12c x:0 0 0 2024-09-12T22:33:17.540 INFO:tasks.workunit.client.0.smithi019.stdout:8/890: chown d7/d2f/d42/d98 386031 1 2024-09-12T22:33:17.542 INFO:tasks.workunit.client.0.smithi019.stdout:4/893: unlink d1/d4/da6/lf4 0 2024-09-12T22:33:17.543 INFO:tasks.workunit.client.0.smithi019.stdout:1/972: dread d3/df/d7e/d96/fa5 [0,4194304] 0 2024-09-12T22:33:17.544 INFO:tasks.workunit.client.0.smithi019.stdout:8/891: creat d7/d2f/d75/dc7/f112 x:0 0 0 2024-09-12T22:33:17.545 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:33:17.545 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:33:17.545 INFO:tasks.workunit.client.0.smithi019.stdout:7/776: creat d6/d2d/d8f/f123 x:0 0 0 2024-09-12T22:33:17.546 INFO:tasks.workunit.client.0.smithi019.stdout:3/814: dwrite dd/d1e/d40/d6e/d70/ff2 [0,4194304] 0 2024-09-12T22:33:17.546 INFO:tasks.workunit.client.0.smithi019.stdout:1/973: creat d3/df/d7e/db7/d16/d3c/dce/f140 x:0 0 0 2024-09-12T22:33:17.546 INFO:tasks.workunit.client.0.smithi019.stdout:7/777: write d6/d2d/d77/fcb [660764,121410] 0 2024-09-12T22:33:17.547 INFO:tasks.workunit.client.0.smithi019.stdout:3/815: creat dd/d12/d62/d74/ffb x:0 0 0 2024-09-12T22:33:17.548 INFO:tasks.workunit.client.0.smithi019.stdout:7/778: mkdir d6/d2d/d77/dbf/dde/d124 0 2024-09-12T22:33:17.549 INFO:tasks.workunit.client.0.smithi019.stdout:3/816: stat dd/d12/d62/d6a/fd1 0 2024-09-12T22:33:17.549 INFO:tasks.workunit.client.0.smithi019.stdout:1/974: rename d3/d3f/l59 to d3/df/d7e/db7/d63/de7/l141 0 2024-09-12T22:33:17.550 INFO:tasks.workunit.client.0.smithi019.stdout:2/878: dread d0/f57 [0,4194304] 0 2024-09-12T22:33:17.551 INFO:tasks.workunit.client.0.smithi019.stdout:4/894: dwrite d1/d22/d26/f43 [0,4194304] 0 2024-09-12T22:33:17.552 INFO:tasks.workunit.client.0.smithi019.stdout:2/879: chown d0/d5/d18/d5c/d63 4 1 2024-09-12T22:33:17.552 INFO:tasks.workunit.client.0.smithi019.stdout:1/975: creat d3/df/d7e/db7/d16/d3c/dbd/dc4/dc3/f142 x:0 0 0 2024-09-12T22:33:17.553 INFO:tasks.workunit.client.0.smithi019.stdout:4/895: write d1/d4c/db0/d75/ffa [90931,90907] 0 2024-09-12T22:33:17.555 INFO:tasks.workunit.client.0.smithi019.stdout:2/880: readlink d0/d5/d18/d1b/d8d/lb8 0 2024-09-12T22:33:17.556 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:33:17.558 INFO:tasks.workunit.client.0.smithi019.stdout:8/892: write d7/d2f/d75/ff5 [115915,105981] 0 2024-09-12T22:33:17.558 INFO:tasks.workunit.client.0.smithi019.stdout:1/976: readlink d3/df/d7e/db7/d63/d76/d91/la8 0 2024-09-12T22:33:17.559 INFO:tasks.workunit.client.0.smithi019.stdout:7/779: dwrite d6/d2d/d8f/daf/fc1 [4194304,4194304] 0 2024-09-12T22:33:17.559 INFO:tasks.workunit.client.0.smithi019.stdout:3/817: dwrite dd/d12/d62/d74/fec [0,4194304] 0 2024-09-12T22:33:17.559 INFO:tasks.workunit.client.0.smithi019.stdout:2/881: mkdir d0/d5/d18/d1b/d113/d127 0 2024-09-12T22:33:17.563 INFO:tasks.workunit.client.0.smithi019.stdout:4/896: rename d1/d11/d15/d1f/d56/dac/c13d to d1/d11/d15/d81/c13e 0 2024-09-12T22:33:17.563 INFO:tasks.workunit.client.0.smithi019.stdout:1/977: link d3/d6e/da9/f2a d3/d3f/f143 0 2024-09-12T22:33:17.563 INFO:tasks.workunit.client.0.smithi019.stdout:7/780: write d6/d2d/d41/fbe [1447491,33437] 0 2024-09-12T22:33:17.563 INFO:tasks.workunit.client.0.smithi019.stdout:9/840: dread dd/f18 [0,4194304] 0 2024-09-12T22:33:17.564 INFO:tasks.workunit.client.0.smithi019.stdout:2/882: mknod d0/d5/d18/d1b/d8d/c128 0 2024-09-12T22:33:17.566 INFO:tasks.workunit.client.0.smithi019.stdout:8/893: dread d7/d2f/d42/f92 [0,4194304] 0 2024-09-12T22:33:17.566 INFO:tasks.workunit.client.0.smithi019.stdout:4/897: link d1/d22/d57/la3 d1/d8/dfb/d10c/l13f 0 2024-09-12T22:33:17.568 INFO:tasks.workunit.client.0.smithi019.stdout:2/883: rmdir d0/d5/d18/d1b/d113/d127 0 2024-09-12T22:33:17.568 INFO:tasks.workunit.client.0.smithi019.stdout:7/781: getdents d6/d14/d2a/da4/d34 0 2024-09-12T22:33:17.569 INFO:tasks.workunit.client.0.smithi019.stdout:8/894: fsync d7/d8/d43/f8f 0 2024-09-12T22:33:17.569 INFO:tasks.workunit.client.0.smithi019.stdout:4/898: readlink d1/d4/d38/dbf/ldc 0 2024-09-12T22:33:17.569 INFO:tasks.workunit.client.0.smithi019.stdout:8/895: readlink d7/l111 0 2024-09-12T22:33:17.569 INFO:tasks.workunit.client.0.smithi019.stdout:3/818: dwrite dd/d1e/d5a/f7f [0,4194304] 0 2024-09-12T22:33:17.569 INFO:tasks.workunit.client.0.smithi019.stdout:2/884: rmdir d0/d5/d18/d3b/df9 39 2024-09-12T22:33:17.570 INFO:tasks.workunit.client.0.smithi019.stdout:4/899: readlink d1/d4/d38/dbf/ldc 0 2024-09-12T22:33:17.571 INFO:tasks.workunit.client.0.smithi019.stdout:8/896: creat d7/d2f/d42/f113 x:0 0 0 2024-09-12T22:33:17.572 INFO:tasks.workunit.client.0.smithi019.stdout:3/819: mknod dd/d12/dbe/cfc 0 2024-09-12T22:33:17.572 INFO:tasks.workunit.client.0.smithi019.stdout:1/978: read d3/f69 [1421178,94687] 0 2024-09-12T22:33:17.572 INFO:tasks.workunit.client.0.smithi019.stdout:4/900: write d1/d11/d15/f2b [2114834,71662] 0 2024-09-12T22:33:17.572 INFO:tasks.workunit.client.0.smithi019.stdout:8/897: chown d7/d34/d78/d53/d108 54 1 2024-09-12T22:33:17.572 INFO:tasks.workunit.client.0.smithi019.stdout:3/820: fdatasync dd/d1e/d40/f4a 0 2024-09-12T22:33:17.573 INFO:tasks.workunit.client.0.smithi019.stdout:9/841: dwrite dd/d10/d17/d22/d42/ff5 [8388608,4194304] 0 2024-09-12T22:33:17.574 INFO:tasks.workunit.client.0.smithi019.stdout:1/979: chown d3/df/d7e/db7/d63/f97 129479 1 2024-09-12T22:33:17.574 INFO:tasks.workunit.client.0.smithi019.stdout:8/898: write d7/d2f/d75/ff5 [1132962,118256] 0 2024-09-12T22:33:17.574 INFO:tasks.workunit.client.0.smithi019.stdout:2/885: dread d0/d5/d18/d1b/d36/f4c [0,4194304] 0 2024-09-12T22:33:17.575 INFO:tasks.workunit.client.0.smithi019.stdout:1/980: creat d3/df/d7e/db7/d63/d76/f144 x:0 0 0 2024-09-12T22:33:17.575 INFO:tasks.workunit.client.0.smithi019.stdout:2/886: mkdir d0/d5/d17/d129 0 2024-09-12T22:33:17.576 INFO:tasks.workunit.client.0.smithi019.stdout:1/981: fdatasync d3/df/d7e/db7/d63/f85 0 2024-09-12T22:33:17.577 INFO:tasks.workunit.client.0.smithi019.stdout:4/901: dwrite d1/d11/f10b [0,4194304] 0 2024-09-12T22:33:17.578 INFO:tasks.workunit.client.0.smithi019.stdout:2/887: symlink d0/d5/d18/d5c/d67/d109/l12a 0 2024-09-12T22:33:17.578 INFO:tasks.workunit.client.0.smithi019.stdout:7/782: truncate d6/d14/d15/d9e/f2f 2032591 0 2024-09-12T22:33:17.579 INFO:tasks.workunit.client.0.smithi019.stdout:5/932: dread d0/d7/d2d/d32/d36/d8c/db8/d39/d38/d4b/dde/da0/d12b/f26 [0,4194304] 0 2024-09-12T22:33:17.580 INFO:tasks.workunit.client.0.smithi019.stdout:1/982: write d3/df/d7e/db7/d16/f60 [1159091,27200] 0 2024-09-12T22:33:17.580 INFO:tasks.workunit.client.0.smithi019.stdout:7/783: dread - d6/d14/d15/d9e/ffb zero size 2024-09-12T22:33:17.582 INFO:tasks.workunit.client.0.smithi019.stdout:1/983: getdents d3/d3f/d58 0 2024-09-12T22:33:17.582 INFO:tasks.workunit.client.0.smithi019.stdout:5/933: readlink d0/d7/d2d/d32/d36/d8c/db8/d39/d38/d4b/dde/da0/d12b/l68 0 2024-09-12T22:33:17.584 INFO:tasks.workunit.client.0.smithi019.stdout:1/984: write d3/df/f41 [4881777,88780] 0 2024-09-12T22:33:17.584 INFO:tasks.workunit.client.0.smithi019.stdout:2/888: write d0/d5/ff3 [2338760,13576] 0 2024-09-12T22:33:17.584 INFO:tasks.workunit.client.0.smithi019.stdout:0/915: sync 2024-09-12T22:33:17.584 INFO:tasks.workunit.client.0.smithi019.stdout:1/985: unlink d3/df/d7e/db7/d16/d126/f129 0 2024-09-12T22:33:17.584 INFO:tasks.workunit.client.0.smithi019.stdout:5/934: mknod d0/d7/d2d/d32/d36/d8c/db8/d39/d38/d4b/dde/da0/d12b/d9d/c141 0 2024-09-12T22:33:17.584 INFO:tasks.workunit.client.0.smithi019.stdout:2/889: creat d0/d5/d60/d74/d7e/d112/f12b x:0 0 0 2024-09-12T22:33:17.585 INFO:tasks.workunit.client.0.smithi019.stdout:0/916: truncate d1/d14/d1b/d3a/d8c/f90 3477552 0 2024-09-12T22:33:17.587 INFO:tasks.workunit.client.0.smithi019.stdout:6/995: dread d1b/d26/d39/d6a/f10b [0,4194304] 0 2024-09-12T22:33:17.587 INFO:tasks.workunit.client.0.smithi019.stdout:0/917: symlink d1/d14/d1b/d3a/l12d 0 2024-09-12T22:33:17.591 INFO:tasks.workunit.client.0.smithi019.stdout:0/918: write d1/d14/d1b/d3a/d122/f10c [874755,98445] 0 2024-09-12T22:33:17.591 INFO:tasks.workunit.client.0.smithi019.stdout:1/986: dwrite d3/df/d7e/d90/f110 [0,4194304] 0 2024-09-12T22:33:17.591 INFO:tasks.workunit.client.0.smithi019.stdout:2/890: dwrite d0/d5/d18/d1b/d5d/d86/f118 [0,4194304] 0 2024-09-12T22:33:17.592 INFO:tasks.workunit.client.0.smithi019.stdout:9/842: dread dd/dc2/f81 [0,4194304] 0 2024-09-12T22:33:17.593 INFO:tasks.workunit.client.0.smithi019.stdout:0/919: write d1/d14/d26/d40/d45/d5e/da2/fd0 [867436,81053] 0 2024-09-12T22:33:17.593 INFO:tasks.workunit.client.0.smithi019.stdout:2/891: write d0/d5/d18/d39/fe8 [1044771,24376] 0 2024-09-12T22:33:17.594 INFO:tasks.workunit.client.0.smithi019.stdout:2/892: chown d0/d5/d18/d1b/d5d/d86/d90/d10d 2293640 1 2024-09-12T22:33:17.595 INFO:tasks.workunit.client.0.smithi019.stdout:2/893: mkdir d0/d5/d18/d1b/d113/d12c 0 2024-09-12T22:33:17.597 INFO:tasks.workunit.client.0.smithi019.stdout:9/843: write dd/d10/d17/d23/d37/f5a [257645,6975] 0 2024-09-12T22:33:17.597 INFO:tasks.workunit.client.0.smithi019.stdout:2/894: mkdir d0/d5/d18/d1b/d5d/d86/d90/d12d 0 2024-09-12T22:33:17.599 INFO:tasks.workunit.client.0.smithi019.stdout:1/987: dwrite d3/df/d7e/db7/d16/d3c/dce/f140 [0,4194304] 0 2024-09-12T22:33:17.599 INFO:tasks.workunit.client.0.smithi019.stdout:9/844: dread - dd/d10/d17/d23/d2e/d31/d3f/d47/d6e/d80/fc6 zero size 2024-09-12T22:33:17.600 INFO:tasks.workunit.client.0.smithi019.stdout:1/988: mknod d3/df/d7e/db7/d63/de7/c145 0 2024-09-12T22:33:17.600 INFO:tasks.workunit.client.0.smithi019.stdout:2/895: getdents d0/d5/d60/d74/d7e/d112/d73/d104 0 2024-09-12T22:33:17.600 INFO:tasks.workunit.client.0.smithi019.stdout:9/845: chown dd/d10/d17/d23/d2e/d31/d3f/d47/d6e/daf 4184542 1 2024-09-12T22:33:17.601 INFO:tasks.workunit.client.0.smithi019.stdout:2/896: creat d0/f12e x:0 0 0 2024-09-12T22:33:17.601 INFO:tasks.workunit.client.0.smithi019.stdout:9/846: symlink dd/d10/d17/d23/ddb/l10d 0 2024-09-12T22:33:17.602 INFO:tasks.workunit.client.0.smithi019.stdout:2/897: readlink d0/d5/d18/l122 0 2024-09-12T22:33:17.602 INFO:tasks.workunit.client.0.smithi019.stdout:1/989: link d3/df/d7e/db7/d16/d3c/dbd/dc4/cd5 d3/df/c146 0 2024-09-12T22:33:17.603 INFO:tasks.workunit.client.0.smithi019.stdout:9/847: readlink dd/d10/d17/d23/d2e/d31/d3f/d47/l51 0 2024-09-12T22:33:17.603 INFO:tasks.workunit.client.0.smithi019.stdout:3/821: dread dd/d1e/d40/fb8 [0,4194304] 0 2024-09-12T22:33:17.603 INFO:tasks.workunit.client.0.smithi019.stdout:1/990: mknod d3/c147 0 2024-09-12T22:33:17.604 INFO:tasks.workunit.client.0.smithi019.stdout:2/898: truncate d0/d5/dd6/fe2 1834832 0 2024-09-12T22:33:17.604 INFO:tasks.workunit.client.0.smithi019.stdout:3/822: write dd/f4d [969766,4662] 0 2024-09-12T22:33:17.604 INFO:tasks.workunit.client.0.smithi019.stdout:9/848: mkdir dd/d10/d17/d23/d37/d10e 0 2024-09-12T22:33:17.605 INFO:tasks.workunit.client.0.smithi019.stdout:1/991: creat d3/df/d7e/db7/d16/f148 x:0 0 0 2024-09-12T22:33:17.605 INFO:tasks.workunit.client.0.smithi019.stdout:2/899: rename d0/d5/d18/d1b/c34 to d0/d5/d60/d71/c12f 0 2024-09-12T22:33:17.605 INFO:tasks.workunit.client.0.smithi019.stdout:3/823: chown f2 22 1 2024-09-12T22:33:17.605 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:17.604+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:17.606 INFO:tasks.workunit.client.0.smithi019.stdout:2/900: write d0/fcf [1029358,107680] 0 2024-09-12T22:33:17.607 INFO:tasks.workunit.client.0.smithi019.stdout:2/901: mknod d0/d5/d18/d1b/d5d/d86/c130 0 2024-09-12T22:33:17.607 INFO:tasks.workunit.client.0.smithi019.stdout:9/849: truncate dd/d10/d17/d22/d6c/d53/d69/fad 928097 0 2024-09-12T22:33:17.607 INFO:tasks.workunit.client.0.smithi019.stdout:9/850: readlink dd/l1a 0 2024-09-12T22:33:17.609 INFO:tasks.workunit.client.0.smithi019.stdout:1/992: dwrite d3/d6e/fcf [0,4194304] 0 2024-09-12T22:33:17.609 INFO:tasks.workunit.client.0.smithi019.stdout:9/851: symlink dd/d10/d17/d23/d2e/d31/d7e/dbc/ddd/dde/l10f 0 2024-09-12T22:33:17.610 INFO:tasks.workunit.client.0.smithi019.stdout:3/824: write dd/d12/f48 [693158,33396] 0 2024-09-12T22:33:17.610 INFO:tasks.workunit.client.0.smithi019.stdout:1/993: mkdir d3/d149 0 2024-09-12T22:33:17.611 INFO:tasks.workunit.client.0.smithi019.stdout:3/825: write dd/d12/f48 [917297,115646] 0 2024-09-12T22:33:17.612 INFO:tasks.workunit.client.0.smithi019.stdout:3/826: symlink dd/d12/d62/d74/lfd 0 2024-09-12T22:33:17.612 INFO:tasks.workunit.client.0.smithi019.stdout:1/994: mknod d3/df/d7e/db7/d16/d3c/d55/da0/c14a 0 2024-09-12T22:33:17.612 INFO:tasks.workunit.client.0.smithi019.stdout:3/827: chown dd/d1e/lb0 5368758 1 2024-09-12T22:33:17.615 INFO:tasks.workunit.client.0.smithi019.stdout:1/995: write d3/df/f11f [1551101,2990] 0 2024-09-12T22:33:17.615 INFO:tasks.workunit.client.0.smithi019.stdout:3/828: mkdir dd/d12/d62/d6a/dfe 0 2024-09-12T22:33:17.616 INFO:tasks.workunit.client.0.smithi019.stdout:9/852: dwrite dd/d10/d17/d22/d6c/d53/d69/d9d/dbd/fe4 [0,4194304] 0 2024-09-12T22:33:17.617 INFO:tasks.workunit.client.0.smithi019.stdout:3/829: fdatasync dd/d12/d62/d6a/fcc 0 2024-09-12T22:33:17.617 INFO:tasks.workunit.client.0.smithi019.stdout:2/902: dwrite d0/d5/d18/d5c/f68 [0,4194304] 0 2024-09-12T22:33:17.617 INFO:tasks.workunit.client.0.smithi019.stdout:1/996: read d3/d3f/d58/dc6/ffe [380736,17656] 0 2024-09-12T22:33:17.619 INFO:tasks.workunit.client.0.smithi019.stdout:2/903: creat d0/d5/d18/d5c/d67/d77/f131 x:0 0 0 2024-09-12T22:33:17.619 INFO:tasks.workunit.client.0.smithi019.stdout:9/853: write dd/f18 [5781952,86439] 0 2024-09-12T22:33:17.621 INFO:tasks.workunit.client.0.smithi019.stdout:9/854: mknod dd/d10/d17/d23/d10b/c110 0 2024-09-12T22:33:17.621 INFO:tasks.workunit.client.0.smithi019.stdout:2/904: mkdir d0/d5/d60/d74/d7e/d112/d73/d104/d132 0 2024-09-12T22:33:17.622 INFO:tasks.workunit.client.0.smithi019.stdout:3/830: dread dd/d12/f24 [0,4194304] 0 2024-09-12T22:33:17.622 INFO:tasks.workunit.client.0.smithi019.stdout:2/905: chown d0/d5/d18/d1b/d5d/d86/d10b/d11d/c11f 121582 1 2024-09-12T22:33:17.624 INFO:tasks.workunit.client.0.smithi019.stdout:7/784: sync 2024-09-12T22:33:17.624 INFO:tasks.workunit.client.0.smithi019.stdout:4/902: sync 2024-09-12T22:33:17.624 INFO:tasks.workunit.client.0.smithi019.stdout:0/920: sync 2024-09-12T22:33:17.625 INFO:tasks.workunit.client.0.smithi019.stdout:7/785: rmdir d6/d14/d15 39 2024-09-12T22:33:17.627 INFO:tasks.workunit.client.0.smithi019.stdout:7/786: creat d6/d14/d45/d7c/f125 x:0 0 0 2024-09-12T22:33:17.627 INFO:tasks.workunit.client.0.smithi019.stdout:4/903: getdents d1/d11/d15/d81 0 2024-09-12T22:33:17.628 INFO:tasks.workunit.client.0.smithi019.stdout:3/831: dwrite dd/d1e/d82/f8f [0,4194304] 0 2024-09-12T22:33:17.628 INFO:tasks.workunit.client.0.smithi019.stdout:2/906: dwrite d0/d5/d17/fc6 [0,4194304] 0 2024-09-12T22:33:17.630 INFO:tasks.workunit.client.0.smithi019.stdout:8/899: dread d7/d8/f2e [0,4194304] 0 2024-09-12T22:33:17.630 INFO:tasks.workunit.client.0.smithi019.stdout:7/787: fsync d6/d14/d15/d62/f87 0 2024-09-12T22:33:17.630 INFO:tasks.workunit.client.0.smithi019.stdout:4/904: truncate d1/d4/f88 3891881 0 2024-09-12T22:33:17.631 INFO:tasks.workunit.client.0.smithi019.stdout:3/832: mkdir dd/d1e/d40/d6e/dff 0 2024-09-12T22:33:17.632 INFO:tasks.workunit.client.0.smithi019.stdout:4/905: fdatasync d1/d8/d7b/fda 0 2024-09-12T22:33:17.632 INFO:tasks.workunit.client.0.smithi019.stdout:8/900: dread - d7/d8/dd/d4f/f97 zero size 2024-09-12T22:33:17.632 INFO:tasks.workunit.client.0.smithi019.stdout:3/833: symlink dd/d12/dbe/l100 0 2024-09-12T22:33:17.632 INFO:tasks.workunit.client.0.smithi019.stdout:2/907: rename d0/d5/le0 to d0/d5/d18/d1b/d8d/dac/d10f/l133 0 2024-09-12T22:33:17.633 INFO:tasks.workunit.client.0.smithi019.stdout:8/901: dread - d7/d8/d43/d87/fe0 zero size 2024-09-12T22:33:17.634 INFO:tasks.workunit.client.0.smithi019.stdout:3/834: mkdir dd/d1e/d82/d101 0 2024-09-12T22:33:17.634 INFO:tasks.workunit.client.0.smithi019.stdout:2/908: chown d0/d5/d18/f56 848876 1 2024-09-12T22:33:17.634 INFO:tasks.workunit.client.0.smithi019.stdout:3/835: fsync dd/d12/f24 0 2024-09-12T22:33:17.636 INFO:tasks.workunit.client.0.smithi019.stdout:2/909: getdents d0/d5/d60/d71 0 2024-09-12T22:33:17.636 INFO:tasks.workunit.client.0.smithi019.stdout:4/906: getdents d1/d11/d15 0 2024-09-12T22:33:17.638 INFO:tasks.workunit.client.0.smithi019.stdout:4/907: chown d1/d4c/c70 1524335 1 2024-09-12T22:33:17.638 INFO:tasks.workunit.client.0.smithi019.stdout:5/935: dread d0/d7/d2d/d32/d36/d8c/db8/d39/d38/d4b/dde/da0/d12b/f86 [4194304,4194304] 0 2024-09-12T22:33:17.638 INFO:tasks.workunit.client.0.smithi019.stdout:7/788: dwrite d6/d14/d15/f98 [0,4194304] 0 2024-09-12T22:33:17.639 INFO:tasks.workunit.client.0.smithi019.stdout:2/910: unlink d0/d5/d60/d74/d7e/d112/f29 0 2024-09-12T22:33:17.640 INFO:tasks.workunit.client.0.smithi019.stdout:4/908: symlink d1/d22/d2c/l140 0 2024-09-12T22:33:17.641 INFO:tasks.workunit.client.0.smithi019.stdout:2/911: chown d0/d5/d60/d74/d7e/db5 15931 1 2024-09-12T22:33:17.641 INFO:tasks.workunit.client.0.smithi019.stdout:8/902: dwrite d7/d8/f1b [0,4194304] 0 2024-09-12T22:33:17.642 INFO:tasks.workunit.client.0.smithi019.stdout:3/836: dread dd/d12/f29 [0,4194304] 0 2024-09-12T22:33:17.642 INFO:tasks.workunit.client.0.smithi019.stdout:7/789: rmdir d6/d2d/d41/dfc 0 2024-09-12T22:33:17.642 INFO:tasks.workunit.client.0.smithi019.stdout:8/903: mkdir d7/d2f/d42/d114 0 2024-09-12T22:33:17.643 INFO:tasks.workunit.client.0.smithi019.stdout:4/909: creat d1/d11/d15/d1f/d56/f141 x:0 0 0 2024-09-12T22:33:17.643 INFO:tasks.workunit.client.0.smithi019.stdout:3/837: fdatasync dd/d12/d62/d78/f8b 0 2024-09-12T22:33:17.645 INFO:tasks.workunit.client.0.smithi019.stdout:2/912: mknod d0/d5/d60/d74/d7e/d112/d73/d104/c134 0 2024-09-12T22:33:17.647 INFO:tasks.workunit.client.0.smithi019.stdout:2/913: mknod d0/d5/d18/d3b/c135 0 2024-09-12T22:33:17.649 INFO:tasks.workunit.client.0.smithi019.stdout:8/904: dwrite d7/d8/dd/d4f/f80 [0,4194304] 0 2024-09-12T22:33:17.649 INFO:tasks.workunit.client.0.smithi019.stdout:2/914: rmdir d0/d5/d17/d129 0 2024-09-12T22:33:17.650 INFO:tasks.workunit.client.0.smithi019.stdout:3/838: dwrite dd/d1e/f3c [4194304,4194304] 0 2024-09-12T22:33:17.651 INFO:tasks.workunit.client.0.smithi019.stdout:4/910: read d1/d4/d38/f83 [3585536,30224] 0 2024-09-12T22:33:17.651 INFO:tasks.workunit.client.0.smithi019.stdout:2/915: stat d0/d5/d18/d3b/f49 0 2024-09-12T22:33:17.652 INFO:tasks.workunit.client.0.smithi019.stdout:3/839: write dd/d12/d62/d74/fec [3874570,56769] 0 2024-09-12T22:33:17.652 INFO:tasks.workunit.client.0.smithi019.stdout:6/996: dread d1b/d26/d27/f5b [0,4194304] 0 2024-09-12T22:33:17.656 INFO:tasks.workunit.client.0.smithi019.stdout:7/790: read d6/d14/d45/f7e [1059647,98979] 0 2024-09-12T22:33:17.658 INFO:tasks.workunit.client.0.smithi019.stdout:4/911: mkdir d1/d22/d31/d85/d142 0 2024-09-12T22:33:17.658 INFO:tasks.workunit.client.0.smithi019.stdout:3/840: unlink dd/d1e/f34 0 2024-09-12T22:33:17.658 INFO:tasks.workunit.client.0.smithi019.stdout:6/997: creat d1b/d2d/f14f x:0 0 0 2024-09-12T22:33:17.658 INFO:tasks.workunit.client.0.smithi019.stdout:7/791: dread - d6/d14/d15/d62/f10c zero size 2024-09-12T22:33:17.658 INFO:tasks.workunit.client.0.smithi019.stdout:6/998: mkdir d1b/d2d/d150 0 2024-09-12T22:33:17.658 INFO:tasks.workunit.client.0.smithi019.stdout:4/912: write d1/d8/d7b/fda [1018230,64631] 0 2024-09-12T22:33:17.658 INFO:tasks.workunit.client.0.smithi019.stdout:3/841: creat dd/d12/d62/d6a/dfe/f102 x:0 0 0 2024-09-12T22:33:17.658 INFO:tasks.workunit.client.0.smithi019.stdout:3/842: symlink dd/d12/d62/d78/l103 0 2024-09-12T22:33:17.658 INFO:tasks.workunit.client.0.smithi019.stdout:6/999: write d1b/d26/d39/d6a/d97/f11d [1331010,222] 0 2024-09-12T22:33:17.658 INFO:tasks.workunit.client.0.smithi019.stdout:8/905: dwrite d7/d8/dd/f67 [0,4194304] 0 2024-09-12T22:33:17.659 INFO:tasks.workunit.client.0.smithi019.stdout:8/906: sync 2024-09-12T22:33:17.659 INFO:tasks.workunit.client.0.smithi019.stdout:7/792: write d6/d14/d2a/da4/d34/f38 [1239062,4112] 0 2024-09-12T22:33:17.659 INFO:tasks.workunit.client.0.smithi019.stdout:4/913: chown d1/d22/d31/d85/l12a 154876617 1 2024-09-12T22:33:17.659 INFO:tasks.workunit.client.0.smithi019.stdout:3/843: dread - dd/d12/d62/fac zero size 2024-09-12T22:33:17.660 INFO:tasks.workunit.client.0.smithi019.stdout:4/914: creat d1/d4/d38/f143 x:0 0 0 2024-09-12T22:33:17.660 INFO:tasks.workunit.client.0.smithi019.stdout:3/844: fdatasync dd/d1e/f67 0 2024-09-12T22:33:17.660 INFO:tasks.workunit.client.0.smithi019.stdout:4/915: fdatasync d1/d4/d38/f94 0 2024-09-12T22:33:17.661 INFO:tasks.workunit.client.0.smithi019.stdout:8/907: rename d7/d8/dd/d45/lfe to d7/d8/dd/l115 0 2024-09-12T22:33:17.661 INFO:tasks.workunit.client.0.smithi019.stdout:7/793: write d6/d14/d2a/da4/dc/d63/d4b/f5a [3019558,56027] 0 2024-09-12T22:33:17.662 INFO:tasks.workunit.client.0.smithi019.stdout:3/845: write dd/d12/dbe/fc5 [789831,10929] 0 2024-09-12T22:33:17.662 INFO:tasks.workunit.client.0.smithi019.stdout:2/916: dwrite d0/d5/d17/d91/d9c/df2/f126 [0,4194304] 0 2024-09-12T22:33:17.662 INFO:tasks.workunit.client.0.smithi019.stdout:7/794: write d6/d2d/d77/fcb [697248,21879] 0 2024-09-12T22:33:17.663 INFO:tasks.workunit.client.0.smithi019.stdout:4/916: fdatasync d1/d11/d15/d1f/da8/fc6 0 2024-09-12T22:33:17.663 INFO:tasks.workunit.client.0.smithi019.stdout:3/846: creat dd/d1e/d40/d6e/f104 x:0 0 0 2024-09-12T22:33:17.664 INFO:tasks.workunit.client.0.smithi019.stdout:2/917: rmdir d0/d5/d18/d5c/d67/d109 39 2024-09-12T22:33:17.664 INFO:tasks.workunit.client.0.smithi019.stdout:7/795: creat d6/d14/d45/dca/f126 x:0 0 0 2024-09-12T22:33:17.665 INFO:tasks.workunit.client.0.smithi019.stdout:3/847: write dd/d1e/d40/da6/dba/fea [805541,129868] 0 2024-09-12T22:33:17.665 INFO:tasks.workunit.client.0.smithi019.stdout:7/796: fsync d6/d2d/d77/fec 0 2024-09-12T22:33:17.665 INFO:tasks.workunit.client.0.smithi019.stdout:2/918: symlink d0/d5/d18/d1b/d5d/d86/d108/l136 0 2024-09-12T22:33:17.665 INFO:tasks.workunit.client.0.smithi019.stdout:4/917: truncate d1/d11/d15/d1f/d56/dac/fe0 227585 0 2024-09-12T22:33:17.667 INFO:tasks.workunit.client.0.smithi019.stdout:2/919: write d0/d5/d18/d5c/f68 [1537232,94157] 0 2024-09-12T22:33:17.667 INFO:tasks.workunit.client.0.smithi019.stdout:4/918: rename d1/d8/d7b/fbe to d1/d4/dec/f144 0 2024-09-12T22:33:17.668 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:17.666+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:17.669 INFO:tasks.workunit.client.0.smithi019.stdout:4/919: symlink d1/d4c/db0/l145 0 2024-09-12T22:33:17.670 INFO:tasks.workunit.client.0.smithi019.stdout:2/920: link d0/d5/f10 d0/d5/d18/d3b/f137 0 2024-09-12T22:33:17.672 INFO:tasks.workunit.client.0.smithi019.stdout:3/848: dwrite dd/fdc [0,4194304] 0 2024-09-12T22:33:17.673 INFO:tasks.workunit.client.0.smithi019.stdout:7/797: dwrite d6/d14/d15/f17 [0,4194304] 0 2024-09-12T22:33:17.673 INFO:tasks.workunit.client.0.smithi019.stdout:7/798: sync 2024-09-12T22:33:17.673 INFO:tasks.workunit.client.0.smithi019.stdout:9/855: dread dd/d10/d17/d22/fd2 [0,4194304] 0 2024-09-12T22:33:17.673 INFO:tasks.workunit.client.0.smithi019.stdout:8/908: truncate d7/f59 2201672 0 2024-09-12T22:33:17.674 INFO:tasks.workunit.client.0.smithi019.stdout:4/920: rename d1/d11/d15/f2b to d1/d22/d57/df2/f146 0 2024-09-12T22:33:17.674 INFO:tasks.workunit.client.0.smithi019.stdout:3/849: symlink dd/d12/d62/dd8/l105 0 2024-09-12T22:33:17.675 INFO:tasks.workunit.client.0.smithi019.stdout:7/799: write d6/d2d/d77/fec [3574346,90959] 0 2024-09-12T22:33:17.676 INFO:tasks.workunit.client.0.smithi019.stdout:9/856: write dd/d10/d17/d22/d77/fb5 [5143338,102151] 0 2024-09-12T22:33:17.676 INFO:tasks.workunit.client.0.smithi019.stdout:2/921: mknod d0/d5/d18/d1b/d5d/d86/d90/d10d/c138 0 2024-09-12T22:33:17.677 INFO:tasks.workunit.client.0.smithi019.stdout:4/921: truncate d1/d4/d38/dbf/fd1 480687 0 2024-09-12T22:33:17.677 INFO:tasks.workunit.client.0.smithi019.stdout:3/850: rename dd/d12/d62/d6a to dd/d12/d62/d6a/d106 22 2024-09-12T22:33:17.677 INFO:tasks.workunit.client.0.smithi019.stdout:2/922: read d0/f57 [943285,22778] 0 2024-09-12T22:33:17.677 INFO:tasks.workunit.client.0.smithi019.stdout:3/851: write dd/d12/d62/d6a/fbc [731644,26418] 0 2024-09-12T22:33:17.678 INFO:tasks.workunit.client.0.smithi019.stdout:7/800: write d6/d2d/d8f/daf/f95 [2329688,59692] 0 2024-09-12T22:33:17.679 INFO:tasks.workunit.client.0.smithi019.stdout:2/923: unlink d0/d5/dd6/ff5 0 2024-09-12T22:33:17.679 INFO:tasks.workunit.client.0.smithi019.stdout:7/801: creat d6/d2d/d77/dbf/f127 x:0 0 0 2024-09-12T22:33:17.679 INFO:tasks.workunit.client.0.smithi019.stdout:9/857: creat dd/d10/d17/d22/d6c/d53/de3/f111 x:0 0 0 2024-09-12T22:33:17.681 INFO:tasks.workunit.client.0.smithi019.stdout:3/852: write dd/d1e/d5a/f94 [1652627,84990] 0 2024-09-12T22:33:17.683 INFO:tasks.workunit.client.0.smithi019.stdout:3/853: creat dd/f107 x:0 0 0 2024-09-12T22:33:17.684 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:33:17.684 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:33:17.685 INFO:tasks.workunit.client.0.smithi019.stdout:9/858: link dd/d10/d17/l62 dd/d10/d17/d22/d42/l112 0 2024-09-12T22:33:17.687 INFO:tasks.workunit.client.0.smithi019.stdout:3/854: mknod dd/d12/d62/d6a/c108 0 2024-09-12T22:33:17.687 INFO:tasks.workunit.client.0.smithi019.stdout:1/997: dread d3/df/d7e/db7/d16/f99 [0,4194304] 0 2024-09-12T22:33:17.688 INFO:tasks.workunit.client.0.smithi019.stdout:4/922: dwrite d1/d4/d38/dbf/fca [0,4194304] 0 2024-09-12T22:33:17.689 INFO:tasks.workunit.client.0.smithi019.stdout:2/924: dwrite d0/d5/d18/d5c/f68 [0,4194304] 0 2024-09-12T22:33:17.689 INFO:tasks.workunit.client.0.smithi019.stdout:8/909: dwrite d7/f6f [0,4194304] 0 2024-09-12T22:33:17.689 INFO:tasks.workunit.client.0.smithi019.stdout:3/855: chown dd/l7b 15814 1 2024-09-12T22:33:17.689 INFO:tasks.workunit.client.0.smithi019.stdout:4/923: stat d1/d4c/fa5 0 2024-09-12T22:33:17.690 INFO:tasks.workunit.client.0.smithi019.stdout:5/936: dread d0/d7/d2d/d32/d36/d8c/db8/d39/d38/d4b/feb [0,4194304] 0 2024-09-12T22:33:17.691 INFO:tasks.workunit.client.0.smithi019.stdout:0/921: dread d1/d14/f36 [0,4194304] 0 2024-09-12T22:33:17.691 INFO:tasks.workunit.client.0.smithi019.stdout:9/859: creat dd/d10/d17/d23/d2e/d31/d7e/dbc/d106/f113 x:0 0 0 2024-09-12T22:33:17.692 INFO:tasks.workunit.client.0.smithi019.stdout:5/937: creat d0/f142 x:0 0 0 2024-09-12T22:33:17.692 INFO:tasks.workunit.client.0.smithi019.stdout:4/924: chown d1/d22/d31/de3/c114 1216787 1 2024-09-12T22:33:17.692 INFO:tasks.workunit.client.0.smithi019.stdout:2/925: mkdir d0/d5/d60/d74/d7e/d139 0 2024-09-12T22:33:17.693 INFO:tasks.workunit.client.0.smithi019.stdout:9/860: fsync dd/d10/d17/d22/d6c/d53/de3/f111 0 2024-09-12T22:33:17.693 INFO:tasks.workunit.client.0.smithi019.stdout:3/856: dread - dd/d12/d62/d78/dde/fe8 zero size 2024-09-12T22:33:17.693 INFO:tasks.workunit.client.0.smithi019.stdout:8/910: rmdir d7/d34/d78/d53/d108/d109 0 2024-09-12T22:33:17.694 INFO:tasks.workunit.client.0.smithi019.stdout:0/922: write d1/f1a [824814,89519] 0 2024-09-12T22:33:17.694 INFO:tasks.workunit.client.0.smithi019.stdout:5/938: write d0/d7/d2d/d32/d36/d8c/d8f/f9f [1690656,66472] 0 2024-09-12T22:33:17.695 INFO:tasks.workunit.client.0.smithi019.stdout:8/911: rmdir d7/d34/d78 39 2024-09-12T22:33:17.695 INFO:tasks.workunit.client.0.smithi019.stdout:9/861: mkdir dd/dcb/df8/d114 0 2024-09-12T22:33:17.696 INFO:tasks.workunit.client.0.smithi019.stdout:3/857: symlink dd/d1e/d40/l109 0 2024-09-12T22:33:17.697 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:33:17.698 INFO:tasks.workunit.client.0.smithi019.stdout:3/858: write dd/f17 [2422389,105875] 0 2024-09-12T22:33:17.698 INFO:tasks.workunit.client.0.smithi019.stdout:5/939: creat d0/db9/d120/d135/f143 x:0 0 0 2024-09-12T22:33:17.698 INFO:tasks.workunit.client.0.smithi019.stdout:0/923: mknod d1/d14/d26/d40/d91/d126/c12e 0 2024-09-12T22:33:17.700 INFO:tasks.workunit.client.0.smithi019.stdout:1/998: dwrite d3/df/d7e/d96/f98 [0,4194304] 0 2024-09-12T22:33:17.702 INFO:tasks.workunit.client.0.smithi019.stdout:8/912: getdents d7/d34/d78/d82 0 2024-09-12T22:33:17.702 INFO:tasks.workunit.client.0.smithi019.stdout:5/940: symlink d0/d7/d90/l144 0 2024-09-12T22:33:17.702 INFO:tasks.workunit.client.0.smithi019.stdout:9/862: rmdir dd/d10/d17/d23/d2e/d31/d7e/dbc/ddd/de2 0 2024-09-12T22:33:17.702 INFO:tasks.workunit.client.0.smithi019.stdout:4/925: dwrite d1/d8/dfb/dfc/f10a [0,4194304] 0 2024-09-12T22:33:17.704 INFO:tasks.workunit.client.0.smithi019.stdout:1/999: mknod d3/df/c14b 0 2024-09-12T22:33:17.704 INFO:tasks.workunit.client.0.smithi019.stdout:5/941: rmdir d0/d7/d2d/d32/d4a 39 2024-09-12T22:33:17.705 INFO:tasks.workunit.client.0.smithi019.stdout:8/913: symlink d7/d2f/ddb/l116 0 2024-09-12T22:33:17.705 INFO:tasks.workunit.client.0.smithi019.stdout:2/926: dwrite d0/d5/d60/d71/fd9 [0,4194304] 0 2024-09-12T22:33:17.706 INFO:tasks.workunit.client.0.smithi019.stdout:2/927: mknod d0/d5/d17/d91/d9c/df2/c13a 0 2024-09-12T22:33:17.709 INFO:tasks.workunit.client.0.smithi019.stdout:2/928: mknod d0/d5/d60/d71/c13b 0 2024-09-12T22:33:17.712 INFO:tasks.workunit.client.0.smithi019.stdout:8/914: dwrite d7/d2f/d75/fd0 [0,4194304] 0 2024-09-12T22:33:17.712 INFO:tasks.workunit.client.0.smithi019.stdout:3/859: dwrite dd/d12/d62/d74/daa/fb7 [0,4194304] 0 2024-09-12T22:33:17.712 INFO:tasks.workunit.client.0.smithi019.stdout:0/924: dread d1/d1f/d5b/d83/dab/dbe/d71/d85/f99 [0,4194304] 0 2024-09-12T22:33:17.713 INFO:tasks.workunit.client.0.smithi019.stdout:0/925: sync 2024-09-12T22:33:17.713 INFO:tasks.workunit.client.0.smithi019.stdout:3/860: mkdir dd/d12/d62/d10a 0 2024-09-12T22:33:17.714 INFO:tasks.workunit.client.0.smithi019.stdout:8/915: truncate d7/d2f/f6d 1476469 0 2024-09-12T22:33:17.715 INFO:tasks.workunit.client.0.smithi019.stdout:3/861: creat dd/d1e/d5a/f10b x:0 0 0 2024-09-12T22:33:17.715 INFO:tasks.workunit.client.0.smithi019.stdout:0/926: creat d1/d14/d26/d40/d45/d5e/f12f x:0 0 0 2024-09-12T22:33:17.715 INFO:tasks.workunit.client.0.smithi019.stdout:8/916: write d7/d2f/f6d [789409,73039] 0 2024-09-12T22:33:17.716 INFO:tasks.workunit.client.0.smithi019.stdout:0/927: readlink d1/d14/l60 0 2024-09-12T22:33:17.716 INFO:tasks.workunit.client.0.smithi019.stdout:3/862: write dd/d12/f48 [331517,70475] 0 2024-09-12T22:33:17.717 INFO:tasks.workunit.client.0.smithi019.stdout:2/929: dwrite d0/d5/d17/fc6 [4194304,4194304] 0 2024-09-12T22:33:17.717 INFO:tasks.workunit.client.0.smithi019.stdout:8/917: write d7/f29 [3615321,106158] 0 2024-09-12T22:33:17.717 INFO:tasks.workunit.client.0.smithi019.stdout:0/928: rmdir d1/d14 39 2024-09-12T22:33:17.719 INFO:tasks.workunit.client.0.smithi019.stdout:8/918: write d7/d34/d106/f10f [1012740,80634] 0 2024-09-12T22:33:17.719 INFO:tasks.workunit.client.0.smithi019.stdout:7/802: dread d6/d14/d15/d62/f91 [0,4194304] 0 2024-09-12T22:33:17.719 INFO:tasks.workunit.client.0.smithi019.stdout:0/929: write d1/d14/d1b/d3a/d8c/dae/fb5 [3518979,112922] 0 2024-09-12T22:33:17.720 INFO:tasks.workunit.client.0.smithi019.stdout:7/803: readlink d6/d14/d15/l25 0 2024-09-12T22:33:17.720 INFO:tasks.workunit.client.0.smithi019.stdout:8/919: rename d7/d34/d78/d2d to d7/d34/d78/d82/d117 0 2024-09-12T22:33:17.722 INFO:tasks.workunit.client.0.smithi019.stdout:8/920: mknod d7/d2f/ddb/c118 0 2024-09-12T22:33:17.723 INFO:tasks.workunit.client.0.smithi019.stdout:8/921: symlink d7/l119 0 2024-09-12T22:33:17.725 INFO:tasks.workunit.client.0.smithi019.stdout:8/922: mkdir d7/d8/dd/df7/d11a 0 2024-09-12T22:33:17.726 INFO:tasks.workunit.client.0.smithi019.stdout:0/930: dwrite d1/d1f/d5b/d83/de0/fe4 [0,4194304] 0 2024-09-12T22:33:17.726 INFO:tasks.workunit.client.0.smithi019.stdout:7/804: dwrite d6/d14/d15/d62/f10e [0,4194304] 0 2024-09-12T22:33:17.726 INFO:tasks.workunit.client.0.smithi019.stdout:4/926: dread d1/d4c/db0/d75/f59 [0,4194304] 0 2024-09-12T22:33:17.727 INFO:tasks.workunit.client.0.smithi019.stdout:0/931: chown d1/d14/f92 0 1 2024-09-12T22:33:17.727 INFO:tasks.workunit.client.0.smithi019.stdout:8/923: creat d7/d2f/d75/f11b x:0 0 0 2024-09-12T22:33:17.729 INFO:tasks.workunit.client.0.smithi019.stdout:7/805: creat d6/d14/df0/f128 x:0 0 0 2024-09-12T22:33:17.729 INFO:tasks.workunit.client.0.smithi019.stdout:8/924: fdatasync d7/f13 0 2024-09-12T22:33:17.730 INFO:tasks.workunit.client.0.smithi019.stdout:8/925: mkdir d7/d8/d11c 0 2024-09-12T22:33:17.730 INFO:tasks.workunit.client.0.smithi019.stdout:0/932: link d1/d14/d1b/d3a/c4a d1/d1f/d5b/d83/dab/dbe/d106/c130 0 2024-09-12T22:33:17.730 INFO:tasks.workunit.client.0.smithi019.stdout:8/926: creat d7/d8/d43/d87/f11d x:0 0 0 2024-09-12T22:33:17.732 INFO:tasks.workunit.client.0.smithi019.stdout:8/927: mknod d7/d5e/c11e 0 2024-09-12T22:33:17.733 INFO:tasks.workunit.client.0.smithi019.stdout:4/927: dwrite d1/d4/d38/f143 [0,4194304] 0 2024-09-12T22:33:17.734 INFO:tasks.workunit.client.0.smithi019.stdout:8/928: rename d7/d8/dd/lbc to d7/d8/dd/d45/dc5/l11f 0 2024-09-12T22:33:17.734 INFO:tasks.workunit.client.0.smithi019.stdout:4/928: truncate d1/d4/d38/dbf/fd1 1243044 0 2024-09-12T22:33:17.735 INFO:tasks.workunit.client.0.smithi019.stdout:8/929: write d7/d34/d78/d82/fa3 [766038,111233] 0 2024-09-12T22:33:17.736 INFO:tasks.workunit.client.0.smithi019.stdout:8/930: symlink d7/d8/dd/l120 0 2024-09-12T22:33:17.737 INFO:tasks.workunit.client.0.smithi019.stdout:8/931: getdents d7/d2f/d75/dc7 0 2024-09-12T22:33:17.739 INFO:tasks.workunit.client.0.smithi019.stdout:8/932: write d7/d2f/d75/ff5 [2163391,50765] 0 2024-09-12T22:33:17.740 INFO:tasks.workunit.client.0.smithi019.stdout:8/933: chown d7/d2f/d75/ff5 32341844 1 2024-09-12T22:33:17.741 INFO:tasks.workunit.client.0.smithi019.stdout:9/863: dread dd/d10/f39 [0,4194304] 0 2024-09-12T22:33:17.741 INFO:tasks.workunit.client.0.smithi019.stdout:4/929: dwrite d1/d22/d2c/d107/d11f/fe4 [0,4194304] 0 2024-09-12T22:33:17.742 INFO:tasks.workunit.client.0.smithi019.stdout:9/864: creat dd/deb/dfc/f115 x:0 0 0 2024-09-12T22:33:17.742 INFO:tasks.workunit.client.0.smithi019.stdout:4/930: mkdir d1/d22/d2c/d147 0 2024-09-12T22:33:17.743 INFO:tasks.workunit.client.0.smithi019.stdout:9/865: fsync dd/d10/d17/d23/d2e/d31/d3f/d47/d6e/d80/fc6 0 2024-09-12T22:33:17.743 INFO:tasks.workunit.client.0.smithi019.stdout:7/806: write d6/d14/d2a/da4/f1c [2059209,84197] 0 2024-09-12T22:33:17.744 INFO:tasks.workunit.client.0.smithi019.stdout:0/933: truncate d1/d14/d1b/d3a/fa8 1700163 0 2024-09-12T22:33:17.745 INFO:tasks.workunit.client.0.smithi019.stdout:7/807: creat d6/d2d/d41/f129 x:0 0 0 2024-09-12T22:33:17.746 INFO:tasks.workunit.client.0.smithi019.stdout:0/934: write d1/d14/d26/d40/d45/d5e/da2/fd0 [1062606,68218] 0 2024-09-12T22:33:17.747 INFO:tasks.workunit.client.0.smithi019.stdout:7/808: truncate d6/d14/d45/fe5 1147440 0 2024-09-12T22:33:17.749 INFO:tasks.workunit.client.0.smithi019.stdout:4/931: dwrite d1/d4c/db0/d75/d5a/d79/db4/f100 [0,4194304] 0 2024-09-12T22:33:17.750 INFO:tasks.workunit.client.0.smithi019.stdout:0/935: getdents d1/d1f/d5b/d83/dab/dbe/d71/d75 0 2024-09-12T22:33:17.751 INFO:tasks.workunit.client.0.smithi019.stdout:9/866: dwrite dd/d10/d17/d22/d6c/d53/d69/d9d/dbd/fe4 [0,4194304] 0 2024-09-12T22:33:17.753 INFO:tasks.workunit.client.0.smithi019.stdout:9/867: chown dd/d10/d17/d23/d2e/d31/d3f/d47/l60 49 1 2024-09-12T22:33:17.754 INFO:tasks.workunit.client.0.smithi019.stdout:0/936: write d1/d14/d26/d40/f52 [1226759,110832] 0 2024-09-12T22:33:17.754 INFO:tasks.workunit.client.0.smithi019.stdout:9/868: link dd/d10/d17/d22/fd2 dd/d10/d17/d23/ddb/f116 0 2024-09-12T22:33:17.756 INFO:tasks.workunit.client.0.smithi019.stdout:9/869: creat dd/d10/d17/d22/d6c/d53/f117 x:0 0 0 2024-09-12T22:33:17.756 INFO:tasks.workunit.client.0.smithi019.stdout:9/870: stat dd/d10/d17/d22/d6c/d53/f117 0 2024-09-12T22:33:17.758 INFO:tasks.workunit.client.0.smithi019.stdout:9/871: write dd/d10/d17/d22/d6c/d53/d69/fc9 [4661531,101042] 0 2024-09-12T22:33:17.759 INFO:tasks.workunit.client.0.smithi019.stdout:9/872: symlink dd/d10/d17/d22/d6c/l118 0 2024-09-12T22:33:17.760 INFO:tasks.workunit.client.0.smithi019.stdout:9/873: getdents dd/d10/d17/d23/d2e/d31/d54 0 2024-09-12T22:33:17.766 INFO:tasks.workunit.client.0.smithi019.stdout:9/874: read dd/d10/d17/d22/ffa [1892843,117448] 0 2024-09-12T22:33:17.767 INFO:tasks.workunit.client.0.smithi019.stdout:9/875: dread - dd/d10/d17/d22/d6c/d53/f117 zero size 2024-09-12T22:33:17.767 INFO:tasks.workunit.client.0.smithi019.stdout:3/863: dread dd/d1e/fd5 [0,4194304] 0 2024-09-12T22:33:17.768 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:17.766+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:17.769 INFO:tasks.workunit.client.0.smithi019.stdout:9/876: chown dd/d10/d17/d23/d2e/d31/d3f/d47/l51 22653 1 2024-09-12T22:33:17.769 INFO:tasks.workunit.client.0.smithi019.stdout:7/809: dread d6/d14/d15/d62/d6a/fc2 [0,4194304] 0 2024-09-12T22:33:17.770 INFO:tasks.workunit.client.0.smithi019.stdout:7/810: mkdir d6/d2d/d12a 0 2024-09-12T22:33:17.770 INFO:tasks.workunit.client.0.smithi019.stdout:9/877: mkdir dd/d10/d17/d22/d6c/d53/d119 0 2024-09-12T22:33:17.770 INFO:tasks.workunit.client.0.smithi019.stdout:9/878: dread - dd/deb/dfc/f115 zero size 2024-09-12T22:33:17.771 INFO:tasks.workunit.client.0.smithi019.stdout:5/942: dread d0/d7/d2d/d32/d36/d8c/db8/d39/d38/dba/f5b [0,4194304] 0 2024-09-12T22:33:17.771 INFO:tasks.workunit.client.0.smithi019.stdout:7/811: creat d6/d14/d15/d62/f12b x:0 0 0 2024-09-12T22:33:17.772 INFO:tasks.workunit.client.0.smithi019.stdout:7/812: write d6/d14/d15/d62/d6a/f75 [304860,107757] 0 2024-09-12T22:33:17.773 INFO:tasks.workunit.client.0.smithi019.stdout:5/943: creat d0/d7/d2d/d32/d36/d8c/db8/d39/d38/d4b/dde/dec/f145 x:0 0 0 2024-09-12T22:33:17.777 INFO:tasks.workunit.client.0.smithi019.stdout:9/879: truncate dd/d10/d17/d23/d2e/d31/f46 418122 0 2024-09-12T22:33:17.777 INFO:tasks.workunit.client.0.smithi019.stdout:5/944: write d0/d7/d2d/d32/d36/d8c/db8/fab [172681,35843] 0 2024-09-12T22:33:17.779 INFO:tasks.workunit.client.0.smithi019.stdout:7/813: dread d6/d14/d2a/da4/d42/f7d [0,4194304] 0 2024-09-12T22:33:17.779 INFO:tasks.workunit.client.0.smithi019.stdout:8/934: dread d7/d34/d78/d54/f71 [0,4194304] 0 2024-09-12T22:33:17.779 INFO:tasks.workunit.client.0.smithi019.stdout:9/880: mknod dd/dcb/c11a 0 2024-09-12T22:33:17.779 INFO:tasks.workunit.client.0.smithi019.stdout:3/864: dwrite dd/d1e/d40/da6/dba/ff4 [0,4194304] 0 2024-09-12T22:33:17.780 INFO:tasks.workunit.client.0.smithi019.stdout:2/930: dread d0/d5/d18/d5c/f6f [0,4194304] 0 2024-09-12T22:33:17.780 INFO:tasks.workunit.client.0.smithi019.stdout:8/935: dread - d7/d34/f7c zero size 2024-09-12T22:33:17.781 INFO:tasks.workunit.client.0.smithi019.stdout:8/936: readlink d7/d8/l24 0 2024-09-12T22:33:17.782 INFO:tasks.workunit.client.0.smithi019.stdout:7/814: creat d6/d14/d2a/da4/dc/f12c x:0 0 0 2024-09-12T22:33:17.783 INFO:tasks.workunit.client.0.smithi019.stdout:8/937: dread - d7/d2f/d42/d98/f102 zero size 2024-09-12T22:33:17.784 INFO:tasks.workunit.client.0.smithi019.stdout:4/932: dread d1/d8/d7b/fda [0,4194304] 0 2024-09-12T22:33:17.785 INFO:tasks.workunit.client.0.smithi019.stdout:4/933: rmdir d1/d11/d15/d81 39 2024-09-12T22:33:17.786 INFO:tasks.workunit.client.0.smithi019.stdout:8/938: creat d7/d8/dd/df7/d11a/f121 x:0 0 0 2024-09-12T22:33:17.786 INFO:tasks.workunit.client.0.smithi019.stdout:7/815: truncate d6/d14/d15/d62/f87 4045655 0 2024-09-12T22:33:17.787 INFO:tasks.workunit.client.0.smithi019.stdout:9/881: dwrite dd/d10/d17/d22/d6c/d53/d69/d9d/dbd/fe4 [0,4194304] 0 2024-09-12T22:33:17.787 INFO:tasks.workunit.client.0.smithi019.stdout:0/937: dread d1/d14/d1b/f4b [0,4194304] 0 2024-09-12T22:33:17.787 INFO:tasks.workunit.client.0.smithi019.stdout:2/931: dread d0/d5/d17/d91/d9c/df2/f126 [0,4194304] 0 2024-09-12T22:33:17.788 INFO:tasks.workunit.client.0.smithi019.stdout:9/882: mknod dd/dc2/c11b 0 2024-09-12T22:33:17.788 INFO:tasks.workunit.client.0.smithi019.stdout:0/938: unlink d1/d14/f1e 0 2024-09-12T22:33:17.789 INFO:tasks.workunit.client.0.smithi019.stdout:9/883: chown dd/fe7 7487562 1 2024-09-12T22:33:17.793 INFO:tasks.workunit.client.0.smithi019.stdout:2/932: getdents d0/d5/d18/d1b/d8d/dac/d10f 0 2024-09-12T22:33:17.793 INFO:tasks.workunit.client.0.smithi019.stdout:9/884: write dd/d10/d17/d23/d2e/d31/d54/d8b/ddf/ff2 [589047,55665] 0 2024-09-12T22:33:17.793 INFO:tasks.workunit.client.0.smithi019.stdout:9/885: chown dd/d10/d17/d22/d6c/d53/d73 0 1 2024-09-12T22:33:17.793 INFO:tasks.workunit.client.0.smithi019.stdout:2/933: truncate d0/d5/d18/d5c/d67/d77/fc4 4723972 0 2024-09-12T22:33:17.793 INFO:tasks.workunit.client.0.smithi019.stdout:9/886: creat dd/d10/d17/d23/ddb/f11c x:0 0 0 2024-09-12T22:33:17.793 INFO:tasks.workunit.client.0.smithi019.stdout:9/887: truncate dd/d10/d17/d76/dcc/fd7 205329 0 2024-09-12T22:33:17.793 INFO:tasks.workunit.client.0.smithi019.stdout:0/939: dread d1/fa9 [0,4194304] 0 2024-09-12T22:33:17.794 INFO:tasks.workunit.client.0.smithi019.stdout:9/888: write dd/d10/d17/d22/d42/fe5 [192019,95930] 0 2024-09-12T22:33:17.794 INFO:tasks.workunit.client.0.smithi019.stdout:0/940: creat d1/d14/d1b/d3a/df4/f131 x:0 0 0 2024-09-12T22:33:17.795 INFO:tasks.workunit.client.0.smithi019.stdout:4/934: dread d1/d11/d15/f2e [0,4194304] 0 2024-09-12T22:33:17.795 INFO:tasks.workunit.client.0.smithi019.stdout:9/889: truncate dd/d10/d17/d23/d2e/d31/d3f/d67/fef 385075 0 2024-09-12T22:33:17.796 INFO:tasks.workunit.client.0.smithi019.stdout:0/941: truncate d1/d14/d26/d40/d45/f124 1046446 0 2024-09-12T22:33:17.797 INFO:tasks.workunit.client.0.smithi019.stdout:4/935: link d1/d11/d15/d1f/c12e d1/d11/d15/d1f/d56/da9/dce/c148 0 2024-09-12T22:33:17.797 INFO:tasks.workunit.client.0.smithi019.stdout:9/890: rename dd/d10/d17/d22/d6c/d53/d69/c7b to dd/d10/d17/d23/d2e/d31/d3f/d47/d6e/c11d 0 2024-09-12T22:33:17.799 INFO:tasks.workunit.client.0.smithi019.stdout:9/891: fsync dd/d10/d17/d23/d2e/d31/f46 0 2024-09-12T22:33:17.800 INFO:tasks.workunit.client.0.smithi019.stdout:9/892: getdents dd/d10 0 2024-09-12T22:33:17.802 INFO:tasks.workunit.client.0.smithi019.stdout:4/936: dwrite d1/d11/f86 [0,4194304] 0 2024-09-12T22:33:17.802 INFO:tasks.workunit.client.0.smithi019.stdout:9/893: write dd/d10/d17/d23/d2e/d31/d3f/d67/fac [3433150,96183] 0 2024-09-12T22:33:17.803 INFO:tasks.workunit.client.0.smithi019.stdout:4/937: rmdir d1/d22 39 2024-09-12T22:33:17.804 INFO:tasks.workunit.client.0.smithi019.stdout:9/894: mkdir dd/d10/d17/d23/d82/d87/d11e 0 2024-09-12T22:33:17.804 INFO:tasks.workunit.client.0.smithi019.stdout:4/938: write d1/d11/d15/d1f/f52 [1886000,81871] 0 2024-09-12T22:33:17.804 INFO:tasks.workunit.client.0.smithi019.stdout:2/934: dread d0/d5/d18/d1b/d8d/fda [0,4194304] 0 2024-09-12T22:33:17.805 INFO:tasks.workunit.client.0.smithi019.stdout:4/939: symlink d1/d11/d15/d1f/da8/l149 0 2024-09-12T22:33:17.806 INFO:tasks.workunit.client.0.smithi019.stdout:3/865: dread dd/f31 [0,4194304] 0 2024-09-12T22:33:17.806 INFO:tasks.workunit.client.0.smithi019.stdout:5/945: dread d0/d7/d16/f12d [0,4194304] 0 2024-09-12T22:33:17.806 INFO:tasks.workunit.client.0.smithi019.stdout:4/940: dread - d1/d22/d57/df2/f129 zero size 2024-09-12T22:33:17.807 INFO:tasks.workunit.client.0.smithi019.stdout:3/866: dread - dd/d1e/d40/d6e/d70/ff9 zero size 2024-09-12T22:33:17.808 INFO:tasks.workunit.client.0.smithi019.stdout:2/935: symlink d0/d5/d18/d1b/d8d/dac/d124/l13c 0 2024-09-12T22:33:17.808 INFO:tasks.workunit.client.0.smithi019.stdout:9/895: dread dd/d10/d17/d22/fd2 [0,4194304] 0 2024-09-12T22:33:17.809 INFO:tasks.workunit.client.0.smithi019.stdout:3/867: mkdir dd/d1e/d40/d5f/d10c 0 2024-09-12T22:33:17.809 INFO:tasks.workunit.client.0.smithi019.stdout:4/941: rename d1/d11/d15/c63 to d1/d8/dd0/c14a 0 2024-09-12T22:33:17.809 INFO:tasks.workunit.client.0.smithi019.stdout:9/896: chown c8 534555069 1 2024-09-12T22:33:17.809 INFO:tasks.workunit.client.0.smithi019.stdout:2/936: chown d0/d5/d18/d5c/d67/d77/fc4 443 1 2024-09-12T22:33:17.809 INFO:tasks.workunit.client.0.smithi019.stdout:3/868: chown dd/d12/fc1 3653 1 2024-09-12T22:33:17.810 INFO:tasks.workunit.client.0.smithi019.stdout:4/942: chown d1/d11/d15/d1f/d56/f11c 5023393 1 2024-09-12T22:33:17.810 INFO:tasks.workunit.client.0.smithi019.stdout:9/897: read dd/d10/f14 [1682469,76223] 0 2024-09-12T22:33:17.811 INFO:tasks.workunit.client.0.smithi019.stdout:5/946: rename d0/d7/d2d/d32/d36/d8c/db8/d39/d38/dba/dc7 to d0/d7/d2d/d32/d36/d8c/db8/d39/d38/d4b/dde/d114/d119/d146 0 2024-09-12T22:33:17.811 INFO:tasks.workunit.client.0.smithi019.stdout:3/869: chown dd/d12/d62/d74/daa/ffa 2 1 2024-09-12T22:33:17.811 INFO:tasks.workunit.client.0.smithi019.stdout:2/937: mkdir d0/d5/d18/d1b/d5d/d86/d90/d12d/d13d 0 2024-09-12T22:33:17.811 INFO:tasks.workunit.client.0.smithi019.stdout:5/947: write d0/d7/d16/fe7 [352334,37552] 0 2024-09-12T22:33:17.812 INFO:tasks.workunit.client.0.smithi019.stdout:9/898: rmdir dd/d10/d17/d23/d2e/d31/d7e/dbc/ddd/dde 39 2024-09-12T22:33:17.812 INFO:tasks.workunit.client.0.smithi019.stdout:3/870: link dd/f11 dd/d12/f10d 0 2024-09-12T22:33:17.813 INFO:tasks.workunit.client.0.smithi019.stdout:9/899: write dd/d10/d17/d23/d2e/d31/d3f/d67/fd4 [914567,30538] 0 2024-09-12T22:33:17.814 INFO:tasks.workunit.client.0.smithi019.stdout:5/948: getdents d0/d7/d2d/d32/d36/d8c/d8f 0 2024-09-12T22:33:17.815 INFO:tasks.workunit.client.0.smithi019.stdout:5/949: symlink d0/d7/d2d/d32/dcd/l147 0 2024-09-12T22:33:17.815 INFO:tasks.workunit.client.0.smithi019.stdout:7/816: dread d6/d14/d2a/da4/dc/f43 [0,4194304] 0 2024-09-12T22:33:17.816 INFO:tasks.workunit.client.0.smithi019.stdout:9/900: chown dd/d10/d17/d23/d2e/d31/d3f/d47/d6e/daf/c109 1960 1 2024-09-12T22:33:17.816 INFO:tasks.workunit.client.0.smithi019.stdout:2/938: write d0/d5/f10 [3602364,102570] 0 2024-09-12T22:33:17.816 INFO:tasks.workunit.client.0.smithi019.stdout:8/939: sync 2024-09-12T22:33:17.817 INFO:tasks.workunit.client.0.smithi019.stdout:0/942: sync 2024-09-12T22:33:17.817 INFO:tasks.workunit.client.0.smithi019.stdout:7/817: mkdir d6/d2d/d12d 0 2024-09-12T22:33:17.817 INFO:tasks.workunit.client.0.smithi019.stdout:5/950: mknod d0/d7/d2d/d32/d36/d8c/db8/d39/d38/d4b/dde/c148 0 2024-09-12T22:33:17.817 INFO:tasks.workunit.client.0.smithi019.stdout:9/901: dread - dd/d10/d17/d76/dca/f107 zero size 2024-09-12T22:33:17.819 INFO:tasks.workunit.client.0.smithi019.stdout:3/871: dwrite dd/d12/d62/fce [0,4194304] 0 2024-09-12T22:33:17.819 INFO:tasks.workunit.client.0.smithi019.stdout:9/902: unlink dd/d10/d17/d22/fa3 0 2024-09-12T22:33:17.819 INFO:tasks.workunit.client.0.smithi019.stdout:2/939: mkdir d0/d5/d60/d74/d7e/d112/d73/d104/d132/d13e 0 2024-09-12T22:33:17.820 INFO:tasks.workunit.client.0.smithi019.stdout:3/872: chown dd/d1e/c50 89542077 1 2024-09-12T22:33:17.821 INFO:tasks.workunit.client.0.smithi019.stdout:5/951: mknod d0/d7/d2d/d32/d36/d8c/db8/d39/d38/d4b/dde/da0/d12b/dfb/c149 0 2024-09-12T22:33:17.822 INFO:tasks.workunit.client.0.smithi019.stdout:2/940: mknod d0/d5/d60/d74/d7e/d139/c13f 0 2024-09-12T22:33:17.822 INFO:tasks.workunit.client.0.smithi019.stdout:3/873: rename dd/d12/d62/d74/daa/ff5 to dd/d1e/d40/d6e/f10e 0 2024-09-12T22:33:17.823 INFO:tasks.workunit.client.0.smithi019.stdout:3/874: dread - dd/f107 zero size 2024-09-12T22:33:17.823 INFO:tasks.workunit.client.0.smithi019.stdout:5/952: rename d0/d7/d16/f91 to d0/d7/d2d/d4c/f14a 0 2024-09-12T22:33:17.823 INFO:tasks.workunit.client.0.smithi019.stdout:2/941: chown d0/d5/d18/d5c/d63/d6a 115320322 1 2024-09-12T22:33:17.824 INFO:tasks.workunit.client.0.smithi019.stdout:3/875: creat dd/d12/d62/d6a/f10f x:0 0 0 2024-09-12T22:33:17.824 INFO:tasks.workunit.client.0.smithi019.stdout:2/942: dread - d0/d5/d17/d91/d9c/ffb zero size 2024-09-12T22:33:17.824 INFO:tasks.workunit.client.0.smithi019.stdout:9/903: dread dd/d10/d17/d76/dcc/fd7 [0,4194304] 0 2024-09-12T22:33:17.825 INFO:tasks.workunit.client.0.smithi019.stdout:8/940: dwrite d7/d8/dd/d4f/f4b [0,4194304] 0 2024-09-12T22:33:17.825 INFO:tasks.workunit.client.0.smithi019.stdout:9/904: dread - dd/d10/d17/d23/ddb/f11c zero size 2024-09-12T22:33:17.826 INFO:tasks.workunit.client.0.smithi019.stdout:3/876: creat dd/d12/d62/d78/dde/f110 x:0 0 0 2024-09-12T22:33:17.826 INFO:tasks.workunit.client.0.smithi019.stdout:8/941: readlink d7/lb4 0 2024-09-12T22:33:17.826 INFO:tasks.workunit.client.0.smithi019.stdout:4/943: dread d1/d4c/fb6 [0,4194304] 0 2024-09-12T22:33:17.826 INFO:tasks.workunit.client.0.smithi019.stdout:3/877: chown dd/f2a 9 1 2024-09-12T22:33:17.827 INFO:tasks.workunit.client.0.smithi019.stdout:4/944: write d1/d4c/db0/d75/f59 [3136011,20480] 0 2024-09-12T22:33:17.829 INFO:tasks.workunit.client.0.smithi019.stdout:9/905: write dd/d10/d17/d23/d2e/d31/d3f/d47/d6e/f8a [1488739,29659] 0 2024-09-12T22:33:17.829 INFO:tasks.workunit.client.0.smithi019.stdout:8/942: rename d7/d34/d78/d82/d117/fc3 to d7/d8/d43/d87/dc2/dce/d10d/f122 0 2024-09-12T22:33:17.829 INFO:tasks.workunit.client.0.smithi019.stdout:4/945: symlink d1/d11/d15/d1f/d56/dac/l14b 0 2024-09-12T22:33:17.830 INFO:tasks.workunit.client.0.smithi019.stdout:8/943: creat d7/d8/dd/df7/f123 x:0 0 0 2024-09-12T22:33:17.830 INFO:tasks.workunit.client.0.smithi019.stdout:9/906: chown dd/d10/d17/d22/d6c/d53/de3/f111 8191 1 2024-09-12T22:33:17.831 INFO:tasks.workunit.client.0.smithi019.stdout:8/944: unlink d7/d34/d78/d82/f103 0 2024-09-12T22:33:17.831 INFO:tasks.workunit.client.0.smithi019.stdout:2/943: dwrite d0/d5/d18/d5c/d85/fb1 [0,4194304] 0 2024-09-12T22:33:17.831 INFO:tasks.workunit.client.0.smithi019.stdout:8/945: readlink d7/d34/d78/l4e 0 2024-09-12T22:33:17.831 INFO:tasks.workunit.client.0.smithi019.stdout:4/946: link d1/d4/d44/l5c d1/d22/d57/l14c 0 2024-09-12T22:33:17.832 INFO:tasks.workunit.client.0.smithi019.stdout:2/944: chown d0/d5/d17/d91/d9c/df2/f126 371118770 1 2024-09-12T22:33:17.832 INFO:tasks.workunit.client.0.smithi019.stdout:4/947: rmdir d1/d4 39 2024-09-12T22:33:17.832 INFO:tasks.workunit.client.0.smithi019.stdout:5/953: dread d0/d7/d2d/d4c/f14a [0,4194304] 0 2024-09-12T22:33:17.832 INFO:tasks.workunit.client.0.smithi019.stdout:8/946: symlink d7/d2f/d42/l124 0 2024-09-12T22:33:17.833 INFO:tasks.workunit.client.0.smithi019.stdout:5/954: readlink d0/d7/d16/lce 0 2024-09-12T22:33:17.833 INFO:tasks.workunit.client.0.smithi019.stdout:2/945: creat d0/d5/d60/d74/d7e/d112/d73/f140 x:0 0 0 2024-09-12T22:33:17.834 INFO:tasks.workunit.client.0.smithi019.stdout:4/948: fsync d1/d4/d38/dc4/dc2/fc9 0 2024-09-12T22:33:17.834 INFO:tasks.workunit.client.0.smithi019.stdout:2/946: stat d0/d5/d18/d5c/f78 0 2024-09-12T22:33:17.835 INFO:tasks.workunit.client.0.smithi019.stdout:5/955: fdatasync d0/d7/d2d/d32/d36/d8c/db8/d9a/f137 0 2024-09-12T22:33:17.835 INFO:tasks.workunit.client.0.smithi019.stdout:4/949: write d1/d11/d15/d49/fb1 [1336132,40833] 0 2024-09-12T22:33:17.835 INFO:tasks.workunit.client.0.smithi019.stdout:2/947: read d0/d5/d60/d71/fd9 [3290957,70082] 0 2024-09-12T22:33:17.836 INFO:tasks.workunit.client.0.smithi019.stdout:5/956: mknod d0/d7/d2d/d32/d36/d8c/c14b 0 2024-09-12T22:33:17.837 INFO:tasks.workunit.client.0.smithi019.stdout:4/950: getdents d1/d4c/db0/d75/d5a/d79/db4 0 2024-09-12T22:33:17.838 INFO:tasks.workunit.client.0.smithi019.stdout:5/957: mknod d0/d7/d2d/d32/d36/d8c/db8/d39/d38/d4b/dde/c14c 0 2024-09-12T22:33:17.839 INFO:tasks.workunit.client.0.smithi019.stdout:4/951: write d1/d22/d31/d4f/ff0 [4929986,119184] 0 2024-09-12T22:33:17.840 INFO:tasks.workunit.client.0.smithi019.stdout:4/952: stat d1/d11/f10b 0 2024-09-12T22:33:17.841 INFO:tasks.workunit.client.0.smithi019.stdout:2/948: dwrite d0/d5/d60/d71/faa [0,4194304] 0 2024-09-12T22:33:17.841 INFO:tasks.workunit.client.0.smithi019.stdout:4/953: symlink d1/d22/d31/d85/d142/l14d 0 2024-09-12T22:33:17.841 INFO:tasks.workunit.client.0.smithi019.stdout:5/958: mkdir d0/d7/d2d/d32/d36/d8c/db8/d39/d38/d4b/dde/d114/d119/d146/df3/d14d 0 2024-09-12T22:33:17.842 INFO:tasks.workunit.client.0.smithi019.stdout:5/959: creat d0/db9/f14e x:0 0 0 2024-09-12T22:33:17.844 INFO:tasks.workunit.client.0.smithi019.stdout:2/949: creat d0/d5/d18/d1b/d5d/d86/d90/d12d/d13d/f141 x:0 0 0 2024-09-12T22:33:17.844 INFO:tasks.workunit.client.0.smithi019.stdout:2/950: chown d0/d5/d60/fd8 5061865 1 2024-09-12T22:33:17.846 INFO:tasks.workunit.client.0.smithi019.stdout:5/960: creat d0/d7/d2d/d32/d4a/dbb/dd5/f14f x:0 0 0 2024-09-12T22:33:17.846 INFO:tasks.workunit.client.0.smithi019.stdout:2/951: fdatasync d0/d5/d18/d5c/d67/d77/f120 0 2024-09-12T22:33:17.850 INFO:tasks.workunit.client.0.smithi019.stdout:4/954: read d1/d22/d31/d4f/ff0 [3615732,14608] 0 2024-09-12T22:33:17.850 INFO:tasks.workunit.client.0.smithi019.stdout:7/818: dread d6/f21 [0,4194304] 0 2024-09-12T22:33:17.850 INFO:tasks.workunit.client.0.smithi019.stdout:4/955: creat d1/d4/dec/f14e x:0 0 0 2024-09-12T22:33:17.851 INFO:tasks.workunit.client.0.smithi019.stdout:5/961: dwrite d0/d7/d16/f12d [0,4194304] 0 2024-09-12T22:33:17.851 INFO:tasks.workunit.client.0.smithi019.stdout:4/956: chown d1/d8/dfb/f12b 50 1 2024-09-12T22:33:17.853 INFO:tasks.workunit.client.0.smithi019.stdout:4/957: write d1/d4/d38/dc4/dc2/fde [835389,33092] 0 2024-09-12T22:33:17.853 INFO:tasks.workunit.client.0.smithi019.stdout:5/962: mknod d0/d7/d2d/d4c/d87/da2/c150 0 2024-09-12T22:33:17.854 INFO:tasks.workunit.client.0.smithi019.stdout:8/947: dread d7/d34/d78/d82/d117/f83 [0,4194304] 0 2024-09-12T22:33:17.854 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T22:33:17.855 INFO:tasks.workunit.client.0.smithi019.stdout:4/958: rename d1/d22/d26/l135 to d1/d8/dd0/l14f 0 2024-09-12T22:33:17.855 INFO:tasks.workunit.client.0.smithi019.stdout:5/963: rename d0/d7/d2d/dc2/l10d to d0/d7/d2d/d32/d36/d8c/d8f/l151 0 2024-09-12T22:33:17.859 INFO:tasks.workunit.client.0.smithi019.stdout:9/907: sync 2024-09-12T22:33:17.859 INFO:tasks.workunit.client.0.smithi019.stdout:7/819: dwrite d6/dcf/fdc [0,4194304] 0 2024-09-12T22:33:17.859 INFO:tasks.workunit.client.0.smithi019.stdout:0/943: sync 2024-09-12T22:33:17.859 INFO:tasks.workunit.client.0.smithi019.stdout:4/959: creat d1/d4c/db0/d75/d5a/d79/d119/f150 x:0 0 0 2024-09-12T22:33:17.860 INFO:tasks.workunit.client.0.smithi019.stdout:5/964: truncate d0/db9/fe9 754674 0 2024-09-12T22:33:17.860 INFO:tasks.workunit.client.0.smithi019.stdout:7/820: creat d6/d14/d45/dca/f12e x:0 0 0 2024-09-12T22:33:17.860 INFO:tasks.workunit.client.0.smithi019.stdout:0/944: fsync d1/d1f/d5b/d83/dab/dbe/fe8 0 2024-09-12T22:33:17.860 INFO:tasks.workunit.client.0.smithi019.stdout:5/965: fdatasync d0/f1a 0 2024-09-12T22:33:17.861 INFO:tasks.workunit.client.0.smithi019.stdout:4/960: creat d1/d8/d7b/f151 x:0 0 0 2024-09-12T22:33:17.861 INFO:tasks.workunit.client.0.smithi019.stdout:3/878: dread dd/d1e/d82/f89 [0,4194304] 0 2024-09-12T22:33:17.862 INFO:tasks.workunit.client.0.smithi019.stdout:7/821: write d6/d2d/d41/f96 [1769747,112308] 0 2024-09-12T22:33:17.862 INFO:tasks.workunit.client.0.smithi019.stdout:9/908: mknod dd/d10/d17/d22/d6c/d53/d119/c11f 0 2024-09-12T22:33:17.863 INFO:tasks.workunit.client.0.smithi019.stdout:8/948: dwrite d7/d34/d78/d53/f5d [4194304,4194304] 0 2024-09-12T22:33:17.863 INFO:tasks.workunit.client.0.smithi019.stdout:9/909: stat dd/d10/d17/l62 0 2024-09-12T22:33:17.863 INFO:tasks.workunit.client.0.smithi019.stdout:5/966: getdents d0/d7/d16/d69 0 2024-09-12T22:33:17.864 INFO:tasks.workunit.client.0.smithi019.stdout:8/949: write d7/d34/fc9 [1152971,130772] 0 2024-09-12T22:33:17.866 INFO:tasks.workunit.client.0.smithi019.stdout:9/910: rmdir dd/d10/d17/d23/d2e/d31/d7e 39 2024-09-12T22:33:17.866 INFO:tasks.workunit.client.0.smithi019.stdout:5/967: rmdir d0/d7/d2d/d32/d36/d8c/db8/d39/d38/d4b/dde/d114 39 2024-09-12T22:33:17.866 INFO:tasks.workunit.client.0.smithi019.stdout:8/950: creat d7/d34/d78/d82/d117/f125 x:0 0 0 2024-09-12T22:33:17.867 INFO:tasks.workunit.client.0.smithi019.stdout:5/968: unlink d0/d7/f20 0 2024-09-12T22:33:17.868 INFO:tasks.workunit.client.0.smithi019.stdout:8/951: write d7/d8/dd/fa4 [710865,127560] 0 2024-09-12T22:33:17.868 INFO:tasks.workunit.client.0.smithi019.stdout:9/911: mknod dd/d10/d17/d23/ddb/c120 0 2024-09-12T22:33:17.869 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:17.867+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:17.869 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:33:17.869 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:33:17.870 INFO:tasks.workunit.client.0.smithi019.stdout:0/945: dwrite d1/d14/d1b/f2b [0,4194304] 0 2024-09-12T22:33:17.870 INFO:tasks.workunit.client.0.smithi019.stdout:9/912: creat dd/d10/d17/d23/d82/d87/d11e/f121 x:0 0 0 2024-09-12T22:33:17.870 INFO:tasks.workunit.client.0.smithi019.stdout:5/969: chown d0/d7/d2d/d32/d36/d8c/db8/d39/d38/d4b/dde/da0/d12b/f115 9 1 2024-09-12T22:33:17.872 INFO:tasks.workunit.client.0.smithi019.stdout:0/946: symlink d1/d14/d1b/d3a/d8c/da3/l132 0 2024-09-12T22:33:17.872 INFO:tasks.workunit.client.0.smithi019.stdout:9/913: rename dd/d10/d17/d22/fae to dd/d10/d17/d22/d42/f122 0 2024-09-12T22:33:17.873 INFO:tasks.workunit.client.0.smithi019.stdout:0/947: rmdir d1/d1f 39 2024-09-12T22:33:17.873 INFO:tasks.workunit.client.0.smithi019.stdout:5/970: write d0/d7/d2d/d32/d36/d8c/db8/d39/d38/f6e [1999423,64293] 0 2024-09-12T22:33:17.875 INFO:tasks.workunit.client.0.smithi019.stdout:9/914: readlink dd/d10/d17/d23/d2e/d31/d3f/d47/d6e/d80/lb4 0 2024-09-12T22:33:17.875 INFO:tasks.workunit.client.0.smithi019.stdout:5/971: creat d0/d7/d16/f152 x:0 0 0 2024-09-12T22:33:17.875 INFO:tasks.workunit.client.0.smithi019.stdout:0/948: chown d1/d1f/d5b/d83/dab/dbe/d106/c130 107194 1 2024-09-12T22:33:17.875 INFO:tasks.workunit.client.0.smithi019.stdout:8/952: dread d7/d2f/f6d [0,4194304] 0 2024-09-12T22:33:17.876 INFO:tasks.workunit.client.0.smithi019.stdout:0/949: stat d1/d14/d1b/d3a/d8c/l93 0 2024-09-12T22:33:17.876 INFO:tasks.workunit.client.0.smithi019.stdout:9/915: chown dd/d10/d17/d23/d2e/d31/d3f/d47/d6e/daf 39 1 2024-09-12T22:33:17.876 INFO:tasks.workunit.client.0.smithi019.stdout:0/950: mkdir d1/d1f/d133 0 2024-09-12T22:33:17.876 INFO:tasks.workunit.client.0.smithi019.stdout:5/972: rename d0/d7/d2d/d4c/l56 to d0/d7/d90/l153 0 2024-09-12T22:33:17.877 INFO:tasks.workunit.client.0.smithi019.stdout:0/951: fdatasync d1/fda 0 2024-09-12T22:33:17.878 INFO:tasks.workunit.client.0.smithi019.stdout:0/952: unlink d1/d14/d26/fd1 0 2024-09-12T22:33:17.878 INFO:tasks.workunit.client.0.smithi019.stdout:5/973: write d0/d7/d2d/d32/d36/d8c/db8/d39/d38/f95 [5936138,9022] 0 2024-09-12T22:33:17.879 INFO:tasks.workunit.client.0.smithi019.stdout:5/974: write d0/d7/d16/f12d [2787646,25050] 0 2024-09-12T22:33:17.879 INFO:tasks.workunit.client.0.smithi019.stdout:0/953: mknod d1/d14/d26/d40/d45/d5e/da2/c134 0 2024-09-12T22:33:17.880 INFO:tasks.workunit.client.0.smithi019.stdout:0/954: mkdir d1/d14/d1b/d94/d135 0 2024-09-12T22:33:17.881 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:33:17.881 INFO:tasks.workunit.client.0.smithi019.stdout:5/975: chown d0/d7/d2d/d32/d36/d8c/db8/d24/d64/f11b 834 1 2024-09-12T22:33:17.882 INFO:tasks.workunit.client.0.smithi019.stdout:7/822: sync 2024-09-12T22:33:17.882 INFO:tasks.workunit.client.0.smithi019.stdout:3/879: sync 2024-09-12T22:33:17.886 INFO:tasks.workunit.client.0.smithi019.stdout:7/823: read d6/d2d/de0/fea [47463,55648] 0 2024-09-12T22:33:17.886 INFO:tasks.workunit.client.0.smithi019.stdout:3/880: truncate dd/f26 3415032 0 2024-09-12T22:33:17.886 INFO:tasks.workunit.client.0.smithi019.stdout:2/952: dread d0/d5/d18/d5c/d63/d6a/fdb [0,4194304] 0 2024-09-12T22:33:17.890 INFO:tasks.workunit.client.0.smithi019.stdout:2/953: chown d0/d5/d18/d5c/d85/cb2 18041 1 2024-09-12T22:33:17.891 INFO:tasks.workunit.client.0.smithi019.stdout:9/916: dwrite dd/d10/d17/d76/dcc/fd7 [0,4194304] 0 2024-09-12T22:33:17.891 INFO:tasks.workunit.client.0.smithi019.stdout:7/824: chown d6/d14/d2a/da4/dc/f43 0 1 2024-09-12T22:33:17.892 INFO:tasks.workunit.client.0.smithi019.stdout:5/976: dwrite d0/d7/d2d/d32/d36/d8c/db8/d39/d38/f5c [4194304,4194304] 0 2024-09-12T22:33:17.892 INFO:tasks.workunit.client.0.smithi019.stdout:3/881: read dd/d12/f7a [7564719,72310] 0 2024-09-12T22:33:17.892 INFO:tasks.workunit.client.0.smithi019.stdout:8/953: dwrite d7/d8/f73 [0,4194304] 0 2024-09-12T22:33:17.892 INFO:tasks.workunit.client.0.smithi019.stdout:0/955: dwrite d1/d14/d26/d40/d45/d5e/f12f [0,4194304] 0 2024-09-12T22:33:17.894 INFO:tasks.workunit.client.0.smithi019.stdout:7/825: chown d6/d2d/d41/f56 13352519 1 2024-09-12T22:33:17.895 INFO:tasks.workunit.client.0.smithi019.stdout:2/954: symlink d0/d5/d18/d1b/d36/l142 0 2024-09-12T22:33:17.895 INFO:tasks.workunit.client.0.smithi019.stdout:4/961: dread d1/d4/f13 [0,4194304] 0 2024-09-12T22:33:17.896 INFO:tasks.workunit.client.0.smithi019.stdout:3/882: mkdir dd/d12/d62/d10a/d111 0 2024-09-12T22:33:17.896 INFO:tasks.workunit.client.0.smithi019.stdout:0/956: mknod d1/d1f/d5b/d83/dab/dbe/c136 0 2024-09-12T22:33:17.896 INFO:tasks.workunit.client.0.smithi019.stdout:5/977: creat d0/d7/d2d/d32/d36/d8c/db8/d39/f154 x:0 0 0 2024-09-12T22:33:17.897 INFO:tasks.workunit.client.0.smithi019.stdout:4/962: rmdir d1/d22/d26 39 2024-09-12T22:33:17.897 INFO:tasks.workunit.client.0.smithi019.stdout:7/826: write d6/d14/d2a/da4/d42/faa [1991648,19075] 0 2024-09-12T22:33:17.898 INFO:tasks.workunit.client.0.smithi019.stdout:3/883: creat dd/d12/dbe/f112 x:0 0 0 2024-09-12T22:33:17.899 INFO:tasks.workunit.client.0.smithi019.stdout:7/827: stat d6/dd2 0 2024-09-12T22:33:17.900 INFO:tasks.workunit.client.0.smithi019.stdout:0/957: mknod d1/d14/d26/c137 0 2024-09-12T22:33:17.900 INFO:tasks.workunit.client.0.smithi019.stdout:4/963: fsync d1/d8/fb 0 2024-09-12T22:33:17.901 INFO:tasks.workunit.client.0.smithi019.stdout:2/955: link d0/d5/d17/c8b d0/d5/d18/d5c/d63/c143 0 2024-09-12T22:33:17.901 INFO:tasks.workunit.client.0.smithi019.stdout:5/978: link d0/d7/d90/l153 d0/d7/d2d/d4c/d87/da2/l155 0 2024-09-12T22:33:17.903 INFO:tasks.workunit.client.0.smithi019.stdout:0/958: write d1/d14/d26/d40/d45/f9f [104965,25471] 0 2024-09-12T22:33:17.903 INFO:tasks.workunit.client.0.smithi019.stdout:9/917: dwrite dd/d10/d17/d22/ffa [8388608,4194304] 0 2024-09-12T22:33:17.904 INFO:tasks.workunit.client.0.smithi019.stdout:4/964: rename d1/d22/d31/d4f/ff0 to d1/d11/dff/f152 0 2024-09-12T22:33:17.908 INFO:tasks.workunit.client.0.smithi019.stdout:9/918: creat dd/d10/d17/d23/d2e/d31/d7e/dbc/f123 x:0 0 0 2024-09-12T22:33:17.908 INFO:tasks.workunit.client.0.smithi019.stdout:4/965: getdents d1/d11/d15/d49 0 2024-09-12T22:33:17.908 INFO:tasks.workunit.client.0.smithi019.stdout:5/979: write d0/d7/d2d/d32/d36/d8c/db8/d39/d38/d4b/dde/da0/d12b/dae/f103 [1886388,3932] 0 2024-09-12T22:33:17.908 INFO:tasks.workunit.client.0.smithi019.stdout:7/828: dwrite d6/d14/d45/d7c/f72 [0,4194304] 0 2024-09-12T22:33:17.909 INFO:tasks.workunit.client.0.smithi019.stdout:9/919: unlink dd/f20 0 2024-09-12T22:33:17.910 INFO:tasks.workunit.client.0.smithi019.stdout:4/966: chown d1/d8/dfb/c11e 47 1 2024-09-12T22:33:17.911 INFO:tasks.workunit.client.0.smithi019.stdout:8/954: dread d7/d8/d43/fb9 [0,4194304] 0 2024-09-12T22:33:17.911 INFO:tasks.workunit.client.0.smithi019.stdout:9/920: stat dd/d10/d17/d22/l2f 0 2024-09-12T22:33:17.911 INFO:tasks.workunit.client.0.smithi019.stdout:7/829: getdents d6/d2d/d8f/daf 0 2024-09-12T22:33:17.912 INFO:tasks.workunit.client.0.smithi019.stdout:0/959: dwrite d1/d1f/d5b/dbf/f107 [4194304,4194304] 0 2024-09-12T22:33:17.915 INFO:tasks.workunit.client.0.smithi019.stdout:9/921: symlink dd/d10/d17/d23/d10b/l124 0 2024-09-12T22:33:17.915 INFO:tasks.workunit.client.0.smithi019.stdout:7/830: truncate d6/d2d/d41/f129 559486 0 2024-09-12T22:33:17.916 INFO:tasks.workunit.client.0.smithi019.stdout:2/956: truncate d0/d5/d18/d39/f44 4162149 0 2024-09-12T22:33:17.917 INFO:tasks.workunit.client.0.smithi019.stdout:4/967: truncate d1/d4/d44/f74 3486057 0 2024-09-12T22:33:17.918 INFO:tasks.workunit.client.0.smithi019.stdout:7/831: symlink d6/d14/d45/d7c/l12f 0 2024-09-12T22:33:17.918 INFO:tasks.workunit.client.0.smithi019.stdout:9/922: fsync dd/d10/d17/d22/d6c/d53/d69/fad 0 2024-09-12T22:33:17.918 INFO:tasks.workunit.client.0.smithi019.stdout:0/960: chown d1/d1f/d5b/d83/dab/dbe/d71/d85/la1 1424 1 2024-09-12T22:33:17.919 INFO:tasks.workunit.client.0.smithi019.stdout:2/957: read - d0/d5/d18/d3b/df9/ffd zero size 2024-09-12T22:33:17.920 INFO:tasks.workunit.client.0.smithi019.stdout:8/955: dwrite d7/d34/d78/d53/daa/fc6 [0,4194304] 0 2024-09-12T22:33:17.920 INFO:tasks.workunit.client.0.smithi019.stdout:5/980: dwrite d0/d7/d2d/d32/d36/d8c/db8/d39/d38/d4b/dde/da0/d12b/f86 [0,4194304] 0 2024-09-12T22:33:17.921 INFO:tasks.workunit.client.0.smithi019.stdout:2/958: stat d0/f12e 0 2024-09-12T22:33:17.921 INFO:tasks.workunit.client.0.smithi019.stdout:7/832: creat d6/d2d/d77/dbf/dde/d124/f130 x:0 0 0 2024-09-12T22:33:17.921 INFO:tasks.workunit.client.0.smithi019.stdout:9/923: fsync dd/d10/d17/d23/d2e/d31/d3f/ff6 0 2024-09-12T22:33:17.921 INFO:tasks.workunit.client.0.smithi019.stdout:8/956: chown d7/d8/f73 2536772 1 2024-09-12T22:33:17.922 INFO:tasks.workunit.client.0.smithi019.stdout:4/968: truncate d1/d22/d2c/d107/d11f/fe4 4256877 0 2024-09-12T22:33:17.922 INFO:tasks.workunit.client.0.smithi019.stdout:2/959: chown d0/d5/d18/d1b/cbc 2934 1 2024-09-12T22:33:17.922 INFO:tasks.workunit.client.0.smithi019.stdout:7/833: write d6/d2d/de0/f11c [521047,94215] 0 2024-09-12T22:33:17.923 INFO:tasks.workunit.client.0.smithi019.stdout:8/957: write d7/d34/d78/d54/fb8 [229860,72260] 0 2024-09-12T22:33:17.923 INFO:tasks.workunit.client.0.smithi019.stdout:4/969: rmdir d1/d4/dec 39 2024-09-12T22:33:17.925 INFO:tasks.workunit.client.0.smithi019.stdout:9/924: creat dd/d10/d17/d23/d2e/d31/d3f/d47/d6e/f125 x:0 0 0 2024-09-12T22:33:17.925 INFO:tasks.workunit.client.0.smithi019.stdout:7/834: creat d6/d14/d15/d8b/d103/f131 x:0 0 0 2024-09-12T22:33:17.926 INFO:tasks.workunit.client.0.smithi019.stdout:8/958: symlink d7/d8/dd/def/l126 0 2024-09-12T22:33:17.926 INFO:tasks.workunit.client.0.smithi019.stdout:2/960: write d0/d5/d18/d1b/d5d/d86/d90/d12d/d13d/f141 [62629,47470] 0 2024-09-12T22:33:17.926 INFO:tasks.workunit.client.0.smithi019.stdout:4/970: unlink d1/d8/dfb/d10c/l13f 0 2024-09-12T22:33:17.927 INFO:tasks.workunit.client.0.smithi019.stdout:2/961: chown d0/c2e 1397389724 1 2024-09-12T22:33:17.927 INFO:tasks.workunit.client.0.smithi019.stdout:4/971: write d1/d22/d31/d85/fab [131104,55702] 0 2024-09-12T22:33:17.928 INFO:tasks.workunit.client.0.smithi019.stdout:9/925: getdents dd/d10/d17/d22/d6c/d53/d103 0 2024-09-12T22:33:17.928 INFO:tasks.workunit.client.0.smithi019.stdout:8/959: link d7/fc d7/d8/f127 0 2024-09-12T22:33:17.929 INFO:tasks.workunit.client.0.smithi019.stdout:5/981: write d0/d7/d2d/d32/d4a/f6f [246260,31629] 0 2024-09-12T22:33:17.929 INFO:tasks.workunit.client.0.smithi019.stdout:8/960: mkdir d7/d5e/d128 0 2024-09-12T22:33:17.930 INFO:tasks.workunit.client.0.smithi019.stdout:4/972: write d1/d11/d15/d1f/da8/fc6 [959858,119738] 0 2024-09-12T22:33:17.930 INFO:tasks.workunit.client.0.smithi019.stdout:2/962: rename d0/d5/d18/d1b/lae to d0/d5/d18/d39/l144 0 2024-09-12T22:33:17.932 INFO:tasks.workunit.client.0.smithi019.stdout:9/926: truncate dd/d10/d17/d22/d6c/d53/d69/fad 1157177 0 2024-09-12T22:33:17.932 INFO:tasks.workunit.client.0.smithi019.stdout:7/835: dwrite d6/d14/d15/f107 [0,4194304] 0 2024-09-12T22:33:17.932 INFO:tasks.workunit.client.0.smithi019.stdout:4/973: link d1/d8/f45 d1/d11/f153 0 2024-09-12T22:33:17.933 INFO:tasks.workunit.client.0.smithi019.stdout:5/982: creat d0/d7/d2d/d32/d36/d8c/db8/d39/d38/d4b/dd9/f156 x:0 0 0 2024-09-12T22:33:17.934 INFO:tasks.workunit.client.0.smithi019.stdout:7/836: unlink d6/d14/d2a/da4/f92 0 2024-09-12T22:33:17.934 INFO:tasks.workunit.client.0.smithi019.stdout:2/963: link d0/d5/c38 d0/d5/d60/d74/d7e/d112/d73/c145 0 2024-09-12T22:33:17.935 INFO:tasks.workunit.client.0.smithi019.stdout:5/983: getdents d0/db9 0 2024-09-12T22:33:17.936 INFO:tasks.workunit.client.0.smithi019.stdout:4/974: rename d1/d11/d15/d1f/d56/da9/dce/cd3 to d1/d22/d31/d126/c154 0 2024-09-12T22:33:17.937 INFO:tasks.workunit.client.0.smithi019.stdout:2/964: rmdir d0/d5/d18/d1b/d5d/d86/d10b/d11d 39 2024-09-12T22:33:17.939 INFO:tasks.workunit.client.0.smithi019.stdout:2/965: creat d0/d5/d60/d74/d7e/d112/d73/dcb/f146 x:0 0 0 2024-09-12T22:33:17.940 INFO:tasks.workunit.client.0.smithi019.stdout:9/927: dwrite dd/d10/d17/d23/d2e/d31/d7e/dbc/d106/f113 [0,4194304] 0 2024-09-12T22:33:17.940 INFO:tasks.workunit.client.0.smithi019.stdout:2/966: write d0/d5/d60/d74/d7e/db5/fde [516774,8931] 0 2024-09-12T22:33:17.941 INFO:tasks.workunit.client.0.smithi019.stdout:9/928: mkdir dd/d10/d126 0 2024-09-12T22:33:17.942 INFO:tasks.workunit.client.0.smithi019.stdout:2/967: dread - d0/d5/d60/d74/d7e/d112/d73/f140 zero size 2024-09-12T22:33:17.942 INFO:tasks.workunit.client.0.smithi019.stdout:0/961: dread d1/d1f/f41 [0,4194304] 0 2024-09-12T22:33:17.944 INFO:tasks.workunit.client.0.smithi019.stdout:0/962: read d1/d14/d26/d40/f9a [71917,51146] 0 2024-09-12T22:33:17.944 INFO:tasks.workunit.client.0.smithi019.stdout:8/961: truncate d7/d2f/d75/f9b 3037141 0 2024-09-12T22:33:17.946 INFO:tasks.workunit.client.0.smithi019.stdout:8/962: rename d7/f13 to d7/d8/d43/d87/dc2/dce/f129 0 2024-09-12T22:33:17.946 INFO:tasks.workunit.client.0.smithi019.stdout:2/968: truncate d0/d5/d18/d1b/f4d 3316591 0 2024-09-12T22:33:17.948 INFO:tasks.workunit.client.0.smithi019.stdout:8/963: creat d7/d8/dd/def/f12a x:0 0 0 2024-09-12T22:33:17.948 INFO:tasks.workunit.client.0.smithi019.stdout:3/884: dread dd/d12/f24 [0,4194304] 0 2024-09-12T22:33:17.949 INFO:tasks.workunit.client.0.smithi019.stdout:5/984: dwrite d0/d7/d2d/d32/d36/d8c/db8/d39/d38/d4b/dde/da0/d12b/dc3/f10a [0,4194304] 0 2024-09-12T22:33:17.949 INFO:tasks.workunit.client.0.smithi019.stdout:2/969: mkdir d0/d5/d18/d5c/d67/d147 0 2024-09-12T22:33:17.950 INFO:tasks.workunit.client.0.smithi019.stdout:3/885: chown dd/d12/le0 5 1 2024-09-12T22:33:17.950 INFO:tasks.workunit.client.0.smithi019.stdout:8/964: chown d7/d34/d78/l6c 7 1 2024-09-12T22:33:17.951 INFO:tasks.workunit.client.0.smithi019.stdout:3/886: mkdir dd/d12/d62/d78/dde/d113 0 2024-09-12T22:33:17.952 INFO:tasks.workunit.client.0.smithi019.stdout:5/985: rmdir d0/d7/d2d/d32/d36/d8c/db8/d39/d38/d4b/dde/da0/d12b/dc3 39 2024-09-12T22:33:17.952 INFO:tasks.workunit.client.0.smithi019.stdout:8/965: unlink d7/d2f/d75/f76 0 2024-09-12T22:33:17.953 INFO:tasks.workunit.client.0.smithi019.stdout:3/887: truncate dd/d1e/d5a/f7f 5151957 0 2024-09-12T22:33:17.955 INFO:tasks.workunit.client.0.smithi019.stdout:5/986: mknod d0/d7/d2d/d32/d36/d8c/db8/d9a/c157 0 2024-09-12T22:33:17.956 INFO:tasks.workunit.client.0.smithi019.stdout:2/970: dwrite d0/d5/f10 [4194304,4194304] 0 2024-09-12T22:33:17.956 INFO:tasks.workunit.client.0.smithi019.stdout:5/987: fdatasync d0/d7/d2d/d4c/f14a 0 2024-09-12T22:33:17.957 INFO:tasks.workunit.client.0.smithi019.stdout:2/971: rmdir d0/d5/d18/d3b/df9 39 2024-09-12T22:33:17.958 INFO:tasks.workunit.client.0.smithi019.stdout:5/988: chown d0/d7/d2d/d32/d36/d8c/db8/d24/lca 5627336 1 2024-09-12T22:33:17.958 INFO:tasks.workunit.client.0.smithi019.stdout:8/966: truncate d7/d34/d78/f20 5098227 0 2024-09-12T22:33:17.959 INFO:tasks.workunit.client.0.smithi019.stdout:5/989: creat d0/db9/f158 x:0 0 0 2024-09-12T22:33:17.960 INFO:tasks.workunit.client.0.smithi019.stdout:5/990: chown d0/lb 2 1 2024-09-12T22:33:17.961 INFO:tasks.workunit.client.0.smithi019.stdout:8/967: creat d7/d34/d78/d53/da8/f12b x:0 0 0 2024-09-12T22:33:17.962 INFO:tasks.workunit.client.0.smithi019.stdout:9/929: dwrite dd/d10/d17/d22/f3e [0,4194304] 0 2024-09-12T22:33:17.965 INFO:tasks.workunit.client.0.smithi019.stdout:7/837: dread d6/d14/d15/f6d [0,4194304] 0 2024-09-12T22:33:17.965 INFO:tasks.workunit.client.0.smithi019.stdout:3/888: dwrite dd/d1e/f23 [0,4194304] 0 2024-09-12T22:33:17.967 INFO:tasks.workunit.client.0.smithi019.stdout:7/838: mknod d6/d14/d15/d8b/c132 0 2024-09-12T22:33:17.967 INFO:tasks.workunit.client.0.smithi019.stdout:2/972: dwrite d0/d5/d18/d5c/d85/f98 [0,4194304] 0 2024-09-12T22:33:17.968 INFO:tasks.workunit.client.0.smithi019.stdout:8/968: dread d7/d8/d43/d87/fb6 [0,4194304] 0 2024-09-12T22:33:17.969 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:17.968+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:17.969 INFO:tasks.workunit.client.0.smithi019.stdout:7/839: symlink d6/d14/df0/l133 0 2024-09-12T22:33:17.969 INFO:tasks.workunit.client.0.smithi019.stdout:7/840: mknod d6/d2d/d77/dbf/dde/d105/c134 0 2024-09-12T22:33:17.970 INFO:tasks.workunit.client.0.smithi019.stdout:8/969: link d7/d34/d78/lac d7/d2f/d42/l12c 0 2024-09-12T22:33:17.970 INFO:tasks.workunit.client.0.smithi019.stdout:7/841: rmdir d6/d14/d45 39 2024-09-12T22:33:17.971 INFO:tasks.workunit.client.0.smithi019.stdout:7/842: read d6/d14/d2a/da4/dc/f43 [180280,107950] 0 2024-09-12T22:33:17.971 INFO:tasks.workunit.client.0.smithi019.stdout:9/930: dread dd/d10/d17/d23/d2e/d31/d3f/fb6 [0,4194304] 0 2024-09-12T22:33:17.972 INFO:tasks.workunit.client.0.smithi019.stdout:9/931: mknod dd/d10/d17/d22/d6c/c127 0 2024-09-12T22:33:17.972 INFO:tasks.workunit.client.0.smithi019.stdout:7/843: mknod d6/d2d/d3d/c135 0 2024-09-12T22:33:17.973 INFO:tasks.workunit.client.0.smithi019.stdout:9/932: creat dd/d10/d17/d23/d82/d87/d11e/f128 x:0 0 0 2024-09-12T22:33:17.974 INFO:tasks.workunit.client.0.smithi019.stdout:7/844: link d6/d2d/d41/l73 d6/d2d/d77/dbf/l136 0 2024-09-12T22:33:17.975 INFO:tasks.workunit.client.0.smithi019.stdout:7/845: link d6/d2d/d3d/d84/c8a d6/d14/c137 0 2024-09-12T22:33:17.978 INFO:tasks.workunit.client.0.smithi019.stdout:2/973: write d0/d5/d60/ff8 [24870,75257] 0 2024-09-12T22:33:17.978 INFO:tasks.workunit.client.0.smithi019.stdout:8/970: rename d7/d34/d78/f20 to d7/d2f/d75/f12d 0 2024-09-12T22:33:17.979 INFO:tasks.workunit.client.0.smithi019.stdout:2/974: mknod d0/d5/d60/d74/c148 0 2024-09-12T22:33:17.979 INFO:tasks.workunit.client.0.smithi019.stdout:8/971: creat d7/d5e/dff/f12e x:0 0 0 2024-09-12T22:33:17.981 INFO:tasks.workunit.client.0.smithi019.stdout:9/933: truncate dd/d10/d17/d22/f3e 3742326 0 2024-09-12T22:33:17.982 INFO:tasks.workunit.client.0.smithi019.stdout:9/934: fsync dd/f18 0 2024-09-12T22:33:17.983 INFO:tasks.workunit.client.0.smithi019.stdout:4/975: sync 2024-09-12T22:33:17.983 INFO:tasks.workunit.client.0.smithi019.stdout:4/976: chown d1/d4/d38/l12d 4777959 1 2024-09-12T22:33:17.983 INFO:tasks.workunit.client.0.smithi019.stdout:0/963: dread d1/fd [0,4194304] 0 2024-09-12T22:33:17.984 INFO:tasks.workunit.client.0.smithi019.stdout:9/935: link dd/d10/d17/l3c dd/d10/d17/d22/d77/l129 0 2024-09-12T22:33:17.984 INFO:tasks.workunit.client.0.smithi019.stdout:4/977: mknod d1/d4/d38/dbf/c155 0 2024-09-12T22:33:17.986 INFO:tasks.workunit.client.0.smithi019.stdout:4/978: mknod d1/d22/d31/d85/d142/c156 0 2024-09-12T22:33:17.986 INFO:tasks.workunit.client.0.smithi019.stdout:9/936: mknod dd/d10/d17/d23/d2e/d31/d3f/dc0/c12a 0 2024-09-12T22:33:17.987 INFO:tasks.workunit.client.0.smithi019.stdout:9/937: rename dd/d10/d17/d23/d2e/d31/d7e/dbc/f71 to dd/d10/d17/d23/d2e/d31/d3f/d67/f12b 0 2024-09-12T22:33:17.990 INFO:tasks.workunit.client.0.smithi019.stdout:9/938: rename dd/d10/d17/d22/d6c/d53/d69/d9d/fc8 to dd/d10/d17/d22/d6c/d53/d69/d9d/dbd/f12c 0 2024-09-12T22:33:17.990 INFO:tasks.workunit.client.0.smithi019.stdout:5/991: dread d0/d7/d2d/d32/d36/d8c/db8/d39/f4e [0,4194304] 0 2024-09-12T22:33:17.990 INFO:tasks.workunit.client.0.smithi019.stdout:9/939: stat dd/d10/d17/d23/ddb/l10d 0 2024-09-12T22:33:17.991 INFO:tasks.workunit.client.0.smithi019.stdout:2/975: dread d0/d5/d60/ff8 [0,4194304] 0 2024-09-12T22:33:17.992 INFO:tasks.workunit.client.0.smithi019.stdout:5/992: getdents d0/d7/d90 0 2024-09-12T22:33:17.992 INFO:tasks.workunit.client.0.smithi019.stdout:9/940: symlink dd/d10/d17/d22/d6c/d53/d119/l12d 0 2024-09-12T22:33:17.992 INFO:tasks.workunit.client.0.smithi019.stdout:4/979: write d1/d22/f68 [2116408,36320] 0 2024-09-12T22:33:17.993 INFO:tasks.workunit.client.0.smithi019.stdout:5/993: symlink d0/d7/de6/l159 0 2024-09-12T22:33:17.993 INFO:tasks.workunit.client.0.smithi019.stdout:9/941: chown dd/d10/d17/d22/d6c/d53/d73/c9f 84526 1 2024-09-12T22:33:17.994 INFO:tasks.workunit.client.0.smithi019.stdout:4/980: unlink d1/d22/d26/f48 0 2024-09-12T22:33:17.994 INFO:tasks.workunit.client.0.smithi019.stdout:2/976: truncate d0/d5/d60/d74/d7e/d112/f37 8244493 0 2024-09-12T22:33:17.995 INFO:tasks.workunit.client.0.smithi019.stdout:4/981: fdatasync d1/d11/d15/d81/f9f 0 2024-09-12T22:33:17.995 INFO:tasks.workunit.client.0.smithi019.stdout:5/994: creat d0/d7/d16/f15a x:0 0 0 2024-09-12T22:33:17.998 INFO:tasks.workunit.client.0.smithi019.stdout:5/995: link d0/d7/d2d/d32/d36/d8c/db8/f74 d0/d7/d2d/d32/d36/d8c/db8/d39/d38/d4b/dde/d114/d119/d146/df6/f15b 0 2024-09-12T22:33:18.000 INFO:tasks.workunit.client.0.smithi019.stdout:5/996: creat d0/dd0/d104/f15c x:0 0 0 2024-09-12T22:33:18.000 INFO:tasks.workunit.client.0.smithi019.stdout:4/982: dwrite d1/d22/d31/d101/f112 [0,4194304] 0 2024-09-12T22:33:18.002 INFO:tasks.workunit.client.0.smithi019.stdout:4/983: symlink d1/d8/dd0/l157 0 2024-09-12T22:33:18.002 INFO:tasks.workunit.client.0.smithi019.stdout:5/997: unlink d0/d7/d2d/d32/d36/d8c/db8/d39/df7/c11e 0 2024-09-12T22:33:18.003 INFO:tasks.workunit.client.0.smithi019.stdout:4/984: unlink d1/d11/d15/d1f/d56/f141 0 2024-09-12T22:33:18.004 INFO:tasks.workunit.client.0.smithi019.stdout:4/985: dread d1/d11/f23 [0,4194304] 0 2024-09-12T22:33:18.005 INFO:tasks.workunit.client.0.smithi019.stdout:4/986: unlink d1/d4c/db0/d75/ffa 0 2024-09-12T22:33:18.005 INFO:tasks.workunit.client.0.smithi019.stdout:4/987: mknod d1/d22/d2c/d107/c158 0 2024-09-12T22:33:18.008 INFO:tasks.workunit.client.0.smithi019.stdout:5/998: read d0/d7/d16/f7a [5345533,127900] 0 2024-09-12T22:33:18.009 INFO:tasks.workunit.client.0.smithi019.stdout:3/889: dread dd/d1e/d40/d6e/d70/ff2 [0,4194304] 0 2024-09-12T22:33:18.010 INFO:tasks.workunit.client.0.smithi019.stdout:5/999: chown d0/d7/d2d/d32/d36/d8c/fea 429121726 1 2024-09-12T22:33:18.010 INFO:tasks.workunit.client.0.smithi019.stdout:3/890: creat dd/d1e/d40/d6e/dff/f114 x:0 0 0 2024-09-12T22:33:18.012 INFO:tasks.workunit.client.0.smithi019.stdout:3/891: write dd/d1e/d40/da6/dba/ff4 [1387166,47172] 0 2024-09-12T22:33:18.012 INFO:tasks.workunit.client.0.smithi019.stdout:7/846: dread d6/d14/d45/f7e [4194304,4194304] 0 2024-09-12T22:33:18.012 INFO:tasks.workunit.client.0.smithi019.stdout:3/892: creat dd/d12/d62/d74/f115 x:0 0 0 2024-09-12T22:33:18.013 INFO:tasks.workunit.client.0.smithi019.stdout:7/847: mknod d6/d14/d2a/da4/d34/c138 0 2024-09-12T22:33:18.013 INFO:tasks.workunit.client.0.smithi019.stdout:3/893: write dd/d12/dbe/fc5 [1423553,114585] 0 2024-09-12T22:33:18.014 INFO:tasks.workunit.client.0.smithi019.stdout:3/894: stat dd/d12/c4b 0 2024-09-12T22:33:18.015 INFO:tasks.workunit.client.0.smithi019.stdout:0/964: dread d1/d1f/d5b/d83/dab/dbe/f35 [0,4194304] 0 2024-09-12T22:33:18.015 INFO:tasks.workunit.client.0.smithi019.stdout:7/848: rename d6/d14/d2a/da4/d34/c138 to d6/d14/d15/d8b/c139 0 2024-09-12T22:33:18.015 INFO:tasks.workunit.client.0.smithi019.stdout:3/895: unlink dd/d1e/d40/d6e/la8 0 2024-09-12T22:33:18.015 INFO:tasks.workunit.client.0.smithi019.stdout:7/849: fsync d6/d14/d15/d8b/d103/f131 0 2024-09-12T22:33:18.016 INFO:tasks.workunit.client.0.smithi019.stdout:0/965: symlink d1/d1f/d5b/d83/dab/dbe/d71/l138 0 2024-09-12T22:33:18.016 INFO:tasks.workunit.client.0.smithi019.stdout:3/896: write dd/d1e/d40/f4a [4502414,53627] 0 2024-09-12T22:33:18.017 INFO:tasks.workunit.client.0.smithi019.stdout:7/850: symlink d6/d2d/d77/dbf/dde/d124/l13a 0 2024-09-12T22:33:18.018 INFO:tasks.workunit.client.0.smithi019.stdout:3/897: truncate dd/d12/d62/d6a/dfe/f102 338266 0 2024-09-12T22:33:18.019 INFO:tasks.workunit.client.0.smithi019.stdout:3/898: mknod dd/d12/d62/d6a/c116 0 2024-09-12T22:33:18.020 INFO:tasks.workunit.client.0.smithi019.stdout:3/899: chown dd/d1e/d40/da6/ca9 20878215 1 2024-09-12T22:33:18.022 INFO:tasks.workunit.client.0.smithi019.stdout:3/900: write dd/d12/d62/d78/fb1 [2383184,114429] 0 2024-09-12T22:33:18.024 INFO:tasks.workunit.client.0.smithi019.stdout:2/977: dread d0/d5/d18/d5c/d67/d77/fb3 [4194304,4194304] 0 2024-09-12T22:33:18.026 INFO:tasks.workunit.client.0.smithi019.stdout:2/978: truncate d0/d5/d60/d71/fc8 1151309 0 2024-09-12T22:33:18.026 INFO:tasks.workunit.client.0.smithi019.stdout:9/942: dread dd/d10/d17/d22/d6c/d53/de3/f105 [0,4194304] 0 2024-09-12T22:33:18.027 INFO:tasks.workunit.client.0.smithi019.stdout:2/979: fdatasync d0/d5/d60/d71/fd9 0 2024-09-12T22:33:18.029 INFO:tasks.workunit.client.0.smithi019.stdout:3/901: dwrite dd/d12/d62/d6a/fd1 [0,4194304] 0 2024-09-12T22:33:18.030 INFO:tasks.workunit.client.0.smithi019.stdout:3/902: unlink dd/d1e/lb0 0 2024-09-12T22:33:18.031 INFO:tasks.workunit.client.0.smithi019.stdout:9/943: read dd/d10/d17/d23/d2e/d31/d3f/dc0/f10c [893048,96483] 0 2024-09-12T22:33:18.031 INFO:tasks.workunit.client.0.smithi019.stdout:3/903: chown dd/d1e/d5a/f60 386087561 1 2024-09-12T22:33:18.032 INFO:tasks.workunit.client.0.smithi019.stdout:8/972: sync 2024-09-12T22:33:18.032 INFO:tasks.workunit.client.0.smithi019.stdout:4/988: sync 2024-09-12T22:33:18.033 INFO:tasks.workunit.client.0.smithi019.stdout:2/980: dwrite d0/d5/d18/d5c/d67/d77/f7b [0,4194304] 0 2024-09-12T22:33:18.033 INFO:tasks.workunit.client.0.smithi019.stdout:3/904: write dd/d1e/d5a/f6b [48311,450] 0 2024-09-12T22:33:18.035 INFO:tasks.workunit.client.0.smithi019.stdout:2/981: stat d0/d5/d18/d5c/d85/d95/l11e 0 2024-09-12T22:33:18.035 INFO:tasks.workunit.client.0.smithi019.stdout:4/989: symlink d1/d4/d38/dbf/l159 0 2024-09-12T22:33:18.037 INFO:tasks.workunit.client.0.smithi019.stdout:0/966: dread d1/d1f/f8b [0,4194304] 0 2024-09-12T22:33:18.038 INFO:tasks.workunit.client.0.smithi019.stdout:4/990: rmdir d1/d11/d15/d1f/d56/dd5 0 2024-09-12T22:33:18.039 INFO:tasks.workunit.client.0.smithi019.stdout:2/982: rename d0/d5/d18/d1b/d5d to d0/d5/d18/d5c/d63/d6a/d149 0 2024-09-12T22:33:18.040 INFO:tasks.workunit.client.0.smithi019.stdout:4/991: write d1/d22/d26/f43 [2314848,109873] 0 2024-09-12T22:33:18.040 INFO:tasks.workunit.client.0.smithi019.stdout:8/973: dwrite d7/d5e/f91 [0,4194304] 0 2024-09-12T22:33:18.042 INFO:tasks.workunit.client.0.smithi019.stdout:0/967: rename d1/d1f/d5b/d83/dc7/c109 to d1/d1f/d5b/d83/dab/dbe/d106/c139 0 2024-09-12T22:33:18.044 INFO:tasks.workunit.client.0.smithi019.stdout:7/851: dread d6/d14/d15/f17 [0,4194304] 0 2024-09-12T22:33:18.044 INFO:tasks.workunit.client.0.smithi019.stdout:4/992: write d1/d22/d2c/d107/d11f/f137 [360250,81470] 0 2024-09-12T22:33:18.044 INFO:tasks.workunit.client.0.smithi019.stdout:3/905: dwrite dd/d12/d62/d78/dde/fe8 [0,4194304] 0 2024-09-12T22:33:18.045 INFO:teuthology.orchestra.run.smithi019.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-12T22:33:18.045 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:33:18.045 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:33:18.047 INFO:tasks.workunit.client.0.smithi019.stdout:0/968: write d1/d1f/d5b/d83/dab/dbe/d89/fc5 [1049752,72656] 0 2024-09-12T22:33:18.048 INFO:tasks.workunit.client.0.smithi019.stdout:4/993: write d1/d8/dfb/dfc/f10a [3450820,10729] 0 2024-09-12T22:33:18.048 INFO:tasks.workunit.client.0.smithi019.stdout:7/852: stat d6/d14/d15/d8b/f117 0 2024-09-12T22:33:18.048 INFO:tasks.workunit.client.0.smithi019.stdout:3/906: getdents dd/d1e/d40/da6 0 2024-09-12T22:33:18.050 INFO:tasks.workunit.client.0.smithi019.stdout:0/969: creat d1/d14/d1b/d12a/f13a x:0 0 0 2024-09-12T22:33:18.050 INFO:tasks.workunit.client.0.smithi019.stdout:2/983: dwrite d0/d5/d18/d5c/f78 [0,4194304] 0 2024-09-12T22:33:18.050 INFO:tasks.workunit.client.0.smithi019.stdout:7/853: symlink d6/d2d/d77/dbf/dde/d124/l13b 0 2024-09-12T22:33:18.053 INFO:tasks.workunit.client.0.smithi019.stdout:7/854: write d6/d2d/d41/fbe [686659,98148] 0 2024-09-12T22:33:18.056 INFO:tasks.workunit.client.0.smithi019.stdout:8/974: dwrite d7/d34/d78/d82/d117/f83 [0,4194304] 0 2024-09-12T22:33:18.056 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:33:18.057 INFO:tasks.workunit.client.0.smithi019.stdout:0/970: truncate d1/d14/d1b/f4b 2219344 0 2024-09-12T22:33:18.057 INFO:tasks.workunit.client.0.smithi019.stdout:3/907: truncate dd/d1e/d40/d6e/d70/ff1 980099 0 2024-09-12T22:33:18.057 INFO:tasks.workunit.client.0.smithi019.stdout:4/994: dwrite d1/fcf [0,4194304] 0 2024-09-12T22:33:18.058 INFO:tasks.workunit.client.0.smithi019.stdout:3/908: chown dd/d1e/d40/d6e/fc4 4 1 2024-09-12T22:33:18.058 INFO:tasks.workunit.client.0.smithi019.stdout:0/971: truncate d1/d14/d1b/dc9/f104 980120 0 2024-09-12T22:33:18.059 INFO:tasks.workunit.client.0.smithi019.stdout:4/995: mkdir d1/d4/d38/dc4/dc2/d15a 0 2024-09-12T22:33:18.059 INFO:tasks.workunit.client.0.smithi019.stdout:3/909: symlink dd/d12/d62/d74/l117 0 2024-09-12T22:33:18.060 INFO:tasks.workunit.client.0.smithi019.stdout:7/855: dread d6/d14/d45/d7c/f72 [0,4194304] 0 2024-09-12T22:33:18.061 INFO:tasks.workunit.client.0.smithi019.stdout:0/972: write d1/d14/d26/d40/d45/d5e/f98 [1233198,113581] 0 2024-09-12T22:33:18.064 INFO:tasks.workunit.client.0.smithi019.stdout:4/996: creat d1/d22/d31/d85/f15b x:0 0 0 2024-09-12T22:33:18.065 INFO:tasks.workunit.client.0.smithi019.stdout:4/997: chown d1/d11/f23 692 1 2024-09-12T22:33:18.065 INFO:tasks.workunit.client.0.smithi019.stdout:4/998: creat d1/d22/d26/f15c x:0 0 0 2024-09-12T22:33:18.065 INFO:tasks.workunit.client.0.smithi019.stdout:9/944: dread dd/d10/d17/d23/d2e/f93 [0,4194304] 0 2024-09-12T22:33:18.065 INFO:tasks.workunit.client.0.smithi019.stdout:0/973: creat d1/d14/d26/d40/d45/d5e/f13b x:0 0 0 2024-09-12T22:33:18.065 INFO:tasks.workunit.client.0.smithi019.stdout:0/974: write d1/d1f/f77 [1339574,11229] 0 2024-09-12T22:33:18.066 INFO:tasks.workunit.client.0.smithi019.stdout:4/999: symlink d1/d11/d15/d1f/d56/da9/dce/l15d 0 2024-09-12T22:33:18.066 INFO:tasks.workunit.client.0.smithi019.stdout:0/975: write d1/d1f/d5b/d83/dab/dbe/dc6/fce [586918,37161] 0 2024-09-12T22:33:18.066 INFO:tasks.workunit.client.0.smithi019.stdout:3/910: dread dd/d1e/d40/fd3 [0,4194304] 0 2024-09-12T22:33:18.067 INFO:tasks.workunit.client.0.smithi019.stdout:9/945: dwrite dd/deb/f108 [0,4194304] 0 2024-09-12T22:33:18.071 INFO:tasks.workunit.client.0.smithi019.stdout:0/976: dwrite d1/d14/d1b/d3a/d8c/dae/fb5 [0,4194304] 0 2024-09-12T22:33:18.072 INFO:tasks.workunit.client.0.smithi019.stdout:0/977: fdatasync d1/d1f/d5b/d83/dab/dbe/dc6/fed 0 2024-09-12T22:33:18.073 INFO:tasks.workunit.client.0.smithi019.stdout:7/856: write d6/d14/d15/d62/f9f [1099976,70334] 0 2024-09-12T22:33:18.076 INFO:tasks.workunit.client.0.smithi019.stdout:3/911: truncate dd/f11 4039455 0 2024-09-12T22:33:18.076 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T22:33:18.076 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:33:18.077 INFO:tasks.workunit.client.0.smithi019.stdout:3/912: mkdir dd/d12/d62/d6a/dfe/d118 0 2024-09-12T22:33:18.080 INFO:tasks.workunit.client.0.smithi019.stdout:3/913: dread dd/d1e/d40/f6f [4194304,4194304] 0 2024-09-12T22:33:18.081 INFO:tasks.workunit.client.0.smithi019.stdout:3/914: chown dd/d1e/c50 0 1 2024-09-12T22:33:18.086 INFO:tasks.workunit.client.0.smithi019.stdout:7/857: dread d6/d14/d2a/da4/d42/faa [0,4194304] 0 2024-09-12T22:33:18.087 INFO:tasks.workunit.client.0.smithi019.stdout:2/984: dread d0/d5/d60/d74/d7e/f87 [0,4194304] 0 2024-09-12T22:33:18.087 INFO:tasks.workunit.client.0.smithi019.stdout:7/858: creat d6/d2d/d12a/f13c x:0 0 0 2024-09-12T22:33:18.088 INFO:tasks.workunit.client.0.smithi019.stdout:7/859: readlink d6/d2d/d77/dbf/dde/d124/l13a 0 2024-09-12T22:33:18.088 INFO:tasks.workunit.client.0.smithi019.stdout:7/860: chown d6/d2d/l4a 970 1 2024-09-12T22:33:18.089 INFO:tasks.workunit.client.0.smithi019.stdout:2/985: rename d0/d5/d60/d71/c13b to d0/d5/d18/d3b/df9/c14a 0 2024-09-12T22:33:18.089 INFO:tasks.workunit.client.0.smithi019.stdout:7/861: fsync d6/d2d/d8f/daf/f95 0 2024-09-12T22:33:18.090 INFO:tasks.workunit.client.0.smithi019.stdout:7/862: fsync d6/d14/d15/d62/f9f 0 2024-09-12T22:33:18.090 INFO:tasks.workunit.client.0.smithi019.stdout:2/986: write d0/d5/d60/d74/d7e/d112/d73/dcb/fcd [3487465,89572] 0 2024-09-12T22:33:18.093 INFO:tasks.workunit.client.0.smithi019.stdout:2/987: rename d0/d5/d18/d5c/d67/d77/c117 to d0/d5/d18/d5c/d63/d6a/d149/d86/d10b/d11d/c14b 0 2024-09-12T22:33:18.093 INFO:tasks.workunit.client.0.smithi019.stdout:2/988: stat d0/d5/d18/d1b/d8d/c121 0 2024-09-12T22:33:18.094 INFO:tasks.workunit.client.0.smithi019.stdout:7/863: truncate d6/d2d/d41/f129 468501 0 2024-09-12T22:33:18.095 INFO:tasks.workunit.client.0.smithi019.stdout:2/989: mknod d0/d5/d60/d74/d7e/d112/c14c 0 2024-09-12T22:33:18.095 INFO:tasks.workunit.client.0.smithi019.stdout:7/864: truncate d6/d2d/d8f/daf/f10b 843332 0 2024-09-12T22:33:18.096 INFO:tasks.workunit.client.0.smithi019.stdout:2/990: chown d0/d5/d18/d1b/d8d/c128 25692 1 2024-09-12T22:33:18.097 INFO:tasks.workunit.client.0.smithi019.stdout:7/865: write d6/d2d/d8f/daf/f10b [232199,83717] 0 2024-09-12T22:33:18.097 INFO:tasks.workunit.client.0.smithi019.stdout:8/975: dread d7/fc [0,4194304] 0 2024-09-12T22:33:18.097 INFO:tasks.workunit.client.0.smithi019.stdout:2/991: chown d0/d5/d18/d3b/df9/c14a 1427648761 1 2024-09-12T22:33:18.098 INFO:tasks.workunit.client.0.smithi019.stdout:7/866: rename d6/d2d/d77/cf5 to d6/d14/df0/c13d 0 2024-09-12T22:33:18.099 INFO:tasks.workunit.client.0.smithi019.stdout:2/992: creat d0/d5/d60/d71/f14d x:0 0 0 2024-09-12T22:33:18.099 INFO:tasks.workunit.client.0.smithi019.stdout:8/976: creat d7/d2f/d75/f12f x:0 0 0 2024-09-12T22:33:18.100 INFO:tasks.workunit.client.0.smithi019.stdout:7/867: chown f1 37 1 2024-09-12T22:33:18.100 INFO:tasks.workunit.client.0.smithi019.stdout:9/946: dread dd/d10/d17/d23/d37/f5b [0,4194304] 0 2024-09-12T22:33:18.100 INFO:tasks.workunit.client.0.smithi019.stdout:0/978: dread d1/d14/f4e [0,4194304] 0 2024-09-12T22:33:18.100 INFO:tasks.workunit.client.0.smithi019.stdout:2/993: chown d0/d5/d18/d5c/d67/d147 392 1 2024-09-12T22:33:18.100 INFO:tasks.workunit.client.0.smithi019.stdout:8/977: mkdir d7/d8/d11c/d130 0 2024-09-12T22:33:18.101 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:18.100+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:18.101 INFO:tasks.workunit.client.0.smithi019.stdout:0/979: mknod d1/d1f/d5b/d83/dab/dbe/d106/c13c 0 2024-09-12T22:33:18.101 INFO:tasks.workunit.client.0.smithi019.stdout:7/868: mknod d6/d14/d2a/da4/dc/d63/c13e 0 2024-09-12T22:33:18.102 INFO:tasks.workunit.client.0.smithi019.stdout:8/978: creat d7/d8/d43/d87/dc2/d10a/f131 x:0 0 0 2024-09-12T22:33:18.103 INFO:tasks.workunit.client.0.smithi019.stdout:7/869: mknod d6/d2d/d41/c13f 0 2024-09-12T22:33:18.103 INFO:tasks.workunit.client.0.smithi019.stdout:8/979: readlink d7/d34/d78/d53/da8/lae 0 2024-09-12T22:33:18.103 INFO:tasks.workunit.client.0.smithi019.stdout:9/947: link dd/d10/d17/d23/d2e/d31/d7e/lfe dd/d10/d17/d22/d6c/d53/d69/d9d/dbd/de8/l12e 0 2024-09-12T22:33:18.104 INFO:tasks.workunit.client.0.smithi019.stdout:0/980: creat d1/d1f/d5b/d83/dab/dbe/d9c/f13d x:0 0 0 2024-09-12T22:33:18.104 INFO:teuthology.orchestra.run.smithi019.stdout:osd.2: {} 2024-09-12T22:33:18.104 INFO:teuthology.orchestra.run.smithi019.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T22:33:18.105 INFO:tasks.workunit.client.0.smithi019.stdout:7/870: symlink d6/d14/d45/l140 0 2024-09-12T22:33:18.105 INFO:tasks.workunit.client.0.smithi019.stdout:8/980: mknod d7/c132 0 2024-09-12T22:33:18.105 INFO:tasks.workunit.client.0.smithi019.stdout:7/871: dread - d6/d14/f102 zero size 2024-09-12T22:33:18.105 INFO:tasks.workunit.client.0.smithi019.stdout:9/948: fdatasync dd/d10/d17/d23/d2e/d31/d3f/dc0/ffb 0 2024-09-12T22:33:18.105 INFO:tasks.workunit.client.0.smithi019.stdout:0/981: getdents d1/d14/d26/d40/d91 0 2024-09-12T22:33:18.106 INFO:tasks.workunit.client.0.smithi019.stdout:8/981: chown d7/d8/dd/d45/fe1 258647198 1 2024-09-12T22:33:18.106 INFO:tasks.workunit.client.0.smithi019.stdout:7/872: symlink d6/d14/d2a/da4/dc/d63/l141 0 2024-09-12T22:33:18.106 INFO:tasks.workunit.client.0.smithi019.stdout:8/982: readlink d7/l68 0 2024-09-12T22:33:18.107 INFO:tasks.workunit.client.0.smithi019.stdout:9/949: chown dd/d10/d17/d22/d6c/d53/d69/d9d/dbd/f12c 784505 1 2024-09-12T22:33:18.108 INFO:tasks.workunit.client.0.smithi019.stdout:8/983: write d7/d5e/f60 [1907691,5023] 0 2024-09-12T22:33:18.108 INFO:tasks.workunit.client.0.smithi019.stdout:0/982: mknod d1/d1f/d5b/d83/dab/dbe/d71/d75/de6/c13e 0 2024-09-12T22:33:18.108 INFO:tasks.workunit.client.0.smithi019.stdout:7/873: creat d6/d14/d45/dca/f142 x:0 0 0 2024-09-12T22:33:18.108 INFO:tasks.workunit.client.0.smithi019.stdout:8/984: chown d7/l119 0 1 2024-09-12T22:33:18.109 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:33:18.110 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:33:18.111 INFO:tasks.workunit.client.0.smithi019.stdout:8/985: fdatasync d7/d34/d78/fd7 0 2024-09-12T22:33:18.111 INFO:tasks.workunit.client.0.smithi019.stdout:7/874: unlink d6/d14/d15/d9e/f36 0 2024-09-12T22:33:18.111 INFO:tasks.workunit.client.0.smithi019.stdout:9/950: rename dd/d10/d17/d22/d42/l68 to dd/d10/d17/l12f 0 2024-09-12T22:33:18.111 INFO:tasks.workunit.client.0.smithi019.stdout:3/915: dread dd/d12/f65 [0,4194304] 0 2024-09-12T22:33:18.111 INFO:tasks.workunit.client.0.smithi019.stdout:0/983: getdents d1/d14/d1b/d3a 0 2024-09-12T22:33:18.111 INFO:tasks.workunit.client.0.smithi019.stdout:8/986: fsync d7/d8/d43/fb9 0 2024-09-12T22:33:18.111 INFO:tasks.workunit.client.0.smithi019.stdout:2/994: dread d0/fe7 [0,4194304] 0 2024-09-12T22:33:18.111 INFO:tasks.workunit.client.0.smithi019.stdout:0/984: rmdir d1/d51 39 2024-09-12T22:33:18.112 INFO:tasks.workunit.client.0.smithi019.stdout:7/875: creat d6/d2d/d41/f143 x:0 0 0 2024-09-12T22:33:18.112 INFO:tasks.workunit.client.0.smithi019.stdout:9/951: stat dd/d10/d17/d22/d6c/d53/d73/fce 0 2024-09-12T22:33:18.112 INFO:tasks.workunit.client.0.smithi019.stdout:8/987: creat d7/d34/d78/d54/f133 x:0 0 0 2024-09-12T22:33:18.112 INFO:tasks.workunit.client.0.smithi019.stdout:7/876: fdatasync d6/d14/d15/d8b/d103/f131 0 2024-09-12T22:33:18.113 INFO:tasks.workunit.client.0.smithi019.stdout:2/995: mkdir d0/d5/d60/d74/d7e/d112/d73/d14e 0 2024-09-12T22:33:18.113 INFO:tasks.workunit.client.0.smithi019.stdout:7/877: fdatasync d6/d2d/d41/f9a 0 2024-09-12T22:33:18.113 INFO:tasks.workunit.client.0.smithi019.stdout:9/952: chown dd/d10/d17/d23/d2e/d31/d3f/d67/lb9 1 1 2024-09-12T22:33:18.113 INFO:tasks.workunit.client.0.smithi019.stdout:8/988: mkdir d7/d8/dd/def/d134 0 2024-09-12T22:33:18.114 INFO:tasks.workunit.client.0.smithi019.stdout:7/878: dread - d6/d2d/fe6 zero size 2024-09-12T22:33:18.114 INFO:tasks.workunit.client.0.smithi019.stdout:9/953: mkdir dd/d10/d126/d130 0 2024-09-12T22:33:18.114 INFO:tasks.workunit.client.0.smithi019.stdout:2/996: mknod d0/d5/d17/d91/d9c/df2/c14f 0 2024-09-12T22:33:18.114 INFO:tasks.workunit.client.0.smithi019.stdout:8/989: getdents d7/d5e/dff 0 2024-09-12T22:33:18.115 INFO:tasks.workunit.client.0.smithi019.stdout:2/997: read - d0/d5/d60/d74/d7e/ff7 zero size 2024-09-12T22:33:18.115 INFO:tasks.workunit.client.0.smithi019.stdout:7/879: write d6/d14/d2a/da4/d42/feb [851783,105479] 0 2024-09-12T22:33:18.117 INFO:tasks.workunit.client.0.smithi019.stdout:0/985: dwrite d1/d1f/d5b/d83/dab/f108 [0,4194304] 0 2024-09-12T22:33:18.117 INFO:tasks.workunit.client.0.smithi019.stdout:7/880: truncate d6/d14/d2a/f82 4677714 0 2024-09-12T22:33:18.118 INFO:tasks.workunit.client.0.smithi019.stdout:2/998: mkdir d0/d5/d60/d74/d7e/d112/d73/d104/d132/d13e/d150 0 2024-09-12T22:33:18.119 INFO:tasks.workunit.client.0.smithi019.stdout:0/986: chown d1/d14/d26/d40/d45/lc3 0 1 2024-09-12T22:33:18.121 INFO:tasks.workunit.client.0.smithi019.stdout:8/990: dwrite d7/d2f/d75/fd0 [0,4194304] 0 2024-09-12T22:33:18.121 INFO:tasks.workunit.client.0.smithi019.stdout:7/881: creat d6/d2d/d77/d8e/f144 x:0 0 0 2024-09-12T22:33:18.121 INFO:tasks.workunit.client.0.smithi019.stdout:2/999: rename d0/d5/d17/d91/d9c/fed to d0/d5/d60/d74/d7e/d112/d73/d104/f151 0 2024-09-12T22:33:18.122 INFO:tasks.workunit.client.0.smithi019.stdout:7/882: symlink d6/d14/d2a/l145 0 2024-09-12T22:33:18.122 INFO:tasks.workunit.client.0.smithi019.stdout:8/991: stat d7/d2f/d42/fd1 0 2024-09-12T22:33:18.123 INFO:tasks.workunit.client.0.smithi019.stdout:9/954: dread dd/d10/d17/d23/d2e/d31/d3f/ff6 [0,4194304] 0 2024-09-12T22:33:18.124 INFO:tasks.workunit.client.0.smithi019.stdout:8/992: getdents d7/d8/dd/d45/dc5 0 2024-09-12T22:33:18.124 INFO:tasks.workunit.client.0.smithi019.stdout:7/883: rename d6/d14/d15/d8b/c139 to d6/d14/d2a/da4/d34/c146 0 2024-09-12T22:33:18.125 INFO:tasks.workunit.client.0.smithi019.stdout:7/884: readlink d6/d14/d15/d9e/l85 0 2024-09-12T22:33:18.125 INFO:tasks.workunit.client.0.smithi019.stdout:8/993: creat d7/d2f/d75/f135 x:0 0 0 2024-09-12T22:33:18.126 INFO:tasks.workunit.client.0.smithi019.stdout:0/987: dwrite d1/d51/f56 [0,4194304] 0 2024-09-12T22:33:18.126 INFO:tasks.workunit.client.0.smithi019.stdout:9/955: rename dd/d10/d17/d22/d6c/d53/d69/d9d/dbd/de8 to dd/d10/d17/d22/d6c/d53/d73/d131 0 2024-09-12T22:33:18.126 INFO:tasks.workunit.client.0.smithi019.stdout:0/988: mkdir d1/d51/d13f 0 2024-09-12T22:33:18.127 INFO:tasks.workunit.client.0.smithi019.stdout:7/885: rename d6/d14/d2a/da4/d34/ff9 to d6/dd2/f147 0 2024-09-12T22:33:18.127 INFO:tasks.workunit.client.0.smithi019.stdout:7/886: readlink l0 0 2024-09-12T22:33:18.127 INFO:tasks.workunit.client.0.smithi019.stdout:9/956: write dd/d10/d17/d22/f9a [777008,63675] 0 2024-09-12T22:33:18.128 INFO:tasks.workunit.client.0.smithi019.stdout:8/994: rename d7/d8/d43/d87/lf3 to d7/d2f/l136 0 2024-09-12T22:33:18.128 INFO:tasks.workunit.client.0.smithi019.stdout:7/887: rmdir d6/d2d/d77/dbf 39 2024-09-12T22:33:18.128 INFO:tasks.workunit.client.0.smithi019.stdout:0/989: read d1/d1f/d5b/f61 [7141593,50073] 0 2024-09-12T22:33:18.128 INFO:tasks.workunit.client.0.smithi019.stdout:8/995: chown d7/f19 77 1 2024-09-12T22:33:18.129 INFO:tasks.workunit.client.0.smithi019.stdout:9/957: chown dd/d10/d17/d23/d2e/d31/d54/d8b 33971 1 2024-09-12T22:33:18.129 INFO:tasks.workunit.client.0.smithi019.stdout:7/888: stat d6/d14/d15/d62/f12b 0 2024-09-12T22:33:18.129 INFO:tasks.workunit.client.0.smithi019.stdout:0/990: write d1/d14/d26/d40/d91/fd4 [2608591,93694] 0 2024-09-12T22:33:18.130 INFO:tasks.workunit.client.0.smithi019.stdout:8/996: rename d7/d34/d78/d53/da8/f12b to d7/d8/dd/def/d104/f137 0 2024-09-12T22:33:18.130 INFO:tasks.workunit.client.0.smithi019.stdout:7/889: rename d6/d14/d15/f6d to d6/d14/d2a/da4/dc/d63/d4b/f148 0 2024-09-12T22:33:18.131 INFO:tasks.workunit.client.0.smithi019.stdout:8/997: chown d7/d34/d78/d53/l6e 1254361144 1 2024-09-12T22:33:18.131 INFO:tasks.workunit.client.0.smithi019.stdout:0/991: truncate d1/d14/d26/d40/d45/d5e/ffa 828127 0 2024-09-12T22:33:18.132 INFO:tasks.workunit.client.0.smithi019.stdout:8/998: symlink d7/d8/dd/def/d134/l138 0 2024-09-12T22:33:18.132 INFO:tasks.workunit.client.0.smithi019.stdout:0/992: stat d1/d14/d26/d40/d45/d5e/d84/l9d 0 2024-09-12T22:33:18.133 INFO:tasks.workunit.client.0.smithi019.stdout:0/993: symlink d1/d14/d26/d40/d91/d126/l140 0 2024-09-12T22:33:18.134 INFO:tasks.workunit.client.0.smithi019.stdout:0/994: read - d1/d14/d1b/d94/f10a zero size 2024-09-12T22:33:18.135 INFO:tasks.workunit.client.0.smithi019.stdout:7/890: dwrite d6/d14/d15/d8b/fbd [0,4194304] 0 2024-09-12T22:33:18.136 INFO:tasks.workunit.client.0.smithi019.stdout:7/891: mknod d6/d2d/d12a/c149 0 2024-09-12T22:33:18.137 INFO:tasks.workunit.client.0.smithi019.stdout:8/999: dwrite d7/d8/dd/d4f/f80 [0,4194304] 0 2024-09-12T22:33:18.139 INFO:tasks.workunit.client.0.smithi019.stdout:7/892: link d6/d2d/d77/dbf/dde/d124/f130 d6/d14/d15/d8b/d103/f14a 0 2024-09-12T22:33:18.140 INFO:tasks.workunit.client.0.smithi019.stdout:7/893: getdents d6/d14/d2a/da4/d34 0 2024-09-12T22:33:18.141 INFO:tasks.workunit.client.0.smithi019.stdout:0/995: truncate d1/d1f/f41 1049099 0 2024-09-12T22:33:18.142 INFO:tasks.workunit.client.0.smithi019.stdout:0/996: creat d1/d14/d1b/d3a/f141 x:0 0 0 2024-09-12T22:33:18.142 INFO:tasks.workunit.client.0.smithi019.stdout:0/997: read - d1/d14/d26/d40/d45/d5e/f13b zero size 2024-09-12T22:33:18.143 INFO:tasks.workunit.client.0.smithi019.stdout:0/998: readlink d1/d1f/d5b/d83/de0/l10e 0 2024-09-12T22:33:18.143 INFO:tasks.workunit.client.0.smithi019.stdout:0/999: mknod d1/d14/dad/c142 0 2024-09-12T22:33:18.144 INFO:tasks.workunit.client.0.smithi019.stdout:7/894: truncate d6/d2d/d8f/daf/fc1 2512428 0 2024-09-12T22:33:18.147 INFO:tasks.workunit.client.0.smithi019.stdout:7/895: dwrite d6/d14/d2a/da4/d42/f10a [0,4194304] 0 2024-09-12T22:33:18.148 INFO:tasks.workunit.client.0.smithi019.stdout:7/896: mkdir d6/d14/d15/d8b/d14b 0 2024-09-12T22:33:18.149 INFO:tasks.workunit.client.0.smithi019.stdout:7/897: mkdir d6/d14/d45/d7c/d14c 0 2024-09-12T22:33:18.150 INFO:tasks.workunit.client.0.smithi019.stdout:7/898: chown d6/d2d/d8f/daf/f95 649 1 2024-09-12T22:33:18.150 INFO:tasks.workunit.client.0.smithi019.stdout:7/899: readlink d6/d2d/l4a 0 2024-09-12T22:33:18.152 INFO:tasks.workunit.client.0.smithi019.stdout:7/900: symlink d6/d14/d45/db0/l14d 0 2024-09-12T22:33:18.152 INFO:tasks.workunit.client.0.smithi019.stdout:7/901: rmdir d6/d2d/d8f 39 2024-09-12T22:33:18.153 INFO:tasks.workunit.client.0.smithi019.stdout:7/902: write d6/d2d/d41/fbe [427472,128009] 0 2024-09-12T22:33:18.154 INFO:tasks.workunit.client.0.smithi019.stdout:7/903: creat d6/f14e x:0 0 0 2024-09-12T22:33:18.155 INFO:tasks.workunit.client.0.smithi019.stdout:7/904: rename d6/d14/d2a/da4/dc/d63/dff/l11d to d6/d2d/d8f/daf/da0/db7/l14f 0 2024-09-12T22:33:18.156 INFO:tasks.workunit.client.0.smithi019.stdout:7/905: write d6/d14/d2a/da4/f44 [2776170,2702] 0 2024-09-12T22:33:18.157 INFO:tasks.workunit.client.0.smithi019.stdout:7/906: creat d6/d14/d45/dca/df8/f150 x:0 0 0 2024-09-12T22:33:18.157 INFO:tasks.workunit.client.0.smithi019.stdout:7/907: readlink d6/d14/d2a/da4/d34/le8 0 2024-09-12T22:33:18.157 INFO:tasks.workunit.client.0.smithi019.stdout:7/908: dread - d6/d14/d15/f47 zero size 2024-09-12T22:33:18.158 INFO:tasks.workunit.client.0.smithi019.stdout:7/909: mknod d6/d2d/d77/dbf/dde/d124/c151 0 2024-09-12T22:33:18.159 INFO:tasks.workunit.client.0.smithi019.stdout:7/910: creat d6/d14/d15/d8b/f152 x:0 0 0 2024-09-12T22:33:18.159 INFO:tasks.workunit.client.0.smithi019.stdout:3/916: sync 2024-09-12T22:33:18.159 INFO:tasks.workunit.client.0.smithi019.stdout:9/958: sync 2024-09-12T22:33:18.160 INFO:tasks.workunit.client.0.smithi019.stdout:7/911: rename d6/d14/d2a/le4 to d6/d2d/d77/dbf/dde/d105/l153 0 2024-09-12T22:33:18.160 INFO:tasks.workunit.client.0.smithi019.stdout:9/959: mkdir dd/dcb/df8/d114/d132 0 2024-09-12T22:33:18.161 INFO:tasks.workunit.client.0.smithi019.stdout:7/912: chown d6/dcf/fdc 99712343 1 2024-09-12T22:33:18.161 INFO:tasks.workunit.client.0.smithi019.stdout:3/917: getdents dd/d1e/d40/d6e/dff 0 2024-09-12T22:33:18.161 INFO:tasks.workunit.client.0.smithi019.stdout:9/960: creat dd/d10/d17/d23/d2e/d31/d7e/f133 x:0 0 0 2024-09-12T22:33:18.161 INFO:tasks.workunit.client.0.smithi019.stdout:3/918: symlink dd/l119 0 2024-09-12T22:33:18.162 INFO:tasks.workunit.client.0.smithi019.stdout:7/913: mknod d6/d14/d15/d8b/d103/c154 0 2024-09-12T22:33:18.162 INFO:tasks.workunit.client.0.smithi019.stdout:9/961: write dd/d10/d17/d23/d2e/f92 [1990473,76310] 0 2024-09-12T22:33:18.162 INFO:tasks.workunit.client.0.smithi019.stdout:7/914: write d6/dd2/f147 [435294,40329] 0 2024-09-12T22:33:18.163 INFO:tasks.workunit.client.0.smithi019.stdout:7/915: creat d6/d2d/d77/d8e/f155 x:0 0 0 2024-09-12T22:33:18.163 INFO:tasks.workunit.client.0.smithi019.stdout:9/962: creat dd/d10/d17/d23/d2e/d31/d7e/dbc/ddd/f134 x:0 0 0 2024-09-12T22:33:18.164 INFO:tasks.workunit.client.0.smithi019.stdout:7/916: getdents d6/d14 0 2024-09-12T22:33:18.164 INFO:tasks.workunit.client.0.smithi019.stdout:3/919: truncate dd/d12/f24 1908767 0 2024-09-12T22:33:18.165 INFO:tasks.workunit.client.0.smithi019.stdout:9/963: symlink dd/d10/d17/d23/d2e/d31/d54/d8b/l135 0 2024-09-12T22:33:18.165 INFO:tasks.workunit.client.0.smithi019.stdout:3/920: creat dd/d1e/d40/d6e/dff/f11a x:0 0 0 2024-09-12T22:33:18.166 INFO:tasks.workunit.client.0.smithi019.stdout:3/921: unlink dd/c5d 0 2024-09-12T22:33:18.166 INFO:tasks.workunit.client.0.smithi019.stdout:9/964: write dd/d10/d17/d23/d2e/d31/d54/d8b/fb3 [355658,126645] 0 2024-09-12T22:33:18.167 INFO:tasks.workunit.client.0.smithi019.stdout:9/965: write dd/fe7 [80093,41528] 0 2024-09-12T22:33:18.169 INFO:tasks.workunit.client.0.smithi019.stdout:7/917: dwrite d6/d14/d2a/da4/dc/d63/d4b/f148 [0,4194304] 0 2024-09-12T22:33:18.170 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:18.169+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:18.170 INFO:tasks.workunit.client.0.smithi019.stdout:7/918: stat d6/d14/l58 0 2024-09-12T22:33:18.171 INFO:tasks.workunit.client.0.smithi019.stdout:9/966: dread dd/d10/d17/d22/f95 [0,4194304] 0 2024-09-12T22:33:18.171 INFO:tasks.workunit.client.0.smithi019.stdout:7/919: mkdir d6/d14/d15/d156 0 2024-09-12T22:33:18.172 INFO:tasks.workunit.client.0.smithi019.stdout:9/967: mknod dd/d10/d17/d23/d2e/c136 0 2024-09-12T22:33:18.174 INFO:tasks.workunit.client.0.smithi019.stdout:7/920: truncate d6/d14/d2a/da4/dc/d63/f37 4469721 0 2024-09-12T22:33:18.175 INFO:tasks.workunit.client.0.smithi019.stdout:7/921: truncate d6/d2d/d77/d8e/f155 772354 0 2024-09-12T22:33:18.176 INFO:tasks.workunit.client.0.smithi019.stdout:7/922: write d6/d14/d45/dca/f12e [332865,75178] 0 2024-09-12T22:33:18.177 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-09-12T22:33:18.177 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-09-12T22:33:18.177 INFO:teuthology.orchestra.run.smithi163.stdout: "num_ops": 0 2024-09-12T22:33:18.177 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-09-12T22:33:18.177 INFO:tasks.workunit.client.0.smithi019.stdout:9/968: dwrite dd/d10/d17/d76/dcc/fdc [0,4194304] 0 2024-09-12T22:33:18.178 INFO:tasks.workunit.client.0.smithi019.stdout:7/923: dread - d6/d14/d45/dca/df8/f150 zero size 2024-09-12T22:33:18.178 INFO:tasks.workunit.client.0.smithi019.stdout:3/922: dread dd/d1e/fd5 [0,4194304] 0 2024-09-12T22:33:18.178 INFO:tasks.workunit.client.0.smithi019.stdout:7/924: chown d6/d14/d45/d7c 2134945077 1 2024-09-12T22:33:18.178 INFO:tasks.workunit.client.0.smithi019.stdout:9/969: mkdir dd/d10/d17/d23/ddb/d137 0 2024-09-12T22:33:18.178 INFO:tasks.workunit.client.0.smithi019.stdout:3/923: symlink dd/d1e/d40/l11b 0 2024-09-12T22:33:18.179 INFO:tasks.workunit.client.0.smithi019.stdout:3/924: creat dd/d1e/d40/d5f/d10c/f11c x:0 0 0 2024-09-12T22:33:18.180 INFO:tasks.workunit.client.0.smithi019.stdout:9/970: write dd/d10/d17/d22/d6c/d53/d69/d9d/dbd/f12c [688205,129262] 0 2024-09-12T22:33:18.181 INFO:tasks.workunit.client.0.smithi019.stdout:9/971: readlink dd/d10/l91 0 2024-09-12T22:33:18.181 INFO:tasks.workunit.client.0.smithi019.stdout:7/925: truncate d6/d14/d2a/da4/f44 2157013 0 2024-09-12T22:33:18.182 INFO:tasks.workunit.client.0.smithi019.stdout:9/972: stat dd/d10/f39 0 2024-09-12T22:33:18.182 INFO:tasks.workunit.client.0.smithi019.stdout:3/925: symlink dd/d12/d62/d6a/dfe/d118/l11d 0 2024-09-12T22:33:18.183 INFO:tasks.workunit.client.0.smithi019.stdout:9/973: write dd/d10/d17/d23/d2e/d31/d3f/fa2 [2117572,94793] 0 2024-09-12T22:33:18.183 INFO:tasks.workunit.client.0.smithi019.stdout:7/926: read d6/d2d/d8f/daf/fc1 [190972,52860] 0 2024-09-12T22:33:18.183 INFO:tasks.workunit.client.0.smithi019.stdout:7/927: fdatasync d6/d14/d45/d7c/f125 0 2024-09-12T22:33:18.184 INFO:tasks.workunit.client.0.smithi019.stdout:7/928: write d6/f14e [232744,80646] 0 2024-09-12T22:33:18.184 INFO:tasks.workunit.client.0.smithi019.stdout:9/974: getdents dd/d10/d17/d22/d6c/d53/d73 0 2024-09-12T22:33:18.185 INFO:tasks.workunit.client.0.smithi019.stdout:7/929: write d6/d14/d2a/da4/d34/fda [1157498,66038] 0 2024-09-12T22:33:18.185 INFO:tasks.workunit.client.0.smithi019.stdout:9/975: mkdir dd/d10/d17/d23/d2e/d31/d54/d8b/d138 0 2024-09-12T22:33:18.186 INFO:tasks.workunit.client.0.smithi019.stdout:7/930: creat d6/d2d/d8f/daf/da0/db7/f157 x:0 0 0 2024-09-12T22:33:18.187 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:33:18.187 INFO:tasks.workunit.client.0.smithi019.stdout:9/976: chown dd/d10/d17/d22/d42/ff5 8177 1 2024-09-12T22:33:18.188 INFO:tasks.workunit.client.0.smithi019.stdout:7/931: creat d6/d2d/d12d/f158 x:0 0 0 2024-09-12T22:33:18.188 INFO:tasks.workunit.client.0.smithi019.stdout:3/926: truncate dd/d12/d62/d74/fec 1215156 0 2024-09-12T22:33:18.188 INFO:tasks.workunit.client.0.smithi019.stdout:9/977: mknod dd/d10/d17/d23/d2e/d31/d3f/d47/d6e/daf/c139 0 2024-09-12T22:33:18.189 INFO:tasks.workunit.client.0.smithi019.stdout:9/978: write dd/d10/d17/d23/d2e/d31/d7e/f133 [515670,79016] 0 2024-09-12T22:33:18.190 INFO:tasks.workunit.client.0.smithi019.stdout:9/979: write dd/d10/d17/d23/d2e/d31/d3f/d67/f12b [2652064,60317] 0 2024-09-12T22:33:18.190 INFO:tasks.workunit.client.0.smithi019.stdout:3/927: dread dd/d12/f65 [0,4194304] 0 2024-09-12T22:33:18.191 INFO:tasks.workunit.client.0.smithi019.stdout:3/928: write dd/f4d [1190076,55194] 0 2024-09-12T22:33:18.191 INFO:tasks.workunit.client.0.smithi019.stdout:9/980: write dd/dc2/f81 [5200395,110213] 0 2024-09-12T22:33:18.193 INFO:tasks.workunit.client.0.smithi019.stdout:7/932: dwrite d6/d14/d15/f98 [4194304,4194304] 0 2024-09-12T22:33:18.194 INFO:tasks.workunit.client.0.smithi019.stdout:7/933: mknod d6/d14/d45/dca/c159 0 2024-09-12T22:33:18.194 INFO:tasks.workunit.client.0.smithi019.stdout:7/934: stat d6/d14/d45/d7c/cf7 0 2024-09-12T22:33:18.195 INFO:tasks.workunit.client.0.smithi019.stdout:9/981: sync 2024-09-12T22:33:18.196 INFO:tasks.workunit.client.0.smithi019.stdout:9/982: chown dd/d10/d17/d76/dca 10631 1 2024-09-12T22:33:18.196 INFO:tasks.workunit.client.0.smithi019.stdout:7/935: symlink d6/d14/d15/d8b/d14b/l15a 0 2024-09-12T22:33:18.196 INFO:tasks.workunit.client.0.smithi019.stdout:7/936: readlink d6/d14/l58 0 2024-09-12T22:33:18.197 INFO:tasks.workunit.client.0.smithi019.stdout:7/937: creat d6/f15b x:0 0 0 2024-09-12T22:33:18.198 INFO:tasks.workunit.client.0.smithi019.stdout:9/983: dread dd/d10/d17/d23/d2e/d31/d7e/dbc/f66 [0,4194304] 0 2024-09-12T22:33:18.199 INFO:tasks.workunit.client.0.smithi019.stdout:9/984: creat dd/d10/d17/d23/d2e/d31/d3f/f13a x:0 0 0 2024-09-12T22:33:18.199 INFO:tasks.workunit.client.0.smithi019.stdout:7/938: getdents d6/d14/d2a/da4/dc/d63/dff 0 2024-09-12T22:33:18.200 INFO:tasks.workunit.client.0.smithi019.stdout:3/929: dwrite dd/d1e/fee [0,4194304] 0 2024-09-12T22:33:18.200 INFO:tasks.workunit.client.0.smithi019.stdout:7/939: write d6/d2d/d41/f56 [3096418,6799] 0 2024-09-12T22:33:18.201 INFO:tasks.workunit.client.0.smithi019.stdout:9/985: getdents dd/d10/d17/d23/d2e/d31/d54/d8b/ddf 0 2024-09-12T22:33:18.202 INFO:tasks.workunit.client.0.smithi019.stdout:3/930: creat dd/d1e/d40/d5f/f11e x:0 0 0 2024-09-12T22:33:18.202 INFO:tasks.workunit.client.0.smithi019.stdout:7/940: write d6/d14/d15/d62/f10c [379759,63811] 0 2024-09-12T22:33:18.202 INFO:tasks.workunit.client.0.smithi019.stdout:3/931: chown dd/d12/d62/d6a/dfe/d118 109652 1 2024-09-12T22:33:18.202 INFO:tasks.workunit.client.0.smithi019.stdout:7/941: stat d6/d2d/d8f/daf/f9d 0 2024-09-12T22:33:18.203 INFO:tasks.workunit.client.0.smithi019.stdout:7/942: fdatasync d6/d2d/de0/fea 0 2024-09-12T22:33:18.204 INFO:tasks.workunit.client.0.smithi019.stdout:7/943: dread - d6/d2d/d77/dbf/dde/d124/f130 zero size 2024-09-12T22:33:18.204 INFO:tasks.workunit.client.0.smithi019.stdout:3/932: link dd/d1e/d40/d6e/d70/cdd dd/d12/d62/d6a/dfe/c11f 0 2024-09-12T22:33:18.204 INFO:tasks.workunit.client.0.smithi019.stdout:7/944: chown d6/d14/d2a/da4/dc/d63/f11f 7623 1 2024-09-12T22:33:18.205 INFO:tasks.workunit.client.0.smithi019.stdout:7/945: creat d6/d2d/de0/f15c x:0 0 0 2024-09-12T22:33:18.206 INFO:tasks.workunit.client.0.smithi019.stdout:7/946: creat d6/d14/d45/db0/f15d x:0 0 0 2024-09-12T22:33:18.206 INFO:tasks.workunit.client.0.smithi019.stdout:7/947: write d6/d2d/d8f/f123 [7634,98022] 0 2024-09-12T22:33:18.207 INFO:tasks.workunit.client.0.smithi019.stdout:7/948: read - d6/d14/d15/f47 zero size 2024-09-12T22:33:18.208 INFO:tasks.workunit.client.0.smithi019.stdout:7/949: creat d6/d2d/d8f/f15e x:0 0 0 2024-09-12T22:33:18.208 INFO:tasks.workunit.client.0.smithi019.stdout:7/950: stat d6/d2d/d77/dbf/f127 0 2024-09-12T22:33:18.217 INFO:tasks.workunit.client.0.smithi019.stdout:9/986: dread dd/d10/d17/d23/d2e/d31/f46 [0,4194304] 0 2024-09-12T22:33:18.217 INFO:tasks.workunit.client.0.smithi019.stdout:9/987: readlink dd/l1a 0 2024-09-12T22:33:18.218 INFO:tasks.workunit.client.0.smithi019.stdout:3/933: dread dd/d1e/d5a/f7f [0,4194304] 0 2024-09-12T22:33:18.219 INFO:tasks.workunit.client.0.smithi019.stdout:9/988: rename dd/d10/d17/d76/dcc/fd7 to dd/d10/d17/d23/d2e/f13b 0 2024-09-12T22:33:18.219 INFO:tasks.workunit.client.0.smithi019.stdout:3/934: read dd/d12/f4c [45,66799] 0 2024-09-12T22:33:18.220 INFO:tasks.workunit.client.0.smithi019.stdout:9/989: stat dd/d10/d17/d23/d2e/d31/d3f/d47/l51 0 2024-09-12T22:33:18.221 INFO:tasks.workunit.client.0.smithi019.stdout:9/990: dread - dd/d10/d17/d23/d2e/d31/d3f/f13a zero size 2024-09-12T22:33:18.222 INFO:tasks.workunit.client.0.smithi019.stdout:9/991: write dd/d10/d17/d23/d2e/d31/d3f/d47/d6e/d80/fc6 [862916,110638] 0 2024-09-12T22:33:18.223 INFO:tasks.workunit.client.0.smithi019.stdout:9/992: rmdir dd/d10/d17/d76 39 2024-09-12T22:33:18.224 INFO:tasks.workunit.client.0.smithi019.stdout:7/951: dread d6/d14/d15/f18 [0,4194304] 0 2024-09-12T22:33:18.224 INFO:tasks.workunit.client.0.smithi019.stdout:3/935: dwrite dd/d1e/d40/fb8 [0,4194304] 0 2024-09-12T22:33:18.224 INFO:tasks.workunit.client.0.smithi019.stdout:9/993: chown dd/d10/d17/c40 113 1 2024-09-12T22:33:18.226 INFO:tasks.workunit.client.0.smithi019.stdout:7/952: rmdir d6/d2d/d77/dbf/dde/d105/d111 0 2024-09-12T22:33:18.226 INFO:tasks.workunit.client.0.smithi019.stdout:9/994: write dd/d10/d17/d22/d6c/d53/d69/d9d/dbd/f12c [682429,125157] 0 2024-09-12T22:33:18.226 INFO:tasks.workunit.client.0.smithi019.stdout:7/953: fsync d6/d2d/d77/dbf/dde/f104 0 2024-09-12T22:33:18.226 INFO:tasks.workunit.client.0.smithi019.stdout:9/995: mknod dd/d10/d17/c13c 0 2024-09-12T22:33:18.227 INFO:tasks.workunit.client.0.smithi019.stdout:7/954: readlink d6/d14/d15/l25 0 2024-09-12T22:33:18.228 INFO:tasks.workunit.client.0.smithi019.stdout:7/955: mknod d6/d14/d15/d8b/d14b/c15f 0 2024-09-12T22:33:18.228 INFO:tasks.workunit.client.0.smithi019.stdout:3/936: dwrite dd/d1e/d40/f4a [0,4194304] 0 2024-09-12T22:33:18.229 INFO:tasks.workunit.client.0.smithi019.stdout:7/956: symlink d6/d2d/d3d/l160 0 2024-09-12T22:33:18.230 INFO:tasks.workunit.client.0.smithi019.stdout:3/937: write dd/d12/f29 [2014751,44145] 0 2024-09-12T22:33:18.230 INFO:tasks.workunit.client.0.smithi019.stdout:7/957: mknod d6/d14/d2a/da4/d34/c161 0 2024-09-12T22:33:18.231 INFO:tasks.workunit.client.0.smithi019.stdout:7/958: symlink d6/d14/d15/d8b/l162 0 2024-09-12T22:33:18.232 INFO:tasks.workunit.client.0.smithi019.stdout:3/938: getdents dd/d1e/d40/d6e/dff 0 2024-09-12T22:33:18.232 INFO:tasks.workunit.client.0.smithi019.stdout:9/996: dwrite dd/d10/d17/d23/d2e/d31/d7e/dbc/faa [0,4194304] 0 2024-09-12T22:33:18.233 INFO:tasks.workunit.client.0.smithi019.stdout:3/939: fsync dd/d12/d62/d74/daa/fb7 0 2024-09-12T22:33:18.233 INFO:tasks.workunit.client.0.smithi019.stdout:7/959: creat d6/d2d/f163 x:0 0 0 2024-09-12T22:33:18.233 INFO:tasks.workunit.client.0.smithi019.stdout:3/940: creat dd/d1e/d40/da6/dba/f120 x:0 0 0 2024-09-12T22:33:18.235 INFO:tasks.workunit.client.0.smithi019.stdout:3/941: truncate dd/d1e/d5a/f64 3349663 0 2024-09-12T22:33:18.236 INFO:tasks.workunit.client.0.smithi019.stdout:3/942: symlink dd/d1e/d40/da6/dba/l121 0 2024-09-12T22:33:18.238 INFO:tasks.workunit.client.0.smithi019.stdout:9/997: dwrite dd/d10/d17/d23/d2e/d31/d3f/d67/fd4 [0,4194304] 0 2024-09-12T22:33:18.243 INFO:tasks.workunit.client.0.smithi019.stdout:3/943: dwrite dd/d1e/d5a/f99 [0,4194304] 0 2024-09-12T22:33:18.245 INFO:tasks.workunit.client.0.smithi019.stdout:7/960: dwrite d6/d14/d15/d8b/d103/f14a [0,4194304] 0 2024-09-12T22:33:18.245 INFO:tasks.workunit.client.0.smithi019.stdout:3/944: write dd/d1e/d40/da6/dba/fea [66445,82006] 0 2024-09-12T22:33:18.245 INFO:tasks.workunit.client.0.smithi019.stdout:9/998: dwrite dd/d10/d17/d23/d82/d87/d11e/f121 [0,4194304] 0 2024-09-12T22:33:18.246 INFO:tasks.workunit.client.0.smithi019.stdout:3/945: mkdir dd/d12/d62/d10a/d122 0 2024-09-12T22:33:18.253 INFO:tasks.workunit.client.0.smithi019.stdout:3/946: dwrite dd/d1e/d40/d5f/f66 [0,4194304] 0 2024-09-12T22:33:18.254 INFO:tasks.workunit.client.0.smithi019.stdout:3/947: rmdir dd 39 2024-09-12T22:33:18.254 INFO:tasks.workunit.client.0.smithi019.stdout:7/961: write d6/d14/d2a/da4/f44 [3033262,80970] 0 2024-09-12T22:33:18.255 INFO:tasks.workunit.client.0.smithi019.stdout:3/948: mknod dd/d12/d62/d10a/d111/c123 0 2024-09-12T22:33:18.259 INFO:tasks.workunit.client.0.smithi019.stdout:7/962: dwrite d6/d14/d15/d8b/d103/f14a [4194304,4194304] 0 2024-09-12T22:33:18.269 INFO:tasks.workunit.client.0.smithi019.stdout:3/949: dwrite dd/d12/d62/d74/fec [0,4194304] 0 2024-09-12T22:33:18.269 INFO:tasks.workunit.client.0.smithi019.stdout:3/950: dread - dd/d12/d62/d74/ffb zero size 2024-09-12T22:33:18.272 INFO:tasks.workunit.client.0.smithi019.stdout:7/963: dread d6/d14/d15/d62/f91 [0,4194304] 0 2024-09-12T22:33:18.272 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:18.270+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:18.274 INFO:tasks.workunit.client.0.smithi019.stdout:3/951: read dd/d12/d62/d74/daa/fb7 [2271967,117201] 0 2024-09-12T22:33:18.274 INFO:tasks.workunit.client.0.smithi019.stdout:3/952: fsync dd/f91 0 2024-09-12T22:33:18.275 INFO:tasks.workunit.client.0.smithi019.stdout:7/964: dwrite d6/d14/d15/f5e [0,4194304] 0 2024-09-12T22:33:18.275 INFO:tasks.workunit.client.0.smithi019.stdout:3/953: rename dd/d1e/d40/da6/lc7 to dd/d12/d62/d10a/l124 0 2024-09-12T22:33:18.276 INFO:tasks.workunit.client.0.smithi019.stdout:3/954: fdatasync dd/f26 0 2024-09-12T22:33:18.279 INFO:tasks.workunit.client.0.smithi019.stdout:7/965: dwrite d6/d2d/d77/dbf/f127 [0,4194304] 0 2024-09-12T22:33:18.280 INFO:tasks.workunit.client.0.smithi019.stdout:7/966: creat d6/d2d/d77/dbf/dde/f164 x:0 0 0 2024-09-12T22:33:18.283 INFO:tasks.workunit.client.0.smithi019.stdout:7/967: rename d6/d2d/de0/f115 to d6/d2d/d8f/daf/f165 0 2024-09-12T22:33:18.283 INFO:tasks.workunit.client.0.smithi019.stdout:7/968: mkdir d6/d2d/d166 0 2024-09-12T22:33:18.285 INFO:tasks.workunit.client.0.smithi019.stdout:7/969: fdatasync d6/d2d/fe6 0 2024-09-12T22:33:18.289 INFO:tasks.workunit.client.0.smithi019.stdout:3/955: write dd/d1e/d5a/f64 [2142629,74254] 0 2024-09-12T22:33:18.289 INFO:tasks.workunit.client.0.smithi019.stdout:3/956: chown dd/d1e/f7e 59351 1 2024-09-12T22:33:18.289 INFO:tasks.workunit.client.0.smithi019.stdout:9/999: dread dd/f9e [0,4194304] 0 2024-09-12T22:33:18.290 INFO:tasks.workunit.client.0.smithi019.stdout:3/957: write dd/d1e/d5a/f99 [846862,45179] 0 2024-09-12T22:33:18.291 INFO:tasks.workunit.client.0.smithi019.stdout:3/958: mkdir dd/d12/d62/d74/d125 0 2024-09-12T22:33:18.297 INFO:tasks.workunit.client.0.smithi019.stdout:3/959: dread dd/d1e/d40/da6/dba/fea [0,4194304] 0 2024-09-12T22:33:18.297 INFO:tasks.workunit.client.0.smithi019.stdout:3/960: write dd/d1e/d40/fd6 [873228,26120] 0 2024-09-12T22:33:18.298 INFO:tasks.workunit.client.0.smithi019.stdout:3/961: fsync dd/d1e/d40/f90 0 2024-09-12T22:33:18.298 INFO:tasks.workunit.client.0.smithi019.stdout:3/962: chown dd/d12/d62/d74/ffb 5 1 2024-09-12T22:33:18.299 INFO:tasks.workunit.client.0.smithi019.stdout:3/963: creat dd/d1e/d40/f126 x:0 0 0 2024-09-12T22:33:18.300 INFO:tasks.workunit.client.0.smithi019.stdout:3/964: write dd/d1e/d40/da6/dba/fea [1336914,53849] 0 2024-09-12T22:33:18.301 INFO:tasks.workunit.client.0.smithi019.stdout:3/965: dread - dd/d12/d62/d74/f115 zero size 2024-09-12T22:33:18.301 INFO:tasks.workunit.client.0.smithi019.stdout:3/966: fsync dd/d12/d62/d74/daa/fd2 0 2024-09-12T22:33:18.304 INFO:tasks.workunit.client.0.smithi019.stdout:3/967: dwrite dd/f107 [0,4194304] 0 2024-09-12T22:33:18.305 INFO:tasks.workunit.client.0.smithi019.stdout:3/968: write dd/d12/d62/d74/daa/fd2 [91089,22542] 0 2024-09-12T22:33:18.306 INFO:tasks.workunit.client.0.smithi019.stdout:3/969: read - dd/d12/d62/fac zero size 2024-09-12T22:33:18.307 INFO:tasks.workunit.client.0.smithi019.stdout:3/970: truncate dd/d1e/d40/d6e/fa1 1289642 0 2024-09-12T22:33:18.310 INFO:tasks.workunit.client.0.smithi019.stdout:3/971: dwrite dd/d1e/f3c [8388608,4194304] 0 2024-09-12T22:33:18.311 INFO:tasks.workunit.client.0.smithi019.stdout:3/972: write dd/d1e/f23 [4274119,128742] 0 2024-09-12T22:33:18.312 INFO:tasks.workunit.client.0.smithi019.stdout:3/973: dread - dd/d12/d62/d78/fd7 zero size 2024-09-12T22:33:18.314 INFO:tasks.workunit.client.0.smithi019.stdout:3/974: dread dd/d1e/d40/f6f [0,4194304] 0 2024-09-12T22:33:18.315 INFO:tasks.workunit.client.0.smithi019.stdout:3/975: rmdir dd/d1e/de6 0 2024-09-12T22:33:18.316 INFO:tasks.workunit.client.0.smithi019.stdout:3/976: link dd/d12/d62/le2 dd/d1e/d82/d101/l127 0 2024-09-12T22:33:18.317 INFO:tasks.workunit.client.0.smithi019.stdout:3/977: truncate dd/d1e/d40/fd3 709761 0 2024-09-12T22:33:18.318 INFO:tasks.workunit.client.0.smithi019.stdout:3/978: getdents dd/d12/d62/d74/d125 0 2024-09-12T22:33:18.319 INFO:tasks.workunit.client.0.smithi019.stdout:3/979: link dd/d12/dbe/fc5 dd/d1e/d5a/f128 0 2024-09-12T22:33:18.319 INFO:tasks.workunit.client.0.smithi019.stdout:3/980: truncate f2 3144014 0 2024-09-12T22:33:18.324 INFO:tasks.workunit.client.0.smithi019.stdout:3/981: truncate dd/d1e/fee 954929 0 2024-09-12T22:33:18.328 INFO:tasks.workunit.client.0.smithi019.stdout:3/982: dwrite dd/d12/f2c [0,4194304] 0 2024-09-12T22:33:18.329 INFO:tasks.workunit.client.0.smithi019.stdout:3/983: unlink dd/d1e/d5a/fbb 0 2024-09-12T22:33:18.330 INFO:tasks.workunit.client.0.smithi019.stdout:3/984: mkdir dd/d1e/d82/d101/d129 0 2024-09-12T22:33:18.330 INFO:tasks.workunit.client.0.smithi019.stdout:3/985: fdatasync dd/d12/f48 0 2024-09-12T22:33:18.334 INFO:tasks.workunit.client.0.smithi019.stdout:3/986: dwrite f5 [4194304,4194304] 0 2024-09-12T22:33:18.335 INFO:tasks.workunit.client.0.smithi019.stdout:3/987: link dd/d1e/d40/c42 dd/d12/d62/d78/dde/c12a 0 2024-09-12T22:33:18.336 INFO:tasks.workunit.client.0.smithi019.stdout:3/988: symlink dd/d12/l12b 0 2024-09-12T22:33:18.337 INFO:tasks.workunit.client.0.smithi019.stdout:3/989: mkdir dd/d12/d62/d74/d125/d12c 0 2024-09-12T22:33:18.340 INFO:tasks.workunit.client.0.smithi019.stdout:3/990: dwrite dd/d12/f55 [0,4194304] 0 2024-09-12T22:33:18.342 INFO:tasks.workunit.client.0.smithi019.stdout:3/991: link dd/c77 dd/d1e/d40/d6e/d70/c12d 0 2024-09-12T22:33:18.342 INFO:tasks.workunit.client.0.smithi019.stdout:7/970: sync 2024-09-12T22:33:18.343 INFO:tasks.workunit.client.0.smithi019.stdout:7/971: unlink d6/d14/d2a/da4/dc/c112 0 2024-09-12T22:33:18.343 INFO:tasks.workunit.client.0.smithi019.stdout:7/972: chown d6/d14/d45/dca/c159 51987918 1 2024-09-12T22:33:18.344 INFO:tasks.workunit.client.0.smithi019.stdout:7/973: creat d6/d2d/d12a/f167 x:0 0 0 2024-09-12T22:33:18.345 INFO:tasks.workunit.client.0.smithi019.stdout:7/974: rename d6/d14/d15/d62/d6a/ce1 to d6/d2d/d77/d8e/c168 0 2024-09-12T22:33:18.346 INFO:tasks.workunit.client.0.smithi019.stdout:7/975: mkdir d6/dcf/d169 0 2024-09-12T22:33:18.350 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-09-12T22:33:18.350 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-09-12T22:33:18.350 INFO:teuthology.orchestra.run.smithi163.stdout: "complaint_time": 30, 2024-09-12T22:33:18.351 INFO:teuthology.orchestra.run.smithi163.stdout: "num_blocked_ops": 0 2024-09-12T22:33:18.351 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-09-12T22:33:18.360 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:33:18.403 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:18.402+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:18.468 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-09-12T22:33:18.468 INFO:teuthology.orchestra.run.smithi163.stdout: "size": 20, 2024-09-12T22:33:18.468 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 600, 2024-09-12T22:33:18.468 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2024-09-12T22:33:18.468 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.468 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-09-12T22:33:18.468 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:27.254459+0000", 2024-09-12T22:33:18.469 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 111.21142060699999, 2024-09-12T22:33:18.469 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.37816283899999997, 2024-09-12T22:33:18.469 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:18.469 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:18.469 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:18.469 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:18.469 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:33:18.469 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:33:18.469 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 1 2024-09-12T22:33:18.469 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.469 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:18.469 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.470 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:18.470 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254459+0000", 2024-09-12T22:33:18.470 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:18.470 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.470 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.470 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:18.470 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254459+0000", 2024-09-12T22:33:18.470 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:18.470 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.470 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.470 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:18.470 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254460+0000", 2024-09-12T22:33:18.470 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1739999999999999e-06 2024-09-12T22:33:18.470 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.471 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.471 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:18.471 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254472+0000", 2024-09-12T22:33:18.472 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2207e-05 2024-09-12T22:33:18.472 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.472 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.472 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:18.472 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254483+0000", 2024-09-12T22:33:18.473 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0631999999999999e-05 2024-09-12T22:33:18.473 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.473 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.473 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:18.473 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254492+0000", 2024-09-12T22:33:18.473 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3670000000000003e-06 2024-09-12T22:33:18.473 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.473 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.473 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:18.473 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254551+0000", 2024-09-12T22:33:18.473 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8687999999999998e-05 2024-09-12T22:33:18.473 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.473 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.474 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for peered", 2024-09-12T22:33:18.474 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254562+0000", 2024-09-12T22:33:18.474 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1249e-05 2024-09-12T22:33:18.474 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.474 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.474 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:18.474 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.631211+0000", 2024-09-12T22:33:18.474 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.376649018 2024-09-12T22:33:18.474 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.474 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.474 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:18.474 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.631345+0000", 2024-09-12T22:33:18.474 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013378700000000001 2024-09-12T22:33:18.475 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.475 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.475 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:33:18.475 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.631479+0000", 2024-09-12T22:33:18.475 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013352399999999999 2024-09-12T22:33:18.475 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.475 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.475 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:18.475 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632324+0000", 2024-09-12T22:33:18.475 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00084508100000000002 2024-09-12T22:33:18.475 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.475 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.475 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:18.475 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632548+0000", 2024-09-12T22:33:18.476 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000224329 2024-09-12T22:33:18.476 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.476 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.476 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:18.476 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632591+0000", 2024-09-12T22:33:18.476 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2564000000000001e-05 2024-09-12T22:33:18.476 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.476 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.476 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:18.476 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632622+0000", 2024-09-12T22:33:18.476 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1219e-05 2024-09-12T22:33:18.476 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:18.476 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:18.477 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:18.477 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.477 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.477 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4490.0:9871 4.35 4:ad66404a:::10000002d4d.00000000:head [write 0~6507] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:33:18.477 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:09.472309+0000", 2024-09-12T22:33:18.477 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 8.9935703310000008, 2024-09-12T22:33:18.477 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.080251445000000005, 2024-09-12T22:33:18.477 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:18.477 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:18.477 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:18.477 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:18.477 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4490", 2024-09-12T22:33:18.477 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:18.478 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 9871 2024-09-12T22:33:18.478 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.478 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:18.478 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.478 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:18.478 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.472309+0000", 2024-09-12T22:33:18.478 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:18.478 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.478 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.478 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:18.478 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.472309+0000", 2024-09-12T22:33:18.478 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:18.478 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.478 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.479 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:18.479 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.472310+0000", 2024-09-12T22:33:18.479 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3799999999999996e-07 2024-09-12T22:33:18.479 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.479 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.479 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:18.479 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.472318+0000", 2024-09-12T22:33:18.479 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.8099999999999998e-06 2024-09-12T22:33:18.479 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.479 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.479 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:18.479 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.472328+0000", 2024-09-12T22:33:18.479 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0359e-05 2024-09-12T22:33:18.479 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.480 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.480 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:18.480 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.472334+0000", 2024-09-12T22:33:18.480 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.0109999999999997e-06 2024-09-12T22:33:18.480 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.480 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.480 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:18.480 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.472382+0000", 2024-09-12T22:33:18.480 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.7311000000000002e-05 2024-09-12T22:33:18.480 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.480 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.480 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:18.480 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.472497+0000", 2024-09-12T22:33:18.481 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011537800000000001 2024-09-12T22:33:18.481 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.481 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.481 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:18.481 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.472617+0000", 2024-09-12T22:33:18.481 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011989600000000001 2024-09-12T22:33:18.481 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.481 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.481 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:18.481 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473149+0000", 2024-09-12T22:33:18.481 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00053227999999999999 2024-09-12T22:33:18.481 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.481 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.482 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:18.482 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.552479+0000", 2024-09-12T22:33:18.482 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.079329541000000003 2024-09-12T22:33:18.482 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.482 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.482 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:18.482 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.552525+0000", 2024-09-12T22:33:18.482 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6421000000000002e-05 2024-09-12T22:33:18.482 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.482 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.482 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:18.482 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.552561+0000", 2024-09-12T22:33:18.482 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5599999999999998e-05 2024-09-12T22:33:18.482 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:18.483 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:18.483 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:18.483 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.483 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.483 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4490.0:9872 4.2c 4:3602c8d3:::10000002d4e.00000000:head [write 0~1178] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:33:18.483 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:09.473085+0000", 2024-09-12T22:33:18.483 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 8.9927950269999997, 2024-09-12T22:33:18.483 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.079631104999999994, 2024-09-12T22:33:18.483 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:18.483 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:18.483 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:18.483 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:18.483 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4490", 2024-09-12T22:33:18.483 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:18.484 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 9872 2024-09-12T22:33:18.484 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.484 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:18.484 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.484 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:18.484 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473085+0000", 2024-09-12T22:33:18.484 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:18.484 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.484 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.484 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:18.484 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473085+0000", 2024-09-12T22:33:18.484 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:18.484 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.485 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.485 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:18.485 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473085+0000", 2024-09-12T22:33:18.485 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3600000000000004e-07 2024-09-12T22:33:18.485 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.485 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.485 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:18.485 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473088+0000", 2024-09-12T22:33:18.485 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.005e-06 2024-09-12T22:33:18.485 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.486 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.486 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:18.486 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473095+0000", 2024-09-12T22:33:18.486 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3950000000000003e-06 2024-09-12T22:33:18.486 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.486 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.486 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:18.486 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473100+0000", 2024-09-12T22:33:18.486 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5460000000000002e-06 2024-09-12T22:33:18.486 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.486 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.486 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:18.486 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473138+0000", 2024-09-12T22:33:18.487 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8244999999999997e-05 2024-09-12T22:33:18.487 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.487 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.487 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:18.487 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473216+0000", 2024-09-12T22:33:18.487 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.7756000000000006e-05 2024-09-12T22:33:18.487 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.487 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.487 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:18.487 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473291+0000", 2024-09-12T22:33:18.488 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5110000000000004e-05 2024-09-12T22:33:18.488 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.488 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.488 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:18.488 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473736+0000", 2024-09-12T22:33:18.488 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00044486500000000002 2024-09-12T22:33:18.488 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.488 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.488 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:18.488 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.552637+0000", 2024-09-12T22:33:18.488 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.078900782000000003 2024-09-12T22:33:18.488 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.488 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.489 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:18.489 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.552680+0000", 2024-09-12T22:33:18.489 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3047999999999998e-05 2024-09-12T22:33:18.489 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.489 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.489 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:18.489 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.552716+0000", 2024-09-12T22:33:18.489 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5816999999999999e-05 2024-09-12T22:33:18.489 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:18.489 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:18.489 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:18.489 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.489 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.489 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4490.0:9873 4.2c 4:372c52ff:::10000002d4f.00000000:head [write 0~1230] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:33:18.490 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:09.473878+0000", 2024-09-12T22:33:18.490 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 8.9920015640000006, 2024-09-12T22:33:18.490 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.079036047999999998, 2024-09-12T22:33:18.490 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:18.490 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:18.490 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:18.490 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:18.490 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4490", 2024-09-12T22:33:18.490 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:18.490 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 9873 2024-09-12T22:33:18.490 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.490 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:18.490 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.491 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:18.491 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473878+0000", 2024-09-12T22:33:18.491 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:18.491 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.491 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.491 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:18.491 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473878+0000", 2024-09-12T22:33:18.491 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:18.491 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.491 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.491 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:18.491 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473879+0000", 2024-09-12T22:33:18.491 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9100000000000004e-07 2024-09-12T22:33:18.491 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.492 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.492 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:18.492 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473882+0000", 2024-09-12T22:33:18.492 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.405e-06 2024-09-12T22:33:18.492 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.492 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.492 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:18.492 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473889+0000", 2024-09-12T22:33:18.492 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7519999999999999e-06 2024-09-12T22:33:18.492 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.492 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.492 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:18.492 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473893+0000", 2024-09-12T22:33:18.492 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9310000000000001e-06 2024-09-12T22:33:18.493 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.493 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.493 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:18.493 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473922+0000", 2024-09-12T22:33:18.493 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9346999999999999e-05 2024-09-12T22:33:18.493 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.493 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.493 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:18.493 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474000+0000", 2024-09-12T22:33:18.493 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.7972000000000005e-05 2024-09-12T22:33:18.493 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.493 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.493 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:18.493 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474072+0000", 2024-09-12T22:33:18.494 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1960999999999998e-05 2024-09-12T22:33:18.494 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.494 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.494 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:18.494 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474470+0000", 2024-09-12T22:33:18.494 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00039803400000000002 2024-09-12T22:33:18.494 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.494 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.494 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:18.494 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.552814+0000", 2024-09-12T22:33:18.494 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.078344164999999993 2024-09-12T22:33:18.494 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.494 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.494 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:18.494 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.552875+0000", 2024-09-12T22:33:18.495 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1008999999999998e-05 2024-09-12T22:33:18.495 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.495 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.495 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:18.495 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.552914+0000", 2024-09-12T22:33:18.495 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8881000000000003e-05 2024-09-12T22:33:18.495 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:18.495 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:18.495 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:18.495 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.495 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.495 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4490.0:9874 4.1b 4:db19d96a:::10000002d50.00000000:head [write 0~1088] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:33:18.495 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:09.474673+0000", 2024-09-12T22:33:18.496 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 8.9912065709999993, 2024-09-12T22:33:18.496 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.080314317999999996, 2024-09-12T22:33:18.496 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:18.496 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:18.496 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:18.496 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:18.496 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4490", 2024-09-12T22:33:18.496 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:18.496 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 9874 2024-09-12T22:33:18.496 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.496 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:18.496 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.496 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:18.497 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474673+0000", 2024-09-12T22:33:18.497 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:18.497 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.497 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.497 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:18.497 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474673+0000", 2024-09-12T22:33:18.497 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:18.497 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.497 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.497 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:18.497 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474674+0000", 2024-09-12T22:33:18.497 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6199999999999998e-07 2024-09-12T22:33:18.497 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.498 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.498 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:18.498 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474677+0000", 2024-09-12T22:33:18.498 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.224e-06 2024-09-12T22:33:18.498 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.498 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.498 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:18.498 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474683+0000", 2024-09-12T22:33:18.498 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.3160000000000002e-06 2024-09-12T22:33:18.498 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.498 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.498 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:18.499 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474687+0000", 2024-09-12T22:33:18.499 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7869999999999999e-06 2024-09-12T22:33:18.499 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.499 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.499 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:18.499 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474730+0000", 2024-09-12T22:33:18.499 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3309000000000002e-05 2024-09-12T22:33:18.499 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.499 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.499 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:18.499 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474845+0000", 2024-09-12T22:33:18.499 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114306 2024-09-12T22:33:18.499 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.500 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.500 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:18.500 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474970+0000", 2024-09-12T22:33:18.500 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000125096 2024-09-12T22:33:18.500 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.500 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.500 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:18.500 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.475621+0000", 2024-09-12T22:33:18.500 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00065124900000000001 2024-09-12T22:33:18.500 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.500 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.501 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:18.501 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.554885+0000", 2024-09-12T22:33:18.501 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.079264055 2024-09-12T22:33:18.501 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.501 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.501 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:18.501 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.554942+0000", 2024-09-12T22:33:18.501 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7284000000000002e-05 2024-09-12T22:33:18.501 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.501 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.501 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:18.501 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.554987+0000", 2024-09-12T22:33:18.501 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5130000000000003e-05 2024-09-12T22:33:18.501 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:18.501 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:18.502 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:18.502 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.502 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.502 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4490.0:12220 4.2b 4:d55bfd66:::10000003169.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-12T22:33:18.502 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.391333+0000", 2024-09-12T22:33:18.502 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 4.0745464279999997, 2024-09-12T22:33:18.502 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.088669550999999999, 2024-09-12T22:33:18.502 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:18.502 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:18.502 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:18.502 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:18.502 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4490", 2024-09-12T22:33:18.502 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:18.503 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 12220 2024-09-12T22:33:18.503 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.503 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:18.503 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.503 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:18.503 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.391333+0000", 2024-09-12T22:33:18.503 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:18.503 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.503 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.503 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:18.503 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.391333+0000", 2024-09-12T22:33:18.503 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:18.503 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.504 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.504 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:18.504 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.391334+0000", 2024-09-12T22:33:18.504 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3099999999999997e-07 2024-09-12T22:33:18.504 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.504 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.504 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:18.504 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398373+0000", 2024-09-12T22:33:18.504 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0070386670000000002 2024-09-12T22:33:18.504 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.504 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.504 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:18.504 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398384+0000", 2024-09-12T22:33:18.504 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1338999999999999e-05 2024-09-12T22:33:18.505 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.505 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.505 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:18.505 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398389+0000", 2024-09-12T22:33:18.505 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3650000000000003e-06 2024-09-12T22:33:18.505 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.505 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.505 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:18.505 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.456308+0000", 2024-09-12T22:33:18.505 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.057918931 2024-09-12T22:33:18.505 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.505 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.505 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:18.506 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.456425+0000", 2024-09-12T22:33:18.506 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000116452 2024-09-12T22:33:18.506 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.506 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.506 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:18.506 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.456536+0000", 2024-09-12T22:33:18.506 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000111839 2024-09-12T22:33:18.506 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.506 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.506 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:18.506 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.465335+0000", 2024-09-12T22:33:18.506 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0087984980000000001 2024-09-12T22:33:18.506 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.506 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.507 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:18.507 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.479950+0000", 2024-09-12T22:33:18.507 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.01461552 2024-09-12T22:33:18.507 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.507 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.507 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:18.507 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.479983+0000", 2024-09-12T22:33:18.507 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2126999999999999e-05 2024-09-12T22:33:18.507 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.507 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.507 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:18.507 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.480003+0000", 2024-09-12T22:33:18.507 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0081999999999998e-05 2024-09-12T22:33:18.508 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:18.508 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:18.508 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:18.508 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.508 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.508 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1208 3.13 3:cb3d3880:::200.0000000d:head [write 1009846~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:18.508 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.398459+0000", 2024-09-12T22:33:18.508 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 4.0674208619999996, 2024-09-12T22:33:18.508 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.078093931000000005, 2024-09-12T22:33:18.508 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:18.508 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:18.508 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:18.508 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:18.509 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.509 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:18.509 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398459+0000", 2024-09-12T22:33:18.509 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:18.509 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.509 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.509 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:18.509 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398459+0000", 2024-09-12T22:33:18.509 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:18.509 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.509 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.509 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:18.509 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398459+0000", 2024-09-12T22:33:18.509 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8100000000000003e-07 2024-09-12T22:33:18.510 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.510 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.510 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:18.510 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398462+0000", 2024-09-12T22:33:18.510 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3700000000000002e-06 2024-09-12T22:33:18.510 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.510 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.510 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:18.510 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398469+0000", 2024-09-12T22:33:18.510 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2320000000000004e-06 2024-09-12T22:33:18.510 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.510 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.510 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:18.510 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398472+0000", 2024-09-12T22:33:18.511 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.658e-06 2024-09-12T22:33:18.511 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.511 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.511 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:18.511 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.456690+0000", 2024-09-12T22:33:18.511 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.058217615 2024-09-12T22:33:18.511 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.511 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.511 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:18.511 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.456731+0000", 2024-09-12T22:33:18.511 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0815000000000001e-05 2024-09-12T22:33:18.511 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.511 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.512 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:18.512 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.456793+0000", 2024-09-12T22:33:18.512 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1796000000000003e-05 2024-09-12T22:33:18.512 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.512 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.512 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:18.512 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.461412+0000", 2024-09-12T22:33:18.512 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0046188560000000002 2024-09-12T22:33:18.512 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.512 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.512 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:18.512 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476429+0000", 2024-09-12T22:33:18.512 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.015017943000000001 2024-09-12T22:33:18.512 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.513 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.513 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:18.513 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476499+0000", 2024-09-12T22:33:18.513 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9047000000000005e-05 2024-09-12T22:33:18.513 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.513 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.513 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:18.513 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476553+0000", 2024-09-12T22:33:18.513 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4117999999999999e-05 2024-09-12T22:33:18.513 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:18.513 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:18.513 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:18.513 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.514 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.514 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1209 3.13 3:cb3d3880:::200.0000000d:head [write 1011245~5867 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:18.514 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.398677+0000", 2024-09-12T22:33:18.514 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 4.0672023050000004, 2024-09-12T22:33:18.514 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.077995698000000002, 2024-09-12T22:33:18.514 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:18.514 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:18.514 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:18.514 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:18.514 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.514 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:18.514 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398677+0000", 2024-09-12T22:33:18.514 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:18.515 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.515 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.515 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:18.515 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398677+0000", 2024-09-12T22:33:18.515 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:18.515 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.515 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.515 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:18.515 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398678+0000", 2024-09-12T22:33:18.515 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5199999999999995e-07 2024-09-12T22:33:18.516 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.516 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.516 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:18.516 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398686+0000", 2024-09-12T22:33:18.516 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0579999999999998e-06 2024-09-12T22:33:18.516 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.516 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.516 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:18.516 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398695+0000", 2024-09-12T22:33:18.516 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.1409999999999994e-06 2024-09-12T22:33:18.516 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.516 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.516 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:18.517 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398703+0000", 2024-09-12T22:33:18.517 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4379999999999998e-06 2024-09-12T22:33:18.517 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.517 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.517 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:18.517 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.457051+0000", 2024-09-12T22:33:18.517 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.058348358000000003 2024-09-12T22:33:18.517 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.517 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.517 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:18.517 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.457096+0000", 2024-09-12T22:33:18.517 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4428000000000002e-05 2024-09-12T22:33:18.517 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.517 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.518 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:18.518 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.457162+0000", 2024-09-12T22:33:18.518 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6298999999999997e-05 2024-09-12T22:33:18.518 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.518 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.518 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:18.518 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.461416+0000", 2024-09-12T22:33:18.518 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0042539980000000002 2024-09-12T22:33:18.519 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.519 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.519 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:18.519 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476610+0000", 2024-09-12T22:33:18.519 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.015193879 2024-09-12T22:33:18.519 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.519 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.519 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:18.519 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476640+0000", 2024-09-12T22:33:18.519 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0648000000000002e-05 2024-09-12T22:33:18.519 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.519 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.519 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:18.520 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476673+0000", 2024-09-12T22:33:18.520 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2598999999999997e-05 2024-09-12T22:33:18.520 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:18.520 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:18.520 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:18.520 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.520 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.520 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1210 3.13 3:cb3d3880:::200.0000000d:head [write 1017112~1958 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:18.520 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.398713+0000", 2024-09-12T22:33:18.520 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 4.0671669819999998, 2024-09-12T22:33:18.520 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.078118317000000007, 2024-09-12T22:33:18.520 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:18.520 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:18.521 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:18.521 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:18.521 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.521 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:18.521 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398713+0000", 2024-09-12T22:33:18.521 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:18.521 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.521 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.521 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:18.521 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398713+0000", 2024-09-12T22:33:18.521 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:18.521 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.521 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.521 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:18.522 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398713+0000", 2024-09-12T22:33:18.522 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7599999999999998e-07 2024-09-12T22:33:18.522 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.522 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.522 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:18.522 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398718+0000", 2024-09-12T22:33:18.522 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8169999999999998e-06 2024-09-12T22:33:18.522 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.522 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.522 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:18.522 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398722+0000", 2024-09-12T22:33:18.522 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5249999999999999e-06 2024-09-12T22:33:18.522 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.523 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.523 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:18.523 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398726+0000", 2024-09-12T22:33:18.523 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5650000000000002e-06 2024-09-12T22:33:18.523 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.523 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.523 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:18.523 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.457644+0000", 2024-09-12T22:33:18.523 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.058918521000000001 2024-09-12T22:33:18.523 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.523 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.523 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:18.523 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.457724+0000", 2024-09-12T22:33:18.523 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9408999999999998e-05 2024-09-12T22:33:18.524 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.524 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.524 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:18.524 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.457821+0000", 2024-09-12T22:33:18.524 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.7015000000000005e-05 2024-09-12T22:33:18.524 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.524 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.524 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:18.524 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.461419+0000", 2024-09-12T22:33:18.524 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0035985309999999999 2024-09-12T22:33:18.524 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.524 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.524 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:18.524 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476726+0000", 2024-09-12T22:33:18.525 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.015306804 2024-09-12T22:33:18.525 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.525 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.525 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:18.525 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476787+0000", 2024-09-12T22:33:18.525 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1062000000000006e-05 2024-09-12T22:33:18.525 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.525 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.525 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:18.525 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476831+0000", 2024-09-12T22:33:18.525 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3692000000000001e-05 2024-09-12T22:33:18.525 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:18.525 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:18.526 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:18.526 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.526 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.526 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1211 3.13 3:cb3d3880:::200.0000000d:head [write 1019070~5873 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:18.526 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.400122+0000", 2024-09-12T22:33:18.526 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 4.0657572640000001, 2024-09-12T22:33:18.526 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.076797146999999996, 2024-09-12T22:33:18.526 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:18.526 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:18.526 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:18.526 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:18.526 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.526 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:18.526 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.400122+0000", 2024-09-12T22:33:18.527 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:18.527 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.527 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.527 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:18.527 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.400122+0000", 2024-09-12T22:33:18.527 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:18.527 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.527 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.527 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:18.527 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.400123+0000", 2024-09-12T22:33:18.527 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2500000000000005e-07 2024-09-12T22:33:18.527 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.527 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.527 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:18.528 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.400129+0000", 2024-09-12T22:33:18.528 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.319e-06 2024-09-12T22:33:18.528 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.528 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.528 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:18.528 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.400139+0000", 2024-09-12T22:33:18.528 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.5200000000000003e-06 2024-09-12T22:33:18.528 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.528 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.528 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:18.528 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.400143+0000", 2024-09-12T22:33:18.528 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.437e-06 2024-09-12T22:33:18.528 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.529 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.529 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:18.529 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.458159+0000", 2024-09-12T22:33:18.529 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.058015960999999998 2024-09-12T22:33:18.529 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.529 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.529 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:18.529 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.458201+0000", 2024-09-12T22:33:18.529 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1693000000000002e-05 2024-09-12T22:33:18.529 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.529 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.529 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:18.529 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.458267+0000", 2024-09-12T22:33:18.529 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5687999999999999e-05 2024-09-12T22:33:18.530 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.530 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.530 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:18.530 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.461423+0000", 2024-09-12T22:33:18.530 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0031560730000000001 2024-09-12T22:33:18.530 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.530 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.530 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:18.530 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476868+0000", 2024-09-12T22:33:18.530 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.015445108000000001 2024-09-12T22:33:18.530 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.530 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.530 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:18.531 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476897+0000", 2024-09-12T22:33:18.531 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9433000000000001e-05 2024-09-12T22:33:18.531 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.531 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.531 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:18.531 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476919+0000", 2024-09-12T22:33:18.531 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.2189999999999999e-05 2024-09-12T22:33:18.531 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:18.531 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:18.531 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:18.531 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.531 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.531 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1212 3.13 3:cb3d3880:::200.0000000d:head [write 1024943~3866 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:18.531 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.401707+0000", 2024-09-12T22:33:18.532 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 4.0641730589999998, 2024-09-12T22:33:18.532 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.075386625999999998, 2024-09-12T22:33:18.532 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:18.532 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:18.532 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:18.532 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:18.532 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.532 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:18.532 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.401707+0000", 2024-09-12T22:33:18.532 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:18.532 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.532 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.532 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:18.533 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.401707+0000", 2024-09-12T22:33:18.533 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:18.533 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.533 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.533 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:18.533 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.401707+0000", 2024-09-12T22:33:18.533 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7700000000000004e-07 2024-09-12T22:33:18.533 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.533 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.533 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:18.533 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.401713+0000", 2024-09-12T22:33:18.533 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6609999999999997e-06 2024-09-12T22:33:18.533 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.533 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.534 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:18.534 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.401726+0000", 2024-09-12T22:33:18.534 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.3088000000000001e-05 2024-09-12T22:33:18.534 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.534 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.534 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:18.534 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.401741+0000", 2024-09-12T22:33:18.534 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.5424e-05 2024-09-12T22:33:18.534 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.534 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.534 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:18.534 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.458853+0000", 2024-09-12T22:33:18.534 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.057111157000000003 2024-09-12T22:33:18.535 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.535 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.535 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:18.535 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.458898+0000", 2024-09-12T22:33:18.535 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5633999999999997e-05 2024-09-12T22:33:18.535 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.535 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.535 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:18.535 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.458972+0000", 2024-09-12T22:33:18.535 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3441000000000004e-05 2024-09-12T22:33:18.535 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.535 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.535 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:18.535 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.461426+0000", 2024-09-12T22:33:18.536 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0024542660000000001 2024-09-12T22:33:18.536 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.536 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.536 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:18.536 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476985+0000", 2024-09-12T22:33:18.536 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.015559513000000001 2024-09-12T22:33:18.536 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.536 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.536 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:18.536 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.477044+0000", 2024-09-12T22:33:18.536 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8156999999999999e-05 2024-09-12T22:33:18.536 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.536 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.536 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:18.537 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.477093+0000", 2024-09-12T22:33:18.537 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9607999999999997e-05 2024-09-12T22:33:18.537 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:18.537 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:18.537 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:18.537 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.537 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.537 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1213 3.13 3:cb3d3880:::200.0000000d:head [write 1028809~6329 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:18.537 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.403250+0000", 2024-09-12T22:33:18.537 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 4.0626295309999998, 2024-09-12T22:33:18.537 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.073936215999999999, 2024-09-12T22:33:18.537 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:18.537 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:18.538 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:18.538 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:18.538 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.538 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:18.538 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403250+0000", 2024-09-12T22:33:18.538 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:18.538 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.538 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.538 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:18.538 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403250+0000", 2024-09-12T22:33:18.538 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:18.538 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.538 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.539 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:18.539 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403251+0000", 2024-09-12T22:33:18.539 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.37e-07 2024-09-12T22:33:18.539 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.539 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.539 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:18.539 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403258+0000", 2024-09-12T22:33:18.539 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.25e-06 2024-09-12T22:33:18.539 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.539 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.539 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:18.539 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403269+0000", 2024-09-12T22:33:18.539 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0509000000000001e-05 2024-09-12T22:33:18.539 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.540 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.540 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:18.540 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403274+0000", 2024-09-12T22:33:18.540 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1290000000000004e-06 2024-09-12T22:33:18.540 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.540 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.540 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:18.540 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.459796+0000", 2024-09-12T22:33:18.540 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.056522020999999999 2024-09-12T22:33:18.540 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.540 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.540 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:18.540 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.459845+0000", 2024-09-12T22:33:18.541 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8884999999999997e-05 2024-09-12T22:33:18.541 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.541 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.541 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:18.541 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.459920+0000", 2024-09-12T22:33:18.541 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5318e-05 2024-09-12T22:33:18.541 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.541 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.541 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:18.541 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.466542+0000", 2024-09-12T22:33:18.541 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0066223139999999998 2024-09-12T22:33:18.541 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.541 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.542 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:18.542 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.477137+0000", 2024-09-12T22:33:18.542 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010594717 2024-09-12T22:33:18.542 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.542 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.542 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:18.542 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.477165+0000", 2024-09-12T22:33:18.542 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8262000000000001e-05 2024-09-12T22:33:18.542 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.542 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.542 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:18.542 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.477186+0000", 2024-09-12T22:33:18.542 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1073999999999998e-05 2024-09-12T22:33:18.543 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:18.543 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:18.543 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:18.543 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.543 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.543 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1214 3.13 3:cb3d3880:::200.0000000d:head [write 1035138~2606 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:18.543 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.403674+0000", 2024-09-12T22:33:18.543 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 4.0622056110000004, 2024-09-12T22:33:18.543 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.073643204000000004, 2024-09-12T22:33:18.543 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:18.543 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:18.543 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:18.543 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:18.543 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.544 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:18.544 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403674+0000", 2024-09-12T22:33:18.544 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:18.544 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.544 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.544 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:18.544 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403674+0000", 2024-09-12T22:33:18.544 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:18.544 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.544 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.544 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:18.544 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403674+0000", 2024-09-12T22:33:18.544 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.7700000000000005e-07 2024-09-12T22:33:18.545 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.545 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.545 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:18.545 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403678+0000", 2024-09-12T22:33:18.545 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2009999999999999e-06 2024-09-12T22:33:18.545 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.545 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.545 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:18.545 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403686+0000", 2024-09-12T22:33:18.545 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5690000000000005e-06 2024-09-12T22:33:18.545 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.545 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.545 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:18.545 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403690+0000", 2024-09-12T22:33:18.546 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.233e-06 2024-09-12T22:33:18.546 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.546 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.546 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:18.546 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.460445+0000", 2024-09-12T22:33:18.546 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.056754412999999997 2024-09-12T22:33:18.546 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.546 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.546 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:18.546 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.460495+0000", 2024-09-12T22:33:18.546 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0238999999999998e-05 2024-09-12T22:33:18.546 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.546 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.547 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:18.547 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.460566+0000", 2024-09-12T22:33:18.547 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1159000000000001e-05 2024-09-12T22:33:18.547 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.547 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.547 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:18.547 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.466546+0000", 2024-09-12T22:33:18.547 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0059798910000000002 2024-09-12T22:33:18.547 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.547 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.547 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:18.547 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.477232+0000", 2024-09-12T22:33:18.547 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010686084 2024-09-12T22:33:18.547 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.548 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.548 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:18.548 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.477280+0000", 2024-09-12T22:33:18.548 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.7719999999999997e-05 2024-09-12T22:33:18.548 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.548 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.548 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:18.548 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.477317+0000", 2024-09-12T22:33:18.548 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7218000000000002e-05 2024-09-12T22:33:18.548 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:18.548 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:18.548 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:18.548 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.548 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.549 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1223 3.13 3:cb3d3880:::200.0000000d:head [write 1090497~1913 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:18.549 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.420111+0000", 2024-09-12T22:33:18.549 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 4.0457684589999996, 2024-09-12T22:33:18.549 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.071634583000000002, 2024-09-12T22:33:18.549 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:18.549 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:18.549 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:18.549 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:18.549 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.549 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:18.549 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.420111+0000", 2024-09-12T22:33:18.549 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:18.549 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.549 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.550 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:18.550 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.420111+0000", 2024-09-12T22:33:18.550 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:18.550 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.550 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.550 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:18.550 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.420112+0000", 2024-09-12T22:33:18.550 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.2900000000000002e-07 2024-09-12T22:33:18.550 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.550 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.550 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:18.550 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.420116+0000", 2024-09-12T22:33:18.550 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.67e-06 2024-09-12T22:33:18.550 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.550 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.551 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:18.551 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.420125+0000", 2024-09-12T22:33:18.551 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.0890000000000006e-06 2024-09-12T22:33:18.551 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.551 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.551 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:18.551 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.420131+0000", 2024-09-12T22:33:18.551 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4269999999999996e-06 2024-09-12T22:33:18.551 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.551 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.551 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:18.551 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.465358+0000", 2024-09-12T22:33:18.551 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.045227030000000001 2024-09-12T22:33:18.551 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.552 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.552 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:18.552 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.465439+0000", 2024-09-12T22:33:18.552 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0901000000000004e-05 2024-09-12T22:33:18.552 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.552 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.552 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:18.552 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.465571+0000", 2024-09-12T22:33:18.552 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000131705 2024-09-12T22:33:18.552 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.552 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.552 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:18.552 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.469496+0000", 2024-09-12T22:33:18.552 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.003925418 2024-09-12T22:33:18.553 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.553 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.553 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:18.553 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.491669+0000", 2024-09-12T22:33:18.553 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.022172335000000001 2024-09-12T22:33:18.553 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.553 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.553 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:18.553 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.491714+0000", 2024-09-12T22:33:18.553 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5417000000000002e-05 2024-09-12T22:33:18.553 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.553 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.553 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:18.553 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.491746+0000", 2024-09-12T22:33:18.554 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1662000000000003e-05 2024-09-12T22:33:18.554 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:18.554 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:18.554 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:18.554 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.554 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.554 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1225 3.13 3:cb3d3880:::200.0000000d:head [write 1097316~1932 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:18.554 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.421303+0000", 2024-09-12T22:33:18.554 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 4.0445766240000003, 2024-09-12T22:33:18.554 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.074934770999999997, 2024-09-12T22:33:18.554 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:18.554 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:18.554 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:18.554 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:18.555 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.555 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:18.555 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.421303+0000", 2024-09-12T22:33:18.555 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:18.555 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.555 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.555 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:18.555 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.421303+0000", 2024-09-12T22:33:18.555 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:18.555 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.555 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.555 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:18.555 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.421303+0000", 2024-09-12T22:33:18.555 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8599999999999998e-07 2024-09-12T22:33:18.556 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.556 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.556 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:18.556 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.421307+0000", 2024-09-12T22:33:18.556 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0879999999999999e-06 2024-09-12T22:33:18.556 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.556 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.556 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:18.556 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.421314+0000", 2024-09-12T22:33:18.556 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1010000000000003e-06 2024-09-12T22:33:18.556 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.556 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.556 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:18.556 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.421319+0000", 2024-09-12T22:33:18.557 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7209999999999999e-06 2024-09-12T22:33:18.557 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.557 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.557 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:18.557 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.466620+0000", 2024-09-12T22:33:18.557 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.045301044999999998 2024-09-12T22:33:18.557 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.557 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.557 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:18.557 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.466703+0000", 2024-09-12T22:33:18.557 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3011999999999997e-05 2024-09-12T22:33:18.557 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.557 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.557 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:18.558 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.466826+0000", 2024-09-12T22:33:18.558 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000122824 2024-09-12T22:33:18.558 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.558 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.558 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:18.558 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.472359+0000", 2024-09-12T22:33:18.558 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0055323009999999999 2024-09-12T22:33:18.558 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.558 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.558 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:18.558 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496142+0000", 2024-09-12T22:33:18.558 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.023783696999999999 2024-09-12T22:33:18.558 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.559 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.559 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:18.559 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496194+0000", 2024-09-12T22:33:18.559 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1350000000000001e-05 2024-09-12T22:33:18.559 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.559 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.559 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:18.559 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496238+0000", 2024-09-12T22:33:18.559 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4146000000000001e-05 2024-09-12T22:33:18.559 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:18.559 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:18.559 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:18.559 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.559 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.559 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1226 3.13 3:cb3d3880:::200.0000000d:head [write 1099248~1973 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:18.559 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.422971+0000", 2024-09-12T22:33:18.560 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 4.0429090260000002, 2024-09-12T22:33:18.560 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.073363063000000006, 2024-09-12T22:33:18.560 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:18.560 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:18.560 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:18.560 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:18.560 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.560 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:18.560 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.422971+0000", 2024-09-12T22:33:18.560 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:18.560 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.560 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.560 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:18.560 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.422971+0000", 2024-09-12T22:33:18.561 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:18.561 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.561 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.561 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:18.561 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.422971+0000", 2024-09-12T22:33:18.561 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.1699999999999997e-07 2024-09-12T22:33:18.561 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.561 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.561 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:18.561 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.422975+0000", 2024-09-12T22:33:18.561 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2650000000000001e-06 2024-09-12T22:33:18.561 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.561 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.562 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:18.562 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.422981+0000", 2024-09-12T22:33:18.562 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7379999999999997e-06 2024-09-12T22:33:18.562 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.562 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.562 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:18.562 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.422986+0000", 2024-09-12T22:33:18.562 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5220000000000001e-06 2024-09-12T22:33:18.562 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.562 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.562 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:18.562 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.467340+0000", 2024-09-12T22:33:18.562 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.044353985999999998 2024-09-12T22:33:18.562 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.563 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.563 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:18.563 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.467412+0000", 2024-09-12T22:33:18.563 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1982000000000003e-05 2024-09-12T22:33:18.563 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.563 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.563 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:18.563 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.467493+0000", 2024-09-12T22:33:18.563 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0829999999999997e-05 2024-09-12T22:33:18.563 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.563 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.563 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:18.563 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.472364+0000", 2024-09-12T22:33:18.563 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0048713189999999998 2024-09-12T22:33:18.564 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.564 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.564 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:18.564 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496271+0000", 2024-09-12T22:33:18.564 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.023906808000000002 2024-09-12T22:33:18.564 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.564 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.564 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:18.564 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496300+0000", 2024-09-12T22:33:18.564 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9315e-05 2024-09-12T22:33:18.564 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.564 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.564 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:18.564 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496334+0000", 2024-09-12T22:33:18.565 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3481e-05 2024-09-12T22:33:18.565 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:18.565 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:18.565 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:18.565 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.565 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.565 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1227 3.13 3:cb3d3880:::200.0000000d:head [write 1101221~1922 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:18.565 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.423028+0000", 2024-09-12T22:33:18.565 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 4.0428520419999998, 2024-09-12T22:33:18.565 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.073444802000000003, 2024-09-12T22:33:18.565 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:18.565 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:18.565 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:18.565 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:18.566 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.566 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:18.566 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423028+0000", 2024-09-12T22:33:18.566 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:18.566 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.566 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.566 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:18.566 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423028+0000", 2024-09-12T22:33:18.566 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:18.566 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.566 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.566 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:18.566 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423028+0000", 2024-09-12T22:33:18.566 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1699999999999998e-07 2024-09-12T22:33:18.567 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.567 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.567 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:18.567 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423031+0000", 2024-09-12T22:33:18.567 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8499999999999998e-06 2024-09-12T22:33:18.567 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.567 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.567 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:18.567 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423036+0000", 2024-09-12T22:33:18.567 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9479999999999999e-06 2024-09-12T22:33:18.567 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.567 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.567 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:18.567 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423039+0000", 2024-09-12T22:33:18.568 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4929999999999998e-06 2024-09-12T22:33:18.568 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.568 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.568 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:18.568 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.467785+0000", 2024-09-12T22:33:18.568 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.044745957000000003 2024-09-12T22:33:18.568 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.568 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.568 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:18.568 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.467838+0000", 2024-09-12T22:33:18.568 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2596999999999998e-05 2024-09-12T22:33:18.568 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.568 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.568 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:18.569 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.467915+0000", 2024-09-12T22:33:18.569 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6744999999999998e-05 2024-09-12T22:33:18.569 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.569 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.569 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:18.569 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.472368+0000", 2024-09-12T22:33:18.569 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0044534730000000003 2024-09-12T22:33:18.569 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.569 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.569 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:18.569 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496382+0000", 2024-09-12T22:33:18.569 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.024014111000000001 2024-09-12T22:33:18.569 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.569 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.570 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:18.570 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496443+0000", 2024-09-12T22:33:18.570 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.0547000000000002e-05 2024-09-12T22:33:18.570 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.570 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.570 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:18.570 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496472+0000", 2024-09-12T22:33:18.570 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9564e-05 2024-09-12T22:33:18.570 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:18.570 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:18.570 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:18.570 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.570 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.570 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1228 3.13 3:cb3d3880:::200.0000000d:head [write 1103143~2423 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:18.571 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.423305+0000", 2024-09-12T22:33:18.571 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 4.0425746780000003, 2024-09-12T22:33:18.571 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.073251160999999995, 2024-09-12T22:33:18.571 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:18.571 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:18.571 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:18.571 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:18.571 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.571 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:18.571 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423305+0000", 2024-09-12T22:33:18.571 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:18.571 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.571 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.571 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:18.571 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423305+0000", 2024-09-12T22:33:18.572 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:18.572 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.572 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.572 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:18.572 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423306+0000", 2024-09-12T22:33:18.572 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4899999999999995e-07 2024-09-12T22:33:18.572 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.572 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.572 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:18.572 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423311+0000", 2024-09-12T22:33:18.572 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7459999999999997e-06 2024-09-12T22:33:18.572 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.572 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.572 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:18.573 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423316+0000", 2024-09-12T22:33:18.573 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0239999999999997e-06 2024-09-12T22:33:18.573 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.573 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.573 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:18.573 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423320+0000", 2024-09-12T22:33:18.573 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.67e-06 2024-09-12T22:33:18.573 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.573 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.573 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:18.573 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.468252+0000", 2024-09-12T22:33:18.573 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.044932262000000001 2024-09-12T22:33:18.573 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.573 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.574 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:18.574 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.468293+0000", 2024-09-12T22:33:18.574 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0368999999999999e-05 2024-09-12T22:33:18.574 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.574 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.574 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:18.574 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.468357+0000", 2024-09-12T22:33:18.574 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4287000000000003e-05 2024-09-12T22:33:18.574 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.574 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.574 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:18.574 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.472371+0000", 2024-09-12T22:33:18.574 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0040144350000000002 2024-09-12T22:33:18.575 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.575 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.575 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:18.575 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496507+0000", 2024-09-12T22:33:18.575 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.024135961000000001 2024-09-12T22:33:18.575 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.575 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.575 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:18.575 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496537+0000", 2024-09-12T22:33:18.575 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9611000000000002e-05 2024-09-12T22:33:18.575 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.575 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.575 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:18.575 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496556+0000", 2024-09-12T22:33:18.575 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9147000000000002e-05 2024-09-12T22:33:18.576 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:18.576 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:18.576 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:18.576 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.576 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.576 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1229 3.13 3:cb3d3880:::200.0000000d:head [write 1105566~1911 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:18.576 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.423606+0000", 2024-09-12T22:33:18.576 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 4.0422736669999999, 2024-09-12T22:33:18.576 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.073027876000000005, 2024-09-12T22:33:18.576 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:18.576 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:18.576 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:18.576 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:18.576 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.577 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:18.577 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423606+0000", 2024-09-12T22:33:18.577 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:18.577 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.577 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.577 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:18.577 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423606+0000", 2024-09-12T22:33:18.577 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:18.577 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.577 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.577 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:18.577 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423606+0000", 2024-09-12T22:33:18.577 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.7e-07 2024-09-12T22:33:18.578 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.578 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.578 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:18.578 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423609+0000", 2024-09-12T22:33:18.578 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5339999999999998e-06 2024-09-12T22:33:18.578 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.578 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.578 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:18.578 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423614+0000", 2024-09-12T22:33:18.578 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.69e-06 2024-09-12T22:33:18.578 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.578 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.578 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:18.578 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423617+0000", 2024-09-12T22:33:18.579 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4300000000000002e-06 2024-09-12T22:33:18.579 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.579 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.579 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:18.579 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.468606+0000", 2024-09-12T22:33:18.579 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.044988606 2024-09-12T22:33:18.579 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.579 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.579 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:18.579 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.468649+0000", 2024-09-12T22:33:18.579 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3414000000000001e-05 2024-09-12T22:33:18.579 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.579 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.579 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:18.579 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.468714+0000", 2024-09-12T22:33:18.580 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4857000000000006e-05 2024-09-12T22:33:18.580 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.580 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.580 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:18.580 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.472375+0000", 2024-09-12T22:33:18.580 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0036607330000000002 2024-09-12T22:33:18.580 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.580 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.580 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:18.580 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496585+0000", 2024-09-12T22:33:18.580 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.024210835 2024-09-12T22:33:18.580 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.580 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.581 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:18.581 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496612+0000", 2024-09-12T22:33:18.581 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6999999999999999e-05 2024-09-12T22:33:18.581 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.581 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.581 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:18.581 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496634+0000", 2024-09-12T22:33:18.581 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1307000000000001e-05 2024-09-12T22:33:18.581 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:18.581 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:18.581 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:18.581 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.581 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.581 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1230 3.13 3:cb3d3880:::200.0000000d:head [write 1107477~6537 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:18.582 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.423911+0000", 2024-09-12T22:33:18.582 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 4.0419688220000003, 2024-09-12T22:33:18.582 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.072794530999999996, 2024-09-12T22:33:18.582 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:18.582 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:18.582 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:18.582 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:18.582 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.582 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:18.582 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423911+0000", 2024-09-12T22:33:18.582 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:18.582 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.582 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.582 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:18.583 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423911+0000", 2024-09-12T22:33:18.583 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:18.583 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.583 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.583 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:18.583 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423911+0000", 2024-09-12T22:33:18.583 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3799999999999998e-07 2024-09-12T22:33:18.583 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.583 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.583 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:18.583 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423919+0000", 2024-09-12T22:33:18.583 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.8329999999999994e-06 2024-09-12T22:33:18.583 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.583 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.583 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:18.584 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423924+0000", 2024-09-12T22:33:18.584 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3449999999999996e-06 2024-09-12T22:33:18.584 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.584 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.584 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:18.584 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423928+0000", 2024-09-12T22:33:18.584 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2339999999999999e-06 2024-09-12T22:33:18.584 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.584 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.584 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:18.584 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.469042+0000", 2024-09-12T22:33:18.584 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.045114888999999998 2024-09-12T22:33:18.584 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.584 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.585 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:18.585 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.469092+0000", 2024-09-12T22:33:18.585 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9289000000000002e-05 2024-09-12T22:33:18.585 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.585 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.585 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:18.585 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.469163+0000", 2024-09-12T22:33:18.585 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1222000000000004e-05 2024-09-12T22:33:18.585 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.585 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.586 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:18.586 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.472379+0000", 2024-09-12T22:33:18.586 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0032156419999999999 2024-09-12T22:33:18.586 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.586 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.586 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:18.586 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496661+0000", 2024-09-12T22:33:18.586 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.024281857 2024-09-12T22:33:18.586 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.586 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.586 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:18.586 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496687+0000", 2024-09-12T22:33:18.586 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6551e-05 2024-09-12T22:33:18.586 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:18.587 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:18.587 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:18.587 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496705+0000", 2024-09-12T22:33:18.587 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.8230999999999999e-05 2024-09-12T22:33:18.587 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:18.587 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:18.587 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:18.587 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:18.587 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:18.587 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-09-12T22:33:18.590 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:18.587+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:18.590 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:33:18.592 INFO:tasks.workunit.client.0.smithi019.stdout:3/992: sync 2024-09-12T22:33:18.592 INFO:tasks.workunit.client.0.smithi019.stdout:7/976: sync 2024-09-12T22:33:18.593 INFO:tasks.workunit.client.0.smithi019.stdout:7/977: mknod d6/dcf/d169/c16a 0 2024-09-12T22:33:18.593 INFO:tasks.workunit.client.0.smithi019.stdout:3/993: write dd/d12/d62/d74/fec [4763182,37165] 0 2024-09-12T22:33:18.593 INFO:tasks.workunit.client.0.smithi019.stdout:7/978: mkdir d6/d14/d45/dca/df8/d16b 0 2024-09-12T22:33:18.593 INFO:tasks.workunit.client.0.smithi019.stdout:3/994: mkdir dd/d12/d62/d78/d12e 0 2024-09-12T22:33:18.593 INFO:tasks.workunit.client.0.smithi019.stdout:7/979: rename d6/d14/d2a/da4/d42/f10a to d6/d2d/d8f/daf/da0/db7/f16c 0 2024-09-12T22:33:18.593 INFO:tasks.workunit.client.0.smithi019.stdout:7/980: chown d6/d14/d15/f10d 1540875740 1 2024-09-12T22:33:18.593 INFO:tasks.workunit.client.0.smithi019.stdout:3/995: dread dd/d12/f55 [0,4194304] 0 2024-09-12T22:33:18.593 INFO:tasks.workunit.client.0.smithi019.stdout:7/981: mknod d6/d14/d2a/da4/dc/d63/c16d 0 2024-09-12T22:33:18.593 INFO:tasks.workunit.client.0.smithi019.stdout:7/982: truncate d6/d2d/de0/f15c 223175 0 2024-09-12T22:33:18.593 INFO:tasks.workunit.client.0.smithi019.stdout:3/996: rename dd/d1e/d40/d6e/l9f to dd/d1e/d40/d6e/d70/l12f 0 2024-09-12T22:33:18.593 INFO:tasks.workunit.client.0.smithi019.stdout:7/983: fdatasync d6/d14/d45/db0/f15d 0 2024-09-12T22:33:18.593 INFO:tasks.workunit.client.0.smithi019.stdout:3/997: rmdir dd/d1e/d82 39 2024-09-12T22:33:18.593 INFO:tasks.workunit.client.0.smithi019.stdout:7/984: chown d6/d14/d2a/da4/fb1 61276 1 2024-09-12T22:33:18.594 INFO:tasks.workunit.client.0.smithi019.stdout:3/998: unlink dd/d12/d62/d78/dde/fe8 0 2024-09-12T22:33:18.594 INFO:tasks.workunit.client.0.smithi019.stdout:7/985: chown d6/d2d/d3d/ca9 244 1 2024-09-12T22:33:18.594 INFO:tasks.workunit.client.0.smithi019.stdout:7/986: mknod d6/d2d/d77/dbf/dde/c16e 0 2024-09-12T22:33:18.594 INFO:tasks.workunit.client.0.smithi019.stdout:3/999: link dd/d1e/c9e dd/d12/d62/d74/d125/d12c/c130 0 2024-09-12T22:33:18.594 INFO:tasks.workunit.client.0.smithi019.stdout:7/987: write d6/d14/d45/d7c/f125 [381680,42128] 0 2024-09-12T22:33:18.594 INFO:tasks.workunit.client.0.smithi019.stdout:7/988: truncate d6/d14/d2a/da4/d42/faa 1323115 0 2024-09-12T22:33:18.594 INFO:tasks.workunit.client.0.smithi019.stdout:7/989: mknod d6/d2d/d77/dbf/dde/d105/c16f 0 2024-09-12T22:33:18.594 INFO:tasks.workunit.client.0.smithi019.stdout:7/990: write d6/d14/fc5 [109719,113181] 0 2024-09-12T22:33:18.594 INFO:tasks.workunit.client.0.smithi019.stdout:7/991: dwrite d6/d14/d15/f17 [0,4194304] 0 2024-09-12T22:33:18.594 INFO:tasks.workunit.client.0.smithi019.stdout:7/992: sync 2024-09-12T22:33:18.594 INFO:tasks.workunit.client.0.smithi019.stdout:7/993: mknod d6/d2d/d8f/c170 0 2024-09-12T22:33:18.594 INFO:tasks.workunit.client.0.smithi019.stdout:7/994: write d6/d14/d2a/da4/d34/f38 [1542017,28360] 0 2024-09-12T22:33:18.594 INFO:tasks.workunit.client.0.smithi019.stdout:7/995: link d6/d14/d15/d62/d6a/f75 d6/d2d/d12a/f171 0 2024-09-12T22:33:18.594 INFO:tasks.workunit.client.0.smithi019.stdout:7/996: write d6/d2d/d41/f129 [785922,105019] 0 2024-09-12T22:33:18.595 INFO:tasks.workunit.client.0.smithi019.stdout:7/997: chown d6/d14/d15 1737 1 2024-09-12T22:33:18.595 INFO:tasks.workunit.client.0.smithi019.stdout:7/998: symlink d6/d2d/d3d/l172 0 2024-09-12T22:33:18.595 INFO:tasks.workunit.client.0.smithi019.stdout:7/999: write d6/d2d/d77/d8e/f155 [341393,87544] 0 2024-09-12T22:33:18.595 INFO:tasks.workunit.client.0.smithi019.stderr:+ rm -rf -- ./tmp.1a2zdSyw4w 2024-09-12T22:33:18.689 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:18.689+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:18.699 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:33:18.700 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:33:18.700 INFO:teuthology.orchestra.run.smithi148.stdout: "num_ops": 0 2024-09-12T22:33:18.700 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:33:18.708 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:33:18.791 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:18.789+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:18.816 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:33:18.816 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:33:18.817 INFO:teuthology.orchestra.run.smithi148.stdout: "complaint_time": 30, 2024-09-12T22:33:18.817 INFO:teuthology.orchestra.run.smithi148.stdout: "num_blocked_ops": 0 2024-09-12T22:33:18.817 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:33:18.826 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:33:18.892 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:18.891+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:18.937 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:33:18.938 INFO:teuthology.orchestra.run.smithi148.stdout: "size": 20, 2024-09-12T22:33:18.938 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 600, 2024-09-12T22:33:18.938 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [ 2024-09-12T22:33:18.938 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.938 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4490.0:9866 4.b 4:d370243b:::10000002d48.00000000:head [write 0~1308] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:33:18.938 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:09.467883+0000", 2024-09-12T22:33:18.938 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 9.4675149810000008, 2024-09-12T22:33:18.938 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.085024817000000003, 2024-09-12T22:33:18.938 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:18.938 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:18.939 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:18.939 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:33:18.939 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4490", 2024-09-12T22:33:18.939 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:18.939 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 9866 2024-09-12T22:33:18.939 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:18.939 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:18.939 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.939 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:18.939 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.467883+0000", 2024-09-12T22:33:18.939 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:18.939 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:18.939 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.940 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:18.940 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.467883+0000", 2024-09-12T22:33:18.940 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:18.940 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:18.940 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.940 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:18.940 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.467884+0000", 2024-09-12T22:33:18.940 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1800000000000005e-07 2024-09-12T22:33:18.940 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:18.940 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.940 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:18.940 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.467888+0000", 2024-09-12T22:33:18.940 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5959999999999997e-06 2024-09-12T22:33:18.941 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:18.941 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.941 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:18.941 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.467896+0000", 2024-09-12T22:33:18.941 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.8679999999999999e-06 2024-09-12T22:33:18.941 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:18.941 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.941 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:18.941 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.467901+0000", 2024-09-12T22:33:18.941 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9169999999999997e-06 2024-09-12T22:33:18.941 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:18.941 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.941 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:18.941 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.467944+0000", 2024-09-12T22:33:18.942 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3055e-05 2024-09-12T22:33:18.942 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:18.942 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.942 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:18.942 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.468011+0000", 2024-09-12T22:33:18.942 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7328000000000003e-05 2024-09-12T22:33:18.942 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:18.942 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.942 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:18.942 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.468078+0000", 2024-09-12T22:33:18.942 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7063999999999994e-05 2024-09-12T22:33:18.942 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:18.943 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.943 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:18.943 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.551406+0000", 2024-09-12T22:33:18.943 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.083327485000000007 2024-09-12T22:33:18.943 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:18.943 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.943 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:18.943 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.552822+0000", 2024-09-12T22:33:18.943 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001415929 2024-09-12T22:33:18.943 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:18.943 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.943 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:18.943 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.552863+0000", 2024-09-12T22:33:18.944 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0809000000000002e-05 2024-09-12T22:33:18.944 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:18.944 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.944 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:18.944 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.552908+0000", 2024-09-12T22:33:18.944 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5048e-05 2024-09-12T22:33:18.944 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:18.944 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:18.944 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:18.944 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:18.944 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.944 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4490.0:9867 4.16 4:6bd8f1b8:::10000002d49.00000000:head [write 0~1599] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:33:18.945 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:09.468760+0000", 2024-09-12T22:33:18.945 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 9.4666379720000009, 2024-09-12T22:33:18.945 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.086660499000000002, 2024-09-12T22:33:18.945 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:18.945 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:18.945 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:18.945 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:33:18.945 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4490", 2024-09-12T22:33:18.945 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:18.946 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 9867 2024-09-12T22:33:18.946 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:18.946 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:18.946 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.946 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:18.946 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.468760+0000", 2024-09-12T22:33:18.946 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:18.946 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:18.946 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.946 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:18.946 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.468760+0000", 2024-09-12T22:33:18.946 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:18.946 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:18.947 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.947 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:18.947 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.468761+0000", 2024-09-12T22:33:18.947 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4399999999999999e-07 2024-09-12T22:33:18.947 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:18.947 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.947 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:18.947 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.468765+0000", 2024-09-12T22:33:18.947 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3259999999999997e-06 2024-09-12T22:33:18.947 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:18.947 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.947 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:18.947 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.548969+0000", 2024-09-12T22:33:18.948 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.080204172000000004 2024-09-12T22:33:18.948 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:18.948 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.948 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:18.948 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.549001+0000", 2024-09-12T22:33:18.948 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.1464999999999998e-05 2024-09-12T22:33:18.948 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:18.948 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.948 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:18.948 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.549148+0000", 2024-09-12T22:33:18.948 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014749399999999999 2024-09-12T22:33:18.948 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:18.948 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.949 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:18.949 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.549379+0000", 2024-09-12T22:33:18.949 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000231091 2024-09-12T22:33:18.949 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:18.949 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.949 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:18.949 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.549518+0000", 2024-09-12T22:33:18.949 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013844899999999999 2024-09-12T22:33:18.949 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:18.949 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.949 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:18.949 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.552236+0000", 2024-09-12T22:33:18.949 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0027179869999999998 2024-09-12T22:33:18.949 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:18.950 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.950 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:18.950 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.555333+0000", 2024-09-12T22:33:18.950 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0030973559999999999 2024-09-12T22:33:18.950 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:18.950 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.950 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:18.950 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.555379+0000", 2024-09-12T22:33:18.950 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6236999999999998e-05 2024-09-12T22:33:18.950 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:18.950 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.950 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:18.950 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.555420+0000", 2024-09-12T22:33:18.951 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1177999999999998e-05 2024-09-12T22:33:18.951 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:18.951 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:18.951 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:18.951 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:18.951 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.951 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop_reply(client.4490.0:9866 4.b e53/18 ondisk, result = 0)", 2024-09-12T22:33:18.951 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:09.468826+0000", 2024-09-12T22:33:18.951 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 9.4665716769999992, 2024-09-12T22:33:18.951 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.082588348000000006, 2024-09-12T22:33:18.951 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:18.951 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:18.951 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:33:18.952 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:18.952 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.952 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:18.952 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.468826+0000", 2024-09-12T22:33:18.952 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:18.952 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:18.952 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.952 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:18.952 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.468826+0000", 2024-09-12T22:33:18.952 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:18.952 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:18.952 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.952 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:18.953 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.468827+0000", 2024-09-12T22:33:18.953 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3399999999999999e-07 2024-09-12T22:33:18.953 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:18.953 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.953 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:18.953 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.468830+0000", 2024-09-12T22:33:18.953 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.1559999999999999e-06 2024-09-12T22:33:18.953 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:18.953 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.953 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:18.953 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.548957+0000", 2024-09-12T22:33:18.953 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.080126852999999998 2024-09-12T22:33:18.953 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:18.954 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.954 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:18.954 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.548989+0000", 2024-09-12T22:33:18.954 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2409000000000001e-05 2024-09-12T22:33:18.954 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:18.954 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.954 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:18.954 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.551065+0000", 2024-09-12T22:33:18.954 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.002075871 2024-09-12T22:33:18.954 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:18.954 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.954 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:18.954 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.551398+0000", 2024-09-12T22:33:18.955 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00033339099999999999 2024-09-12T22:33:18.955 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:18.955 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.955 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:18.955 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.551414+0000", 2024-09-12T22:33:18.955 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6133999999999998e-05 2024-09-12T22:33:18.955 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:18.955 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:18.955 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:18.955 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:18.955 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.955 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4490.0:10437 4.2f 4:f6cd553b:::10000002fce.00000000:head [write 0~27313] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:33:18.955 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:10.050890+0000", 2024-09-12T22:33:18.956 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 8.8845072809999994, 2024-09-12T22:33:18.956 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.056482601, 2024-09-12T22:33:18.956 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:18.956 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:18.956 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:18.956 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:33:18.956 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4490", 2024-09-12T22:33:18.956 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:18.956 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 10437 2024-09-12T22:33:18.956 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:18.956 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:18.956 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.956 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:18.957 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.050890+0000", 2024-09-12T22:33:18.957 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:18.957 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:18.957 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.957 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:18.957 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.050890+0000", 2024-09-12T22:33:18.957 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:18.957 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:18.957 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.957 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:18.957 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.050891+0000", 2024-09-12T22:33:18.957 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.6600000000000005e-07 2024-09-12T22:33:18.957 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:18.958 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.958 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:18.958 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.050906+0000", 2024-09-12T22:33:18.958 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4521e-05 2024-09-12T22:33:18.958 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:18.958 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.958 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:18.958 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.050915+0000", 2024-09-12T22:33:18.958 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.2569999999999996e-06 2024-09-12T22:33:18.958 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:18.958 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.958 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:18.958 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.050920+0000", 2024-09-12T22:33:18.959 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.724e-06 2024-09-12T22:33:18.959 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:18.959 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.959 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:18.959 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.050960+0000", 2024-09-12T22:33:18.959 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9999000000000001e-05 2024-09-12T22:33:18.959 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:18.959 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.959 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:18.959 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.051031+0000", 2024-09-12T22:33:18.959 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1007000000000006e-05 2024-09-12T22:33:18.959 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:18.959 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.960 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:18.960 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.107249+0000", 2024-09-12T22:33:18.960 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.056218432999999998 2024-09-12T22:33:18.960 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:18.960 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.960 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:18.960 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.107301+0000", 2024-09-12T22:33:18.960 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1289000000000003e-05 2024-09-12T22:33:18.960 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:18.960 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.960 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:18.960 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.107373+0000", 2024-09-12T22:33:18.960 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.2504999999999998e-05 2024-09-12T22:33:18.961 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:18.961 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:18.961 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:18.961 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:18.961 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.961 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4490.0:10439 4.12 4:483953cb:::10000002fd0.00000000:head [write 0~4842] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:33:18.961 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:10.052567+0000", 2024-09-12T22:33:18.961 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 8.8828310730000002, 2024-09-12T22:33:18.961 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.055835449000000002, 2024-09-12T22:33:18.961 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:18.961 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:18.961 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:18.961 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:33:18.962 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4490", 2024-09-12T22:33:18.962 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:18.962 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 10439 2024-09-12T22:33:18.962 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:18.962 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:18.962 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.962 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:18.962 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.052567+0000", 2024-09-12T22:33:18.962 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:18.962 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:18.962 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.962 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:18.962 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.052567+0000", 2024-09-12T22:33:18.962 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:18.963 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:18.963 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.963 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:18.963 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.052568+0000", 2024-09-12T22:33:18.963 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.3600000000000002e-07 2024-09-12T22:33:18.963 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:18.963 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.963 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:18.963 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.052591+0000", 2024-09-12T22:33:18.963 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.3110000000000001e-05 2024-09-12T22:33:18.963 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:18.963 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.963 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:18.964 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.106740+0000", 2024-09-12T22:33:18.964 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.054149315000000003 2024-09-12T22:33:18.964 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:18.964 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.964 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:18.964 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.106751+0000", 2024-09-12T22:33:18.964 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1056000000000001e-05 2024-09-12T22:33:18.964 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:18.964 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.964 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:18.964 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.106811+0000", 2024-09-12T22:33:18.964 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9515999999999997e-05 2024-09-12T22:33:18.964 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:18.965 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.965 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:18.965 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.106929+0000", 2024-09-12T22:33:18.965 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00011879000000000001 2024-09-12T22:33:18.965 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:18.965 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.965 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:18.965 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.108283+0000", 2024-09-12T22:33:18.965 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001354177 2024-09-12T22:33:18.965 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:18.965 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.965 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:18.965 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.108328+0000", 2024-09-12T22:33:18.965 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4931000000000001e-05 2024-09-12T22:33:18.966 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:18.966 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.966 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:18.966 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.108402+0000", 2024-09-12T22:33:18.966 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3718000000000001e-05 2024-09-12T22:33:18.966 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:18.966 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:18.966 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:18.966 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:18.966 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.966 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(client.4490.0:10445 4.3c e53/18 4:3d97251e:::10000002fd8.00000000:head v 53'154, mlcod=53'152)", 2024-09-12T22:33:18.966 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:10.058521+0000", 2024-09-12T22:33:18.966 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 8.8768767329999996, 2024-09-12T22:33:18.967 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.049310138000000003, 2024-09-12T22:33:18.967 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:18.967 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:18.967 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:18.967 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:18.967 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.967 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:18.967 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.058521+0000", 2024-09-12T22:33:18.967 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:18.967 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:18.967 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.967 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:18.967 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.058521+0000", 2024-09-12T22:33:18.967 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:18.968 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:18.968 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.968 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:18.968 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.058522+0000", 2024-09-12T22:33:18.968 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.1099999999999995e-07 2024-09-12T22:33:18.968 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:18.968 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.968 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:18.968 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.058530+0000", 2024-09-12T22:33:18.968 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.7290000000000006e-06 2024-09-12T22:33:18.968 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:18.968 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.969 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:18.969 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.106760+0000", 2024-09-12T22:33:18.969 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.048229384 2024-09-12T22:33:18.969 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:18.969 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.969 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:18.969 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.106770+0000", 2024-09-12T22:33:18.969 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0431999999999999e-05 2024-09-12T22:33:18.969 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:18.969 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.969 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:18.969 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.106823+0000", 2024-09-12T22:33:18.969 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2309999999999999e-05 2024-09-12T22:33:18.969 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:18.970 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.970 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:18.970 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.106841+0000", 2024-09-12T22:33:18.970 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.8218000000000001e-05 2024-09-12T22:33:18.970 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:18.970 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.970 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:18.970 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.107796+0000", 2024-09-12T22:33:18.970 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00095552600000000005 2024-09-12T22:33:18.970 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:18.970 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.970 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:18.970 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.107831+0000", 2024-09-12T22:33:18.971 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4928000000000002e-05 2024-09-12T22:33:18.971 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:18.971 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:18.971 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:18.971 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:18.971 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.971 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4490.0:11257 4.17 4:e9f3a865:::10000003294.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-12T22:33:18.971 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:13.248554+0000", 2024-09-12T22:33:18.971 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 5.6868433109999996, 2024-09-12T22:33:18.971 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.033281518000000003, 2024-09-12T22:33:18.971 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:18.971 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:18.971 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:18.971 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:33:18.972 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4490", 2024-09-12T22:33:18.972 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:18.972 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 11257 2024-09-12T22:33:18.972 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:18.972 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:18.972 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.972 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:18.972 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.248554+0000", 2024-09-12T22:33:18.972 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:18.972 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:18.972 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.972 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:18.972 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.248554+0000", 2024-09-12T22:33:18.973 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:18.973 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:18.973 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.973 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:18.973 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.248555+0000", 2024-09-12T22:33:18.973 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.6699999999999999e-07 2024-09-12T22:33:18.973 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:18.973 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.973 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:18.973 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.255560+0000", 2024-09-12T22:33:18.973 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0070048719999999997 2024-09-12T22:33:18.973 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:18.973 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.974 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:18.974 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.255571+0000", 2024-09-12T22:33:18.974 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1131999999999999e-05 2024-09-12T22:33:18.974 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:18.974 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.974 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:18.974 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.255577+0000", 2024-09-12T22:33:18.974 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.964e-06 2024-09-12T22:33:18.974 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:18.974 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.974 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:18.974 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.255637+0000", 2024-09-12T22:33:18.974 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.0381999999999999e-05 2024-09-12T22:33:18.975 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:18.975 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.975 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:18.975 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.255814+0000", 2024-09-12T22:33:18.975 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00017719 2024-09-12T22:33:18.975 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:18.975 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.975 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:18.975 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.255935+0000", 2024-09-12T22:33:18.975 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000120414 2024-09-12T22:33:18.975 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:18.975 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.975 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:18.975 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.268536+0000", 2024-09-12T22:33:18.976 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.012601661 2024-09-12T22:33:18.976 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:18.976 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.976 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:18.976 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.281767+0000", 2024-09-12T22:33:18.976 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.013231002 2024-09-12T22:33:18.976 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:18.976 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.976 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:18.976 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.281805+0000", 2024-09-12T22:33:18.976 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.7713999999999998e-05 2024-09-12T22:33:18.976 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:18.976 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.977 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:18.977 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.281836+0000", 2024-09-12T22:33:18.977 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.082e-05 2024-09-12T22:33:18.977 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:18.977 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:18.977 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:18.977 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:18.977 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.977 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4490.0:11351 4.3f 4:fd498422:::10000003188.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-12T22:33:18.977 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:13.354715+0000", 2024-09-12T22:33:18.977 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 5.580682919, 2024-09-12T22:33:18.977 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.043059568999999999, 2024-09-12T22:33:18.977 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:18.978 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:18.978 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:18.978 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:33:18.978 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4490", 2024-09-12T22:33:18.978 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:18.978 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 11351 2024-09-12T22:33:18.978 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:18.978 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:18.978 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.978 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:18.978 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.354715+0000", 2024-09-12T22:33:18.978 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:18.978 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:18.979 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.979 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:18.979 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.354715+0000", 2024-09-12T22:33:18.979 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:18.979 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:18.979 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.979 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:18.979 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.354716+0000", 2024-09-12T22:33:18.979 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.7600000000000006e-07 2024-09-12T22:33:18.979 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:18.979 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.979 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:18.979 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.361477+0000", 2024-09-12T22:33:18.979 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0067607090000000002 2024-09-12T22:33:18.980 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:18.980 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.980 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:18.980 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.361487+0000", 2024-09-12T22:33:18.980 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0249e-05 2024-09-12T22:33:18.980 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:18.980 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.980 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:18.980 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.361493+0000", 2024-09-12T22:33:18.980 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.4699999999999999e-06 2024-09-12T22:33:18.980 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:18.980 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.980 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:18.981 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.361544+0000", 2024-09-12T22:33:18.981 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1124e-05 2024-09-12T22:33:18.981 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:18.981 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.981 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:18.981 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.361604+0000", 2024-09-12T22:33:18.981 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9397000000000001e-05 2024-09-12T22:33:18.981 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:18.981 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.981 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:18.981 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.397601+0000", 2024-09-12T22:33:18.981 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.035996927999999997 2024-09-12T22:33:18.981 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:18.981 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.982 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:18.982 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.397646+0000", 2024-09-12T22:33:18.982 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5176000000000003e-05 2024-09-12T22:33:18.982 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:18.982 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.982 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:18.982 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.397774+0000", 2024-09-12T22:33:18.982 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012854000000000001 2024-09-12T22:33:18.982 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:18.982 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:18.982 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:18.982 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:18.982 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.983 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4490.0:12265 4.26 4:65ffb4ee:::10000003343.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-12T22:33:18.983 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:14.461783+0000", 2024-09-12T22:33:18.983 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 4.4736152660000004, 2024-09-12T22:33:18.983 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.036838316000000003, 2024-09-12T22:33:18.983 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:18.983 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:18.983 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:18.983 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:33:18.983 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4490", 2024-09-12T22:33:18.983 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:18.983 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 12265 2024-09-12T22:33:18.983 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:18.983 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:18.984 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.984 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:18.984 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:14.461783+0000", 2024-09-12T22:33:18.984 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:18.984 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:18.984 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.984 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:18.984 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:14.461783+0000", 2024-09-12T22:33:18.984 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:18.984 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:18.984 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.984 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:18.984 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:14.461784+0000", 2024-09-12T22:33:18.985 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1170000000000001e-06 2024-09-12T22:33:18.985 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:18.985 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.985 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:18.985 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:14.467934+0000", 2024-09-12T22:33:18.985 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0061503349999999998 2024-09-12T22:33:18.985 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:18.985 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.985 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:18.985 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:14.467948+0000", 2024-09-12T22:33:18.985 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.3574000000000001e-05 2024-09-12T22:33:18.985 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:18.985 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.986 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:18.986 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:14.467954+0000", 2024-09-12T22:33:18.986 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.3029999999999996e-06 2024-09-12T22:33:18.986 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:18.986 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.986 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:18.986 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:14.468006+0000", 2024-09-12T22:33:18.986 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1780999999999998e-05 2024-09-12T22:33:18.986 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:18.986 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.986 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:18.986 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:14.468072+0000", 2024-09-12T22:33:18.986 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.6497999999999999e-05 2024-09-12T22:33:18.987 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:18.987 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.987 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:18.987 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:14.468162+0000", 2024-09-12T22:33:18.987 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.9652000000000002e-05 2024-09-12T22:33:18.987 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:18.987 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.987 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:18.987 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:14.490170+0000", 2024-09-12T22:33:18.987 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.022008459000000001 2024-09-12T22:33:18.987 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:18.987 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.987 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:18.987 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:14.498526+0000", 2024-09-12T22:33:18.988 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.008355833 2024-09-12T22:33:18.988 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:18.988 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.988 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:18.988 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:14.498562+0000", 2024-09-12T22:33:18.988 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.6439999999999997e-05 2024-09-12T22:33:18.988 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:18.988 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.988 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:18.988 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:14.498621+0000", 2024-09-12T22:33:18.988 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8323999999999999e-05 2024-09-12T22:33:18.988 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:18.988 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:18.989 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:18.989 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:18.989 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.989 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4490.0:12268 4.2e 4:75d2e7a1:::10000003146.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-12T22:33:18.989 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:14.473428+0000", 2024-09-12T22:33:18.989 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 4.461969925, 2024-09-12T22:33:18.989 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.034479100999999998, 2024-09-12T22:33:18.989 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:18.989 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:18.989 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:18.989 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:33:18.989 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4490", 2024-09-12T22:33:18.989 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:18.990 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 12268 2024-09-12T22:33:18.990 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:18.990 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:18.990 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.990 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:18.990 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:14.473428+0000", 2024-09-12T22:33:18.990 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:18.990 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:18.990 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.990 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:18.990 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:14.473428+0000", 2024-09-12T22:33:18.990 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:18.990 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:18.991 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.991 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:18.991 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:14.473429+0000", 2024-09-12T22:33:18.991 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1960000000000001e-06 2024-09-12T22:33:18.991 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:18.991 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.991 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:18.991 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:14.477388+0000", 2024-09-12T22:33:18.991 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0039589279999999996 2024-09-12T22:33:18.991 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:18.991 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.991 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:18.991 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:14.477400+0000", 2024-09-12T22:33:18.992 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2465e-05 2024-09-12T22:33:18.992 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:18.992 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.992 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:18.992 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:14.477410+0000", 2024-09-12T22:33:18.992 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.6399999999999992e-06 2024-09-12T22:33:18.992 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:18.992 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.992 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:18.992 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:14.490169+0000", 2024-09-12T22:33:18.992 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.012759336 2024-09-12T22:33:18.992 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:18.993 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.993 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:18.993 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:14.490359+0000", 2024-09-12T22:33:18.993 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000189469 2024-09-12T22:33:18.993 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:18.993 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.993 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:18.993 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:14.507802+0000", 2024-09-12T22:33:18.993 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017443316 2024-09-12T22:33:18.993 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:18.993 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.993 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:18.993 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:14.507856+0000", 2024-09-12T22:33:18.994 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3968999999999998e-05 2024-09-12T22:33:18.994 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:18.994 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.994 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:18.994 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:14.507907+0000", 2024-09-12T22:33:18.994 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.0782000000000003e-05 2024-09-12T22:33:18.994 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:18.994 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:18.994 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:18.994 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:18.994 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.994 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(client.4490.0:12319 4.3c e55/18 4:3fac4345:::1000000333d.00000000:head v 55'167, mlcod=54'165)", 2024-09-12T22:33:18.994 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:14.567601+0000", 2024-09-12T22:33:18.995 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 4.3677964539999996, 2024-09-12T22:33:18.995 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.034553657000000002, 2024-09-12T22:33:18.995 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:18.995 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:18.995 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:18.995 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:18.995 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.995 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:18.995 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:14.567601+0000", 2024-09-12T22:33:18.995 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:18.995 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:18.995 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.995 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:18.996 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:14.567601+0000", 2024-09-12T22:33:18.996 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:18.996 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:18.996 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.996 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:18.996 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:14.567603+0000", 2024-09-12T22:33:18.996 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4640000000000001e-06 2024-09-12T22:33:18.996 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:18.996 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.996 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:18.996 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:14.575561+0000", 2024-09-12T22:33:18.996 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0079585750000000007 2024-09-12T22:33:18.996 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:18.997 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.997 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:18.997 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:14.575587+0000", 2024-09-12T22:33:18.997 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5548e-05 2024-09-12T22:33:18.997 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:18.997 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.997 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:18.997 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:14.575594+0000", 2024-09-12T22:33:18.997 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.2930000000000003e-06 2024-09-12T22:33:18.997 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:18.997 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.997 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:18.997 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:14.575649+0000", 2024-09-12T22:33:18.998 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4546999999999998e-05 2024-09-12T22:33:18.998 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:18.998 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.998 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:18.998 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:14.575670+0000", 2024-09-12T22:33:18.998 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.1472999999999999e-05 2024-09-12T22:33:18.998 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:18.998 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.998 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:18.998 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:14.602081+0000", 2024-09-12T22:33:18.998 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.026410886000000001 2024-09-12T22:33:18.998 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:18.998 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.999 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:18.999 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:14.602155+0000", 2024-09-12T22:33:18.999 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3870999999999998e-05 2024-09-12T22:33:18.999 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:18.999 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:18.999 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:18.999 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:18.999 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:18.999 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4490.0:12480 4.1e 4:786dd32f:::1000000324e.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-12T22:33:18.999 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:14.743135+0000", 2024-09-12T22:33:18.999 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 4.1922631990000001, 2024-09-12T22:33:18.999 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.037056259000000001, 2024-09-12T22:33:18.999 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:18.999 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:19.000 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:19.000 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:33:19.000 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4490", 2024-09-12T22:33:19.000 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:19.000 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 12480 2024-09-12T22:33:19.000 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.000 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:19.000 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.000 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:19.000 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:14.743135+0000", 2024-09-12T22:33:19.000 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:19.000 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.001 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.001 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:19.001 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:14.743135+0000", 2024-09-12T22:33:19.001 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:19.001 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.001 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.001 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:19.001 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:14.743135+0000", 2024-09-12T22:33:19.001 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1500000000000004e-07 2024-09-12T22:33:19.001 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.001 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.001 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:19.001 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:14.750441+0000", 2024-09-12T22:33:19.002 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0073052280000000004 2024-09-12T22:33:19.002 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.002 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.002 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:19.002 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:14.750453+0000", 2024-09-12T22:33:19.002 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2692e-05 2024-09-12T22:33:19.002 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.002 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.002 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:19.002 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:14.750462+0000", 2024-09-12T22:33:19.002 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.6179999999999995e-06 2024-09-12T22:33:19.002 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.002 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.002 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:19.003 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:14.750506+0000", 2024-09-12T22:33:19.003 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4431999999999997e-05 2024-09-12T22:33:19.003 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.003 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.003 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:19.003 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:14.750568+0000", 2024-09-12T22:33:19.003 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.1872999999999995e-05 2024-09-12T22:33:19.003 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.003 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.003 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:19.003 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:14.750661+0000", 2024-09-12T22:33:19.004 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.2819999999999996e-05 2024-09-12T22:33:19.004 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.004 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.004 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:19.004 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:14.768021+0000", 2024-09-12T22:33:19.004 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.017360322000000001 2024-09-12T22:33:19.004 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.004 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.004 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:19.004 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:14.780085+0000", 2024-09-12T22:33:19.004 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.012063776 2024-09-12T22:33:19.004 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.004 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.005 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:19.005 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:14.780140+0000", 2024-09-12T22:33:19.005 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4619e-05 2024-09-12T22:33:19.005 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.005 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.005 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:19.005 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:14.780191+0000", 2024-09-12T22:33:19.005 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1164e-05 2024-09-12T22:33:19.005 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:19.005 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:19.005 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:19.005 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.005 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.006 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4490.0:12488 4.b 4:d2207142:::100000030bf.00000000:head [write 0~4194304 [2@929226]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-12T22:33:19.006 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:14.751658+0000", 2024-09-12T22:33:19.006 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 4.1837398800000001, 2024-09-12T22:33:19.006 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.032597333999999999, 2024-09-12T22:33:19.006 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:19.006 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:19.006 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:19.006 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:33:19.006 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4490", 2024-09-12T22:33:19.006 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:19.006 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 12488 2024-09-12T22:33:19.006 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.007 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:19.007 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.007 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:19.007 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:14.751658+0000", 2024-09-12T22:33:19.007 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:19.007 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.007 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.007 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:19.007 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:14.751658+0000", 2024-09-12T22:33:19.007 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:19.007 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.007 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.007 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:19.008 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:14.751660+0000", 2024-09-12T22:33:19.008 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.697e-06 2024-09-12T22:33:19.008 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.008 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.008 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:19.008 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:14.759517+0000", 2024-09-12T22:33:19.008 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0078571990000000005 2024-09-12T22:33:19.008 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.008 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.008 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:19.008 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:14.759528+0000", 2024-09-12T22:33:19.008 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1494e-05 2024-09-12T22:33:19.008 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.009 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.009 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:19.009 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:14.759534+0000", 2024-09-12T22:33:19.009 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5759999999999996e-06 2024-09-12T22:33:19.009 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.009 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.009 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:19.009 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:14.759576+0000", 2024-09-12T22:33:19.009 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2295000000000001e-05 2024-09-12T22:33:19.009 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.009 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.009 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:19.009 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:14.759642+0000", 2024-09-12T22:33:19.010 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.5995999999999996e-05 2024-09-12T22:33:19.010 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.010 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.010 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:19.010 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:14.759721+0000", 2024-09-12T22:33:19.010 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.9219000000000002e-05 2024-09-12T22:33:19.010 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.010 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.010 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:19.010 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:14.768129+0000", 2024-09-12T22:33:19.010 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0084074140000000002 2024-09-12T22:33:19.010 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.010 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.011 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:19.011 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:14.784199+0000", 2024-09-12T22:33:19.011 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016070363000000001 2024-09-12T22:33:19.011 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.011 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.011 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:19.011 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:14.784233+0000", 2024-09-12T22:33:19.011 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3417999999999998e-05 2024-09-12T22:33:19.011 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.011 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.011 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:19.011 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:14.784255+0000", 2024-09-12T22:33:19.012 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.2663e-05 2024-09-12T22:33:19.012 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:19.012 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:19.012 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:19.012 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.012 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.012 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4490.0:12798 4.3e 4:7eb070ca:::100000030e0.00000000:head [write 0~4194304 [5@1189789]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-12T22:33:19.012 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:15.140228+0000", 2024-09-12T22:33:19.012 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 3.7951702689999998, 2024-09-12T22:33:19.012 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.046073232999999998, 2024-09-12T22:33:19.012 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:19.012 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:19.013 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:19.013 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:33:19.013 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4490", 2024-09-12T22:33:19.013 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:19.013 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 12798 2024-09-12T22:33:19.013 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.013 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:19.013 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.013 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:19.013 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.140228+0000", 2024-09-12T22:33:19.013 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:19.013 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.013 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.014 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:19.014 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.140228+0000", 2024-09-12T22:33:19.014 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:19.014 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.014 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.014 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:19.014 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.140228+0000", 2024-09-12T22:33:19.014 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5899999999999996e-07 2024-09-12T22:33:19.014 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.014 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.014 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:19.014 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.147541+0000", 2024-09-12T22:33:19.014 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0073125339999999999 2024-09-12T22:33:19.014 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.015 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.015 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:19.015 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.147555+0000", 2024-09-12T22:33:19.015 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.42e-05 2024-09-12T22:33:19.015 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.015 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.015 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:19.015 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.147564+0000", 2024-09-12T22:33:19.015 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.0999999999999993e-06 2024-09-12T22:33:19.015 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.015 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.015 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:19.015 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.147637+0000", 2024-09-12T22:33:19.016 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3288999999999996e-05 2024-09-12T22:33:19.016 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.016 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.016 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:19.016 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.147725+0000", 2024-09-12T22:33:19.016 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.7622999999999998e-05 2024-09-12T22:33:19.016 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.016 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.016 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:19.016 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.186239+0000", 2024-09-12T22:33:19.016 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.038514171 2024-09-12T22:33:19.016 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.017 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.017 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:19.017 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.186265+0000", 2024-09-12T22:33:19.017 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5738e-05 2024-09-12T22:33:19.017 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.017 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.017 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:19.017 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.186301+0000", 2024-09-12T22:33:19.017 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.6019000000000002e-05 2024-09-12T22:33:19.017 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:19.017 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:19.017 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:19.017 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.018 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.018 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(client.4490.0:12814 4.2b e55/18 4:d6b6ba21:::100000031b4.00000000:head v 55'184, mlcod=55'182)", 2024-09-12T22:33:19.018 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:15.144072+0000", 2024-09-12T22:33:19.018 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 3.791325294, 2024-09-12T22:33:19.018 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.036604959999999999, 2024-09-12T22:33:19.018 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:19.018 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:19.018 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:19.018 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:19.018 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.018 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:19.018 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.144072+0000", 2024-09-12T22:33:19.018 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:19.019 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.019 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.019 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:19.019 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.144072+0000", 2024-09-12T22:33:19.019 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:19.019 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.019 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.019 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:19.019 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.144073+0000", 2024-09-12T22:33:19.019 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.8700000000000004e-07 2024-09-12T22:33:19.019 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.019 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.019 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:19.020 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.151719+0000", 2024-09-12T22:33:19.020 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0076456739999999999 2024-09-12T22:33:19.020 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.020 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.020 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:19.020 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.151731+0000", 2024-09-12T22:33:19.020 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2325e-05 2024-09-12T22:33:19.020 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.020 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.020 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:19.020 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.151741+0000", 2024-09-12T22:33:19.020 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.6879999999999994e-06 2024-09-12T22:33:19.021 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.021 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.021 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:19.021 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.151790+0000", 2024-09-12T22:33:19.021 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9431999999999997e-05 2024-09-12T22:33:19.021 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.021 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.021 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:19.021 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.151806+0000", 2024-09-12T22:33:19.021 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.5322999999999999e-05 2024-09-12T22:33:19.021 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.021 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.021 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:19.022 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.180629+0000", 2024-09-12T22:33:19.022 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.028823273999999999 2024-09-12T22:33:19.022 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.022 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.022 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:19.022 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.180677+0000", 2024-09-12T22:33:19.022 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8356999999999998e-05 2024-09-12T22:33:19.022 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:19.022 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:19.022 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:19.022 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.022 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.022 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4490.0:12801 4.6 4:615a0d63:::100000032dd.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-12T22:33:19.023 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:15.147700+0000", 2024-09-12T22:33:19.023 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 3.7876975939999999, 2024-09-12T22:33:19.023 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.038675674, 2024-09-12T22:33:19.023 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:19.023 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:19.023 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:19.023 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:33:19.023 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4490", 2024-09-12T22:33:19.023 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:19.023 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 12801 2024-09-12T22:33:19.023 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.023 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:19.023 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.023 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:19.024 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.147700+0000", 2024-09-12T22:33:19.024 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:19.024 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.024 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.024 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:19.024 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.147700+0000", 2024-09-12T22:33:19.024 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:19.024 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.024 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.024 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:19.024 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.147701+0000", 2024-09-12T22:33:19.024 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.4099999999999998e-07 2024-09-12T22:33:19.024 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.025 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.025 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:19.025 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.152982+0000", 2024-09-12T22:33:19.025 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0052811020000000002 2024-09-12T22:33:19.025 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.025 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.025 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:19.025 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.152992+0000", 2024-09-12T22:33:19.025 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.6090000000000007e-06 2024-09-12T22:33:19.025 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.025 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.025 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:19.025 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.152996+0000", 2024-09-12T22:33:19.025 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6949999999999999e-06 2024-09-12T22:33:19.026 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.026 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.026 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:19.026 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.153075+0000", 2024-09-12T22:33:19.026 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.8509000000000003e-05 2024-09-12T22:33:19.026 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.026 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.026 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:19.026 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.153163+0000", 2024-09-12T22:33:19.026 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.7868000000000006e-05 2024-09-12T22:33:19.026 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.026 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.026 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:19.026 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.186308+0000", 2024-09-12T22:33:19.027 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.033145471000000003 2024-09-12T22:33:19.027 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.027 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.027 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:19.027 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.186337+0000", 2024-09-12T22:33:19.027 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.9167999999999999e-05 2024-09-12T22:33:19.027 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.027 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.027 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:19.027 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.186376+0000", 2024-09-12T22:33:19.027 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.8611e-05 2024-09-12T22:33:19.027 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:19.027 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:19.028 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:19.028 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.028 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.028 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4490.0:12806 4.6 4:61c3996c:::10000003442.00000000:head [write 567904~3968] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-12T22:33:19.028 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:15.153045+0000", 2024-09-12T22:33:19.028 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 3.782352779, 2024-09-12T22:33:19.028 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.033404439000000001, 2024-09-12T22:33:19.028 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:19.028 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:19.028 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:19.028 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:33:19.028 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4490", 2024-09-12T22:33:19.029 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:19.029 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 12806 2024-09-12T22:33:19.029 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.029 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:19.029 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.029 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:19.029 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.153045+0000", 2024-09-12T22:33:19.029 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:19.029 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.029 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.029 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:19.029 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.153045+0000", 2024-09-12T22:33:19.029 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:19.030 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.030 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.030 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:19.030 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.153045+0000", 2024-09-12T22:33:19.030 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.8299999999999998e-07 2024-09-12T22:33:19.030 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.030 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.030 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:19.030 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.153051+0000", 2024-09-12T22:33:19.030 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8189999999999997e-06 2024-09-12T22:33:19.030 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.031 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.031 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:19.031 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.153055+0000", 2024-09-12T22:33:19.031 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1489999999999996e-06 2024-09-12T22:33:19.031 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.031 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.031 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:19.031 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.153058+0000", 2024-09-12T22:33:19.031 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.9040000000000001e-06 2024-09-12T22:33:19.031 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.031 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.032 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:19.032 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.164929+0000", 2024-09-12T22:33:19.032 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.011870353 2024-09-12T22:33:19.032 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.032 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.032 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:19.032 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.165082+0000", 2024-09-12T22:33:19.033 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00015369 2024-09-12T22:33:19.033 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.033 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.033 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:19.033 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.186382+0000", 2024-09-12T22:33:19.033 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.021299304000000002 2024-09-12T22:33:19.033 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.033 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.033 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:19.033 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.186406+0000", 2024-09-12T22:33:19.034 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4865999999999999e-05 2024-09-12T22:33:19.034 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.034 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.034 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:19.034 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.186449+0000", 2024-09-12T22:33:19.034 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2970999999999999e-05 2024-09-12T22:33:19.034 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:19.034 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:19.034 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:19.035 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.035 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.035 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4490.0:12830 4.26 4:67fac9a7:::100000033fa.00000000:head [write 936231~106509] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-12T22:33:19.035 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:15.165509+0000", 2024-09-12T22:33:19.035 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 3.7698887320000001, 2024-09-12T22:33:19.035 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.033783457000000003, 2024-09-12T22:33:19.035 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:19.035 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:19.036 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:19.036 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:33:19.036 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4490", 2024-09-12T22:33:19.036 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:19.036 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 12830 2024-09-12T22:33:19.036 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.036 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:19.036 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.036 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:19.037 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.165509+0000", 2024-09-12T22:33:19.037 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:19.037 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.037 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.037 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:19.037 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.165509+0000", 2024-09-12T22:33:19.037 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:19.037 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.037 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.037 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:19.037 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.165510+0000", 2024-09-12T22:33:19.037 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9800000000000003e-07 2024-09-12T22:33:19.037 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.038 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.038 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:19.038 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.165544+0000", 2024-09-12T22:33:19.038 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4542999999999998e-05 2024-09-12T22:33:19.038 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.038 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.038 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:19.038 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.165552+0000", 2024-09-12T22:33:19.038 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.2160000000000006e-06 2024-09-12T22:33:19.038 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.038 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.038 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:19.038 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.165556+0000", 2024-09-12T22:33:19.038 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2830000000000002e-06 2024-09-12T22:33:19.039 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.039 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.039 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:19.039 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.181795+0000", 2024-09-12T22:33:19.039 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.016239213999999998 2024-09-12T22:33:19.039 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.039 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.039 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:19.039 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.181888+0000", 2024-09-12T22:33:19.039 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.2816e-05 2024-09-12T22:33:19.039 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.039 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.039 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:19.039 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.181976+0000", 2024-09-12T22:33:19.040 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.8164000000000005e-05 2024-09-12T22:33:19.040 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.040 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.040 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:19.040 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.186575+0000", 2024-09-12T22:33:19.040 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0045991720000000003 2024-09-12T22:33:19.040 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.040 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.040 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:19.040 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.199250+0000", 2024-09-12T22:33:19.040 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.012674529 2024-09-12T22:33:19.040 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.040 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.041 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:19.041 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.199274+0000", 2024-09-12T22:33:19.041 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.3960000000000001e-05 2024-09-12T22:33:19.041 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.041 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.041 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:19.041 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.199292+0000", 2024-09-12T22:33:19.041 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.8961999999999999e-05 2024-09-12T22:33:19.041 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:19.041 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:19.041 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:19.041 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.041 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.042 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4490.0:15579 4.29 4:9641a85f:::1000000360e.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:33:19.042 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:18.243743+0000", 2024-09-12T22:33:19.042 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.69165432699999996, 2024-09-12T22:33:19.042 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.04066782, 2024-09-12T22:33:19.042 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:19.042 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:19.042 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:19.042 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:33:19.042 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4490", 2024-09-12T22:33:19.042 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:19.042 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 15579 2024-09-12T22:33:19.042 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.042 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:19.042 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.043 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:19.043 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:18.243743+0000", 2024-09-12T22:33:19.043 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:19.043 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.043 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.043 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:19.043 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:18.243743+0000", 2024-09-12T22:33:19.043 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:19.043 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.043 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.043 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:19.043 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:18.243745+0000", 2024-09-12T22:33:19.043 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2550000000000001e-06 2024-09-12T22:33:19.044 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.044 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.044 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:19.044 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:18.249935+0000", 2024-09-12T22:33:19.044 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0061902570000000002 2024-09-12T22:33:19.044 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.044 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.044 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:19.044 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:18.249951+0000", 2024-09-12T22:33:19.044 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6470999999999999e-05 2024-09-12T22:33:19.044 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.045 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.045 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:19.045 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:18.249959+0000", 2024-09-12T22:33:19.045 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.6690000000000006e-06 2024-09-12T22:33:19.045 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.045 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.045 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:19.045 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:18.250029+0000", 2024-09-12T22:33:19.045 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.0334999999999997e-05 2024-09-12T22:33:19.045 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.045 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.045 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:19.045 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:18.250244+0000", 2024-09-12T22:33:19.046 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00021427300000000001 2024-09-12T22:33:19.046 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.046 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.046 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:19.046 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:18.250377+0000", 2024-09-12T22:33:19.046 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013336199999999999 2024-09-12T22:33:19.046 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.046 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.046 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:19.046 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:18.258564+0000", 2024-09-12T22:33:19.046 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.008187293 2024-09-12T22:33:19.047 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.047 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.047 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:19.047 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:18.284343+0000", 2024-09-12T22:33:19.047 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.025779036000000002 2024-09-12T22:33:19.047 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.047 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.047 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:19.047 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:18.284379+0000", 2024-09-12T22:33:19.047 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.5485000000000003e-05 2024-09-12T22:33:19.047 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.047 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.048 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:19.048 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:18.284411+0000", 2024-09-12T22:33:19.048 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2384e-05 2024-09-12T22:33:19.048 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:19.048 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:19.048 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:19.048 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.048 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.048 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4490.0:15582 4.11 4:8b7ff786:::10000003a1c.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-12T22:33:19.048 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:18.250065+0000", 2024-09-12T22:33:19.048 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.685332473, 2024-09-12T22:33:19.048 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.034871654000000002, 2024-09-12T22:33:19.048 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:19.049 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:19.049 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:19.049 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:33:19.049 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4490", 2024-09-12T22:33:19.049 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:19.049 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 15582 2024-09-12T22:33:19.049 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.049 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:19.049 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.049 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:19.049 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:18.250065+0000", 2024-09-12T22:33:19.049 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:19.050 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.050 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.050 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:19.050 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:18.250065+0000", 2024-09-12T22:33:19.050 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:19.050 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.050 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.050 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:19.050 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:18.250066+0000", 2024-09-12T22:33:19.050 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.7300000000000001e-07 2024-09-12T22:33:19.050 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.050 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.050 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:19.050 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:18.255262+0000", 2024-09-12T22:33:19.051 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0051961239999999999 2024-09-12T22:33:19.051 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.051 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.051 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:19.051 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:18.255274+0000", 2024-09-12T22:33:19.051 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.182e-05 2024-09-12T22:33:19.051 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.051 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.051 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:19.051 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:18.255281+0000", 2024-09-12T22:33:19.051 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.9090000000000003e-06 2024-09-12T22:33:19.051 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.051 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.051 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:19.052 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:18.255350+0000", 2024-09-12T22:33:19.052 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.8990000000000002e-05 2024-09-12T22:33:19.052 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.052 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.052 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:19.052 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:18.255499+0000", 2024-09-12T22:33:19.052 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000148966 2024-09-12T22:33:19.052 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.052 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.052 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:19.052 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:18.255634+0000", 2024-09-12T22:33:19.052 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000135341 2024-09-12T22:33:19.053 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.053 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.053 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:19.053 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:18.264751+0000", 2024-09-12T22:33:19.053 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0091166240000000003 2024-09-12T22:33:19.053 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.053 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.053 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:19.053 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:18.284840+0000", 2024-09-12T22:33:19.053 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.020089828000000001 2024-09-12T22:33:19.053 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.053 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.053 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:19.054 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:18.284895+0000", 2024-09-12T22:33:19.054 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.4812000000000003e-05 2024-09-12T22:33:19.054 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.054 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.054 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:19.054 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:18.284937+0000", 2024-09-12T22:33:19.054 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1767000000000002e-05 2024-09-12T22:33:19.054 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:19.054 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:19.054 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:19.054 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:19.054 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:19.054 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:33:19.056 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:33:19.056 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:19.054+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:19.157 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:19.156+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:19.162 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-09-12T22:33:19.162 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-09-12T22:33:19.162 INFO:teuthology.orchestra.run.smithi163.stdout: "num_ops": 0 2024-09-12T22:33:19.162 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-09-12T22:33:19.170 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:33:19.258 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:19.257+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:19.273 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-09-12T22:33:19.274 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-09-12T22:33:19.274 INFO:teuthology.orchestra.run.smithi163.stdout: "complaint_time": 30, 2024-09-12T22:33:19.274 INFO:teuthology.orchestra.run.smithi163.stdout: "num_blocked_ops": 0 2024-09-12T22:33:19.274 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-09-12T22:33:19.283 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:33:19.359 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:19.358+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:19.390 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-09-12T22:33:19.390 INFO:teuthology.orchestra.run.smithi163.stdout: "size": 20, 2024-09-12T22:33:19.390 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 600, 2024-09-12T22:33:19.390 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2024-09-12T22:33:19.390 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.390 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-09-12T22:33:19.391 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:27.254459+0000", 2024-09-12T22:33:19.391 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 112.132529338, 2024-09-12T22:33:19.391 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.37816283899999997, 2024-09-12T22:33:19.391 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:19.391 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:19.392 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:19.392 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:19.392 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:33:19.392 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:33:19.392 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 1 2024-09-12T22:33:19.392 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.393 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:19.393 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.393 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:19.393 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254459+0000", 2024-09-12T22:33:19.393 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:19.393 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.394 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.394 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:19.394 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254459+0000", 2024-09-12T22:33:19.395 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:19.395 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.395 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.396 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:19.396 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254460+0000", 2024-09-12T22:33:19.396 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1739999999999999e-06 2024-09-12T22:33:19.397 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.397 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.397 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:19.397 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254472+0000", 2024-09-12T22:33:19.398 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2207e-05 2024-09-12T22:33:19.398 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.398 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.398 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:19.398 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254483+0000", 2024-09-12T22:33:19.398 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0631999999999999e-05 2024-09-12T22:33:19.398 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.398 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.398 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:19.398 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254492+0000", 2024-09-12T22:33:19.398 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3670000000000003e-06 2024-09-12T22:33:19.398 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.398 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.398 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:19.399 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254551+0000", 2024-09-12T22:33:19.399 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8687999999999998e-05 2024-09-12T22:33:19.399 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.399 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.399 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for peered", 2024-09-12T22:33:19.399 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254562+0000", 2024-09-12T22:33:19.399 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1249e-05 2024-09-12T22:33:19.399 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.399 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.399 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:19.400 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.631211+0000", 2024-09-12T22:33:19.400 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.376649018 2024-09-12T22:33:19.400 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.400 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.400 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:19.400 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.631345+0000", 2024-09-12T22:33:19.400 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013378700000000001 2024-09-12T22:33:19.400 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.400 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.400 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:33:19.401 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.631479+0000", 2024-09-12T22:33:19.401 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013352399999999999 2024-09-12T22:33:19.401 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.401 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.401 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:19.401 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632324+0000", 2024-09-12T22:33:19.401 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00084508100000000002 2024-09-12T22:33:19.401 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.401 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.402 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:19.402 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632548+0000", 2024-09-12T22:33:19.402 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000224329 2024-09-12T22:33:19.402 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.402 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.402 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:19.402 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632591+0000", 2024-09-12T22:33:19.402 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2564000000000001e-05 2024-09-12T22:33:19.402 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.402 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.402 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:19.402 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632622+0000", 2024-09-12T22:33:19.402 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1219e-05 2024-09-12T22:33:19.402 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:19.403 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:19.403 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:19.403 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.403 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.403 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4490.0:9871 4.35 4:ad66404a:::10000002d4d.00000000:head [write 0~6507] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:33:19.403 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:09.472309+0000", 2024-09-12T22:33:19.403 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 9.9146790619999994, 2024-09-12T22:33:19.403 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.080251445000000005, 2024-09-12T22:33:19.403 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:19.403 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:19.403 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:19.403 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:19.403 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4490", 2024-09-12T22:33:19.403 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:19.404 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 9871 2024-09-12T22:33:19.404 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.404 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:19.404 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.404 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:19.404 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.472309+0000", 2024-09-12T22:33:19.404 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:19.404 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.404 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.404 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:19.404 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.472309+0000", 2024-09-12T22:33:19.404 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:19.404 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.404 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.405 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:19.405 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.472310+0000", 2024-09-12T22:33:19.405 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3799999999999996e-07 2024-09-12T22:33:19.405 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.405 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.405 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:19.405 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.472318+0000", 2024-09-12T22:33:19.405 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.8099999999999998e-06 2024-09-12T22:33:19.405 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.405 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.405 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:19.405 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.472328+0000", 2024-09-12T22:33:19.405 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0359e-05 2024-09-12T22:33:19.405 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.406 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.406 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:19.406 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.472334+0000", 2024-09-12T22:33:19.406 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.0109999999999997e-06 2024-09-12T22:33:19.406 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.406 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.406 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:19.406 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.472382+0000", 2024-09-12T22:33:19.407 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.7311000000000002e-05 2024-09-12T22:33:19.407 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.407 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.407 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:19.407 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.472497+0000", 2024-09-12T22:33:19.407 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011537800000000001 2024-09-12T22:33:19.407 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.407 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.407 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:19.407 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.472617+0000", 2024-09-12T22:33:19.407 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011989600000000001 2024-09-12T22:33:19.407 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.407 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.408 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:19.408 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473149+0000", 2024-09-12T22:33:19.408 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00053227999999999999 2024-09-12T22:33:19.408 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.408 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.408 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:19.408 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.552479+0000", 2024-09-12T22:33:19.408 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.079329541000000003 2024-09-12T22:33:19.408 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.408 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.408 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:19.408 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.552525+0000", 2024-09-12T22:33:19.408 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6421000000000002e-05 2024-09-12T22:33:19.409 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.409 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.409 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:19.409 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.552561+0000", 2024-09-12T22:33:19.409 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5599999999999998e-05 2024-09-12T22:33:19.409 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:19.409 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:19.409 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:19.409 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.409 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.409 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4490.0:9872 4.2c 4:3602c8d3:::10000002d4e.00000000:head [write 0~1178] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:33:19.409 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:09.473085+0000", 2024-09-12T22:33:19.409 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 9.913903758, 2024-09-12T22:33:19.409 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.079631104999999994, 2024-09-12T22:33:19.410 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:19.410 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:19.410 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:19.410 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:19.410 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4490", 2024-09-12T22:33:19.410 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:19.410 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 9872 2024-09-12T22:33:19.410 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.410 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:19.410 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.410 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:19.410 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473085+0000", 2024-09-12T22:33:19.410 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:19.411 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.411 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.411 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:19.411 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473085+0000", 2024-09-12T22:33:19.411 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:19.411 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.411 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.412 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:19.412 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473085+0000", 2024-09-12T22:33:19.412 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3600000000000004e-07 2024-09-12T22:33:19.412 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.412 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.412 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:19.412 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473088+0000", 2024-09-12T22:33:19.412 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.005e-06 2024-09-12T22:33:19.412 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.412 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.412 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:19.412 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473095+0000", 2024-09-12T22:33:19.412 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3950000000000003e-06 2024-09-12T22:33:19.413 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.413 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.413 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:19.413 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473100+0000", 2024-09-12T22:33:19.413 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5460000000000002e-06 2024-09-12T22:33:19.413 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.413 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.413 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:19.413 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473138+0000", 2024-09-12T22:33:19.413 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8244999999999997e-05 2024-09-12T22:33:19.413 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.413 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.413 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:19.413 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473216+0000", 2024-09-12T22:33:19.414 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.7756000000000006e-05 2024-09-12T22:33:19.414 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.414 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.414 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:19.414 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473291+0000", 2024-09-12T22:33:19.414 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5110000000000004e-05 2024-09-12T22:33:19.414 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.414 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.414 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:19.414 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473736+0000", 2024-09-12T22:33:19.414 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00044486500000000002 2024-09-12T22:33:19.414 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.414 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.414 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:19.415 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.552637+0000", 2024-09-12T22:33:19.415 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.078900782000000003 2024-09-12T22:33:19.415 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.415 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.415 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:19.415 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.552680+0000", 2024-09-12T22:33:19.415 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3047999999999998e-05 2024-09-12T22:33:19.415 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.415 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.415 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:19.415 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.552716+0000", 2024-09-12T22:33:19.415 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5816999999999999e-05 2024-09-12T22:33:19.416 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:19.416 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:19.416 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:19.416 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.416 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.416 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4490.0:9873 4.2c 4:372c52ff:::10000002d4f.00000000:head [write 0~1230] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:33:19.416 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:09.473878+0000", 2024-09-12T22:33:19.416 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 9.9131102949999992, 2024-09-12T22:33:19.416 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.079036047999999998, 2024-09-12T22:33:19.416 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:19.416 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:19.416 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:19.416 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:19.417 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4490", 2024-09-12T22:33:19.417 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:19.417 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 9873 2024-09-12T22:33:19.417 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.417 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:19.417 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.417 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:19.417 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473878+0000", 2024-09-12T22:33:19.417 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:19.417 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.417 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.417 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:19.417 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473878+0000", 2024-09-12T22:33:19.417 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:19.418 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.418 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.418 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:19.418 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473879+0000", 2024-09-12T22:33:19.418 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9100000000000004e-07 2024-09-12T22:33:19.418 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.418 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.418 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:19.418 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473882+0000", 2024-09-12T22:33:19.418 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.405e-06 2024-09-12T22:33:19.418 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.418 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.418 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:19.418 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473889+0000", 2024-09-12T22:33:19.419 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7519999999999999e-06 2024-09-12T22:33:19.419 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.419 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.419 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:19.419 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473893+0000", 2024-09-12T22:33:19.419 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9310000000000001e-06 2024-09-12T22:33:19.419 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.419 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.419 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:19.419 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473922+0000", 2024-09-12T22:33:19.419 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9346999999999999e-05 2024-09-12T22:33:19.419 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.419 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.419 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:19.420 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474000+0000", 2024-09-12T22:33:19.420 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.7972000000000005e-05 2024-09-12T22:33:19.420 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.420 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.420 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:19.420 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474072+0000", 2024-09-12T22:33:19.420 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1960999999999998e-05 2024-09-12T22:33:19.420 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.420 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.420 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:19.420 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474470+0000", 2024-09-12T22:33:19.420 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00039803400000000002 2024-09-12T22:33:19.420 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.421 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.421 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:19.421 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.552814+0000", 2024-09-12T22:33:19.421 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.078344164999999993 2024-09-12T22:33:19.421 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.421 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.421 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:19.421 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.552875+0000", 2024-09-12T22:33:19.421 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1008999999999998e-05 2024-09-12T22:33:19.421 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.421 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.421 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:19.421 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.552914+0000", 2024-09-12T22:33:19.421 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8881000000000003e-05 2024-09-12T22:33:19.422 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:19.422 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:19.422 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:19.422 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.422 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.422 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4490.0:9874 4.1b 4:db19d96a:::10000002d50.00000000:head [write 0~1088] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:33:19.422 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:09.474673+0000", 2024-09-12T22:33:19.422 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 9.9123153019999997, 2024-09-12T22:33:19.422 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.080314317999999996, 2024-09-12T22:33:19.422 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:19.422 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:19.422 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:19.422 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:19.422 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4490", 2024-09-12T22:33:19.423 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:19.423 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 9874 2024-09-12T22:33:19.423 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.423 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:19.423 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.423 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:19.423 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474673+0000", 2024-09-12T22:33:19.423 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:19.423 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.423 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.423 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:19.423 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474673+0000", 2024-09-12T22:33:19.423 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:19.423 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.424 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.424 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:19.424 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474674+0000", 2024-09-12T22:33:19.424 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6199999999999998e-07 2024-09-12T22:33:19.424 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.424 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.424 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:19.424 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474677+0000", 2024-09-12T22:33:19.424 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.224e-06 2024-09-12T22:33:19.424 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.424 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.424 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:19.424 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474683+0000", 2024-09-12T22:33:19.425 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.3160000000000002e-06 2024-09-12T22:33:19.425 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.425 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.425 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:19.425 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474687+0000", 2024-09-12T22:33:19.425 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7869999999999999e-06 2024-09-12T22:33:19.425 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.425 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.425 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:19.425 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474730+0000", 2024-09-12T22:33:19.425 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3309000000000002e-05 2024-09-12T22:33:19.425 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.426 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.426 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:19.426 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474845+0000", 2024-09-12T22:33:19.426 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114306 2024-09-12T22:33:19.426 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.426 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.426 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:19.426 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474970+0000", 2024-09-12T22:33:19.426 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000125096 2024-09-12T22:33:19.426 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.426 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.426 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:19.426 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.475621+0000", 2024-09-12T22:33:19.426 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00065124900000000001 2024-09-12T22:33:19.427 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.427 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.427 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:19.427 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.554885+0000", 2024-09-12T22:33:19.427 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.079264055 2024-09-12T22:33:19.427 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.427 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.427 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:19.427 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.554942+0000", 2024-09-12T22:33:19.427 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7284000000000002e-05 2024-09-12T22:33:19.427 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.427 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.428 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:19.428 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.554987+0000", 2024-09-12T22:33:19.428 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5130000000000003e-05 2024-09-12T22:33:19.428 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:19.428 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:19.428 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:19.428 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.428 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.428 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4490.0:12220 4.2b 4:d55bfd66:::10000003169.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-12T22:33:19.428 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.391333+0000", 2024-09-12T22:33:19.428 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 4.995655159, 2024-09-12T22:33:19.428 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.088669550999999999, 2024-09-12T22:33:19.429 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:19.429 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:19.429 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:19.429 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:19.429 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4490", 2024-09-12T22:33:19.429 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:19.429 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 12220 2024-09-12T22:33:19.429 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.429 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:19.429 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.429 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:19.429 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.391333+0000", 2024-09-12T22:33:19.429 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:19.429 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.430 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.430 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:19.430 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.391333+0000", 2024-09-12T22:33:19.430 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:19.430 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.430 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.430 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:19.430 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.391334+0000", 2024-09-12T22:33:19.430 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3099999999999997e-07 2024-09-12T22:33:19.430 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.430 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.430 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:19.430 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398373+0000", 2024-09-12T22:33:19.431 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0070386670000000002 2024-09-12T22:33:19.431 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.431 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.431 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:19.431 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398384+0000", 2024-09-12T22:33:19.431 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1338999999999999e-05 2024-09-12T22:33:19.431 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.431 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.431 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:19.431 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398389+0000", 2024-09-12T22:33:19.431 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3650000000000003e-06 2024-09-12T22:33:19.431 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.431 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.432 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:19.432 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.456308+0000", 2024-09-12T22:33:19.432 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.057918931 2024-09-12T22:33:19.432 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.432 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.432 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:19.432 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.456425+0000", 2024-09-12T22:33:19.432 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000116452 2024-09-12T22:33:19.432 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.432 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.432 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:19.432 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.456536+0000", 2024-09-12T22:33:19.432 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000111839 2024-09-12T22:33:19.433 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.433 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.433 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:19.433 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.465335+0000", 2024-09-12T22:33:19.433 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0087984980000000001 2024-09-12T22:33:19.433 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.433 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.433 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:19.433 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.479950+0000", 2024-09-12T22:33:19.433 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.01461552 2024-09-12T22:33:19.433 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.433 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.433 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:19.433 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.479983+0000", 2024-09-12T22:33:19.434 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2126999999999999e-05 2024-09-12T22:33:19.434 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.434 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.434 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:19.434 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.480003+0000", 2024-09-12T22:33:19.434 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0081999999999998e-05 2024-09-12T22:33:19.434 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:19.434 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:19.434 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:19.434 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.434 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.434 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1208 3.13 3:cb3d3880:::200.0000000d:head [write 1009846~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:19.434 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.398459+0000", 2024-09-12T22:33:19.435 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 4.988529593, 2024-09-12T22:33:19.435 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.078093931000000005, 2024-09-12T22:33:19.435 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:19.435 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:19.435 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:19.435 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:19.435 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.435 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:19.435 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398459+0000", 2024-09-12T22:33:19.435 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:19.435 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.435 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.435 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:19.435 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398459+0000", 2024-09-12T22:33:19.436 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:19.436 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.436 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.436 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:19.436 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398459+0000", 2024-09-12T22:33:19.436 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8100000000000003e-07 2024-09-12T22:33:19.436 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.436 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.436 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:19.436 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398462+0000", 2024-09-12T22:33:19.436 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3700000000000002e-06 2024-09-12T22:33:19.436 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.436 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.437 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:19.437 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398469+0000", 2024-09-12T22:33:19.437 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2320000000000004e-06 2024-09-12T22:33:19.437 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.437 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.437 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:19.437 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398472+0000", 2024-09-12T22:33:19.437 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.658e-06 2024-09-12T22:33:19.437 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.437 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.437 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:19.437 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.456690+0000", 2024-09-12T22:33:19.437 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.058217615 2024-09-12T22:33:19.438 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.438 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.438 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:19.438 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.456731+0000", 2024-09-12T22:33:19.438 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0815000000000001e-05 2024-09-12T22:33:19.438 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.438 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.438 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:19.438 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.456793+0000", 2024-09-12T22:33:19.438 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1796000000000003e-05 2024-09-12T22:33:19.439 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.439 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.439 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:19.439 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.461412+0000", 2024-09-12T22:33:19.439 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0046188560000000002 2024-09-12T22:33:19.439 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.439 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.439 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:19.439 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476429+0000", 2024-09-12T22:33:19.439 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.015017943000000001 2024-09-12T22:33:19.439 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.439 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.440 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:19.440 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476499+0000", 2024-09-12T22:33:19.440 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9047000000000005e-05 2024-09-12T22:33:19.440 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.440 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.440 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:19.440 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476553+0000", 2024-09-12T22:33:19.440 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4117999999999999e-05 2024-09-12T22:33:19.440 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:19.440 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:19.440 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:19.440 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.440 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.441 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1209 3.13 3:cb3d3880:::200.0000000d:head [write 1011245~5867 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:19.441 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.398677+0000", 2024-09-12T22:33:19.441 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 4.9883110359999998, 2024-09-12T22:33:19.441 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.077995698000000002, 2024-09-12T22:33:19.441 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:19.441 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:19.441 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:19.441 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:19.441 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.441 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:19.441 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398677+0000", 2024-09-12T22:33:19.441 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:19.442 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.442 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.442 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:19.442 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398677+0000", 2024-09-12T22:33:19.442 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:19.442 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.442 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.442 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:19.442 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398678+0000", 2024-09-12T22:33:19.442 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5199999999999995e-07 2024-09-12T22:33:19.442 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.442 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.443 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:19.443 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398686+0000", 2024-09-12T22:33:19.443 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0579999999999998e-06 2024-09-12T22:33:19.443 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.443 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.443 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:19.443 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398695+0000", 2024-09-12T22:33:19.443 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.1409999999999994e-06 2024-09-12T22:33:19.443 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.443 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.443 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:19.443 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398703+0000", 2024-09-12T22:33:19.443 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4379999999999998e-06 2024-09-12T22:33:19.443 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.444 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.444 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:19.444 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.457051+0000", 2024-09-12T22:33:19.444 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.058348358000000003 2024-09-12T22:33:19.444 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.444 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.444 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:19.444 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.457096+0000", 2024-09-12T22:33:19.444 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4428000000000002e-05 2024-09-12T22:33:19.444 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.444 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.444 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:19.445 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.457162+0000", 2024-09-12T22:33:19.445 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6298999999999997e-05 2024-09-12T22:33:19.445 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.445 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.445 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:19.445 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.461416+0000", 2024-09-12T22:33:19.445 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0042539980000000002 2024-09-12T22:33:19.445 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.445 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.445 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:19.445 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476610+0000", 2024-09-12T22:33:19.445 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.015193879 2024-09-12T22:33:19.445 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.445 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.446 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:19.446 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476640+0000", 2024-09-12T22:33:19.446 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0648000000000002e-05 2024-09-12T22:33:19.446 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.446 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.446 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:19.446 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476673+0000", 2024-09-12T22:33:19.446 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2598999999999997e-05 2024-09-12T22:33:19.446 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:19.446 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:19.446 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:19.446 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.446 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.447 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1210 3.13 3:cb3d3880:::200.0000000d:head [write 1017112~1958 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:19.447 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.398713+0000", 2024-09-12T22:33:19.447 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 4.9882757130000002, 2024-09-12T22:33:19.447 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.078118317000000007, 2024-09-12T22:33:19.447 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:19.447 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:19.447 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:19.447 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:19.447 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.447 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:19.447 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398713+0000", 2024-09-12T22:33:19.447 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:19.447 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.447 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.448 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:19.448 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398713+0000", 2024-09-12T22:33:19.448 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:19.448 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.448 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.448 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:19.448 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398713+0000", 2024-09-12T22:33:19.448 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7599999999999998e-07 2024-09-12T22:33:19.448 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.448 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.448 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:19.448 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398718+0000", 2024-09-12T22:33:19.449 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8169999999999998e-06 2024-09-12T22:33:19.449 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.449 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.449 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:19.449 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398722+0000", 2024-09-12T22:33:19.449 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5249999999999999e-06 2024-09-12T22:33:19.449 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.449 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.449 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:19.449 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398726+0000", 2024-09-12T22:33:19.449 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5650000000000002e-06 2024-09-12T22:33:19.449 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.449 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.449 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:19.450 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.457644+0000", 2024-09-12T22:33:19.450 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.058918521000000001 2024-09-12T22:33:19.450 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.450 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.450 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:19.450 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.457724+0000", 2024-09-12T22:33:19.450 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9408999999999998e-05 2024-09-12T22:33:19.450 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.450 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.450 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:19.450 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.457821+0000", 2024-09-12T22:33:19.450 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.7015000000000005e-05 2024-09-12T22:33:19.450 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.450 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.451 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:19.451 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.461419+0000", 2024-09-12T22:33:19.451 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0035985309999999999 2024-09-12T22:33:19.451 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.451 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.451 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:19.451 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476726+0000", 2024-09-12T22:33:19.451 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.015306804 2024-09-12T22:33:19.451 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.451 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.451 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:19.451 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476787+0000", 2024-09-12T22:33:19.451 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1062000000000006e-05 2024-09-12T22:33:19.451 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.452 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.452 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:19.452 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476831+0000", 2024-09-12T22:33:19.452 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3692000000000001e-05 2024-09-12T22:33:19.452 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:19.452 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:19.452 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:19.452 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.452 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.452 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1211 3.13 3:cb3d3880:::200.0000000d:head [write 1019070~5873 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:19.452 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.400122+0000", 2024-09-12T22:33:19.452 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 4.9868659950000005, 2024-09-12T22:33:19.452 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.076797146999999996, 2024-09-12T22:33:19.452 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:19.453 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:19.453 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:19.453 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:19.453 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.453 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:19.453 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.400122+0000", 2024-09-12T22:33:19.453 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:19.453 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.453 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.453 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:19.453 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.400122+0000", 2024-09-12T22:33:19.453 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:19.453 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.454 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.454 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:19.454 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.400123+0000", 2024-09-12T22:33:19.454 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2500000000000005e-07 2024-09-12T22:33:19.454 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.454 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.454 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:19.454 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.400129+0000", 2024-09-12T22:33:19.454 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.319e-06 2024-09-12T22:33:19.454 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.454 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.454 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:19.454 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.400139+0000", 2024-09-12T22:33:19.455 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.5200000000000003e-06 2024-09-12T22:33:19.455 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.455 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.455 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:19.455 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.400143+0000", 2024-09-12T22:33:19.455 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.437e-06 2024-09-12T22:33:19.455 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.455 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.455 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:19.455 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.458159+0000", 2024-09-12T22:33:19.455 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.058015960999999998 2024-09-12T22:33:19.455 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.455 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.455 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:19.456 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.458201+0000", 2024-09-12T22:33:19.456 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1693000000000002e-05 2024-09-12T22:33:19.456 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.456 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.456 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:19.456 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.458267+0000", 2024-09-12T22:33:19.456 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5687999999999999e-05 2024-09-12T22:33:19.456 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.456 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.456 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:19.456 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.461423+0000", 2024-09-12T22:33:19.456 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0031560730000000001 2024-09-12T22:33:19.456 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.457 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.457 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:19.457 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476868+0000", 2024-09-12T22:33:19.457 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.015445108000000001 2024-09-12T22:33:19.457 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.457 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.457 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:19.457 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476897+0000", 2024-09-12T22:33:19.457 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9433000000000001e-05 2024-09-12T22:33:19.457 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.457 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.457 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:19.457 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476919+0000", 2024-09-12T22:33:19.457 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.2189999999999999e-05 2024-09-12T22:33:19.458 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:19.458 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:19.458 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:19.458 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.458 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.458 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1212 3.13 3:cb3d3880:::200.0000000d:head [write 1024943~3866 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:19.458 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.401707+0000", 2024-09-12T22:33:19.458 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 4.9852817900000002, 2024-09-12T22:33:19.458 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.075386625999999998, 2024-09-12T22:33:19.458 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:19.458 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:19.458 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:19.458 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:19.458 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.459 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:19.459 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.401707+0000", 2024-09-12T22:33:19.459 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:19.459 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.459 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.459 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:19.459 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.401707+0000", 2024-09-12T22:33:19.459 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:19.459 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.459 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.459 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:19.459 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.401707+0000", 2024-09-12T22:33:19.459 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7700000000000004e-07 2024-09-12T22:33:19.460 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.460 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.460 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:19.460 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.401713+0000", 2024-09-12T22:33:19.460 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6609999999999997e-06 2024-09-12T22:33:19.460 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.460 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.460 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:19.460 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.401726+0000", 2024-09-12T22:33:19.460 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.3088000000000001e-05 2024-09-12T22:33:19.460 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.460 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.460 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:19.460 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.401741+0000", 2024-09-12T22:33:19.461 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.5424e-05 2024-09-12T22:33:19.461 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.461 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.461 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:19.461 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.458853+0000", 2024-09-12T22:33:19.461 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.057111157000000003 2024-09-12T22:33:19.461 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.461 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.461 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:19.461 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.458898+0000", 2024-09-12T22:33:19.461 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5633999999999997e-05 2024-09-12T22:33:19.461 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.461 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.461 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:19.462 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.458972+0000", 2024-09-12T22:33:19.462 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3441000000000004e-05 2024-09-12T22:33:19.462 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.462 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.462 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:19.462 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.461426+0000", 2024-09-12T22:33:19.462 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0024542660000000001 2024-09-12T22:33:19.462 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.462 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.462 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:19.462 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476985+0000", 2024-09-12T22:33:19.462 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.015559513000000001 2024-09-12T22:33:19.462 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.462 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.463 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:19.463 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.477044+0000", 2024-09-12T22:33:19.463 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8156999999999999e-05 2024-09-12T22:33:19.463 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.463 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.463 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:19.463 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.477093+0000", 2024-09-12T22:33:19.463 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9607999999999997e-05 2024-09-12T22:33:19.463 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:19.463 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:19.463 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:19.463 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.463 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.463 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1213 3.13 3:cb3d3880:::200.0000000d:head [write 1028809~6329 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:19.464 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.403250+0000", 2024-09-12T22:33:19.464 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 4.9837382620000001, 2024-09-12T22:33:19.464 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.073936215999999999, 2024-09-12T22:33:19.464 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:19.464 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:19.464 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:19.464 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:19.464 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.464 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:19.464 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403250+0000", 2024-09-12T22:33:19.464 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:19.464 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.464 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.465 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:19.465 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403250+0000", 2024-09-12T22:33:19.465 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:19.465 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.465 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.465 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:19.465 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403251+0000", 2024-09-12T22:33:19.465 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.37e-07 2024-09-12T22:33:19.465 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.465 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.465 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:19.465 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403258+0000", 2024-09-12T22:33:19.465 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.25e-06 2024-09-12T22:33:19.465 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.466 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.466 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:19.466 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403269+0000", 2024-09-12T22:33:19.466 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0509000000000001e-05 2024-09-12T22:33:19.466 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.466 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.466 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:19.466 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403274+0000", 2024-09-12T22:33:19.466 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1290000000000004e-06 2024-09-12T22:33:19.466 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.466 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.466 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:19.466 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.459796+0000", 2024-09-12T22:33:19.466 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.056522020999999999 2024-09-12T22:33:19.467 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.467 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.467 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:19.467 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.459845+0000", 2024-09-12T22:33:19.467 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8884999999999997e-05 2024-09-12T22:33:19.467 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.467 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.467 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:19.467 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.459920+0000", 2024-09-12T22:33:19.467 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5318e-05 2024-09-12T22:33:19.467 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.467 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.467 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:19.467 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.466542+0000", 2024-09-12T22:33:19.468 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0066223139999999998 2024-09-12T22:33:19.468 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.468 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.468 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:19.468 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.477137+0000", 2024-09-12T22:33:19.468 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010594717 2024-09-12T22:33:19.468 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.468 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.468 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:19.468 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.477165+0000", 2024-09-12T22:33:19.468 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8262000000000001e-05 2024-09-12T22:33:19.468 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.468 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.469 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:19.469 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.477186+0000", 2024-09-12T22:33:19.469 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1073999999999998e-05 2024-09-12T22:33:19.469 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:19.469 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:19.469 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:19.469 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.469 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.469 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1214 3.13 3:cb3d3880:::200.0000000d:head [write 1035138~2606 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:19.469 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.403674+0000", 2024-09-12T22:33:19.469 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 4.9833143419999999, 2024-09-12T22:33:19.469 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.073643204000000004, 2024-09-12T22:33:19.469 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:19.469 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:19.470 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:19.470 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:19.470 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.470 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:19.470 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403674+0000", 2024-09-12T22:33:19.470 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:19.470 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.470 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.470 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:19.470 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403674+0000", 2024-09-12T22:33:19.470 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:19.470 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.470 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.470 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:19.470 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403674+0000", 2024-09-12T22:33:19.471 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.7700000000000005e-07 2024-09-12T22:33:19.471 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.471 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.471 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:19.471 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403678+0000", 2024-09-12T22:33:19.471 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2009999999999999e-06 2024-09-12T22:33:19.471 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.471 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.471 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:19.471 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403686+0000", 2024-09-12T22:33:19.471 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5690000000000005e-06 2024-09-12T22:33:19.471 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.471 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.471 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:19.472 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403690+0000", 2024-09-12T22:33:19.472 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.233e-06 2024-09-12T22:33:19.472 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.472 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.472 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:19.472 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.460445+0000", 2024-09-12T22:33:19.472 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.056754412999999997 2024-09-12T22:33:19.472 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.472 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.472 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:19.472 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.460495+0000", 2024-09-12T22:33:19.472 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0238999999999998e-05 2024-09-12T22:33:19.473 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.473 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.473 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:19.473 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.460566+0000", 2024-09-12T22:33:19.473 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1159000000000001e-05 2024-09-12T22:33:19.473 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.473 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.473 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:19.473 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.466546+0000", 2024-09-12T22:33:19.473 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0059798910000000002 2024-09-12T22:33:19.473 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.473 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.473 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:19.473 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.477232+0000", 2024-09-12T22:33:19.474 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010686084 2024-09-12T22:33:19.474 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.474 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.474 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:19.474 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.477280+0000", 2024-09-12T22:33:19.474 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.7719999999999997e-05 2024-09-12T22:33:19.474 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.474 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.474 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:19.474 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.477317+0000", 2024-09-12T22:33:19.474 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7218000000000002e-05 2024-09-12T22:33:19.474 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:19.474 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:19.475 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:19.475 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.475 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.475 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1223 3.13 3:cb3d3880:::200.0000000d:head [write 1090497~1913 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:19.475 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.420111+0000", 2024-09-12T22:33:19.475 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 4.9668771899999999, 2024-09-12T22:33:19.475 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.071634583000000002, 2024-09-12T22:33:19.475 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:19.475 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:19.475 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:19.475 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:19.475 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.475 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:19.476 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.420111+0000", 2024-09-12T22:33:19.476 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:19.476 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.476 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.476 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:19.476 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.420111+0000", 2024-09-12T22:33:19.476 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:19.476 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.476 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.476 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:19.476 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.420112+0000", 2024-09-12T22:33:19.476 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.2900000000000002e-07 2024-09-12T22:33:19.476 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.476 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.477 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:19.477 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.420116+0000", 2024-09-12T22:33:19.477 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.67e-06 2024-09-12T22:33:19.477 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.477 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.477 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:19.477 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.420125+0000", 2024-09-12T22:33:19.477 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.0890000000000006e-06 2024-09-12T22:33:19.477 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.477 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.477 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:19.477 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.420131+0000", 2024-09-12T22:33:19.477 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4269999999999996e-06 2024-09-12T22:33:19.478 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.478 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.478 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:19.478 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.465358+0000", 2024-09-12T22:33:19.478 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.045227030000000001 2024-09-12T22:33:19.478 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.478 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.478 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:19.478 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.465439+0000", 2024-09-12T22:33:19.478 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0901000000000004e-05 2024-09-12T22:33:19.478 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.478 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.478 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:19.478 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.465571+0000", 2024-09-12T22:33:19.479 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000131705 2024-09-12T22:33:19.479 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.479 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.479 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:19.479 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.469496+0000", 2024-09-12T22:33:19.479 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.003925418 2024-09-12T22:33:19.479 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.479 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.479 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:19.479 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.491669+0000", 2024-09-12T22:33:19.479 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.022172335000000001 2024-09-12T22:33:19.479 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.479 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.479 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:19.480 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.491714+0000", 2024-09-12T22:33:19.480 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5417000000000002e-05 2024-09-12T22:33:19.480 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.480 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.480 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:19.480 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.491746+0000", 2024-09-12T22:33:19.480 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1662000000000003e-05 2024-09-12T22:33:19.480 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:19.480 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:19.480 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:19.480 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.480 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.480 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1225 3.13 3:cb3d3880:::200.0000000d:head [write 1097316~1932 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:19.481 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.421303+0000", 2024-09-12T22:33:19.481 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 4.9656853549999997, 2024-09-12T22:33:19.481 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.074934770999999997, 2024-09-12T22:33:19.481 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:19.481 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:19.481 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:19.481 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:19.481 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.481 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:19.481 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.421303+0000", 2024-09-12T22:33:19.481 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:19.481 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.481 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.481 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:19.482 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.421303+0000", 2024-09-12T22:33:19.482 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:19.482 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.482 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.482 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:19.482 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.421303+0000", 2024-09-12T22:33:19.482 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8599999999999998e-07 2024-09-12T22:33:19.482 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.482 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.482 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:19.482 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.421307+0000", 2024-09-12T22:33:19.482 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0879999999999999e-06 2024-09-12T22:33:19.482 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.483 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.483 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:19.483 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.421314+0000", 2024-09-12T22:33:19.483 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1010000000000003e-06 2024-09-12T22:33:19.483 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.483 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.483 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:19.483 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.421319+0000", 2024-09-12T22:33:19.483 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7209999999999999e-06 2024-09-12T22:33:19.483 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.483 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.483 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:19.483 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.466620+0000", 2024-09-12T22:33:19.483 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.045301044999999998 2024-09-12T22:33:19.484 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.484 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.484 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:19.484 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.466703+0000", 2024-09-12T22:33:19.484 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3011999999999997e-05 2024-09-12T22:33:19.484 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.484 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.484 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:19.484 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.466826+0000", 2024-09-12T22:33:19.484 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000122824 2024-09-12T22:33:19.484 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.484 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.484 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:19.485 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.472359+0000", 2024-09-12T22:33:19.485 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0055323009999999999 2024-09-12T22:33:19.485 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.485 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.485 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:19.485 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496142+0000", 2024-09-12T22:33:19.485 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.023783696999999999 2024-09-12T22:33:19.485 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.485 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.485 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:19.485 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496194+0000", 2024-09-12T22:33:19.485 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1350000000000001e-05 2024-09-12T22:33:19.485 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.485 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.486 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:19.486 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496238+0000", 2024-09-12T22:33:19.486 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4146000000000001e-05 2024-09-12T22:33:19.486 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:19.486 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:19.486 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:19.486 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.487 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.487 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1226 3.13 3:cb3d3880:::200.0000000d:head [write 1099248~1973 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:19.487 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.422971+0000", 2024-09-12T22:33:19.487 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 4.9640177569999997, 2024-09-12T22:33:19.487 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.073363063000000006, 2024-09-12T22:33:19.487 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:19.487 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:19.487 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:19.487 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:19.487 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.487 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:19.487 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.422971+0000", 2024-09-12T22:33:19.487 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:19.488 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.488 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.488 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:19.488 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.422971+0000", 2024-09-12T22:33:19.488 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:19.488 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.488 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.488 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:19.488 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.422971+0000", 2024-09-12T22:33:19.488 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.1699999999999997e-07 2024-09-12T22:33:19.488 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.488 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.488 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:19.489 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.422975+0000", 2024-09-12T22:33:19.489 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2650000000000001e-06 2024-09-12T22:33:19.489 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.489 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.493 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:19.493 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.422981+0000", 2024-09-12T22:33:19.493 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7379999999999997e-06 2024-09-12T22:33:19.494 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.494 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.494 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:19.494 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.422986+0000", 2024-09-12T22:33:19.494 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5220000000000001e-06 2024-09-12T22:33:19.494 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.494 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.494 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:19.494 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.467340+0000", 2024-09-12T22:33:19.494 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.044353985999999998 2024-09-12T22:33:19.494 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.494 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.494 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:19.494 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.467412+0000", 2024-09-12T22:33:19.495 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1982000000000003e-05 2024-09-12T22:33:19.495 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.495 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.495 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:19.495 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.467493+0000", 2024-09-12T22:33:19.495 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0829999999999997e-05 2024-09-12T22:33:19.495 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.495 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.495 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:19.495 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.472364+0000", 2024-09-12T22:33:19.495 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0048713189999999998 2024-09-12T22:33:19.495 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.495 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.495 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:19.496 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496271+0000", 2024-09-12T22:33:19.496 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.023906808000000002 2024-09-12T22:33:19.496 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.496 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.496 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:19.496 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496300+0000", 2024-09-12T22:33:19.496 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9315e-05 2024-09-12T22:33:19.496 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.496 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.496 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:19.496 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496334+0000", 2024-09-12T22:33:19.496 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3481e-05 2024-09-12T22:33:19.496 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:19.497 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:19.497 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:19.497 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.497 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.497 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1227 3.13 3:cb3d3880:::200.0000000d:head [write 1101221~1922 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:19.497 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.423028+0000", 2024-09-12T22:33:19.497 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 4.9639607730000002, 2024-09-12T22:33:19.497 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.073444802000000003, 2024-09-12T22:33:19.497 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:19.497 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:19.497 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:19.497 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:19.497 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.497 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:19.498 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423028+0000", 2024-09-12T22:33:19.498 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:19.498 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.498 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.498 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:19.498 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423028+0000", 2024-09-12T22:33:19.498 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:19.498 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.498 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.498 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:19.498 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423028+0000", 2024-09-12T22:33:19.498 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1699999999999998e-07 2024-09-12T22:33:19.498 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.498 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.499 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:19.499 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423031+0000", 2024-09-12T22:33:19.499 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8499999999999998e-06 2024-09-12T22:33:19.499 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.499 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.499 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:19.499 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423036+0000", 2024-09-12T22:33:19.499 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9479999999999999e-06 2024-09-12T22:33:19.499 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.499 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.499 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:19.499 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423039+0000", 2024-09-12T22:33:19.499 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4929999999999998e-06 2024-09-12T22:33:19.499 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.500 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.500 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:19.500 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.467785+0000", 2024-09-12T22:33:19.500 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.044745957000000003 2024-09-12T22:33:19.500 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.500 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.500 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:19.500 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.467838+0000", 2024-09-12T22:33:19.500 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2596999999999998e-05 2024-09-12T22:33:19.500 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.500 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.500 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:19.500 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.467915+0000", 2024-09-12T22:33:19.501 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6744999999999998e-05 2024-09-12T22:33:19.501 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.501 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.501 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:19.501 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.472368+0000", 2024-09-12T22:33:19.501 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0044534730000000003 2024-09-12T22:33:19.501 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.501 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.501 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:19.501 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496382+0000", 2024-09-12T22:33:19.501 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.024014111000000001 2024-09-12T22:33:19.501 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.501 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.501 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:19.502 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496443+0000", 2024-09-12T22:33:19.502 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.0547000000000002e-05 2024-09-12T22:33:19.502 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.502 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.502 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:19.502 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496472+0000", 2024-09-12T22:33:19.502 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9564e-05 2024-09-12T22:33:19.502 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:19.502 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:19.502 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:19.502 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.502 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.502 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1228 3.13 3:cb3d3880:::200.0000000d:head [write 1103143~2423 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:19.502 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.423305+0000", 2024-09-12T22:33:19.503 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 4.9636834089999997, 2024-09-12T22:33:19.503 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.073251160999999995, 2024-09-12T22:33:19.503 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:19.503 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:19.503 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:19.503 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:19.503 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.503 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:19.503 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423305+0000", 2024-09-12T22:33:19.503 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:19.503 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.503 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.503 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:19.504 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423305+0000", 2024-09-12T22:33:19.504 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:19.504 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.504 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.504 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:19.504 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423306+0000", 2024-09-12T22:33:19.504 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4899999999999995e-07 2024-09-12T22:33:19.504 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.504 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.504 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:19.504 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423311+0000", 2024-09-12T22:33:19.504 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7459999999999997e-06 2024-09-12T22:33:19.504 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.504 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.505 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:19.505 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423316+0000", 2024-09-12T22:33:19.505 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0239999999999997e-06 2024-09-12T22:33:19.505 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.505 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.505 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:19.505 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423320+0000", 2024-09-12T22:33:19.505 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.67e-06 2024-09-12T22:33:19.505 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.505 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.505 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:19.505 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.468252+0000", 2024-09-12T22:33:19.505 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.044932262000000001 2024-09-12T22:33:19.505 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.506 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.506 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:19.506 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.468293+0000", 2024-09-12T22:33:19.506 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0368999999999999e-05 2024-09-12T22:33:19.506 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.506 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.506 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:19.506 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.468357+0000", 2024-09-12T22:33:19.506 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4287000000000003e-05 2024-09-12T22:33:19.506 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.506 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.506 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:19.506 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.472371+0000", 2024-09-12T22:33:19.506 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0040144350000000002 2024-09-12T22:33:19.507 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.507 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.507 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:19.507 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496507+0000", 2024-09-12T22:33:19.507 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.024135961000000001 2024-09-12T22:33:19.507 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.507 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.507 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:19.507 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496537+0000", 2024-09-12T22:33:19.507 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9611000000000002e-05 2024-09-12T22:33:19.507 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.507 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.507 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:19.507 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496556+0000", 2024-09-12T22:33:19.508 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9147000000000002e-05 2024-09-12T22:33:19.508 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:19.508 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:19.508 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:19.508 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.508 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.508 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1229 3.13 3:cb3d3880:::200.0000000d:head [write 1105566~1911 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:19.508 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.423606+0000", 2024-09-12T22:33:19.508 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 4.9633823980000003, 2024-09-12T22:33:19.508 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.073027876000000005, 2024-09-12T22:33:19.508 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:19.508 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:19.508 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:19.508 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:19.509 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.509 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:19.509 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423606+0000", 2024-09-12T22:33:19.509 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:19.509 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.509 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.509 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:19.509 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423606+0000", 2024-09-12T22:33:19.509 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:19.509 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.509 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.509 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:19.509 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423606+0000", 2024-09-12T22:33:19.509 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.7e-07 2024-09-12T22:33:19.510 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.510 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.510 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:19.510 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423609+0000", 2024-09-12T22:33:19.510 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5339999999999998e-06 2024-09-12T22:33:19.510 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.510 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.510 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:19.510 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423614+0000", 2024-09-12T22:33:19.510 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.69e-06 2024-09-12T22:33:19.510 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.510 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.510 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:19.511 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423617+0000", 2024-09-12T22:33:19.511 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4300000000000002e-06 2024-09-12T22:33:19.511 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.511 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.511 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:19.511 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.468606+0000", 2024-09-12T22:33:19.511 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.044988606 2024-09-12T22:33:19.511 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.511 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.511 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:19.511 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.468649+0000", 2024-09-12T22:33:19.511 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3414000000000001e-05 2024-09-12T22:33:19.511 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.511 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.512 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:19.512 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.468714+0000", 2024-09-12T22:33:19.512 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4857000000000006e-05 2024-09-12T22:33:19.512 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.512 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.512 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:19.512 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.472375+0000", 2024-09-12T22:33:19.512 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0036607330000000002 2024-09-12T22:33:19.512 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.512 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.512 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:19.512 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496585+0000", 2024-09-12T22:33:19.512 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.024210835 2024-09-12T22:33:19.513 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.513 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.513 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:19.513 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496612+0000", 2024-09-12T22:33:19.513 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6999999999999999e-05 2024-09-12T22:33:19.513 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.513 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.513 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:19.513 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496634+0000", 2024-09-12T22:33:19.513 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1307000000000001e-05 2024-09-12T22:33:19.513 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:19.513 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:19.513 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:19.513 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.514 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.514 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1230 3.13 3:cb3d3880:::200.0000000d:head [write 1107477~6537 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:19.514 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.423911+0000", 2024-09-12T22:33:19.514 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 4.9630775529999998, 2024-09-12T22:33:19.514 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.072794530999999996, 2024-09-12T22:33:19.514 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:19.514 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:19.514 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:19.514 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:19.514 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.514 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:19.514 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423911+0000", 2024-09-12T22:33:19.514 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:19.515 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.515 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.515 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:19.515 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423911+0000", 2024-09-12T22:33:19.515 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:19.515 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.515 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.515 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:19.515 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423911+0000", 2024-09-12T22:33:19.515 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3799999999999998e-07 2024-09-12T22:33:19.515 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.515 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.515 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:19.515 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423919+0000", 2024-09-12T22:33:19.516 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.8329999999999994e-06 2024-09-12T22:33:19.516 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.516 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.516 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:19.516 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423924+0000", 2024-09-12T22:33:19.516 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3449999999999996e-06 2024-09-12T22:33:19.516 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.516 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.516 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:19.516 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423928+0000", 2024-09-12T22:33:19.516 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2339999999999999e-06 2024-09-12T22:33:19.516 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.516 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.516 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:19.517 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.469042+0000", 2024-09-12T22:33:19.517 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.045114888999999998 2024-09-12T22:33:19.517 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.517 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.517 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:19.517 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.469092+0000", 2024-09-12T22:33:19.517 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9289000000000002e-05 2024-09-12T22:33:19.517 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.517 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.517 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:19.517 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.469163+0000", 2024-09-12T22:33:19.517 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1222000000000004e-05 2024-09-12T22:33:19.517 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.517 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.518 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:19.518 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.472379+0000", 2024-09-12T22:33:19.518 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0032156419999999999 2024-09-12T22:33:19.518 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.518 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.518 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:19.518 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496661+0000", 2024-09-12T22:33:19.518 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.024281857 2024-09-12T22:33:19.518 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.518 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.518 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:19.518 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496687+0000", 2024-09-12T22:33:19.518 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6551e-05 2024-09-12T22:33:19.519 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:19.519 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:19.519 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:19.519 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496705+0000", 2024-09-12T22:33:19.519 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.8230999999999999e-05 2024-09-12T22:33:19.519 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:19.519 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:19.519 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:19.519 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:19.519 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:19.519 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-09-12T22:33:19.521 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:19.519+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:19.521 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:33:19.559 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T22:33:19.622 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:19.620+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:19.626 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:33:19.626 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:33:19.626 INFO:teuthology.orchestra.run.smithi148.stdout: "num_ops": 0 2024-09-12T22:33:19.626 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:33:19.635 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:33:19.722 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:19.721+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:19.782 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:33:19.782 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:33:19.782 INFO:teuthology.orchestra.run.smithi148.stdout: "complaint_time": 30, 2024-09-12T22:33:19.782 INFO:teuthology.orchestra.run.smithi148.stdout: "num_blocked_ops": 0 2024-09-12T22:33:19.782 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:33:19.791 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:33:19.824 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:19.823+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:19.925 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:19.924+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:19.938 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:33:19.938 INFO:teuthology.orchestra.run.smithi148.stdout: "size": 20, 2024-09-12T22:33:19.938 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 600, 2024-09-12T22:33:19.938 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [ 2024-09-12T22:33:19.939 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.939 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4490.0:9866 4.b 4:d370243b:::10000002d48.00000000:head [write 0~1308] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:33:19.939 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:09.467883+0000", 2024-09-12T22:33:19.939 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 10.468418143999999, 2024-09-12T22:33:19.939 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.085024817000000003, 2024-09-12T22:33:19.939 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:19.939 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:19.939 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:19.939 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:33:19.939 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4490", 2024-09-12T22:33:19.939 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:19.939 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 9866 2024-09-12T22:33:19.939 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.939 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:19.940 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.940 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:19.940 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.467883+0000", 2024-09-12T22:33:19.940 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:19.940 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.940 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.940 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:19.940 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.467883+0000", 2024-09-12T22:33:19.940 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:19.940 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.940 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.940 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:19.940 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.467884+0000", 2024-09-12T22:33:19.941 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1800000000000005e-07 2024-09-12T22:33:19.941 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.941 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.941 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:19.941 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.467888+0000", 2024-09-12T22:33:19.941 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5959999999999997e-06 2024-09-12T22:33:19.941 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.941 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.941 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:19.941 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.467896+0000", 2024-09-12T22:33:19.941 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.8679999999999999e-06 2024-09-12T22:33:19.941 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.941 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.942 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:19.942 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.467901+0000", 2024-09-12T22:33:19.942 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9169999999999997e-06 2024-09-12T22:33:19.942 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.942 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.942 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:19.942 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.467944+0000", 2024-09-12T22:33:19.942 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3055e-05 2024-09-12T22:33:19.942 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.942 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.942 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:19.942 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.468011+0000", 2024-09-12T22:33:19.942 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7328000000000003e-05 2024-09-12T22:33:19.942 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.943 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.943 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:19.943 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.468078+0000", 2024-09-12T22:33:19.943 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7063999999999994e-05 2024-09-12T22:33:19.943 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.943 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.943 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:19.943 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.551406+0000", 2024-09-12T22:33:19.943 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.083327485000000007 2024-09-12T22:33:19.943 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.943 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.943 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:19.943 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.552822+0000", 2024-09-12T22:33:19.943 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001415929 2024-09-12T22:33:19.944 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.944 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.944 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:19.944 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.552863+0000", 2024-09-12T22:33:19.944 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0809000000000002e-05 2024-09-12T22:33:19.944 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.944 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.944 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:19.944 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.552908+0000", 2024-09-12T22:33:19.944 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5048e-05 2024-09-12T22:33:19.944 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:19.944 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:19.945 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:19.945 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.945 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.945 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4490.0:9867 4.16 4:6bd8f1b8:::10000002d49.00000000:head [write 0~1599] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:33:19.945 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:09.468760+0000", 2024-09-12T22:33:19.945 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 10.467541134999999, 2024-09-12T22:33:19.945 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.086660499000000002, 2024-09-12T22:33:19.945 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:19.945 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:19.945 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:19.945 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:33:19.945 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4490", 2024-09-12T22:33:19.945 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:19.945 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 9867 2024-09-12T22:33:19.946 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.946 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:19.946 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.946 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:19.946 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.468760+0000", 2024-09-12T22:33:19.946 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:19.946 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.946 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.946 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:19.946 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.468760+0000", 2024-09-12T22:33:19.946 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:19.946 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.946 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.946 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:19.947 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.468761+0000", 2024-09-12T22:33:19.947 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4399999999999999e-07 2024-09-12T22:33:19.947 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.947 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.947 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:19.947 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.468765+0000", 2024-09-12T22:33:19.947 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3259999999999997e-06 2024-09-12T22:33:19.947 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.947 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.948 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:19.948 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.548969+0000", 2024-09-12T22:33:19.948 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.080204172000000004 2024-09-12T22:33:19.948 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.948 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.948 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:19.948 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.549001+0000", 2024-09-12T22:33:19.948 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.1464999999999998e-05 2024-09-12T22:33:19.948 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.948 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.948 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:19.948 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.549148+0000", 2024-09-12T22:33:19.948 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014749399999999999 2024-09-12T22:33:19.949 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.949 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.949 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:19.949 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.549379+0000", 2024-09-12T22:33:19.949 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000231091 2024-09-12T22:33:19.949 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.949 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.949 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:19.949 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.549518+0000", 2024-09-12T22:33:19.949 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013844899999999999 2024-09-12T22:33:19.949 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.949 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.949 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:19.950 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.552236+0000", 2024-09-12T22:33:19.950 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0027179869999999998 2024-09-12T22:33:19.950 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.950 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.950 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:19.950 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.555333+0000", 2024-09-12T22:33:19.950 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0030973559999999999 2024-09-12T22:33:19.950 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.950 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.950 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:19.950 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.555379+0000", 2024-09-12T22:33:19.950 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6236999999999998e-05 2024-09-12T22:33:19.950 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.950 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.951 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:19.951 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.555420+0000", 2024-09-12T22:33:19.951 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1177999999999998e-05 2024-09-12T22:33:19.951 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:19.951 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:19.951 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:19.951 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.951 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.951 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop_reply(client.4490.0:9866 4.b e53/18 ondisk, result = 0)", 2024-09-12T22:33:19.951 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:09.468826+0000", 2024-09-12T22:33:19.951 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 10.46747484, 2024-09-12T22:33:19.951 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.082588348000000006, 2024-09-12T22:33:19.951 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:19.951 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:19.952 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:33:19.952 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:19.952 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.952 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:19.952 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.468826+0000", 2024-09-12T22:33:19.952 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:19.952 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.952 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.952 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:19.952 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.468826+0000", 2024-09-12T22:33:19.952 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:19.952 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.952 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.952 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:19.953 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.468827+0000", 2024-09-12T22:33:19.953 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3399999999999999e-07 2024-09-12T22:33:19.953 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.953 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.953 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:19.953 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.468830+0000", 2024-09-12T22:33:19.953 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.1559999999999999e-06 2024-09-12T22:33:19.953 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.953 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.953 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:19.953 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.548957+0000", 2024-09-12T22:33:19.953 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.080126852999999998 2024-09-12T22:33:19.953 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.954 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.954 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:19.954 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.548989+0000", 2024-09-12T22:33:19.954 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2409000000000001e-05 2024-09-12T22:33:19.954 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.954 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.954 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:19.954 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.551065+0000", 2024-09-12T22:33:19.954 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.002075871 2024-09-12T22:33:19.954 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.954 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.954 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:19.954 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.551398+0000", 2024-09-12T22:33:19.954 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00033339099999999999 2024-09-12T22:33:19.955 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.955 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.955 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:19.955 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.551414+0000", 2024-09-12T22:33:19.955 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6133999999999998e-05 2024-09-12T22:33:19.955 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:19.955 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:19.955 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:19.955 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.956 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.956 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4490.0:10437 4.2f 4:f6cd553b:::10000002fce.00000000:head [write 0~27313] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:33:19.956 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:10.050890+0000", 2024-09-12T22:33:19.956 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 9.8854104439999997, 2024-09-12T22:33:19.956 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.056482601, 2024-09-12T22:33:19.956 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:19.956 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:19.956 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:19.956 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:33:19.956 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4490", 2024-09-12T22:33:19.956 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:19.956 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 10437 2024-09-12T22:33:19.956 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.957 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:19.957 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.957 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:19.957 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.050890+0000", 2024-09-12T22:33:19.957 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:19.957 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.957 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.957 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:19.957 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.050890+0000", 2024-09-12T22:33:19.957 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:19.957 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.957 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.957 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:19.958 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.050891+0000", 2024-09-12T22:33:19.958 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.6600000000000005e-07 2024-09-12T22:33:19.958 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.958 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.958 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:19.959 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.050906+0000", 2024-09-12T22:33:19.959 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4521e-05 2024-09-12T22:33:19.959 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.959 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.959 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:19.959 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.050915+0000", 2024-09-12T22:33:19.959 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.2569999999999996e-06 2024-09-12T22:33:19.959 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.959 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.959 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:19.960 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.050920+0000", 2024-09-12T22:33:19.960 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.724e-06 2024-09-12T22:33:19.960 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.960 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.960 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:19.960 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.050960+0000", 2024-09-12T22:33:19.960 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9999000000000001e-05 2024-09-12T22:33:19.960 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.960 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.960 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:19.960 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.051031+0000", 2024-09-12T22:33:19.960 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1007000000000006e-05 2024-09-12T22:33:19.960 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.961 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.961 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:19.961 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.107249+0000", 2024-09-12T22:33:19.961 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.056218432999999998 2024-09-12T22:33:19.961 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.961 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.961 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:19.961 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.107301+0000", 2024-09-12T22:33:19.961 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1289000000000003e-05 2024-09-12T22:33:19.961 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.961 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.961 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:19.962 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.107373+0000", 2024-09-12T22:33:19.962 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.2504999999999998e-05 2024-09-12T22:33:19.962 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:19.962 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:19.962 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:19.962 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.962 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.962 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4490.0:10439 4.12 4:483953cb:::10000002fd0.00000000:head [write 0~4842] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:33:19.962 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:10.052567+0000", 2024-09-12T22:33:19.962 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 9.8837342360000005, 2024-09-12T22:33:19.962 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.055835449000000002, 2024-09-12T22:33:19.962 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:19.962 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:19.963 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:19.963 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:33:19.963 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4490", 2024-09-12T22:33:19.963 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:19.963 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 10439 2024-09-12T22:33:19.963 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.963 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:19.963 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.963 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:19.963 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.052567+0000", 2024-09-12T22:33:19.963 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:19.963 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.963 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.964 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:19.964 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.052567+0000", 2024-09-12T22:33:19.964 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:19.964 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.964 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.964 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:19.964 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.052568+0000", 2024-09-12T22:33:19.964 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.3600000000000002e-07 2024-09-12T22:33:19.964 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.964 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.964 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:19.964 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.052591+0000", 2024-09-12T22:33:19.964 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.3110000000000001e-05 2024-09-12T22:33:19.965 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.965 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.965 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:19.965 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.106740+0000", 2024-09-12T22:33:19.965 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.054149315000000003 2024-09-12T22:33:19.965 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.965 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.965 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:19.965 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.106751+0000", 2024-09-12T22:33:19.965 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1056000000000001e-05 2024-09-12T22:33:19.965 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.965 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.965 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:19.965 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.106811+0000", 2024-09-12T22:33:19.966 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9515999999999997e-05 2024-09-12T22:33:19.966 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.966 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.966 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:19.966 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.106929+0000", 2024-09-12T22:33:19.966 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00011879000000000001 2024-09-12T22:33:19.966 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.966 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.966 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:19.966 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.108283+0000", 2024-09-12T22:33:19.966 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001354177 2024-09-12T22:33:19.966 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.966 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.966 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:19.967 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.108328+0000", 2024-09-12T22:33:19.967 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4931000000000001e-05 2024-09-12T22:33:19.967 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.967 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.967 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:19.967 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.108402+0000", 2024-09-12T22:33:19.967 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3718000000000001e-05 2024-09-12T22:33:19.967 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:19.967 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:19.967 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:19.967 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.967 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.967 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(client.4490.0:10445 4.3c e53/18 4:3d97251e:::10000002fd8.00000000:head v 53'154, mlcod=53'152)", 2024-09-12T22:33:19.968 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:10.058521+0000", 2024-09-12T22:33:19.968 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 9.8777798959999998, 2024-09-12T22:33:19.968 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.049310138000000003, 2024-09-12T22:33:19.968 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:19.968 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:19.968 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:19.968 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:19.968 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.968 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:19.968 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.058521+0000", 2024-09-12T22:33:19.968 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:19.968 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.968 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.969 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:19.969 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.058521+0000", 2024-09-12T22:33:19.969 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:19.969 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.969 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.969 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:19.969 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.058522+0000", 2024-09-12T22:33:19.969 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.1099999999999995e-07 2024-09-12T22:33:19.969 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.969 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.969 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:19.969 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.058530+0000", 2024-09-12T22:33:19.969 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.7290000000000006e-06 2024-09-12T22:33:19.970 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.970 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.970 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:19.970 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.106760+0000", 2024-09-12T22:33:19.970 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.048229384 2024-09-12T22:33:19.970 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.970 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.970 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:19.970 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.106770+0000", 2024-09-12T22:33:19.970 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0431999999999999e-05 2024-09-12T22:33:19.970 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.970 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.970 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:19.971 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.106823+0000", 2024-09-12T22:33:19.971 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2309999999999999e-05 2024-09-12T22:33:19.971 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.971 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.971 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:19.971 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.106841+0000", 2024-09-12T22:33:19.971 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.8218000000000001e-05 2024-09-12T22:33:19.971 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.971 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.971 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:19.971 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.107796+0000", 2024-09-12T22:33:19.971 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00095552600000000005 2024-09-12T22:33:19.971 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.972 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.972 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:19.972 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.107831+0000", 2024-09-12T22:33:19.972 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4928000000000002e-05 2024-09-12T22:33:19.972 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:19.972 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:19.972 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:19.972 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.972 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.972 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4490.0:11351 4.3f 4:fd498422:::10000003188.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-12T22:33:19.972 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:13.354715+0000", 2024-09-12T22:33:19.972 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 6.5815860820000003, 2024-09-12T22:33:19.972 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.043059568999999999, 2024-09-12T22:33:19.972 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:19.973 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:19.973 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:19.973 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:33:19.973 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4490", 2024-09-12T22:33:19.973 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:19.973 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 11351 2024-09-12T22:33:19.973 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.973 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:19.973 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.973 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:19.973 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.354715+0000", 2024-09-12T22:33:19.973 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:19.973 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.973 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.973 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:19.974 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.354715+0000", 2024-09-12T22:33:19.974 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:19.974 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.974 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.974 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:19.974 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.354716+0000", 2024-09-12T22:33:19.974 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.7600000000000006e-07 2024-09-12T22:33:19.974 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.974 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.974 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:19.974 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.361477+0000", 2024-09-12T22:33:19.974 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0067607090000000002 2024-09-12T22:33:19.974 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.974 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.975 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:19.975 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.361487+0000", 2024-09-12T22:33:19.975 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0249e-05 2024-09-12T22:33:19.975 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.975 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.975 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:19.975 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.361493+0000", 2024-09-12T22:33:19.975 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.4699999999999999e-06 2024-09-12T22:33:19.975 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.975 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.975 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:19.975 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.361544+0000", 2024-09-12T22:33:19.975 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1124e-05 2024-09-12T22:33:19.975 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.975 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.976 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:19.976 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.361604+0000", 2024-09-12T22:33:19.976 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9397000000000001e-05 2024-09-12T22:33:19.976 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.976 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.976 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:19.976 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.397601+0000", 2024-09-12T22:33:19.976 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.035996927999999997 2024-09-12T22:33:19.976 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.976 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.976 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:19.976 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.397646+0000", 2024-09-12T22:33:19.976 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5176000000000003e-05 2024-09-12T22:33:19.976 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.976 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.977 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:19.977 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.397774+0000", 2024-09-12T22:33:19.977 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012854000000000001 2024-09-12T22:33:19.977 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:19.977 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:19.977 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:19.977 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.977 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.977 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4490.0:12798 4.3e 4:7eb070ca:::100000030e0.00000000:head [write 0~4194304 [5@1189789]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-12T22:33:19.977 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:15.140228+0000", 2024-09-12T22:33:19.977 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 4.796073432, 2024-09-12T22:33:19.977 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.046073232999999998, 2024-09-12T22:33:19.977 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:19.977 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:19.978 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:19.978 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:33:19.978 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4490", 2024-09-12T22:33:19.978 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:19.978 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 12798 2024-09-12T22:33:19.978 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.978 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:19.978 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.978 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:19.978 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.140228+0000", 2024-09-12T22:33:19.978 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:19.978 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.978 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.978 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:19.979 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.140228+0000", 2024-09-12T22:33:19.979 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:19.979 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.979 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.979 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:19.979 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.140228+0000", 2024-09-12T22:33:19.979 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5899999999999996e-07 2024-09-12T22:33:19.979 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.979 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.979 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:19.979 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.147541+0000", 2024-09-12T22:33:19.979 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0073125339999999999 2024-09-12T22:33:19.979 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.980 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.980 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:19.980 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.147555+0000", 2024-09-12T22:33:19.980 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.42e-05 2024-09-12T22:33:19.980 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.980 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.980 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:19.980 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.147564+0000", 2024-09-12T22:33:19.980 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.0999999999999993e-06 2024-09-12T22:33:19.980 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.980 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.980 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:19.980 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.147637+0000", 2024-09-12T22:33:19.981 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3288999999999996e-05 2024-09-12T22:33:19.981 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.981 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.981 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:19.981 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.147725+0000", 2024-09-12T22:33:19.981 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.7622999999999998e-05 2024-09-12T22:33:19.981 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.981 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.981 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:19.981 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.186239+0000", 2024-09-12T22:33:19.981 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.038514171 2024-09-12T22:33:19.981 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.981 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.982 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:19.982 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.186265+0000", 2024-09-12T22:33:19.982 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5738e-05 2024-09-12T22:33:19.982 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.982 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.982 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:19.982 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.186301+0000", 2024-09-12T22:33:19.982 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.6019000000000002e-05 2024-09-12T22:33:19.982 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:19.982 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:19.982 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:19.982 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.982 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.983 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3063 3.2 3:42569fed:::200.00000011:head [write 3915305~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:33:19.983 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:19.386685+0000", 2024-09-12T22:33:19.983 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.54961620300000003, 2024-09-12T22:33:19.983 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.042365220000000002, 2024-09-12T22:33:19.983 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:19.983 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:19.983 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:19.983 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:19.983 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.983 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:19.983 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386685+0000", 2024-09-12T22:33:19.983 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:19.984 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.984 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.984 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:19.984 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386685+0000", 2024-09-12T22:33:19.984 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:19.984 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.984 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.984 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:19.984 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386685+0000", 2024-09-12T22:33:19.984 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.08e-07 2024-09-12T22:33:19.984 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.984 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.985 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:19.985 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386688+0000", 2024-09-12T22:33:19.985 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8880000000000001e-06 2024-09-12T22:33:19.985 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.985 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.985 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:19.985 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386694+0000", 2024-09-12T22:33:19.985 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8089999999999998e-06 2024-09-12T22:33:19.985 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.985 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.985 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:19.985 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386699+0000", 2024-09-12T22:33:19.985 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8010000000000003e-06 2024-09-12T22:33:19.986 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.986 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.986 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:19.986 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.427136+0000", 2024-09-12T22:33:19.986 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.04043712 2024-09-12T22:33:19.986 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.986 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.986 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:19.986 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.427185+0000", 2024-09-12T22:33:19.986 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9493999999999997e-05 2024-09-12T22:33:19.986 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.986 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.986 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:19.987 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.428988+0000", 2024-09-12T22:33:19.987 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001803191 2024-09-12T22:33:19.987 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.987 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.987 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:19.987 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.429015+0000", 2024-09-12T22:33:19.987 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.6438999999999999e-05 2024-09-12T22:33:19.987 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.987 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.987 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:19.987 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.429050+0000", 2024-09-12T22:33:19.987 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.5070000000000001e-05 2024-09-12T22:33:19.987 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:19.988 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:19.988 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:19.988 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.988 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.988 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3064 3.2 3:42569fed:::200.00000011:head [write 3916704~1398 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:33:19.988 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:19.386705+0000", 2024-09-12T22:33:19.988 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.54959642799999997, 2024-09-12T22:33:19.988 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.043238378000000001, 2024-09-12T22:33:19.988 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:19.988 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:19.988 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:19.988 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:19.988 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.989 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:19.989 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386705+0000", 2024-09-12T22:33:19.989 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:19.989 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.989 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.989 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:19.989 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386705+0000", 2024-09-12T22:33:19.989 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:19.989 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.989 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.989 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:19.989 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386705+0000", 2024-09-12T22:33:19.989 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.8299999999999998e-07 2024-09-12T22:33:19.990 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.990 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.990 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:19.990 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386711+0000", 2024-09-12T22:33:19.990 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7080000000000002e-06 2024-09-12T22:33:19.990 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.990 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.990 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:19.990 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386717+0000", 2024-09-12T22:33:19.990 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.3990000000000001e-06 2024-09-12T22:33:19.990 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.990 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.991 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:19.991 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386722+0000", 2024-09-12T22:33:19.991 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9219999999999996e-06 2024-09-12T22:33:19.991 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.991 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.991 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:19.991 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.427585+0000", 2024-09-12T22:33:19.991 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.040863414000000001 2024-09-12T22:33:19.991 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.991 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.991 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:19.991 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.427628+0000", 2024-09-12T22:33:19.992 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2873000000000001e-05 2024-09-12T22:33:19.992 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.992 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.992 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:19.992 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.429871+0000", 2024-09-12T22:33:19.992 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.002242572 2024-09-12T22:33:19.992 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.992 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.992 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:19.992 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.429901+0000", 2024-09-12T22:33:19.992 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0114e-05 2024-09-12T22:33:19.992 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.992 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.992 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:19.993 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.429943+0000", 2024-09-12T22:33:19.993 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1993000000000003e-05 2024-09-12T22:33:19.993 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:19.993 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:19.993 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:19.993 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.993 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.993 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3065 3.2 3:42569fed:::200.00000011:head [write 3918102~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:33:19.993 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:19.386735+0000", 2024-09-12T22:33:19.993 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.54956622099999997, 2024-09-12T22:33:19.993 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.043278369999999997, 2024-09-12T22:33:19.993 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:19.993 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:19.994 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:19.994 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:19.994 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.994 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:19.994 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386735+0000", 2024-09-12T22:33:19.994 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:19.994 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.994 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.994 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:19.995 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386735+0000", 2024-09-12T22:33:19.995 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:19.995 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.995 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.995 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:19.995 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386735+0000", 2024-09-12T22:33:19.995 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.7300000000000001e-07 2024-09-12T22:33:19.995 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.995 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.996 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:19.996 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386738+0000", 2024-09-12T22:33:19.996 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8420000000000001e-06 2024-09-12T22:33:19.996 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.996 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.996 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:19.996 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386744+0000", 2024-09-12T22:33:19.996 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.3040000000000001e-06 2024-09-12T22:33:19.996 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.996 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.996 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:19.996 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386749+0000", 2024-09-12T22:33:19.996 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8409999999999999e-06 2024-09-12T22:33:19.997 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.997 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.997 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:19.997 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.428112+0000", 2024-09-12T22:33:19.997 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.041363204000000001 2024-09-12T22:33:19.997 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.997 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.997 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:19.997 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.428158+0000", 2024-09-12T22:33:19.997 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5756e-05 2024-09-12T22:33:19.997 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.997 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.997 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:19.998 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.429950+0000", 2024-09-12T22:33:19.998 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0017922859999999999 2024-09-12T22:33:19.998 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.998 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.998 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:19.998 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.429975+0000", 2024-09-12T22:33:19.998 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4640000000000001e-05 2024-09-12T22:33:19.998 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.998 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.998 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:19.998 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.430013+0000", 2024-09-12T22:33:19.998 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.8024000000000001e-05 2024-09-12T22:33:19.998 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:19.998 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:19.999 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:19.999 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:19.999 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:19.999 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3066 3.2 3:42569fed:::200.00000011:head [write 3919501~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:33:19.999 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:19.386755+0000", 2024-09-12T22:33:19.999 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.54954557999999998, 2024-09-12T22:33:19.999 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.044668934, 2024-09-12T22:33:19.999 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:19.999 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:19.999 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:19.999 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:19.999 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:20.000 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:20.000 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386755+0000", 2024-09-12T22:33:20.000 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:20.000 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:20.000 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:20.000 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:20.000 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386755+0000", 2024-09-12T22:33:20.000 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:20.000 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:20.000 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:20.000 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:20.000 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386756+0000", 2024-09-12T22:33:20.000 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4499999999999997e-07 2024-09-12T22:33:20.001 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:20.001 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:20.001 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:20.001 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386763+0000", 2024-09-12T22:33:20.001 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.6459999999999993e-06 2024-09-12T22:33:20.001 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:20.001 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:20.001 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:20.001 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386770+0000", 2024-09-12T22:33:20.001 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.19e-06 2024-09-12T22:33:20.001 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:20.001 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:20.001 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:20.001 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386775+0000", 2024-09-12T22:33:20.002 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9640000000000002e-06 2024-09-12T22:33:20.002 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:20.002 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:20.002 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:20.002 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.428489+0000", 2024-09-12T22:33:20.002 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.041714539000000002 2024-09-12T22:33:20.002 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:20.002 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:20.002 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:20.002 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.428535+0000", 2024-09-12T22:33:20.002 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5658999999999998e-05 2024-09-12T22:33:20.002 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:20.002 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:20.002 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:20.003 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.431353+0000", 2024-09-12T22:33:20.003 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0028186270000000002 2024-09-12T22:33:20.003 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:20.003 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:20.003 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:20.003 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.431385+0000", 2024-09-12T22:33:20.003 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.1374000000000001e-05 2024-09-12T22:33:20.003 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:20.003 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:20.003 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:20.003 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.431424+0000", 2024-09-12T22:33:20.003 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9490000000000003e-05 2024-09-12T22:33:20.004 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:20.004 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:20.004 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:20.004 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:20.004 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:20.004 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3067 3.2 3:42569fed:::200.00000011:head [write 3920900~2245 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:33:20.004 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:19.386781+0000", 2024-09-12T22:33:20.004 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.54951969099999998, 2024-09-12T22:33:20.004 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.044711322999999997, 2024-09-12T22:33:20.004 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:20.004 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:20.004 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:20.005 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:20.005 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:20.005 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:20.005 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386781+0000", 2024-09-12T22:33:20.005 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:20.005 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:20.005 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:20.005 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:20.005 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386781+0000", 2024-09-12T22:33:20.005 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:20.005 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:20.005 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:20.006 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:20.006 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386782+0000", 2024-09-12T22:33:20.006 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9900000000000001e-07 2024-09-12T22:33:20.006 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:20.006 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:20.006 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:20.006 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386795+0000", 2024-09-12T22:33:20.006 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2864000000000001e-05 2024-09-12T22:33:20.006 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:20.006 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:20.006 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:20.006 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386801+0000", 2024-09-12T22:33:20.006 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.3589999999999996e-06 2024-09-12T22:33:20.006 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:20.007 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:20.007 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:20.007 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386805+0000", 2024-09-12T22:33:20.007 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6190000000000002e-06 2024-09-12T22:33:20.007 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:20.007 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:20.007 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:20.007 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.429080+0000", 2024-09-12T22:33:20.007 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.042274027999999998 2024-09-12T22:33:20.007 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:20.007 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:20.007 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:20.007 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.429131+0000", 2024-09-12T22:33:20.008 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1715000000000002e-05 2024-09-12T22:33:20.008 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:20.008 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:20.008 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:20.008 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.431432+0000", 2024-09-12T22:33:20.008 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0023007489999999999 2024-09-12T22:33:20.008 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:20.008 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:20.008 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:20.008 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.431458+0000", 2024-09-12T22:33:20.008 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.603e-05 2024-09-12T22:33:20.009 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:20.009 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:20.009 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:20.009 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.431493+0000", 2024-09-12T22:33:20.009 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4560000000000001e-05 2024-09-12T22:33:20.009 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:20.009 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:20.009 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:20.009 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:20.009 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:20.009 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3068 3.2 3:42569fed:::200.00000011:head [write 3923145~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:33:20.009 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:19.386812+0000", 2024-09-12T22:33:20.009 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.54948893200000004, 2024-09-12T22:33:20.009 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.045559559999999999, 2024-09-12T22:33:20.009 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:20.010 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:20.010 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:20.010 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:20.010 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:20.010 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:20.010 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386812+0000", 2024-09-12T22:33:20.010 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:20.010 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:20.010 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:20.010 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:20.010 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386812+0000", 2024-09-12T22:33:20.010 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:20.010 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:20.011 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:20.011 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:20.011 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386812+0000", 2024-09-12T22:33:20.011 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.01e-07 2024-09-12T22:33:20.011 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:20.011 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:20.011 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:20.011 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386823+0000", 2024-09-12T22:33:20.011 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1038e-05 2024-09-12T22:33:20.011 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:20.011 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:20.011 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:20.011 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386830+0000", 2024-09-12T22:33:20.011 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.5409999999999997e-06 2024-09-12T22:33:20.012 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:20.012 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:20.012 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:20.012 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386835+0000", 2024-09-12T22:33:20.012 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.091e-06 2024-09-12T22:33:20.012 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:20.012 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:20.012 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:20.012 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.429460+0000", 2024-09-12T22:33:20.012 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.042625333000000001 2024-09-12T22:33:20.012 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:20.012 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:20.012 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:20.012 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.429506+0000", 2024-09-12T22:33:20.013 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5299000000000001e-05 2024-09-12T22:33:20.013 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:20.013 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:20.013 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:20.013 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.432283+0000", 2024-09-12T22:33:20.013 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0027776799999999998 2024-09-12T22:33:20.013 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:20.013 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:20.013 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:20.013 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.432315+0000", 2024-09-12T22:33:20.013 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.1401e-05 2024-09-12T22:33:20.013 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:20.013 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:20.014 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:20.014 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.432372+0000", 2024-09-12T22:33:20.014 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.6776e-05 2024-09-12T22:33:20.014 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:20.014 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:20.014 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:20.014 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:20.014 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:20.014 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3069 3.2 3:42569fed:::200.00000011:head [write 3924544~2246 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:33:20.014 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:19.386842+0000", 2024-09-12T22:33:20.014 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.54945903200000001, 2024-09-12T22:33:20.014 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.045596166, 2024-09-12T22:33:20.014 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:20.014 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:20.015 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:20.015 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:20.015 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:20.015 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:20.015 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386842+0000", 2024-09-12T22:33:20.015 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:20.015 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:20.015 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:20.015 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:20.015 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386842+0000", 2024-09-12T22:33:20.015 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:20.015 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:20.015 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:20.016 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:20.016 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386842+0000", 2024-09-12T22:33:20.016 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5200000000000002e-07 2024-09-12T22:33:20.016 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:20.016 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:20.016 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:20.016 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386845+0000", 2024-09-12T22:33:20.016 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8820000000000001e-06 2024-09-12T22:33:20.016 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:20.016 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:20.016 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:20.016 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386851+0000", 2024-09-12T22:33:20.017 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9540000000000001e-06 2024-09-12T22:33:20.017 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:20.017 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:20.017 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:20.017 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386856+0000", 2024-09-12T22:33:20.017 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5159999999999996e-06 2024-09-12T22:33:20.017 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:20.017 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:20.017 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:20.017 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.430043+0000", 2024-09-12T22:33:20.017 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.043186930999999998 2024-09-12T22:33:20.017 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:20.017 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:20.018 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:20.018 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.430086+0000", 2024-09-12T22:33:20.018 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3844999999999998e-05 2024-09-12T22:33:20.018 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:20.018 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:20.018 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:20.018 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.432379+0000", 2024-09-12T22:33:20.018 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0022922049999999999 2024-09-12T22:33:20.018 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:20.018 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:20.018 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:20.018 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.432405+0000", 2024-09-12T22:33:20.018 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5877999999999999e-05 2024-09-12T22:33:20.019 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:20.019 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:20.019 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:20.019 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.432438+0000", 2024-09-12T22:33:20.019 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3503000000000001e-05 2024-09-12T22:33:20.019 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:20.019 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:20.019 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:20.019 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:20.019 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:20.019 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3070 3.2 3:42569fed:::200.00000011:head [write 3926790~2768 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:33:20.019 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:19.387280+0000", 2024-09-12T22:33:20.019 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.54902086400000005, 2024-09-12T22:33:20.020 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.04692201, 2024-09-12T22:33:20.020 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:20.020 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:20.020 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:20.020 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:20.020 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:20.020 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:20.020 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.387280+0000", 2024-09-12T22:33:20.020 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:20.020 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:20.020 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:20.020 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:20.020 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.387280+0000", 2024-09-12T22:33:20.021 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:20.021 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:20.021 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:20.021 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:20.021 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.387281+0000", 2024-09-12T22:33:20.021 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4300000000000002e-07 2024-09-12T22:33:20.021 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:20.021 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:20.021 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:20.021 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.387285+0000", 2024-09-12T22:33:20.021 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2570000000000001e-06 2024-09-12T22:33:20.021 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:20.022 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:20.022 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:20.022 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.387293+0000", 2024-09-12T22:33:20.022 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0209999999999999e-06 2024-09-12T22:33:20.022 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:20.022 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:20.022 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:20.022 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.387299+0000", 2024-09-12T22:33:20.022 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.6930000000000004e-06 2024-09-12T22:33:20.022 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:20.022 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:20.022 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:20.022 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.430441+0000", 2024-09-12T22:33:20.022 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.043141789999999999 2024-09-12T22:33:20.023 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:20.023 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:20.023 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:20.023 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.430484+0000", 2024-09-12T22:33:20.023 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3745000000000002e-05 2024-09-12T22:33:20.023 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:20.023 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:20.023 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:20.023 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.434132+0000", 2024-09-12T22:33:20.023 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00364818 2024-09-12T22:33:20.023 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:20.023 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:20.023 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:20.024 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.434163+0000", 2024-09-12T22:33:20.024 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0599000000000003e-05 2024-09-12T22:33:20.024 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:20.024 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:20.024 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:20.024 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.434202+0000", 2024-09-12T22:33:20.024 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.8982e-05 2024-09-12T22:33:20.024 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:20.024 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:20.024 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:20.024 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:20.024 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:20.024 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3071 3.2 3:42569fed:::200.00000011:head [write 3929558~3203 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:33:20.025 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:19.387860+0000", 2024-09-12T22:33:20.025 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.54844083399999999, 2024-09-12T22:33:20.025 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.049590902999999999, 2024-09-12T22:33:20.025 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:20.025 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:20.025 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:20.025 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:20.025 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:20.025 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:20.025 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.387860+0000", 2024-09-12T22:33:20.025 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:20.025 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:20.025 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:20.026 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:20.026 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.387860+0000", 2024-09-12T22:33:20.026 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:20.026 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:20.026 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:20.026 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:20.026 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.387861+0000", 2024-09-12T22:33:20.026 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5099999999999999e-07 2024-09-12T22:33:20.026 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:20.026 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:20.026 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:20.026 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.387865+0000", 2024-09-12T22:33:20.026 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2629999999999997e-06 2024-09-12T22:33:20.026 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:20.027 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:20.027 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:20.027 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.387875+0000", 2024-09-12T22:33:20.027 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0256e-05 2024-09-12T22:33:20.027 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:20.027 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:20.027 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:20.027 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.387881+0000", 2024-09-12T22:33:20.027 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.947e-06 2024-09-12T22:33:20.027 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:20.027 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:20.027 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:20.027 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.430930+0000", 2024-09-12T22:33:20.027 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.043048386000000001 2024-09-12T22:33:20.028 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:20.028 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:20.028 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:20.028 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.430976+0000", 2024-09-12T22:33:20.028 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6408e-05 2024-09-12T22:33:20.028 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:20.028 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:20.028 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:20.028 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.437377+0000", 2024-09-12T22:33:20.028 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0064010719999999998 2024-09-12T22:33:20.028 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:20.028 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:20.028 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:20.029 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.437409+0000", 2024-09-12T22:33:20.029 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2054999999999997e-05 2024-09-12T22:33:20.029 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:20.029 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:20.029 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:20.029 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.437451+0000", 2024-09-12T22:33:20.029 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1764999999999997e-05 2024-09-12T22:33:20.029 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:20.029 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:20.029 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:20.029 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:20.029 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:20.029 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3072 3.2 3:42569fed:::200.00000011:head [write 3932761~2786 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:33:20.030 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:19.388005+0000", 2024-09-12T22:33:20.030 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.54829573499999995, 2024-09-12T22:33:20.030 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.049514177999999999, 2024-09-12T22:33:20.030 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:20.030 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:20.030 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:20.030 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:20.030 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:20.030 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:20.030 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.388005+0000", 2024-09-12T22:33:20.030 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:20.030 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:20.030 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:20.031 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:20.031 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.388005+0000", 2024-09-12T22:33:20.031 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:20.031 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:20.031 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:20.031 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:20.031 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.388006+0000", 2024-09-12T22:33:20.031 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.1799999999999995e-07 2024-09-12T22:33:20.031 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:20.031 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:20.031 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:20.031 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.388009+0000", 2024-09-12T22:33:20.032 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.574e-06 2024-09-12T22:33:20.032 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:20.032 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:20.032 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:20.032 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.388017+0000", 2024-09-12T22:33:20.032 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3170000000000004e-06 2024-09-12T22:33:20.032 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:20.032 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:20.032 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:20.032 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.388022+0000", 2024-09-12T22:33:20.032 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9910000000000002e-06 2024-09-12T22:33:20.032 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:20.032 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:20.032 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:20.033 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.431522+0000", 2024-09-12T22:33:20.033 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0435001 2024-09-12T22:33:20.033 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:20.033 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:20.033 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:20.033 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.431567+0000", 2024-09-12T22:33:20.033 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4734000000000002e-05 2024-09-12T22:33:20.033 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:20.033 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:20.033 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:20.033 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.437458+0000", 2024-09-12T22:33:20.033 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00589166 2024-09-12T22:33:20.034 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:20.034 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:20.034 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:20.034 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.437484+0000", 2024-09-12T22:33:20.034 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5622999999999998e-05 2024-09-12T22:33:20.034 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:20.034 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:20.034 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:20.034 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.437519+0000", 2024-09-12T22:33:20.034 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.5561000000000001e-05 2024-09-12T22:33:20.034 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:20.034 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:20.034 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:20.035 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:20.035 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:20.035 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3073 3.2 3:42569fed:::200.00000011:head [write 3935547~1924 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:33:20.035 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:19.389181+0000", 2024-09-12T22:33:20.035 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.54711957300000003, 2024-09-12T22:33:20.035 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.048402300000000002, 2024-09-12T22:33:20.035 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:20.035 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:20.035 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:20.035 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:20.035 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:20.035 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:20.035 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.389181+0000", 2024-09-12T22:33:20.036 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:20.036 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:20.036 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:20.036 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:20.036 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.389181+0000", 2024-09-12T22:33:20.036 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:20.036 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:20.036 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:20.036 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:20.036 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.389182+0000", 2024-09-12T22:33:20.036 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7700000000000004e-07 2024-09-12T22:33:20.036 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:20.036 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:20.037 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:20.037 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.389191+0000", 2024-09-12T22:33:20.037 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1120000000000002e-06 2024-09-12T22:33:20.037 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:20.037 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:20.037 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:20.037 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.389203+0000", 2024-09-12T22:33:20.037 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.146e-05 2024-09-12T22:33:20.037 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:20.037 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:20.037 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:20.037 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.389209+0000", 2024-09-12T22:33:20.037 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9989999999999997e-06 2024-09-12T22:33:20.038 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:20.038 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:20.038 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:20.038 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.431890+0000", 2024-09-12T22:33:20.038 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.042681251000000003 2024-09-12T22:33:20.038 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:20.038 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:20.038 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:20.038 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.431935+0000", 2024-09-12T22:33:20.038 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5166000000000001e-05 2024-09-12T22:33:20.038 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:20.038 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:20.038 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:20.038 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.437526+0000", 2024-09-12T22:33:20.039 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0055910489999999998 2024-09-12T22:33:20.039 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:20.039 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:20.039 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:20.039 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.437550+0000", 2024-09-12T22:33:20.039 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4134999999999998e-05 2024-09-12T22:33:20.039 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:20.039 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:20.039 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:20.039 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.437584+0000", 2024-09-12T22:33:20.039 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3451000000000002e-05 2024-09-12T22:33:20.039 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:20.039 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:20.040 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:20.040 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:20.040 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:20.040 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3074 3.2 3:42569fed:::200.00000011:head [write 3937471~7660 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:33:20.040 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:19.390512+0000", 2024-09-12T22:33:20.040 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 0.54578844999999998, 2024-09-12T22:33:20.040 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.047134045999999999, 2024-09-12T22:33:20.040 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:20.040 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:20.040 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:20.040 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:20.040 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:20.040 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:20.041 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.390512+0000", 2024-09-12T22:33:20.041 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:20.041 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:20.041 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:20.041 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:20.041 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.390512+0000", 2024-09-12T22:33:20.041 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:20.041 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:20.041 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:20.041 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:20.041 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.390513+0000", 2024-09-12T22:33:20.041 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.7699999999999992e-07 2024-09-12T22:33:20.041 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:20.042 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:20.042 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:20.042 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.390522+0000", 2024-09-12T22:33:20.042 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0390000000000005e-06 2024-09-12T22:33:20.042 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:20.042 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:20.042 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:20.042 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.390530+0000", 2024-09-12T22:33:20.042 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.8349999999999993e-06 2024-09-12T22:33:20.042 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:20.042 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:20.042 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:20.042 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.390537+0000", 2024-09-12T22:33:20.043 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.1850000000000001e-06 2024-09-12T22:33:20.043 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:20.043 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:20.043 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:20.043 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.432468+0000", 2024-09-12T22:33:20.043 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.041931883000000003 2024-09-12T22:33:20.043 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:20.043 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:20.043 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:20.043 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.432512+0000", 2024-09-12T22:33:20.043 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4054999999999997e-05 2024-09-12T22:33:20.043 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:20.043 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:20.043 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:20.044 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.437590+0000", 2024-09-12T22:33:20.044 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0050777230000000001 2024-09-12T22:33:20.044 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:20.044 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:20.044 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:20.044 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.437613+0000", 2024-09-12T22:33:20.044 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.2693000000000001e-05 2024-09-12T22:33:20.044 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:20.044 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:20.044 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:20.044 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.437647+0000", 2024-09-12T22:33:20.044 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3655999999999998e-05 2024-09-12T22:33:20.044 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:20.045 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:20.045 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:20.045 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:20.045 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:20.045 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:33:20.046 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:33:20.047 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:20.045+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:20.110 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T22:33:20.147 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:20.146+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:20.153 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-09-12T22:33:20.153 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-09-12T22:33:20.153 INFO:teuthology.orchestra.run.smithi163.stdout: "num_ops": 0 2024-09-12T22:33:20.153 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-09-12T22:33:20.162 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:33:20.236 INFO:teuthology.orchestra.run.smithi019.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-12T22:33:20.249 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:20.248+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:20.257 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T22:33:20.257 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:33:20.267 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-09-12T22:33:20.267 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-09-12T22:33:20.267 INFO:teuthology.orchestra.run.smithi163.stdout: "complaint_time": 30, 2024-09-12T22:33:20.267 INFO:teuthology.orchestra.run.smithi163.stdout: "num_blocked_ops": 0 2024-09-12T22:33:20.267 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-09-12T22:33:20.276 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:33:20.277 INFO:teuthology.orchestra.run.smithi019.stdout:osd.2: {} 2024-09-12T22:33:20.277 INFO:teuthology.orchestra.run.smithi019.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T22:33:20.280 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:33:20.280 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:33:20.360 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:20.359+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:20.421 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:33:20.421 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:33:20.430 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:33:20.474 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:20.473+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:20.549 INFO:teuthology.orchestra.run.smithi019.stderr:noscrub is set 2024-09-12T22:33:20.553 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:20.550+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:20.581 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:33:20.581 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:33:20.595 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:33:20.679 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:20.678+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:20.738 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:33:20.738 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:33:20.746 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:33:20.754 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:20.754+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:20.855 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:20.854+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:20.890 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:33:20.890 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:33:20.899 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:33:20.956 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:20.954+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:20.989 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T22:33:20.989 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T22:33:21.006 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:33:21.006 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:33:21.015 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:33:21.056 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:21.055+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:21.157 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:21.156+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:21.160 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:33:21.160 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:33:21.169 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:33:21.259 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:21.258+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:21.278 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:33:21.278 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:33:21.287 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:33:21.360 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:21.359+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:21.397 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:33:21.397 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:33:21.407 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:33:21.426 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~36s 2024-09-12T22:33:21.491 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:21.490+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:21.552 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:33:21.552 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:33:21.561 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:33:21.602 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:21.601+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:21.663 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:21.662+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:21.707 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:33:21.707 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:33:21.716 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:33:21.763 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:21.761+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:21.823 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:33:21.823 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:33:21.833 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:33:21.865 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:21.864+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:21.966 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:21.964+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:21.979 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:33:21.979 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:33:21.988 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:33:22.066 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:22.065+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:22.136 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:33:22.136 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:33:22.150 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:33:22.167 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:22.166+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:22.255 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:33:22.255 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:33:22.265 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:33:22.268 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:22.266+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:22.281 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T22:33:22.367 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:33:22.367 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:33:22.369 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:22.367+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:22.376 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:33:22.405 INFO:teuthology.orchestra.run.smithi019.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-12T22:33:22.425 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T22:33:22.425 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:33:22.448 INFO:teuthology.orchestra.run.smithi019.stdout:osd.2: {} 2024-09-12T22:33:22.448 INFO:teuthology.orchestra.run.smithi019.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T22:33:22.451 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:33:22.452 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:33:22.469 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:22.468+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:22.487 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:33:22.488 INFO:teuthology.orchestra.run.smithi148.stdout: "size": 20, 2024-09-12T22:33:22.488 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 600, 2024-09-12T22:33:22.488 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [ 2024-09-12T22:33:22.488 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.488 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4490.0:9866 4.b 4:d370243b:::10000002d48.00000000:head [write 0~1308] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:33:22.488 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:09.467883+0000", 2024-09-12T22:33:22.489 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 13.016206462, 2024-09-12T22:33:22.489 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.085024817000000003, 2024-09-12T22:33:22.489 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:22.489 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:22.489 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:22.489 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:33:22.489 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4490", 2024-09-12T22:33:22.490 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:22.490 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 9866 2024-09-12T22:33:22.490 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.490 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:22.490 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.490 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:22.490 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.467883+0000", 2024-09-12T22:33:22.490 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:22.491 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.491 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.491 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:22.491 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.467883+0000", 2024-09-12T22:33:22.491 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:22.491 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.492 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.492 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:22.492 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.467884+0000", 2024-09-12T22:33:22.492 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1800000000000005e-07 2024-09-12T22:33:22.492 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.492 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.492 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:22.492 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.467888+0000", 2024-09-12T22:33:22.492 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5959999999999997e-06 2024-09-12T22:33:22.492 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.492 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.493 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:22.493 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.467896+0000", 2024-09-12T22:33:22.493 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.8679999999999999e-06 2024-09-12T22:33:22.493 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.493 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.493 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:22.493 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.467901+0000", 2024-09-12T22:33:22.493 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9169999999999997e-06 2024-09-12T22:33:22.493 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.493 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.494 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:22.494 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.467944+0000", 2024-09-12T22:33:22.494 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3055e-05 2024-09-12T22:33:22.494 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.494 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.494 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:22.494 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.468011+0000", 2024-09-12T22:33:22.494 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7328000000000003e-05 2024-09-12T22:33:22.494 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.494 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.494 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:22.494 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.468078+0000", 2024-09-12T22:33:22.494 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7063999999999994e-05 2024-09-12T22:33:22.495 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.495 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.495 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:22.495 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.551406+0000", 2024-09-12T22:33:22.495 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.083327485000000007 2024-09-12T22:33:22.495 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.495 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.495 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:22.495 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.552822+0000", 2024-09-12T22:33:22.495 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001415929 2024-09-12T22:33:22.495 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.495 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.495 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:22.496 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.552863+0000", 2024-09-12T22:33:22.496 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0809000000000002e-05 2024-09-12T22:33:22.496 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.496 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.496 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:22.496 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.552908+0000", 2024-09-12T22:33:22.496 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5048e-05 2024-09-12T22:33:22.496 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:22.496 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:22.496 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:22.497 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.497 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.497 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4490.0:9867 4.16 4:6bd8f1b8:::10000002d49.00000000:head [write 0~1599] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:33:22.497 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:09.468760+0000", 2024-09-12T22:33:22.497 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 13.015329453, 2024-09-12T22:33:22.497 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.086660499000000002, 2024-09-12T22:33:22.497 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:22.497 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:22.498 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:22.498 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:33:22.498 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4490", 2024-09-12T22:33:22.498 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:22.498 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 9867 2024-09-12T22:33:22.498 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.498 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:22.498 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.498 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:22.499 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.468760+0000", 2024-09-12T22:33:22.499 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:22.499 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.499 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.499 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:22.499 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.468760+0000", 2024-09-12T22:33:22.499 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:22.499 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.500 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.500 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:22.500 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.468761+0000", 2024-09-12T22:33:22.500 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4399999999999999e-07 2024-09-12T22:33:22.500 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.500 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.500 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:22.500 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.468765+0000", 2024-09-12T22:33:22.501 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3259999999999997e-06 2024-09-12T22:33:22.501 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.501 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.501 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:22.501 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.548969+0000", 2024-09-12T22:33:22.501 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.080204172000000004 2024-09-12T22:33:22.501 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.501 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.502 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:22.502 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.549001+0000", 2024-09-12T22:33:22.502 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.1464999999999998e-05 2024-09-12T22:33:22.502 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.502 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.502 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:22.502 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.549148+0000", 2024-09-12T22:33:22.503 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014749399999999999 2024-09-12T22:33:22.503 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.503 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.503 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:22.503 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.549379+0000", 2024-09-12T22:33:22.503 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000231091 2024-09-12T22:33:22.503 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.503 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.504 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:22.504 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.549518+0000", 2024-09-12T22:33:22.504 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013844899999999999 2024-09-12T22:33:22.504 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.504 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.504 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:22.505 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.552236+0000", 2024-09-12T22:33:22.505 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0027179869999999998 2024-09-12T22:33:22.505 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.505 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.505 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:22.505 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.555333+0000", 2024-09-12T22:33:22.505 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0030973559999999999 2024-09-12T22:33:22.505 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.506 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.506 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:22.506 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.555379+0000", 2024-09-12T22:33:22.506 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6236999999999998e-05 2024-09-12T22:33:22.506 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.507 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.507 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:22.507 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.555420+0000", 2024-09-12T22:33:22.507 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1177999999999998e-05 2024-09-12T22:33:22.507 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:22.507 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:22.507 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:22.508 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.508 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.508 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop_reply(client.4490.0:9866 4.b e53/18 ondisk, result = 0)", 2024-09-12T22:33:22.508 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:09.468826+0000", 2024-09-12T22:33:22.509 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 13.015263158, 2024-09-12T22:33:22.509 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.082588348000000006, 2024-09-12T22:33:22.509 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:22.509 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:22.509 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:33:22.509 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:22.509 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.509 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:22.510 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.468826+0000", 2024-09-12T22:33:22.510 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:22.510 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.510 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.510 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:22.510 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.468826+0000", 2024-09-12T22:33:22.510 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:22.510 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.510 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.511 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:22.511 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.468827+0000", 2024-09-12T22:33:22.511 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3399999999999999e-07 2024-09-12T22:33:22.511 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.511 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.511 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:22.511 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.468830+0000", 2024-09-12T22:33:22.511 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.1559999999999999e-06 2024-09-12T22:33:22.512 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.512 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.512 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:22.512 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.548957+0000", 2024-09-12T22:33:22.512 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.080126852999999998 2024-09-12T22:33:22.512 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.512 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.512 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:22.512 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.548989+0000", 2024-09-12T22:33:22.512 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2409000000000001e-05 2024-09-12T22:33:22.512 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.512 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.513 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:22.513 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.551065+0000", 2024-09-12T22:33:22.513 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.002075871 2024-09-12T22:33:22.513 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.513 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.513 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:22.514 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.551398+0000", 2024-09-12T22:33:22.514 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00033339099999999999 2024-09-12T22:33:22.514 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.514 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.514 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:22.514 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.551414+0000", 2024-09-12T22:33:22.514 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6133999999999998e-05 2024-09-12T22:33:22.515 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:22.515 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:22.515 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:22.515 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.515 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.515 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4490.0:10437 4.2f 4:f6cd553b:::10000002fce.00000000:head [write 0~27313] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:33:22.515 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:10.050890+0000", 2024-09-12T22:33:22.516 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 12.433198762, 2024-09-12T22:33:22.516 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.056482601, 2024-09-12T22:33:22.516 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:22.516 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:22.516 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:22.516 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:33:22.516 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4490", 2024-09-12T22:33:22.516 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:22.517 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 10437 2024-09-12T22:33:22.517 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.517 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:22.517 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.517 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:22.517 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.050890+0000", 2024-09-12T22:33:22.517 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:22.517 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.517 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.518 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:22.518 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.050890+0000", 2024-09-12T22:33:22.518 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:22.518 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.518 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.518 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:22.519 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.050891+0000", 2024-09-12T22:33:22.519 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.6600000000000005e-07 2024-09-12T22:33:22.519 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.519 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.519 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:22.519 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.050906+0000", 2024-09-12T22:33:22.519 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4521e-05 2024-09-12T22:33:22.519 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.520 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.520 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:22.520 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.050915+0000", 2024-09-12T22:33:22.520 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.2569999999999996e-06 2024-09-12T22:33:22.520 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.520 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.520 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:22.520 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.050920+0000", 2024-09-12T22:33:22.520 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.724e-06 2024-09-12T22:33:22.520 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.520 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.520 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:22.520 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.050960+0000", 2024-09-12T22:33:22.521 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9999000000000001e-05 2024-09-12T22:33:22.521 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.521 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.521 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:22.521 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.051031+0000", 2024-09-12T22:33:22.521 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1007000000000006e-05 2024-09-12T22:33:22.521 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.521 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.521 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:22.521 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.107249+0000", 2024-09-12T22:33:22.521 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.056218432999999998 2024-09-12T22:33:22.521 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.521 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.522 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:22.522 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.107301+0000", 2024-09-12T22:33:22.522 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1289000000000003e-05 2024-09-12T22:33:22.522 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.522 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.522 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:22.522 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.107373+0000", 2024-09-12T22:33:22.522 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.2504999999999998e-05 2024-09-12T22:33:22.522 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:22.522 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:22.522 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:22.522 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.522 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.522 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4490.0:10439 4.12 4:483953cb:::10000002fd0.00000000:head [write 0~4842] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:33:22.523 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:10.052567+0000", 2024-09-12T22:33:22.523 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 12.431522554000001, 2024-09-12T22:33:22.523 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.055835449000000002, 2024-09-12T22:33:22.523 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:22.523 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:22.523 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:22.523 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:33:22.523 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4490", 2024-09-12T22:33:22.523 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:22.523 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 10439 2024-09-12T22:33:22.524 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.524 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:22.524 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.524 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:22.524 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.052567+0000", 2024-09-12T22:33:22.524 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:22.524 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.524 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.524 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:22.525 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.052567+0000", 2024-09-12T22:33:22.525 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:22.525 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.525 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.525 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:22.525 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.052568+0000", 2024-09-12T22:33:22.525 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.3600000000000002e-07 2024-09-12T22:33:22.525 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.525 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.525 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:22.525 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.052591+0000", 2024-09-12T22:33:22.525 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.3110000000000001e-05 2024-09-12T22:33:22.525 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.525 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.526 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:22.526 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.106740+0000", 2024-09-12T22:33:22.526 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.054149315000000003 2024-09-12T22:33:22.526 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.526 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.526 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:22.526 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.106751+0000", 2024-09-12T22:33:22.526 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1056000000000001e-05 2024-09-12T22:33:22.526 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.526 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.526 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:22.526 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.106811+0000", 2024-09-12T22:33:22.527 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9515999999999997e-05 2024-09-12T22:33:22.527 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.527 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.527 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:22.527 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.106929+0000", 2024-09-12T22:33:22.527 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00011879000000000001 2024-09-12T22:33:22.527 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.527 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.527 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:22.527 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.108283+0000", 2024-09-12T22:33:22.527 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001354177 2024-09-12T22:33:22.527 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.528 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.528 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:22.528 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.108328+0000", 2024-09-12T22:33:22.528 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4931000000000001e-05 2024-09-12T22:33:22.528 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.528 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.528 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:22.528 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.108402+0000", 2024-09-12T22:33:22.528 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3718000000000001e-05 2024-09-12T22:33:22.528 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:22.528 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:22.528 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:22.528 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.529 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.529 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(client.4490.0:10445 4.3c e53/18 4:3d97251e:::10000002fd8.00000000:head v 53'154, mlcod=53'152)", 2024-09-12T22:33:22.529 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:10.058521+0000", 2024-09-12T22:33:22.529 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 12.425568214, 2024-09-12T22:33:22.529 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.049310138000000003, 2024-09-12T22:33:22.529 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:22.529 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:22.529 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:22.529 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:22.529 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.529 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:22.529 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.058521+0000", 2024-09-12T22:33:22.529 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:22.530 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.530 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.530 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:22.530 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.058521+0000", 2024-09-12T22:33:22.530 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:22.530 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.530 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.530 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:22.530 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.058522+0000", 2024-09-12T22:33:22.530 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.1099999999999995e-07 2024-09-12T22:33:22.530 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.530 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.530 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:22.530 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.058530+0000", 2024-09-12T22:33:22.531 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.7290000000000006e-06 2024-09-12T22:33:22.531 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.531 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.531 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:22.531 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.106760+0000", 2024-09-12T22:33:22.531 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.048229384 2024-09-12T22:33:22.531 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.531 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.531 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:22.531 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.106770+0000", 2024-09-12T22:33:22.531 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0431999999999999e-05 2024-09-12T22:33:22.531 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.531 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.532 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:22.532 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.106823+0000", 2024-09-12T22:33:22.532 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2309999999999999e-05 2024-09-12T22:33:22.532 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.532 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.532 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:22.532 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.106841+0000", 2024-09-12T22:33:22.532 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.8218000000000001e-05 2024-09-12T22:33:22.532 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.532 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.532 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:22.532 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.107796+0000", 2024-09-12T22:33:22.532 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00095552600000000005 2024-09-12T22:33:22.532 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.533 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.533 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:22.533 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.107831+0000", 2024-09-12T22:33:22.533 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4928000000000002e-05 2024-09-12T22:33:22.533 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:22.533 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:22.533 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:22.533 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.533 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.533 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4490.0:11351 4.3f 4:fd498422:::10000003188.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-12T22:33:22.533 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:13.354715+0000", 2024-09-12T22:33:22.533 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 9.1293743999999997, 2024-09-12T22:33:22.534 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.043059568999999999, 2024-09-12T22:33:22.534 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:22.534 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:22.534 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:22.534 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:33:22.534 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4490", 2024-09-12T22:33:22.534 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:22.534 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 11351 2024-09-12T22:33:22.535 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.535 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:22.535 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.535 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:22.535 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.354715+0000", 2024-09-12T22:33:22.535 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:22.535 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.535 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.535 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:22.535 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.354715+0000", 2024-09-12T22:33:22.535 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:22.535 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.535 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.535 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:22.536 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.354716+0000", 2024-09-12T22:33:22.536 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.7600000000000006e-07 2024-09-12T22:33:22.536 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.536 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.536 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:22.536 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.361477+0000", 2024-09-12T22:33:22.536 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0067607090000000002 2024-09-12T22:33:22.536 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.536 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.536 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:22.536 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.361487+0000", 2024-09-12T22:33:22.536 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0249e-05 2024-09-12T22:33:22.537 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.537 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.537 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:22.537 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.361493+0000", 2024-09-12T22:33:22.537 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.4699999999999999e-06 2024-09-12T22:33:22.537 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.537 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.537 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:22.537 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.361544+0000", 2024-09-12T22:33:22.537 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1124e-05 2024-09-12T22:33:22.537 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.538 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.538 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:22.538 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.361604+0000", 2024-09-12T22:33:22.538 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9397000000000001e-05 2024-09-12T22:33:22.538 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.538 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.538 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:22.538 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.397601+0000", 2024-09-12T22:33:22.538 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.035996927999999997 2024-09-12T22:33:22.538 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.539 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.539 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:22.539 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.397646+0000", 2024-09-12T22:33:22.539 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5176000000000003e-05 2024-09-12T22:33:22.539 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.539 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.539 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:22.539 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.397774+0000", 2024-09-12T22:33:22.539 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012854000000000001 2024-09-12T22:33:22.539 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:22.539 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:22.539 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:22.539 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.539 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.540 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4490.0:12798 4.3e 4:7eb070ca:::100000030e0.00000000:head [write 0~4194304 [5@1189789]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-12T22:33:22.540 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:15.140228+0000", 2024-09-12T22:33:22.540 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 7.3438617500000003, 2024-09-12T22:33:22.540 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.046073232999999998, 2024-09-12T22:33:22.540 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:22.540 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:22.540 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:22.540 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:33:22.540 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4490", 2024-09-12T22:33:22.540 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:22.540 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 12798 2024-09-12T22:33:22.541 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.541 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:22.541 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.541 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:22.541 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.140228+0000", 2024-09-12T22:33:22.541 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:22.541 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.541 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.541 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:22.541 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.140228+0000", 2024-09-12T22:33:22.541 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:22.541 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.541 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.542 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:22.542 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.140228+0000", 2024-09-12T22:33:22.542 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5899999999999996e-07 2024-09-12T22:33:22.542 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.542 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.542 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:22.542 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.147541+0000", 2024-09-12T22:33:22.542 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0073125339999999999 2024-09-12T22:33:22.542 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.542 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.542 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:22.542 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.147555+0000", 2024-09-12T22:33:22.542 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.42e-05 2024-09-12T22:33:22.543 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.543 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.543 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:22.543 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.147564+0000", 2024-09-12T22:33:22.543 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.0999999999999993e-06 2024-09-12T22:33:22.543 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.543 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.543 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:22.543 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.147637+0000", 2024-09-12T22:33:22.543 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3288999999999996e-05 2024-09-12T22:33:22.543 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.543 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.544 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:22.544 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.147725+0000", 2024-09-12T22:33:22.544 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.7622999999999998e-05 2024-09-12T22:33:22.544 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.544 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.544 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:22.545 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.186239+0000", 2024-09-12T22:33:22.545 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.038514171 2024-09-12T22:33:22.545 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.545 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.545 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:22.545 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.186265+0000", 2024-09-12T22:33:22.545 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5738e-05 2024-09-12T22:33:22.545 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.545 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.545 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:22.546 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.186301+0000", 2024-09-12T22:33:22.546 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.6019000000000002e-05 2024-09-12T22:33:22.546 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:22.546 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:22.546 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:22.546 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.546 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.546 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3063 3.2 3:42569fed:::200.00000011:head [write 3915305~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:33:22.546 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:19.386685+0000", 2024-09-12T22:33:22.546 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 3.0974045210000001, 2024-09-12T22:33:22.546 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.042365220000000002, 2024-09-12T22:33:22.546 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:22.547 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:22.547 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:22.547 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:22.547 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.547 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:22.547 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386685+0000", 2024-09-12T22:33:22.547 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:22.547 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.547 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.548 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:22.548 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386685+0000", 2024-09-12T22:33:22.548 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:22.548 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.548 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.548 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:22.548 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386685+0000", 2024-09-12T22:33:22.548 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.08e-07 2024-09-12T22:33:22.548 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.548 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.548 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:22.549 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386688+0000", 2024-09-12T22:33:22.549 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8880000000000001e-06 2024-09-12T22:33:22.549 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.549 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.549 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:22.549 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386694+0000", 2024-09-12T22:33:22.549 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8089999999999998e-06 2024-09-12T22:33:22.549 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.549 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.549 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:22.549 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386699+0000", 2024-09-12T22:33:22.549 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8010000000000003e-06 2024-09-12T22:33:22.549 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.549 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.550 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:22.550 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.427136+0000", 2024-09-12T22:33:22.550 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.04043712 2024-09-12T22:33:22.550 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.550 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.550 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:22.550 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.427185+0000", 2024-09-12T22:33:22.550 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9493999999999997e-05 2024-09-12T22:33:22.550 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.550 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.550 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:22.551 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.428988+0000", 2024-09-12T22:33:22.551 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001803191 2024-09-12T22:33:22.551 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.551 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.551 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:22.551 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.429015+0000", 2024-09-12T22:33:22.551 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.6438999999999999e-05 2024-09-12T22:33:22.551 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.551 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.551 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:22.551 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.429050+0000", 2024-09-12T22:33:22.551 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.5070000000000001e-05 2024-09-12T22:33:22.551 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:22.552 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:22.552 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:22.552 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.552 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.552 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3064 3.2 3:42569fed:::200.00000011:head [write 3916704~1398 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:33:22.552 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:19.386705+0000", 2024-09-12T22:33:22.552 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 3.0973847459999999, 2024-09-12T22:33:22.552 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.043238378000000001, 2024-09-12T22:33:22.552 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:22.552 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:22.552 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:22.553 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:22.553 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.553 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:22.553 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386705+0000", 2024-09-12T22:33:22.553 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:22.553 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.553 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.553 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:22.553 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386705+0000", 2024-09-12T22:33:22.553 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:22.553 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.553 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.553 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:22.553 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386705+0000", 2024-09-12T22:33:22.554 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.8299999999999998e-07 2024-09-12T22:33:22.554 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.554 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.554 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:22.554 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386711+0000", 2024-09-12T22:33:22.554 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7080000000000002e-06 2024-09-12T22:33:22.554 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.554 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.554 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:22.554 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386717+0000", 2024-09-12T22:33:22.554 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.3990000000000001e-06 2024-09-12T22:33:22.554 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.554 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.554 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:22.555 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386722+0000", 2024-09-12T22:33:22.555 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9219999999999996e-06 2024-09-12T22:33:22.555 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.555 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.555 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:22.555 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.427585+0000", 2024-09-12T22:33:22.555 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.040863414000000001 2024-09-12T22:33:22.555 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.555 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.555 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:22.555 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.427628+0000", 2024-09-12T22:33:22.555 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2873000000000001e-05 2024-09-12T22:33:22.555 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.555 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.556 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:22.556 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.429871+0000", 2024-09-12T22:33:22.556 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.002242572 2024-09-12T22:33:22.556 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.556 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.556 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:22.556 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.429901+0000", 2024-09-12T22:33:22.556 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0114e-05 2024-09-12T22:33:22.556 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.556 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.556 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:22.556 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.429943+0000", 2024-09-12T22:33:22.557 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1993000000000003e-05 2024-09-12T22:33:22.557 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:22.557 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:22.557 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:22.557 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.557 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.557 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3065 3.2 3:42569fed:::200.00000011:head [write 3918102~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:33:22.557 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:19.386735+0000", 2024-09-12T22:33:22.557 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 3.0973545389999999, 2024-09-12T22:33:22.557 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.043278369999999997, 2024-09-12T22:33:22.557 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:22.557 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:22.557 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:22.557 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:22.558 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.558 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:22.558 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386735+0000", 2024-09-12T22:33:22.558 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:22.558 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.558 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.558 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:22.558 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386735+0000", 2024-09-12T22:33:22.558 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:22.558 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.558 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.558 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:22.558 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386735+0000", 2024-09-12T22:33:22.558 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.7300000000000001e-07 2024-09-12T22:33:22.559 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.559 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.559 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:22.559 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386738+0000", 2024-09-12T22:33:22.559 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8420000000000001e-06 2024-09-12T22:33:22.559 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.559 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.559 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:22.559 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386744+0000", 2024-09-12T22:33:22.559 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.3040000000000001e-06 2024-09-12T22:33:22.559 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.559 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.559 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:22.559 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386749+0000", 2024-09-12T22:33:22.560 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8409999999999999e-06 2024-09-12T22:33:22.560 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.560 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.560 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:22.560 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.428112+0000", 2024-09-12T22:33:22.560 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.041363204000000001 2024-09-12T22:33:22.560 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.560 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.560 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:22.560 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.428158+0000", 2024-09-12T22:33:22.560 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5756e-05 2024-09-12T22:33:22.560 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.560 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.560 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:22.561 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.429950+0000", 2024-09-12T22:33:22.561 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0017922859999999999 2024-09-12T22:33:22.561 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.561 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.561 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:22.561 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.429975+0000", 2024-09-12T22:33:22.561 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4640000000000001e-05 2024-09-12T22:33:22.561 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.561 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.561 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:22.561 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.430013+0000", 2024-09-12T22:33:22.561 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.8024000000000001e-05 2024-09-12T22:33:22.561 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:22.562 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:22.562 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:22.562 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.562 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.562 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3066 3.2 3:42569fed:::200.00000011:head [write 3919501~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:33:22.562 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:19.386755+0000", 2024-09-12T22:33:22.562 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 3.097333898, 2024-09-12T22:33:22.562 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.044668934, 2024-09-12T22:33:22.562 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:22.562 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:22.562 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:22.562 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:22.562 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.562 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:22.563 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386755+0000", 2024-09-12T22:33:22.563 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:22.563 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.563 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.563 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:22.563 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386755+0000", 2024-09-12T22:33:22.563 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:22.563 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.563 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.563 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:22.563 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386756+0000", 2024-09-12T22:33:22.563 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4499999999999997e-07 2024-09-12T22:33:22.563 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.563 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.564 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:22.564 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386763+0000", 2024-09-12T22:33:22.564 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.6459999999999993e-06 2024-09-12T22:33:22.564 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.564 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.564 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:22.564 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386770+0000", 2024-09-12T22:33:22.564 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.19e-06 2024-09-12T22:33:22.564 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.564 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.564 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:22.564 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386775+0000", 2024-09-12T22:33:22.564 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9640000000000002e-06 2024-09-12T22:33:22.564 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.565 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.565 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:22.565 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.428489+0000", 2024-09-12T22:33:22.565 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.041714539000000002 2024-09-12T22:33:22.565 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.565 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.565 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:22.565 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.428535+0000", 2024-09-12T22:33:22.565 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5658999999999998e-05 2024-09-12T22:33:22.565 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.565 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.565 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:22.565 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.431353+0000", 2024-09-12T22:33:22.566 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0028186270000000002 2024-09-12T22:33:22.566 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.566 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.566 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:22.566 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.431385+0000", 2024-09-12T22:33:22.566 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.1374000000000001e-05 2024-09-12T22:33:22.566 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.566 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.566 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:22.566 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.431424+0000", 2024-09-12T22:33:22.566 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9490000000000003e-05 2024-09-12T22:33:22.566 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:22.566 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:22.567 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:22.567 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.567 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.567 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3067 3.2 3:42569fed:::200.00000011:head [write 3920900~2245 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:33:22.567 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:19.386781+0000", 2024-09-12T22:33:22.567 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 3.0973080089999998, 2024-09-12T22:33:22.567 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.044711322999999997, 2024-09-12T22:33:22.567 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:22.567 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:22.567 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:22.567 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:22.567 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.567 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:22.568 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386781+0000", 2024-09-12T22:33:22.568 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:22.568 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.568 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.568 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:22.568 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386781+0000", 2024-09-12T22:33:22.568 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:22.568 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.568 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.568 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:22.569 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386782+0000", 2024-09-12T22:33:22.569 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9900000000000001e-07 2024-09-12T22:33:22.569 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.569 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.569 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:22.569 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386795+0000", 2024-09-12T22:33:22.569 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2864000000000001e-05 2024-09-12T22:33:22.569 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.569 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.569 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:22.569 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386801+0000", 2024-09-12T22:33:22.569 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.3589999999999996e-06 2024-09-12T22:33:22.569 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.570 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.570 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:22.570 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386805+0000", 2024-09-12T22:33:22.570 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6190000000000002e-06 2024-09-12T22:33:22.570 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.570 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.570 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:22.570 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.429080+0000", 2024-09-12T22:33:22.570 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.042274027999999998 2024-09-12T22:33:22.570 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.570 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.570 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:22.570 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.429131+0000", 2024-09-12T22:33:22.571 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1715000000000002e-05 2024-09-12T22:33:22.571 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.571 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.571 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:22.571 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.431432+0000", 2024-09-12T22:33:22.571 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0023007489999999999 2024-09-12T22:33:22.571 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.571 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.571 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:22.571 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.431458+0000", 2024-09-12T22:33:22.571 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.603e-05 2024-09-12T22:33:22.571 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.571 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.571 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:22.571 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.431493+0000", 2024-09-12T22:33:22.571 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4560000000000001e-05 2024-09-12T22:33:22.572 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:22.572 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:22.572 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:22.572 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.572 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.572 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3068 3.2 3:42569fed:::200.00000011:head [write 3923145~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:33:22.572 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:19.386812+0000", 2024-09-12T22:33:22.572 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 3.0972772499999999, 2024-09-12T22:33:22.572 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.045559559999999999, 2024-09-12T22:33:22.572 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:22.572 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:22.572 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:22.572 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:22.573 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.573 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:22.573 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386812+0000", 2024-09-12T22:33:22.573 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:22.573 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.573 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.573 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:22.573 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386812+0000", 2024-09-12T22:33:22.573 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:22.573 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.573 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.573 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:22.573 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386812+0000", 2024-09-12T22:33:22.574 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.01e-07 2024-09-12T22:33:22.574 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.574 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.574 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:22.574 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386823+0000", 2024-09-12T22:33:22.574 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1038e-05 2024-09-12T22:33:22.574 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.574 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.574 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:22.574 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386830+0000", 2024-09-12T22:33:22.574 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.5409999999999997e-06 2024-09-12T22:33:22.574 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.574 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.575 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:22.575 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386835+0000", 2024-09-12T22:33:22.575 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.091e-06 2024-09-12T22:33:22.575 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.575 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.575 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:22.575 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.429460+0000", 2024-09-12T22:33:22.575 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.042625333000000001 2024-09-12T22:33:22.575 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.575 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.575 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:22.575 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.429506+0000", 2024-09-12T22:33:22.575 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5299000000000001e-05 2024-09-12T22:33:22.575 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.575 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.576 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:22.576 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.432283+0000", 2024-09-12T22:33:22.576 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0027776799999999998 2024-09-12T22:33:22.576 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.576 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.576 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:22.576 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.432315+0000", 2024-09-12T22:33:22.576 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.1401e-05 2024-09-12T22:33:22.576 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.576 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.576 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:22.576 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.432372+0000", 2024-09-12T22:33:22.576 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.6776e-05 2024-09-12T22:33:22.577 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:22.577 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:22.577 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:22.577 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.577 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.577 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3069 3.2 3:42569fed:::200.00000011:head [write 3924544~2246 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:33:22.577 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:19.386842+0000", 2024-09-12T22:33:22.577 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 3.09724735, 2024-09-12T22:33:22.577 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.045596166, 2024-09-12T22:33:22.577 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:22.577 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:22.577 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:22.577 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:22.578 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.578 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:22.578 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386842+0000", 2024-09-12T22:33:22.578 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:22.578 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.578 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.578 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:22.578 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386842+0000", 2024-09-12T22:33:22.578 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:22.578 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.578 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.578 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:22.578 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386842+0000", 2024-09-12T22:33:22.578 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5200000000000002e-07 2024-09-12T22:33:22.578 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.579 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.579 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:22.579 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386845+0000", 2024-09-12T22:33:22.579 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8820000000000001e-06 2024-09-12T22:33:22.579 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.579 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.579 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:22.579 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386851+0000", 2024-09-12T22:33:22.579 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9540000000000001e-06 2024-09-12T22:33:22.579 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.579 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.579 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:22.579 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386856+0000", 2024-09-12T22:33:22.579 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5159999999999996e-06 2024-09-12T22:33:22.580 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.580 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.580 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:22.580 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.430043+0000", 2024-09-12T22:33:22.580 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.043186930999999998 2024-09-12T22:33:22.580 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.580 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.580 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:22.580 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.430086+0000", 2024-09-12T22:33:22.580 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3844999999999998e-05 2024-09-12T22:33:22.580 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.580 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.580 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:22.581 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.432379+0000", 2024-09-12T22:33:22.581 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0022922049999999999 2024-09-12T22:33:22.581 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.581 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.581 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:22.581 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.432405+0000", 2024-09-12T22:33:22.581 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5877999999999999e-05 2024-09-12T22:33:22.581 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.581 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.581 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:22.581 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.432438+0000", 2024-09-12T22:33:22.581 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3503000000000001e-05 2024-09-12T22:33:22.581 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:22.582 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:22.582 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:22.582 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.582 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.582 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3070 3.2 3:42569fed:::200.00000011:head [write 3926790~2768 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:33:22.582 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:19.387280+0000", 2024-09-12T22:33:22.582 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 3.0968091819999999, 2024-09-12T22:33:22.582 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.04692201, 2024-09-12T22:33:22.582 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:22.582 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:22.582 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:22.582 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:22.582 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.582 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:22.583 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.387280+0000", 2024-09-12T22:33:22.583 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:22.583 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.583 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.583 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:22.583 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.387280+0000", 2024-09-12T22:33:22.583 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:22.583 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.583 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.583 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:22.583 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.387281+0000", 2024-09-12T22:33:22.583 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4300000000000002e-07 2024-09-12T22:33:22.583 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.583 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.583 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:22.584 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.387285+0000", 2024-09-12T22:33:22.584 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2570000000000001e-06 2024-09-12T22:33:22.584 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.584 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.584 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:22.584 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.387293+0000", 2024-09-12T22:33:22.584 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0209999999999999e-06 2024-09-12T22:33:22.584 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.584 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.584 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:22.584 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.387299+0000", 2024-09-12T22:33:22.584 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.6930000000000004e-06 2024-09-12T22:33:22.584 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.585 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.585 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:22.585 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.430441+0000", 2024-09-12T22:33:22.585 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.043141789999999999 2024-09-12T22:33:22.585 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.585 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.585 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:22.585 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.430484+0000", 2024-09-12T22:33:22.585 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3745000000000002e-05 2024-09-12T22:33:22.585 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.585 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.585 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:22.585 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.434132+0000", 2024-09-12T22:33:22.586 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00364818 2024-09-12T22:33:22.586 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.586 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.586 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:22.586 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.434163+0000", 2024-09-12T22:33:22.586 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0599000000000003e-05 2024-09-12T22:33:22.586 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.586 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.586 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:22.586 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.434202+0000", 2024-09-12T22:33:22.586 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.8982e-05 2024-09-12T22:33:22.586 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:22.586 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:22.586 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:22.587 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.587 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.587 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3071 3.2 3:42569fed:::200.00000011:head [write 3929558~3203 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:33:22.587 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:19.387860+0000", 2024-09-12T22:33:22.587 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 3.0962291519999998, 2024-09-12T22:33:22.587 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.049590902999999999, 2024-09-12T22:33:22.587 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:22.587 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:22.587 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:22.587 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:22.587 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.587 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:22.588 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.387860+0000", 2024-09-12T22:33:22.588 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:22.588 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.588 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.588 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:22.588 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.387860+0000", 2024-09-12T22:33:22.588 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:22.588 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.588 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.588 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:22.588 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.387861+0000", 2024-09-12T22:33:22.588 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5099999999999999e-07 2024-09-12T22:33:22.588 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.589 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.589 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:22.589 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.387865+0000", 2024-09-12T22:33:22.589 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2629999999999997e-06 2024-09-12T22:33:22.589 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.589 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.589 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:22.589 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.387875+0000", 2024-09-12T22:33:22.589 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0256e-05 2024-09-12T22:33:22.589 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.589 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.589 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:22.589 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.387881+0000", 2024-09-12T22:33:22.589 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.947e-06 2024-09-12T22:33:22.590 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.590 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.590 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:22.590 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.430930+0000", 2024-09-12T22:33:22.590 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.043048386000000001 2024-09-12T22:33:22.590 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.590 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.590 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:22.590 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.430976+0000", 2024-09-12T22:33:22.590 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6408e-05 2024-09-12T22:33:22.590 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.590 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.590 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:22.591 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.437377+0000", 2024-09-12T22:33:22.591 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0064010719999999998 2024-09-12T22:33:22.591 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.591 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.591 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:22.591 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.437409+0000", 2024-09-12T22:33:22.591 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2054999999999997e-05 2024-09-12T22:33:22.591 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.591 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.591 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:22.591 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.437451+0000", 2024-09-12T22:33:22.591 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1764999999999997e-05 2024-09-12T22:33:22.591 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:22.591 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:22.592 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:22.592 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.592 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.592 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3072 3.2 3:42569fed:::200.00000011:head [write 3932761~2786 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:33:22.592 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:19.388005+0000", 2024-09-12T22:33:22.592 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 3.0960840530000002, 2024-09-12T22:33:22.592 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.049514177999999999, 2024-09-12T22:33:22.592 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:22.592 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:22.592 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:22.593 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:22.593 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.593 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:22.593 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.388005+0000", 2024-09-12T22:33:22.593 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:22.593 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.593 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.593 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:22.593 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.388005+0000", 2024-09-12T22:33:22.593 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:22.593 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.593 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.593 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:22.594 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.388006+0000", 2024-09-12T22:33:22.594 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.1799999999999995e-07 2024-09-12T22:33:22.594 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.594 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.594 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:22.594 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.388009+0000", 2024-09-12T22:33:22.594 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.574e-06 2024-09-12T22:33:22.594 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.594 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.594 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:22.594 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.388017+0000", 2024-09-12T22:33:22.594 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3170000000000004e-06 2024-09-12T22:33:22.594 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.594 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.595 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:22.595 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.388022+0000", 2024-09-12T22:33:22.595 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9910000000000002e-06 2024-09-12T22:33:22.595 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.595 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.595 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:22.595 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.431522+0000", 2024-09-12T22:33:22.595 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0435001 2024-09-12T22:33:22.595 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.595 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.595 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:22.595 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.431567+0000", 2024-09-12T22:33:22.595 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4734000000000002e-05 2024-09-12T22:33:22.595 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.596 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.596 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:22.596 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.437458+0000", 2024-09-12T22:33:22.596 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00589166 2024-09-12T22:33:22.596 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.596 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.596 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:22.596 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.437484+0000", 2024-09-12T22:33:22.596 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5622999999999998e-05 2024-09-12T22:33:22.596 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.596 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.596 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:22.596 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.437519+0000", 2024-09-12T22:33:22.596 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.5561000000000001e-05 2024-09-12T22:33:22.597 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:22.597 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:22.597 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:22.597 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.597 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.597 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3073 3.2 3:42569fed:::200.00000011:head [write 3935547~1924 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:33:22.597 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:19.389181+0000", 2024-09-12T22:33:22.597 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 3.0949078910000001, 2024-09-12T22:33:22.597 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.048402300000000002, 2024-09-12T22:33:22.597 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:22.597 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:22.597 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:22.597 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:22.598 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.598 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:22.598 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.389181+0000", 2024-09-12T22:33:22.598 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:22.598 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.598 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.598 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:22.598 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.389181+0000", 2024-09-12T22:33:22.598 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:22.598 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.598 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.598 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:22.598 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.389182+0000", 2024-09-12T22:33:22.598 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7700000000000004e-07 2024-09-12T22:33:22.599 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.599 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.599 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:22.599 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.389191+0000", 2024-09-12T22:33:22.599 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1120000000000002e-06 2024-09-12T22:33:22.599 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.599 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.599 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:22.599 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.389203+0000", 2024-09-12T22:33:22.599 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.146e-05 2024-09-12T22:33:22.599 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.599 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.599 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:22.600 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.389209+0000", 2024-09-12T22:33:22.600 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9989999999999997e-06 2024-09-12T22:33:22.600 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.600 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.600 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:22.600 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.431890+0000", 2024-09-12T22:33:22.600 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.042681251000000003 2024-09-12T22:33:22.600 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.600 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.600 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:22.600 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.431935+0000", 2024-09-12T22:33:22.600 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5166000000000001e-05 2024-09-12T22:33:22.600 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.601 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.601 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:22.601 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.437526+0000", 2024-09-12T22:33:22.601 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0055910489999999998 2024-09-12T22:33:22.601 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.601 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.601 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:22.601 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.437550+0000", 2024-09-12T22:33:22.601 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4134999999999998e-05 2024-09-12T22:33:22.601 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.601 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.601 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:22.601 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.437584+0000", 2024-09-12T22:33:22.601 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3451000000000002e-05 2024-09-12T22:33:22.602 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:22.602 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:22.602 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:22.602 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.602 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.602 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3074 3.2 3:42569fed:::200.00000011:head [write 3937471~7660 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:33:22.602 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:19.390512+0000", 2024-09-12T22:33:22.602 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 3.0935767680000001, 2024-09-12T22:33:22.602 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.047134045999999999, 2024-09-12T22:33:22.602 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:22.602 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:22.602 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:22.603 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:22.603 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.603 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:22.603 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.390512+0000", 2024-09-12T22:33:22.603 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:22.603 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.603 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.603 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:22.603 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.390512+0000", 2024-09-12T22:33:22.603 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:22.603 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.603 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.603 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:22.604 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.390513+0000", 2024-09-12T22:33:22.604 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.7699999999999992e-07 2024-09-12T22:33:22.604 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.604 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.604 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:22.604 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.390522+0000", 2024-09-12T22:33:22.604 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0390000000000005e-06 2024-09-12T22:33:22.604 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.604 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.604 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:22.604 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.390530+0000", 2024-09-12T22:33:22.605 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.8349999999999993e-06 2024-09-12T22:33:22.605 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.605 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.605 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:22.605 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.390537+0000", 2024-09-12T22:33:22.605 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.1850000000000001e-06 2024-09-12T22:33:22.605 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.605 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.605 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:22.605 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.432468+0000", 2024-09-12T22:33:22.605 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.041931883000000003 2024-09-12T22:33:22.606 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.606 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.606 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:22.606 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.432512+0000", 2024-09-12T22:33:22.606 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4054999999999997e-05 2024-09-12T22:33:22.606 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.606 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.606 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:22.606 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.437590+0000", 2024-09-12T22:33:22.606 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0050777230000000001 2024-09-12T22:33:22.606 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.606 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.607 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:22.607 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.437613+0000", 2024-09-12T22:33:22.607 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.2693000000000001e-05 2024-09-12T22:33:22.607 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:22.607 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:22.607 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:22.607 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.437647+0000", 2024-09-12T22:33:22.607 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3655999999999998e-05 2024-09-12T22:33:22.607 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:22.608 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:22.608 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:22.608 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:22.608 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:22.608 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:33:22.608 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T22:33:22.611 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:33:22.611 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:22.608+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:22.711 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:22.710+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:22.740 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-09-12T22:33:22.740 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-09-12T22:33:22.740 INFO:teuthology.orchestra.run.smithi163.stdout: "num_ops": 0 2024-09-12T22:33:22.740 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-09-12T22:33:22.749 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:33:22.812 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:22.809+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:22.851 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-09-12T22:33:22.851 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-09-12T22:33:22.852 INFO:teuthology.orchestra.run.smithi163.stdout: "complaint_time": 30, 2024-09-12T22:33:22.852 INFO:teuthology.orchestra.run.smithi163.stdout: "num_blocked_ops": 0 2024-09-12T22:33:22.852 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-09-12T22:33:22.860 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:33:22.913 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:22.911+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:23.008 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-09-12T22:33:23.008 INFO:teuthology.orchestra.run.smithi163.stdout: "size": 20, 2024-09-12T22:33:23.008 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 600, 2024-09-12T22:33:23.008 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2024-09-12T22:33:23.008 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.009 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-09-12T22:33:23.009 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:27.254459+0000", 2024-09-12T22:33:23.009 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 115.75122381600001, 2024-09-12T22:33:23.009 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.37816283899999997, 2024-09-12T22:33:23.009 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:23.009 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:23.009 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:23.009 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:23.009 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:33:23.009 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:33:23.009 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 1 2024-09-12T22:33:23.009 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.010 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:23.010 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.010 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:23.010 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254459+0000", 2024-09-12T22:33:23.010 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:23.010 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.010 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.010 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:23.010 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254459+0000", 2024-09-12T22:33:23.010 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:23.010 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.010 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.010 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:23.010 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254460+0000", 2024-09-12T22:33:23.011 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1739999999999999e-06 2024-09-12T22:33:23.011 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.011 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.011 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:23.011 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254472+0000", 2024-09-12T22:33:23.011 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2207e-05 2024-09-12T22:33:23.011 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.011 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.011 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:23.011 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254483+0000", 2024-09-12T22:33:23.011 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0631999999999999e-05 2024-09-12T22:33:23.011 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.011 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.012 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:23.012 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254492+0000", 2024-09-12T22:33:23.012 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3670000000000003e-06 2024-09-12T22:33:23.012 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.012 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.012 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:23.012 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254551+0000", 2024-09-12T22:33:23.012 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8687999999999998e-05 2024-09-12T22:33:23.012 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.012 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.012 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for peered", 2024-09-12T22:33:23.012 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254562+0000", 2024-09-12T22:33:23.013 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1249e-05 2024-09-12T22:33:23.013 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.013 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.013 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:23.013 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.631211+0000", 2024-09-12T22:33:23.013 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.376649018 2024-09-12T22:33:23.013 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.013 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.013 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:23.013 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.631345+0000", 2024-09-12T22:33:23.013 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013378700000000001 2024-09-12T22:33:23.013 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.013 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.014 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:33:23.014 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.631479+0000", 2024-09-12T22:33:23.014 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013352399999999999 2024-09-12T22:33:23.014 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.014 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.014 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:23.014 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632324+0000", 2024-09-12T22:33:23.014 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00084508100000000002 2024-09-12T22:33:23.014 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.014 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.014 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:23.014 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632548+0000", 2024-09-12T22:33:23.014 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000224329 2024-09-12T22:33:23.015 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.015 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.015 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:23.015 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632591+0000", 2024-09-12T22:33:23.015 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2564000000000001e-05 2024-09-12T22:33:23.015 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.015 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.015 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:23.015 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632622+0000", 2024-09-12T22:33:23.015 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1219e-05 2024-09-12T22:33:23.015 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:23.015 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:23.015 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:23.015 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.016 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.016 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4490.0:9871 4.35 4:ad66404a:::10000002d4d.00000000:head [write 0~6507] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:33:23.016 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:09.472309+0000", 2024-09-12T22:33:23.016 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 13.533373539999999, 2024-09-12T22:33:23.016 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.080251445000000005, 2024-09-12T22:33:23.016 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:23.016 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:23.016 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:23.016 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:23.016 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4490", 2024-09-12T22:33:23.016 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:23.016 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 9871 2024-09-12T22:33:23.016 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.017 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:23.017 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.017 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:23.017 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.472309+0000", 2024-09-12T22:33:23.017 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:23.017 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.017 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.017 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:23.017 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.472309+0000", 2024-09-12T22:33:23.017 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:23.017 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.017 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.017 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:23.017 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.472310+0000", 2024-09-12T22:33:23.018 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3799999999999996e-07 2024-09-12T22:33:23.018 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.018 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.018 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:23.018 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.472318+0000", 2024-09-12T22:33:23.018 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.8099999999999998e-06 2024-09-12T22:33:23.018 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.018 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.018 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:23.018 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.472328+0000", 2024-09-12T22:33:23.018 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0359e-05 2024-09-12T22:33:23.018 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.018 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.018 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:23.019 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.472334+0000", 2024-09-12T22:33:23.019 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.0109999999999997e-06 2024-09-12T22:33:23.019 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.019 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.019 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:23.019 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.472382+0000", 2024-09-12T22:33:23.019 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.7311000000000002e-05 2024-09-12T22:33:23.019 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.019 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.019 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:23.019 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.472497+0000", 2024-09-12T22:33:23.019 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011537800000000001 2024-09-12T22:33:23.019 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.019 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.019 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:23.020 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.472617+0000", 2024-09-12T22:33:23.020 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011989600000000001 2024-09-12T22:33:23.020 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.020 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.020 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:23.020 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473149+0000", 2024-09-12T22:33:23.020 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00053227999999999999 2024-09-12T22:33:23.020 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.020 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.020 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:23.020 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.552479+0000", 2024-09-12T22:33:23.020 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.079329541000000003 2024-09-12T22:33:23.020 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.021 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.021 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:23.021 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.552525+0000", 2024-09-12T22:33:23.021 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6421000000000002e-05 2024-09-12T22:33:23.021 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.021 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.021 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:23.021 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.552561+0000", 2024-09-12T22:33:23.021 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5599999999999998e-05 2024-09-12T22:33:23.021 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:23.021 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:23.021 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:23.021 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.021 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.022 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4490.0:9872 4.2c 4:3602c8d3:::10000002d4e.00000000:head [write 0~1178] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:33:23.022 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:09.473085+0000", 2024-09-12T22:33:23.022 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 13.532598236, 2024-09-12T22:33:23.022 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.079631104999999994, 2024-09-12T22:33:23.022 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:23.022 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:23.022 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:23.022 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:23.022 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4490", 2024-09-12T22:33:23.022 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:23.022 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 9872 2024-09-12T22:33:23.022 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.022 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:23.023 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.023 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:23.023 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473085+0000", 2024-09-12T22:33:23.023 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:23.023 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.023 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.023 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:23.023 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473085+0000", 2024-09-12T22:33:23.023 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:23.023 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.023 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.023 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:23.023 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473085+0000", 2024-09-12T22:33:23.023 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3600000000000004e-07 2024-09-12T22:33:23.024 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.024 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.024 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:23.024 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473088+0000", 2024-09-12T22:33:23.024 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.005e-06 2024-09-12T22:33:23.024 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.024 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.024 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:23.024 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473095+0000", 2024-09-12T22:33:23.024 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3950000000000003e-06 2024-09-12T22:33:23.024 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.024 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.024 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:23.025 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473100+0000", 2024-09-12T22:33:23.025 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5460000000000002e-06 2024-09-12T22:33:23.025 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.025 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.025 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:23.025 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473138+0000", 2024-09-12T22:33:23.025 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8244999999999997e-05 2024-09-12T22:33:23.025 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.025 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.025 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:23.025 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473216+0000", 2024-09-12T22:33:23.025 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.7756000000000006e-05 2024-09-12T22:33:23.025 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.026 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.026 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:23.026 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473291+0000", 2024-09-12T22:33:23.026 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5110000000000004e-05 2024-09-12T22:33:23.026 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.026 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.026 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:23.026 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473736+0000", 2024-09-12T22:33:23.026 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00044486500000000002 2024-09-12T22:33:23.026 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.026 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.026 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:23.026 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.552637+0000", 2024-09-12T22:33:23.026 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.078900782000000003 2024-09-12T22:33:23.027 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.027 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.027 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:23.027 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.552680+0000", 2024-09-12T22:33:23.027 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3047999999999998e-05 2024-09-12T22:33:23.027 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.027 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.027 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:23.027 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.552716+0000", 2024-09-12T22:33:23.027 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5816999999999999e-05 2024-09-12T22:33:23.027 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:23.027 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:23.027 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:23.027 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.028 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.028 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4490.0:9873 4.2c 4:372c52ff:::10000002d4f.00000000:head [write 0~1230] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:33:23.028 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:09.473878+0000", 2024-09-12T22:33:23.028 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 13.531804772999999, 2024-09-12T22:33:23.028 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.079036047999999998, 2024-09-12T22:33:23.028 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:23.028 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:23.028 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:23.028 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:23.028 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4490", 2024-09-12T22:33:23.028 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:23.028 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 9873 2024-09-12T22:33:23.028 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.029 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:23.029 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.029 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:23.029 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473878+0000", 2024-09-12T22:33:23.029 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:23.029 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.029 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.029 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:23.029 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473878+0000", 2024-09-12T22:33:23.029 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:23.029 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.029 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.029 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:23.029 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473879+0000", 2024-09-12T22:33:23.030 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9100000000000004e-07 2024-09-12T22:33:23.030 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.030 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.030 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:23.030 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473882+0000", 2024-09-12T22:33:23.030 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.405e-06 2024-09-12T22:33:23.030 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.030 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.030 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:23.030 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473889+0000", 2024-09-12T22:33:23.030 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7519999999999999e-06 2024-09-12T22:33:23.030 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.030 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.031 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:23.031 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473893+0000", 2024-09-12T22:33:23.031 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9310000000000001e-06 2024-09-12T22:33:23.031 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.031 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.031 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:23.031 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473922+0000", 2024-09-12T22:33:23.031 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9346999999999999e-05 2024-09-12T22:33:23.031 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.031 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.031 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:23.031 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474000+0000", 2024-09-12T22:33:23.031 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.7972000000000005e-05 2024-09-12T22:33:23.031 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.031 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.032 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:23.032 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474072+0000", 2024-09-12T22:33:23.032 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1960999999999998e-05 2024-09-12T22:33:23.032 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.032 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.032 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:23.032 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474470+0000", 2024-09-12T22:33:23.032 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00039803400000000002 2024-09-12T22:33:23.032 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.032 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.032 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:23.032 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.552814+0000", 2024-09-12T22:33:23.032 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.078344164999999993 2024-09-12T22:33:23.032 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.033 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.033 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:23.033 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.552875+0000", 2024-09-12T22:33:23.033 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1008999999999998e-05 2024-09-12T22:33:23.033 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.033 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.033 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:23.033 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.552914+0000", 2024-09-12T22:33:23.033 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8881000000000003e-05 2024-09-12T22:33:23.033 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:23.033 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:23.033 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:23.033 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.034 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.034 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4490.0:9874 4.1b 4:db19d96a:::10000002d50.00000000:head [write 0~1088] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:33:23.034 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:09.474673+0000", 2024-09-12T22:33:23.034 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 13.53100978, 2024-09-12T22:33:23.034 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.080314317999999996, 2024-09-12T22:33:23.034 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:23.034 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:23.034 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:23.034 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:23.034 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4490", 2024-09-12T22:33:23.034 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:23.034 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 9874 2024-09-12T22:33:23.034 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.034 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:23.035 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.035 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:23.035 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474673+0000", 2024-09-12T22:33:23.035 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:23.035 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.035 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.035 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:23.035 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474673+0000", 2024-09-12T22:33:23.035 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:23.035 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.035 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.035 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:23.035 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474674+0000", 2024-09-12T22:33:23.035 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6199999999999998e-07 2024-09-12T22:33:23.036 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.036 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.036 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:23.036 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474677+0000", 2024-09-12T22:33:23.036 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.224e-06 2024-09-12T22:33:23.036 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.036 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.036 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:23.036 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474683+0000", 2024-09-12T22:33:23.036 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.3160000000000002e-06 2024-09-12T22:33:23.036 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.036 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.037 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:23.037 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474687+0000", 2024-09-12T22:33:23.037 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7869999999999999e-06 2024-09-12T22:33:23.037 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.037 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.037 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:23.037 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474730+0000", 2024-09-12T22:33:23.037 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3309000000000002e-05 2024-09-12T22:33:23.037 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.037 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.037 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:23.037 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474845+0000", 2024-09-12T22:33:23.037 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114306 2024-09-12T22:33:23.038 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.038 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.038 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:23.038 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474970+0000", 2024-09-12T22:33:23.038 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000125096 2024-09-12T22:33:23.038 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.038 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.038 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:23.038 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.475621+0000", 2024-09-12T22:33:23.038 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00065124900000000001 2024-09-12T22:33:23.038 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.038 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.038 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:23.039 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.554885+0000", 2024-09-12T22:33:23.039 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.079264055 2024-09-12T22:33:23.039 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.039 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.039 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:23.039 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.554942+0000", 2024-09-12T22:33:23.039 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7284000000000002e-05 2024-09-12T22:33:23.039 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.039 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.039 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:23.039 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.554987+0000", 2024-09-12T22:33:23.039 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5130000000000003e-05 2024-09-12T22:33:23.039 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:23.039 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:23.040 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:23.040 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.040 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.040 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4490.0:12220 4.2b 4:d55bfd66:::10000003169.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-12T22:33:23.040 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.391333+0000", 2024-09-12T22:33:23.040 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 8.6143496370000001, 2024-09-12T22:33:23.040 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.088669550999999999, 2024-09-12T22:33:23.040 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:23.040 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:23.040 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:23.040 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:23.040 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4490", 2024-09-12T22:33:23.041 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:23.041 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 12220 2024-09-12T22:33:23.041 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.041 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:23.041 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.041 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:23.041 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.391333+0000", 2024-09-12T22:33:23.041 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:23.041 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.041 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.041 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:23.041 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.391333+0000", 2024-09-12T22:33:23.041 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:23.042 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.042 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.042 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:23.042 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.391334+0000", 2024-09-12T22:33:23.042 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3099999999999997e-07 2024-09-12T22:33:23.042 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.042 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.042 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:23.042 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398373+0000", 2024-09-12T22:33:23.042 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0070386670000000002 2024-09-12T22:33:23.042 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.042 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.042 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:23.042 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398384+0000", 2024-09-12T22:33:23.043 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1338999999999999e-05 2024-09-12T22:33:23.043 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.043 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.043 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:23.043 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398389+0000", 2024-09-12T22:33:23.043 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3650000000000003e-06 2024-09-12T22:33:23.043 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.043 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.043 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:23.043 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.456308+0000", 2024-09-12T22:33:23.043 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.057918931 2024-09-12T22:33:23.043 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.043 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.043 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:23.044 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.456425+0000", 2024-09-12T22:33:23.044 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000116452 2024-09-12T22:33:23.044 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.044 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.044 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:23.044 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.456536+0000", 2024-09-12T22:33:23.044 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000111839 2024-09-12T22:33:23.044 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.044 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.044 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:23.044 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.465335+0000", 2024-09-12T22:33:23.044 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0087984980000000001 2024-09-12T22:33:23.045 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.045 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.045 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:23.045 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.479950+0000", 2024-09-12T22:33:23.045 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.01461552 2024-09-12T22:33:23.045 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.045 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.045 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:23.045 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.479983+0000", 2024-09-12T22:33:23.045 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2126999999999999e-05 2024-09-12T22:33:23.045 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.045 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.045 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:23.046 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.480003+0000", 2024-09-12T22:33:23.046 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0081999999999998e-05 2024-09-12T22:33:23.046 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:23.046 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:23.046 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:23.046 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.046 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.046 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1208 3.13 3:cb3d3880:::200.0000000d:head [write 1009846~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:23.046 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.398459+0000", 2024-09-12T22:33:23.046 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 8.6072240709999992, 2024-09-12T22:33:23.046 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.078093931000000005, 2024-09-12T22:33:23.046 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:23.046 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:23.047 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:23.047 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:23.047 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.047 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:23.047 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398459+0000", 2024-09-12T22:33:23.047 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:23.047 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.047 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.047 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:23.047 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398459+0000", 2024-09-12T22:33:23.047 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:23.047 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.047 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.048 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:23.048 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398459+0000", 2024-09-12T22:33:23.048 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8100000000000003e-07 2024-09-12T22:33:23.048 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.048 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.048 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:23.048 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398462+0000", 2024-09-12T22:33:23.048 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3700000000000002e-06 2024-09-12T22:33:23.048 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.048 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.048 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:23.048 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398469+0000", 2024-09-12T22:33:23.048 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2320000000000004e-06 2024-09-12T22:33:23.049 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.049 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.049 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:23.049 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398472+0000", 2024-09-12T22:33:23.049 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.658e-06 2024-09-12T22:33:23.049 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.049 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.049 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:23.049 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.456690+0000", 2024-09-12T22:33:23.049 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.058217615 2024-09-12T22:33:23.049 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.049 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.049 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:23.050 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.456731+0000", 2024-09-12T22:33:23.050 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0815000000000001e-05 2024-09-12T22:33:23.050 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.050 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.050 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:23.050 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.456793+0000", 2024-09-12T22:33:23.050 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1796000000000003e-05 2024-09-12T22:33:23.050 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.050 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.050 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:23.050 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.461412+0000", 2024-09-12T22:33:23.050 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0046188560000000002 2024-09-12T22:33:23.050 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.050 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.050 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:23.050 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476429+0000", 2024-09-12T22:33:23.051 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.015017943000000001 2024-09-12T22:33:23.051 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.051 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.051 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:23.051 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476499+0000", 2024-09-12T22:33:23.051 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9047000000000005e-05 2024-09-12T22:33:23.051 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.051 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.051 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:23.051 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476553+0000", 2024-09-12T22:33:23.051 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4117999999999999e-05 2024-09-12T22:33:23.051 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:23.052 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:23.052 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:23.052 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.052 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.052 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1209 3.13 3:cb3d3880:::200.0000000d:head [write 1011245~5867 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:23.052 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.398677+0000", 2024-09-12T22:33:23.052 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 8.6070055140000008, 2024-09-12T22:33:23.052 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.077995698000000002, 2024-09-12T22:33:23.052 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:23.052 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:23.052 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:23.052 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:23.052 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.053 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:23.053 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398677+0000", 2024-09-12T22:33:23.053 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:23.053 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.053 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.053 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:23.053 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398677+0000", 2024-09-12T22:33:23.053 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:23.053 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.053 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.053 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:23.053 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398678+0000", 2024-09-12T22:33:23.053 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5199999999999995e-07 2024-09-12T22:33:23.054 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.054 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.054 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:23.054 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398686+0000", 2024-09-12T22:33:23.054 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0579999999999998e-06 2024-09-12T22:33:23.054 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.054 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.054 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:23.054 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398695+0000", 2024-09-12T22:33:23.054 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.1409999999999994e-06 2024-09-12T22:33:23.054 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.054 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.054 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:23.054 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398703+0000", 2024-09-12T22:33:23.055 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4379999999999998e-06 2024-09-12T22:33:23.055 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.055 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.055 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:23.055 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.457051+0000", 2024-09-12T22:33:23.055 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.058348358000000003 2024-09-12T22:33:23.055 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.055 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.055 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:23.055 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.457096+0000", 2024-09-12T22:33:23.055 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4428000000000002e-05 2024-09-12T22:33:23.055 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.055 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.056 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:23.056 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.457162+0000", 2024-09-12T22:33:23.056 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6298999999999997e-05 2024-09-12T22:33:23.056 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.056 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.056 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:23.056 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.461416+0000", 2024-09-12T22:33:23.056 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0042539980000000002 2024-09-12T22:33:23.056 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.056 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.056 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:23.056 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476610+0000", 2024-09-12T22:33:23.056 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.015193879 2024-09-12T22:33:23.056 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.057 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.057 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:23.057 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476640+0000", 2024-09-12T22:33:23.057 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0648000000000002e-05 2024-09-12T22:33:23.057 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.057 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.057 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:23.057 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476673+0000", 2024-09-12T22:33:23.057 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2598999999999997e-05 2024-09-12T22:33:23.057 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:23.057 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:23.057 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:23.057 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.057 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.058 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1210 3.13 3:cb3d3880:::200.0000000d:head [write 1017112~1958 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:23.058 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.398713+0000", 2024-09-12T22:33:23.058 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 8.6069701910000003, 2024-09-12T22:33:23.058 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.078118317000000007, 2024-09-12T22:33:23.058 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:23.058 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:23.058 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:23.058 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:23.058 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.058 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:23.058 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398713+0000", 2024-09-12T22:33:23.058 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:23.058 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.058 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.059 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:23.059 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398713+0000", 2024-09-12T22:33:23.059 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:23.059 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.059 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.059 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:23.059 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398713+0000", 2024-09-12T22:33:23.059 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7599999999999998e-07 2024-09-12T22:33:23.059 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.059 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.059 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:23.059 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398718+0000", 2024-09-12T22:33:23.059 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8169999999999998e-06 2024-09-12T22:33:23.060 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.060 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.060 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:23.060 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398722+0000", 2024-09-12T22:33:23.060 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5249999999999999e-06 2024-09-12T22:33:23.060 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.060 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.060 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:23.060 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398726+0000", 2024-09-12T22:33:23.060 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5650000000000002e-06 2024-09-12T22:33:23.060 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.060 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.060 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:23.061 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.457644+0000", 2024-09-12T22:33:23.061 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.058918521000000001 2024-09-12T22:33:23.061 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.061 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.061 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:23.061 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.457724+0000", 2024-09-12T22:33:23.061 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9408999999999998e-05 2024-09-12T22:33:23.061 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.061 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.061 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:23.061 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.457821+0000", 2024-09-12T22:33:23.061 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.7015000000000005e-05 2024-09-12T22:33:23.061 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.062 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.062 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:23.062 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.461419+0000", 2024-09-12T22:33:23.062 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0035985309999999999 2024-09-12T22:33:23.062 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.062 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.062 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:23.062 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476726+0000", 2024-09-12T22:33:23.062 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.015306804 2024-09-12T22:33:23.062 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.062 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.062 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:23.062 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476787+0000", 2024-09-12T22:33:23.062 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1062000000000006e-05 2024-09-12T22:33:23.063 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.063 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.063 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:23.063 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476831+0000", 2024-09-12T22:33:23.063 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3692000000000001e-05 2024-09-12T22:33:23.063 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:23.063 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:23.063 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:23.063 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.063 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.063 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1211 3.13 3:cb3d3880:::200.0000000d:head [write 1019070~5873 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:23.063 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.400122+0000", 2024-09-12T22:33:23.063 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 8.6055604730000006, 2024-09-12T22:33:23.063 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.076797146999999996, 2024-09-12T22:33:23.064 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:23.064 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:23.064 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:23.064 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:23.064 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.064 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:23.064 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.400122+0000", 2024-09-12T22:33:23.064 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:23.064 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.064 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.064 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:23.064 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.400122+0000", 2024-09-12T22:33:23.064 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:23.065 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.065 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.065 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:23.065 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.400123+0000", 2024-09-12T22:33:23.065 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2500000000000005e-07 2024-09-12T22:33:23.065 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.065 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.065 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:23.065 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.400129+0000", 2024-09-12T22:33:23.065 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.319e-06 2024-09-12T22:33:23.065 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.065 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.065 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:23.066 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.400139+0000", 2024-09-12T22:33:23.066 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.5200000000000003e-06 2024-09-12T22:33:23.066 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.066 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.066 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:23.066 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.400143+0000", 2024-09-12T22:33:23.066 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.437e-06 2024-09-12T22:33:23.066 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.066 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.066 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:23.066 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.458159+0000", 2024-09-12T22:33:23.066 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.058015960999999998 2024-09-12T22:33:23.066 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.066 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.067 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:23.067 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.458201+0000", 2024-09-12T22:33:23.067 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1693000000000002e-05 2024-09-12T22:33:23.067 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.067 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.067 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:23.067 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.458267+0000", 2024-09-12T22:33:23.067 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5687999999999999e-05 2024-09-12T22:33:23.067 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.067 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.067 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:23.067 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.461423+0000", 2024-09-12T22:33:23.067 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0031560730000000001 2024-09-12T22:33:23.068 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.068 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.068 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:23.068 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476868+0000", 2024-09-12T22:33:23.068 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.015445108000000001 2024-09-12T22:33:23.068 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.068 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.068 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:23.068 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476897+0000", 2024-09-12T22:33:23.068 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9433000000000001e-05 2024-09-12T22:33:23.068 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.068 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.068 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:23.068 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476919+0000", 2024-09-12T22:33:23.069 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.2189999999999999e-05 2024-09-12T22:33:23.069 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:23.069 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:23.069 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:23.069 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.069 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.069 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1212 3.13 3:cb3d3880:::200.0000000d:head [write 1024943~3866 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:23.069 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.401707+0000", 2024-09-12T22:33:23.069 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 8.6039762680000003, 2024-09-12T22:33:23.069 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.075386625999999998, 2024-09-12T22:33:23.069 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:23.069 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:23.069 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:23.070 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:23.070 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.070 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:23.070 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.401707+0000", 2024-09-12T22:33:23.070 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:23.070 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.070 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.070 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:23.070 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.401707+0000", 2024-09-12T22:33:23.070 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:23.070 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.070 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.070 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:23.070 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.401707+0000", 2024-09-12T22:33:23.071 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7700000000000004e-07 2024-09-12T22:33:23.071 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.071 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.071 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:23.071 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.401713+0000", 2024-09-12T22:33:23.071 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6609999999999997e-06 2024-09-12T22:33:23.071 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.071 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.071 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:23.071 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.401726+0000", 2024-09-12T22:33:23.071 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.3088000000000001e-05 2024-09-12T22:33:23.071 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.071 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.071 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:23.072 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.401741+0000", 2024-09-12T22:33:23.072 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.5424e-05 2024-09-12T22:33:23.072 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.072 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.072 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:23.072 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.458853+0000", 2024-09-12T22:33:23.072 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.057111157000000003 2024-09-12T22:33:23.072 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.072 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.072 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:23.072 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.458898+0000", 2024-09-12T22:33:23.072 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5633999999999997e-05 2024-09-12T22:33:23.072 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.073 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.073 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:23.073 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.458972+0000", 2024-09-12T22:33:23.073 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3441000000000004e-05 2024-09-12T22:33:23.073 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.073 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.073 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:23.073 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.461426+0000", 2024-09-12T22:33:23.073 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0024542660000000001 2024-09-12T22:33:23.073 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.073 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.073 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:23.073 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476985+0000", 2024-09-12T22:33:23.074 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.015559513000000001 2024-09-12T22:33:23.074 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.074 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.074 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:23.074 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.477044+0000", 2024-09-12T22:33:23.074 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8156999999999999e-05 2024-09-12T22:33:23.074 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.074 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.074 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:23.074 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.477093+0000", 2024-09-12T22:33:23.074 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9607999999999997e-05 2024-09-12T22:33:23.074 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:23.074 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:23.074 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:23.075 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.075 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.075 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1213 3.13 3:cb3d3880:::200.0000000d:head [write 1028809~6329 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:23.075 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.403250+0000", 2024-09-12T22:33:23.075 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 8.6024327399999994, 2024-09-12T22:33:23.075 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.073936215999999999, 2024-09-12T22:33:23.075 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:23.075 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:23.075 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:23.075 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:23.075 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.075 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:23.075 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403250+0000", 2024-09-12T22:33:23.075 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:23.076 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.076 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.076 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:23.076 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403250+0000", 2024-09-12T22:33:23.076 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:23.076 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.076 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.076 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:23.076 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403251+0000", 2024-09-12T22:33:23.076 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.37e-07 2024-09-12T22:33:23.076 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.076 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.076 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:23.077 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403258+0000", 2024-09-12T22:33:23.077 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.25e-06 2024-09-12T22:33:23.077 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.077 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.077 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:23.077 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403269+0000", 2024-09-12T22:33:23.077 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0509000000000001e-05 2024-09-12T22:33:23.077 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.077 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.077 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:23.077 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403274+0000", 2024-09-12T22:33:23.077 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1290000000000004e-06 2024-09-12T22:33:23.077 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.077 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.078 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:23.078 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.459796+0000", 2024-09-12T22:33:23.078 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.056522020999999999 2024-09-12T22:33:23.078 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.078 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.078 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:23.078 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.459845+0000", 2024-09-12T22:33:23.078 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8884999999999997e-05 2024-09-12T22:33:23.078 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.078 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.078 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:23.078 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.459920+0000", 2024-09-12T22:33:23.078 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5318e-05 2024-09-12T22:33:23.079 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.079 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.079 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:23.079 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.466542+0000", 2024-09-12T22:33:23.079 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0066223139999999998 2024-09-12T22:33:23.079 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.079 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.079 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:23.079 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.477137+0000", 2024-09-12T22:33:23.079 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010594717 2024-09-12T22:33:23.079 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.079 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.079 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:23.080 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.477165+0000", 2024-09-12T22:33:23.080 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8262000000000001e-05 2024-09-12T22:33:23.080 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.080 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.080 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:23.080 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.477186+0000", 2024-09-12T22:33:23.080 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1073999999999998e-05 2024-09-12T22:33:23.080 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:23.080 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:23.080 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:23.080 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.080 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.080 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1214 3.13 3:cb3d3880:::200.0000000d:head [write 1035138~2606 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:23.080 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.403674+0000", 2024-09-12T22:33:23.081 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 8.60200882, 2024-09-12T22:33:23.081 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.073643204000000004, 2024-09-12T22:33:23.081 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:23.081 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:23.081 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:23.081 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:23.081 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.081 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:23.081 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403674+0000", 2024-09-12T22:33:23.081 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:23.081 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.081 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.081 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:23.082 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403674+0000", 2024-09-12T22:33:23.082 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:23.082 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.082 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.082 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:23.082 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403674+0000", 2024-09-12T22:33:23.082 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.7700000000000005e-07 2024-09-12T22:33:23.082 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.082 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.082 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:23.082 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403678+0000", 2024-09-12T22:33:23.082 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2009999999999999e-06 2024-09-12T22:33:23.082 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.082 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.083 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:23.083 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403686+0000", 2024-09-12T22:33:23.083 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5690000000000005e-06 2024-09-12T22:33:23.083 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.083 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.083 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:23.083 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403690+0000", 2024-09-12T22:33:23.083 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.233e-06 2024-09-12T22:33:23.083 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.083 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.083 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:23.083 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.460445+0000", 2024-09-12T22:33:23.083 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.056754412999999997 2024-09-12T22:33:23.083 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.084 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.084 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:23.084 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.460495+0000", 2024-09-12T22:33:23.084 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0238999999999998e-05 2024-09-12T22:33:23.084 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.084 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.084 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:23.084 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.460566+0000", 2024-09-12T22:33:23.084 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1159000000000001e-05 2024-09-12T22:33:23.084 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.084 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.084 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:23.084 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.466546+0000", 2024-09-12T22:33:23.085 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0059798910000000002 2024-09-12T22:33:23.085 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.085 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.085 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:23.085 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.477232+0000", 2024-09-12T22:33:23.085 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010686084 2024-09-12T22:33:23.085 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.085 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.085 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:23.085 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.477280+0000", 2024-09-12T22:33:23.085 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.7719999999999997e-05 2024-09-12T22:33:23.085 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.085 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.085 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:23.086 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.477317+0000", 2024-09-12T22:33:23.086 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7218000000000002e-05 2024-09-12T22:33:23.086 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:23.086 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:23.086 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:23.086 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.086 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.086 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1223 3.13 3:cb3d3880:::200.0000000d:head [write 1090497~1913 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:23.086 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.420111+0000", 2024-09-12T22:33:23.086 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 8.585571668, 2024-09-12T22:33:23.086 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.071634583000000002, 2024-09-12T22:33:23.086 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:23.086 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:23.086 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:23.087 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:23.087 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.087 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:23.087 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.420111+0000", 2024-09-12T22:33:23.087 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:23.087 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.087 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.087 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:23.087 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.420111+0000", 2024-09-12T22:33:23.087 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:23.087 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.087 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.087 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:23.088 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.420112+0000", 2024-09-12T22:33:23.088 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.2900000000000002e-07 2024-09-12T22:33:23.088 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.088 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.088 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:23.088 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.420116+0000", 2024-09-12T22:33:23.088 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.67e-06 2024-09-12T22:33:23.088 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.088 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.088 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:23.088 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.420125+0000", 2024-09-12T22:33:23.088 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.0890000000000006e-06 2024-09-12T22:33:23.088 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.088 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.089 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:23.089 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.420131+0000", 2024-09-12T22:33:23.089 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4269999999999996e-06 2024-09-12T22:33:23.089 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.089 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.089 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:23.089 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.465358+0000", 2024-09-12T22:33:23.089 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.045227030000000001 2024-09-12T22:33:23.089 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.089 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.089 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:23.089 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.465439+0000", 2024-09-12T22:33:23.089 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0901000000000004e-05 2024-09-12T22:33:23.089 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.090 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.090 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:23.090 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.465571+0000", 2024-09-12T22:33:23.090 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000131705 2024-09-12T22:33:23.090 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.090 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.090 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:23.090 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.469496+0000", 2024-09-12T22:33:23.090 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.003925418 2024-09-12T22:33:23.090 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.090 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.090 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:23.090 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.491669+0000", 2024-09-12T22:33:23.090 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.022172335000000001 2024-09-12T22:33:23.091 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.091 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.091 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:23.091 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.491714+0000", 2024-09-12T22:33:23.091 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5417000000000002e-05 2024-09-12T22:33:23.091 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.091 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.091 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:23.091 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.491746+0000", 2024-09-12T22:33:23.091 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1662000000000003e-05 2024-09-12T22:33:23.091 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:23.091 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:23.091 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:23.091 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.092 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.092 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1225 3.13 3:cb3d3880:::200.0000000d:head [write 1097316~1932 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:23.092 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.421303+0000", 2024-09-12T22:33:23.092 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 8.5843798329999998, 2024-09-12T22:33:23.092 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.074934770999999997, 2024-09-12T22:33:23.092 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:23.092 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:23.092 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:23.092 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:23.092 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.092 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:23.092 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.421303+0000", 2024-09-12T22:33:23.092 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:23.093 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.093 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.093 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:23.093 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.421303+0000", 2024-09-12T22:33:23.093 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:23.093 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.093 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.093 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:23.093 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.421303+0000", 2024-09-12T22:33:23.093 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8599999999999998e-07 2024-09-12T22:33:23.093 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.093 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.093 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:23.093 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.421307+0000", 2024-09-12T22:33:23.094 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0879999999999999e-06 2024-09-12T22:33:23.094 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.094 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.094 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:23.094 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.421314+0000", 2024-09-12T22:33:23.094 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1010000000000003e-06 2024-09-12T22:33:23.094 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.094 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.094 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:23.094 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.421319+0000", 2024-09-12T22:33:23.094 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7209999999999999e-06 2024-09-12T22:33:23.094 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.094 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.095 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:23.095 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.466620+0000", 2024-09-12T22:33:23.095 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.045301044999999998 2024-09-12T22:33:23.095 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.095 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.095 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:23.095 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.466703+0000", 2024-09-12T22:33:23.095 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3011999999999997e-05 2024-09-12T22:33:23.095 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.095 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.095 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:23.095 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.466826+0000", 2024-09-12T22:33:23.095 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000122824 2024-09-12T22:33:23.095 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.096 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.096 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:23.096 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.472359+0000", 2024-09-12T22:33:23.096 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0055323009999999999 2024-09-12T22:33:23.096 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.096 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.096 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:23.096 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496142+0000", 2024-09-12T22:33:23.096 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.023783696999999999 2024-09-12T22:33:23.096 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.096 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.096 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:23.096 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496194+0000", 2024-09-12T22:33:23.096 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1350000000000001e-05 2024-09-12T22:33:23.097 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.097 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.097 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:23.097 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496238+0000", 2024-09-12T22:33:23.097 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4146000000000001e-05 2024-09-12T22:33:23.097 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:23.097 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:23.097 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:23.097 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.097 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.097 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1226 3.13 3:cb3d3880:::200.0000000d:head [write 1099248~1973 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:23.097 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.422971+0000", 2024-09-12T22:33:23.097 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 8.5827122350000007, 2024-09-12T22:33:23.098 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.073363063000000006, 2024-09-12T22:33:23.098 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:23.098 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:23.098 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:23.098 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:23.098 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.098 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:23.098 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.422971+0000", 2024-09-12T22:33:23.098 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:23.098 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.098 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.098 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:23.098 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.422971+0000", 2024-09-12T22:33:23.098 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:23.099 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.099 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.099 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:23.099 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.422971+0000", 2024-09-12T22:33:23.099 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.1699999999999997e-07 2024-09-12T22:33:23.099 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.099 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.099 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:23.099 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.422975+0000", 2024-09-12T22:33:23.099 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2650000000000001e-06 2024-09-12T22:33:23.099 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.099 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.099 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:23.099 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.422981+0000", 2024-09-12T22:33:23.100 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7379999999999997e-06 2024-09-12T22:33:23.100 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.100 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.100 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:23.100 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.422986+0000", 2024-09-12T22:33:23.100 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5220000000000001e-06 2024-09-12T22:33:23.100 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.100 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.100 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:23.100 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.467340+0000", 2024-09-12T22:33:23.100 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.044353985999999998 2024-09-12T22:33:23.100 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.100 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.100 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:23.101 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.467412+0000", 2024-09-12T22:33:23.101 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1982000000000003e-05 2024-09-12T22:33:23.101 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.101 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.101 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:23.101 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.467493+0000", 2024-09-12T22:33:23.101 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0829999999999997e-05 2024-09-12T22:33:23.101 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.101 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.101 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:23.101 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.472364+0000", 2024-09-12T22:33:23.101 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0048713189999999998 2024-09-12T22:33:23.101 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.102 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.102 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:23.102 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496271+0000", 2024-09-12T22:33:23.102 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.023906808000000002 2024-09-12T22:33:23.102 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.102 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.102 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:23.102 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496300+0000", 2024-09-12T22:33:23.102 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9315e-05 2024-09-12T22:33:23.102 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.102 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.102 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:23.102 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496334+0000", 2024-09-12T22:33:23.102 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3481e-05 2024-09-12T22:33:23.103 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:23.103 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:23.103 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:23.103 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.103 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.103 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1227 3.13 3:cb3d3880:::200.0000000d:head [write 1101221~1922 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:23.103 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.423028+0000", 2024-09-12T22:33:23.103 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 8.5826552510000003, 2024-09-12T22:33:23.103 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.073444802000000003, 2024-09-12T22:33:23.103 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:23.103 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:23.103 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:23.103 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:23.103 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.104 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:23.104 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423028+0000", 2024-09-12T22:33:23.104 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:23.104 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.104 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.104 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:23.104 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423028+0000", 2024-09-12T22:33:23.104 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:23.104 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.104 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.104 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:23.104 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423028+0000", 2024-09-12T22:33:23.104 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1699999999999998e-07 2024-09-12T22:33:23.104 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.105 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.105 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:23.105 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423031+0000", 2024-09-12T22:33:23.105 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8499999999999998e-06 2024-09-12T22:33:23.105 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.105 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.105 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:23.105 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423036+0000", 2024-09-12T22:33:23.105 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9479999999999999e-06 2024-09-12T22:33:23.105 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.105 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.105 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:23.105 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423039+0000", 2024-09-12T22:33:23.105 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4929999999999998e-06 2024-09-12T22:33:23.106 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.106 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.106 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:23.106 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.467785+0000", 2024-09-12T22:33:23.106 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.044745957000000003 2024-09-12T22:33:23.106 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.106 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.106 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:23.106 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.467838+0000", 2024-09-12T22:33:23.106 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2596999999999998e-05 2024-09-12T22:33:23.106 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.106 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.106 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:23.106 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.467915+0000", 2024-09-12T22:33:23.107 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6744999999999998e-05 2024-09-12T22:33:23.107 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.107 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.107 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:23.107 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.472368+0000", 2024-09-12T22:33:23.107 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0044534730000000003 2024-09-12T22:33:23.107 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.107 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.107 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:23.107 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496382+0000", 2024-09-12T22:33:23.107 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.024014111000000001 2024-09-12T22:33:23.107 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.107 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.108 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:23.108 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496443+0000", 2024-09-12T22:33:23.108 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.0547000000000002e-05 2024-09-12T22:33:23.108 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.108 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.108 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:23.108 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496472+0000", 2024-09-12T22:33:23.108 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9564e-05 2024-09-12T22:33:23.108 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:23.108 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:23.108 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:23.108 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.108 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.108 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1228 3.13 3:cb3d3880:::200.0000000d:head [write 1103143~2423 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:23.109 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.423305+0000", 2024-09-12T22:33:23.109 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 8.5823778869999998, 2024-09-12T22:33:23.109 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.073251160999999995, 2024-09-12T22:33:23.109 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:23.109 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:23.109 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:23.109 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:23.109 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.109 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:23.109 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423305+0000", 2024-09-12T22:33:23.109 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:23.109 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.109 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.110 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:23.110 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423305+0000", 2024-09-12T22:33:23.110 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:23.110 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.110 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.110 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:23.110 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423306+0000", 2024-09-12T22:33:23.110 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4899999999999995e-07 2024-09-12T22:33:23.110 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.110 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.110 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:23.110 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423311+0000", 2024-09-12T22:33:23.110 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7459999999999997e-06 2024-09-12T22:33:23.110 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.111 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.111 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:23.111 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423316+0000", 2024-09-12T22:33:23.111 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0239999999999997e-06 2024-09-12T22:33:23.111 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.111 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.111 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:23.111 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423320+0000", 2024-09-12T22:33:23.111 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.67e-06 2024-09-12T22:33:23.111 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.111 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.111 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:23.111 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.468252+0000", 2024-09-12T22:33:23.111 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.044932262000000001 2024-09-12T22:33:23.112 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.112 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.112 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:23.112 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.468293+0000", 2024-09-12T22:33:23.112 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0368999999999999e-05 2024-09-12T22:33:23.112 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.112 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.112 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:23.112 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.468357+0000", 2024-09-12T22:33:23.112 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4287000000000003e-05 2024-09-12T22:33:23.112 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.112 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.112 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:23.113 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.472371+0000", 2024-09-12T22:33:23.113 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0040144350000000002 2024-09-12T22:33:23.113 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.113 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.113 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:23.113 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496507+0000", 2024-09-12T22:33:23.113 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.024135961000000001 2024-09-12T22:33:23.113 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.113 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.113 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:23.113 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496537+0000", 2024-09-12T22:33:23.113 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9611000000000002e-05 2024-09-12T22:33:23.113 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.113 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.114 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:23.114 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496556+0000", 2024-09-12T22:33:23.114 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9147000000000002e-05 2024-09-12T22:33:23.114 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:23.114 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:23.114 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:23.114 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.114 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.114 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1229 3.13 3:cb3d3880:::200.0000000d:head [write 1105566~1911 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:23.114 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.423606+0000", 2024-09-12T22:33:23.114 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 8.5820768760000004, 2024-09-12T22:33:23.114 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.073027876000000005, 2024-09-12T22:33:23.114 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:23.114 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:23.115 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:23.115 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:23.115 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.115 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:23.115 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423606+0000", 2024-09-12T22:33:23.115 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:23.115 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.115 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.115 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:23.115 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423606+0000", 2024-09-12T22:33:23.115 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:23.115 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.115 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.115 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:23.116 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423606+0000", 2024-09-12T22:33:23.116 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.7e-07 2024-09-12T22:33:23.116 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.116 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.116 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:23.116 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423609+0000", 2024-09-12T22:33:23.116 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5339999999999998e-06 2024-09-12T22:33:23.116 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.116 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.116 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:23.116 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423614+0000", 2024-09-12T22:33:23.116 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.69e-06 2024-09-12T22:33:23.116 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.116 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.117 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:23.117 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423617+0000", 2024-09-12T22:33:23.117 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4300000000000002e-06 2024-09-12T22:33:23.117 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.117 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.117 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:23.117 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.468606+0000", 2024-09-12T22:33:23.117 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.044988606 2024-09-12T22:33:23.117 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.117 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.117 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:23.117 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.468649+0000", 2024-09-12T22:33:23.117 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3414000000000001e-05 2024-09-12T22:33:23.117 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.118 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.118 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:23.118 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.468714+0000", 2024-09-12T22:33:23.118 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4857000000000006e-05 2024-09-12T22:33:23.118 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.118 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.118 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:23.118 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.472375+0000", 2024-09-12T22:33:23.118 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0036607330000000002 2024-09-12T22:33:23.118 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.118 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.118 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:23.118 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496585+0000", 2024-09-12T22:33:23.118 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.024210835 2024-09-12T22:33:23.119 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.119 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.119 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:23.119 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496612+0000", 2024-09-12T22:33:23.119 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6999999999999999e-05 2024-09-12T22:33:23.119 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.119 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.119 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:23.119 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496634+0000", 2024-09-12T22:33:23.119 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1307000000000001e-05 2024-09-12T22:33:23.119 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:23.119 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:23.119 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:23.119 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.120 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.120 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1230 3.13 3:cb3d3880:::200.0000000d:head [write 1107477~6537 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:23.120 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.423911+0000", 2024-09-12T22:33:23.120 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 8.5817720309999999, 2024-09-12T22:33:23.120 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.072794530999999996, 2024-09-12T22:33:23.120 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:23.120 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:23.120 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:23.120 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:23.120 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.120 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:23.120 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423911+0000", 2024-09-12T22:33:23.120 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:23.121 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.121 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.121 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:23.121 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423911+0000", 2024-09-12T22:33:23.121 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:23.121 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.121 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.121 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:23.121 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423911+0000", 2024-09-12T22:33:23.121 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3799999999999998e-07 2024-09-12T22:33:23.121 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.121 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.121 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:23.121 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423919+0000", 2024-09-12T22:33:23.122 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.8329999999999994e-06 2024-09-12T22:33:23.122 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.122 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.122 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:23.122 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423924+0000", 2024-09-12T22:33:23.122 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3449999999999996e-06 2024-09-12T22:33:23.122 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.122 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.122 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:23.122 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423928+0000", 2024-09-12T22:33:23.122 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2339999999999999e-06 2024-09-12T22:33:23.122 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.122 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.122 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:23.123 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.469042+0000", 2024-09-12T22:33:23.123 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.045114888999999998 2024-09-12T22:33:23.123 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.123 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.123 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:23.123 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.469092+0000", 2024-09-12T22:33:23.123 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9289000000000002e-05 2024-09-12T22:33:23.123 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.123 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.123 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:23.123 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.469163+0000", 2024-09-12T22:33:23.123 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1222000000000004e-05 2024-09-12T22:33:23.123 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.124 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.124 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:23.124 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.472379+0000", 2024-09-12T22:33:23.124 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0032156419999999999 2024-09-12T22:33:23.124 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.124 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.124 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:23.124 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496661+0000", 2024-09-12T22:33:23.124 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.024281857 2024-09-12T22:33:23.124 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.124 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.124 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:23.124 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496687+0000", 2024-09-12T22:33:23.124 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6551e-05 2024-09-12T22:33:23.125 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:23.125 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:23.125 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:23.125 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496705+0000", 2024-09-12T22:33:23.125 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.8230999999999999e-05 2024-09-12T22:33:23.125 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:23.125 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:23.125 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:23.125 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:23.125 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:23.125 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-09-12T22:33:23.127 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:23.125+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:23.127 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:33:23.228 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:23.226+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:23.234 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:33:23.234 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:33:23.234 INFO:teuthology.orchestra.run.smithi148.stdout: "num_ops": 0 2024-09-12T22:33:23.235 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:33:23.244 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:33:23.328 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:23.327+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:23.347 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:33:23.347 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:33:23.347 INFO:teuthology.orchestra.run.smithi148.stdout: "complaint_time": 30, 2024-09-12T22:33:23.348 INFO:teuthology.orchestra.run.smithi148.stdout: "num_blocked_ops": 0 2024-09-12T22:33:23.348 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:33:23.356 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:33:23.430 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:23.428+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:23.502 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:33:23.502 INFO:teuthology.orchestra.run.smithi148.stdout: "size": 20, 2024-09-12T22:33:23.502 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 600, 2024-09-12T22:33:23.502 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [ 2024-09-12T22:33:23.502 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.502 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4490.0:9866 4.b 4:d370243b:::10000002d48.00000000:head [write 0~1308] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:33:23.502 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:09.467883+0000", 2024-09-12T22:33:23.502 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 14.032203728000001, 2024-09-12T22:33:23.503 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.085024817000000003, 2024-09-12T22:33:23.503 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:23.503 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:23.503 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:23.503 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:33:23.503 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4490", 2024-09-12T22:33:23.503 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:23.503 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 9866 2024-09-12T22:33:23.503 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.503 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:23.503 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.503 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:23.503 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.467883+0000", 2024-09-12T22:33:23.504 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:23.504 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.504 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.504 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:23.504 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.467883+0000", 2024-09-12T22:33:23.504 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:23.504 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.504 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.504 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:23.504 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.467884+0000", 2024-09-12T22:33:23.504 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1800000000000005e-07 2024-09-12T22:33:23.504 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.504 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.505 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:23.505 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.467888+0000", 2024-09-12T22:33:23.505 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5959999999999997e-06 2024-09-12T22:33:23.505 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.505 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.505 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:23.505 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.467896+0000", 2024-09-12T22:33:23.505 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.8679999999999999e-06 2024-09-12T22:33:23.505 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.505 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.505 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:23.505 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.467901+0000", 2024-09-12T22:33:23.506 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9169999999999997e-06 2024-09-12T22:33:23.506 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.506 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.506 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:23.506 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.467944+0000", 2024-09-12T22:33:23.506 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3055e-05 2024-09-12T22:33:23.506 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.506 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.506 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:23.506 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.468011+0000", 2024-09-12T22:33:23.506 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7328000000000003e-05 2024-09-12T22:33:23.506 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.506 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.507 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:23.507 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.468078+0000", 2024-09-12T22:33:23.507 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7063999999999994e-05 2024-09-12T22:33:23.507 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.507 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.507 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:23.507 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.551406+0000", 2024-09-12T22:33:23.507 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.083327485000000007 2024-09-12T22:33:23.507 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.508 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.508 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:23.508 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.552822+0000", 2024-09-12T22:33:23.508 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001415929 2024-09-12T22:33:23.508 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.508 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.508 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:23.508 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.552863+0000", 2024-09-12T22:33:23.508 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0809000000000002e-05 2024-09-12T22:33:23.508 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.508 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.508 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:23.508 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.552908+0000", 2024-09-12T22:33:23.509 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5048e-05 2024-09-12T22:33:23.509 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:23.509 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:23.509 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:23.509 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.509 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.509 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4490.0:9867 4.16 4:6bd8f1b8:::10000002d49.00000000:head [write 0~1599] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:33:23.509 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:09.468760+0000", 2024-09-12T22:33:23.509 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 14.031326719000001, 2024-09-12T22:33:23.509 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.086660499000000002, 2024-09-12T22:33:23.509 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:23.510 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:23.510 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:23.510 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:33:23.510 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4490", 2024-09-12T22:33:23.510 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:23.510 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 9867 2024-09-12T22:33:23.510 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.510 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:23.510 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.510 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:23.510 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.468760+0000", 2024-09-12T22:33:23.510 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:23.510 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.511 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.511 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:23.511 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.468760+0000", 2024-09-12T22:33:23.511 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:23.511 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.511 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.511 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:23.511 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.468761+0000", 2024-09-12T22:33:23.511 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4399999999999999e-07 2024-09-12T22:33:23.511 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.511 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.511 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:23.511 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.468765+0000", 2024-09-12T22:33:23.511 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3259999999999997e-06 2024-09-12T22:33:23.512 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.512 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.512 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:23.512 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.548969+0000", 2024-09-12T22:33:23.512 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.080204172000000004 2024-09-12T22:33:23.512 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.512 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.512 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:23.512 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.549001+0000", 2024-09-12T22:33:23.512 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.1464999999999998e-05 2024-09-12T22:33:23.512 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.512 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.513 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:23.513 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.549148+0000", 2024-09-12T22:33:23.513 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014749399999999999 2024-09-12T22:33:23.513 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.513 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.513 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:23.513 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.549379+0000", 2024-09-12T22:33:23.513 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000231091 2024-09-12T22:33:23.513 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.513 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.513 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:23.513 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.549518+0000", 2024-09-12T22:33:23.513 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013844899999999999 2024-09-12T22:33:23.513 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.514 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.514 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:23.514 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.552236+0000", 2024-09-12T22:33:23.514 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0027179869999999998 2024-09-12T22:33:23.514 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.514 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.514 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:23.514 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.555333+0000", 2024-09-12T22:33:23.514 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0030973559999999999 2024-09-12T22:33:23.514 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.514 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.514 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:23.514 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.555379+0000", 2024-09-12T22:33:23.515 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6236999999999998e-05 2024-09-12T22:33:23.515 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.515 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.515 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:23.515 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.555420+0000", 2024-09-12T22:33:23.515 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1177999999999998e-05 2024-09-12T22:33:23.515 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:23.515 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:23.515 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:23.515 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.515 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.515 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop_reply(client.4490.0:9866 4.b e53/18 ondisk, result = 0)", 2024-09-12T22:33:23.516 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:09.468826+0000", 2024-09-12T22:33:23.516 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 14.031260423999999, 2024-09-12T22:33:23.516 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.082588348000000006, 2024-09-12T22:33:23.516 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:23.516 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:23.516 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:33:23.516 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:23.516 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.516 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:23.516 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.468826+0000", 2024-09-12T22:33:23.516 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:23.517 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.517 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.517 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:23.517 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.468826+0000", 2024-09-12T22:33:23.517 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:23.517 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.517 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.517 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:23.517 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.468827+0000", 2024-09-12T22:33:23.517 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3399999999999999e-07 2024-09-12T22:33:23.517 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.517 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.517 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:23.518 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.468830+0000", 2024-09-12T22:33:23.518 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.1559999999999999e-06 2024-09-12T22:33:23.518 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.518 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.518 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:23.518 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.548957+0000", 2024-09-12T22:33:23.518 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.080126852999999998 2024-09-12T22:33:23.518 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.518 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.518 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:23.519 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.548989+0000", 2024-09-12T22:33:23.519 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2409000000000001e-05 2024-09-12T22:33:23.519 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.519 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.519 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:23.519 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.551065+0000", 2024-09-12T22:33:23.519 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.002075871 2024-09-12T22:33:23.519 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.519 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.519 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:23.519 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.551398+0000", 2024-09-12T22:33:23.520 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00033339099999999999 2024-09-12T22:33:23.520 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.520 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.520 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:23.520 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.551414+0000", 2024-09-12T22:33:23.520 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6133999999999998e-05 2024-09-12T22:33:23.520 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:23.520 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:23.520 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:23.520 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.520 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.520 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4490.0:10437 4.2f 4:f6cd553b:::10000002fce.00000000:head [write 0~27313] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:33:23.520 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:10.050890+0000", 2024-09-12T22:33:23.521 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 13.449196027999999, 2024-09-12T22:33:23.521 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.056482601, 2024-09-12T22:33:23.521 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:23.521 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:23.521 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:23.521 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:33:23.521 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4490", 2024-09-12T22:33:23.521 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:23.522 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 10437 2024-09-12T22:33:23.522 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.522 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:23.522 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.522 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:23.522 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.050890+0000", 2024-09-12T22:33:23.522 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:23.522 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.522 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.522 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:23.522 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.050890+0000", 2024-09-12T22:33:23.523 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:23.523 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.523 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.523 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:23.523 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.050891+0000", 2024-09-12T22:33:23.523 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.6600000000000005e-07 2024-09-12T22:33:23.523 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.523 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.523 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:23.523 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.050906+0000", 2024-09-12T22:33:23.524 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4521e-05 2024-09-12T22:33:23.524 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.524 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.524 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:23.524 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.050915+0000", 2024-09-12T22:33:23.524 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.2569999999999996e-06 2024-09-12T22:33:23.524 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.524 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.524 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:23.524 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.050920+0000", 2024-09-12T22:33:23.524 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.724e-06 2024-09-12T22:33:23.524 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.524 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.525 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:23.525 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.050960+0000", 2024-09-12T22:33:23.525 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9999000000000001e-05 2024-09-12T22:33:23.525 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.525 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.525 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:23.525 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.051031+0000", 2024-09-12T22:33:23.525 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1007000000000006e-05 2024-09-12T22:33:23.525 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.526 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.526 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:23.526 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.107249+0000", 2024-09-12T22:33:23.526 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.056218432999999998 2024-09-12T22:33:23.526 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.526 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.526 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:23.526 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.107301+0000", 2024-09-12T22:33:23.526 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1289000000000003e-05 2024-09-12T22:33:23.526 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.526 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.527 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:23.527 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.107373+0000", 2024-09-12T22:33:23.527 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.2504999999999998e-05 2024-09-12T22:33:23.527 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:23.527 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:23.527 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:23.527 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.528 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.528 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4490.0:10439 4.12 4:483953cb:::10000002fd0.00000000:head [write 0~4842] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:33:23.528 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:10.052567+0000", 2024-09-12T22:33:23.528 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 13.44751982, 2024-09-12T22:33:23.528 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.055835449000000002, 2024-09-12T22:33:23.528 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:23.528 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:23.528 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:23.528 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:33:23.528 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4490", 2024-09-12T22:33:23.528 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:23.528 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 10439 2024-09-12T22:33:23.529 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.529 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:23.529 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.529 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:23.529 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.052567+0000", 2024-09-12T22:33:23.529 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:23.529 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.529 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.529 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:23.529 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.052567+0000", 2024-09-12T22:33:23.529 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:23.529 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.529 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.530 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:23.530 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.052568+0000", 2024-09-12T22:33:23.530 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.3600000000000002e-07 2024-09-12T22:33:23.530 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.530 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.530 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:23.530 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.052591+0000", 2024-09-12T22:33:23.530 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.3110000000000001e-05 2024-09-12T22:33:23.530 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.530 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.530 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:23.530 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.106740+0000", 2024-09-12T22:33:23.530 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.054149315000000003 2024-09-12T22:33:23.531 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.531 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.531 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:23.531 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.106751+0000", 2024-09-12T22:33:23.531 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1056000000000001e-05 2024-09-12T22:33:23.531 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.531 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.531 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:23.531 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.106811+0000", 2024-09-12T22:33:23.532 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9515999999999997e-05 2024-09-12T22:33:23.532 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.532 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.532 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:23.532 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.106929+0000", 2024-09-12T22:33:23.532 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00011879000000000001 2024-09-12T22:33:23.533 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.533 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.533 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:23.533 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.108283+0000", 2024-09-12T22:33:23.533 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001354177 2024-09-12T22:33:23.533 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.533 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.534 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:23.534 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.108328+0000", 2024-09-12T22:33:23.534 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4931000000000001e-05 2024-09-12T22:33:23.534 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.534 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.534 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:23.534 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.108402+0000", 2024-09-12T22:33:23.534 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3718000000000001e-05 2024-09-12T22:33:23.534 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:23.534 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:23.534 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:23.535 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.535 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.535 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(client.4490.0:10445 4.3c e53/18 4:3d97251e:::10000002fd8.00000000:head v 53'154, mlcod=53'152)", 2024-09-12T22:33:23.535 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:10.058521+0000", 2024-09-12T22:33:23.535 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 13.44156548, 2024-09-12T22:33:23.535 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.049310138000000003, 2024-09-12T22:33:23.535 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:23.535 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:23.535 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:23.535 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:23.535 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.535 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:23.535 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.058521+0000", 2024-09-12T22:33:23.535 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:23.536 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.536 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.536 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:23.536 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.058521+0000", 2024-09-12T22:33:23.536 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:23.536 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.536 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.536 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:23.536 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.058522+0000", 2024-09-12T22:33:23.536 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.1099999999999995e-07 2024-09-12T22:33:23.536 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.536 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.537 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:23.537 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.058530+0000", 2024-09-12T22:33:23.537 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.7290000000000006e-06 2024-09-12T22:33:23.537 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.537 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.537 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:23.537 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.106760+0000", 2024-09-12T22:33:23.537 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.048229384 2024-09-12T22:33:23.537 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.537 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.537 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:23.537 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.106770+0000", 2024-09-12T22:33:23.537 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0431999999999999e-05 2024-09-12T22:33:23.537 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.538 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.538 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:23.538 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.106823+0000", 2024-09-12T22:33:23.538 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2309999999999999e-05 2024-09-12T22:33:23.538 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.538 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.538 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:23.538 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.106841+0000", 2024-09-12T22:33:23.538 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.8218000000000001e-05 2024-09-12T22:33:23.538 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.538 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.538 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:23.538 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.107796+0000", 2024-09-12T22:33:23.539 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00095552600000000005 2024-09-12T22:33:23.539 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.539 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.539 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:23.539 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.107831+0000", 2024-09-12T22:33:23.539 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4928000000000002e-05 2024-09-12T22:33:23.539 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:23.539 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:23.539 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:23.539 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.539 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.539 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4490.0:11351 4.3f 4:fd498422:::10000003188.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-12T22:33:23.540 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:13.354715+0000", 2024-09-12T22:33:23.540 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 10.145371666000001, 2024-09-12T22:33:23.540 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.043059568999999999, 2024-09-12T22:33:23.540 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:23.540 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:23.540 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:23.540 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:33:23.540 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4490", 2024-09-12T22:33:23.540 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:23.540 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 11351 2024-09-12T22:33:23.540 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.540 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:23.540 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.541 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:23.541 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.354715+0000", 2024-09-12T22:33:23.541 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:23.541 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.541 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.541 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:23.541 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.354715+0000", 2024-09-12T22:33:23.541 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:23.541 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.541 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.541 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:23.541 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.354716+0000", 2024-09-12T22:33:23.541 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.7600000000000006e-07 2024-09-12T22:33:23.542 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.542 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.542 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:23.542 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.361477+0000", 2024-09-12T22:33:23.542 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0067607090000000002 2024-09-12T22:33:23.542 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.542 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.542 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:23.542 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.361487+0000", 2024-09-12T22:33:23.542 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0249e-05 2024-09-12T22:33:23.542 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.542 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.542 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:23.542 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.361493+0000", 2024-09-12T22:33:23.543 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.4699999999999999e-06 2024-09-12T22:33:23.543 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.543 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.543 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:23.543 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.361544+0000", 2024-09-12T22:33:23.543 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1124e-05 2024-09-12T22:33:23.543 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.543 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.543 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:23.543 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.361604+0000", 2024-09-12T22:33:23.543 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9397000000000001e-05 2024-09-12T22:33:23.543 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.543 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.543 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:23.544 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.397601+0000", 2024-09-12T22:33:23.544 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.035996927999999997 2024-09-12T22:33:23.544 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.544 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.544 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:23.544 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.397646+0000", 2024-09-12T22:33:23.544 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5176000000000003e-05 2024-09-12T22:33:23.544 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.544 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.544 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:23.544 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.397774+0000", 2024-09-12T22:33:23.544 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012854000000000001 2024-09-12T22:33:23.545 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:23.545 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:23.545 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:23.545 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.545 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.545 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4490.0:12798 4.3e 4:7eb070ca:::100000030e0.00000000:head [write 0~4194304 [5@1189789]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-12T22:33:23.545 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:15.140228+0000", 2024-09-12T22:33:23.545 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 8.3598590159999997, 2024-09-12T22:33:23.545 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.046073232999999998, 2024-09-12T22:33:23.545 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:23.545 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:23.545 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:23.545 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:33:23.545 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4490", 2024-09-12T22:33:23.546 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:23.546 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 12798 2024-09-12T22:33:23.546 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.546 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:23.546 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.546 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:23.546 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.140228+0000", 2024-09-12T22:33:23.546 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:23.546 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.546 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.546 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:23.547 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.140228+0000", 2024-09-12T22:33:23.547 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:23.547 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.547 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.547 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:23.547 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.140228+0000", 2024-09-12T22:33:23.547 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5899999999999996e-07 2024-09-12T22:33:23.547 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.547 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.547 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:23.547 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.147541+0000", 2024-09-12T22:33:23.547 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0073125339999999999 2024-09-12T22:33:23.547 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.548 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.548 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:23.548 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.147555+0000", 2024-09-12T22:33:23.548 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.42e-05 2024-09-12T22:33:23.548 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.548 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.548 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:23.548 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.147564+0000", 2024-09-12T22:33:23.548 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.0999999999999993e-06 2024-09-12T22:33:23.548 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.548 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.548 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:23.549 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.147637+0000", 2024-09-12T22:33:23.549 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3288999999999996e-05 2024-09-12T22:33:23.549 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.549 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.549 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:23.549 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.147725+0000", 2024-09-12T22:33:23.549 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.7622999999999998e-05 2024-09-12T22:33:23.549 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.549 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.549 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:23.549 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.186239+0000", 2024-09-12T22:33:23.549 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.038514171 2024-09-12T22:33:23.549 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.549 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.550 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:23.550 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.186265+0000", 2024-09-12T22:33:23.550 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5738e-05 2024-09-12T22:33:23.550 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.550 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.550 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:23.550 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.186301+0000", 2024-09-12T22:33:23.550 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.6019000000000002e-05 2024-09-12T22:33:23.550 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:23.550 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:23.550 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:23.550 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.550 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.550 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3063 3.2 3:42569fed:::200.00000011:head [write 3915305~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:33:23.551 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:19.386685+0000", 2024-09-12T22:33:23.551 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 4.1134017869999999, 2024-09-12T22:33:23.551 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.042365220000000002, 2024-09-12T22:33:23.551 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:23.551 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:23.551 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:23.551 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:23.551 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.551 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:23.551 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386685+0000", 2024-09-12T22:33:23.551 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:23.551 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.551 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.552 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:23.552 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386685+0000", 2024-09-12T22:33:23.552 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:23.552 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.552 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.552 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:23.552 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386685+0000", 2024-09-12T22:33:23.552 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.08e-07 2024-09-12T22:33:23.552 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.552 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.552 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:23.552 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386688+0000", 2024-09-12T22:33:23.552 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8880000000000001e-06 2024-09-12T22:33:23.553 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.553 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.553 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:23.553 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386694+0000", 2024-09-12T22:33:23.553 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8089999999999998e-06 2024-09-12T22:33:23.553 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.553 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.553 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:23.553 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386699+0000", 2024-09-12T22:33:23.553 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8010000000000003e-06 2024-09-12T22:33:23.553 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.553 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.553 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:23.554 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.427136+0000", 2024-09-12T22:33:23.554 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.04043712 2024-09-12T22:33:23.554 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.554 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.554 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:23.554 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.427185+0000", 2024-09-12T22:33:23.554 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9493999999999997e-05 2024-09-12T22:33:23.554 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.554 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.554 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:23.554 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.428988+0000", 2024-09-12T22:33:23.554 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001803191 2024-09-12T22:33:23.554 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.555 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.555 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:23.555 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.429015+0000", 2024-09-12T22:33:23.555 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.6438999999999999e-05 2024-09-12T22:33:23.555 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.555 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.555 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:23.555 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.429050+0000", 2024-09-12T22:33:23.555 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.5070000000000001e-05 2024-09-12T22:33:23.555 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:23.556 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:23.556 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:23.556 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.556 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.556 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3064 3.2 3:42569fed:::200.00000011:head [write 3916704~1398 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:33:23.556 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:19.386705+0000", 2024-09-12T22:33:23.556 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 4.1133820119999998, 2024-09-12T22:33:23.556 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.043238378000000001, 2024-09-12T22:33:23.556 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:23.556 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:23.556 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:23.557 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:23.557 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.557 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:23.557 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386705+0000", 2024-09-12T22:33:23.557 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:23.557 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.557 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.557 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:23.557 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386705+0000", 2024-09-12T22:33:23.557 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:23.557 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.558 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.558 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:23.558 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386705+0000", 2024-09-12T22:33:23.558 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.8299999999999998e-07 2024-09-12T22:33:23.558 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.558 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.558 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:23.558 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386711+0000", 2024-09-12T22:33:23.558 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7080000000000002e-06 2024-09-12T22:33:23.559 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.559 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.559 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:23.559 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386717+0000", 2024-09-12T22:33:23.559 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.3990000000000001e-06 2024-09-12T22:33:23.559 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.559 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.559 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:23.559 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386722+0000", 2024-09-12T22:33:23.559 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9219999999999996e-06 2024-09-12T22:33:23.559 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.559 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.559 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:23.560 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.427585+0000", 2024-09-12T22:33:23.560 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.040863414000000001 2024-09-12T22:33:23.560 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.560 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.560 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:23.560 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.427628+0000", 2024-09-12T22:33:23.560 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2873000000000001e-05 2024-09-12T22:33:23.560 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.560 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.560 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:23.560 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.429871+0000", 2024-09-12T22:33:23.561 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.002242572 2024-09-12T22:33:23.561 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.561 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.561 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:23.561 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.429901+0000", 2024-09-12T22:33:23.561 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0114e-05 2024-09-12T22:33:23.561 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.561 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.561 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:23.561 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.429943+0000", 2024-09-12T22:33:23.561 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1993000000000003e-05 2024-09-12T22:33:23.562 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:23.562 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:23.562 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:23.562 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.562 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.562 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3065 3.2 3:42569fed:::200.00000011:head [write 3918102~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:33:23.562 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:19.386735+0000", 2024-09-12T22:33:23.562 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 4.1133518049999998, 2024-09-12T22:33:23.562 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.043278369999999997, 2024-09-12T22:33:23.562 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:23.562 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:23.563 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:23.563 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:23.563 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.563 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:23.563 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386735+0000", 2024-09-12T22:33:23.563 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:23.563 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.563 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.563 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:23.563 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386735+0000", 2024-09-12T22:33:23.563 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:23.564 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.564 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.564 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:23.564 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386735+0000", 2024-09-12T22:33:23.564 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.7300000000000001e-07 2024-09-12T22:33:23.564 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.564 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.564 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:23.564 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386738+0000", 2024-09-12T22:33:23.564 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8420000000000001e-06 2024-09-12T22:33:23.564 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.565 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.565 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:23.565 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386744+0000", 2024-09-12T22:33:23.565 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.3040000000000001e-06 2024-09-12T22:33:23.565 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.565 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.565 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:23.565 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386749+0000", 2024-09-12T22:33:23.566 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8409999999999999e-06 2024-09-12T22:33:23.566 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.566 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.566 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:23.566 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.428112+0000", 2024-09-12T22:33:23.566 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.041363204000000001 2024-09-12T22:33:23.566 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.566 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.567 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:23.567 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.428158+0000", 2024-09-12T22:33:23.567 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5756e-05 2024-09-12T22:33:23.567 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.567 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.567 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:23.567 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.429950+0000", 2024-09-12T22:33:23.567 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0017922859999999999 2024-09-12T22:33:23.568 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.568 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.568 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:23.568 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.429975+0000", 2024-09-12T22:33:23.568 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4640000000000001e-05 2024-09-12T22:33:23.568 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.568 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.568 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:23.568 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.430013+0000", 2024-09-12T22:33:23.568 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.8024000000000001e-05 2024-09-12T22:33:23.569 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:23.569 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:23.569 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:23.569 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.569 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.569 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3066 3.2 3:42569fed:::200.00000011:head [write 3919501~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:33:23.569 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:19.386755+0000", 2024-09-12T22:33:23.569 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 4.1133311639999999, 2024-09-12T22:33:23.569 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.044668934, 2024-09-12T22:33:23.569 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:23.569 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:23.569 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:23.570 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:23.570 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.570 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:23.570 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386755+0000", 2024-09-12T22:33:23.570 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:23.570 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.570 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.570 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:23.570 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386755+0000", 2024-09-12T22:33:23.570 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:23.570 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.571 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.571 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:23.571 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386756+0000", 2024-09-12T22:33:23.571 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4499999999999997e-07 2024-09-12T22:33:23.571 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.571 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.571 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:23.571 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386763+0000", 2024-09-12T22:33:23.571 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.6459999999999993e-06 2024-09-12T22:33:23.571 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.571 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.571 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:23.571 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386770+0000", 2024-09-12T22:33:23.572 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.19e-06 2024-09-12T22:33:23.572 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.572 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.572 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:23.572 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386775+0000", 2024-09-12T22:33:23.572 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9640000000000002e-06 2024-09-12T22:33:23.572 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.572 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.572 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:23.572 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.428489+0000", 2024-09-12T22:33:23.572 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.041714539000000002 2024-09-12T22:33:23.572 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.572 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.572 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:23.573 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.428535+0000", 2024-09-12T22:33:23.573 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5658999999999998e-05 2024-09-12T22:33:23.573 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.573 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.573 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:23.573 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.431353+0000", 2024-09-12T22:33:23.573 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0028186270000000002 2024-09-12T22:33:23.573 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.573 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.573 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:23.573 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.431385+0000", 2024-09-12T22:33:23.573 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.1374000000000001e-05 2024-09-12T22:33:23.573 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.574 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.574 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:23.574 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.431424+0000", 2024-09-12T22:33:23.574 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9490000000000003e-05 2024-09-12T22:33:23.576 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:23.576 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:23.576 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:23.576 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.576 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.577 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3067 3.2 3:42569fed:::200.00000011:head [write 3920900~2245 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:33:23.577 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:19.386781+0000", 2024-09-12T22:33:23.577 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 4.1133052750000001, 2024-09-12T22:33:23.577 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.044711322999999997, 2024-09-12T22:33:23.577 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:23.577 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:23.577 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:23.577 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:23.577 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.577 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:23.577 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386781+0000", 2024-09-12T22:33:23.577 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:23.577 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.578 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.578 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:23.578 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386781+0000", 2024-09-12T22:33:23.578 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:23.578 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.578 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.578 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:23.578 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386782+0000", 2024-09-12T22:33:23.578 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9900000000000001e-07 2024-09-12T22:33:23.578 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.578 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.578 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:23.578 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386795+0000", 2024-09-12T22:33:23.578 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2864000000000001e-05 2024-09-12T22:33:23.579 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.579 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.579 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:23.579 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386801+0000", 2024-09-12T22:33:23.579 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.3589999999999996e-06 2024-09-12T22:33:23.579 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.579 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.579 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:23.579 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386805+0000", 2024-09-12T22:33:23.579 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6190000000000002e-06 2024-09-12T22:33:23.579 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.579 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.580 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:23.580 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.429080+0000", 2024-09-12T22:33:23.580 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.042274027999999998 2024-09-12T22:33:23.580 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.580 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.580 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:23.580 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.429131+0000", 2024-09-12T22:33:23.580 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1715000000000002e-05 2024-09-12T22:33:23.580 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.580 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.580 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:23.580 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.431432+0000", 2024-09-12T22:33:23.581 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0023007489999999999 2024-09-12T22:33:23.581 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.581 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.581 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:23.581 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.431458+0000", 2024-09-12T22:33:23.581 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.603e-05 2024-09-12T22:33:23.581 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.581 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.581 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:23.581 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.431493+0000", 2024-09-12T22:33:23.581 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4560000000000001e-05 2024-09-12T22:33:23.581 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:23.581 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:23.581 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:23.582 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.582 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.582 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3068 3.2 3:42569fed:::200.00000011:head [write 3923145~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:33:23.582 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:19.386812+0000", 2024-09-12T22:33:23.582 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 4.1132745159999997, 2024-09-12T22:33:23.582 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.045559559999999999, 2024-09-12T22:33:23.582 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:23.582 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:23.582 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:23.582 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:23.582 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.582 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:23.582 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386812+0000", 2024-09-12T22:33:23.583 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:23.583 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.583 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.583 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:23.583 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386812+0000", 2024-09-12T22:33:23.583 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:23.583 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.583 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.583 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:23.583 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386812+0000", 2024-09-12T22:33:23.583 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.01e-07 2024-09-12T22:33:23.583 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.583 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.584 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:23.584 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386823+0000", 2024-09-12T22:33:23.584 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1038e-05 2024-09-12T22:33:23.584 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.584 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.584 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:23.584 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386830+0000", 2024-09-12T22:33:23.584 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.5409999999999997e-06 2024-09-12T22:33:23.584 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.584 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.584 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:23.584 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386835+0000", 2024-09-12T22:33:23.584 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.091e-06 2024-09-12T22:33:23.585 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.585 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.585 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:23.585 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.429460+0000", 2024-09-12T22:33:23.585 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.042625333000000001 2024-09-12T22:33:23.585 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.585 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.585 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:23.585 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.429506+0000", 2024-09-12T22:33:23.585 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5299000000000001e-05 2024-09-12T22:33:23.585 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.585 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.586 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:23.586 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.432283+0000", 2024-09-12T22:33:23.586 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0027776799999999998 2024-09-12T22:33:23.586 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.586 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.586 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:23.586 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.432315+0000", 2024-09-12T22:33:23.586 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.1401e-05 2024-09-12T22:33:23.586 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.586 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.586 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:23.586 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.432372+0000", 2024-09-12T22:33:23.586 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.6776e-05 2024-09-12T22:33:23.587 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:23.587 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:23.587 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:23.587 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.587 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.587 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3069 3.2 3:42569fed:::200.00000011:head [write 3924544~2246 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:33:23.587 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:19.386842+0000", 2024-09-12T22:33:23.587 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 4.1132446160000002, 2024-09-12T22:33:23.587 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.045596166, 2024-09-12T22:33:23.587 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:23.587 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:23.587 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:23.587 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:23.587 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.588 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:23.588 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386842+0000", 2024-09-12T22:33:23.588 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:23.588 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.588 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.588 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:23.588 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386842+0000", 2024-09-12T22:33:23.588 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:23.588 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.588 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.588 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:23.588 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386842+0000", 2024-09-12T22:33:23.589 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5200000000000002e-07 2024-09-12T22:33:23.589 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.589 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.589 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:23.589 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386845+0000", 2024-09-12T22:33:23.589 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8820000000000001e-06 2024-09-12T22:33:23.589 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.589 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.589 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:23.589 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386851+0000", 2024-09-12T22:33:23.589 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9540000000000001e-06 2024-09-12T22:33:23.589 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.589 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.590 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:23.590 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386856+0000", 2024-09-12T22:33:23.590 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5159999999999996e-06 2024-09-12T22:33:23.590 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.590 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.590 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:23.590 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.430043+0000", 2024-09-12T22:33:23.590 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.043186930999999998 2024-09-12T22:33:23.590 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.590 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.590 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:23.590 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.430086+0000", 2024-09-12T22:33:23.591 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3844999999999998e-05 2024-09-12T22:33:23.591 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.591 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.591 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:23.591 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.432379+0000", 2024-09-12T22:33:23.591 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0022922049999999999 2024-09-12T22:33:23.591 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.591 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.591 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:23.591 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.432405+0000", 2024-09-12T22:33:23.591 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5877999999999999e-05 2024-09-12T22:33:23.591 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.592 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.592 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:23.592 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.432438+0000", 2024-09-12T22:33:23.592 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3503000000000001e-05 2024-09-12T22:33:23.592 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:23.592 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:23.592 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:23.592 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.592 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.592 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3070 3.2 3:42569fed:::200.00000011:head [write 3926790~2768 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:33:23.593 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:19.387280+0000", 2024-09-12T22:33:23.593 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 4.1128064479999997, 2024-09-12T22:33:23.593 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.04692201, 2024-09-12T22:33:23.593 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:23.593 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:23.593 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:23.593 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:23.593 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.593 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:23.593 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.387280+0000", 2024-09-12T22:33:23.593 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:23.593 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.593 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.594 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:23.594 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.387280+0000", 2024-09-12T22:33:23.594 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:23.594 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.594 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.594 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:23.594 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.387281+0000", 2024-09-12T22:33:23.594 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4300000000000002e-07 2024-09-12T22:33:23.594 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.595 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.595 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:23.595 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.387285+0000", 2024-09-12T22:33:23.595 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2570000000000001e-06 2024-09-12T22:33:23.595 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.595 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.595 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:23.595 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.387293+0000", 2024-09-12T22:33:23.595 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0209999999999999e-06 2024-09-12T22:33:23.595 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.595 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.596 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:23.596 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.387299+0000", 2024-09-12T22:33:23.596 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.6930000000000004e-06 2024-09-12T22:33:23.596 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.596 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.596 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:23.596 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.430441+0000", 2024-09-12T22:33:23.596 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.043141789999999999 2024-09-12T22:33:23.596 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.596 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.596 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:23.597 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.430484+0000", 2024-09-12T22:33:23.597 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3745000000000002e-05 2024-09-12T22:33:23.597 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.597 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.597 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:23.597 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.434132+0000", 2024-09-12T22:33:23.597 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00364818 2024-09-12T22:33:23.597 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.597 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.597 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:23.597 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.434163+0000", 2024-09-12T22:33:23.598 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0599000000000003e-05 2024-09-12T22:33:23.598 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.598 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.598 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:23.598 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.434202+0000", 2024-09-12T22:33:23.598 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.8982e-05 2024-09-12T22:33:23.598 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:23.598 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:23.598 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:23.598 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.598 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.599 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3071 3.2 3:42569fed:::200.00000011:head [write 3929558~3203 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:33:23.599 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:19.387860+0000", 2024-09-12T22:33:23.599 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 4.1122264179999997, 2024-09-12T22:33:23.599 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.049590902999999999, 2024-09-12T22:33:23.599 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:23.599 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:23.599 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:23.599 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:23.599 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.599 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:23.599 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.387860+0000", 2024-09-12T22:33:23.599 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:23.600 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.600 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.600 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:23.600 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.387860+0000", 2024-09-12T22:33:23.600 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:23.600 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.600 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.600 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:23.601 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.387861+0000", 2024-09-12T22:33:23.601 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5099999999999999e-07 2024-09-12T22:33:23.601 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.601 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.601 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:23.601 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.387865+0000", 2024-09-12T22:33:23.601 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2629999999999997e-06 2024-09-12T22:33:23.601 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.601 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.601 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:23.601 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.387875+0000", 2024-09-12T22:33:23.601 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0256e-05 2024-09-12T22:33:23.602 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.602 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.602 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:23.602 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.387881+0000", 2024-09-12T22:33:23.602 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.947e-06 2024-09-12T22:33:23.602 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.602 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.602 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:23.602 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.430930+0000", 2024-09-12T22:33:23.602 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.043048386000000001 2024-09-12T22:33:23.602 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.603 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.603 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:23.603 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.430976+0000", 2024-09-12T22:33:23.603 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6408e-05 2024-09-12T22:33:23.603 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.603 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.603 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:23.603 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.437377+0000", 2024-09-12T22:33:23.603 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0064010719999999998 2024-09-12T22:33:23.603 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.603 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.603 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:23.603 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.437409+0000", 2024-09-12T22:33:23.604 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2054999999999997e-05 2024-09-12T22:33:23.604 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.604 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.604 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:23.604 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.437451+0000", 2024-09-12T22:33:23.604 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1764999999999997e-05 2024-09-12T22:33:23.604 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:23.604 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:23.604 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:23.604 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.604 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.604 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3072 3.2 3:42569fed:::200.00000011:head [write 3932761~2786 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:33:23.604 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:19.388005+0000", 2024-09-12T22:33:23.605 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 4.1120813189999996, 2024-09-12T22:33:23.605 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.049514177999999999, 2024-09-12T22:33:23.605 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:23.605 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:23.605 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:23.605 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:23.605 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.605 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:23.605 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.388005+0000", 2024-09-12T22:33:23.605 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:23.605 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.606 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.606 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:23.606 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.388005+0000", 2024-09-12T22:33:23.606 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:23.606 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.606 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.606 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:23.606 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.388006+0000", 2024-09-12T22:33:23.606 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.1799999999999995e-07 2024-09-12T22:33:23.606 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.606 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.607 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:23.607 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.388009+0000", 2024-09-12T22:33:23.607 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.574e-06 2024-09-12T22:33:23.607 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.607 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.607 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:23.607 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.388017+0000", 2024-09-12T22:33:23.607 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3170000000000004e-06 2024-09-12T22:33:23.607 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.607 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.608 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:23.608 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.388022+0000", 2024-09-12T22:33:23.608 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9910000000000002e-06 2024-09-12T22:33:23.608 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.608 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.608 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:23.608 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.431522+0000", 2024-09-12T22:33:23.608 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0435001 2024-09-12T22:33:23.608 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.608 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.608 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:23.608 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.431567+0000", 2024-09-12T22:33:23.608 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4734000000000002e-05 2024-09-12T22:33:23.609 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.609 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.609 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:23.609 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.437458+0000", 2024-09-12T22:33:23.609 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00589166 2024-09-12T22:33:23.609 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.609 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.609 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:23.609 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.437484+0000", 2024-09-12T22:33:23.609 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5622999999999998e-05 2024-09-12T22:33:23.609 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.609 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.609 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:23.610 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.437519+0000", 2024-09-12T22:33:23.610 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.5561000000000001e-05 2024-09-12T22:33:23.610 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:23.610 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:23.610 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:23.610 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.610 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.610 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3073 3.2 3:42569fed:::200.00000011:head [write 3935547~1924 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:33:23.610 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:19.389181+0000", 2024-09-12T22:33:23.610 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 4.1109051570000004, 2024-09-12T22:33:23.610 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.048402300000000002, 2024-09-12T22:33:23.610 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:23.610 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:23.611 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:23.611 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:23.611 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.611 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:23.611 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.389181+0000", 2024-09-12T22:33:23.611 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:23.611 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.611 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.611 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:23.611 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.389181+0000", 2024-09-12T22:33:23.611 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:23.611 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.611 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.612 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:23.612 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.389182+0000", 2024-09-12T22:33:23.612 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7700000000000004e-07 2024-09-12T22:33:23.612 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.612 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.612 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:23.612 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.389191+0000", 2024-09-12T22:33:23.612 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1120000000000002e-06 2024-09-12T22:33:23.612 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.612 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.612 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:23.612 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.389203+0000", 2024-09-12T22:33:23.612 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.146e-05 2024-09-12T22:33:23.613 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.613 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.613 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:23.613 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.389209+0000", 2024-09-12T22:33:23.613 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9989999999999997e-06 2024-09-12T22:33:23.613 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.613 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.613 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:23.613 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.431890+0000", 2024-09-12T22:33:23.614 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.042681251000000003 2024-09-12T22:33:23.614 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.614 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.614 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:23.614 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.431935+0000", 2024-09-12T22:33:23.614 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5166000000000001e-05 2024-09-12T22:33:23.614 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.614 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.614 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:23.614 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.437526+0000", 2024-09-12T22:33:23.614 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0055910489999999998 2024-09-12T22:33:23.614 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.614 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.615 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:23.615 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.437550+0000", 2024-09-12T22:33:23.615 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4134999999999998e-05 2024-09-12T22:33:23.615 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.615 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.615 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:23.615 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.437584+0000", 2024-09-12T22:33:23.615 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3451000000000002e-05 2024-09-12T22:33:23.615 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:23.615 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:23.615 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:23.615 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.615 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.615 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3074 3.2 3:42569fed:::200.00000011:head [write 3937471~7660 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:33:23.616 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:19.390512+0000", 2024-09-12T22:33:23.616 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 4.1095740340000004, 2024-09-12T22:33:23.616 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.047134045999999999, 2024-09-12T22:33:23.616 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:23.616 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:23.616 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:23.616 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:23.616 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.616 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:23.616 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.390512+0000", 2024-09-12T22:33:23.616 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:23.616 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.616 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.616 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:23.617 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.390512+0000", 2024-09-12T22:33:23.617 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:23.617 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.617 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.617 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:23.617 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.390513+0000", 2024-09-12T22:33:23.617 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.7699999999999992e-07 2024-09-12T22:33:23.617 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.617 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.617 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:23.617 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.390522+0000", 2024-09-12T22:33:23.617 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0390000000000005e-06 2024-09-12T22:33:23.617 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.617 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.618 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:23.618 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.390530+0000", 2024-09-12T22:33:23.618 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.8349999999999993e-06 2024-09-12T22:33:23.618 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.618 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.618 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:23.618 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.390537+0000", 2024-09-12T22:33:23.618 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.1850000000000001e-06 2024-09-12T22:33:23.618 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.618 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.618 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:23.618 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.432468+0000", 2024-09-12T22:33:23.618 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.041931883000000003 2024-09-12T22:33:23.618 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.619 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.619 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:23.619 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.432512+0000", 2024-09-12T22:33:23.619 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4054999999999997e-05 2024-09-12T22:33:23.619 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.619 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.619 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:23.619 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.437590+0000", 2024-09-12T22:33:23.619 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0050777230000000001 2024-09-12T22:33:23.619 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.619 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.619 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:23.619 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.437613+0000", 2024-09-12T22:33:23.619 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.2693000000000001e-05 2024-09-12T22:33:23.620 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:23.620 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:23.620 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:23.620 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.437647+0000", 2024-09-12T22:33:23.620 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3655999999999998e-05 2024-09-12T22:33:23.620 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:23.620 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:23.620 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:23.620 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:23.620 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:23.620 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:33:23.623 INFO:teuthology.orchestra.run.smithi019.stderr:nodeep-scrub is set 2024-09-12T22:33:23.623 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:33:23.623 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:23.620+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:23.723 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:23.721+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:23.728 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-09-12T22:33:23.729 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-09-12T22:33:23.729 INFO:teuthology.orchestra.run.smithi163.stdout: "num_ops": 0 2024-09-12T22:33:23.729 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-09-12T22:33:23.738 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:33:23.824 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:23.823+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:23.884 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-09-12T22:33:23.885 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-09-12T22:33:23.885 INFO:teuthology.orchestra.run.smithi163.stdout: "complaint_time": 30, 2024-09-12T22:33:23.885 INFO:teuthology.orchestra.run.smithi163.stdout: "num_blocked_ops": 0 2024-09-12T22:33:23.885 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-09-12T22:33:23.893 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:33:23.934 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:23.933+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:24.026 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:24.025+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:24.042 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-09-12T22:33:24.042 INFO:teuthology.orchestra.run.smithi163.stdout: "size": 20, 2024-09-12T22:33:24.042 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 600, 2024-09-12T22:33:24.042 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2024-09-12T22:33:24.042 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.043 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-09-12T22:33:24.043 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:27.254459+0000", 2024-09-12T22:33:24.043 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 116.784649665, 2024-09-12T22:33:24.043 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.37816283899999997, 2024-09-12T22:33:24.043 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:24.043 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:24.044 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:24.044 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:24.044 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:33:24.044 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:33:24.044 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 1 2024-09-12T22:33:24.044 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.045 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:24.045 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.045 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:24.045 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254459+0000", 2024-09-12T22:33:24.045 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:24.045 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.046 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.046 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:24.046 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254459+0000", 2024-09-12T22:33:24.046 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:24.046 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.046 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.047 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:24.047 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254460+0000", 2024-09-12T22:33:24.047 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1739999999999999e-06 2024-09-12T22:33:24.047 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.047 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.047 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:24.047 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254472+0000", 2024-09-12T22:33:24.048 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2207e-05 2024-09-12T22:33:24.048 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.048 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.048 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:24.048 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254483+0000", 2024-09-12T22:33:24.048 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0631999999999999e-05 2024-09-12T22:33:24.048 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.048 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.048 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:24.048 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254492+0000", 2024-09-12T22:33:24.048 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3670000000000003e-06 2024-09-12T22:33:24.048 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.049 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.049 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:24.049 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254551+0000", 2024-09-12T22:33:24.049 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8687999999999998e-05 2024-09-12T22:33:24.049 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.049 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.049 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for peered", 2024-09-12T22:33:24.049 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254562+0000", 2024-09-12T22:33:24.049 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1249e-05 2024-09-12T22:33:24.049 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.049 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.049 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:24.049 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.631211+0000", 2024-09-12T22:33:24.050 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.376649018 2024-09-12T22:33:24.050 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.050 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.050 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:24.050 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.631345+0000", 2024-09-12T22:33:24.050 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013378700000000001 2024-09-12T22:33:24.051 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.051 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.051 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:33:24.051 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.631479+0000", 2024-09-12T22:33:24.051 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013352399999999999 2024-09-12T22:33:24.051 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.051 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.051 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:24.051 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632324+0000", 2024-09-12T22:33:24.051 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00084508100000000002 2024-09-12T22:33:24.052 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.052 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.052 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:24.052 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632548+0000", 2024-09-12T22:33:24.052 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000224329 2024-09-12T22:33:24.052 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.052 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.052 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:24.052 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632591+0000", 2024-09-12T22:33:24.052 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2564000000000001e-05 2024-09-12T22:33:24.052 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.052 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.053 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:24.053 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632622+0000", 2024-09-12T22:33:24.053 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1219e-05 2024-09-12T22:33:24.053 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:24.053 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:24.053 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:24.053 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.053 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.053 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4490.0:9871 4.35 4:ad66404a:::10000002d4d.00000000:head [write 0~6507] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:33:24.054 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:09.472309+0000", 2024-09-12T22:33:24.054 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 14.566799389, 2024-09-12T22:33:24.054 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.080251445000000005, 2024-09-12T22:33:24.054 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:24.054 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:24.054 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:24.054 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:24.054 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4490", 2024-09-12T22:33:24.055 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:24.055 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 9871 2024-09-12T22:33:24.055 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.055 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:24.055 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.055 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:24.055 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.472309+0000", 2024-09-12T22:33:24.056 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:24.056 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.056 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.056 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:24.056 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.472309+0000", 2024-09-12T22:33:24.056 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:24.056 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.056 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.056 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:24.056 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.472310+0000", 2024-09-12T22:33:24.056 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3799999999999996e-07 2024-09-12T22:33:24.056 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.056 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.057 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:24.057 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.472318+0000", 2024-09-12T22:33:24.057 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.8099999999999998e-06 2024-09-12T22:33:24.057 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.057 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.057 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:24.057 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.472328+0000", 2024-09-12T22:33:24.057 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0359e-05 2024-09-12T22:33:24.057 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.058 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.058 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:24.058 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.472334+0000", 2024-09-12T22:33:24.058 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.0109999999999997e-06 2024-09-12T22:33:24.058 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.058 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.058 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:24.058 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.472382+0000", 2024-09-12T22:33:24.058 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.7311000000000002e-05 2024-09-12T22:33:24.059 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.059 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.059 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:24.059 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.472497+0000", 2024-09-12T22:33:24.059 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011537800000000001 2024-09-12T22:33:24.059 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.059 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.059 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:24.059 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.472617+0000", 2024-09-12T22:33:24.059 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011989600000000001 2024-09-12T22:33:24.059 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.059 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.059 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:24.059 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473149+0000", 2024-09-12T22:33:24.060 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00053227999999999999 2024-09-12T22:33:24.060 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.060 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.060 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:24.060 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.552479+0000", 2024-09-12T22:33:24.060 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.079329541000000003 2024-09-12T22:33:24.060 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.060 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.060 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:24.060 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.552525+0000", 2024-09-12T22:33:24.060 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6421000000000002e-05 2024-09-12T22:33:24.061 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.061 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.061 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:24.061 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.552561+0000", 2024-09-12T22:33:24.062 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5599999999999998e-05 2024-09-12T22:33:24.062 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:24.062 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:24.062 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:24.062 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.062 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.062 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4490.0:9872 4.2c 4:3602c8d3:::10000002d4e.00000000:head [write 0~1178] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:33:24.062 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:09.473085+0000", 2024-09-12T22:33:24.062 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 14.566024085, 2024-09-12T22:33:24.062 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.079631104999999994, 2024-09-12T22:33:24.062 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:24.062 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:24.062 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:24.063 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:24.063 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4490", 2024-09-12T22:33:24.063 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:24.063 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 9872 2024-09-12T22:33:24.063 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.063 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:24.063 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.063 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:24.063 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473085+0000", 2024-09-12T22:33:24.063 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:24.063 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.063 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.063 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:24.064 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473085+0000", 2024-09-12T22:33:24.064 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:24.064 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.064 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.064 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:24.064 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473085+0000", 2024-09-12T22:33:24.064 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3600000000000004e-07 2024-09-12T22:33:24.065 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.066 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.066 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:24.066 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473088+0000", 2024-09-12T22:33:24.066 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.005e-06 2024-09-12T22:33:24.066 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.066 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.067 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:24.067 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473095+0000", 2024-09-12T22:33:24.067 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3950000000000003e-06 2024-09-12T22:33:24.067 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.067 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.067 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:24.067 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473100+0000", 2024-09-12T22:33:24.067 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5460000000000002e-06 2024-09-12T22:33:24.067 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.068 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.068 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:24.068 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473138+0000", 2024-09-12T22:33:24.068 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8244999999999997e-05 2024-09-12T22:33:24.068 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.068 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.068 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:24.068 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473216+0000", 2024-09-12T22:33:24.068 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.7756000000000006e-05 2024-09-12T22:33:24.068 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.068 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.069 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:24.069 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473291+0000", 2024-09-12T22:33:24.069 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5110000000000004e-05 2024-09-12T22:33:24.069 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.069 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.069 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:24.069 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473736+0000", 2024-09-12T22:33:24.069 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00044486500000000002 2024-09-12T22:33:24.069 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.069 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.069 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:24.069 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.552637+0000", 2024-09-12T22:33:24.069 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.078900782000000003 2024-09-12T22:33:24.070 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.070 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.070 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:24.070 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.552680+0000", 2024-09-12T22:33:24.070 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3047999999999998e-05 2024-09-12T22:33:24.070 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.070 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.070 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:24.070 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.552716+0000", 2024-09-12T22:33:24.070 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5816999999999999e-05 2024-09-12T22:33:24.070 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:24.070 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:24.070 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:24.071 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.071 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.071 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4490.0:9873 4.2c 4:372c52ff:::10000002d4f.00000000:head [write 0~1230] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:33:24.071 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:09.473878+0000", 2024-09-12T22:33:24.071 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 14.565230622, 2024-09-12T22:33:24.071 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.079036047999999998, 2024-09-12T22:33:24.071 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:24.071 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:24.071 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:24.071 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:24.071 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4490", 2024-09-12T22:33:24.071 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:24.071 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 9873 2024-09-12T22:33:24.072 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.072 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:24.072 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.072 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:24.072 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473878+0000", 2024-09-12T22:33:24.072 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:24.072 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.072 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.072 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:24.073 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473878+0000", 2024-09-12T22:33:24.073 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:24.073 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.073 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.073 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:24.073 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473879+0000", 2024-09-12T22:33:24.073 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9100000000000004e-07 2024-09-12T22:33:24.073 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.074 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.074 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:24.074 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473882+0000", 2024-09-12T22:33:24.074 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.405e-06 2024-09-12T22:33:24.074 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.074 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.074 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:24.074 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473889+0000", 2024-09-12T22:33:24.074 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7519999999999999e-06 2024-09-12T22:33:24.074 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.075 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.075 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:24.075 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473893+0000", 2024-09-12T22:33:24.075 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9310000000000001e-06 2024-09-12T22:33:24.075 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.075 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.075 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:24.075 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473922+0000", 2024-09-12T22:33:24.075 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9346999999999999e-05 2024-09-12T22:33:24.075 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.075 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.075 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:24.075 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474000+0000", 2024-09-12T22:33:24.076 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.7972000000000005e-05 2024-09-12T22:33:24.076 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.076 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.076 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:24.076 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474072+0000", 2024-09-12T22:33:24.076 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1960999999999998e-05 2024-09-12T22:33:24.076 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.076 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.076 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:24.076 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474470+0000", 2024-09-12T22:33:24.076 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00039803400000000002 2024-09-12T22:33:24.076 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.076 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.076 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:24.077 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.552814+0000", 2024-09-12T22:33:24.077 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.078344164999999993 2024-09-12T22:33:24.077 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.077 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.077 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:24.077 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.552875+0000", 2024-09-12T22:33:24.077 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1008999999999998e-05 2024-09-12T22:33:24.077 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.077 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.077 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:24.077 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.552914+0000", 2024-09-12T22:33:24.077 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8881000000000003e-05 2024-09-12T22:33:24.078 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:24.078 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:24.078 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:24.078 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.078 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.078 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4490.0:9874 4.1b 4:db19d96a:::10000002d50.00000000:head [write 0~1088] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:33:24.078 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:09.474673+0000", 2024-09-12T22:33:24.078 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 14.564435629, 2024-09-12T22:33:24.078 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.080314317999999996, 2024-09-12T22:33:24.078 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:24.078 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:24.078 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:24.078 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:24.078 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4490", 2024-09-12T22:33:24.079 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:24.079 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 9874 2024-09-12T22:33:24.079 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.079 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:24.079 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.079 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:24.079 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474673+0000", 2024-09-12T22:33:24.079 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:24.079 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.079 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.079 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:24.079 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474673+0000", 2024-09-12T22:33:24.079 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:24.079 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.080 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.080 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:24.080 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474674+0000", 2024-09-12T22:33:24.080 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6199999999999998e-07 2024-09-12T22:33:24.080 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.080 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.080 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:24.080 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474677+0000", 2024-09-12T22:33:24.080 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.224e-06 2024-09-12T22:33:24.080 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.080 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.080 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:24.080 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474683+0000", 2024-09-12T22:33:24.081 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.3160000000000002e-06 2024-09-12T22:33:24.081 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.081 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.081 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:24.081 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474687+0000", 2024-09-12T22:33:24.081 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7869999999999999e-06 2024-09-12T22:33:24.081 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.081 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.081 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:24.081 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474730+0000", 2024-09-12T22:33:24.081 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3309000000000002e-05 2024-09-12T22:33:24.081 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.081 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.082 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:24.082 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474845+0000", 2024-09-12T22:33:24.082 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114306 2024-09-12T22:33:24.082 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.082 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.082 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:24.082 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474970+0000", 2024-09-12T22:33:24.082 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000125096 2024-09-12T22:33:24.082 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.082 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.082 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:24.082 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.475621+0000", 2024-09-12T22:33:24.082 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00065124900000000001 2024-09-12T22:33:24.082 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.083 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.083 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:24.083 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.554885+0000", 2024-09-12T22:33:24.083 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.079264055 2024-09-12T22:33:24.083 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.083 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.083 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:24.083 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.554942+0000", 2024-09-12T22:33:24.083 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7284000000000002e-05 2024-09-12T22:33:24.083 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.083 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.083 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:24.083 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.554987+0000", 2024-09-12T22:33:24.084 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5130000000000003e-05 2024-09-12T22:33:24.084 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:24.084 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:24.084 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:24.084 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.084 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.084 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4490.0:12220 4.2b 4:d55bfd66:::10000003169.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-12T22:33:24.084 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.391333+0000", 2024-09-12T22:33:24.084 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 9.6477754860000005, 2024-09-12T22:33:24.084 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.088669550999999999, 2024-09-12T22:33:24.084 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:24.084 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:24.084 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:24.085 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:24.085 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4490", 2024-09-12T22:33:24.085 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:24.085 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 12220 2024-09-12T22:33:24.085 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.085 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:24.085 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.085 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:24.085 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.391333+0000", 2024-09-12T22:33:24.085 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:24.085 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.085 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.085 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:24.085 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.391333+0000", 2024-09-12T22:33:24.086 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:24.086 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.086 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.086 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:24.086 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.391334+0000", 2024-09-12T22:33:24.086 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3099999999999997e-07 2024-09-12T22:33:24.086 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.086 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.086 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:24.086 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398373+0000", 2024-09-12T22:33:24.086 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0070386670000000002 2024-09-12T22:33:24.086 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.086 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.087 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:24.087 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398384+0000", 2024-09-12T22:33:24.087 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1338999999999999e-05 2024-09-12T22:33:24.087 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.087 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.087 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:24.087 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398389+0000", 2024-09-12T22:33:24.087 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3650000000000003e-06 2024-09-12T22:33:24.087 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.087 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.087 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:24.087 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.456308+0000", 2024-09-12T22:33:24.087 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.057918931 2024-09-12T22:33:24.087 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.088 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.088 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:24.088 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.456425+0000", 2024-09-12T22:33:24.088 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000116452 2024-09-12T22:33:24.088 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.088 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.088 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:24.088 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.456536+0000", 2024-09-12T22:33:24.088 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000111839 2024-09-12T22:33:24.088 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.088 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.088 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:24.088 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.465335+0000", 2024-09-12T22:33:24.089 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0087984980000000001 2024-09-12T22:33:24.089 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.089 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.089 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:24.089 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.479950+0000", 2024-09-12T22:33:24.089 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.01461552 2024-09-12T22:33:24.089 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.089 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.089 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:24.089 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.479983+0000", 2024-09-12T22:33:24.089 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2126999999999999e-05 2024-09-12T22:33:24.089 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.089 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.090 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:24.090 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.480003+0000", 2024-09-12T22:33:24.090 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0081999999999998e-05 2024-09-12T22:33:24.090 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:24.090 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:24.090 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:24.090 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.090 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.090 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1208 3.13 3:cb3d3880:::200.0000000d:head [write 1009846~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:24.090 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.398459+0000", 2024-09-12T22:33:24.090 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 9.6406499199999995, 2024-09-12T22:33:24.090 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.078093931000000005, 2024-09-12T22:33:24.090 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:24.091 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:24.091 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:24.091 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:24.091 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.091 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:24.091 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398459+0000", 2024-09-12T22:33:24.091 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:24.091 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.091 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.091 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:24.091 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398459+0000", 2024-09-12T22:33:24.091 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:24.091 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.092 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.092 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:24.092 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398459+0000", 2024-09-12T22:33:24.092 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8100000000000003e-07 2024-09-12T22:33:24.092 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.092 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.092 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:24.092 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398462+0000", 2024-09-12T22:33:24.092 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3700000000000002e-06 2024-09-12T22:33:24.092 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.092 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.092 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:24.092 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398469+0000", 2024-09-12T22:33:24.092 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2320000000000004e-06 2024-09-12T22:33:24.093 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.093 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.093 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:24.093 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398472+0000", 2024-09-12T22:33:24.093 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.658e-06 2024-09-12T22:33:24.093 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.093 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.093 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:24.093 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.456690+0000", 2024-09-12T22:33:24.093 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.058217615 2024-09-12T22:33:24.093 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.093 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.093 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:24.094 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.456731+0000", 2024-09-12T22:33:24.094 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0815000000000001e-05 2024-09-12T22:33:24.094 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.094 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.094 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:24.094 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.456793+0000", 2024-09-12T22:33:24.094 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1796000000000003e-05 2024-09-12T22:33:24.094 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.094 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.094 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:24.094 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.461412+0000", 2024-09-12T22:33:24.094 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0046188560000000002 2024-09-12T22:33:24.094 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.094 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.095 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:24.095 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476429+0000", 2024-09-12T22:33:24.095 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.015017943000000001 2024-09-12T22:33:24.095 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.095 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.095 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:24.095 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476499+0000", 2024-09-12T22:33:24.095 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9047000000000005e-05 2024-09-12T22:33:24.095 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.096 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.096 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:24.096 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476553+0000", 2024-09-12T22:33:24.096 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4117999999999999e-05 2024-09-12T22:33:24.096 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:24.096 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:24.096 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:24.096 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.096 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.096 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1209 3.13 3:cb3d3880:::200.0000000d:head [write 1011245~5867 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:24.096 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.398677+0000", 2024-09-12T22:33:24.096 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 9.6404313629999994, 2024-09-12T22:33:24.096 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.077995698000000002, 2024-09-12T22:33:24.097 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:24.097 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:24.097 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:24.097 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:24.097 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.097 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:24.097 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398677+0000", 2024-09-12T22:33:24.097 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:24.097 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.097 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.098 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:24.098 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398677+0000", 2024-09-12T22:33:24.098 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:24.098 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.098 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.098 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:24.098 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398678+0000", 2024-09-12T22:33:24.098 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5199999999999995e-07 2024-09-12T22:33:24.098 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.098 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.098 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:24.098 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398686+0000", 2024-09-12T22:33:24.099 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0579999999999998e-06 2024-09-12T22:33:24.099 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.099 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.099 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:24.099 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398695+0000", 2024-09-12T22:33:24.099 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.1409999999999994e-06 2024-09-12T22:33:24.099 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.099 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.099 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:24.099 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398703+0000", 2024-09-12T22:33:24.099 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4379999999999998e-06 2024-09-12T22:33:24.099 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.099 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.100 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:24.100 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.457051+0000", 2024-09-12T22:33:24.100 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.058348358000000003 2024-09-12T22:33:24.100 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.100 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.100 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:24.100 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.457096+0000", 2024-09-12T22:33:24.100 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4428000000000002e-05 2024-09-12T22:33:24.100 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.100 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.100 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:24.101 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.457162+0000", 2024-09-12T22:33:24.101 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6298999999999997e-05 2024-09-12T22:33:24.101 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.101 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.101 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:24.101 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.461416+0000", 2024-09-12T22:33:24.101 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0042539980000000002 2024-09-12T22:33:24.101 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.101 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.101 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:24.101 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476610+0000", 2024-09-12T22:33:24.102 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.015193879 2024-09-12T22:33:24.102 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.102 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.102 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:24.102 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476640+0000", 2024-09-12T22:33:24.102 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0648000000000002e-05 2024-09-12T22:33:24.102 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.102 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.102 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:24.102 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476673+0000", 2024-09-12T22:33:24.102 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2598999999999997e-05 2024-09-12T22:33:24.102 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:24.103 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:24.103 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:24.103 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.103 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.103 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1210 3.13 3:cb3d3880:::200.0000000d:head [write 1017112~1958 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:24.103 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.398713+0000", 2024-09-12T22:33:24.103 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 9.6403960400000006, 2024-09-12T22:33:24.103 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.078118317000000007, 2024-09-12T22:33:24.103 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:24.103 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:24.103 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:24.104 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:24.104 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.104 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:24.104 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398713+0000", 2024-09-12T22:33:24.104 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:24.104 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.104 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.104 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:24.104 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398713+0000", 2024-09-12T22:33:24.104 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:24.105 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.105 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.105 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:24.105 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398713+0000", 2024-09-12T22:33:24.105 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7599999999999998e-07 2024-09-12T22:33:24.105 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.105 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.105 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:24.105 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398718+0000", 2024-09-12T22:33:24.105 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8169999999999998e-06 2024-09-12T22:33:24.105 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.106 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.106 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:24.106 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398722+0000", 2024-09-12T22:33:24.106 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5249999999999999e-06 2024-09-12T22:33:24.106 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.106 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.106 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:24.106 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398726+0000", 2024-09-12T22:33:24.107 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5650000000000002e-06 2024-09-12T22:33:24.107 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.107 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.107 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:24.107 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.457644+0000", 2024-09-12T22:33:24.107 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.058918521000000001 2024-09-12T22:33:24.107 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.107 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.107 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:24.108 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.457724+0000", 2024-09-12T22:33:24.108 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9408999999999998e-05 2024-09-12T22:33:24.108 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.108 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.108 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:24.108 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.457821+0000", 2024-09-12T22:33:24.108 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.7015000000000005e-05 2024-09-12T22:33:24.108 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.109 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.109 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:24.109 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.461419+0000", 2024-09-12T22:33:24.109 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0035985309999999999 2024-09-12T22:33:24.109 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.109 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.109 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:24.109 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476726+0000", 2024-09-12T22:33:24.110 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.015306804 2024-09-12T22:33:24.110 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.110 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.110 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:24.110 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476787+0000", 2024-09-12T22:33:24.110 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1062000000000006e-05 2024-09-12T22:33:24.110 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.110 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.110 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:24.110 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476831+0000", 2024-09-12T22:33:24.110 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3692000000000001e-05 2024-09-12T22:33:24.111 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:24.111 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:24.111 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:24.111 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.111 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.111 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1211 3.13 3:cb3d3880:::200.0000000d:head [write 1019070~5873 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:24.111 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.400122+0000", 2024-09-12T22:33:24.111 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 9.6389863220000009, 2024-09-12T22:33:24.111 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.076797146999999996, 2024-09-12T22:33:24.112 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:24.112 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:24.112 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:24.112 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:24.112 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.112 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:24.112 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.400122+0000", 2024-09-12T22:33:24.112 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:24.112 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.112 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.112 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:24.112 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.400122+0000", 2024-09-12T22:33:24.113 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:24.113 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.113 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.113 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:24.113 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.400123+0000", 2024-09-12T22:33:24.113 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2500000000000005e-07 2024-09-12T22:33:24.113 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.113 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.113 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:24.113 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.400129+0000", 2024-09-12T22:33:24.113 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.319e-06 2024-09-12T22:33:24.113 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.113 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.114 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:24.114 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.400139+0000", 2024-09-12T22:33:24.114 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.5200000000000003e-06 2024-09-12T22:33:24.114 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.114 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.114 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:24.114 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.400143+0000", 2024-09-12T22:33:24.114 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.437e-06 2024-09-12T22:33:24.114 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.114 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.114 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:24.114 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.458159+0000", 2024-09-12T22:33:24.115 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.058015960999999998 2024-09-12T22:33:24.115 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.115 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.115 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:24.115 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.458201+0000", 2024-09-12T22:33:24.115 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1693000000000002e-05 2024-09-12T22:33:24.115 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.115 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.115 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:24.115 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.458267+0000", 2024-09-12T22:33:24.115 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5687999999999999e-05 2024-09-12T22:33:24.115 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.115 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.116 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:24.116 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.461423+0000", 2024-09-12T22:33:24.116 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0031560730000000001 2024-09-12T22:33:24.116 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.116 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.116 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:24.116 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476868+0000", 2024-09-12T22:33:24.116 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.015445108000000001 2024-09-12T22:33:24.116 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.116 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.116 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:24.116 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476897+0000", 2024-09-12T22:33:24.116 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9433000000000001e-05 2024-09-12T22:33:24.116 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.117 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.117 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:24.117 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476919+0000", 2024-09-12T22:33:24.117 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.2189999999999999e-05 2024-09-12T22:33:24.117 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:24.117 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:24.117 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:24.117 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.117 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.117 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1212 3.13 3:cb3d3880:::200.0000000d:head [write 1024943~3866 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:24.117 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.401707+0000", 2024-09-12T22:33:24.117 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 9.6374021170000006, 2024-09-12T22:33:24.117 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.075386625999999998, 2024-09-12T22:33:24.118 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:24.118 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:24.118 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:24.118 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:24.118 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.118 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:24.118 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.401707+0000", 2024-09-12T22:33:24.118 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:24.118 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.118 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.118 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:24.118 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.401707+0000", 2024-09-12T22:33:24.118 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:24.119 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.119 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.119 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:24.119 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.401707+0000", 2024-09-12T22:33:24.119 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7700000000000004e-07 2024-09-12T22:33:24.119 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.119 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.119 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:24.119 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.401713+0000", 2024-09-12T22:33:24.119 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6609999999999997e-06 2024-09-12T22:33:24.119 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.119 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.119 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:24.119 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.401726+0000", 2024-09-12T22:33:24.120 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.3088000000000001e-05 2024-09-12T22:33:24.120 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.120 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.120 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:24.120 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.401741+0000", 2024-09-12T22:33:24.120 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.5424e-05 2024-09-12T22:33:24.120 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.120 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.120 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:24.120 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.458853+0000", 2024-09-12T22:33:24.120 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.057111157000000003 2024-09-12T22:33:24.120 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.121 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.121 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:24.121 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.458898+0000", 2024-09-12T22:33:24.121 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5633999999999997e-05 2024-09-12T22:33:24.121 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.121 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.121 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:24.121 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.458972+0000", 2024-09-12T22:33:24.121 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3441000000000004e-05 2024-09-12T22:33:24.121 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.121 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.121 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:24.121 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.461426+0000", 2024-09-12T22:33:24.122 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0024542660000000001 2024-09-12T22:33:24.122 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.122 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.122 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:24.122 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476985+0000", 2024-09-12T22:33:24.122 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.015559513000000001 2024-09-12T22:33:24.122 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.122 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.122 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:24.122 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.477044+0000", 2024-09-12T22:33:24.122 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8156999999999999e-05 2024-09-12T22:33:24.122 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.122 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.123 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:24.123 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.477093+0000", 2024-09-12T22:33:24.123 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9607999999999997e-05 2024-09-12T22:33:24.123 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:24.123 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:24.123 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:24.123 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.123 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.123 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1213 3.13 3:cb3d3880:::200.0000000d:head [write 1028809~6329 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:24.123 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.403250+0000", 2024-09-12T22:33:24.123 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 9.6358585889999997, 2024-09-12T22:33:24.123 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.073936215999999999, 2024-09-12T22:33:24.123 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:24.123 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:24.124 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:24.124 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:24.124 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.124 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:24.124 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403250+0000", 2024-09-12T22:33:24.124 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:24.124 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.124 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.124 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:24.124 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403250+0000", 2024-09-12T22:33:24.124 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:24.124 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.124 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.125 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:24.125 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403251+0000", 2024-09-12T22:33:24.125 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.37e-07 2024-09-12T22:33:24.125 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.125 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.125 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:24.125 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403258+0000", 2024-09-12T22:33:24.125 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.25e-06 2024-09-12T22:33:24.125 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.125 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.125 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:24.125 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403269+0000", 2024-09-12T22:33:24.125 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0509000000000001e-05 2024-09-12T22:33:24.126 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.126 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.126 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:24.126 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403274+0000", 2024-09-12T22:33:24.126 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1290000000000004e-06 2024-09-12T22:33:24.126 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.126 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.126 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:24.126 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.459796+0000", 2024-09-12T22:33:24.126 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.056522020999999999 2024-09-12T22:33:24.126 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.126 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.126 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:24.126 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.459845+0000", 2024-09-12T22:33:24.126 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8884999999999997e-05 2024-09-12T22:33:24.127 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.127 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.127 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:24.127 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.459920+0000", 2024-09-12T22:33:24.127 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5318e-05 2024-09-12T22:33:24.127 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.127 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.127 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:24.127 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.466542+0000", 2024-09-12T22:33:24.127 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0066223139999999998 2024-09-12T22:33:24.127 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.127 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.127 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:24.127 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.477137+0000", 2024-09-12T22:33:24.128 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010594717 2024-09-12T22:33:24.128 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.128 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.128 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:24.128 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.477165+0000", 2024-09-12T22:33:24.128 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8262000000000001e-05 2024-09-12T22:33:24.128 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.128 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.128 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:24.128 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.477186+0000", 2024-09-12T22:33:24.128 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1073999999999998e-05 2024-09-12T22:33:24.128 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:24.129 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:24.129 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:24.129 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.129 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.129 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1214 3.13 3:cb3d3880:::200.0000000d:head [write 1035138~2606 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:24.129 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.403674+0000", 2024-09-12T22:33:24.129 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 9.6354346690000003, 2024-09-12T22:33:24.129 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.073643204000000004, 2024-09-12T22:33:24.129 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:24.130 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:24.130 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:24.130 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:24.130 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.130 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:24.130 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403674+0000", 2024-09-12T22:33:24.130 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:24.130 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.130 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.130 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:24.130 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403674+0000", 2024-09-12T22:33:24.130 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:24.131 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.131 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.131 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:24.131 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403674+0000", 2024-09-12T22:33:24.131 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.7700000000000005e-07 2024-09-12T22:33:24.131 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.131 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.131 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:24.131 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403678+0000", 2024-09-12T22:33:24.131 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2009999999999999e-06 2024-09-12T22:33:24.132 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.132 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.132 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:24.132 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403686+0000", 2024-09-12T22:33:24.132 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5690000000000005e-06 2024-09-12T22:33:24.132 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.132 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.132 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:24.132 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403690+0000", 2024-09-12T22:33:24.132 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.233e-06 2024-09-12T22:33:24.132 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.132 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.133 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:24.133 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.460445+0000", 2024-09-12T22:33:24.133 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.056754412999999997 2024-09-12T22:33:24.133 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.133 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.133 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:24.133 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.460495+0000", 2024-09-12T22:33:24.133 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0238999999999998e-05 2024-09-12T22:33:24.133 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.133 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.133 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:24.133 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.460566+0000", 2024-09-12T22:33:24.134 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1159000000000001e-05 2024-09-12T22:33:24.134 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.134 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.134 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:24.134 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.466546+0000", 2024-09-12T22:33:24.134 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0059798910000000002 2024-09-12T22:33:24.134 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.134 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.134 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:24.135 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.477232+0000", 2024-09-12T22:33:24.135 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010686084 2024-09-12T22:33:24.135 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.135 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.135 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:24.135 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.477280+0000", 2024-09-12T22:33:24.135 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.7719999999999997e-05 2024-09-12T22:33:24.135 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.135 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.135 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:24.135 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.477317+0000", 2024-09-12T22:33:24.135 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7218000000000002e-05 2024-09-12T22:33:24.136 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:24.136 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:24.136 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:24.136 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.136 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.136 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1223 3.13 3:cb3d3880:::200.0000000d:head [write 1090497~1913 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:24.136 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.420111+0000", 2024-09-12T22:33:24.136 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 9.6189975170000004, 2024-09-12T22:33:24.136 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.071634583000000002, 2024-09-12T22:33:24.136 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:24.136 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:24.137 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:24.137 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:24.137 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.137 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:24.137 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.420111+0000", 2024-09-12T22:33:24.137 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:24.137 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.137 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.137 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:24.137 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.420111+0000", 2024-09-12T22:33:24.138 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:24.138 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.138 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.138 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:24.138 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.420112+0000", 2024-09-12T22:33:24.138 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.2900000000000002e-07 2024-09-12T22:33:24.138 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.138 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.138 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:24.138 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.420116+0000", 2024-09-12T22:33:24.138 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.67e-06 2024-09-12T22:33:24.139 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.139 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.139 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:24.139 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.420125+0000", 2024-09-12T22:33:24.139 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.0890000000000006e-06 2024-09-12T22:33:24.139 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.139 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.139 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:24.139 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.420131+0000", 2024-09-12T22:33:24.139 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4269999999999996e-06 2024-09-12T22:33:24.140 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.140 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.140 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:24.140 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.465358+0000", 2024-09-12T22:33:24.140 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.045227030000000001 2024-09-12T22:33:24.140 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.140 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.140 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:24.140 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.465439+0000", 2024-09-12T22:33:24.140 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0901000000000004e-05 2024-09-12T22:33:24.141 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.141 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.141 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:24.141 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.465571+0000", 2024-09-12T22:33:24.141 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000131705 2024-09-12T22:33:24.141 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.141 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.141 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:24.141 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.469496+0000", 2024-09-12T22:33:24.141 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.003925418 2024-09-12T22:33:24.141 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.142 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.142 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:24.142 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.491669+0000", 2024-09-12T22:33:24.142 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.022172335000000001 2024-09-12T22:33:24.142 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.142 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.142 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:24.142 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.491714+0000", 2024-09-12T22:33:24.142 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5417000000000002e-05 2024-09-12T22:33:24.142 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.142 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.142 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:24.142 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.491746+0000", 2024-09-12T22:33:24.143 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1662000000000003e-05 2024-09-12T22:33:24.143 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:24.143 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:24.143 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:24.143 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.143 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.143 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1225 3.13 3:cb3d3880:::200.0000000d:head [write 1097316~1932 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:24.143 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.421303+0000", 2024-09-12T22:33:24.143 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 9.6178056820000002, 2024-09-12T22:33:24.143 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.074934770999999997, 2024-09-12T22:33:24.143 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:24.143 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:24.143 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:24.143 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:24.144 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.144 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:24.144 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.421303+0000", 2024-09-12T22:33:24.144 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:24.144 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.144 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.144 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:24.144 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.421303+0000", 2024-09-12T22:33:24.144 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:24.144 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.144 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.144 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:24.145 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.421303+0000", 2024-09-12T22:33:24.145 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8599999999999998e-07 2024-09-12T22:33:24.145 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.145 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.145 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:24.145 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.421307+0000", 2024-09-12T22:33:24.145 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0879999999999999e-06 2024-09-12T22:33:24.145 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.145 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.146 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:24.146 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.421314+0000", 2024-09-12T22:33:24.146 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1010000000000003e-06 2024-09-12T22:33:24.146 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.146 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.146 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:24.146 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.421319+0000", 2024-09-12T22:33:24.146 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7209999999999999e-06 2024-09-12T22:33:24.146 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.146 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.146 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:24.146 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.466620+0000", 2024-09-12T22:33:24.146 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.045301044999999998 2024-09-12T22:33:24.147 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.147 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.147 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:24.147 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.466703+0000", 2024-09-12T22:33:24.147 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3011999999999997e-05 2024-09-12T22:33:24.147 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.147 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.147 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:24.147 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.466826+0000", 2024-09-12T22:33:24.147 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000122824 2024-09-12T22:33:24.147 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.147 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.147 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:24.148 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.472359+0000", 2024-09-12T22:33:24.148 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0055323009999999999 2024-09-12T22:33:24.148 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.148 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.148 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:24.148 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496142+0000", 2024-09-12T22:33:24.148 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.023783696999999999 2024-09-12T22:33:24.148 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.148 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.148 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:24.148 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496194+0000", 2024-09-12T22:33:24.148 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1350000000000001e-05 2024-09-12T22:33:24.148 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.148 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.149 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:24.149 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496238+0000", 2024-09-12T22:33:24.149 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4146000000000001e-05 2024-09-12T22:33:24.149 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:24.149 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:24.149 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:24.149 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.149 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.149 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1226 3.13 3:cb3d3880:::200.0000000d:head [write 1099248~1973 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:24.149 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.422971+0000", 2024-09-12T22:33:24.149 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 9.6161380839999993, 2024-09-12T22:33:24.149 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.073363063000000006, 2024-09-12T22:33:24.149 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:24.150 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:24.150 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:24.150 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:24.150 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.150 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:24.150 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.422971+0000", 2024-09-12T22:33:24.150 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:24.150 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.150 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.150 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:24.150 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.422971+0000", 2024-09-12T22:33:24.150 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:24.150 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.150 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.151 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:24.151 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.422971+0000", 2024-09-12T22:33:24.151 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.1699999999999997e-07 2024-09-12T22:33:24.151 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.151 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.151 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:24.151 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.422975+0000", 2024-09-12T22:33:24.151 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2650000000000001e-06 2024-09-12T22:33:24.151 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.152 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.152 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:24.152 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.422981+0000", 2024-09-12T22:33:24.152 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7379999999999997e-06 2024-09-12T22:33:24.152 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.152 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.152 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:24.152 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.422986+0000", 2024-09-12T22:33:24.152 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5220000000000001e-06 2024-09-12T22:33:24.152 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.153 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.153 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:24.153 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.467340+0000", 2024-09-12T22:33:24.153 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.044353985999999998 2024-09-12T22:33:24.153 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.153 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.153 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:24.153 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.467412+0000", 2024-09-12T22:33:24.153 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1982000000000003e-05 2024-09-12T22:33:24.153 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.153 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.153 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:24.153 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.467493+0000", 2024-09-12T22:33:24.153 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0829999999999997e-05 2024-09-12T22:33:24.154 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.154 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.154 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:24.154 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.472364+0000", 2024-09-12T22:33:24.154 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0048713189999999998 2024-09-12T22:33:24.154 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.154 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.154 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:24.154 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496271+0000", 2024-09-12T22:33:24.154 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.023906808000000002 2024-09-12T22:33:24.154 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.154 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.154 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:24.155 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496300+0000", 2024-09-12T22:33:24.155 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9315e-05 2024-09-12T22:33:24.155 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.155 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.155 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:24.155 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496334+0000", 2024-09-12T22:33:24.155 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3481e-05 2024-09-12T22:33:24.155 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:24.155 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:24.155 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:24.155 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.155 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.155 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1227 3.13 3:cb3d3880:::200.0000000d:head [write 1101221~1922 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:24.156 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.423028+0000", 2024-09-12T22:33:24.156 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 9.6160811000000006, 2024-09-12T22:33:24.156 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.073444802000000003, 2024-09-12T22:33:24.156 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:24.156 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:24.156 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:24.156 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:24.156 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.156 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:24.156 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423028+0000", 2024-09-12T22:33:24.156 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:24.156 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.156 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.157 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:24.157 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423028+0000", 2024-09-12T22:33:24.157 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:24.157 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.157 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.157 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:24.157 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423028+0000", 2024-09-12T22:33:24.157 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1699999999999998e-07 2024-09-12T22:33:24.157 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.157 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.157 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:24.157 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423031+0000", 2024-09-12T22:33:24.157 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8499999999999998e-06 2024-09-12T22:33:24.157 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.158 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.158 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:24.158 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423036+0000", 2024-09-12T22:33:24.158 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9479999999999999e-06 2024-09-12T22:33:24.158 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.158 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.158 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:24.158 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423039+0000", 2024-09-12T22:33:24.158 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4929999999999998e-06 2024-09-12T22:33:24.158 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.158 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.158 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:24.159 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.467785+0000", 2024-09-12T22:33:24.159 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.044745957000000003 2024-09-12T22:33:24.159 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.159 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.159 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:24.159 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.467838+0000", 2024-09-12T22:33:24.159 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2596999999999998e-05 2024-09-12T22:33:24.159 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.159 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.159 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:24.159 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.467915+0000", 2024-09-12T22:33:24.159 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6744999999999998e-05 2024-09-12T22:33:24.160 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.160 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.160 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:24.160 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.472368+0000", 2024-09-12T22:33:24.160 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0044534730000000003 2024-09-12T22:33:24.160 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.160 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.160 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:24.160 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496382+0000", 2024-09-12T22:33:24.160 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.024014111000000001 2024-09-12T22:33:24.160 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.160 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.161 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:24.161 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496443+0000", 2024-09-12T22:33:24.161 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.0547000000000002e-05 2024-09-12T22:33:24.161 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.161 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.161 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:24.161 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496472+0000", 2024-09-12T22:33:24.161 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9564e-05 2024-09-12T22:33:24.161 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:24.161 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:24.161 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:24.161 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.161 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.161 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1228 3.13 3:cb3d3880:::200.0000000d:head [write 1103143~2423 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:24.162 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.423305+0000", 2024-09-12T22:33:24.162 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 9.6158037360000002, 2024-09-12T22:33:24.162 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.073251160999999995, 2024-09-12T22:33:24.162 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:24.162 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:24.162 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:24.162 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:24.162 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.162 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:24.162 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423305+0000", 2024-09-12T22:33:24.162 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:24.162 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.162 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.162 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:24.163 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423305+0000", 2024-09-12T22:33:24.163 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:24.163 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.163 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.163 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:24.163 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423306+0000", 2024-09-12T22:33:24.163 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4899999999999995e-07 2024-09-12T22:33:24.163 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.163 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.163 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:24.163 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423311+0000", 2024-09-12T22:33:24.163 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7459999999999997e-06 2024-09-12T22:33:24.163 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.163 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.164 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:24.164 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423316+0000", 2024-09-12T22:33:24.164 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0239999999999997e-06 2024-09-12T22:33:24.164 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.164 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.164 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:24.164 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423320+0000", 2024-09-12T22:33:24.164 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.67e-06 2024-09-12T22:33:24.164 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.164 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.164 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:24.164 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.468252+0000", 2024-09-12T22:33:24.164 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.044932262000000001 2024-09-12T22:33:24.165 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.165 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.165 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:24.165 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.468293+0000", 2024-09-12T22:33:24.165 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0368999999999999e-05 2024-09-12T22:33:24.165 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.165 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.165 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:24.165 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.468357+0000", 2024-09-12T22:33:24.165 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4287000000000003e-05 2024-09-12T22:33:24.165 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.165 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.165 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:24.166 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.472371+0000", 2024-09-12T22:33:24.166 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0040144350000000002 2024-09-12T22:33:24.166 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.166 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.166 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:24.166 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496507+0000", 2024-09-12T22:33:24.166 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.024135961000000001 2024-09-12T22:33:24.166 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.166 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.166 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:24.167 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496537+0000", 2024-09-12T22:33:24.167 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9611000000000002e-05 2024-09-12T22:33:24.167 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.167 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.167 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:24.167 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496556+0000", 2024-09-12T22:33:24.167 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9147000000000002e-05 2024-09-12T22:33:24.167 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:24.167 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:24.167 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:24.167 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.167 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.168 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1229 3.13 3:cb3d3880:::200.0000000d:head [write 1105566~1911 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:24.168 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.423606+0000", 2024-09-12T22:33:24.168 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 9.6155027250000007, 2024-09-12T22:33:24.168 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.073027876000000005, 2024-09-12T22:33:24.168 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:24.168 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:24.168 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:24.168 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:24.168 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.168 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:24.168 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423606+0000", 2024-09-12T22:33:24.169 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:24.169 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.169 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.169 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:24.169 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423606+0000", 2024-09-12T22:33:24.169 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:24.169 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.169 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.169 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:24.169 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423606+0000", 2024-09-12T22:33:24.169 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.7e-07 2024-09-12T22:33:24.170 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.170 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.170 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:24.170 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423609+0000", 2024-09-12T22:33:24.170 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5339999999999998e-06 2024-09-12T22:33:24.170 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.170 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.170 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:24.170 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423614+0000", 2024-09-12T22:33:24.170 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.69e-06 2024-09-12T22:33:24.170 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.170 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.170 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:24.171 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423617+0000", 2024-09-12T22:33:24.171 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4300000000000002e-06 2024-09-12T22:33:24.171 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.171 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.171 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:24.171 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.468606+0000", 2024-09-12T22:33:24.171 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.044988606 2024-09-12T22:33:24.171 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.171 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.172 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:24.172 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.468649+0000", 2024-09-12T22:33:24.172 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3414000000000001e-05 2024-09-12T22:33:24.172 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.172 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.172 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:24.172 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.468714+0000", 2024-09-12T22:33:24.172 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4857000000000006e-05 2024-09-12T22:33:24.172 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.172 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.172 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:24.172 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.472375+0000", 2024-09-12T22:33:24.172 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0036607330000000002 2024-09-12T22:33:24.173 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.173 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.173 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:24.173 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496585+0000", 2024-09-12T22:33:24.173 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.024210835 2024-09-12T22:33:24.173 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.173 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.173 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:24.173 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496612+0000", 2024-09-12T22:33:24.174 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6999999999999999e-05 2024-09-12T22:33:24.174 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.174 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.174 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:24.174 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496634+0000", 2024-09-12T22:33:24.174 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1307000000000001e-05 2024-09-12T22:33:24.174 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:24.174 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:24.174 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:24.174 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.174 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.174 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1230 3.13 3:cb3d3880:::200.0000000d:head [write 1107477~6537 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:24.175 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.423911+0000", 2024-09-12T22:33:24.175 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 9.6151978800000002, 2024-09-12T22:33:24.175 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.072794530999999996, 2024-09-12T22:33:24.175 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:24.175 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:24.175 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:24.175 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:24.175 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.175 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:24.175 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423911+0000", 2024-09-12T22:33:24.176 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:24.176 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.176 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.176 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:24.176 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423911+0000", 2024-09-12T22:33:24.176 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:24.176 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.177 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.177 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:24.177 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423911+0000", 2024-09-12T22:33:24.177 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3799999999999998e-07 2024-09-12T22:33:24.177 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.177 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.177 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:24.177 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423919+0000", 2024-09-12T22:33:24.177 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.8329999999999994e-06 2024-09-12T22:33:24.177 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.178 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.178 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:24.178 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423924+0000", 2024-09-12T22:33:24.178 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3449999999999996e-06 2024-09-12T22:33:24.178 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.178 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.178 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:24.178 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423928+0000", 2024-09-12T22:33:24.179 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2339999999999999e-06 2024-09-12T22:33:24.179 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.179 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.179 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:24.179 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.469042+0000", 2024-09-12T22:33:24.179 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.045114888999999998 2024-09-12T22:33:24.179 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.179 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.179 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:24.180 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.469092+0000", 2024-09-12T22:33:24.180 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9289000000000002e-05 2024-09-12T22:33:24.180 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.180 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.180 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:24.180 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.469163+0000", 2024-09-12T22:33:24.180 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1222000000000004e-05 2024-09-12T22:33:24.180 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.180 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.180 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:24.180 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.472379+0000", 2024-09-12T22:33:24.180 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0032156419999999999 2024-09-12T22:33:24.180 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.181 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.181 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:24.181 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496661+0000", 2024-09-12T22:33:24.181 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.024281857 2024-09-12T22:33:24.181 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.181 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.181 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:24.181 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496687+0000", 2024-09-12T22:33:24.181 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6551e-05 2024-09-12T22:33:24.181 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:24.181 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:24.181 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:24.181 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496705+0000", 2024-09-12T22:33:24.182 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.8230999999999999e-05 2024-09-12T22:33:24.182 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:24.182 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:24.182 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:24.182 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:24.182 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:24.182 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-09-12T22:33:24.183 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:33:24.184 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:24.182+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:24.284 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:24.283+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:24.288 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:33:24.288 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:33:24.289 INFO:teuthology.orchestra.run.smithi148.stdout: "num_ops": 0 2024-09-12T22:33:24.289 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:33:24.297 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:33:24.384 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:24.383+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:24.450 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:33:24.451 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:33:24.451 INFO:teuthology.orchestra.run.smithi148.stdout: "complaint_time": 30, 2024-09-12T22:33:24.451 INFO:teuthology.orchestra.run.smithi148.stdout: "num_blocked_ops": 0 2024-09-12T22:33:24.451 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:33:24.453 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T22:33:24.459 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:33:24.486 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:24.484+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:24.579 INFO:teuthology.orchestra.run.smithi019.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-12T22:33:24.587 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:24.585+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:24.603 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T22:33:24.603 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:33:24.620 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:33:24.620 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:33:24.626 INFO:teuthology.orchestra.run.smithi019.stdout:osd.2: {} 2024-09-12T22:33:24.627 INFO:teuthology.orchestra.run.smithi019.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T22:33:24.629 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:33:24.630 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:33:24.630 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:33:24.687 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:24.686+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:24.735 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:33:24.735 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:33:24.744 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:33:24.789 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:24.787+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:24.889 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:33:24.889 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:33:24.890 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:24.888+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:24.898 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:33:24.991 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:24.990+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:25.041 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:33:25.041 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:33:25.050 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:33:25.092 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:25.091+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:25.159 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:33:25.160 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:33:25.169 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:33:25.193 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:25.192+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:25.276 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:33:25.277 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:33:25.286 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:33:25.294 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:25.293+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:25.392 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:33:25.392 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:33:25.395 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:25.394+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:25.401 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:33:25.497 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:25.496+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:25.513 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:33:25.514 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:33:25.527 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:33:25.599 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:25.597+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:25.624 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T22:33:25.685 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:33:25.685 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:33:25.694 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:33:25.699 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:25.698+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:25.799 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:25.799+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:25.843 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:33:25.843 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:33:25.852 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:33:25.901 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:25.900+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:25.957 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:33:25.957 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:33:25.966 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:33:26.002 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:26.001+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:26.103 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:26.102+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:26.108 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:33:26.108 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:33:26.117 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:33:26.204 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:26.203+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:26.263 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:33:26.263 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:33:26.272 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:33:26.317 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:26.316+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:26.379 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:33:26.379 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:33:26.388 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:33:26.430 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:26.428+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:26.508 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:26.507+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:26.554 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:33:26.554 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:33:26.567 INFO:teuthology.orchestra.run.smithi019.stderr:noscrub is unset 2024-09-12T22:33:26.568 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:33:26.613 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:26.611+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:26.632 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T22:33:26.710 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:26.709+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:26.727 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:33:26.727 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:33:26.736 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:33:26.752 INFO:teuthology.orchestra.run.smithi019.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-12T22:33:26.772 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T22:33:26.772 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:33:26.793 INFO:teuthology.orchestra.run.smithi019.stdout:osd.2: {} 2024-09-12T22:33:26.793 INFO:teuthology.orchestra.run.smithi019.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T22:33:26.796 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:33:26.796 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:33:26.811 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:26.810+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:26.843 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:33:26.843 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:33:26.843 INFO:teuthology.orchestra.run.smithi148.stdout: "num_ops": 0 2024-09-12T22:33:26.843 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:33:26.852 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:33:26.912 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:26.910+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:26.960 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:33:26.960 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:33:26.960 INFO:teuthology.orchestra.run.smithi148.stdout: "complaint_time": 30, 2024-09-12T22:33:26.960 INFO:teuthology.orchestra.run.smithi148.stdout: "num_blocked_ops": 0 2024-09-12T22:33:26.960 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:33:26.969 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:33:27.013 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:27.012+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:27.078 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:33:27.078 INFO:teuthology.orchestra.run.smithi148.stdout: "size": 20, 2024-09-12T22:33:27.079 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 600, 2024-09-12T22:33:27.079 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [ 2024-09-12T22:33:27.079 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.079 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4490.0:9866 4.b 4:d370243b:::10000002d48.00000000:head [write 0~1308] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:33:27.079 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:09.467883+0000", 2024-09-12T22:33:27.079 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 17.608405940000001, 2024-09-12T22:33:27.079 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.085024817000000003, 2024-09-12T22:33:27.079 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:27.079 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:27.079 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:27.080 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:33:27.080 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4490", 2024-09-12T22:33:27.080 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:27.080 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 9866 2024-09-12T22:33:27.080 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.080 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:27.080 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.080 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:27.080 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.467883+0000", 2024-09-12T22:33:27.080 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:27.080 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.080 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.080 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:27.081 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.467883+0000", 2024-09-12T22:33:27.081 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:27.081 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.081 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.081 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:27.081 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.467884+0000", 2024-09-12T22:33:27.081 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1800000000000005e-07 2024-09-12T22:33:27.081 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.081 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.081 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:27.081 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.467888+0000", 2024-09-12T22:33:27.081 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5959999999999997e-06 2024-09-12T22:33:27.082 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.082 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.082 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:27.082 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.467896+0000", 2024-09-12T22:33:27.082 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.8679999999999999e-06 2024-09-12T22:33:27.082 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.082 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.082 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:27.083 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.467901+0000", 2024-09-12T22:33:27.083 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9169999999999997e-06 2024-09-12T22:33:27.083 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.083 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.083 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:27.083 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.467944+0000", 2024-09-12T22:33:27.083 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3055e-05 2024-09-12T22:33:27.083 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.083 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.083 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:27.083 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.468011+0000", 2024-09-12T22:33:27.083 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7328000000000003e-05 2024-09-12T22:33:27.083 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.083 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.084 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:27.084 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.468078+0000", 2024-09-12T22:33:27.084 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7063999999999994e-05 2024-09-12T22:33:27.084 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.084 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.084 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:27.084 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.551406+0000", 2024-09-12T22:33:27.084 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.083327485000000007 2024-09-12T22:33:27.084 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.084 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.084 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:27.084 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.552822+0000", 2024-09-12T22:33:27.085 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001415929 2024-09-12T22:33:27.085 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.085 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.085 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:27.085 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.552863+0000", 2024-09-12T22:33:27.085 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0809000000000002e-05 2024-09-12T22:33:27.085 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.085 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.085 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:27.085 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.552908+0000", 2024-09-12T22:33:27.085 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5048e-05 2024-09-12T22:33:27.085 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:27.085 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:27.085 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:27.086 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.086 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.086 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4490.0:9867 4.16 4:6bd8f1b8:::10000002d49.00000000:head [write 0~1599] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:33:27.086 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:09.468760+0000", 2024-09-12T22:33:27.086 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 17.607528931000001, 2024-09-12T22:33:27.086 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.086660499000000002, 2024-09-12T22:33:27.086 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:27.086 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:27.086 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:27.086 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:33:27.086 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4490", 2024-09-12T22:33:27.086 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:27.086 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 9867 2024-09-12T22:33:27.087 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.087 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:27.087 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.087 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:27.087 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.468760+0000", 2024-09-12T22:33:27.087 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:27.087 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.087 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.087 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:27.087 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.468760+0000", 2024-09-12T22:33:27.087 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:27.087 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.088 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.088 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:27.088 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.468761+0000", 2024-09-12T22:33:27.088 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4399999999999999e-07 2024-09-12T22:33:27.088 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.088 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.088 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:27.088 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.468765+0000", 2024-09-12T22:33:27.088 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3259999999999997e-06 2024-09-12T22:33:27.088 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.088 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.088 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:27.089 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.548969+0000", 2024-09-12T22:33:27.089 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.080204172000000004 2024-09-12T22:33:27.089 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.089 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.089 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:27.089 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.549001+0000", 2024-09-12T22:33:27.089 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.1464999999999998e-05 2024-09-12T22:33:27.089 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.089 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.089 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:27.089 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.549148+0000", 2024-09-12T22:33:27.089 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014749399999999999 2024-09-12T22:33:27.089 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.089 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.090 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:27.090 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.549379+0000", 2024-09-12T22:33:27.090 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000231091 2024-09-12T22:33:27.090 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.090 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.090 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:27.090 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.549518+0000", 2024-09-12T22:33:27.090 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013844899999999999 2024-09-12T22:33:27.090 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.090 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.090 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:27.090 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.552236+0000", 2024-09-12T22:33:27.090 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0027179869999999998 2024-09-12T22:33:27.091 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.091 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.091 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:27.091 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.555333+0000", 2024-09-12T22:33:27.091 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0030973559999999999 2024-09-12T22:33:27.091 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.091 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.091 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:27.091 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.555379+0000", 2024-09-12T22:33:27.091 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6236999999999998e-05 2024-09-12T22:33:27.091 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.091 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.091 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:27.091 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.555420+0000", 2024-09-12T22:33:27.092 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1177999999999998e-05 2024-09-12T22:33:27.092 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:27.092 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:27.092 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:27.092 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.092 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.092 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop_reply(client.4490.0:9866 4.b e53/18 ondisk, result = 0)", 2024-09-12T22:33:27.092 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:09.468826+0000", 2024-09-12T22:33:27.092 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 17.607462636000001, 2024-09-12T22:33:27.092 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.082588348000000006, 2024-09-12T22:33:27.092 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:27.092 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:27.092 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:33:27.092 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:27.093 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.093 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:27.093 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.468826+0000", 2024-09-12T22:33:27.093 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:27.093 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.093 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.093 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:27.093 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.468826+0000", 2024-09-12T22:33:27.093 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:27.093 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.093 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.093 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:27.094 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.468827+0000", 2024-09-12T22:33:27.094 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3399999999999999e-07 2024-09-12T22:33:27.094 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.094 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.094 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:27.094 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.468830+0000", 2024-09-12T22:33:27.094 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.1559999999999999e-06 2024-09-12T22:33:27.094 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.094 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.094 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:27.094 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.548957+0000", 2024-09-12T22:33:27.095 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.080126852999999998 2024-09-12T22:33:27.095 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.095 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.095 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:27.095 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.548989+0000", 2024-09-12T22:33:27.095 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2409000000000001e-05 2024-09-12T22:33:27.095 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.095 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.095 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:27.095 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.551065+0000", 2024-09-12T22:33:27.095 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.002075871 2024-09-12T22:33:27.095 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.095 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.096 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:27.096 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.551398+0000", 2024-09-12T22:33:27.096 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00033339099999999999 2024-09-12T22:33:27.096 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.096 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.096 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:27.096 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.551414+0000", 2024-09-12T22:33:27.096 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6133999999999998e-05 2024-09-12T22:33:27.096 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:27.096 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:27.096 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:27.096 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.096 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.097 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4490.0:10437 4.2f 4:f6cd553b:::10000002fce.00000000:head [write 0~27313] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:33:27.097 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:10.050890+0000", 2024-09-12T22:33:27.097 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 17.025398240000001, 2024-09-12T22:33:27.097 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.056482601, 2024-09-12T22:33:27.097 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:27.097 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:27.097 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:27.097 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:33:27.097 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4490", 2024-09-12T22:33:27.097 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:27.097 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 10437 2024-09-12T22:33:27.097 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.097 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:27.098 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.098 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:27.098 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.050890+0000", 2024-09-12T22:33:27.098 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:27.098 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.098 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.098 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:27.098 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.050890+0000", 2024-09-12T22:33:27.098 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:27.098 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.098 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.098 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:27.098 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.050891+0000", 2024-09-12T22:33:27.099 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.6600000000000005e-07 2024-09-12T22:33:27.099 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.099 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.099 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:27.099 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.050906+0000", 2024-09-12T22:33:27.099 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4521e-05 2024-09-12T22:33:27.099 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.099 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.099 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:27.099 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.050915+0000", 2024-09-12T22:33:27.099 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.2569999999999996e-06 2024-09-12T22:33:27.099 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.099 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.100 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:27.100 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.050920+0000", 2024-09-12T22:33:27.100 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.724e-06 2024-09-12T22:33:27.100 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.100 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.100 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:27.100 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.050960+0000", 2024-09-12T22:33:27.100 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9999000000000001e-05 2024-09-12T22:33:27.100 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.100 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.100 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:27.100 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.051031+0000", 2024-09-12T22:33:27.100 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1007000000000006e-05 2024-09-12T22:33:27.101 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.101 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.101 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:27.101 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.107249+0000", 2024-09-12T22:33:27.101 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.056218432999999998 2024-09-12T22:33:27.101 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.102 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.102 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:27.102 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.107301+0000", 2024-09-12T22:33:27.102 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1289000000000003e-05 2024-09-12T22:33:27.102 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.102 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.102 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:27.102 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.107373+0000", 2024-09-12T22:33:27.102 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.2504999999999998e-05 2024-09-12T22:33:27.102 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:27.102 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:27.102 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:27.103 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.103 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.103 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4490.0:10439 4.12 4:483953cb:::10000002fd0.00000000:head [write 0~4842] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:33:27.103 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:10.052567+0000", 2024-09-12T22:33:27.103 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 17.023722031999998, 2024-09-12T22:33:27.103 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.055835449000000002, 2024-09-12T22:33:27.103 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:27.103 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:27.103 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:27.103 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:33:27.103 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4490", 2024-09-12T22:33:27.103 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:27.104 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 10439 2024-09-12T22:33:27.104 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.104 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:27.104 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.104 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:27.104 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.052567+0000", 2024-09-12T22:33:27.104 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:27.104 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.104 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.104 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:27.104 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.052567+0000", 2024-09-12T22:33:27.104 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:27.104 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.105 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.105 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:27.105 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.052568+0000", 2024-09-12T22:33:27.105 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.3600000000000002e-07 2024-09-12T22:33:27.105 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.105 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.105 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:27.105 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.052591+0000", 2024-09-12T22:33:27.105 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.3110000000000001e-05 2024-09-12T22:33:27.105 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.105 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.105 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:27.105 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.106740+0000", 2024-09-12T22:33:27.106 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.054149315000000003 2024-09-12T22:33:27.106 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.106 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.106 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:27.106 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.106751+0000", 2024-09-12T22:33:27.106 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1056000000000001e-05 2024-09-12T22:33:27.106 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.106 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.106 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:27.106 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.106811+0000", 2024-09-12T22:33:27.106 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9515999999999997e-05 2024-09-12T22:33:27.106 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.106 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.107 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:27.107 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.106929+0000", 2024-09-12T22:33:27.107 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00011879000000000001 2024-09-12T22:33:27.107 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.107 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.107 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:27.107 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.108283+0000", 2024-09-12T22:33:27.107 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001354177 2024-09-12T22:33:27.107 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.107 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.107 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:27.107 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.108328+0000", 2024-09-12T22:33:27.107 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4931000000000001e-05 2024-09-12T22:33:27.108 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.108 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.108 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:27.108 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.108402+0000", 2024-09-12T22:33:27.108 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3718000000000001e-05 2024-09-12T22:33:27.108 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:27.108 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:27.108 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:27.108 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.108 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.108 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(client.4490.0:10445 4.3c e53/18 4:3d97251e:::10000002fd8.00000000:head v 53'154, mlcod=53'152)", 2024-09-12T22:33:27.108 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:10.058521+0000", 2024-09-12T22:33:27.109 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 17.017767692, 2024-09-12T22:33:27.109 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.049310138000000003, 2024-09-12T22:33:27.109 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:27.109 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:27.109 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:27.109 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:27.109 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.109 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:27.109 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.058521+0000", 2024-09-12T22:33:27.109 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:27.109 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.109 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.109 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:27.110 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.058521+0000", 2024-09-12T22:33:27.110 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:27.110 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.110 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.110 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:27.110 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.058522+0000", 2024-09-12T22:33:27.110 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.1099999999999995e-07 2024-09-12T22:33:27.110 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.110 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.110 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:27.110 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.058530+0000", 2024-09-12T22:33:27.110 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.7290000000000006e-06 2024-09-12T22:33:27.110 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.110 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.111 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:27.111 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.106760+0000", 2024-09-12T22:33:27.111 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.048229384 2024-09-12T22:33:27.111 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.111 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.111 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:27.111 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.106770+0000", 2024-09-12T22:33:27.111 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0431999999999999e-05 2024-09-12T22:33:27.111 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.111 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.111 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:27.111 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.106823+0000", 2024-09-12T22:33:27.111 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2309999999999999e-05 2024-09-12T22:33:27.111 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.112 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.112 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:27.112 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.106841+0000", 2024-09-12T22:33:27.112 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.8218000000000001e-05 2024-09-12T22:33:27.112 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.112 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.112 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:27.112 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.107796+0000", 2024-09-12T22:33:27.112 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00095552600000000005 2024-09-12T22:33:27.112 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.112 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.112 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:27.112 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.107831+0000", 2024-09-12T22:33:27.113 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4928000000000002e-05 2024-09-12T22:33:27.113 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:27.113 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:27.113 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:27.113 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.113 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.113 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4490.0:11351 4.3f 4:fd498422:::10000003188.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-12T22:33:27.113 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:13.354715+0000", 2024-09-12T22:33:27.113 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 13.721573877999999, 2024-09-12T22:33:27.113 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.043059568999999999, 2024-09-12T22:33:27.113 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:27.113 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:27.113 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:27.114 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:33:27.114 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4490", 2024-09-12T22:33:27.114 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:27.114 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 11351 2024-09-12T22:33:27.114 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.114 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:27.114 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.114 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:27.114 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.354715+0000", 2024-09-12T22:33:27.114 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:27.114 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.114 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.114 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:27.114 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.354715+0000", 2024-09-12T22:33:27.114 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:27.115 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.115 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.115 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:27.115 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.354716+0000", 2024-09-12T22:33:27.115 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.7600000000000006e-07 2024-09-12T22:33:27.115 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.115 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.115 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:27.115 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.361477+0000", 2024-09-12T22:33:27.115 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0067607090000000002 2024-09-12T22:33:27.115 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.115 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.115 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:27.115 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.361487+0000", 2024-09-12T22:33:27.116 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0249e-05 2024-09-12T22:33:27.116 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.116 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.116 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:27.116 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.361493+0000", 2024-09-12T22:33:27.116 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.4699999999999999e-06 2024-09-12T22:33:27.116 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.116 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.116 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:27.116 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.361544+0000", 2024-09-12T22:33:27.116 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1124e-05 2024-09-12T22:33:27.116 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.116 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.117 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:27.117 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.361604+0000", 2024-09-12T22:33:27.117 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9397000000000001e-05 2024-09-12T22:33:27.117 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.117 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.117 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:27.117 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.397601+0000", 2024-09-12T22:33:27.117 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.035996927999999997 2024-09-12T22:33:27.117 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.117 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.117 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:27.117 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.397646+0000", 2024-09-12T22:33:27.117 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5176000000000003e-05 2024-09-12T22:33:27.117 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.118 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.118 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:27.118 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.397774+0000", 2024-09-12T22:33:27.118 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012854000000000001 2024-09-12T22:33:27.118 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:27.118 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:27.118 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:27.118 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.118 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.118 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4490.0:12798 4.3e 4:7eb070ca:::100000030e0.00000000:head [write 0~4194304 [5@1189789]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-12T22:33:27.118 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:15.140228+0000", 2024-09-12T22:33:27.118 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 11.936061228, 2024-09-12T22:33:27.118 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.046073232999999998, 2024-09-12T22:33:27.118 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:27.119 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:27.119 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:27.119 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:33:27.119 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4490", 2024-09-12T22:33:27.119 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:27.119 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 12798 2024-09-12T22:33:27.119 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.119 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:27.119 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.119 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:27.119 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.140228+0000", 2024-09-12T22:33:27.119 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:27.119 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.120 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.120 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:27.120 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.140228+0000", 2024-09-12T22:33:27.120 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:27.120 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.120 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.120 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:27.120 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.140228+0000", 2024-09-12T22:33:27.120 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5899999999999996e-07 2024-09-12T22:33:27.120 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.120 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.120 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:27.121 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.147541+0000", 2024-09-12T22:33:27.121 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0073125339999999999 2024-09-12T22:33:27.121 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.121 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.121 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:27.121 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.147555+0000", 2024-09-12T22:33:27.121 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.42e-05 2024-09-12T22:33:27.121 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.121 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.121 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:27.121 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.147564+0000", 2024-09-12T22:33:27.121 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.0999999999999993e-06 2024-09-12T22:33:27.121 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.122 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.122 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:27.122 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.147637+0000", 2024-09-12T22:33:27.122 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3288999999999996e-05 2024-09-12T22:33:27.122 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.122 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.122 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:27.122 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.147725+0000", 2024-09-12T22:33:27.122 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.7622999999999998e-05 2024-09-12T22:33:27.122 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.122 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.122 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:27.122 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.186239+0000", 2024-09-12T22:33:27.122 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.038514171 2024-09-12T22:33:27.123 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.123 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.123 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:27.123 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.186265+0000", 2024-09-12T22:33:27.123 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5738e-05 2024-09-12T22:33:27.123 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.123 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.123 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:27.123 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.186301+0000", 2024-09-12T22:33:27.123 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.6019000000000002e-05 2024-09-12T22:33:27.123 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:27.123 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:27.123 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:27.124 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.124 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.124 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3063 3.2 3:42569fed:::200.00000011:head [write 3915305~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:33:27.124 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:19.386685+0000", 2024-09-12T22:33:27.124 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 7.689603999, 2024-09-12T22:33:27.124 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.042365220000000002, 2024-09-12T22:33:27.124 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:27.124 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:27.124 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:27.124 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:27.124 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.124 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:27.124 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386685+0000", 2024-09-12T22:33:27.125 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:27.125 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.125 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.125 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:27.125 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386685+0000", 2024-09-12T22:33:27.125 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:27.125 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.125 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.126 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:27.126 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386685+0000", 2024-09-12T22:33:27.127 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.08e-07 2024-09-12T22:33:27.127 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.127 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.127 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:27.127 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386688+0000", 2024-09-12T22:33:27.127 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8880000000000001e-06 2024-09-12T22:33:27.127 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.127 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.128 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:27.128 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386694+0000", 2024-09-12T22:33:27.128 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8089999999999998e-06 2024-09-12T22:33:27.128 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.128 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.128 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:27.128 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386699+0000", 2024-09-12T22:33:27.128 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8010000000000003e-06 2024-09-12T22:33:27.128 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.129 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.129 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:27.129 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.427136+0000", 2024-09-12T22:33:27.129 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.04043712 2024-09-12T22:33:27.129 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.129 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.129 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:27.129 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.427185+0000", 2024-09-12T22:33:27.129 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9493999999999997e-05 2024-09-12T22:33:27.130 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.130 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.130 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:27.130 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.428988+0000", 2024-09-12T22:33:27.130 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001803191 2024-09-12T22:33:27.130 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.130 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.130 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:27.130 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.429015+0000", 2024-09-12T22:33:27.130 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.6438999999999999e-05 2024-09-12T22:33:27.130 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.130 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.130 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:27.131 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.429050+0000", 2024-09-12T22:33:27.131 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.5070000000000001e-05 2024-09-12T22:33:27.131 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:27.131 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:27.131 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:27.131 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.131 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.131 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3064 3.2 3:42569fed:::200.00000011:head [write 3916704~1398 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:33:27.131 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:19.386705+0000", 2024-09-12T22:33:27.131 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 7.6895842239999999, 2024-09-12T22:33:27.131 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.043238378000000001, 2024-09-12T22:33:27.131 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:27.131 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:27.132 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:27.132 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:27.132 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.132 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:27.132 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386705+0000", 2024-09-12T22:33:27.132 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:27.132 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.132 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.132 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:27.133 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386705+0000", 2024-09-12T22:33:27.133 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:27.133 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.133 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.133 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:27.133 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386705+0000", 2024-09-12T22:33:27.133 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.8299999999999998e-07 2024-09-12T22:33:27.133 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.133 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.134 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:27.134 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386711+0000", 2024-09-12T22:33:27.134 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7080000000000002e-06 2024-09-12T22:33:27.134 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.134 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.134 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:27.134 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386717+0000", 2024-09-12T22:33:27.134 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.3990000000000001e-06 2024-09-12T22:33:27.134 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.135 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.135 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:27.135 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386722+0000", 2024-09-12T22:33:27.135 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9219999999999996e-06 2024-09-12T22:33:27.135 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.135 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.135 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:27.135 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.427585+0000", 2024-09-12T22:33:27.135 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.040863414000000001 2024-09-12T22:33:27.136 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.136 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.136 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:27.136 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.427628+0000", 2024-09-12T22:33:27.136 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2873000000000001e-05 2024-09-12T22:33:27.136 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.137 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.137 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:27.137 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.429871+0000", 2024-09-12T22:33:27.137 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.002242572 2024-09-12T22:33:27.137 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.137 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.137 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:27.137 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.429901+0000", 2024-09-12T22:33:27.138 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0114e-05 2024-09-12T22:33:27.138 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.138 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.138 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:27.138 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.429943+0000", 2024-09-12T22:33:27.138 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1993000000000003e-05 2024-09-12T22:33:27.138 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:27.138 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:27.138 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:27.138 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.139 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.139 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3065 3.2 3:42569fed:::200.00000011:head [write 3918102~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:33:27.139 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:19.386735+0000", 2024-09-12T22:33:27.139 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 7.6895540169999999, 2024-09-12T22:33:27.139 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.043278369999999997, 2024-09-12T22:33:27.139 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:27.139 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:27.139 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:27.139 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:27.139 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.139 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:27.139 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386735+0000", 2024-09-12T22:33:27.139 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:27.139 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.140 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.140 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:27.140 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386735+0000", 2024-09-12T22:33:27.140 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:27.140 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.140 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.140 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:27.140 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386735+0000", 2024-09-12T22:33:27.140 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.7300000000000001e-07 2024-09-12T22:33:27.140 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.140 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.140 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:27.141 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386738+0000", 2024-09-12T22:33:27.141 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8420000000000001e-06 2024-09-12T22:33:27.141 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.141 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.141 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:27.141 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386744+0000", 2024-09-12T22:33:27.141 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.3040000000000001e-06 2024-09-12T22:33:27.141 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.141 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.141 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:27.141 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386749+0000", 2024-09-12T22:33:27.142 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8409999999999999e-06 2024-09-12T22:33:27.142 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.142 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.142 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:27.142 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.428112+0000", 2024-09-12T22:33:27.142 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.041363204000000001 2024-09-12T22:33:27.142 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.142 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.142 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:27.142 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.428158+0000", 2024-09-12T22:33:27.142 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5756e-05 2024-09-12T22:33:27.142 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.142 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.143 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:27.143 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.429950+0000", 2024-09-12T22:33:27.143 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0017922859999999999 2024-09-12T22:33:27.143 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.143 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.143 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:27.143 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.429975+0000", 2024-09-12T22:33:27.143 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4640000000000001e-05 2024-09-12T22:33:27.143 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.143 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.143 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:27.143 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.430013+0000", 2024-09-12T22:33:27.143 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.8024000000000001e-05 2024-09-12T22:33:27.144 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:27.144 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:27.144 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:27.144 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.144 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.144 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3066 3.2 3:42569fed:::200.00000011:head [write 3919501~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:33:27.144 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:19.386755+0000", 2024-09-12T22:33:27.144 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 7.689533376, 2024-09-12T22:33:27.144 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.044668934, 2024-09-12T22:33:27.144 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:27.144 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:27.145 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:27.145 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:27.145 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.145 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:27.145 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386755+0000", 2024-09-12T22:33:27.145 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:27.145 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.145 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.145 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:27.145 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386755+0000", 2024-09-12T22:33:27.145 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:27.146 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.146 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.146 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:27.146 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386756+0000", 2024-09-12T22:33:27.146 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4499999999999997e-07 2024-09-12T22:33:27.146 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.146 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.146 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:27.146 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386763+0000", 2024-09-12T22:33:27.146 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.6459999999999993e-06 2024-09-12T22:33:27.147 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.147 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.147 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:27.147 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386770+0000", 2024-09-12T22:33:27.147 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.19e-06 2024-09-12T22:33:27.147 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.147 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.147 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:27.147 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386775+0000", 2024-09-12T22:33:27.147 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9640000000000002e-06 2024-09-12T22:33:27.147 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.147 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.148 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:27.148 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.428489+0000", 2024-09-12T22:33:27.148 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.041714539000000002 2024-09-12T22:33:27.148 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.148 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.148 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:27.148 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.428535+0000", 2024-09-12T22:33:27.149 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5658999999999998e-05 2024-09-12T22:33:27.149 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.149 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.149 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:27.149 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.431353+0000", 2024-09-12T22:33:27.150 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0028186270000000002 2024-09-12T22:33:27.150 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.150 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.150 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:27.150 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.431385+0000", 2024-09-12T22:33:27.150 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.1374000000000001e-05 2024-09-12T22:33:27.150 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.150 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.150 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:27.150 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.431424+0000", 2024-09-12T22:33:27.151 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9490000000000003e-05 2024-09-12T22:33:27.151 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:27.151 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:27.151 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:27.151 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.151 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.151 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3067 3.2 3:42569fed:::200.00000011:head [write 3920900~2245 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:33:27.151 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:19.386781+0000", 2024-09-12T22:33:27.151 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 7.6895074870000002, 2024-09-12T22:33:27.151 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.044711322999999997, 2024-09-12T22:33:27.151 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:27.151 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:27.151 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:27.152 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:27.152 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.152 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:27.152 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386781+0000", 2024-09-12T22:33:27.152 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:27.152 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.152 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.152 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:27.152 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386781+0000", 2024-09-12T22:33:27.152 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:27.152 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.153 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.153 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:27.153 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386782+0000", 2024-09-12T22:33:27.153 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9900000000000001e-07 2024-09-12T22:33:27.153 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.153 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.153 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:27.153 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386795+0000", 2024-09-12T22:33:27.153 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2864000000000001e-05 2024-09-12T22:33:27.153 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.153 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.153 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:27.153 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386801+0000", 2024-09-12T22:33:27.154 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.3589999999999996e-06 2024-09-12T22:33:27.154 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.154 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.154 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:27.154 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386805+0000", 2024-09-12T22:33:27.154 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6190000000000002e-06 2024-09-12T22:33:27.154 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.154 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.154 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:27.154 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.429080+0000", 2024-09-12T22:33:27.155 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.042274027999999998 2024-09-12T22:33:27.155 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.155 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.155 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:27.155 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.429131+0000", 2024-09-12T22:33:27.155 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1715000000000002e-05 2024-09-12T22:33:27.155 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.155 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.155 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:27.155 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.431432+0000", 2024-09-12T22:33:27.155 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0023007489999999999 2024-09-12T22:33:27.155 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.155 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.156 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:27.156 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.431458+0000", 2024-09-12T22:33:27.156 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.603e-05 2024-09-12T22:33:27.156 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.156 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.156 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:27.156 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.431493+0000", 2024-09-12T22:33:27.156 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4560000000000001e-05 2024-09-12T22:33:27.156 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:27.156 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:27.156 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:27.156 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.157 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.157 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3068 3.2 3:42569fed:::200.00000011:head [write 3923145~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:33:27.157 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:19.386812+0000", 2024-09-12T22:33:27.157 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 7.6894767279999998, 2024-09-12T22:33:27.157 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.045559559999999999, 2024-09-12T22:33:27.157 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:27.158 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:27.158 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:27.158 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:27.158 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.158 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:27.158 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386812+0000", 2024-09-12T22:33:27.158 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:27.158 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.158 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.158 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:27.158 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386812+0000", 2024-09-12T22:33:27.159 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:27.159 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.159 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.159 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:27.159 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386812+0000", 2024-09-12T22:33:27.159 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.01e-07 2024-09-12T22:33:27.159 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.159 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.159 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:27.159 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386823+0000", 2024-09-12T22:33:27.160 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1038e-05 2024-09-12T22:33:27.160 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.160 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.160 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:27.160 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386830+0000", 2024-09-12T22:33:27.160 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.5409999999999997e-06 2024-09-12T22:33:27.160 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.160 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.160 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:27.160 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386835+0000", 2024-09-12T22:33:27.160 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.091e-06 2024-09-12T22:33:27.160 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.160 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.161 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:27.161 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.429460+0000", 2024-09-12T22:33:27.161 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.042625333000000001 2024-09-12T22:33:27.161 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.161 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.161 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:27.161 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.429506+0000", 2024-09-12T22:33:27.161 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5299000000000001e-05 2024-09-12T22:33:27.161 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.161 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.161 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:27.161 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.432283+0000", 2024-09-12T22:33:27.161 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0027776799999999998 2024-09-12T22:33:27.161 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.162 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.162 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:27.162 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.432315+0000", 2024-09-12T22:33:27.162 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.1401e-05 2024-09-12T22:33:27.162 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.162 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.162 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:27.162 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.432372+0000", 2024-09-12T22:33:27.162 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.6776e-05 2024-09-12T22:33:27.162 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:27.162 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:27.162 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:27.162 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.163 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.163 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3069 3.2 3:42569fed:::200.00000011:head [write 3924544~2246 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:33:27.163 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:19.386842+0000", 2024-09-12T22:33:27.163 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 7.6894468280000003, 2024-09-12T22:33:27.163 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.045596166, 2024-09-12T22:33:27.163 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:27.163 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:27.163 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:27.163 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:27.164 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.164 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:27.164 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386842+0000", 2024-09-12T22:33:27.164 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:27.164 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.164 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.164 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:27.164 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386842+0000", 2024-09-12T22:33:27.164 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:27.164 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.164 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.165 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:27.165 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386842+0000", 2024-09-12T22:33:27.165 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5200000000000002e-07 2024-09-12T22:33:27.165 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.165 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.165 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:27.165 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386845+0000", 2024-09-12T22:33:27.165 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8820000000000001e-06 2024-09-12T22:33:27.165 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.165 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.166 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:27.166 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386851+0000", 2024-09-12T22:33:27.166 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9540000000000001e-06 2024-09-12T22:33:27.166 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.166 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.166 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:27.166 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386856+0000", 2024-09-12T22:33:27.166 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5159999999999996e-06 2024-09-12T22:33:27.166 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.167 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.167 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:27.167 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.430043+0000", 2024-09-12T22:33:27.167 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.043186930999999998 2024-09-12T22:33:27.167 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.167 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.167 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:27.167 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.430086+0000", 2024-09-12T22:33:27.167 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3844999999999998e-05 2024-09-12T22:33:27.167 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.168 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.168 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:27.168 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.432379+0000", 2024-09-12T22:33:27.168 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0022922049999999999 2024-09-12T22:33:27.168 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.168 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.168 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:27.168 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.432405+0000", 2024-09-12T22:33:27.169 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5877999999999999e-05 2024-09-12T22:33:27.169 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.169 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.169 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:27.169 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.432438+0000", 2024-09-12T22:33:27.169 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3503000000000001e-05 2024-09-12T22:33:27.170 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:27.170 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:27.170 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:27.170 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.170 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.170 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3070 3.2 3:42569fed:::200.00000011:head [write 3926790~2768 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:33:27.170 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:19.387280+0000", 2024-09-12T22:33:27.170 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 7.6890086599999998, 2024-09-12T22:33:27.170 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.04692201, 2024-09-12T22:33:27.170 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:27.171 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:27.171 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:27.171 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:27.171 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.171 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:27.171 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.387280+0000", 2024-09-12T22:33:27.171 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:27.171 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.171 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.171 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:27.171 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.387280+0000", 2024-09-12T22:33:27.171 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:27.171 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.172 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.172 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:27.172 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.387281+0000", 2024-09-12T22:33:27.172 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4300000000000002e-07 2024-09-12T22:33:27.172 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.172 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.172 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:27.172 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.387285+0000", 2024-09-12T22:33:27.173 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2570000000000001e-06 2024-09-12T22:33:27.173 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.173 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.173 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:27.173 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.387293+0000", 2024-09-12T22:33:27.174 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0209999999999999e-06 2024-09-12T22:33:27.174 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.174 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.174 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:27.174 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.387299+0000", 2024-09-12T22:33:27.175 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.6930000000000004e-06 2024-09-12T22:33:27.175 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.175 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.175 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:27.175 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.430441+0000", 2024-09-12T22:33:27.176 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.043141789999999999 2024-09-12T22:33:27.176 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.176 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.176 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:27.176 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.430484+0000", 2024-09-12T22:33:27.177 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3745000000000002e-05 2024-09-12T22:33:27.177 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.177 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.177 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:27.177 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.434132+0000", 2024-09-12T22:33:27.177 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00364818 2024-09-12T22:33:27.178 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.178 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.178 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:27.178 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.434163+0000", 2024-09-12T22:33:27.178 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0599000000000003e-05 2024-09-12T22:33:27.178 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.178 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.178 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:27.179 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.434202+0000", 2024-09-12T22:33:27.179 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.8982e-05 2024-09-12T22:33:27.179 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:27.179 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:27.179 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:27.179 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.179 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.179 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3071 3.2 3:42569fed:::200.00000011:head [write 3929558~3203 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:33:27.179 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:19.387860+0000", 2024-09-12T22:33:27.179 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 7.6884286299999998, 2024-09-12T22:33:27.180 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.049590902999999999, 2024-09-12T22:33:27.180 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:27.180 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:27.180 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:27.180 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:27.180 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.180 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:27.180 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.387860+0000", 2024-09-12T22:33:27.180 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:27.180 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.180 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.180 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:27.180 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.387860+0000", 2024-09-12T22:33:27.181 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:27.181 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.181 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.181 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:27.181 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.387861+0000", 2024-09-12T22:33:27.181 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5099999999999999e-07 2024-09-12T22:33:27.181 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.181 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.181 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:27.181 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.387865+0000", 2024-09-12T22:33:27.181 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2629999999999997e-06 2024-09-12T22:33:27.181 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.181 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.182 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:27.182 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.387875+0000", 2024-09-12T22:33:27.182 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0256e-05 2024-09-12T22:33:27.182 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.182 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.182 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:27.182 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.387881+0000", 2024-09-12T22:33:27.182 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.947e-06 2024-09-12T22:33:27.182 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.182 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.182 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:27.182 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.430930+0000", 2024-09-12T22:33:27.182 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.043048386000000001 2024-09-12T22:33:27.182 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.183 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.183 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:27.183 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.430976+0000", 2024-09-12T22:33:27.183 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6408e-05 2024-09-12T22:33:27.183 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.183 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.183 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:27.183 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.437377+0000", 2024-09-12T22:33:27.183 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0064010719999999998 2024-09-12T22:33:27.183 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.183 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.183 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:27.183 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.437409+0000", 2024-09-12T22:33:27.184 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2054999999999997e-05 2024-09-12T22:33:27.184 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.184 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.184 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:27.184 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.437451+0000", 2024-09-12T22:33:27.184 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1764999999999997e-05 2024-09-12T22:33:27.184 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:27.184 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:27.184 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:27.184 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.185 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.185 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3072 3.2 3:42569fed:::200.00000011:head [write 3932761~2786 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:33:27.185 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:19.388005+0000", 2024-09-12T22:33:27.185 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 7.6882835309999997, 2024-09-12T22:33:27.185 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.049514177999999999, 2024-09-12T22:33:27.185 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:27.185 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:27.185 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:27.185 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:27.185 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.185 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:27.185 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.388005+0000", 2024-09-12T22:33:27.185 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:27.186 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.186 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.186 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:27.186 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.388005+0000", 2024-09-12T22:33:27.186 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:27.186 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.186 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.186 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:27.186 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.388006+0000", 2024-09-12T22:33:27.186 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.1799999999999995e-07 2024-09-12T22:33:27.186 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.186 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.186 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:27.187 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.388009+0000", 2024-09-12T22:33:27.187 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.574e-06 2024-09-12T22:33:27.187 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.187 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.187 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:27.187 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.388017+0000", 2024-09-12T22:33:27.187 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3170000000000004e-06 2024-09-12T22:33:27.187 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.187 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.187 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:27.187 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.388022+0000", 2024-09-12T22:33:27.187 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9910000000000002e-06 2024-09-12T22:33:27.187 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.188 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.188 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:27.188 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.431522+0000", 2024-09-12T22:33:27.188 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0435001 2024-09-12T22:33:27.188 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.188 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.188 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:27.188 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.431567+0000", 2024-09-12T22:33:27.188 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4734000000000002e-05 2024-09-12T22:33:27.188 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.188 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.188 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:27.188 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.437458+0000", 2024-09-12T22:33:27.188 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00589166 2024-09-12T22:33:27.189 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.189 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.189 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:27.189 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.437484+0000", 2024-09-12T22:33:27.189 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5622999999999998e-05 2024-09-12T22:33:27.189 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.189 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.189 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:27.189 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.437519+0000", 2024-09-12T22:33:27.189 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.5561000000000001e-05 2024-09-12T22:33:27.189 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:27.189 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:27.189 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:27.190 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.190 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.190 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3073 3.2 3:42569fed:::200.00000011:head [write 3935547~1924 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:33:27.190 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:19.389181+0000", 2024-09-12T22:33:27.190 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 7.6871073689999996, 2024-09-12T22:33:27.190 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.048402300000000002, 2024-09-12T22:33:27.190 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:27.190 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:27.190 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:27.190 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:27.190 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.191 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:27.191 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.389181+0000", 2024-09-12T22:33:27.191 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:27.191 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.191 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.191 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:27.191 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.389181+0000", 2024-09-12T22:33:27.191 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:27.191 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.191 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.192 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:27.192 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.389182+0000", 2024-09-12T22:33:27.192 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7700000000000004e-07 2024-09-12T22:33:27.192 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.192 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.192 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:27.192 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.389191+0000", 2024-09-12T22:33:27.192 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1120000000000002e-06 2024-09-12T22:33:27.192 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.192 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.192 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:27.192 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.389203+0000", 2024-09-12T22:33:27.192 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.146e-05 2024-09-12T22:33:27.193 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.193 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.193 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:27.193 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.389209+0000", 2024-09-12T22:33:27.193 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9989999999999997e-06 2024-09-12T22:33:27.193 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.193 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.194 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:27.194 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.431890+0000", 2024-09-12T22:33:27.194 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.042681251000000003 2024-09-12T22:33:27.194 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.194 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.194 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:27.194 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.431935+0000", 2024-09-12T22:33:27.194 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5166000000000001e-05 2024-09-12T22:33:27.195 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.195 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.195 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:27.195 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.437526+0000", 2024-09-12T22:33:27.195 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0055910489999999998 2024-09-12T22:33:27.195 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.195 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.195 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:27.195 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.437550+0000", 2024-09-12T22:33:27.196 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4134999999999998e-05 2024-09-12T22:33:27.196 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.196 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.196 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:27.196 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.437584+0000", 2024-09-12T22:33:27.196 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3451000000000002e-05 2024-09-12T22:33:27.196 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:27.196 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:27.196 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:27.196 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.197 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.197 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3074 3.2 3:42569fed:::200.00000011:head [write 3937471~7660 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:33:27.197 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:19.390512+0000", 2024-09-12T22:33:27.197 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 7.6857762459999996, 2024-09-12T22:33:27.197 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.047134045999999999, 2024-09-12T22:33:27.197 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:27.197 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:27.197 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:27.197 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:27.197 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.198 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:27.198 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.390512+0000", 2024-09-12T22:33:27.199 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:27.199 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.199 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.199 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:27.199 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.390512+0000", 2024-09-12T22:33:27.199 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:27.199 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.199 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.199 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:27.199 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.390513+0000", 2024-09-12T22:33:27.199 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.7699999999999992e-07 2024-09-12T22:33:27.200 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.200 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.200 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:27.200 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.390522+0000", 2024-09-12T22:33:27.200 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0390000000000005e-06 2024-09-12T22:33:27.200 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.200 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.200 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:27.200 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.390530+0000", 2024-09-12T22:33:27.200 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.8349999999999993e-06 2024-09-12T22:33:27.201 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.201 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.201 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:27.201 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.390537+0000", 2024-09-12T22:33:27.202 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.1850000000000001e-06 2024-09-12T22:33:27.202 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.202 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.202 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:27.203 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.432468+0000", 2024-09-12T22:33:27.203 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.041931883000000003 2024-09-12T22:33:27.203 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.203 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.204 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:27.204 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.432512+0000", 2024-09-12T22:33:27.204 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4054999999999997e-05 2024-09-12T22:33:27.204 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.204 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.204 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:27.205 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.437590+0000", 2024-09-12T22:33:27.205 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0050777230000000001 2024-09-12T22:33:27.205 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.205 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.205 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:27.206 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.437613+0000", 2024-09-12T22:33:27.206 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.2693000000000001e-05 2024-09-12T22:33:27.206 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:27.206 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:27.206 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:27.206 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.437647+0000", 2024-09-12T22:33:27.207 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3655999999999998e-05 2024-09-12T22:33:27.207 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:27.207 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:27.207 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:27.207 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:27.207 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:27.208 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:33:27.210 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:27.208+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:27.210 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:33:27.310 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~42s 2024-09-12T22:33:27.311 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:27.309+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:27.316 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-09-12T22:33:27.317 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-09-12T22:33:27.317 INFO:teuthology.orchestra.run.smithi163.stdout: "num_ops": 0 2024-09-12T22:33:27.317 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-09-12T22:33:27.326 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:33:27.410 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:27.409+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:27.433 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-09-12T22:33:27.434 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-09-12T22:33:27.434 INFO:teuthology.orchestra.run.smithi163.stdout: "complaint_time": 30, 2024-09-12T22:33:27.434 INFO:teuthology.orchestra.run.smithi163.stdout: "num_blocked_ops": 0 2024-09-12T22:33:27.434 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-09-12T22:33:27.442 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:33:27.511 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:27.510+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:27.613 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:27.611+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:27.642 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-09-12T22:33:27.642 INFO:teuthology.orchestra.run.smithi163.stdout: "size": 20, 2024-09-12T22:33:27.642 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 600, 2024-09-12T22:33:27.642 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2024-09-12T22:33:27.642 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.642 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-09-12T22:33:27.642 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:27.254459+0000", 2024-09-12T22:33:27.642 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 120.38465361, 2024-09-12T22:33:27.642 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.37816283899999997, 2024-09-12T22:33:27.642 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:27.642 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:27.643 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:27.643 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:27.643 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:33:27.643 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:33:27.643 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 1 2024-09-12T22:33:27.643 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.643 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:27.643 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.643 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:27.643 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254459+0000", 2024-09-12T22:33:27.643 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:27.643 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.643 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.643 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:27.644 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254459+0000", 2024-09-12T22:33:27.644 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:27.644 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.644 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.644 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:27.644 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254460+0000", 2024-09-12T22:33:27.644 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1739999999999999e-06 2024-09-12T22:33:27.644 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.644 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.644 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:27.644 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254472+0000", 2024-09-12T22:33:27.644 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2207e-05 2024-09-12T22:33:27.644 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.644 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.645 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:27.645 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254483+0000", 2024-09-12T22:33:27.645 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0631999999999999e-05 2024-09-12T22:33:27.645 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.645 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.645 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:27.645 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254492+0000", 2024-09-12T22:33:27.645 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3670000000000003e-06 2024-09-12T22:33:27.645 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.645 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.645 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:27.645 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254551+0000", 2024-09-12T22:33:27.645 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8687999999999998e-05 2024-09-12T22:33:27.645 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.646 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.646 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for peered", 2024-09-12T22:33:27.646 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254562+0000", 2024-09-12T22:33:27.646 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1249e-05 2024-09-12T22:33:27.646 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.646 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.646 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:27.646 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.631211+0000", 2024-09-12T22:33:27.646 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.376649018 2024-09-12T22:33:27.646 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.646 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.646 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:27.646 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.631345+0000", 2024-09-12T22:33:27.647 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013378700000000001 2024-09-12T22:33:27.647 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.647 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.647 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:33:27.647 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.631479+0000", 2024-09-12T22:33:27.647 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013352399999999999 2024-09-12T22:33:27.647 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.647 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.647 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:27.647 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632324+0000", 2024-09-12T22:33:27.647 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00084508100000000002 2024-09-12T22:33:27.647 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.647 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.647 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:27.648 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632548+0000", 2024-09-12T22:33:27.648 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000224329 2024-09-12T22:33:27.648 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.648 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.648 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:27.648 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632591+0000", 2024-09-12T22:33:27.648 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2564000000000001e-05 2024-09-12T22:33:27.648 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.649 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.649 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:27.649 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632622+0000", 2024-09-12T22:33:27.649 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1219e-05 2024-09-12T22:33:27.649 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:27.649 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:27.649 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:27.649 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.649 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.649 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4490.0:9871 4.35 4:ad66404a:::10000002d4d.00000000:head [write 0~6507] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:33:27.649 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:09.472309+0000", 2024-09-12T22:33:27.649 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 18.166803334000001, 2024-09-12T22:33:27.650 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.080251445000000005, 2024-09-12T22:33:27.650 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:27.650 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:27.650 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:27.650 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:27.650 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4490", 2024-09-12T22:33:27.650 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:27.650 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 9871 2024-09-12T22:33:27.650 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.650 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:27.650 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.650 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:27.650 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.472309+0000", 2024-09-12T22:33:27.650 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:27.651 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.651 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.651 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:27.651 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.472309+0000", 2024-09-12T22:33:27.651 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:27.651 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.651 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.651 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:27.651 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.472310+0000", 2024-09-12T22:33:27.651 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3799999999999996e-07 2024-09-12T22:33:27.651 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.651 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.651 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:27.651 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.472318+0000", 2024-09-12T22:33:27.652 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.8099999999999998e-06 2024-09-12T22:33:27.652 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.652 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.652 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:27.652 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.472328+0000", 2024-09-12T22:33:27.652 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0359e-05 2024-09-12T22:33:27.652 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.652 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.652 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:27.652 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.472334+0000", 2024-09-12T22:33:27.652 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.0109999999999997e-06 2024-09-12T22:33:27.652 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.652 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.652 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:27.653 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.472382+0000", 2024-09-12T22:33:27.653 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.7311000000000002e-05 2024-09-12T22:33:27.653 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.653 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.653 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:27.653 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.472497+0000", 2024-09-12T22:33:27.653 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011537800000000001 2024-09-12T22:33:27.653 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.653 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.653 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:27.653 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.472617+0000", 2024-09-12T22:33:27.653 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011989600000000001 2024-09-12T22:33:27.653 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.653 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.654 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:27.654 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473149+0000", 2024-09-12T22:33:27.654 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00053227999999999999 2024-09-12T22:33:27.654 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.654 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.654 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:27.654 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.552479+0000", 2024-09-12T22:33:27.654 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.079329541000000003 2024-09-12T22:33:27.654 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.654 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.654 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:27.654 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.552525+0000", 2024-09-12T22:33:27.654 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6421000000000002e-05 2024-09-12T22:33:27.654 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.654 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.655 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:27.655 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.552561+0000", 2024-09-12T22:33:27.655 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5599999999999998e-05 2024-09-12T22:33:27.655 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:27.655 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:27.655 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:27.655 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.655 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.655 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4490.0:9872 4.2c 4:3602c8d3:::10000002d4e.00000000:head [write 0~1178] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:33:27.655 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:09.473085+0000", 2024-09-12T22:33:27.655 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 18.16602803, 2024-09-12T22:33:27.655 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.079631104999999994, 2024-09-12T22:33:27.655 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:27.655 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:27.656 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:27.656 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:27.656 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4490", 2024-09-12T22:33:27.656 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:27.656 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 9872 2024-09-12T22:33:27.656 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.656 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:27.656 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.656 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:27.656 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473085+0000", 2024-09-12T22:33:27.656 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:27.656 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.656 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.657 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:27.657 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473085+0000", 2024-09-12T22:33:27.657 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:27.657 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.657 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.657 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:27.657 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473085+0000", 2024-09-12T22:33:27.657 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3600000000000004e-07 2024-09-12T22:33:27.657 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.657 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.657 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:27.657 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473088+0000", 2024-09-12T22:33:27.657 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.005e-06 2024-09-12T22:33:27.657 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.658 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.658 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:27.658 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473095+0000", 2024-09-12T22:33:27.658 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3950000000000003e-06 2024-09-12T22:33:27.658 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.658 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.658 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:27.658 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473100+0000", 2024-09-12T22:33:27.658 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5460000000000002e-06 2024-09-12T22:33:27.658 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.658 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.658 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:27.658 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473138+0000", 2024-09-12T22:33:27.658 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8244999999999997e-05 2024-09-12T22:33:27.659 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.659 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.659 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:27.659 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473216+0000", 2024-09-12T22:33:27.659 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.7756000000000006e-05 2024-09-12T22:33:27.659 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.659 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.659 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:27.659 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473291+0000", 2024-09-12T22:33:27.659 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5110000000000004e-05 2024-09-12T22:33:27.659 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.659 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.659 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:27.659 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473736+0000", 2024-09-12T22:33:27.660 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00044486500000000002 2024-09-12T22:33:27.660 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.660 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.660 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:27.660 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.552637+0000", 2024-09-12T22:33:27.660 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.078900782000000003 2024-09-12T22:33:27.660 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.660 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.660 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:27.660 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.552680+0000", 2024-09-12T22:33:27.660 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3047999999999998e-05 2024-09-12T22:33:27.660 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.660 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.660 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:27.661 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.552716+0000", 2024-09-12T22:33:27.661 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5816999999999999e-05 2024-09-12T22:33:27.661 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:27.661 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:27.661 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:27.661 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.661 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.661 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4490.0:9873 4.2c 4:372c52ff:::10000002d4f.00000000:head [write 0~1230] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:33:27.661 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:09.473878+0000", 2024-09-12T22:33:27.661 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 18.165234566999999, 2024-09-12T22:33:27.661 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.079036047999999998, 2024-09-12T22:33:27.661 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:27.661 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:27.661 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:27.662 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:27.662 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4490", 2024-09-12T22:33:27.662 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:27.662 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 9873 2024-09-12T22:33:27.662 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.662 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:27.662 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.662 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:27.662 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473878+0000", 2024-09-12T22:33:27.662 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:27.662 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.662 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.662 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:27.662 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473878+0000", 2024-09-12T22:33:27.663 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:27.663 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.663 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.663 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:27.663 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473879+0000", 2024-09-12T22:33:27.663 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9100000000000004e-07 2024-09-12T22:33:27.663 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.663 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.663 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:27.663 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473882+0000", 2024-09-12T22:33:27.663 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.405e-06 2024-09-12T22:33:27.663 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.663 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.663 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:27.664 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473889+0000", 2024-09-12T22:33:27.664 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7519999999999999e-06 2024-09-12T22:33:27.664 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.664 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.664 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:27.664 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473893+0000", 2024-09-12T22:33:27.664 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9310000000000001e-06 2024-09-12T22:33:27.664 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.664 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.664 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:27.664 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473922+0000", 2024-09-12T22:33:27.664 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9346999999999999e-05 2024-09-12T22:33:27.664 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.664 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.665 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:27.665 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474000+0000", 2024-09-12T22:33:27.665 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.7972000000000005e-05 2024-09-12T22:33:27.665 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.665 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.665 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:27.665 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474072+0000", 2024-09-12T22:33:27.665 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1960999999999998e-05 2024-09-12T22:33:27.665 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.665 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.665 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:27.665 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474470+0000", 2024-09-12T22:33:27.665 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00039803400000000002 2024-09-12T22:33:27.665 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.666 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.666 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:27.666 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.552814+0000", 2024-09-12T22:33:27.666 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.078344164999999993 2024-09-12T22:33:27.666 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.666 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.666 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:27.666 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.552875+0000", 2024-09-12T22:33:27.666 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1008999999999998e-05 2024-09-12T22:33:27.666 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.666 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.666 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:27.666 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.552914+0000", 2024-09-12T22:33:27.666 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8881000000000003e-05 2024-09-12T22:33:27.667 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:27.667 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:27.667 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:27.667 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.667 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.667 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4490.0:9874 4.1b 4:db19d96a:::10000002d50.00000000:head [write 0~1088] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:33:27.667 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:09.474673+0000", 2024-09-12T22:33:27.667 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 18.164439573999999, 2024-09-12T22:33:27.667 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.080314317999999996, 2024-09-12T22:33:27.667 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:27.667 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:27.667 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:27.667 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:27.667 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4490", 2024-09-12T22:33:27.667 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:27.668 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 9874 2024-09-12T22:33:27.668 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.668 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:27.668 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.668 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:27.668 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474673+0000", 2024-09-12T22:33:27.668 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:27.668 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.668 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.668 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:27.668 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474673+0000", 2024-09-12T22:33:27.668 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:27.668 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.669 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.669 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:27.669 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474674+0000", 2024-09-12T22:33:27.669 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6199999999999998e-07 2024-09-12T22:33:27.669 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.669 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.669 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:27.669 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474677+0000", 2024-09-12T22:33:27.669 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.224e-06 2024-09-12T22:33:27.669 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.669 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.669 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:27.669 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474683+0000", 2024-09-12T22:33:27.669 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.3160000000000002e-06 2024-09-12T22:33:27.670 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.670 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.670 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:27.670 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474687+0000", 2024-09-12T22:33:27.670 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7869999999999999e-06 2024-09-12T22:33:27.670 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.670 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.670 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:27.670 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474730+0000", 2024-09-12T22:33:27.670 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3309000000000002e-05 2024-09-12T22:33:27.670 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.670 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.670 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:27.670 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474845+0000", 2024-09-12T22:33:27.671 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114306 2024-09-12T22:33:27.671 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.671 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.671 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:27.671 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474970+0000", 2024-09-12T22:33:27.671 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000125096 2024-09-12T22:33:27.671 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.671 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.671 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:27.671 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.475621+0000", 2024-09-12T22:33:27.671 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00065124900000000001 2024-09-12T22:33:27.671 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.671 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.671 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:27.672 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.554885+0000", 2024-09-12T22:33:27.672 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.079264055 2024-09-12T22:33:27.672 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.672 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.672 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:27.672 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.554942+0000", 2024-09-12T22:33:27.672 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7284000000000002e-05 2024-09-12T22:33:27.672 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.672 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.672 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:27.672 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.554987+0000", 2024-09-12T22:33:27.672 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5130000000000003e-05 2024-09-12T22:33:27.672 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:27.672 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:27.673 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:27.673 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.673 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.673 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4490.0:12220 4.2b 4:d55bfd66:::10000003169.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-12T22:33:27.673 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.391333+0000", 2024-09-12T22:33:27.673 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 13.247779431, 2024-09-12T22:33:27.673 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.088669550999999999, 2024-09-12T22:33:27.673 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:27.673 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:27.673 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:27.673 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:27.673 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4490", 2024-09-12T22:33:27.673 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:27.673 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 12220 2024-09-12T22:33:27.674 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.674 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:27.674 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.674 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:27.674 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.391333+0000", 2024-09-12T22:33:27.674 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:27.674 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.674 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.674 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:27.674 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.391333+0000", 2024-09-12T22:33:27.674 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:27.674 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.674 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.675 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:27.675 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.391334+0000", 2024-09-12T22:33:27.675 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3099999999999997e-07 2024-09-12T22:33:27.675 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.675 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.675 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:27.675 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398373+0000", 2024-09-12T22:33:27.675 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0070386670000000002 2024-09-12T22:33:27.675 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.675 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.675 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:27.675 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398384+0000", 2024-09-12T22:33:27.675 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1338999999999999e-05 2024-09-12T22:33:27.675 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.675 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.676 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:27.676 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398389+0000", 2024-09-12T22:33:27.676 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3650000000000003e-06 2024-09-12T22:33:27.676 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.676 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.676 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:27.676 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.456308+0000", 2024-09-12T22:33:27.676 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.057918931 2024-09-12T22:33:27.676 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.676 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.676 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:27.676 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.456425+0000", 2024-09-12T22:33:27.676 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000116452 2024-09-12T22:33:27.676 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.677 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.677 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:27.677 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.456536+0000", 2024-09-12T22:33:27.677 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000111839 2024-09-12T22:33:27.677 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.677 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.677 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:27.677 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.465335+0000", 2024-09-12T22:33:27.677 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0087984980000000001 2024-09-12T22:33:27.677 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.677 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.677 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:27.677 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.479950+0000", 2024-09-12T22:33:27.678 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.01461552 2024-09-12T22:33:27.678 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.678 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.678 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:27.678 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.479983+0000", 2024-09-12T22:33:27.678 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2126999999999999e-05 2024-09-12T22:33:27.678 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.678 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.678 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:27.678 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.480003+0000", 2024-09-12T22:33:27.678 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0081999999999998e-05 2024-09-12T22:33:27.678 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:27.678 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:27.678 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:27.678 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.679 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.679 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1208 3.13 3:cb3d3880:::200.0000000d:head [write 1009846~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:27.679 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.398459+0000", 2024-09-12T22:33:27.679 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 13.240653865000001, 2024-09-12T22:33:27.679 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.078093931000000005, 2024-09-12T22:33:27.679 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:27.679 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:27.679 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:27.679 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:27.679 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.679 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:27.679 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398459+0000", 2024-09-12T22:33:27.679 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:27.680 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.680 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.680 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:27.680 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398459+0000", 2024-09-12T22:33:27.680 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:27.680 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.680 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.680 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:27.681 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398459+0000", 2024-09-12T22:33:27.681 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8100000000000003e-07 2024-09-12T22:33:27.681 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.681 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.681 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:27.681 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398462+0000", 2024-09-12T22:33:27.681 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3700000000000002e-06 2024-09-12T22:33:27.681 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.681 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.681 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:27.681 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398469+0000", 2024-09-12T22:33:27.681 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2320000000000004e-06 2024-09-12T22:33:27.681 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.681 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.682 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:27.682 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398472+0000", 2024-09-12T22:33:27.682 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.658e-06 2024-09-12T22:33:27.682 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.682 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.682 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:27.682 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.456690+0000", 2024-09-12T22:33:27.682 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.058217615 2024-09-12T22:33:27.682 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.682 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.682 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:27.682 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.456731+0000", 2024-09-12T22:33:27.682 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0815000000000001e-05 2024-09-12T22:33:27.682 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.683 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.683 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:27.683 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.456793+0000", 2024-09-12T22:33:27.683 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1796000000000003e-05 2024-09-12T22:33:27.683 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.683 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.683 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:27.683 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.461412+0000", 2024-09-12T22:33:27.683 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0046188560000000002 2024-09-12T22:33:27.683 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.683 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.683 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:27.683 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476429+0000", 2024-09-12T22:33:27.683 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.015017943000000001 2024-09-12T22:33:27.684 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.684 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.684 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:27.684 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476499+0000", 2024-09-12T22:33:27.684 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9047000000000005e-05 2024-09-12T22:33:27.684 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.684 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.684 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:27.684 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476553+0000", 2024-09-12T22:33:27.684 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4117999999999999e-05 2024-09-12T22:33:27.684 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:27.684 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:27.684 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:27.684 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.685 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.685 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1209 3.13 3:cb3d3880:::200.0000000d:head [write 1011245~5867 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:27.685 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.398677+0000", 2024-09-12T22:33:27.685 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 13.240435308, 2024-09-12T22:33:27.685 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.077995698000000002, 2024-09-12T22:33:27.685 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:27.685 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:27.685 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:27.685 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:27.685 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.685 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:27.685 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398677+0000", 2024-09-12T22:33:27.685 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:27.685 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.686 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.686 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:27.686 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398677+0000", 2024-09-12T22:33:27.686 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:27.686 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.686 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.686 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:27.686 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398678+0000", 2024-09-12T22:33:27.686 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5199999999999995e-07 2024-09-12T22:33:27.686 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.686 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.686 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:27.686 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398686+0000", 2024-09-12T22:33:27.686 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0579999999999998e-06 2024-09-12T22:33:27.687 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.687 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.687 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:27.687 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398695+0000", 2024-09-12T22:33:27.687 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.1409999999999994e-06 2024-09-12T22:33:27.687 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.687 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.687 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:27.687 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398703+0000", 2024-09-12T22:33:27.687 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4379999999999998e-06 2024-09-12T22:33:27.687 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.687 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.687 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:27.687 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.457051+0000", 2024-09-12T22:33:27.688 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.058348358000000003 2024-09-12T22:33:27.688 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.688 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.688 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:27.688 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.457096+0000", 2024-09-12T22:33:27.688 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4428000000000002e-05 2024-09-12T22:33:27.688 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.688 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.688 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:27.688 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.457162+0000", 2024-09-12T22:33:27.688 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6298999999999997e-05 2024-09-12T22:33:27.688 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.688 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.688 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:27.689 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.461416+0000", 2024-09-12T22:33:27.689 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0042539980000000002 2024-09-12T22:33:27.689 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.689 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.689 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:27.689 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476610+0000", 2024-09-12T22:33:27.689 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.015193879 2024-09-12T22:33:27.689 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.689 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.689 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:27.689 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476640+0000", 2024-09-12T22:33:27.689 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0648000000000002e-05 2024-09-12T22:33:27.689 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.689 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.690 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:27.690 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476673+0000", 2024-09-12T22:33:27.690 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2598999999999997e-05 2024-09-12T22:33:27.690 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:27.690 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:27.690 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:27.690 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.690 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.690 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1210 3.13 3:cb3d3880:::200.0000000d:head [write 1017112~1958 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:27.690 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.398713+0000", 2024-09-12T22:33:27.690 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 13.240399985, 2024-09-12T22:33:27.690 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.078118317000000007, 2024-09-12T22:33:27.690 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:27.690 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:27.690 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:27.691 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:27.691 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.691 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:27.691 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398713+0000", 2024-09-12T22:33:27.691 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:27.691 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.691 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.691 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:27.691 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398713+0000", 2024-09-12T22:33:27.691 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:27.691 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.691 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.691 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:27.691 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398713+0000", 2024-09-12T22:33:27.692 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7599999999999998e-07 2024-09-12T22:33:27.692 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.692 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.692 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:27.692 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398718+0000", 2024-09-12T22:33:27.692 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8169999999999998e-06 2024-09-12T22:33:27.692 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.692 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.692 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:27.692 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398722+0000", 2024-09-12T22:33:27.692 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5249999999999999e-06 2024-09-12T22:33:27.692 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.692 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.692 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:27.693 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398726+0000", 2024-09-12T22:33:27.693 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5650000000000002e-06 2024-09-12T22:33:27.693 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.693 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.693 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:27.693 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.457644+0000", 2024-09-12T22:33:27.693 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.058918521000000001 2024-09-12T22:33:27.693 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.693 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.693 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:27.693 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.457724+0000", 2024-09-12T22:33:27.693 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9408999999999998e-05 2024-09-12T22:33:27.693 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.693 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.694 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:27.694 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.457821+0000", 2024-09-12T22:33:27.694 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.7015000000000005e-05 2024-09-12T22:33:27.694 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.694 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.694 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:27.694 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.461419+0000", 2024-09-12T22:33:27.694 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0035985309999999999 2024-09-12T22:33:27.694 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.694 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.694 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:27.694 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476726+0000", 2024-09-12T22:33:27.694 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.015306804 2024-09-12T22:33:27.694 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.694 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.695 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:27.695 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476787+0000", 2024-09-12T22:33:27.695 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1062000000000006e-05 2024-09-12T22:33:27.695 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.695 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.695 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:27.695 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476831+0000", 2024-09-12T22:33:27.695 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3692000000000001e-05 2024-09-12T22:33:27.695 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:27.695 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:27.695 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:27.695 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.695 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.695 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1211 3.13 3:cb3d3880:::200.0000000d:head [write 1019070~5873 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:27.696 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.400122+0000", 2024-09-12T22:33:27.696 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 13.238990267, 2024-09-12T22:33:27.696 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.076797146999999996, 2024-09-12T22:33:27.696 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:27.696 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:27.696 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:27.696 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:27.696 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.696 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:27.696 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.400122+0000", 2024-09-12T22:33:27.696 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:27.696 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.696 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.696 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:27.697 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.400122+0000", 2024-09-12T22:33:27.697 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:27.697 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.697 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.697 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:27.697 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.400123+0000", 2024-09-12T22:33:27.697 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2500000000000005e-07 2024-09-12T22:33:27.697 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.697 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.697 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:27.697 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.400129+0000", 2024-09-12T22:33:27.697 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.319e-06 2024-09-12T22:33:27.697 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.698 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.698 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:27.698 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.400139+0000", 2024-09-12T22:33:27.698 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.5200000000000003e-06 2024-09-12T22:33:27.698 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.698 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.698 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:27.698 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.400143+0000", 2024-09-12T22:33:27.698 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.437e-06 2024-09-12T22:33:27.698 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.698 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.698 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:27.698 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.458159+0000", 2024-09-12T22:33:27.698 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.058015960999999998 2024-09-12T22:33:27.699 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.699 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.699 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:27.699 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.458201+0000", 2024-09-12T22:33:27.699 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1693000000000002e-05 2024-09-12T22:33:27.699 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.699 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.699 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:27.699 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.458267+0000", 2024-09-12T22:33:27.699 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5687999999999999e-05 2024-09-12T22:33:27.699 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.699 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.699 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:27.699 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.461423+0000", 2024-09-12T22:33:27.700 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0031560730000000001 2024-09-12T22:33:27.700 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.700 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.700 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:27.700 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476868+0000", 2024-09-12T22:33:27.700 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.015445108000000001 2024-09-12T22:33:27.700 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.700 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.700 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:27.700 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476897+0000", 2024-09-12T22:33:27.700 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9433000000000001e-05 2024-09-12T22:33:27.700 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.700 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.700 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:27.701 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476919+0000", 2024-09-12T22:33:27.701 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.2189999999999999e-05 2024-09-12T22:33:27.701 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:27.701 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:27.701 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:27.701 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.701 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.701 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1212 3.13 3:cb3d3880:::200.0000000d:head [write 1024943~3866 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:27.701 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.401707+0000", 2024-09-12T22:33:27.701 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 13.237406062, 2024-09-12T22:33:27.701 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.075386625999999998, 2024-09-12T22:33:27.701 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:27.701 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:27.701 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:27.702 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:27.702 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.702 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:27.702 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.401707+0000", 2024-09-12T22:33:27.702 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:27.702 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.702 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.702 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:27.702 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.401707+0000", 2024-09-12T22:33:27.702 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:27.702 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.702 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.702 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:27.703 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.401707+0000", 2024-09-12T22:33:27.703 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7700000000000004e-07 2024-09-12T22:33:27.703 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.703 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.703 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:27.703 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.401713+0000", 2024-09-12T22:33:27.703 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6609999999999997e-06 2024-09-12T22:33:27.703 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.703 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.703 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:27.703 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.401726+0000", 2024-09-12T22:33:27.703 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.3088000000000001e-05 2024-09-12T22:33:27.703 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.703 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.704 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:27.704 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.401741+0000", 2024-09-12T22:33:27.704 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.5424e-05 2024-09-12T22:33:27.704 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.704 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.704 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:27.704 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.458853+0000", 2024-09-12T22:33:27.704 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.057111157000000003 2024-09-12T22:33:27.704 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.704 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.704 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:27.704 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.458898+0000", 2024-09-12T22:33:27.704 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5633999999999997e-05 2024-09-12T22:33:27.704 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.705 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.705 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:27.705 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.458972+0000", 2024-09-12T22:33:27.705 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3441000000000004e-05 2024-09-12T22:33:27.705 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.705 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.705 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:27.705 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.461426+0000", 2024-09-12T22:33:27.705 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0024542660000000001 2024-09-12T22:33:27.705 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.705 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.705 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:27.705 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476985+0000", 2024-09-12T22:33:27.706 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.015559513000000001 2024-09-12T22:33:27.706 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.706 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.706 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:27.706 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.477044+0000", 2024-09-12T22:33:27.706 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8156999999999999e-05 2024-09-12T22:33:27.706 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.706 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.706 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:27.706 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.477093+0000", 2024-09-12T22:33:27.706 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9607999999999997e-05 2024-09-12T22:33:27.706 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:27.706 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:27.706 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:27.707 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.707 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.707 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1213 3.13 3:cb3d3880:::200.0000000d:head [write 1028809~6329 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:27.707 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.403250+0000", 2024-09-12T22:33:27.707 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 13.235862534000001, 2024-09-12T22:33:27.707 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.073936215999999999, 2024-09-12T22:33:27.707 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:27.707 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:27.707 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:27.707 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:27.707 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.707 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:27.707 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403250+0000", 2024-09-12T22:33:27.707 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:27.708 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.708 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.708 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:27.708 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403250+0000", 2024-09-12T22:33:27.708 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:27.708 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.708 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.708 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:27.708 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403251+0000", 2024-09-12T22:33:27.708 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.37e-07 2024-09-12T22:33:27.708 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.708 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.708 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:27.709 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403258+0000", 2024-09-12T22:33:27.709 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.25e-06 2024-09-12T22:33:27.709 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.709 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.709 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:27.709 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403269+0000", 2024-09-12T22:33:27.709 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0509000000000001e-05 2024-09-12T22:33:27.709 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.709 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.709 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:27.709 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403274+0000", 2024-09-12T22:33:27.709 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1290000000000004e-06 2024-09-12T22:33:27.709 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.709 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.709 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:27.710 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.459796+0000", 2024-09-12T22:33:27.710 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.056522020999999999 2024-09-12T22:33:27.710 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.710 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.710 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:27.710 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.459845+0000", 2024-09-12T22:33:27.710 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8884999999999997e-05 2024-09-12T22:33:27.710 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.710 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.710 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:27.710 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.459920+0000", 2024-09-12T22:33:27.710 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5318e-05 2024-09-12T22:33:27.710 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.710 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.711 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:27.711 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.466542+0000", 2024-09-12T22:33:27.711 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0066223139999999998 2024-09-12T22:33:27.711 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.711 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.711 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:27.711 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.477137+0000", 2024-09-12T22:33:27.711 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010594717 2024-09-12T22:33:27.711 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.711 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.711 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:27.711 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.477165+0000", 2024-09-12T22:33:27.711 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8262000000000001e-05 2024-09-12T22:33:27.712 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.712 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.712 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:27.712 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.477186+0000", 2024-09-12T22:33:27.712 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1073999999999998e-05 2024-09-12T22:33:27.712 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:27.712 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:27.712 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:27.712 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.712 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.712 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1214 3.13 3:cb3d3880:::200.0000000d:head [write 1035138~2606 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:27.712 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.403674+0000", 2024-09-12T22:33:27.712 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 13.235438614, 2024-09-12T22:33:27.713 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.073643204000000004, 2024-09-12T22:33:27.713 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:27.713 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:27.713 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:27.713 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:27.713 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.713 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:27.713 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403674+0000", 2024-09-12T22:33:27.713 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:27.713 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.713 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.713 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:27.713 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403674+0000", 2024-09-12T22:33:27.713 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:27.714 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.714 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.714 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:27.714 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403674+0000", 2024-09-12T22:33:27.714 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.7700000000000005e-07 2024-09-12T22:33:27.714 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.714 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.714 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:27.714 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403678+0000", 2024-09-12T22:33:27.714 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2009999999999999e-06 2024-09-12T22:33:27.714 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.714 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.714 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:27.714 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403686+0000", 2024-09-12T22:33:27.715 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5690000000000005e-06 2024-09-12T22:33:27.715 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.715 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.715 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:27.715 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403690+0000", 2024-09-12T22:33:27.715 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.233e-06 2024-09-12T22:33:27.715 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.715 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.715 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:27.715 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.460445+0000", 2024-09-12T22:33:27.715 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.056754412999999997 2024-09-12T22:33:27.715 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.715 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.716 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:27.716 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.460495+0000", 2024-09-12T22:33:27.716 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0238999999999998e-05 2024-09-12T22:33:27.716 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.716 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.716 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:27.716 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.460566+0000", 2024-09-12T22:33:27.716 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1159000000000001e-05 2024-09-12T22:33:27.716 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.716 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.716 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:27.716 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.466546+0000", 2024-09-12T22:33:27.716 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0059798910000000002 2024-09-12T22:33:27.716 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.717 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.717 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:27.717 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.477232+0000", 2024-09-12T22:33:27.717 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010686084 2024-09-12T22:33:27.717 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.717 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.717 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:27.717 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.477280+0000", 2024-09-12T22:33:27.717 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.7719999999999997e-05 2024-09-12T22:33:27.717 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.717 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.717 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:27.717 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.477317+0000", 2024-09-12T22:33:27.717 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7218000000000002e-05 2024-09-12T22:33:27.717 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:27.718 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:27.718 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:27.718 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.718 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.718 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1223 3.13 3:cb3d3880:::200.0000000d:head [write 1090497~1913 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:27.718 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.420111+0000", 2024-09-12T22:33:27.718 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 13.219001462, 2024-09-12T22:33:27.718 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.071634583000000002, 2024-09-12T22:33:27.718 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:27.718 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:27.718 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:27.718 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:27.718 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.719 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:27.719 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.420111+0000", 2024-09-12T22:33:27.719 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:27.719 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.719 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.719 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:27.719 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.420111+0000", 2024-09-12T22:33:27.719 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:27.719 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.719 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.719 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:27.719 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.420112+0000", 2024-09-12T22:33:27.719 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.2900000000000002e-07 2024-09-12T22:33:27.719 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.719 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.720 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:27.720 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.420116+0000", 2024-09-12T22:33:27.720 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.67e-06 2024-09-12T22:33:27.720 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.720 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.720 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:27.720 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.420125+0000", 2024-09-12T22:33:27.720 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.0890000000000006e-06 2024-09-12T22:33:27.720 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.720 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.720 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:27.720 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.420131+0000", 2024-09-12T22:33:27.720 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4269999999999996e-06 2024-09-12T22:33:27.720 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.721 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.721 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:27.721 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.465358+0000", 2024-09-12T22:33:27.721 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.045227030000000001 2024-09-12T22:33:27.721 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.721 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.721 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:27.721 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.465439+0000", 2024-09-12T22:33:27.721 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0901000000000004e-05 2024-09-12T22:33:27.721 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.721 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.721 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:27.721 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.465571+0000", 2024-09-12T22:33:27.721 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000131705 2024-09-12T22:33:27.721 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.722 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.722 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:27.722 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.469496+0000", 2024-09-12T22:33:27.722 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.003925418 2024-09-12T22:33:27.722 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.722 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.722 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:27.722 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.491669+0000", 2024-09-12T22:33:27.722 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.022172335000000001 2024-09-12T22:33:27.722 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.722 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.722 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:27.722 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.491714+0000", 2024-09-12T22:33:27.722 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5417000000000002e-05 2024-09-12T22:33:27.722 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.723 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.723 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:27.723 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.491746+0000", 2024-09-12T22:33:27.723 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1662000000000003e-05 2024-09-12T22:33:27.723 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:27.723 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:27.723 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:27.723 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.723 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.723 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1225 3.13 3:cb3d3880:::200.0000000d:head [write 1097316~1932 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:27.723 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.421303+0000", 2024-09-12T22:33:27.723 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 13.217809626999999, 2024-09-12T22:33:27.723 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.074934770999999997, 2024-09-12T22:33:27.723 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:27.724 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:27.724 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:27.724 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:27.724 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.724 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:27.724 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.421303+0000", 2024-09-12T22:33:27.724 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:27.724 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.724 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.724 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:27.724 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.421303+0000", 2024-09-12T22:33:27.724 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:27.724 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.724 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.724 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:27.725 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.421303+0000", 2024-09-12T22:33:27.725 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8599999999999998e-07 2024-09-12T22:33:27.725 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.725 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.725 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:27.725 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.421307+0000", 2024-09-12T22:33:27.725 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0879999999999999e-06 2024-09-12T22:33:27.725 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.725 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.725 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:27.725 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.421314+0000", 2024-09-12T22:33:27.725 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1010000000000003e-06 2024-09-12T22:33:27.725 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.725 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.726 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:27.726 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.421319+0000", 2024-09-12T22:33:27.726 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7209999999999999e-06 2024-09-12T22:33:27.726 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.726 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.726 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:27.726 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.466620+0000", 2024-09-12T22:33:27.726 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.045301044999999998 2024-09-12T22:33:27.726 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.726 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.726 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:27.726 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.466703+0000", 2024-09-12T22:33:27.726 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3011999999999997e-05 2024-09-12T22:33:27.726 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.727 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.727 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:27.727 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.466826+0000", 2024-09-12T22:33:27.727 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000122824 2024-09-12T22:33:27.727 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.727 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.727 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:27.727 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.472359+0000", 2024-09-12T22:33:27.727 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0055323009999999999 2024-09-12T22:33:27.727 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.727 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.727 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:27.727 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496142+0000", 2024-09-12T22:33:27.727 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.023783696999999999 2024-09-12T22:33:27.728 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.728 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.728 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:27.728 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496194+0000", 2024-09-12T22:33:27.728 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1350000000000001e-05 2024-09-12T22:33:27.728 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.728 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.728 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:27.729 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496238+0000", 2024-09-12T22:33:27.729 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4146000000000001e-05 2024-09-12T22:33:27.729 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:27.729 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:27.729 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:27.729 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.729 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.729 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1226 3.13 3:cb3d3880:::200.0000000d:head [write 1099248~1973 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:27.729 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.422971+0000", 2024-09-12T22:33:27.729 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 13.216142029, 2024-09-12T22:33:27.729 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.073363063000000006, 2024-09-12T22:33:27.730 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:27.730 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:27.730 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:27.730 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:27.730 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.730 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:27.730 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.422971+0000", 2024-09-12T22:33:27.730 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:27.730 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.730 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.730 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:27.730 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.422971+0000", 2024-09-12T22:33:27.730 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:27.730 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.731 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.731 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:27.731 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.422971+0000", 2024-09-12T22:33:27.731 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.1699999999999997e-07 2024-09-12T22:33:27.731 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.731 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.731 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:27.731 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.422975+0000", 2024-09-12T22:33:27.731 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2650000000000001e-06 2024-09-12T22:33:27.731 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.731 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.731 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:27.731 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.422981+0000", 2024-09-12T22:33:27.731 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7379999999999997e-06 2024-09-12T22:33:27.732 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.732 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.732 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:27.732 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.422986+0000", 2024-09-12T22:33:27.732 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5220000000000001e-06 2024-09-12T22:33:27.732 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.732 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.732 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:27.732 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.467340+0000", 2024-09-12T22:33:27.732 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.044353985999999998 2024-09-12T22:33:27.732 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.732 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.732 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:27.733 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.467412+0000", 2024-09-12T22:33:27.733 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1982000000000003e-05 2024-09-12T22:33:27.733 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.733 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.733 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:27.733 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.467493+0000", 2024-09-12T22:33:27.733 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0829999999999997e-05 2024-09-12T22:33:27.733 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.733 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.733 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:27.733 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.472364+0000", 2024-09-12T22:33:27.733 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0048713189999999998 2024-09-12T22:33:27.733 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.733 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.734 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:27.734 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496271+0000", 2024-09-12T22:33:27.734 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.023906808000000002 2024-09-12T22:33:27.734 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.734 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.734 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:27.734 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496300+0000", 2024-09-12T22:33:27.734 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9315e-05 2024-09-12T22:33:27.734 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.734 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.734 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:27.734 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496334+0000", 2024-09-12T22:33:27.734 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3481e-05 2024-09-12T22:33:27.735 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:27.735 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:27.735 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:27.735 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.735 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.735 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1227 3.13 3:cb3d3880:::200.0000000d:head [write 1101221~1922 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:27.735 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.423028+0000", 2024-09-12T22:33:27.735 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 13.216085045, 2024-09-12T22:33:27.735 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.073444802000000003, 2024-09-12T22:33:27.735 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:27.735 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:27.735 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:27.735 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:27.735 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.736 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:27.736 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423028+0000", 2024-09-12T22:33:27.736 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:27.736 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.736 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.736 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:27.736 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423028+0000", 2024-09-12T22:33:27.736 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:27.736 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.736 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.736 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:27.736 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423028+0000", 2024-09-12T22:33:27.736 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1699999999999998e-07 2024-09-12T22:33:27.736 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.737 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.737 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:27.737 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423031+0000", 2024-09-12T22:33:27.737 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8499999999999998e-06 2024-09-12T22:33:27.737 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.737 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.737 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:27.737 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423036+0000", 2024-09-12T22:33:27.737 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9479999999999999e-06 2024-09-12T22:33:27.737 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.737 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.737 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:27.737 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423039+0000", 2024-09-12T22:33:27.738 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4929999999999998e-06 2024-09-12T22:33:27.738 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.738 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.738 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:27.738 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.467785+0000", 2024-09-12T22:33:27.738 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.044745957000000003 2024-09-12T22:33:27.738 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.738 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.738 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:27.738 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.467838+0000", 2024-09-12T22:33:27.738 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2596999999999998e-05 2024-09-12T22:33:27.738 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.738 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.738 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:27.739 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.467915+0000", 2024-09-12T22:33:27.739 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6744999999999998e-05 2024-09-12T22:33:27.739 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.739 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.739 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:27.739 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.472368+0000", 2024-09-12T22:33:27.739 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0044534730000000003 2024-09-12T22:33:27.739 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.739 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.739 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:27.739 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496382+0000", 2024-09-12T22:33:27.739 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.024014111000000001 2024-09-12T22:33:27.739 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.740 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.740 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:27.740 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496443+0000", 2024-09-12T22:33:27.740 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.0547000000000002e-05 2024-09-12T22:33:27.740 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.740 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.740 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:27.740 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496472+0000", 2024-09-12T22:33:27.740 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9564e-05 2024-09-12T22:33:27.740 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:27.740 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:27.740 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:27.740 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.741 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.741 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1228 3.13 3:cb3d3880:::200.0000000d:head [write 1103143~2423 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:27.741 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.423305+0000", 2024-09-12T22:33:27.741 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 13.215807680999999, 2024-09-12T22:33:27.741 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.073251160999999995, 2024-09-12T22:33:27.741 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:27.741 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:27.741 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:27.741 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:27.741 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.741 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:27.741 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423305+0000", 2024-09-12T22:33:27.741 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:27.741 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.742 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.742 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:27.742 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423305+0000", 2024-09-12T22:33:27.742 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:27.742 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.742 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.742 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:27.742 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423306+0000", 2024-09-12T22:33:27.742 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4899999999999995e-07 2024-09-12T22:33:27.742 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.742 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.742 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:27.742 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423311+0000", 2024-09-12T22:33:27.743 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7459999999999997e-06 2024-09-12T22:33:27.743 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.743 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.743 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:27.743 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423316+0000", 2024-09-12T22:33:27.743 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0239999999999997e-06 2024-09-12T22:33:27.743 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.743 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.743 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:27.743 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423320+0000", 2024-09-12T22:33:27.743 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.67e-06 2024-09-12T22:33:27.743 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.743 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.743 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:27.744 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.468252+0000", 2024-09-12T22:33:27.744 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.044932262000000001 2024-09-12T22:33:27.744 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.744 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.744 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:27.744 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.468293+0000", 2024-09-12T22:33:27.744 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0368999999999999e-05 2024-09-12T22:33:27.744 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.744 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.744 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:27.744 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.468357+0000", 2024-09-12T22:33:27.744 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4287000000000003e-05 2024-09-12T22:33:27.744 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.744 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.745 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:27.745 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.472371+0000", 2024-09-12T22:33:27.745 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0040144350000000002 2024-09-12T22:33:27.745 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.745 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.745 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:27.745 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496507+0000", 2024-09-12T22:33:27.745 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.024135961000000001 2024-09-12T22:33:27.745 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.745 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.745 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:27.745 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496537+0000", 2024-09-12T22:33:27.745 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9611000000000002e-05 2024-09-12T22:33:27.746 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.746 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.746 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:27.746 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496556+0000", 2024-09-12T22:33:27.746 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9147000000000002e-05 2024-09-12T22:33:27.746 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:27.746 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:27.746 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:27.746 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.746 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.746 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1229 3.13 3:cb3d3880:::200.0000000d:head [write 1105566~1911 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:27.746 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.423606+0000", 2024-09-12T22:33:27.746 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 13.21550667, 2024-09-12T22:33:27.746 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.073027876000000005, 2024-09-12T22:33:27.747 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:27.747 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:27.747 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:27.747 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:27.747 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.747 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:27.747 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423606+0000", 2024-09-12T22:33:27.747 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:27.747 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.747 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.747 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:27.747 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423606+0000", 2024-09-12T22:33:27.747 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:27.748 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.748 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.748 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:27.748 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423606+0000", 2024-09-12T22:33:27.748 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.7e-07 2024-09-12T22:33:27.748 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.748 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.748 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:27.748 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423609+0000", 2024-09-12T22:33:27.748 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5339999999999998e-06 2024-09-12T22:33:27.748 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.748 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.748 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:27.749 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423614+0000", 2024-09-12T22:33:27.749 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.69e-06 2024-09-12T22:33:27.749 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.749 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.749 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:27.749 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423617+0000", 2024-09-12T22:33:27.749 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4300000000000002e-06 2024-09-12T22:33:27.749 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.749 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.749 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:27.749 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.468606+0000", 2024-09-12T22:33:27.749 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.044988606 2024-09-12T22:33:27.749 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.750 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.750 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:27.750 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.468649+0000", 2024-09-12T22:33:27.750 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3414000000000001e-05 2024-09-12T22:33:27.750 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.750 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.750 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:27.750 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.468714+0000", 2024-09-12T22:33:27.750 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4857000000000006e-05 2024-09-12T22:33:27.750 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.750 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.750 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:27.750 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.472375+0000", 2024-09-12T22:33:27.750 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0036607330000000002 2024-09-12T22:33:27.751 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.751 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.751 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:27.751 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496585+0000", 2024-09-12T22:33:27.751 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.024210835 2024-09-12T22:33:27.751 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.751 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.751 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:27.751 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496612+0000", 2024-09-12T22:33:27.751 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6999999999999999e-05 2024-09-12T22:33:27.751 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.751 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.751 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:27.752 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496634+0000", 2024-09-12T22:33:27.752 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1307000000000001e-05 2024-09-12T22:33:27.752 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:27.752 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:27.752 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:27.752 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.752 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.752 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1230 3.13 3:cb3d3880:::200.0000000d:head [write 1107477~6537 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:27.752 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.423911+0000", 2024-09-12T22:33:27.752 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 13.215201824999999, 2024-09-12T22:33:27.752 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.072794530999999996, 2024-09-12T22:33:27.752 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:27.752 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:27.752 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:27.753 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:27.753 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.753 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:27.753 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423911+0000", 2024-09-12T22:33:27.753 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:27.753 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.753 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.753 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:27.753 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423911+0000", 2024-09-12T22:33:27.753 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:27.753 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.753 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.753 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:27.753 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423911+0000", 2024-09-12T22:33:27.754 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3799999999999998e-07 2024-09-12T22:33:27.754 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.754 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.754 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:27.754 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423919+0000", 2024-09-12T22:33:27.754 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.8329999999999994e-06 2024-09-12T22:33:27.754 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.754 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.754 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:27.754 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423924+0000", 2024-09-12T22:33:27.754 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3449999999999996e-06 2024-09-12T22:33:27.754 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.754 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.754 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:27.754 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423928+0000", 2024-09-12T22:33:27.755 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2339999999999999e-06 2024-09-12T22:33:27.755 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.755 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.755 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:27.755 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.469042+0000", 2024-09-12T22:33:27.755 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.045114888999999998 2024-09-12T22:33:27.755 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.755 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.755 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:27.755 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.469092+0000", 2024-09-12T22:33:27.755 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9289000000000002e-05 2024-09-12T22:33:27.755 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.755 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.755 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:27.756 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.469163+0000", 2024-09-12T22:33:27.756 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1222000000000004e-05 2024-09-12T22:33:27.756 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.756 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.756 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:27.756 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.472379+0000", 2024-09-12T22:33:27.756 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0032156419999999999 2024-09-12T22:33:27.756 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.756 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.756 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:27.756 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496661+0000", 2024-09-12T22:33:27.756 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.024281857 2024-09-12T22:33:27.756 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.757 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.757 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:27.757 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496687+0000", 2024-09-12T22:33:27.757 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6551e-05 2024-09-12T22:33:27.757 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:27.757 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:27.757 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:27.757 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496705+0000", 2024-09-12T22:33:27.757 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.8230999999999999e-05 2024-09-12T22:33:27.757 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:27.757 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:27.757 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:27.757 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:27.757 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:27.758 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-09-12T22:33:27.759 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:27.757+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:27.759 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:33:27.860 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:27.859+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:27.865 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:33:27.865 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:33:27.866 INFO:teuthology.orchestra.run.smithi148.stdout: "num_ops": 0 2024-09-12T22:33:27.866 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:33:27.875 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:33:27.961 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:27.960+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:27.985 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:33:27.985 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:33:27.985 INFO:teuthology.orchestra.run.smithi148.stdout: "complaint_time": 30, 2024-09-12T22:33:27.985 INFO:teuthology.orchestra.run.smithi148.stdout: "num_blocked_ops": 0 2024-09-12T22:33:27.985 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:33:27.995 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:33:28.063 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:28.062+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:28.102 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:33:28.102 INFO:teuthology.orchestra.run.smithi148.stdout: "size": 20, 2024-09-12T22:33:28.102 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 600, 2024-09-12T22:33:28.102 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [ 2024-09-12T22:33:28.102 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.102 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4490.0:9866 4.b 4:d370243b:::10000002d48.00000000:head [write 0~1308] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:33:28.102 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:09.467883+0000", 2024-09-12T22:33:28.102 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 18.632361015000001, 2024-09-12T22:33:28.102 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.085024817000000003, 2024-09-12T22:33:28.103 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:28.103 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:28.103 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:28.103 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:33:28.103 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4490", 2024-09-12T22:33:28.103 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:28.103 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 9866 2024-09-12T22:33:28.103 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.103 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:28.103 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.103 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:28.103 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.467883+0000", 2024-09-12T22:33:28.103 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:28.104 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.104 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.104 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:28.104 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.467883+0000", 2024-09-12T22:33:28.104 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:28.104 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.104 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.104 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:28.104 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.467884+0000", 2024-09-12T22:33:28.104 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1800000000000005e-07 2024-09-12T22:33:28.104 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.104 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.104 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:28.104 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.467888+0000", 2024-09-12T22:33:28.105 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5959999999999997e-06 2024-09-12T22:33:28.105 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.105 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.105 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:28.105 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.467896+0000", 2024-09-12T22:33:28.105 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.8679999999999999e-06 2024-09-12T22:33:28.105 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.105 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.105 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:28.105 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.467901+0000", 2024-09-12T22:33:28.105 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9169999999999997e-06 2024-09-12T22:33:28.105 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.105 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.105 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:28.106 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.467944+0000", 2024-09-12T22:33:28.106 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3055e-05 2024-09-12T22:33:28.106 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.106 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.106 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:28.106 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.468011+0000", 2024-09-12T22:33:28.106 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7328000000000003e-05 2024-09-12T22:33:28.106 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.106 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.106 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:28.106 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.468078+0000", 2024-09-12T22:33:28.106 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7063999999999994e-05 2024-09-12T22:33:28.106 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.106 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.107 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:28.107 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.551406+0000", 2024-09-12T22:33:28.107 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.083327485000000007 2024-09-12T22:33:28.107 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.107 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.107 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:28.107 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.552822+0000", 2024-09-12T22:33:28.107 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001415929 2024-09-12T22:33:28.107 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.107 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.107 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:28.107 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.552863+0000", 2024-09-12T22:33:28.107 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0809000000000002e-05 2024-09-12T22:33:28.107 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.108 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.108 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:28.108 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.552908+0000", 2024-09-12T22:33:28.108 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5048e-05 2024-09-12T22:33:28.108 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:28.108 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:28.108 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:28.108 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.108 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.108 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4490.0:9867 4.16 4:6bd8f1b8:::10000002d49.00000000:head [write 0~1599] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:33:28.108 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:09.468760+0000", 2024-09-12T22:33:28.108 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 18.631484006000001, 2024-09-12T22:33:28.108 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.086660499000000002, 2024-09-12T22:33:28.108 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:28.109 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:28.109 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:28.109 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:33:28.109 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4490", 2024-09-12T22:33:28.109 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:28.109 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 9867 2024-09-12T22:33:28.109 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.109 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:28.109 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.109 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:28.109 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.468760+0000", 2024-09-12T22:33:28.109 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:28.109 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.109 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.110 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:28.110 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.468760+0000", 2024-09-12T22:33:28.110 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:28.110 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.110 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.110 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:28.110 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.468761+0000", 2024-09-12T22:33:28.111 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4399999999999999e-07 2024-09-12T22:33:28.111 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.111 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.111 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:28.111 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.468765+0000", 2024-09-12T22:33:28.111 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3259999999999997e-06 2024-09-12T22:33:28.111 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.111 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.111 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:28.111 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.548969+0000", 2024-09-12T22:33:28.111 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.080204172000000004 2024-09-12T22:33:28.111 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.111 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.111 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:28.112 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.549001+0000", 2024-09-12T22:33:28.112 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.1464999999999998e-05 2024-09-12T22:33:28.112 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.112 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.112 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:28.112 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.549148+0000", 2024-09-12T22:33:28.112 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014749399999999999 2024-09-12T22:33:28.112 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.112 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.112 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:28.112 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.549379+0000", 2024-09-12T22:33:28.112 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000231091 2024-09-12T22:33:28.112 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.112 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.113 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:28.113 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.549518+0000", 2024-09-12T22:33:28.113 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013844899999999999 2024-09-12T22:33:28.113 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.113 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.113 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:28.113 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.552236+0000", 2024-09-12T22:33:28.113 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0027179869999999998 2024-09-12T22:33:28.113 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.113 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.113 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:28.113 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.555333+0000", 2024-09-12T22:33:28.113 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0030973559999999999 2024-09-12T22:33:28.113 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.114 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.114 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:28.114 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.555379+0000", 2024-09-12T22:33:28.114 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6236999999999998e-05 2024-09-12T22:33:28.114 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.114 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.114 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:28.114 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.555420+0000", 2024-09-12T22:33:28.114 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1177999999999998e-05 2024-09-12T22:33:28.114 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:28.114 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:28.114 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:28.114 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.114 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.115 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop_reply(client.4490.0:9866 4.b e53/18 ondisk, result = 0)", 2024-09-12T22:33:28.115 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:09.468826+0000", 2024-09-12T22:33:28.115 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 18.631417711000001, 2024-09-12T22:33:28.115 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.082588348000000006, 2024-09-12T22:33:28.115 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:28.115 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:28.115 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:33:28.115 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:28.115 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.115 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:28.115 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.468826+0000", 2024-09-12T22:33:28.115 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:28.115 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.115 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.116 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:28.116 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.468826+0000", 2024-09-12T22:33:28.116 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:28.116 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.116 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.116 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:28.116 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.468827+0000", 2024-09-12T22:33:28.116 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3399999999999999e-07 2024-09-12T22:33:28.116 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.116 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.116 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:28.116 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.468830+0000", 2024-09-12T22:33:28.116 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.1559999999999999e-06 2024-09-12T22:33:28.116 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.117 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.117 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:28.117 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.548957+0000", 2024-09-12T22:33:28.117 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.080126852999999998 2024-09-12T22:33:28.117 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.117 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.117 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:28.117 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.548989+0000", 2024-09-12T22:33:28.117 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2409000000000001e-05 2024-09-12T22:33:28.117 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.117 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.117 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:28.117 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.551065+0000", 2024-09-12T22:33:28.117 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.002075871 2024-09-12T22:33:28.118 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.118 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.118 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:28.118 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.551398+0000", 2024-09-12T22:33:28.118 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00033339099999999999 2024-09-12T22:33:28.118 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.118 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.118 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:28.118 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.551414+0000", 2024-09-12T22:33:28.118 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6133999999999998e-05 2024-09-12T22:33:28.118 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:28.118 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:28.118 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:28.118 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.119 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.119 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4490.0:10437 4.2f 4:f6cd553b:::10000002fce.00000000:head [write 0~27313] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:33:28.119 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:10.050890+0000", 2024-09-12T22:33:28.119 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 18.049353315000001, 2024-09-12T22:33:28.119 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.056482601, 2024-09-12T22:33:28.119 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:28.119 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:28.119 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:28.119 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:33:28.119 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4490", 2024-09-12T22:33:28.119 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:28.119 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 10437 2024-09-12T22:33:28.119 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.119 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:28.120 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.120 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:28.120 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.050890+0000", 2024-09-12T22:33:28.120 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:28.120 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.120 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.120 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:28.120 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.050890+0000", 2024-09-12T22:33:28.120 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:28.120 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.120 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.120 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:28.120 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.050891+0000", 2024-09-12T22:33:28.120 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.6600000000000005e-07 2024-09-12T22:33:28.121 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.121 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.121 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:28.121 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.050906+0000", 2024-09-12T22:33:28.121 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4521e-05 2024-09-12T22:33:28.121 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.121 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.121 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:28.121 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.050915+0000", 2024-09-12T22:33:28.121 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.2569999999999996e-06 2024-09-12T22:33:28.121 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.121 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.121 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:28.121 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.050920+0000", 2024-09-12T22:33:28.122 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.724e-06 2024-09-12T22:33:28.122 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.122 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.122 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:28.122 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.050960+0000", 2024-09-12T22:33:28.122 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9999000000000001e-05 2024-09-12T22:33:28.122 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.122 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.122 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:28.122 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.051031+0000", 2024-09-12T22:33:28.122 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1007000000000006e-05 2024-09-12T22:33:28.122 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.122 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.122 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:28.123 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.107249+0000", 2024-09-12T22:33:28.123 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.056218432999999998 2024-09-12T22:33:28.123 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.123 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.123 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:28.123 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.107301+0000", 2024-09-12T22:33:28.123 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1289000000000003e-05 2024-09-12T22:33:28.123 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.123 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.123 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:28.123 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.107373+0000", 2024-09-12T22:33:28.123 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.2504999999999998e-05 2024-09-12T22:33:28.123 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:28.123 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:28.124 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:28.124 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.124 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.124 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4490.0:10439 4.12 4:483953cb:::10000002fd0.00000000:head [write 0~4842] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:33:28.124 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:10.052567+0000", 2024-09-12T22:33:28.124 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 18.047677106999998, 2024-09-12T22:33:28.124 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.055835449000000002, 2024-09-12T22:33:28.124 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:28.124 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:28.124 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:28.124 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:33:28.124 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4490", 2024-09-12T22:33:28.124 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:28.125 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 10439 2024-09-12T22:33:28.125 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.125 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:28.125 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.125 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:28.125 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.052567+0000", 2024-09-12T22:33:28.125 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:28.125 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.125 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.125 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:28.125 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.052567+0000", 2024-09-12T22:33:28.125 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:28.125 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.125 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.126 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:28.126 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.052568+0000", 2024-09-12T22:33:28.126 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.3600000000000002e-07 2024-09-12T22:33:28.126 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.126 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.126 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:28.126 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.052591+0000", 2024-09-12T22:33:28.126 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.3110000000000001e-05 2024-09-12T22:33:28.126 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.126 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.126 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:28.126 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.106740+0000", 2024-09-12T22:33:28.126 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.054149315000000003 2024-09-12T22:33:28.126 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.127 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.127 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:28.127 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.106751+0000", 2024-09-12T22:33:28.127 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1056000000000001e-05 2024-09-12T22:33:28.127 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.127 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.127 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:28.127 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.106811+0000", 2024-09-12T22:33:28.127 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9515999999999997e-05 2024-09-12T22:33:28.127 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.127 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.127 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:28.127 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.106929+0000", 2024-09-12T22:33:28.128 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00011879000000000001 2024-09-12T22:33:28.128 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.128 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.128 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:28.128 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.108283+0000", 2024-09-12T22:33:28.128 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001354177 2024-09-12T22:33:28.128 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.128 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.128 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:28.128 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.108328+0000", 2024-09-12T22:33:28.128 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4931000000000001e-05 2024-09-12T22:33:28.128 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.128 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.128 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:28.129 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.108402+0000", 2024-09-12T22:33:28.129 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3718000000000001e-05 2024-09-12T22:33:28.129 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:28.129 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:28.129 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:28.129 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.130 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.130 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(client.4490.0:10445 4.3c e53/18 4:3d97251e:::10000002fd8.00000000:head v 53'154, mlcod=53'152)", 2024-09-12T22:33:28.130 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:10.058521+0000", 2024-09-12T22:33:28.131 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 18.041722767, 2024-09-12T22:33:28.131 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.049310138000000003, 2024-09-12T22:33:28.131 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:28.131 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:28.131 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:28.131 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:28.131 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.131 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:28.131 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.058521+0000", 2024-09-12T22:33:28.131 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:28.131 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.131 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.131 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:28.132 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.058521+0000", 2024-09-12T22:33:28.132 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:28.132 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.132 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.132 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:28.132 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.058522+0000", 2024-09-12T22:33:28.132 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.1099999999999995e-07 2024-09-12T22:33:28.132 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.132 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.132 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:28.132 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.058530+0000", 2024-09-12T22:33:28.132 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.7290000000000006e-06 2024-09-12T22:33:28.133 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.133 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.133 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:28.133 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.106760+0000", 2024-09-12T22:33:28.133 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.048229384 2024-09-12T22:33:28.133 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.133 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.133 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:28.133 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.106770+0000", 2024-09-12T22:33:28.133 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0431999999999999e-05 2024-09-12T22:33:28.133 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.133 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.133 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:28.133 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.106823+0000", 2024-09-12T22:33:28.134 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2309999999999999e-05 2024-09-12T22:33:28.134 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.134 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.134 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:28.134 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.106841+0000", 2024-09-12T22:33:28.134 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.8218000000000001e-05 2024-09-12T22:33:28.134 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.134 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.134 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:28.134 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.107796+0000", 2024-09-12T22:33:28.134 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00095552600000000005 2024-09-12T22:33:28.134 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.134 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.135 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:28.135 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.107831+0000", 2024-09-12T22:33:28.135 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4928000000000002e-05 2024-09-12T22:33:28.135 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:28.135 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:28.135 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:28.135 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.135 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.135 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4490.0:11351 4.3f 4:fd498422:::10000003188.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-12T22:33:28.135 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:13.354715+0000", 2024-09-12T22:33:28.135 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 14.745528953000001, 2024-09-12T22:33:28.135 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.043059568999999999, 2024-09-12T22:33:28.136 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:28.136 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:28.136 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:28.136 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:33:28.136 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4490", 2024-09-12T22:33:28.136 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:28.136 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 11351 2024-09-12T22:33:28.136 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.136 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:28.136 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.136 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:28.136 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.354715+0000", 2024-09-12T22:33:28.136 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:28.137 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.137 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.137 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:28.137 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.354715+0000", 2024-09-12T22:33:28.137 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:28.137 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.137 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.137 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:28.137 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.354716+0000", 2024-09-12T22:33:28.137 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.7600000000000006e-07 2024-09-12T22:33:28.137 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.137 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.138 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:28.138 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.361477+0000", 2024-09-12T22:33:28.138 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0067607090000000002 2024-09-12T22:33:28.138 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.138 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.138 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:28.138 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.361487+0000", 2024-09-12T22:33:28.138 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0249e-05 2024-09-12T22:33:28.138 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.138 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.138 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:28.138 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.361493+0000", 2024-09-12T22:33:28.139 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.4699999999999999e-06 2024-09-12T22:33:28.139 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.139 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.139 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:28.139 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.361544+0000", 2024-09-12T22:33:28.139 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1124e-05 2024-09-12T22:33:28.139 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.139 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.139 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:28.139 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.361604+0000", 2024-09-12T22:33:28.139 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9397000000000001e-05 2024-09-12T22:33:28.139 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.140 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.140 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:28.140 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.397601+0000", 2024-09-12T22:33:28.140 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.035996927999999997 2024-09-12T22:33:28.140 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.140 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.140 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:28.140 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.397646+0000", 2024-09-12T22:33:28.140 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5176000000000003e-05 2024-09-12T22:33:28.140 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.140 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.140 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:28.140 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.397774+0000", 2024-09-12T22:33:28.141 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012854000000000001 2024-09-12T22:33:28.141 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:28.141 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:28.141 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:28.141 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.141 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.141 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4490.0:12798 4.3e 4:7eb070ca:::100000030e0.00000000:head [write 0~4194304 [5@1189789]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-12T22:33:28.141 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:15.140228+0000", 2024-09-12T22:33:28.141 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 12.960016303, 2024-09-12T22:33:28.141 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.046073232999999998, 2024-09-12T22:33:28.141 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:28.141 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:28.141 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:28.142 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:33:28.142 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4490", 2024-09-12T22:33:28.142 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:28.142 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 12798 2024-09-12T22:33:28.142 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.142 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:28.142 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.142 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:28.142 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.140228+0000", 2024-09-12T22:33:28.142 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:28.142 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.142 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.142 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:28.143 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.140228+0000", 2024-09-12T22:33:28.143 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:28.143 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.143 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.143 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:28.143 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.140228+0000", 2024-09-12T22:33:28.143 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5899999999999996e-07 2024-09-12T22:33:28.143 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.143 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.143 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:28.143 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.147541+0000", 2024-09-12T22:33:28.143 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0073125339999999999 2024-09-12T22:33:28.144 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.144 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.144 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:28.144 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.147555+0000", 2024-09-12T22:33:28.144 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.42e-05 2024-09-12T22:33:28.144 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.144 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.144 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:28.144 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.147564+0000", 2024-09-12T22:33:28.144 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.0999999999999993e-06 2024-09-12T22:33:28.144 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.144 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.144 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:28.145 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.147637+0000", 2024-09-12T22:33:28.145 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3288999999999996e-05 2024-09-12T22:33:28.145 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.145 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.145 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:28.145 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.147725+0000", 2024-09-12T22:33:28.145 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.7622999999999998e-05 2024-09-12T22:33:28.145 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.145 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.145 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:28.145 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.186239+0000", 2024-09-12T22:33:28.145 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.038514171 2024-09-12T22:33:28.145 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.145 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.146 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:28.146 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.186265+0000", 2024-09-12T22:33:28.146 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5738e-05 2024-09-12T22:33:28.146 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.146 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.146 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:28.146 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.186301+0000", 2024-09-12T22:33:28.146 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.6019000000000002e-05 2024-09-12T22:33:28.146 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:28.146 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:28.146 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:28.146 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.147 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.147 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3063 3.2 3:42569fed:::200.00000011:head [write 3915305~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:33:28.147 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:19.386685+0000", 2024-09-12T22:33:28.147 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 8.7135590739999991, 2024-09-12T22:33:28.147 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.042365220000000002, 2024-09-12T22:33:28.147 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:28.147 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:28.147 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:28.147 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:28.147 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.147 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:28.147 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386685+0000", 2024-09-12T22:33:28.147 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:28.148 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.148 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.148 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:28.148 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386685+0000", 2024-09-12T22:33:28.148 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:28.148 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.148 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.148 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:28.148 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386685+0000", 2024-09-12T22:33:28.148 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.08e-07 2024-09-12T22:33:28.148 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.148 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.148 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:28.149 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386688+0000", 2024-09-12T22:33:28.149 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8880000000000001e-06 2024-09-12T22:33:28.149 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.149 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.149 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:28.149 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386694+0000", 2024-09-12T22:33:28.149 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8089999999999998e-06 2024-09-12T22:33:28.149 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.149 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.149 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:28.149 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386699+0000", 2024-09-12T22:33:28.149 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8010000000000003e-06 2024-09-12T22:33:28.149 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.150 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.150 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:28.150 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.427136+0000", 2024-09-12T22:33:28.150 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.04043712 2024-09-12T22:33:28.150 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.150 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.150 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:28.150 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.427185+0000", 2024-09-12T22:33:28.150 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9493999999999997e-05 2024-09-12T22:33:28.150 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.150 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.150 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:28.151 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.428988+0000", 2024-09-12T22:33:28.151 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001803191 2024-09-12T22:33:28.151 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.151 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.151 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:28.151 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.429015+0000", 2024-09-12T22:33:28.151 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.6438999999999999e-05 2024-09-12T22:33:28.151 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.151 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.151 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:28.151 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.429050+0000", 2024-09-12T22:33:28.151 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.5070000000000001e-05 2024-09-12T22:33:28.151 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:28.152 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:28.152 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:28.152 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.152 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.152 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3064 3.2 3:42569fed:::200.00000011:head [write 3916704~1398 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:33:28.152 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:19.386705+0000", 2024-09-12T22:33:28.152 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 8.7135392990000007, 2024-09-12T22:33:28.152 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.043238378000000001, 2024-09-12T22:33:28.152 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:28.152 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:28.152 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:28.152 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:28.152 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.153 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:28.153 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386705+0000", 2024-09-12T22:33:28.153 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:28.153 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.153 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.153 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:28.153 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386705+0000", 2024-09-12T22:33:28.153 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:28.153 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.153 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.153 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:28.153 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386705+0000", 2024-09-12T22:33:28.153 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.8299999999999998e-07 2024-09-12T22:33:28.154 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.154 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.154 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:28.154 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386711+0000", 2024-09-12T22:33:28.154 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7080000000000002e-06 2024-09-12T22:33:28.154 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.154 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.154 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:28.154 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386717+0000", 2024-09-12T22:33:28.154 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.3990000000000001e-06 2024-09-12T22:33:28.154 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.154 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.154 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:28.154 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386722+0000", 2024-09-12T22:33:28.155 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9219999999999996e-06 2024-09-12T22:33:28.155 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.155 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.155 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:28.155 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.427585+0000", 2024-09-12T22:33:28.155 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.040863414000000001 2024-09-12T22:33:28.155 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.155 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.155 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:28.155 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.427628+0000", 2024-09-12T22:33:28.155 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2873000000000001e-05 2024-09-12T22:33:28.155 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.155 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.155 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:28.156 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.429871+0000", 2024-09-12T22:33:28.156 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.002242572 2024-09-12T22:33:28.156 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.156 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.156 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:28.156 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.429901+0000", 2024-09-12T22:33:28.156 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0114e-05 2024-09-12T22:33:28.156 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.156 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.156 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:28.156 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.429943+0000", 2024-09-12T22:33:28.156 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1993000000000003e-05 2024-09-12T22:33:28.156 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:28.157 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:28.157 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:28.157 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.157 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.157 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3065 3.2 3:42569fed:::200.00000011:head [write 3918102~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:33:28.157 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:19.386735+0000", 2024-09-12T22:33:28.157 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 8.7135090920000007, 2024-09-12T22:33:28.157 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.043278369999999997, 2024-09-12T22:33:28.157 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:28.157 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:28.157 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:28.157 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:28.157 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.158 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:28.158 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386735+0000", 2024-09-12T22:33:28.158 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:28.158 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.158 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.158 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:28.158 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386735+0000", 2024-09-12T22:33:28.158 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:28.158 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.158 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.158 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:28.158 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386735+0000", 2024-09-12T22:33:28.158 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.7300000000000001e-07 2024-09-12T22:33:28.158 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.159 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.159 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:28.159 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386738+0000", 2024-09-12T22:33:28.159 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8420000000000001e-06 2024-09-12T22:33:28.159 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.159 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.159 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:28.159 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386744+0000", 2024-09-12T22:33:28.159 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.3040000000000001e-06 2024-09-12T22:33:28.159 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.159 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.159 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:28.159 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386749+0000", 2024-09-12T22:33:28.160 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8409999999999999e-06 2024-09-12T22:33:28.160 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.160 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.160 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:28.160 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.428112+0000", 2024-09-12T22:33:28.160 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.041363204000000001 2024-09-12T22:33:28.160 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.160 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.160 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:28.160 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.428158+0000", 2024-09-12T22:33:28.160 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5756e-05 2024-09-12T22:33:28.160 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.160 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.160 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:28.161 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.429950+0000", 2024-09-12T22:33:28.161 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0017922859999999999 2024-09-12T22:33:28.161 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.161 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.161 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:28.161 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.429975+0000", 2024-09-12T22:33:28.161 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4640000000000001e-05 2024-09-12T22:33:28.161 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.161 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.161 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:28.161 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.430013+0000", 2024-09-12T22:33:28.161 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.8024000000000001e-05 2024-09-12T22:33:28.161 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:28.162 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:28.162 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:28.162 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.162 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.162 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3066 3.2 3:42569fed:::200.00000011:head [write 3919501~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:33:28.162 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:19.386755+0000", 2024-09-12T22:33:28.162 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 8.7134884509999999, 2024-09-12T22:33:28.162 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.044668934, 2024-09-12T22:33:28.162 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:28.162 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:28.162 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:28.162 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:28.162 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.162 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:28.163 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386755+0000", 2024-09-12T22:33:28.163 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:28.163 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.163 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.163 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:28.163 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386755+0000", 2024-09-12T22:33:28.163 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:28.163 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.163 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.163 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:28.163 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386756+0000", 2024-09-12T22:33:28.163 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4499999999999997e-07 2024-09-12T22:33:28.163 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.164 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.164 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:28.164 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386763+0000", 2024-09-12T22:33:28.164 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.6459999999999993e-06 2024-09-12T22:33:28.164 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.164 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.164 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:28.164 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386770+0000", 2024-09-12T22:33:28.164 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.19e-06 2024-09-12T22:33:28.164 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.164 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.164 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:28.164 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386775+0000", 2024-09-12T22:33:28.165 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9640000000000002e-06 2024-09-12T22:33:28.165 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.165 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.165 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:28.165 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.428489+0000", 2024-09-12T22:33:28.165 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.041714539000000002 2024-09-12T22:33:28.165 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.165 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.165 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:28.165 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.428535+0000", 2024-09-12T22:33:28.165 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5658999999999998e-05 2024-09-12T22:33:28.165 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.165 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.166 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:28.166 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.431353+0000", 2024-09-12T22:33:28.166 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0028186270000000002 2024-09-12T22:33:28.166 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.166 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.166 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:28.166 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.431385+0000", 2024-09-12T22:33:28.166 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.1374000000000001e-05 2024-09-12T22:33:28.166 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.166 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.166 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:28.166 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.431424+0000", 2024-09-12T22:33:28.166 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9490000000000003e-05 2024-09-12T22:33:28.166 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:28.167 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:28.167 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:28.167 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.167 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.167 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3067 3.2 3:42569fed:::200.00000011:head [write 3920900~2245 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:33:28.167 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:19.386781+0000", 2024-09-12T22:33:28.167 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 8.7134625620000001, 2024-09-12T22:33:28.167 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.044711322999999997, 2024-09-12T22:33:28.167 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:28.167 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:28.167 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:28.167 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:28.167 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.168 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:28.168 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386781+0000", 2024-09-12T22:33:28.168 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:28.168 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.168 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.168 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:28.168 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386781+0000", 2024-09-12T22:33:28.168 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:28.168 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.168 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.168 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:28.168 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386782+0000", 2024-09-12T22:33:28.168 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9900000000000001e-07 2024-09-12T22:33:28.169 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.169 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.169 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:28.169 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386795+0000", 2024-09-12T22:33:28.169 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2864000000000001e-05 2024-09-12T22:33:28.169 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.169 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.169 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:28.169 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386801+0000", 2024-09-12T22:33:28.169 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.3589999999999996e-06 2024-09-12T22:33:28.169 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.169 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.169 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:28.169 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386805+0000", 2024-09-12T22:33:28.170 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6190000000000002e-06 2024-09-12T22:33:28.170 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.170 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.170 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:28.170 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.429080+0000", 2024-09-12T22:33:28.170 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.042274027999999998 2024-09-12T22:33:28.170 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.170 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.170 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:28.170 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.429131+0000", 2024-09-12T22:33:28.170 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1715000000000002e-05 2024-09-12T22:33:28.170 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.170 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.171 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:28.171 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.431432+0000", 2024-09-12T22:33:28.171 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0023007489999999999 2024-09-12T22:33:28.171 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.171 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.171 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:28.171 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.431458+0000", 2024-09-12T22:33:28.171 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.603e-05 2024-09-12T22:33:28.171 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.171 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.171 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:28.171 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.431493+0000", 2024-09-12T22:33:28.171 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4560000000000001e-05 2024-09-12T22:33:28.171 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:28.172 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:28.172 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:28.172 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.172 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.172 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3068 3.2 3:42569fed:::200.00000011:head [write 3923145~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:33:28.172 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:19.386812+0000", 2024-09-12T22:33:28.172 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 8.7134318030000006, 2024-09-12T22:33:28.172 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.045559559999999999, 2024-09-12T22:33:28.172 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:28.172 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:28.172 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:28.172 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:28.172 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.173 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:28.173 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386812+0000", 2024-09-12T22:33:28.173 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:28.173 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.173 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.173 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:28.173 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386812+0000", 2024-09-12T22:33:28.173 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:28.173 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.173 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.173 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:28.173 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386812+0000", 2024-09-12T22:33:28.173 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.01e-07 2024-09-12T22:33:28.174 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.174 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.174 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:28.174 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386823+0000", 2024-09-12T22:33:28.174 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1038e-05 2024-09-12T22:33:28.174 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.174 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.174 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:28.174 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386830+0000", 2024-09-12T22:33:28.174 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.5409999999999997e-06 2024-09-12T22:33:28.174 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.174 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.174 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:28.174 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386835+0000", 2024-09-12T22:33:28.175 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.091e-06 2024-09-12T22:33:28.175 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.175 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.175 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:28.175 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.429460+0000", 2024-09-12T22:33:28.175 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.042625333000000001 2024-09-12T22:33:28.175 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.175 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.175 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:28.175 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.429506+0000", 2024-09-12T22:33:28.175 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5299000000000001e-05 2024-09-12T22:33:28.175 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.175 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.176 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:28.176 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.432283+0000", 2024-09-12T22:33:28.176 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0027776799999999998 2024-09-12T22:33:28.176 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.176 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.176 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:28.176 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.432315+0000", 2024-09-12T22:33:28.176 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.1401e-05 2024-09-12T22:33:28.176 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.176 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.176 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:28.176 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.432372+0000", 2024-09-12T22:33:28.177 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.6776e-05 2024-09-12T22:33:28.177 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:28.177 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:28.177 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:28.177 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.177 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.177 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3069 3.2 3:42569fed:::200.00000011:head [write 3924544~2246 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:33:28.177 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:19.386842+0000", 2024-09-12T22:33:28.177 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 8.7134019029999994, 2024-09-12T22:33:28.177 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.045596166, 2024-09-12T22:33:28.177 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:28.177 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:28.177 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:28.178 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:28.178 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.178 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:28.178 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386842+0000", 2024-09-12T22:33:28.178 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:28.178 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.178 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.178 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:28.178 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386842+0000", 2024-09-12T22:33:28.178 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:28.178 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.178 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.178 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:28.179 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386842+0000", 2024-09-12T22:33:28.179 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5200000000000002e-07 2024-09-12T22:33:28.179 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.179 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.179 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:28.179 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386845+0000", 2024-09-12T22:33:28.179 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8820000000000001e-06 2024-09-12T22:33:28.179 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.179 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.179 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:28.179 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386851+0000", 2024-09-12T22:33:28.179 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9540000000000001e-06 2024-09-12T22:33:28.179 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.179 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.180 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:28.180 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386856+0000", 2024-09-12T22:33:28.180 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5159999999999996e-06 2024-09-12T22:33:28.180 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.180 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.180 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:28.180 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.430043+0000", 2024-09-12T22:33:28.180 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.043186930999999998 2024-09-12T22:33:28.180 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.180 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.180 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:28.180 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.430086+0000", 2024-09-12T22:33:28.180 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3844999999999998e-05 2024-09-12T22:33:28.181 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.181 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.181 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:28.181 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.432379+0000", 2024-09-12T22:33:28.181 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0022922049999999999 2024-09-12T22:33:28.181 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.181 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.181 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:28.181 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.432405+0000", 2024-09-12T22:33:28.181 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5877999999999999e-05 2024-09-12T22:33:28.181 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.181 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.181 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:28.181 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.432438+0000", 2024-09-12T22:33:28.182 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3503000000000001e-05 2024-09-12T22:33:28.182 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:28.182 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:28.182 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:28.182 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.182 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.182 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3070 3.2 3:42569fed:::200.00000011:head [write 3926790~2768 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:33:28.182 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:19.387280+0000", 2024-09-12T22:33:28.182 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 8.7129637350000007, 2024-09-12T22:33:28.182 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.04692201, 2024-09-12T22:33:28.182 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:28.182 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:28.182 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:28.183 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:28.183 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.183 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:28.183 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.387280+0000", 2024-09-12T22:33:28.183 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:28.183 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.183 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.183 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:28.183 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.387280+0000", 2024-09-12T22:33:28.183 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:28.183 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.183 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.183 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:28.184 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.387281+0000", 2024-09-12T22:33:28.184 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4300000000000002e-07 2024-09-12T22:33:28.184 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.184 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.184 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:28.184 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.387285+0000", 2024-09-12T22:33:28.184 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2570000000000001e-06 2024-09-12T22:33:28.184 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.184 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.184 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:28.184 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.387293+0000", 2024-09-12T22:33:28.184 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0209999999999999e-06 2024-09-12T22:33:28.184 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.185 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.185 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:28.185 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.387299+0000", 2024-09-12T22:33:28.185 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.6930000000000004e-06 2024-09-12T22:33:28.185 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.185 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.185 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:28.185 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.430441+0000", 2024-09-12T22:33:28.185 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.043141789999999999 2024-09-12T22:33:28.185 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.185 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.185 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:28.185 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.430484+0000", 2024-09-12T22:33:28.186 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3745000000000002e-05 2024-09-12T22:33:28.186 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.186 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.186 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:28.186 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.434132+0000", 2024-09-12T22:33:28.186 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00364818 2024-09-12T22:33:28.186 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.186 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.186 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:28.186 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.434163+0000", 2024-09-12T22:33:28.186 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0599000000000003e-05 2024-09-12T22:33:28.186 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.186 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.187 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:28.187 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.434202+0000", 2024-09-12T22:33:28.187 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.8982e-05 2024-09-12T22:33:28.187 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:28.187 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:28.187 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:28.187 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.187 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.187 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3071 3.2 3:42569fed:::200.00000011:head [write 3929558~3203 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:33:28.187 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:19.387860+0000", 2024-09-12T22:33:28.187 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 8.7123837050000006, 2024-09-12T22:33:28.187 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.049590902999999999, 2024-09-12T22:33:28.187 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:28.187 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:28.188 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:28.188 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:28.188 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.188 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:28.188 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.387860+0000", 2024-09-12T22:33:28.188 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:28.188 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.188 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.188 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:28.188 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.387860+0000", 2024-09-12T22:33:28.188 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:28.188 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.188 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.189 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:28.189 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.387861+0000", 2024-09-12T22:33:28.189 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5099999999999999e-07 2024-09-12T22:33:28.189 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.189 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.189 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:28.189 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.387865+0000", 2024-09-12T22:33:28.189 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2629999999999997e-06 2024-09-12T22:33:28.189 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.189 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.189 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:28.189 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.387875+0000", 2024-09-12T22:33:28.189 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0256e-05 2024-09-12T22:33:28.189 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.190 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.190 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:28.190 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.387881+0000", 2024-09-12T22:33:28.190 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.947e-06 2024-09-12T22:33:28.190 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.190 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.190 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:28.190 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.430930+0000", 2024-09-12T22:33:28.190 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.043048386000000001 2024-09-12T22:33:28.190 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.190 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.190 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:28.191 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.430976+0000", 2024-09-12T22:33:28.191 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6408e-05 2024-09-12T22:33:28.191 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.191 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.191 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:28.191 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.437377+0000", 2024-09-12T22:33:28.191 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0064010719999999998 2024-09-12T22:33:28.191 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.191 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.191 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:28.191 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.437409+0000", 2024-09-12T22:33:28.191 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2054999999999997e-05 2024-09-12T22:33:28.191 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.192 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.192 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:28.192 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.437451+0000", 2024-09-12T22:33:28.192 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1764999999999997e-05 2024-09-12T22:33:28.192 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:28.192 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:28.192 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:28.192 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.192 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.192 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3072 3.2 3:42569fed:::200.00000011:head [write 3932761~2786 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:33:28.192 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:19.388005+0000", 2024-09-12T22:33:28.192 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 8.7122386059999997, 2024-09-12T22:33:28.192 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.049514177999999999, 2024-09-12T22:33:28.193 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:28.193 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:28.193 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:28.193 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:28.193 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.193 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:28.193 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.388005+0000", 2024-09-12T22:33:28.193 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:28.193 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.193 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.193 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:28.193 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.388005+0000", 2024-09-12T22:33:28.193 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:28.193 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.194 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.194 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:28.194 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.388006+0000", 2024-09-12T22:33:28.194 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.1799999999999995e-07 2024-09-12T22:33:28.194 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.194 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.194 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:28.194 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.388009+0000", 2024-09-12T22:33:28.194 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.574e-06 2024-09-12T22:33:28.194 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.194 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.194 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:28.194 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.388017+0000", 2024-09-12T22:33:28.195 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3170000000000004e-06 2024-09-12T22:33:28.195 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.195 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.195 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:28.195 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.388022+0000", 2024-09-12T22:33:28.195 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9910000000000002e-06 2024-09-12T22:33:28.195 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.195 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.195 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:28.195 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.431522+0000", 2024-09-12T22:33:28.195 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0435001 2024-09-12T22:33:28.195 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.195 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.196 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:28.196 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.431567+0000", 2024-09-12T22:33:28.196 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4734000000000002e-05 2024-09-12T22:33:28.196 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.196 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.196 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:28.196 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.437458+0000", 2024-09-12T22:33:28.196 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00589166 2024-09-12T22:33:28.196 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.196 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.196 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:28.196 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.437484+0000", 2024-09-12T22:33:28.196 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5622999999999998e-05 2024-09-12T22:33:28.197 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.197 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.197 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:28.197 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.437519+0000", 2024-09-12T22:33:28.197 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.5561000000000001e-05 2024-09-12T22:33:28.197 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:28.197 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:28.197 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:28.197 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.197 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.197 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3073 3.2 3:42569fed:::200.00000011:head [write 3935547~1924 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:33:28.197 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:19.389181+0000", 2024-09-12T22:33:28.197 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 8.7110624439999995, 2024-09-12T22:33:28.198 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.048402300000000002, 2024-09-12T22:33:28.198 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:28.198 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:28.198 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:28.198 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:28.198 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.198 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:28.198 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.389181+0000", 2024-09-12T22:33:28.198 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:28.198 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.198 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.198 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:28.198 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.389181+0000", 2024-09-12T22:33:28.198 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:28.199 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.199 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.199 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:28.199 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.389182+0000", 2024-09-12T22:33:28.199 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7700000000000004e-07 2024-09-12T22:33:28.199 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.199 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.199 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:28.199 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.389191+0000", 2024-09-12T22:33:28.199 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1120000000000002e-06 2024-09-12T22:33:28.199 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.199 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.199 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:28.200 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.389203+0000", 2024-09-12T22:33:28.200 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.146e-05 2024-09-12T22:33:28.200 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.200 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.200 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:28.200 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.389209+0000", 2024-09-12T22:33:28.200 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9989999999999997e-06 2024-09-12T22:33:28.200 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.200 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.200 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:28.200 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.431890+0000", 2024-09-12T22:33:28.200 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.042681251000000003 2024-09-12T22:33:28.200 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.201 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.201 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:28.201 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.431935+0000", 2024-09-12T22:33:28.201 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5166000000000001e-05 2024-09-12T22:33:28.201 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.201 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.201 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:28.201 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.437526+0000", 2024-09-12T22:33:28.201 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0055910489999999998 2024-09-12T22:33:28.201 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.201 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.201 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:28.201 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.437550+0000", 2024-09-12T22:33:28.201 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4134999999999998e-05 2024-09-12T22:33:28.202 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.202 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.202 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:28.202 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.437584+0000", 2024-09-12T22:33:28.202 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3451000000000002e-05 2024-09-12T22:33:28.202 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:28.202 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:28.202 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:28.202 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.202 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.202 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3074 3.2 3:42569fed:::200.00000011:head [write 3937471~7660 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:33:28.202 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:19.390512+0000", 2024-09-12T22:33:28.202 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 8.7097313209999996, 2024-09-12T22:33:28.203 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.047134045999999999, 2024-09-12T22:33:28.203 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:28.203 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:28.203 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:28.203 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:28.203 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.203 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:28.203 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.390512+0000", 2024-09-12T22:33:28.203 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:28.203 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.203 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.203 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:28.203 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.390512+0000", 2024-09-12T22:33:28.203 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:28.204 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.204 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.204 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:28.204 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.390513+0000", 2024-09-12T22:33:28.204 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.7699999999999992e-07 2024-09-12T22:33:28.204 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.204 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.204 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:28.204 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.390522+0000", 2024-09-12T22:33:28.204 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0390000000000005e-06 2024-09-12T22:33:28.204 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.204 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.204 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:28.204 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.390530+0000", 2024-09-12T22:33:28.205 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.8349999999999993e-06 2024-09-12T22:33:28.205 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.205 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.205 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:28.205 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.390537+0000", 2024-09-12T22:33:28.205 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.1850000000000001e-06 2024-09-12T22:33:28.205 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.205 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.205 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:28.205 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.432468+0000", 2024-09-12T22:33:28.205 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.041931883000000003 2024-09-12T22:33:28.205 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.205 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.206 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:28.206 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.432512+0000", 2024-09-12T22:33:28.206 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4054999999999997e-05 2024-09-12T22:33:28.206 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.206 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.206 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:28.206 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.437590+0000", 2024-09-12T22:33:28.206 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0050777230000000001 2024-09-12T22:33:28.206 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.206 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.206 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:28.206 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.437613+0000", 2024-09-12T22:33:28.206 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.2693000000000001e-05 2024-09-12T22:33:28.206 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:28.207 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:28.207 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:28.207 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.437647+0000", 2024-09-12T22:33:28.207 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3655999999999998e-05 2024-09-12T22:33:28.207 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:28.207 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:28.207 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:28.207 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:28.207 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:28.207 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:33:28.209 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:33:28.209 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:28.207+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:28.309 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:28.308+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:28.314 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-09-12T22:33:28.314 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-09-12T22:33:28.314 INFO:teuthology.orchestra.run.smithi163.stdout: "num_ops": 0 2024-09-12T22:33:28.314 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-09-12T22:33:28.323 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:33:28.411 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:28.410+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:28.427 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-09-12T22:33:28.427 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-09-12T22:33:28.427 INFO:teuthology.orchestra.run.smithi163.stdout: "complaint_time": 30, 2024-09-12T22:33:28.427 INFO:teuthology.orchestra.run.smithi163.stdout: "num_blocked_ops": 0 2024-09-12T22:33:28.427 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-09-12T22:33:28.435 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:33:28.511 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:28.510+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:28.557 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-09-12T22:33:28.557 INFO:teuthology.orchestra.run.smithi163.stdout: "size": 20, 2024-09-12T22:33:28.557 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 600, 2024-09-12T22:33:28.558 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2024-09-12T22:33:28.558 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.558 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-09-12T22:33:28.558 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:27.254459+0000", 2024-09-12T22:33:28.558 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 121.299379769, 2024-09-12T22:33:28.558 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.37816283899999997, 2024-09-12T22:33:28.558 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:28.558 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:28.558 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:28.558 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:28.558 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:33:28.559 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:33:28.559 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 1 2024-09-12T22:33:28.559 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.559 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:28.559 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.559 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:28.559 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254459+0000", 2024-09-12T22:33:28.559 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:28.559 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.559 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.559 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:28.559 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254459+0000", 2024-09-12T22:33:28.559 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:28.560 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.560 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.560 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:28.560 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254460+0000", 2024-09-12T22:33:28.560 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1739999999999999e-06 2024-09-12T22:33:28.560 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.560 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.560 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:28.560 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254472+0000", 2024-09-12T22:33:28.560 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2207e-05 2024-09-12T22:33:28.560 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.560 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.561 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:28.561 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254483+0000", 2024-09-12T22:33:28.561 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0631999999999999e-05 2024-09-12T22:33:28.561 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.561 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.561 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:28.561 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254492+0000", 2024-09-12T22:33:28.561 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3670000000000003e-06 2024-09-12T22:33:28.561 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.561 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.561 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:28.561 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254551+0000", 2024-09-12T22:33:28.561 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8687999999999998e-05 2024-09-12T22:33:28.562 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.562 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.562 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for peered", 2024-09-12T22:33:28.562 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254562+0000", 2024-09-12T22:33:28.562 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1249e-05 2024-09-12T22:33:28.562 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.562 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.562 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:28.562 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.631211+0000", 2024-09-12T22:33:28.562 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.376649018 2024-09-12T22:33:28.562 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.562 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.562 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:28.563 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.631345+0000", 2024-09-12T22:33:28.563 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013378700000000001 2024-09-12T22:33:28.563 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.563 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.563 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:33:28.563 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.631479+0000", 2024-09-12T22:33:28.563 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013352399999999999 2024-09-12T22:33:28.563 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.563 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.563 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:28.563 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632324+0000", 2024-09-12T22:33:28.563 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00084508100000000002 2024-09-12T22:33:28.563 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.564 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.564 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:28.564 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632548+0000", 2024-09-12T22:33:28.564 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000224329 2024-09-12T22:33:28.564 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.564 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.564 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:28.564 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632591+0000", 2024-09-12T22:33:28.564 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2564000000000001e-05 2024-09-12T22:33:28.564 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.564 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.564 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:28.564 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632622+0000", 2024-09-12T22:33:28.565 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1219e-05 2024-09-12T22:33:28.565 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:28.565 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:28.565 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:28.565 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.565 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.565 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4490.0:9871 4.35 4:ad66404a:::10000002d4d.00000000:head [write 0~6507] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:33:28.565 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:09.472309+0000", 2024-09-12T22:33:28.565 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 19.081529493000001, 2024-09-12T22:33:28.565 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.080251445000000005, 2024-09-12T22:33:28.565 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:28.566 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:28.566 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:28.566 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:28.566 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4490", 2024-09-12T22:33:28.566 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:28.566 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 9871 2024-09-12T22:33:28.566 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.566 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:28.566 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.566 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:28.566 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.472309+0000", 2024-09-12T22:33:28.566 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:28.566 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.566 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.567 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:28.567 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.472309+0000", 2024-09-12T22:33:28.567 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:28.567 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.567 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.567 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:28.567 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.472310+0000", 2024-09-12T22:33:28.567 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3799999999999996e-07 2024-09-12T22:33:28.567 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.567 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.567 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:28.567 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.472318+0000", 2024-09-12T22:33:28.567 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.8099999999999998e-06 2024-09-12T22:33:28.568 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.568 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.568 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:28.568 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.472328+0000", 2024-09-12T22:33:28.568 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0359e-05 2024-09-12T22:33:28.568 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.568 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.568 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:28.568 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.472334+0000", 2024-09-12T22:33:28.568 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.0109999999999997e-06 2024-09-12T22:33:28.568 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.568 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.569 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:28.569 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.472382+0000", 2024-09-12T22:33:28.569 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.7311000000000002e-05 2024-09-12T22:33:28.569 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.569 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.569 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:28.569 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.472497+0000", 2024-09-12T22:33:28.569 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011537800000000001 2024-09-12T22:33:28.569 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.569 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.569 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:28.569 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.472617+0000", 2024-09-12T22:33:28.569 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011989600000000001 2024-09-12T22:33:28.570 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.570 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.570 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:28.570 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473149+0000", 2024-09-12T22:33:28.570 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00053227999999999999 2024-09-12T22:33:28.570 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.570 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.570 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:28.570 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.552479+0000", 2024-09-12T22:33:28.570 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.079329541000000003 2024-09-12T22:33:28.570 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.570 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.570 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:28.571 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.552525+0000", 2024-09-12T22:33:28.571 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6421000000000002e-05 2024-09-12T22:33:28.571 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.571 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.571 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:28.571 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.552561+0000", 2024-09-12T22:33:28.571 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5599999999999998e-05 2024-09-12T22:33:28.571 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:28.571 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:28.571 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:28.571 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.571 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.572 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4490.0:9872 4.2c 4:3602c8d3:::10000002d4e.00000000:head [write 0~1178] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:33:28.572 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:09.473085+0000", 2024-09-12T22:33:28.572 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 19.080754189, 2024-09-12T22:33:28.572 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.079631104999999994, 2024-09-12T22:33:28.572 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:28.572 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:28.572 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:28.572 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:28.572 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4490", 2024-09-12T22:33:28.572 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:28.572 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 9872 2024-09-12T22:33:28.572 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.573 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:28.573 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.573 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:28.573 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473085+0000", 2024-09-12T22:33:28.573 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:28.573 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.573 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.573 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:28.573 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473085+0000", 2024-09-12T22:33:28.573 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:28.574 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.574 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.574 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:28.574 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473085+0000", 2024-09-12T22:33:28.574 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3600000000000004e-07 2024-09-12T22:33:28.574 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.574 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.574 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:28.574 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473088+0000", 2024-09-12T22:33:28.574 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.005e-06 2024-09-12T22:33:28.574 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.574 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.574 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:28.575 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473095+0000", 2024-09-12T22:33:28.575 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3950000000000003e-06 2024-09-12T22:33:28.575 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.575 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.575 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:28.575 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473100+0000", 2024-09-12T22:33:28.575 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5460000000000002e-06 2024-09-12T22:33:28.575 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.575 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.575 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:28.575 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473138+0000", 2024-09-12T22:33:28.575 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8244999999999997e-05 2024-09-12T22:33:28.575 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.576 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.576 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:28.576 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473216+0000", 2024-09-12T22:33:28.576 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.7756000000000006e-05 2024-09-12T22:33:28.576 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.576 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.576 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:28.576 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473291+0000", 2024-09-12T22:33:28.576 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5110000000000004e-05 2024-09-12T22:33:28.576 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.576 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.576 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:28.576 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473736+0000", 2024-09-12T22:33:28.577 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00044486500000000002 2024-09-12T22:33:28.577 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.577 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.577 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:28.577 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.552637+0000", 2024-09-12T22:33:28.577 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.078900782000000003 2024-09-12T22:33:28.577 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.577 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.577 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:28.577 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.552680+0000", 2024-09-12T22:33:28.577 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3047999999999998e-05 2024-09-12T22:33:28.577 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.577 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.578 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:28.578 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.552716+0000", 2024-09-12T22:33:28.578 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5816999999999999e-05 2024-09-12T22:33:28.578 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:28.578 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:28.578 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:28.578 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.578 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.578 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4490.0:9873 4.2c 4:372c52ff:::10000002d4f.00000000:head [write 0~1230] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:33:28.578 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:09.473878+0000", 2024-09-12T22:33:28.578 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 19.079960725999999, 2024-09-12T22:33:28.578 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.079036047999999998, 2024-09-12T22:33:28.578 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:28.579 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:28.579 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:28.579 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:28.579 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4490", 2024-09-12T22:33:28.579 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:28.579 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 9873 2024-09-12T22:33:28.579 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.579 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:28.579 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.579 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:28.579 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473878+0000", 2024-09-12T22:33:28.579 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:28.579 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.580 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.580 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:28.580 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473878+0000", 2024-09-12T22:33:28.580 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:28.580 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.580 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.580 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:28.580 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473879+0000", 2024-09-12T22:33:28.580 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9100000000000004e-07 2024-09-12T22:33:28.580 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.580 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.580 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:28.580 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473882+0000", 2024-09-12T22:33:28.581 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.405e-06 2024-09-12T22:33:28.581 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.581 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.581 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:28.581 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473889+0000", 2024-09-12T22:33:28.581 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7519999999999999e-06 2024-09-12T22:33:28.581 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.581 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.581 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:28.581 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473893+0000", 2024-09-12T22:33:28.581 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9310000000000001e-06 2024-09-12T22:33:28.581 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.581 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.582 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:28.582 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473922+0000", 2024-09-12T22:33:28.582 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9346999999999999e-05 2024-09-12T22:33:28.582 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.582 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.582 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:28.582 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474000+0000", 2024-09-12T22:33:28.582 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.7972000000000005e-05 2024-09-12T22:33:28.582 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.582 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.582 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:28.582 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474072+0000", 2024-09-12T22:33:28.582 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1960999999999998e-05 2024-09-12T22:33:28.582 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.583 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.583 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:28.583 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474470+0000", 2024-09-12T22:33:28.583 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00039803400000000002 2024-09-12T22:33:28.583 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.583 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.583 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:28.583 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.552814+0000", 2024-09-12T22:33:28.583 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.078344164999999993 2024-09-12T22:33:28.583 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.583 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.583 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:28.583 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.552875+0000", 2024-09-12T22:33:28.584 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1008999999999998e-05 2024-09-12T22:33:28.584 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.584 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.584 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:28.584 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.552914+0000", 2024-09-12T22:33:28.584 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8881000000000003e-05 2024-09-12T22:33:28.584 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:28.584 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:28.584 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:28.584 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.584 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.584 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4490.0:9874 4.1b 4:db19d96a:::10000002d50.00000000:head [write 0~1088] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:33:28.585 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:09.474673+0000", 2024-09-12T22:33:28.585 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 19.079165733, 2024-09-12T22:33:28.585 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.080314317999999996, 2024-09-12T22:33:28.585 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:28.585 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:28.585 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:28.585 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:28.585 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4490", 2024-09-12T22:33:28.585 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:28.585 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 9874 2024-09-12T22:33:28.585 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.585 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:28.585 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.586 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:28.586 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474673+0000", 2024-09-12T22:33:28.586 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:28.586 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.586 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.586 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:28.586 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474673+0000", 2024-09-12T22:33:28.586 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:28.586 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.586 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.586 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:28.586 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474674+0000", 2024-09-12T22:33:28.587 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6199999999999998e-07 2024-09-12T22:33:28.587 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.587 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.587 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:28.587 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474677+0000", 2024-09-12T22:33:28.587 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.224e-06 2024-09-12T22:33:28.587 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.587 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.587 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:28.587 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474683+0000", 2024-09-12T22:33:28.587 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.3160000000000002e-06 2024-09-12T22:33:28.587 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.587 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.588 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:28.588 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474687+0000", 2024-09-12T22:33:28.588 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7869999999999999e-06 2024-09-12T22:33:28.588 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.588 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.588 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:28.588 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474730+0000", 2024-09-12T22:33:28.588 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3309000000000002e-05 2024-09-12T22:33:28.588 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.588 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.588 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:28.589 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474845+0000", 2024-09-12T22:33:28.589 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114306 2024-09-12T22:33:28.589 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.589 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.589 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:28.589 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474970+0000", 2024-09-12T22:33:28.589 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000125096 2024-09-12T22:33:28.589 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.589 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.589 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:28.589 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.475621+0000", 2024-09-12T22:33:28.589 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00065124900000000001 2024-09-12T22:33:28.590 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.590 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.590 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:28.590 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.554885+0000", 2024-09-12T22:33:28.590 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.079264055 2024-09-12T22:33:28.590 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.590 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.590 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:28.590 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.554942+0000", 2024-09-12T22:33:28.590 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7284000000000002e-05 2024-09-12T22:33:28.590 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.590 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.590 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:28.591 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.554987+0000", 2024-09-12T22:33:28.591 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5130000000000003e-05 2024-09-12T22:33:28.591 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:28.591 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:28.591 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:28.591 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.591 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.591 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4490.0:12220 4.2b 4:d55bfd66:::10000003169.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-12T22:33:28.591 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.391333+0000", 2024-09-12T22:33:28.592 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 14.16250559, 2024-09-12T22:33:28.592 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.088669550999999999, 2024-09-12T22:33:28.592 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:28.592 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:28.592 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:28.592 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:28.592 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4490", 2024-09-12T22:33:28.592 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:28.592 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 12220 2024-09-12T22:33:28.592 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.592 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:28.592 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.593 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:28.593 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.391333+0000", 2024-09-12T22:33:28.593 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:28.593 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.593 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.593 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:28.593 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.391333+0000", 2024-09-12T22:33:28.593 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:28.593 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.593 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.593 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:28.593 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.391334+0000", 2024-09-12T22:33:28.593 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3099999999999997e-07 2024-09-12T22:33:28.594 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.594 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.594 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:28.594 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398373+0000", 2024-09-12T22:33:28.594 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0070386670000000002 2024-09-12T22:33:28.594 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.594 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.594 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:28.594 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398384+0000", 2024-09-12T22:33:28.594 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1338999999999999e-05 2024-09-12T22:33:28.594 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.594 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.594 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:28.595 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398389+0000", 2024-09-12T22:33:28.595 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3650000000000003e-06 2024-09-12T22:33:28.595 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.595 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.595 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:28.595 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.456308+0000", 2024-09-12T22:33:28.595 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.057918931 2024-09-12T22:33:28.595 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.595 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.595 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:28.595 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.456425+0000", 2024-09-12T22:33:28.595 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000116452 2024-09-12T22:33:28.595 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.595 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.596 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:28.596 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.456536+0000", 2024-09-12T22:33:28.596 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000111839 2024-09-12T22:33:28.596 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.596 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.596 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:28.596 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.465335+0000", 2024-09-12T22:33:28.596 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0087984980000000001 2024-09-12T22:33:28.596 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.597 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.597 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:28.597 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.479950+0000", 2024-09-12T22:33:28.597 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.01461552 2024-09-12T22:33:28.597 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.597 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.597 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:28.597 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.479983+0000", 2024-09-12T22:33:28.597 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2126999999999999e-05 2024-09-12T22:33:28.597 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.597 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.597 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:28.597 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.480003+0000", 2024-09-12T22:33:28.598 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0081999999999998e-05 2024-09-12T22:33:28.598 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:28.598 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:28.598 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:28.598 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.598 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.598 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1208 3.13 3:cb3d3880:::200.0000000d:head [write 1009846~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:28.598 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.398459+0000", 2024-09-12T22:33:28.598 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 14.155380023999999, 2024-09-12T22:33:28.598 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.078093931000000005, 2024-09-12T22:33:28.598 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:28.598 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:28.598 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:28.599 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:28.599 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.599 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:28.599 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398459+0000", 2024-09-12T22:33:28.599 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:28.599 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.599 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.599 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:28.599 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398459+0000", 2024-09-12T22:33:28.599 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:28.599 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.599 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.599 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:28.599 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398459+0000", 2024-09-12T22:33:28.600 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8100000000000003e-07 2024-09-12T22:33:28.600 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.600 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.600 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:28.600 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398462+0000", 2024-09-12T22:33:28.600 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3700000000000002e-06 2024-09-12T22:33:28.600 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.600 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.600 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:28.600 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398469+0000", 2024-09-12T22:33:28.600 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2320000000000004e-06 2024-09-12T22:33:28.600 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.600 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.601 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:28.601 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398472+0000", 2024-09-12T22:33:28.601 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.658e-06 2024-09-12T22:33:28.601 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.601 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.601 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:28.601 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.456690+0000", 2024-09-12T22:33:28.601 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.058217615 2024-09-12T22:33:28.601 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.601 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.601 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:28.601 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.456731+0000", 2024-09-12T22:33:28.601 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0815000000000001e-05 2024-09-12T22:33:28.601 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.602 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.602 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:28.602 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.456793+0000", 2024-09-12T22:33:28.602 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1796000000000003e-05 2024-09-12T22:33:28.602 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.602 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.602 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:28.602 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.461412+0000", 2024-09-12T22:33:28.602 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0046188560000000002 2024-09-12T22:33:28.602 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.602 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.602 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:28.602 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476429+0000", 2024-09-12T22:33:28.603 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.015017943000000001 2024-09-12T22:33:28.603 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.603 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.603 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:28.603 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476499+0000", 2024-09-12T22:33:28.603 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9047000000000005e-05 2024-09-12T22:33:28.603 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.603 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.603 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:28.603 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476553+0000", 2024-09-12T22:33:28.603 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4117999999999999e-05 2024-09-12T22:33:28.603 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:28.603 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:28.603 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:28.604 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.604 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.604 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1209 3.13 3:cb3d3880:::200.0000000d:head [write 1011245~5867 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:28.604 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.398677+0000", 2024-09-12T22:33:28.604 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 14.155161466999999, 2024-09-12T22:33:28.604 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.077995698000000002, 2024-09-12T22:33:28.604 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:28.604 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:28.604 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:28.604 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:28.604 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.605 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:28.605 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398677+0000", 2024-09-12T22:33:28.605 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:28.605 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.605 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.605 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:28.605 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398677+0000", 2024-09-12T22:33:28.605 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:28.605 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.605 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.605 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:28.605 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398678+0000", 2024-09-12T22:33:28.605 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5199999999999995e-07 2024-09-12T22:33:28.606 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.606 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.606 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:28.606 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398686+0000", 2024-09-12T22:33:28.606 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0579999999999998e-06 2024-09-12T22:33:28.606 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.606 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.606 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:28.606 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398695+0000", 2024-09-12T22:33:28.606 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.1409999999999994e-06 2024-09-12T22:33:28.606 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.606 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.606 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:28.606 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398703+0000", 2024-09-12T22:33:28.607 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4379999999999998e-06 2024-09-12T22:33:28.607 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.607 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.607 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:28.607 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.457051+0000", 2024-09-12T22:33:28.607 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.058348358000000003 2024-09-12T22:33:28.607 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.607 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.607 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:28.607 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.457096+0000", 2024-09-12T22:33:28.607 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4428000000000002e-05 2024-09-12T22:33:28.607 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.607 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.607 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:28.608 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.457162+0000", 2024-09-12T22:33:28.608 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6298999999999997e-05 2024-09-12T22:33:28.608 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.608 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.608 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:28.608 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.461416+0000", 2024-09-12T22:33:28.608 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0042539980000000002 2024-09-12T22:33:28.608 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.608 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.608 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:28.608 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476610+0000", 2024-09-12T22:33:28.608 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.015193879 2024-09-12T22:33:28.609 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.609 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.609 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:28.609 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476640+0000", 2024-09-12T22:33:28.609 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0648000000000002e-05 2024-09-12T22:33:28.609 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.609 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.609 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:28.609 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476673+0000", 2024-09-12T22:33:28.609 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2598999999999997e-05 2024-09-12T22:33:28.609 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:28.609 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:28.609 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:28.609 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.610 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.610 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1210 3.13 3:cb3d3880:::200.0000000d:head [write 1017112~1958 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:28.610 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.398713+0000", 2024-09-12T22:33:28.610 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 14.155126144, 2024-09-12T22:33:28.610 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.078118317000000007, 2024-09-12T22:33:28.610 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:28.610 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:28.610 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:28.610 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:28.610 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.610 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:28.610 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398713+0000", 2024-09-12T22:33:28.610 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:28.611 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.611 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.611 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:28.611 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398713+0000", 2024-09-12T22:33:28.611 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:28.611 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.611 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.611 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:28.611 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398713+0000", 2024-09-12T22:33:28.611 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7599999999999998e-07 2024-09-12T22:33:28.611 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.611 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.611 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:28.612 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398718+0000", 2024-09-12T22:33:28.612 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8169999999999998e-06 2024-09-12T22:33:28.612 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.612 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.612 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:28.612 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398722+0000", 2024-09-12T22:33:28.612 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5249999999999999e-06 2024-09-12T22:33:28.612 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.612 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.612 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:28.612 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398726+0000", 2024-09-12T22:33:28.612 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5650000000000002e-06 2024-09-12T22:33:28.612 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.613 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.613 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:28.613 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.457644+0000", 2024-09-12T22:33:28.613 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.058918521000000001 2024-09-12T22:33:28.613 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.613 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.613 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:28.613 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.457724+0000", 2024-09-12T22:33:28.613 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9408999999999998e-05 2024-09-12T22:33:28.613 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.613 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.613 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:28.614 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.457821+0000", 2024-09-12T22:33:28.614 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.7015000000000005e-05 2024-09-12T22:33:28.614 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.614 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.614 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:28.614 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.461419+0000", 2024-09-12T22:33:28.614 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0035985309999999999 2024-09-12T22:33:28.614 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.614 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.614 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:28.614 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476726+0000", 2024-09-12T22:33:28.614 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.015306804 2024-09-12T22:33:28.614 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.615 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.615 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:28.615 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476787+0000", 2024-09-12T22:33:28.615 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1062000000000006e-05 2024-09-12T22:33:28.615 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.615 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.615 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:28.615 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476831+0000", 2024-09-12T22:33:28.615 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3692000000000001e-05 2024-09-12T22:33:28.615 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:28.615 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:28.615 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:28.615 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.615 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.616 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1211 3.13 3:cb3d3880:::200.0000000d:head [write 1019070~5873 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:28.616 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.400122+0000", 2024-09-12T22:33:28.616 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 14.153716426000001, 2024-09-12T22:33:28.616 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.076797146999999996, 2024-09-12T22:33:28.616 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:28.616 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:28.616 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:28.616 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:28.616 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.616 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:28.616 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.400122+0000", 2024-09-12T22:33:28.617 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:28.617 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.617 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.617 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:28.617 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.400122+0000", 2024-09-12T22:33:28.617 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:28.617 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.617 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.617 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:28.617 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.400123+0000", 2024-09-12T22:33:28.617 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2500000000000005e-07 2024-09-12T22:33:28.617 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.618 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.618 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:28.618 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.400129+0000", 2024-09-12T22:33:28.618 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.319e-06 2024-09-12T22:33:28.618 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.618 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.618 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:28.618 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.400139+0000", 2024-09-12T22:33:28.618 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.5200000000000003e-06 2024-09-12T22:33:28.618 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.618 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.618 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:28.619 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.400143+0000", 2024-09-12T22:33:28.619 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.437e-06 2024-09-12T22:33:28.619 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.619 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.619 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:28.619 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.458159+0000", 2024-09-12T22:33:28.619 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.058015960999999998 2024-09-12T22:33:28.619 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.619 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.619 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:28.619 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.458201+0000", 2024-09-12T22:33:28.619 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1693000000000002e-05 2024-09-12T22:33:28.619 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.619 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.620 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:28.620 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.458267+0000", 2024-09-12T22:33:28.620 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5687999999999999e-05 2024-09-12T22:33:28.620 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.620 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.620 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:28.620 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.461423+0000", 2024-09-12T22:33:28.620 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0031560730000000001 2024-09-12T22:33:28.620 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.620 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.620 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:28.620 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476868+0000", 2024-09-12T22:33:28.620 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.015445108000000001 2024-09-12T22:33:28.621 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.621 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.621 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:28.621 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476897+0000", 2024-09-12T22:33:28.621 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9433000000000001e-05 2024-09-12T22:33:28.621 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.621 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.621 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:28.621 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476919+0000", 2024-09-12T22:33:28.621 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.2189999999999999e-05 2024-09-12T22:33:28.621 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:28.621 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:28.622 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:28.622 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.622 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.622 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1212 3.13 3:cb3d3880:::200.0000000d:head [write 1024943~3866 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:28.622 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.401707+0000", 2024-09-12T22:33:28.622 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 14.152132221, 2024-09-12T22:33:28.622 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.075386625999999998, 2024-09-12T22:33:28.622 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:28.622 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:28.622 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:28.622 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:28.622 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.622 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:28.623 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.401707+0000", 2024-09-12T22:33:28.623 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:28.623 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.623 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.623 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:28.623 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.401707+0000", 2024-09-12T22:33:28.623 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:28.623 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.623 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.623 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:28.623 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.401707+0000", 2024-09-12T22:33:28.623 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7700000000000004e-07 2024-09-12T22:33:28.623 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.624 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.624 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:28.624 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.401713+0000", 2024-09-12T22:33:28.624 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6609999999999997e-06 2024-09-12T22:33:28.624 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.624 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.624 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:28.624 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.401726+0000", 2024-09-12T22:33:28.624 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.3088000000000001e-05 2024-09-12T22:33:28.624 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.624 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.624 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:28.624 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.401741+0000", 2024-09-12T22:33:28.625 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.5424e-05 2024-09-12T22:33:28.625 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.625 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.625 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:28.625 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.458853+0000", 2024-09-12T22:33:28.625 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.057111157000000003 2024-09-12T22:33:28.625 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.625 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.625 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:28.625 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.458898+0000", 2024-09-12T22:33:28.625 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5633999999999997e-05 2024-09-12T22:33:28.625 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.625 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.626 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:28.626 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.458972+0000", 2024-09-12T22:33:28.626 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3441000000000004e-05 2024-09-12T22:33:28.626 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.626 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.626 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:28.626 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.461426+0000", 2024-09-12T22:33:28.626 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0024542660000000001 2024-09-12T22:33:28.626 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.626 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.626 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:28.626 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476985+0000", 2024-09-12T22:33:28.626 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.015559513000000001 2024-09-12T22:33:28.627 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.627 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.627 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:28.627 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.477044+0000", 2024-09-12T22:33:28.627 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8156999999999999e-05 2024-09-12T22:33:28.627 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.627 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.627 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:28.627 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.477093+0000", 2024-09-12T22:33:28.627 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9607999999999997e-05 2024-09-12T22:33:28.627 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:28.627 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:28.627 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:28.627 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.628 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.628 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1213 3.13 3:cb3d3880:::200.0000000d:head [write 1028809~6329 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:28.628 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.403250+0000", 2024-09-12T22:33:28.628 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 14.150588693, 2024-09-12T22:33:28.628 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.073936215999999999, 2024-09-12T22:33:28.628 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:28.628 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:28.628 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:28.628 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:28.628 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.628 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:28.629 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403250+0000", 2024-09-12T22:33:28.629 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:28.629 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.629 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.629 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:28.629 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403250+0000", 2024-09-12T22:33:28.629 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:28.629 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.629 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.629 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:28.629 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403251+0000", 2024-09-12T22:33:28.629 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.37e-07 2024-09-12T22:33:28.629 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.630 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.630 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:28.630 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403258+0000", 2024-09-12T22:33:28.630 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.25e-06 2024-09-12T22:33:28.630 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.630 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.630 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:28.630 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403269+0000", 2024-09-12T22:33:28.630 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0509000000000001e-05 2024-09-12T22:33:28.630 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.630 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.630 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:28.630 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403274+0000", 2024-09-12T22:33:28.630 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1290000000000004e-06 2024-09-12T22:33:28.631 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.631 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.631 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:28.631 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.459796+0000", 2024-09-12T22:33:28.631 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.056522020999999999 2024-09-12T22:33:28.631 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.631 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.631 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:28.631 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.459845+0000", 2024-09-12T22:33:28.631 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8884999999999997e-05 2024-09-12T22:33:28.631 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.631 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.631 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:28.632 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.459920+0000", 2024-09-12T22:33:28.632 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5318e-05 2024-09-12T22:33:28.632 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.632 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.632 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:28.632 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.466542+0000", 2024-09-12T22:33:28.632 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0066223139999999998 2024-09-12T22:33:28.632 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.632 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.632 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:28.632 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.477137+0000", 2024-09-12T22:33:28.632 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010594717 2024-09-12T22:33:28.632 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.633 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.633 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:28.633 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.477165+0000", 2024-09-12T22:33:28.633 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8262000000000001e-05 2024-09-12T22:33:28.633 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.633 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.633 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:28.633 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.477186+0000", 2024-09-12T22:33:28.633 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1073999999999998e-05 2024-09-12T22:33:28.633 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:28.634 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:28.634 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:28.634 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.634 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.634 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1214 3.13 3:cb3d3880:::200.0000000d:head [write 1035138~2606 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:28.634 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.403674+0000", 2024-09-12T22:33:28.634 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 14.150164773, 2024-09-12T22:33:28.634 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.073643204000000004, 2024-09-12T22:33:28.634 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:28.634 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:28.634 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:28.634 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:28.634 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.635 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:28.635 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403674+0000", 2024-09-12T22:33:28.635 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:28.635 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.635 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.635 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:28.635 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403674+0000", 2024-09-12T22:33:28.635 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:28.635 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.635 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.635 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:28.635 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403674+0000", 2024-09-12T22:33:28.635 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.7700000000000005e-07 2024-09-12T22:33:28.636 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.636 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.636 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:28.636 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403678+0000", 2024-09-12T22:33:28.636 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2009999999999999e-06 2024-09-12T22:33:28.636 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.636 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.636 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:28.636 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403686+0000", 2024-09-12T22:33:28.636 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5690000000000005e-06 2024-09-12T22:33:28.636 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.636 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.636 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:28.637 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403690+0000", 2024-09-12T22:33:28.637 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.233e-06 2024-09-12T22:33:28.637 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.637 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.637 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:28.637 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.460445+0000", 2024-09-12T22:33:28.637 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.056754412999999997 2024-09-12T22:33:28.637 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.637 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.637 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:28.637 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.460495+0000", 2024-09-12T22:33:28.637 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0238999999999998e-05 2024-09-12T22:33:28.638 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.638 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.638 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:28.638 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.460566+0000", 2024-09-12T22:33:28.638 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1159000000000001e-05 2024-09-12T22:33:28.638 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.638 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.638 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:28.638 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.466546+0000", 2024-09-12T22:33:28.638 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0059798910000000002 2024-09-12T22:33:28.638 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.638 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.638 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:28.638 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.477232+0000", 2024-09-12T22:33:28.639 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010686084 2024-09-12T22:33:28.639 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.639 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.639 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:28.639 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.477280+0000", 2024-09-12T22:33:28.639 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.7719999999999997e-05 2024-09-12T22:33:28.639 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.639 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.639 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:28.639 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.477317+0000", 2024-09-12T22:33:28.639 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7218000000000002e-05 2024-09-12T22:33:28.639 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:28.639 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:28.640 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:28.640 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.640 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.640 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1223 3.13 3:cb3d3880:::200.0000000d:head [write 1090497~1913 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:28.640 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.420111+0000", 2024-09-12T22:33:28.640 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 14.133727621, 2024-09-12T22:33:28.640 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.071634583000000002, 2024-09-12T22:33:28.640 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:28.640 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:28.640 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:28.640 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:28.640 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.640 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:28.641 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.420111+0000", 2024-09-12T22:33:28.641 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:28.641 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.641 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.641 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:28.641 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.420111+0000", 2024-09-12T22:33:28.641 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:28.641 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.641 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.641 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:28.641 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.420112+0000", 2024-09-12T22:33:28.641 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.2900000000000002e-07 2024-09-12T22:33:28.642 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.642 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.642 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:28.642 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.420116+0000", 2024-09-12T22:33:28.642 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.67e-06 2024-09-12T22:33:28.642 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.642 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.642 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:28.642 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.420125+0000", 2024-09-12T22:33:28.642 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.0890000000000006e-06 2024-09-12T22:33:28.642 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.642 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.642 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:28.642 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.420131+0000", 2024-09-12T22:33:28.643 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4269999999999996e-06 2024-09-12T22:33:28.643 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.643 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.643 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:28.643 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.465358+0000", 2024-09-12T22:33:28.643 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.045227030000000001 2024-09-12T22:33:28.643 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.643 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.643 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:28.643 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.465439+0000", 2024-09-12T22:33:28.643 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0901000000000004e-05 2024-09-12T22:33:28.643 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.643 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.643 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:28.644 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.465571+0000", 2024-09-12T22:33:28.644 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000131705 2024-09-12T22:33:28.644 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.644 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.644 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:28.644 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.469496+0000", 2024-09-12T22:33:28.644 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.003925418 2024-09-12T22:33:28.644 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.644 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.644 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:28.644 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.491669+0000", 2024-09-12T22:33:28.644 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.022172335000000001 2024-09-12T22:33:28.644 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.645 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.645 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:28.645 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.491714+0000", 2024-09-12T22:33:28.645 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5417000000000002e-05 2024-09-12T22:33:28.645 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.645 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.645 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:28.645 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.491746+0000", 2024-09-12T22:33:28.645 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1662000000000003e-05 2024-09-12T22:33:28.645 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:28.645 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:28.645 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:28.645 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.645 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.646 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1225 3.13 3:cb3d3880:::200.0000000d:head [write 1097316~1932 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:28.646 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.421303+0000", 2024-09-12T22:33:28.646 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 14.132535786, 2024-09-12T22:33:28.646 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.074934770999999997, 2024-09-12T22:33:28.646 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:28.646 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:28.646 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:28.646 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:28.646 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.646 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:28.646 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.421303+0000", 2024-09-12T22:33:28.646 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:28.646 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.647 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.647 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:28.647 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.421303+0000", 2024-09-12T22:33:28.647 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:28.647 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.647 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.647 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:28.647 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.421303+0000", 2024-09-12T22:33:28.647 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8599999999999998e-07 2024-09-12T22:33:28.647 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.647 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.647 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:28.647 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.421307+0000", 2024-09-12T22:33:28.648 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0879999999999999e-06 2024-09-12T22:33:28.648 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.648 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.648 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:28.648 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.421314+0000", 2024-09-12T22:33:28.648 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1010000000000003e-06 2024-09-12T22:33:28.648 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.648 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.648 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:28.648 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.421319+0000", 2024-09-12T22:33:28.648 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7209999999999999e-06 2024-09-12T22:33:28.648 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.649 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.649 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:28.649 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.466620+0000", 2024-09-12T22:33:28.649 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.045301044999999998 2024-09-12T22:33:28.649 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.649 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.649 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:28.649 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.466703+0000", 2024-09-12T22:33:28.649 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3011999999999997e-05 2024-09-12T22:33:28.649 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.649 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.649 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:28.650 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.466826+0000", 2024-09-12T22:33:28.650 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000122824 2024-09-12T22:33:28.650 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.650 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.650 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:28.650 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.472359+0000", 2024-09-12T22:33:28.650 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0055323009999999999 2024-09-12T22:33:28.650 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.650 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.650 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:28.650 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496142+0000", 2024-09-12T22:33:28.650 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.023783696999999999 2024-09-12T22:33:28.650 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.651 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.651 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:28.651 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496194+0000", 2024-09-12T22:33:28.651 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1350000000000001e-05 2024-09-12T22:33:28.651 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.651 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.651 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:28.651 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496238+0000", 2024-09-12T22:33:28.651 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4146000000000001e-05 2024-09-12T22:33:28.651 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:28.651 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:28.651 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:28.651 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.652 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.652 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1226 3.13 3:cb3d3880:::200.0000000d:head [write 1099248~1973 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:28.652 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.422971+0000", 2024-09-12T22:33:28.652 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 14.130868188000001, 2024-09-12T22:33:28.652 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.073363063000000006, 2024-09-12T22:33:28.652 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:28.652 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:28.652 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:28.652 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:28.653 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.653 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:28.653 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.422971+0000", 2024-09-12T22:33:28.653 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:28.653 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.653 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.653 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:28.653 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.422971+0000", 2024-09-12T22:33:28.653 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:28.653 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.654 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.654 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:28.654 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.422971+0000", 2024-09-12T22:33:28.654 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.1699999999999997e-07 2024-09-12T22:33:28.654 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.654 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.654 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:28.654 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.422975+0000", 2024-09-12T22:33:28.654 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2650000000000001e-06 2024-09-12T22:33:28.654 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.654 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.654 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:28.654 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.422981+0000", 2024-09-12T22:33:28.655 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7379999999999997e-06 2024-09-12T22:33:28.655 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.655 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.655 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:28.655 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.422986+0000", 2024-09-12T22:33:28.655 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5220000000000001e-06 2024-09-12T22:33:28.655 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.655 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.655 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:28.655 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.467340+0000", 2024-09-12T22:33:28.655 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.044353985999999998 2024-09-12T22:33:28.655 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.656 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.656 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:28.656 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.467412+0000", 2024-09-12T22:33:28.656 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1982000000000003e-05 2024-09-12T22:33:28.656 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.656 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.656 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:28.656 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.467493+0000", 2024-09-12T22:33:28.656 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0829999999999997e-05 2024-09-12T22:33:28.656 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.656 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.656 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:28.657 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.472364+0000", 2024-09-12T22:33:28.657 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0048713189999999998 2024-09-12T22:33:28.657 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.657 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.657 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:28.657 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496271+0000", 2024-09-12T22:33:28.657 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.023906808000000002 2024-09-12T22:33:28.657 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.657 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.657 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:28.657 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496300+0000", 2024-09-12T22:33:28.657 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9315e-05 2024-09-12T22:33:28.658 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.658 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.658 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:28.658 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496334+0000", 2024-09-12T22:33:28.658 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3481e-05 2024-09-12T22:33:28.658 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:28.658 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:28.658 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:28.658 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.658 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.658 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1227 3.13 3:cb3d3880:::200.0000000d:head [write 1101221~1922 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:28.658 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.423028+0000", 2024-09-12T22:33:28.658 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 14.130811204, 2024-09-12T22:33:28.659 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.073444802000000003, 2024-09-12T22:33:28.659 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:28.659 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:28.659 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:28.659 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:28.659 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.659 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:28.659 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423028+0000", 2024-09-12T22:33:28.659 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:28.659 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.659 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.659 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:28.659 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423028+0000", 2024-09-12T22:33:28.660 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:28.660 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.660 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.660 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:28.660 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423028+0000", 2024-09-12T22:33:28.660 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1699999999999998e-07 2024-09-12T22:33:28.660 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.660 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.660 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:28.660 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423031+0000", 2024-09-12T22:33:28.660 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8499999999999998e-06 2024-09-12T22:33:28.660 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.660 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.661 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:28.661 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423036+0000", 2024-09-12T22:33:28.661 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9479999999999999e-06 2024-09-12T22:33:28.661 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.661 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.661 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:28.661 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423039+0000", 2024-09-12T22:33:28.661 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4929999999999998e-06 2024-09-12T22:33:28.661 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.661 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.661 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:28.661 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.467785+0000", 2024-09-12T22:33:28.661 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.044745957000000003 2024-09-12T22:33:28.662 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.662 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.662 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:28.662 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.467838+0000", 2024-09-12T22:33:28.662 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2596999999999998e-05 2024-09-12T22:33:28.662 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.662 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.662 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:28.662 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.467915+0000", 2024-09-12T22:33:28.662 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6744999999999998e-05 2024-09-12T22:33:28.662 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.662 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.662 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:28.663 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.472368+0000", 2024-09-12T22:33:28.663 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0044534730000000003 2024-09-12T22:33:28.663 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.663 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.663 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:28.663 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496382+0000", 2024-09-12T22:33:28.663 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.024014111000000001 2024-09-12T22:33:28.663 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.663 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.663 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:28.663 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496443+0000", 2024-09-12T22:33:28.663 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.0547000000000002e-05 2024-09-12T22:33:28.663 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.664 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.664 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:28.664 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496472+0000", 2024-09-12T22:33:28.664 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9564e-05 2024-09-12T22:33:28.664 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:28.664 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:28.664 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:28.664 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.664 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.664 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1228 3.13 3:cb3d3880:::200.0000000d:head [write 1103143~2423 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:28.664 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.423305+0000", 2024-09-12T22:33:28.664 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 14.13053384, 2024-09-12T22:33:28.665 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.073251160999999995, 2024-09-12T22:33:28.665 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:28.665 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:28.665 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:28.665 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:28.665 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.665 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:28.665 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423305+0000", 2024-09-12T22:33:28.665 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:28.665 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.665 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.665 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:28.665 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423305+0000", 2024-09-12T22:33:28.666 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:28.666 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.666 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.666 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:28.666 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423306+0000", 2024-09-12T22:33:28.666 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4899999999999995e-07 2024-09-12T22:33:28.666 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.666 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.666 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:28.666 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423311+0000", 2024-09-12T22:33:28.666 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7459999999999997e-06 2024-09-12T22:33:28.666 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.666 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.667 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:28.667 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423316+0000", 2024-09-12T22:33:28.667 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0239999999999997e-06 2024-09-12T22:33:28.667 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.667 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.667 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:28.667 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423320+0000", 2024-09-12T22:33:28.667 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.67e-06 2024-09-12T22:33:28.667 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.667 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.667 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:28.667 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.468252+0000", 2024-09-12T22:33:28.667 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.044932262000000001 2024-09-12T22:33:28.668 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.668 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.668 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:28.668 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.468293+0000", 2024-09-12T22:33:28.668 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0368999999999999e-05 2024-09-12T22:33:28.668 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.668 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.668 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:28.668 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.468357+0000", 2024-09-12T22:33:28.668 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4287000000000003e-05 2024-09-12T22:33:28.668 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.668 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.668 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:28.669 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.472371+0000", 2024-09-12T22:33:28.669 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0040144350000000002 2024-09-12T22:33:28.669 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.669 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.669 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:28.669 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496507+0000", 2024-09-12T22:33:28.669 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.024135961000000001 2024-09-12T22:33:28.669 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.669 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.669 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:28.669 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496537+0000", 2024-09-12T22:33:28.669 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9611000000000002e-05 2024-09-12T22:33:28.669 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.670 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.670 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:28.670 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496556+0000", 2024-09-12T22:33:28.670 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9147000000000002e-05 2024-09-12T22:33:28.670 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:28.670 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:28.670 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:28.670 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.670 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.670 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1229 3.13 3:cb3d3880:::200.0000000d:head [write 1105566~1911 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:28.670 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.423606+0000", 2024-09-12T22:33:28.670 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 14.130232829000001, 2024-09-12T22:33:28.671 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.073027876000000005, 2024-09-12T22:33:28.671 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:28.671 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:28.671 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:28.671 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:28.671 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.671 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:28.671 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423606+0000", 2024-09-12T22:33:28.671 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:28.671 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.671 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.671 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:28.671 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423606+0000", 2024-09-12T22:33:28.671 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:28.672 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.672 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.672 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:28.672 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423606+0000", 2024-09-12T22:33:28.672 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.7e-07 2024-09-12T22:33:28.672 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.672 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.672 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:28.672 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423609+0000", 2024-09-12T22:33:28.672 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5339999999999998e-06 2024-09-12T22:33:28.672 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.672 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.672 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:28.673 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423614+0000", 2024-09-12T22:33:28.673 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.69e-06 2024-09-12T22:33:28.673 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.676 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.676 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:28.677 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423617+0000", 2024-09-12T22:33:28.677 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4300000000000002e-06 2024-09-12T22:33:28.677 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.677 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.677 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:28.677 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.468606+0000", 2024-09-12T22:33:28.677 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.044988606 2024-09-12T22:33:28.677 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.677 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.677 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:28.677 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.468649+0000", 2024-09-12T22:33:28.677 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3414000000000001e-05 2024-09-12T22:33:28.677 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.678 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.678 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:28.678 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.468714+0000", 2024-09-12T22:33:28.678 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4857000000000006e-05 2024-09-12T22:33:28.678 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.678 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.678 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:28.678 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.472375+0000", 2024-09-12T22:33:28.678 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0036607330000000002 2024-09-12T22:33:28.678 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.678 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.678 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:28.679 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496585+0000", 2024-09-12T22:33:28.679 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.024210835 2024-09-12T22:33:28.679 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.679 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.679 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:28.679 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496612+0000", 2024-09-12T22:33:28.679 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6999999999999999e-05 2024-09-12T22:33:28.679 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.679 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.679 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:28.679 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496634+0000", 2024-09-12T22:33:28.679 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1307000000000001e-05 2024-09-12T22:33:28.679 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:28.680 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:28.680 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:28.680 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.680 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.680 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1230 3.13 3:cb3d3880:::200.0000000d:head [write 1107477~6537 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:28.680 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.423911+0000", 2024-09-12T22:33:28.680 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 14.129927984, 2024-09-12T22:33:28.680 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.072794530999999996, 2024-09-12T22:33:28.680 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:28.680 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:28.680 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:28.681 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:28.681 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.681 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:28.681 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423911+0000", 2024-09-12T22:33:28.681 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:28.681 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.681 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.681 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:28.681 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423911+0000", 2024-09-12T22:33:28.681 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:28.682 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.682 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.682 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:28.682 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423911+0000", 2024-09-12T22:33:28.682 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3799999999999998e-07 2024-09-12T22:33:28.682 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.682 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.682 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:28.682 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423919+0000", 2024-09-12T22:33:28.682 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.8329999999999994e-06 2024-09-12T22:33:28.682 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.682 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.683 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:28.683 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423924+0000", 2024-09-12T22:33:28.683 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3449999999999996e-06 2024-09-12T22:33:28.683 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.683 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.683 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:28.683 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423928+0000", 2024-09-12T22:33:28.683 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2339999999999999e-06 2024-09-12T22:33:28.683 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.683 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.684 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:28.684 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.469042+0000", 2024-09-12T22:33:28.684 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.045114888999999998 2024-09-12T22:33:28.684 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.684 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.684 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:28.684 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.469092+0000", 2024-09-12T22:33:28.684 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9289000000000002e-05 2024-09-12T22:33:28.684 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.684 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.684 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:28.685 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.469163+0000", 2024-09-12T22:33:28.685 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1222000000000004e-05 2024-09-12T22:33:28.685 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.685 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.685 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:28.685 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.472379+0000", 2024-09-12T22:33:28.685 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0032156419999999999 2024-09-12T22:33:28.685 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.685 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.685 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:28.685 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496661+0000", 2024-09-12T22:33:28.685 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.024281857 2024-09-12T22:33:28.685 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.685 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.686 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:28.686 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496687+0000", 2024-09-12T22:33:28.686 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6551e-05 2024-09-12T22:33:28.686 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:28.686 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:28.686 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:28.686 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496705+0000", 2024-09-12T22:33:28.686 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.8230999999999999e-05 2024-09-12T22:33:28.686 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:28.686 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:28.686 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:28.686 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:28.687 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:28.687 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-09-12T22:33:28.687 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T22:33:28.689 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:28.687+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:28.689 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:33:28.790 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:28.788+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:28.797 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T22:33:28.800 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:33:28.800 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:33:28.800 INFO:teuthology.orchestra.run.smithi148.stdout: "num_ops": 0 2024-09-12T22:33:28.800 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:33:28.809 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:33:28.890 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:28.889+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:28.914 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:33:28.915 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:33:28.915 INFO:teuthology.orchestra.run.smithi148.stdout: "complaint_time": 30, 2024-09-12T22:33:28.915 INFO:teuthology.orchestra.run.smithi148.stdout: "num_blocked_ops": 0 2024-09-12T22:33:28.915 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:33:28.923 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:33:28.924 INFO:teuthology.orchestra.run.smithi019.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-12T22:33:28.946 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T22:33:28.947 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:33:28.968 INFO:teuthology.orchestra.run.smithi019.stdout:osd.2: {} 2024-09-12T22:33:28.968 INFO:teuthology.orchestra.run.smithi019.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T22:33:28.973 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:33:28.973 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:33:29.009 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:29.007+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:29.071 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:33:29.072 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:33:29.081 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:33:29.128 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:29.127+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:29.192 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:33:29.193 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:33:29.193 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:29.192+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:29.201 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:33:29.291 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2024-09-12T22:33:29.292 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T22:33:29.293 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:29.292+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:29.345 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:33:29.345 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:33:29.354 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:33:29.394 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:29.393+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:29.495 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:29.494+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:29.499 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:33:29.499 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:33:29.507 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:33:29.565 INFO:teuthology.orchestra.run.smithi019.stderr:nodeep-scrub is unset 2024-09-12T22:33:29.596 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:29.595+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:29.609 DEBUG:teuthology.parallel:result is None 2024-09-12T22:33:29.609 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T22:33:29.654 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:33:29.654 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:33:29.664 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:33:29.677 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T22:33:29.677 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-09-12T22:33:29.697 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-09-12T22:33:29.697 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T22:33:29.697 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T22:33:29.705 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:29.704+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:29.733 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T22:33:29.733 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T22:33:29.789 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T22:33:29.799 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:29.798+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:29.806 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:33:29.806 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:33:29.815 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:33:29.900 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:29.899+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:29.958 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:33:29.958 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:33:29.967 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:33:30.001 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:30.000+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:30.071 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:33:30.071 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:33:30.079 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:33:30.101 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:30.100+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:30.130 INFO:teuthology.orchestra.run.smithi019.stderr:listed 0 entries 2024-09-12T22:33:30.143 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T22:33:30.143 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T22:33:30.160 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T22:33:30.182 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:33:30.182 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:33:30.191 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:33:30.203 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:30.202+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:30.295 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:33:30.295 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:33:30.304 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:30.303+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:30.305 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:33:30.404 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:30.403+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:30.412 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:33:30.412 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:33:30.420 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:33:30.501 INFO:teuthology.orchestra.run.smithi019.stderr:listed 0 entries 2024-09-12T22:33:30.505 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:30.504+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:30.514 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi019.front.sepia.ceph.com... 2024-09-12T22:33:30.514 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T22:33:30.514 DEBUG:teuthology.orchestra.run.smithi019:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-12T22:33:30.523 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:33:30.523 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:33:30.533 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:33:30.542 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi019.stderr:ceph-fuse[32819]: fuse finished with error 0 and tester_r 0 2024-09-12T22:33:30.543 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T22:33:30.619 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:30.618+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:30.707 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:30.706+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:30.717 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:33:30.717 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:33:30.726 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:33:30.808 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:30.806+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:30.830 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:33:30.831 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:33:30.840 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:33:30.924 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:30.923+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:30.974 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T22:33:30.983 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:33:30.983 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:33:30.991 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:33:31.032 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:31.031+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:31.082 INFO:teuthology.orchestra.run.smithi019.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-12T22:33:31.100 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T22:33:31.100 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:33:31.111 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:31.110+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:31.119 INFO:teuthology.orchestra.run.smithi019.stdout:osd.2: {} 2024-09-12T22:33:31.120 INFO:teuthology.orchestra.run.smithi019.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T22:33:31.126 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:33:31.126 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:33:31.137 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-09-12T22:33:31.137 INFO:teuthology.orchestra.run.smithi163.stdout: "size": 20, 2024-09-12T22:33:31.137 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 600, 2024-09-12T22:33:31.137 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2024-09-12T22:33:31.138 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.138 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-09-12T22:33:31.138 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:27.254459+0000", 2024-09-12T22:33:31.138 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 123.88058832, 2024-09-12T22:33:31.138 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.37816283899999997, 2024-09-12T22:33:31.138 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:31.138 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:31.138 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:31.138 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:31.138 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:33:31.138 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:33:31.138 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 1 2024-09-12T22:33:31.138 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.139 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:31.139 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.139 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:31.139 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254459+0000", 2024-09-12T22:33:31.139 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:31.139 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.139 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.139 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:31.139 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254459+0000", 2024-09-12T22:33:31.139 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:31.139 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.139 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.139 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:31.139 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254460+0000", 2024-09-12T22:33:31.140 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1739999999999999e-06 2024-09-12T22:33:31.140 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.140 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.140 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:31.140 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254472+0000", 2024-09-12T22:33:31.140 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2207e-05 2024-09-12T22:33:31.140 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.140 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.140 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:31.140 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254483+0000", 2024-09-12T22:33:31.140 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0631999999999999e-05 2024-09-12T22:33:31.140 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.140 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.141 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:31.141 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254492+0000", 2024-09-12T22:33:31.141 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3670000000000003e-06 2024-09-12T22:33:31.141 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.141 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.141 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:31.141 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254551+0000", 2024-09-12T22:33:31.141 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8687999999999998e-05 2024-09-12T22:33:31.141 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.142 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.142 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for peered", 2024-09-12T22:33:31.142 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254562+0000", 2024-09-12T22:33:31.142 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1249e-05 2024-09-12T22:33:31.142 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.142 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.142 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:31.142 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.631211+0000", 2024-09-12T22:33:31.142 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.376649018 2024-09-12T22:33:31.142 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.142 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.142 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:31.143 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.631345+0000", 2024-09-12T22:33:31.143 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013378700000000001 2024-09-12T22:33:31.143 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.143 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.143 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:33:31.143 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.631479+0000", 2024-09-12T22:33:31.143 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013352399999999999 2024-09-12T22:33:31.143 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.143 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.143 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:31.143 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632324+0000", 2024-09-12T22:33:31.143 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00084508100000000002 2024-09-12T22:33:31.143 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.144 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.144 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:31.144 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632548+0000", 2024-09-12T22:33:31.144 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000224329 2024-09-12T22:33:31.144 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.144 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.144 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:31.144 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632591+0000", 2024-09-12T22:33:31.144 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2564000000000001e-05 2024-09-12T22:33:31.144 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.144 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.144 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:31.144 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632622+0000", 2024-09-12T22:33:31.145 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1219e-05 2024-09-12T22:33:31.145 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:31.145 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:31.145 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:31.145 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.145 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.145 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4490.0:9871 4.35 4:ad66404a:::10000002d4d.00000000:head [write 0~6507] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:33:31.145 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:09.472309+0000", 2024-09-12T22:33:31.145 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 21.662738044000001, 2024-09-12T22:33:31.145 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.080251445000000005, 2024-09-12T22:33:31.145 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:31.145 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:31.145 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:31.146 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:31.146 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4490", 2024-09-12T22:33:31.146 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:31.146 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 9871 2024-09-12T22:33:31.146 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.146 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:31.146 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.146 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:31.146 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.472309+0000", 2024-09-12T22:33:31.146 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:31.146 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.146 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.147 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:31.147 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.472309+0000", 2024-09-12T22:33:31.147 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:31.147 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.147 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.147 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:31.147 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.472310+0000", 2024-09-12T22:33:31.147 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3799999999999996e-07 2024-09-12T22:33:31.147 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.147 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.147 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:31.147 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.472318+0000", 2024-09-12T22:33:31.147 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.8099999999999998e-06 2024-09-12T22:33:31.148 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.148 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.148 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:31.148 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.472328+0000", 2024-09-12T22:33:31.148 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0359e-05 2024-09-12T22:33:31.148 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.148 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.148 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:31.148 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.472334+0000", 2024-09-12T22:33:31.148 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.0109999999999997e-06 2024-09-12T22:33:31.148 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.148 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.148 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:31.149 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.472382+0000", 2024-09-12T22:33:31.149 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.7311000000000002e-05 2024-09-12T22:33:31.149 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.149 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.149 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:31.149 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.472497+0000", 2024-09-12T22:33:31.149 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011537800000000001 2024-09-12T22:33:31.149 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.149 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.149 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:31.149 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.472617+0000", 2024-09-12T22:33:31.149 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011989600000000001 2024-09-12T22:33:31.149 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.149 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.150 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:31.150 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473149+0000", 2024-09-12T22:33:31.150 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00053227999999999999 2024-09-12T22:33:31.150 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.150 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.150 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:31.150 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.552479+0000", 2024-09-12T22:33:31.150 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.079329541000000003 2024-09-12T22:33:31.150 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.150 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.150 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:31.150 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.552525+0000", 2024-09-12T22:33:31.151 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6421000000000002e-05 2024-09-12T22:33:31.151 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.151 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.151 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:31.151 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.552561+0000", 2024-09-12T22:33:31.151 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5599999999999998e-05 2024-09-12T22:33:31.151 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:31.151 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:31.151 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:31.151 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.151 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.151 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4490.0:9872 4.2c 4:3602c8d3:::10000002d4e.00000000:head [write 0~1178] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:33:31.151 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:09.473085+0000", 2024-09-12T22:33:31.152 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 21.66196274, 2024-09-12T22:33:31.152 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.079631104999999994, 2024-09-12T22:33:31.152 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:31.152 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:31.152 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:31.152 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:31.152 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4490", 2024-09-12T22:33:31.152 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:31.152 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 9872 2024-09-12T22:33:31.152 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.152 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:31.152 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.152 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:31.153 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473085+0000", 2024-09-12T22:33:31.153 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:31.153 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.153 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.153 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:31.153 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473085+0000", 2024-09-12T22:33:31.153 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:31.153 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.153 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.153 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:31.153 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473085+0000", 2024-09-12T22:33:31.153 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3600000000000004e-07 2024-09-12T22:33:31.153 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.154 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.154 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:31.154 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473088+0000", 2024-09-12T22:33:31.154 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.005e-06 2024-09-12T22:33:31.154 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.154 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.154 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:31.154 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473095+0000", 2024-09-12T22:33:31.154 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3950000000000003e-06 2024-09-12T22:33:31.154 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.154 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.154 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:31.154 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473100+0000", 2024-09-12T22:33:31.155 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5460000000000002e-06 2024-09-12T22:33:31.155 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.155 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.155 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:31.155 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473138+0000", 2024-09-12T22:33:31.155 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8244999999999997e-05 2024-09-12T22:33:31.155 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.155 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.155 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:31.155 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473216+0000", 2024-09-12T22:33:31.155 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.7756000000000006e-05 2024-09-12T22:33:31.155 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.155 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.156 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:31.156 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473291+0000", 2024-09-12T22:33:31.156 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5110000000000004e-05 2024-09-12T22:33:31.156 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.156 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.156 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:31.156 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473736+0000", 2024-09-12T22:33:31.156 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00044486500000000002 2024-09-12T22:33:31.156 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.156 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.156 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:31.156 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.552637+0000", 2024-09-12T22:33:31.156 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.078900782000000003 2024-09-12T22:33:31.157 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.157 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.157 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:31.157 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.552680+0000", 2024-09-12T22:33:31.157 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3047999999999998e-05 2024-09-12T22:33:31.157 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.157 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.157 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:31.157 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.552716+0000", 2024-09-12T22:33:31.157 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5816999999999999e-05 2024-09-12T22:33:31.157 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:31.157 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:31.157 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:31.158 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.158 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.158 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4490.0:9873 4.2c 4:372c52ff:::10000002d4f.00000000:head [write 0~1230] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:33:31.158 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:09.473878+0000", 2024-09-12T22:33:31.158 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 21.661169276999999, 2024-09-12T22:33:31.158 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.079036047999999998, 2024-09-12T22:33:31.158 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:31.158 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:31.158 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:31.158 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:31.158 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4490", 2024-09-12T22:33:31.158 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:31.158 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 9873 2024-09-12T22:33:31.159 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.159 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:31.159 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.159 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:31.159 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473878+0000", 2024-09-12T22:33:31.159 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:31.159 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.159 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.159 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:31.159 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473878+0000", 2024-09-12T22:33:31.159 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:31.159 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.159 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.159 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:31.160 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473879+0000", 2024-09-12T22:33:31.160 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9100000000000004e-07 2024-09-12T22:33:31.160 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.160 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.160 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:31.160 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473882+0000", 2024-09-12T22:33:31.160 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.405e-06 2024-09-12T22:33:31.160 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.160 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.160 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:31.160 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473889+0000", 2024-09-12T22:33:31.160 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7519999999999999e-06 2024-09-12T22:33:31.160 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.161 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.161 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:31.161 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473893+0000", 2024-09-12T22:33:31.161 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9310000000000001e-06 2024-09-12T22:33:31.161 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.161 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.161 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:31.161 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473922+0000", 2024-09-12T22:33:31.161 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9346999999999999e-05 2024-09-12T22:33:31.161 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.161 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.161 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:31.161 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474000+0000", 2024-09-12T22:33:31.161 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.7972000000000005e-05 2024-09-12T22:33:31.162 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.162 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.162 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:31.162 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474072+0000", 2024-09-12T22:33:31.162 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1960999999999998e-05 2024-09-12T22:33:31.162 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.162 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.162 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:31.162 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474470+0000", 2024-09-12T22:33:31.162 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00039803400000000002 2024-09-12T22:33:31.162 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.162 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.162 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:31.162 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.552814+0000", 2024-09-12T22:33:31.162 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.078344164999999993 2024-09-12T22:33:31.163 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.163 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.163 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:31.163 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.552875+0000", 2024-09-12T22:33:31.163 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1008999999999998e-05 2024-09-12T22:33:31.163 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.163 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.163 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:31.163 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.552914+0000", 2024-09-12T22:33:31.163 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8881000000000003e-05 2024-09-12T22:33:31.163 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:31.163 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:31.163 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:31.164 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.164 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.164 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4490.0:9874 4.1b 4:db19d96a:::10000002d50.00000000:head [write 0~1088] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:33:31.164 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:09.474673+0000", 2024-09-12T22:33:31.164 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 21.660374284, 2024-09-12T22:33:31.164 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.080314317999999996, 2024-09-12T22:33:31.164 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:31.164 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:31.164 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:31.164 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:31.164 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4490", 2024-09-12T22:33:31.164 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:31.164 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 9874 2024-09-12T22:33:31.165 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.165 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:31.165 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.165 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:31.165 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474673+0000", 2024-09-12T22:33:31.165 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:31.165 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.165 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.165 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:31.165 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474673+0000", 2024-09-12T22:33:31.165 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:31.165 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.166 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.166 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:31.166 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474674+0000", 2024-09-12T22:33:31.166 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6199999999999998e-07 2024-09-12T22:33:31.166 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.166 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.166 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:31.166 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474677+0000", 2024-09-12T22:33:31.166 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.224e-06 2024-09-12T22:33:31.166 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.166 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.166 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:31.166 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474683+0000", 2024-09-12T22:33:31.167 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.3160000000000002e-06 2024-09-12T22:33:31.167 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.167 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.167 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:31.167 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474687+0000", 2024-09-12T22:33:31.167 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7869999999999999e-06 2024-09-12T22:33:31.167 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.167 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.167 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:31.167 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474730+0000", 2024-09-12T22:33:31.167 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3309000000000002e-05 2024-09-12T22:33:31.167 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.167 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.168 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:31.168 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474845+0000", 2024-09-12T22:33:31.168 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114306 2024-09-12T22:33:31.168 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.168 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.168 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:31.168 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474970+0000", 2024-09-12T22:33:31.168 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000125096 2024-09-12T22:33:31.168 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.168 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.168 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:31.168 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.475621+0000", 2024-09-12T22:33:31.168 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00065124900000000001 2024-09-12T22:33:31.169 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.169 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.169 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:31.169 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.554885+0000", 2024-09-12T22:33:31.169 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.079264055 2024-09-12T22:33:31.169 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.169 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.169 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:31.169 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.554942+0000", 2024-09-12T22:33:31.169 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7284000000000002e-05 2024-09-12T22:33:31.169 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.169 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.170 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:31.170 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.554987+0000", 2024-09-12T22:33:31.170 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5130000000000003e-05 2024-09-12T22:33:31.170 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:31.170 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:31.170 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:31.170 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.170 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.170 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4490.0:12220 4.2b 4:d55bfd66:::10000003169.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-12T22:33:31.170 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.391333+0000", 2024-09-12T22:33:31.170 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 16.743714141000002, 2024-09-12T22:33:31.170 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.088669550999999999, 2024-09-12T22:33:31.170 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:31.171 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:31.171 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:31.171 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:31.171 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4490", 2024-09-12T22:33:31.171 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:31.171 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 12220 2024-09-12T22:33:31.171 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.171 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:31.171 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.171 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:31.171 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.391333+0000", 2024-09-12T22:33:31.171 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:31.171 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.172 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.172 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:31.172 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.391333+0000", 2024-09-12T22:33:31.172 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:31.172 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.172 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.172 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:31.172 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.391334+0000", 2024-09-12T22:33:31.173 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3099999999999997e-07 2024-09-12T22:33:31.173 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.173 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.173 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:31.173 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398373+0000", 2024-09-12T22:33:31.173 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0070386670000000002 2024-09-12T22:33:31.173 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.173 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.173 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:31.173 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398384+0000", 2024-09-12T22:33:31.173 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1338999999999999e-05 2024-09-12T22:33:31.173 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.173 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.173 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:31.174 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398389+0000", 2024-09-12T22:33:31.174 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3650000000000003e-06 2024-09-12T22:33:31.174 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.174 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.174 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:31.174 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.456308+0000", 2024-09-12T22:33:31.174 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.057918931 2024-09-12T22:33:31.174 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.174 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.174 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:31.174 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.456425+0000", 2024-09-12T22:33:31.174 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000116452 2024-09-12T22:33:31.174 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.175 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.175 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:31.175 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.456536+0000", 2024-09-12T22:33:31.175 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000111839 2024-09-12T22:33:31.175 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.175 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.175 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:31.175 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.465335+0000", 2024-09-12T22:33:31.175 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0087984980000000001 2024-09-12T22:33:31.175 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.175 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.175 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:31.175 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.479950+0000", 2024-09-12T22:33:31.176 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.01461552 2024-09-12T22:33:31.176 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.176 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.176 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:31.176 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.479983+0000", 2024-09-12T22:33:31.176 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2126999999999999e-05 2024-09-12T22:33:31.176 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.176 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.176 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:31.176 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.480003+0000", 2024-09-12T22:33:31.176 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0081999999999998e-05 2024-09-12T22:33:31.176 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:31.176 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:31.177 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:31.177 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.177 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.177 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1208 3.13 3:cb3d3880:::200.0000000d:head [write 1009846~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:31.177 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.398459+0000", 2024-09-12T22:33:31.177 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 16.736588574999999, 2024-09-12T22:33:31.177 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.078093931000000005, 2024-09-12T22:33:31.177 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:31.177 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:31.177 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:31.177 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:31.177 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.177 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:31.178 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398459+0000", 2024-09-12T22:33:31.178 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:31.178 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.178 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.178 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:31.178 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398459+0000", 2024-09-12T22:33:31.178 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:31.178 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.178 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.178 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:31.178 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398459+0000", 2024-09-12T22:33:31.178 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8100000000000003e-07 2024-09-12T22:33:31.179 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.179 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.179 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:31.179 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398462+0000", 2024-09-12T22:33:31.179 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3700000000000002e-06 2024-09-12T22:33:31.179 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.179 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.179 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:31.179 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398469+0000", 2024-09-12T22:33:31.179 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2320000000000004e-06 2024-09-12T22:33:31.179 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.179 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.179 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:31.179 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398472+0000", 2024-09-12T22:33:31.180 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.658e-06 2024-09-12T22:33:31.180 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.180 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.180 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:31.180 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.456690+0000", 2024-09-12T22:33:31.180 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.058217615 2024-09-12T22:33:31.180 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.180 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.180 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:31.180 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.456731+0000", 2024-09-12T22:33:31.180 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0815000000000001e-05 2024-09-12T22:33:31.180 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.180 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.180 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:31.181 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.456793+0000", 2024-09-12T22:33:31.181 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1796000000000003e-05 2024-09-12T22:33:31.181 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.181 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.181 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:31.181 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.461412+0000", 2024-09-12T22:33:31.181 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0046188560000000002 2024-09-12T22:33:31.181 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.181 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.181 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:31.181 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476429+0000", 2024-09-12T22:33:31.181 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.015017943000000001 2024-09-12T22:33:31.181 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.182 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.182 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:31.182 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476499+0000", 2024-09-12T22:33:31.182 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9047000000000005e-05 2024-09-12T22:33:31.182 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.182 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.182 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:31.182 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476553+0000", 2024-09-12T22:33:31.182 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4117999999999999e-05 2024-09-12T22:33:31.182 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:31.182 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:31.182 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:31.182 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.183 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.183 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1209 3.13 3:cb3d3880:::200.0000000d:head [write 1011245~5867 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:31.183 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.398677+0000", 2024-09-12T22:33:31.183 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 16.736370017999999, 2024-09-12T22:33:31.183 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.077995698000000002, 2024-09-12T22:33:31.183 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:31.183 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:31.183 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:31.183 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:31.183 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.183 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:31.183 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398677+0000", 2024-09-12T22:33:31.183 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:31.184 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.184 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.184 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:31.184 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398677+0000", 2024-09-12T22:33:31.184 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:31.184 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.184 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.184 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:31.184 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398678+0000", 2024-09-12T22:33:31.184 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5199999999999995e-07 2024-09-12T22:33:31.184 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.184 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.185 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:31.185 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398686+0000", 2024-09-12T22:33:31.185 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0579999999999998e-06 2024-09-12T22:33:31.185 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.185 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.185 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:31.185 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398695+0000", 2024-09-12T22:33:31.185 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.1409999999999994e-06 2024-09-12T22:33:31.185 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.185 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.185 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:31.185 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398703+0000", 2024-09-12T22:33:31.186 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4379999999999998e-06 2024-09-12T22:33:31.186 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.186 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.186 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:31.186 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.457051+0000", 2024-09-12T22:33:31.186 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.058348358000000003 2024-09-12T22:33:31.186 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.186 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.186 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:31.186 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.457096+0000", 2024-09-12T22:33:31.186 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4428000000000002e-05 2024-09-12T22:33:31.186 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.186 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.187 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:31.187 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.457162+0000", 2024-09-12T22:33:31.187 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6298999999999997e-05 2024-09-12T22:33:31.187 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.187 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.187 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:31.187 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.461416+0000", 2024-09-12T22:33:31.187 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0042539980000000002 2024-09-12T22:33:31.187 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.187 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.187 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:31.187 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476610+0000", 2024-09-12T22:33:31.187 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.015193879 2024-09-12T22:33:31.188 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.188 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.188 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:31.188 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476640+0000", 2024-09-12T22:33:31.188 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0648000000000002e-05 2024-09-12T22:33:31.188 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.188 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.188 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:31.188 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476673+0000", 2024-09-12T22:33:31.188 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2598999999999997e-05 2024-09-12T22:33:31.188 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:31.188 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:31.189 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:31.189 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.189 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.189 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1210 3.13 3:cb3d3880:::200.0000000d:head [write 1017112~1958 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:31.189 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.398713+0000", 2024-09-12T22:33:31.189 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 16.736334695, 2024-09-12T22:33:31.189 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.078118317000000007, 2024-09-12T22:33:31.189 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:31.189 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:31.189 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:31.189 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:31.189 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.190 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:31.190 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398713+0000", 2024-09-12T22:33:31.190 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:31.190 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.190 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.190 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:31.190 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398713+0000", 2024-09-12T22:33:31.190 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:31.190 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.190 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.190 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:31.190 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398713+0000", 2024-09-12T22:33:31.191 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7599999999999998e-07 2024-09-12T22:33:31.191 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.191 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.191 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:31.191 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398718+0000", 2024-09-12T22:33:31.191 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8169999999999998e-06 2024-09-12T22:33:31.191 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.191 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.191 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:31.191 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398722+0000", 2024-09-12T22:33:31.191 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5249999999999999e-06 2024-09-12T22:33:31.191 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.191 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.191 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:31.192 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398726+0000", 2024-09-12T22:33:31.192 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5650000000000002e-06 2024-09-12T22:33:31.192 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.192 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.192 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:31.192 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.457644+0000", 2024-09-12T22:33:31.192 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.058918521000000001 2024-09-12T22:33:31.192 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.192 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.192 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:31.192 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.457724+0000", 2024-09-12T22:33:31.193 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9408999999999998e-05 2024-09-12T22:33:31.193 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.193 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.193 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:31.193 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.457821+0000", 2024-09-12T22:33:31.193 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.7015000000000005e-05 2024-09-12T22:33:31.193 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.193 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.193 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:31.193 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.461419+0000", 2024-09-12T22:33:31.193 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0035985309999999999 2024-09-12T22:33:31.193 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.193 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.193 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:31.194 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476726+0000", 2024-09-12T22:33:31.194 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.015306804 2024-09-12T22:33:31.194 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.194 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.194 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:31.194 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476787+0000", 2024-09-12T22:33:31.194 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1062000000000006e-05 2024-09-12T22:33:31.194 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.194 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.194 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:31.194 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476831+0000", 2024-09-12T22:33:31.194 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3692000000000001e-05 2024-09-12T22:33:31.194 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:31.195 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:31.195 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:31.195 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.195 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.195 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1211 3.13 3:cb3d3880:::200.0000000d:head [write 1019070~5873 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:31.195 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.400122+0000", 2024-09-12T22:33:31.195 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 16.734924976999999, 2024-09-12T22:33:31.195 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.076797146999999996, 2024-09-12T22:33:31.195 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:31.195 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:31.195 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:31.195 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:31.195 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.195 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:31.196 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.400122+0000", 2024-09-12T22:33:31.196 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:31.196 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.196 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.196 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:31.196 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.400122+0000", 2024-09-12T22:33:31.196 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:31.196 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.196 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.196 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:31.196 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.400123+0000", 2024-09-12T22:33:31.196 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2500000000000005e-07 2024-09-12T22:33:31.196 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.197 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.197 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:31.197 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.400129+0000", 2024-09-12T22:33:31.197 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.319e-06 2024-09-12T22:33:31.197 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.197 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.197 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:31.197 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.400139+0000", 2024-09-12T22:33:31.197 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.5200000000000003e-06 2024-09-12T22:33:31.197 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.197 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.197 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:31.197 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.400143+0000", 2024-09-12T22:33:31.198 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.437e-06 2024-09-12T22:33:31.198 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.198 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.198 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:31.198 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.458159+0000", 2024-09-12T22:33:31.198 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.058015960999999998 2024-09-12T22:33:31.198 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.198 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.198 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:31.198 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.458201+0000", 2024-09-12T22:33:31.198 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1693000000000002e-05 2024-09-12T22:33:31.198 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.198 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.199 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:31.199 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.458267+0000", 2024-09-12T22:33:31.199 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5687999999999999e-05 2024-09-12T22:33:31.199 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.199 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.199 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:31.199 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.461423+0000", 2024-09-12T22:33:31.199 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0031560730000000001 2024-09-12T22:33:31.199 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.199 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.199 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:31.199 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476868+0000", 2024-09-12T22:33:31.199 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.015445108000000001 2024-09-12T22:33:31.200 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.200 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.200 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:31.200 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476897+0000", 2024-09-12T22:33:31.200 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9433000000000001e-05 2024-09-12T22:33:31.200 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.200 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.200 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:31.200 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476919+0000", 2024-09-12T22:33:31.200 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.2189999999999999e-05 2024-09-12T22:33:31.200 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:31.200 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:31.200 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:31.201 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.201 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.201 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1212 3.13 3:cb3d3880:::200.0000000d:head [write 1024943~3866 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:31.201 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.401707+0000", 2024-09-12T22:33:31.201 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 16.733340771999998, 2024-09-12T22:33:31.201 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.075386625999999998, 2024-09-12T22:33:31.201 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:31.201 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:31.201 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:31.201 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:31.201 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.201 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:31.201 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.401707+0000", 2024-09-12T22:33:31.202 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:31.202 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.202 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.202 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:31.202 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.401707+0000", 2024-09-12T22:33:31.202 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:31.202 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.202 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.202 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:31.202 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.401707+0000", 2024-09-12T22:33:31.202 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7700000000000004e-07 2024-09-12T22:33:31.202 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.202 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.202 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:31.203 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.401713+0000", 2024-09-12T22:33:31.203 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6609999999999997e-06 2024-09-12T22:33:31.203 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.203 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.203 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:31.203 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.401726+0000", 2024-09-12T22:33:31.203 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.3088000000000001e-05 2024-09-12T22:33:31.203 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.203 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.203 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:31.203 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.401741+0000", 2024-09-12T22:33:31.203 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.5424e-05 2024-09-12T22:33:31.203 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.204 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.204 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:31.204 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.458853+0000", 2024-09-12T22:33:31.204 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.057111157000000003 2024-09-12T22:33:31.204 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.204 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.204 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:31.204 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.458898+0000", 2024-09-12T22:33:31.204 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5633999999999997e-05 2024-09-12T22:33:31.204 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.204 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.204 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:31.204 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.458972+0000", 2024-09-12T22:33:31.205 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3441000000000004e-05 2024-09-12T22:33:31.205 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.205 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.205 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:31.205 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.461426+0000", 2024-09-12T22:33:31.205 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0024542660000000001 2024-09-12T22:33:31.205 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.205 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.205 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:31.205 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476985+0000", 2024-09-12T22:33:31.205 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.015559513000000001 2024-09-12T22:33:31.205 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.205 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.206 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:31.206 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.477044+0000", 2024-09-12T22:33:31.206 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8156999999999999e-05 2024-09-12T22:33:31.206 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.206 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.206 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:31.206 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.477093+0000", 2024-09-12T22:33:31.206 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9607999999999997e-05 2024-09-12T22:33:31.206 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:31.206 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:31.206 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:31.206 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.206 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.206 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1213 3.13 3:cb3d3880:::200.0000000d:head [write 1028809~6329 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:31.207 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.403250+0000", 2024-09-12T22:33:31.207 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 16.731797243999999, 2024-09-12T22:33:31.207 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.073936215999999999, 2024-09-12T22:33:31.207 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:31.207 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:31.207 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:31.207 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:31.207 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.207 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:31.207 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403250+0000", 2024-09-12T22:33:31.207 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:31.207 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.207 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.207 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:31.208 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403250+0000", 2024-09-12T22:33:31.208 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:31.208 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.208 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.208 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:31.208 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403251+0000", 2024-09-12T22:33:31.208 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.37e-07 2024-09-12T22:33:31.208 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.208 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.208 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:31.208 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403258+0000", 2024-09-12T22:33:31.208 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.25e-06 2024-09-12T22:33:31.208 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.209 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.209 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:31.209 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403269+0000", 2024-09-12T22:33:31.209 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0509000000000001e-05 2024-09-12T22:33:31.209 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.209 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.209 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:31.209 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403274+0000", 2024-09-12T22:33:31.209 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1290000000000004e-06 2024-09-12T22:33:31.209 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.209 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.209 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:31.209 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.459796+0000", 2024-09-12T22:33:31.210 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.056522020999999999 2024-09-12T22:33:31.210 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.210 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.210 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:31.210 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.459845+0000", 2024-09-12T22:33:31.210 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8884999999999997e-05 2024-09-12T22:33:31.210 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.210 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.210 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:31.210 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.459920+0000", 2024-09-12T22:33:31.210 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5318e-05 2024-09-12T22:33:31.210 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.210 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.211 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:31.211 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.466542+0000", 2024-09-12T22:33:31.211 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0066223139999999998 2024-09-12T22:33:31.211 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.211 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.211 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:31.211 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.477137+0000", 2024-09-12T22:33:31.211 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010594717 2024-09-12T22:33:31.211 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.211 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.211 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:31.211 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.477165+0000", 2024-09-12T22:33:31.211 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8262000000000001e-05 2024-09-12T22:33:31.212 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.212 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.212 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:31.212 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.477186+0000", 2024-09-12T22:33:31.212 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1073999999999998e-05 2024-09-12T22:33:31.212 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:31.212 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:31.212 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:31.212 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.212 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.212 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1214 3.13 3:cb3d3880:::200.0000000d:head [write 1035138~2606 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:31.212 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.403674+0000", 2024-09-12T22:33:31.212 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 16.731373324, 2024-09-12T22:33:31.212 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.073643204000000004, 2024-09-12T22:33:31.213 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:31.213 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:31.213 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:31.213 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:31.213 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.213 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:31.213 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403674+0000", 2024-09-12T22:33:31.213 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:31.213 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.213 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.213 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:31.213 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403674+0000", 2024-09-12T22:33:31.213 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:31.214 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.214 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.214 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:31.214 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403674+0000", 2024-09-12T22:33:31.214 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.7700000000000005e-07 2024-09-12T22:33:31.214 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.214 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.214 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:31.214 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403678+0000", 2024-09-12T22:33:31.214 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2009999999999999e-06 2024-09-12T22:33:31.214 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.214 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.214 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:31.215 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403686+0000", 2024-09-12T22:33:31.215 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5690000000000005e-06 2024-09-12T22:33:31.215 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.215 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.215 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:31.215 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403690+0000", 2024-09-12T22:33:31.215 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.233e-06 2024-09-12T22:33:31.215 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.215 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.215 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:31.215 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.460445+0000", 2024-09-12T22:33:31.215 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.056754412999999997 2024-09-12T22:33:31.215 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.215 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.216 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:31.216 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.460495+0000", 2024-09-12T22:33:31.216 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0238999999999998e-05 2024-09-12T22:33:31.216 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.216 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.216 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:31.216 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.460566+0000", 2024-09-12T22:33:31.216 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1159000000000001e-05 2024-09-12T22:33:31.216 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.216 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.216 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:31.216 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.466546+0000", 2024-09-12T22:33:31.216 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0059798910000000002 2024-09-12T22:33:31.217 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.217 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.217 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:31.217 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.477232+0000", 2024-09-12T22:33:31.217 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010686084 2024-09-12T22:33:31.217 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.217 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.217 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:31.217 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.477280+0000", 2024-09-12T22:33:31.217 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.7719999999999997e-05 2024-09-12T22:33:31.217 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.217 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.217 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:31.218 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.477317+0000", 2024-09-12T22:33:31.218 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7218000000000002e-05 2024-09-12T22:33:31.218 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:31.218 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:31.218 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:31.218 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.218 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.218 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1223 3.13 3:cb3d3880:::200.0000000d:head [write 1090497~1913 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:31.218 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.420111+0000", 2024-09-12T22:33:31.218 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 16.714936172000002, 2024-09-12T22:33:31.218 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.071634583000000002, 2024-09-12T22:33:31.218 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:31.218 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:31.219 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:31.219 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:31.219 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.219 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:31.219 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.420111+0000", 2024-09-12T22:33:31.219 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:31.219 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.219 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.219 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:31.219 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.420111+0000", 2024-09-12T22:33:31.219 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:31.219 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.219 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.220 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:31.220 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.420112+0000", 2024-09-12T22:33:31.220 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.2900000000000002e-07 2024-09-12T22:33:31.220 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.220 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.220 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:31.220 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.420116+0000", 2024-09-12T22:33:31.220 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.67e-06 2024-09-12T22:33:31.220 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.220 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.220 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:31.220 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.420125+0000", 2024-09-12T22:33:31.220 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.0890000000000006e-06 2024-09-12T22:33:31.221 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.221 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.221 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:31.221 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.420131+0000", 2024-09-12T22:33:31.221 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4269999999999996e-06 2024-09-12T22:33:31.221 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.221 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.221 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:31.221 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.465358+0000", 2024-09-12T22:33:31.221 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.045227030000000001 2024-09-12T22:33:31.221 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.221 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.221 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:31.222 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.465439+0000", 2024-09-12T22:33:31.222 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0901000000000004e-05 2024-09-12T22:33:31.222 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.222 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.222 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:31.222 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.465571+0000", 2024-09-12T22:33:31.222 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000131705 2024-09-12T22:33:31.222 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.222 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.222 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:31.222 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.469496+0000", 2024-09-12T22:33:31.222 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.003925418 2024-09-12T22:33:31.222 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.223 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.223 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:31.223 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.491669+0000", 2024-09-12T22:33:31.223 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.022172335000000001 2024-09-12T22:33:31.223 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.223 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.223 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:31.223 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.491714+0000", 2024-09-12T22:33:31.223 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5417000000000002e-05 2024-09-12T22:33:31.223 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.223 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.223 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:31.223 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.491746+0000", 2024-09-12T22:33:31.223 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1662000000000003e-05 2024-09-12T22:33:31.224 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:31.224 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:31.224 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:31.224 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.224 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.224 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1225 3.13 3:cb3d3880:::200.0000000d:head [write 1097316~1932 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:31.224 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.421303+0000", 2024-09-12T22:33:31.224 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 16.713744337000001, 2024-09-12T22:33:31.224 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.074934770999999997, 2024-09-12T22:33:31.224 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:31.224 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:31.224 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:31.224 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:31.225 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.225 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:31.225 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.421303+0000", 2024-09-12T22:33:31.225 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:31.225 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.225 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.225 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:31.225 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.421303+0000", 2024-09-12T22:33:31.225 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:31.225 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.225 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.225 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:31.225 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.421303+0000", 2024-09-12T22:33:31.225 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8599999999999998e-07 2024-09-12T22:33:31.226 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.226 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.226 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:31.226 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.421307+0000", 2024-09-12T22:33:31.226 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0879999999999999e-06 2024-09-12T22:33:31.226 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.226 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.226 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:31.226 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.421314+0000", 2024-09-12T22:33:31.226 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1010000000000003e-06 2024-09-12T22:33:31.226 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.226 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.226 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:31.227 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.421319+0000", 2024-09-12T22:33:31.227 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7209999999999999e-06 2024-09-12T22:33:31.227 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.227 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.227 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:31.227 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.466620+0000", 2024-09-12T22:33:31.227 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.045301044999999998 2024-09-12T22:33:31.227 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.227 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.227 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:31.227 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.466703+0000", 2024-09-12T22:33:31.227 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3011999999999997e-05 2024-09-12T22:33:31.228 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.228 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.228 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:31.228 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.466826+0000", 2024-09-12T22:33:31.228 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000122824 2024-09-12T22:33:31.228 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.228 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.228 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:31.228 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.472359+0000", 2024-09-12T22:33:31.228 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0055323009999999999 2024-09-12T22:33:31.228 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.228 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.229 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:31.229 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496142+0000", 2024-09-12T22:33:31.229 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.023783696999999999 2024-09-12T22:33:31.229 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.229 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.229 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:31.229 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496194+0000", 2024-09-12T22:33:31.229 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1350000000000001e-05 2024-09-12T22:33:31.229 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.229 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.229 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:31.229 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496238+0000", 2024-09-12T22:33:31.229 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4146000000000001e-05 2024-09-12T22:33:31.230 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:31.230 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:31.230 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:31.230 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.230 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.230 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1226 3.13 3:cb3d3880:::200.0000000d:head [write 1099248~1973 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:31.230 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.422971+0000", 2024-09-12T22:33:31.230 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 16.712076739, 2024-09-12T22:33:31.230 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.073363063000000006, 2024-09-12T22:33:31.230 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:31.230 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:31.230 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:31.230 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:31.231 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.231 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:31.231 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.422971+0000", 2024-09-12T22:33:31.231 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:31.231 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.231 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.231 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:31.231 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.422971+0000", 2024-09-12T22:33:31.231 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:31.231 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.231 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.231 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:31.231 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.422971+0000", 2024-09-12T22:33:31.232 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.1699999999999997e-07 2024-09-12T22:33:31.232 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.232 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.232 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:31.232 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.422975+0000", 2024-09-12T22:33:31.232 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2650000000000001e-06 2024-09-12T22:33:31.232 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.232 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.232 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:31.232 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.422981+0000", 2024-09-12T22:33:31.232 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7379999999999997e-06 2024-09-12T22:33:31.232 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.232 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.232 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:31.233 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.422986+0000", 2024-09-12T22:33:31.233 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5220000000000001e-06 2024-09-12T22:33:31.233 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.233 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.233 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:31.233 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.467340+0000", 2024-09-12T22:33:31.233 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.044353985999999998 2024-09-12T22:33:31.233 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.233 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.233 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:31.233 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.467412+0000", 2024-09-12T22:33:31.233 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1982000000000003e-05 2024-09-12T22:33:31.234 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.234 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.234 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:31.234 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.467493+0000", 2024-09-12T22:33:31.234 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0829999999999997e-05 2024-09-12T22:33:31.234 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.234 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.234 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:31.234 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.472364+0000", 2024-09-12T22:33:31.234 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0048713189999999998 2024-09-12T22:33:31.234 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.234 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.234 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:31.234 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496271+0000", 2024-09-12T22:33:31.234 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.023906808000000002 2024-09-12T22:33:31.235 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.235 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.235 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:31.235 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496300+0000", 2024-09-12T22:33:31.235 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9315e-05 2024-09-12T22:33:31.235 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.235 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.235 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:31.235 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496334+0000", 2024-09-12T22:33:31.235 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3481e-05 2024-09-12T22:33:31.235 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:31.235 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:31.235 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:31.236 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.236 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.236 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1227 3.13 3:cb3d3880:::200.0000000d:head [write 1101221~1922 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:31.236 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.423028+0000", 2024-09-12T22:33:31.236 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 16.712019755, 2024-09-12T22:33:31.236 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.073444802000000003, 2024-09-12T22:33:31.236 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:31.236 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:31.236 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:31.236 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:31.236 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.236 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:31.236 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423028+0000", 2024-09-12T22:33:31.237 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:31.237 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.237 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.237 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:31.237 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423028+0000", 2024-09-12T22:33:31.237 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:31.237 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.237 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.237 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:31.237 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423028+0000", 2024-09-12T22:33:31.237 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1699999999999998e-07 2024-09-12T22:33:31.237 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.237 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.237 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:31.238 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423031+0000", 2024-09-12T22:33:31.238 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8499999999999998e-06 2024-09-12T22:33:31.238 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.238 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.238 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:31.238 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423036+0000", 2024-09-12T22:33:31.238 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9479999999999999e-06 2024-09-12T22:33:31.238 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.238 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.238 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:31.238 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423039+0000", 2024-09-12T22:33:31.238 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4929999999999998e-06 2024-09-12T22:33:31.239 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.239 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.239 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:31.239 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.467785+0000", 2024-09-12T22:33:31.239 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.044745957000000003 2024-09-12T22:33:31.239 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.239 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.239 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:31.239 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.467838+0000", 2024-09-12T22:33:31.239 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2596999999999998e-05 2024-09-12T22:33:31.239 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.239 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.239 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:31.240 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.467915+0000", 2024-09-12T22:33:31.240 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6744999999999998e-05 2024-09-12T22:33:31.240 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.240 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.240 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:31.240 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.472368+0000", 2024-09-12T22:33:31.240 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0044534730000000003 2024-09-12T22:33:31.240 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.240 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.240 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:31.240 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496382+0000", 2024-09-12T22:33:31.240 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.024014111000000001 2024-09-12T22:33:31.240 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.241 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.241 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:31.241 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496443+0000", 2024-09-12T22:33:31.241 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.0547000000000002e-05 2024-09-12T22:33:31.241 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.241 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.241 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:31.241 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496472+0000", 2024-09-12T22:33:31.241 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9564e-05 2024-09-12T22:33:31.241 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:31.241 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:31.242 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:31.242 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.242 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.242 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1228 3.13 3:cb3d3880:::200.0000000d:head [write 1103143~2423 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:31.242 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.423305+0000", 2024-09-12T22:33:31.242 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 16.711742391000001, 2024-09-12T22:33:31.242 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.073251160999999995, 2024-09-12T22:33:31.242 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:31.242 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:31.242 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:31.242 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:31.243 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.243 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:31.243 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423305+0000", 2024-09-12T22:33:31.243 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:31.243 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.243 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.243 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:31.243 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423305+0000", 2024-09-12T22:33:31.243 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:31.243 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.243 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.243 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:31.243 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423306+0000", 2024-09-12T22:33:31.244 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4899999999999995e-07 2024-09-12T22:33:31.244 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.244 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.244 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:31.244 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423311+0000", 2024-09-12T22:33:31.244 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7459999999999997e-06 2024-09-12T22:33:31.244 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.244 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.244 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:31.244 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423316+0000", 2024-09-12T22:33:31.244 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0239999999999997e-06 2024-09-12T22:33:31.244 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.244 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.245 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:31.245 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423320+0000", 2024-09-12T22:33:31.245 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.67e-06 2024-09-12T22:33:31.245 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.245 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.245 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:31.245 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.468252+0000", 2024-09-12T22:33:31.245 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.044932262000000001 2024-09-12T22:33:31.245 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.245 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.245 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:31.245 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.468293+0000", 2024-09-12T22:33:31.245 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0368999999999999e-05 2024-09-12T22:33:31.246 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.246 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.246 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:31.246 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.468357+0000", 2024-09-12T22:33:31.246 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4287000000000003e-05 2024-09-12T22:33:31.246 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.246 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.246 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:31.246 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.472371+0000", 2024-09-12T22:33:31.246 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0040144350000000002 2024-09-12T22:33:31.246 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.246 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.246 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:31.247 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496507+0000", 2024-09-12T22:33:31.247 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.024135961000000001 2024-09-12T22:33:31.247 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.247 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.247 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:31.247 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496537+0000", 2024-09-12T22:33:31.247 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9611000000000002e-05 2024-09-12T22:33:31.247 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.247 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.247 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:31.247 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496556+0000", 2024-09-12T22:33:31.247 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9147000000000002e-05 2024-09-12T22:33:31.247 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:31.248 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:31.248 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:31.248 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.248 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.248 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1229 3.13 3:cb3d3880:::200.0000000d:head [write 1105566~1911 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:31.248 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.423606+0000", 2024-09-12T22:33:31.248 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 16.71144138, 2024-09-12T22:33:31.248 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.073027876000000005, 2024-09-12T22:33:31.248 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:31.248 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:31.248 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:31.248 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:31.249 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.249 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:31.249 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423606+0000", 2024-09-12T22:33:31.249 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:31.249 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.249 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.249 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:31.249 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423606+0000", 2024-09-12T22:33:31.249 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:31.249 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.249 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.249 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:31.250 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423606+0000", 2024-09-12T22:33:31.250 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.7e-07 2024-09-12T22:33:31.250 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.250 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.250 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:31.250 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423609+0000", 2024-09-12T22:33:31.250 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5339999999999998e-06 2024-09-12T22:33:31.250 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.250 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.250 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:31.250 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423614+0000", 2024-09-12T22:33:31.250 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.69e-06 2024-09-12T22:33:31.250 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.251 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.251 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:31.251 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423617+0000", 2024-09-12T22:33:31.251 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4300000000000002e-06 2024-09-12T22:33:31.251 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.251 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.251 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:31.251 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.468606+0000", 2024-09-12T22:33:31.251 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.044988606 2024-09-12T22:33:31.251 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.251 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.251 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:31.252 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.468649+0000", 2024-09-12T22:33:31.252 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3414000000000001e-05 2024-09-12T22:33:31.252 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.252 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.252 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:31.252 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.468714+0000", 2024-09-12T22:33:31.252 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4857000000000006e-05 2024-09-12T22:33:31.252 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.252 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.252 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:31.252 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.472375+0000", 2024-09-12T22:33:31.252 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0036607330000000002 2024-09-12T22:33:31.252 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.253 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.253 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:31.253 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496585+0000", 2024-09-12T22:33:31.253 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.024210835 2024-09-12T22:33:31.253 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.253 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.253 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:31.253 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496612+0000", 2024-09-12T22:33:31.253 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6999999999999999e-05 2024-09-12T22:33:31.253 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.253 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.253 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:31.253 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496634+0000", 2024-09-12T22:33:31.254 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1307000000000001e-05 2024-09-12T22:33:31.254 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:31.254 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:31.254 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:31.254 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.254 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.254 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1230 3.13 3:cb3d3880:::200.0000000d:head [write 1107477~6537 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:31.254 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.423911+0000", 2024-09-12T22:33:31.254 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 16.711136535000001, 2024-09-12T22:33:31.254 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.072794530999999996, 2024-09-12T22:33:31.254 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:31.254 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:31.254 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:31.254 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:31.255 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.255 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:31.255 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423911+0000", 2024-09-12T22:33:31.255 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:31.255 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.255 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.255 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:31.255 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423911+0000", 2024-09-12T22:33:31.255 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:31.255 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.255 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.255 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:31.255 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423911+0000", 2024-09-12T22:33:31.256 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3799999999999998e-07 2024-09-12T22:33:31.256 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.256 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.256 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:31.256 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423919+0000", 2024-09-12T22:33:31.256 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.8329999999999994e-06 2024-09-12T22:33:31.256 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.256 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.256 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:31.256 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423924+0000", 2024-09-12T22:33:31.256 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3449999999999996e-06 2024-09-12T22:33:31.256 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.256 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.257 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:31.257 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423928+0000", 2024-09-12T22:33:31.257 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2339999999999999e-06 2024-09-12T22:33:31.257 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.257 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.257 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:31.257 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.469042+0000", 2024-09-12T22:33:31.257 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.045114888999999998 2024-09-12T22:33:31.257 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.257 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.257 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:31.257 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.469092+0000", 2024-09-12T22:33:31.258 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9289000000000002e-05 2024-09-12T22:33:31.258 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.258 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.258 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:31.258 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.469163+0000", 2024-09-12T22:33:31.258 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1222000000000004e-05 2024-09-12T22:33:31.258 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.258 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.258 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:31.258 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.472379+0000", 2024-09-12T22:33:31.258 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0032156419999999999 2024-09-12T22:33:31.258 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.258 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.259 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:31.259 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496661+0000", 2024-09-12T22:33:31.259 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.024281857 2024-09-12T22:33:31.259 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.259 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.259 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:31.259 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496687+0000", 2024-09-12T22:33:31.259 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6551e-05 2024-09-12T22:33:31.259 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:31.259 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:31.259 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:31.259 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496705+0000", 2024-09-12T22:33:31.259 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.8230999999999999e-05 2024-09-12T22:33:31.260 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:31.260 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:31.260 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:31.260 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:31.260 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:31.260 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-09-12T22:33:31.261 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:33:31.262 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:31.260+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:31.362 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:31.361+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:31.377 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:33:31.377 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:33:31.377 INFO:teuthology.orchestra.run.smithi148.stdout: "num_ops": 0 2024-09-12T22:33:31.377 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:33:31.386 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:33:31.464 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:31.462+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:31.530 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:33:31.530 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:33:31.530 INFO:teuthology.orchestra.run.smithi148.stdout: "complaint_time": 30, 2024-09-12T22:33:31.530 INFO:teuthology.orchestra.run.smithi148.stdout: "num_blocked_ops": 0 2024-09-12T22:33:31.530 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:33:31.540 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:33:31.581 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T22:33:31.586 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:31.585+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:31.665 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:31.664+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:31.678 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:33:31.678 INFO:teuthology.orchestra.run.smithi148.stdout: "size": 20, 2024-09-12T22:33:31.678 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 600, 2024-09-12T22:33:31.678 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [ 2024-09-12T22:33:31.678 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.678 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4490.0:9866 4.b 4:d370243b:::10000002d48.00000000:head [write 0~1308] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:33:31.678 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:09.467883+0000", 2024-09-12T22:33:31.678 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 22.208013222999998, 2024-09-12T22:33:31.678 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.085024817000000003, 2024-09-12T22:33:31.678 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:31.678 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:31.679 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:31.679 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:33:31.679 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4490", 2024-09-12T22:33:31.679 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:31.679 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 9866 2024-09-12T22:33:31.679 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.679 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:31.679 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.679 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:31.679 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.467883+0000", 2024-09-12T22:33:31.679 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:31.679 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.679 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.680 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:31.680 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.467883+0000", 2024-09-12T22:33:31.680 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:31.680 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.680 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.680 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:31.680 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.467884+0000", 2024-09-12T22:33:31.680 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1800000000000005e-07 2024-09-12T22:33:31.680 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.680 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.680 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:31.680 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.467888+0000", 2024-09-12T22:33:31.680 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5959999999999997e-06 2024-09-12T22:33:31.681 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.681 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.681 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:31.681 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.467896+0000", 2024-09-12T22:33:31.681 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.8679999999999999e-06 2024-09-12T22:33:31.681 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.681 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.681 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:31.681 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.467901+0000", 2024-09-12T22:33:31.681 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9169999999999997e-06 2024-09-12T22:33:31.681 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.681 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.681 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:31.681 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.467944+0000", 2024-09-12T22:33:31.682 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3055e-05 2024-09-12T22:33:31.682 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.682 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.682 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:31.682 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.468011+0000", 2024-09-12T22:33:31.682 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7328000000000003e-05 2024-09-12T22:33:31.682 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.682 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.682 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:31.682 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.468078+0000", 2024-09-12T22:33:31.682 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7063999999999994e-05 2024-09-12T22:33:31.682 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.682 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.683 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:31.683 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.551406+0000", 2024-09-12T22:33:31.683 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.083327485000000007 2024-09-12T22:33:31.683 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.683 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.683 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:31.683 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.552822+0000", 2024-09-12T22:33:31.683 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001415929 2024-09-12T22:33:31.683 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.683 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.683 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:31.683 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.552863+0000", 2024-09-12T22:33:31.683 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0809000000000002e-05 2024-09-12T22:33:31.683 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.684 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.684 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:31.684 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.552908+0000", 2024-09-12T22:33:31.684 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5048e-05 2024-09-12T22:33:31.684 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:31.684 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:31.684 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:31.684 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.684 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.684 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4490.0:9867 4.16 4:6bd8f1b8:::10000002d49.00000000:head [write 0~1599] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:33:31.684 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:09.468760+0000", 2024-09-12T22:33:31.684 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 22.207136213999998, 2024-09-12T22:33:31.684 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.086660499000000002, 2024-09-12T22:33:31.685 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:31.685 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:31.685 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:31.685 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:33:31.685 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4490", 2024-09-12T22:33:31.685 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:31.685 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 9867 2024-09-12T22:33:31.685 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.685 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:31.685 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.685 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:31.685 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.468760+0000", 2024-09-12T22:33:31.686 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:31.686 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.686 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.686 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:31.686 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.468760+0000", 2024-09-12T22:33:31.686 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:31.686 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.686 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.686 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:31.686 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.468761+0000", 2024-09-12T22:33:31.686 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4399999999999999e-07 2024-09-12T22:33:31.686 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.686 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.686 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:31.687 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.468765+0000", 2024-09-12T22:33:31.687 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3259999999999997e-06 2024-09-12T22:33:31.687 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.687 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.687 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:31.687 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.548969+0000", 2024-09-12T22:33:31.687 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.080204172000000004 2024-09-12T22:33:31.687 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.687 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.687 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:31.687 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.549001+0000", 2024-09-12T22:33:31.687 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.1464999999999998e-05 2024-09-12T22:33:31.687 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.688 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.688 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:31.688 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.549148+0000", 2024-09-12T22:33:31.688 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014749399999999999 2024-09-12T22:33:31.688 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.688 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.688 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:31.688 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.549379+0000", 2024-09-12T22:33:31.688 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000231091 2024-09-12T22:33:31.688 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.688 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.688 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:31.689 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.549518+0000", 2024-09-12T22:33:31.689 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013844899999999999 2024-09-12T22:33:31.689 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.689 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.689 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:31.689 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.552236+0000", 2024-09-12T22:33:31.689 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0027179869999999998 2024-09-12T22:33:31.689 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.689 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.689 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:31.689 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.555333+0000", 2024-09-12T22:33:31.689 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0030973559999999999 2024-09-12T22:33:31.689 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.689 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.690 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:31.690 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.555379+0000", 2024-09-12T22:33:31.690 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6236999999999998e-05 2024-09-12T22:33:31.690 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.690 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.690 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:31.690 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.555420+0000", 2024-09-12T22:33:31.690 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1177999999999998e-05 2024-09-12T22:33:31.690 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:31.690 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:31.690 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:31.690 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.691 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.691 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop_reply(client.4490.0:9866 4.b e53/18 ondisk, result = 0)", 2024-09-12T22:33:31.691 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:09.468826+0000", 2024-09-12T22:33:31.691 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 22.207069918999998, 2024-09-12T22:33:31.691 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.082588348000000006, 2024-09-12T22:33:31.691 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:31.691 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:31.691 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:33:31.691 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:31.691 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.691 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:31.691 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.468826+0000", 2024-09-12T22:33:31.691 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:31.691 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.692 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.692 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:31.692 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.468826+0000", 2024-09-12T22:33:31.692 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:31.692 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.692 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.692 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:31.692 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.468827+0000", 2024-09-12T22:33:31.692 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3399999999999999e-07 2024-09-12T22:33:31.692 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.692 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.692 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:31.692 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.468830+0000", 2024-09-12T22:33:31.693 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.1559999999999999e-06 2024-09-12T22:33:31.693 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.693 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.693 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:31.693 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.548957+0000", 2024-09-12T22:33:31.693 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.080126852999999998 2024-09-12T22:33:31.693 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.693 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.693 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:31.693 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.548989+0000", 2024-09-12T22:33:31.693 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2409000000000001e-05 2024-09-12T22:33:31.693 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.693 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.694 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:31.694 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.551065+0000", 2024-09-12T22:33:31.694 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.002075871 2024-09-12T22:33:31.694 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.694 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.694 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:31.694 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.551398+0000", 2024-09-12T22:33:31.694 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00033339099999999999 2024-09-12T22:33:31.694 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.694 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.694 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:31.694 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.551414+0000", 2024-09-12T22:33:31.694 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6133999999999998e-05 2024-09-12T22:33:31.694 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:31.695 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:31.695 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:31.695 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.695 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.695 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4490.0:10437 4.2f 4:f6cd553b:::10000002fce.00000000:head [write 0~27313] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:33:31.695 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:10.050890+0000", 2024-09-12T22:33:31.695 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 21.625005522999999, 2024-09-12T22:33:31.695 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.056482601, 2024-09-12T22:33:31.695 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:31.695 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:31.695 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:31.695 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:33:31.695 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4490", 2024-09-12T22:33:31.696 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:31.696 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 10437 2024-09-12T22:33:31.696 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.696 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:31.696 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.696 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:31.696 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.050890+0000", 2024-09-12T22:33:31.696 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:31.696 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.696 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.696 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:31.696 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.050890+0000", 2024-09-12T22:33:31.696 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:31.696 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.697 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.697 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:31.697 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.050891+0000", 2024-09-12T22:33:31.697 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.6600000000000005e-07 2024-09-12T22:33:31.697 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.697 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.697 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:31.697 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.050906+0000", 2024-09-12T22:33:31.697 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4521e-05 2024-09-12T22:33:31.697 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.697 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.697 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:31.697 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.050915+0000", 2024-09-12T22:33:31.698 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.2569999999999996e-06 2024-09-12T22:33:31.698 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.698 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.698 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:31.698 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.050920+0000", 2024-09-12T22:33:31.698 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.724e-06 2024-09-12T22:33:31.698 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.698 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.698 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:31.698 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.050960+0000", 2024-09-12T22:33:31.698 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9999000000000001e-05 2024-09-12T22:33:31.698 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.698 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.699 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:31.699 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.051031+0000", 2024-09-12T22:33:31.699 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1007000000000006e-05 2024-09-12T22:33:31.699 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.699 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.699 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:31.699 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.107249+0000", 2024-09-12T22:33:31.699 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.056218432999999998 2024-09-12T22:33:31.699 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.699 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.699 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:31.699 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.107301+0000", 2024-09-12T22:33:31.699 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1289000000000003e-05 2024-09-12T22:33:31.699 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.700 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.700 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:31.700 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.107373+0000", 2024-09-12T22:33:31.700 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.2504999999999998e-05 2024-09-12T22:33:31.700 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:31.700 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:31.700 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:31.700 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.700 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.700 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4490.0:10439 4.12 4:483953cb:::10000002fd0.00000000:head [write 0~4842] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:33:31.700 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:10.052567+0000", 2024-09-12T22:33:31.700 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 21.623329314999999, 2024-09-12T22:33:31.700 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.055835449000000002, 2024-09-12T22:33:31.700 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:31.701 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:31.701 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:31.701 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:33:31.701 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4490", 2024-09-12T22:33:31.701 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:31.701 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 10439 2024-09-12T22:33:31.701 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.701 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:31.701 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.701 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:31.701 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.052567+0000", 2024-09-12T22:33:31.701 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:31.702 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.702 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.702 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:31.702 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.052567+0000", 2024-09-12T22:33:31.702 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:31.702 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.702 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.702 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:31.702 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.052568+0000", 2024-09-12T22:33:31.702 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.3600000000000002e-07 2024-09-12T22:33:31.702 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.702 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.702 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:31.702 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.052591+0000", 2024-09-12T22:33:31.703 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.3110000000000001e-05 2024-09-12T22:33:31.703 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.703 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.703 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:31.703 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.106740+0000", 2024-09-12T22:33:31.703 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.054149315000000003 2024-09-12T22:33:31.703 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.703 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.703 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:31.703 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.106751+0000", 2024-09-12T22:33:31.703 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1056000000000001e-05 2024-09-12T22:33:31.703 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.703 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.704 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:31.704 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.106811+0000", 2024-09-12T22:33:31.704 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9515999999999997e-05 2024-09-12T22:33:31.704 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.704 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.704 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:31.704 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.106929+0000", 2024-09-12T22:33:31.704 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00011879000000000001 2024-09-12T22:33:31.704 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.704 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.704 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:31.704 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.108283+0000", 2024-09-12T22:33:31.704 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001354177 2024-09-12T22:33:31.705 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.705 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.705 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:31.705 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.108328+0000", 2024-09-12T22:33:31.705 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4931000000000001e-05 2024-09-12T22:33:31.705 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.705 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.705 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:31.705 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.108402+0000", 2024-09-12T22:33:31.705 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3718000000000001e-05 2024-09-12T22:33:31.705 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:31.705 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:31.705 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:31.705 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.706 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.706 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(client.4490.0:10445 4.3c e53/18 4:3d97251e:::10000002fd8.00000000:head v 53'154, mlcod=53'152)", 2024-09-12T22:33:31.706 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:10.058521+0000", 2024-09-12T22:33:31.706 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 21.617374975000001, 2024-09-12T22:33:31.706 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.049310138000000003, 2024-09-12T22:33:31.706 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:31.706 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:31.706 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:31.706 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:31.706 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.706 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:31.706 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.058521+0000", 2024-09-12T22:33:31.706 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:31.706 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.707 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.707 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:31.707 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.058521+0000", 2024-09-12T22:33:31.707 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:31.707 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.707 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.707 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:31.707 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.058522+0000", 2024-09-12T22:33:31.707 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.1099999999999995e-07 2024-09-12T22:33:31.707 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.707 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.707 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:31.707 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.058530+0000", 2024-09-12T22:33:31.708 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.7290000000000006e-06 2024-09-12T22:33:31.708 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.708 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.708 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:31.708 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.106760+0000", 2024-09-12T22:33:31.708 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.048229384 2024-09-12T22:33:31.708 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.708 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.708 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:31.708 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.106770+0000", 2024-09-12T22:33:31.708 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0431999999999999e-05 2024-09-12T22:33:31.708 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.708 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.709 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:31.709 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.106823+0000", 2024-09-12T22:33:31.709 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2309999999999999e-05 2024-09-12T22:33:31.709 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.709 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.709 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:31.709 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.106841+0000", 2024-09-12T22:33:31.709 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.8218000000000001e-05 2024-09-12T22:33:31.709 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.709 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.709 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:31.709 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.107796+0000", 2024-09-12T22:33:31.709 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00095552600000000005 2024-09-12T22:33:31.709 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.710 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.710 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:31.710 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.107831+0000", 2024-09-12T22:33:31.710 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4928000000000002e-05 2024-09-12T22:33:31.710 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:31.710 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:31.710 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:31.710 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.710 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.710 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4490.0:11351 4.3f 4:fd498422:::10000003188.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-12T22:33:31.710 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:13.354715+0000", 2024-09-12T22:33:31.710 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 18.321181160999998, 2024-09-12T22:33:31.710 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.043059568999999999, 2024-09-12T22:33:31.710 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:31.711 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:31.711 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:31.711 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:33:31.711 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4490", 2024-09-12T22:33:31.711 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:31.711 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 11351 2024-09-12T22:33:31.711 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.711 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:31.711 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.711 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:31.711 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.354715+0000", 2024-09-12T22:33:31.711 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:31.711 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.712 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.712 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:31.712 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.354715+0000", 2024-09-12T22:33:31.712 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:31.712 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.712 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.712 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:31.712 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.354716+0000", 2024-09-12T22:33:31.712 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.7600000000000006e-07 2024-09-12T22:33:31.712 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.712 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.712 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:31.712 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.361477+0000", 2024-09-12T22:33:31.712 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0067607090000000002 2024-09-12T22:33:31.713 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.713 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.713 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:31.713 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.361487+0000", 2024-09-12T22:33:31.713 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0249e-05 2024-09-12T22:33:31.713 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.713 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.713 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:31.713 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.361493+0000", 2024-09-12T22:33:31.713 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.4699999999999999e-06 2024-09-12T22:33:31.713 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.713 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.713 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:31.714 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.361544+0000", 2024-09-12T22:33:31.714 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1124e-05 2024-09-12T22:33:31.714 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.714 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.714 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:31.714 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.361604+0000", 2024-09-12T22:33:31.714 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9397000000000001e-05 2024-09-12T22:33:31.714 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.714 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.714 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:31.714 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.397601+0000", 2024-09-12T22:33:31.714 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.035996927999999997 2024-09-12T22:33:31.714 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.714 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.715 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:31.715 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.397646+0000", 2024-09-12T22:33:31.715 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5176000000000003e-05 2024-09-12T22:33:31.715 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.715 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.715 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:31.715 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.397774+0000", 2024-09-12T22:33:31.715 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012854000000000001 2024-09-12T22:33:31.715 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:31.715 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:31.715 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:31.715 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.715 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.715 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4490.0:12798 4.3e 4:7eb070ca:::100000030e0.00000000:head [write 0~4194304 [5@1189789]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-12T22:33:31.716 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:15.140228+0000", 2024-09-12T22:33:31.716 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 16.535668511000001, 2024-09-12T22:33:31.716 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.046073232999999998, 2024-09-12T22:33:31.716 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:31.716 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:31.716 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:31.716 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:33:31.716 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4490", 2024-09-12T22:33:31.716 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:31.716 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 12798 2024-09-12T22:33:31.716 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.716 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:31.716 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.716 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:31.717 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.140228+0000", 2024-09-12T22:33:31.717 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:31.717 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.717 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.717 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:31.717 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.140228+0000", 2024-09-12T22:33:31.717 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:31.717 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.717 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.718 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:31.718 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.140228+0000", 2024-09-12T22:33:31.718 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5899999999999996e-07 2024-09-12T22:33:31.718 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.718 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.718 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:31.718 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.147541+0000", 2024-09-12T22:33:31.718 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0073125339999999999 2024-09-12T22:33:31.718 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.718 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.718 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:31.718 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.147555+0000", 2024-09-12T22:33:31.718 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.42e-05 2024-09-12T22:33:31.718 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.719 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.719 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:31.719 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.147564+0000", 2024-09-12T22:33:31.719 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.0999999999999993e-06 2024-09-12T22:33:31.719 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.719 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.719 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:31.719 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.147637+0000", 2024-09-12T22:33:31.719 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3288999999999996e-05 2024-09-12T22:33:31.719 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.719 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.719 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:31.719 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.147725+0000", 2024-09-12T22:33:31.720 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.7622999999999998e-05 2024-09-12T22:33:31.720 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.720 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.720 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:31.720 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.186239+0000", 2024-09-12T22:33:31.720 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.038514171 2024-09-12T22:33:31.720 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.720 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.720 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:31.720 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.186265+0000", 2024-09-12T22:33:31.720 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5738e-05 2024-09-12T22:33:31.720 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.720 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.721 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:31.721 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.186301+0000", 2024-09-12T22:33:31.721 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.6019000000000002e-05 2024-09-12T22:33:31.721 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:31.721 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:31.721 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:31.721 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.721 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.721 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3063 3.2 3:42569fed:::200.00000011:head [write 3915305~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:33:31.721 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:19.386685+0000", 2024-09-12T22:33:31.721 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 12.289211282, 2024-09-12T22:33:31.721 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.042365220000000002, 2024-09-12T22:33:31.721 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:31.722 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:31.722 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:31.722 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:31.722 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.722 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:31.722 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386685+0000", 2024-09-12T22:33:31.722 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:31.722 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.722 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.722 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:31.722 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386685+0000", 2024-09-12T22:33:31.722 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:31.722 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.723 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.723 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:31.723 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386685+0000", 2024-09-12T22:33:31.723 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.08e-07 2024-09-12T22:33:31.723 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.723 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.723 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:31.723 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386688+0000", 2024-09-12T22:33:31.723 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8880000000000001e-06 2024-09-12T22:33:31.723 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.723 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.723 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:31.723 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386694+0000", 2024-09-12T22:33:31.724 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8089999999999998e-06 2024-09-12T22:33:31.724 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.724 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.724 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:31.724 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386699+0000", 2024-09-12T22:33:31.724 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8010000000000003e-06 2024-09-12T22:33:31.724 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.724 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.724 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:31.724 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.427136+0000", 2024-09-12T22:33:31.724 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.04043712 2024-09-12T22:33:31.724 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.724 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.724 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:31.725 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.427185+0000", 2024-09-12T22:33:31.725 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9493999999999997e-05 2024-09-12T22:33:31.725 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.725 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.725 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:31.725 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.428988+0000", 2024-09-12T22:33:31.725 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001803191 2024-09-12T22:33:31.725 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.725 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.725 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:31.725 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.429015+0000", 2024-09-12T22:33:31.725 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.6438999999999999e-05 2024-09-12T22:33:31.725 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.726 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.726 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:31.726 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.429050+0000", 2024-09-12T22:33:31.726 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.5070000000000001e-05 2024-09-12T22:33:31.726 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:31.726 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:31.726 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:31.726 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.726 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.726 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3064 3.2 3:42569fed:::200.00000011:head [write 3916704~1398 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:33:31.726 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:19.386705+0000", 2024-09-12T22:33:31.726 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 12.289191507, 2024-09-12T22:33:31.726 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.043238378000000001, 2024-09-12T22:33:31.727 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:31.727 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:31.727 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:31.727 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:31.727 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.727 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:31.727 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386705+0000", 2024-09-12T22:33:31.727 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:31.727 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.727 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.727 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:31.727 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386705+0000", 2024-09-12T22:33:31.727 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:31.727 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.728 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.728 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:31.728 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386705+0000", 2024-09-12T22:33:31.728 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.8299999999999998e-07 2024-09-12T22:33:31.728 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.728 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.728 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:31.728 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386711+0000", 2024-09-12T22:33:31.728 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7080000000000002e-06 2024-09-12T22:33:31.728 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.728 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.728 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:31.729 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386717+0000", 2024-09-12T22:33:31.729 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.3990000000000001e-06 2024-09-12T22:33:31.729 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.729 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.729 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:31.729 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386722+0000", 2024-09-12T22:33:31.729 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9219999999999996e-06 2024-09-12T22:33:31.729 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.729 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.729 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:31.729 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.427585+0000", 2024-09-12T22:33:31.729 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.040863414000000001 2024-09-12T22:33:31.729 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.729 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.730 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:31.730 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.427628+0000", 2024-09-12T22:33:31.730 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2873000000000001e-05 2024-09-12T22:33:31.730 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.730 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.730 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:31.730 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.429871+0000", 2024-09-12T22:33:31.730 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.002242572 2024-09-12T22:33:31.730 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.730 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.730 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:31.730 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.429901+0000", 2024-09-12T22:33:31.730 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0114e-05 2024-09-12T22:33:31.731 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.731 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.731 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:31.731 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.429943+0000", 2024-09-12T22:33:31.731 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1993000000000003e-05 2024-09-12T22:33:31.731 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:31.731 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:31.731 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:31.731 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.731 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.731 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3065 3.2 3:42569fed:::200.00000011:head [write 3918102~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:33:31.731 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:19.386735+0000", 2024-09-12T22:33:31.731 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 12.2891613, 2024-09-12T22:33:31.731 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.043278369999999997, 2024-09-12T22:33:31.732 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:31.732 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:31.732 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:31.732 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:31.732 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.732 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:31.732 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386735+0000", 2024-09-12T22:33:31.732 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:31.732 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.732 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.732 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:31.732 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386735+0000", 2024-09-12T22:33:31.732 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:31.733 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.733 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.733 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:31.733 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386735+0000", 2024-09-12T22:33:31.733 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.7300000000000001e-07 2024-09-12T22:33:31.733 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.733 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.733 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:31.733 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386738+0000", 2024-09-12T22:33:31.733 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8420000000000001e-06 2024-09-12T22:33:31.733 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.733 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.733 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:31.733 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386744+0000", 2024-09-12T22:33:31.734 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.3040000000000001e-06 2024-09-12T22:33:31.734 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.734 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.734 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:31.734 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386749+0000", 2024-09-12T22:33:31.734 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8409999999999999e-06 2024-09-12T22:33:31.734 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.734 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.734 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:31.734 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.428112+0000", 2024-09-12T22:33:31.734 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.041363204000000001 2024-09-12T22:33:31.734 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.734 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.735 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:31.735 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.428158+0000", 2024-09-12T22:33:31.735 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5756e-05 2024-09-12T22:33:31.735 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.735 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.735 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:31.735 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.429950+0000", 2024-09-12T22:33:31.735 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0017922859999999999 2024-09-12T22:33:31.735 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.735 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.735 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:31.735 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.429975+0000", 2024-09-12T22:33:31.735 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4640000000000001e-05 2024-09-12T22:33:31.735 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.736 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.736 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:31.736 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.430013+0000", 2024-09-12T22:33:31.736 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.8024000000000001e-05 2024-09-12T22:33:31.736 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:31.736 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:31.736 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:31.736 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.736 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.736 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3066 3.2 3:42569fed:::200.00000011:head [write 3919501~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:33:31.736 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:19.386755+0000", 2024-09-12T22:33:31.736 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 12.289140658999999, 2024-09-12T22:33:31.736 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.044668934, 2024-09-12T22:33:31.737 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:31.737 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:31.737 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:31.737 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:31.737 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.737 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:31.737 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386755+0000", 2024-09-12T22:33:31.737 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:31.737 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.737 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.737 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:31.737 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386755+0000", 2024-09-12T22:33:31.737 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:31.738 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.738 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.738 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:31.738 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386756+0000", 2024-09-12T22:33:31.738 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4499999999999997e-07 2024-09-12T22:33:31.738 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.738 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.738 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:31.738 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386763+0000", 2024-09-12T22:33:31.738 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.6459999999999993e-06 2024-09-12T22:33:31.738 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.738 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.738 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:31.738 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386770+0000", 2024-09-12T22:33:31.739 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.19e-06 2024-09-12T22:33:31.739 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.739 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.739 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:31.739 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386775+0000", 2024-09-12T22:33:31.739 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9640000000000002e-06 2024-09-12T22:33:31.739 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.739 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.739 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:31.739 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.428489+0000", 2024-09-12T22:33:31.739 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.041714539000000002 2024-09-12T22:33:31.739 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.739 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.740 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:31.740 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.428535+0000", 2024-09-12T22:33:31.740 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5658999999999998e-05 2024-09-12T22:33:31.740 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.740 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.740 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:31.740 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.431353+0000", 2024-09-12T22:33:31.740 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0028186270000000002 2024-09-12T22:33:31.740 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.740 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.740 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:31.740 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.431385+0000", 2024-09-12T22:33:31.740 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.1374000000000001e-05 2024-09-12T22:33:31.741 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.741 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.741 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:31.741 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.431424+0000", 2024-09-12T22:33:31.741 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9490000000000003e-05 2024-09-12T22:33:31.741 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:31.741 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:31.741 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:31.741 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.741 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.741 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3067 3.2 3:42569fed:::200.00000011:head [write 3920900~2245 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:33:31.741 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:19.386781+0000", 2024-09-12T22:33:31.741 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 12.289114769999999, 2024-09-12T22:33:31.741 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.044711322999999997, 2024-09-12T22:33:31.742 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:31.742 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:31.742 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:31.742 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:31.742 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.742 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:31.742 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386781+0000", 2024-09-12T22:33:31.742 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:31.742 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.742 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.742 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:31.742 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386781+0000", 2024-09-12T22:33:31.742 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:31.743 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.743 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.743 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:31.743 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386782+0000", 2024-09-12T22:33:31.743 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9900000000000001e-07 2024-09-12T22:33:31.743 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.743 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.743 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:31.743 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386795+0000", 2024-09-12T22:33:31.743 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2864000000000001e-05 2024-09-12T22:33:31.743 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.743 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.743 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:31.743 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386801+0000", 2024-09-12T22:33:31.744 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.3589999999999996e-06 2024-09-12T22:33:31.744 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.744 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.744 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:31.744 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386805+0000", 2024-09-12T22:33:31.744 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6190000000000002e-06 2024-09-12T22:33:31.744 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.744 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.744 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:31.744 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.429080+0000", 2024-09-12T22:33:31.744 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.042274027999999998 2024-09-12T22:33:31.744 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.744 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.745 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:31.745 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.429131+0000", 2024-09-12T22:33:31.745 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1715000000000002e-05 2024-09-12T22:33:31.745 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.745 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.745 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:31.745 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.431432+0000", 2024-09-12T22:33:31.745 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0023007489999999999 2024-09-12T22:33:31.745 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.745 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.745 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:31.745 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.431458+0000", 2024-09-12T22:33:31.745 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.603e-05 2024-09-12T22:33:31.745 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.746 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.746 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:31.746 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.431493+0000", 2024-09-12T22:33:31.746 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4560000000000001e-05 2024-09-12T22:33:31.746 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:31.746 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:31.746 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:31.746 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.746 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.746 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3068 3.2 3:42569fed:::200.00000011:head [write 3923145~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:33:31.746 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:19.386812+0000", 2024-09-12T22:33:31.746 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 12.289084011, 2024-09-12T22:33:31.746 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.045559559999999999, 2024-09-12T22:33:31.747 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:31.747 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:31.747 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:31.747 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:31.747 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.747 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:31.747 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386812+0000", 2024-09-12T22:33:31.747 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:31.747 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.747 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.747 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:31.747 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386812+0000", 2024-09-12T22:33:31.747 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:31.747 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.748 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.748 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:31.748 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386812+0000", 2024-09-12T22:33:31.748 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.01e-07 2024-09-12T22:33:31.748 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.748 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.748 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:31.748 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386823+0000", 2024-09-12T22:33:31.748 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1038e-05 2024-09-12T22:33:31.748 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.748 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.748 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:31.748 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386830+0000", 2024-09-12T22:33:31.749 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.5409999999999997e-06 2024-09-12T22:33:31.749 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.749 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.749 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:31.749 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386835+0000", 2024-09-12T22:33:31.749 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.091e-06 2024-09-12T22:33:31.749 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.749 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.749 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:31.749 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.429460+0000", 2024-09-12T22:33:31.749 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.042625333000000001 2024-09-12T22:33:31.749 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.749 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.750 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:31.750 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.429506+0000", 2024-09-12T22:33:31.750 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5299000000000001e-05 2024-09-12T22:33:31.750 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.750 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.750 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:31.750 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.432283+0000", 2024-09-12T22:33:31.750 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0027776799999999998 2024-09-12T22:33:31.750 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.750 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.750 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:31.750 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.432315+0000", 2024-09-12T22:33:31.750 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.1401e-05 2024-09-12T22:33:31.751 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.751 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.751 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:31.751 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.432372+0000", 2024-09-12T22:33:31.751 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.6776e-05 2024-09-12T22:33:31.751 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:31.751 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:31.751 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:31.751 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.751 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.751 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3069 3.2 3:42569fed:::200.00000011:head [write 3924544~2246 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:33:31.751 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:19.386842+0000", 2024-09-12T22:33:31.751 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 12.289054111, 2024-09-12T22:33:31.752 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.045596166, 2024-09-12T22:33:31.752 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:31.752 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:31.752 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:31.752 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:31.752 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.752 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:31.752 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386842+0000", 2024-09-12T22:33:31.752 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:31.752 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.752 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.752 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:31.752 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386842+0000", 2024-09-12T22:33:31.752 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:31.753 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.753 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.753 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:31.753 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386842+0000", 2024-09-12T22:33:31.753 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5200000000000002e-07 2024-09-12T22:33:31.753 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.753 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.753 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:31.753 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386845+0000", 2024-09-12T22:33:31.753 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8820000000000001e-06 2024-09-12T22:33:31.753 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.753 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.753 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:31.754 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386851+0000", 2024-09-12T22:33:31.754 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9540000000000001e-06 2024-09-12T22:33:31.754 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.754 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.754 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:31.754 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386856+0000", 2024-09-12T22:33:31.754 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5159999999999996e-06 2024-09-12T22:33:31.754 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.754 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.754 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:31.754 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.430043+0000", 2024-09-12T22:33:31.754 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.043186930999999998 2024-09-12T22:33:31.754 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.755 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.755 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:31.755 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.430086+0000", 2024-09-12T22:33:31.755 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3844999999999998e-05 2024-09-12T22:33:31.755 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.755 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.755 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:31.755 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.432379+0000", 2024-09-12T22:33:31.755 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0022922049999999999 2024-09-12T22:33:31.755 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.755 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.755 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:31.755 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.432405+0000", 2024-09-12T22:33:31.755 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5877999999999999e-05 2024-09-12T22:33:31.755 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.756 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.756 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:31.756 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.432438+0000", 2024-09-12T22:33:31.756 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3503000000000001e-05 2024-09-12T22:33:31.756 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:31.756 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:31.756 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:31.756 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.756 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.756 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3070 3.2 3:42569fed:::200.00000011:head [write 3926790~2768 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:33:31.756 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:19.387280+0000", 2024-09-12T22:33:31.756 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 12.288615943, 2024-09-12T22:33:31.756 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.04692201, 2024-09-12T22:33:31.757 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:31.757 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:31.757 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:31.757 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:31.757 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.757 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:31.757 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.387280+0000", 2024-09-12T22:33:31.757 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:31.757 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.757 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.757 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:31.757 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.387280+0000", 2024-09-12T22:33:31.757 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:31.757 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.758 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.758 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:31.758 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.387281+0000", 2024-09-12T22:33:31.758 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4300000000000002e-07 2024-09-12T22:33:31.758 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.758 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.758 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:31.758 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.387285+0000", 2024-09-12T22:33:31.758 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2570000000000001e-06 2024-09-12T22:33:31.758 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.758 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.758 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:31.759 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.387293+0000", 2024-09-12T22:33:31.759 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0209999999999999e-06 2024-09-12T22:33:31.759 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.759 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.759 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:31.759 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.387299+0000", 2024-09-12T22:33:31.759 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.6930000000000004e-06 2024-09-12T22:33:31.759 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.759 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.759 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:31.759 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.430441+0000", 2024-09-12T22:33:31.759 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.043141789999999999 2024-09-12T22:33:31.759 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.759 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.760 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:31.760 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.430484+0000", 2024-09-12T22:33:31.760 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3745000000000002e-05 2024-09-12T22:33:31.760 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.760 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.760 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:31.760 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.434132+0000", 2024-09-12T22:33:31.760 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00364818 2024-09-12T22:33:31.760 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.760 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.760 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:31.760 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.434163+0000", 2024-09-12T22:33:31.760 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0599000000000003e-05 2024-09-12T22:33:31.761 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.761 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.761 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:31.761 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.434202+0000", 2024-09-12T22:33:31.761 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.8982e-05 2024-09-12T22:33:31.761 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:31.761 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:31.761 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:31.761 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.761 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.761 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3071 3.2 3:42569fed:::200.00000011:head [write 3929558~3203 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:33:31.761 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:19.387860+0000", 2024-09-12T22:33:31.761 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 12.288035913, 2024-09-12T22:33:31.761 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.049590902999999999, 2024-09-12T22:33:31.762 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:31.762 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:31.762 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:31.762 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:31.762 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.762 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:31.762 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.387860+0000", 2024-09-12T22:33:31.762 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:31.762 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.762 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.762 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:31.762 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.387860+0000", 2024-09-12T22:33:31.762 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:31.763 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.763 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.763 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:31.763 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.387861+0000", 2024-09-12T22:33:31.763 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5099999999999999e-07 2024-09-12T22:33:31.763 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.763 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.763 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:31.763 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.387865+0000", 2024-09-12T22:33:31.763 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2629999999999997e-06 2024-09-12T22:33:31.763 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.763 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.763 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:31.764 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.387875+0000", 2024-09-12T22:33:31.764 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0256e-05 2024-09-12T22:33:31.764 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.764 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.764 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:31.764 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.387881+0000", 2024-09-12T22:33:31.764 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.947e-06 2024-09-12T22:33:31.764 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.764 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.764 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:31.764 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.430930+0000", 2024-09-12T22:33:31.764 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.043048386000000001 2024-09-12T22:33:31.764 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.765 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.765 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:31.765 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.430976+0000", 2024-09-12T22:33:31.765 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6408e-05 2024-09-12T22:33:31.765 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.765 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.765 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:31.765 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.437377+0000", 2024-09-12T22:33:31.765 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0064010719999999998 2024-09-12T22:33:31.765 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.765 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.765 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:31.765 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.437409+0000", 2024-09-12T22:33:31.765 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2054999999999997e-05 2024-09-12T22:33:31.766 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.766 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.766 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:31.766 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.437451+0000", 2024-09-12T22:33:31.766 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1764999999999997e-05 2024-09-12T22:33:31.766 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:31.766 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:31.766 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:31.766 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.766 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.766 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3072 3.2 3:42569fed:::200.00000011:head [write 3932761~2786 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:33:31.766 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:19.388005+0000", 2024-09-12T22:33:31.766 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 12.287890814000001, 2024-09-12T22:33:31.767 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.049514177999999999, 2024-09-12T22:33:31.767 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:31.767 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:31.767 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:31.767 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:31.767 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.767 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:31.767 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.388005+0000", 2024-09-12T22:33:31.767 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:31.767 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.767 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.767 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:31.767 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.388005+0000", 2024-09-12T22:33:31.767 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:31.768 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.768 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.768 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:31.768 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.388006+0000", 2024-09-12T22:33:31.768 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.1799999999999995e-07 2024-09-12T22:33:31.768 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.768 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.768 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:31.768 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.388009+0000", 2024-09-12T22:33:31.768 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.574e-06 2024-09-12T22:33:31.768 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.768 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.768 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:31.769 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.388017+0000", 2024-09-12T22:33:31.769 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3170000000000004e-06 2024-09-12T22:33:31.769 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.769 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.769 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:31.769 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.388022+0000", 2024-09-12T22:33:31.769 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9910000000000002e-06 2024-09-12T22:33:31.769 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.769 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.769 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:31.769 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.431522+0000", 2024-09-12T22:33:31.769 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0435001 2024-09-12T22:33:31.769 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.769 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.770 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:31.770 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.431567+0000", 2024-09-12T22:33:31.770 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4734000000000002e-05 2024-09-12T22:33:31.770 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.770 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.770 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:31.770 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.437458+0000", 2024-09-12T22:33:31.770 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00589166 2024-09-12T22:33:31.770 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.770 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.770 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:31.770 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.437484+0000", 2024-09-12T22:33:31.770 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5622999999999998e-05 2024-09-12T22:33:31.771 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.771 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.771 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:31.771 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.437519+0000", 2024-09-12T22:33:31.771 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.5561000000000001e-05 2024-09-12T22:33:31.771 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:31.771 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:31.771 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:31.771 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.771 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.771 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3073 3.2 3:42569fed:::200.00000011:head [write 3935547~1924 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:33:31.771 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:19.389181+0000", 2024-09-12T22:33:31.771 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 12.286714652000001, 2024-09-12T22:33:31.771 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.048402300000000002, 2024-09-12T22:33:31.772 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:31.772 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:31.772 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:31.772 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:31.772 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.772 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:31.772 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.389181+0000", 2024-09-12T22:33:31.772 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:31.772 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.772 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.772 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:31.772 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.389181+0000", 2024-09-12T22:33:31.772 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:31.772 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.773 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.773 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:31.773 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.389182+0000", 2024-09-12T22:33:31.773 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7700000000000004e-07 2024-09-12T22:33:31.773 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.773 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.773 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:31.773 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.389191+0000", 2024-09-12T22:33:31.773 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1120000000000002e-06 2024-09-12T22:33:31.773 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.773 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.773 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:31.774 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.389203+0000", 2024-09-12T22:33:31.774 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.146e-05 2024-09-12T22:33:31.774 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.774 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.774 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:31.774 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.389209+0000", 2024-09-12T22:33:31.774 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9989999999999997e-06 2024-09-12T22:33:31.774 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.774 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.774 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:31.774 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.431890+0000", 2024-09-12T22:33:31.774 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.042681251000000003 2024-09-12T22:33:31.774 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.774 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.775 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:31.775 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.431935+0000", 2024-09-12T22:33:31.775 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5166000000000001e-05 2024-09-12T22:33:31.775 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.775 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.775 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:31.775 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.437526+0000", 2024-09-12T22:33:31.775 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0055910489999999998 2024-09-12T22:33:31.775 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.775 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.775 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:31.775 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.437550+0000", 2024-09-12T22:33:31.775 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4134999999999998e-05 2024-09-12T22:33:31.776 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.776 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.776 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:31.776 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.437584+0000", 2024-09-12T22:33:31.776 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3451000000000002e-05 2024-09-12T22:33:31.776 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:31.776 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:31.776 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:31.776 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.776 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.776 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3074 3.2 3:42569fed:::200.00000011:head [write 3937471~7660 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:33:31.776 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:19.390512+0000", 2024-09-12T22:33:31.776 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 12.285383529000001, 2024-09-12T22:33:31.777 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.047134045999999999, 2024-09-12T22:33:31.777 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:31.777 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:31.777 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:31.777 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:31.777 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.777 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:31.777 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.390512+0000", 2024-09-12T22:33:31.777 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:31.777 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.777 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.777 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:31.777 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.390512+0000", 2024-09-12T22:33:31.777 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:31.778 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.778 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.778 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:31.778 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.390513+0000", 2024-09-12T22:33:31.778 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.7699999999999992e-07 2024-09-12T22:33:31.778 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.778 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.778 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:31.778 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.390522+0000", 2024-09-12T22:33:31.778 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0390000000000005e-06 2024-09-12T22:33:31.778 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.778 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.778 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:31.778 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.390530+0000", 2024-09-12T22:33:31.779 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.8349999999999993e-06 2024-09-12T22:33:31.779 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.779 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.779 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:31.779 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.390537+0000", 2024-09-12T22:33:31.779 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.1850000000000001e-06 2024-09-12T22:33:31.779 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.779 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.779 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:31.779 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.432468+0000", 2024-09-12T22:33:31.779 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.041931883000000003 2024-09-12T22:33:31.779 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.779 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.780 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:31.780 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.432512+0000", 2024-09-12T22:33:31.780 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4054999999999997e-05 2024-09-12T22:33:31.780 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.780 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.780 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:31.780 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.437590+0000", 2024-09-12T22:33:31.780 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0050777230000000001 2024-09-12T22:33:31.780 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.780 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.780 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:31.780 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.437613+0000", 2024-09-12T22:33:31.780 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.2693000000000001e-05 2024-09-12T22:33:31.781 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:31.781 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:31.781 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:31.781 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.437647+0000", 2024-09-12T22:33:31.781 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3655999999999998e-05 2024-09-12T22:33:31.781 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:31.781 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:31.781 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:31.781 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:31.781 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:31.781 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:33:31.783 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:33:31.783 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:31.781+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:31.883 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:31.882+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:31.886 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-09-12T22:33:31.887 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-09-12T22:33:31.887 INFO:teuthology.orchestra.run.smithi163.stdout: "num_ops": 0 2024-09-12T22:33:31.887 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-09-12T22:33:31.895 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:33:31.984 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:31.983+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:32.037 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-09-12T22:33:32.037 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-09-12T22:33:32.037 INFO:teuthology.orchestra.run.smithi163.stdout: "complaint_time": 30, 2024-09-12T22:33:32.037 INFO:teuthology.orchestra.run.smithi163.stdout: "num_blocked_ops": 0 2024-09-12T22:33:32.037 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-09-12T22:33:32.045 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:33:32.085 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:32.084+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:32.150 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-09-12T22:33:32.150 INFO:teuthology.orchestra.run.smithi163.stdout: "size": 20, 2024-09-12T22:33:32.150 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 600, 2024-09-12T22:33:32.150 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2024-09-12T22:33:32.150 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.150 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-09-12T22:33:32.150 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:27.254459+0000", 2024-09-12T22:33:32.150 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 124.89309622, 2024-09-12T22:33:32.150 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.37816283899999997, 2024-09-12T22:33:32.150 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:32.150 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:32.150 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:32.151 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:32.151 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:33:32.151 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:33:32.151 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 1 2024-09-12T22:33:32.151 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.151 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:32.151 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.151 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:32.151 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254459+0000", 2024-09-12T22:33:32.151 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:32.151 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.151 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.151 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:32.151 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254459+0000", 2024-09-12T22:33:32.152 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:32.152 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.152 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.152 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:32.152 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254460+0000", 2024-09-12T22:33:32.152 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1739999999999999e-06 2024-09-12T22:33:32.152 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.152 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.152 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:32.152 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254472+0000", 2024-09-12T22:33:32.152 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2207e-05 2024-09-12T22:33:32.152 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.152 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.152 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:32.153 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254483+0000", 2024-09-12T22:33:32.153 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0631999999999999e-05 2024-09-12T22:33:32.153 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.153 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.153 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:32.153 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254492+0000", 2024-09-12T22:33:32.153 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3670000000000003e-06 2024-09-12T22:33:32.153 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.153 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.153 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:32.153 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254551+0000", 2024-09-12T22:33:32.153 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8687999999999998e-05 2024-09-12T22:33:32.153 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.153 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.154 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for peered", 2024-09-12T22:33:32.154 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254562+0000", 2024-09-12T22:33:32.154 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1249e-05 2024-09-12T22:33:32.154 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.154 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.154 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:32.154 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.631211+0000", 2024-09-12T22:33:32.154 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.376649018 2024-09-12T22:33:32.154 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.154 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.154 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:32.154 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.631345+0000", 2024-09-12T22:33:32.154 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013378700000000001 2024-09-12T22:33:32.155 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.155 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.155 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:33:32.155 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.631479+0000", 2024-09-12T22:33:32.155 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013352399999999999 2024-09-12T22:33:32.155 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.155 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.155 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:32.155 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632324+0000", 2024-09-12T22:33:32.155 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00084508100000000002 2024-09-12T22:33:32.155 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.155 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.155 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:32.155 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632548+0000", 2024-09-12T22:33:32.155 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000224329 2024-09-12T22:33:32.156 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.156 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.156 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:32.156 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632591+0000", 2024-09-12T22:33:32.156 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2564000000000001e-05 2024-09-12T22:33:32.156 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.156 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.156 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:32.156 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632622+0000", 2024-09-12T22:33:32.156 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1219e-05 2024-09-12T22:33:32.156 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:32.156 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:32.156 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:32.156 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.157 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.157 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4490.0:9871 4.35 4:ad66404a:::10000002d4d.00000000:head [write 0~6507] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:33:32.157 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:09.472309+0000", 2024-09-12T22:33:32.157 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 22.675245944, 2024-09-12T22:33:32.157 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.080251445000000005, 2024-09-12T22:33:32.157 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:32.157 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:32.157 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:32.157 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:32.157 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4490", 2024-09-12T22:33:32.157 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:32.157 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 9871 2024-09-12T22:33:32.157 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.158 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:32.158 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.158 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:32.158 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.472309+0000", 2024-09-12T22:33:32.158 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:32.158 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.158 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.158 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:32.158 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.472309+0000", 2024-09-12T22:33:32.158 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:32.158 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.158 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.158 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:32.158 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.472310+0000", 2024-09-12T22:33:32.158 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3799999999999996e-07 2024-09-12T22:33:32.159 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.159 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.159 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:32.159 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.472318+0000", 2024-09-12T22:33:32.159 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.8099999999999998e-06 2024-09-12T22:33:32.159 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.159 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.159 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:32.159 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.472328+0000", 2024-09-12T22:33:32.159 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0359e-05 2024-09-12T22:33:32.159 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.159 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.159 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:32.160 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.472334+0000", 2024-09-12T22:33:32.160 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.0109999999999997e-06 2024-09-12T22:33:32.160 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.160 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.160 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:32.160 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.472382+0000", 2024-09-12T22:33:32.160 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.7311000000000002e-05 2024-09-12T22:33:32.160 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.160 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.160 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:32.160 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.472497+0000", 2024-09-12T22:33:32.160 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011537800000000001 2024-09-12T22:33:32.160 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.161 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.161 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:32.161 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.472617+0000", 2024-09-12T22:33:32.161 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011989600000000001 2024-09-12T22:33:32.161 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.161 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.161 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:32.161 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473149+0000", 2024-09-12T22:33:32.161 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00053227999999999999 2024-09-12T22:33:32.161 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.161 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.161 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:32.161 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.552479+0000", 2024-09-12T22:33:32.161 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.079329541000000003 2024-09-12T22:33:32.162 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.162 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.162 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:32.162 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.552525+0000", 2024-09-12T22:33:32.162 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6421000000000002e-05 2024-09-12T22:33:32.162 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.162 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.162 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:32.162 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.552561+0000", 2024-09-12T22:33:32.162 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5599999999999998e-05 2024-09-12T22:33:32.162 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:32.162 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:32.162 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:32.162 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.163 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.163 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4490.0:9872 4.2c 4:3602c8d3:::10000002d4e.00000000:head [write 0~1178] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:33:32.163 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:09.473085+0000", 2024-09-12T22:33:32.163 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 22.674470639999999, 2024-09-12T22:33:32.163 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.079631104999999994, 2024-09-12T22:33:32.163 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:32.163 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:32.163 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:32.163 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:32.163 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4490", 2024-09-12T22:33:32.163 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:32.163 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 9872 2024-09-12T22:33:32.163 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.163 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:32.164 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.164 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:32.164 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473085+0000", 2024-09-12T22:33:32.164 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:32.164 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.164 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.164 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:32.164 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473085+0000", 2024-09-12T22:33:32.164 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:32.164 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.164 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.164 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:32.165 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473085+0000", 2024-09-12T22:33:32.165 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3600000000000004e-07 2024-09-12T22:33:32.165 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.165 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.165 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:32.165 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473088+0000", 2024-09-12T22:33:32.165 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.005e-06 2024-09-12T22:33:32.165 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.165 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.165 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:32.165 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473095+0000", 2024-09-12T22:33:32.166 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3950000000000003e-06 2024-09-12T22:33:32.166 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.166 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.166 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:32.166 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473100+0000", 2024-09-12T22:33:32.166 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5460000000000002e-06 2024-09-12T22:33:32.166 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.166 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.166 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:32.166 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473138+0000", 2024-09-12T22:33:32.166 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8244999999999997e-05 2024-09-12T22:33:32.166 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.166 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.166 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:32.167 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473216+0000", 2024-09-12T22:33:32.167 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.7756000000000006e-05 2024-09-12T22:33:32.167 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.167 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.167 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:32.167 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473291+0000", 2024-09-12T22:33:32.167 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5110000000000004e-05 2024-09-12T22:33:32.167 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.167 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.167 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:32.167 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473736+0000", 2024-09-12T22:33:32.167 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00044486500000000002 2024-09-12T22:33:32.167 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.168 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.168 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:32.168 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.552637+0000", 2024-09-12T22:33:32.168 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.078900782000000003 2024-09-12T22:33:32.168 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.168 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.168 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:32.168 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.552680+0000", 2024-09-12T22:33:32.168 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3047999999999998e-05 2024-09-12T22:33:32.168 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.168 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.168 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:32.168 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.552716+0000", 2024-09-12T22:33:32.168 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5816999999999999e-05 2024-09-12T22:33:32.169 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:32.169 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:32.169 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:32.169 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.169 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.169 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4490.0:9873 4.2c 4:372c52ff:::10000002d4f.00000000:head [write 0~1230] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:33:32.169 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:09.473878+0000", 2024-09-12T22:33:32.169 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 22.673677176999998, 2024-09-12T22:33:32.169 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.079036047999999998, 2024-09-12T22:33:32.169 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:32.169 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:32.169 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:32.169 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:32.169 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4490", 2024-09-12T22:33:32.170 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:32.170 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 9873 2024-09-12T22:33:32.170 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.170 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:32.170 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.170 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:32.170 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473878+0000", 2024-09-12T22:33:32.170 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:32.170 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.170 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.170 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:32.170 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473878+0000", 2024-09-12T22:33:32.170 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:32.171 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.171 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.171 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:32.171 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473879+0000", 2024-09-12T22:33:32.171 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9100000000000004e-07 2024-09-12T22:33:32.171 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.171 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.171 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:32.171 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473882+0000", 2024-09-12T22:33:32.171 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.405e-06 2024-09-12T22:33:32.171 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.171 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.171 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:32.171 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473889+0000", 2024-09-12T22:33:32.172 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7519999999999999e-06 2024-09-12T22:33:32.172 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.172 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.172 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:32.172 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473893+0000", 2024-09-12T22:33:32.172 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9310000000000001e-06 2024-09-12T22:33:32.172 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.172 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.172 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:32.172 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473922+0000", 2024-09-12T22:33:32.172 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9346999999999999e-05 2024-09-12T22:33:32.172 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.172 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.172 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:32.173 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474000+0000", 2024-09-12T22:33:32.173 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.7972000000000005e-05 2024-09-12T22:33:32.173 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.173 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.173 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:32.173 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474072+0000", 2024-09-12T22:33:32.173 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1960999999999998e-05 2024-09-12T22:33:32.173 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.173 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.173 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:32.173 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474470+0000", 2024-09-12T22:33:32.173 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00039803400000000002 2024-09-12T22:33:32.173 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.173 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.174 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:32.174 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.552814+0000", 2024-09-12T22:33:32.174 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.078344164999999993 2024-09-12T22:33:32.174 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.174 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.174 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:32.174 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.552875+0000", 2024-09-12T22:33:32.174 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1008999999999998e-05 2024-09-12T22:33:32.174 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.174 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.174 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:32.174 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.552914+0000", 2024-09-12T22:33:32.174 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8881000000000003e-05 2024-09-12T22:33:32.174 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:32.175 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:32.175 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:32.175 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.175 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.175 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4490.0:9874 4.1b 4:db19d96a:::10000002d50.00000000:head [write 0~1088] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:33:32.175 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:09.474673+0000", 2024-09-12T22:33:32.175 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 22.672882183999999, 2024-09-12T22:33:32.175 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.080314317999999996, 2024-09-12T22:33:32.175 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:32.175 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:32.175 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:32.175 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:32.175 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4490", 2024-09-12T22:33:32.176 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:32.176 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 9874 2024-09-12T22:33:32.176 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.176 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:32.176 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.176 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:32.176 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474673+0000", 2024-09-12T22:33:32.176 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:32.176 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.176 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.176 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:32.176 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474673+0000", 2024-09-12T22:33:32.176 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:32.176 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.177 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.177 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:32.177 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474674+0000", 2024-09-12T22:33:32.177 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6199999999999998e-07 2024-09-12T22:33:32.177 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.177 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.177 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:32.177 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474677+0000", 2024-09-12T22:33:32.177 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.224e-06 2024-09-12T22:33:32.177 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.177 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.177 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:32.177 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474683+0000", 2024-09-12T22:33:32.178 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.3160000000000002e-06 2024-09-12T22:33:32.178 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.178 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.178 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:32.178 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474687+0000", 2024-09-12T22:33:32.178 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7869999999999999e-06 2024-09-12T22:33:32.178 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.178 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.178 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:32.178 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474730+0000", 2024-09-12T22:33:32.178 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3309000000000002e-05 2024-09-12T22:33:32.178 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.178 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.178 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:32.179 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474845+0000", 2024-09-12T22:33:32.179 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114306 2024-09-12T22:33:32.179 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.179 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.179 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:32.179 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474970+0000", 2024-09-12T22:33:32.179 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000125096 2024-09-12T22:33:32.179 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.179 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.179 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:32.179 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.475621+0000", 2024-09-12T22:33:32.179 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00065124900000000001 2024-09-12T22:33:32.179 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.179 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.180 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:32.180 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.554885+0000", 2024-09-12T22:33:32.180 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.079264055 2024-09-12T22:33:32.180 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.180 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.180 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:32.180 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.554942+0000", 2024-09-12T22:33:32.180 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7284000000000002e-05 2024-09-12T22:33:32.180 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.180 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.180 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:32.180 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.554987+0000", 2024-09-12T22:33:32.180 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5130000000000003e-05 2024-09-12T22:33:32.181 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:32.181 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:32.181 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:32.181 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.181 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.181 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4490.0:12220 4.2b 4:d55bfd66:::10000003169.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-12T22:33:32.181 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.391333+0000", 2024-09-12T22:33:32.181 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 17.756222041000001, 2024-09-12T22:33:32.181 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.088669550999999999, 2024-09-12T22:33:32.181 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:32.181 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:32.181 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:32.181 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:32.181 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4490", 2024-09-12T22:33:32.182 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:32.182 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 12220 2024-09-12T22:33:32.182 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.182 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:32.182 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.182 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:32.182 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.391333+0000", 2024-09-12T22:33:32.182 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:32.182 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.182 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.182 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:32.182 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.391333+0000", 2024-09-12T22:33:32.182 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:32.183 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.183 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.183 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:32.183 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.391334+0000", 2024-09-12T22:33:32.183 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3099999999999997e-07 2024-09-12T22:33:32.183 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.183 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.183 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:32.183 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398373+0000", 2024-09-12T22:33:32.183 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0070386670000000002 2024-09-12T22:33:32.183 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.183 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.183 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:32.183 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398384+0000", 2024-09-12T22:33:32.184 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1338999999999999e-05 2024-09-12T22:33:32.184 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.184 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.184 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:32.184 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398389+0000", 2024-09-12T22:33:32.184 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3650000000000003e-06 2024-09-12T22:33:32.184 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.184 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.184 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:32.184 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.456308+0000", 2024-09-12T22:33:32.184 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.057918931 2024-09-12T22:33:32.184 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.184 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.185 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:32.185 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.456425+0000", 2024-09-12T22:33:32.185 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000116452 2024-09-12T22:33:32.185 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.185 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.185 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:32.185 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.456536+0000", 2024-09-12T22:33:32.185 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000111839 2024-09-12T22:33:32.185 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.185 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.185 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:32.185 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.465335+0000", 2024-09-12T22:33:32.185 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0087984980000000001 2024-09-12T22:33:32.185 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.186 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.186 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:32.186 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.479950+0000", 2024-09-12T22:33:32.186 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.01461552 2024-09-12T22:33:32.186 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.186 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.186 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:32.186 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.479983+0000", 2024-09-12T22:33:32.186 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2126999999999999e-05 2024-09-12T22:33:32.186 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.186 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.186 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:32.186 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.480003+0000", 2024-09-12T22:33:32.187 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0081999999999998e-05 2024-09-12T22:33:32.187 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:32.187 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:32.187 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:32.187 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.187 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.187 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1208 3.13 3:cb3d3880:::200.0000000d:head [write 1009846~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:32.187 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.398459+0000", 2024-09-12T22:33:32.187 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 17.749096475000002, 2024-09-12T22:33:32.187 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.078093931000000005, 2024-09-12T22:33:32.187 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:32.187 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:32.187 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:32.188 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:32.188 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.188 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:32.188 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398459+0000", 2024-09-12T22:33:32.188 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:32.188 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.188 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.188 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:32.188 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398459+0000", 2024-09-12T22:33:32.188 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:32.188 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.188 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.188 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:32.189 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398459+0000", 2024-09-12T22:33:32.189 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8100000000000003e-07 2024-09-12T22:33:32.189 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.189 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.189 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:32.189 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398462+0000", 2024-09-12T22:33:32.189 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3700000000000002e-06 2024-09-12T22:33:32.189 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.189 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.189 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:32.189 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398469+0000", 2024-09-12T22:33:32.189 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2320000000000004e-06 2024-09-12T22:33:32.189 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.189 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.190 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:32.190 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398472+0000", 2024-09-12T22:33:32.190 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.658e-06 2024-09-12T22:33:32.190 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.190 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.190 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:32.190 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.456690+0000", 2024-09-12T22:33:32.190 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.058217615 2024-09-12T22:33:32.190 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.190 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.190 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:32.190 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.456731+0000", 2024-09-12T22:33:32.190 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0815000000000001e-05 2024-09-12T22:33:32.190 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.191 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.191 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:32.191 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.456793+0000", 2024-09-12T22:33:32.191 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1796000000000003e-05 2024-09-12T22:33:32.191 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.191 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.191 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:32.191 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.461412+0000", 2024-09-12T22:33:32.191 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0046188560000000002 2024-09-12T22:33:32.191 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.191 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.191 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:32.191 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476429+0000", 2024-09-12T22:33:32.191 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.015017943000000001 2024-09-12T22:33:32.192 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.192 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.192 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:32.192 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476499+0000", 2024-09-12T22:33:32.192 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9047000000000005e-05 2024-09-12T22:33:32.192 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.192 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.192 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:32.192 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476553+0000", 2024-09-12T22:33:32.192 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4117999999999999e-05 2024-09-12T22:33:32.192 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:32.192 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:32.192 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:32.192 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.193 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.193 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1209 3.13 3:cb3d3880:::200.0000000d:head [write 1011245~5867 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:32.193 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.398677+0000", 2024-09-12T22:33:32.193 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 17.748877918000002, 2024-09-12T22:33:32.193 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.077995698000000002, 2024-09-12T22:33:32.193 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:32.193 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:32.193 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:32.193 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:32.193 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.193 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:32.193 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398677+0000", 2024-09-12T22:33:32.193 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:32.193 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.194 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.194 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:32.194 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398677+0000", 2024-09-12T22:33:32.194 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:32.194 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.194 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.194 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:32.194 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398678+0000", 2024-09-12T22:33:32.194 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5199999999999995e-07 2024-09-12T22:33:32.194 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.194 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.194 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:32.195 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398686+0000", 2024-09-12T22:33:32.195 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0579999999999998e-06 2024-09-12T22:33:32.195 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.195 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.195 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:32.195 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398695+0000", 2024-09-12T22:33:32.195 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.1409999999999994e-06 2024-09-12T22:33:32.195 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.195 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.195 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:32.195 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398703+0000", 2024-09-12T22:33:32.195 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4379999999999998e-06 2024-09-12T22:33:32.195 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.195 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.196 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:32.196 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.457051+0000", 2024-09-12T22:33:32.196 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.058348358000000003 2024-09-12T22:33:32.196 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.196 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.196 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:32.196 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.457096+0000", 2024-09-12T22:33:32.196 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4428000000000002e-05 2024-09-12T22:33:32.196 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.196 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.196 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:32.196 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.457162+0000", 2024-09-12T22:33:32.196 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6298999999999997e-05 2024-09-12T22:33:32.197 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.197 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.197 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:32.197 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.461416+0000", 2024-09-12T22:33:32.197 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0042539980000000002 2024-09-12T22:33:32.197 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.197 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.197 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:32.197 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476610+0000", 2024-09-12T22:33:32.197 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.015193879 2024-09-12T22:33:32.197 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.197 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.197 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:32.198 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476640+0000", 2024-09-12T22:33:32.198 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0648000000000002e-05 2024-09-12T22:33:32.198 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.198 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.198 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:32.198 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476673+0000", 2024-09-12T22:33:32.198 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2598999999999997e-05 2024-09-12T22:33:32.198 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:32.198 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:32.198 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:32.198 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.198 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.198 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1210 3.13 3:cb3d3880:::200.0000000d:head [write 1017112~1958 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:32.198 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.398713+0000", 2024-09-12T22:33:32.199 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 17.748842594999999, 2024-09-12T22:33:32.199 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.078118317000000007, 2024-09-12T22:33:32.199 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:32.199 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:32.199 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:32.199 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:32.199 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.199 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:32.199 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398713+0000", 2024-09-12T22:33:32.199 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:32.199 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.199 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.199 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:32.200 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398713+0000", 2024-09-12T22:33:32.200 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:32.200 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.200 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.200 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:32.200 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398713+0000", 2024-09-12T22:33:32.200 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7599999999999998e-07 2024-09-12T22:33:32.200 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.200 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.200 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:32.200 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398718+0000", 2024-09-12T22:33:32.200 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8169999999999998e-06 2024-09-12T22:33:32.201 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.201 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.201 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:32.201 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398722+0000", 2024-09-12T22:33:32.201 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5249999999999999e-06 2024-09-12T22:33:32.201 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.201 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.201 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:32.201 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398726+0000", 2024-09-12T22:33:32.201 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5650000000000002e-06 2024-09-12T22:33:32.201 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.201 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.201 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:32.202 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.457644+0000", 2024-09-12T22:33:32.202 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.058918521000000001 2024-09-12T22:33:32.202 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.202 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.202 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:32.202 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.457724+0000", 2024-09-12T22:33:32.202 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9408999999999998e-05 2024-09-12T22:33:32.202 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.202 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.202 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:32.202 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.457821+0000", 2024-09-12T22:33:32.202 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.7015000000000005e-05 2024-09-12T22:33:32.202 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.202 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.203 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:32.203 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.461419+0000", 2024-09-12T22:33:32.203 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0035985309999999999 2024-09-12T22:33:32.203 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.203 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.203 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:32.203 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476726+0000", 2024-09-12T22:33:32.203 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.015306804 2024-09-12T22:33:32.203 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.203 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.203 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:32.203 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476787+0000", 2024-09-12T22:33:32.203 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1062000000000006e-05 2024-09-12T22:33:32.203 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.204 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.204 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:32.204 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476831+0000", 2024-09-12T22:33:32.204 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3692000000000001e-05 2024-09-12T22:33:32.204 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:32.204 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:32.204 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:32.204 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.204 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.204 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1211 3.13 3:cb3d3880:::200.0000000d:head [write 1019070~5873 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:32.204 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.400122+0000", 2024-09-12T22:33:32.204 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 17.747432877000001, 2024-09-12T22:33:32.204 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.076797146999999996, 2024-09-12T22:33:32.204 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:32.205 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:32.205 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:32.205 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:32.205 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.205 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:32.205 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.400122+0000", 2024-09-12T22:33:32.205 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:32.205 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.205 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.205 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:32.205 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.400122+0000", 2024-09-12T22:33:32.205 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:32.205 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.205 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.205 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:32.206 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.400123+0000", 2024-09-12T22:33:32.206 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2500000000000005e-07 2024-09-12T22:33:32.206 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.206 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.206 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:32.206 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.400129+0000", 2024-09-12T22:33:32.206 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.319e-06 2024-09-12T22:33:32.206 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.206 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.206 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:32.206 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.400139+0000", 2024-09-12T22:33:32.206 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.5200000000000003e-06 2024-09-12T22:33:32.206 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.207 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.207 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:32.207 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.400143+0000", 2024-09-12T22:33:32.207 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.437e-06 2024-09-12T22:33:32.207 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.207 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.207 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:32.207 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.458159+0000", 2024-09-12T22:33:32.207 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.058015960999999998 2024-09-12T22:33:32.207 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.207 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.207 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:32.207 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.458201+0000", 2024-09-12T22:33:32.207 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1693000000000002e-05 2024-09-12T22:33:32.208 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.208 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.208 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:32.208 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.458267+0000", 2024-09-12T22:33:32.208 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5687999999999999e-05 2024-09-12T22:33:32.208 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.208 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.208 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:32.208 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.461423+0000", 2024-09-12T22:33:32.208 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0031560730000000001 2024-09-12T22:33:32.208 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.208 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.208 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:32.208 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476868+0000", 2024-09-12T22:33:32.209 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.015445108000000001 2024-09-12T22:33:32.209 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.209 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.209 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:32.209 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476897+0000", 2024-09-12T22:33:32.209 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9433000000000001e-05 2024-09-12T22:33:32.209 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.209 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.209 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:32.209 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476919+0000", 2024-09-12T22:33:32.209 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.2189999999999999e-05 2024-09-12T22:33:32.209 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:32.209 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:32.210 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:32.210 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.210 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.210 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1212 3.13 3:cb3d3880:::200.0000000d:head [write 1024943~3866 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:32.210 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.401707+0000", 2024-09-12T22:33:32.210 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 17.745848672000001, 2024-09-12T22:33:32.210 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.075386625999999998, 2024-09-12T22:33:32.210 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:32.210 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:32.210 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:32.210 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:32.210 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.210 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:32.210 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.401707+0000", 2024-09-12T22:33:32.211 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:32.211 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.211 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.211 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:32.211 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.401707+0000", 2024-09-12T22:33:32.211 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:32.211 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.211 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.211 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:32.211 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.401707+0000", 2024-09-12T22:33:32.211 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7700000000000004e-07 2024-09-12T22:33:32.211 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.211 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.211 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:32.212 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.401713+0000", 2024-09-12T22:33:32.212 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6609999999999997e-06 2024-09-12T22:33:32.212 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.212 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.212 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:32.212 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.401726+0000", 2024-09-12T22:33:32.212 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.3088000000000001e-05 2024-09-12T22:33:32.212 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.212 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.212 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:32.212 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.401741+0000", 2024-09-12T22:33:32.212 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.5424e-05 2024-09-12T22:33:32.212 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.212 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.213 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:32.213 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.458853+0000", 2024-09-12T22:33:32.213 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.057111157000000003 2024-09-12T22:33:32.213 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.213 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.213 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:32.213 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.458898+0000", 2024-09-12T22:33:32.213 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5633999999999997e-05 2024-09-12T22:33:32.213 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.213 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.213 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:32.213 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.458972+0000", 2024-09-12T22:33:32.213 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3441000000000004e-05 2024-09-12T22:33:32.213 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.214 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.214 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:32.214 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.461426+0000", 2024-09-12T22:33:32.214 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0024542660000000001 2024-09-12T22:33:32.214 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.214 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.214 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:32.214 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476985+0000", 2024-09-12T22:33:32.214 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.015559513000000001 2024-09-12T22:33:32.214 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.214 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.214 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:32.214 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.477044+0000", 2024-09-12T22:33:32.214 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8156999999999999e-05 2024-09-12T22:33:32.214 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.215 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.215 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:32.215 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.477093+0000", 2024-09-12T22:33:32.215 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9607999999999997e-05 2024-09-12T22:33:32.215 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:32.215 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:32.215 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:32.215 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.215 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.215 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1213 3.13 3:cb3d3880:::200.0000000d:head [write 1028809~6329 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:32.215 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.403250+0000", 2024-09-12T22:33:32.215 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 17.744305143999998, 2024-09-12T22:33:32.215 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.073936215999999999, 2024-09-12T22:33:32.215 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:32.216 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:32.216 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:32.216 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:32.216 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.216 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:32.216 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403250+0000", 2024-09-12T22:33:32.216 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:32.216 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.216 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.216 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:32.216 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403250+0000", 2024-09-12T22:33:32.216 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:32.216 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.217 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.217 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:32.217 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403251+0000", 2024-09-12T22:33:32.217 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.37e-07 2024-09-12T22:33:32.217 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.217 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.217 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:32.217 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403258+0000", 2024-09-12T22:33:32.217 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.25e-06 2024-09-12T22:33:32.217 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.217 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.217 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:32.217 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403269+0000", 2024-09-12T22:33:32.217 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0509000000000001e-05 2024-09-12T22:33:32.217 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.218 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.218 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:32.218 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403274+0000", 2024-09-12T22:33:32.218 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1290000000000004e-06 2024-09-12T22:33:32.218 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.218 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.218 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:32.218 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.459796+0000", 2024-09-12T22:33:32.218 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.056522020999999999 2024-09-12T22:33:32.218 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.218 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.218 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:32.218 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.459845+0000", 2024-09-12T22:33:32.219 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8884999999999997e-05 2024-09-12T22:33:32.219 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.219 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.219 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:32.219 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.459920+0000", 2024-09-12T22:33:32.219 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5318e-05 2024-09-12T22:33:32.219 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.219 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.219 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:32.219 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.466542+0000", 2024-09-12T22:33:32.219 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0066223139999999998 2024-09-12T22:33:32.219 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.219 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.219 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:32.220 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.477137+0000", 2024-09-12T22:33:32.220 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010594717 2024-09-12T22:33:32.220 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.220 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.220 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:32.220 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.477165+0000", 2024-09-12T22:33:32.220 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8262000000000001e-05 2024-09-12T22:33:32.220 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.220 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.220 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:32.220 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.477186+0000", 2024-09-12T22:33:32.220 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1073999999999998e-05 2024-09-12T22:33:32.220 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:32.221 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:32.221 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:32.221 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.221 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.221 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1214 3.13 3:cb3d3880:::200.0000000d:head [write 1035138~2606 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:32.221 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.403674+0000", 2024-09-12T22:33:32.221 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 17.743881223999999, 2024-09-12T22:33:32.221 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.073643204000000004, 2024-09-12T22:33:32.221 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:32.221 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:32.221 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:32.221 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:32.221 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.221 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:32.222 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403674+0000", 2024-09-12T22:33:32.222 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:32.222 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.222 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.222 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:32.222 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403674+0000", 2024-09-12T22:33:32.222 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:32.222 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.222 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.222 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:32.222 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403674+0000", 2024-09-12T22:33:32.222 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.7700000000000005e-07 2024-09-12T22:33:32.222 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.222 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.223 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:32.223 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403678+0000", 2024-09-12T22:33:32.223 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2009999999999999e-06 2024-09-12T22:33:32.223 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.223 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.223 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:32.223 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403686+0000", 2024-09-12T22:33:32.223 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5690000000000005e-06 2024-09-12T22:33:32.223 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.223 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.223 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:32.223 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403690+0000", 2024-09-12T22:33:32.223 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.233e-06 2024-09-12T22:33:32.223 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.224 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.224 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:32.224 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.460445+0000", 2024-09-12T22:33:32.224 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.056754412999999997 2024-09-12T22:33:32.224 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.224 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.224 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:32.224 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.460495+0000", 2024-09-12T22:33:32.224 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0238999999999998e-05 2024-09-12T22:33:32.224 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.224 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.224 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:32.224 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.460566+0000", 2024-09-12T22:33:32.224 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1159000000000001e-05 2024-09-12T22:33:32.225 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.225 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.225 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:32.225 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.466546+0000", 2024-09-12T22:33:32.225 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0059798910000000002 2024-09-12T22:33:32.225 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.225 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.225 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:32.225 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.477232+0000", 2024-09-12T22:33:32.225 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010686084 2024-09-12T22:33:32.225 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.225 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.225 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:32.226 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.477280+0000", 2024-09-12T22:33:32.226 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.7719999999999997e-05 2024-09-12T22:33:32.226 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.226 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.226 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:32.226 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.477317+0000", 2024-09-12T22:33:32.226 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7218000000000002e-05 2024-09-12T22:33:32.226 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:32.226 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:32.226 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:32.226 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.226 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.226 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1223 3.13 3:cb3d3880:::200.0000000d:head [write 1090497~1913 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:32.226 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.420111+0000", 2024-09-12T22:33:32.227 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 17.727444072000001, 2024-09-12T22:33:32.227 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.071634583000000002, 2024-09-12T22:33:32.227 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:32.227 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:32.227 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:32.227 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:32.227 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.227 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:32.227 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.420111+0000", 2024-09-12T22:33:32.227 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:32.227 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.227 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.227 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:32.227 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.420111+0000", 2024-09-12T22:33:32.227 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:32.228 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.228 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.228 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:32.228 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.420112+0000", 2024-09-12T22:33:32.228 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.2900000000000002e-07 2024-09-12T22:33:32.228 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.228 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.228 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:32.228 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.420116+0000", 2024-09-12T22:33:32.228 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.67e-06 2024-09-12T22:33:32.228 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.228 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.228 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:32.229 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.420125+0000", 2024-09-12T22:33:32.229 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.0890000000000006e-06 2024-09-12T22:33:32.229 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.229 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.229 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:32.229 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.420131+0000", 2024-09-12T22:33:32.229 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4269999999999996e-06 2024-09-12T22:33:32.229 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.229 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.229 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:32.229 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.465358+0000", 2024-09-12T22:33:32.229 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.045227030000000001 2024-09-12T22:33:32.229 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.229 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.230 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:32.230 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.465439+0000", 2024-09-12T22:33:32.230 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0901000000000004e-05 2024-09-12T22:33:32.230 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.230 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.230 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:32.230 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.465571+0000", 2024-09-12T22:33:32.230 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000131705 2024-09-12T22:33:32.230 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.230 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.230 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:32.230 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.469496+0000", 2024-09-12T22:33:32.230 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.003925418 2024-09-12T22:33:32.230 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.231 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.231 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:32.231 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.491669+0000", 2024-09-12T22:33:32.231 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.022172335000000001 2024-09-12T22:33:32.231 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.231 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.231 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:32.231 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.491714+0000", 2024-09-12T22:33:32.231 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5417000000000002e-05 2024-09-12T22:33:32.231 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.231 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.231 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:32.231 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.491746+0000", 2024-09-12T22:33:32.231 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1662000000000003e-05 2024-09-12T22:33:32.232 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:32.232 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:32.232 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:32.232 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.232 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.232 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1225 3.13 3:cb3d3880:::200.0000000d:head [write 1097316~1932 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:32.232 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.421303+0000", 2024-09-12T22:33:32.232 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 17.726252237000001, 2024-09-12T22:33:32.232 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.074934770999999997, 2024-09-12T22:33:32.232 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:32.232 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:32.232 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:32.232 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:32.232 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.233 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:32.233 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.421303+0000", 2024-09-12T22:33:32.233 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:32.233 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.233 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.233 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:32.233 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.421303+0000", 2024-09-12T22:33:32.233 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:32.233 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.233 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.233 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:32.233 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.421303+0000", 2024-09-12T22:33:32.233 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8599999999999998e-07 2024-09-12T22:33:32.234 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.234 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.234 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:32.234 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.421307+0000", 2024-09-12T22:33:32.234 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0879999999999999e-06 2024-09-12T22:33:32.234 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.234 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.234 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:32.234 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.421314+0000", 2024-09-12T22:33:32.234 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1010000000000003e-06 2024-09-12T22:33:32.234 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.234 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.234 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:32.234 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.421319+0000", 2024-09-12T22:33:32.235 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7209999999999999e-06 2024-09-12T22:33:32.235 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.235 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.235 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:32.235 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.466620+0000", 2024-09-12T22:33:32.235 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.045301044999999998 2024-09-12T22:33:32.235 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.235 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.235 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:32.235 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.466703+0000", 2024-09-12T22:33:32.235 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3011999999999997e-05 2024-09-12T22:33:32.235 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.235 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.235 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:32.236 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.466826+0000", 2024-09-12T22:33:32.236 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000122824 2024-09-12T22:33:32.236 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.236 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.236 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:32.236 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.472359+0000", 2024-09-12T22:33:32.236 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0055323009999999999 2024-09-12T22:33:32.236 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.236 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.236 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:32.236 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496142+0000", 2024-09-12T22:33:32.236 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.023783696999999999 2024-09-12T22:33:32.236 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.236 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.237 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:32.237 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496194+0000", 2024-09-12T22:33:32.237 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1350000000000001e-05 2024-09-12T22:33:32.237 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.237 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.237 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:32.237 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496238+0000", 2024-09-12T22:33:32.237 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4146000000000001e-05 2024-09-12T22:33:32.237 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:32.237 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:32.237 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:32.237 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.237 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.237 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1226 3.13 3:cb3d3880:::200.0000000d:head [write 1099248~1973 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:32.238 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.422971+0000", 2024-09-12T22:33:32.238 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 17.724584639, 2024-09-12T22:33:32.238 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.073363063000000006, 2024-09-12T22:33:32.238 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:32.238 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:32.238 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:32.238 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:32.238 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.238 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:32.238 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.422971+0000", 2024-09-12T22:33:32.238 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:32.238 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.238 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.239 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:32.239 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.422971+0000", 2024-09-12T22:33:32.239 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:32.239 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.239 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.239 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:32.239 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.422971+0000", 2024-09-12T22:33:32.239 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.1699999999999997e-07 2024-09-12T22:33:32.239 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.239 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.239 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:32.239 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.422975+0000", 2024-09-12T22:33:32.239 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2650000000000001e-06 2024-09-12T22:33:32.240 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.240 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.240 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:32.240 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.422981+0000", 2024-09-12T22:33:32.240 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7379999999999997e-06 2024-09-12T22:33:32.240 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.240 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.240 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:32.240 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.422986+0000", 2024-09-12T22:33:32.240 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5220000000000001e-06 2024-09-12T22:33:32.240 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.240 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.240 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:32.240 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.467340+0000", 2024-09-12T22:33:32.241 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.044353985999999998 2024-09-12T22:33:32.241 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.241 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.241 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:32.241 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.467412+0000", 2024-09-12T22:33:32.241 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1982000000000003e-05 2024-09-12T22:33:32.241 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.241 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.241 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:32.241 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.467493+0000", 2024-09-12T22:33:32.241 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0829999999999997e-05 2024-09-12T22:33:32.241 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.241 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.241 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:32.242 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.472364+0000", 2024-09-12T22:33:32.242 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0048713189999999998 2024-09-12T22:33:32.242 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.242 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.242 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:32.242 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496271+0000", 2024-09-12T22:33:32.242 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.023906808000000002 2024-09-12T22:33:32.242 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.242 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.242 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:32.242 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496300+0000", 2024-09-12T22:33:32.242 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9315e-05 2024-09-12T22:33:32.242 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.242 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.243 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:32.243 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496334+0000", 2024-09-12T22:33:32.243 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3481e-05 2024-09-12T22:33:32.243 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:32.243 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:32.243 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:32.243 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.243 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.243 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1227 3.13 3:cb3d3880:::200.0000000d:head [write 1101221~1922 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:32.243 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.423028+0000", 2024-09-12T22:33:32.243 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 17.724527654999999, 2024-09-12T22:33:32.243 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.073444802000000003, 2024-09-12T22:33:32.243 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:32.244 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:32.244 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:32.244 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:32.244 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.244 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:32.244 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423028+0000", 2024-09-12T22:33:32.244 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:32.244 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.244 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.244 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:32.244 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423028+0000", 2024-09-12T22:33:32.244 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:32.244 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.244 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.245 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:32.245 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423028+0000", 2024-09-12T22:33:32.245 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1699999999999998e-07 2024-09-12T22:33:32.245 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.245 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.245 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:32.245 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423031+0000", 2024-09-12T22:33:32.246 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8499999999999998e-06 2024-09-12T22:33:32.246 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.246 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.246 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:32.246 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423036+0000", 2024-09-12T22:33:32.246 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9479999999999999e-06 2024-09-12T22:33:32.246 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.246 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.246 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:32.246 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423039+0000", 2024-09-12T22:33:32.246 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4929999999999998e-06 2024-09-12T22:33:32.246 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.246 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.246 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:32.247 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.467785+0000", 2024-09-12T22:33:32.247 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.044745957000000003 2024-09-12T22:33:32.247 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.247 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.247 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:32.247 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.467838+0000", 2024-09-12T22:33:32.247 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2596999999999998e-05 2024-09-12T22:33:32.247 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.247 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.247 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:32.247 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.467915+0000", 2024-09-12T22:33:32.247 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6744999999999998e-05 2024-09-12T22:33:32.247 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.248 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.248 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:32.248 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.472368+0000", 2024-09-12T22:33:32.248 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0044534730000000003 2024-09-12T22:33:32.248 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.248 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.248 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:32.248 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496382+0000", 2024-09-12T22:33:32.248 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.024014111000000001 2024-09-12T22:33:32.248 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.248 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.248 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:32.248 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496443+0000", 2024-09-12T22:33:32.248 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.0547000000000002e-05 2024-09-12T22:33:32.249 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.249 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.249 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:32.249 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496472+0000", 2024-09-12T22:33:32.249 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9564e-05 2024-09-12T22:33:32.249 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:32.249 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:32.249 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:32.249 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.249 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.249 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1228 3.13 3:cb3d3880:::200.0000000d:head [write 1103143~2423 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:32.249 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.423305+0000", 2024-09-12T22:33:32.249 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 17.724250291000001, 2024-09-12T22:33:32.249 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.073251160999999995, 2024-09-12T22:33:32.250 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:32.250 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:32.250 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:32.250 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:32.250 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.250 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:32.250 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423305+0000", 2024-09-12T22:33:32.250 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:32.250 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.250 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.250 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:32.250 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423305+0000", 2024-09-12T22:33:32.250 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:32.250 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.251 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.251 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:32.251 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423306+0000", 2024-09-12T22:33:32.251 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4899999999999995e-07 2024-09-12T22:33:32.251 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.251 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.251 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:32.251 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423311+0000", 2024-09-12T22:33:32.251 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7459999999999997e-06 2024-09-12T22:33:32.251 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.251 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.251 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:32.251 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423316+0000", 2024-09-12T22:33:32.251 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0239999999999997e-06 2024-09-12T22:33:32.252 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.252 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.252 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:32.252 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423320+0000", 2024-09-12T22:33:32.252 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.67e-06 2024-09-12T22:33:32.252 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.252 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.252 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:32.252 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.468252+0000", 2024-09-12T22:33:32.252 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.044932262000000001 2024-09-12T22:33:32.252 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.252 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.252 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:32.252 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.468293+0000", 2024-09-12T22:33:32.253 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0368999999999999e-05 2024-09-12T22:33:32.253 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.253 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.253 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:32.253 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.468357+0000", 2024-09-12T22:33:32.253 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4287000000000003e-05 2024-09-12T22:33:32.253 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.253 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.253 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:32.253 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.472371+0000", 2024-09-12T22:33:32.253 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0040144350000000002 2024-09-12T22:33:32.253 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.253 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.253 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:32.254 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496507+0000", 2024-09-12T22:33:32.254 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.024135961000000001 2024-09-12T22:33:32.254 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.254 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.254 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:32.254 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496537+0000", 2024-09-12T22:33:32.254 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9611000000000002e-05 2024-09-12T22:33:32.254 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.254 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.254 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:32.254 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496556+0000", 2024-09-12T22:33:32.254 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9147000000000002e-05 2024-09-12T22:33:32.254 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:32.254 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:32.255 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:32.255 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.255 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.255 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1229 3.13 3:cb3d3880:::200.0000000d:head [write 1105566~1911 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:32.255 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.423606+0000", 2024-09-12T22:33:32.255 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 17.723949279999999, 2024-09-12T22:33:32.255 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.073027876000000005, 2024-09-12T22:33:32.255 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:32.255 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:32.255 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:32.255 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:32.255 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.255 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:32.255 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423606+0000", 2024-09-12T22:33:32.255 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:32.256 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.256 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.256 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:32.256 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423606+0000", 2024-09-12T22:33:32.256 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:32.256 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.256 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.256 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:32.256 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423606+0000", 2024-09-12T22:33:32.256 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.7e-07 2024-09-12T22:33:32.256 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.256 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.256 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:32.256 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423609+0000", 2024-09-12T22:33:32.257 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5339999999999998e-06 2024-09-12T22:33:32.257 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.257 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.257 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:32.257 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423614+0000", 2024-09-12T22:33:32.257 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.69e-06 2024-09-12T22:33:32.257 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.257 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.257 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:32.257 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423617+0000", 2024-09-12T22:33:32.257 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4300000000000002e-06 2024-09-12T22:33:32.257 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.257 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.258 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:32.258 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.468606+0000", 2024-09-12T22:33:32.258 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.044988606 2024-09-12T22:33:32.258 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.258 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.258 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:32.258 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.468649+0000", 2024-09-12T22:33:32.258 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3414000000000001e-05 2024-09-12T22:33:32.258 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.258 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.258 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:32.258 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.468714+0000", 2024-09-12T22:33:32.258 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4857000000000006e-05 2024-09-12T22:33:32.258 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.259 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.259 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:32.259 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.472375+0000", 2024-09-12T22:33:32.259 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0036607330000000002 2024-09-12T22:33:32.259 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.259 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.259 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:32.259 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496585+0000", 2024-09-12T22:33:32.259 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.024210835 2024-09-12T22:33:32.259 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.259 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.259 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:32.259 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496612+0000", 2024-09-12T22:33:32.259 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6999999999999999e-05 2024-09-12T22:33:32.260 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.260 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.260 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:32.260 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496634+0000", 2024-09-12T22:33:32.260 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1307000000000001e-05 2024-09-12T22:33:32.260 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:32.260 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:32.260 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:32.260 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.260 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.260 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1230 3.13 3:cb3d3880:::200.0000000d:head [write 1107477~6537 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:32.260 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.423911+0000", 2024-09-12T22:33:32.260 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 17.723644435000001, 2024-09-12T22:33:32.260 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.072794530999999996, 2024-09-12T22:33:32.261 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:32.261 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:32.261 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:32.261 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:32.261 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.261 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:32.261 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423911+0000", 2024-09-12T22:33:32.261 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:32.261 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.261 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.261 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:32.261 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423911+0000", 2024-09-12T22:33:32.261 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:32.261 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.262 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.262 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:32.262 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423911+0000", 2024-09-12T22:33:32.262 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3799999999999998e-07 2024-09-12T22:33:32.262 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.262 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.262 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:32.262 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423919+0000", 2024-09-12T22:33:32.262 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.8329999999999994e-06 2024-09-12T22:33:32.262 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.262 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.262 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:32.262 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423924+0000", 2024-09-12T22:33:32.263 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3449999999999996e-06 2024-09-12T22:33:32.263 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.263 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.263 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:32.263 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423928+0000", 2024-09-12T22:33:32.263 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2339999999999999e-06 2024-09-12T22:33:32.263 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.263 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.263 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:32.263 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.469042+0000", 2024-09-12T22:33:32.263 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.045114888999999998 2024-09-12T22:33:32.263 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.263 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.263 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:32.263 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.469092+0000", 2024-09-12T22:33:32.264 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9289000000000002e-05 2024-09-12T22:33:32.264 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.264 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.264 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:32.264 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.469163+0000", 2024-09-12T22:33:32.264 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1222000000000004e-05 2024-09-12T22:33:32.264 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.264 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.264 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:32.264 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.472379+0000", 2024-09-12T22:33:32.264 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0032156419999999999 2024-09-12T22:33:32.264 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.264 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.265 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:32.265 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496661+0000", 2024-09-12T22:33:32.265 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.024281857 2024-09-12T22:33:32.265 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.265 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.265 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:32.265 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496687+0000", 2024-09-12T22:33:32.265 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6551e-05 2024-09-12T22:33:32.265 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:32.265 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:32.265 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:32.265 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496705+0000", 2024-09-12T22:33:32.265 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.8230999999999999e-05 2024-09-12T22:33:32.265 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:32.266 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:32.266 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:32.266 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:32.266 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:32.266 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-09-12T22:33:32.267 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:33:32.268 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:32.266+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:32.368 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:32.367+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:32.375 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:33:32.375 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:33:32.375 INFO:teuthology.orchestra.run.smithi148.stdout: "num_ops": 0 2024-09-12T22:33:32.376 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:33:32.384 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:33:32.470 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:32.469+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:32.488 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:33:32.488 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:33:32.489 INFO:teuthology.orchestra.run.smithi148.stdout: "complaint_time": 30, 2024-09-12T22:33:32.489 INFO:teuthology.orchestra.run.smithi148.stdout: "num_blocked_ops": 0 2024-09-12T22:33:32.489 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:33:32.497 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:33:32.571 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:32.570+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:32.579 INFO:teuthology.orchestra.run.smithi019.stderr:noscrub is set 2024-09-12T22:33:32.601 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:33:32.602 INFO:teuthology.orchestra.run.smithi148.stdout: "size": 20, 2024-09-12T22:33:32.602 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 600, 2024-09-12T22:33:32.602 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [ 2024-09-12T22:33:32.602 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.602 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4490.0:9866 4.b 4:d370243b:::10000002d48.00000000:head [write 0~1308] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:33:32.602 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:09.467883+0000", 2024-09-12T22:33:32.602 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 23.132046842000001, 2024-09-12T22:33:32.602 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.085024817000000003, 2024-09-12T22:33:32.602 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:32.602 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:32.602 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:32.602 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:33:32.602 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4490", 2024-09-12T22:33:32.603 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:32.603 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 9866 2024-09-12T22:33:32.603 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.603 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:32.603 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.603 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:32.603 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.467883+0000", 2024-09-12T22:33:32.603 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:32.603 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.603 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.603 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:32.603 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.467883+0000", 2024-09-12T22:33:32.603 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:32.604 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.604 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.604 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:32.604 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.467884+0000", 2024-09-12T22:33:32.604 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1800000000000005e-07 2024-09-12T22:33:32.604 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.604 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.604 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:32.604 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.467888+0000", 2024-09-12T22:33:32.604 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5959999999999997e-06 2024-09-12T22:33:32.605 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.605 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.605 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:32.605 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.467896+0000", 2024-09-12T22:33:32.605 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.8679999999999999e-06 2024-09-12T22:33:32.605 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.605 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.605 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:32.605 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.467901+0000", 2024-09-12T22:33:32.605 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9169999999999997e-06 2024-09-12T22:33:32.605 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.606 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.606 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:32.606 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.467944+0000", 2024-09-12T22:33:32.606 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3055e-05 2024-09-12T22:33:32.606 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.606 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.606 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:32.606 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.468011+0000", 2024-09-12T22:33:32.606 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7328000000000003e-05 2024-09-12T22:33:32.606 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.606 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.607 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:32.607 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.468078+0000", 2024-09-12T22:33:32.607 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7063999999999994e-05 2024-09-12T22:33:32.607 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.607 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.607 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:32.607 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.551406+0000", 2024-09-12T22:33:32.607 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.083327485000000007 2024-09-12T22:33:32.607 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.608 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.608 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:32.608 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.552822+0000", 2024-09-12T22:33:32.608 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001415929 2024-09-12T22:33:32.608 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.608 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.608 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:32.608 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.552863+0000", 2024-09-12T22:33:32.608 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0809000000000002e-05 2024-09-12T22:33:32.608 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.608 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.608 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:32.608 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.552908+0000", 2024-09-12T22:33:32.609 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5048e-05 2024-09-12T22:33:32.609 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:32.609 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:32.609 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:32.609 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.609 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.609 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4490.0:9867 4.16 4:6bd8f1b8:::10000002d49.00000000:head [write 0~1599] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:33:32.609 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:09.468760+0000", 2024-09-12T22:33:32.609 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 23.131169833000001, 2024-09-12T22:33:32.609 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.086660499000000002, 2024-09-12T22:33:32.609 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:32.609 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:32.609 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:32.610 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:33:32.610 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4490", 2024-09-12T22:33:32.610 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:32.610 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 9867 2024-09-12T22:33:32.610 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.610 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:32.610 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.610 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:32.610 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.468760+0000", 2024-09-12T22:33:32.610 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:32.610 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.610 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.610 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:32.611 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.468760+0000", 2024-09-12T22:33:32.611 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:32.611 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.611 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.611 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:32.611 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.468761+0000", 2024-09-12T22:33:32.611 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4399999999999999e-07 2024-09-12T22:33:32.611 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.611 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.611 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:32.611 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.468765+0000", 2024-09-12T22:33:32.611 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3259999999999997e-06 2024-09-12T22:33:32.611 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.611 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.612 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:32.612 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.548969+0000", 2024-09-12T22:33:32.612 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.080204172000000004 2024-09-12T22:33:32.612 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.612 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.612 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:32.612 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.549001+0000", 2024-09-12T22:33:32.612 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.1464999999999998e-05 2024-09-12T22:33:32.612 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.612 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.612 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:32.612 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.549148+0000", 2024-09-12T22:33:32.612 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014749399999999999 2024-09-12T22:33:32.613 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.613 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.613 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:32.613 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.549379+0000", 2024-09-12T22:33:32.613 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000231091 2024-09-12T22:33:32.613 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.613 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.613 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:32.613 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.549518+0000", 2024-09-12T22:33:32.613 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013844899999999999 2024-09-12T22:33:32.613 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.613 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.613 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:32.614 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.552236+0000", 2024-09-12T22:33:32.614 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0027179869999999998 2024-09-12T22:33:32.614 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.614 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.614 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:32.614 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.555333+0000", 2024-09-12T22:33:32.614 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0030973559999999999 2024-09-12T22:33:32.614 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.614 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.614 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:32.614 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.555379+0000", 2024-09-12T22:33:32.614 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6236999999999998e-05 2024-09-12T22:33:32.614 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.614 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.615 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:32.615 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.555420+0000", 2024-09-12T22:33:32.615 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1177999999999998e-05 2024-09-12T22:33:32.615 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:32.615 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:32.615 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:32.615 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.615 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.615 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop_reply(client.4490.0:9866 4.b e53/18 ondisk, result = 0)", 2024-09-12T22:33:32.615 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:09.468826+0000", 2024-09-12T22:33:32.615 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 23.131103538000001, 2024-09-12T22:33:32.615 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.082588348000000006, 2024-09-12T22:33:32.615 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:32.615 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:32.616 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:33:32.616 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:32.616 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.616 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:32.616 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.468826+0000", 2024-09-12T22:33:32.616 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:32.616 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.616 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.616 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:32.616 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.468826+0000", 2024-09-12T22:33:32.616 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:32.616 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.616 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.617 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:32.617 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.468827+0000", 2024-09-12T22:33:32.617 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3399999999999999e-07 2024-09-12T22:33:32.617 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.617 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.617 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:32.617 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.468830+0000", 2024-09-12T22:33:32.617 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.1559999999999999e-06 2024-09-12T22:33:32.617 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.617 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.617 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:32.617 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.548957+0000", 2024-09-12T22:33:32.617 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.080126852999999998 2024-09-12T22:33:32.617 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.618 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.618 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:32.618 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.548989+0000", 2024-09-12T22:33:32.618 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2409000000000001e-05 2024-09-12T22:33:32.618 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.618 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.618 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:32.618 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.551065+0000", 2024-09-12T22:33:32.618 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.002075871 2024-09-12T22:33:32.618 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.618 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.618 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:32.618 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.551398+0000", 2024-09-12T22:33:32.618 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00033339099999999999 2024-09-12T22:33:32.619 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.619 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.619 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:32.619 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.551414+0000", 2024-09-12T22:33:32.619 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6133999999999998e-05 2024-09-12T22:33:32.619 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:32.619 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:32.619 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:32.619 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.619 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.619 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4490.0:10437 4.2f 4:f6cd553b:::10000002fce.00000000:head [write 0~27313] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:33:32.619 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:10.050890+0000", 2024-09-12T22:33:32.619 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 22.549039142000002, 2024-09-12T22:33:32.620 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.056482601, 2024-09-12T22:33:32.620 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:32.620 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:32.620 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:32.620 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:33:32.620 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4490", 2024-09-12T22:33:32.620 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:32.620 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 10437 2024-09-12T22:33:32.620 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.620 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:32.620 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.620 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:32.620 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.050890+0000", 2024-09-12T22:33:32.621 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:32.621 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.621 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.621 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:32.621 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.050890+0000", 2024-09-12T22:33:32.621 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:32.621 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.621 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.621 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:32.621 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.050891+0000", 2024-09-12T22:33:32.621 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.6600000000000005e-07 2024-09-12T22:33:32.621 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.621 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.621 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:32.622 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.050906+0000", 2024-09-12T22:33:32.622 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4521e-05 2024-09-12T22:33:32.622 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.622 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.622 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:32.622 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.050915+0000", 2024-09-12T22:33:32.622 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.2569999999999996e-06 2024-09-12T22:33:32.622 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.622 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.622 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:32.622 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.050920+0000", 2024-09-12T22:33:32.622 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.724e-06 2024-09-12T22:33:32.622 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.622 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.623 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:32.623 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.050960+0000", 2024-09-12T22:33:32.623 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9999000000000001e-05 2024-09-12T22:33:32.623 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.623 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.623 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:32.623 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.051031+0000", 2024-09-12T22:33:32.623 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1007000000000006e-05 2024-09-12T22:33:32.623 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.623 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.623 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:32.623 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.107249+0000", 2024-09-12T22:33:32.623 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.056218432999999998 2024-09-12T22:33:32.624 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.624 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.624 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:32.624 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.107301+0000", 2024-09-12T22:33:32.624 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1289000000000003e-05 2024-09-12T22:33:32.624 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.624 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.624 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:32.624 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.107373+0000", 2024-09-12T22:33:32.624 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.2504999999999998e-05 2024-09-12T22:33:32.624 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:32.624 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:32.624 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:32.624 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.625 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.625 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4490.0:10439 4.12 4:483953cb:::10000002fd0.00000000:head [write 0~4842] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:33:32.625 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:10.052567+0000", 2024-09-12T22:33:32.625 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 22.547362933999999, 2024-09-12T22:33:32.625 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.055835449000000002, 2024-09-12T22:33:32.625 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:32.625 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:32.625 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:32.625 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:33:32.625 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4490", 2024-09-12T22:33:32.625 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:32.625 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 10439 2024-09-12T22:33:32.625 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.626 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:32.626 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.626 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:32.626 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.052567+0000", 2024-09-12T22:33:32.626 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:32.626 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.626 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.626 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:32.626 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.052567+0000", 2024-09-12T22:33:32.626 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:32.626 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.626 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.626 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:32.626 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.052568+0000", 2024-09-12T22:33:32.627 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.3600000000000002e-07 2024-09-12T22:33:32.627 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.627 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.627 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:32.627 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.052591+0000", 2024-09-12T22:33:32.627 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.3110000000000001e-05 2024-09-12T22:33:32.627 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.627 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.627 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:32.627 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.106740+0000", 2024-09-12T22:33:32.627 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.054149315000000003 2024-09-12T22:33:32.627 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.627 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.627 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:32.628 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.106751+0000", 2024-09-12T22:33:32.628 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1056000000000001e-05 2024-09-12T22:33:32.628 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.628 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.628 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:32.628 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.106811+0000", 2024-09-12T22:33:32.628 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9515999999999997e-05 2024-09-12T22:33:32.628 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.628 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.628 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:32.628 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.106929+0000", 2024-09-12T22:33:32.628 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00011879000000000001 2024-09-12T22:33:32.628 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.629 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.629 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:32.629 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.108283+0000", 2024-09-12T22:33:32.629 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001354177 2024-09-12T22:33:32.629 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.629 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.629 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:32.629 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.108328+0000", 2024-09-12T22:33:32.629 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4931000000000001e-05 2024-09-12T22:33:32.629 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.629 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.629 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:32.629 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.108402+0000", 2024-09-12T22:33:32.629 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3718000000000001e-05 2024-09-12T22:33:32.630 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:32.630 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:32.630 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:32.630 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.630 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.630 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(client.4490.0:10445 4.3c e53/18 4:3d97251e:::10000002fd8.00000000:head v 53'154, mlcod=53'152)", 2024-09-12T22:33:32.630 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:10.058521+0000", 2024-09-12T22:33:32.630 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 22.541408594, 2024-09-12T22:33:32.630 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.049310138000000003, 2024-09-12T22:33:32.630 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:32.630 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:32.630 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:32.630 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:32.631 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.631 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:32.631 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.058521+0000", 2024-09-12T22:33:32.631 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:32.631 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.631 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.631 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:32.631 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.058521+0000", 2024-09-12T22:33:32.631 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:32.631 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.631 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.631 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:32.631 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.058522+0000", 2024-09-12T22:33:32.631 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.1099999999999995e-07 2024-09-12T22:33:32.632 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.632 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.632 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:32.632 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.058530+0000", 2024-09-12T22:33:32.632 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.7290000000000006e-06 2024-09-12T22:33:32.632 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.632 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.632 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:32.632 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.106760+0000", 2024-09-12T22:33:32.632 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.048229384 2024-09-12T22:33:32.632 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.632 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.632 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:32.633 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.106770+0000", 2024-09-12T22:33:32.633 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0431999999999999e-05 2024-09-12T22:33:32.633 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.633 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.633 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:32.633 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.106823+0000", 2024-09-12T22:33:32.633 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2309999999999999e-05 2024-09-12T22:33:32.633 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.633 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.633 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:32.633 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.106841+0000", 2024-09-12T22:33:32.633 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.8218000000000001e-05 2024-09-12T22:33:32.633 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.633 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.634 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:32.634 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.107796+0000", 2024-09-12T22:33:32.634 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00095552600000000005 2024-09-12T22:33:32.634 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.634 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.634 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:32.634 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.107831+0000", 2024-09-12T22:33:32.634 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4928000000000002e-05 2024-09-12T22:33:32.634 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:32.634 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:32.634 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:32.634 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.634 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.635 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4490.0:11351 4.3f 4:fd498422:::10000003188.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-12T22:33:32.635 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:13.354715+0000", 2024-09-12T22:33:32.635 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 19.245214780000001, 2024-09-12T22:33:32.635 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.043059568999999999, 2024-09-12T22:33:32.635 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:32.635 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:32.635 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:32.635 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:33:32.635 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4490", 2024-09-12T22:33:32.635 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:32.635 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 11351 2024-09-12T22:33:32.635 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.635 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:32.635 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.636 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:32.636 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.354715+0000", 2024-09-12T22:33:32.636 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:32.636 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.636 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.636 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:32.636 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.354715+0000", 2024-09-12T22:33:32.636 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:32.636 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.636 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.636 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:32.636 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.354716+0000", 2024-09-12T22:33:32.636 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.7600000000000006e-07 2024-09-12T22:33:32.637 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.637 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.637 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:32.637 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.361477+0000", 2024-09-12T22:33:32.637 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0067607090000000002 2024-09-12T22:33:32.637 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.637 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.637 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:32.637 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.361487+0000", 2024-09-12T22:33:32.637 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0249e-05 2024-09-12T22:33:32.637 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.637 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.637 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:32.638 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.361493+0000", 2024-09-12T22:33:32.638 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.4699999999999999e-06 2024-09-12T22:33:32.638 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.638 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.638 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:32.638 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.361544+0000", 2024-09-12T22:33:32.638 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1124e-05 2024-09-12T22:33:32.638 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.638 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.638 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:32.638 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.361604+0000", 2024-09-12T22:33:32.638 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9397000000000001e-05 2024-09-12T22:33:32.638 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.639 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.639 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:32.639 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.397601+0000", 2024-09-12T22:33:32.639 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.035996927999999997 2024-09-12T22:33:32.639 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.639 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.639 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:32.639 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.397646+0000", 2024-09-12T22:33:32.639 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5176000000000003e-05 2024-09-12T22:33:32.639 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.639 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.639 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:32.639 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.397774+0000", 2024-09-12T22:33:32.639 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012854000000000001 2024-09-12T22:33:32.640 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:32.640 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:32.640 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:32.640 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.640 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.640 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4490.0:12798 4.3e 4:7eb070ca:::100000030e0.00000000:head [write 0~4194304 [5@1189789]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-12T22:33:32.640 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:15.140228+0000", 2024-09-12T22:33:32.640 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 17.45970213, 2024-09-12T22:33:32.640 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.046073232999999998, 2024-09-12T22:33:32.640 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:32.640 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:32.640 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:32.641 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:33:32.641 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4490", 2024-09-12T22:33:32.641 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:32.641 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 12798 2024-09-12T22:33:32.641 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.641 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:32.641 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.641 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:32.641 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.140228+0000", 2024-09-12T22:33:32.641 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:32.641 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.641 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.641 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:32.641 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.140228+0000", 2024-09-12T22:33:32.642 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:32.642 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.642 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.642 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:32.642 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.140228+0000", 2024-09-12T22:33:32.642 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5899999999999996e-07 2024-09-12T22:33:32.642 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.642 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.642 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:32.642 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.147541+0000", 2024-09-12T22:33:32.642 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0073125339999999999 2024-09-12T22:33:32.642 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.642 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.643 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:32.643 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.147555+0000", 2024-09-12T22:33:32.643 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.42e-05 2024-09-12T22:33:32.643 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.643 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.643 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:32.643 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.147564+0000", 2024-09-12T22:33:32.643 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.0999999999999993e-06 2024-09-12T22:33:32.643 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.643 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.643 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:32.643 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.147637+0000", 2024-09-12T22:33:32.643 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3288999999999996e-05 2024-09-12T22:33:32.644 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.644 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.644 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:32.644 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.147725+0000", 2024-09-12T22:33:32.644 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.7622999999999998e-05 2024-09-12T22:33:32.644 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.644 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.644 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:32.644 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.186239+0000", 2024-09-12T22:33:32.644 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.038514171 2024-09-12T22:33:32.644 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.644 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.644 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:32.645 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.186265+0000", 2024-09-12T22:33:32.645 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5738e-05 2024-09-12T22:33:32.645 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.645 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.645 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:32.645 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.186301+0000", 2024-09-12T22:33:32.645 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.6019000000000002e-05 2024-09-12T22:33:32.645 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:32.645 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:32.645 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:32.645 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.645 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.645 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3063 3.2 3:42569fed:::200.00000011:head [write 3915305~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:33:32.646 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:19.386685+0000", 2024-09-12T22:33:32.646 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 13.213244900999999, 2024-09-12T22:33:32.646 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.042365220000000002, 2024-09-12T22:33:32.646 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:32.646 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:32.646 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:32.646 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:32.646 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.646 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:32.646 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386685+0000", 2024-09-12T22:33:32.647 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:32.647 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.647 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.647 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:32.647 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386685+0000", 2024-09-12T22:33:32.647 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:32.647 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.647 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.647 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:32.647 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386685+0000", 2024-09-12T22:33:32.647 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.08e-07 2024-09-12T22:33:32.647 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.648 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.648 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:32.648 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386688+0000", 2024-09-12T22:33:32.648 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8880000000000001e-06 2024-09-12T22:33:32.648 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.648 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.648 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:32.648 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386694+0000", 2024-09-12T22:33:32.648 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8089999999999998e-06 2024-09-12T22:33:32.648 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.648 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.648 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:32.648 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386699+0000", 2024-09-12T22:33:32.648 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8010000000000003e-06 2024-09-12T22:33:32.649 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.649 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.649 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:32.649 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.427136+0000", 2024-09-12T22:33:32.649 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.04043712 2024-09-12T22:33:32.649 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.649 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.649 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:32.649 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.427185+0000", 2024-09-12T22:33:32.649 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9493999999999997e-05 2024-09-12T22:33:32.649 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.649 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.649 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:32.650 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.428988+0000", 2024-09-12T22:33:32.650 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001803191 2024-09-12T22:33:32.650 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.650 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.650 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:32.650 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.429015+0000", 2024-09-12T22:33:32.650 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.6438999999999999e-05 2024-09-12T22:33:32.650 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.650 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.650 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:32.650 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.429050+0000", 2024-09-12T22:33:32.650 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.5070000000000001e-05 2024-09-12T22:33:32.650 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:32.650 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:32.651 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:32.651 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.651 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.651 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3064 3.2 3:42569fed:::200.00000011:head [write 3916704~1398 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:33:32.651 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:19.386705+0000", 2024-09-12T22:33:32.651 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 13.213225125999999, 2024-09-12T22:33:32.651 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.043238378000000001, 2024-09-12T22:33:32.651 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:32.651 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:32.651 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:32.651 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:32.651 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.651 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:32.651 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386705+0000", 2024-09-12T22:33:32.652 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:32.652 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.652 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.652 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:32.652 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386705+0000", 2024-09-12T22:33:32.652 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:32.652 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.652 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.652 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:32.652 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386705+0000", 2024-09-12T22:33:32.652 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.8299999999999998e-07 2024-09-12T22:33:32.652 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.652 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.653 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:32.653 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386711+0000", 2024-09-12T22:33:32.653 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7080000000000002e-06 2024-09-12T22:33:32.653 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.653 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.653 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:32.653 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386717+0000", 2024-09-12T22:33:32.653 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.3990000000000001e-06 2024-09-12T22:33:32.653 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.653 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.653 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:32.653 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386722+0000", 2024-09-12T22:33:32.653 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9219999999999996e-06 2024-09-12T22:33:32.654 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.654 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.654 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:32.654 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.427585+0000", 2024-09-12T22:33:32.654 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.040863414000000001 2024-09-12T22:33:32.654 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.654 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.654 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:32.654 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.427628+0000", 2024-09-12T22:33:32.654 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2873000000000001e-05 2024-09-12T22:33:32.654 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.654 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.654 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:32.654 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.429871+0000", 2024-09-12T22:33:32.655 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.002242572 2024-09-12T22:33:32.655 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.655 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.655 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:32.655 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.429901+0000", 2024-09-12T22:33:32.655 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0114e-05 2024-09-12T22:33:32.655 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.655 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.655 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:32.655 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.429943+0000", 2024-09-12T22:33:32.655 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1993000000000003e-05 2024-09-12T22:33:32.655 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:32.655 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:32.656 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:32.656 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.656 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.656 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3065 3.2 3:42569fed:::200.00000011:head [write 3918102~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:33:32.656 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:19.386735+0000", 2024-09-12T22:33:32.656 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 13.213194918999999, 2024-09-12T22:33:32.656 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.043278369999999997, 2024-09-12T22:33:32.656 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:32.656 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:32.656 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:32.656 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:32.656 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.656 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:32.656 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386735+0000", 2024-09-12T22:33:32.657 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:32.657 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.657 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.657 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:32.657 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386735+0000", 2024-09-12T22:33:32.657 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:32.657 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.657 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.657 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:32.657 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386735+0000", 2024-09-12T22:33:32.657 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.7300000000000001e-07 2024-09-12T22:33:32.657 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.658 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.658 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:32.658 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386738+0000", 2024-09-12T22:33:32.658 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8420000000000001e-06 2024-09-12T22:33:32.658 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.658 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.658 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:32.658 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386744+0000", 2024-09-12T22:33:32.658 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.3040000000000001e-06 2024-09-12T22:33:32.658 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.658 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.658 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:32.658 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386749+0000", 2024-09-12T22:33:32.658 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8409999999999999e-06 2024-09-12T22:33:32.659 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.659 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.659 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:32.659 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.428112+0000", 2024-09-12T22:33:32.659 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.041363204000000001 2024-09-12T22:33:32.659 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.659 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.659 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:32.659 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.428158+0000", 2024-09-12T22:33:32.659 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5756e-05 2024-09-12T22:33:32.659 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.659 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.659 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:32.660 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.429950+0000", 2024-09-12T22:33:32.660 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0017922859999999999 2024-09-12T22:33:32.660 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.660 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.660 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:32.660 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.429975+0000", 2024-09-12T22:33:32.660 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4640000000000001e-05 2024-09-12T22:33:32.660 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.660 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.660 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:32.660 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.430013+0000", 2024-09-12T22:33:32.660 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.8024000000000001e-05 2024-09-12T22:33:32.660 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:32.661 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:32.661 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:32.661 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.661 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.661 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3066 3.2 3:42569fed:::200.00000011:head [write 3919501~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:33:32.661 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:19.386755+0000", 2024-09-12T22:33:32.661 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 13.213174278, 2024-09-12T22:33:32.661 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.044668934, 2024-09-12T22:33:32.661 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:32.661 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:32.661 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:32.661 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:32.662 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.662 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:32.662 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386755+0000", 2024-09-12T22:33:32.662 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:32.662 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.662 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.662 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:32.662 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386755+0000", 2024-09-12T22:33:32.662 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:32.662 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.662 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.662 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:32.662 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386756+0000", 2024-09-12T22:33:32.662 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4499999999999997e-07 2024-09-12T22:33:32.663 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.663 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.663 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:32.663 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386763+0000", 2024-09-12T22:33:32.663 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.6459999999999993e-06 2024-09-12T22:33:32.663 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.663 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.663 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:32.663 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386770+0000", 2024-09-12T22:33:32.663 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.19e-06 2024-09-12T22:33:32.663 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.663 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.663 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:32.663 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386775+0000", 2024-09-12T22:33:32.664 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9640000000000002e-06 2024-09-12T22:33:32.664 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.664 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.664 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:32.664 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.428489+0000", 2024-09-12T22:33:32.664 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.041714539000000002 2024-09-12T22:33:32.664 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.664 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.664 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:32.664 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.428535+0000", 2024-09-12T22:33:32.664 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5658999999999998e-05 2024-09-12T22:33:32.664 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.664 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.665 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:32.665 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.431353+0000", 2024-09-12T22:33:32.665 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0028186270000000002 2024-09-12T22:33:32.665 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.665 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.665 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:32.665 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.431385+0000", 2024-09-12T22:33:32.665 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.1374000000000001e-05 2024-09-12T22:33:32.665 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.665 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.665 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:32.665 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.431424+0000", 2024-09-12T22:33:32.665 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9490000000000003e-05 2024-09-12T22:33:32.666 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:32.666 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:32.666 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:32.666 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.666 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.666 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3067 3.2 3:42569fed:::200.00000011:head [write 3920900~2245 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:33:32.666 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:19.386781+0000", 2024-09-12T22:33:32.666 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 13.213148389000001, 2024-09-12T22:33:32.666 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.044711322999999997, 2024-09-12T22:33:32.666 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:32.666 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:32.666 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:32.667 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:32.667 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.667 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:32.667 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386781+0000", 2024-09-12T22:33:32.667 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:32.667 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.667 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.667 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:32.667 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386781+0000", 2024-09-12T22:33:32.667 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:32.667 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.667 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.667 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:32.667 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386782+0000", 2024-09-12T22:33:32.668 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9900000000000001e-07 2024-09-12T22:33:32.668 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.668 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.668 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:32.668 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386795+0000", 2024-09-12T22:33:32.668 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2864000000000001e-05 2024-09-12T22:33:32.668 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.668 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.668 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:32.668 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386801+0000", 2024-09-12T22:33:32.668 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.3589999999999996e-06 2024-09-12T22:33:32.668 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.668 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.669 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:32.669 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386805+0000", 2024-09-12T22:33:32.669 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6190000000000002e-06 2024-09-12T22:33:32.669 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.669 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.669 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:32.669 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.429080+0000", 2024-09-12T22:33:32.669 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.042274027999999998 2024-09-12T22:33:32.669 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.669 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.669 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:32.669 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.429131+0000", 2024-09-12T22:33:32.669 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1715000000000002e-05 2024-09-12T22:33:32.670 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.670 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.670 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:32.670 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.431432+0000", 2024-09-12T22:33:32.670 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0023007489999999999 2024-09-12T22:33:32.670 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.670 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.670 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:32.670 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.431458+0000", 2024-09-12T22:33:32.670 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.603e-05 2024-09-12T22:33:32.670 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.670 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.670 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:32.670 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.431493+0000", 2024-09-12T22:33:32.671 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4560000000000001e-05 2024-09-12T22:33:32.671 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:32.671 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:32.671 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:32.671 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.671 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.671 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3068 3.2 3:42569fed:::200.00000011:head [write 3923145~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:33:32.671 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:19.386812+0000", 2024-09-12T22:33:32.671 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 13.213117629999999, 2024-09-12T22:33:32.671 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.045559559999999999, 2024-09-12T22:33:32.671 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:32.671 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:32.671 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:32.672 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:32.672 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.672 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:32.672 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386812+0000", 2024-09-12T22:33:32.672 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:32.672 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.672 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.672 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:32.672 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386812+0000", 2024-09-12T22:33:32.672 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:32.672 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.672 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.672 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:32.673 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386812+0000", 2024-09-12T22:33:32.673 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.01e-07 2024-09-12T22:33:32.673 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.673 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.673 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:32.673 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386823+0000", 2024-09-12T22:33:32.673 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1038e-05 2024-09-12T22:33:32.673 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.673 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.673 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:32.673 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386830+0000", 2024-09-12T22:33:32.673 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.5409999999999997e-06 2024-09-12T22:33:32.673 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.674 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.674 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:32.674 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386835+0000", 2024-09-12T22:33:32.674 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.091e-06 2024-09-12T22:33:32.674 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.674 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.674 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:32.674 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.429460+0000", 2024-09-12T22:33:32.674 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.042625333000000001 2024-09-12T22:33:32.674 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.674 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.674 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:32.674 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.429506+0000", 2024-09-12T22:33:32.674 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5299000000000001e-05 2024-09-12T22:33:32.675 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.675 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.675 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:32.675 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.432283+0000", 2024-09-12T22:33:32.675 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0027776799999999998 2024-09-12T22:33:32.675 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.675 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.675 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:32.675 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.432315+0000", 2024-09-12T22:33:32.675 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.1401e-05 2024-09-12T22:33:32.675 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.675 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.675 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:32.676 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.432372+0000", 2024-09-12T22:33:32.676 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.6776e-05 2024-09-12T22:33:32.676 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:32.676 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:32.676 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:32.676 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.676 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.676 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3069 3.2 3:42569fed:::200.00000011:head [write 3924544~2246 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:33:32.676 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:19.386842+0000", 2024-09-12T22:33:32.676 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 13.21308773, 2024-09-12T22:33:32.676 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.045596166, 2024-09-12T22:33:32.676 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:32.676 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:32.677 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:32.677 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:32.677 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.677 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:32.677 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386842+0000", 2024-09-12T22:33:32.677 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:32.677 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.677 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.677 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:32.677 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386842+0000", 2024-09-12T22:33:32.677 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:32.677 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.677 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.678 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:32.678 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386842+0000", 2024-09-12T22:33:32.678 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5200000000000002e-07 2024-09-12T22:33:32.678 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.678 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.678 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:32.678 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386845+0000", 2024-09-12T22:33:32.678 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8820000000000001e-06 2024-09-12T22:33:32.678 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.678 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.678 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:32.678 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386851+0000", 2024-09-12T22:33:32.678 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9540000000000001e-06 2024-09-12T22:33:32.679 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.679 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.679 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:32.679 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386856+0000", 2024-09-12T22:33:32.679 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5159999999999996e-06 2024-09-12T22:33:32.679 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.679 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.679 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:32.679 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.430043+0000", 2024-09-12T22:33:32.679 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.043186930999999998 2024-09-12T22:33:32.679 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.679 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.679 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:32.679 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.430086+0000", 2024-09-12T22:33:32.680 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3844999999999998e-05 2024-09-12T22:33:32.680 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.680 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.680 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:32.680 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.432379+0000", 2024-09-12T22:33:32.680 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0022922049999999999 2024-09-12T22:33:32.680 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.680 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.680 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:32.680 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.432405+0000", 2024-09-12T22:33:32.680 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5877999999999999e-05 2024-09-12T22:33:32.680 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.680 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.681 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:32.681 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.432438+0000", 2024-09-12T22:33:32.681 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3503000000000001e-05 2024-09-12T22:33:32.681 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:32.681 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:32.681 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:32.681 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.681 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.681 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3070 3.2 3:42569fed:::200.00000011:head [write 3926790~2768 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:33:32.681 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:19.387280+0000", 2024-09-12T22:33:32.681 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 13.212649561999999, 2024-09-12T22:33:32.681 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.04692201, 2024-09-12T22:33:32.681 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:32.682 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:32.682 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:32.682 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:32.682 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.682 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:32.682 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.387280+0000", 2024-09-12T22:33:32.682 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:32.682 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.682 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.682 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:32.682 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.387280+0000", 2024-09-12T22:33:32.682 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:32.682 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.682 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.683 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:32.683 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.387281+0000", 2024-09-12T22:33:32.683 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4300000000000002e-07 2024-09-12T22:33:32.683 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.683 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.683 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:32.683 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.387285+0000", 2024-09-12T22:33:32.683 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2570000000000001e-06 2024-09-12T22:33:32.683 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.683 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.683 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:32.683 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.387293+0000", 2024-09-12T22:33:32.683 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0209999999999999e-06 2024-09-12T22:33:32.684 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.684 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.684 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:32.684 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.387299+0000", 2024-09-12T22:33:32.684 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.6930000000000004e-06 2024-09-12T22:33:32.684 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.684 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.684 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:32.684 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.430441+0000", 2024-09-12T22:33:32.684 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.043141789999999999 2024-09-12T22:33:32.684 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.684 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.684 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:32.684 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.430484+0000", 2024-09-12T22:33:32.685 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3745000000000002e-05 2024-09-12T22:33:32.685 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.685 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.685 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:32.685 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.434132+0000", 2024-09-12T22:33:32.685 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00364818 2024-09-12T22:33:32.685 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.685 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.685 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:32.685 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.434163+0000", 2024-09-12T22:33:32.685 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0599000000000003e-05 2024-09-12T22:33:32.685 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.685 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.685 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:32.686 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.434202+0000", 2024-09-12T22:33:32.686 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.8982e-05 2024-09-12T22:33:32.686 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:32.686 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:32.686 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:32.686 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.686 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.686 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3071 3.2 3:42569fed:::200.00000011:head [write 3929558~3203 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:33:32.686 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:19.387860+0000", 2024-09-12T22:33:32.686 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 13.212069531999999, 2024-09-12T22:33:32.686 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.049590902999999999, 2024-09-12T22:33:32.686 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:32.686 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:32.687 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:32.687 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:32.687 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.687 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:32.687 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.387860+0000", 2024-09-12T22:33:32.687 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:32.687 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.687 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.687 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:32.687 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.387860+0000", 2024-09-12T22:33:32.687 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:32.687 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.687 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.687 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:32.688 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.387861+0000", 2024-09-12T22:33:32.688 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5099999999999999e-07 2024-09-12T22:33:32.688 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.688 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.688 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:32.688 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.387865+0000", 2024-09-12T22:33:32.688 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2629999999999997e-06 2024-09-12T22:33:32.688 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.688 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.688 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:32.688 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.387875+0000", 2024-09-12T22:33:32.688 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0256e-05 2024-09-12T22:33:32.688 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.689 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.689 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:32.689 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.387881+0000", 2024-09-12T22:33:32.689 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.947e-06 2024-09-12T22:33:32.689 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.689 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.689 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:32.689 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.430930+0000", 2024-09-12T22:33:32.689 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.043048386000000001 2024-09-12T22:33:32.689 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.689 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.689 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:32.689 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.430976+0000", 2024-09-12T22:33:32.690 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6408e-05 2024-09-12T22:33:32.690 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.690 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.690 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:32.690 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.437377+0000", 2024-09-12T22:33:32.690 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0064010719999999998 2024-09-12T22:33:32.690 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.690 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.690 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:32.690 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.437409+0000", 2024-09-12T22:33:32.690 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2054999999999997e-05 2024-09-12T22:33:32.690 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.690 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.690 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:32.691 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.437451+0000", 2024-09-12T22:33:32.691 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1764999999999997e-05 2024-09-12T22:33:32.691 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:32.691 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:32.691 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:32.691 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.691 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.691 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3072 3.2 3:42569fed:::200.00000011:head [write 3932761~2786 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:33:32.691 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:19.388005+0000", 2024-09-12T22:33:32.691 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 13.211924433, 2024-09-12T22:33:32.691 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.049514177999999999, 2024-09-12T22:33:32.691 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:32.691 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:32.692 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:32.692 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:32.692 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.692 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:32.692 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.388005+0000", 2024-09-12T22:33:32.692 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:32.692 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.692 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.692 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:32.692 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.388005+0000", 2024-09-12T22:33:32.692 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:32.692 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.692 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.693 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:32.693 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.388006+0000", 2024-09-12T22:33:32.693 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.1799999999999995e-07 2024-09-12T22:33:32.693 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.693 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.693 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:32.693 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.388009+0000", 2024-09-12T22:33:32.693 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.574e-06 2024-09-12T22:33:32.693 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.693 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.693 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:32.693 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.388017+0000", 2024-09-12T22:33:32.693 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3170000000000004e-06 2024-09-12T22:33:32.694 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.694 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.694 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:32.694 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.388022+0000", 2024-09-12T22:33:32.694 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9910000000000002e-06 2024-09-12T22:33:32.694 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.694 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.694 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:32.694 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.431522+0000", 2024-09-12T22:33:32.694 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0435001 2024-09-12T22:33:32.694 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.694 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.694 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:32.695 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.431567+0000", 2024-09-12T22:33:32.695 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4734000000000002e-05 2024-09-12T22:33:32.695 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.695 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.695 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:32.695 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.437458+0000", 2024-09-12T22:33:32.695 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00589166 2024-09-12T22:33:32.695 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.695 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.695 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:32.695 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.437484+0000", 2024-09-12T22:33:32.695 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5622999999999998e-05 2024-09-12T22:33:32.695 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.695 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.696 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:32.696 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.437519+0000", 2024-09-12T22:33:32.696 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.5561000000000001e-05 2024-09-12T22:33:32.696 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:32.696 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:32.696 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:32.696 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.696 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.696 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3073 3.2 3:42569fed:::200.00000011:head [write 3935547~1924 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:33:32.696 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:19.389181+0000", 2024-09-12T22:33:32.696 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 13.210748271, 2024-09-12T22:33:32.696 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.048402300000000002, 2024-09-12T22:33:32.696 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:32.697 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:32.697 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:32.697 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:32.697 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.697 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:32.697 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.389181+0000", 2024-09-12T22:33:32.697 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:32.697 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.697 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.697 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:32.697 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.389181+0000", 2024-09-12T22:33:32.697 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:32.697 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.697 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.698 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:32.698 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.389182+0000", 2024-09-12T22:33:32.698 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7700000000000004e-07 2024-09-12T22:33:32.698 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.698 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.698 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:32.698 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.389191+0000", 2024-09-12T22:33:32.698 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1120000000000002e-06 2024-09-12T22:33:32.698 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.698 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.698 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:32.698 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.389203+0000", 2024-09-12T22:33:32.698 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.146e-05 2024-09-12T22:33:32.699 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.699 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.699 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:32.699 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.389209+0000", 2024-09-12T22:33:32.699 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9989999999999997e-06 2024-09-12T22:33:32.699 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.699 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.699 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:32.699 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.431890+0000", 2024-09-12T22:33:32.699 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.042681251000000003 2024-09-12T22:33:32.699 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.699 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.699 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:32.699 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.431935+0000", 2024-09-12T22:33:32.700 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5166000000000001e-05 2024-09-12T22:33:32.700 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.700 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.700 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:32.700 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.437526+0000", 2024-09-12T22:33:32.700 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0055910489999999998 2024-09-12T22:33:32.700 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.700 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.700 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:32.700 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.437550+0000", 2024-09-12T22:33:32.700 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4134999999999998e-05 2024-09-12T22:33:32.700 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.700 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.701 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:32.701 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.437584+0000", 2024-09-12T22:33:32.701 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3451000000000002e-05 2024-09-12T22:33:32.701 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:32.701 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:32.701 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:32.701 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.701 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.701 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3074 3.2 3:42569fed:::200.00000011:head [write 3937471~7660 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:33:32.701 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:19.390512+0000", 2024-09-12T22:33:32.701 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 13.209417148, 2024-09-12T22:33:32.701 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.047134045999999999, 2024-09-12T22:33:32.701 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:32.701 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:32.702 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:32.702 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:32.702 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.702 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:32.702 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.390512+0000", 2024-09-12T22:33:32.702 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:32.702 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.702 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.702 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:32.702 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.390512+0000", 2024-09-12T22:33:32.702 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:32.702 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.702 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.702 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:32.703 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.390513+0000", 2024-09-12T22:33:32.703 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.7699999999999992e-07 2024-09-12T22:33:32.703 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.703 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.703 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:32.703 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.390522+0000", 2024-09-12T22:33:32.703 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0390000000000005e-06 2024-09-12T22:33:32.703 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.703 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.703 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:32.703 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.390530+0000", 2024-09-12T22:33:32.703 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.8349999999999993e-06 2024-09-12T22:33:32.703 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.704 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.704 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:32.704 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.390537+0000", 2024-09-12T22:33:32.704 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.1850000000000001e-06 2024-09-12T22:33:32.704 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.704 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.704 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:32.704 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.432468+0000", 2024-09-12T22:33:32.704 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.041931883000000003 2024-09-12T22:33:32.704 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.704 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.704 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:32.704 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.432512+0000", 2024-09-12T22:33:32.705 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4054999999999997e-05 2024-09-12T22:33:32.705 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.705 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.705 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:32.705 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.437590+0000", 2024-09-12T22:33:32.705 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0050777230000000001 2024-09-12T22:33:32.705 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.705 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.705 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:32.705 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.437613+0000", 2024-09-12T22:33:32.705 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.2693000000000001e-05 2024-09-12T22:33:32.705 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:32.706 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:32.706 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:32.706 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.437647+0000", 2024-09-12T22:33:32.706 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3655999999999998e-05 2024-09-12T22:33:32.706 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:32.706 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:32.706 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:32.706 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:32.706 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:32.706 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:33:32.708 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:33:32.708 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:32.707+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:32.809 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:32.808+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:32.813 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-09-12T22:33:32.814 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-09-12T22:33:32.814 INFO:teuthology.orchestra.run.smithi163.stdout: "num_ops": 0 2024-09-12T22:33:32.814 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-09-12T22:33:32.822 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:33:32.909 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:32.909+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:32.924 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-09-12T22:33:32.925 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-09-12T22:33:32.925 INFO:teuthology.orchestra.run.smithi163.stdout: "complaint_time": 30, 2024-09-12T22:33:32.925 INFO:teuthology.orchestra.run.smithi163.stdout: "num_blocked_ops": 0 2024-09-12T22:33:32.925 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-09-12T22:33:32.933 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:33:33.011 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:33.010+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:33.038 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-09-12T22:33:33.038 INFO:teuthology.orchestra.run.smithi163.stdout: "size": 20, 2024-09-12T22:33:33.039 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 600, 2024-09-12T22:33:33.039 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2024-09-12T22:33:33.039 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.039 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-09-12T22:33:33.039 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:27.254459+0000", 2024-09-12T22:33:33.039 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 125.781886546, 2024-09-12T22:33:33.039 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.37816283899999997, 2024-09-12T22:33:33.039 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:33.039 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:33.039 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:33.039 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:33.039 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:33:33.039 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:33:33.040 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 1 2024-09-12T22:33:33.040 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.040 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:33.040 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.040 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:33.040 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254459+0000", 2024-09-12T22:33:33.040 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:33.040 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.040 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.040 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:33.040 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254459+0000", 2024-09-12T22:33:33.040 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:33.040 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.041 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.041 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:33.041 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254460+0000", 2024-09-12T22:33:33.041 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1739999999999999e-06 2024-09-12T22:33:33.041 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.041 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.041 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:33.041 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254472+0000", 2024-09-12T22:33:33.041 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2207e-05 2024-09-12T22:33:33.041 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.041 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.041 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:33.041 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254483+0000", 2024-09-12T22:33:33.042 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0631999999999999e-05 2024-09-12T22:33:33.042 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.042 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.042 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:33.042 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254492+0000", 2024-09-12T22:33:33.042 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3670000000000003e-06 2024-09-12T22:33:33.042 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.042 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.042 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:33.042 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254551+0000", 2024-09-12T22:33:33.042 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8687999999999998e-05 2024-09-12T22:33:33.042 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.042 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.043 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for peered", 2024-09-12T22:33:33.043 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254562+0000", 2024-09-12T22:33:33.043 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1249e-05 2024-09-12T22:33:33.043 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.043 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.043 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:33.043 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.631211+0000", 2024-09-12T22:33:33.043 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.376649018 2024-09-12T22:33:33.043 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.043 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.043 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:33.043 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.631345+0000", 2024-09-12T22:33:33.043 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013378700000000001 2024-09-12T22:33:33.044 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.044 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.044 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:33:33.044 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.631479+0000", 2024-09-12T22:33:33.044 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013352399999999999 2024-09-12T22:33:33.044 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.044 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.044 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:33.044 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632324+0000", 2024-09-12T22:33:33.044 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00084508100000000002 2024-09-12T22:33:33.044 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.045 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.045 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:33.045 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632548+0000", 2024-09-12T22:33:33.045 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000224329 2024-09-12T22:33:33.045 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.045 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.045 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:33.045 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632591+0000", 2024-09-12T22:33:33.045 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2564000000000001e-05 2024-09-12T22:33:33.045 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.045 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.045 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:33.045 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632622+0000", 2024-09-12T22:33:33.046 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1219e-05 2024-09-12T22:33:33.046 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:33.046 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:33.046 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:33.046 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.046 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.046 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4490.0:9871 4.35 4:ad66404a:::10000002d4d.00000000:head [write 0~6507] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:33:33.046 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:09.472309+0000", 2024-09-12T22:33:33.046 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 23.564036269999999, 2024-09-12T22:33:33.046 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.080251445000000005, 2024-09-12T22:33:33.046 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:33.046 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:33.046 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:33.046 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:33.047 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4490", 2024-09-12T22:33:33.047 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:33.047 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 9871 2024-09-12T22:33:33.047 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.047 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:33.047 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.047 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:33.047 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.472309+0000", 2024-09-12T22:33:33.047 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:33.047 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.047 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.047 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:33.048 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.472309+0000", 2024-09-12T22:33:33.048 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:33.048 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.048 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.048 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:33.048 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.472310+0000", 2024-09-12T22:33:33.048 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3799999999999996e-07 2024-09-12T22:33:33.048 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.048 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.049 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:33.049 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.472318+0000", 2024-09-12T22:33:33.049 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.8099999999999998e-06 2024-09-12T22:33:33.049 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.049 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.049 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:33.049 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.472328+0000", 2024-09-12T22:33:33.049 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0359e-05 2024-09-12T22:33:33.049 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.049 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.049 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:33.049 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.472334+0000", 2024-09-12T22:33:33.049 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.0109999999999997e-06 2024-09-12T22:33:33.050 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.050 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.050 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:33.050 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.472382+0000", 2024-09-12T22:33:33.050 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.7311000000000002e-05 2024-09-12T22:33:33.050 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.050 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.050 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:33.050 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.472497+0000", 2024-09-12T22:33:33.050 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011537800000000001 2024-09-12T22:33:33.050 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.050 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.051 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:33.051 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.472617+0000", 2024-09-12T22:33:33.051 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011989600000000001 2024-09-12T22:33:33.051 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.051 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.051 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:33.051 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473149+0000", 2024-09-12T22:33:33.051 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00053227999999999999 2024-09-12T22:33:33.051 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.051 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.051 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:33.051 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.552479+0000", 2024-09-12T22:33:33.051 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.079329541000000003 2024-09-12T22:33:33.052 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.052 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.052 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:33.052 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.552525+0000", 2024-09-12T22:33:33.052 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6421000000000002e-05 2024-09-12T22:33:33.052 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.052 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.052 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:33.052 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.552561+0000", 2024-09-12T22:33:33.052 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5599999999999998e-05 2024-09-12T22:33:33.052 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:33.052 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:33.052 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:33.053 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.053 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.053 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4490.0:9872 4.2c 4:3602c8d3:::10000002d4e.00000000:head [write 0~1178] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:33:33.053 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:09.473085+0000", 2024-09-12T22:33:33.053 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 23.563260966000001, 2024-09-12T22:33:33.053 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.079631104999999994, 2024-09-12T22:33:33.053 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:33.053 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:33.053 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:33.053 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:33.053 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4490", 2024-09-12T22:33:33.053 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:33.054 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 9872 2024-09-12T22:33:33.054 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.054 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:33.054 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.054 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:33.054 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473085+0000", 2024-09-12T22:33:33.054 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:33.054 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.054 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.054 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:33.054 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473085+0000", 2024-09-12T22:33:33.054 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:33.054 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.055 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.055 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:33.055 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473085+0000", 2024-09-12T22:33:33.055 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3600000000000004e-07 2024-09-12T22:33:33.055 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.055 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.055 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:33.055 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473088+0000", 2024-09-12T22:33:33.055 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.005e-06 2024-09-12T22:33:33.055 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.055 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.055 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:33.055 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473095+0000", 2024-09-12T22:33:33.056 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3950000000000003e-06 2024-09-12T22:33:33.056 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.056 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.056 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:33.056 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473100+0000", 2024-09-12T22:33:33.056 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5460000000000002e-06 2024-09-12T22:33:33.056 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.056 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.056 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:33.056 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473138+0000", 2024-09-12T22:33:33.056 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8244999999999997e-05 2024-09-12T22:33:33.056 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.056 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.057 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:33.057 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473216+0000", 2024-09-12T22:33:33.057 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.7756000000000006e-05 2024-09-12T22:33:33.057 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.057 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.057 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:33.057 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473291+0000", 2024-09-12T22:33:33.057 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5110000000000004e-05 2024-09-12T22:33:33.057 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.057 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.057 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:33.057 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473736+0000", 2024-09-12T22:33:33.057 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00044486500000000002 2024-09-12T22:33:33.058 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.058 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.058 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:33.058 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.552637+0000", 2024-09-12T22:33:33.058 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.078900782000000003 2024-09-12T22:33:33.058 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.058 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.058 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:33.058 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.552680+0000", 2024-09-12T22:33:33.058 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3047999999999998e-05 2024-09-12T22:33:33.058 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.058 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.058 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:33.059 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.552716+0000", 2024-09-12T22:33:33.059 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5816999999999999e-05 2024-09-12T22:33:33.059 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:33.059 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:33.059 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:33.059 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.059 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.059 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4490.0:9873 4.2c 4:372c52ff:::10000002d4f.00000000:head [write 0~1230] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:33:33.059 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:09.473878+0000", 2024-09-12T22:33:33.059 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 23.562467503000001, 2024-09-12T22:33:33.059 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.079036047999999998, 2024-09-12T22:33:33.059 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:33.059 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:33.059 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:33.060 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:33.060 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4490", 2024-09-12T22:33:33.060 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:33.060 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 9873 2024-09-12T22:33:33.060 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.060 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:33.060 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.060 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:33.060 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473878+0000", 2024-09-12T22:33:33.060 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:33.060 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.060 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.060 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:33.061 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473878+0000", 2024-09-12T22:33:33.061 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:33.061 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.061 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.061 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:33.061 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473879+0000", 2024-09-12T22:33:33.061 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9100000000000004e-07 2024-09-12T22:33:33.061 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.061 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.061 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:33.061 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473882+0000", 2024-09-12T22:33:33.061 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.405e-06 2024-09-12T22:33:33.061 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.062 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.062 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:33.062 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473889+0000", 2024-09-12T22:33:33.062 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7519999999999999e-06 2024-09-12T22:33:33.062 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.062 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.062 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:33.062 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473893+0000", 2024-09-12T22:33:33.062 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9310000000000001e-06 2024-09-12T22:33:33.063 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.063 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.063 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:33.063 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473922+0000", 2024-09-12T22:33:33.063 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9346999999999999e-05 2024-09-12T22:33:33.063 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.063 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.063 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:33.063 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474000+0000", 2024-09-12T22:33:33.063 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.7972000000000005e-05 2024-09-12T22:33:33.063 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.063 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.063 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:33.063 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474072+0000", 2024-09-12T22:33:33.064 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1960999999999998e-05 2024-09-12T22:33:33.064 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.064 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.064 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:33.064 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474470+0000", 2024-09-12T22:33:33.064 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00039803400000000002 2024-09-12T22:33:33.064 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.064 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.064 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:33.064 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.552814+0000", 2024-09-12T22:33:33.064 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.078344164999999993 2024-09-12T22:33:33.064 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.064 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.065 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:33.065 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.552875+0000", 2024-09-12T22:33:33.065 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1008999999999998e-05 2024-09-12T22:33:33.065 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.065 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.065 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:33.065 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.552914+0000", 2024-09-12T22:33:33.065 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8881000000000003e-05 2024-09-12T22:33:33.065 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:33.065 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:33.065 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:33.065 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.065 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.066 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4490.0:9874 4.1b 4:db19d96a:::10000002d50.00000000:head [write 0~1088] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:33:33.066 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:09.474673+0000", 2024-09-12T22:33:33.066 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 23.561672510000001, 2024-09-12T22:33:33.066 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.080314317999999996, 2024-09-12T22:33:33.066 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:33.066 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:33.066 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:33.066 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:33.066 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4490", 2024-09-12T22:33:33.066 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:33.066 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 9874 2024-09-12T22:33:33.067 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.067 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:33.067 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.067 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:33.067 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474673+0000", 2024-09-12T22:33:33.067 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:33.067 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.067 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.067 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:33.067 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474673+0000", 2024-09-12T22:33:33.068 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:33.068 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.068 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.068 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:33.068 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474674+0000", 2024-09-12T22:33:33.068 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6199999999999998e-07 2024-09-12T22:33:33.068 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.068 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.068 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:33.068 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474677+0000", 2024-09-12T22:33:33.068 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.224e-06 2024-09-12T22:33:33.068 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.069 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.069 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:33.069 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474683+0000", 2024-09-12T22:33:33.069 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.3160000000000002e-06 2024-09-12T22:33:33.069 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.069 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.069 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:33.069 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474687+0000", 2024-09-12T22:33:33.069 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7869999999999999e-06 2024-09-12T22:33:33.069 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.069 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.069 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:33.069 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474730+0000", 2024-09-12T22:33:33.070 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3309000000000002e-05 2024-09-12T22:33:33.070 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.070 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.070 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:33.070 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474845+0000", 2024-09-12T22:33:33.070 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114306 2024-09-12T22:33:33.070 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.070 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.070 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:33.070 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474970+0000", 2024-09-12T22:33:33.070 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000125096 2024-09-12T22:33:33.070 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.071 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.071 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:33.071 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.475621+0000", 2024-09-12T22:33:33.071 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00065124900000000001 2024-09-12T22:33:33.071 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.071 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.071 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:33.071 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.554885+0000", 2024-09-12T22:33:33.071 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.079264055 2024-09-12T22:33:33.071 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.071 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.071 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:33.071 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.554942+0000", 2024-09-12T22:33:33.072 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7284000000000002e-05 2024-09-12T22:33:33.072 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.072 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.072 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:33.072 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.554987+0000", 2024-09-12T22:33:33.072 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5130000000000003e-05 2024-09-12T22:33:33.072 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:33.072 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:33.072 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:33.072 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.072 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.072 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4490.0:12220 4.2b 4:d55bfd66:::10000003169.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-12T22:33:33.073 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.391333+0000", 2024-09-12T22:33:33.073 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 18.645012367, 2024-09-12T22:33:33.073 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.088669550999999999, 2024-09-12T22:33:33.073 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:33.073 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:33.073 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:33.073 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:33.073 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4490", 2024-09-12T22:33:33.073 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:33.073 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 12220 2024-09-12T22:33:33.073 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.073 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:33.073 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.074 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:33.074 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.391333+0000", 2024-09-12T22:33:33.074 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:33.074 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.074 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.074 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:33.074 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.391333+0000", 2024-09-12T22:33:33.074 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:33.074 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.074 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.074 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:33.074 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.391334+0000", 2024-09-12T22:33:33.074 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3099999999999997e-07 2024-09-12T22:33:33.075 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.075 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.075 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:33.075 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398373+0000", 2024-09-12T22:33:33.075 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0070386670000000002 2024-09-12T22:33:33.075 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.075 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.075 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:33.075 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398384+0000", 2024-09-12T22:33:33.075 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1338999999999999e-05 2024-09-12T22:33:33.075 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.075 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.075 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:33.076 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398389+0000", 2024-09-12T22:33:33.076 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3650000000000003e-06 2024-09-12T22:33:33.076 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.076 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.076 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:33.076 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.456308+0000", 2024-09-12T22:33:33.076 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.057918931 2024-09-12T22:33:33.076 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.076 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.076 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:33.076 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.456425+0000", 2024-09-12T22:33:33.076 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000116452 2024-09-12T22:33:33.076 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.077 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.077 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:33.077 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.456536+0000", 2024-09-12T22:33:33.077 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000111839 2024-09-12T22:33:33.077 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.077 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.077 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:33.077 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.465335+0000", 2024-09-12T22:33:33.077 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0087984980000000001 2024-09-12T22:33:33.077 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.077 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.077 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:33.077 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.479950+0000", 2024-09-12T22:33:33.078 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.01461552 2024-09-12T22:33:33.078 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.078 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.078 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:33.078 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.479983+0000", 2024-09-12T22:33:33.078 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2126999999999999e-05 2024-09-12T22:33:33.078 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.078 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.078 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:33.078 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.480003+0000", 2024-09-12T22:33:33.078 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0081999999999998e-05 2024-09-12T22:33:33.078 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:33.078 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:33.079 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:33.079 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.079 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.079 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1208 3.13 3:cb3d3880:::200.0000000d:head [write 1009846~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:33.079 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.398459+0000", 2024-09-12T22:33:33.079 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 18.637886801000001, 2024-09-12T22:33:33.079 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.078093931000000005, 2024-09-12T22:33:33.079 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:33.079 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:33.079 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:33.079 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:33.079 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.079 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:33.080 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398459+0000", 2024-09-12T22:33:33.080 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:33.080 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.080 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.080 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:33.080 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398459+0000", 2024-09-12T22:33:33.080 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:33.080 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.080 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.080 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:33.080 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398459+0000", 2024-09-12T22:33:33.080 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8100000000000003e-07 2024-09-12T22:33:33.080 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.081 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.081 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:33.081 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398462+0000", 2024-09-12T22:33:33.081 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3700000000000002e-06 2024-09-12T22:33:33.081 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.081 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.081 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:33.081 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398469+0000", 2024-09-12T22:33:33.081 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2320000000000004e-06 2024-09-12T22:33:33.081 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.081 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.081 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:33.081 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398472+0000", 2024-09-12T22:33:33.081 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.658e-06 2024-09-12T22:33:33.082 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.082 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.082 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:33.082 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.456690+0000", 2024-09-12T22:33:33.082 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.058217615 2024-09-12T22:33:33.082 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.082 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.082 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:33.082 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.456731+0000", 2024-09-12T22:33:33.082 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0815000000000001e-05 2024-09-12T22:33:33.082 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.082 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.082 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:33.083 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.456793+0000", 2024-09-12T22:33:33.083 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1796000000000003e-05 2024-09-12T22:33:33.083 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.083 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.083 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:33.083 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.461412+0000", 2024-09-12T22:33:33.083 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0046188560000000002 2024-09-12T22:33:33.083 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.083 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.083 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:33.083 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476429+0000", 2024-09-12T22:33:33.083 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.015017943000000001 2024-09-12T22:33:33.083 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.084 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.084 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:33.084 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476499+0000", 2024-09-12T22:33:33.084 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9047000000000005e-05 2024-09-12T22:33:33.084 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.084 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.084 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:33.084 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476553+0000", 2024-09-12T22:33:33.084 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4117999999999999e-05 2024-09-12T22:33:33.084 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:33.084 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:33.084 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:33.084 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.085 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.085 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1209 3.13 3:cb3d3880:::200.0000000d:head [write 1011245~5867 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:33.085 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.398677+0000", 2024-09-12T22:33:33.085 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 18.637668244, 2024-09-12T22:33:33.085 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.077995698000000002, 2024-09-12T22:33:33.085 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:33.085 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:33.085 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:33.085 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:33.085 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.085 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:33.085 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398677+0000", 2024-09-12T22:33:33.085 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:33.086 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.086 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.086 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:33.086 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398677+0000", 2024-09-12T22:33:33.086 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:33.086 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.086 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.086 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:33.086 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398678+0000", 2024-09-12T22:33:33.086 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5199999999999995e-07 2024-09-12T22:33:33.086 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.086 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.086 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:33.087 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398686+0000", 2024-09-12T22:33:33.087 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0579999999999998e-06 2024-09-12T22:33:33.087 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.087 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.087 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:33.087 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398695+0000", 2024-09-12T22:33:33.087 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.1409999999999994e-06 2024-09-12T22:33:33.087 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.087 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.087 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:33.087 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398703+0000", 2024-09-12T22:33:33.087 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4379999999999998e-06 2024-09-12T22:33:33.087 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.088 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.088 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:33.088 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.457051+0000", 2024-09-12T22:33:33.088 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.058348358000000003 2024-09-12T22:33:33.088 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.088 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.088 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:33.088 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.457096+0000", 2024-09-12T22:33:33.088 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4428000000000002e-05 2024-09-12T22:33:33.088 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.088 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.088 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:33.088 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.457162+0000", 2024-09-12T22:33:33.089 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6298999999999997e-05 2024-09-12T22:33:33.089 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.089 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.089 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:33.089 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.461416+0000", 2024-09-12T22:33:33.089 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0042539980000000002 2024-09-12T22:33:33.089 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.089 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.089 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:33.089 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476610+0000", 2024-09-12T22:33:33.089 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.015193879 2024-09-12T22:33:33.089 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.089 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.090 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:33.090 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476640+0000", 2024-09-12T22:33:33.090 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0648000000000002e-05 2024-09-12T22:33:33.090 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.090 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.090 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:33.090 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476673+0000", 2024-09-12T22:33:33.090 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2598999999999997e-05 2024-09-12T22:33:33.090 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:33.090 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:33.090 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:33.090 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.090 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.091 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1210 3.13 3:cb3d3880:::200.0000000d:head [write 1017112~1958 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:33.091 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.398713+0000", 2024-09-12T22:33:33.091 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 18.637632921000002, 2024-09-12T22:33:33.091 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.078118317000000007, 2024-09-12T22:33:33.091 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:33.091 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:33.091 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:33.091 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:33.091 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.091 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:33.091 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398713+0000", 2024-09-12T22:33:33.091 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:33.091 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.091 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.092 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:33.092 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398713+0000", 2024-09-12T22:33:33.092 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:33.092 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.092 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.092 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:33.092 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398713+0000", 2024-09-12T22:33:33.092 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7599999999999998e-07 2024-09-12T22:33:33.092 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.092 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.092 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:33.092 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398718+0000", 2024-09-12T22:33:33.092 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8169999999999998e-06 2024-09-12T22:33:33.093 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.093 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.093 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:33.093 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398722+0000", 2024-09-12T22:33:33.093 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5249999999999999e-06 2024-09-12T22:33:33.093 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.093 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.093 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:33.093 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398726+0000", 2024-09-12T22:33:33.093 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5650000000000002e-06 2024-09-12T22:33:33.093 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.093 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.094 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:33.094 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.457644+0000", 2024-09-12T22:33:33.094 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.058918521000000001 2024-09-12T22:33:33.094 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.094 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.094 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:33.094 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.457724+0000", 2024-09-12T22:33:33.094 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9408999999999998e-05 2024-09-12T22:33:33.094 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.094 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.094 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:33.094 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.457821+0000", 2024-09-12T22:33:33.094 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.7015000000000005e-05 2024-09-12T22:33:33.095 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.095 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.095 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:33.095 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.461419+0000", 2024-09-12T22:33:33.095 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0035985309999999999 2024-09-12T22:33:33.095 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.095 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.095 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:33.095 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476726+0000", 2024-09-12T22:33:33.095 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.015306804 2024-09-12T22:33:33.096 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.096 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.096 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:33.096 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476787+0000", 2024-09-12T22:33:33.096 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1062000000000006e-05 2024-09-12T22:33:33.096 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.096 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.096 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:33.096 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476831+0000", 2024-09-12T22:33:33.096 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3692000000000001e-05 2024-09-12T22:33:33.096 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:33.096 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:33.096 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:33.097 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.097 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.097 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1211 3.13 3:cb3d3880:::200.0000000d:head [write 1019070~5873 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:33.097 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.400122+0000", 2024-09-12T22:33:33.097 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 18.636223203, 2024-09-12T22:33:33.097 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.076797146999999996, 2024-09-12T22:33:33.097 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:33.097 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:33.097 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:33.097 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:33.097 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.097 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:33.098 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.400122+0000", 2024-09-12T22:33:33.098 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:33.098 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.098 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.098 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:33.098 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.400122+0000", 2024-09-12T22:33:33.098 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:33.098 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.098 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.098 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:33.098 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.400123+0000", 2024-09-12T22:33:33.098 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2500000000000005e-07 2024-09-12T22:33:33.098 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.099 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.099 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:33.099 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.400129+0000", 2024-09-12T22:33:33.099 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.319e-06 2024-09-12T22:33:33.099 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.099 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.099 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:33.099 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.400139+0000", 2024-09-12T22:33:33.099 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.5200000000000003e-06 2024-09-12T22:33:33.099 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.099 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.099 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:33.099 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.400143+0000", 2024-09-12T22:33:33.100 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.437e-06 2024-09-12T22:33:33.100 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.100 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.100 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:33.100 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.458159+0000", 2024-09-12T22:33:33.100 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.058015960999999998 2024-09-12T22:33:33.100 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.100 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.100 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:33.100 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.458201+0000", 2024-09-12T22:33:33.100 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1693000000000002e-05 2024-09-12T22:33:33.100 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.100 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.100 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:33.101 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.458267+0000", 2024-09-12T22:33:33.101 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5687999999999999e-05 2024-09-12T22:33:33.101 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.101 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.101 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:33.101 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.461423+0000", 2024-09-12T22:33:33.101 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0031560730000000001 2024-09-12T22:33:33.101 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.101 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.101 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:33.101 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476868+0000", 2024-09-12T22:33:33.101 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.015445108000000001 2024-09-12T22:33:33.102 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.102 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.102 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:33.102 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476897+0000", 2024-09-12T22:33:33.102 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9433000000000001e-05 2024-09-12T22:33:33.102 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.102 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.102 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:33.102 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476919+0000", 2024-09-12T22:33:33.102 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.2189999999999999e-05 2024-09-12T22:33:33.102 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:33.102 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:33.102 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:33.102 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.102 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.103 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1212 3.13 3:cb3d3880:::200.0000000d:head [write 1024943~3866 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:33.103 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.401707+0000", 2024-09-12T22:33:33.103 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 18.634638998, 2024-09-12T22:33:33.103 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.075386625999999998, 2024-09-12T22:33:33.103 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:33.103 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:33.103 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:33.103 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:33.103 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.103 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:33.103 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.401707+0000", 2024-09-12T22:33:33.103 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:33.103 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.104 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.104 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:33.104 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.401707+0000", 2024-09-12T22:33:33.104 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:33.104 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.104 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.104 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:33.104 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.401707+0000", 2024-09-12T22:33:33.104 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7700000000000004e-07 2024-09-12T22:33:33.104 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.104 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.104 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:33.104 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.401713+0000", 2024-09-12T22:33:33.104 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6609999999999997e-06 2024-09-12T22:33:33.105 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.105 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.105 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:33.105 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.401726+0000", 2024-09-12T22:33:33.105 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.3088000000000001e-05 2024-09-12T22:33:33.105 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.105 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.105 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:33.105 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.401741+0000", 2024-09-12T22:33:33.105 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.5424e-05 2024-09-12T22:33:33.105 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.105 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.105 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:33.106 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.458853+0000", 2024-09-12T22:33:33.106 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.057111157000000003 2024-09-12T22:33:33.106 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.106 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.106 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:33.106 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.458898+0000", 2024-09-12T22:33:33.106 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5633999999999997e-05 2024-09-12T22:33:33.106 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.106 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.106 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:33.106 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.458972+0000", 2024-09-12T22:33:33.106 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3441000000000004e-05 2024-09-12T22:33:33.106 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.107 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.107 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:33.107 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.461426+0000", 2024-09-12T22:33:33.107 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0024542660000000001 2024-09-12T22:33:33.107 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.107 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.107 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:33.107 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476985+0000", 2024-09-12T22:33:33.107 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.015559513000000001 2024-09-12T22:33:33.107 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.107 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.107 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:33.107 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.477044+0000", 2024-09-12T22:33:33.107 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8156999999999999e-05 2024-09-12T22:33:33.108 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.108 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.108 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:33.108 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.477093+0000", 2024-09-12T22:33:33.108 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9607999999999997e-05 2024-09-12T22:33:33.108 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:33.108 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:33.108 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:33.108 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.108 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.108 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1213 3.13 3:cb3d3880:::200.0000000d:head [write 1028809~6329 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:33.108 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.403250+0000", 2024-09-12T22:33:33.108 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 18.633095470000001, 2024-09-12T22:33:33.109 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.073936215999999999, 2024-09-12T22:33:33.109 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:33.109 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:33.109 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:33.109 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:33.109 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.109 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:33.109 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403250+0000", 2024-09-12T22:33:33.109 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:33.109 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.109 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.109 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:33.109 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403250+0000", 2024-09-12T22:33:33.110 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:33.110 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.110 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.110 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:33.110 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403251+0000", 2024-09-12T22:33:33.110 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.37e-07 2024-09-12T22:33:33.110 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.110 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.110 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:33.110 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403258+0000", 2024-09-12T22:33:33.110 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.25e-06 2024-09-12T22:33:33.110 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.110 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.110 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:33.111 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403269+0000", 2024-09-12T22:33:33.111 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0509000000000001e-05 2024-09-12T22:33:33.111 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.111 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.111 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:33.111 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403274+0000", 2024-09-12T22:33:33.111 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1290000000000004e-06 2024-09-12T22:33:33.111 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.111 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.111 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:33.111 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.459796+0000", 2024-09-12T22:33:33.111 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.056522020999999999 2024-09-12T22:33:33.112 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.112 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.112 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:33.112 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.459845+0000", 2024-09-12T22:33:33.112 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8884999999999997e-05 2024-09-12T22:33:33.112 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.112 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.112 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:33.112 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.459920+0000", 2024-09-12T22:33:33.112 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5318e-05 2024-09-12T22:33:33.112 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.112 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.112 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:33.113 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.466542+0000", 2024-09-12T22:33:33.113 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0066223139999999998 2024-09-12T22:33:33.113 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.113 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.113 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:33.113 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.477137+0000", 2024-09-12T22:33:33.113 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010594717 2024-09-12T22:33:33.113 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.113 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.113 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:33.113 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.477165+0000", 2024-09-12T22:33:33.113 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8262000000000001e-05 2024-09-12T22:33:33.113 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.113 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.114 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:33.114 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.477186+0000", 2024-09-12T22:33:33.114 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1073999999999998e-05 2024-09-12T22:33:33.114 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:33.114 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:33.114 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:33.114 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.114 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.114 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1214 3.13 3:cb3d3880:::200.0000000d:head [write 1035138~2606 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:33.114 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.403674+0000", 2024-09-12T22:33:33.114 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 18.632671550000001, 2024-09-12T22:33:33.114 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.073643204000000004, 2024-09-12T22:33:33.114 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:33.115 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:33.115 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:33.115 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:33.115 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.115 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:33.115 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403674+0000", 2024-09-12T22:33:33.115 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:33.115 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.115 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.115 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:33.115 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403674+0000", 2024-09-12T22:33:33.115 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:33.115 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.116 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.116 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:33.116 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403674+0000", 2024-09-12T22:33:33.116 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.7700000000000005e-07 2024-09-12T22:33:33.116 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.116 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.116 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:33.116 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403678+0000", 2024-09-12T22:33:33.116 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2009999999999999e-06 2024-09-12T22:33:33.116 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.116 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.116 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:33.116 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403686+0000", 2024-09-12T22:33:33.117 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5690000000000005e-06 2024-09-12T22:33:33.117 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.117 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.117 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:33.117 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403690+0000", 2024-09-12T22:33:33.117 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.233e-06 2024-09-12T22:33:33.117 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.117 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.117 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:33.117 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.460445+0000", 2024-09-12T22:33:33.117 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.056754412999999997 2024-09-12T22:33:33.117 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.117 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.118 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:33.118 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.460495+0000", 2024-09-12T22:33:33.118 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0238999999999998e-05 2024-09-12T22:33:33.118 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.118 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.118 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:33.118 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.460566+0000", 2024-09-12T22:33:33.118 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1159000000000001e-05 2024-09-12T22:33:33.118 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.118 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.118 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:33.118 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.466546+0000", 2024-09-12T22:33:33.118 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0059798910000000002 2024-09-12T22:33:33.119 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.119 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.119 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:33.119 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.477232+0000", 2024-09-12T22:33:33.119 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010686084 2024-09-12T22:33:33.119 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.119 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.119 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:33.119 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.477280+0000", 2024-09-12T22:33:33.119 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.7719999999999997e-05 2024-09-12T22:33:33.119 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.119 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.119 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:33.119 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.477317+0000", 2024-09-12T22:33:33.120 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7218000000000002e-05 2024-09-12T22:33:33.120 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:33.120 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:33.120 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:33.120 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.120 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.120 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1223 3.13 3:cb3d3880:::200.0000000d:head [write 1090497~1913 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:33.120 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.420111+0000", 2024-09-12T22:33:33.120 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 18.616234398, 2024-09-12T22:33:33.120 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.071634583000000002, 2024-09-12T22:33:33.120 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:33.120 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:33.120 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:33.120 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:33.121 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.121 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:33.121 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.420111+0000", 2024-09-12T22:33:33.121 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:33.121 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.121 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.121 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:33.121 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.420111+0000", 2024-09-12T22:33:33.121 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:33.121 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.121 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.121 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:33.121 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.420112+0000", 2024-09-12T22:33:33.122 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.2900000000000002e-07 2024-09-12T22:33:33.122 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.122 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.122 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:33.122 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.420116+0000", 2024-09-12T22:33:33.122 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.67e-06 2024-09-12T22:33:33.122 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.122 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.122 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:33.122 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.420125+0000", 2024-09-12T22:33:33.122 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.0890000000000006e-06 2024-09-12T22:33:33.122 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.122 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.123 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:33.123 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.420131+0000", 2024-09-12T22:33:33.123 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4269999999999996e-06 2024-09-12T22:33:33.123 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.123 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.123 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:33.123 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.465358+0000", 2024-09-12T22:33:33.123 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.045227030000000001 2024-09-12T22:33:33.123 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.123 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.123 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:33.123 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.465439+0000", 2024-09-12T22:33:33.123 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0901000000000004e-05 2024-09-12T22:33:33.124 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.124 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.124 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:33.124 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.465571+0000", 2024-09-12T22:33:33.124 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000131705 2024-09-12T22:33:33.124 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.124 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.124 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:33.124 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.469496+0000", 2024-09-12T22:33:33.124 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.003925418 2024-09-12T22:33:33.124 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.124 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.124 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:33.124 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.491669+0000", 2024-09-12T22:33:33.125 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.022172335000000001 2024-09-12T22:33:33.125 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.125 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.125 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:33.125 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.491714+0000", 2024-09-12T22:33:33.125 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5417000000000002e-05 2024-09-12T22:33:33.125 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.125 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.125 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:33.125 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.491746+0000", 2024-09-12T22:33:33.125 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1662000000000003e-05 2024-09-12T22:33:33.125 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:33.125 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:33.126 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:33.126 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.126 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.126 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1225 3.13 3:cb3d3880:::200.0000000d:head [write 1097316~1932 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:33.126 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.421303+0000", 2024-09-12T22:33:33.126 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 18.615042562999999, 2024-09-12T22:33:33.126 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.074934770999999997, 2024-09-12T22:33:33.126 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:33.126 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:33.126 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:33.126 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:33.126 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.126 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:33.126 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.421303+0000", 2024-09-12T22:33:33.127 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:33.127 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.127 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.127 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:33.127 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.421303+0000", 2024-09-12T22:33:33.127 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:33.127 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.127 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.127 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:33.127 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.421303+0000", 2024-09-12T22:33:33.127 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8599999999999998e-07 2024-09-12T22:33:33.127 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.127 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.128 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:33.128 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.421307+0000", 2024-09-12T22:33:33.128 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0879999999999999e-06 2024-09-12T22:33:33.128 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.128 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.128 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:33.128 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.421314+0000", 2024-09-12T22:33:33.128 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1010000000000003e-06 2024-09-12T22:33:33.128 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.128 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.128 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:33.128 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.421319+0000", 2024-09-12T22:33:33.128 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7209999999999999e-06 2024-09-12T22:33:33.128 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.129 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.129 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:33.129 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.466620+0000", 2024-09-12T22:33:33.129 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.045301044999999998 2024-09-12T22:33:33.129 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.129 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.129 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:33.129 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.466703+0000", 2024-09-12T22:33:33.129 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3011999999999997e-05 2024-09-12T22:33:33.129 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.129 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.129 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:33.130 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.466826+0000", 2024-09-12T22:33:33.130 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000122824 2024-09-12T22:33:33.130 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.130 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.130 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:33.130 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.472359+0000", 2024-09-12T22:33:33.130 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0055323009999999999 2024-09-12T22:33:33.130 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.130 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.130 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:33.130 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496142+0000", 2024-09-12T22:33:33.130 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.023783696999999999 2024-09-12T22:33:33.130 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.131 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.131 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:33.131 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496194+0000", 2024-09-12T22:33:33.131 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1350000000000001e-05 2024-09-12T22:33:33.131 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.131 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.131 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:33.131 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496238+0000", 2024-09-12T22:33:33.131 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4146000000000001e-05 2024-09-12T22:33:33.131 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:33.131 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:33.131 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:33.131 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.132 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.132 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1226 3.13 3:cb3d3880:::200.0000000d:head [write 1099248~1973 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:33.132 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.422971+0000", 2024-09-12T22:33:33.132 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 18.613374964999998, 2024-09-12T22:33:33.132 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.073363063000000006, 2024-09-12T22:33:33.132 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:33.132 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:33.132 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:33.132 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:33.132 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.132 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:33.132 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.422971+0000", 2024-09-12T22:33:33.132 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:33.133 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.133 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.133 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:33.133 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.422971+0000", 2024-09-12T22:33:33.133 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:33.133 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.133 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.133 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:33.133 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.422971+0000", 2024-09-12T22:33:33.133 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.1699999999999997e-07 2024-09-12T22:33:33.133 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.133 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.133 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:33.134 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.422975+0000", 2024-09-12T22:33:33.134 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2650000000000001e-06 2024-09-12T22:33:33.134 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.134 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.134 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:33.134 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.422981+0000", 2024-09-12T22:33:33.134 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7379999999999997e-06 2024-09-12T22:33:33.134 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.134 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.134 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:33.134 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.422986+0000", 2024-09-12T22:33:33.134 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5220000000000001e-06 2024-09-12T22:33:33.134 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.135 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.135 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:33.135 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.467340+0000", 2024-09-12T22:33:33.135 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.044353985999999998 2024-09-12T22:33:33.135 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.135 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.135 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:33.135 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.467412+0000", 2024-09-12T22:33:33.135 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1982000000000003e-05 2024-09-12T22:33:33.135 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.135 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.135 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:33.135 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.467493+0000", 2024-09-12T22:33:33.136 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0829999999999997e-05 2024-09-12T22:33:33.136 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.136 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.136 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:33.136 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.472364+0000", 2024-09-12T22:33:33.136 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0048713189999999998 2024-09-12T22:33:33.136 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.136 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.136 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:33.136 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496271+0000", 2024-09-12T22:33:33.136 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.023906808000000002 2024-09-12T22:33:33.136 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.136 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.136 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:33.137 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496300+0000", 2024-09-12T22:33:33.137 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9315e-05 2024-09-12T22:33:33.137 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.137 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.137 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:33.137 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496334+0000", 2024-09-12T22:33:33.137 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3481e-05 2024-09-12T22:33:33.137 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:33.137 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:33.137 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:33.137 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.137 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.138 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1227 3.13 3:cb3d3880:::200.0000000d:head [write 1101221~1922 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:33.138 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.423028+0000", 2024-09-12T22:33:33.138 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 18.613317981000002, 2024-09-12T22:33:33.138 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.073444802000000003, 2024-09-12T22:33:33.138 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:33.138 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:33.138 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:33.138 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:33.138 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.138 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:33.138 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423028+0000", 2024-09-12T22:33:33.138 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:33.138 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.139 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.139 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:33.139 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423028+0000", 2024-09-12T22:33:33.139 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:33.139 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.139 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.139 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:33.139 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423028+0000", 2024-09-12T22:33:33.139 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1699999999999998e-07 2024-09-12T22:33:33.139 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.139 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.139 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:33.139 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423031+0000", 2024-09-12T22:33:33.139 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8499999999999998e-06 2024-09-12T22:33:33.140 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.140 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.140 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:33.140 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423036+0000", 2024-09-12T22:33:33.140 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9479999999999999e-06 2024-09-12T22:33:33.140 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.140 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.140 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:33.140 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423039+0000", 2024-09-12T22:33:33.140 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4929999999999998e-06 2024-09-12T22:33:33.140 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.140 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.140 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:33.141 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.467785+0000", 2024-09-12T22:33:33.141 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.044745957000000003 2024-09-12T22:33:33.141 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.141 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.141 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:33.141 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.467838+0000", 2024-09-12T22:33:33.141 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2596999999999998e-05 2024-09-12T22:33:33.141 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.141 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.141 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:33.141 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.467915+0000", 2024-09-12T22:33:33.141 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6744999999999998e-05 2024-09-12T22:33:33.141 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.142 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.142 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:33.142 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.472368+0000", 2024-09-12T22:33:33.142 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0044534730000000003 2024-09-12T22:33:33.142 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.142 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.142 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:33.142 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496382+0000", 2024-09-12T22:33:33.142 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.024014111000000001 2024-09-12T22:33:33.142 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.142 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.142 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:33.142 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496443+0000", 2024-09-12T22:33:33.142 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.0547000000000002e-05 2024-09-12T22:33:33.143 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.143 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.143 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:33.143 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496472+0000", 2024-09-12T22:33:33.143 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9564e-05 2024-09-12T22:33:33.143 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:33.143 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:33.143 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:33.143 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.143 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.143 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1228 3.13 3:cb3d3880:::200.0000000d:head [write 1103143~2423 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:33.143 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.423305+0000", 2024-09-12T22:33:33.143 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 18.613040616999999, 2024-09-12T22:33:33.144 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.073251160999999995, 2024-09-12T22:33:33.144 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:33.144 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:33.144 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:33.144 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:33.144 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.144 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:33.144 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423305+0000", 2024-09-12T22:33:33.144 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:33.144 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.144 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.144 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:33.145 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423305+0000", 2024-09-12T22:33:33.145 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:33.145 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.145 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.145 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:33.145 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423306+0000", 2024-09-12T22:33:33.145 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4899999999999995e-07 2024-09-12T22:33:33.145 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.145 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.145 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:33.145 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423311+0000", 2024-09-12T22:33:33.145 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7459999999999997e-06 2024-09-12T22:33:33.145 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.146 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.146 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:33.146 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423316+0000", 2024-09-12T22:33:33.146 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0239999999999997e-06 2024-09-12T22:33:33.146 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.146 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.146 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:33.146 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423320+0000", 2024-09-12T22:33:33.146 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.67e-06 2024-09-12T22:33:33.146 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.146 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.146 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:33.146 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.468252+0000", 2024-09-12T22:33:33.146 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.044932262000000001 2024-09-12T22:33:33.147 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.147 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.147 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:33.147 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.468293+0000", 2024-09-12T22:33:33.147 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0368999999999999e-05 2024-09-12T22:33:33.147 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.147 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.147 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:33.147 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.468357+0000", 2024-09-12T22:33:33.147 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4287000000000003e-05 2024-09-12T22:33:33.147 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.147 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.147 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:33.148 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.472371+0000", 2024-09-12T22:33:33.148 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0040144350000000002 2024-09-12T22:33:33.148 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.148 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.148 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:33.148 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496507+0000", 2024-09-12T22:33:33.148 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.024135961000000001 2024-09-12T22:33:33.148 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.148 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.149 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:33.149 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496537+0000", 2024-09-12T22:33:33.149 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9611000000000002e-05 2024-09-12T22:33:33.149 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.149 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.149 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:33.149 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496556+0000", 2024-09-12T22:33:33.149 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9147000000000002e-05 2024-09-12T22:33:33.149 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:33.149 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:33.149 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:33.149 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.149 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.150 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1229 3.13 3:cb3d3880:::200.0000000d:head [write 1105566~1911 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:33.150 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.423606+0000", 2024-09-12T22:33:33.150 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 18.612739606000002, 2024-09-12T22:33:33.150 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.073027876000000005, 2024-09-12T22:33:33.150 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:33.150 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:33.150 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:33.150 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:33.150 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.150 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:33.150 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423606+0000", 2024-09-12T22:33:33.150 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:33.150 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.150 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.151 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:33.151 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423606+0000", 2024-09-12T22:33:33.151 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:33.151 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.151 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.151 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:33.151 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423606+0000", 2024-09-12T22:33:33.151 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.7e-07 2024-09-12T22:33:33.151 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.151 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.151 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:33.151 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423609+0000", 2024-09-12T22:33:33.151 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5339999999999998e-06 2024-09-12T22:33:33.152 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.152 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.152 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:33.152 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423614+0000", 2024-09-12T22:33:33.152 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.69e-06 2024-09-12T22:33:33.152 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.152 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.152 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:33.152 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423617+0000", 2024-09-12T22:33:33.152 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4300000000000002e-06 2024-09-12T22:33:33.152 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.152 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.152 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:33.152 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.468606+0000", 2024-09-12T22:33:33.153 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.044988606 2024-09-12T22:33:33.153 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.153 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.153 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:33.153 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.468649+0000", 2024-09-12T22:33:33.153 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3414000000000001e-05 2024-09-12T22:33:33.153 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.153 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.153 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:33.153 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.468714+0000", 2024-09-12T22:33:33.153 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4857000000000006e-05 2024-09-12T22:33:33.153 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.153 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.154 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:33.154 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.472375+0000", 2024-09-12T22:33:33.154 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0036607330000000002 2024-09-12T22:33:33.154 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.154 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.154 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:33.154 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496585+0000", 2024-09-12T22:33:33.154 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.024210835 2024-09-12T22:33:33.154 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.154 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.154 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:33.154 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496612+0000", 2024-09-12T22:33:33.154 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6999999999999999e-05 2024-09-12T22:33:33.154 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.155 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.155 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:33.155 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496634+0000", 2024-09-12T22:33:33.155 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1307000000000001e-05 2024-09-12T22:33:33.155 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:33.155 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:33.155 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:33.155 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.155 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.155 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1230 3.13 3:cb3d3880:::200.0000000d:head [write 1107477~6537 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:33.155 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.423911+0000", 2024-09-12T22:33:33.155 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 18.612434760999999, 2024-09-12T22:33:33.155 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.072794530999999996, 2024-09-12T22:33:33.155 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:33.156 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:33.156 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:33.156 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:33.156 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.156 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:33.156 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423911+0000", 2024-09-12T22:33:33.156 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:33.156 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.156 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.156 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:33.156 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423911+0000", 2024-09-12T22:33:33.156 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:33.156 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.157 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.157 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:33.157 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423911+0000", 2024-09-12T22:33:33.157 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3799999999999998e-07 2024-09-12T22:33:33.157 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.157 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.157 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:33.157 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423919+0000", 2024-09-12T22:33:33.157 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.8329999999999994e-06 2024-09-12T22:33:33.157 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.157 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.157 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:33.157 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423924+0000", 2024-09-12T22:33:33.158 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3449999999999996e-06 2024-09-12T22:33:33.158 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.158 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.158 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:33.158 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423928+0000", 2024-09-12T22:33:33.158 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2339999999999999e-06 2024-09-12T22:33:33.158 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.158 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.158 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:33.158 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.469042+0000", 2024-09-12T22:33:33.158 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.045114888999999998 2024-09-12T22:33:33.158 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.158 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.158 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:33.159 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.469092+0000", 2024-09-12T22:33:33.159 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9289000000000002e-05 2024-09-12T22:33:33.159 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.159 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.159 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:33.159 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.469163+0000", 2024-09-12T22:33:33.159 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1222000000000004e-05 2024-09-12T22:33:33.159 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.159 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.159 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:33.159 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.472379+0000", 2024-09-12T22:33:33.159 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0032156419999999999 2024-09-12T22:33:33.159 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.159 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.160 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:33.160 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496661+0000", 2024-09-12T22:33:33.160 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.024281857 2024-09-12T22:33:33.160 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.160 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.160 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:33.160 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496687+0000", 2024-09-12T22:33:33.160 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6551e-05 2024-09-12T22:33:33.160 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:33.160 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:33.160 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:33.160 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496705+0000", 2024-09-12T22:33:33.160 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.8230999999999999e-05 2024-09-12T22:33:33.161 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:33.161 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:33.161 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:33.161 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:33.161 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:33.164 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-09-12T22:33:33.165 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T22:33:33.167 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:33.165+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:33.168 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:33:33.266 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~48s 2024-09-12T22:33:33.267 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:33.266+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:33.274 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:33:33.274 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:33:33.274 INFO:teuthology.orchestra.run.smithi148.stdout: "num_ops": 0 2024-09-12T22:33:33.274 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:33:33.283 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:33:33.286 INFO:teuthology.orchestra.run.smithi019.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-12T22:33:33.304 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T22:33:33.304 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:33:33.322 INFO:teuthology.orchestra.run.smithi019.stdout:osd.2: {} 2024-09-12T22:33:33.322 INFO:teuthology.orchestra.run.smithi019.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T22:33:33.326 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:33:33.326 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:33:33.369 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:33.368+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:33.425 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:33:33.425 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:33:33.433 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:33:33.470 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:33.469+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:33.536 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:33:33.536 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:33:33.545 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:33:33.590 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:33.588+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:33.649 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:33:33.650 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:33:33.658 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:33:33.699 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:33.698+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:33.775 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:33.774+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:33.801 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:33:33.801 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:33:33.810 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:33:33.876 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:33.875+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:33.952 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:33:33.952 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:33:33.961 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:33:33.977 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:33.975+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:34.066 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:33:34.066 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:33:34.075 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:33:34.078 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:34.077+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:34.178 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:34.177+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:34.178 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:33:34.178 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:33:34.187 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:33:34.278 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:34.277+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:34.329 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:33:34.330 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:33:34.338 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:33:34.382 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:34.381+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:34.444 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:33:34.444 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:33:34.452 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:33:34.480 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:34.479+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:34.581 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:34.580+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:34.595 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:33:34.595 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:33:34.597 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T22:33:34.604 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:33:34.682 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:34.682+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:34.706 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:33:34.706 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:33:34.715 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:33:34.783 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:34.782+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:34.820 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:33:34.820 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:33:34.829 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:33:34.913 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:34.912+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:34.972 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:33:34.972 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:33:34.981 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:33:35.022 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:35.021+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:35.085 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:35.084+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:35.124 INFO:teuthology.orchestra.run.smithi148.stdout:ERROR: (22) Invalid argument 2024-09-12T22:33:35.124 INFO:teuthology.orchestra.run.smithi148.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:33:35.132 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:33:35.186 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:35.185+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:35.235 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:33:35.235 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:33:35.244 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:33:35.287 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:35.286+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:35.327 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T22:33:35.347 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:33:35.347 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:33:35.355 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:33:35.399 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:35.398+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:35.438 INFO:teuthology.orchestra.run.smithi019.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-12T22:33:35.456 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1: {} 2024-09-12T22:33:35.456 INFO:teuthology.orchestra.run.smithi019.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T22:33:35.458 INFO:teuthology.orchestra.run.smithi163.stdout:ERROR: (22) Invalid argument 2024-09-12T22:33:35.459 INFO:teuthology.orchestra.run.smithi163.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T22:33:35.467 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:33:35.474 INFO:teuthology.orchestra.run.smithi019.stdout:osd.2: {} 2024-09-12T22:33:35.474 INFO:teuthology.orchestra.run.smithi019.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T22:33:35.477 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T22:33:35.478 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T22:33:35.508 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:35.507+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:35.572 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:33:35.572 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:33:35.572 INFO:teuthology.orchestra.run.smithi148.stdout: "num_ops": 0 2024-09-12T22:33:35.572 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:33:35.581 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:33:35.591 INFO:teuthology.orchestra.run.smithi019.stderr:nodeep-scrub is set 2024-09-12T22:33:35.625 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:35.624+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:35.684 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:33:35.684 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:33:35.684 INFO:teuthology.orchestra.run.smithi148.stdout: "complaint_time": 30, 2024-09-12T22:33:35.684 INFO:teuthology.orchestra.run.smithi148.stdout: "num_blocked_ops": 0 2024-09-12T22:33:35.684 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:33:35.691 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:35.689+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:35.693 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:33:35.792 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:35.790+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:35.837 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:33:35.837 INFO:teuthology.orchestra.run.smithi148.stdout: "size": 20, 2024-09-12T22:33:35.838 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 600, 2024-09-12T22:33:35.838 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [ 2024-09-12T22:33:35.838 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.838 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4490.0:9866 4.b 4:d370243b:::10000002d48.00000000:head [write 0~1308] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:33:35.838 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:09.467883+0000", 2024-09-12T22:33:35.838 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 26.367696520999999, 2024-09-12T22:33:35.838 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.085024817000000003, 2024-09-12T22:33:35.838 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:35.838 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:35.838 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:35.838 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:33:35.838 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4490", 2024-09-12T22:33:35.838 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:35.839 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 9866 2024-09-12T22:33:35.839 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.839 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:35.839 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.839 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:35.839 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.467883+0000", 2024-09-12T22:33:35.839 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:35.839 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.839 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.839 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:35.839 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.467883+0000", 2024-09-12T22:33:35.839 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:35.839 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.840 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.840 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:35.840 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.467884+0000", 2024-09-12T22:33:35.840 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1800000000000005e-07 2024-09-12T22:33:35.840 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.840 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.840 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:35.840 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.467888+0000", 2024-09-12T22:33:35.840 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5959999999999997e-06 2024-09-12T22:33:35.840 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.840 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.840 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:35.841 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.467896+0000", 2024-09-12T22:33:35.841 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.8679999999999999e-06 2024-09-12T22:33:35.841 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.841 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.841 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:35.841 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.467901+0000", 2024-09-12T22:33:35.841 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9169999999999997e-06 2024-09-12T22:33:35.841 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.841 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.841 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:35.841 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.467944+0000", 2024-09-12T22:33:35.841 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3055e-05 2024-09-12T22:33:35.841 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.842 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.842 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:35.842 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.468011+0000", 2024-09-12T22:33:35.842 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7328000000000003e-05 2024-09-12T22:33:35.842 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.842 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.842 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:35.842 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.468078+0000", 2024-09-12T22:33:35.842 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7063999999999994e-05 2024-09-12T22:33:35.842 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.842 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.842 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:35.842 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.551406+0000", 2024-09-12T22:33:35.843 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.083327485000000007 2024-09-12T22:33:35.843 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.843 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.843 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:35.843 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.552822+0000", 2024-09-12T22:33:35.843 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001415929 2024-09-12T22:33:35.843 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.843 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.843 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:35.843 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.552863+0000", 2024-09-12T22:33:35.843 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0809000000000002e-05 2024-09-12T22:33:35.843 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.843 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.844 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:35.844 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.552908+0000", 2024-09-12T22:33:35.844 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5048e-05 2024-09-12T22:33:35.844 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:35.844 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:35.844 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:35.844 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.844 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.844 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4490.0:9867 4.16 4:6bd8f1b8:::10000002d49.00000000:head [write 0~1599] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:33:35.844 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:09.468760+0000", 2024-09-12T22:33:35.844 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 26.366819511999999, 2024-09-12T22:33:35.844 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.086660499000000002, 2024-09-12T22:33:35.845 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:35.845 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:35.845 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:35.845 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:33:35.845 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4490", 2024-09-12T22:33:35.845 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:35.845 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 9867 2024-09-12T22:33:35.845 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.845 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:35.845 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.846 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:35.846 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.468760+0000", 2024-09-12T22:33:35.846 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:35.846 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.846 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.846 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:35.846 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.468760+0000", 2024-09-12T22:33:35.846 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:35.846 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.846 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.846 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:35.846 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.468761+0000", 2024-09-12T22:33:35.846 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4399999999999999e-07 2024-09-12T22:33:35.847 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.847 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.847 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:35.847 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.468765+0000", 2024-09-12T22:33:35.847 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3259999999999997e-06 2024-09-12T22:33:35.847 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.847 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.847 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:35.847 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.548969+0000", 2024-09-12T22:33:35.847 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.080204172000000004 2024-09-12T22:33:35.847 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.847 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.847 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:35.848 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.549001+0000", 2024-09-12T22:33:35.848 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.1464999999999998e-05 2024-09-12T22:33:35.848 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.848 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.848 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:35.848 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.549148+0000", 2024-09-12T22:33:35.848 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014749399999999999 2024-09-12T22:33:35.848 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.848 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.848 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:35.848 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.549379+0000", 2024-09-12T22:33:35.848 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000231091 2024-09-12T22:33:35.848 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.849 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.849 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:35.849 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.549518+0000", 2024-09-12T22:33:35.849 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013844899999999999 2024-09-12T22:33:35.849 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.849 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.849 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:35.849 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.552236+0000", 2024-09-12T22:33:35.849 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0027179869999999998 2024-09-12T22:33:35.849 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.849 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.849 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:35.849 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.555333+0000", 2024-09-12T22:33:35.850 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0030973559999999999 2024-09-12T22:33:35.850 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.850 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.850 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:35.850 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.555379+0000", 2024-09-12T22:33:35.850 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6236999999999998e-05 2024-09-12T22:33:35.850 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.850 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.850 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:35.850 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.555420+0000", 2024-09-12T22:33:35.850 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1177999999999998e-05 2024-09-12T22:33:35.850 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:35.851 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:35.851 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:35.851 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.851 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.851 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop_reply(client.4490.0:9866 4.b e53/18 ondisk, result = 0)", 2024-09-12T22:33:35.851 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:09.468826+0000", 2024-09-12T22:33:35.851 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 26.366753216999999, 2024-09-12T22:33:35.851 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.082588348000000006, 2024-09-12T22:33:35.851 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:35.851 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:35.851 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:33:35.851 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:35.851 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.852 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:35.852 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.468826+0000", 2024-09-12T22:33:35.852 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:35.852 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.852 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.852 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:35.852 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.468826+0000", 2024-09-12T22:33:35.852 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:35.852 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.852 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.852 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:35.852 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.468827+0000", 2024-09-12T22:33:35.853 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3399999999999999e-07 2024-09-12T22:33:35.853 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.853 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.853 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:35.853 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.468830+0000", 2024-09-12T22:33:35.853 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.1559999999999999e-06 2024-09-12T22:33:35.853 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.853 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.853 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:35.853 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.548957+0000", 2024-09-12T22:33:35.853 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.080126852999999998 2024-09-12T22:33:35.853 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.854 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.854 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:35.854 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.548989+0000", 2024-09-12T22:33:35.854 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2409000000000001e-05 2024-09-12T22:33:35.854 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.854 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.854 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:35.854 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.551065+0000", 2024-09-12T22:33:35.854 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.002075871 2024-09-12T22:33:35.854 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.854 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.854 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:35.854 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.551398+0000", 2024-09-12T22:33:35.855 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00033339099999999999 2024-09-12T22:33:35.855 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.855 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.855 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:35.855 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.551414+0000", 2024-09-12T22:33:35.855 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6133999999999998e-05 2024-09-12T22:33:35.855 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:35.855 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:35.855 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:35.855 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.855 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.855 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4490.0:10437 4.2f 4:f6cd553b:::10000002fce.00000000:head [write 0~27313] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:33:35.856 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:10.050890+0000", 2024-09-12T22:33:35.856 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 25.784688821, 2024-09-12T22:33:35.856 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.056482601, 2024-09-12T22:33:35.856 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:35.856 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:35.856 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:35.856 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:33:35.856 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4490", 2024-09-12T22:33:35.856 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:35.856 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 10437 2024-09-12T22:33:35.856 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.856 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:35.856 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.857 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:35.857 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.050890+0000", 2024-09-12T22:33:35.857 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:35.857 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.857 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.857 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:35.857 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.050890+0000", 2024-09-12T22:33:35.857 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:35.857 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.857 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.857 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:35.857 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.050891+0000", 2024-09-12T22:33:35.857 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.6600000000000005e-07 2024-09-12T22:33:35.858 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.858 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.858 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:35.858 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.050906+0000", 2024-09-12T22:33:35.858 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4521e-05 2024-09-12T22:33:35.858 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.858 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.858 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:35.858 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.050915+0000", 2024-09-12T22:33:35.858 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.2569999999999996e-06 2024-09-12T22:33:35.858 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.859 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.859 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:35.859 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.050920+0000", 2024-09-12T22:33:35.859 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.724e-06 2024-09-12T22:33:35.859 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.859 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.859 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:35.860 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.050960+0000", 2024-09-12T22:33:35.860 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9999000000000001e-05 2024-09-12T22:33:35.860 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.860 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.860 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:35.860 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.051031+0000", 2024-09-12T22:33:35.860 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1007000000000006e-05 2024-09-12T22:33:35.860 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.860 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.860 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:35.860 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.107249+0000", 2024-09-12T22:33:35.860 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.056218432999999998 2024-09-12T22:33:35.860 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.861 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.861 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:35.861 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.107301+0000", 2024-09-12T22:33:35.861 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1289000000000003e-05 2024-09-12T22:33:35.861 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.861 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.861 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:35.861 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.107373+0000", 2024-09-12T22:33:35.861 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.2504999999999998e-05 2024-09-12T22:33:35.861 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:35.861 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:35.861 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:35.862 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.862 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.862 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4490.0:10439 4.12 4:483953cb:::10000002fd0.00000000:head [write 0~4842] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:33:35.862 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:10.052567+0000", 2024-09-12T22:33:35.862 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 25.783012613, 2024-09-12T22:33:35.862 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.055835449000000002, 2024-09-12T22:33:35.862 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:35.862 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:35.862 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:35.862 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:33:35.862 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4490", 2024-09-12T22:33:35.862 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:35.862 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 10439 2024-09-12T22:33:35.863 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.863 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:35.863 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.863 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:35.863 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.052567+0000", 2024-09-12T22:33:35.863 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:35.863 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.863 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.863 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:35.863 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.052567+0000", 2024-09-12T22:33:35.863 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:35.863 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.863 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.864 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:35.864 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.052568+0000", 2024-09-12T22:33:35.864 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.3600000000000002e-07 2024-09-12T22:33:35.864 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.864 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.864 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:35.864 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.052591+0000", 2024-09-12T22:33:35.864 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.3110000000000001e-05 2024-09-12T22:33:35.864 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.864 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.864 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:35.864 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.106740+0000", 2024-09-12T22:33:35.864 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.054149315000000003 2024-09-12T22:33:35.865 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.865 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.865 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:35.865 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.106751+0000", 2024-09-12T22:33:35.865 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1056000000000001e-05 2024-09-12T22:33:35.865 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.865 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.865 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:35.865 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.106811+0000", 2024-09-12T22:33:35.865 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9515999999999997e-05 2024-09-12T22:33:35.865 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.865 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.865 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:35.866 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.106929+0000", 2024-09-12T22:33:35.866 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00011879000000000001 2024-09-12T22:33:35.866 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.866 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.866 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:35.866 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.108283+0000", 2024-09-12T22:33:35.866 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001354177 2024-09-12T22:33:35.866 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.866 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.866 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:35.866 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.108328+0000", 2024-09-12T22:33:35.866 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4931000000000001e-05 2024-09-12T22:33:35.866 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.867 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.867 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:35.867 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.108402+0000", 2024-09-12T22:33:35.867 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3718000000000001e-05 2024-09-12T22:33:35.867 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:35.867 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:35.867 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:35.867 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.867 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.867 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(client.4490.0:10445 4.3c e53/18 4:3d97251e:::10000002fd8.00000000:head v 53'154, mlcod=53'152)", 2024-09-12T22:33:35.867 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:10.058521+0000", 2024-09-12T22:33:35.867 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 25.777058273000002, 2024-09-12T22:33:35.867 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.049310138000000003, 2024-09-12T22:33:35.867 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:35.868 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:35.868 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:35.868 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:35.868 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.868 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:35.868 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.058521+0000", 2024-09-12T22:33:35.868 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:35.868 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.868 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.868 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:35.868 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.058521+0000", 2024-09-12T22:33:35.868 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:35.869 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.869 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.869 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:35.869 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.058522+0000", 2024-09-12T22:33:35.869 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.1099999999999995e-07 2024-09-12T22:33:35.869 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.869 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.869 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:35.869 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.058530+0000", 2024-09-12T22:33:35.869 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.7290000000000006e-06 2024-09-12T22:33:35.869 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.869 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.869 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:35.870 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.106760+0000", 2024-09-12T22:33:35.870 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.048229384 2024-09-12T22:33:35.870 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.870 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.870 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:35.870 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.106770+0000", 2024-09-12T22:33:35.870 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0431999999999999e-05 2024-09-12T22:33:35.870 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.870 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.870 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:35.870 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.106823+0000", 2024-09-12T22:33:35.870 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2309999999999999e-05 2024-09-12T22:33:35.871 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.871 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.871 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:35.871 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.106841+0000", 2024-09-12T22:33:35.871 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.8218000000000001e-05 2024-09-12T22:33:35.871 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.871 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.871 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:35.871 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.107796+0000", 2024-09-12T22:33:35.871 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00095552600000000005 2024-09-12T22:33:35.871 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.871 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.871 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:35.871 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.107831+0000", 2024-09-12T22:33:35.872 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4928000000000002e-05 2024-09-12T22:33:35.872 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:35.872 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:35.872 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:35.872 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.872 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.872 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4490.0:11351 4.3f 4:fd498422:::10000003188.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-12T22:33:35.872 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:13.354715+0000", 2024-09-12T22:33:35.872 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 22.480864458999999, 2024-09-12T22:33:35.872 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.043059568999999999, 2024-09-12T22:33:35.872 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:35.872 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:35.873 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:35.873 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:33:35.873 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4490", 2024-09-12T22:33:35.873 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:35.873 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 11351 2024-09-12T22:33:35.873 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.873 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:35.873 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.873 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:35.873 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.354715+0000", 2024-09-12T22:33:35.873 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:35.873 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.873 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.874 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:35.874 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.354715+0000", 2024-09-12T22:33:35.874 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:35.874 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.874 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.874 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:35.874 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.354716+0000", 2024-09-12T22:33:35.874 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.7600000000000006e-07 2024-09-12T22:33:35.874 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.874 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.874 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:35.874 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.361477+0000", 2024-09-12T22:33:35.874 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0067607090000000002 2024-09-12T22:33:35.875 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.875 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.875 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:35.875 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.361487+0000", 2024-09-12T22:33:35.875 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0249e-05 2024-09-12T22:33:35.875 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.875 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.875 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:35.875 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.361493+0000", 2024-09-12T22:33:35.875 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.4699999999999999e-06 2024-09-12T22:33:35.875 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.875 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.875 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:35.876 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.361544+0000", 2024-09-12T22:33:35.876 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1124e-05 2024-09-12T22:33:35.876 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.876 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.876 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:35.876 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.361604+0000", 2024-09-12T22:33:35.876 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9397000000000001e-05 2024-09-12T22:33:35.876 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.876 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.876 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:35.876 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.397601+0000", 2024-09-12T22:33:35.876 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.035996927999999997 2024-09-12T22:33:35.876 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.877 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.877 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:35.877 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.397646+0000", 2024-09-12T22:33:35.877 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5176000000000003e-05 2024-09-12T22:33:35.877 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.877 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.877 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:35.877 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.397774+0000", 2024-09-12T22:33:35.877 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012854000000000001 2024-09-12T22:33:35.877 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:35.877 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:35.877 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:35.877 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.877 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.878 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4490.0:12798 4.3e 4:7eb070ca:::100000030e0.00000000:head [write 0~4194304 [5@1189789]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-12T22:33:35.878 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:15.140228+0000", 2024-09-12T22:33:35.878 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 20.695351809000002, 2024-09-12T22:33:35.878 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.046073232999999998, 2024-09-12T22:33:35.878 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:35.878 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:35.878 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:35.878 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:33:35.878 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4490", 2024-09-12T22:33:35.878 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:35.878 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 12798 2024-09-12T22:33:35.878 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.879 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:35.879 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.879 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:35.879 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.140228+0000", 2024-09-12T22:33:35.879 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:35.879 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.879 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.879 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:35.879 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.140228+0000", 2024-09-12T22:33:35.879 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:35.879 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.879 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.879 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:35.879 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.140228+0000", 2024-09-12T22:33:35.880 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5899999999999996e-07 2024-09-12T22:33:35.880 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.880 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.880 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:35.880 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.147541+0000", 2024-09-12T22:33:35.880 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0073125339999999999 2024-09-12T22:33:35.880 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.880 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.880 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:35.880 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.147555+0000", 2024-09-12T22:33:35.880 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.42e-05 2024-09-12T22:33:35.880 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.881 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.881 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:35.881 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.147564+0000", 2024-09-12T22:33:35.881 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.0999999999999993e-06 2024-09-12T22:33:35.881 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.881 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.881 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:35.881 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.147637+0000", 2024-09-12T22:33:35.881 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3288999999999996e-05 2024-09-12T22:33:35.881 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.881 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.881 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:35.881 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.147725+0000", 2024-09-12T22:33:35.881 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.7622999999999998e-05 2024-09-12T22:33:35.882 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.882 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.882 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:35.882 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.186239+0000", 2024-09-12T22:33:35.882 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.038514171 2024-09-12T22:33:35.882 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.882 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.882 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:35.882 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.186265+0000", 2024-09-12T22:33:35.882 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5738e-05 2024-09-12T22:33:35.882 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.882 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.882 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:35.883 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.186301+0000", 2024-09-12T22:33:35.883 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.6019000000000002e-05 2024-09-12T22:33:35.883 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:35.883 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:35.883 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:35.883 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.883 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.883 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3063 3.2 3:42569fed:::200.00000011:head [write 3915305~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:33:35.883 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:19.386685+0000", 2024-09-12T22:33:35.883 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 16.448894580000001, 2024-09-12T22:33:35.883 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.042365220000000002, 2024-09-12T22:33:35.883 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:35.883 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:35.884 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:35.884 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:35.884 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.884 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:35.884 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386685+0000", 2024-09-12T22:33:35.884 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:35.884 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.884 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.884 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:35.884 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386685+0000", 2024-09-12T22:33:35.884 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:35.884 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.885 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.885 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:35.885 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386685+0000", 2024-09-12T22:33:35.885 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.08e-07 2024-09-12T22:33:35.885 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.885 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.885 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:35.885 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386688+0000", 2024-09-12T22:33:35.885 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8880000000000001e-06 2024-09-12T22:33:35.885 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.885 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.885 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:35.885 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386694+0000", 2024-09-12T22:33:35.886 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8089999999999998e-06 2024-09-12T22:33:35.886 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.886 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.886 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:35.886 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386699+0000", 2024-09-12T22:33:35.886 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8010000000000003e-06 2024-09-12T22:33:35.886 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.886 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.886 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:35.886 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.427136+0000", 2024-09-12T22:33:35.886 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.04043712 2024-09-12T22:33:35.886 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.886 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.887 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:35.887 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.427185+0000", 2024-09-12T22:33:35.887 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9493999999999997e-05 2024-09-12T22:33:35.887 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.887 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.887 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:35.887 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.428988+0000", 2024-09-12T22:33:35.887 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001803191 2024-09-12T22:33:35.887 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.887 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.887 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:35.887 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.429015+0000", 2024-09-12T22:33:35.887 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.6438999999999999e-05 2024-09-12T22:33:35.888 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.888 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.888 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:35.888 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.429050+0000", 2024-09-12T22:33:35.888 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.5070000000000001e-05 2024-09-12T22:33:35.888 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:35.888 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:35.888 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:35.888 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.888 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.888 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3064 3.2 3:42569fed:::200.00000011:head [write 3916704~1398 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:33:35.888 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:19.386705+0000", 2024-09-12T22:33:35.888 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 16.448874804999999, 2024-09-12T22:33:35.889 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.043238378000000001, 2024-09-12T22:33:35.889 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:35.889 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:35.889 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:35.889 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:35.889 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.889 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:35.889 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386705+0000", 2024-09-12T22:33:35.889 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:35.889 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.889 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.889 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:35.889 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386705+0000", 2024-09-12T22:33:35.890 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:35.890 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.890 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.890 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:35.890 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386705+0000", 2024-09-12T22:33:35.890 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.8299999999999998e-07 2024-09-12T22:33:35.890 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.890 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.890 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:35.890 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386711+0000", 2024-09-12T22:33:35.890 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7080000000000002e-06 2024-09-12T22:33:35.890 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.890 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.891 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:35.891 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386717+0000", 2024-09-12T22:33:35.891 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.3990000000000001e-06 2024-09-12T22:33:35.891 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.891 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.891 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:35.891 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386722+0000", 2024-09-12T22:33:35.891 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9219999999999996e-06 2024-09-12T22:33:35.891 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.891 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.891 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:35.891 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.427585+0000", 2024-09-12T22:33:35.891 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.040863414000000001 2024-09-12T22:33:35.892 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.892 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.892 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:35.892 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.427628+0000", 2024-09-12T22:33:35.892 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2873000000000001e-05 2024-09-12T22:33:35.892 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.892 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.892 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:35.892 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.429871+0000", 2024-09-12T22:33:35.892 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.002242572 2024-09-12T22:33:35.892 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.892 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.893 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:35.893 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.429901+0000", 2024-09-12T22:33:35.893 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0114e-05 2024-09-12T22:33:35.893 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.893 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.893 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:35.893 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.429943+0000", 2024-09-12T22:33:35.893 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1993000000000003e-05 2024-09-12T22:33:35.893 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:35.893 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:35.893 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:35.893 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.893 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.894 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3065 3.2 3:42569fed:::200.00000011:head [write 3918102~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:33:35.894 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:19.386735+0000", 2024-09-12T22:33:35.894 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 16.448844598000001, 2024-09-12T22:33:35.894 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.043278369999999997, 2024-09-12T22:33:35.894 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:35.894 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:35.894 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:35.894 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:35.894 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.894 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:35.894 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386735+0000", 2024-09-12T22:33:35.894 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:35.894 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.895 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.895 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:35.895 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386735+0000", 2024-09-12T22:33:35.895 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:35.895 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.895 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.895 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:35.895 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386735+0000", 2024-09-12T22:33:35.895 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.7300000000000001e-07 2024-09-12T22:33:35.895 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.895 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.895 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:35.895 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386738+0000", 2024-09-12T22:33:35.895 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8420000000000001e-06 2024-09-12T22:33:35.896 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.896 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.896 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:35.896 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386744+0000", 2024-09-12T22:33:35.896 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.3040000000000001e-06 2024-09-12T22:33:35.896 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.896 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.896 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:35.896 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386749+0000", 2024-09-12T22:33:35.896 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8409999999999999e-06 2024-09-12T22:33:35.896 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.896 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.896 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:35.897 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.428112+0000", 2024-09-12T22:33:35.897 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.041363204000000001 2024-09-12T22:33:35.897 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.897 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.897 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:35.897 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.428158+0000", 2024-09-12T22:33:35.897 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5756e-05 2024-09-12T22:33:35.897 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.897 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.897 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:35.897 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.429950+0000", 2024-09-12T22:33:35.897 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0017922859999999999 2024-09-12T22:33:35.897 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.898 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.898 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:35.898 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.429975+0000", 2024-09-12T22:33:35.898 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4640000000000001e-05 2024-09-12T22:33:35.898 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.898 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.898 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:35.898 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.430013+0000", 2024-09-12T22:33:35.898 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.8024000000000001e-05 2024-09-12T22:33:35.898 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:35.898 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:35.898 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:35.899 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.899 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.899 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3066 3.2 3:42569fed:::200.00000011:head [write 3919501~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:33:35.899 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:19.386755+0000", 2024-09-12T22:33:35.899 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 16.448823956999998, 2024-09-12T22:33:35.899 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.044668934, 2024-09-12T22:33:35.899 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:35.899 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:35.899 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:35.899 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:35.899 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.899 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:35.899 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386755+0000", 2024-09-12T22:33:35.899 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:35.900 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.900 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.900 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:35.900 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386755+0000", 2024-09-12T22:33:35.900 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:35.900 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.900 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.900 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:35.900 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386756+0000", 2024-09-12T22:33:35.900 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4499999999999997e-07 2024-09-12T22:33:35.900 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.900 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.900 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:35.901 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386763+0000", 2024-09-12T22:33:35.901 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.6459999999999993e-06 2024-09-12T22:33:35.901 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.901 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.901 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:35.901 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386770+0000", 2024-09-12T22:33:35.901 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.19e-06 2024-09-12T22:33:35.901 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.901 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.901 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:35.901 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386775+0000", 2024-09-12T22:33:35.901 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9640000000000002e-06 2024-09-12T22:33:35.901 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.902 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.902 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:35.902 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.428489+0000", 2024-09-12T22:33:35.902 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.041714539000000002 2024-09-12T22:33:35.902 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.902 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.902 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:35.902 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.428535+0000", 2024-09-12T22:33:35.902 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5658999999999998e-05 2024-09-12T22:33:35.902 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.902 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.902 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:35.902 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.431353+0000", 2024-09-12T22:33:35.902 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0028186270000000002 2024-09-12T22:33:35.903 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.903 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.903 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:35.903 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.431385+0000", 2024-09-12T22:33:35.903 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.1374000000000001e-05 2024-09-12T22:33:35.903 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.903 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.903 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:35.903 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.431424+0000", 2024-09-12T22:33:35.903 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9490000000000003e-05 2024-09-12T22:33:35.903 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:35.903 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:35.903 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:35.904 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.904 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.904 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3067 3.2 3:42569fed:::200.00000011:head [write 3920900~2245 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:33:35.904 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:19.386781+0000", 2024-09-12T22:33:35.904 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 16.448798067999999, 2024-09-12T22:33:35.904 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.044711322999999997, 2024-09-12T22:33:35.904 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:35.904 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:35.904 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:35.904 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:35.904 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.904 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:35.904 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386781+0000", 2024-09-12T22:33:35.905 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:35.905 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.905 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.905 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:35.905 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386781+0000", 2024-09-12T22:33:35.905 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:35.905 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.905 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.905 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:35.905 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386782+0000", 2024-09-12T22:33:35.905 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9900000000000001e-07 2024-09-12T22:33:35.905 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.905 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.906 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:35.906 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386795+0000", 2024-09-12T22:33:35.906 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2864000000000001e-05 2024-09-12T22:33:35.906 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.906 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.906 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:35.906 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386801+0000", 2024-09-12T22:33:35.906 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.3589999999999996e-06 2024-09-12T22:33:35.906 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.906 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.906 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:35.906 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386805+0000", 2024-09-12T22:33:35.906 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6190000000000002e-06 2024-09-12T22:33:35.906 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.907 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.907 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:35.907 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.429080+0000", 2024-09-12T22:33:35.907 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.042274027999999998 2024-09-12T22:33:35.907 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.907 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.907 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:35.907 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.429131+0000", 2024-09-12T22:33:35.907 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1715000000000002e-05 2024-09-12T22:33:35.907 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.907 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.907 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:35.907 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.431432+0000", 2024-09-12T22:33:35.908 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0023007489999999999 2024-09-12T22:33:35.908 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.908 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.908 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:35.908 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.431458+0000", 2024-09-12T22:33:35.908 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.603e-05 2024-09-12T22:33:35.908 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.908 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.908 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:35.908 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.431493+0000", 2024-09-12T22:33:35.908 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4560000000000001e-05 2024-09-12T22:33:35.908 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:35.908 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:35.909 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:35.909 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.909 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.909 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3068 3.2 3:42569fed:::200.00000011:head [write 3923145~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:33:35.909 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:19.386812+0000", 2024-09-12T22:33:35.909 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 16.448767309000001, 2024-09-12T22:33:35.909 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.045559559999999999, 2024-09-12T22:33:35.909 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:35.909 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:35.909 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:35.909 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:35.909 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.909 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:35.909 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386812+0000", 2024-09-12T22:33:35.910 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:35.910 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.910 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.910 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:35.910 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386812+0000", 2024-09-12T22:33:35.910 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:35.910 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.910 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.910 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:35.910 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386812+0000", 2024-09-12T22:33:35.910 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.01e-07 2024-09-12T22:33:35.910 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.910 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.911 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:35.911 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386823+0000", 2024-09-12T22:33:35.911 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1038e-05 2024-09-12T22:33:35.911 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.911 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.911 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:35.911 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386830+0000", 2024-09-12T22:33:35.911 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.5409999999999997e-06 2024-09-12T22:33:35.911 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.911 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.911 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:35.911 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386835+0000", 2024-09-12T22:33:35.911 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.091e-06 2024-09-12T22:33:35.912 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.912 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.912 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:35.912 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.429460+0000", 2024-09-12T22:33:35.912 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.042625333000000001 2024-09-12T22:33:35.912 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.912 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.912 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:35.912 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.429506+0000", 2024-09-12T22:33:35.912 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5299000000000001e-05 2024-09-12T22:33:35.912 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.912 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.912 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:35.913 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.432283+0000", 2024-09-12T22:33:35.913 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0027776799999999998 2024-09-12T22:33:35.913 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.913 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.913 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:35.913 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.432315+0000", 2024-09-12T22:33:35.913 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.1401e-05 2024-09-12T22:33:35.913 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.913 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.913 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:35.913 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.432372+0000", 2024-09-12T22:33:35.913 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.6776e-05 2024-09-12T22:33:35.913 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:35.914 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:35.914 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:35.914 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.914 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.914 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3069 3.2 3:42569fed:::200.00000011:head [write 3924544~2246 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:33:35.914 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:19.386842+0000", 2024-09-12T22:33:35.914 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 16.448737409, 2024-09-12T22:33:35.914 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.045596166, 2024-09-12T22:33:35.914 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:35.914 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:35.914 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:35.914 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:35.914 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.915 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:35.915 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386842+0000", 2024-09-12T22:33:35.915 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:35.915 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.915 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.915 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:35.915 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386842+0000", 2024-09-12T22:33:35.915 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:35.915 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.915 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.915 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:35.915 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386842+0000", 2024-09-12T22:33:35.915 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5200000000000002e-07 2024-09-12T22:33:35.916 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.916 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.916 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:35.916 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386845+0000", 2024-09-12T22:33:35.916 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8820000000000001e-06 2024-09-12T22:33:35.916 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.916 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.916 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:35.916 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386851+0000", 2024-09-12T22:33:35.916 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9540000000000001e-06 2024-09-12T22:33:35.916 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.916 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.916 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:35.917 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386856+0000", 2024-09-12T22:33:35.917 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5159999999999996e-06 2024-09-12T22:33:35.917 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.917 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.917 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:35.917 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.430043+0000", 2024-09-12T22:33:35.917 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.043186930999999998 2024-09-12T22:33:35.917 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.917 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.917 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:35.917 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.430086+0000", 2024-09-12T22:33:35.917 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3844999999999998e-05 2024-09-12T22:33:35.917 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.918 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.918 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:35.918 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.432379+0000", 2024-09-12T22:33:35.918 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0022922049999999999 2024-09-12T22:33:35.918 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.918 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.918 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:35.918 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.432405+0000", 2024-09-12T22:33:35.918 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5877999999999999e-05 2024-09-12T22:33:35.918 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.918 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.918 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:35.918 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.432438+0000", 2024-09-12T22:33:35.919 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3503000000000001e-05 2024-09-12T22:33:35.919 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:35.919 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:35.919 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:35.919 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.919 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.919 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3070 3.2 3:42569fed:::200.00000011:head [write 3926790~2768 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:33:35.919 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:19.387280+0000", 2024-09-12T22:33:35.919 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 16.448299241000001, 2024-09-12T22:33:35.919 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.04692201, 2024-09-12T22:33:35.919 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:35.919 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:35.919 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:35.920 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:35.920 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.920 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:35.920 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.387280+0000", 2024-09-12T22:33:35.920 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:35.920 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.920 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.920 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:35.920 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.387280+0000", 2024-09-12T22:33:35.920 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:35.920 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.920 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.920 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:35.920 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.387281+0000", 2024-09-12T22:33:35.921 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4300000000000002e-07 2024-09-12T22:33:35.921 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.921 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.921 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:35.921 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.387285+0000", 2024-09-12T22:33:35.921 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2570000000000001e-06 2024-09-12T22:33:35.921 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.921 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.921 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:35.921 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.387293+0000", 2024-09-12T22:33:35.921 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0209999999999999e-06 2024-09-12T22:33:35.921 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.921 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.922 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:35.922 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.387299+0000", 2024-09-12T22:33:35.922 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.6930000000000004e-06 2024-09-12T22:33:35.922 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.922 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.922 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:35.922 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.430441+0000", 2024-09-12T22:33:35.922 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.043141789999999999 2024-09-12T22:33:35.922 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.922 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.922 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:35.922 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.430484+0000", 2024-09-12T22:33:35.923 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3745000000000002e-05 2024-09-12T22:33:35.923 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.923 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.923 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:35.923 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.434132+0000", 2024-09-12T22:33:35.923 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00364818 2024-09-12T22:33:35.923 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.923 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.923 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:35.923 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.434163+0000", 2024-09-12T22:33:35.923 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0599000000000003e-05 2024-09-12T22:33:35.923 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.923 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.924 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:35.924 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.434202+0000", 2024-09-12T22:33:35.924 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.8982e-05 2024-09-12T22:33:35.924 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:35.924 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:35.924 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:35.924 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.924 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.924 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3071 3.2 3:42569fed:::200.00000011:head [write 3929558~3203 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:33:35.924 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:19.387860+0000", 2024-09-12T22:33:35.924 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 16.447719210999999, 2024-09-12T22:33:35.924 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.049590902999999999, 2024-09-12T22:33:35.924 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:35.925 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:35.925 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:35.925 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:35.925 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.925 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:35.925 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.387860+0000", 2024-09-12T22:33:35.925 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:35.925 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.925 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.925 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:35.925 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.387860+0000", 2024-09-12T22:33:35.925 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:35.925 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.926 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.926 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:35.926 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.387861+0000", 2024-09-12T22:33:35.926 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5099999999999999e-07 2024-09-12T22:33:35.926 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.926 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.926 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:35.926 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.387865+0000", 2024-09-12T22:33:35.926 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2629999999999997e-06 2024-09-12T22:33:35.926 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.926 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.926 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:35.926 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.387875+0000", 2024-09-12T22:33:35.926 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0256e-05 2024-09-12T22:33:35.927 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.927 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.927 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:35.927 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.387881+0000", 2024-09-12T22:33:35.927 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.947e-06 2024-09-12T22:33:35.927 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.927 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.927 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:35.927 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.430930+0000", 2024-09-12T22:33:35.927 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.043048386000000001 2024-09-12T22:33:35.927 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.927 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.927 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:35.928 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.430976+0000", 2024-09-12T22:33:35.928 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6408e-05 2024-09-12T22:33:35.928 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.928 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.928 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:35.928 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.437377+0000", 2024-09-12T22:33:35.928 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0064010719999999998 2024-09-12T22:33:35.928 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.928 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.928 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:35.928 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.437409+0000", 2024-09-12T22:33:35.928 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2054999999999997e-05 2024-09-12T22:33:35.928 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.929 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.929 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:35.929 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.437451+0000", 2024-09-12T22:33:35.929 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1764999999999997e-05 2024-09-12T22:33:35.929 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:35.929 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:35.929 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:35.929 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.929 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.929 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3072 3.2 3:42569fed:::200.00000011:head [write 3932761~2786 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:33:35.929 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:19.388005+0000", 2024-09-12T22:33:35.929 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 16.447574112000002, 2024-09-12T22:33:35.930 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.049514177999999999, 2024-09-12T22:33:35.930 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:35.930 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:35.930 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:35.930 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:35.930 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.930 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:35.930 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.388005+0000", 2024-09-12T22:33:35.930 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:35.930 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.930 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.930 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:35.930 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.388005+0000", 2024-09-12T22:33:35.931 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:35.931 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.931 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.931 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:35.931 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.388006+0000", 2024-09-12T22:33:35.931 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.1799999999999995e-07 2024-09-12T22:33:35.931 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.931 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.931 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:35.931 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.388009+0000", 2024-09-12T22:33:35.931 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.574e-06 2024-09-12T22:33:35.931 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.931 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.932 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:35.932 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.388017+0000", 2024-09-12T22:33:35.932 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3170000000000004e-06 2024-09-12T22:33:35.932 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.932 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.932 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:35.932 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.388022+0000", 2024-09-12T22:33:35.932 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9910000000000002e-06 2024-09-12T22:33:35.932 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.932 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.932 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:35.932 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.431522+0000", 2024-09-12T22:33:35.932 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0435001 2024-09-12T22:33:35.933 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.933 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.933 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:35.933 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.431567+0000", 2024-09-12T22:33:35.933 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4734000000000002e-05 2024-09-12T22:33:35.933 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.933 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.933 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:35.933 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.437458+0000", 2024-09-12T22:33:35.933 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00589166 2024-09-12T22:33:35.933 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.933 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.933 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:35.933 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.437484+0000", 2024-09-12T22:33:35.934 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5622999999999998e-05 2024-09-12T22:33:35.934 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.934 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.934 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:35.936 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.437519+0000", 2024-09-12T22:33:35.937 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.5561000000000001e-05 2024-09-12T22:33:35.937 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:35.937 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:35.937 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:35.937 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.937 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.937 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3073 3.2 3:42569fed:::200.00000011:head [write 3935547~1924 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:33:35.937 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:19.389181+0000", 2024-09-12T22:33:35.937 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 16.446397950000001, 2024-09-12T22:33:35.937 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.048402300000000002, 2024-09-12T22:33:35.937 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:35.937 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:35.938 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:35.938 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:35.938 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.938 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:35.938 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.389181+0000", 2024-09-12T22:33:35.938 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:35.938 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.938 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.938 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:35.938 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.389181+0000", 2024-09-12T22:33:35.938 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:35.938 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.938 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.939 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:35.939 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.389182+0000", 2024-09-12T22:33:35.939 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7700000000000004e-07 2024-09-12T22:33:35.939 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.939 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.939 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:35.939 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.389191+0000", 2024-09-12T22:33:35.939 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1120000000000002e-06 2024-09-12T22:33:35.939 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.939 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.939 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:35.939 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.389203+0000", 2024-09-12T22:33:35.939 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.146e-05 2024-09-12T22:33:35.940 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.940 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.940 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:35.940 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.389209+0000", 2024-09-12T22:33:35.940 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9989999999999997e-06 2024-09-12T22:33:35.940 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.940 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.940 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:35.940 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.431890+0000", 2024-09-12T22:33:35.940 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.042681251000000003 2024-09-12T22:33:35.940 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.940 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.940 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:35.941 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.431935+0000", 2024-09-12T22:33:35.941 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5166000000000001e-05 2024-09-12T22:33:35.941 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.941 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.941 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:35.941 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.437526+0000", 2024-09-12T22:33:35.941 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0055910489999999998 2024-09-12T22:33:35.941 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.941 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.941 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:35.941 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.437550+0000", 2024-09-12T22:33:35.941 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4134999999999998e-05 2024-09-12T22:33:35.941 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.942 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.942 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:35.942 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.437584+0000", 2024-09-12T22:33:35.942 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3451000000000002e-05 2024-09-12T22:33:35.942 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:35.942 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:35.942 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:35.942 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.942 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.942 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3074 3.2 3:42569fed:::200.00000011:head [write 3937471~7660 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:33:35.942 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:19.390512+0000", 2024-09-12T22:33:35.942 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 16.445066827000002, 2024-09-12T22:33:35.942 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.047134045999999999, 2024-09-12T22:33:35.943 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:35.943 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:35.943 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:35.943 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:35.943 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.943 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:35.943 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.390512+0000", 2024-09-12T22:33:35.943 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:35.943 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.943 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.943 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:35.943 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.390512+0000", 2024-09-12T22:33:35.944 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:35.944 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.944 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.944 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:35.944 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.390513+0000", 2024-09-12T22:33:35.944 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.7699999999999992e-07 2024-09-12T22:33:35.944 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.944 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.944 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:35.944 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.390522+0000", 2024-09-12T22:33:35.944 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0390000000000005e-06 2024-09-12T22:33:35.944 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.944 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.945 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:35.945 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.390530+0000", 2024-09-12T22:33:35.945 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.8349999999999993e-06 2024-09-12T22:33:35.945 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.945 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.945 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:35.945 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.390537+0000", 2024-09-12T22:33:35.945 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.1850000000000001e-06 2024-09-12T22:33:35.945 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.945 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.946 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:35.946 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.432468+0000", 2024-09-12T22:33:35.946 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.041931883000000003 2024-09-12T22:33:35.946 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.946 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.946 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:35.946 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.432512+0000", 2024-09-12T22:33:35.946 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4054999999999997e-05 2024-09-12T22:33:35.946 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.946 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.946 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:35.946 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.437590+0000", 2024-09-12T22:33:35.946 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0050777230000000001 2024-09-12T22:33:35.947 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.947 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.947 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:35.947 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.437613+0000", 2024-09-12T22:33:35.947 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.2693000000000001e-05 2024-09-12T22:33:35.947 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:35.947 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:35.947 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:35.947 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.437647+0000", 2024-09-12T22:33:35.947 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3655999999999998e-05 2024-09-12T22:33:35.947 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:35.947 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:35.947 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:35.948 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:35.948 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:35.948 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:33:35.949 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:33:35.950 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:35.948+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:36.050 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:36.049+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:36.054 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-09-12T22:33:36.054 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-09-12T22:33:36.054 INFO:teuthology.orchestra.run.smithi163.stdout: "num_ops": 0 2024-09-12T22:33:36.055 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-09-12T22:33:36.063 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:33:36.151 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:36.150+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:36.166 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-09-12T22:33:36.166 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-09-12T22:33:36.166 INFO:teuthology.orchestra.run.smithi163.stdout: "complaint_time": 30, 2024-09-12T22:33:36.166 INFO:teuthology.orchestra.run.smithi163.stdout: "num_blocked_ops": 0 2024-09-12T22:33:36.167 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-09-12T22:33:36.175 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:33:36.251 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:36.250+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:36.280 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-09-12T22:33:36.280 INFO:teuthology.orchestra.run.smithi163.stdout: "size": 20, 2024-09-12T22:33:36.280 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 600, 2024-09-12T22:33:36.280 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2024-09-12T22:33:36.280 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.281 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-09-12T22:33:36.281 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:27.254459+0000", 2024-09-12T22:33:36.281 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 129.02335518999999, 2024-09-12T22:33:36.281 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.37816283899999997, 2024-09-12T22:33:36.281 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:36.281 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:36.281 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:36.281 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:36.281 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:33:36.281 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:33:36.281 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 1 2024-09-12T22:33:36.281 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.281 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:36.281 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.282 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:36.282 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254459+0000", 2024-09-12T22:33:36.282 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:36.282 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.282 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.282 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:36.282 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254459+0000", 2024-09-12T22:33:36.282 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:36.282 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.282 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.282 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:36.282 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254460+0000", 2024-09-12T22:33:36.282 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1739999999999999e-06 2024-09-12T22:33:36.282 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.283 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.283 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:36.283 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254472+0000", 2024-09-12T22:33:36.283 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2207e-05 2024-09-12T22:33:36.283 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.283 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.283 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:36.283 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254483+0000", 2024-09-12T22:33:36.283 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0631999999999999e-05 2024-09-12T22:33:36.283 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.283 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.283 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:36.283 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254492+0000", 2024-09-12T22:33:36.284 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3670000000000003e-06 2024-09-12T22:33:36.284 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.284 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.284 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:36.284 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254551+0000", 2024-09-12T22:33:36.284 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8687999999999998e-05 2024-09-12T22:33:36.284 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.284 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.284 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for peered", 2024-09-12T22:33:36.284 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254562+0000", 2024-09-12T22:33:36.284 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1249e-05 2024-09-12T22:33:36.284 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.284 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.284 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:36.285 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.631211+0000", 2024-09-12T22:33:36.285 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.376649018 2024-09-12T22:33:36.285 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.285 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.285 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:36.285 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.631345+0000", 2024-09-12T22:33:36.285 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013378700000000001 2024-09-12T22:33:36.285 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.285 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.285 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:33:36.285 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.631479+0000", 2024-09-12T22:33:36.285 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013352399999999999 2024-09-12T22:33:36.285 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.286 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.286 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:36.286 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632324+0000", 2024-09-12T22:33:36.286 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00084508100000000002 2024-09-12T22:33:36.286 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.286 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.286 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:36.286 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632548+0000", 2024-09-12T22:33:36.286 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000224329 2024-09-12T22:33:36.286 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.286 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.286 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:36.286 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632591+0000", 2024-09-12T22:33:36.286 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2564000000000001e-05 2024-09-12T22:33:36.287 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.287 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.287 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:36.287 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632622+0000", 2024-09-12T22:33:36.287 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1219e-05 2024-09-12T22:33:36.287 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:36.287 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:36.287 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:36.287 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.287 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.287 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4490.0:9871 4.35 4:ad66404a:::10000002d4d.00000000:head [write 0~6507] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:33:36.287 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:09.472309+0000", 2024-09-12T22:33:36.287 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 26.805504914, 2024-09-12T22:33:36.287 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.080251445000000005, 2024-09-12T22:33:36.288 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:36.288 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:36.288 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:36.288 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:36.288 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4490", 2024-09-12T22:33:36.288 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:36.288 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 9871 2024-09-12T22:33:36.288 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.288 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:36.288 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.288 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:36.288 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.472309+0000", 2024-09-12T22:33:36.288 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:36.289 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.289 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.289 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:36.289 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.472309+0000", 2024-09-12T22:33:36.289 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:36.289 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.289 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.289 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:36.289 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.472310+0000", 2024-09-12T22:33:36.289 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3799999999999996e-07 2024-09-12T22:33:36.289 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.289 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.289 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:36.289 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.472318+0000", 2024-09-12T22:33:36.290 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.8099999999999998e-06 2024-09-12T22:33:36.290 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.290 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.290 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:36.290 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.472328+0000", 2024-09-12T22:33:36.290 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0359e-05 2024-09-12T22:33:36.290 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.290 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.290 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:36.290 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.472334+0000", 2024-09-12T22:33:36.290 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.0109999999999997e-06 2024-09-12T22:33:36.290 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.290 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.290 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:36.291 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.472382+0000", 2024-09-12T22:33:36.291 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.7311000000000002e-05 2024-09-12T22:33:36.291 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.291 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.291 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:36.291 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.472497+0000", 2024-09-12T22:33:36.291 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011537800000000001 2024-09-12T22:33:36.291 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.291 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.291 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:36.291 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.472617+0000", 2024-09-12T22:33:36.291 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011989600000000001 2024-09-12T22:33:36.291 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.291 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.292 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:36.292 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473149+0000", 2024-09-12T22:33:36.292 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00053227999999999999 2024-09-12T22:33:36.292 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.292 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.292 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:36.292 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.552479+0000", 2024-09-12T22:33:36.292 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.079329541000000003 2024-09-12T22:33:36.292 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.292 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.292 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:36.292 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.552525+0000", 2024-09-12T22:33:36.292 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6421000000000002e-05 2024-09-12T22:33:36.292 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.293 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.293 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:36.293 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.552561+0000", 2024-09-12T22:33:36.293 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5599999999999998e-05 2024-09-12T22:33:36.293 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:36.293 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:36.293 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:36.293 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.293 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.293 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4490.0:9872 4.2c 4:3602c8d3:::10000002d4e.00000000:head [write 0~1178] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:33:36.293 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:09.473085+0000", 2024-09-12T22:33:36.293 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 26.804729609999999, 2024-09-12T22:33:36.293 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.079631104999999994, 2024-09-12T22:33:36.293 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:36.294 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:36.294 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:36.294 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:36.294 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4490", 2024-09-12T22:33:36.294 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:36.294 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 9872 2024-09-12T22:33:36.294 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.294 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:36.294 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.294 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:36.294 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473085+0000", 2024-09-12T22:33:36.294 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:36.294 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.294 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.295 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:36.295 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473085+0000", 2024-09-12T22:33:36.295 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:36.295 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.295 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.295 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:36.295 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473085+0000", 2024-09-12T22:33:36.295 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3600000000000004e-07 2024-09-12T22:33:36.295 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.295 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.295 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:36.295 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473088+0000", 2024-09-12T22:33:36.295 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.005e-06 2024-09-12T22:33:36.295 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.296 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.296 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:36.296 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473095+0000", 2024-09-12T22:33:36.296 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3950000000000003e-06 2024-09-12T22:33:36.296 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.296 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.296 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:36.296 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473100+0000", 2024-09-12T22:33:36.296 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5460000000000002e-06 2024-09-12T22:33:36.296 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.296 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.296 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:36.296 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473138+0000", 2024-09-12T22:33:36.297 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8244999999999997e-05 2024-09-12T22:33:36.297 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.297 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.297 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:36.297 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473216+0000", 2024-09-12T22:33:36.297 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.7756000000000006e-05 2024-09-12T22:33:36.297 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.297 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.297 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:36.297 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473291+0000", 2024-09-12T22:33:36.297 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5110000000000004e-05 2024-09-12T22:33:36.297 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.297 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.297 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:36.298 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473736+0000", 2024-09-12T22:33:36.298 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00044486500000000002 2024-09-12T22:33:36.298 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.298 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.298 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:36.298 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.552637+0000", 2024-09-12T22:33:36.298 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.078900782000000003 2024-09-12T22:33:36.298 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.298 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.298 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:36.298 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.552680+0000", 2024-09-12T22:33:36.298 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3047999999999998e-05 2024-09-12T22:33:36.298 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.299 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.299 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:36.299 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.552716+0000", 2024-09-12T22:33:36.299 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5816999999999999e-05 2024-09-12T22:33:36.299 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:36.299 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:36.299 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:36.299 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.299 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.299 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4490.0:9873 4.2c 4:372c52ff:::10000002d4f.00000000:head [write 0~1230] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:33:36.299 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:09.473878+0000", 2024-09-12T22:33:36.299 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 26.803936147000002, 2024-09-12T22:33:36.299 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.079036047999999998, 2024-09-12T22:33:36.299 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:36.300 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:36.300 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:36.300 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:36.300 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4490", 2024-09-12T22:33:36.300 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:36.300 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 9873 2024-09-12T22:33:36.300 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.300 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:36.300 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.300 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:36.300 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473878+0000", 2024-09-12T22:33:36.300 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:36.300 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.300 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.301 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:36.301 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473878+0000", 2024-09-12T22:33:36.301 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:36.301 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.301 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.301 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:36.301 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473879+0000", 2024-09-12T22:33:36.301 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9100000000000004e-07 2024-09-12T22:33:36.301 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.301 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.301 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:36.301 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473882+0000", 2024-09-12T22:33:36.301 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.405e-06 2024-09-12T22:33:36.302 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.302 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.302 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:36.302 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473889+0000", 2024-09-12T22:33:36.302 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7519999999999999e-06 2024-09-12T22:33:36.302 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.302 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.302 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:36.302 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473893+0000", 2024-09-12T22:33:36.302 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9310000000000001e-06 2024-09-12T22:33:36.302 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.302 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.302 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:36.302 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473922+0000", 2024-09-12T22:33:36.303 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9346999999999999e-05 2024-09-12T22:33:36.303 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.303 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.303 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:36.303 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474000+0000", 2024-09-12T22:33:36.303 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.7972000000000005e-05 2024-09-12T22:33:36.303 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.303 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.303 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:36.303 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474072+0000", 2024-09-12T22:33:36.304 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1960999999999998e-05 2024-09-12T22:33:36.304 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.304 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.304 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:36.304 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474470+0000", 2024-09-12T22:33:36.304 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00039803400000000002 2024-09-12T22:33:36.304 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.304 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.304 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:36.304 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.552814+0000", 2024-09-12T22:33:36.304 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.078344164999999993 2024-09-12T22:33:36.304 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.304 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.304 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:36.305 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.552875+0000", 2024-09-12T22:33:36.305 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1008999999999998e-05 2024-09-12T22:33:36.305 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.305 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.305 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:36.305 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.552914+0000", 2024-09-12T22:33:36.305 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8881000000000003e-05 2024-09-12T22:33:36.305 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:36.305 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:36.305 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:36.305 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.305 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.305 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4490.0:9874 4.1b 4:db19d96a:::10000002d50.00000000:head [write 0~1088] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:33:36.305 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:09.474673+0000", 2024-09-12T22:33:36.306 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 26.803141153999999, 2024-09-12T22:33:36.306 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.080314317999999996, 2024-09-12T22:33:36.306 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:36.306 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:36.306 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:36.306 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:36.306 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4490", 2024-09-12T22:33:36.306 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:36.306 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 9874 2024-09-12T22:33:36.306 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.306 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:36.306 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.306 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:36.306 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474673+0000", 2024-09-12T22:33:36.307 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:36.307 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.307 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.307 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:36.307 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474673+0000", 2024-09-12T22:33:36.307 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:36.307 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.307 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.307 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:36.307 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474674+0000", 2024-09-12T22:33:36.307 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6199999999999998e-07 2024-09-12T22:33:36.307 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.307 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.308 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:36.308 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474677+0000", 2024-09-12T22:33:36.308 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.224e-06 2024-09-12T22:33:36.308 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.308 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.308 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:36.308 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474683+0000", 2024-09-12T22:33:36.308 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.3160000000000002e-06 2024-09-12T22:33:36.308 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.308 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.308 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:36.308 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474687+0000", 2024-09-12T22:33:36.308 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7869999999999999e-06 2024-09-12T22:33:36.308 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.309 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.309 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:36.309 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474730+0000", 2024-09-12T22:33:36.309 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3309000000000002e-05 2024-09-12T22:33:36.309 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.309 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.309 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:36.309 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474845+0000", 2024-09-12T22:33:36.309 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114306 2024-09-12T22:33:36.309 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.309 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.309 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:36.309 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474970+0000", 2024-09-12T22:33:36.310 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000125096 2024-09-12T22:33:36.310 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.310 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.310 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:36.310 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.475621+0000", 2024-09-12T22:33:36.310 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00065124900000000001 2024-09-12T22:33:36.310 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.310 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.310 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:36.310 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.554885+0000", 2024-09-12T22:33:36.310 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.079264055 2024-09-12T22:33:36.310 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.310 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.310 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:36.311 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.554942+0000", 2024-09-12T22:33:36.311 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7284000000000002e-05 2024-09-12T22:33:36.311 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.311 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.311 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:36.311 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.554987+0000", 2024-09-12T22:33:36.311 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5130000000000003e-05 2024-09-12T22:33:36.311 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:36.311 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:36.311 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:36.311 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.311 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.311 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4490.0:12220 4.2b 4:d55bfd66:::10000003169.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-12T22:33:36.312 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.391333+0000", 2024-09-12T22:33:36.312 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 21.886481011000001, 2024-09-12T22:33:36.312 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.088669550999999999, 2024-09-12T22:33:36.312 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:36.312 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:36.312 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:36.312 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:36.312 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4490", 2024-09-12T22:33:36.312 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:36.312 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 12220 2024-09-12T22:33:36.312 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.312 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:36.312 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.313 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:36.313 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.391333+0000", 2024-09-12T22:33:36.313 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:36.313 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.313 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.313 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:36.313 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.391333+0000", 2024-09-12T22:33:36.313 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:36.313 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.313 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.313 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:36.314 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.391334+0000", 2024-09-12T22:33:36.314 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3099999999999997e-07 2024-09-12T22:33:36.314 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.314 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.314 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:36.314 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398373+0000", 2024-09-12T22:33:36.314 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0070386670000000002 2024-09-12T22:33:36.314 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.314 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.314 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:36.314 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398384+0000", 2024-09-12T22:33:36.314 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1338999999999999e-05 2024-09-12T22:33:36.314 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.314 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.315 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:36.315 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398389+0000", 2024-09-12T22:33:36.315 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3650000000000003e-06 2024-09-12T22:33:36.315 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.315 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.315 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:36.315 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.456308+0000", 2024-09-12T22:33:36.315 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.057918931 2024-09-12T22:33:36.315 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.315 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.315 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:36.315 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.456425+0000", 2024-09-12T22:33:36.315 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000116452 2024-09-12T22:33:36.316 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.316 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.316 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:36.316 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.456536+0000", 2024-09-12T22:33:36.316 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000111839 2024-09-12T22:33:36.316 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.316 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.316 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:36.316 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.465335+0000", 2024-09-12T22:33:36.316 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0087984980000000001 2024-09-12T22:33:36.316 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.316 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.316 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:36.317 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.479950+0000", 2024-09-12T22:33:36.317 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.01461552 2024-09-12T22:33:36.317 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.317 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.317 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:36.317 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.479983+0000", 2024-09-12T22:33:36.317 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2126999999999999e-05 2024-09-12T22:33:36.318 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.318 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.318 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:36.318 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.480003+0000", 2024-09-12T22:33:36.318 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0081999999999998e-05 2024-09-12T22:33:36.318 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:36.318 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:36.318 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:36.318 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.319 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.319 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1208 3.13 3:cb3d3880:::200.0000000d:head [write 1009846~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:36.319 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.398459+0000", 2024-09-12T22:33:36.319 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 21.879355445000002, 2024-09-12T22:33:36.319 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.078093931000000005, 2024-09-12T22:33:36.319 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:36.319 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:36.320 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:36.320 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:36.320 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.320 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:36.320 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398459+0000", 2024-09-12T22:33:36.320 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:36.320 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.320 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.321 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:36.321 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398459+0000", 2024-09-12T22:33:36.321 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:36.321 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.321 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.321 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:36.321 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398459+0000", 2024-09-12T22:33:36.321 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8100000000000003e-07 2024-09-12T22:33:36.321 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.321 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.321 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:36.321 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398462+0000", 2024-09-12T22:33:36.321 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3700000000000002e-06 2024-09-12T22:33:36.322 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.322 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.322 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:36.322 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398469+0000", 2024-09-12T22:33:36.322 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2320000000000004e-06 2024-09-12T22:33:36.322 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.322 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.322 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:36.322 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398472+0000", 2024-09-12T22:33:36.322 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.658e-06 2024-09-12T22:33:36.322 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.322 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.322 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:36.323 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.456690+0000", 2024-09-12T22:33:36.323 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.058217615 2024-09-12T22:33:36.323 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.323 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.323 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:36.323 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.456731+0000", 2024-09-12T22:33:36.323 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0815000000000001e-05 2024-09-12T22:33:36.323 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.323 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.323 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:36.323 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.456793+0000", 2024-09-12T22:33:36.323 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1796000000000003e-05 2024-09-12T22:33:36.324 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.324 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.324 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:36.324 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.461412+0000", 2024-09-12T22:33:36.324 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0046188560000000002 2024-09-12T22:33:36.324 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.324 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.324 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:36.325 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476429+0000", 2024-09-12T22:33:36.325 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.015017943000000001 2024-09-12T22:33:36.325 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.325 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.325 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:36.325 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476499+0000", 2024-09-12T22:33:36.325 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9047000000000005e-05 2024-09-12T22:33:36.325 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.326 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.326 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:36.326 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476553+0000", 2024-09-12T22:33:36.326 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4117999999999999e-05 2024-09-12T22:33:36.326 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:36.326 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:36.326 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:36.326 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.327 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.327 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1209 3.13 3:cb3d3880:::200.0000000d:head [write 1011245~5867 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:36.327 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.398677+0000", 2024-09-12T22:33:36.327 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 21.879136888000001, 2024-09-12T22:33:36.327 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.077995698000000002, 2024-09-12T22:33:36.327 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:36.327 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:36.327 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:36.328 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:36.328 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.328 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:36.328 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398677+0000", 2024-09-12T22:33:36.328 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:36.328 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.328 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.328 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:36.329 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398677+0000", 2024-09-12T22:33:36.329 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:36.329 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.329 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.329 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:36.329 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398678+0000", 2024-09-12T22:33:36.329 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5199999999999995e-07 2024-09-12T22:33:36.329 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.329 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.330 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:36.330 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398686+0000", 2024-09-12T22:33:36.330 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0579999999999998e-06 2024-09-12T22:33:36.330 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.330 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.330 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:36.330 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398695+0000", 2024-09-12T22:33:36.330 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.1409999999999994e-06 2024-09-12T22:33:36.331 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.331 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.331 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:36.331 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398703+0000", 2024-09-12T22:33:36.331 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4379999999999998e-06 2024-09-12T22:33:36.331 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.331 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.332 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:36.332 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.457051+0000", 2024-09-12T22:33:36.332 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.058348358000000003 2024-09-12T22:33:36.332 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.332 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.332 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:36.332 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.457096+0000", 2024-09-12T22:33:36.332 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4428000000000002e-05 2024-09-12T22:33:36.333 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.333 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.333 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:36.333 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.457162+0000", 2024-09-12T22:33:36.333 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6298999999999997e-05 2024-09-12T22:33:36.333 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.333 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.333 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:36.334 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.461416+0000", 2024-09-12T22:33:36.334 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0042539980000000002 2024-09-12T22:33:36.334 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.334 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.334 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:36.334 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476610+0000", 2024-09-12T22:33:36.334 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.015193879 2024-09-12T22:33:36.334 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.335 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.335 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:36.335 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476640+0000", 2024-09-12T22:33:36.335 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0648000000000002e-05 2024-09-12T22:33:36.335 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.335 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.335 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:36.335 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476673+0000", 2024-09-12T22:33:36.335 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2598999999999997e-05 2024-09-12T22:33:36.336 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:36.336 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:36.336 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:36.336 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.336 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.336 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1210 3.13 3:cb3d3880:::200.0000000d:head [write 1017112~1958 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:36.336 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.398713+0000", 2024-09-12T22:33:36.336 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 21.879101564999999, 2024-09-12T22:33:36.337 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.078118317000000007, 2024-09-12T22:33:36.337 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:36.337 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:36.337 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:36.337 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:36.337 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.337 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:36.337 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398713+0000", 2024-09-12T22:33:36.338 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:36.338 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.338 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.338 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:36.338 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398713+0000", 2024-09-12T22:33:36.338 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:36.338 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.338 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.339 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:36.339 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398713+0000", 2024-09-12T22:33:36.339 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7599999999999998e-07 2024-09-12T22:33:36.339 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.339 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.339 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:36.339 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398718+0000", 2024-09-12T22:33:36.339 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8169999999999998e-06 2024-09-12T22:33:36.339 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.339 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.339 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:36.339 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398722+0000", 2024-09-12T22:33:36.340 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5249999999999999e-06 2024-09-12T22:33:36.340 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.340 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.340 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:36.340 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398726+0000", 2024-09-12T22:33:36.340 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5650000000000002e-06 2024-09-12T22:33:36.340 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.340 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.340 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:36.341 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.457644+0000", 2024-09-12T22:33:36.341 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.058918521000000001 2024-09-12T22:33:36.341 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.341 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.341 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:36.342 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.457724+0000", 2024-09-12T22:33:36.342 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9408999999999998e-05 2024-09-12T22:33:36.342 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.342 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.342 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:36.342 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.457821+0000", 2024-09-12T22:33:36.343 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.7015000000000005e-05 2024-09-12T22:33:36.343 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.343 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.343 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:36.343 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.461419+0000", 2024-09-12T22:33:36.343 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0035985309999999999 2024-09-12T22:33:36.343 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.344 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.344 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:36.344 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476726+0000", 2024-09-12T22:33:36.344 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.015306804 2024-09-12T22:33:36.344 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.344 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.344 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:36.344 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476787+0000", 2024-09-12T22:33:36.344 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1062000000000006e-05 2024-09-12T22:33:36.344 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.344 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.344 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:36.344 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476831+0000", 2024-09-12T22:33:36.344 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3692000000000001e-05 2024-09-12T22:33:36.345 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:36.345 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:36.345 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:36.345 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.345 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.345 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1211 3.13 3:cb3d3880:::200.0000000d:head [write 1019070~5873 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:36.345 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.400122+0000", 2024-09-12T22:33:36.345 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 21.877691847000001, 2024-09-12T22:33:36.345 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.076797146999999996, 2024-09-12T22:33:36.345 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:36.345 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:36.345 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:36.345 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:36.346 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.346 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:36.346 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.400122+0000", 2024-09-12T22:33:36.346 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:36.346 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.346 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.346 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:36.346 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.400122+0000", 2024-09-12T22:33:36.346 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:36.346 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.346 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.346 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:36.346 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.400123+0000", 2024-09-12T22:33:36.347 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2500000000000005e-07 2024-09-12T22:33:36.347 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.347 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.347 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:36.347 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.400129+0000", 2024-09-12T22:33:36.347 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.319e-06 2024-09-12T22:33:36.347 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.347 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.347 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:36.347 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.400139+0000", 2024-09-12T22:33:36.347 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.5200000000000003e-06 2024-09-12T22:33:36.348 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.348 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.348 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:36.348 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.400143+0000", 2024-09-12T22:33:36.348 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.437e-06 2024-09-12T22:33:36.348 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.348 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.348 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:36.348 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.458159+0000", 2024-09-12T22:33:36.348 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.058015960999999998 2024-09-12T22:33:36.348 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.348 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.348 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:36.349 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.458201+0000", 2024-09-12T22:33:36.349 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1693000000000002e-05 2024-09-12T22:33:36.349 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.349 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.349 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:36.349 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.458267+0000", 2024-09-12T22:33:36.349 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5687999999999999e-05 2024-09-12T22:33:36.349 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.349 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.349 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:36.349 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.461423+0000", 2024-09-12T22:33:36.349 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0031560730000000001 2024-09-12T22:33:36.350 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.350 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.350 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:36.350 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476868+0000", 2024-09-12T22:33:36.350 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.015445108000000001 2024-09-12T22:33:36.350 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.350 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.350 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:36.350 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476897+0000", 2024-09-12T22:33:36.350 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9433000000000001e-05 2024-09-12T22:33:36.350 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.350 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.350 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:36.351 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476919+0000", 2024-09-12T22:33:36.351 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.2189999999999999e-05 2024-09-12T22:33:36.351 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:36.351 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:36.351 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:36.351 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.351 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.351 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1212 3.13 3:cb3d3880:::200.0000000d:head [write 1024943~3866 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:36.351 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.401707+0000", 2024-09-12T22:33:36.351 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 21.876107642000001, 2024-09-12T22:33:36.352 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.075386625999999998, 2024-09-12T22:33:36.352 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:36.352 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:36.352 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:36.352 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:36.352 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.352 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:36.352 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.401707+0000", 2024-09-12T22:33:36.353 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:36.353 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.353 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.353 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:36.353 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.401707+0000", 2024-09-12T22:33:36.353 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:36.353 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.353 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.353 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:36.353 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.401707+0000", 2024-09-12T22:33:36.354 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7700000000000004e-07 2024-09-12T22:33:36.354 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.354 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.354 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:36.354 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.401713+0000", 2024-09-12T22:33:36.354 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6609999999999997e-06 2024-09-12T22:33:36.354 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.354 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.354 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:36.354 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.401726+0000", 2024-09-12T22:33:36.354 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.3088000000000001e-05 2024-09-12T22:33:36.355 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.355 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.355 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:36.355 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.401741+0000", 2024-09-12T22:33:36.355 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.5424e-05 2024-09-12T22:33:36.355 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.355 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.355 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:36.355 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.458853+0000", 2024-09-12T22:33:36.355 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.057111157000000003 2024-09-12T22:33:36.355 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.355 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.355 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:36.356 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.458898+0000", 2024-09-12T22:33:36.356 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5633999999999997e-05 2024-09-12T22:33:36.356 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.356 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.356 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:36.356 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.458972+0000", 2024-09-12T22:33:36.356 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3441000000000004e-05 2024-09-12T22:33:36.356 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.356 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.356 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:36.356 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.461426+0000", 2024-09-12T22:33:36.356 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0024542660000000001 2024-09-12T22:33:36.356 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.357 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.357 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:36.357 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476985+0000", 2024-09-12T22:33:36.357 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.015559513000000001 2024-09-12T22:33:36.357 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.357 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.357 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:36.357 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.477044+0000", 2024-09-12T22:33:36.357 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8156999999999999e-05 2024-09-12T22:33:36.357 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.357 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.358 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:36.358 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.477093+0000", 2024-09-12T22:33:36.358 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9607999999999997e-05 2024-09-12T22:33:36.358 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:36.358 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:36.358 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:36.358 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.358 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.359 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1213 3.13 3:cb3d3880:::200.0000000d:head [write 1028809~6329 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:36.359 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.403250+0000", 2024-09-12T22:33:36.359 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 21.874564114000002, 2024-09-12T22:33:36.359 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.073936215999999999, 2024-09-12T22:33:36.359 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:36.359 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:36.359 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:36.359 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:36.359 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.360 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:36.360 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403250+0000", 2024-09-12T22:33:36.360 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:36.360 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.360 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.360 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:36.360 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403250+0000", 2024-09-12T22:33:36.361 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:36.361 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.361 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.361 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:36.361 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403251+0000", 2024-09-12T22:33:36.361 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.37e-07 2024-09-12T22:33:36.361 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.362 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.362 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:36.362 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403258+0000", 2024-09-12T22:33:36.362 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.25e-06 2024-09-12T22:33:36.362 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.362 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.363 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:36.363 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403269+0000", 2024-09-12T22:33:36.363 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0509000000000001e-05 2024-09-12T22:33:36.363 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.363 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.363 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:36.363 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403274+0000", 2024-09-12T22:33:36.363 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1290000000000004e-06 2024-09-12T22:33:36.363 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.364 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.364 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:36.364 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.459796+0000", 2024-09-12T22:33:36.364 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.056522020999999999 2024-09-12T22:33:36.364 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.364 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.365 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:36.365 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.459845+0000", 2024-09-12T22:33:36.365 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8884999999999997e-05 2024-09-12T22:33:36.365 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.365 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.365 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:36.365 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.459920+0000", 2024-09-12T22:33:36.365 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5318e-05 2024-09-12T22:33:36.365 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.365 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.365 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:36.366 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.466542+0000", 2024-09-12T22:33:36.366 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0066223139999999998 2024-09-12T22:33:36.366 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.366 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.366 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:36.366 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.477137+0000", 2024-09-12T22:33:36.366 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010594717 2024-09-12T22:33:36.366 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.366 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.366 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:36.366 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.477165+0000", 2024-09-12T22:33:36.367 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8262000000000001e-05 2024-09-12T22:33:36.367 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.367 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.367 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:36.367 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.477186+0000", 2024-09-12T22:33:36.367 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1073999999999998e-05 2024-09-12T22:33:36.367 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:36.367 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:36.367 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:36.367 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.367 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.367 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1214 3.13 3:cb3d3880:::200.0000000d:head [write 1035138~2606 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:36.367 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.403674+0000", 2024-09-12T22:33:36.368 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 21.874140193999999, 2024-09-12T22:33:36.368 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.073643204000000004, 2024-09-12T22:33:36.368 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:36.368 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:36.368 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:36.368 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:36.368 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.368 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:36.368 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403674+0000", 2024-09-12T22:33:36.368 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:36.368 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.369 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.369 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:36.369 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403674+0000", 2024-09-12T22:33:36.369 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:36.369 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.369 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.369 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:36.369 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403674+0000", 2024-09-12T22:33:36.369 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.7700000000000005e-07 2024-09-12T22:33:36.369 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.369 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.369 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:36.369 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403678+0000", 2024-09-12T22:33:36.370 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2009999999999999e-06 2024-09-12T22:33:36.370 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.370 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.370 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:36.370 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403686+0000", 2024-09-12T22:33:36.370 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5690000000000005e-06 2024-09-12T22:33:36.370 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.370 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.370 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:36.370 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403690+0000", 2024-09-12T22:33:36.370 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.233e-06 2024-09-12T22:33:36.370 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.370 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.370 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:36.371 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.460445+0000", 2024-09-12T22:33:36.371 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.056754412999999997 2024-09-12T22:33:36.371 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.371 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.371 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:36.371 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.460495+0000", 2024-09-12T22:33:36.371 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0238999999999998e-05 2024-09-12T22:33:36.371 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.371 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.371 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:36.371 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.460566+0000", 2024-09-12T22:33:36.371 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1159000000000001e-05 2024-09-12T22:33:36.371 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.372 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.372 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:36.372 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.466546+0000", 2024-09-12T22:33:36.372 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0059798910000000002 2024-09-12T22:33:36.372 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.372 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.372 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:36.372 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.477232+0000", 2024-09-12T22:33:36.372 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010686084 2024-09-12T22:33:36.372 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.372 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.372 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:36.372 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.477280+0000", 2024-09-12T22:33:36.372 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.7719999999999997e-05 2024-09-12T22:33:36.373 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.373 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.373 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:36.373 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.477317+0000", 2024-09-12T22:33:36.373 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7218000000000002e-05 2024-09-12T22:33:36.373 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:36.373 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:36.373 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:36.374 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.374 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.374 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1223 3.13 3:cb3d3880:::200.0000000d:head [write 1090497~1913 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:36.374 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.420111+0000", 2024-09-12T22:33:36.374 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 21.857703042000001, 2024-09-12T22:33:36.374 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.071634583000000002, 2024-09-12T22:33:36.374 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:36.374 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:36.374 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:36.374 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:36.374 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.374 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:36.375 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.420111+0000", 2024-09-12T22:33:36.375 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:36.375 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.375 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.375 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:36.375 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.420111+0000", 2024-09-12T22:33:36.375 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:36.375 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.375 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.375 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:36.375 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.420112+0000", 2024-09-12T22:33:36.375 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.2900000000000002e-07 2024-09-12T22:33:36.375 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.375 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.376 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:36.376 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.420116+0000", 2024-09-12T22:33:36.376 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.67e-06 2024-09-12T22:33:36.376 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.376 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.376 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:36.376 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.420125+0000", 2024-09-12T22:33:36.376 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.0890000000000006e-06 2024-09-12T22:33:36.376 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.376 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.376 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:36.377 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.420131+0000", 2024-09-12T22:33:36.377 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4269999999999996e-06 2024-09-12T22:33:36.377 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.377 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.377 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:36.377 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.465358+0000", 2024-09-12T22:33:36.377 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.045227030000000001 2024-09-12T22:33:36.377 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.377 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.377 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:36.378 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.465439+0000", 2024-09-12T22:33:36.378 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0901000000000004e-05 2024-09-12T22:33:36.378 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.378 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.378 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:36.378 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.465571+0000", 2024-09-12T22:33:36.378 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000131705 2024-09-12T22:33:36.378 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.378 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.378 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:36.378 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.469496+0000", 2024-09-12T22:33:36.378 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.003925418 2024-09-12T22:33:36.378 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.378 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.379 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:36.379 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.491669+0000", 2024-09-12T22:33:36.379 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.022172335000000001 2024-09-12T22:33:36.379 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.379 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.379 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:36.379 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.491714+0000", 2024-09-12T22:33:36.379 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5417000000000002e-05 2024-09-12T22:33:36.379 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.379 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.379 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:36.379 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.491746+0000", 2024-09-12T22:33:36.379 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1662000000000003e-05 2024-09-12T22:33:36.380 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:36.380 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:36.380 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:36.380 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.380 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.380 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1225 3.13 3:cb3d3880:::200.0000000d:head [write 1097316~1932 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:36.380 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.421303+0000", 2024-09-12T22:33:36.380 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 21.856511207, 2024-09-12T22:33:36.380 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.074934770999999997, 2024-09-12T22:33:36.380 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:36.380 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:36.380 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:36.380 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:36.381 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.381 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:36.381 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.421303+0000", 2024-09-12T22:33:36.381 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:36.381 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.381 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.381 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:36.381 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.421303+0000", 2024-09-12T22:33:36.381 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:36.381 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.381 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.381 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:36.382 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.421303+0000", 2024-09-12T22:33:36.382 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8599999999999998e-07 2024-09-12T22:33:36.382 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.382 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.382 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:36.382 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.421307+0000", 2024-09-12T22:33:36.382 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0879999999999999e-06 2024-09-12T22:33:36.382 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.382 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.382 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:36.382 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.421314+0000", 2024-09-12T22:33:36.382 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1010000000000003e-06 2024-09-12T22:33:36.382 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.383 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.383 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:36.383 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.421319+0000", 2024-09-12T22:33:36.383 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7209999999999999e-06 2024-09-12T22:33:36.383 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.383 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.383 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:36.383 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.466620+0000", 2024-09-12T22:33:36.383 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.045301044999999998 2024-09-12T22:33:36.383 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.383 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.383 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:36.384 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.466703+0000", 2024-09-12T22:33:36.384 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3011999999999997e-05 2024-09-12T22:33:36.384 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.384 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.384 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:36.384 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.466826+0000", 2024-09-12T22:33:36.385 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000122824 2024-09-12T22:33:36.385 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.385 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.385 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:36.385 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.472359+0000", 2024-09-12T22:33:36.385 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0055323009999999999 2024-09-12T22:33:36.385 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.385 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.385 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:36.385 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496142+0000", 2024-09-12T22:33:36.385 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.023783696999999999 2024-09-12T22:33:36.385 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.386 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.386 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:36.386 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496194+0000", 2024-09-12T22:33:36.386 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1350000000000001e-05 2024-09-12T22:33:36.386 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.386 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.387 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:36.387 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496238+0000", 2024-09-12T22:33:36.387 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4146000000000001e-05 2024-09-12T22:33:36.387 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:36.387 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:36.387 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:36.387 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.387 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.387 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1226 3.13 3:cb3d3880:::200.0000000d:head [write 1099248~1973 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:36.388 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.422971+0000", 2024-09-12T22:33:36.388 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 21.854843609, 2024-09-12T22:33:36.388 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.073363063000000006, 2024-09-12T22:33:36.388 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:36.388 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:36.388 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:36.388 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:36.388 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.388 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:36.389 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.422971+0000", 2024-09-12T22:33:36.389 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:36.389 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.389 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.389 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:36.389 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.422971+0000", 2024-09-12T22:33:36.389 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:36.389 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.389 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.389 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:36.389 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.422971+0000", 2024-09-12T22:33:36.389 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.1699999999999997e-07 2024-09-12T22:33:36.389 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.390 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.390 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:36.390 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.422975+0000", 2024-09-12T22:33:36.390 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2650000000000001e-06 2024-09-12T22:33:36.390 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.390 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.390 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:36.390 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.422981+0000", 2024-09-12T22:33:36.390 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7379999999999997e-06 2024-09-12T22:33:36.390 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.391 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.391 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:36.391 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.422986+0000", 2024-09-12T22:33:36.391 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5220000000000001e-06 2024-09-12T22:33:36.391 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.391 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.391 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:36.391 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.467340+0000", 2024-09-12T22:33:36.391 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.044353985999999998 2024-09-12T22:33:36.391 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.391 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.391 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:36.392 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.467412+0000", 2024-09-12T22:33:36.392 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1982000000000003e-05 2024-09-12T22:33:36.392 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.392 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.392 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:36.392 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.467493+0000", 2024-09-12T22:33:36.392 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0829999999999997e-05 2024-09-12T22:33:36.392 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.392 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.392 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:36.393 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.472364+0000", 2024-09-12T22:33:36.393 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0048713189999999998 2024-09-12T22:33:36.393 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.393 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.393 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:36.393 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496271+0000", 2024-09-12T22:33:36.393 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.023906808000000002 2024-09-12T22:33:36.393 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.394 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.394 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:36.394 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496300+0000", 2024-09-12T22:33:36.394 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9315e-05 2024-09-12T22:33:36.394 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.394 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.394 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:36.394 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496334+0000", 2024-09-12T22:33:36.394 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3481e-05 2024-09-12T22:33:36.394 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:36.394 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:36.395 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:36.395 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.395 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.395 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1227 3.13 3:cb3d3880:::200.0000000d:head [write 1101221~1922 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:36.395 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.423028+0000", 2024-09-12T22:33:36.395 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 21.854786624999999, 2024-09-12T22:33:36.395 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.073444802000000003, 2024-09-12T22:33:36.395 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:36.395 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:36.396 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:36.396 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:36.396 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.396 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:36.396 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423028+0000", 2024-09-12T22:33:36.396 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:36.396 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.396 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.396 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:36.396 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423028+0000", 2024-09-12T22:33:36.396 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:36.397 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.397 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.397 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:36.397 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423028+0000", 2024-09-12T22:33:36.397 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1699999999999998e-07 2024-09-12T22:33:36.397 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.397 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.397 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:36.397 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423031+0000", 2024-09-12T22:33:36.397 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8499999999999998e-06 2024-09-12T22:33:36.397 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.397 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.397 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:36.398 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423036+0000", 2024-09-12T22:33:36.398 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9479999999999999e-06 2024-09-12T22:33:36.398 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.398 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.398 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:36.398 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423039+0000", 2024-09-12T22:33:36.398 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4929999999999998e-06 2024-09-12T22:33:36.398 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.398 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.398 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:36.398 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.467785+0000", 2024-09-12T22:33:36.398 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.044745957000000003 2024-09-12T22:33:36.398 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.398 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.399 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:36.399 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.467838+0000", 2024-09-12T22:33:36.399 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2596999999999998e-05 2024-09-12T22:33:36.399 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.399 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.399 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:36.399 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.467915+0000", 2024-09-12T22:33:36.399 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6744999999999998e-05 2024-09-12T22:33:36.399 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.399 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.399 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:36.400 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.472368+0000", 2024-09-12T22:33:36.400 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0044534730000000003 2024-09-12T22:33:36.400 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.400 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.400 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:36.400 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496382+0000", 2024-09-12T22:33:36.400 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.024014111000000001 2024-09-12T22:33:36.400 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.401 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.401 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:36.401 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496443+0000", 2024-09-12T22:33:36.401 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.0547000000000002e-05 2024-09-12T22:33:36.401 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.402 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.402 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:36.402 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496472+0000", 2024-09-12T22:33:36.402 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9564e-05 2024-09-12T22:33:36.402 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:36.402 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:36.402 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:36.402 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.402 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.402 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1228 3.13 3:cb3d3880:::200.0000000d:head [write 1103143~2423 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:36.403 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.423305+0000", 2024-09-12T22:33:36.403 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 21.854509261, 2024-09-12T22:33:36.403 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.073251160999999995, 2024-09-12T22:33:36.403 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:36.403 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:36.403 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:36.403 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:36.403 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.403 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:36.403 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423305+0000", 2024-09-12T22:33:36.403 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:36.403 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.403 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.404 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:36.404 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423305+0000", 2024-09-12T22:33:36.404 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:36.404 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.404 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.404 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:36.404 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423306+0000", 2024-09-12T22:33:36.404 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4899999999999995e-07 2024-09-12T22:33:36.404 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.404 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.404 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:36.405 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423311+0000", 2024-09-12T22:33:36.405 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7459999999999997e-06 2024-09-12T22:33:36.405 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.405 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.405 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:36.405 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423316+0000", 2024-09-12T22:33:36.405 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0239999999999997e-06 2024-09-12T22:33:36.406 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.406 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.406 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:36.406 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423320+0000", 2024-09-12T22:33:36.406 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.67e-06 2024-09-12T22:33:36.406 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.406 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.406 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:36.406 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.468252+0000", 2024-09-12T22:33:36.406 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.044932262000000001 2024-09-12T22:33:36.406 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.406 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.406 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:36.407 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.468293+0000", 2024-09-12T22:33:36.407 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0368999999999999e-05 2024-09-12T22:33:36.407 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.407 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.407 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:36.407 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.468357+0000", 2024-09-12T22:33:36.407 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4287000000000003e-05 2024-09-12T22:33:36.407 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.407 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.407 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:36.407 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.472371+0000", 2024-09-12T22:33:36.407 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0040144350000000002 2024-09-12T22:33:36.407 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.408 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.408 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:36.408 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496507+0000", 2024-09-12T22:33:36.408 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.024135961000000001 2024-09-12T22:33:36.408 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.408 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.408 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:36.408 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496537+0000", 2024-09-12T22:33:36.408 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9611000000000002e-05 2024-09-12T22:33:36.408 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.408 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.409 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:36.409 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496556+0000", 2024-09-12T22:33:36.409 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9147000000000002e-05 2024-09-12T22:33:36.409 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:36.409 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:36.409 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:36.409 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.409 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.409 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1229 3.13 3:cb3d3880:::200.0000000d:head [write 1105566~1911 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:36.409 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.423606+0000", 2024-09-12T22:33:36.409 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 21.854208249999999, 2024-09-12T22:33:36.409 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.073027876000000005, 2024-09-12T22:33:36.409 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:36.410 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:36.410 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:36.410 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:36.410 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.410 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:36.410 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423606+0000", 2024-09-12T22:33:36.410 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:36.410 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.410 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.410 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:36.410 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423606+0000", 2024-09-12T22:33:36.410 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:36.410 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.411 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.411 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:36.411 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423606+0000", 2024-09-12T22:33:36.411 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.7e-07 2024-09-12T22:33:36.411 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.411 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.411 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:36.411 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423609+0000", 2024-09-12T22:33:36.411 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5339999999999998e-06 2024-09-12T22:33:36.411 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.411 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.411 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:36.411 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423614+0000", 2024-09-12T22:33:36.411 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.69e-06 2024-09-12T22:33:36.412 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.412 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.412 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:36.412 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423617+0000", 2024-09-12T22:33:36.412 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4300000000000002e-06 2024-09-12T22:33:36.412 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.412 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.412 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:36.412 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.468606+0000", 2024-09-12T22:33:36.412 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.044988606 2024-09-12T22:33:36.412 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.412 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.412 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:36.413 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.468649+0000", 2024-09-12T22:33:36.413 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3414000000000001e-05 2024-09-12T22:33:36.413 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.413 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.413 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:36.413 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.468714+0000", 2024-09-12T22:33:36.413 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4857000000000006e-05 2024-09-12T22:33:36.413 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.413 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.413 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:36.413 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.472375+0000", 2024-09-12T22:33:36.413 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0036607330000000002 2024-09-12T22:33:36.413 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.413 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.414 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:36.414 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496585+0000", 2024-09-12T22:33:36.414 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.024210835 2024-09-12T22:33:36.414 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.414 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.414 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:36.414 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496612+0000", 2024-09-12T22:33:36.414 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6999999999999999e-05 2024-09-12T22:33:36.414 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.414 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.414 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:36.414 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496634+0000", 2024-09-12T22:33:36.414 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1307000000000001e-05 2024-09-12T22:33:36.415 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:36.415 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:36.415 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:36.415 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.415 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.415 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1230 3.13 3:cb3d3880:::200.0000000d:head [write 1107477~6537 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:36.415 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.423911+0000", 2024-09-12T22:33:36.415 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 21.853903405000001, 2024-09-12T22:33:36.415 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.072794530999999996, 2024-09-12T22:33:36.416 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:36.416 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:36.416 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:36.416 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:36.416 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.416 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:36.417 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423911+0000", 2024-09-12T22:33:36.417 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:36.417 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.417 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.417 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:36.417 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423911+0000", 2024-09-12T22:33:36.417 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:36.418 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.418 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.418 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:36.418 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423911+0000", 2024-09-12T22:33:36.418 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3799999999999998e-07 2024-09-12T22:33:36.418 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.419 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.419 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:36.419 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423919+0000", 2024-09-12T22:33:36.419 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.8329999999999994e-06 2024-09-12T22:33:36.419 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.419 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.420 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:36.420 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423924+0000", 2024-09-12T22:33:36.420 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3449999999999996e-06 2024-09-12T22:33:36.420 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.420 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.420 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:36.421 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423928+0000", 2024-09-12T22:33:36.421 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2339999999999999e-06 2024-09-12T22:33:36.421 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.421 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.421 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:36.421 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.469042+0000", 2024-09-12T22:33:36.421 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.045114888999999998 2024-09-12T22:33:36.421 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.422 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.422 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:36.422 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.469092+0000", 2024-09-12T22:33:36.422 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9289000000000002e-05 2024-09-12T22:33:36.422 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.422 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.422 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:36.422 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.469163+0000", 2024-09-12T22:33:36.422 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1222000000000004e-05 2024-09-12T22:33:36.422 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.422 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.422 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:36.422 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.472379+0000", 2024-09-12T22:33:36.423 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0032156419999999999 2024-09-12T22:33:36.423 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.423 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.423 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:36.423 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496661+0000", 2024-09-12T22:33:36.423 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.024281857 2024-09-12T22:33:36.423 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.423 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.423 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:36.423 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496687+0000", 2024-09-12T22:33:36.423 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6551e-05 2024-09-12T22:33:36.423 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:36.423 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:36.423 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:36.424 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496705+0000", 2024-09-12T22:33:36.424 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.8230999999999999e-05 2024-09-12T22:33:36.424 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:36.424 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:36.424 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:36.424 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:36.424 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:36.424 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-09-12T22:33:36.426 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:36.424+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:36.426 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T22:33:36.527 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:36.526+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:36.531 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:33:36.531 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:33:36.531 INFO:teuthology.orchestra.run.smithi148.stdout: "num_ops": 0 2024-09-12T22:33:36.531 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:33:36.541 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T22:33:36.628 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:36.627+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:36.644 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi019.front.sepia.ceph.com 2024-09-12T22:33:36.644 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T22:33:36.644 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-12T22:33:36.670 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T22:33:36.670 DEBUG:teuthology.orchestra.run.smithi019:> ip netns list 2024-09-12T22:33:36.684 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:33:36.685 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [], 2024-09-12T22:33:36.685 INFO:teuthology.orchestra.run.smithi148.stdout: "complaint_time": 30, 2024-09-12T22:33:36.685 INFO:teuthology.orchestra.run.smithi148.stdout: "num_blocked_ops": 0 2024-09-12T22:33:36.685 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:33:36.693 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T22:33:36.729 INFO:teuthology.orchestra.run.smithi019.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-12T22:33:36.730 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T22:33:36.730 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T22:33:36.734 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:36.733+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:36.801 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T22:33:36.801 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link delete ceph-brx 2024-09-12T22:33:36.829 INFO:tasks.ceph.osd.1.smithi148.stderr:2024-09-12T22:33:36.828+0000 7f9496829640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 30590) UID: 0 2024-09-12T22:33:36.839 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-12T22:33:36.839 INFO:teuthology.orchestra.run.smithi148.stdout: "size": 20, 2024-09-12T22:33:36.839 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 600, 2024-09-12T22:33:36.839 INFO:teuthology.orchestra.run.smithi148.stdout: "ops": [ 2024-09-12T22:33:36.839 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.839 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4490.0:9866 4.b 4:d370243b:::10000002d48.00000000:head [write 0~1308] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:33:36.840 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:09.467883+0000", 2024-09-12T22:33:36.840 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 27.369594843000002, 2024-09-12T22:33:36.840 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.085024817000000003, 2024-09-12T22:33:36.840 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:36.840 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:36.840 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:36.840 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:33:36.840 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4490", 2024-09-12T22:33:36.840 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:36.840 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 9866 2024-09-12T22:33:36.840 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.841 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:36.841 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.841 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:36.841 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.467883+0000", 2024-09-12T22:33:36.841 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:36.841 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.841 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.841 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:36.841 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.467883+0000", 2024-09-12T22:33:36.841 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:36.841 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.841 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.841 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:36.842 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.467884+0000", 2024-09-12T22:33:36.842 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1800000000000005e-07 2024-09-12T22:33:36.842 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.842 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.842 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:36.842 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.467888+0000", 2024-09-12T22:33:36.842 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5959999999999997e-06 2024-09-12T22:33:36.842 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.842 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.842 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:36.842 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.467896+0000", 2024-09-12T22:33:36.842 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.8679999999999999e-06 2024-09-12T22:33:36.842 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.843 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.843 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:36.843 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.467901+0000", 2024-09-12T22:33:36.843 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9169999999999997e-06 2024-09-12T22:33:36.843 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.843 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.843 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:36.843 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.467944+0000", 2024-09-12T22:33:36.843 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3055e-05 2024-09-12T22:33:36.843 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.843 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.844 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:36.844 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.468011+0000", 2024-09-12T22:33:36.844 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7328000000000003e-05 2024-09-12T22:33:36.844 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.844 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.844 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:36.844 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.468078+0000", 2024-09-12T22:33:36.844 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7063999999999994e-05 2024-09-12T22:33:36.844 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.844 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.844 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:36.844 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.551406+0000", 2024-09-12T22:33:36.844 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.083327485000000007 2024-09-12T22:33:36.845 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.845 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.845 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:36.845 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.552822+0000", 2024-09-12T22:33:36.845 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001415929 2024-09-12T22:33:36.845 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.845 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.845 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:36.845 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.552863+0000", 2024-09-12T22:33:36.845 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.0809000000000002e-05 2024-09-12T22:33:36.845 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.845 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.846 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:36.846 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.552908+0000", 2024-09-12T22:33:36.846 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5048e-05 2024-09-12T22:33:36.846 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:36.846 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:36.846 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:36.846 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.846 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.846 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4490.0:9867 4.16 4:6bd8f1b8:::10000002d49.00000000:head [write 0~1599] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:33:36.846 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:09.468760+0000", 2024-09-12T22:33:36.847 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 27.368717834000002, 2024-09-12T22:33:36.847 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.086660499000000002, 2024-09-12T22:33:36.847 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:36.847 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:36.847 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:36.847 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:33:36.847 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4490", 2024-09-12T22:33:36.847 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:36.847 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 9867 2024-09-12T22:33:36.847 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.847 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:36.847 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.847 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:36.848 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.468760+0000", 2024-09-12T22:33:36.848 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:36.848 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.848 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.848 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:36.848 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.468760+0000", 2024-09-12T22:33:36.848 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:36.848 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.848 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.849 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:36.849 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.468761+0000", 2024-09-12T22:33:36.849 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4399999999999999e-07 2024-09-12T22:33:36.849 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.849 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.849 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:36.849 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.468765+0000", 2024-09-12T22:33:36.849 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3259999999999997e-06 2024-09-12T22:33:36.849 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.849 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.849 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:36.849 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.548969+0000", 2024-09-12T22:33:36.849 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.080204172000000004 2024-09-12T22:33:36.849 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.850 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.850 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:36.850 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.549001+0000", 2024-09-12T22:33:36.850 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.1464999999999998e-05 2024-09-12T22:33:36.850 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.850 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.850 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:36.850 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.549148+0000", 2024-09-12T22:33:36.850 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00014749399999999999 2024-09-12T22:33:36.850 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.850 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.850 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:36.850 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.549379+0000", 2024-09-12T22:33:36.850 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.000231091 2024-09-12T22:33:36.851 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.851 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.851 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "waiting for subops from 2", 2024-09-12T22:33:36.851 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.549518+0000", 2024-09-12T22:33:36.851 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00013844899999999999 2024-09-12T22:33:36.851 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.851 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.851 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:36.851 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.552236+0000", 2024-09-12T22:33:36.851 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0027179869999999998 2024-09-12T22:33:36.851 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.851 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.851 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:36.852 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.555333+0000", 2024-09-12T22:33:36.852 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0030973559999999999 2024-09-12T22:33:36.852 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.852 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.852 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:36.852 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.555379+0000", 2024-09-12T22:33:36.852 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6236999999999998e-05 2024-09-12T22:33:36.852 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.852 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.852 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:36.852 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.555420+0000", 2024-09-12T22:33:36.852 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1177999999999998e-05 2024-09-12T22:33:36.852 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:36.853 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:36.853 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:36.853 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.853 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.853 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop_reply(client.4490.0:9866 4.b e53/18 ondisk, result = 0)", 2024-09-12T22:33:36.853 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:09.468826+0000", 2024-09-12T22:33:36.853 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 27.368651538999998, 2024-09-12T22:33:36.853 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.082588348000000006, 2024-09-12T22:33:36.853 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:36.853 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:36.853 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "started", 2024-09-12T22:33:36.853 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:36.854 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.854 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:36.854 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.468826+0000", 2024-09-12T22:33:36.854 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:36.854 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.854 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.854 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:36.854 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.468826+0000", 2024-09-12T22:33:36.854 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:36.854 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.854 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.854 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:36.854 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.468827+0000", 2024-09-12T22:33:36.854 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.3399999999999999e-07 2024-09-12T22:33:36.855 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.855 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.855 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:36.855 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.468830+0000", 2024-09-12T22:33:36.855 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.1559999999999999e-06 2024-09-12T22:33:36.855 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.855 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.855 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:36.855 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.548957+0000", 2024-09-12T22:33:36.855 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.080126852999999998 2024-09-12T22:33:36.855 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.855 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.855 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:36.855 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.548989+0000", 2024-09-12T22:33:36.856 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2409000000000001e-05 2024-09-12T22:33:36.856 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.856 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.856 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:36.856 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.551065+0000", 2024-09-12T22:33:36.856 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.002075871 2024-09-12T22:33:36.856 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.856 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.856 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:36.856 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.551398+0000", 2024-09-12T22:33:36.856 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00033339099999999999 2024-09-12T22:33:36.856 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.856 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.856 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:36.857 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:09.551414+0000", 2024-09-12T22:33:36.857 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.6133999999999998e-05 2024-09-12T22:33:36.857 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:36.857 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:36.857 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:36.857 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.857 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.857 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4490.0:10437 4.2f 4:f6cd553b:::10000002fce.00000000:head [write 0~27313] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:33:36.857 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:10.050890+0000", 2024-09-12T22:33:36.857 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 26.786587142999998, 2024-09-12T22:33:36.857 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.056482601, 2024-09-12T22:33:36.857 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:36.857 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:36.857 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:36.858 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:33:36.858 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4490", 2024-09-12T22:33:36.858 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:36.858 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 10437 2024-09-12T22:33:36.858 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.858 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:36.858 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.858 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:36.858 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.050890+0000", 2024-09-12T22:33:36.858 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:36.858 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.858 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.858 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:36.858 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.050890+0000", 2024-09-12T22:33:36.859 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:36.859 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.859 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.859 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:36.859 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.050891+0000", 2024-09-12T22:33:36.859 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.6600000000000005e-07 2024-09-12T22:33:36.859 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.859 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.859 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:36.859 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.050906+0000", 2024-09-12T22:33:36.859 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.4521e-05 2024-09-12T22:33:36.859 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.859 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.859 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:36.860 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.050915+0000", 2024-09-12T22:33:36.860 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.2569999999999996e-06 2024-09-12T22:33:36.860 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.860 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.860 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:36.860 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.050920+0000", 2024-09-12T22:33:36.860 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.724e-06 2024-09-12T22:33:36.860 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.860 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.860 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:36.860 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.050960+0000", 2024-09-12T22:33:36.860 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9999000000000001e-05 2024-09-12T22:33:36.860 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.860 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.861 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:36.861 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.051031+0000", 2024-09-12T22:33:36.861 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.1007000000000006e-05 2024-09-12T22:33:36.861 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.861 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.861 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:36.861 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.107249+0000", 2024-09-12T22:33:36.861 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.056218432999999998 2024-09-12T22:33:36.861 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.861 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.861 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:36.861 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.107301+0000", 2024-09-12T22:33:36.861 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1289000000000003e-05 2024-09-12T22:33:36.861 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.862 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.862 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:36.862 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.107373+0000", 2024-09-12T22:33:36.862 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.2504999999999998e-05 2024-09-12T22:33:36.862 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:36.862 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:36.862 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:36.862 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.862 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.862 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4490.0:10439 4.12 4:483953cb:::10000002fd0.00000000:head [write 0~4842] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:33:36.862 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:10.052567+0000", 2024-09-12T22:33:36.862 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 26.784910934999999, 2024-09-12T22:33:36.862 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.055835449000000002, 2024-09-12T22:33:36.863 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:36.863 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:36.863 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:36.863 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:33:36.863 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4490", 2024-09-12T22:33:36.863 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:36.863 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 10439 2024-09-12T22:33:36.864 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.864 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:36.864 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.864 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:36.864 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.052567+0000", 2024-09-12T22:33:36.864 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:36.864 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.864 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.864 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:36.864 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.052567+0000", 2024-09-12T22:33:36.864 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:36.864 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.864 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.865 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:36.865 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.052568+0000", 2024-09-12T22:33:36.865 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.3600000000000002e-07 2024-09-12T22:33:36.865 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.865 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.865 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:36.865 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.052591+0000", 2024-09-12T22:33:36.865 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.3110000000000001e-05 2024-09-12T22:33:36.865 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.865 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.865 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:36.865 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.106740+0000", 2024-09-12T22:33:36.865 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.054149315000000003 2024-09-12T22:33:36.865 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.866 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.866 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:36.866 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.106751+0000", 2024-09-12T22:33:36.866 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1056000000000001e-05 2024-09-12T22:33:36.866 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.866 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.866 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:36.866 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.106811+0000", 2024-09-12T22:33:36.866 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9515999999999997e-05 2024-09-12T22:33:36.866 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.866 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.866 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:36.866 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.106929+0000", 2024-09-12T22:33:36.867 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00011879000000000001 2024-09-12T22:33:36.867 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.867 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.867 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:36.867 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.108283+0000", 2024-09-12T22:33:36.867 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001354177 2024-09-12T22:33:36.867 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.867 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.867 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:36.867 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.108328+0000", 2024-09-12T22:33:36.867 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4931000000000001e-05 2024-09-12T22:33:36.867 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.867 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.867 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:36.868 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.108402+0000", 2024-09-12T22:33:36.868 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3718000000000001e-05 2024-09-12T22:33:36.868 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:36.868 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:36.868 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:36.868 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.868 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.868 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_repop(client.4490.0:10445 4.3c e53/18 4:3d97251e:::10000002fd8.00000000:head v 53'154, mlcod=53'152)", 2024-09-12T22:33:36.868 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:10.058521+0000", 2024-09-12T22:33:36.868 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 26.778956595, 2024-09-12T22:33:36.868 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.049310138000000003, 2024-09-12T22:33:36.868 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:36.868 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:36.868 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:36.869 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:36.869 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.869 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:36.869 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.058521+0000", 2024-09-12T22:33:36.869 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:36.869 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.869 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.869 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:36.869 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.058521+0000", 2024-09-12T22:33:36.869 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:36.869 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.869 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.869 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:36.869 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.058522+0000", 2024-09-12T22:33:36.870 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.1099999999999995e-07 2024-09-12T22:33:36.870 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.870 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.870 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:36.870 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.058530+0000", 2024-09-12T22:33:36.870 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.7290000000000006e-06 2024-09-12T22:33:36.870 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.870 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.870 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:36.870 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.106760+0000", 2024-09-12T22:33:36.870 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.048229384 2024-09-12T22:33:36.870 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.870 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.871 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:36.871 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.106770+0000", 2024-09-12T22:33:36.871 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0431999999999999e-05 2024-09-12T22:33:36.871 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.871 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.871 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:36.871 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.106823+0000", 2024-09-12T22:33:36.871 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.2309999999999999e-05 2024-09-12T22:33:36.871 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.871 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.871 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:36.871 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.106841+0000", 2024-09-12T22:33:36.871 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.8218000000000001e-05 2024-09-12T22:33:36.871 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.871 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.872 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:36.872 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.107796+0000", 2024-09-12T22:33:36.872 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00095552600000000005 2024-09-12T22:33:36.872 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.872 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.872 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:36.872 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:10.107831+0000", 2024-09-12T22:33:36.872 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4928000000000002e-05 2024-09-12T22:33:36.872 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:36.872 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:36.872 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:36.872 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.872 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.873 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4490.0:11351 4.3f 4:fd498422:::10000003188.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-12T22:33:36.873 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:13.354715+0000", 2024-09-12T22:33:36.873 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 23.482762781000002, 2024-09-12T22:33:36.873 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.043059568999999999, 2024-09-12T22:33:36.873 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:36.873 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:36.873 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:36.873 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:33:36.873 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4490", 2024-09-12T22:33:36.873 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:36.873 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 11351 2024-09-12T22:33:36.873 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.873 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:36.873 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.874 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:36.874 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.354715+0000", 2024-09-12T22:33:36.874 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:36.874 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.874 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.874 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:36.874 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.354715+0000", 2024-09-12T22:33:36.874 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:36.874 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.874 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.874 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:36.874 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.354716+0000", 2024-09-12T22:33:36.874 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.7600000000000006e-07 2024-09-12T22:33:36.874 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.875 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.875 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:36.875 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.361477+0000", 2024-09-12T22:33:36.875 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0067607090000000002 2024-09-12T22:33:36.875 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.875 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.875 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:36.875 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.361487+0000", 2024-09-12T22:33:36.875 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0249e-05 2024-09-12T22:33:36.875 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.875 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.875 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:36.875 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.361493+0000", 2024-09-12T22:33:36.875 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.4699999999999999e-06 2024-09-12T22:33:36.876 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.876 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.876 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:36.876 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.361544+0000", 2024-09-12T22:33:36.876 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1124e-05 2024-09-12T22:33:36.876 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.876 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.876 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:36.876 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.361604+0000", 2024-09-12T22:33:36.876 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9397000000000001e-05 2024-09-12T22:33:36.876 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.876 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.876 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:36.876 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.397601+0000", 2024-09-12T22:33:36.877 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.035996927999999997 2024-09-12T22:33:36.877 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.877 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.877 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:36.877 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.397646+0000", 2024-09-12T22:33:36.877 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5176000000000003e-05 2024-09-12T22:33:36.877 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.877 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.877 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:36.877 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:13.397774+0000", 2024-09-12T22:33:36.877 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00012854000000000001 2024-09-12T22:33:36.877 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:36.877 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:36.877 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:36.878 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.878 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.878 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(client.4490.0:12798 4.3e 4:7eb070ca:::100000030e0.00000000:head [write 0~4194304 [5@1189789]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-12T22:33:36.878 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:15.140228+0000", 2024-09-12T22:33:36.878 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 21.697250131000001, 2024-09-12T22:33:36.878 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.046073232999999998, 2024-09-12T22:33:36.878 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:36.878 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:36.878 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:36.878 INFO:teuthology.orchestra.run.smithi148.stdout: "client_info": { 2024-09-12T22:33:36.878 INFO:teuthology.orchestra.run.smithi148.stdout: "client": "client.4490", 2024-09-12T22:33:36.878 INFO:teuthology.orchestra.run.smithi148.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:36.878 INFO:teuthology.orchestra.run.smithi148.stdout: "tid": 12798 2024-09-12T22:33:36.878 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.879 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:36.879 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.879 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:36.879 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.140228+0000", 2024-09-12T22:33:36.879 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:36.879 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.879 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.879 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:36.879 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.140228+0000", 2024-09-12T22:33:36.879 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:36.879 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.879 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.879 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:36.879 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.140228+0000", 2024-09-12T22:33:36.880 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.5899999999999996e-07 2024-09-12T22:33:36.880 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.880 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.880 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:36.880 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.147541+0000", 2024-09-12T22:33:36.880 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0073125339999999999 2024-09-12T22:33:36.880 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.880 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.880 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:36.880 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.147555+0000", 2024-09-12T22:33:36.880 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.42e-05 2024-09-12T22:33:36.880 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.880 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.880 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:36.881 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.147564+0000", 2024-09-12T22:33:36.881 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.0999999999999993e-06 2024-09-12T22:33:36.881 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.881 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.881 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:36.881 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.147637+0000", 2024-09-12T22:33:36.881 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3288999999999996e-05 2024-09-12T22:33:36.881 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.881 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.881 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:36.881 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.147725+0000", 2024-09-12T22:33:36.881 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.7622999999999998e-05 2024-09-12T22:33:36.881 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.881 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.882 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:36.882 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.186239+0000", 2024-09-12T22:33:36.882 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.038514171 2024-09-12T22:33:36.882 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.882 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.882 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:36.882 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.186265+0000", 2024-09-12T22:33:36.882 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5738e-05 2024-09-12T22:33:36.882 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.882 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.882 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:36.882 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:15.186301+0000", 2024-09-12T22:33:36.882 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.6019000000000002e-05 2024-09-12T22:33:36.883 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:36.883 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:36.883 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:36.883 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.883 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.883 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3063 3.2 3:42569fed:::200.00000011:head [write 3915305~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:33:36.883 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:19.386685+0000", 2024-09-12T22:33:36.883 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 17.450792902, 2024-09-12T22:33:36.883 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.042365220000000002, 2024-09-12T22:33:36.883 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:36.883 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:36.883 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:36.883 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:36.884 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.884 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:36.884 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386685+0000", 2024-09-12T22:33:36.884 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:36.884 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.884 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.884 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:36.884 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386685+0000", 2024-09-12T22:33:36.884 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:36.884 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.884 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.884 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:36.884 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386685+0000", 2024-09-12T22:33:36.884 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.08e-07 2024-09-12T22:33:36.885 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.885 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.885 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:36.885 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386688+0000", 2024-09-12T22:33:36.885 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8880000000000001e-06 2024-09-12T22:33:36.885 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.885 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.885 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:36.885 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386694+0000", 2024-09-12T22:33:36.885 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.8089999999999998e-06 2024-09-12T22:33:36.885 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.885 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.885 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:36.885 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386699+0000", 2024-09-12T22:33:36.886 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8010000000000003e-06 2024-09-12T22:33:36.886 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.886 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.886 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:36.886 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.427136+0000", 2024-09-12T22:33:36.886 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.04043712 2024-09-12T22:33:36.886 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.886 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.886 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:36.886 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.427185+0000", 2024-09-12T22:33:36.886 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9493999999999997e-05 2024-09-12T22:33:36.886 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.886 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.886 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:36.887 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.428988+0000", 2024-09-12T22:33:36.887 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.001803191 2024-09-12T22:33:36.887 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.887 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.887 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:36.887 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.429015+0000", 2024-09-12T22:33:36.887 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.6438999999999999e-05 2024-09-12T22:33:36.887 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.887 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.887 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:36.887 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.429050+0000", 2024-09-12T22:33:36.887 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.5070000000000001e-05 2024-09-12T22:33:36.887 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:36.887 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:36.888 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:36.888 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.888 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.888 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3064 3.2 3:42569fed:::200.00000011:head [write 3916704~1398 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:33:36.888 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:19.386705+0000", 2024-09-12T22:33:36.888 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 17.450773127000001, 2024-09-12T22:33:36.888 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.043238378000000001, 2024-09-12T22:33:36.888 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:36.888 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:36.888 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:36.888 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:36.888 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.888 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:36.889 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386705+0000", 2024-09-12T22:33:36.889 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:36.889 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.889 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.889 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:36.889 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386705+0000", 2024-09-12T22:33:36.889 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:36.889 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.889 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.889 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:36.889 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386705+0000", 2024-09-12T22:33:36.889 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.8299999999999998e-07 2024-09-12T22:33:36.889 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.889 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.890 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:36.890 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386711+0000", 2024-09-12T22:33:36.890 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.7080000000000002e-06 2024-09-12T22:33:36.890 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.890 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.890 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:36.890 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386717+0000", 2024-09-12T22:33:36.890 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.3990000000000001e-06 2024-09-12T22:33:36.890 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.890 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.890 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:36.890 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386722+0000", 2024-09-12T22:33:36.890 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9219999999999996e-06 2024-09-12T22:33:36.890 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.891 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.891 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:36.891 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.427585+0000", 2024-09-12T22:33:36.891 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.040863414000000001 2024-09-12T22:33:36.891 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.891 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.891 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:36.891 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.427628+0000", 2024-09-12T22:33:36.891 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2873000000000001e-05 2024-09-12T22:33:36.891 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.891 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.891 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:36.891 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.429871+0000", 2024-09-12T22:33:36.892 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.002242572 2024-09-12T22:33:36.892 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.892 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.892 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:36.892 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.429901+0000", 2024-09-12T22:33:36.892 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0114e-05 2024-09-12T22:33:36.892 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.892 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.892 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:36.892 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.429943+0000", 2024-09-12T22:33:36.892 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1993000000000003e-05 2024-09-12T22:33:36.892 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:36.892 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:36.893 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:36.893 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.893 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.893 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3065 3.2 3:42569fed:::200.00000011:head [write 3918102~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:33:36.893 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:19.386735+0000", 2024-09-12T22:33:36.893 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 17.45074292, 2024-09-12T22:33:36.893 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.043278369999999997, 2024-09-12T22:33:36.893 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:36.893 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:36.893 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:36.893 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:36.893 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.893 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:36.893 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386735+0000", 2024-09-12T22:33:36.894 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:36.894 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.894 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.894 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:36.894 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386735+0000", 2024-09-12T22:33:36.894 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:36.894 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.894 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.894 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:36.894 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386735+0000", 2024-09-12T22:33:36.894 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.7300000000000001e-07 2024-09-12T22:33:36.894 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.894 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.894 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:36.895 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386738+0000", 2024-09-12T22:33:36.895 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8420000000000001e-06 2024-09-12T22:33:36.895 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.895 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.895 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:36.895 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386744+0000", 2024-09-12T22:33:36.895 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.3040000000000001e-06 2024-09-12T22:33:36.895 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.895 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.895 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:36.895 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386749+0000", 2024-09-12T22:33:36.895 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.8409999999999999e-06 2024-09-12T22:33:36.895 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.895 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.896 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:36.896 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.428112+0000", 2024-09-12T22:33:36.896 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.041363204000000001 2024-09-12T22:33:36.896 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.896 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.896 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:36.896 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.428158+0000", 2024-09-12T22:33:36.896 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5756e-05 2024-09-12T22:33:36.896 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.896 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.896 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:36.896 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.429950+0000", 2024-09-12T22:33:36.896 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0017922859999999999 2024-09-12T22:33:36.896 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.897 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.897 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:36.897 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.429975+0000", 2024-09-12T22:33:36.897 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4640000000000001e-05 2024-09-12T22:33:36.897 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.897 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.897 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:36.897 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.430013+0000", 2024-09-12T22:33:36.897 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.8024000000000001e-05 2024-09-12T22:33:36.897 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:36.897 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:36.897 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:36.897 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.897 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.898 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3066 3.2 3:42569fed:::200.00000011:head [write 3919501~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:33:36.898 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:19.386755+0000", 2024-09-12T22:33:36.898 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 17.450722279000001, 2024-09-12T22:33:36.898 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.044668934, 2024-09-12T22:33:36.898 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:36.898 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:36.898 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:36.898 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:36.898 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.898 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:36.898 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386755+0000", 2024-09-12T22:33:36.898 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:36.898 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.898 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.899 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:36.899 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386755+0000", 2024-09-12T22:33:36.899 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:36.899 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.899 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.899 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:36.899 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386756+0000", 2024-09-12T22:33:36.899 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4499999999999997e-07 2024-09-12T22:33:36.899 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.899 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.899 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:36.899 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386763+0000", 2024-09-12T22:33:36.899 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.6459999999999993e-06 2024-09-12T22:33:36.900 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.900 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.900 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:36.900 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386770+0000", 2024-09-12T22:33:36.900 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.19e-06 2024-09-12T22:33:36.900 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.900 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.900 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:36.900 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386775+0000", 2024-09-12T22:33:36.900 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9640000000000002e-06 2024-09-12T22:33:36.900 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.900 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.900 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:36.900 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.428489+0000", 2024-09-12T22:33:36.901 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.041714539000000002 2024-09-12T22:33:36.901 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.901 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.901 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:36.901 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.428535+0000", 2024-09-12T22:33:36.901 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5658999999999998e-05 2024-09-12T22:33:36.901 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.901 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.901 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:36.901 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.431353+0000", 2024-09-12T22:33:36.901 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0028186270000000002 2024-09-12T22:33:36.901 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.901 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.901 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:36.902 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.431385+0000", 2024-09-12T22:33:36.902 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.1374000000000001e-05 2024-09-12T22:33:36.902 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.902 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.902 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:36.902 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.431424+0000", 2024-09-12T22:33:36.902 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9490000000000003e-05 2024-09-12T22:33:36.902 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:36.902 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:36.902 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:36.902 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.902 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.902 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3067 3.2 3:42569fed:::200.00000011:head [write 3920900~2245 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:33:36.902 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:19.386781+0000", 2024-09-12T22:33:36.903 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 17.450696390000001, 2024-09-12T22:33:36.903 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.044711322999999997, 2024-09-12T22:33:36.903 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:36.903 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:36.903 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:36.903 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:36.903 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.903 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:36.903 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386781+0000", 2024-09-12T22:33:36.903 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:36.903 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.903 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.903 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:36.903 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386781+0000", 2024-09-12T22:33:36.904 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:36.904 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.904 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.904 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:36.904 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386782+0000", 2024-09-12T22:33:36.904 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.9900000000000001e-07 2024-09-12T22:33:36.904 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.904 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.904 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:36.904 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386795+0000", 2024-09-12T22:33:36.904 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.2864000000000001e-05 2024-09-12T22:33:36.904 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.904 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.905 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:36.905 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386801+0000", 2024-09-12T22:33:36.905 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.3589999999999996e-06 2024-09-12T22:33:36.905 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.905 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.905 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:36.905 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386805+0000", 2024-09-12T22:33:36.905 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6190000000000002e-06 2024-09-12T22:33:36.905 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.905 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.905 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:36.905 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.429080+0000", 2024-09-12T22:33:36.905 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.042274027999999998 2024-09-12T22:33:36.905 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.905 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.906 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:36.906 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.429131+0000", 2024-09-12T22:33:36.906 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.1715000000000002e-05 2024-09-12T22:33:36.906 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.906 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.906 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:36.906 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.431432+0000", 2024-09-12T22:33:36.906 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0023007489999999999 2024-09-12T22:33:36.906 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.906 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.906 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:36.906 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.431458+0000", 2024-09-12T22:33:36.906 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.603e-05 2024-09-12T22:33:36.906 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.907 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.907 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:36.907 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.431493+0000", 2024-09-12T22:33:36.907 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.4560000000000001e-05 2024-09-12T22:33:36.907 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:36.907 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:36.907 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:36.907 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.907 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.907 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3068 3.2 3:42569fed:::200.00000011:head [write 3923145~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:33:36.907 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:19.386812+0000", 2024-09-12T22:33:36.907 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 17.450665631, 2024-09-12T22:33:36.907 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.045559559999999999, 2024-09-12T22:33:36.907 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:36.908 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:36.908 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:36.908 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:36.908 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.908 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:36.908 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386812+0000", 2024-09-12T22:33:36.908 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:36.908 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.908 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.908 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:36.908 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386812+0000", 2024-09-12T22:33:36.908 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:36.908 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.909 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.909 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:36.909 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386812+0000", 2024-09-12T22:33:36.909 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.01e-07 2024-09-12T22:33:36.909 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.909 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.909 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:36.909 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386823+0000", 2024-09-12T22:33:36.909 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.1038e-05 2024-09-12T22:33:36.909 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.909 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.909 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:36.909 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386830+0000", 2024-09-12T22:33:36.909 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.5409999999999997e-06 2024-09-12T22:33:36.910 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.910 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.910 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:36.910 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386835+0000", 2024-09-12T22:33:36.910 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.091e-06 2024-09-12T22:33:36.910 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.910 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.910 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:36.910 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.429460+0000", 2024-09-12T22:33:36.910 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.042625333000000001 2024-09-12T22:33:36.910 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.910 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.910 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:36.910 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.429506+0000", 2024-09-12T22:33:36.911 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5299000000000001e-05 2024-09-12T22:33:36.911 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.911 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.911 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:36.911 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.432283+0000", 2024-09-12T22:33:36.911 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0027776799999999998 2024-09-12T22:33:36.911 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.911 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.911 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:36.911 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.432315+0000", 2024-09-12T22:33:36.911 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.1401e-05 2024-09-12T22:33:36.911 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.911 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.911 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:36.912 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.432372+0000", 2024-09-12T22:33:36.912 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.6776e-05 2024-09-12T22:33:36.912 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:36.912 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:36.912 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:36.912 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.912 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.912 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3069 3.2 3:42569fed:::200.00000011:head [write 3924544~2246 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:33:36.912 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:19.386842+0000", 2024-09-12T22:33:36.912 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 17.450635730999998, 2024-09-12T22:33:36.912 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.045596166, 2024-09-12T22:33:36.912 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:36.912 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:36.913 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:36.913 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:36.913 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.913 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:36.913 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386842+0000", 2024-09-12T22:33:36.913 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:36.913 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.913 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.913 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:36.913 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386842+0000", 2024-09-12T22:33:36.913 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:36.913 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.913 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.913 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:36.914 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386842+0000", 2024-09-12T22:33:36.914 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5200000000000002e-07 2024-09-12T22:33:36.914 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.914 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.914 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:36.914 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386845+0000", 2024-09-12T22:33:36.914 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.8820000000000001e-06 2024-09-12T22:33:36.914 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.914 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.914 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:36.914 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386851+0000", 2024-09-12T22:33:36.914 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9540000000000001e-06 2024-09-12T22:33:36.914 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.914 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.915 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:36.915 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.386856+0000", 2024-09-12T22:33:36.915 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5159999999999996e-06 2024-09-12T22:33:36.915 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.915 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.915 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:36.915 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.430043+0000", 2024-09-12T22:33:36.915 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.043186930999999998 2024-09-12T22:33:36.915 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.915 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.915 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:36.915 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.430086+0000", 2024-09-12T22:33:36.915 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3844999999999998e-05 2024-09-12T22:33:36.915 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.916 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.916 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:36.916 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.432379+0000", 2024-09-12T22:33:36.916 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0022922049999999999 2024-09-12T22:33:36.916 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.916 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.916 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:36.916 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.432405+0000", 2024-09-12T22:33:36.916 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5877999999999999e-05 2024-09-12T22:33:36.916 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.916 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.916 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:36.916 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.432438+0000", 2024-09-12T22:33:36.916 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3503000000000001e-05 2024-09-12T22:33:36.917 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:36.917 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:36.917 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:36.917 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.917 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.917 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3070 3.2 3:42569fed:::200.00000011:head [write 3926790~2768 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:33:36.917 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:19.387280+0000", 2024-09-12T22:33:36.917 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 17.450197563, 2024-09-12T22:33:36.917 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.04692201, 2024-09-12T22:33:36.917 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:36.917 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:36.917 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:36.917 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:36.918 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.918 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:36.918 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.387280+0000", 2024-09-12T22:33:36.918 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:36.918 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.918 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.918 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:36.918 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.387280+0000", 2024-09-12T22:33:36.918 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:36.918 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.918 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.918 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:36.918 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.387281+0000", 2024-09-12T22:33:36.918 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.4300000000000002e-07 2024-09-12T22:33:36.919 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.919 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.919 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:36.919 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.387285+0000", 2024-09-12T22:33:36.919 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2570000000000001e-06 2024-09-12T22:33:36.919 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.919 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.919 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:36.919 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.387293+0000", 2024-09-12T22:33:36.919 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0209999999999999e-06 2024-09-12T22:33:36.919 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.919 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.919 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:36.919 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.387299+0000", 2024-09-12T22:33:36.920 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.6930000000000004e-06 2024-09-12T22:33:36.920 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.920 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.920 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:36.920 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.430441+0000", 2024-09-12T22:33:36.920 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.043141789999999999 2024-09-12T22:33:36.920 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.920 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.920 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:36.920 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.430484+0000", 2024-09-12T22:33:36.920 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.3745000000000002e-05 2024-09-12T22:33:36.920 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.920 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.920 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:36.921 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.434132+0000", 2024-09-12T22:33:36.921 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00364818 2024-09-12T22:33:36.921 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.921 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.921 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:36.921 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.434163+0000", 2024-09-12T22:33:36.921 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.0599000000000003e-05 2024-09-12T22:33:36.921 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.921 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.921 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:36.921 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.434202+0000", 2024-09-12T22:33:36.921 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.8982e-05 2024-09-12T22:33:36.921 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:36.922 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:36.922 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:36.922 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.922 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.922 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3071 3.2 3:42569fed:::200.00000011:head [write 3929558~3203 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:33:36.922 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:19.387860+0000", 2024-09-12T22:33:36.922 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 17.449617533000001, 2024-09-12T22:33:36.922 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.049590902999999999, 2024-09-12T22:33:36.922 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:36.922 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:36.922 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:36.922 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:36.922 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.923 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:36.923 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.387860+0000", 2024-09-12T22:33:36.923 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:36.923 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.923 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.923 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:36.923 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.387860+0000", 2024-09-12T22:33:36.923 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:36.923 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.923 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.923 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:36.923 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.387861+0000", 2024-09-12T22:33:36.923 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.5099999999999999e-07 2024-09-12T22:33:36.923 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.924 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.924 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:36.924 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.387865+0000", 2024-09-12T22:33:36.924 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.2629999999999997e-06 2024-09-12T22:33:36.924 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.924 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.924 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:36.924 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.387875+0000", 2024-09-12T22:33:36.924 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.0256e-05 2024-09-12T22:33:36.924 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.924 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.924 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:36.924 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.387881+0000", 2024-09-12T22:33:36.924 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.947e-06 2024-09-12T22:33:36.925 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.925 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.925 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:36.925 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.430930+0000", 2024-09-12T22:33:36.925 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.043048386000000001 2024-09-12T22:33:36.925 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.925 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.925 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:36.925 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.430976+0000", 2024-09-12T22:33:36.925 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.6408e-05 2024-09-12T22:33:36.925 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.925 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.925 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:36.926 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.437377+0000", 2024-09-12T22:33:36.926 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0064010719999999998 2024-09-12T22:33:36.926 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.926 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.926 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:36.926 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.437409+0000", 2024-09-12T22:33:36.926 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.2054999999999997e-05 2024-09-12T22:33:36.926 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.926 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.926 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:36.926 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.437451+0000", 2024-09-12T22:33:36.926 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.1764999999999997e-05 2024-09-12T22:33:36.926 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:36.926 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:36.927 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:36.927 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.927 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.927 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3072 3.2 3:42569fed:::200.00000011:head [write 3932761~2786 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:33:36.927 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:19.388005+0000", 2024-09-12T22:33:36.927 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 17.449472434, 2024-09-12T22:33:36.927 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.049514177999999999, 2024-09-12T22:33:36.927 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:36.927 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:36.927 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:36.927 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:36.927 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.927 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:36.927 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.388005+0000", 2024-09-12T22:33:36.928 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:36.928 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.928 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.928 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:36.928 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.388005+0000", 2024-09-12T22:33:36.928 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:36.928 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.928 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.928 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:36.928 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.388006+0000", 2024-09-12T22:33:36.928 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.1799999999999995e-07 2024-09-12T22:33:36.928 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.928 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.928 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:36.929 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.388009+0000", 2024-09-12T22:33:36.929 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.574e-06 2024-09-12T22:33:36.929 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.929 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.929 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:36.929 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.388017+0000", 2024-09-12T22:33:36.929 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 7.3170000000000004e-06 2024-09-12T22:33:36.929 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.929 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.929 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:36.929 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.388022+0000", 2024-09-12T22:33:36.929 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.9910000000000002e-06 2024-09-12T22:33:36.929 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.929 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.930 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:36.930 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.431522+0000", 2024-09-12T22:33:36.930 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0435001 2024-09-12T22:33:36.930 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.930 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.930 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:36.930 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.431567+0000", 2024-09-12T22:33:36.930 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4734000000000002e-05 2024-09-12T22:33:36.930 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.930 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.930 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:36.930 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.437458+0000", 2024-09-12T22:33:36.930 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.00589166 2024-09-12T22:33:36.930 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.931 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.931 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:36.931 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.437484+0000", 2024-09-12T22:33:36.931 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.5622999999999998e-05 2024-09-12T22:33:36.931 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.931 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.931 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:36.931 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.437519+0000", 2024-09-12T22:33:36.931 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.5561000000000001e-05 2024-09-12T22:33:36.931 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:36.931 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:36.931 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:36.931 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.931 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.932 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3073 3.2 3:42569fed:::200.00000011:head [write 3935547~1924 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:33:36.932 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:19.389181+0000", 2024-09-12T22:33:36.932 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 17.448296272, 2024-09-12T22:33:36.932 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.048402300000000002, 2024-09-12T22:33:36.932 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:36.932 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:36.932 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:36.932 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:36.932 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.932 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:36.932 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.389181+0000", 2024-09-12T22:33:36.932 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:36.932 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.933 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.933 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:36.933 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.389181+0000", 2024-09-12T22:33:36.933 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:36.933 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.933 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.933 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:36.933 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.389182+0000", 2024-09-12T22:33:36.933 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.7700000000000004e-07 2024-09-12T22:33:36.933 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.933 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.933 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:36.933 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.389191+0000", 2024-09-12T22:33:36.933 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.1120000000000002e-06 2024-09-12T22:33:36.934 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.934 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.934 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:36.934 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.389203+0000", 2024-09-12T22:33:36.934 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 1.146e-05 2024-09-12T22:33:36.934 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.934 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.934 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:36.934 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.389209+0000", 2024-09-12T22:33:36.934 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 5.9989999999999997e-06 2024-09-12T22:33:36.934 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.934 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.934 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:36.934 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.431890+0000", 2024-09-12T22:33:36.935 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.042681251000000003 2024-09-12T22:33:36.935 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.935 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.935 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:36.935 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.431935+0000", 2024-09-12T22:33:36.935 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.5166000000000001e-05 2024-09-12T22:33:36.935 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.935 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.935 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:36.935 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.437526+0000", 2024-09-12T22:33:36.935 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0055910489999999998 2024-09-12T22:33:36.935 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.935 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.935 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:36.936 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.437550+0000", 2024-09-12T22:33:36.936 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.4134999999999998e-05 2024-09-12T22:33:36.936 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.936 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.936 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:36.936 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.437584+0000", 2024-09-12T22:33:36.936 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3451000000000002e-05 2024-09-12T22:33:36.936 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:36.936 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:36.936 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:36.936 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.936 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.936 INFO:teuthology.orchestra.run.smithi148.stdout: "description": "osd_op(mds.0.3:3074 3.2 3:42569fed:::200.00000011:head [write 3937471~7660 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-09-12T22:33:36.936 INFO:teuthology.orchestra.run.smithi148.stdout: "initiated_at": "2024-09-12T22:33:19.390512+0000", 2024-09-12T22:33:36.937 INFO:teuthology.orchestra.run.smithi148.stdout: "age": 17.446965149, 2024-09-12T22:33:36.937 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.047134045999999999, 2024-09-12T22:33:36.937 INFO:teuthology.orchestra.run.smithi148.stdout: "continuous": false, 2024-09-12T22:33:36.937 INFO:teuthology.orchestra.run.smithi148.stdout: "type_data": { 2024-09-12T22:33:36.937 INFO:teuthology.orchestra.run.smithi148.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:36.937 INFO:teuthology.orchestra.run.smithi148.stdout: "events": [ 2024-09-12T22:33:36.937 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.937 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "initiated", 2024-09-12T22:33:36.937 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.390512+0000", 2024-09-12T22:33:36.937 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:36.937 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.937 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.937 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "header_read", 2024-09-12T22:33:36.937 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.390512+0000", 2024-09-12T22:33:36.938 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0 2024-09-12T22:33:36.938 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.938 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.938 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "throttled", 2024-09-12T22:33:36.938 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.390513+0000", 2024-09-12T22:33:36.938 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 9.7699999999999992e-07 2024-09-12T22:33:36.938 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.938 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.938 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "all_read", 2024-09-12T22:33:36.938 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.390522+0000", 2024-09-12T22:33:36.938 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.0390000000000005e-06 2024-09-12T22:33:36.938 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.938 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.938 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "dispatched", 2024-09-12T22:33:36.939 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.390530+0000", 2024-09-12T22:33:36.939 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 8.8349999999999993e-06 2024-09-12T22:33:36.939 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.939 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.939 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "queued_for_pg", 2024-09-12T22:33:36.939 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.390537+0000", 2024-09-12T22:33:36.939 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 6.1850000000000001e-06 2024-09-12T22:33:36.939 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.939 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.939 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "reached_pg", 2024-09-12T22:33:36.939 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.432468+0000", 2024-09-12T22:33:36.939 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.041931883000000003 2024-09-12T22:33:36.939 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.940 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.940 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "started", 2024-09-12T22:33:36.940 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.432512+0000", 2024-09-12T22:33:36.940 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 4.4054999999999997e-05 2024-09-12T22:33:36.940 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.940 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.940 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "op_commit", 2024-09-12T22:33:36.940 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.437590+0000", 2024-09-12T22:33:36.940 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 0.0050777230000000001 2024-09-12T22:33:36.940 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.940 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.940 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "commit_sent", 2024-09-12T22:33:36.940 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.437613+0000", 2024-09-12T22:33:36.941 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 2.2693000000000001e-05 2024-09-12T22:33:36.941 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-12T22:33:36.941 INFO:teuthology.orchestra.run.smithi148.stdout: { 2024-09-12T22:33:36.941 INFO:teuthology.orchestra.run.smithi148.stdout: "event": "done", 2024-09-12T22:33:36.941 INFO:teuthology.orchestra.run.smithi148.stdout: "time": "2024-09-12T22:33:19.437647+0000", 2024-09-12T22:33:36.941 INFO:teuthology.orchestra.run.smithi148.stdout: "duration": 3.3655999999999998e-05 2024-09-12T22:33:36.941 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:36.941 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:36.941 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:36.941 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-12T22:33:36.941 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-12T22:33:36.941 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-12T22:33:36.943 INFO:tasks.ceph.osd.2.smithi163.stderr:2024-09-12T22:33:36.941+0000 7fce92068640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 30674) UID: 0 2024-09-12T22:33:36.943 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T22:33:36.994 DEBUG:teuthology.run_tasks:Unwinding manager thrashosds 2024-09-12T22:33:37.004 INFO:tasks.thrashosds:joining thrashosds 2024-09-12T22:33:37.058 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-09-12T22:33:37.058 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-09-12T22:33:37.058 INFO:teuthology.orchestra.run.smithi163.stdout: "num_ops": 0 2024-09-12T22:33:37.058 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-09-12T22:33:37.067 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T22:33:37.170 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-09-12T22:33:37.171 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [], 2024-09-12T22:33:37.171 INFO:teuthology.orchestra.run.smithi163.stdout: "complaint_time": 30, 2024-09-12T22:33:37.171 INFO:teuthology.orchestra.run.smithi163.stdout: "num_blocked_ops": 0 2024-09-12T22:33:37.171 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-09-12T22:33:37.180 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T22:33:37.284 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-09-12T22:33:37.284 INFO:teuthology.orchestra.run.smithi163.stdout: "size": 20, 2024-09-12T22:33:37.284 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 600, 2024-09-12T22:33:37.284 INFO:teuthology.orchestra.run.smithi163.stdout: "ops": [ 2024-09-12T22:33:37.284 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.284 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4141.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2024-09-12T22:33:37.285 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:31:27.254459+0000", 2024-09-12T22:33:37.285 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 130.02745775299999, 2024-09-12T22:33:37.285 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.37816283899999997, 2024-09-12T22:33:37.285 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:37.285 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:37.285 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:37.285 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:37.285 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4141", 2024-09-12T22:33:37.285 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "172.21.15.19:0/139849582", 2024-09-12T22:33:37.285 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 1 2024-09-12T22:33:37.285 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.285 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:37.285 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.285 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:37.286 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254459+0000", 2024-09-12T22:33:37.286 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:37.286 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.286 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.286 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:37.286 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254459+0000", 2024-09-12T22:33:37.286 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:37.286 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.286 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.286 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:37.286 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254460+0000", 2024-09-12T22:33:37.286 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1739999999999999e-06 2024-09-12T22:33:37.286 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.286 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.287 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:37.287 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254472+0000", 2024-09-12T22:33:37.287 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.2207e-05 2024-09-12T22:33:37.287 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.287 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.287 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:37.287 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254483+0000", 2024-09-12T22:33:37.287 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0631999999999999e-05 2024-09-12T22:33:37.287 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.287 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.287 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:37.288 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254492+0000", 2024-09-12T22:33:37.288 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.3670000000000003e-06 2024-09-12T22:33:37.288 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.288 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.288 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:37.288 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254551+0000", 2024-09-12T22:33:37.288 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8687999999999998e-05 2024-09-12T22:33:37.288 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.288 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.288 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for peered", 2024-09-12T22:33:37.288 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.254562+0000", 2024-09-12T22:33:37.288 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1249e-05 2024-09-12T22:33:37.288 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.288 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.289 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:37.289 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.631211+0000", 2024-09-12T22:33:37.289 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.376649018 2024-09-12T22:33:37.289 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.289 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.289 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:37.289 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.631345+0000", 2024-09-12T22:33:37.289 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013378700000000001 2024-09-12T22:33:37.289 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.289 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.289 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 0", 2024-09-12T22:33:37.289 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.631479+0000", 2024-09-12T22:33:37.289 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00013352399999999999 2024-09-12T22:33:37.289 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.290 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.290 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:37.290 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632324+0000", 2024-09-12T22:33:37.290 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00084508100000000002 2024-09-12T22:33:37.290 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.290 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.290 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:37.290 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632548+0000", 2024-09-12T22:33:37.290 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000224329 2024-09-12T22:33:37.290 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.290 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.290 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:37.290 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632591+0000", 2024-09-12T22:33:37.291 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.2564000000000001e-05 2024-09-12T22:33:37.291 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.291 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.291 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:37.291 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:31:27.632622+0000", 2024-09-12T22:33:37.291 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1219e-05 2024-09-12T22:33:37.291 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:37.291 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:37.291 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:37.291 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.291 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.291 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4490.0:9871 4.35 4:ad66404a:::10000002d4d.00000000:head [write 0~6507] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:33:37.291 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:09.472309+0000", 2024-09-12T22:33:37.291 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 27.809607477, 2024-09-12T22:33:37.292 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.080251445000000005, 2024-09-12T22:33:37.292 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:37.292 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:37.292 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:37.292 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:37.292 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4490", 2024-09-12T22:33:37.292 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:37.292 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 9871 2024-09-12T22:33:37.292 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.292 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:37.292 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.292 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:37.292 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.472309+0000", 2024-09-12T22:33:37.292 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:37.293 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.293 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.293 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:37.293 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.472309+0000", 2024-09-12T22:33:37.293 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:37.293 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.293 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.293 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:37.293 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.472310+0000", 2024-09-12T22:33:37.293 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3799999999999996e-07 2024-09-12T22:33:37.293 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.293 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.293 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:37.293 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.472318+0000", 2024-09-12T22:33:37.294 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.8099999999999998e-06 2024-09-12T22:33:37.294 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.294 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.294 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:37.294 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.472328+0000", 2024-09-12T22:33:37.294 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0359e-05 2024-09-12T22:33:37.294 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.294 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.294 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:37.295 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.472334+0000", 2024-09-12T22:33:37.295 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.0109999999999997e-06 2024-09-12T22:33:37.295 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.295 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.295 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:37.295 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.472382+0000", 2024-09-12T22:33:37.295 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.7311000000000002e-05 2024-09-12T22:33:37.295 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.295 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.295 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:37.295 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.472497+0000", 2024-09-12T22:33:37.295 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011537800000000001 2024-09-12T22:33:37.295 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.295 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.296 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:37.296 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.472617+0000", 2024-09-12T22:33:37.296 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00011989600000000001 2024-09-12T22:33:37.296 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.296 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.296 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:37.296 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473149+0000", 2024-09-12T22:33:37.296 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00053227999999999999 2024-09-12T22:33:37.296 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.297 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.297 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:37.297 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.552479+0000", 2024-09-12T22:33:37.297 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.079329541000000003 2024-09-12T22:33:37.297 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.297 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.297 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:37.297 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.552525+0000", 2024-09-12T22:33:37.297 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.6421000000000002e-05 2024-09-12T22:33:37.297 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.297 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.297 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:37.297 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.552561+0000", 2024-09-12T22:33:37.297 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5599999999999998e-05 2024-09-12T22:33:37.298 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:37.298 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:37.298 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:37.298 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.298 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.298 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4490.0:9872 4.2c 4:3602c8d3:::10000002d4e.00000000:head [write 0~1178] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:33:37.298 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:09.473085+0000", 2024-09-12T22:33:37.298 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 27.808832172999999, 2024-09-12T22:33:37.298 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.079631104999999994, 2024-09-12T22:33:37.298 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:37.298 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:37.298 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:37.299 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:37.299 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4490", 2024-09-12T22:33:37.299 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:37.299 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 9872 2024-09-12T22:33:37.299 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.299 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:37.299 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.299 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:37.299 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473085+0000", 2024-09-12T22:33:37.299 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:37.299 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.299 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.299 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:37.299 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473085+0000", 2024-09-12T22:33:37.300 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:37.300 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.300 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.300 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:37.300 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473085+0000", 2024-09-12T22:33:37.300 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3600000000000004e-07 2024-09-12T22:33:37.300 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.300 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.300 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:37.300 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473088+0000", 2024-09-12T22:33:37.300 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.005e-06 2024-09-12T22:33:37.300 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.300 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.300 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:37.301 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473095+0000", 2024-09-12T22:33:37.301 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3950000000000003e-06 2024-09-12T22:33:37.301 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.301 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.301 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:37.301 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473100+0000", 2024-09-12T22:33:37.301 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5460000000000002e-06 2024-09-12T22:33:37.301 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.301 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.301 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:37.301 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473138+0000", 2024-09-12T22:33:37.301 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8244999999999997e-05 2024-09-12T22:33:37.301 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.302 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.302 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:37.302 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473216+0000", 2024-09-12T22:33:37.302 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.7756000000000006e-05 2024-09-12T22:33:37.302 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.302 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.302 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:37.302 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473291+0000", 2024-09-12T22:33:37.302 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5110000000000004e-05 2024-09-12T22:33:37.302 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.302 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.303 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:37.303 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473736+0000", 2024-09-12T22:33:37.303 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00044486500000000002 2024-09-12T22:33:37.303 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.303 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.303 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:37.303 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.552637+0000", 2024-09-12T22:33:37.303 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.078900782000000003 2024-09-12T22:33:37.303 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.303 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.303 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:37.303 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.552680+0000", 2024-09-12T22:33:37.303 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3047999999999998e-05 2024-09-12T22:33:37.303 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.303 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.304 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:37.304 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.552716+0000", 2024-09-12T22:33:37.304 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5816999999999999e-05 2024-09-12T22:33:37.304 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:37.304 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:37.304 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:37.304 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.304 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.304 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4490.0:9873 4.2c 4:372c52ff:::10000002d4f.00000000:head [write 0~1230] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:33:37.305 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:09.473878+0000", 2024-09-12T22:33:37.305 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 27.808038710000002, 2024-09-12T22:33:37.305 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.079036047999999998, 2024-09-12T22:33:37.305 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:37.305 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:37.305 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:37.305 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:37.305 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4490", 2024-09-12T22:33:37.305 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:37.305 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 9873 2024-09-12T22:33:37.305 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.305 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:37.305 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.305 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:37.306 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473878+0000", 2024-09-12T22:33:37.306 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:37.306 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.306 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.306 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:37.306 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473878+0000", 2024-09-12T22:33:37.306 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:37.306 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.306 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.306 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:37.306 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473879+0000", 2024-09-12T22:33:37.307 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.9100000000000004e-07 2024-09-12T22:33:37.307 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.307 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.307 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:37.307 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473882+0000", 2024-09-12T22:33:37.307 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.405e-06 2024-09-12T22:33:37.307 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.307 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.307 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:37.307 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473889+0000", 2024-09-12T22:33:37.307 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7519999999999999e-06 2024-09-12T22:33:37.307 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.307 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.307 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:37.308 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473893+0000", 2024-09-12T22:33:37.308 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.9310000000000001e-06 2024-09-12T22:33:37.308 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.308 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.308 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:37.308 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.473922+0000", 2024-09-12T22:33:37.308 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9346999999999999e-05 2024-09-12T22:33:37.308 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.308 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.308 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:37.308 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474000+0000", 2024-09-12T22:33:37.308 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.7972000000000005e-05 2024-09-12T22:33:37.308 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.308 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.309 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:37.309 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474072+0000", 2024-09-12T22:33:37.309 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1960999999999998e-05 2024-09-12T22:33:37.309 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.309 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.309 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:37.309 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474470+0000", 2024-09-12T22:33:37.309 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00039803400000000002 2024-09-12T22:33:37.309 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.309 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.309 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:37.309 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.552814+0000", 2024-09-12T22:33:37.309 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.078344164999999993 2024-09-12T22:33:37.309 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.310 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.310 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:37.310 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.552875+0000", 2024-09-12T22:33:37.310 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1008999999999998e-05 2024-09-12T22:33:37.310 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.310 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.310 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:37.310 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.552914+0000", 2024-09-12T22:33:37.310 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.8881000000000003e-05 2024-09-12T22:33:37.310 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:37.311 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:37.311 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:37.311 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.311 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.311 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4490.0:9874 4.1b 4:db19d96a:::10000002d50.00000000:head [write 0~1088] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-12T22:33:37.311 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:09.474673+0000", 2024-09-12T22:33:37.311 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 27.807243716999999, 2024-09-12T22:33:37.311 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.080314317999999996, 2024-09-12T22:33:37.311 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:37.311 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:37.311 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:37.311 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:37.311 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4490", 2024-09-12T22:33:37.311 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:37.312 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 9874 2024-09-12T22:33:37.312 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.312 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:37.312 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.312 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:37.312 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474673+0000", 2024-09-12T22:33:37.312 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:37.312 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.312 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.312 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:37.312 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474673+0000", 2024-09-12T22:33:37.312 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:37.312 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.312 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.313 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:37.313 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474674+0000", 2024-09-12T22:33:37.313 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6199999999999998e-07 2024-09-12T22:33:37.313 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.313 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.313 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:37.313 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474677+0000", 2024-09-12T22:33:37.313 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.224e-06 2024-09-12T22:33:37.313 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.313 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.313 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:37.313 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474683+0000", 2024-09-12T22:33:37.313 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.3160000000000002e-06 2024-09-12T22:33:37.313 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.314 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.314 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:37.314 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474687+0000", 2024-09-12T22:33:37.314 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7869999999999999e-06 2024-09-12T22:33:37.314 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.314 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.314 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:37.314 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474730+0000", 2024-09-12T22:33:37.314 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3309000000000002e-05 2024-09-12T22:33:37.314 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.314 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.314 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:37.314 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474845+0000", 2024-09-12T22:33:37.314 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000114306 2024-09-12T22:33:37.314 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.315 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.315 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:37.315 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.474970+0000", 2024-09-12T22:33:37.315 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000125096 2024-09-12T22:33:37.315 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.315 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.315 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:37.315 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.475621+0000", 2024-09-12T22:33:37.315 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.00065124900000000001 2024-09-12T22:33:37.315 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.315 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.315 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:37.315 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.554885+0000", 2024-09-12T22:33:37.315 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.079264055 2024-09-12T22:33:37.316 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.316 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.316 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:37.316 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.554942+0000", 2024-09-12T22:33:37.316 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7284000000000002e-05 2024-09-12T22:33:37.316 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.316 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.316 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:37.316 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:09.554987+0000", 2024-09-12T22:33:37.316 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5130000000000003e-05 2024-09-12T22:33:37.316 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:37.316 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:37.316 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:37.316 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.317 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.317 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(client.4490.0:12220 4.2b 4:d55bfd66:::10000003169.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-09-12T22:33:37.317 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.391333+0000", 2024-09-12T22:33:37.317 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 22.890583574000001, 2024-09-12T22:33:37.317 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.088669550999999999, 2024-09-12T22:33:37.317 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:37.317 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:37.317 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:37.317 INFO:teuthology.orchestra.run.smithi163.stdout: "client_info": { 2024-09-12T22:33:37.317 INFO:teuthology.orchestra.run.smithi163.stdout: "client": "client.4490", 2024-09-12T22:33:37.317 INFO:teuthology.orchestra.run.smithi163.stdout: "client_addr": "192.168.0.1:0/2707118308", 2024-09-12T22:33:37.317 INFO:teuthology.orchestra.run.smithi163.stdout: "tid": 12220 2024-09-12T22:33:37.317 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.317 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:37.318 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.318 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:37.318 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.391333+0000", 2024-09-12T22:33:37.318 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:37.318 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.318 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.318 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:37.318 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.391333+0000", 2024-09-12T22:33:37.318 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:37.318 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.318 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.318 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:37.318 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.391334+0000", 2024-09-12T22:33:37.318 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3099999999999997e-07 2024-09-12T22:33:37.319 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.319 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.319 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:37.319 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398373+0000", 2024-09-12T22:33:37.319 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0070386670000000002 2024-09-12T22:33:37.319 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.319 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.319 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:37.319 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398384+0000", 2024-09-12T22:33:37.319 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.1338999999999999e-05 2024-09-12T22:33:37.319 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.319 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.319 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:37.319 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398389+0000", 2024-09-12T22:33:37.320 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3650000000000003e-06 2024-09-12T22:33:37.320 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.320 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.320 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:37.320 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.456308+0000", 2024-09-12T22:33:37.320 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.057918931 2024-09-12T22:33:37.320 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.320 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.320 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:37.320 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.456425+0000", 2024-09-12T22:33:37.320 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000116452 2024-09-12T22:33:37.320 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.320 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.320 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:37.321 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.456536+0000", 2024-09-12T22:33:37.321 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000111839 2024-09-12T22:33:37.321 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.321 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.321 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:37.321 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.465335+0000", 2024-09-12T22:33:37.321 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0087984980000000001 2024-09-12T22:33:37.321 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.321 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.321 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:37.321 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.479950+0000", 2024-09-12T22:33:37.321 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.01461552 2024-09-12T22:33:37.321 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.321 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.322 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:37.322 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.479983+0000", 2024-09-12T22:33:37.322 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2126999999999999e-05 2024-09-12T22:33:37.322 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.322 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.322 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:37.322 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.480003+0000", 2024-09-12T22:33:37.322 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.0081999999999998e-05 2024-09-12T22:33:37.322 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:37.322 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:37.323 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:37.323 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.323 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.323 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1208 3.13 3:cb3d3880:::200.0000000d:head [write 1009846~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:37.323 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.398459+0000", 2024-09-12T22:33:37.323 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 22.883458008000002, 2024-09-12T22:33:37.323 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.078093931000000005, 2024-09-12T22:33:37.323 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:37.323 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:37.324 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:37.324 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:37.324 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.324 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:37.324 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398459+0000", 2024-09-12T22:33:37.324 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:37.324 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.324 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.324 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:37.324 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398459+0000", 2024-09-12T22:33:37.324 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:37.324 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.324 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.324 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:37.325 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398459+0000", 2024-09-12T22:33:37.325 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8100000000000003e-07 2024-09-12T22:33:37.325 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.325 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.325 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:37.325 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398462+0000", 2024-09-12T22:33:37.325 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.3700000000000002e-06 2024-09-12T22:33:37.325 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.325 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.325 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:37.325 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398469+0000", 2024-09-12T22:33:37.325 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2320000000000004e-06 2024-09-12T22:33:37.325 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.325 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.326 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:37.326 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398472+0000", 2024-09-12T22:33:37.326 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.658e-06 2024-09-12T22:33:37.326 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.326 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.326 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:37.326 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.456690+0000", 2024-09-12T22:33:37.326 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.058217615 2024-09-12T22:33:37.326 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.326 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.326 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:37.326 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.456731+0000", 2024-09-12T22:33:37.326 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0815000000000001e-05 2024-09-12T22:33:37.326 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.327 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.327 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:37.327 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.456793+0000", 2024-09-12T22:33:37.327 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1796000000000003e-05 2024-09-12T22:33:37.327 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.327 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.327 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:37.327 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.461412+0000", 2024-09-12T22:33:37.327 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0046188560000000002 2024-09-12T22:33:37.327 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.327 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.327 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:37.327 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476429+0000", 2024-09-12T22:33:37.327 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.015017943000000001 2024-09-12T22:33:37.328 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.328 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.328 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:37.328 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476499+0000", 2024-09-12T22:33:37.328 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.9047000000000005e-05 2024-09-12T22:33:37.328 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.328 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.328 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:37.328 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476553+0000", 2024-09-12T22:33:37.328 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.4117999999999999e-05 2024-09-12T22:33:37.329 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:37.329 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:37.329 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:37.329 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.329 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.329 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1209 3.13 3:cb3d3880:::200.0000000d:head [write 1011245~5867 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:37.329 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.398677+0000", 2024-09-12T22:33:37.329 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 22.883239451000001, 2024-09-12T22:33:37.329 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.077995698000000002, 2024-09-12T22:33:37.329 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:37.329 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:37.329 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:37.329 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:37.329 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.330 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:37.330 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398677+0000", 2024-09-12T22:33:37.330 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:37.330 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.330 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.330 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:37.330 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398677+0000", 2024-09-12T22:33:37.330 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:37.330 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.330 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.330 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:37.330 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398678+0000", 2024-09-12T22:33:37.330 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5199999999999995e-07 2024-09-12T22:33:37.330 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.331 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.331 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:37.331 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398686+0000", 2024-09-12T22:33:37.331 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0579999999999998e-06 2024-09-12T22:33:37.331 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.331 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.331 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:37.331 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398695+0000", 2024-09-12T22:33:37.331 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.1409999999999994e-06 2024-09-12T22:33:37.331 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.331 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.331 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:37.331 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398703+0000", 2024-09-12T22:33:37.331 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.4379999999999998e-06 2024-09-12T22:33:37.332 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.332 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.332 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:37.332 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.457051+0000", 2024-09-12T22:33:37.332 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.058348358000000003 2024-09-12T22:33:37.332 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.332 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.332 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:37.332 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.457096+0000", 2024-09-12T22:33:37.332 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4428000000000002e-05 2024-09-12T22:33:37.332 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.332 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.332 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:37.332 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.457162+0000", 2024-09-12T22:33:37.333 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.6298999999999997e-05 2024-09-12T22:33:37.333 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.333 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.333 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:37.333 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.461416+0000", 2024-09-12T22:33:37.333 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0042539980000000002 2024-09-12T22:33:37.333 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.333 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.333 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:37.333 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476610+0000", 2024-09-12T22:33:37.333 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.015193879 2024-09-12T22:33:37.333 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.333 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.333 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:37.334 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476640+0000", 2024-09-12T22:33:37.334 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0648000000000002e-05 2024-09-12T22:33:37.334 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.334 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.334 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:37.334 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476673+0000", 2024-09-12T22:33:37.334 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2598999999999997e-05 2024-09-12T22:33:37.334 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:37.334 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:37.334 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:37.334 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.334 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.334 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1210 3.13 3:cb3d3880:::200.0000000d:head [write 1017112~1958 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:37.334 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.398713+0000", 2024-09-12T22:33:37.335 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 22.883204127999999, 2024-09-12T22:33:37.335 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.078118317000000007, 2024-09-12T22:33:37.335 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:37.335 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:37.335 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:37.335 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:37.335 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.335 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:37.335 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398713+0000", 2024-09-12T22:33:37.335 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:37.335 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.335 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.335 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:37.335 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398713+0000", 2024-09-12T22:33:37.335 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:37.336 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.336 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.336 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:37.336 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398713+0000", 2024-09-12T22:33:37.336 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7599999999999998e-07 2024-09-12T22:33:37.336 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.336 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.336 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:37.336 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398718+0000", 2024-09-12T22:33:37.336 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8169999999999998e-06 2024-09-12T22:33:37.336 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.336 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.336 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:37.336 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398722+0000", 2024-09-12T22:33:37.337 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5249999999999999e-06 2024-09-12T22:33:37.337 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.337 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.337 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:37.337 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.398726+0000", 2024-09-12T22:33:37.337 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.5650000000000002e-06 2024-09-12T22:33:37.337 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.337 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.337 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:37.337 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.457644+0000", 2024-09-12T22:33:37.337 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.058918521000000001 2024-09-12T22:33:37.337 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.337 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.337 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:37.338 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.457724+0000", 2024-09-12T22:33:37.338 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.9408999999999998e-05 2024-09-12T22:33:37.338 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.338 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.338 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:37.338 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.457821+0000", 2024-09-12T22:33:37.338 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.7015000000000005e-05 2024-09-12T22:33:37.338 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.338 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.338 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:37.338 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.461419+0000", 2024-09-12T22:33:37.338 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0035985309999999999 2024-09-12T22:33:37.338 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.338 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.339 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:37.339 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476726+0000", 2024-09-12T22:33:37.339 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.015306804 2024-09-12T22:33:37.339 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.339 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.339 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:37.339 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476787+0000", 2024-09-12T22:33:37.339 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.1062000000000006e-05 2024-09-12T22:33:37.339 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.339 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.339 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:37.339 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476831+0000", 2024-09-12T22:33:37.339 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3692000000000001e-05 2024-09-12T22:33:37.339 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:37.339 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:37.340 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:37.340 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.340 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.340 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1211 3.13 3:cb3d3880:::200.0000000d:head [write 1019070~5873 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:37.340 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.400122+0000", 2024-09-12T22:33:37.340 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 22.881794410000001, 2024-09-12T22:33:37.340 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.076797146999999996, 2024-09-12T22:33:37.340 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:37.340 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:37.340 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:37.340 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:37.341 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.341 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:37.341 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.400122+0000", 2024-09-12T22:33:37.341 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:37.341 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.341 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.341 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:37.341 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.400122+0000", 2024-09-12T22:33:37.341 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:37.341 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.341 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.341 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:37.341 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.400123+0000", 2024-09-12T22:33:37.341 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.2500000000000005e-07 2024-09-12T22:33:37.342 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.342 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.342 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:37.342 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.400129+0000", 2024-09-12T22:33:37.342 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.319e-06 2024-09-12T22:33:37.342 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.342 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.342 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:37.342 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.400139+0000", 2024-09-12T22:33:37.342 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.5200000000000003e-06 2024-09-12T22:33:37.342 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.342 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.342 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:37.342 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.400143+0000", 2024-09-12T22:33:37.343 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.437e-06 2024-09-12T22:33:37.343 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.343 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.343 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:37.343 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.458159+0000", 2024-09-12T22:33:37.343 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.058015960999999998 2024-09-12T22:33:37.343 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.343 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.343 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:37.343 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.458201+0000", 2024-09-12T22:33:37.343 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.1693000000000002e-05 2024-09-12T22:33:37.343 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.343 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.343 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:37.344 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.458267+0000", 2024-09-12T22:33:37.344 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.5687999999999999e-05 2024-09-12T22:33:37.344 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.344 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.344 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:37.344 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.461423+0000", 2024-09-12T22:33:37.344 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0031560730000000001 2024-09-12T22:33:37.344 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.344 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.344 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:37.344 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476868+0000", 2024-09-12T22:33:37.344 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.015445108000000001 2024-09-12T22:33:37.344 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.344 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.345 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:37.345 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476897+0000", 2024-09-12T22:33:37.345 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9433000000000001e-05 2024-09-12T22:33:37.345 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.345 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.345 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:37.345 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476919+0000", 2024-09-12T22:33:37.345 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.2189999999999999e-05 2024-09-12T22:33:37.345 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:37.345 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:37.345 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:37.345 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.345 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.345 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1212 3.13 3:cb3d3880:::200.0000000d:head [write 1024943~3866 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:37.346 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.401707+0000", 2024-09-12T22:33:37.346 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 22.880210205000001, 2024-09-12T22:33:37.346 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.075386625999999998, 2024-09-12T22:33:37.346 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:37.346 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:37.346 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:37.346 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:37.346 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.346 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:37.346 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.401707+0000", 2024-09-12T22:33:37.346 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:37.346 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.346 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.346 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:37.347 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.401707+0000", 2024-09-12T22:33:37.347 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:37.347 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.347 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.347 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:37.347 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.401707+0000", 2024-09-12T22:33:37.347 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7700000000000004e-07 2024-09-12T22:33:37.347 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.347 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.347 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:37.347 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.401713+0000", 2024-09-12T22:33:37.347 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.6609999999999997e-06 2024-09-12T22:33:37.347 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.347 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.348 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:37.348 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.401726+0000", 2024-09-12T22:33:37.348 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.3088000000000001e-05 2024-09-12T22:33:37.348 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.348 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.348 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:37.348 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.401741+0000", 2024-09-12T22:33:37.348 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.5424e-05 2024-09-12T22:33:37.348 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.348 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.348 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:37.348 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.458853+0000", 2024-09-12T22:33:37.348 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.057111157000000003 2024-09-12T22:33:37.348 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.349 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.349 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:37.349 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.458898+0000", 2024-09-12T22:33:37.349 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5633999999999997e-05 2024-09-12T22:33:37.349 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.349 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.349 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:37.349 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.458972+0000", 2024-09-12T22:33:37.349 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.3441000000000004e-05 2024-09-12T22:33:37.349 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.349 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.349 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:37.349 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.461426+0000", 2024-09-12T22:33:37.349 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0024542660000000001 2024-09-12T22:33:37.350 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.350 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.350 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:37.350 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.476985+0000", 2024-09-12T22:33:37.350 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.015559513000000001 2024-09-12T22:33:37.350 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.350 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.350 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:37.350 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.477044+0000", 2024-09-12T22:33:37.350 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.8156999999999999e-05 2024-09-12T22:33:37.350 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.350 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.350 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:37.350 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.477093+0000", 2024-09-12T22:33:37.350 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9607999999999997e-05 2024-09-12T22:33:37.351 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:37.351 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:37.351 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:37.351 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.351 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.351 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1213 3.13 3:cb3d3880:::200.0000000d:head [write 1028809~6329 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:37.351 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.403250+0000", 2024-09-12T22:33:37.351 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 22.878666676999998, 2024-09-12T22:33:37.351 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.073936215999999999, 2024-09-12T22:33:37.351 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:37.351 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:37.351 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:37.351 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:37.351 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.352 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:37.352 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403250+0000", 2024-09-12T22:33:37.352 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:37.352 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.352 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.352 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:37.352 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403250+0000", 2024-09-12T22:33:37.352 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:37.352 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.352 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.352 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:37.352 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403251+0000", 2024-09-12T22:33:37.352 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.37e-07 2024-09-12T22:33:37.352 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.353 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.353 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:37.353 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403258+0000", 2024-09-12T22:33:37.353 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.25e-06 2024-09-12T22:33:37.353 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.353 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.353 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:37.353 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403269+0000", 2024-09-12T22:33:37.353 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.0509000000000001e-05 2024-09-12T22:33:37.353 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.353 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.353 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:37.353 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403274+0000", 2024-09-12T22:33:37.353 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1290000000000004e-06 2024-09-12T22:33:37.354 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.354 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.354 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:37.354 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.459796+0000", 2024-09-12T22:33:37.354 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.056522020999999999 2024-09-12T22:33:37.354 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.354 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.354 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:37.354 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.459845+0000", 2024-09-12T22:33:37.354 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8884999999999997e-05 2024-09-12T22:33:37.354 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.354 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.354 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:37.354 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.459920+0000", 2024-09-12T22:33:37.354 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.5318e-05 2024-09-12T22:33:37.355 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.355 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.355 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:37.355 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.466542+0000", 2024-09-12T22:33:37.355 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0066223139999999998 2024-09-12T22:33:37.355 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.355 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.355 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:37.355 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.477137+0000", 2024-09-12T22:33:37.355 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010594717 2024-09-12T22:33:37.355 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.355 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.355 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:37.356 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.477165+0000", 2024-09-12T22:33:37.356 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8262000000000001e-05 2024-09-12T22:33:37.356 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.356 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.356 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:37.356 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.477186+0000", 2024-09-12T22:33:37.356 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1073999999999998e-05 2024-09-12T22:33:37.356 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:37.356 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:37.356 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:37.356 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.356 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.356 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1214 3.13 3:cb3d3880:::200.0000000d:head [write 1035138~2606 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:37.357 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.403674+0000", 2024-09-12T22:33:37.357 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 22.878242756999999, 2024-09-12T22:33:37.357 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.073643204000000004, 2024-09-12T22:33:37.357 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:37.357 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:37.357 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:37.357 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:37.357 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.357 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:37.357 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403674+0000", 2024-09-12T22:33:37.357 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:37.357 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.357 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.357 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:37.358 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403674+0000", 2024-09-12T22:33:37.358 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:37.358 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.358 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.358 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:37.358 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403674+0000", 2024-09-12T22:33:37.358 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.7700000000000005e-07 2024-09-12T22:33:37.358 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.358 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.358 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:37.358 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403678+0000", 2024-09-12T22:33:37.358 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2009999999999999e-06 2024-09-12T22:33:37.358 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.358 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.358 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:37.359 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403686+0000", 2024-09-12T22:33:37.359 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.5690000000000005e-06 2024-09-12T22:33:37.359 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.359 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.359 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:37.359 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.403690+0000", 2024-09-12T22:33:37.359 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.233e-06 2024-09-12T22:33:37.359 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.359 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.359 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:37.359 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.460445+0000", 2024-09-12T22:33:37.359 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.056754412999999997 2024-09-12T22:33:37.359 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.359 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.360 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:37.360 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.460495+0000", 2024-09-12T22:33:37.360 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0238999999999998e-05 2024-09-12T22:33:37.360 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.360 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.360 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:37.360 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.460566+0000", 2024-09-12T22:33:37.360 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1159000000000001e-05 2024-09-12T22:33:37.360 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.360 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.360 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:37.360 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.466546+0000", 2024-09-12T22:33:37.360 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0059798910000000002 2024-09-12T22:33:37.361 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.361 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.361 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:37.361 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.477232+0000", 2024-09-12T22:33:37.361 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.010686084 2024-09-12T22:33:37.361 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.361 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.361 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:37.361 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.477280+0000", 2024-09-12T22:33:37.361 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.7719999999999997e-05 2024-09-12T22:33:37.361 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.361 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.361 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:37.361 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.477317+0000", 2024-09-12T22:33:37.362 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.7218000000000002e-05 2024-09-12T22:33:37.362 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:37.362 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:37.362 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:37.362 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.362 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.362 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1223 3.13 3:cb3d3880:::200.0000000d:head [write 1090497~1913 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:37.362 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.420111+0000", 2024-09-12T22:33:37.362 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 22.861805605000001, 2024-09-12T22:33:37.362 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.071634583000000002, 2024-09-12T22:33:37.362 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:37.362 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:37.362 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:37.362 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:37.363 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.363 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:37.363 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.420111+0000", 2024-09-12T22:33:37.363 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:37.363 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.363 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.363 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:37.363 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.420111+0000", 2024-09-12T22:33:37.363 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:37.363 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.363 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.363 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:37.363 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.420112+0000", 2024-09-12T22:33:37.363 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.2900000000000002e-07 2024-09-12T22:33:37.364 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.364 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.364 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:37.364 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.420116+0000", 2024-09-12T22:33:37.364 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.67e-06 2024-09-12T22:33:37.364 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.364 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.364 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:37.364 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.420125+0000", 2024-09-12T22:33:37.364 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 9.0890000000000006e-06 2024-09-12T22:33:37.364 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.364 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.365 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:37.365 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.420131+0000", 2024-09-12T22:33:37.365 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4269999999999996e-06 2024-09-12T22:33:37.365 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.365 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.365 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:37.365 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.465358+0000", 2024-09-12T22:33:37.365 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.045227030000000001 2024-09-12T22:33:37.365 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.365 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.365 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:37.365 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.465439+0000", 2024-09-12T22:33:37.366 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0901000000000004e-05 2024-09-12T22:33:37.366 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.366 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.366 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:37.366 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.465571+0000", 2024-09-12T22:33:37.366 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000131705 2024-09-12T22:33:37.366 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.366 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.366 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:37.366 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.469496+0000", 2024-09-12T22:33:37.366 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.003925418 2024-09-12T22:33:37.366 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.366 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.366 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:37.367 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.491669+0000", 2024-09-12T22:33:37.367 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.022172335000000001 2024-09-12T22:33:37.367 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.367 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.367 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:37.367 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.491714+0000", 2024-09-12T22:33:37.367 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5417000000000002e-05 2024-09-12T22:33:37.367 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.367 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.367 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:37.367 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.491746+0000", 2024-09-12T22:33:37.367 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.1662000000000003e-05 2024-09-12T22:33:37.367 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:37.367 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:37.368 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:37.368 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.368 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.368 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1225 3.13 3:cb3d3880:::200.0000000d:head [write 1097316~1932 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:37.368 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.421303+0000", 2024-09-12T22:33:37.368 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 22.86061377, 2024-09-12T22:33:37.368 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.074934770999999997, 2024-09-12T22:33:37.368 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:37.368 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:37.368 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:37.368 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:37.368 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.368 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:37.368 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.421303+0000", 2024-09-12T22:33:37.369 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:37.369 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.369 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.369 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:37.369 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.421303+0000", 2024-09-12T22:33:37.369 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:37.369 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.369 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.369 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:37.369 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.421303+0000", 2024-09-12T22:33:37.369 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.8599999999999998e-07 2024-09-12T22:33:37.369 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.369 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.370 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:37.370 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.421307+0000", 2024-09-12T22:33:37.370 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.0879999999999999e-06 2024-09-12T22:33:37.370 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.370 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.370 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:37.370 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.421314+0000", 2024-09-12T22:33:37.370 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1010000000000003e-06 2024-09-12T22:33:37.370 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.370 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.370 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:37.370 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.421319+0000", 2024-09-12T22:33:37.370 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7209999999999999e-06 2024-09-12T22:33:37.370 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.370 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.371 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:37.371 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.466620+0000", 2024-09-12T22:33:37.371 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.045301044999999998 2024-09-12T22:33:37.371 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.371 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.371 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:37.371 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.466703+0000", 2024-09-12T22:33:37.371 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.3011999999999997e-05 2024-09-12T22:33:37.371 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.371 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.371 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:37.371 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.466826+0000", 2024-09-12T22:33:37.371 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.000122824 2024-09-12T22:33:37.371 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.372 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.372 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:37.372 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.472359+0000", 2024-09-12T22:33:37.372 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0055323009999999999 2024-09-12T22:33:37.372 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.372 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.372 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:37.372 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496142+0000", 2024-09-12T22:33:37.372 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.023783696999999999 2024-09-12T22:33:37.372 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.372 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.372 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:37.372 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496194+0000", 2024-09-12T22:33:37.372 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1350000000000001e-05 2024-09-12T22:33:37.373 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.373 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.373 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:37.373 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496238+0000", 2024-09-12T22:33:37.373 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.4146000000000001e-05 2024-09-12T22:33:37.373 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:37.373 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:37.373 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:37.373 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.373 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.373 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1226 3.13 3:cb3d3880:::200.0000000d:head [write 1099248~1973 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:37.373 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.422971+0000", 2024-09-12T22:33:37.373 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 22.858946172, 2024-09-12T22:33:37.373 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.073363063000000006, 2024-09-12T22:33:37.374 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:37.374 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:37.374 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:37.374 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:37.374 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.374 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:37.374 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.422971+0000", 2024-09-12T22:33:37.374 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:37.374 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.374 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.374 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:37.374 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.422971+0000", 2024-09-12T22:33:37.374 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:37.374 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.375 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.375 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:37.375 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.422971+0000", 2024-09-12T22:33:37.375 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.1699999999999997e-07 2024-09-12T22:33:37.375 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.375 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.375 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:37.375 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.422975+0000", 2024-09-12T22:33:37.375 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2650000000000001e-06 2024-09-12T22:33:37.375 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.375 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.375 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:37.375 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.422981+0000", 2024-09-12T22:33:37.375 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.7379999999999997e-06 2024-09-12T22:33:37.376 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.376 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.376 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:37.376 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.422986+0000", 2024-09-12T22:33:37.376 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.5220000000000001e-06 2024-09-12T22:33:37.376 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.376 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.376 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:37.376 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.467340+0000", 2024-09-12T22:33:37.376 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.044353985999999998 2024-09-12T22:33:37.376 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.376 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.376 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:37.376 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.467412+0000", 2024-09-12T22:33:37.377 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1982000000000003e-05 2024-09-12T22:33:37.377 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.377 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.377 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:37.377 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.467493+0000", 2024-09-12T22:33:37.377 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 8.0829999999999997e-05 2024-09-12T22:33:37.377 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.377 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.377 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:37.377 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.472364+0000", 2024-09-12T22:33:37.377 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0048713189999999998 2024-09-12T22:33:37.377 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.377 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.377 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:37.378 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496271+0000", 2024-09-12T22:33:37.378 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.023906808000000002 2024-09-12T22:33:37.378 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.378 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.378 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:37.378 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496300+0000", 2024-09-12T22:33:37.378 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9315e-05 2024-09-12T22:33:37.378 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.378 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.378 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:37.378 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496334+0000", 2024-09-12T22:33:37.378 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.3481e-05 2024-09-12T22:33:37.378 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:37.378 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:37.379 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:37.379 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.379 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.379 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1227 3.13 3:cb3d3880:::200.0000000d:head [write 1101221~1922 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:37.379 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.423028+0000", 2024-09-12T22:33:37.379 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 22.858889187999999, 2024-09-12T22:33:37.379 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.073444802000000003, 2024-09-12T22:33:37.379 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:37.379 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:37.379 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:37.379 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:37.379 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.379 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:37.379 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423028+0000", 2024-09-12T22:33:37.379 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:37.380 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.380 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.380 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:37.380 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423028+0000", 2024-09-12T22:33:37.380 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:37.380 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.380 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.380 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:37.380 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423028+0000", 2024-09-12T22:33:37.380 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.1699999999999998e-07 2024-09-12T22:33:37.380 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.380 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.380 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:37.380 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423031+0000", 2024-09-12T22:33:37.381 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.8499999999999998e-06 2024-09-12T22:33:37.381 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.381 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.381 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:37.381 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423036+0000", 2024-09-12T22:33:37.381 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9479999999999999e-06 2024-09-12T22:33:37.381 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.381 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.381 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:37.381 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423039+0000", 2024-09-12T22:33:37.381 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4929999999999998e-06 2024-09-12T22:33:37.381 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.381 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.381 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:37.382 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.467785+0000", 2024-09-12T22:33:37.382 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.044745957000000003 2024-09-12T22:33:37.382 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.382 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.382 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:37.382 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.467838+0000", 2024-09-12T22:33:37.382 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.2596999999999998e-05 2024-09-12T22:33:37.382 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.382 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.382 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:37.382 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.467915+0000", 2024-09-12T22:33:37.382 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.6744999999999998e-05 2024-09-12T22:33:37.382 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.382 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.383 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:37.383 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.472368+0000", 2024-09-12T22:33:37.383 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0044534730000000003 2024-09-12T22:33:37.383 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.383 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.383 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:37.383 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496382+0000", 2024-09-12T22:33:37.383 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.024014111000000001 2024-09-12T22:33:37.383 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.383 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.383 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:37.383 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496443+0000", 2024-09-12T22:33:37.383 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.0547000000000002e-05 2024-09-12T22:33:37.383 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.384 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.384 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:37.384 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496472+0000", 2024-09-12T22:33:37.384 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9564e-05 2024-09-12T22:33:37.384 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:37.384 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:37.384 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:37.384 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.384 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.384 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1228 3.13 3:cb3d3880:::200.0000000d:head [write 1103143~2423 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:37.384 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.423305+0000", 2024-09-12T22:33:37.384 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 22.858611824, 2024-09-12T22:33:37.384 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.073251160999999995, 2024-09-12T22:33:37.384 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:37.385 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:37.385 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:37.385 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:37.385 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.385 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:37.385 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423305+0000", 2024-09-12T22:33:37.385 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:37.385 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.385 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.385 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:37.385 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423305+0000", 2024-09-12T22:33:37.385 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:37.385 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.385 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.386 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:37.386 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423306+0000", 2024-09-12T22:33:37.386 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4899999999999995e-07 2024-09-12T22:33:37.386 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.386 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.386 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:37.386 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423311+0000", 2024-09-12T22:33:37.386 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.7459999999999997e-06 2024-09-12T22:33:37.386 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.386 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.386 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:37.386 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423316+0000", 2024-09-12T22:33:37.386 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.0239999999999997e-06 2024-09-12T22:33:37.387 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.387 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.387 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:37.387 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423320+0000", 2024-09-12T22:33:37.387 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.67e-06 2024-09-12T22:33:37.387 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.387 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.387 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:37.387 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.468252+0000", 2024-09-12T22:33:37.387 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.044932262000000001 2024-09-12T22:33:37.387 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.387 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.387 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:37.387 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.468293+0000", 2024-09-12T22:33:37.388 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.0368999999999999e-05 2024-09-12T22:33:37.388 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.388 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.388 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:37.388 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.468357+0000", 2024-09-12T22:33:37.388 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4287000000000003e-05 2024-09-12T22:33:37.388 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.388 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.388 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:37.388 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.472371+0000", 2024-09-12T22:33:37.388 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0040144350000000002 2024-09-12T22:33:37.388 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.388 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.388 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:37.389 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496507+0000", 2024-09-12T22:33:37.389 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.024135961000000001 2024-09-12T22:33:37.389 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.389 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.389 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:37.389 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496537+0000", 2024-09-12T22:33:37.389 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.9611000000000002e-05 2024-09-12T22:33:37.389 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.389 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.389 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:37.389 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496556+0000", 2024-09-12T22:33:37.389 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.9147000000000002e-05 2024-09-12T22:33:37.389 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:37.389 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:37.390 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:37.390 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.390 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.390 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1229 3.13 3:cb3d3880:::200.0000000d:head [write 1105566~1911 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:37.390 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.423606+0000", 2024-09-12T22:33:37.390 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 22.858310812999999, 2024-09-12T22:33:37.390 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.073027876000000005, 2024-09-12T22:33:37.390 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:37.390 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:37.390 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:37.390 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:37.390 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.390 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:37.391 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423606+0000", 2024-09-12T22:33:37.391 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:37.391 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.391 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.391 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:37.391 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423606+0000", 2024-09-12T22:33:37.391 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:37.391 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.391 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.391 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:37.391 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423606+0000", 2024-09-12T22:33:37.391 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.7e-07 2024-09-12T22:33:37.391 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.391 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.392 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:37.392 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423609+0000", 2024-09-12T22:33:37.392 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.5339999999999998e-06 2024-09-12T22:33:37.392 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.392 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.392 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:37.392 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423614+0000", 2024-09-12T22:33:37.392 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.69e-06 2024-09-12T22:33:37.392 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.392 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.392 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:37.392 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423617+0000", 2024-09-12T22:33:37.392 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.4300000000000002e-06 2024-09-12T22:33:37.392 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.392 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.393 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:37.393 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.468606+0000", 2024-09-12T22:33:37.393 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.044988606 2024-09-12T22:33:37.393 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.393 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.393 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:37.393 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.468649+0000", 2024-09-12T22:33:37.393 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3414000000000001e-05 2024-09-12T22:33:37.393 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.393 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.393 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:37.393 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.468714+0000", 2024-09-12T22:33:37.393 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 6.4857000000000006e-05 2024-09-12T22:33:37.394 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.394 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.394 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:37.394 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.472375+0000", 2024-09-12T22:33:37.394 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0036607330000000002 2024-09-12T22:33:37.394 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.394 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.394 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:37.394 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496585+0000", 2024-09-12T22:33:37.394 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.024210835 2024-09-12T22:33:37.394 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.394 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.394 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:37.394 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496612+0000", 2024-09-12T22:33:37.394 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6999999999999999e-05 2024-09-12T22:33:37.395 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.395 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.395 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:37.395 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496634+0000", 2024-09-12T22:33:37.395 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.1307000000000001e-05 2024-09-12T22:33:37.395 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:37.395 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:37.395 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:37.395 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.395 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.395 INFO:teuthology.orchestra.run.smithi163.stdout: "description": "osd_op(mds.0.3:1230 3.13 3:cb3d3880:::200.0000000d:head [write 1107477~6537 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-09-12T22:33:37.395 INFO:teuthology.orchestra.run.smithi163.stdout: "initiated_at": "2024-09-12T22:33:14.423911+0000", 2024-09-12T22:33:37.395 INFO:teuthology.orchestra.run.smithi163.stdout: "age": 22.858005968000001, 2024-09-12T22:33:37.395 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.072794530999999996, 2024-09-12T22:33:37.396 INFO:teuthology.orchestra.run.smithi163.stdout: "continuous": false, 2024-09-12T22:33:37.396 INFO:teuthology.orchestra.run.smithi163.stdout: "type_data": { 2024-09-12T22:33:37.396 INFO:teuthology.orchestra.run.smithi163.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T22:33:37.396 INFO:teuthology.orchestra.run.smithi163.stdout: "events": [ 2024-09-12T22:33:37.396 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.396 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "initiated", 2024-09-12T22:33:37.396 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423911+0000", 2024-09-12T22:33:37.396 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:37.396 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.396 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.396 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "header_read", 2024-09-12T22:33:37.396 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423911+0000", 2024-09-12T22:33:37.396 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0 2024-09-12T22:33:37.397 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.397 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.397 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "throttled", 2024-09-12T22:33:37.397 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423911+0000", 2024-09-12T22:33:37.397 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.3799999999999998e-07 2024-09-12T22:33:37.397 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.397 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.397 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "all_read", 2024-09-12T22:33:37.397 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423919+0000", 2024-09-12T22:33:37.397 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.8329999999999994e-06 2024-09-12T22:33:37.397 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.397 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.397 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "dispatched", 2024-09-12T22:33:37.397 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423924+0000", 2024-09-12T22:33:37.397 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 5.3449999999999996e-06 2024-09-12T22:33:37.398 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.398 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.398 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "queued_for_pg", 2024-09-12T22:33:37.398 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.423928+0000", 2024-09-12T22:33:37.398 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 3.2339999999999999e-06 2024-09-12T22:33:37.398 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.398 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.398 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "reached_pg", 2024-09-12T22:33:37.398 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.469042+0000", 2024-09-12T22:33:37.398 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.045114888999999998 2024-09-12T22:33:37.398 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.398 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.398 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "started", 2024-09-12T22:33:37.399 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.469092+0000", 2024-09-12T22:33:37.399 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 4.9289000000000002e-05 2024-09-12T22:33:37.399 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.399 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.399 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "waiting for subops from 1", 2024-09-12T22:33:37.399 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.469163+0000", 2024-09-12T22:33:37.399 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 7.1222000000000004e-05 2024-09-12T22:33:37.399 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.399 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.399 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "op_commit", 2024-09-12T22:33:37.399 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.472379+0000", 2024-09-12T22:33:37.399 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.0032156419999999999 2024-09-12T22:33:37.399 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.399 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.399 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "sub_op_commit_rec", 2024-09-12T22:33:37.400 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496661+0000", 2024-09-12T22:33:37.400 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 0.024281857 2024-09-12T22:33:37.400 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.400 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.400 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "commit_sent", 2024-09-12T22:33:37.400 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496687+0000", 2024-09-12T22:33:37.400 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 2.6551e-05 2024-09-12T22:33:37.400 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2024-09-12T22:33:37.400 INFO:teuthology.orchestra.run.smithi163.stdout: { 2024-09-12T22:33:37.400 INFO:teuthology.orchestra.run.smithi163.stdout: "event": "done", 2024-09-12T22:33:37.400 INFO:teuthology.orchestra.run.smithi163.stdout: "time": "2024-09-12T22:33:14.496705+0000", 2024-09-12T22:33:37.400 INFO:teuthology.orchestra.run.smithi163.stdout: "duration": 1.8230999999999999e-05 2024-09-12T22:33:37.400 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:37.400 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:37.401 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:37.401 INFO:teuthology.orchestra.run.smithi163.stdout: } 2024-09-12T22:33:37.401 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-09-12T22:33:37.401 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-09-12T22:33:37.606 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T22:33:38.602 INFO:teuthology.orchestra.run.smithi019.stderr:noscrub is unset 2024-09-12T22:33:38.617 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T22:33:39.077 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~54s 2024-09-12T22:33:39.605 INFO:teuthology.orchestra.run.smithi019.stderr:nodeep-scrub is unset 2024-09-12T22:33:44.886 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~59s 2024-09-12T22:33:50.693 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~65s 2024-09-12T22:33:56.500 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~71s 2024-09-12T22:34:02.308 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~77s 2024-09-12T22:34:08.115 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~83s 2024-09-12T22:34:13.921 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~88s 2024-09-12T22:34:19.729 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~94s 2024-09-12T22:34:25.534 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~100s 2024-09-12T22:34:31.340 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~106s 2024-09-12T22:34:37.147 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~112s 2024-09-12T22:34:42.954 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~117s 2024-09-12T22:34:48.760 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~123s 2024-09-12T22:34:54.567 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~129s 2024-09-12T22:35:00.372 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~135s 2024-09-12T22:35:06.178 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~141s 2024-09-12T22:35:09.408 DEBUG:teuthology.orchestra.console.smithi076:expect before: [Enter `^Ec?' for help] \x80 \x80 \x80 Initializing Intel(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Press Ctrl+S to enter the Setup Menu..  \x80 \x80  el(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Initializing Intel(R) Boot Agent XE v2.1.60 Press Ctrl+S to enter the Setup Menu..  \x80 \x80 Initializing Intel(R) Boot Agent GE v1.5.72 PXE 2.1 Build 092 (WfM 2.0) Press Ctrl+S to enter the Setup Menu.                       Press Ctrl+S to enter the Setup Menu..  \x80 \x80 Initializing Intel(R) Boot Agent GE v1.5.72 PXE 2.1 Build 092 (WfM 2.0) Press Ctrl+S to enter the Setup Menu.                       Press Ctrl+S to enter the Setup Menu..  \x80 \x80  Intel(R) Boot Agent XE v2.1.60 Copyright (C) 1997-2009, Intel Corporation  CLIENT MAC ADDR: 0C C4 7A 8F 47 E1 GUID: 00000000 0000 0000 0000 0CC47AD8DA66 DHCP.|                    DHCP.\ DHCP.| DHCP./ DHCP.- DHCP.\ DHCP.| CLIENT IP: 172.21.15.76 MASK: 255.255.240.0 DHCP IP: 172.21.0.10 GATEWAY IP: 172.21.15.254 PXE->EB: !PXE at 95D3:0070, entry point at 95D3:0106  UNDI code segment 95D3:3E70, data segment 8E94:73F0 (570-615kB)  UNDI device is PCI 03:00.1, type DIX+802.3  570kB free base memory after PXE unload iPXE initialising devices... iPXE initialising devices...ok iPXE 1.20.1+ (g4bd0) -- Open Source Network Boot Firmware -- http://ipxe.org Features: DNS FTP HTTP HTTPS iSCSI NFS TFTP VLAN AoE ELF MBOOT PXE bzImage Menu PXEXT Configuring (net0 0c:c4:7a:8f:47:e1)... Configuring (net0 0c:c4:7a:8f:47:e1).... Configuring (net0 0c:c4:7a:8f:47:e1)..... Configuring (net0 0c:c4:7a:8f:47:e1)...... ok .   [?25lUse the ^ and v keys to change the selection. Press 'e' to edit the selected item, or 'c' for a command prompt.   CentOS Stream (5.14.0-505.el9.x86_64) 9  CentOS Stream (5.14.0-503.el9.x86_64) 9  CentOS Stream (5.14.0-239.el9.x86_64) 9  CentOS Stream (0-rescue-fbf6b6fa6cf04654a0e563f30ecbf43a) 9               CentOS Stream (0-rescue-fbf6b6fa6cf0465 The selected entry will be started automatically in 5s. 4a0e563f30ecbf43a) 9            Use the * and * keys to change the selection.  Press 'e' to edit the selected item, or 'c' for a command prompt.  The selected entry will be started automatically in 5s.   CentOS Stream (5.14.0-505.el9.x86_64) 9   CentOS Stream (5.14.0-503.el9.x86_64) 9  CentOS Stream (5.14.0-239.el9.x86_64) 9  The selected entry will be started automatically in 4s.  The selected entry will be started automatically in 4s.  The selected entry will be started automatically in 3s.  The selected entry will be started automatically in 3s.  The selected entry will be started automatically in 2s.  The selected entry will be started automatically in 2s.  The selected entry will be started automatically in 1s.  The selected entry will be started automatically in 1s.  The selected entry will be started automatically in 0s. [?25h       [ 0.000000] Linux version 5.14.0-505.el9.x86_64 (mockbuild@x86-05.stream.rdu2.redhat.com) (gcc (GCC) 11.5.0 20240719 (Red Hat 11.5.0-2), GNU ld version 2.35.2-54.el9) #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 [ 0.000000] The list of certified hardware and cloud instances for Red Hat Enterprise Linux 9 can be viewed at the Red Hat Ecosystem Catalog, https://catalog.redhat.com. [ 0.000000] Command line: BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-5.14.0-505.el9.x86_64 root=UUID=fa8d2923-554d-41e2-ac4a-c752ff079ceb ro crashkernel=1G-4G:192M,4G-64G:256M,64G-:512M console=ttyS1,115200 [ 0.000000] BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000008abff] usable [ 0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x0000000078ec5fff] usable [ 0.000000] BIOS-e820: [mem 0x0000000078f78000-0x00000000798a7fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000798a8000-0x0000000079d44fff] ACPI NVS [ 0.000000] BIOS-e820: [mem 0x0000000079d45000-0x000000008fffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed44fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000ff000000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000087fffffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] APIC: Static calls initialized [ 0.000000] SMBIOS 3.0 present. [ 0.000000] DMI: Supermicro SYS-5018R-WR/X10SRW-F, BIOS 2.0a 08/02/2016 [ 0.000000] tsc: Fast TSC calibration using PIT [ 0.000000] tsc: Detected 3499.737 MHz processor [ 0.000447] last_pfn = 0x880000 max_arch_pfn = 0x400000000 [ 0.000451] MTRR map: 5 entries (3 fixed + 2 variable; max 23), built from 10 variable MTRRs [ 0.000452] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT [ 0.000782] last_pfn = 0x78ec6 max_arch_pfn = 0x400000000 [ 0.006443] found SMP MP-table at [mem 0x000fcd40-0x000fcd4f] [ 0.006451] Using GB pages for direct mapping [ 0.006569] RAMDISK: [mem 0x341fd000-0x360f6fff] [ 0.006571] ACPI: Early table checksum verification disabled [ 0.006573] ACPI: RSDP 0x00000000000F05B0 000024 (v02 SUPERM) [ 0.006576] ACPI: XSDT 0x00000000798A80A0 0000BC (v01 01072009 AMI 00010013) [ 0.006581] ACPI: FACP 0x00000000798DB838 00010C (v05 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.006585] ACPI: DSDT 0x00000000798A81F0 033641 (v02 SUPERM SMCI--MB 01072009 INTL 20091013) [ 0.006587] ACPI: FACS 0x0000000079D43F80 000040 [ 0.006589] ACPI: APIC 0x00000000798DB948 0000C8 (v03 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.006592] ACPI: FPDT 0x00000000798DBA10 000044 (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.006594] ACPI: FIDT 0x00000000798DBA58 00009C (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.006596] ACPI: SPMI 0x00000000798DBAF8 000040 (v05 SUPERM SMCI--MB 00000000 AMI. 00000000) [ 0.006598] ACPI: MCFG 0x00000000798DBB38 00003C (v01 SUPERM SMCI--MB 01072009 MSFT 00000097) [ 0.006600] ACPI: UEFI 0x00000000798DBB78 000042 (v01 SUPERM SMCI--MB 01072009 00000000) [ 0.006603] ACPI: HPET 0x00000000798DBBC0 000038 (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.006605] ACPI: WDDT 0x00000000798DBBF8 000040 (v01 SUPERM SMCI--MB 00000000 INTL 20091013) [ 0.006607] ACPI: SSDT 0x00000000798DBC38 01717F (v02 SUPERM PmMgt 00000001 INTL 20120913) [ 0.006609] ACPI: NITR 0x00000000798F2DB8 000071 (v02 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.006611] ACPI: SSDT 0x00000000798F2E30 00264C (v02 SUPERM SpsNm 00000002 INTL 20120913) [ 0.006614] ACPI: SSDT 0x00000000798F5480 000064 (v02 SUPERM SpsNvs 00000002 INTL 20120913) [ 0.006616] ACPI: PRAD 0x00000000798F54E8 000102 (v02 SUPERM SMCI--MB 00000002 INTL 20120913) [ 0.006618] ACPI: DMAR 0x00000000798F55F0 0000BC (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.006620] ACPI: HEST 0x00000000798F56B0 00027C (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.006623] ACPI: BERT 0x00000000798F5930 000030 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.006625] ACPI: ERST 0x00000000798F5960 000230 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.006627] ACPI: EINJ 0x00000000798F5B90 000130 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.006629] ACPI: Reserving FACP table memory at [mem 0x798db838-0x798db943] [ 0.006630] ACPI: Reserving DSDT table memory at [mem 0x798a81f0-0x798db830] [ 0.006630] ACPI: Reserving FACS table memory at [mem 0x79d43f80-0x79d43fbf] [ 0.006631] ACPI: Reserving APIC table memory at [mem 0x798db948-0x798dba0f] [ 0.006632] ACPI: Reserving FPDT table memory at [mem 0x798dba10-0x798dba53] [ 0.006632] ACPI: Reserving FIDT table memory at [mem 0x798dba58-0x798dbaf3] [ 0.006633] ACPI: Reserving SPMI table memory at [mem 0x798dbaf8-0x798dbb37] [ 0.006633] ACPI: Reserving MCFG table memory at [mem 0x798dbb38-0x798dbb73] [ 0.006634] ACPI: Reserving UEFI table memory at [mem 0x798dbb78-0x798dbbb9] [ 0.006635] ACPI: Reserving HPET table memory at [mem 0x798dbbc0-0x798dbbf7] [ 0.006635] ACPI: Reserving WDDT table memory at [mem 0x798dbbf8-0x798dbc37] [ 0.006636] ACPI: Reserving SSDT table memory at [mem 0x798dbc38-0x798f2db6] [ 0.006636] ACPI: Reserving NITR table memory at [mem 0x798f2db8-0x798f2e28] [ 0.006637] ACPI: Reserving SSDT table memory at [mem 0x798f2e30-0x798f547b] [ 0.006637] ACPI: Reserving SSDT table memory at [mem 0x798f5480-0x798f54e3] [ 0.006638] ACPI: Reserving PRAD table memory at [mem 0x798f54e8-0x798f55e9] [ 0.006639] ACPI: Reserving DMAR table memory at [mem 0x798f55f0-0x798f56ab] [ 0.006639] ACPI: Reserving HEST table memory at [mem 0x798f56b0-0x798f592b] [ 0.006640] ACPI: Reserving BERT table memory at [mem 0x798f5930-0x798f595f] [ 0.006640] ACPI: Reserving ERST table memory at [mem 0x798f5960-0x798f5b8f] [ 0.006641] ACPI: Reserving EINJ table memory at [mem 0x798f5b90-0x798f5cbf] [ 0.006687] No NUMA configuration found [ 0.006688] Faking a node at [mem 0x0000000000000000-0x000000087fffffff] [ 0.006696] NODE_DATA(0) allocated [mem 0x87ffd5000-0x87fffffff] [ 0.006864] Reserving 256MB of memory at 1664MB for crashkernel (System RAM: 32654MB) [ 0.006900] Zone ranges: [ 0.006900] DMA [mem 0x0000000000001000-0x0000000000ffffff] [ 0.006902] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] [ 0.006903] Normal [mem 0x0000000100000000-0x000000087fffffff] [ 0.006904] Device empty [ 0.006904] Movable zone start for each node [ 0.006907] Early memory node ranges [ 0.006907] node 0: [mem 0x0000000000001000-0x0000000000089fff] [ 0.006908] node 0: [mem 0x0000000000100000-0x0000000078ec5fff] [ 0.006909] node 0: [mem 0x0000000100000000-0x000000087fffffff] [ 0.006913] Initmem setup node 0 [mem 0x0000000000001000-0x000000087fffffff] [ 0.006917] On node 0, zone DMA: 1 pages in unavailable ranges [ 0.006953] On node 0, zone DMA: 118 pages in unavailable ranges [ 0.011631] On node 0, zone Normal: 28986 pages in unavailable ranges [ 0.011742] ACPI: PM-Timer IO Port: 0x408 [ 0.011750] ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1]) [ 0.011751] ACPI: LAPIC_NMI (acpi_id[0x02] high edge lint[0x1]) [ 0.011752] ACPI: LAPIC_NMI (acpi_id[0x04] high edge lint[0x1]) [ 0.011752] ACPI: LAPIC_NMI (acpi_id[0x06] high edge lint[0x1]) [ 0.011753] ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1]) [ 0.011753] ACPI: LAPIC_NMI (acpi_id[0x03] high edge lint[0x1]) [ 0.011754] ACPI: LAPIC_NMI (acpi_id[0x05] high edge lint[0x1]) [ 0.011755] ACPI: LAPIC_NMI (acpi_id[0x07] high edge lint[0x1]) [ 0.011763] IOAPIC[0]: apic_id 1, version 32, address 0xfec00000, GSI 0-23 [ 0.011767] IOAPIC[1]: apic_id 2, version 32, address 0xfec01000, GSI 24-47 [ 0.011769] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.011771] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.011774] ACPI: Using ACPI (MADT) for SMP configuration information [ 0.011775] ACPI: HPET id: 0x8086a701 base: 0xfed00000 [ 0.011779] [Firmware Bug]: TSC_DEADLINE disabled due to Errata; please update microcode to version: 0xb000020 (or later) [ 0.011784] CPU topo: Max. logical packages: 1 [ 0.011784] CPU topo: Max. logical dies: 1 [ 0.011785] CPU topo: Max. dies per package: 1 [ 0.011789] CPU topo: Max. threads per core: 2 [ 0.011790] CPU topo: Num. cores per package: 4 [ 0.011790] CPU topo: Num. threads per package: 8 [ 0.011791] CPU topo: Allowing 8 present CPUs plus 0 hotplug CPUs [ 0.011799] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] [ 0.011801] PM: hibernation: Registered nosave memory: [mem 0x0008a000-0x000dffff] [ 0.011802] PM: hibernation: Registered nosave memory: [mem 0x000e0000-0x000fffff] [ 0.011803] PM: hibernation: Registered nosave memory: [mem 0x78ec6000-0x78f77fff] [ 0.011803] PM: hibernation: Registered nosave memory: [mem 0x78f78000-0x798a7fff] [ 0.011804] PM: hibernation: Registered nosave memory: [mem 0x798a8000-0x79d44fff] [ 0.011804] PM: hibernation: Registered nosave memory: [mem 0x79d45000-0x8fffffff] [ 0.011805] PM: hibernation: Registered nosave memory: [mem 0x90000000-0xfed1bfff] [ 0.011805] PM: hibernation: Registered nosave memory: [mem 0xfed1c000-0xfed44fff] [ 0.011806] PM: hibernation: Registered nosave memory: [mem 0xfed45000-0xfeffffff] [ 0.011806] PM: hibernation: Registered nosave memory: [mem 0xff000000-0xffffffff] [ 0.011808] [mem 0x90000000-0xfed1bfff] available for PCI devices [ 0.011809] Booting paravirtualized kernel on bare hardware [ 0.011811] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns [ 0.016173] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:8 nr_cpu_ids:8 nr_node_ids:1 [ 0.016393] percpu: Embedded 64 pages/cpu s225280 r8192 d28672 u262144 [ 0.016414] Kernel command line: BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-5.14.0-505.el9.x86_64 root=UUID=fa8d2923-554d-41e2-ac4a-c752ff079ceb ro crashkernel=1G-4G:192M,4G-64G:256M,64G-:512M console=ttyS1,115200 [ 0.016467] Unknown kernel command line parameters "BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-5.14.0-505.el9.x86_64", will be passed to user space. [ 0.016482] random: crng init done [ 0.018661] Dentry cache hash table entries: 4194304 (order: 13, 33554432 bytes, linear) [ 0.019799] Inode-cache hash table entries: 2097152 (order: 12, 16777216 bytes, linear) [ 0.019903] Fallback order for Node 0: 0 [ 0.019907] Built 1 zonelists, mobility grouping on. Total pages: 8228746 [ 0.019908] Policy zone: Normal [ 0.020050] mem auto-init: stack:off, heap alloc:off, heap free:off [ 0.020057] software IO TLB: area num 8. [ 0.041024] Memory: 1751596K/33438012K available (16384K kernel code, 5657K rwdata, 12972K rodata, 3980K init, 5696K bss, 989844K reserved, 0K cma-reserved) [ 0.041126] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=8, Nodes=1 [ 0.041135] Kernel/User page tables isolation: enabled [ 0.041158] ftrace: allocating 48134 entries in 189 pages [ 0.047988] ftrace: allocated 189 pages with 6 groups [ 0.048512] Dynamic Preempt: voluntary [ 0.048553] rcu: Preemptible hierarchical RCU implementation. [ 0.048554] rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=8. [ 0.048555] Trampoline variant of Tasks RCU enabled. [ 0.048556] Rude variant of Tasks RCU enabled. [ 0.048556] Tracing variant of Tasks RCU enabled. [ 0.048556] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. [ 0.048557] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=8 [ 0.052027] NR_IRQS: 524544, nr_irqs: 896, preallocated irqs: 16 [ 0.052188] rcu: srcu_init: Setting srcu_struct sizes based on contention. [ 0.052295] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) [ 0.057555] Console: colour VGA+ 80x25 [ 0.057573] printk: console [ttyS1] enabled [ 1.128137] ACPI: Core revision 20230331 [ 1.132230] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 133484882848 ns [ 1.141360] APIC: Switch to symmetric I/O mode setup [ 1.146330] DMAR: Host address width 46 [ 1.150172] DMAR: DRHD base: 0x000000fbffc000 flags: 0x1 [ 1.155489] DMAR: dmar0: reg_base_addr fbffc000 ver 1:0 cap 8d2078c106f0466 ecap f020de [ 1.163484] DMAR: RMRR base: 0x0000007ba6e000 end: 0x0000007ba7dfff [ 1.169751] DMAR: ATSR flags: 0x0 [ 1.173071] DMAR: RHSA base: 0x000000fbffc000 proximity domain: 0x0 [ 1.179338] DMAR-IR: IOAPIC id 1 under DRHD base 0xfbffc000 IOMMU 0 [ 1.185691] DMAR-IR: IOAPIC id 2 under DRHD base 0xfbffc000 IOMMU 0 [ 1.192045] DMAR-IR: HPET id 0 under DRHD base 0xfbffc000 [ 1.197444] DMAR-IR: x2apic is disabled because BIOS sets x2apic opt out bit. [ 1.197445] DMAR-IR: Use 'intremap=no_x2apic_optout' to override the BIOS setting. [ 1.212463] DMAR-IR: Enabled IRQ remapping in xapic mode [ 1.217773] x2apic: IRQ remapping doesn't support X2APIC mode [ 1.223975] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 1.234366] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x32725850a05, max_idle_ns: 440795315679 ns [ 1.244880] Calibrating delay loop (skipped), value calculated using timer frequency.. 6999.47 BogoMIPS (lpj=3499737) [ 1.245898] CPU0: Thermal monitoring enabled (TM1) [ 1.246934] process: using mwait in idle threads [ 1.247880] Last level iTLB entries: 4KB 64, 2MB 8, 4MB 8 [ 1.248879] Last level dTLB entries: 4KB 64, 2MB 0, 4MB 0, 1GB 4 [ 1.249880] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization [ 1.250880] Spectre V2 : Mitigation: Retpolines [ 1.251879] Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch [ 1.252879] Spectre V2 : Spectre v2 / SpectreRSB : Filling RSB on VMEXIT [ 1.253879] Speculative Store Bypass: Vulnerable [ 1.254884] MDS: Vulnerable: Clear CPU buffers attempted, no microcode [ 1.255879] TAA: Vulnerable: Clear CPU buffers attempted, no microcode [ 1.256879] MMIO Stale Data: Vulnerable: Clear CPU buffers attempted, no microcode [ 1.257882] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' [ 1.258879] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' [ 1.259879] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' [ 1.260879] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 [ 1.261879] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. [ 1.274462] Freeing SMP alternatives memory: 40K [ 1.274880] pid_max: default: 32768 minimum: 301 [ 1.275898] LSM: initializing lsm=lockdown,capability,yama,integrity,selinux,bpf [ 1.276884] Yama: becoming mindful. [ 1.277884] SELinux: Initializing. [ 1.278895] LSM support for eBPF active [ 1.279936] Mount-cache hash table entries: 65536 (order: 7, 524288 bytes, linear) [ 1.280917] Mountpoint-cache hash table entries: 65536 (order: 7, 524288 bytes, linear) [ 1.384864] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz (family: 0x6, model: 0x4f, stepping: 0x1) [ 1.385981] RCU Tasks: Setting shift to 3 and lim to 1 rcu_task_cb_adjust=1. [ 1.386891] RCU Tasks Rude: Setting shift to 3 and lim to 1 rcu_task_cb_adjust=1. [ 1.387888] RCU Tasks Trace: Setting shift to 3 and lim to 1 rcu_task_cb_adjust=1. [ 1.388887] Performance Events: PEBS fmt2+, Broadwell events, 16-deep LBR, full-width counters, Intel PMU driver. [ 1.389880] ... version: 3 [ 1.390879] ... bit width: 48 [ 1.391879] ... generic registers: 4 [ 1.392879] ... value mask: 0000ffffffffffff [ 1.393879] ... max period: 00007fffffffffff [ 1.394879] ... fixed-purpose events: 3 [ 1.395879] ... event mask: 000000070000000f [ 1.396965] signal: max sigframe size: 1776 [ 1.397890] Estimated ratio of average max frequency by base frequency (times 1024): 1053 [ 1.398904] rcu: Hierarchical SRCU implementation. [ 1.398905] rcu: Max phase no-delay instances is 400. [ 1.402353] NMI watchdog: Enabled. Permanently consumes one hw-PMU counter. [ 1.402946] smp: Bringing up secondary CPUs ... [ 1.403944] smpboot: x86: Booting SMP configuration: [ 1.403946] .... node #0, CPUs: #1 #2 #3 #4 #5 #6 #7 [ 1.407146] MDS CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/mds.html for more details. [ 1.407146] TAA CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/tsx_async_abort.html for more details. [ 1.407146] MMIO Stale Data CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/processor_mmio_stale_data.html for more details. [ 1.410923] smp: Brought up 1 node, 8 CPUs [ 1.410923] smpboot: Total of 8 processors activated (55995.79 BogoMIPS) [ 1.452039] node 0 deferred pages initialised in 38ms [ 1.454916] devtmpfs: initialized [ 1.454916] x86/mm: Memory block size: 128MB [ 1.455878] ACPI: PM: Registering ACPI NVS region [mem 0x798a8000-0x79d44fff] (4837376 bytes) [ 1.455878] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns [ 1.455878] futex hash table entries: 2048 (order: 5, 131072 bytes, linear) [ 1.455878] pinctrl core: initialized pinctrl subsystem [ 1.459878] NET: Registered PF_NETLINK/PF_ROUTE protocol family [ 1.459878] DMA: preallocated 4096 KiB GFP_KERNEL pool for atomic allocations [ 1.459878] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations [ 1.459878] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations [ 1.459878] audit: initializing netlink subsys (disabled) [ 1.459887] audit: type=2000 audit(1726180479.235:1): state=initialized audit_enabled=0 res=1 [ 1.459948] thermal_sys: Registered thermal governor 'fair_share' [ 1.459949] thermal_sys: Registered thermal governor 'step_wise' [ 1.459949] thermal_sys: Registered thermal governor 'user_space' [ 1.460881] cpuidle: using governor menu [ 1.461897] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it [ 1.461899] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 1.461954] PCI: ECAM [mem 0x80000000-0x8fffffff] (base 0x80000000) for domain 0000 [bus 00-ff] [ 1.461966] PCI: Using configuration type 1 for base access [ 1.465907] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. [ 1.465910] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages [ 1.465910] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page [ 1.465910] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages [ 1.465910] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page [ 1.466915] cryptd: max_cpu_qlen set to 1000 [ 1.466971] ACPI: Added _OSI(Module Device) [ 1.466973] ACPI: Added _OSI(Processor Device) [ 1.466973] ACPI: Added _OSI(3.0 _SCP Extensions) [ 1.466974] ACPI: Added _OSI(Processor Aggregator Device) [ 1.466975] ACPI: Added _OSI(Linux-Dell-Video) [ 1.466976] ACPI: Added _OSI(Linux-Lenovo-NV-HDMI-Audio) [ 1.466977] ACPI: Added _OSI(Linux-HPI-Hybrid-Graphics) [ 1.471878] ACPI: 4 ACPI AML tables successfully acquired and loaded [ 1.472878] ACPI: [Firmware Bug]: BIOS _OSI(Linux) query ignored [ 1.472878] ACPI: Dynamic OEM Table Load: [ 1.482878] ACPI: _OSC evaluated successfully for all CPUs [ 1.482878] ACPI: Interpreter enabled [ 1.482878] ACPI: PM: (supports S0 S4 S5) [ 1.482878] ACPI: Using IOAPIC for interrupt routing [ 1.483413] HEST: Enabling Firmware First mode for corrected errors. [ 1.489878] HEST: Table parsing has been initialized. [ 1.489878] GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC. [ 1.489878] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 1.489878] PCI: Using E820 reservations for host bridge windows [ 1.489878] ACPI: Enabled 5 GPEs in block 00 to 3F [ 1.494878] ACPI: PCI Root Bridge [UNC0] (domain 0000 [bus ff]) [ 1.494878] acpi PNP0A03:03: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 1.494878] acpi PNP0A03:03: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 1.494956] acpi PNP0A03:03: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 1.494957] acpi PNP0A03:03: FADT indicates ASPM is unsupported, using BIOS configuration [ 1.494985] PCI host bridge to bus 0000:ff [ 1.494986] pci_bus 0000:ff: root bus resource [bus ff] [ 1.494997] pci 0000:ff:0b.0: [8086:6f81] type 00 class 0x088000 conventional PCI endpoint [ 1.495041] pci 0000:ff:0b.1: [8086:6f36] type 00 class 0x110100 conventional PCI endpoint [ 1.495072] pci 0000:ff:0b.2: [8086:6f37] type 00 class 0x110100 conventional PCI endpoint [ 1.495102] pci 0000:ff:0b.3: [8086:6f76] type 00 class 0x088000 conventional PCI endpoint [ 1.495133] pci 0000:ff:0c.0: [8086:6fe0] type 00 class 0x088000 conventional PCI endpoint [ 1.495164] pci 0000:ff:0c.1: [8086:6fe1] type 00 class 0x088000 conventional PCI endpoint [ 1.495193] pci 0000:ff:0c.2: [8086:6fe2] type 00 class 0x088000 conventional PCI endpoint [ 1.495222] pci 0000:ff:0c.3: [8086:6fe3] type 00 class 0x088000 conventional PCI endpoint [ 1.495253] pci 0000:ff:0f.0: [8086:6ff8] type 00 class 0x088000 conventional PCI endpoint [ 1.495282] pci 0000:ff:0f.1: [8086:6ff9] type 00 class 0x088000 conventional PCI endpoint [ 1.495312] pci 0000:ff:0f.4: [8086:6ffc] type 00 class 0x088000 conventional PCI endpoint [ 1.495342] pci 0000:ff:0f.5: [8086:6ffd] type 00 class 0x088000 conventional PCI endpoint [ 1.495372] pci 0000:ff:0f.6: [8086:6ffe] type 00 class 0x088000 conventional PCI endpoint [ 1.495402] pci 0000:ff:10.0: [8086:6f1d] type 00 class 0x088000 conventional PCI endpoint [ 1.495431] pci 0000:ff:10.1: [8086:6f34] type 00 class 0x110100 conventional PCI endpoint [ 1.495462] pci 0000:ff:10.5: [8086:6f1e] type 00 class 0x088000 conventional PCI endpoint [ 1.495491] pci 0000:ff:10.6: [8086:6f7d] type 00 class 0x110100 conventional PCI endpoint [ 1.495519] pci 0000:ff:10.7: [8086:6f1f] type 00 class 0x088000 conventional PCI endpoint [ 1.495549] pci 0000:ff:12.0: [8086:6fa0] type 00 class 0x088000 conventional PCI endpoint [ 1.495571] pci 0000:ff:12.1: [8086:6f30] type 00 class 0x110100 conventional PCI endpoint [ 1.495607] pci 0000:ff:13.0: [8086:6fa8] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.495666] pci 0000:ff:13.1: [8086:6f71] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.495708] pci 0000:ff:13.2: [8086:6faa] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.495751] pci 0000:ff:13.3: [8086:6fab] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.495793] pci 0000:ff:13.4: [8086:6fac] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.495835] pci 0000:ff:13.5: [8086:6fad] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.495875] pci 0000:ff:13.6: [8086:6fae] type 00 class 0x088000 conventional PCI endpoint [ 1.495878] pci 0000:ff:13.7: [8086:6faf] type 00 class 0x088000 conventional PCI endpoint [ 1.495878] pci 0000:ff:14.0: [8086:6fb0] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.495878] pci 0000:ff:14.1: [8086:6fb1] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.495878] pci 0000:ff:14.2: [8086:6fb2] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.495878] pci 0000:ff:14.3: [8086:6fb3] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.495878] pci 0000:ff:14.4: [8086:6fbc] type 00 class 0x088000 conventional PCI endpoint [ 1.495878] pci 0000:ff:14.5: [8086:6fbd] type 00 class 0x088000 conventional PCI endpoint [ 1.495878] pci 0000:ff:14.6: [8086:6fbe] type 00 class 0x088000 conventional PCI endpoint [ 1.495878] pci 0000:ff:14.7: [8086:6fbf] type 00 class 0x088000 conventional PCI endpoint [ 1.495878] pci 0000:ff:15.0: [8086:6fb4] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.495878] pci 0000:ff:15.1: [8086:6fb5] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.495878] pci 0000:ff:15.2: [8086:6fb6] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.495878] pci 0000:ff:15.3: [8086:6fb7] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.495878] pci 0000:ff:16.0: [8086:6f68] type 00 class 0x088000 conventional PCI endpoint [ 1.495878] pci 0000:ff:16.6: [8086:6f6e] type 00 class 0x088000 conventional PCI endpoint [ 1.495878] pci 0000:ff:16.7: [8086:6f6f] type 00 class 0x088000 conventional PCI endpoint [ 1.495878] pci 0000:ff:17.0: [8086:6fd0] type 00 class 0x088000 conventional PCI endpoint [ 1.495878] pci 0000:ff:17.4: [8086:6fb8] type 00 class 0x088000 conventional PCI endpoint [ 1.495878] pci 0000:ff:17.5: [8086:6fb9] type 00 class 0x088000 conventional PCI endpoint [ 1.495878] pci 0000:ff:17.6: [8086:6fba] type 00 class 0x088000 conventional PCI endpoint [ 1.495878] pci 0000:ff:17.7: [8086:6fbb] type 00 class 0x088000 conventional PCI endpoint [ 1.495878] pci 0000:ff:1e.0: [8086:6f98] type 00 class 0x088000 conventional PCI endpoint [ 1.495878] pci 0000:ff:1e.1: [8086:6f99] type 00 class 0x088000 conventional PCI endpoint [ 1.495878] pci 0000:ff:1e.2: [8086:6f9a] type 00 class 0x088000 conventional PCI endpoint [ 1.495878] pci 0000:ff:1e.3: [8086:6fc0] type 00 class 0x088000 conventional PCI endpoint [ 1.495878] pci 0000:ff:1e.4: [8086:6f9c] type 00 class 0x088000 conventional PCI endpoint [ 1.495878] pci 0000:ff:1f.0: [8086:6f88] type 00 class 0x088000 conventional PCI endpoint [ 1.495878] pci 0000:ff:1f.2: [8086:6f8a] type 00 class 0x088000 conventional PCI endpoint [ 1.495878] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-fe]) [ 1.495878] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 1.495878] acpi PNP0A08:00: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 1.495878] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 1.495878] acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration [ 1.495878] PCI host bridge to bus 0000:00 [ 1.495878] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 1.495878] pci_bus 0000:00: root bus resource [io 0x1000-0xffff window] [ 1.495878] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 1.495878] pci_bus 0000:00: root bus resource [mem 0xfedb0000-0xfedb000f window] [ 1.495878] pci_bus 0000:00: root bus resource [mem 0xfedc0000-0xfedc000f window] [ 1.495878] pci_bus 0000:00: root bus resource [mem 0x90000000-0xfbffbfff window] [ 1.495878] pci_bus 0000:00: root bus resource [bus 00-fe] [ 1.495878] pci 0000:00:00.0: [8086:6f00] type 00 class 0x060000 PCIe Root Port [ 1.495878] pci 0000:00:01.0: [8086:6f02] type 01 class 0x060400 PCIe Root Port [ 1.495878] pci 0000:00:01.0: PCI bridge to [bus 01] [ 1.495878] pci 0000:00:01.0: PME# supported from D0 D3hot D3cold [ 1.495878] pci 0000:00:02.0: [8086:6f04] type 01 class 0x060400 PCIe Root Port [ 1.495878] pci 0000:00:02.0: PCI bridge to [bus 02] [ 1.495878] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 1.495878] pci 0000:00:02.0: PME# supported from D0 D3hot D3cold [ 1.495878] pci 0000:00:03.0: [8086:6f08] type 01 class 0x060400 PCIe Root Port [ 1.495878] pci 0000:00:03.0: PCI bridge to [bus 03] [ 1.495878] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 1.495878] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 1.495878] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 1.495878] pci 0000:00:03.0: PME# supported from D0 D3hot D3cold [ 1.495878] pci 0000:00:04.0: [8086:6f20] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.495878] pci 0000:00:04.0: BAR 0 [mem 0xfb42c000-0xfb42ffff 64bit] [ 1.495878] pci 0000:00:04.1: [8086:6f21] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.495878] pci 0000:00:04.1: BAR 0 [mem 0xfb428000-0xfb42bfff 64bit] [ 1.495878] pci 0000:00:04.2: [8086:6f22] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.495878] pci 0000:00:04.2: BAR 0 [mem 0xfb424000-0xfb427fff 64bit] [ 1.495878] pci 0000:00:04.3: [8086:6f23] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.495878] pci 0000:00:04.3: BAR 0 [mem 0xfb420000-0xfb423fff 64bit] [ 1.495878] pci 0000:00:04.4: [8086:6f24] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.495878] pci 0000:00:04.4: BAR 0 [mem 0xfb41c000-0xfb41ffff 64bit] [ 1.495878] pci 0000:00:04.5: [8086:6f25] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.495878] pci 0000:00:04.5: BAR 0 [mem 0xfb418000-0xfb41bfff 64bit] [ 1.495936] pci 0000:00:04.6: [8086:6f26] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.495943] pci 0000:00:04.6: BAR 0 [mem 0xfb414000-0xfb417fff 64bit] [ 1.496018] pci 0000:00:04.7: [8086:6f27] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.496025] pci 0000:00:04.7: BAR 0 [mem 0xfb410000-0xfb413fff 64bit] [ 1.496099] pci 0000:00:05.0: [8086:6f28] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.496160] pci 0000:00:05.1: [8086:6f29] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.496248] pci 0000:00:05.2: [8086:6f2a] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.496305] pci 0000:00:05.4: [8086:6f2c] type 00 class 0x080020 PCIe Root Complex Integrated Endpoint [ 1.496310] pci 0000:00:05.4: BAR 0 [mem 0xfb439000-0xfb439fff] [ 1.496394] pci 0000:00:11.0: [8086:8d7c] type 00 class 0xff0000 PCIe Root Complex Integrated Endpoint [ 1.496634] pci 0000:00:11.4: [8086:8d62] type 00 class 0x010601 conventional PCI endpoint [ 1.496655] pci 0000:00:11.4: BAR 0 [io 0xf110-0xf117] [ 1.496665] pci 0000:00:11.4: BAR 1 [io 0xf100-0xf103] [ 1.496676] pci 0000:00:11.4: BAR 2 [io 0xf0f0-0xf0f7] [ 1.496688] pci 0000:00:11.4: BAR 3 [io 0xf0e0-0xf0e3] [ 1.496699] pci 0000:00:11.4: BAR 4 [io 0xf020-0xf03f] [ 1.496710] pci 0000:00:11.4: BAR 5 [mem 0xfb438000-0xfb4387ff] [ 1.496769] pci 0000:00:11.4: PME# supported from D3hot [ 1.496848] pci 0000:00:14.0: [8086:8d31] type 00 class 0x0c0330 conventional PCI endpoint [ 1.496872] pci 0000:00:14.0: BAR 0 [mem 0xfb400000-0xfb40ffff 64bit] [ 1.496878] pci 0000:00:14.0: PME# supported from D3hot D3cold [ 1.496878] pci 0000:00:16.0: [8086:8d3a] type 00 class 0x078000 conventional PCI endpoint [ 1.496878] pci 0000:00:16.0: BAR 0 [mem 0xfb437000-0xfb43700f 64bit] [ 1.496878] pci 0000:00:16.0: PME# supported from D0 D3hot D3cold [ 1.496878] pci 0000:00:16.1: [8086:8d3b] type 00 class 0x078000 conventional PCI endpoint [ 1.496878] pci 0000:00:16.1: BAR 0 [mem 0xfb436000-0xfb43600f 64bit] [ 1.496878] pci 0000:00:16.1: PME# supported from D0 D3hot D3cold [ 1.496878] pci 0000:00:1a.0: [8086:8d2d] type 00 class 0x0c0320 conventional PCI endpoint [ 1.496878] pci 0000:00:1a.0: BAR 0 [mem 0xfb434000-0xfb4343ff] [ 1.496878] pci 0000:00:1a.0: PME# supported from D0 D3hot D3cold [ 1.496878] pci 0000:00:1c.0: [8086:8d10] type 01 class 0x060400 PCIe Root Port [ 1.496878] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 1.496878] pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold [ 1.496878] pci 0000:00:1c.2: [8086:8d14] type 01 class 0x060400 PCIe Root Port [ 1.496878] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 1.496878] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 1.496878] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.496878] pci 0000:00:1c.2: PME# supported from D0 D3hot D3cold [ 1.496878] pci 0000:00:1c.4: [8086:8d18] type 01 class 0x060400 PCIe Root Port [ 1.496878] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 1.496878] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 1.496878] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 1.496878] pci 0000:00:1c.4: PME# supported from D0 D3hot D3cold [ 1.496878] pci 0000:00:1d.0: [8086:8d26] type 00 class 0x0c0320 conventional PCI endpoint [ 1.496878] pci 0000:00:1d.0: BAR 0 [mem 0xfb433000-0xfb4333ff] [ 1.496878] pci 0000:00:1d.0: PME# supported from D0 D3hot D3cold [ 1.496878] pci 0000:00:1f.0: [8086:8d44] type 00 class 0x060100 conventional PCI endpoint [ 1.496878] pci 0000:00:1f.2: [8086:8d02] type 00 class 0x010601 conventional PCI endpoint [ 1.496878] pci 0000:00:1f.2: BAR 0 [io 0xf070-0xf077] [ 1.496878] pci 0000:00:1f.2: BAR 1 [io 0xf060-0xf063] [ 1.496878] pci 0000:00:1f.2: BAR 2 [io 0xf050-0xf057] [ 1.496878] pci 0000:00:1f.2: BAR 3 [io 0xf040-0xf043] [ 1.496878] pci 0000:00:1f.2: BAR 4 [io 0xf000-0xf01f] [ 1.496878] pci 0000:00:1f.2: BAR 5 [mem 0xfb432000-0xfb4327ff] [ 1.496878] pci 0000:00:1f.2: PME# supported from D3hot [ 1.496878] pci 0000:00:1f.3: [8086:8d22] type 00 class 0x0c0500 conventional PCI endpoint [ 1.496878] pci 0000:00:1f.3: BAR 0 [mem 0xfb431000-0xfb4310ff 64bit] [ 1.496878] pci 0000:00:1f.3: BAR 4 [io 0x0580-0x059f] [ 1.496878] acpiphp: Slot [1] registered [ 1.496878] pci 0000:00:01.0: PCI bridge to [bus 01] [ 1.496878] pci 0000:02:00.0: [8086:0953] type 00 class 0x010802 PCIe Endpoint [ 1.496878] pci 0000:02:00.0: BAR 0 [mem 0xfb310000-0xfb313fff 64bit] [ 1.496878] pci 0000:02:00.0: ROM [mem 0xfb300000-0xfb30ffff pref] [ 1.496878] pci 0000:02:00.0: enabling Extended Tags [ 1.496878] pci 0000:00:02.0: PCI bridge to [bus 02] [ 1.496878] pci 0000:03:00.0: [8086:10fb] type 00 class 0x020000 PCIe Endpoint [ 1.496878] pci 0000:03:00.0: BAR 0 [mem 0xfbd80000-0xfbdfffff 64bit pref] [ 1.496878] pci 0000:03:00.0: BAR 2 [io 0xe020-0xe03f] [ 1.496878] pci 0000:03:00.0: BAR 4 [mem 0xfbe04000-0xfbe07fff 64bit pref] [ 1.496878] pci 0000:03:00.0: ROM [mem 0xfb280000-0xfb2fffff pref] [ 1.496878] pci 0000:03:00.0: PME# supported from D0 D3hot D3cold [ 1.496878] pci 0000:03:00.0: VF BAR 0 [mem 0x00000000-0x00003fff 64bit pref] [ 1.496878] pci 0000:03:00.0: VF BAR 0 [mem 0x00000000-0x000fffff 64bit pref]: contains BAR 0 for 64 VFs [ 1.496878] pci 0000:03:00.0: VF BAR 3 [mem 0x00000000-0x00003fff 64bit pref] [ 1.496878] pci 0000:03:00.0: VF BAR 3 [mem 0x00000000-0x000fffff 64bit pref]: contains BAR 3 for 64 VFs [ 1.496878] pci 0000:03:00.1: [8086:10fb] type 00 class 0x020000 PCIe Endpoint [ 1.496878] pci 0000:03:00.1: BAR 0 [mem 0xfbd00000-0xfbd7ffff 64bit pref] [ 1.496878] pci 0000:03:00.1: BAR 2 [io 0xe000-0xe01f] [ 1.496878] pci 0000:03:00.1: BAR 4 [mem 0xfbe00000-0xfbe03fff 64bit pref] [ 1.496878] pci 0000:03:00.1: ROM [mem 0xfb200000-0xfb27ffff pref] [ 1.496878] pci 0000:03:00.1: PME# supported from D0 D3hot D3cold [ 1.496878] pci 0000:03:00.1: VF BAR 0 [mem 0x00000000-0x00003fff 64bit pref] [ 1.496878] pci 0000:03:00.1: VF BAR 0 [mem 0x00000000-0x000fffff 64bit pref]: contains BAR 0 for 64 VFs [ 1.496878] pci 0000:03:00.1: VF BAR 3 [mem 0x00000000-0x00003fff 64bit pref] [ 1.496878] pci 0000:03:00.1: VF BAR 3 [mem 0x00000000-0x000fffff 64bit pref]: contains BAR 3 for 64 VFs [ 1.496878] pci 0000:00:03.0: PCI bridge to [bus 03] [ 1.496878] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 1.496878] pci 0000:05:00.0: [1a03:1150] type 01 class 0x060400 PCIe to PCI/PCI-X bridge [ 1.496878] pci 0000:05:00.0: PCI bridge to [bus 06] [ 1.496878] pci 0000:05:00.0: 0xdfff] [ 1. window [mem 0xfa000000-0xfb0fffff] [ 1.496878] pci 0000:05:00.0: enabling Extended Tags [ 1.496878] pci 0000:05:00.0: supports D1 D2 [ 1.496878] pci 0000:05:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 1.496958] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 1.497040] pci_bus 0000:06: extended config space not accessible [ 1.497073] pci 0000:06:00.0: [1a03:2000] type 00 class 0x030000 conventional PCI endpoint [ 1.497110] pci 0000:06:00.0: BAR 0 [mem 0xfa000000-0xfaffffff] [ 1.497113] pci 0000:06:00.0: BAR 1 [mem 0xfb000000-0xfb01ffff] [ 1.497113] pci 0000:06:00.0: BAR 2 [io 0xd000-0xd07f] [ 1.497113] pci 0000:06:00.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] [ 1.497113] pci 0000:06:00.0: supports D1 D2 [ 1.497113] pci 0000:06:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 1.498013] pci 0000:05: 06] [ 1.4981521] type 00 cl.498201] pci 0000:07:00.0: BAR 0 [mem 0xfb120000-0xfb13ffff] [ 1.498238] pci 0000:07:00.0: BAR 2 [io 0xc020-0xc03f] [ 1.498256] pci 0000:07:00.0: BAR 3 [mem 0xfb144000-0xfb147fff] [ 1.498494] pci 0000:07:00.0: PME# supported from D0 D3hot D3cold [ 1.498526] pci 0000:07:00.0: VF BAR 0 [mem 0x00000000-0x00003fff 64bit pref] [ 1.498526] pci 0000:07:00.0: VF BAR 0 [mem 0x00000000-0x0001ffff 64bit pref]: contains BAR 0 for 8 VFs [ 1.498526] pci 0000:07:00.0: VF BAR 3 [mem 0x00000000-0x00003fff 64bit pref] [ 1.498526] pci 0000:07:00.0: VF BAR 3 [mem 0x00000000-0x0001ffff 64bit pref]: contains BAR 3 for 8 VFs [ 1.498526] pci 0000:07:00.1: [8086:1521] type 00 class 0x020000 PCIe Endpoint [ 1.498526] pci 0000:07:00.1: BAR 0 [mem 0xfb100000-0xfb11ffff] [ 1.498526] pci 0000:07:00.1: BAR 2 [io 0xc000-0xc01f] [ 1.498526] pci 0000:07:00.1: BAR 3 [mem 0xfb140000-0xfb143fff] [ 1.498609] pci 0000:07:00.1: PME# supported from D0 D3hot D3cold [ 1.498671] pci 0000:07:00-0x00003fff 64bit pref] [ 1.498672] pci 0000:07:00.1: VF BAR 0 [mem 0x0000001ffff 64bit pref]: contains BAR 0 for 8 VFs [ 1.498705] pci 0000:07:00.1: VF BAR 3 [mem 0x00000000-0x00003fff 64bit pref] [ 1.498706] pci 0000:07:00.1: VF BAR 3 [mem 0x00000000-0x0001ffff 64bit pref]: contains BAR 3 for 8 VFs [ 1.499014] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 1.499026] pci 0000:00:1c.4: bridge has subordinate 07 but max busn 08 [ 1.499692] ACPI: PCI: Interrupt link LNKA configured for IRQ 11 [ 1.499723] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 [ 1.499753] ACPI: PCI: Interrupt link LNKC configured for IRQ 5 [ 1.499783] APCI: Interrupt link LNKD configured for IRQ 11 [ 1.499813] ACPI: PCI: Interrupt link LNKE configured for IRQ 0 [ 1.499814] ACPI: PCI: Interrupt link LNKE disabled [ 1.499843] ACPI: PCI: Interrupt link LNKF configured for IRQ 0 [ 1.499844] ACPI: PCI: Interrupt link LNKF disabled [ 1.499873] ACPI: PCI: Interrupt link LNKG configured for IRQ 0 [ 1.499874] ACPI: PCI: Interrupt link LNKG disabled [ 1.499904] ACPI: PCI: Interrupt link LNKH configured for IRQ 0 [ 1.499905] ACPI: PCI: Interrupt link LNKH disabled [ 1.500892] iommu: Default domain type: Translated [ 1.500892] iommu: DMA domain TLB invalidation policy: lazy mode [ 1.500958] SCSI subsystem initialized [ 1.500973] ACPI: bus type USB registered [ 1.500987] usbcore: registered new interface driver usbfs [ 1.500992] usbcore: registered new interface driver hub [ 1.500996] usbcore: registered new device driver usb [ 1.501016] pps_core: LinuxPPS API ver. 1 registered [ 1.501017] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti [ 1.501019] PTP clock support registered [ 1.501032] EDAC MC: Ver: 3.0.0 [ 1.501038] NetLabel: Initializing [ 1.501039] NetLabel: domain hash size = 128 [ 1.501040] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO [ 1.501053] NetLabel: unlabeled traffic allowed by default [ 1.501053] PCI: Using ACPI for IRQ routing [ 1.511906] pci 0000:06:00.0: vgaarb: setting as boot VGA device [ 1.511906] pci 0000:06:00.0: vgaarb: bridge control possible [ 1.511906] pci 0000:06:00.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none [ 1.511906] vgaarb: loaded [ 1.511909] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0 [ 1.511914] hpet0: 8 comparators, 64-bit 14.318180 MHz counter [ 1.519236] clocksource: Switched to clocksource tsc-early [ 1.527951] VFS: Disk quotas dquot_6.6.0 [ 1.527960] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 1.528008] pnp: PnP ACPI init [ 1.528325] system 00:01: [io 0x0500-0x057f] has been reserved [ 1.528328] system 00:01: [io 0x0400-0x047f] has been reserved [ 1.528330] system 00:01: [io 0x0580-0x059f] has been reserved [ 1.528331] system 00:01: [io 0x0600-0x061f] has been reserved [ 1.528331] system 00:01: [io 0x0880-0x0883] has been reserved [ 1.528332] system 00:01: [io 0x0800-0x081f] has been reserved [ 1.528334] system 00:01: [mem 0xfed1c000-0xfed3ffff] has been reserved [ 1.528335] system 00:01: [mem 0xfed45000-0xfed8bfff] has been reserved [ 1.528336] system 00:01: [mem 0xff000000-0xffffffff] has been reserved [ 1.528337] system 00:01: [mem 0xfee00000-0xfeefffff] has been reserved [ 1.528338] system 00:01: [mem 0xfed12000-0xfed1200f] has been reserved [ 1.528339] system 00:01: [mem 0xfed12010-0xfed1201f] has been reserved [ 1.528340] system 00:01: [mem 0xfed1b000-0xfed1bfff] has been reserved [ 1.528487] system 00:02: [io 0x0a00-0x0a0f] has been reserved [ 1.528489] system 00:02: [io 0x0a10-0x0a1f] has been reserved [ 1.528490] system 00:02: [io 0x0a20-0x0a2f] has been reserved [ 1.528491] system 00:02: [io 0x0a30-0x0a3f] has been reserved [ 1.528492] system 00:02: [io 0x0a40-0x0a4f] has been reserved [ 1.529160] pnp: PnP ACPI: found 5 devices [ 1.534655] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns [ 1.534704] NET: Registered PF_INET protocol family [ 1.534867] IP idents hash table entries: 262144 (order: 9, 2097152 bytes, linear) [ 1.537130] tcp_listen_portaddr_hash hash table entries: 16384 (order: 6, 262144 bytes, linear) [ 1.537159] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) [ 1.537169] TCP established hash table entries: 262144 (order: 9, 2097152 bytes, linear) [ 1.537381] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes, linear) [ 1.537489] TCP: Hash tables configured (established 262144 bind 65536) [ 1.537616] MPTCP token hash table entries: 32768 (order: 7, 786432 bytes, linear) [ 1.537708] UDP hash table entries: 16384 (order: 7, 524288 bytes, linear) [ 1.537762] UDP-Lite hash table entries: 16384 (order: 7, 524288 bytes, linear) [ 1.537845] NET: Registered PF_UNIX/PF_LOCAL protocol family [ 1.537849] NET: Registered PF_XDP protocol family [ 1.537869] pci 0000:00:1c.4: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 07] add_size 100000 add_align 100000 [ 1.537880] pci 0000:00:1c.4: bridge window [mem 0x90000000-0x900fffff 64bit pref]: assigned [ 1.537882] pci 0000:00:01.0: PCI bridge to [bus 01] [ 1.537887] pci 0000:00:02.0: PCI bridge to [bus 02] [ 1.537889] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 1.537894] pci 0000:03:00.0: VF BAR 0 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.537896] pci 0000:03:00.0: VF BAR 0 [mem size 0x00100000 64bit pref]: failed to assign [ 1.537897] pci 0000:03:00.0: VF BAR 3 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.537898] pci 0000:03:00.0: VF BAR 3 [mem size 0x00100000 64bit pref]: failed to assign [ 1.537899] pci 0000:03:00.1: VF BAR 0 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.537900] pci 0000:03:00.1: VF BAR 0 [mem size 0x00100000 64bit pref]: failed to assign [ 1.537902] pci 0000:03:00.1: VF BAR 3 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.537902] pci 0000:03:00.1: VF BAR 3 [mem size 0x00100000 64bit pref]: failed to assign [ 1.537904] pci 0000:03:00.0: VF BAR 0 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.537905] pci 0000:03:00.0: VF BAR 0 [mem size 0x00100000 64bit pref]: failed to assign [ 1.537906] pci 0000:03:00.0: VF BAR 3 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.537907] pci 0000:03:00.0: VF BAR 3 [mem size 0x00100000 64bit pref]: failed to assign [ 1.537908] pci 0000:03:00.1: VF BAR 0 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.537909] pci 0000:03:00.1: VF BAR 0 [mem size 0x00100000 64bit pref]: failed to assign [ 1.537910] pci 0000:03:00.1: VF BAR 3 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.537911] pci 0000:03:00.1: VF BAR 3 [mem size 0x00100000 64bit pref]: failed to assign [ 1.537912] pci 0000:00:03.0: PCI bridge to [bus 03] [ 1.537913] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 1.537915] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 1.537917] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 1.537920] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 1.537933] pci 0000:05:00.0: PCI bridge to [bus 06] [ 1.537935] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 1.537943] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.537959] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 1.537961] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 1.537967] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.537977] pci 0000:07:00.0: VF BAR 0 [mem 0x90000000-0x9001ffff 64bit pref]: assigned [ 1.537985] pci 0000:07:00.0: VF BAR 3 [mem 0x90020000-0x9003ffff 64bit pref]: assigned [ 1.537991] pci 0000:07:00.1: VF BAR 0 [mem 0x90040000-0x9005ffff 64bit pref]: assigned [ 1.537997] pci 0000:07:00.1: VF BAR 3 [mem 0x90060000-0x9007ffff 64bit pref]: assigned [ 1.538004] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 1.538006] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 1.538011] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 1.538014] pci 0000:00:1c.4: bridge window [mem 0x90000000-0x900fffff 64bit pref] [ 1.538020] pci_bus 0000:00: Some PCI device resources are unassigned, try booting with pci=realloc [ 1.538021] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [ 1.538022] pci_bus 0000:00: resource 5 [io 0x1000-0xffff window] [ 1.538023] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [ 1.538024] pci_bus 0000:00: resource 7 [mem 0xfedb0000-0xfedb000f window] [ 1.538025] pci_bus 0000:00: resource 8 [mem 0xfedc0000-0xfedc000f window] [ 1.538026] pci_bus 0000:00: resource 9 [mem 0x90000000-0xfbffbfff window] [ 1.538027] pci_bus 0000:02: resource 1 [mem 0xfb300000-0xfb3fffff] [ 1.538028] pci_bus 0000:03: resource 0 [io 0xe000-0xefff] [ 1.538028] pci_bus 0000:03: resource 1 [mem 0xfb200000-0xfb2fffff] [ 1.538029] pci_bus 0000:03: resource 2 [mem 0xfbd00000-0xfbefffff 64bit pref] [ 1.538030] pci_bus 0000:05: resource 0 [io 0xd000-0xdfff] [ 1.538031] pci_bus 0000:05: resource 1 [mem 0xfa000000-0xfb0fffff] [ 1.538032] pci_bus 0000:06: resource 0 [io 0xd000-0xdfff] [ 1.538033] pci_bus 0000:06: resource 1 [mem 0xfa000000-0xfb0fffff] [ 1.538034] pci_bus 0000:07: resource 0 [io 0xc000-0xcfff] [ 1.538034] pci_bus 0000:07: resource 1 [mem 0xfb100000-0xfb1fffff] [ 1.538035] pci_bus 0000:07: resource 2 [mem 0x90000000-0x900fffff 64bit pref] [ 1.538194] pci 0000:00:05.0: disabled boot interrupts on device [8086:6f28] [ 1.555709] pci 0000:00:1a.0: quirk_usb_early_handoff+0x0/0x140 took 16936 usecs [ 1.567704] pci 0000:00:1d.0: quirk_usb_early_handoff+0x0/0x140 took 11699 usecs [ 1.567718] pci 0000:02:00.0: CLS mismatch (64 != 32), using 64 bytes [ 1.567752] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 1.567752] software IO TLB: mapped [mem 0x0000000064000000-0x0000000068000000] (64MB) [ 1.567762] Trying to unpack rootfs image as initramfs... [ 1.567765] ACPI: bus type thunderbolt registered [ 1.775452] Initialise system trusted keyrings [ 1.775462] Key type blacklist registered [ 1.775511] workingset: timestamp_bits=36 max_order=23 bucket_order=0 [ 1.775524] zbud: loaded [ 1.884787] Freeing initrd memory: 31720K [ 1.899048] integrity: Platform Keyring initialized [ 1.899052] integrity: Machine keyring initialized [ 1.907120] NET: Registered PF_ALG protocol family [ 1.907122] xor: automatically using best checksumming function avx [ 1.907124] Key type asymmetric registered [ 1.907125] Asymmetric key parser 'x509' registered [ 1.907125] Running certificate verification selftests [ 1.909276] Loaded X.509 cert 'Certificate verification self-testing key: f58703bb33ce1b73ee02eccdee5b8817518fe3db' [ 1.909750] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 246) [ 1.909777] io scheduler mq-deadline registered [ 1.909778] io scheduler kyber registered [ 1.909783] io scheduler bfq registered [ 1.968156] atomic64_test: passed for x86-64 platform with CX8 and with SSE [ 1.968470] pcieport 0000:00:01.0: PME: Signaling with IRQ 25 [ 1.968630] pcieport 0000:00:02.0: PME: Signaling with IRQ 27 [ 1.968785] pcieport 0000:00:03.0: PME: Signaling with IRQ 29 [ 1.968920] pcieport 0000:00:1c.0: PME: Signaling with IRQ 30 [ 1.969075] pcieport 0000:00:1c.2: PME: Signaling with IRQ 31 [ 1.969223] pcieport 0000:00:1c.4: PME: Signaling with IRQ 32 [ 1.969381] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 [ 1.976400] ACPI: \_SB_.SCK0.CP00: Found 2 idle states [ 2.001446] input: Power Button as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C0C:00/input/input0 [ 2.001468] ACPI: button: Power Button [PWRB] [ 2.001491] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input1 [ 2.001527] ACPI: button: Power Button [PWRF] [ 2.289792] ERST: Error Record Serialization Table (ERST) support is initialized. [ 2.289794] pstore: Registered erst as persistent store backend [ 2.289878] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled [ 2.289980] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A [ 2.295598] 00:04: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A [ 2.305271] Non-volatile memory driver v1.3 [ 2.311639] rdac: device handler registered [ 2.311668] hp_sw: device handler registered [ 2.311670] emc: device handler registered [ 2.311686] alua: device handler registered [ 2.312034] ehci-pci 0000:00:1d.0: EHCI Host Controller [ 2.312067] ehci-pci 0000:00:1d.0: new USB bus registered, assigned bus number 1 [ 2.312080] ehci-pci 0000:00:1d.0: debug port 2 [ 2.316007] ehci-pci 0000:00:1d.0: irq 18, io mem 0xfb433000 [ 2.324710] ehci-pci 0000:00:1d.0: USB 2.0 started, EHCI 1.00 [ 2.324750] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.14 [ 2.324752] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 2.324753] usb usb1: Product: EHCI Host Controller [ 2.324754] usb usb1: Manufacturer: Linux 5.14.0-505.el9.x86_64 ehci_hcd [ 2.324755] usb usb1: SerialNumber: 0000:00:1d.0 [ 2.324843] hub 1-0:1.0: USB hub found [ 2.324847] hub 1-0:1.0: 2 ports detected [ 2.324954] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 2.324985] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 2 [ 2.326071] xhci_hcd 0000:00:14.0: hcc params 0x200077c1 hci version 0x100 quirks 0x0000000000009810 [ 2.326319] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 2.326320] ehci-pci 0000:00:1a.0: EHCI Host Controller [ 2.326367] ehci-pci 0000:00:1a.0: new USB bus registered, assigned bus number 4 [ 2.326369] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 3 [ 2.326371] xhci_hcd 0000:00:14.0: Host supports USB 3.0 SuperSpeed [ 2.326386] ehci-pci 0000:00:1a.0: debug port 2 [ 2.326401] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.14 [ 2.326403] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 2.326404] usb usb2: Product: xHCI Host Controller [ 2.326405] usb usb2: Manufacturer: Linux 5.14.0-505.el9.x86_64 xhci-hcd [ 2.326405] usb usb2: SerialNumber: 0000:00:14.0 [ 2.326491] hub 2-0:1.0: USB hub found [ 2.326523] hub 2-0:1.0: 15 ports detected [ 2.328278] usb usb3: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 5.14 [ 2.328280] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 2.328281] usb usb3: Product: xHCI Host Controller [ 2.328282] usb usb3: Manufacturer: Linux 5.14.0-505.el9.x86_64 xhci-hcd [ 2.328283] usb usb3: SerialNumber: 0000:00:14.0 [ 2.328369] hub 3-0:1.0: USB hub found [ 2.328386] hub 3-0:1.0: 6 ports detected [ 2.329325] usbcore: registered new interface driver usbserial_generic [ 2.329330] usbserial: USB Serial support registered for generic [ 2.329355] i8042: PNP: No PS/2 controller found. [ 2.329405] mousedev: PS/2 mouse device common for all mice [ 2.329460] rtc_cmos 00:00: RTC can wake from S4 [ 2.329776] rtc_cmos 00:00: registered as rtc0 [ 2.329830] rtc_cmos 00:00: setting system clock to 2024-09-12T22:34:42 UTC (1726180482) [ 2.329855] rtc_cmos 00:00: alarms up to one month, y3k, 114 bytes nvram [ 2.330288] ehci-pci 0000:00:1a.0: irq 18, io mem 0xfb434000 [ 2.337694] ehci-pci 0000:00:1a.0: USB 2.0 started, EHCI 1.00 [ 2.337728] usb usb4: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.14 [ 2.337729] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 2.337731] usb usb4: Product: EHCI Host Controller [ 2.337731] usb usb4: Manufacturer: Linux 5.14.0-505.el9.x86_64 ehci_hcd [ 2.337732] usb usb4: SerialNumber: 0000:00:1a.0 [ 2.337809] hub 4-0:1.0: USB hub found [ 2.337813] hub 4-0:1.0: 2 ports detected [ 2.358577] intel_pstate: Intel P-state driver initializing [ 2.435085] hid: raw HID events driver (C) Jiri Kosina [ 2.435117] usbcore: registered new interface driver usbhid [ 2.435118] usbhid: USB HID core driver [ 2.435137] drop_monitor: Initializing network drop monitor service [ 2.445533] Initializing XFRM netlink socket [ 2.445550] NET: Registered PF_INET6 protocol family [ 2.450677] Segment Routing with IPv6 [ 2.450693] NET: Registered PF_PACKET protocol family [ 2.450715] mpls_gso: MPLS GSO support [ 2.471370] microcode: Current revision: 0x0b00001b [ 2.497944] resctrl: L3 allocation detected [ 2.497945] resctrl: L3 monitoring detected [ 2.497962] IPI shorthand broadcast: enabled [ 2.497967] AVX2 version of gcm_enc/dec engaged. [ 2.532916] AES CTR mode by8 optimization enabled [ 2.532965] sched_clock: Marking stable (1360000494, 1172661842)->(3077252544, -544590208) [ 2.539107] registered taskstats version 1 [ 2.551583] Loading compiled-in X.509 certificates [ 2.552086] Loaded X.509 cert 'The CentOS Project: CentOS Stream kernel signing key: d7d2edb13bc4136035087569dd0b474add53ff98' [ 2.552351] Loaded X.509 cert 'Red Hat Enterprise Linux Driver Update Program (key 3): bf57f3e87362bc7229d9f465321773dfd1f77a80' [ 2.552612] Loaded X.509 cert 'Red Hat Enterprise Linux kpatch signing key: 4d38fd864ebe18c5f0b72e3852e2014c3a676fc8' [ 2.552775] Loaded X.509 cert 'RH-IMA-CA: Red Hat IMA CA: fb31825dd0e073685b264e3038963673f753959a' [ 2.552785] Loaded X.509 cert 'Nvidia GPU OOT signing 001: 55e1cef88193e60419f0b0ec379c49f77545acf0' [ 2.554507] page_owner is disabled [ 2.554726] pstore: Using crash dump compression: deflate [ 2.554735] Key type big_key registered [ 2.572078] Key type encrypted registered [ 2.572083] ima: No TPM chip found, activating TPM-bypass! [ 2.572085] Loading compiled-in module X.509 certificates [ 2.572368] Loaded X.509 cert 'The CentOS Project: CentOS Stream kernel signing key: d7d2edb13bc4136035087569dd0b474add53ff98' [ 2.572370] ima: Allocated hash algorithm: sha256 [ 2.572379] ima: No architecture policies found [ 2.572386] evm: Initialising EVM extended attributes: [ 2.572386] evm: security.selinux [ 2.572387] evm: security.SMACK64 (disabled) [ 2.572387] evm: security.SMACK64EXEC (disabled) [ 2.572388] evm: security.SMACK64TRANSMUTE (disabled) [ 2.572388] evm: security.SMACK64MMAP (disabled) [ 2.572388] evm: security.apparmor (disabled) [ 2.572389] evm: security.ima [ 2.572389] evm: security.capability [ 2.572390] evm: HMAC attrs: 0x1 [ 2.572668] usb 1-1: new high-speed USB device number 2 using ehci-pci [ 2.576206] usb 2-12: new high-speed USB device number 2 using xhci_hcd [ 2.578672] usb 4-1: new high-speed USB device number 2 using ehci-pci [ 2.600670] tsc: Refined TSC clocksource calibration: 3499.999 MHz [ 2.600674] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x32734f9ce42, max_idle_ns: 440795224466 ns [ 2.601336] clocksource: Switched to clocksource tsc [ 2.702071] usb 1-1: New USB device found, idVendor=8087, idProduct=8002, bcdDevice= 0.05 [ 2.702074] usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 2.702225] hub 1-1:1.0: USB hub found [ 2.702318] hub 1-1:1.0: 8 ports detected [ 2.707068] usb 4-1: New USB device found, idVendor=8087, idProduct=800a, bcdDevice= 0.05 [ 2.707070] usb 4-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 2.707222] hub 4-1:1.0: USB hub found [ 2.707319] hub 4-1:1.0: 6 ports detected [ 2.709262] usb 2-12: New USB device found, idVendor=0557, idProduct=7000, bcdDevice= 0.00 [ 2.709265] usb 2-12: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 2.709770] hub 2-12:1.0: USB hub found [ 2.709851] hub 2-12:1.0: 4 ports detected [ 3.004669] usb 2-12.1: new low-speed USB device number 3 using xhci_hcd [ 3.107978] usb 2-12.1: New USB device found, idVendor=0557, idProduct=2419, bcdDevice= 1.00 [ 3.107980] usb 2-12.1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 3.112876] input: HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb2/2-12/2-12.1/2-12.1:1.0/0003:0557:2419.0001/input/input2 [ 3.164822] hid-generic 0003:0557:2419.0001: input,hidraw0: USB HID v1.00 Keyboard [HID 0557:2419] on usb-0000:00:14.0-12.1/input0 [ 3.167384] input: HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb2/2-12/2-12.1/2-12.1:1.1/0003:0557:2419.0002/input/input3 [ 3.167472] hid-generic 0003:0557:2419.0002: input,hidraw1: USB HID v1.00 Mouse [HID 0557:2419] on usb-0000:00:14.0-12.1/input1 [ 5.057116] clk: Disabling unused clocks [ 5.061953] Freeing unused decrypted memory: 2028K [ 5.067162] Freeing unused kernel image (initmem) memory: 3980K [ 5.073078] Write protecting the kernel read-only data: 30720k [ 5.079230] Freeing unused kernel image (rodata/data gap) memory: 1364K [ 5.124289] x86/mm: Checked W+X mappings: passed, no W+X pages found. [ 5.124291] x86/mm: Checking user space page tables [ 5.161672] x86/mm: Checked W+X mappings: passed, no W+X pages found. [ 5.161681] Run /init as init process [ 5.174508] systemd[1]: systemd 252-45.el9 running in system mode (+PAM +AUDIT +SELINUX -APPARMOR +IMA +SMACK +SECCOMP +GCRYPT +GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 -IDN -IPTC +KMOD +LIBCRYPTSETUP +LIBFDISK +PCRE2 -PWQUALITY +P11KIT -QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD -BPF_FRAMEWORK +XKBCOMMON +UTMP +SYSVINIT default-hierarchy=unified) [ 5.174611] systemd[1]: Detected architecture x86-64. [ 5.174613] systemd[1]: Running in initrd. Welcome to CentOS Stream 9 dracut-057-70.git20240819.el9 (Initramfs)! [ 5.225783] systemd[1]: Hostname set to . [ 5.284631] systemd[1]: Queued start job for default target Initrd Default Target. [ 5.284769] systemd[1]: Reached target Initrd /usr File System. [ OK ] Reached target Initrd /usr File System. [ OK [[ 5.305767] systemd[1]: Reached target Local File Systems. 0m] Reached target Local File Systems. [ 5.319836] systemd[1]: Reached target Slice Units. [ OK ] Reached target Slice Units. [ OK [[ 5.331753] systemd[1]: Reached target Swaps. 0m] Reached target Swaps. [ 5.342727] systemd[1]: Reached target Timer Units. [ OK ] Reached target Timer Units. [ OK [[ 5.354787] systemd[1]: Listening on D-Bus System Message Bus Socket. 0m] Listening on D-Bus System Message Bus Socket. [ OK [[ 5.369979] systemd[1]: Listening on Journal Socket (/dev/log). 0m] Listening on Journal Socket (/dev/log). [ OK [[ 5.383985] systemd[1]: Listening on Journal Socket. 0m] Listening on Journal Socket. [ OK [[ 5.395803] systemd[1]: Listening on udev Control Socket. 0m] Listening on udev Control Socket. [ OK [[ 5.409805] systemd[1]: Listening on udev Kernel Socket. 0m] Listening on udev Kernel Socket. [ OK [[ 5.422726] systemd[1]: Reached target Socket Units. 0m] Reached target Socket Units. [ 5.441371] systemd[1]: Starting Create List of Static Device Nodes... Starting Create List of Static Device Nodes... [ 5.457057] systemd[1]: Starting Journal Service... Starting Journal Service... [ 5.469408] systemd[1]: Starting Load Kernel Modules... Starting Load Kernel Modules... [ 5.482305] systemd[1]: Starting Create System Users... Starting Creat[ 5.488921] fuse: init (API version 7.36) e System Users... [ 5.498323] systemd[1]: Starting Setup Virtual Console... Starting Setup Virtual Console... [ 5.511406] systemd[1]: Started Journal Service. [ OK ] Started Journal Service. [ OK ] Finished Create List of Static Device Nodes. [ OK ] Finished Load Kernel Modules. Starting Apply Kernel Variables... [ OK ] Finished Setup Virtual Console. [ OK ] Finished Apply Kernel Variables. Starting dracut cmdline hook... [ OK ] Finished Create System Users. Starting Create Static Device Nodes in /dev... Starting Create Volatile Files and Directories... [ OK ] Finished dracut cmdline hook. [ OK ] Finished Create Static Device Nodes in /dev. [ OK ] Finished Create Volatile Files and Directories. Starting dracut pre-udev hook... [ OK ] Finished dracut pre-udev hook. Starting Rule-based Manager for Device Events and Files... [ OK ] Started Rule-based Manager for Device Events and Files. Starting Coldplug All udev Devices... [ OK ] Finished Coldplug All udev Devices. [ OK ] Reached target System Initialization. [ OK ] Reached target Network. Startin[ 5.890072] dca service started, version 1.12.1 g dracut initqueue hook... Starting Show [ 5.936228] igb: Intel(R) Gigabit Ethernet Network Driver Plymouth Boot Sc[ 5.936235] igb: Copyright (c) 2007-2014 Intel Corporation. reen... [ 5.955604] ixgbe: Intel(R) 10 Gigabit PCI Express Network Driver [ 5.955611] ixgbe: Copyright (c) 1999-2016 Intel Corporation. [ OK ] Started Show Plymouth Boot Screen. [ OK ] Started Forward Password Requests to Plymouth Directory Watch. [ OK ] Reac[ 5.983702] ahci 0000:00:11.4: AHCI vers 0001.0300, 32 command slots, 6 Gbps, SATA mode hed target [0;1[ 5.983710] ahci 0000:00:11.4: 4/4 ports implemented (port mask 0xf) [ 5.983712] ahci 0000:00:11.4: flags: 64bit ncq pm led clo pio slum part ems apst ;39mPath Units[[ 5.993001] scsi host0: ahci [ 5.993189] scsi host1: ahci 0m. [ [ 5.993295] scsi host2: ahci OK ] Reache[ 5.993522] scsi host3: ahci [ 5.993588] ata1: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438100 irq 50 lpm-pol 0 [ 5.993591] ata2: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438180 irq 50 lpm-pol 0 d target [0;1;3[ 5.993593] ata3: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438200 irq 50 lpm-pol 0 [ 5.993596] ata4: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438280 irq 50 lpm-pol 0 9mBasic System[[ 5.993887] igb 0000:07:00.0: added PHC on eth0 [ 5.993921] igb 0000:07:00.0: Intel(R) Gigabit Ethernet Network Connection [ 5.993923] igb 0000:07:00.0: eth0: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d8:da:66 [ 5.994001] igb 0000:07:00.0: eth0: PBA No: 050B00-000 [ 5.994002] igb 0000:07:00.0: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 5.994068] ahci 0000:00:1f.2: AHCI vers 0001.0300, 32 command slots, 6 Gbps, SATA mode [ 5.994071] ahci 0000:00:1f.2: 6/6 ports implemented (port mask 0x3f) [ 5.994073] ahci 0000:00:1f.2: flags: 64bit ncq pm led clo pio slum part ems apst [ 6.012453] ACPI: bus type drm_connector registered [ 6.015411] scsi host4: ahci [ 6.015736] scsi host5: ahci [ 6.015855] scsi host6: ahci [ 6.015960] scsi host7: ahci [ 6.016057] scsi host8: ahci [ 6.016152] scsi host9: ahci [ 6.016192] ata5: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432100 irq 51 lpm-pol 0 [ 6.016195] ata6: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432180 irq 51 lpm-pol 0 [ 6.016198] ata7: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432200 irq 51 lpm-pol 0 [ 6.016201] ata8: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432280 irq 51 lpm-pol 0 [ 6.016204] ata9: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432300 irq 51 lpm-pol 0 [ 6.016207] ata10: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432380 irq 51 lpm-pol 0 [ 6.058381] nvme nvme0: pci function 0000:02:00.0 [ 6.058384] igb 0000:07:00.1: added PHC on eth1 [ 6.058429] igb 0000:07:00.1: Intel(R) Gigabit Ethernet Network Connection [ 6.058430] igb 0000:07:00.1: eth1: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d8:da:67 [ 6.058520] igb 0000:07:00.1: eth1: PBA No: 050B00-000 [ 6.058521] igb 0000:07:00.1: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 6.060413] nvme nvme0: 8/0/0 default/read/poll queues 0m. [ 6.302656] ata1: SATA link down (SStatus 0 SControl 300) [ 6.302681] ata4: SATA link down (SStatus 0 SControl 300) [ 6.302713] ata3: SATA link down (SStatus 0 SControl 300) [ 6.302742] ata2: SATA link down (SStatus 0 SControl 300) [ 6.326554] ata9: SATA link down (SStatus 0 SControl 300) [ 6.326602] ata5: SATA link up 6.0 Gbps (SStatus 133 SControl 300) [ 6.326625] ata7: SATA link down (SStatus 0 SControl 300) [ 6.326647] ata10: SATA link down (SStatus 0 SControl 300) [ 6.326673] ata6: SATA link down (SStatus 0 SControl 300) [ 6.327615] ata5.00: ATA-9: ST1000NM0033-9ZM173, SN06, max UDMA/133 [ 6.328197] ata5.00: NCQ Send/Recv Log not supported [ 6.328198] ata5.00: 1953525168 sectors, multi 16: LBA48 NCQ (depth 32), AA [ 6.328415] ata8: SATA link down (SStatus 0 SControl 300) [ 6.329569] ata5.00: NCQ Send/Recv Log not supported [ 6.329573] ata5.00: configured for UDMA/133 [ 6.329682] scsi 4:0:0:0: Direct-Access ATA ST1000NM0033-9ZM SN06 PQ: 0 ANSI: 5 [ 6.345351] igb 0000:07:00.0 eno1: renamed from eth0 [ 6.374940] igb 0000:07:00.1 eno2: renamed from eth1 [ 6.407211] scsi 4:0:0:0: Attached scsi generic sg0 type 0 [ 6.418112] sd 4:0:0:0: [sda] 1953525168 512-byte logical blocks: (1.00 TB/932 GiB) [ 6.418129] sd 4:0:0:0: [sda] Write Protect is off [ 6.418146] sd 4:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA [ 6.418165] sd 4:0:0:0: [sda] Preferred minimum I/O size 512 bytes [ 6.435353] sda: sda1 [ 6.435413] sd 4:0:0:0: [sda] Attached SCSI removable disk [ 6.448211] ast 0000:06:00.0: vgaarb: deactivate vga console [ 6.459585] Console: switching to colour dummy device 80x25 [ 6.459736] ast 0000:06:00.0: Using P2A bridge for configuration [ 6.459738] ast 0000:06:00.0: AST 2400 detected [ 6.459787] ast 0000:06:00.0: [drm] Using analog VGA [ 6.459796] ast 0000:06:00.0: [drm] dram MCLK=408 Mhz type=1 bus_width=16 [ 6.459984] [drm] Initialized ast 0.1.0 20120228 for 0000:06:00.0 on minor 0 [ 6.465763] fbcon: astdrmfb (fb0) is primary device [ 6.495721] Console: switching to colour frame buffer device 128x48 [ 6.513018] ast 0000:06:00.0: [drm] fb0: astdrmfb frame buffer device [ OK ] Found device ST1000NM0033-9ZM173 1. [ OK ] Reached target Initrd Root Device. [ 7.093985] ixgbe 0000:03:00.0: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 7.094309] ixgbe 0000:03:00.0: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 7.094392] ixgbe 0000:03:00.0: MAC: 2, PHY: 1, PBA No: 0210FF-0FF [ 7.094393] ixgbe 0000:03:00.0: 0c:c4:7a:8f:47:e0 [ 7.096712] ixgbe 0000:03:00.0: Intel(R) 10 Gigabit Network Connection [ 7.252891] ixgbe 0000:03:00.1: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 7.253180] ixgbe 0000:03:00.1: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 7.253262] ixgbe 0000:03:00.1: MAC: 2, PHY: 14, SFP+: 4, PBA No: 0210FF-0FF [ 7.253263] ixgbe 0000:03:00.1: 0c:c4:7a:8f:47:e1 [ 7.256271] ixgbe 0000:03:00.1: Intel(R) 10 Gigabit Network Connection [ 7.272143] ixgbe 0000:03:00.0 enp3s0f0: renamed from eth0 [ 7.296056] ixgbe 0000:03:00.1 enp3s0f1: renamed from eth1 [ OK ] Finished dracut initqueue hook. [ OK ] Reached target Preparation for Remote File Systems. [ OK ] Reached target Remote File Systems. Starting File System Check on /dev…2923-554d-41e2-ac4a-c752ff079ceb... [ OK ] Finished File System Check on /dev…8d2923-554d-41e2-ac4a-c752ff079ceb. Mounting /sysroot... [ 7.518131] EXT4-fs (sda1): mounted filesystem fa8d2923-554d-41e2-ac4a-c752ff079ceb ro with ordered data mode. Quota mode: none. [ OK ] Mounted /sysroot. [ OK ] Reached target Initrd Root File System. Starting Mountpoints Configured in the Real Root... [ OK ] Finished Mountpoints Configured in the Real Root. [ OK ] Reached target Initrd File Systems. [ OK ] Reached target Initrd Default Target. Starting dracut pre-pivot and cleanup hook... [ OK ] Finished dracut pre-pivot and cleanup hook. Starting Cleaning Up and Shutting Down Daemons... [ OK ] Stopped target Network. [ OK ] Stopped target Timer Units. [ OK ] Closed D-Bus System Message Bus Socket. [ OK ] Stopped dracut pre-pivot and cleanup hook. [ OK ] Stopped target Initrd Default Target. [ OK ] Stopped target Basic System. [ OK ] Stopped target Initrd Root Device. [ OK ] Stopped target Initrd /usr File System. [ OK ] Stopped target Path Units. [ OK ] Stopped target Remote File Systems. [ OK ] Stopped target Preparation for Remote File Systems. [ OK ] Stopped target Slice Units. [ OK ] Stopped target Socket Units. [ OK ] Stopped target System Initialization. [ OK ] Stopped target Local File Systems. [ OK ] Stopped target Swaps. [ OK ] Stopped dracut initqueue hook. Starting Plymouth switch root service... [ OK ] Stopped Apply Kernel Variables. [ OK ] Stopped Load Kernel Modules. [ OK ] Stopped Create Volatile Files and Directories. [ OK ] Stopped Coldplug All udev Devices. Stopping Rule-based Manager for Device Events and Files... [ OK ] Stopped Rule-based Manager for Device Events and Files. [ OK ] Finished Cleaning Up and Shutting Down Daemons. [ OK ] Closed udev Control Socket. [ OK ] Closed udev Kernel Socket. [ OK ] Stopped dracut pre-udev hook. [ OK ] Stopped dracut cmdline hook. Starting Cleanup udev Database... [ OK ] Stopped Create Static Device Nodes in /dev. [ OK ] Stopped Create List of Static Device Nodes. [ OK ] Stopped Create System Users. [ OK ] Finished Cleanup udev Database. [ OK ] Reached target Switch Root. [ OK ] Finished Plymouth switch root service. Starting Switch Root... [ 7.872959] systemd-journald[282]: Received SIGTERM from PID 1 (systemd). [ 8.437336] SELinux: policy capability network_peer_controls=1 [ 8.437344] SELinux: policy capability open_perms=1 [ 8.437345] SELinux: policy capability extended_socket_class=1 [ 8.437346] SELinux: policy capability always_check_network=0 [ 8.437347] SELinux: policy capability cgroup_seclabel=1 [ 8.437348] SELinux: policy capability nnp_nosuid_transition=1 [ 8.437349] SELinux: policy capability genfs_seclabel_symlinks=1 [ 8.480870] audit: type=1403 audit(1726180488.650:2): auid=4294967295 ses=4294967295 lsm=selinux res=1 [ 8.482756] systemd[1]: Successfully loaded SELinux policy in 117.476ms. [ 8.547766] systemd[1]: Relabelled /dev, /dev/shm, /run, /sys/fs/cgroup in 25.782ms. [ 8.555606] systemd[1]: systemd 252-45.el9 running in system mode (+PAM +AUDIT +SELINUX -APPARMOR +IMA +SMACK +SECCOMP +GCRYPT +GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 -IDN -IPTC +KMOD +LIBCRYPTSETUP +LIBFDISK +PCRE2 -PWQUALITY +P11KIT -QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD -BPF_FRAMEWORK +XKBCOMMON +UTMP +SYSVINIT default-hierarchy=unified) [ 8.555729] systemd[1]: Detected architecture x86-64. Welcome to CentOS Stream 9! [ 9.538547] systemd[1]: initrd-switch-root.service: Deactivated successfully. [ 9.538678] systemd[1]: Stopped Switch Root. [ 9.545952] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. [ 9.546232] systemd[1]: Created slice Slice /system/getty. [ OK [[ 9.550262] systemd[1]: Created slice Slice /system/modprobe. 0m] Stopped [0;[ 9.559122] systemd[1]: Created slice Slice /system/serial-getty. [ 9.564627] systemd[1]: Created slice Slice /system/sshd-keygen. 1;39mSwitch Root[ 9.585201] systemd[1]: Created slice User and Session Slice. . [[ 9.592091] systemd[1]: Dispatch Password Requests to Console Directory Watch was skipped because of an unmet condition check (ConditionPathExists=!/run/plymouth/pid). [ 9.592191] systemd[1]: Started Forward Password Requests to Wall Directory Watch. OK ] Crea[ 9.608716] systemd[1]: Set up automount Arbitrary Executable File Formats File System Automount Point. [ 9.615983] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mon@.service instances at once. ted slice [0;1;[ 9.626730] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mds@.service instances at once. [ 9.637053] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mgr@.service instances at once. 39mSlice /system[ 9.637078] systemd[1]: Reached target ceph target allowing to start/stop all ceph-osd@.service instances at once. [ 9.648767] systemd[1]: Reached target ceph target allowing to start/stop all ceph-radosgw@.service instances at once. /getty. [[ 9.659113] systemd[1]: Reached target ceph target allowing to start/stop all ceph-rbd-mirror@.service instances at once. [ 9.670820] systemd[1]: Reached target Local Encrypted Volumes. [0;32m OK [ 9.681507] systemd[1]: Stopped target Switch Root. [ 9.693822] systemd[1]: Stopped target Initrd File Systems. ] Created slice [ 9.699727] systemd[1]: Stopped target Initrd Root File System. [ 9.699756] systemd[1]: Reached target Local Integrity Protected Volumes. Slice /[ 9.706001] systemd[1]: Reached target Path Units. [ 9.711564] systemd[1]: Reached target Slice Units. system/modprobe[ 9.718853] systemd[1]: Reached target Swaps. [ 9.725629] systemd[1]: Reached target Local Verity Protected Volumes. [0m. [ [ 9.726000] systemd[1]: Listening on Device-mapper event daemon FIFOs. [ 9.732712] systemd[1]: Listening on LVM2 poll daemon socket. OK ] Creat[ 9.760948] systemd[1]: Listening on RPCbind Server Activation Socket. [ 9.762619] systemd[1]: Reached target RPC Port Mapper. ed slice [0;1;3[ 9.775264] systemd[1]: Listening on Process Core Dump Socket. [ 9.775817] systemd[1]: Listening on initctl Compatibility Named Pipe. 9mSlice /system/[ 9.783645] systemd[1]: Listening on udev Control Socket. [ 9.789674] systemd[1]: Listening on udev Kernel Socket. serial-getty[ 9.797061] systemd[1]: Mounting Huge Pages File System... [ 9.802370] systemd[1]: Mounting POSIX Message Queue File System... . [ OK[ 9.809201] systemd[1]: Mounting Kernel Debug File System... [ 9.815412] systemd[1]: Mounting Kernel Trace File System... ] Created [ 9.821762] systemd[1]: Kernel Module supporting RPCSEC_GSS was skipped because of an unmet condition check (ConditionPathExists=/etc/krb5.keytab). [ 9.839824] systemd[1]: Starting Create List of Static Device Nodes... slice S[ 9.842729] systemd[1]: Starting Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling... [ 9.849288] systemd[1]: Starting Load Kernel Module configfs... lice /system/ssh[ 9.860888] systemd[1]: Starting Load Kernel Module drm... [ 9.866763] systemd[1]: Starting Load Kernel Module fuse... d-keygen. [ 9.873894] systemd[1]: Starting Read and set NIS domainname from /etc/sysconfig/network... [ 9.878481] systemd[1]: plymouth-switch-root.service: Deactivated successfully. [ OK [[ 9.878523] systemd[1]: Stopped Plymouth switch root service. 0m] Created slic[ 9.888309] systemd[1]: Stopped Journal Service. e User [ 9.909122] systemd[1]: Starting Journal Service... and Session Slice. [ OK ] Started Forward Password Requests to Wall Directory Watch. [ OK ] Set up automount Arbitrary Executa…ormats File System Automount Point. [ OK ] Reached target ceph target allowin…eph-mon@.service instances [ 9.941959] systemd[1]: Starting Load Kernel Modules... [ 9.942749] systemd[1]: Starting Generate network units from Kernel command line... at once. [[ 9.947839] systemd[1]: TPM2 PCR Machine ID Measurement was skipped because of an unmet condition check (ConditionPathExists=/sys/firmware/efi/efivars/StubPcrKernelImage-4a67b082-0a4c-41cf-b6c7-440b29bb8c4f).  OK [0[ 9.948710] systemd[1]: Starting Remount Root and Kernel File Systems... [ 9.955541] systemd[1]: Repartition Root Disk was skipped because no trigger condition checks were met. m] Reached targe[ 9.956789] systemd[1]: Starting Coldplug All udev Devices... [ 9.976965] systemd[1]: Started Journal Service. t ceph target allowin…eph-mds@.service instances at once. [ OK ] Reached target ceph target allowin…eph[ 10.016712] EXT4-fs (sda1): re-mounted fa8d2923-554d-41e2-ac4a-c752ff079ceb r/w. Quota mode: none. -mgr@.service instances at once. [ OK ] Reached target ceph target allowin…eph-osd@.service instances at once. [ OK ] Reached target ceph target allowin…radosgw@.service instances at once. [ OK ] Reached target ceph target allowin…-mirror@.service instances at once. [ OK ] Reached target Local Encrypted Volumes. [ OK ] Stopped target [0;1;3[ 10.066516] systemd-journald[579]: Received client request to flush runtime journal. 9mSwitch Root. [ OK ] Stopped target Initrd File Systems. [ OK ] Stopped target Initrd Root File System. [ OK ] Reached target Local Integrity Protected Volumes. [ OK ] Reached target Path Units. [ OK ] Reached target Slice Units. [ OK ] Reached target Swaps. [ OK ] Reached target Local Verity Protected Volumes. [ OK ] Listening on Device-mapper event daemon FIFOs. [ OK ] Listening on LVM2 poll daemon socket. [ OK ] Listening on RPCbind Server Activation Socket. [ OK ] Reached target RPC Port Mapper. [ OK ] Listening on Process Core Dump Socket. [ OK ] Listening on initctl Compatibility Named Pipe. [ OK ] Listening on udev Control Socket. [ O[ 10.165772] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. [ 10.165793] device-mapper: uevent: version 1.0.3 [ 10.165880] device-mapper: ioctl: 4.48.0-ioctl (2023-03-01) initialised: dm-devel@redhat.com K ] Listening on udev Kernel Socket. Mounting Huge Pages File System... Mounting POSIX Message Queue File System... Mounting Kernel Debug File System... Mounting Kernel Trace File System... Starting Create List of Static Device Nodes... Starting Monitoring of LVM2 mirror…ing dmeventd or progress polling... Starting Load Kernel Module configfs... Starting Load Kernel Module drm... Starting Load Kernel Module fuse... Starting Read and set NIS domainname from /etc/sysconfig/network... [ OK ] Stopped Plymouth switch root service. [ OK ] Stopped Journal Service. Starting Journal Service... Starting Load Kernel Modules... Starting Generate network units from Kernel command line... Starting Remount Root and Kernel File Systems... Starting Coldplug All udev Devices... [ OK ] Started Journal Service. [ OK ] Mounted Huge Pages File System. [ OK ] Mounted POSIX Message Queue File System. [ OK ] Mounted Kernel Debug File System. [ OK ] Mounted Kernel Trace File System. [ OK ] Finished Create List of Static Device Nodes. [ OK ] Finished Load Kernel Module configfs. [ OK ] Finished Load Kernel Module drm. [ OK ] Finished Load Kernel Module fuse. [ OK ] Finished Read and set NIS domainname from /etc/sysconfig/network. [ OK ] Finished Load Kernel Modules. [ OK ] Finished Generate network units from Kernel command line. [ OK ] Reached target Preparation for Network. Mounting FUSE Control File System... Mounting Kernel Configuration File System... Starting Apply Kernel Variables... [ OK ] Mounted FUSE Control File System. [ OK ] Mounted Kernel Configuration File System. [ OK ] Finished Remount Root and Kernel File Systems. Starting Flush Journal to Persistent Storage... Starting Load/Save OS Random Seed... Starting Create Static Device Nodes in /dev... [ OK ] Finished Apply Kernel Variables. [ OK ] Finished Flush Journal to Persistent Storage. [ OK ] Finished Coldplug All udev Devices. [ OK ] Finished Load/Save OS Random Seed. [ OK ] Finished Monitoring of LVM2 mirror…using dmeventd or progress polling. [ OK ] Finished Create Static Device Nodes in /dev. Starting Rule-based Manager for Device Events and Files... [ OK ] Started Rule-based Manager for Device Events and Files. [ OK ] Reached target Preparation for Local File Systems. [ OK ] Reached target Local File Systems. Starting Tell Plymouth To Write Out Runtime Data... Starting Automatic Boot Loader Update... Starting Create Volatile Files and Directories... Starting Load Kernel Module configfs... Starting Load Kernel Module fuse... [ OK ] Finished Load Kernel Module configfs. [ OK ] Finished Load Kernel Module fuse. [ 10.679427] IPMI message handler: version 39.2 [ 10.686507] ipmi device interface [ 10.695782] ipmi_si: IPMI System Interface driver [ 10.695806] ipmi_si dmi-ipmi-si.0: ipmi_platform: probing via SMBIOS [ 10.695809] ipmi_platform: ipmi_si: SMBIOS: io 0xca2 regsize 1 spacing 1 irq 0 [ 10.695812] ipmi_si: Adding SMBIOS-specified kcs state machine [ 10.695868] ipmi_si IPI0001:00: ipmi_platform: probing via ACPI [ 10.695968] ipmi_si IPI0001:00: ipmi_platform: [io 0x0ca2] regsize 1 spacing 1 irq 0 [ 10.697653] ipmi_si dmi-ipmi-si.0: Removing SMBIOS-specified kcs state machine in favor of ACPI [ 10.697656] ipmi_si: Adding ACPI-specified kcs state machine [ 10.697732] ipmi_si: Trying ACPI-specified kcs state machine at i/o address 0xca2, slave address 0x20, irq 0 [ 10.752898] power_meter ACPI000D:00: Found ACPI power meter. [ OK [[ 10.752920] power_meter ACPI000D:00: Ignoring unsafe software power cap! 0m] Finished [0[ 10.752925] power_meter ACPI000D:00: hwmon_device_register() is deprecated. Please convert the driver to use hwmon_device_register_with_info(). ;1;39mAutomatic Boot Loader Update. [ OK ] Finished Tell Plymouth To[ 10.793119] ioatdma: Intel(R) QuickData Technology Driver 5.00 Write Out Runti[ 10.793216] input: PC Speaker as /devices/platform/pcspkr/input/input4 me Data. [ 10.801677] ipmi_si IPI0001:00: The BMC does not support clearing the recv irq bit, compensating, but the BMC needs to be fixed. [ 10.802563] igb 0000:07:00.0: DCA enabled [ 10.802584] igb 0000:07:00.1: DCA enabled [ 10.829779] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt [ 10.830790] i2c i2c-3: 2/8 memory slots populated (from DMI) [ 10.846407] ipmi_si IPI0001:00: IPMI message handler: Found new BMC (man_id: 0x002a7c, prod_id: 0x0833, dev_id: 0x20) [ 10.857567] mei_me 0000:00:16.0: Device doesn't have valid ME Interface [ OK ] Started /usr/sbin/lvm vgchange -aay --autoactivation event vg_nvme. [ 10.881966] RAPL PMU: API unit is 2^-32 Joules, 2 fixed counters, 655360 ms ovfl timer [ 10.881973] RAPL PMU: hw unit of domain package 2^-14 Joules [ 10.881978] RAPL PMU: hw unit of domain dram 2^-16 Joules [ OK ] Finished Create Volatile Files and Directories. [ 10.931295] iTCO_vendor_support: vendor-support=0 Starting Security Auditing Service... Starting RPC Bind... [ 10.963794] ipmi_si IPI0001:00: IPMI kcs interface initialized [ 10.973996] ipmi_ssif: IPMI SSIF Interface driver [ 10.983028] iTCO_wdt iTCO_wdt.1.auto: Found a Wellsburg TCO device (Version=2, TCOBASE=0x0460) [ 10.984710] iTCO_wdt iTCO_wdt.1.auto: initialized. heartbeat=30 sec (nowayout=0) Mounting RPC Pipe File System... [ OK ] Found device /dev/vg_nvme/lv_5. Mounting /var/lib/ceph... [ 11.128614] RPC: Registered named UNIX socket transport module. [ 11.128618] RPC: Registered udp transport module. [ 11.128621] RPC: Registered tcp transport module. [ 11.128621] RPC: Registered tcp-with-tls transport module. [ 11.128622] RPC: Registered tcp NFSv4.1 backchannel transport module. [ OK ] Mounted RPC Pipe File System. [ OK ] Reached target rpc_pipefs.target. [ 11.267613] EDAC MC0: Giving out device to module sb_edac controller Broadwell SrcID#0_Ha#0: DEV 0000:ff:12.0 (INTERRUPT) [ 11.267617] EDAC sbridge: Ver: 1.1.2 [ OK ] Started RPC Bind. [ OK ] Started Security Auditing Service. Starting Record System Boot/Shutdown in UTMP... [ OK ] Finished Record System Boot/Shutdown in UTMP. [ OK [ 11.496291] SGI XFS with ACLs, security attributes, scrub, quota, no debug enabled [0m] Reached target System Initializati[ 11.508856] XFS (dm-4): Deprecated V4 format (crc=0) will not be supported beginning with RHEL10 on. [[0;3[ 11.508985] XFS (dm-4): Mounting V4 Filesystem 2858b88a-50ca-44b7-b84a-9d395855c4bf [ 11.513318] XFS (dm-4): Ending clean mount [ 11.513357] xfs filesystem being mounted at /var/lib/ceph supports timestamps until 2038 (0x7fffffff) 2m OK ] St[ 11.540677] intel_rapl_common: Found RAPL domain package [ 11.540684] intel_rapl_common: Found RAPL domain dram arted Daily rotation of log files. [ OK ] Started Updates mlocate database every day. [ OK ] Started Run system activity accounting tool every 10 minutes. [ OK ] Started Generate summary of yesterday's process accounting. [ OK ] Started Daily Cleanup of Temporary Directories. [ OK ] Reached target Timer Units. [ OK ] Listening on D-Bus System Message Bus Socket. [ OK ] Listening on SSSD Kerberos Cache Manager responder socket. [ OK ] Reached target Socket Units. Starting D-Bus System Message Bus... [ OK ] Mounted /var/lib/ceph. [ OK ] Started D-Bus System Message Bus. [ OK ] Reached target Basic System. Starting Network Manager... [ OK ] Started Ceph crash dump collector. [ OK ] Reached target ceph target allowin…l ceph*@.service instances at once. Starting NTP client/server... Starting Restore /run/initramfs on shutdown... [ OK ] Started irqbalance daemon. [ OK ] Started libstoragemgmt plug-in server daemon. [ OK ] Started Machine Check Exception Logging Daemon. Starting Self Monitoring and Reporting Technology (SMART) Daemon... [ OK ] Reached target sshd-keygen.target. [ OK ] Reached target User and Group Name Lookups. Starting Resets System Activity Logs... Starting User Login Management... [ OK ] Finished Restore /run/initramfs on shutdown. [ OK ] Started User Login Management. [ OK ] Finished Resets System Activity Logs. [ OK ] Started NTP client/server. [ OK ] Started Self Monitoring and Reporting Technology (SMART) Daemon. [* ] A start job is running for Network Manager (5s / no limit) M  Starting Hostname Service... [ OK ] Started Hostname Service. [ OK ] Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. Starting Network Manager Script Dispatcher Service... [ OK ] Started Network Manager Script Dispatcher Service. [ 15.473978] ixgbe 0000:03:00.0: registered PHC device on enp3s0f0 [ 15.618484] ixgbe 0000:03:00.1: registered PHC device on enp3s0f1 [ OK ] Started Network Manager. [ OK ] Reached target Network. Starting Network Manager Wait Online... Starting GSSAPI Proxy Daemon... [ 15.852884] ixgbe 0000:03:00.1 enp3s0f1: detected SFP+: 4 Starting OpenSSH server daemon... [ OK ] Started OpenSSH server daemon. [ 16.032875] ixgbe 0000:03:00.1 enp3s0f1: NIC Link is Up 10 Gbps, Flow Control: RX/TX [ 16.033021] IPv6: ADDRCONF(NETDEV_CHANGE): enp3s0f1: link becomes ready [ OK ] Started GSSAPI Proxy Daemon. [ OK ] Reached target NFS client services. [ OK ] Reached target Preparation for Remote File Systems. [ OK ] Reached target Remote File Systems. Starting Permit User Sessions... [ OK ] Finished Permit User Sessions. [ OK ] Started Deferred execution scheduler. [ OK ] Started Command Scheduler. [** ] A start job is running for Network Manager Wait Online (8s / no limit) M [*** ] A start job is running for Network Manager Wait Online (9s / no limit) M [ *** ] A start job is running for Network Manager Wait Online (9s / no limit) M [ *** ] A start job is running for Network …nager Wait Online (10s / no limit) M [ ***] A start job is running for Network …nager Wait Online (10s / no limit) M [ **] A start job is running for Network …nager Wait Online (11s / no limit) M [ *] A start job is running for Network …nager Wait Online (11s / no limit) M [ OK ] Finished Network Manager Wait Online. [ OK ] Reached target Network is Online. Starting Crash recovery kernel arming... [ OK ] Started Nagios Remote Plugin Executor. Starting /etc/rc.d/rc.local Compatibility... Starting Notify NFS peers of a restart... Starting System Logging Service... [ OK ] Started Notify NFS peers of a restart. + '[' '!' -f /.cephlab_net_configured ']' + set +e + attempts=0 + myips= + '[' '' '!=' '' ']' + '[' 0 -ge 10 ']' ++ ip -4 addr ++ grep -oP '(?<=inet\s)\d+(\.\d+){3}' ++ grep -v '127.0.0.1\|127.0.1.1' + myips=172.21.15.76 + attempts=1 + sleep 1 [ OK ] Started System Logging Service. Starting SETroubleshoot daemon for…ocessing new SELinux denial logs... + '[' 172.21.15.76 '!=' '' ']' + set -e + '[' -n 172.21.15.76 ']' + for ip in $myips + timeout 1s ping -I 172.21.15.76 -nq -c1 172.21.0.1 ++ dig +short -x 172.21.15.76 @172.21.0.1 ++ sed 's/\.com.*/\.com/g' [ 22.769466] block sda: the capability attribute has been deprecated. + newhostname=smithi076.front.sepia.ceph.com + '[' -n smithi076.front.sepia.ceph.com ']' + hostname smithi076.front.sepia.ceph.com ++ hostname -d + newdomain=front.sepia.ceph.com ++ hostname -s + shorthostname=smithi076 + echo smithi076 + grep -q front.sepia.ceph.com /etc/hosts + sed -i 's/.*front.sepia.ceph.com.*/172.21.15.76 smithi076.front.sepia.ceph.com smithi076/g' /etc/hosts + break + command -v zypper + command -v apt-get + '[' -e /.cephlab_rc_local ']' + exit 0 [ OK ] Started /etc/rc.d/rc.local Compatibility. Starting Hold until boot process finishes up... Starting Terminate Plymouth Boot Screen... CentOS Stream 9 Kernel 5.14.0-505.el9.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket 2024-09-12T22:35:09.410 DEBUG:teuthology.orchestra.console.smithi076:expect after: smithi076 login: 2024-09-12T22:35:09.464 DEBUG:teuthology.orchestra.console.smithi076:console disconnect output: [Enter `^Ec?' for help] \x80 \x80 \x80 Initializing Intel(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Press Ctrl+S to enter the Setup Menu..  \x80 \x80  el(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Initializing Intel(R) Boot Agent XE v2.1.60 Press Ctrl+S to enter the Setup Menu..  \x80 \x80 Initializing Intel(R) Boot Agent GE v1.5.72 PXE 2.1 Build 092 (WfM 2.0) Press Ctrl+S to enter the Setup Menu.                       Press Ctrl+S to enter the Setup Menu..  \x80 \x80 Initializing Intel(R) Boot Agent GE v1.5.72 PXE 2.1 Build 092 (WfM 2.0) Press Ctrl+S to enter the Setup Menu.                       Press Ctrl+S to enter the Setup Menu..  \x80 \x80  Intel(R) Boot Agent XE v2.1.60 Copyright (C) 1997-2009, Intel Corporation  CLIENT MAC ADDR: 0C C4 7A 8F 47 E1 GUID: 00000000 0000 0000 0000 0CC47AD8DA66 DHCP.|                    DHCP.\ DHCP.| DHCP./ DHCP.- DHCP.\ DHCP.| CLIENT IP: 172.21.15.76 MASK: 255.255.240.0 DHCP IP: 172.21.0.10 GATEWAY IP: 172.21.15.254 PXE->EB: !PXE at 95D3:0070, entry point at 95D3:0106  UNDI code segment 95D3:3E70, data segment 8E94:73F0 (570-615kB)  UNDI device is PCI 03:00.1, type DIX+802.3  570kB free base memory after PXE unload iPXE initialising devices... iPXE initialising devices...ok iPXE 1.20.1+ (g4bd0) -- Open Source Network Boot Firmware -- http://ipxe.org Features: DNS FTP HTTP HTTPS iSCSI NFS TFTP VLAN AoE ELF MBOOT PXE bzImage Menu PXEXT Configuring (net0 0c:c4:7a:8f:47:e1)... Configuring (net0 0c:c4:7a:8f:47:e1).... Configuring (net0 0c:c4:7a:8f:47:e1)..... Configuring (net0 0c:c4:7a:8f:47:e1)...... ok .   [?25lUse the ^ and v keys to change the selection. Press 'e' to edit the selected item, or 'c' for a command prompt.   CentOS Stream (5.14.0-505.el9.x86_64) 9  CentOS Stream (5.14.0-503.el9.x86_64) 9  CentOS Stream (5.14.0-239.el9.x86_64) 9  CentOS Stream (0-rescue-fbf6b6fa6cf04654a0e563f30ecbf43a) 9               CentOS Stream (0-rescue-fbf6b6fa6cf0465 The selected entry will be started automatically in 5s. 4a0e563f30ecbf43a) 9            Use the * and * keys to change the selection.  Press 'e' to edit the selected item, or 'c' for a command prompt.  The selected entry will be started automatically in 5s.   CentOS Stream (5.14.0-505.el9.x86_64) 9   CentOS Stream (5.14.0-503.el9.x86_64) 9  CentOS Stream (5.14.0-239.el9.x86_64) 9  The selected entry will be started automatically in 4s.  The selected entry will be started automatically in 4s.  The selected entry will be started automatically in 3s.  The selected entry will be started automatically in 3s.  The selected entry will be started automatically in 2s.  The selected entry will be started automatically in 2s.  The selected entry will be started automatically in 1s.  The selected entry will be started automatically in 1s.  The selected entry will be started automatically in 0s. [?25h       [ 0.000000] Linux version 5.14.0-505.el9.x86_64 (mockbuild@x86-05.stream.rdu2.redhat.com) (gcc (GCC) 11.5.0 20240719 (Red Hat 11.5.0-2), GNU ld version 2.35.2-54.el9) #1 SMP PREEMPT_DYNAMIC Thu Sep 5 07:54:07 UTC 2024 [ 0.000000] The list of certified hardware and cloud instances for Red Hat Enterprise Linux 9 can be viewed at the Red Hat Ecosystem Catalog, https://catalog.redhat.com. [ 0.000000] Command line: BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-5.14.0-505.el9.x86_64 root=UUID=fa8d2923-554d-41e2-ac4a-c752ff079ceb ro crashkernel=1G-4G:192M,4G-64G:256M,64G-:512M console=ttyS1,115200 [ 0.000000] BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000008abff] usable [ 0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x0000000078ec5fff] usable [ 0.000000] BIOS-e820: [mem 0x0000000078f78000-0x00000000798a7fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000798a8000-0x0000000079d44fff] ACPI NVS [ 0.000000] BIOS-e820: [mem 0x0000000079d45000-0x000000008fffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed44fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000ff000000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000087fffffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] APIC: Static calls initialized [ 0.000000] SMBIOS 3.0 present. [ 0.000000] DMI: Supermicro SYS-5018R-WR/X10SRW-F, BIOS 2.0a 08/02/2016 [ 0.000000] tsc: Fast TSC calibration using PIT [ 0.000000] tsc: Detected 3499.737 MHz processor [ 0.000447] last_pfn = 0x880000 max_arch_pfn = 0x400000000 [ 0.000451] MTRR map: 5 entries (3 fixed + 2 variable; max 23), built from 10 variable MTRRs [ 0.000452] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT [ 0.000782] last_pfn = 0x78ec6 max_arch_pfn = 0x400000000 [ 0.006443] found SMP MP-table at [mem 0x000fcd40-0x000fcd4f] [ 0.006451] Using GB pages for direct mapping [ 0.006569] RAMDISK: [mem 0x341fd000-0x360f6fff] [ 0.006571] ACPI: Early table checksum verification disabled [ 0.006573] ACPI: RSDP 0x00000000000F05B0 000024 (v02 SUPERM) [ 0.006576] ACPI: XSDT 0x00000000798A80A0 0000BC (v01 01072009 AMI 00010013) [ 0.006581] ACPI: FACP 0x00000000798DB838 00010C (v05 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.006585] ACPI: DSDT 0x00000000798A81F0 033641 (v02 SUPERM SMCI--MB 01072009 INTL 20091013) [ 0.006587] ACPI: FACS 0x0000000079D43F80 000040 [ 0.006589] ACPI: APIC 0x00000000798DB948 0000C8 (v03 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.006592] ACPI: FPDT 0x00000000798DBA10 000044 (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.006594] ACPI: FIDT 0x00000000798DBA58 00009C (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.006596] ACPI: SPMI 0x00000000798DBAF8 000040 (v05 SUPERM SMCI--MB 00000000 AMI. 00000000) [ 0.006598] ACPI: MCFG 0x00000000798DBB38 00003C (v01 SUPERM SMCI--MB 01072009 MSFT 00000097) [ 0.006600] ACPI: UEFI 0x00000000798DBB78 000042 (v01 SUPERM SMCI--MB 01072009 00000000) [ 0.006603] ACPI: HPET 0x00000000798DBBC0 000038 (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.006605] ACPI: WDDT 0x00000000798DBBF8 000040 (v01 SUPERM SMCI--MB 00000000 INTL 20091013) [ 0.006607] ACPI: SSDT 0x00000000798DBC38 01717F (v02 SUPERM PmMgt 00000001 INTL 20120913) [ 0.006609] ACPI: NITR 0x00000000798F2DB8 000071 (v02 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.006611] ACPI: SSDT 0x00000000798F2E30 00264C (v02 SUPERM SpsNm 00000002 INTL 20120913) [ 0.006614] ACPI: SSDT 0x00000000798F5480 000064 (v02 SUPERM SpsNvs 00000002 INTL 20120913) [ 0.006616] ACPI: PRAD 0x00000000798F54E8 000102 (v02 SUPERM SMCI--MB 00000002 INTL 20120913) [ 0.006618] ACPI: DMAR 0x00000000798F55F0 0000BC (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.006620] ACPI: HEST 0x00000000798F56B0 00027C (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.006623] ACPI: BERT 0x00000000798F5930 000030 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.006625] ACPI: ERST 0x00000000798F5960 000230 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.006627] ACPI: EINJ 0x00000000798F5B90 000130 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.006629] ACPI: Reserving FACP table memory at [mem 0x798db838-0x798db943] [ 0.006630] ACPI: Reserving DSDT table memory at [mem 0x798a81f0-0x798db830] [ 0.006630] ACPI: Reserving FACS table memory at [mem 0x79d43f80-0x79d43fbf] [ 0.006631] ACPI: Reserving APIC table memory at [mem 0x798db948-0x798dba0f] [ 0.006632] ACPI: Reserving FPDT table memory at [mem 0x798dba10-0x798dba53] [ 0.006632] ACPI: Reserving FIDT table memory at [mem 0x798dba58-0x798dbaf3] [ 0.006633] ACPI: Reserving SPMI table memory at [mem 0x798dbaf8-0x798dbb37] [ 0.006633] ACPI: Reserving MCFG table memory at [mem 0x798dbb38-0x798dbb73] [ 0.006634] ACPI: Reserving UEFI table memory at [mem 0x798dbb78-0x798dbbb9] [ 0.006635] ACPI: Reserving HPET table memory at [mem 0x798dbbc0-0x798dbbf7] [ 0.006635] ACPI: Reserving WDDT table memory at [mem 0x798dbbf8-0x798dbc37] [ 0.006636] ACPI: Reserving SSDT table memory at [mem 0x798dbc38-0x798f2db6] [ 0.006636] ACPI: Reserving NITR table memory at [mem 0x798f2db8-0x798f2e28] [ 0.006637] ACPI: Reserving SSDT table memory at [mem 0x798f2e30-0x798f547b] [ 0.006637] ACPI: Reserving SSDT table memory at [mem 0x798f5480-0x798f54e3] [ 0.006638] ACPI: Reserving PRAD table memory at [mem 0x798f54e8-0x798f55e9] [ 0.006639] ACPI: Reserving DMAR table memory at [mem 0x798f55f0-0x798f56ab] [ 0.006639] ACPI: Reserving HEST table memory at [mem 0x798f56b0-0x798f592b] [ 0.006640] ACPI: Reserving BERT table memory at [mem 0x798f5930-0x798f595f] [ 0.006640] ACPI: Reserving ERST table memory at [mem 0x798f5960-0x798f5b8f] [ 0.006641] ACPI: Reserving EINJ table memory at [mem 0x798f5b90-0x798f5cbf] [ 0.006687] No NUMA configuration found [ 0.006688] Faking a node at [mem 0x0000000000000000-0x000000087fffffff] [ 0.006696] NODE_DATA(0) allocated [mem 0x87ffd5000-0x87fffffff] [ 0.006864] Reserving 256MB of memory at 1664MB for crashkernel (System RAM: 32654MB) [ 0.006900] Zone ranges: [ 0.006900] DMA [mem 0x0000000000001000-0x0000000000ffffff] [ 0.006902] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] [ 0.006903] Normal [mem 0x0000000100000000-0x000000087fffffff] [ 0.006904] Device empty [ 0.006904] Movable zone start for each node [ 0.006907] Early memory node ranges [ 0.006907] node 0: [mem 0x0000000000001000-0x0000000000089fff] [ 0.006908] node 0: [mem 0x0000000000100000-0x0000000078ec5fff] [ 0.006909] node 0: [mem 0x0000000100000000-0x000000087fffffff] [ 0.006913] Initmem setup node 0 [mem 0x0000000000001000-0x000000087fffffff] [ 0.006917] On node 0, zone DMA: 1 pages in unavailable ranges [ 0.006953] On node 0, zone DMA: 118 pages in unavailable ranges [ 0.011631] On node 0, zone Normal: 28986 pages in unavailable ranges [ 0.011742] ACPI: PM-Timer IO Port: 0x408 [ 0.011750] ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1]) [ 0.011751] ACPI: LAPIC_NMI (acpi_id[0x02] high edge lint[0x1]) [ 0.011752] ACPI: LAPIC_NMI (acpi_id[0x04] high edge lint[0x1]) [ 0.011752] ACPI: LAPIC_NMI (acpi_id[0x06] high edge lint[0x1]) [ 0.011753] ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1]) [ 0.011753] ACPI: LAPIC_NMI (acpi_id[0x03] high edge lint[0x1]) [ 0.011754] ACPI: LAPIC_NMI (acpi_id[0x05] high edge lint[0x1]) [ 0.011755] ACPI: LAPIC_NMI (acpi_id[0x07] high edge lint[0x1]) [ 0.011763] IOAPIC[0]: apic_id 1, version 32, address 0xfec00000, GSI 0-23 [ 0.011767] IOAPIC[1]: apic_id 2, version 32, address 0xfec01000, GSI 24-47 [ 0.011769] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.011771] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.011774] ACPI: Using ACPI (MADT) for SMP configuration information [ 0.011775] ACPI: HPET id: 0x8086a701 base: 0xfed00000 [ 0.011779] [Firmware Bug]: TSC_DEADLINE disabled due to Errata; please update microcode to version: 0xb000020 (or later) [ 0.011784] CPU topo: Max. logical packages: 1 [ 0.011784] CPU topo: Max. logical dies: 1 [ 0.011785] CPU topo: Max. dies per package: 1 [ 0.011789] CPU topo: Max. threads per core: 2 [ 0.011790] CPU topo: Num. cores per package: 4 [ 0.011790] CPU topo: Num. threads per package: 8 [ 0.011791] CPU topo: Allowing 8 present CPUs plus 0 hotplug CPUs [ 0.011799] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] [ 0.011801] PM: hibernation: Registered nosave memory: [mem 0x0008a000-0x000dffff] [ 0.011802] PM: hibernation: Registered nosave memory: [mem 0x000e0000-0x000fffff] [ 0.011803] PM: hibernation: Registered nosave memory: [mem 0x78ec6000-0x78f77fff] [ 0.011803] PM: hibernation: Registered nosave memory: [mem 0x78f78000-0x798a7fff] [ 0.011804] PM: hibernation: Registered nosave memory: [mem 0x798a8000-0x79d44fff] [ 0.011804] PM: hibernation: Registered nosave memory: [mem 0x79d45000-0x8fffffff] [ 0.011805] PM: hibernation: Registered nosave memory: [mem 0x90000000-0xfed1bfff] [ 0.011805] PM: hibernation: Registered nosave memory: [mem 0xfed1c000-0xfed44fff] [ 0.011806] PM: hibernation: Registered nosave memory: [mem 0xfed45000-0xfeffffff] [ 0.011806] PM: hibernation: Registered nosave memory: [mem 0xff000000-0xffffffff] [ 0.011808] [mem 0x90000000-0xfed1bfff] available for PCI devices [ 0.011809] Booting paravirtualized kernel on bare hardware [ 0.011811] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns [ 0.016173] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:8 nr_cpu_ids:8 nr_node_ids:1 [ 0.016393] percpu: Embedded 64 pages/cpu s225280 r8192 d28672 u262144 [ 0.016414] Kernel command line: BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-5.14.0-505.el9.x86_64 root=UUID=fa8d2923-554d-41e2-ac4a-c752ff079ceb ro crashkernel=1G-4G:192M,4G-64G:256M,64G-:512M console=ttyS1,115200 [ 0.016467] Unknown kernel command line parameters "BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-5.14.0-505.el9.x86_64", will be passed to user space. [ 0.016482] random: crng init done [ 0.018661] Dentry cache hash table entries: 4194304 (order: 13, 33554432 bytes, linear) [ 0.019799] Inode-cache hash table entries: 2097152 (order: 12, 16777216 bytes, linear) [ 0.019903] Fallback order for Node 0: 0 [ 0.019907] Built 1 zonelists, mobility grouping on. Total pages: 8228746 [ 0.019908] Policy zone: Normal [ 0.020050] mem auto-init: stack:off, heap alloc:off, heap free:off [ 0.020057] software IO TLB: area num 8. [ 0.041024] Memory: 1751596K/33438012K available (16384K kernel code, 5657K rwdata, 12972K rodata, 3980K init, 5696K bss, 989844K reserved, 0K cma-reserved) [ 0.041126] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=8, Nodes=1 [ 0.041135] Kernel/User page tables isolation: enabled [ 0.041158] ftrace: allocating 48134 entries in 189 pages [ 0.047988] ftrace: allocated 189 pages with 6 groups [ 0.048512] Dynamic Preempt: voluntary [ 0.048553] rcu: Preemptible hierarchical RCU implementation. [ 0.048554] rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=8. [ 0.048555] Trampoline variant of Tasks RCU enabled. [ 0.048556] Rude variant of Tasks RCU enabled. [ 0.048556] Tracing variant of Tasks RCU enabled. [ 0.048556] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. [ 0.048557] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=8 [ 0.052027] NR_IRQS: 524544, nr_irqs: 896, preallocated irqs: 16 [ 0.052188] rcu: srcu_init: Setting srcu_struct sizes based on contention. [ 0.052295] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) [ 0.057555] Console: colour VGA+ 80x25 [ 0.057573] printk: console [ttyS1] enabled [ 1.128137] ACPI: Core revision 20230331 [ 1.132230] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 133484882848 ns [ 1.141360] APIC: Switch to symmetric I/O mode setup [ 1.146330] DMAR: Host address width 46 [ 1.150172] DMAR: DRHD base: 0x000000fbffc000 flags: 0x1 [ 1.155489] DMAR: dmar0: reg_base_addr fbffc000 ver 1:0 cap 8d2078c106f0466 ecap f020de [ 1.163484] DMAR: RMRR base: 0x0000007ba6e000 end: 0x0000007ba7dfff [ 1.169751] DMAR: ATSR flags: 0x0 [ 1.173071] DMAR: RHSA base: 0x000000fbffc000 proximity domain: 0x0 [ 1.179338] DMAR-IR: IOAPIC id 1 under DRHD base 0xfbffc000 IOMMU 0 [ 1.185691] DMAR-IR: IOAPIC id 2 under DRHD base 0xfbffc000 IOMMU 0 [ 1.192045] DMAR-IR: HPET id 0 under DRHD base 0xfbffc000 [ 1.197444] DMAR-IR: x2apic is disabled because BIOS sets x2apic opt out bit. [ 1.197445] DMAR-IR: Use 'intremap=no_x2apic_optout' to override the BIOS setting. [ 1.212463] DMAR-IR: Enabled IRQ remapping in xapic mode [ 1.217773] x2apic: IRQ remapping doesn't support X2APIC mode [ 1.223975] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 1.234366] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x32725850a05, max_idle_ns: 440795315679 ns [ 1.244880] Calibrating delay loop (skipped), value calculated using timer frequency.. 6999.47 BogoMIPS (lpj=3499737) [ 1.245898] CPU0: Thermal monitoring enabled (TM1) [ 1.246934] process: using mwait in idle threads [ 1.247880] Last level iTLB entries: 4KB 64, 2MB 8, 4MB 8 [ 1.248879] Last level dTLB entries: 4KB 64, 2MB 0, 4MB 0, 1GB 4 [ 1.249880] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization [ 1.250880] Spectre V2 : Mitigation: Retpolines [ 1.251879] Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch [ 1.252879] Spectre V2 : Spectre v2 / SpectreRSB : Filling RSB on VMEXIT [ 1.253879] Speculative Store Bypass: Vulnerable [ 1.254884] MDS: Vulnerable: Clear CPU buffers attempted, no microcode [ 1.255879] TAA: Vulnerable: Clear CPU buffers attempted, no microcode [ 1.256879] MMIO Stale Data: Vulnerable: Clear CPU buffers attempted, no microcode [ 1.257882] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' [ 1.258879] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' [ 1.259879] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' [ 1.260879] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 [ 1.261879] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. [ 1.274462] Freeing SMP alternatives memory: 40K [ 1.274880] pid_max: default: 32768 minimum: 301 [ 1.275898] LSM: initializing lsm=lockdown,capability,yama,integrity,selinux,bpf [ 1.276884] Yama: becoming mindful. [ 1.277884] SELinux: Initializing. [ 1.278895] LSM support for eBPF active [ 1.279936] Mount-cache hash table entries: 65536 (order: 7, 524288 bytes, linear) [ 1.280917] Mountpoint-cache hash table entries: 65536 (order: 7, 524288 bytes, linear) [ 1.384864] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz (family: 0x6, model: 0x4f, stepping: 0x1) [ 1.385981] RCU Tasks: Setting shift to 3 and lim to 1 rcu_task_cb_adjust=1. [ 1.386891] RCU Tasks Rude: Setting shift to 3 and lim to 1 rcu_task_cb_adjust=1. [ 1.387888] RCU Tasks Trace: Setting shift to 3 and lim to 1 rcu_task_cb_adjust=1. [ 1.388887] Performance Events: PEBS fmt2+, Broadwell events, 16-deep LBR, full-width counters, Intel PMU driver. [ 1.389880] ... version: 3 [ 1.390879] ... bit width: 48 [ 1.391879] ... generic registers: 4 [ 1.392879] ... value mask: 0000ffffffffffff [ 1.393879] ... max period: 00007fffffffffff [ 1.394879] ... fixed-purpose events: 3 [ 1.395879] ... event mask: 000000070000000f [ 1.396965] signal: max sigframe size: 1776 [ 1.397890] Estimated ratio of average max frequency by base frequency (times 1024): 1053 [ 1.398904] rcu: Hierarchical SRCU implementation. [ 1.398905] rcu: Max phase no-delay instances is 400. [ 1.402353] NMI watchdog: Enabled. Permanently consumes one hw-PMU counter. [ 1.402946] smp: Bringing up secondary CPUs ... [ 1.403944] smpboot: x86: Booting SMP configuration: [ 1.403946] .... node #0, CPUs: #1 #2 #3 #4 #5 #6 #7 [ 1.407146] MDS CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/mds.html for more details. [ 1.407146] TAA CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/tsx_async_abort.html for more details. [ 1.407146] MMIO Stale Data CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/processor_mmio_stale_data.html for more details. [ 1.410923] smp: Brought up 1 node, 8 CPUs [ 1.410923] smpboot: Total of 8 processors activated (55995.79 BogoMIPS) [ 1.452039] node 0 deferred pages initialised in 38ms [ 1.454916] devtmpfs: initialized [ 1.454916] x86/mm: Memory block size: 128MB [ 1.455878] ACPI: PM: Registering ACPI NVS region [mem 0x798a8000-0x79d44fff] (4837376 bytes) [ 1.455878] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns [ 1.455878] futex hash table entries: 2048 (order: 5, 131072 bytes, linear) [ 1.455878] pinctrl core: initialized pinctrl subsystem [ 1.459878] NET: Registered PF_NETLINK/PF_ROUTE protocol family [ 1.459878] DMA: preallocated 4096 KiB GFP_KERNEL pool for atomic allocations [ 1.459878] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations [ 1.459878] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations [ 1.459878] audit: initializing netlink subsys (disabled) [ 1.459887] audit: type=2000 audit(1726180479.235:1): state=initialized audit_enabled=0 res=1 [ 1.459948] thermal_sys: Registered thermal governor 'fair_share' [ 1.459949] thermal_sys: Registered thermal governor 'step_wise' [ 1.459949] thermal_sys: Registered thermal governor 'user_space' [ 1.460881] cpuidle: using governor menu [ 1.461897] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it [ 1.461899] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 1.461954] PCI: ECAM [mem 0x80000000-0x8fffffff] (base 0x80000000) for domain 0000 [bus 00-ff] [ 1.461966] PCI: Using configuration type 1 for base access [ 1.465907] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. [ 1.465910] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages [ 1.465910] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page [ 1.465910] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages [ 1.465910] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page [ 1.466915] cryptd: max_cpu_qlen set to 1000 [ 1.466971] ACPI: Added _OSI(Module Device) [ 1.466973] ACPI: Added _OSI(Processor Device) [ 1.466973] ACPI: Added _OSI(3.0 _SCP Extensions) [ 1.466974] ACPI: Added _OSI(Processor Aggregator Device) [ 1.466975] ACPI: Added _OSI(Linux-Dell-Video) [ 1.466976] ACPI: Added _OSI(Linux-Lenovo-NV-HDMI-Audio) [ 1.466977] ACPI: Added _OSI(Linux-HPI-Hybrid-Graphics) [ 1.471878] ACPI: 4 ACPI AML tables successfully acquired and loaded [ 1.472878] ACPI: [Firmware Bug]: BIOS _OSI(Linux) query ignored [ 1.472878] ACPI: Dynamic OEM Table Load: [ 1.482878] ACPI: _OSC evaluated successfully for all CPUs [ 1.482878] ACPI: Interpreter enabled [ 1.482878] ACPI: PM: (supports S0 S4 S5) [ 1.482878] ACPI: Using IOAPIC for interrupt routing [ 1.483413] HEST: Enabling Firmware First mode for corrected errors. [ 1.489878] HEST: Table parsing has been initialized. [ 1.489878] GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC. [ 1.489878] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 1.489878] PCI: Using E820 reservations for host bridge windows [ 1.489878] ACPI: Enabled 5 GPEs in block 00 to 3F [ 1.494878] ACPI: PCI Root Bridge [UNC0] (domain 0000 [bus ff]) [ 1.494878] acpi PNP0A03:03: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 1.494878] acpi PNP0A03:03: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 1.494956] acpi PNP0A03:03: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 1.494957] acpi PNP0A03:03: FADT indicates ASPM is unsupported, using BIOS configuration [ 1.494985] PCI host bridge to bus 0000:ff [ 1.494986] pci_bus 0000:ff: root bus resource [bus ff] [ 1.494997] pci 0000:ff:0b.0: [8086:6f81] type 00 class 0x088000 conventional PCI endpoint [ 1.495041] pci 0000:ff:0b.1: [8086:6f36] type 00 class 0x110100 conventional PCI endpoint [ 1.495072] pci 0000:ff:0b.2: [8086:6f37] type 00 class 0x110100 conventional PCI endpoint [ 1.495102] pci 0000:ff:0b.3: [8086:6f76] type 00 class 0x088000 conventional PCI endpoint [ 1.495133] pci 0000:ff:0c.0: [8086:6fe0] type 00 class 0x088000 conventional PCI endpoint [ 1.495164] pci 0000:ff:0c.1: [8086:6fe1] type 00 class 0x088000 conventional PCI endpoint [ 1.495193] pci 0000:ff:0c.2: [8086:6fe2] type 00 class 0x088000 conventional PCI endpoint [ 1.495222] pci 0000:ff:0c.3: [8086:6fe3] type 00 class 0x088000 conventional PCI endpoint [ 1.495253] pci 0000:ff:0f.0: [8086:6ff8] type 00 class 0x088000 conventional PCI endpoint [ 1.495282] pci 0000:ff:0f.1: [8086:6ff9] type 00 class 0x088000 conventional PCI endpoint [ 1.495312] pci 0000:ff:0f.4: [8086:6ffc] type 00 class 0x088000 conventional PCI endpoint [ 1.495342] pci 0000:ff:0f.5: [8086:6ffd] type 00 class 0x088000 conventional PCI endpoint [ 1.495372] pci 0000:ff:0f.6: [8086:6ffe] type 00 class 0x088000 conventional PCI endpoint [ 1.495402] pci 0000:ff:10.0: [8086:6f1d] type 00 class 0x088000 conventional PCI endpoint [ 1.495431] pci 0000:ff:10.1: [8086:6f34] type 00 class 0x110100 conventional PCI endpoint [ 1.495462] pci 0000:ff:10.5: [8086:6f1e] type 00 class 0x088000 conventional PCI endpoint [ 1.495491] pci 0000:ff:10.6: [8086:6f7d] type 00 class 0x110100 conventional PCI endpoint [ 1.495519] pci 0000:ff:10.7: [8086:6f1f] type 00 class 0x088000 conventional PCI endpoint [ 1.495549] pci 0000:ff:12.0: [8086:6fa0] type 00 class 0x088000 conventional PCI endpoint [ 1.495571] pci 0000:ff:12.1: [8086:6f30] type 00 class 0x110100 conventional PCI endpoint [ 1.495607] pci 0000:ff:13.0: [8086:6fa8] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.495666] pci 0000:ff:13.1: [8086:6f71] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.495708] pci 0000:ff:13.2: [8086:6faa] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.495751] pci 0000:ff:13.3: [8086:6fab] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.495793] pci 0000:ff:13.4: [8086:6fac] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.495835] pci 0000:ff:13.5: [8086:6fad] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.495875] pci 0000:ff:13.6: [8086:6fae] type 00 class 0x088000 conventional PCI endpoint [ 1.495878] pci 0000:ff:13.7: [8086:6faf] type 00 class 0x088000 conventional PCI endpoint [ 1.495878] pci 0000:ff:14.0: [8086:6fb0] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.495878] pci 0000:ff:14.1: [8086:6fb1] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.495878] pci 0000:ff:14.2: [8086:6fb2] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.495878] pci 0000:ff:14.3: [8086:6fb3] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.495878] pci 0000:ff:14.4: [8086:6fbc] type 00 class 0x088000 conventional PCI endpoint [ 1.495878] pci 0000:ff:14.5: [8086:6fbd] type 00 class 0x088000 conventional PCI endpoint [ 1.495878] pci 0000:ff:14.6: [8086:6fbe] type 00 class 0x088000 conventional PCI endpoint [ 1.495878] pci 0000:ff:14.7: [8086:6fbf] type 00 class 0x088000 conventional PCI endpoint [ 1.495878] pci 0000:ff:15.0: [8086:6fb4] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.495878] pci 0000:ff:15.1: [8086:6fb5] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.495878] pci 0000:ff:15.2: [8086:6fb6] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.495878] pci 0000:ff:15.3: [8086:6fb7] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.495878] pci 0000:ff:16.0: [8086:6f68] type 00 class 0x088000 conventional PCI endpoint [ 1.495878] pci 0000:ff:16.6: [8086:6f6e] type 00 class 0x088000 conventional PCI endpoint [ 1.495878] pci 0000:ff:16.7: [8086:6f6f] type 00 class 0x088000 conventional PCI endpoint [ 1.495878] pci 0000:ff:17.0: [8086:6fd0] type 00 class 0x088000 conventional PCI endpoint [ 1.495878] pci 0000:ff:17.4: [8086:6fb8] type 00 class 0x088000 conventional PCI endpoint [ 1.495878] pci 0000:ff:17.5: [8086:6fb9] type 00 class 0x088000 conventional PCI endpoint [ 1.495878] pci 0000:ff:17.6: [8086:6fba] type 00 class 0x088000 conventional PCI endpoint [ 1.495878] pci 0000:ff:17.7: [8086:6fbb] type 00 class 0x088000 conventional PCI endpoint [ 1.495878] pci 0000:ff:1e.0: [8086:6f98] type 00 class 0x088000 conventional PCI endpoint [ 1.495878] pci 0000:ff:1e.1: [8086:6f99] type 00 class 0x088000 conventional PCI endpoint [ 1.495878] pci 0000:ff:1e.2: [8086:6f9a] type 00 class 0x088000 conventional PCI endpoint [ 1.495878] pci 0000:ff:1e.3: [8086:6fc0] type 00 class 0x088000 conventional PCI endpoint [ 1.495878] pci 0000:ff:1e.4: [8086:6f9c] type 00 class 0x088000 conventional PCI endpoint [ 1.495878] pci 0000:ff:1f.0: [8086:6f88] type 00 class 0x088000 conventional PCI endpoint [ 1.495878] pci 0000:ff:1f.2: [8086:6f8a] type 00 class 0x088000 conventional PCI endpoint [ 1.495878] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-fe]) [ 1.495878] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 1.495878] acpi PNP0A08:00: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 1.495878] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 1.495878] acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration [ 1.495878] PCI host bridge to bus 0000:00 [ 1.495878] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 1.495878] pci_bus 0000:00: root bus resource [io 0x1000-0xffff window] [ 1.495878] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 1.495878] pci_bus 0000:00: root bus resource [mem 0xfedb0000-0xfedb000f window] [ 1.495878] pci_bus 0000:00: root bus resource [mem 0xfedc0000-0xfedc000f window] [ 1.495878] pci_bus 0000:00: root bus resource [mem 0x90000000-0xfbffbfff window] [ 1.495878] pci_bus 0000:00: root bus resource [bus 00-fe] [ 1.495878] pci 0000:00:00.0: [8086:6f00] type 00 class 0x060000 PCIe Root Port [ 1.495878] pci 0000:00:01.0: [8086:6f02] type 01 class 0x060400 PCIe Root Port [ 1.495878] pci 0000:00:01.0: PCI bridge to [bus 01] [ 1.495878] pci 0000:00:01.0: PME# supported from D0 D3hot D3cold [ 1.495878] pci 0000:00:02.0: [8086:6f04] type 01 class 0x060400 PCIe Root Port [ 1.495878] pci 0000:00:02.0: PCI bridge to [bus 02] [ 1.495878] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 1.495878] pci 0000:00:02.0: PME# supported from D0 D3hot D3cold [ 1.495878] pci 0000:00:03.0: [8086:6f08] type 01 class 0x060400 PCIe Root Port [ 1.495878] pci 0000:00:03.0: PCI bridge to [bus 03] [ 1.495878] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 1.495878] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 1.495878] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 1.495878] pci 0000:00:03.0: PME# supported from D0 D3hot D3cold [ 1.495878] pci 0000:00:04.0: [8086:6f20] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.495878] pci 0000:00:04.0: BAR 0 [mem 0xfb42c000-0xfb42ffff 64bit] [ 1.495878] pci 0000:00:04.1: [8086:6f21] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.495878] pci 0000:00:04.1: BAR 0 [mem 0xfb428000-0xfb42bfff 64bit] [ 1.495878] pci 0000:00:04.2: [8086:6f22] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.495878] pci 0000:00:04.2: BAR 0 [mem 0xfb424000-0xfb427fff 64bit] [ 1.495878] pci 0000:00:04.3: [8086:6f23] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.495878] pci 0000:00:04.3: BAR 0 [mem 0xfb420000-0xfb423fff 64bit] [ 1.495878] pci 0000:00:04.4: [8086:6f24] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.495878] pci 0000:00:04.4: BAR 0 [mem 0xfb41c000-0xfb41ffff 64bit] [ 1.495878] pci 0000:00:04.5: [8086:6f25] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.495878] pci 0000:00:04.5: BAR 0 [mem 0xfb418000-0xfb41bfff 64bit] [ 1.495936] pci 0000:00:04.6: [8086:6f26] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.495943] pci 0000:00:04.6: BAR 0 [mem 0xfb414000-0xfb417fff 64bit] [ 1.496018] pci 0000:00:04.7: [8086:6f27] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.496025] pci 0000:00:04.7: BAR 0 [mem 0xfb410000-0xfb413fff 64bit] [ 1.496099] pci 0000:00:05.0: [8086:6f28] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.496160] pci 0000:00:05.1: [8086:6f29] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.496248] pci 0000:00:05.2: [8086:6f2a] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.496305] pci 0000:00:05.4: [8086:6f2c] type 00 class 0x080020 PCIe Root Complex Integrated Endpoint [ 1.496310] pci 0000:00:05.4: BAR 0 [mem 0xfb439000-0xfb439fff] [ 1.496394] pci 0000:00:11.0: [8086:8d7c] type 00 class 0xff0000 PCIe Root Complex Integrated Endpoint [ 1.496634] pci 0000:00:11.4: [8086:8d62] type 00 class 0x010601 conventional PCI endpoint [ 1.496655] pci 0000:00:11.4: BAR 0 [io 0xf110-0xf117] [ 1.496665] pci 0000:00:11.4: BAR 1 [io 0xf100-0xf103] [ 1.496676] pci 0000:00:11.4: BAR 2 [io 0xf0f0-0xf0f7] [ 1.496688] pci 0000:00:11.4: BAR 3 [io 0xf0e0-0xf0e3] [ 1.496699] pci 0000:00:11.4: BAR 4 [io 0xf020-0xf03f] [ 1.496710] pci 0000:00:11.4: BAR 5 [mem 0xfb438000-0xfb4387ff] [ 1.496769] pci 0000:00:11.4: PME# supported from D3hot [ 1.496848] pci 0000:00:14.0: [8086:8d31] type 00 class 0x0c0330 conventional PCI endpoint [ 1.496872] pci 0000:00:14.0: BAR 0 [mem 0xfb400000-0xfb40ffff 64bit] [ 1.496878] pci 0000:00:14.0: PME# supported from D3hot D3cold [ 1.496878] pci 0000:00:16.0: [8086:8d3a] type 00 class 0x078000 conventional PCI endpoint [ 1.496878] pci 0000:00:16.0: BAR 0 [mem 0xfb437000-0xfb43700f 64bit] [ 1.496878] pci 0000:00:16.0: PME# supported from D0 D3hot D3cold [ 1.496878] pci 0000:00:16.1: [8086:8d3b] type 00 class 0x078000 conventional PCI endpoint [ 1.496878] pci 0000:00:16.1: BAR 0 [mem 0xfb436000-0xfb43600f 64bit] [ 1.496878] pci 0000:00:16.1: PME# supported from D0 D3hot D3cold [ 1.496878] pci 0000:00:1a.0: [8086:8d2d] type 00 class 0x0c0320 conventional PCI endpoint [ 1.496878] pci 0000:00:1a.0: BAR 0 [mem 0xfb434000-0xfb4343ff] [ 1.496878] pci 0000:00:1a.0: PME# supported from D0 D3hot D3cold [ 1.496878] pci 0000:00:1c.0: [8086:8d10] type 01 class 0x060400 PCIe Root Port [ 1.496878] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 1.496878] pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold [ 1.496878] pci 0000:00:1c.2: [8086:8d14] type 01 class 0x060400 PCIe Root Port [ 1.496878] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 1.496878] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 1.496878] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.496878] pci 0000:00:1c.2: PME# supported from D0 D3hot D3cold [ 1.496878] pci 0000:00:1c.4: [8086:8d18] type 01 class 0x060400 PCIe Root Port [ 1.496878] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 1.496878] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 1.496878] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 1.496878] pci 0000:00:1c.4: PME# supported from D0 D3hot D3cold [ 1.496878] pci 0000:00:1d.0: [8086:8d26] type 00 class 0x0c0320 conventional PCI endpoint [ 1.496878] pci 0000:00:1d.0: BAR 0 [mem 0xfb433000-0xfb4333ff] [ 1.496878] pci 0000:00:1d.0: PME# supported from D0 D3hot D3cold [ 1.496878] pci 0000:00:1f.0: [8086:8d44] type 00 class 0x060100 conventional PCI endpoint [ 1.496878] pci 0000:00:1f.2: [8086:8d02] type 00 class 0x010601 conventional PCI endpoint [ 1.496878] pci 0000:00:1f.2: BAR 0 [io 0xf070-0xf077] [ 1.496878] pci 0000:00:1f.2: BAR 1 [io 0xf060-0xf063] [ 1.496878] pci 0000:00:1f.2: BAR 2 [io 0xf050-0xf057] [ 1.496878] pci 0000:00:1f.2: BAR 3 [io 0xf040-0xf043] [ 1.496878] pci 0000:00:1f.2: BAR 4 [io 0xf000-0xf01f] [ 1.496878] pci 0000:00:1f.2: BAR 5 [mem 0xfb432000-0xfb4327ff] [ 1.496878] pci 0000:00:1f.2: PME# supported from D3hot [ 1.496878] pci 0000:00:1f.3: [8086:8d22] type 00 class 0x0c0500 conventional PCI endpoint [ 1.496878] pci 0000:00:1f.3: BAR 0 [mem 0xfb431000-0xfb4310ff 64bit] [ 1.496878] pci 0000:00:1f.3: BAR 4 [io 0x0580-0x059f] [ 1.496878] acpiphp: Slot [1] registered [ 1.496878] pci 0000:00:01.0: PCI bridge to [bus 01] [ 1.496878] pci 0000:02:00.0: [8086:0953] type 00 class 0x010802 PCIe Endpoint [ 1.496878] pci 0000:02:00.0: BAR 0 [mem 0xfb310000-0xfb313fff 64bit] [ 1.496878] pci 0000:02:00.0: ROM [mem 0xfb300000-0xfb30ffff pref] [ 1.496878] pci 0000:02:00.0: enabling Extended Tags [ 1.496878] pci 0000:00:02.0: PCI bridge to [bus 02] [ 1.496878] pci 0000:03:00.0: [8086:10fb] type 00 class 0x020000 PCIe Endpoint [ 1.496878] pci 0000:03:00.0: BAR 0 [mem 0xfbd80000-0xfbdfffff 64bit pref] [ 1.496878] pci 0000:03:00.0: BAR 2 [io 0xe020-0xe03f] [ 1.496878] pci 0000:03:00.0: BAR 4 [mem 0xfbe04000-0xfbe07fff 64bit pref] [ 1.496878] pci 0000:03:00.0: ROM [mem 0xfb280000-0xfb2fffff pref] [ 1.496878] pci 0000:03:00.0: PME# supported from D0 D3hot D3cold [ 1.496878] pci 0000:03:00.0: VF BAR 0 [mem 0x00000000-0x00003fff 64bit pref] [ 1.496878] pci 0000:03:00.0: VF BAR 0 [mem 0x00000000-0x000fffff 64bit pref]: contains BAR 0 for 64 VFs [ 1.496878] pci 0000:03:00.0: VF BAR 3 [mem 0x00000000-0x00003fff 64bit pref] [ 1.496878] pci 0000:03:00.0: VF BAR 3 [mem 0x00000000-0x000fffff 64bit pref]: contains BAR 3 for 64 VFs [ 1.496878] pci 0000:03:00.1: [8086:10fb] type 00 class 0x020000 PCIe Endpoint [ 1.496878] pci 0000:03:00.1: BAR 0 [mem 0xfbd00000-0xfbd7ffff 64bit pref] [ 1.496878] pci 0000:03:00.1: BAR 2 [io 0xe000-0xe01f] [ 1.496878] pci 0000:03:00.1: BAR 4 [mem 0xfbe00000-0xfbe03fff 64bit pref] [ 1.496878] pci 0000:03:00.1: ROM [mem 0xfb200000-0xfb27ffff pref] [ 1.496878] pci 0000:03:00.1: PME# supported from D0 D3hot D3cold [ 1.496878] pci 0000:03:00.1: VF BAR 0 [mem 0x00000000-0x00003fff 64bit pref] [ 1.496878] pci 0000:03:00.1: VF BAR 0 [mem 0x00000000-0x000fffff 64bit pref]: contains BAR 0 for 64 VFs [ 1.496878] pci 0000:03:00.1: VF BAR 3 [mem 0x00000000-0x00003fff 64bit pref] [ 1.496878] pci 0000:03:00.1: VF BAR 3 [mem 0x00000000-0x000fffff 64bit pref]: contains BAR 3 for 64 VFs [ 1.496878] pci 0000:00:03.0: PCI bridge to [bus 03] [ 1.496878] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 1.496878] pci 0000:05:00.0: [1a03:1150] type 01 class 0x060400 PCIe to PCI/PCI-X bridge [ 1.496878] pci 0000:05:00.0: PCI bridge to [bus 06] [ 1.496878] pci 0000:05:00.0: 0xdfff] [ 1. window [mem 0xfa000000-0xfb0fffff] [ 1.496878] pci 0000:05:00.0: enabling Extended Tags [ 1.496878] pci 0000:05:00.0: supports D1 D2 [ 1.496878] pci 0000:05:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 1.496958] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 1.497040] pci_bus 0000:06: extended config space not accessible [ 1.497073] pci 0000:06:00.0: [1a03:2000] type 00 class 0x030000 conventional PCI endpoint [ 1.497110] pci 0000:06:00.0: BAR 0 [mem 0xfa000000-0xfaffffff] [ 1.497113] pci 0000:06:00.0: BAR 1 [mem 0xfb000000-0xfb01ffff] [ 1.497113] pci 0000:06:00.0: BAR 2 [io 0xd000-0xd07f] [ 1.497113] pci 0000:06:00.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] [ 1.497113] pci 0000:06:00.0: supports D1 D2 [ 1.497113] pci 0000:06:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 1.498013] pci 0000:05: 06] [ 1.4981521] type 00 cl.498201] pci 0000:07:00.0: BAR 0 [mem 0xfb120000-0xfb13ffff] [ 1.498238] pci 0000:07:00.0: BAR 2 [io 0xc020-0xc03f] [ 1.498256] pci 0000:07:00.0: BAR 3 [mem 0xfb144000-0xfb147fff] [ 1.498494] pci 0000:07:00.0: PME# supported from D0 D3hot D3cold [ 1.498526] pci 0000:07:00.0: VF BAR 0 [mem 0x00000000-0x00003fff 64bit pref] [ 1.498526] pci 0000:07:00.0: VF BAR 0 [mem 0x00000000-0x0001ffff 64bit pref]: contains BAR 0 for 8 VFs [ 1.498526] pci 0000:07:00.0: VF BAR 3 [mem 0x00000000-0x00003fff 64bit pref] [ 1.498526] pci 0000:07:00.0: VF BAR 3 [mem 0x00000000-0x0001ffff 64bit pref]: contains BAR 3 for 8 VFs [ 1.498526] pci 0000:07:00.1: [8086:1521] type 00 class 0x020000 PCIe Endpoint [ 1.498526] pci 0000:07:00.1: BAR 0 [mem 0xfb100000-0xfb11ffff] [ 1.498526] pci 0000:07:00.1: BAR 2 [io 0xc000-0xc01f] [ 1.498526] pci 0000:07:00.1: BAR 3 [mem 0xfb140000-0xfb143fff] [ 1.498609] pci 0000:07:00.1: PME# supported from D0 D3hot D3cold [ 1.498671] pci 0000:07:00-0x00003fff 64bit pref] [ 1.498672] pci 0000:07:00.1: VF BAR 0 [mem 0x0000001ffff 64bit pref]: contains BAR 0 for 8 VFs [ 1.498705] pci 0000:07:00.1: VF BAR 3 [mem 0x00000000-0x00003fff 64bit pref] [ 1.498706] pci 0000:07:00.1: VF BAR 3 [mem 0x00000000-0x0001ffff 64bit pref]: contains BAR 3 for 8 VFs [ 1.499014] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 1.499026] pci 0000:00:1c.4: bridge has subordinate 07 but max busn 08 [ 1.499692] ACPI: PCI: Interrupt link LNKA configured for IRQ 11 [ 1.499723] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 [ 1.499753] ACPI: PCI: Interrupt link LNKC configured for IRQ 5 [ 1.499783] APCI: Interrupt link LNKD configured for IRQ 11 [ 1.499813] ACPI: PCI: Interrupt link LNKE configured for IRQ 0 [ 1.499814] ACPI: PCI: Interrupt link LNKE disabled [ 1.499843] ACPI: PCI: Interrupt link LNKF configured for IRQ 0 [ 1.499844] ACPI: PCI: Interrupt link LNKF disabled [ 1.499873] ACPI: PCI: Interrupt link LNKG configured for IRQ 0 [ 1.499874] ACPI: PCI: Interrupt link LNKG disabled [ 1.499904] ACPI: PCI: Interrupt link LNKH configured for IRQ 0 [ 1.499905] ACPI: PCI: Interrupt link LNKH disabled [ 1.500892] iommu: Default domain type: Translated [ 1.500892] iommu: DMA domain TLB invalidation policy: lazy mode [ 1.500958] SCSI subsystem initialized [ 1.500973] ACPI: bus type USB registered [ 1.500987] usbcore: registered new interface driver usbfs [ 1.500992] usbcore: registered new interface driver hub [ 1.500996] usbcore: registered new device driver usb [ 1.501016] pps_core: LinuxPPS API ver. 1 registered [ 1.501017] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti [ 1.501019] PTP clock support registered [ 1.501032] EDAC MC: Ver: 3.0.0 [ 1.501038] NetLabel: Initializing [ 1.501039] NetLabel: domain hash size = 128 [ 1.501040] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO [ 1.501053] NetLabel: unlabeled traffic allowed by default [ 1.501053] PCI: Using ACPI for IRQ routing [ 1.511906] pci 0000:06:00.0: vgaarb: setting as boot VGA device [ 1.511906] pci 0000:06:00.0: vgaarb: bridge control possible [ 1.511906] pci 0000:06:00.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none [ 1.511906] vgaarb: loaded [ 1.511909] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0 [ 1.511914] hpet0: 8 comparators, 64-bit 14.318180 MHz counter [ 1.519236] clocksource: Switched to clocksource tsc-early [ 1.527951] VFS: Disk quotas dquot_6.6.0 [ 1.527960] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 1.528008] pnp: PnP ACPI init [ 1.528325] system 00:01: [io 0x0500-0x057f] has been reserved [ 1.528328] system 00:01: [io 0x0400-0x047f] has been reserved [ 1.528330] system 00:01: [io 0x0580-0x059f] has been reserved [ 1.528331] system 00:01: [io 0x0600-0x061f] has been reserved [ 1.528331] system 00:01: [io 0x0880-0x0883] has been reserved [ 1.528332] system 00:01: [io 0x0800-0x081f] has been reserved [ 1.528334] system 00:01: [mem 0xfed1c000-0xfed3ffff] has been reserved [ 1.528335] system 00:01: [mem 0xfed45000-0xfed8bfff] has been reserved [ 1.528336] system 00:01: [mem 0xff000000-0xffffffff] has been reserved [ 1.528337] system 00:01: [mem 0xfee00000-0xfeefffff] has been reserved [ 1.528338] system 00:01: [mem 0xfed12000-0xfed1200f] has been reserved [ 1.528339] system 00:01: [mem 0xfed12010-0xfed1201f] has been reserved [ 1.528340] system 00:01: [mem 0xfed1b000-0xfed1bfff] has been reserved [ 1.528487] system 00:02: [io 0x0a00-0x0a0f] has been reserved [ 1.528489] system 00:02: [io 0x0a10-0x0a1f] has been reserved [ 1.528490] system 00:02: [io 0x0a20-0x0a2f] has been reserved [ 1.528491] system 00:02: [io 0x0a30-0x0a3f] has been reserved [ 1.528492] system 00:02: [io 0x0a40-0x0a4f] has been reserved [ 1.529160] pnp: PnP ACPI: found 5 devices [ 1.534655] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns [ 1.534704] NET: Registered PF_INET protocol family [ 1.534867] IP idents hash table entries: 262144 (order: 9, 2097152 bytes, linear) [ 1.537130] tcp_listen_portaddr_hash hash table entries: 16384 (order: 6, 262144 bytes, linear) [ 1.537159] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) [ 1.537169] TCP established hash table entries: 262144 (order: 9, 2097152 bytes, linear) [ 1.537381] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes, linear) [ 1.537489] TCP: Hash tables configured (established 262144 bind 65536) [ 1.537616] MPTCP token hash table entries: 32768 (order: 7, 786432 bytes, linear) [ 1.537708] UDP hash table entries: 16384 (order: 7, 524288 bytes, linear) [ 1.537762] UDP-Lite hash table entries: 16384 (order: 7, 524288 bytes, linear) [ 1.537845] NET: Registered PF_UNIX/PF_LOCAL protocol family [ 1.537849] NET: Registered PF_XDP protocol family [ 1.537869] pci 0000:00:1c.4: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 07] add_size 100000 add_align 100000 [ 1.537880] pci 0000:00:1c.4: bridge window [mem 0x90000000-0x900fffff 64bit pref]: assigned [ 1.537882] pci 0000:00:01.0: PCI bridge to [bus 01] [ 1.537887] pci 0000:00:02.0: PCI bridge to [bus 02] [ 1.537889] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 1.537894] pci 0000:03:00.0: VF BAR 0 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.537896] pci 0000:03:00.0: VF BAR 0 [mem size 0x00100000 64bit pref]: failed to assign [ 1.537897] pci 0000:03:00.0: VF BAR 3 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.537898] pci 0000:03:00.0: VF BAR 3 [mem size 0x00100000 64bit pref]: failed to assign [ 1.537899] pci 0000:03:00.1: VF BAR 0 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.537900] pci 0000:03:00.1: VF BAR 0 [mem size 0x00100000 64bit pref]: failed to assign [ 1.537902] pci 0000:03:00.1: VF BAR 3 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.537902] pci 0000:03:00.1: VF BAR 3 [mem size 0x00100000 64bit pref]: failed to assign [ 1.537904] pci 0000:03:00.0: VF BAR 0 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.537905] pci 0000:03:00.0: VF BAR 0 [mem size 0x00100000 64bit pref]: failed to assign [ 1.537906] pci 0000:03:00.0: VF BAR 3 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.537907] pci 0000:03:00.0: VF BAR 3 [mem size 0x00100000 64bit pref]: failed to assign [ 1.537908] pci 0000:03:00.1: VF BAR 0 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.537909] pci 0000:03:00.1: VF BAR 0 [mem size 0x00100000 64bit pref]: failed to assign [ 1.537910] pci 0000:03:00.1: VF BAR 3 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.537911] pci 0000:03:00.1: VF BAR 3 [mem size 0x00100000 64bit pref]: failed to assign [ 1.537912] pci 0000:00:03.0: PCI bridge to [bus 03] [ 1.537913] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 1.537915] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 1.537917] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 1.537920] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 1.537933] pci 0000:05:00.0: PCI bridge to [bus 06] [ 1.537935] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 1.537943] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.537959] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 1.537961] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 1.537967] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.537977] pci 0000:07:00.0: VF BAR 0 [mem 0x90000000-0x9001ffff 64bit pref]: assigned [ 1.537985] pci 0000:07:00.0: VF BAR 3 [mem 0x90020000-0x9003ffff 64bit pref]: assigned [ 1.537991] pci 0000:07:00.1: VF BAR 0 [mem 0x90040000-0x9005ffff 64bit pref]: assigned [ 1.537997] pci 0000:07:00.1: VF BAR 3 [mem 0x90060000-0x9007ffff 64bit pref]: assigned [ 1.538004] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 1.538006] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 1.538011] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 1.538014] pci 0000:00:1c.4: bridge window [mem 0x90000000-0x900fffff 64bit pref] [ 1.538020] pci_bus 0000:00: Some PCI device resources are unassigned, try booting with pci=realloc [ 1.538021] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [ 1.538022] pci_bus 0000:00: resource 5 [io 0x1000-0xffff window] [ 1.538023] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [ 1.538024] pci_bus 0000:00: resource 7 [mem 0xfedb0000-0xfedb000f window] [ 1.538025] pci_bus 0000:00: resource 8 [mem 0xfedc0000-0xfedc000f window] [ 1.538026] pci_bus 0000:00: resource 9 [mem 0x90000000-0xfbffbfff window] [ 1.538027] pci_bus 0000:02: resource 1 [mem 0xfb300000-0xfb3fffff] [ 1.538028] pci_bus 0000:03: resource 0 [io 0xe000-0xefff] [ 1.538028] pci_bus 0000:03: resource 1 [mem 0xfb200000-0xfb2fffff] [ 1.538029] pci_bus 0000:03: resource 2 [mem 0xfbd00000-0xfbefffff 64bit pref] [ 1.538030] pci_bus 0000:05: resource 0 [io 0xd000-0xdfff] [ 1.538031] pci_bus 0000:05: resource 1 [mem 0xfa000000-0xfb0fffff] [ 1.538032] pci_bus 0000:06: resource 0 [io 0xd000-0xdfff] [ 1.538033] pci_bus 0000:06: resource 1 [mem 0xfa000000-0xfb0fffff] [ 1.538034] pci_bus 0000:07: resource 0 [io 0xc000-0xcfff] [ 1.538034] pci_bus 0000:07: resource 1 [mem 0xfb100000-0xfb1fffff] [ 1.538035] pci_bus 0000:07: resource 2 [mem 0x90000000-0x900fffff 64bit pref] [ 1.538194] pci 0000:00:05.0: disabled boot interrupts on device [8086:6f28] [ 1.555709] pci 0000:00:1a.0: quirk_usb_early_handoff+0x0/0x140 took 16936 usecs [ 1.567704] pci 0000:00:1d.0: quirk_usb_early_handoff+0x0/0x140 took 11699 usecs [ 1.567718] pci 0000:02:00.0: CLS mismatch (64 != 32), using 64 bytes [ 1.567752] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 1.567752] software IO TLB: mapped [mem 0x0000000064000000-0x0000000068000000] (64MB) [ 1.567762] Trying to unpack rootfs image as initramfs... [ 1.567765] ACPI: bus type thunderbolt registered [ 1.775452] Initialise system trusted keyrings [ 1.775462] Key type blacklist registered [ 1.775511] workingset: timestamp_bits=36 max_order=23 bucket_order=0 [ 1.775524] zbud: loaded [ 1.884787] Freeing initrd memory: 31720K [ 1.899048] integrity: Platform Keyring initialized [ 1.899052] integrity: Machine keyring initialized [ 1.907120] NET: Registered PF_ALG protocol family [ 1.907122] xor: automatically using best checksumming function avx [ 1.907124] Key type asymmetric registered [ 1.907125] Asymmetric key parser 'x509' registered [ 1.907125] Running certificate verification selftests [ 1.909276] Loaded X.509 cert 'Certificate verification self-testing key: f58703bb33ce1b73ee02eccdee5b8817518fe3db' [ 1.909750] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 246) [ 1.909777] io scheduler mq-deadline registered [ 1.909778] io scheduler kyber registered [ 1.909783] io scheduler bfq registered [ 1.968156] atomic64_test: passed for x86-64 platform with CX8 and with SSE [ 1.968470] pcieport 0000:00:01.0: PME: Signaling with IRQ 25 [ 1.968630] pcieport 0000:00:02.0: PME: Signaling with IRQ 27 [ 1.968785] pcieport 0000:00:03.0: PME: Signaling with IRQ 29 [ 1.968920] pcieport 0000:00:1c.0: PME: Signaling with IRQ 30 [ 1.969075] pcieport 0000:00:1c.2: PME: Signaling with IRQ 31 [ 1.969223] pcieport 0000:00:1c.4: PME: Signaling with IRQ 32 [ 1.969381] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 [ 1.976400] ACPI: \_SB_.SCK0.CP00: Found 2 idle states [ 2.001446] input: Power Button as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C0C:00/input/input0 [ 2.001468] ACPI: button: Power Button [PWRB] [ 2.001491] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input1 [ 2.001527] ACPI: button: Power Button [PWRF] [ 2.289792] ERST: Error Record Serialization Table (ERST) support is initialized. [ 2.289794] pstore: Registered erst as persistent store backend [ 2.289878] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled [ 2.289980] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A [ 2.295598] 00:04: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A [ 2.305271] Non-volatile memory driver v1.3 [ 2.311639] rdac: device handler registered [ 2.311668] hp_sw: device handler registered [ 2.311670] emc: device handler registered [ 2.311686] alua: device handler registered [ 2.312034] ehci-pci 0000:00:1d.0: EHCI Host Controller [ 2.312067] ehci-pci 0000:00:1d.0: new USB bus registered, assigned bus number 1 [ 2.312080] ehci-pci 0000:00:1d.0: debug port 2 [ 2.316007] ehci-pci 0000:00:1d.0: irq 18, io mem 0xfb433000 [ 2.324710] ehci-pci 0000:00:1d.0: USB 2.0 started, EHCI 1.00 [ 2.324750] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.14 [ 2.324752] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 2.324753] usb usb1: Product: EHCI Host Controller [ 2.324754] usb usb1: Manufacturer: Linux 5.14.0-505.el9.x86_64 ehci_hcd [ 2.324755] usb usb1: SerialNumber: 0000:00:1d.0 [ 2.324843] hub 1-0:1.0: USB hub found [ 2.324847] hub 1-0:1.0: 2 ports detected [ 2.324954] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 2.324985] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 2 [ 2.326071] xhci_hcd 0000:00:14.0: hcc params 0x200077c1 hci version 0x100 quirks 0x0000000000009810 [ 2.326319] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 2.326320] ehci-pci 0000:00:1a.0: EHCI Host Controller [ 2.326367] ehci-pci 0000:00:1a.0: new USB bus registered, assigned bus number 4 [ 2.326369] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 3 [ 2.326371] xhci_hcd 0000:00:14.0: Host supports USB 3.0 SuperSpeed [ 2.326386] ehci-pci 0000:00:1a.0: debug port 2 [ 2.326401] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.14 [ 2.326403] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 2.326404] usb usb2: Product: xHCI Host Controller [ 2.326405] usb usb2: Manufacturer: Linux 5.14.0-505.el9.x86_64 xhci-hcd [ 2.326405] usb usb2: SerialNumber: 0000:00:14.0 [ 2.326491] hub 2-0:1.0: USB hub found [ 2.326523] hub 2-0:1.0: 15 ports detected [ 2.328278] usb usb3: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 5.14 [ 2.328280] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 2.328281] usb usb3: Product: xHCI Host Controller [ 2.328282] usb usb3: Manufacturer: Linux 5.14.0-505.el9.x86_64 xhci-hcd [ 2.328283] usb usb3: SerialNumber: 0000:00:14.0 [ 2.328369] hub 3-0:1.0: USB hub found [ 2.328386] hub 3-0:1.0: 6 ports detected [ 2.329325] usbcore: registered new interface driver usbserial_generic [ 2.329330] usbserial: USB Serial support registered for generic [ 2.329355] i8042: PNP: No PS/2 controller found. [ 2.329405] mousedev: PS/2 mouse device common for all mice [ 2.329460] rtc_cmos 00:00: RTC can wake from S4 [ 2.329776] rtc_cmos 00:00: registered as rtc0 [ 2.329830] rtc_cmos 00:00: setting system clock to 2024-09-12T22:34:42 UTC (1726180482) [ 2.329855] rtc_cmos 00:00: alarms up to one month, y3k, 114 bytes nvram [ 2.330288] ehci-pci 0000:00:1a.0: irq 18, io mem 0xfb434000 [ 2.337694] ehci-pci 0000:00:1a.0: USB 2.0 started, EHCI 1.00 [ 2.337728] usb usb4: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.14 [ 2.337729] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 2.337731] usb usb4: Product: EHCI Host Controller [ 2.337731] usb usb4: Manufacturer: Linux 5.14.0-505.el9.x86_64 ehci_hcd [ 2.337732] usb usb4: SerialNumber: 0000:00:1a.0 [ 2.337809] hub 4-0:1.0: USB hub found [ 2.337813] hub 4-0:1.0: 2 ports detected [ 2.358577] intel_pstate: Intel P-state driver initializing [ 2.435085] hid: raw HID events driver (C) Jiri Kosina [ 2.435117] usbcore: registered new interface driver usbhid [ 2.435118] usbhid: USB HID core driver [ 2.435137] drop_monitor: Initializing network drop monitor service [ 2.445533] Initializing XFRM netlink socket [ 2.445550] NET: Registered PF_INET6 protocol family [ 2.450677] Segment Routing with IPv6 [ 2.450693] NET: Registered PF_PACKET protocol family [ 2.450715] mpls_gso: MPLS GSO support [ 2.471370] microcode: Current revision: 0x0b00001b [ 2.497944] resctrl: L3 allocation detected [ 2.497945] resctrl: L3 monitoring detected [ 2.497962] IPI shorthand broadcast: enabled [ 2.497967] AVX2 version of gcm_enc/dec engaged. [ 2.532916] AES CTR mode by8 optimization enabled [ 2.532965] sched_clock: Marking stable (1360000494, 1172661842)->(3077252544, -544590208) [ 2.539107] registered taskstats version 1 [ 2.551583] Loading compiled-in X.509 certificates [ 2.552086] Loaded X.509 cert 'The CentOS Project: CentOS Stream kernel signing key: d7d2edb13bc4136035087569dd0b474add53ff98' [ 2.552351] Loaded X.509 cert 'Red Hat Enterprise Linux Driver Update Program (key 3): bf57f3e87362bc7229d9f465321773dfd1f77a80' [ 2.552612] Loaded X.509 cert 'Red Hat Enterprise Linux kpatch signing key: 4d38fd864ebe18c5f0b72e3852e2014c3a676fc8' [ 2.552775] Loaded X.509 cert 'RH-IMA-CA: Red Hat IMA CA: fb31825dd0e073685b264e3038963673f753959a' [ 2.552785] Loaded X.509 cert 'Nvidia GPU OOT signing 001: 55e1cef88193e60419f0b0ec379c49f77545acf0' [ 2.554507] page_owner is disabled [ 2.554726] pstore: Using crash dump compression: deflate [ 2.554735] Key type big_key registered [ 2.572078] Key type encrypted registered [ 2.572083] ima: No TPM chip found, activating TPM-bypass! [ 2.572085] Loading compiled-in module X.509 certificates [ 2.572368] Loaded X.509 cert 'The CentOS Project: CentOS Stream kernel signing key: d7d2edb13bc4136035087569dd0b474add53ff98' [ 2.572370] ima: Allocated hash algorithm: sha256 [ 2.572379] ima: No architecture policies found [ 2.572386] evm: Initialising EVM extended attributes: [ 2.572386] evm: security.selinux [ 2.572387] evm: security.SMACK64 (disabled) [ 2.572387] evm: security.SMACK64EXEC (disabled) [ 2.572388] evm: security.SMACK64TRANSMUTE (disabled) [ 2.572388] evm: security.SMACK64MMAP (disabled) [ 2.572388] evm: security.apparmor (disabled) [ 2.572389] evm: security.ima [ 2.572389] evm: security.capability [ 2.572390] evm: HMAC attrs: 0x1 [ 2.572668] usb 1-1: new high-speed USB device number 2 using ehci-pci [ 2.576206] usb 2-12: new high-speed USB device number 2 using xhci_hcd [ 2.578672] usb 4-1: new high-speed USB device number 2 using ehci-pci [ 2.600670] tsc: Refined TSC clocksource calibration: 3499.999 MHz [ 2.600674] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x32734f9ce42, max_idle_ns: 440795224466 ns [ 2.601336] clocksource: Switched to clocksource tsc [ 2.702071] usb 1-1: New USB device found, idVendor=8087, idProduct=8002, bcdDevice= 0.05 [ 2.702074] usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 2.702225] hub 1-1:1.0: USB hub found [ 2.702318] hub 1-1:1.0: 8 ports detected [ 2.707068] usb 4-1: New USB device found, idVendor=8087, idProduct=800a, bcdDevice= 0.05 [ 2.707070] usb 4-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 2.707222] hub 4-1:1.0: USB hub found [ 2.707319] hub 4-1:1.0: 6 ports detected [ 2.709262] usb 2-12: New USB device found, idVendor=0557, idProduct=7000, bcdDevice= 0.00 [ 2.709265] usb 2-12: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 2.709770] hub 2-12:1.0: USB hub found [ 2.709851] hub 2-12:1.0: 4 ports detected [ 3.004669] usb 2-12.1: new low-speed USB device number 3 using xhci_hcd [ 3.107978] usb 2-12.1: New USB device found, idVendor=0557, idProduct=2419, bcdDevice= 1.00 [ 3.107980] usb 2-12.1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 3.112876] input: HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb2/2-12/2-12.1/2-12.1:1.0/0003:0557:2419.0001/input/input2 [ 3.164822] hid-generic 0003:0557:2419.0001: input,hidraw0: USB HID v1.00 Keyboard [HID 0557:2419] on usb-0000:00:14.0-12.1/input0 [ 3.167384] input: HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb2/2-12/2-12.1/2-12.1:1.1/0003:0557:2419.0002/input/input3 [ 3.167472] hid-generic 0003:0557:2419.0002: input,hidraw1: USB HID v1.00 Mouse [HID 0557:2419] on usb-0000:00:14.0-12.1/input1 [ 5.057116] clk: Disabling unused clocks [ 5.061953] Freeing unused decrypted memory: 2028K [ 5.067162] Freeing unused kernel image (initmem) memory: 3980K [ 5.073078] Write protecting the kernel read-only data: 30720k [ 5.079230] Freeing unused kernel image (rodata/data gap) memory: 1364K [ 5.124289] x86/mm: Checked W+X mappings: passed, no W+X pages found. [ 5.124291] x86/mm: Checking user space page tables [ 5.161672] x86/mm: Checked W+X mappings: passed, no W+X pages found. [ 5.161681] Run /init as init process [ 5.174508] systemd[1]: systemd 252-45.el9 running in system mode (+PAM +AUDIT +SELINUX -APPARMOR +IMA +SMACK +SECCOMP +GCRYPT +GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 -IDN -IPTC +KMOD +LIBCRYPTSETUP +LIBFDISK +PCRE2 -PWQUALITY +P11KIT -QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD -BPF_FRAMEWORK +XKBCOMMON +UTMP +SYSVINIT default-hierarchy=unified) [ 5.174611] systemd[1]: Detected architecture x86-64. [ 5.174613] systemd[1]: Running in initrd. Welcome to CentOS Stream 9 dracut-057-70.git20240819.el9 (Initramfs)! [ 5.225783] systemd[1]: Hostname set to . [ 5.284631] systemd[1]: Queued start job for default target Initrd Default Target. [ 5.284769] systemd[1]: Reached target Initrd /usr File System. [ OK ] Reached target Initrd /usr File System. [ OK [[ 5.305767] systemd[1]: Reached target Local File Systems. 0m] Reached target Local File Systems. [ 5.319836] systemd[1]: Reached target Slice Units. [ OK ] Reached target Slice Units. [ OK [[ 5.331753] systemd[1]: Reached target Swaps. 0m] Reached target Swaps. [ 5.342727] systemd[1]: Reached target Timer Units. [ OK ] Reached target Timer Units. [ OK [[ 5.354787] systemd[1]: Listening on D-Bus System Message Bus Socket. 0m] Listening on D-Bus System Message Bus Socket. [ OK [[ 5.369979] systemd[1]: Listening on Journal Socket (/dev/log). 0m] Listening on Journal Socket (/dev/log). [ OK [[ 5.383985] systemd[1]: Listening on Journal Socket. 0m] Listening on Journal Socket. [ OK [[ 5.395803] systemd[1]: Listening on udev Control Socket. 0m] Listening on udev Control Socket. [ OK [[ 5.409805] systemd[1]: Listening on udev Kernel Socket. 0m] Listening on udev Kernel Socket. [ OK [[ 5.422726] systemd[1]: Reached target Socket Units. 0m] Reached target Socket Units. [ 5.441371] systemd[1]: Starting Create List of Static Device Nodes... Starting Create List of Static Device Nodes... [ 5.457057] systemd[1]: Starting Journal Service... Starting Journal Service... [ 5.469408] systemd[1]: Starting Load Kernel Modules... Starting Load Kernel Modules... [ 5.482305] systemd[1]: Starting Create System Users... Starting Creat[ 5.488921] fuse: init (API version 7.36) e System Users... [ 5.498323] systemd[1]: Starting Setup Virtual Console... Starting Setup Virtual Console... [ 5.511406] systemd[1]: Started Journal Service. [ OK ] Started Journal Service. [ OK ] Finished Create List of Static Device Nodes. [ OK ] Finished Load Kernel Modules. Starting Apply Kernel Variables... [ OK ] Finished Setup Virtual Console. [ OK ] Finished Apply Kernel Variables. Starting dracut cmdline hook... [ OK ] Finished Create System Users. Starting Create Static Device Nodes in /dev... Starting Create Volatile Files and Directories... [ OK ] Finished dracut cmdline hook. [ OK ] Finished Create Static Device Nodes in /dev. [ OK ] Finished Create Volatile Files and Directories. Starting dracut pre-udev hook... [ OK ] Finished dracut pre-udev hook. Starting Rule-based Manager for Device Events and Files... [ OK ] Started Rule-based Manager for Device Events and Files. Starting Coldplug All udev Devices... [ OK ] Finished Coldplug All udev Devices. [ OK ] Reached target System Initialization. [ OK ] Reached target Network. Startin[ 5.890072] dca service started, version 1.12.1 g dracut initqueue hook... Starting Show [ 5.936228] igb: Intel(R) Gigabit Ethernet Network Driver Plymouth Boot Sc[ 5.936235] igb: Copyright (c) 2007-2014 Intel Corporation. reen... [ 5.955604] ixgbe: Intel(R) 10 Gigabit PCI Express Network Driver [ 5.955611] ixgbe: Copyright (c) 1999-2016 Intel Corporation. [ OK ] Started Show Plymouth Boot Screen. [ OK ] Started Forward Password Requests to Plymouth Directory Watch. [ OK ] Reac[ 5.983702] ahci 0000:00:11.4: AHCI vers 0001.0300, 32 command slots, 6 Gbps, SATA mode hed target [0;1[ 5.983710] ahci 0000:00:11.4: 4/4 ports implemented (port mask 0xf) [ 5.983712] ahci 0000:00:11.4: flags: 64bit ncq pm led clo pio slum part ems apst ;39mPath Units[[ 5.993001] scsi host0: ahci [ 5.993189] scsi host1: ahci 0m. [ [ 5.993295] scsi host2: ahci OK ] Reache[ 5.993522] scsi host3: ahci [ 5.993588] ata1: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438100 irq 50 lpm-pol 0 [ 5.993591] ata2: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438180 irq 50 lpm-pol 0 d target [0;1;3[ 5.993593] ata3: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438200 irq 50 lpm-pol 0 [ 5.993596] ata4: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438280 irq 50 lpm-pol 0 9mBasic System[[ 5.993887] igb 0000:07:00.0: added PHC on eth0 [ 5.993921] igb 0000:07:00.0: Intel(R) Gigabit Ethernet Network Connection [ 5.993923] igb 0000:07:00.0: eth0: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d8:da:66 [ 5.994001] igb 0000:07:00.0: eth0: PBA No: 050B00-000 [ 5.994002] igb 0000:07:00.0: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 5.994068] ahci 0000:00:1f.2: AHCI vers 0001.0300, 32 command slots, 6 Gbps, SATA mode [ 5.994071] ahci 0000:00:1f.2: 6/6 ports implemented (port mask 0x3f) [ 5.994073] ahci 0000:00:1f.2: flags: 64bit ncq pm led clo pio slum part ems apst [ 6.012453] ACPI: bus type drm_connector registered [ 6.015411] scsi host4: ahci [ 6.015736] scsi host5: ahci [ 6.015855] scsi host6: ahci [ 6.015960] scsi host7: ahci [ 6.016057] scsi host8: ahci [ 6.016152] scsi host9: ahci [ 6.016192] ata5: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432100 irq 51 lpm-pol 0 [ 6.016195] ata6: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432180 irq 51 lpm-pol 0 [ 6.016198] ata7: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432200 irq 51 lpm-pol 0 [ 6.016201] ata8: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432280 irq 51 lpm-pol 0 [ 6.016204] ata9: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432300 irq 51 lpm-pol 0 [ 6.016207] ata10: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432380 irq 51 lpm-pol 0 [ 6.058381] nvme nvme0: pci function 0000:02:00.0 [ 6.058384] igb 0000:07:00.1: added PHC on eth1 [ 6.058429] igb 0000:07:00.1: Intel(R) Gigabit Ethernet Network Connection [ 6.058430] igb 0000:07:00.1: eth1: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d8:da:67 [ 6.058520] igb 0000:07:00.1: eth1: PBA No: 050B00-000 [ 6.058521] igb 0000:07:00.1: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 6.060413] nvme nvme0: 8/0/0 default/read/poll queues 0m. [ 6.302656] ata1: SATA link down (SStatus 0 SControl 300) [ 6.302681] ata4: SATA link down (SStatus 0 SControl 300) [ 6.302713] ata3: SATA link down (SStatus 0 SControl 300) [ 6.302742] ata2: SATA link down (SStatus 0 SControl 300) [ 6.326554] ata9: SATA link down (SStatus 0 SControl 300) [ 6.326602] ata5: SATA link up 6.0 Gbps (SStatus 133 SControl 300) [ 6.326625] ata7: SATA link down (SStatus 0 SControl 300) [ 6.326647] ata10: SATA link down (SStatus 0 SControl 300) [ 6.326673] ata6: SATA link down (SStatus 0 SControl 300) [ 6.327615] ata5.00: ATA-9: ST1000NM0033-9ZM173, SN06, max UDMA/133 [ 6.328197] ata5.00: NCQ Send/Recv Log not supported [ 6.328198] ata5.00: 1953525168 sectors, multi 16: LBA48 NCQ (depth 32), AA [ 6.328415] ata8: SATA link down (SStatus 0 SControl 300) [ 6.329569] ata5.00: NCQ Send/Recv Log not supported [ 6.329573] ata5.00: configured for UDMA/133 [ 6.329682] scsi 4:0:0:0: Direct-Access ATA ST1000NM0033-9ZM SN06 PQ: 0 ANSI: 5 [ 6.345351] igb 0000:07:00.0 eno1: renamed from eth0 [ 6.374940] igb 0000:07:00.1 eno2: renamed from eth1 [ 6.407211] scsi 4:0:0:0: Attached scsi generic sg0 type 0 [ 6.418112] sd 4:0:0:0: [sda] 1953525168 512-byte logical blocks: (1.00 TB/932 GiB) [ 6.418129] sd 4:0:0:0: [sda] Write Protect is off [ 6.418146] sd 4:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA [ 6.418165] sd 4:0:0:0: [sda] Preferred minimum I/O size 512 bytes [ 6.435353] sda: sda1 [ 6.435413] sd 4:0:0:0: [sda] Attached SCSI removable disk [ 6.448211] ast 0000:06:00.0: vgaarb: deactivate vga console [ 6.459585] Console: switching to colour dummy device 80x25 [ 6.459736] ast 0000:06:00.0: Using P2A bridge for configuration [ 6.459738] ast 0000:06:00.0: AST 2400 detected [ 6.459787] ast 0000:06:00.0: [drm] Using analog VGA [ 6.459796] ast 0000:06:00.0: [drm] dram MCLK=408 Mhz type=1 bus_width=16 [ 6.459984] [drm] Initialized ast 0.1.0 20120228 for 0000:06:00.0 on minor 0 [ 6.465763] fbcon: astdrmfb (fb0) is primary device [ 6.495721] Console: switching to colour frame buffer device 128x48 [ 6.513018] ast 0000:06:00.0: [drm] fb0: astdrmfb frame buffer device [ OK ] Found device ST1000NM0033-9ZM173 1. [ OK ] Reached target Initrd Root Device. [ 7.093985] ixgbe 0000:03:00.0: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 7.094309] ixgbe 0000:03:00.0: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 7.094392] ixgbe 0000:03:00.0: MAC: 2, PHY: 1, PBA No: 0210FF-0FF [ 7.094393] ixgbe 0000:03:00.0: 0c:c4:7a:8f:47:e0 [ 7.096712] ixgbe 0000:03:00.0: Intel(R) 10 Gigabit Network Connection [ 7.252891] ixgbe 0000:03:00.1: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 7.253180] ixgbe 0000:03:00.1: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 7.253262] ixgbe 0000:03:00.1: MAC: 2, PHY: 14, SFP+: 4, PBA No: 0210FF-0FF [ 7.253263] ixgbe 0000:03:00.1: 0c:c4:7a:8f:47:e1 [ 7.256271] ixgbe 0000:03:00.1: Intel(R) 10 Gigabit Network Connection [ 7.272143] ixgbe 0000:03:00.0 enp3s0f0: renamed from eth0 [ 7.296056] ixgbe 0000:03:00.1 enp3s0f1: renamed from eth1 [ OK ] Finished dracut initqueue hook. [ OK ] Reached target Preparation for Remote File Systems. [ OK ] Reached target Remote File Systems. Starting File System Check on /dev…2923-554d-41e2-ac4a-c752ff079ceb... [ OK ] Finished File System Check on /dev…8d2923-554d-41e2-ac4a-c752ff079ceb. Mounting /sysroot... [ 7.518131] EXT4-fs (sda1): mounted filesystem fa8d2923-554d-41e2-ac4a-c752ff079ceb ro with ordered data mode. Quota mode: none. [ OK ] Mounted /sysroot. [ OK ] Reached target Initrd Root File System. Starting Mountpoints Configured in the Real Root... [ OK ] Finished Mountpoints Configured in the Real Root. [ OK ] Reached target Initrd File Systems. [ OK ] Reached target Initrd Default Target. Starting dracut pre-pivot and cleanup hook... [ OK ] Finished dracut pre-pivot and cleanup hook. Starting Cleaning Up and Shutting Down Daemons... [ OK ] Stopped target Network. [ OK ] Stopped target Timer Units. [ OK ] Closed D-Bus System Message Bus Socket. [ OK ] Stopped dracut pre-pivot and cleanup hook. [ OK ] Stopped target Initrd Default Target. [ OK ] Stopped target Basic System. [ OK ] Stopped target Initrd Root Device. [ OK ] Stopped target Initrd /usr File System. [ OK ] Stopped target Path Units. [ OK ] Stopped target Remote File Systems. [ OK ] Stopped target Preparation for Remote File Systems. [ OK ] Stopped target Slice Units. [ OK ] Stopped target Socket Units. [ OK ] Stopped target System Initialization. [ OK ] Stopped target Local File Systems. [ OK ] Stopped target Swaps. [ OK ] Stopped dracut initqueue hook. Starting Plymouth switch root service... [ OK ] Stopped Apply Kernel Variables. [ OK ] Stopped Load Kernel Modules. [ OK ] Stopped Create Volatile Files and Directories. [ OK ] Stopped Coldplug All udev Devices. Stopping Rule-based Manager for Device Events and Files... [ OK ] Stopped Rule-based Manager for Device Events and Files. [ OK ] Finished Cleaning Up and Shutting Down Daemons. [ OK ] Closed udev Control Socket. [ OK ] Closed udev Kernel Socket. [ OK ] Stopped dracut pre-udev hook. [ OK ] Stopped dracut cmdline hook. Starting Cleanup udev Database... [ OK ] Stopped Create Static Device Nodes in /dev. [ OK ] Stopped Create List of Static Device Nodes. [ OK ] Stopped Create System Users. [ OK ] Finished Cleanup udev Database. [ OK ] Reached target Switch Root. [ OK ] Finished Plymouth switch root service. Starting Switch Root... [ 7.872959] systemd-journald[282]: Received SIGTERM from PID 1 (systemd). [ 8.437336] SELinux: policy capability network_peer_controls=1 [ 8.437344] SELinux: policy capability open_perms=1 [ 8.437345] SELinux: policy capability extended_socket_class=1 [ 8.437346] SELinux: policy capability always_check_network=0 [ 8.437347] SELinux: policy capability cgroup_seclabel=1 [ 8.437348] SELinux: policy capability nnp_nosuid_transition=1 [ 8.437349] SELinux: policy capability genfs_seclabel_symlinks=1 [ 8.480870] audit: type=1403 audit(1726180488.650:2): auid=4294967295 ses=4294967295 lsm=selinux res=1 [ 8.482756] systemd[1]: Successfully loaded SELinux policy in 117.476ms. [ 8.547766] systemd[1]: Relabelled /dev, /dev/shm, /run, /sys/fs/cgroup in 25.782ms. [ 8.555606] systemd[1]: systemd 252-45.el9 running in system mode (+PAM +AUDIT +SELINUX -APPARMOR +IMA +SMACK +SECCOMP +GCRYPT +GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 -IDN -IPTC +KMOD +LIBCRYPTSETUP +LIBFDISK +PCRE2 -PWQUALITY +P11KIT -QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD -BPF_FRAMEWORK +XKBCOMMON +UTMP +SYSVINIT default-hierarchy=unified) [ 8.555729] systemd[1]: Detected architecture x86-64. Welcome to CentOS Stream 9! [ 9.538547] systemd[1]: initrd-switch-root.service: Deactivated successfully. [ 9.538678] systemd[1]: Stopped Switch Root. [ 9.545952] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. [ 9.546232] systemd[1]: Created slice Slice /system/getty. [ OK [[ 9.550262] systemd[1]: Created slice Slice /system/modprobe. 0m] Stopped [0;[ 9.559122] systemd[1]: Created slice Slice /system/serial-getty. [ 9.564627] systemd[1]: Created slice Slice /system/sshd-keygen. 1;39mSwitch Root[ 9.585201] systemd[1]: Created slice User and Session Slice. . [[ 9.592091] systemd[1]: Dispatch Password Requests to Console Directory Watch was skipped because of an unmet condition check (ConditionPathExists=!/run/plymouth/pid). [ 9.592191] systemd[1]: Started Forward Password Requests to Wall Directory Watch. OK ] Crea[ 9.608716] systemd[1]: Set up automount Arbitrary Executable File Formats File System Automount Point. [ 9.615983] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mon@.service instances at once. ted slice [0;1;[ 9.626730] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mds@.service instances at once. [ 9.637053] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mgr@.service instances at once. 39mSlice /system[ 9.637078] systemd[1]: Reached target ceph target allowing to start/stop all ceph-osd@.service instances at once. [ 9.648767] systemd[1]: Reached target ceph target allowing to start/stop all ceph-radosgw@.service instances at once. /getty. [[ 9.659113] systemd[1]: Reached target ceph target allowing to start/stop all ceph-rbd-mirror@.service instances at once. [ 9.670820] systemd[1]: Reached target Local Encrypted Volumes. [0;32m OK [ 9.681507] systemd[1]: Stopped target Switch Root. [ 9.693822] systemd[1]: Stopped target Initrd File Systems. ] Created slice [ 9.699727] systemd[1]: Stopped target Initrd Root File System. [ 9.699756] systemd[1]: Reached target Local Integrity Protected Volumes. Slice /[ 9.706001] systemd[1]: Reached target Path Units. [ 9.711564] systemd[1]: Reached target Slice Units. system/modprobe[ 9.718853] systemd[1]: Reached target Swaps. [ 9.725629] systemd[1]: Reached target Local Verity Protected Volumes. [0m. [ [ 9.726000] systemd[1]: Listening on Device-mapper event daemon FIFOs. [ 9.732712] systemd[1]: Listening on LVM2 poll daemon socket. OK ] Creat[ 9.760948] systemd[1]: Listening on RPCbind Server Activation Socket. [ 9.762619] systemd[1]: Reached target RPC Port Mapper. ed slice [0;1;3[ 9.775264] systemd[1]: Listening on Process Core Dump Socket. [ 9.775817] systemd[1]: Listening on initctl Compatibility Named Pipe. 9mSlice /system/[ 9.783645] systemd[1]: Listening on udev Control Socket. [ 9.789674] systemd[1]: Listening on udev Kernel Socket. serial-getty[ 9.797061] systemd[1]: Mounting Huge Pages File System... [ 9.802370] systemd[1]: Mounting POSIX Message Queue File System... . [ OK[ 9.809201] systemd[1]: Mounting Kernel Debug File System... [ 9.815412] systemd[1]: Mounting Kernel Trace File System... ] Created [ 9.821762] systemd[1]: Kernel Module supporting RPCSEC_GSS was skipped because of an unmet condition check (ConditionPathExists=/etc/krb5.keytab). [ 9.839824] systemd[1]: Starting Create List of Static Device Nodes... slice S[ 9.842729] systemd[1]: Starting Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling... [ 9.849288] systemd[1]: Starting Load Kernel Module configfs... lice /system/ssh[ 9.860888] systemd[1]: Starting Load Kernel Module drm... [ 9.866763] systemd[1]: Starting Load Kernel Module fuse... d-keygen. [ 9.873894] systemd[1]: Starting Read and set NIS domainname from /etc/sysconfig/network... [ 9.878481] systemd[1]: plymouth-switch-root.service: Deactivated successfully. [ OK [[ 9.878523] systemd[1]: Stopped Plymouth switch root service. 0m] Created slic[ 9.888309] systemd[1]: Stopped Journal Service. e User [ 9.909122] systemd[1]: Starting Journal Service... and Session Slice. [ OK ] Started Forward Password Requests to Wall Directory Watch. [ OK ] Set up automount Arbitrary Executa…ormats File System Automount Point. [ OK ] Reached target ceph target allowin…eph-mon@.service instances [ 9.941959] systemd[1]: Starting Load Kernel Modules... [ 9.942749] systemd[1]: Starting Generate network units from Kernel command line... at once. [[ 9.947839] systemd[1]: TPM2 PCR Machine ID Measurement was skipped because of an unmet condition check (ConditionPathExists=/sys/firmware/efi/efivars/StubPcrKernelImage-4a67b082-0a4c-41cf-b6c7-440b29bb8c4f).  OK [0[ 9.948710] systemd[1]: Starting Remount Root and Kernel File Systems... [ 9.955541] systemd[1]: Repartition Root Disk was skipped because no trigger condition checks were met. m] Reached targe[ 9.956789] systemd[1]: Starting Coldplug All udev Devices... [ 9.976965] systemd[1]: Started Journal Service. t ceph target allowin…eph-mds@.service instances at once. [ OK ] Reached target ceph target allowin…eph[ 10.016712] EXT4-fs (sda1): re-mounted fa8d2923-554d-41e2-ac4a-c752ff079ceb r/w. Quota mode: none. -mgr@.service instances at once. [ OK ] Reached target ceph target allowin…eph-osd@.service instances at once. [ OK ] Reached target ceph target allowin…radosgw@.service instances at once. [ OK ] Reached target ceph target allowin…-mirror@.service instances at once. [ OK ] Reached target Local Encrypted Volumes. [ OK ] Stopped target [0;1;3[ 10.066516] systemd-journald[579]: Received client request to flush runtime journal. 9mSwitch Root. [ OK ] Stopped target Initrd File Systems. [ OK ] Stopped target Initrd Root File System. [ OK ] Reached target Local Integrity Protected Volumes. [ OK ] Reached target Path Units. [ OK ] Reached target Slice Units. [ OK ] Reached target Swaps. [ OK ] Reached target Local Verity Protected Volumes. [ OK ] Listening on Device-mapper event daemon FIFOs. [ OK ] Listening on LVM2 poll daemon socket. [ OK ] Listening on RPCbind Server Activation Socket. [ OK ] Reached target RPC Port Mapper. [ OK ] Listening on Process Core Dump Socket. [ OK ] Listening on initctl Compatibility Named Pipe. [ OK ] Listening on udev Control Socket. [ O[ 10.165772] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. [ 10.165793] device-mapper: uevent: version 1.0.3 [ 10.165880] device-mapper: ioctl: 4.48.0-ioctl (2023-03-01) initialised: dm-devel@redhat.com K ] Listening on udev Kernel Socket. Mounting Huge Pages File System... Mounting POSIX Message Queue File System... Mounting Kernel Debug File System... Mounting Kernel Trace File System... Starting Create List of Static Device Nodes... Starting Monitoring of LVM2 mirror…ing dmeventd or progress polling... Starting Load Kernel Module configfs... Starting Load Kernel Module drm... Starting Load Kernel Module fuse... Starting Read and set NIS domainname from /etc/sysconfig/network... [ OK ] Stopped Plymouth switch root service. [ OK ] Stopped Journal Service. Starting Journal Service... Starting Load Kernel Modules... Starting Generate network units from Kernel command line... Starting Remount Root and Kernel File Systems... Starting Coldplug All udev Devices... [ OK ] Started Journal Service. [ OK ] Mounted Huge Pages File System. [ OK ] Mounted POSIX Message Queue File System. [ OK ] Mounted Kernel Debug File System. [ OK ] Mounted Kernel Trace File System. [ OK ] Finished Create List of Static Device Nodes. [ OK ] Finished Load Kernel Module configfs. [ OK ] Finished Load Kernel Module drm. [ OK ] Finished Load Kernel Module fuse. [ OK ] Finished Read and set NIS domainname from /etc/sysconfig/network. [ OK ] Finished Load Kernel Modules. [ OK ] Finished Generate network units from Kernel command line. [ OK ] Reached target Preparation for Network. Mounting FUSE Control File System... Mounting Kernel Configuration File System... Starting Apply Kernel Variables... [ OK ] Mounted FUSE Control File System. [ OK ] Mounted Kernel Configuration File System. [ OK ] Finished Remount Root and Kernel File Systems. Starting Flush Journal to Persistent Storage... Starting Load/Save OS Random Seed... Starting Create Static Device Nodes in /dev... [ OK ] Finished Apply Kernel Variables. [ OK ] Finished Flush Journal to Persistent Storage. [ OK ] Finished Coldplug All udev Devices. [ OK ] Finished Load/Save OS Random Seed. [ OK ] Finished Monitoring of LVM2 mirror…using dmeventd or progress polling. [ OK ] Finished Create Static Device Nodes in /dev. Starting Rule-based Manager for Device Events and Files... [ OK ] Started Rule-based Manager for Device Events and Files. [ OK ] Reached target Preparation for Local File Systems. [ OK ] Reached target Local File Systems. Starting Tell Plymouth To Write Out Runtime Data... Starting Automatic Boot Loader Update... Starting Create Volatile Files and Directories... Starting Load Kernel Module configfs... Starting Load Kernel Module fuse... [ OK ] Finished Load Kernel Module configfs. [ OK ] Finished Load Kernel Module fuse. [ 10.679427] IPMI message handler: version 39.2 [ 10.686507] ipmi device interface [ 10.695782] ipmi_si: IPMI System Interface driver [ 10.695806] ipmi_si dmi-ipmi-si.0: ipmi_platform: probing via SMBIOS [ 10.695809] ipmi_platform: ipmi_si: SMBIOS: io 0xca2 regsize 1 spacing 1 irq 0 [ 10.695812] ipmi_si: Adding SMBIOS-specified kcs state machine [ 10.695868] ipmi_si IPI0001:00: ipmi_platform: probing via ACPI [ 10.695968] ipmi_si IPI0001:00: ipmi_platform: [io 0x0ca2] regsize 1 spacing 1 irq 0 [ 10.697653] ipmi_si dmi-ipmi-si.0: Removing SMBIOS-specified kcs state machine in favor of ACPI [ 10.697656] ipmi_si: Adding ACPI-specified kcs state machine [ 10.697732] ipmi_si: Trying ACPI-specified kcs state machine at i/o address 0xca2, slave address 0x20, irq 0 [ 10.752898] power_meter ACPI000D:00: Found ACPI power meter. [ OK [[ 10.752920] power_meter ACPI000D:00: Ignoring unsafe software power cap! 0m] Finished [0[ 10.752925] power_meter ACPI000D:00: hwmon_device_register() is deprecated. Please convert the driver to use hwmon_device_register_with_info(). ;1;39mAutomatic Boot Loader Update. [ OK ] Finished Tell Plymouth To[ 10.793119] ioatdma: Intel(R) QuickData Technology Driver 5.00 Write Out Runti[ 10.793216] input: PC Speaker as /devices/platform/pcspkr/input/input4 me Data. [ 10.801677] ipmi_si IPI0001:00: The BMC does not support clearing the recv irq bit, compensating, but the BMC needs to be fixed. [ 10.802563] igb 0000:07:00.0: DCA enabled [ 10.802584] igb 0000:07:00.1: DCA enabled [ 10.829779] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt [ 10.830790] i2c i2c-3: 2/8 memory slots populated (from DMI) [ 10.846407] ipmi_si IPI0001:00: IPMI message handler: Found new BMC (man_id: 0x002a7c, prod_id: 0x0833, dev_id: 0x20) [ 10.857567] mei_me 0000:00:16.0: Device doesn't have valid ME Interface [ OK ] Started /usr/sbin/lvm vgchange -aay --autoactivation event vg_nvme. [ 10.881966] RAPL PMU: API unit is 2^-32 Joules, 2 fixed counters, 655360 ms ovfl timer [ 10.881973] RAPL PMU: hw unit of domain package 2^-14 Joules [ 10.881978] RAPL PMU: hw unit of domain dram 2^-16 Joules [ OK ] Finished Create Volatile Files and Directories. [ 10.931295] iTCO_vendor_support: vendor-support=0 Starting Security Auditing Service... Starting RPC Bind... [ 10.963794] ipmi_si IPI0001:00: IPMI kcs interface initialized [ 10.973996] ipmi_ssif: IPMI SSIF Interface driver [ 10.983028] iTCO_wdt iTCO_wdt.1.auto: Found a Wellsburg TCO device (Version=2, TCOBASE=0x0460) [ 10.984710] iTCO_wdt iTCO_wdt.1.auto: initialized. heartbeat=30 sec (nowayout=0) Mounting RPC Pipe File System... [ OK ] Found device /dev/vg_nvme/lv_5. Mounting /var/lib/ceph... [ 11.128614] RPC: Registered named UNIX socket transport module. [ 11.128618] RPC: Registered udp transport module. [ 11.128621] RPC: Registered tcp transport module. [ 11.128621] RPC: Registered tcp-with-tls transport module. [ 11.128622] RPC: Registered tcp NFSv4.1 backchannel transport module. [ OK ] Mounted RPC Pipe File System. [ OK ] Reached target rpc_pipefs.target. [ 11.267613] EDAC MC0: Giving out device to module sb_edac controller Broadwell SrcID#0_Ha#0: DEV 0000:ff:12.0 (INTERRUPT) [ 11.267617] EDAC sbridge: Ver: 1.1.2 [ OK ] Started RPC Bind. [ OK ] Started Security Auditing Service. Starting Record System Boot/Shutdown in UTMP... [ OK ] Finished Record System Boot/Shutdown in UTMP. [ OK [ 11.496291] SGI XFS with ACLs, security attributes, scrub, quota, no debug enabled [0m] Reached target System Initializati[ 11.508856] XFS (dm-4): Deprecated V4 format (crc=0) will not be supported beginning with RHEL10 on. [[0;3[ 11.508985] XFS (dm-4): Mounting V4 Filesystem 2858b88a-50ca-44b7-b84a-9d395855c4bf [ 11.513318] XFS (dm-4): Ending clean mount [ 11.513357] xfs filesystem being mounted at /var/lib/ceph supports timestamps until 2038 (0x7fffffff) 2m OK ] St[ 11.540677] intel_rapl_common: Found RAPL domain package [ 11.540684] intel_rapl_common: Found RAPL domain dram arted Daily rotation of log files. [ OK ] Started Updates mlocate database every day. [ OK ] Started Run system activity accounting tool every 10 minutes. [ OK ] Started Generate summary of yesterday's process accounting. [ OK ] Started Daily Cleanup of Temporary Directories. [ OK ] Reached target Timer Units. [ OK ] Listening on D-Bus System Message Bus Socket. [ OK ] Listening on SSSD Kerberos Cache Manager responder socket. [ OK ] Reached target Socket Units. Starting D-Bus System Message Bus... [ OK ] Mounted /var/lib/ceph. [ OK ] Started D-Bus System Message Bus. [ OK ] Reached target Basic System. Starting Network Manager... [ OK ] Started Ceph crash dump collector. [ OK ] Reached target ceph target allowin…l ceph*@.service instances at once. Starting NTP client/server... Starting Restore /run/initramfs on shutdown... [ OK ] Started irqbalance daemon. [ OK ] Started libstoragemgmt plug-in server daemon. [ OK ] Started Machine Check Exception Logging Daemon. Starting Self Monitoring and Reporting Technology (SMART) Daemon... [ OK ] Reached target sshd-keygen.target. [ OK ] Reached target User and Group Name Lookups. Starting Resets System Activity Logs... Starting User Login Management... [ OK ] Finished Restore /run/initramfs on shutdown. [ OK ] Started User Login Management. [ OK ] Finished Resets System Activity Logs. [ OK ] Started NTP client/server. [ OK ] Started Self Monitoring and Reporting Technology (SMART) Daemon. [* ] A start job is running for Network Manager (5s / no limit) M  Starting Hostname Service... [ OK ] Started Hostname Service. [ OK ] Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. Starting Network Manager Script Dispatcher Service... [ OK ] Started Network Manager Script Dispatcher Service. [ 15.473978] ixgbe 0000:03:00.0: registered PHC device on enp3s0f0 [ 15.618484] ixgbe 0000:03:00.1: registered PHC device on enp3s0f1 [ OK ] Started Network Manager. [ OK ] Reached target Network. Starting Network Manager Wait Online... Starting GSSAPI Proxy Daemon... [ 15.852884] ixgbe 0000:03:00.1 enp3s0f1: detected SFP+: 4 Starting OpenSSH server daemon... [ OK ] Started OpenSSH server daemon. [ 16.032875] ixgbe 0000:03:00.1 enp3s0f1: NIC Link is Up 10 Gbps, Flow Control: RX/TX [ 16.033021] IPv6: ADDRCONF(NETDEV_CHANGE): enp3s0f1: link becomes ready [ OK ] Started GSSAPI Proxy Daemon. [ OK ] Reached target NFS client services. [ OK ] Reached target Preparation for Remote File Systems. [ OK ] Reached target Remote File Systems. Starting Permit User Sessions... [ OK ] Finished Permit User Sessions. [ OK ] Started Deferred execution scheduler. [ OK ] Started Command Scheduler. [** ] A start job is running for Network Manager Wait Online (8s / no limit) M [*** ] A start job is running for Network Manager Wait Online (9s / no limit) M [ *** ] A start job is running for Network Manager Wait Online (9s / no limit) M [ *** ] A start job is running for Network …nager Wait Online (10s / no limit) M [ ***] A start job is running for Network …nager Wait Online (10s / no limit) M [ **] A start job is running for Network …nager Wait Online (11s / no limit) M [ *] A start job is running for Network …nager Wait Online (11s / no limit) M [ OK ] Finished Network Manager Wait Online. [ OK ] Reached target Network is Online. Starting Crash recovery kernel arming... [ OK ] Started Nagios Remote Plugin Executor. Starting /etc/rc.d/rc.local Compatibility... Starting Notify NFS peers of a restart... Starting System Logging Service... [ OK ] Started Notify NFS peers of a restart. + '[' '!' -f /.cephlab_net_configured ']' + set +e + attempts=0 + myips= + '[' '' '!=' '' ']' + '[' 0 -ge 10 ']' ++ ip -4 addr ++ grep -oP '(?<=inet\s)\d+(\.\d+){3}' ++ grep -v '127.0.0.1\|127.0.1.1' + myips=172.21.15.76 + attempts=1 + sleep 1 [ OK ] Started System Logging Service. Starting SETroubleshoot daemon for…ocessing new SELinux denial logs... + '[' 172.21.15.76 '!=' '' ']' + set -e + '[' -n 172.21.15.76 ']' + for ip in $myips + timeout 1s ping -I 172.21.15.76 -nq -c1 172.21.0.1 ++ dig +short -x 172.21.15.76 @172.21.0.1 ++ sed 's/\.com.*/\.com/g' [ 22.769466] block sda: the capability attribute has been deprecated. + newhostname=smithi076.front.sepia.ceph.com + '[' -n smithi076.front.sepia.ceph.com ']' + hostname smithi076.front.sepia.ceph.com ++ hostname -d + newdomain=front.sepia.ceph.com ++ hostname -s + shorthostname=smithi076 + echo smithi076 + grep -q front.sepia.ceph.com /etc/hosts + sed -i 's/.*front.sepia.ceph.com.*/172.21.15.76 smithi076.front.sepia.ceph.com smithi076/g' /etc/hosts + break + command -v zypper + command -v apt-get + '[' -e /.cephlab_rc_local ']' + exit 0 [ OK ] Started /etc/rc.d/rc.local Compatibility. Starting Hold until boot process finishes up... Starting Terminate Plymouth Boot Screen... CentOS Stream 9 Kernel 5.14.0-505.el9.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket smithi076 login: [disconnect] 2024-09-12T22:35:09.566 INFO:teuthology.misc:Re-opening connections... 2024-09-12T22:35:09.566 INFO:teuthology.misc:trying to connect to ubuntu@smithi076.front.sepia.ceph.com 2024-09-12T22:35:09.566 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi076.front.sepia.ceph.com' 2024-09-12T22:35:09.568 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T22:35:09.823 DEBUG:teuthology.orchestra.run.smithi076:> true 2024-09-12T22:35:10.198 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi076.front.sepia.ceph.com' 2024-09-12T22:35:10.199 DEBUG:teuthology.misc:waited 0.6328229904174805 2024-09-12T22:35:11.200 DEBUG:tasks.ceph_manager:Mounting data for osd.0 on ubuntu@smithi076.front.sepia.ceph.com 2024-09-12T22:35:11.200 INFO:tasks.ceph_manager:Mounting osd.0: dev: ubuntu@smithi076.front.sepia.ceph.com, cluster: cephmountpoint: /var/lib/ceph/osd/ceph-0, type: xfs, options: ['noatime'] 2024-09-12T22:35:11.200 DEBUG:teuthology.orchestra.run.smithi076:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-12T22:35:11.386 DEBUG:teuthology.orchestra.run.smithi076:> sudo install -d -m0777 -- /var/run/ceph 2024-09-12T22:35:11.485 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-12T22:35:11.486 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-12T22:35:11.488 INFO:tasks.ceph.osd.0:Started 2024-09-12T22:35:11.488 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:35:11.642 INFO:teuthology.orchestra.run.smithi076.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2024-09-12T22:35:11.645 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-12T22:35:11.645 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-0, ['dump_ops_in_flight'] 2024-09-12T22:35:11.984 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~146s 2024-09-12T22:35:13.844 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:35:13.842+0000 7f3ded61a640 -1 Falling back to public interface 2024-09-12T22:35:16.647 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:35:16.769 INFO:teuthology.orchestra.run.smithi076.stderr:no valid command found; 10 closest matches: 2024-09-12T22:35:16.769 INFO:teuthology.orchestra.run.smithi076.stderr:0 2024-09-12T22:35:16.769 INFO:teuthology.orchestra.run.smithi076.stderr:1 2024-09-12T22:35:16.769 INFO:teuthology.orchestra.run.smithi076.stderr:2 2024-09-12T22:35:16.769 INFO:teuthology.orchestra.run.smithi076.stderr:abort 2024-09-12T22:35:16.770 INFO:teuthology.orchestra.run.smithi076.stderr:assert 2024-09-12T22:35:16.770 INFO:teuthology.orchestra.run.smithi076.stderr:config diff 2024-09-12T22:35:16.770 INFO:teuthology.orchestra.run.smithi076.stderr:config diff get 2024-09-12T22:35:16.770 INFO:teuthology.orchestra.run.smithi076.stderr:config get 2024-09-12T22:35:16.770 INFO:teuthology.orchestra.run.smithi076.stderr:config help [] 2024-09-12T22:35:16.770 INFO:teuthology.orchestra.run.smithi076.stderr:config set ... 2024-09-12T22:35:16.770 INFO:teuthology.orchestra.run.smithi076.stderr:admin_socket: invalid command 2024-09-12T22:35:16.771 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-12T22:35:16.772 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-0, ['dump_ops_in_flight'] 2024-09-12T22:35:17.894 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2024-09-12T22:35:18.276 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:35:18.275+0000 7f3ded61a640 -1 osd.0 42 log_to_monitors true 2024-09-12T22:35:18.768 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-09-12T22:35:18.767+0000 7f3de13b8640 -1 osd.0 42 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T22:35:21.773 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T22:35:21.902 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-09-12T22:35:21.902 INFO:teuthology.orchestra.run.smithi076.stdout: "ops": [], 2024-09-12T22:35:21.902 INFO:teuthology.orchestra.run.smithi076.stdout: "num_ops": 0 2024-09-12T22:35:21.902 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-09-12T22:35:26.913 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=600 2024-09-12T22:35:27.044 INFO:teuthology.orchestra.run.smithi019.stdout:mon.a: {} 2024-09-12T22:35:27.044 INFO:teuthology.orchestra.run.smithi019.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-12T22:35:27.052 INFO:teuthology.orchestra.run.smithi019.stdout:mon.b: {} 2024-09-12T22:35:27.053 INFO:teuthology.orchestra.run.smithi019.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-12T22:35:27.061 INFO:teuthology.orchestra.run.smithi019.stdout:mon.c: {} 2024-09-12T22:35:27.061 INFO:teuthology.orchestra.run.smithi019.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-12T22:35:27.072 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-12T22:35:27.728 INFO:teuthology.orchestra.run.smithi019.stderr:reweighted osd.1 to 1 (10000) 2024-09-12T22:35:27.743 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 1 2024-09-12T22:35:28.729 INFO:teuthology.orchestra.run.smithi019.stderr:set osd.1 primary-affinity to 1 (8655362) 2024-09-12T22:35:28.745 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-12T22:35:29.732 INFO:teuthology.orchestra.run.smithi019.stderr:reweighted osd.2 to 1 (10000) 2024-09-12T22:35:29.749 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 2 1 2024-09-12T22:35:30.724 INFO:teuthology.orchestra.run.smithi019.stderr:set osd.2 primary-affinity to 1 (8655362) 2024-09-12T22:35:30.742 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-12T22:35:31.726 INFO:teuthology.orchestra.run.smithi019.stderr:reweighted osd.0 to 1 (10000) 2024-09-12T22:35:31.742 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 0 1 2024-09-12T22:35:32.751 INFO:teuthology.orchestra.run.smithi019.stderr:set osd.0 primary-affinity to 1 (8655362) 2024-09-12T22:35:32.768 INFO:tasks.thrashosds.thrasher:joining the do_sighup greenlet 2024-09-12T22:35:32.769 INFO:tasks.thrashosds.thrasher:joining the do_optrack_toggle greenlet 2024-09-12T22:35:32.769 INFO:tasks.thrashosds.thrasher:joining the do_dump_ops greenlet 2024-09-12T22:35:32.769 INFO:tasks.thrashosds.thrasher:joining the do_noscrub_toggle greenlet 2024-09-12T22:35:32.769 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-12T22:35:32.769 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T22:35:33.067 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:35:33.067 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":79,"fsid":"957ce235-19cb-4350-8fee-febd6e3f2199","created":"2024-09-12T22:31:15.903133+0000","modified":"2024-09-12T22:35:32.746956+0000","last_up_change":"2024-09-12T22:35:19.733135+0000","last_in_change":"2024-09-12T22:31:16.757598+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T22:31:26.228956+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T22:31:30.975989+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":16,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-12T22:31:35.267679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-12T22:31:35.724475+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.0800000429153442,"score_stable":1.0800000429153442,"optimal_score":1,"raw_score_acting":1.0800000429153442,"raw_score_stable":1.0800000429153442,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73b96314-15d5-4058-9993-ac103e997b27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":42,"up_from":66,"up_thru":77,"down_at":43,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6800","nonce":1671177249},{"type":"v1","addr":"172.21.15.76:6801","nonce":1671177249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6802","nonce":1671177249},{"type":"v1","addr":"172.21.15.76:6803","nonce":1671177249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6806","nonce":1671177249},{"type":"v1","addr":"172.21.15.76:6807","nonce":1671177249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6804","nonce":1671177249},{"type":"v1","addr":"172.21.15.76:6805","nonce":1671177249}]},"public_addr":"172.21.15.76:6801/1671177249","cluster_addr":"172.21.15.76:6803/1671177249","heartbeat_back_addr":"172.21.15.76:6807/1671177249","heartbeat_front_addr":"172.21.15.76:6805/1671177249","state":["exists","up"]},{"osd":1,"uuid":"f82ad621-e9cf-41cb-b9c0-43470cf7ddb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":616952176},{"type":"v1","addr":"172.21.15.148:6801","nonce":616952176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":616952176},{"type":"v1","addr":"172.21.15.148:6803","nonce":616952176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":616952176},{"type":"v1","addr":"172.21.15.148:6807","nonce":616952176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":616952176},{"type":"v1","addr":"172.21.15.148:6805","nonce":616952176}]},"public_addr":"172.21.15.148:6801/616952176","cluster_addr":"172.21.15.148:6803/616952176","heartbeat_back_addr":"172.21.15.148:6807/616952176","heartbeat_front_addr":"172.21.15.148:6805/616952176","state":["exists","up"]},{"osd":2,"uuid":"f30dda36-a84c-4a01-a81a-afbfb88c0aed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":533442754},{"type":"v1","addr":"172.21.15.163:6801","nonce":533442754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":533442754},{"type":"v1","addr":"172.21.15.163:6803","nonce":533442754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":533442754},{"type":"v1","addr":"172.21.15.163:6807","nonce":533442754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":533442754},{"type":"v1","addr":"172.21.15.163:6805","nonce":533442754}]},"public_addr":"172.21.15.163:6801/533442754","cluster_addr":"172.21.15.163:6803/533442754","heartbeat_back_addr":"172.21.15.163:6807/533442754","heartbeat_front_addr":"172.21.15.163:6805/533442754","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T22:31:23.899591+0000","dead_epoch":42},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T22:31:22.988274+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T22:31:23.932109+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"3.5","osds":[0,1]},{"pgid":"4.19","osds":[2,0]}],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T22:35:33.081 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-12T22:35:33.081 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T22:35:33.371 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:35:33.372 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":79,"fsid":"957ce235-19cb-4350-8fee-febd6e3f2199","created":"2024-09-12T22:31:15.903133+0000","modified":"2024-09-12T22:35:32.746956+0000","last_up_change":"2024-09-12T22:35:19.733135+0000","last_in_change":"2024-09-12T22:31:16.757598+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T22:31:26.228956+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T22:31:30.975989+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":16,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-12T22:31:35.267679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-12T22:31:35.724475+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.0800000429153442,"score_stable":1.0800000429153442,"optimal_score":1,"raw_score_acting":1.0800000429153442,"raw_score_stable":1.0800000429153442,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73b96314-15d5-4058-9993-ac103e997b27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":42,"up_from":66,"up_thru":77,"down_at":43,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6800","nonce":1671177249},{"type":"v1","addr":"172.21.15.76:6801","nonce":1671177249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6802","nonce":1671177249},{"type":"v1","addr":"172.21.15.76:6803","nonce":1671177249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6806","nonce":1671177249},{"type":"v1","addr":"172.21.15.76:6807","nonce":1671177249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6804","nonce":1671177249},{"type":"v1","addr":"172.21.15.76:6805","nonce":1671177249}]},"public_addr":"172.21.15.76:6801/1671177249","cluster_addr":"172.21.15.76:6803/1671177249","heartbeat_back_addr":"172.21.15.76:6807/1671177249","heartbeat_front_addr":"172.21.15.76:6805/1671177249","state":["exists","up"]},{"osd":1,"uuid":"f82ad621-e9cf-41cb-b9c0-43470cf7ddb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":616952176},{"type":"v1","addr":"172.21.15.148:6801","nonce":616952176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":616952176},{"type":"v1","addr":"172.21.15.148:6803","nonce":616952176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":616952176},{"type":"v1","addr":"172.21.15.148:6807","nonce":616952176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":616952176},{"type":"v1","addr":"172.21.15.148:6805","nonce":616952176}]},"public_addr":"172.21.15.148:6801/616952176","cluster_addr":"172.21.15.148:6803/616952176","heartbeat_back_addr":"172.21.15.148:6807/616952176","heartbeat_front_addr":"172.21.15.148:6805/616952176","state":["exists","up"]},{"osd":2,"uuid":"f30dda36-a84c-4a01-a81a-afbfb88c0aed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":533442754},{"type":"v1","addr":"172.21.15.163:6801","nonce":533442754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":533442754},{"type":"v1","addr":"172.21.15.163:6803","nonce":533442754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":533442754},{"type":"v1","addr":"172.21.15.163:6807","nonce":533442754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":533442754},{"type":"v1","addr":"172.21.15.163:6805","nonce":533442754}]},"public_addr":"172.21.15.163:6801/533442754","cluster_addr":"172.21.15.163:6803/533442754","heartbeat_back_addr":"172.21.15.163:6807/533442754","heartbeat_front_addr":"172.21.15.163:6805/533442754","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T22:31:23.899591+0000","dead_epoch":42},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T22:31:22.988274+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T22:31:23.932109+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"3.5","osds":[0,1]},{"pgid":"4.19","osds":[2,0]}],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T22:35:33.385 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-12T22:35:33.385 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-12T22:35:33.386 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-12T22:35:33.530 INFO:teuthology.orchestra.run.smithi019.stdout:34359738422 2024-09-12T22:35:33.530 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T22:35:33.548 INFO:teuthology.orchestra.run.smithi019.stdout:38654705718 2024-09-12T22:35:33.549 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T22:35:33.549 INFO:teuthology.orchestra.run.smithi019.stdout:283467841540 2024-09-12T22:35:33.550 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T22:35:33.837 INFO:teuthology.orchestra.run.smithi019.stdout:34359738421 2024-09-12T22:35:33.850 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738422 got 34359738421 for osd.1 2024-09-12T22:35:33.892 INFO:teuthology.orchestra.run.smithi019.stdout:283467841539 2024-09-12T22:35:33.899 INFO:teuthology.orchestra.run.smithi019.stdout:38654705717 2024-09-12T22:35:33.906 INFO:tasks.ceph.ceph_manager.ceph:need seq 283467841540 got 283467841539 for osd.0 2024-09-12T22:35:33.913 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705718 got 38654705717 for osd.2 2024-09-12T22:35:34.852 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T22:35:34.907 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T22:35:34.914 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T22:35:35.188 INFO:teuthology.orchestra.run.smithi019.stdout:34359738422 2024-09-12T22:35:35.203 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738422 got 34359738422 for osd.1 2024-09-12T22:35:35.203 DEBUG:teuthology.parallel:result is None 2024-09-12T22:35:35.221 INFO:teuthology.orchestra.run.smithi019.stdout:283467841541 2024-09-12T22:35:35.235 INFO:tasks.ceph.ceph_manager.ceph:need seq 283467841540 got 283467841541 for osd.0 2024-09-12T22:35:35.235 DEBUG:teuthology.parallel:result is None 2024-09-12T22:35:35.270 INFO:teuthology.orchestra.run.smithi019.stdout:38654705718 2024-09-12T22:35:35.284 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705718 got 38654705718 for osd.2 2024-09-12T22:35:35.284 DEBUG:teuthology.parallel:result is None 2024-09-12T22:35:35.284 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-12T22:35:35.285 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T22:35:35.620 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:35:35.623 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-12T22:35:35.630 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":203,"stamp":"2024-09-12T22:35:34.252943+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":127859341,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":2926,"num_read_kb":1537360,"num_write":29160,"num_write_kb":4400295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5694,"num_bytes_recovered":54520159,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33059,"ondisk_log_size":33059,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":492940,"kb_used_data":251836,"kb_used_omap":9,"kb_used_meta":241014,"kb_avail":282622580,"statfs":{"total":289910292480,"available":289405521920,"internally_reserved":0,"allocated":257880064,"data_stored":256696256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9227,"internal_metadata":246799349},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-1580,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":78,"num_bytes_recovered":-33525457,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000724"},"pg_stats":[{"pgid":"4.3f","version":"60'422","reported_seq":536,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.753683+0000","last_change":"2024-09-12T22:35:30.733306+0000","last_active":"2024-09-12T22:35:33.753683+0000","last_peered":"2024-09-12T22:35:33.753683+0000","last_clean":"2024-09-12T22:35:33.753683+0000","last_became_active":"2024-09-12T22:35:30.731323+0000","last_became_peered":"2024-09-12T22:35:30.731323+0000","last_unstale":"2024-09-12T22:35:33.753683+0000","last_undegraded":"2024-09-12T22:35:33.753683+0000","last_fullsized":"2024-09-12T22:35:33.753683+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:14:12.288153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":29437,"num_write":385,"num_write_kb":96431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"60'470","reported_seq":631,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.764988+0000","last_change":"2024-09-12T22:35:33.764988+0000","last_active":"2024-09-12T22:35:33.764988+0000","last_peered":"2024-09-12T22:35:33.764988+0000","last_clean":"2024-09-12T22:35:33.764988+0000","last_became_active":"2024-09-12T22:35:33.759906+0000","last_became_peered":"2024-09-12T22:35:33.759906+0000","last_unstale":"2024-09-12T22:35:33.764988+0000","last_undegraded":"2024-09-12T22:35:33.764988+0000","last_fullsized":"2024-09-12T22:35:33.764988+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:06:06.794825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":18334,"num_write":442,"num_write_kb":109282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"60'391","reported_seq":910,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.751884+0000","last_change":"2024-09-12T22:35:30.732861+0000","last_active":"2024-09-12T22:35:32.751884+0000","last_peered":"2024-09-12T22:35:32.751884+0000","last_clean":"2024-09-12T22:35:32.751884+0000","last_became_active":"2024-09-12T22:35:30.731086+0000","last_became_peered":"2024-09-12T22:35:30.731086+0000","last_unstale":"2024-09-12T22:35:32.751884+0000","last_undegraded":"2024-09-12T22:35:32.751884+0000","last_fullsized":"2024-09-12T22:35:32.751884+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:56:09.762357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":32771,"num_write":355,"num_write_kb":71120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"60'397","reported_seq":578,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.752135+0000","last_change":"2024-09-12T22:31:37.413094+0000","last_active":"2024-09-12T22:35:32.752135+0000","last_peered":"2024-09-12T22:35:32.752135+0000","last_clean":"2024-09-12T22:35:32.752135+0000","last_became_active":"2024-09-12T22:31:37.412746+0000","last_became_peered":"2024-09-12T22:31:37.412746+0000","last_unstale":"2024-09-12T22:35:32.752135+0000","last_undegraded":"2024-09-12T22:35:32.752135+0000","last_fullsized":"2024-09-12T22:35:32.752135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:32:14.415120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":28544,"num_write":368,"num_write_kb":83737,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"60'458","reported_seq":591,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752878+0000","last_change":"2024-09-12T22:35:24.759019+0000","last_active":"2024-09-12T22:35:33.752878+0000","last_peered":"2024-09-12T22:35:33.752878+0000","last_clean":"2024-09-12T22:35:33.752878+0000","last_became_active":"2024-09-12T22:35:24.756373+0000","last_became_peered":"2024-09-12T22:35:24.756373+0000","last_unstale":"2024-09-12T22:35:33.752878+0000","last_undegraded":"2024-09-12T22:35:33.752878+0000","last_fullsized":"2024-09-12T22:35:33.752878+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":458,"log_dups_size":0,"ondisk_log_size":458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:49:34.350038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":28467,"num_write":430,"num_write_kb":81329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":198,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"60'381","reported_seq":513,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.751146+0000","last_change":"2024-09-12T22:31:37.409177+0000","last_active":"2024-09-12T22:35:32.751146+0000","last_peered":"2024-09-12T22:35:32.751146+0000","last_clean":"2024-09-12T22:35:32.751146+0000","last_became_active":"2024-09-12T22:31:37.408811+0000","last_became_peered":"2024-09-12T22:31:37.408811+0000","last_unstale":"2024-09-12T22:35:32.751146+0000","last_undegraded":"2024-09-12T22:35:32.751146+0000","last_fullsized":"2024-09-12T22:35:32.751146+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:17:21.695079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":60,"num_write":353,"num_write_kb":58419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"60'439","reported_seq":616,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.751293+0000","last_change":"2024-09-12T22:31:37.413023+0000","last_active":"2024-09-12T22:35:32.751293+0000","last_peered":"2024-09-12T22:35:32.751293+0000","last_clean":"2024-09-12T22:35:32.751293+0000","last_became_active":"2024-09-12T22:31:37.412691+0000","last_became_peered":"2024-09-12T22:31:37.412691+0000","last_unstale":"2024-09-12T22:35:32.751293+0000","last_undegraded":"2024-09-12T22:35:32.751293+0000","last_fullsized":"2024-09-12T22:35:32.751293+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:02:36.454134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":27053,"num_write":405,"num_write_kb":79743,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"60'384","reported_seq":587,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.750909+0000","last_change":"2024-09-12T22:31:37.411074+0000","last_active":"2024-09-12T22:35:32.750909+0000","last_peered":"2024-09-12T22:35:32.750909+0000","last_clean":"2024-09-12T22:35:32.750909+0000","last_became_active":"2024-09-12T22:31:37.410633+0000","last_became_peered":"2024-09-12T22:31:37.410633+0000","last_unstale":"2024-09-12T22:35:32.750909+0000","last_undegraded":"2024-09-12T22:35:32.750909+0000","last_fullsized":"2024-09-12T22:35:32.750909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:39:20.383152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":44358,"num_write":338,"num_write_kb":67411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"60'418","reported_seq":1000,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.751692+0000","last_change":"2024-09-12T22:35:28.732156+0000","last_active":"2024-09-12T22:35:32.751692+0000","last_peered":"2024-09-12T22:35:32.751692+0000","last_clean":"2024-09-12T22:35:32.751692+0000","last_became_active":"2024-09-12T22:35:28.731002+0000","last_became_peered":"2024-09-12T22:35:28.731002+0000","last_unstale":"2024-09-12T22:35:32.751692+0000","last_undegraded":"2024-09-12T22:35:32.751692+0000","last_fullsized":"2024-09-12T22:35:32.751692+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:52:19.679715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":48711,"num_write":384,"num_write_kb":63228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"60'406","reported_seq":520,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.753178+0000","last_change":"2024-09-12T22:35:27.732831+0000","last_active":"2024-09-12T22:35:33.753178+0000","last_peered":"2024-09-12T22:35:33.753178+0000","last_clean":"2024-09-12T22:35:33.753178+0000","last_became_active":"2024-09-12T22:35:27.729480+0000","last_became_peered":"2024-09-12T22:35:27.729480+0000","last_unstale":"2024-09-12T22:35:33.753178+0000","last_undegraded":"2024-09-12T22:35:33.753178+0000","last_fullsized":"2024-09-12T22:35:33.753178+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:38:13.307443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":21851,"num_write":367,"num_write_kb":79913,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"60'338","reported_seq":477,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.752028+0000","last_change":"2024-09-12T22:31:37.414469+0000","last_active":"2024-09-12T22:35:32.752028+0000","last_peered":"2024-09-12T22:35:32.752028+0000","last_clean":"2024-09-12T22:35:32.752028+0000","last_became_active":"2024-09-12T22:31:37.414165+0000","last_became_peered":"2024-09-12T22:31:37.414165+0000","last_unstale":"2024-09-12T22:35:32.752028+0000","last_undegraded":"2024-09-12T22:35:32.752028+0000","last_fullsized":"2024-09-12T22:35:32.752028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":338,"log_dups_size":0,"ondisk_log_size":338,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:25:38.148636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":4053,"num_write":316,"num_write_kb":21475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"60'359","reported_seq":495,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.764173+0000","last_change":"2024-09-12T22:35:33.764173+0000","last_active":"2024-09-12T22:35:33.764173+0000","last_peered":"2024-09-12T22:35:33.764173+0000","last_clean":"2024-09-12T22:35:33.764173+0000","last_became_active":"2024-09-12T22:35:33.760739+0000","last_became_peered":"2024-09-12T22:35:33.760739+0000","last_unstale":"2024-09-12T22:35:33.764173+0000","last_undegraded":"2024-09-12T22:35:33.764173+0000","last_fullsized":"2024-09-12T22:35:33.764173+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:58:38.596224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":6688,"num_write":330,"num_write_kb":38146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"60'402","reported_seq":537,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.761962+0000","last_change":"2024-09-12T22:35:33.761962+0000","last_active":"2024-09-12T22:35:33.761962+0000","last_peered":"2024-09-12T22:35:33.761962+0000","last_clean":"2024-09-12T22:35:33.761962+0000","last_became_active":"2024-09-12T22:35:33.754938+0000","last_became_peered":"2024-09-12T22:35:33.754938+0000","last_unstale":"2024-09-12T22:35:33.761962+0000","last_undegraded":"2024-09-12T22:35:33.761962+0000","last_fullsized":"2024-09-12T22:35:33.761962+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:01:27.181524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":16384,"num_write":363,"num_write_kb":62556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"60'409","reported_seq":933,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.751196+0000","last_change":"2024-09-12T22:35:29.737252+0000","last_active":"2024-09-12T22:35:32.751196+0000","last_peered":"2024-09-12T22:35:32.751196+0000","last_clean":"2024-09-12T22:35:32.751196+0000","last_became_active":"2024-09-12T22:35:29.735835+0000","last_became_peered":"2024-09-12T22:35:29.735835+0000","last_unstale":"2024-09-12T22:35:32.751196+0000","last_undegraded":"2024-09-12T22:35:32.751196+0000","last_fullsized":"2024-09-12T22:35:32.751196+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:32:12.014289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":13943,"num_write":382,"num_write_kb":54682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"60'412","reported_seq":946,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.751376+0000","last_change":"2024-09-12T22:35:28.731566+0000","last_active":"2024-09-12T22:35:32.751376+0000","last_peered":"2024-09-12T22:35:32.751376+0000","last_clean":"2024-09-12T22:35:32.751376+0000","last_became_active":"2024-09-12T22:35:28.730413+0000","last_became_peered":"2024-09-12T22:35:28.730413+0000","last_unstale":"2024-09-12T22:35:32.751376+0000","last_undegraded":"2024-09-12T22:35:32.751376+0000","last_fullsized":"2024-09-12T22:35:32.751376+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:47:47.029549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":19700,"num_write":377,"num_write_kb":67929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"60'404","reported_seq":535,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.751031+0000","last_change":"2024-09-12T22:31:37.411006+0000","last_active":"2024-09-12T22:35:32.751031+0000","last_peered":"2024-09-12T22:35:32.751031+0000","last_clean":"2024-09-12T22:35:32.751031+0000","last_became_active":"2024-09-12T22:31:37.410557+0000","last_became_peered":"2024-09-12T22:31:37.410557+0000","last_unstale":"2024-09-12T22:35:32.751031+0000","last_undegraded":"2024-09-12T22:35:32.751031+0000","last_fullsized":"2024-09-12T22:35:32.751031+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:08:21.709770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":368,"num_write_kb":25652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"60'405","reported_seq":938,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.752906+0000","last_change":"2024-09-12T22:35:31.732234+0000","last_active":"2024-09-12T22:35:32.752906+0000","last_peered":"2024-09-12T22:35:32.752906+0000","last_clean":"2024-09-12T22:35:32.752906+0000","last_became_active":"2024-09-12T22:35:31.730883+0000","last_became_peered":"2024-09-12T22:35:31.730883+0000","last_unstale":"2024-09-12T22:35:32.752906+0000","last_undegraded":"2024-09-12T22:35:32.752906+0000","last_fullsized":"2024-09-12T22:35:32.752906+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:50:20.904744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":18251,"num_write":369,"num_write_kb":34203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"60'406","reported_seq":579,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.760018+0000","last_change":"2024-09-12T22:35:33.760018+0000","last_active":"2024-09-12T22:35:33.760018+0000","last_peered":"2024-09-12T22:35:33.760018+0000","last_clean":"2024-09-12T22:35:33.760018+0000","last_became_active":"2024-09-12T22:35:33.754915+0000","last_became_peered":"2024-09-12T22:35:33.754915+0000","last_unstale":"2024-09-12T22:35:33.760018+0000","last_undegraded":"2024-09-12T22:35:33.760018+0000","last_fullsized":"2024-09-12T22:35:33.760018+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:36:51.477439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":45843,"num_write":367,"num_write_kb":59097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"60'413","reported_seq":930,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.751645+0000","last_change":"2024-09-12T22:35:31.731988+0000","last_active":"2024-09-12T22:35:32.751645+0000","last_peered":"2024-09-12T22:35:32.751645+0000","last_clean":"2024-09-12T22:35:32.751645+0000","last_became_active":"2024-09-12T22:35:31.730742+0000","last_became_peered":"2024-09-12T22:35:31.730742+0000","last_unstale":"2024-09-12T22:35:32.751645+0000","last_undegraded":"2024-09-12T22:35:32.751645+0000","last_fullsized":"2024-09-12T22:35:32.751645+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:33:38.616668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":20855,"num_write":371,"num_write_kb":71095,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"60'441","reported_seq":619,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.752308+0000","last_change":"2024-09-12T22:31:37.414235+0000","last_active":"2024-09-12T22:35:32.752308+0000","last_peered":"2024-09-12T22:35:32.752308+0000","last_clean":"2024-09-12T22:35:32.752308+0000","last_became_active":"2024-09-12T22:31:37.413786+0000","last_became_peered":"2024-09-12T22:31:37.413786+0000","last_unstale":"2024-09-12T22:35:32.752308+0000","last_undegraded":"2024-09-12T22:35:32.752308+0000","last_fullsized":"2024-09-12T22:35:32.752308+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:21:11.866973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":23954,"num_write":419,"num_write_kb":72528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"60'414","reported_seq":620,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.752179+0000","last_change":"2024-09-12T22:31:37.415382+0000","last_active":"2024-09-12T22:35:32.752179+0000","last_peered":"2024-09-12T22:35:32.752179+0000","last_clean":"2024-09-12T22:35:32.752179+0000","last_became_active":"2024-09-12T22:31:37.414319+0000","last_became_peered":"2024-09-12T22:31:37.414319+0000","last_unstale":"2024-09-12T22:35:32.752179+0000","last_undegraded":"2024-09-12T22:35:32.752179+0000","last_fullsized":"2024-09-12T22:35:32.752179+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:26:25.578693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":44129,"num_write":387,"num_write_kb":104899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"60'444","reported_seq":551,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.753335+0000","last_change":"2024-09-12T22:35:25.729851+0000","last_active":"2024-09-12T22:35:33.753335+0000","last_peered":"2024-09-12T22:35:33.753335+0000","last_clean":"2024-09-12T22:35:33.753335+0000","last_became_active":"2024-09-12T22:35:25.727269+0000","last_became_peered":"2024-09-12T22:35:25.727269+0000","last_unstale":"2024-09-12T22:35:33.753335+0000","last_undegraded":"2024-09-12T22:35:33.753335+0000","last_fullsized":"2024-09-12T22:35:33.753335+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:30:26.718280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":17411,"num_write":407,"num_write_kb":87850,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"60'421","reported_seq":644,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.750673+0000","last_change":"2024-09-12T22:31:37.410364+0000","last_active":"2024-09-12T22:35:32.750673+0000","last_peered":"2024-09-12T22:35:32.750673+0000","last_clean":"2024-09-12T22:35:32.750673+0000","last_became_active":"2024-09-12T22:31:37.409951+0000","last_became_peered":"2024-09-12T22:31:37.409951+0000","last_unstale":"2024-09-12T22:35:32.750673+0000","last_undegraded":"2024-09-12T22:35:32.750673+0000","last_fullsized":"2024-09-12T22:35:32.750673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:39:17.785755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":44074,"num_write":389,"num_write_kb":44104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"60'459","reported_seq":614,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.760584+0000","last_change":"2024-09-12T22:35:33.760584+0000","last_active":"2024-09-12T22:35:33.760584+0000","last_peered":"2024-09-12T22:35:33.760584+0000","last_clean":"2024-09-12T22:35:33.760584+0000","last_became_active":"2024-09-12T22:35:33.754576+0000","last_became_peered":"2024-09-12T22:35:33.754576+0000","last_unstale":"2024-09-12T22:35:33.760584+0000","last_undegraded":"2024-09-12T22:35:33.760584+0000","last_fullsized":"2024-09-12T22:35:33.760584+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:14:34.676855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":28605,"num_write":432,"num_write_kb":100377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"60'419","reported_seq":516,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752435+0000","last_change":"2024-09-12T22:35:29.738235+0000","last_active":"2024-09-12T22:35:33.752435+0000","last_peered":"2024-09-12T22:35:33.752435+0000","last_clean":"2024-09-12T22:35:33.752435+0000","last_became_active":"2024-09-12T22:35:29.735450+0000","last_became_peered":"2024-09-12T22:35:29.735450+0000","last_unstale":"2024-09-12T22:35:33.752435+0000","last_undegraded":"2024-09-12T22:35:33.752435+0000","last_fullsized":"2024-09-12T22:35:33.752435+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:24.582229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":16852,"num_write":404,"num_write_kb":34622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"60'494","reported_seq":708,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.752021+0000","last_change":"2024-09-12T22:31:37.411880+0000","last_active":"2024-09-12T22:35:32.752021+0000","last_peered":"2024-09-12T22:35:32.752021+0000","last_clean":"2024-09-12T22:35:32.752021+0000","last_became_active":"2024-09-12T22:31:37.410563+0000","last_became_peered":"2024-09-12T22:31:37.410563+0000","last_unstale":"2024-09-12T22:35:32.752021+0000","last_undegraded":"2024-09-12T22:35:32.752021+0000","last_fullsized":"2024-09-12T22:35:32.752021+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":494,"log_dups_size":0,"ondisk_log_size":494,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:47:52.560533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":35239,"num_write":450,"num_write_kb":76898,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"60'401","reported_seq":921,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.752165+0000","last_change":"2024-09-12T22:35:30.732843+0000","last_active":"2024-09-12T22:35:32.752165+0000","last_peered":"2024-09-12T22:35:32.752165+0000","last_clean":"2024-09-12T22:35:32.752165+0000","last_became_active":"2024-09-12T22:35:30.731155+0000","last_became_peered":"2024-09-12T22:35:30.731155+0000","last_unstale":"2024-09-12T22:35:32.752165+0000","last_undegraded":"2024-09-12T22:35:32.752165+0000","last_fullsized":"2024-09-12T22:35:32.752165+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:54:33.926426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":10993,"num_write":369,"num_write_kb":55171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"60'390","reported_seq":538,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.763890+0000","last_change":"2024-09-12T22:35:33.763890+0000","last_active":"2024-09-12T22:35:33.763890+0000","last_peered":"2024-09-12T22:35:33.763890+0000","last_clean":"2024-09-12T22:35:33.763890+0000","last_became_active":"2024-09-12T22:35:33.756108+0000","last_became_peered":"2024-09-12T22:35:33.756108+0000","last_unstale":"2024-09-12T22:35:33.763890+0000","last_undegraded":"2024-09-12T22:35:33.763890+0000","last_fullsized":"2024-09-12T22:35:33.763890+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:53:03.258457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":18588,"num_write":360,"num_write_kb":59307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"60'429","reported_seq":1005,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.752084+0000","last_change":"2024-09-12T22:35:23.756871+0000","last_active":"2024-09-12T22:35:32.752084+0000","last_peered":"2024-09-12T22:35:32.752084+0000","last_clean":"2024-09-12T22:35:32.752084+0000","last_became_active":"2024-09-12T22:35:23.755618+0000","last_became_peered":"2024-09-12T22:35:23.755618+0000","last_unstale":"2024-09-12T22:35:32.752084+0000","last_undegraded":"2024-09-12T22:35:32.752084+0000","last_fullsized":"2024-09-12T22:35:32.752084+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:21:46.470290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":32541,"num_write":398,"num_write_kb":76609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"60'458","reported_seq":575,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.753011+0000","last_change":"2024-09-12T22:35:28.732538+0000","last_active":"2024-09-12T22:35:33.753011+0000","last_peered":"2024-09-12T22:35:33.753011+0000","last_clean":"2024-09-12T22:35:33.753011+0000","last_became_active":"2024-09-12T22:35:28.730337+0000","last_became_peered":"2024-09-12T22:35:28.730337+0000","last_unstale":"2024-09-12T22:35:33.753011+0000","last_undegraded":"2024-09-12T22:35:33.753011+0000","last_fullsized":"2024-09-12T22:35:33.753011+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":458,"log_dups_size":0,"ondisk_log_size":458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:55:45.185896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":16425,"num_write":413,"num_write_kb":47110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"60'432","reported_seq":980,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.750757+0000","last_change":"2024-09-12T22:35:26.732243+0000","last_active":"2024-09-12T22:35:32.750757+0000","last_peered":"2024-09-12T22:35:32.750757+0000","last_clean":"2024-09-12T22:35:32.750757+0000","last_became_active":"2024-09-12T22:35:26.731135+0000","last_became_peered":"2024-09-12T22:35:26.731135+0000","last_unstale":"2024-09-12T22:35:32.750757+0000","last_undegraded":"2024-09-12T22:35:32.750757+0000","last_fullsized":"2024-09-12T22:35:32.750757+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:34:06.084746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":21090,"num_write":393,"num_write_kb":67477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"60'458","reported_seq":634,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.751172+0000","last_change":"2024-09-12T22:31:37.415190+0000","last_active":"2024-09-12T22:35:32.751172+0000","last_peered":"2024-09-12T22:35:32.751172+0000","last_clean":"2024-09-12T22:35:32.751172+0000","last_became_active":"2024-09-12T22:31:37.414265+0000","last_became_peered":"2024-09-12T22:31:37.414265+0000","last_unstale":"2024-09-12T22:35:32.751172+0000","last_undegraded":"2024-09-12T22:35:32.751172+0000","last_fullsized":"2024-09-12T22:35:32.751172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":458,"log_dups_size":0,"ondisk_log_size":458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:07:02.173590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":37395,"num_write":421,"num_write_kb":73250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"60'411","reported_seq":583,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.764162+0000","last_change":"2024-09-12T22:35:33.764162+0000","last_active":"2024-09-12T22:35:33.764162+0000","last_peered":"2024-09-12T22:35:33.764162+0000","last_clean":"2024-09-12T22:35:33.764162+0000","last_became_active":"2024-09-12T22:35:33.761121+0000","last_became_peered":"2024-09-12T22:35:33.761121+0000","last_unstale":"2024-09-12T22:35:33.764162+0000","last_undegraded":"2024-09-12T22:35:33.764162+0000","last_fullsized":"2024-09-12T22:35:33.764162+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:03:51.948278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":36400,"num_write":371,"num_write_kb":92142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"60'546","reported_seq":679,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.752305+0000","last_change":"2024-09-12T22:31:36.412082+0000","last_active":"2024-09-12T22:35:32.752305+0000","last_peered":"2024-09-12T22:35:32.752305+0000","last_clean":"2024-09-12T22:35:32.752305+0000","last_became_active":"2024-09-12T22:31:36.410871+0000","last_became_peered":"2024-09-12T22:31:36.410871+0000","last_unstale":"2024-09-12T22:35:32.752305+0000","last_undegraded":"2024-09-12T22:35:32.752305+0000","last_fullsized":"2024-09-12T22:35:32.752305+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":546,"log_dups_size":0,"ondisk_log_size":546,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:30:49.127253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":495,"num_write_kb":8426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"60'427","reported_seq":598,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.753291+0000","last_change":"2024-09-12T22:35:31.732681+0000","last_active":"2024-09-12T22:35:33.753291+0000","last_peered":"2024-09-12T22:35:33.753291+0000","last_clean":"2024-09-12T22:35:33.753291+0000","last_became_active":"2024-09-12T22:35:31.730237+0000","last_became_peered":"2024-09-12T22:35:31.730237+0000","last_unstale":"2024-09-12T22:35:33.753291+0000","last_undegraded":"2024-09-12T22:35:33.753291+0000","last_fullsized":"2024-09-12T22:35:33.753291+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:51:57.088855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":59223,"num_write":394,"num_write_kb":80309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":175,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"60'55","reported_seq":188,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.751522+0000","last_change":"2024-09-12T22:31:36.408563+0000","last_active":"2024-09-12T22:35:32.751522+0000","last_peered":"2024-09-12T22:35:32.751522+0000","last_clean":"2024-09-12T22:35:32.751522+0000","last_became_active":"2024-09-12T22:31:36.407447+0000","last_became_peered":"2024-09-12T22:31:36.407447+0000","last_unstale":"2024-09-12T22:35:32.751522+0000","last_undegraded":"2024-09-12T22:35:32.751522+0000","last_fullsized":"2024-09-12T22:35:32.751522+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:29:37.933109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"60'424","reported_seq":586,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.752707+0000","last_change":"2024-09-12T22:31:37.411680+0000","last_active":"2024-09-12T22:35:32.752707+0000","last_peered":"2024-09-12T22:35:32.752707+0000","last_clean":"2024-09-12T22:35:32.752707+0000","last_became_active":"2024-09-12T22:31:37.411168+0000","last_became_peered":"2024-09-12T22:31:37.411168+0000","last_unstale":"2024-09-12T22:35:32.752707+0000","last_undegraded":"2024-09-12T22:35:32.752707+0000","last_fullsized":"2024-09-12T22:35:32.752707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:27.706282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":13992,"num_write":386,"num_write_kb":38510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"60'70","reported_seq":47,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752499+0000","last_change":"2024-09-12T22:35:20.734652+0000","last_active":"2024-09-12T22:35:33.752499+0000","last_peered":"2024-09-12T22:35:33.752499+0000","last_clean":"2024-09-12T22:35:33.752499+0000","last_became_active":"2024-09-12T22:35:20.734023+0000","last_became_peered":"2024-09-12T22:35:20.734023+0000","last_unstale":"2024-09-12T22:35:33.752499+0000","last_undegraded":"2024-09-12T22:35:33.752499+0000","last_fullsized":"2024-09-12T22:35:33.752499+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:18:27.888573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"60'395","reported_seq":575,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.751711+0000","last_change":"2024-09-12T22:31:37.411218+0000","last_active":"2024-09-12T22:35:32.751711+0000","last_peered":"2024-09-12T22:35:32.751711+0000","last_clean":"2024-09-12T22:35:32.751711+0000","last_became_active":"2024-09-12T22:31:37.409666+0000","last_became_peered":"2024-09-12T22:31:37.409666+0000","last_unstale":"2024-09-12T22:35:32.751711+0000","last_undegraded":"2024-09-12T22:35:32.751711+0000","last_fullsized":"2024-09-12T22:35:32.751711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:45:34.230090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":24198,"num_write":363,"num_write_kb":67056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"60'68","reported_seq":209,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.751319+0000","last_change":"2024-09-12T22:35:20.737076+0000","last_active":"2024-09-12T22:35:32.751319+0000","last_peered":"2024-09-12T22:35:32.751319+0000","last_clean":"2024-09-12T22:35:32.751319+0000","last_became_active":"2024-09-12T22:35:20.736755+0000","last_became_peered":"2024-09-12T22:35:20.736755+0000","last_unstale":"2024-09-12T22:35:32.751319+0000","last_undegraded":"2024-09-12T22:35:32.751319+0000","last_fullsized":"2024-09-12T22:35:32.751319+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:57:36.195186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"60'158","reported_seq":305,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.752766+0000","last_change":"2024-09-12T22:35:23.756940+0000","last_active":"2024-09-12T22:35:32.752766+0000","last_peered":"2024-09-12T22:35:32.752766+0000","last_clean":"2024-09-12T22:35:32.752766+0000","last_became_active":"2024-09-12T22:35:23.756663+0000","last_became_peered":"2024-09-12T22:35:23.756663+0000","last_unstale":"2024-09-12T22:35:32.752766+0000","last_undegraded":"2024-09-12T22:35:32.752766+0000","last_fullsized":"2024-09-12T22:35:32.752766+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:08:58.453420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":105,"num_write_kb":4159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"60'426","reported_seq":545,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.753740+0000","last_change":"2024-09-12T22:35:26.735223+0000","last_active":"2024-09-12T22:35:33.753740+0000","last_peered":"2024-09-12T22:35:33.753740+0000","last_clean":"2024-09-12T22:35:33.753740+0000","last_became_active":"2024-09-12T22:35:26.732245+0000","last_became_peered":"2024-09-12T22:35:26.732245+0000","last_unstale":"2024-09-12T22:35:33.753740+0000","last_undegraded":"2024-09-12T22:35:33.753740+0000","last_fullsized":"2024-09-12T22:35:33.753740+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:29:27.860798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":29225,"num_write":390,"num_write_kb":83737,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"60'274","reported_seq":367,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752328+0000","last_change":"2024-09-12T22:35:23.755688+0000","last_active":"2024-09-12T22:35:33.752328+0000","last_peered":"2024-09-12T22:35:33.752328+0000","last_clean":"2024-09-12T22:35:33.752328+0000","last_became_active":"2024-09-12T22:35:23.755282+0000","last_became_peered":"2024-09-12T22:35:23.755282+0000","last_unstale":"2024-09-12T22:35:33.752328+0000","last_undegraded":"2024-09-12T22:35:33.752328+0000","last_fullsized":"2024-09-12T22:35:33.752328+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":274,"log_dups_size":0,"ondisk_log_size":274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:44:38.920273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":213,"num_write_kb":4214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"60'455","reported_seq":607,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.760415+0000","last_change":"2024-09-12T22:35:33.760415+0000","last_active":"2024-09-12T22:35:33.760415+0000","last_peered":"2024-09-12T22:35:33.760415+0000","last_clean":"2024-09-12T22:35:33.760415+0000","last_became_active":"2024-09-12T22:35:33.754299+0000","last_became_peered":"2024-09-12T22:35:33.754299+0000","last_unstale":"2024-09-12T22:35:33.760415+0000","last_undegraded":"2024-09-12T22:35:33.760415+0000","last_fullsized":"2024-09-12T22:35:33.760415+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:26:00.753338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":20747,"num_write":425,"num_write_kb":56005,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"60'423","reported_seq":570,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.753143+0000","last_change":"2024-09-12T22:35:23.757047+0000","last_active":"2024-09-12T22:35:32.753143+0000","last_peered":"2024-09-12T22:35:32.753143+0000","last_clean":"2024-09-12T22:35:32.753143+0000","last_became_active":"2024-09-12T22:35:23.756668+0000","last_became_peered":"2024-09-12T22:35:23.756668+0000","last_unstale":"2024-09-12T22:35:32.753143+0000","last_undegraded":"2024-09-12T22:35:32.753143+0000","last_fullsized":"2024-09-12T22:35:32.753143+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:53:35.298628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":371,"num_write_kb":4254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"60'431","reported_seq":596,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.751328+0000","last_change":"2024-09-12T22:31:37.414809+0000","last_active":"2024-09-12T22:35:32.751328+0000","last_peered":"2024-09-12T22:35:32.751328+0000","last_clean":"2024-09-12T22:35:32.751328+0000","last_became_active":"2024-09-12T22:31:37.414492+0000","last_became_peered":"2024-09-12T22:31:37.414492+0000","last_unstale":"2024-09-12T22:35:32.751328+0000","last_undegraded":"2024-09-12T22:35:32.751328+0000","last_fullsized":"2024-09-12T22:35:32.751328+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:50:48.426898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":21479,"num_write":394,"num_write_kb":83756,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"60'70","reported_seq":203,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.752793+0000","last_change":"2024-09-12T22:31:36.412068+0000","last_active":"2024-09-12T22:35:32.752793+0000","last_peered":"2024-09-12T22:35:32.752793+0000","last_clean":"2024-09-12T22:35:32.752793+0000","last_became_active":"2024-09-12T22:31:36.411366+0000","last_became_peered":"2024-09-12T22:31:36.411366+0000","last_unstale":"2024-09-12T22:35:32.752793+0000","last_undegraded":"2024-09-12T22:35:32.752793+0000","last_fullsized":"2024-09-12T22:35:32.752793+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:35:51.647051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"60'471","reported_seq":671,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.752314+0000","last_change":"2024-09-12T22:31:37.410303+0000","last_active":"2024-09-12T22:35:32.752314+0000","last_peered":"2024-09-12T22:35:32.752314+0000","last_clean":"2024-09-12T22:35:32.752314+0000","last_became_active":"2024-09-12T22:31:37.409607+0000","last_became_peered":"2024-09-12T22:31:37.409607+0000","last_unstale":"2024-09-12T22:35:32.752314+0000","last_undegraded":"2024-09-12T22:35:32.752314+0000","last_fullsized":"2024-09-12T22:35:32.752314+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":471,"log_dups_size":0,"ondisk_log_size":471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:53:42.732654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":37922,"num_write":440,"num_write_kb":138112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"60'209","reported_seq":342,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.752462+0000","last_change":"2024-09-12T22:31:36.407974+0000","last_active":"2024-09-12T22:35:32.752462+0000","last_peered":"2024-09-12T22:35:32.752462+0000","last_clean":"2024-09-12T22:35:32.752462+0000","last_became_active":"2024-09-12T22:31:36.406955+0000","last_became_peered":"2024-09-12T22:31:36.406955+0000","last_unstale":"2024-09-12T22:35:32.752462+0000","last_undegraded":"2024-09-12T22:35:32.752462+0000","last_fullsized":"2024-09-12T22:35:32.752462+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:07:34.831264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":8267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"60'437","reported_seq":578,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.752444+0000","last_change":"2024-09-12T22:31:37.415285+0000","last_active":"2024-09-12T22:35:32.752444+0000","last_peered":"2024-09-12T22:35:32.752444+0000","last_clean":"2024-09-12T22:35:32.752444+0000","last_became_active":"2024-09-12T22:31:37.414890+0000","last_became_peered":"2024-09-12T22:31:37.414890+0000","last_unstale":"2024-09-12T22:35:32.752444+0000","last_undegraded":"2024-09-12T22:35:32.752444+0000","last_fullsized":"2024-09-12T22:35:32.752444+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:38:16.956786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":4587,"num_write":407,"num_write_kb":50860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"60'108","reported_seq":241,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.751610+0000","last_change":"2024-09-12T22:31:36.412147+0000","last_active":"2024-09-12T22:35:32.751610+0000","last_peered":"2024-09-12T22:35:32.751610+0000","last_clean":"2024-09-12T22:35:32.751610+0000","last_became_active":"2024-09-12T22:31:36.411382+0000","last_became_peered":"2024-09-12T22:31:36.411382+0000","last_unstale":"2024-09-12T22:35:32.751610+0000","last_undegraded":"2024-09-12T22:35:32.751610+0000","last_fullsized":"2024-09-12T22:35:32.751610+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:54:51.454867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":4129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"60'407","reported_seq":925,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.752981+0000","last_change":"2024-09-12T22:35:31.732325+0000","last_active":"2024-09-12T22:35:32.752981+0000","last_peered":"2024-09-12T22:35:32.752981+0000","last_clean":"2024-09-12T22:35:32.752981+0000","last_became_active":"2024-09-12T22:35:31.729817+0000","last_became_peered":"2024-09-12T22:35:31.729817+0000","last_unstale":"2024-09-12T22:35:32.752981+0000","last_undegraded":"2024-09-12T22:35:32.752981+0000","last_fullsized":"2024-09-12T22:35:32.752981+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:21:52.633068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":5615,"num_write":375,"num_write_kb":50827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"60'57","reported_seq":47,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.751984+0000","last_change":"2024-09-12T22:35:20.734244+0000","last_active":"2024-09-12T22:35:33.751984+0000","last_peered":"2024-09-12T22:35:33.751984+0000","last_clean":"2024-09-12T22:35:33.751984+0000","last_became_active":"2024-09-12T22:35:20.733664+0000","last_became_peered":"2024-09-12T22:35:20.733664+0000","last_unstale":"2024-09-12T22:35:33.751984+0000","last_undegraded":"2024-09-12T22:35:33.751984+0000","last_fullsized":"2024-09-12T22:35:33.751984+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:41:11.108676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"60'357","reported_seq":831,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.752466+0000","last_change":"2024-09-12T22:35:27.734437+0000","last_active":"2024-09-12T22:35:32.752466+0000","last_peered":"2024-09-12T22:35:32.752466+0000","last_clean":"2024-09-12T22:35:32.752466+0000","last_became_active":"2024-09-12T22:35:27.733274+0000","last_became_peered":"2024-09-12T22:35:27.733274+0000","last_unstale":"2024-09-12T22:35:32.752466+0000","last_undegraded":"2024-09-12T22:35:32.752466+0000","last_fullsized":"2024-09-12T22:35:32.752466+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":357,"log_dups_size":0,"ondisk_log_size":357,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:35:58.820958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":2460,"num_write":324,"num_write_kb":37873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"60'417","reported_seq":501,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.753610+0000","last_change":"2024-09-12T22:35:23.755080+0000","last_active":"2024-09-12T22:35:33.753610+0000","last_peered":"2024-09-12T22:35:33.753610+0000","last_clean":"2024-09-12T22:35:33.753610+0000","last_became_active":"2024-09-12T22:35:23.754683+0000","last_became_peered":"2024-09-12T22:35:23.754683+0000","last_unstale":"2024-09-12T22:35:33.753610+0000","last_undegraded":"2024-09-12T22:35:33.753610+0000","last_fullsized":"2024-09-12T22:35:33.753610+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:34:00.150680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":359,"num_write_kb":4251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"60'416","reported_seq":961,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.751903+0000","last_change":"2024-09-12T22:35:30.730978+0000","last_active":"2024-09-12T22:35:32.751903+0000","last_peered":"2024-09-12T22:35:32.751903+0000","last_clean":"2024-09-12T22:35:32.751903+0000","last_became_active":"2024-09-12T22:35:30.729912+0000","last_became_peered":"2024-09-12T22:35:30.729912+0000","last_unstale":"2024-09-12T22:35:32.751903+0000","last_undegraded":"2024-09-12T22:35:32.751903+0000","last_fullsized":"2024-09-12T22:35:32.751903+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:32:25.562466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":42190,"num_write":377,"num_write_kb":87849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":351,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.751576+0000","last_change":"2024-09-12T22:35:20.737092+0000","last_active":"2024-09-12T22:35:32.751576+0000","last_peered":"2024-09-12T22:35:32.751576+0000","last_clean":"2024-09-12T22:35:32.751576+0000","last_became_active":"2024-09-12T22:35:20.736721+0000","last_became_peered":"2024-09-12T22:35:20.736721+0000","last_unstale":"2024-09-12T22:35:32.751576+0000","last_undegraded":"2024-09-12T22:35:32.751576+0000","last_fullsized":"2024-09-12T22:35:32.751576+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:26.229539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:26.229539+0000","last_clean_scrub_stamp":"2024-09-12T22:31:26.229539+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:44:38.486987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":147,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.752551+0000","last_change":"2024-09-12T22:31:34.286952+0000","last_active":"2024-09-12T22:35:32.752551+0000","last_peered":"2024-09-12T22:35:32.752551+0000","last_clean":"2024-09-12T22:35:32.752551+0000","last_became_active":"2024-09-12T22:31:32.283661+0000","last_became_peered":"2024-09-12T22:31:32.283661+0000","last_unstale":"2024-09-12T22:35:32.752551+0000","last_undegraded":"2024-09-12T22:35:32.752551+0000","last_fullsized":"2024-09-12T22:35:32.752551+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:21.681390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000621274,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"60'678","reported_seq":826,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.751874+0000","last_change":"2024-09-12T22:35:23.755996+0000","last_active":"2024-09-12T22:35:32.751874+0000","last_peered":"2024-09-12T22:35:32.751874+0000","last_clean":"2024-09-12T22:35:32.751874+0000","last_became_active":"2024-09-12T22:35:23.755652+0000","last_became_peered":"2024-09-12T22:35:23.755652+0000","last_unstale":"2024-09-12T22:35:32.751874+0000","last_undegraded":"2024-09-12T22:35:32.751874+0000","last_fullsized":"2024-09-12T22:35:32.751874+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":678,"log_dups_size":0,"ondisk_log_size":678,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:05:19.284888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":608,"num_write_kb":8482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"60'426","reported_seq":974,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.753120+0000","last_change":"2024-09-12T22:35:31.732344+0000","last_active":"2024-09-12T22:35:32.753120+0000","last_peered":"2024-09-12T22:35:32.753120+0000","last_clean":"2024-09-12T22:35:32.753120+0000","last_became_active":"2024-09-12T22:35:31.730242+0000","last_became_peered":"2024-09-12T22:35:31.730242+0000","last_unstale":"2024-09-12T22:35:32.753120+0000","last_undegraded":"2024-09-12T22:35:32.753120+0000","last_fullsized":"2024-09-12T22:35:32.753120+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:45:28.259069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":24636,"num_write":392,"num_write_kb":59176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":153,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.751568+0000","last_change":"2024-09-12T22:35:20.735913+0000","last_active":"2024-09-12T22:35:32.751568+0000","last_peered":"2024-09-12T22:35:32.751568+0000","last_clean":"2024-09-12T22:35:32.751568+0000","last_became_active":"2024-09-12T22:35:20.735545+0000","last_became_peered":"2024-09-12T22:35:20.735545+0000","last_unstale":"2024-09-12T22:35:32.751568+0000","last_undegraded":"2024-09-12T22:35:32.751568+0000","last_fullsized":"2024-09-12T22:35:32.751568+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:37:09.150338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037858999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"60'106","reported_seq":282,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.751154+0000","last_change":"2024-09-12T22:31:36.407395+0000","last_active":"2024-09-12T22:35:32.751154+0000","last_peered":"2024-09-12T22:35:32.751154+0000","last_clean":"2024-09-12T22:35:32.751154+0000","last_became_active":"2024-09-12T22:31:36.406770+0000","last_became_peered":"2024-09-12T22:31:36.406770+0000","last_unstale":"2024-09-12T22:35:32.751154+0000","last_undegraded":"2024-09-12T22:35:32.751154+0000","last_fullsized":"2024-09-12T22:35:32.751154+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:49:26.547848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1467429,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":43,"num_read_kb":1462,"num_write":43,"num_write_kb":1462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"60'448","reported_seq":547,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.753927+0000","last_change":"2024-09-12T22:35:27.733064+0000","last_active":"2024-09-12T22:35:33.753927+0000","last_peered":"2024-09-12T22:35:33.753927+0000","last_clean":"2024-09-12T22:35:33.753927+0000","last_became_active":"2024-09-12T22:35:27.729522+0000","last_became_peered":"2024-09-12T22:35:27.729522+0000","last_unstale":"2024-09-12T22:35:33.753927+0000","last_undegraded":"2024-09-12T22:35:33.753927+0000","last_fullsized":"2024-09-12T22:35:33.753927+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:59:06.989020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":10436,"num_write":420,"num_write_kb":67816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":153,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.751267+0000","last_change":"2024-09-12T22:35:20.735217+0000","last_active":"2024-09-12T22:35:32.751267+0000","last_peered":"2024-09-12T22:35:32.751267+0000","last_clean":"2024-09-12T22:35:32.751267+0000","last_became_active":"2024-09-12T22:35:20.734643+0000","last_became_peered":"2024-09-12T22:35:20.734643+0000","last_unstale":"2024-09-12T22:35:32.751267+0000","last_undegraded":"2024-09-12T22:35:32.751267+0000","last_fullsized":"2024-09-12T22:35:32.751267+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:27:17.331198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039540700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"60'292","reported_seq":404,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.761303+0000","last_change":"2024-09-12T22:35:33.761303+0000","last_active":"2024-09-12T22:35:33.761303+0000","last_peered":"2024-09-12T22:35:33.761303+0000","last_clean":"2024-09-12T22:35:33.761303+0000","last_became_active":"2024-09-12T22:35:33.760742+0000","last_became_peered":"2024-09-12T22:35:33.760742+0000","last_unstale":"2024-09-12T22:35:33.761303+0000","last_undegraded":"2024-09-12T22:35:33.761303+0000","last_fullsized":"2024-09-12T22:35:33.761303+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":292,"log_dups_size":0,"ondisk_log_size":292,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:48:04.210933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":235,"num_write_kb":8293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"60'375","reported_seq":910,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.752023+0000","last_change":"2024-09-12T22:35:29.740484+0000","last_active":"2024-09-12T22:35:32.752023+0000","last_peered":"2024-09-12T22:35:32.752023+0000","last_clean":"2024-09-12T22:35:32.752023+0000","last_became_active":"2024-09-12T22:35:29.738755+0000","last_became_peered":"2024-09-12T22:35:29.738755+0000","last_unstale":"2024-09-12T22:35:32.752023+0000","last_undegraded":"2024-09-12T22:35:32.752023+0000","last_fullsized":"2024-09-12T22:35:32.752023+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:07:35.007529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":43566,"num_write":354,"num_write_kb":92229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":160,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":148,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.751641+0000","last_change":"2024-09-12T22:31:34.286938+0000","last_active":"2024-09-12T22:35:32.751641+0000","last_peered":"2024-09-12T22:35:32.751641+0000","last_clean":"2024-09-12T22:35:32.751641+0000","last_became_active":"2024-09-12T22:31:32.282230+0000","last_became_peered":"2024-09-12T22:31:32.282230+0000","last_unstale":"2024-09-12T22:35:32.751641+0000","last_undegraded":"2024-09-12T22:35:32.751641+0000","last_fullsized":"2024-09-12T22:35:32.751641+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:11:05.988384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000615758,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"60'63","reported_seq":196,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.752347+0000","last_change":"2024-09-12T22:31:36.410694+0000","last_active":"2024-09-12T22:35:32.752347+0000","last_peered":"2024-09-12T22:35:32.752347+0000","last_clean":"2024-09-12T22:35:32.752347+0000","last_became_active":"2024-09-12T22:31:36.409816+0000","last_became_peered":"2024-09-12T22:31:36.409816+0000","last_unstale":"2024-09-12T22:35:32.752347+0000","last_undegraded":"2024-09-12T22:35:32.752347+0000","last_fullsized":"2024-09-12T22:35:32.752347+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:40:35.369213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"60'405","reported_seq":927,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.752175+0000","last_change":"2024-09-12T22:35:29.736704+0000","last_active":"2024-09-12T22:35:32.752175+0000","last_peered":"2024-09-12T22:35:32.752175+0000","last_clean":"2024-09-12T22:35:32.752175+0000","last_became_active":"2024-09-12T22:35:29.735499+0000","last_became_peered":"2024-09-12T22:35:29.735499+0000","last_unstale":"2024-09-12T22:35:32.752175+0000","last_undegraded":"2024-09-12T22:35:32.752175+0000","last_fullsized":"2024-09-12T22:35:32.752175+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:26:06.464684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":20152,"num_write":366,"num_write_kb":92447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"60'277","reported_seq":361,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.753169+0000","last_change":"2024-09-12T22:35:23.755555+0000","last_active":"2024-09-12T22:35:33.753169+0000","last_peered":"2024-09-12T22:35:33.753169+0000","last_clean":"2024-09-12T22:35:33.753169+0000","last_became_active":"2024-09-12T22:35:23.755237+0000","last_became_peered":"2024-09-12T22:35:23.755237+0000","last_unstale":"2024-09-12T22:35:33.753169+0000","last_undegraded":"2024-09-12T22:35:33.753169+0000","last_fullsized":"2024-09-12T22:35:33.753169+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":277,"log_dups_size":0,"ondisk_log_size":277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:10:23.649578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":216,"num_write_kb":4193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":153,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.752317+0000","last_change":"2024-09-12T22:35:20.736644+0000","last_active":"2024-09-12T22:35:32.752317+0000","last_peered":"2024-09-12T22:35:32.752317+0000","last_clean":"2024-09-12T22:35:32.752317+0000","last_became_active":"2024-09-12T22:35:20.736428+0000","last_became_peered":"2024-09-12T22:35:20.736428+0000","last_unstale":"2024-09-12T22:35:32.752317+0000","last_undegraded":"2024-09-12T22:35:32.752317+0000","last_fullsized":"2024-09-12T22:35:32.752317+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:42:12.023369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041972500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"60'355","reported_seq":457,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752866+0000","last_change":"2024-09-12T22:35:25.729864+0000","last_active":"2024-09-12T22:35:33.752866+0000","last_peered":"2024-09-12T22:35:33.752866+0000","last_clean":"2024-09-12T22:35:33.752866+0000","last_became_active":"2024-09-12T22:35:25.727299+0000","last_became_peered":"2024-09-12T22:35:25.727299+0000","last_unstale":"2024-09-12T22:35:33.752866+0000","last_undegraded":"2024-09-12T22:35:33.752866+0000","last_fullsized":"2024-09-12T22:35:33.752866+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":355,"log_dups_size":0,"ondisk_log_size":355,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:56:40.812767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13196,"num_write":321,"num_write_kb":41797,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"60'55","reported_seq":195,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.752178+0000","last_change":"2024-09-12T22:35:20.738078+0000","last_active":"2024-09-12T22:35:32.752178+0000","last_peered":"2024-09-12T22:35:32.752178+0000","last_clean":"2024-09-12T22:35:32.752178+0000","last_became_active":"2024-09-12T22:35:20.737705+0000","last_became_peered":"2024-09-12T22:35:20.737705+0000","last_unstale":"2024-09-12T22:35:32.752178+0000","last_undegraded":"2024-09-12T22:35:32.752178+0000","last_fullsized":"2024-09-12T22:35:32.752178+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:04:15.554381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":68,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.754453+0000","last_change":"2024-09-12T22:35:20.738327+0000","last_active":"2024-09-12T22:35:33.754453+0000","last_peered":"2024-09-12T22:35:33.754453+0000","last_clean":"2024-09-12T22:35:33.754453+0000","last_became_active":"2024-09-12T22:35:20.737799+0000","last_became_peered":"2024-09-12T22:35:20.737799+0000","last_unstale":"2024-09-12T22:35:33.754453+0000","last_undegraded":"2024-09-12T22:35:33.754453+0000","last_fullsized":"2024-09-12T22:35:33.754453+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:03:16.381453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"60'385","reported_seq":533,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.761943+0000","last_change":"2024-09-12T22:35:33.761943+0000","last_active":"2024-09-12T22:35:33.761943+0000","last_peered":"2024-09-12T22:35:33.761943+0000","last_clean":"2024-09-12T22:35:33.761943+0000","last_became_active":"2024-09-12T22:35:33.754546+0000","last_became_peered":"2024-09-12T22:35:33.754546+0000","last_unstale":"2024-09-12T22:35:33.761943+0000","last_undegraded":"2024-09-12T22:35:33.761943+0000","last_fullsized":"2024-09-12T22:35:33.761943+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:35:36.478089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":22437,"num_write":347,"num_write_kb":30121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"60'61","reported_seq":202,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.753022+0000","last_change":"2024-09-12T22:35:20.738494+0000","last_active":"2024-09-12T22:35:32.753022+0000","last_peered":"2024-09-12T22:35:32.753022+0000","last_clean":"2024-09-12T22:35:32.753022+0000","last_became_active":"2024-09-12T22:35:20.738129+0000","last_became_peered":"2024-09-12T22:35:20.738129+0000","last_unstale":"2024-09-12T22:35:32.753022+0000","last_undegraded":"2024-09-12T22:35:32.753022+0000","last_fullsized":"2024-09-12T22:35:32.753022+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:27:06.987354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":153,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.752907+0000","last_change":"2024-09-12T22:35:20.736934+0000","last_active":"2024-09-12T22:35:32.752907+0000","last_peered":"2024-09-12T22:35:32.752907+0000","last_clean":"2024-09-12T22:35:32.752907+0000","last_became_active":"2024-09-12T22:35:20.736628+0000","last_became_peered":"2024-09-12T22:35:20.736628+0000","last_unstale":"2024-09-12T22:35:32.752907+0000","last_undegraded":"2024-09-12T22:35:32.752907+0000","last_fullsized":"2024-09-12T22:35:32.752907+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:04:03.284313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058589999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"60'402","reported_seq":551,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.750986+0000","last_change":"2024-09-12T22:31:37.411152+0000","last_active":"2024-09-12T22:35:32.750986+0000","last_peered":"2024-09-12T22:35:32.750986+0000","last_clean":"2024-09-12T22:35:32.750986+0000","last_became_active":"2024-09-12T22:31:37.410558+0000","last_became_peered":"2024-09-12T22:31:37.410558+0000","last_unstale":"2024-09-12T22:35:32.750986+0000","last_undegraded":"2024-09-12T22:35:32.750986+0000","last_fullsized":"2024-09-12T22:35:32.750986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:14:29.892478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":10169,"num_write":370,"num_write_kb":38130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"61'105","reported_seq":238,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.752870+0000","last_change":"2024-09-12T22:31:36.407460+0000","last_active":"2024-09-12T22:35:32.752870+0000","last_peered":"2024-09-12T22:35:32.752870+0000","last_clean":"2024-09-12T22:35:32.752870+0000","last_became_active":"2024-09-12T22:31:36.406729+0000","last_became_peered":"2024-09-12T22:31:36.406729+0000","last_unstale":"2024-09-12T22:35:32.752870+0000","last_undegraded":"2024-09-12T22:35:32.752870+0000","last_fullsized":"2024-09-12T22:35:32.752870+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:27:58.012573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103,"num_write_kb":1085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":153,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.752840+0000","last_change":"2024-09-12T22:35:20.737068+0000","last_active":"2024-09-12T22:35:32.752840+0000","last_peered":"2024-09-12T22:35:32.752840+0000","last_clean":"2024-09-12T22:35:32.752840+0000","last_became_active":"2024-09-12T22:35:20.736769+0000","last_became_peered":"2024-09-12T22:35:20.736769+0000","last_unstale":"2024-09-12T22:35:32.752840+0000","last_undegraded":"2024-09-12T22:35:32.752840+0000","last_fullsized":"2024-09-12T22:35:32.752840+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:44:36.675350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000382109,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"60'412","reported_seq":550,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752676+0000","last_change":"2024-09-12T22:35:26.734859+0000","last_active":"2024-09-12T22:35:33.752676+0000","last_peered":"2024-09-12T22:35:33.752676+0000","last_clean":"2024-09-12T22:35:33.752676+0000","last_became_active":"2024-09-12T22:35:26.732923+0000","last_became_peered":"2024-09-12T22:35:26.732923+0000","last_unstale":"2024-09-12T22:35:33.752676+0000","last_undegraded":"2024-09-12T22:35:33.752676+0000","last_fullsized":"2024-09-12T22:35:33.752676+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:48:09.924688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":34504,"num_write":385,"num_write_kb":100438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"60'415","reported_seq":966,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.751921+0000","last_change":"2024-09-12T22:35:24.760883+0000","last_active":"2024-09-12T22:35:32.751921+0000","last_peered":"2024-09-12T22:35:32.751921+0000","last_clean":"2024-09-12T22:35:32.751921+0000","last_became_active":"2024-09-12T22:35:24.759441+0000","last_became_peered":"2024-09-12T22:35:24.759441+0000","last_unstale":"2024-09-12T22:35:32.751921+0000","last_undegraded":"2024-09-12T22:35:32.751921+0000","last_fullsized":"2024-09-12T22:35:32.751921+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:26:21.054210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":37207,"num_write":375,"num_write_kb":84660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"60'221","reported_seq":372,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.752659+0000","last_change":"2024-09-12T22:35:23.756290+0000","last_active":"2024-09-12T22:35:32.752659+0000","last_peered":"2024-09-12T22:35:32.752659+0000","last_clean":"2024-09-12T22:35:32.752659+0000","last_became_active":"2024-09-12T22:35:23.755918+0000","last_became_peered":"2024-09-12T22:35:23.755918+0000","last_unstale":"2024-09-12T22:35:32.752659+0000","last_undegraded":"2024-09-12T22:35:32.752659+0000","last_fullsized":"2024-09-12T22:35:32.752659+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":221,"log_dups_size":0,"ondisk_log_size":221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:08:03.811119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":175,"num_write_kb":8282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":8382815,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"60'429","reported_seq":959,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.751022+0000","last_change":"2024-09-12T22:35:25.728726+0000","last_active":"2024-09-12T22:35:32.751022+0000","last_peered":"2024-09-12T22:35:32.751022+0000","last_clean":"2024-09-12T22:35:32.751022+0000","last_became_active":"2024-09-12T22:35:25.726837+0000","last_became_peered":"2024-09-12T22:35:25.726837+0000","last_unstale":"2024-09-12T22:35:32.751022+0000","last_undegraded":"2024-09-12T22:35:32.751022+0000","last_fullsized":"2024-09-12T22:35:32.751022+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:38.996042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":12230,"num_write":389,"num_write_kb":71746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"60'98","reported_seq":217,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.760239+0000","last_change":"2024-09-12T22:35:33.760239+0000","last_active":"2024-09-12T22:35:33.760239+0000","last_peered":"2024-09-12T22:35:33.760239+0000","last_clean":"2024-09-12T22:35:33.760239+0000","last_became_active":"2024-09-12T22:35:33.758640+0000","last_became_peered":"2024-09-12T22:35:33.758640+0000","last_unstale":"2024-09-12T22:35:33.760239+0000","last_undegraded":"2024-09-12T22:35:33.760239+0000","last_fullsized":"2024-09-12T22:35:33.760239+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:24:11.251168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"60'214","reported_seq":347,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.752646+0000","last_change":"2024-09-12T22:31:36.411549+0000","last_active":"2024-09-12T22:35:32.752646+0000","last_peered":"2024-09-12T22:35:32.752646+0000","last_clean":"2024-09-12T22:35:32.752646+0000","last_became_active":"2024-09-12T22:31:36.410674+0000","last_became_peered":"2024-09-12T22:31:36.410674+0000","last_unstale":"2024-09-12T22:35:32.752646+0000","last_undegraded":"2024-09-12T22:35:32.752646+0000","last_fullsized":"2024-09-12T22:35:32.752646+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:58:05.676197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":151,"num_write_kb":4168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"60'460","reported_seq":620,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.750802+0000","last_change":"2024-09-12T22:31:37.411254+0000","last_active":"2024-09-12T22:35:32.750802+0000","last_peered":"2024-09-12T22:35:32.750802+0000","last_clean":"2024-09-12T22:35:32.750802+0000","last_became_active":"2024-09-12T22:31:37.410404+0000","last_became_peered":"2024-09-12T22:31:37.410404+0000","last_unstale":"2024-09-12T22:35:32.750802+0000","last_undegraded":"2024-09-12T22:35:32.750802+0000","last_fullsized":"2024-09-12T22:35:32.750802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:42:00.856616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":15059,"num_write":431,"num_write_kb":59615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"60'52","reported_seq":185,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.752698+0000","last_change":"2024-09-12T22:31:36.408390+0000","last_active":"2024-09-12T22:35:32.752698+0000","last_peered":"2024-09-12T22:35:32.752698+0000","last_clean":"2024-09-12T22:35:32.752698+0000","last_became_active":"2024-09-12T22:31:36.407062+0000","last_became_peered":"2024-09-12T22:31:36.407062+0000","last_unstale":"2024-09-12T22:35:32.752698+0000","last_undegraded":"2024-09-12T22:35:32.752698+0000","last_fullsized":"2024-09-12T22:35:32.752698+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:09:10.618195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"60'461","reported_seq":1023,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.750862+0000","last_change":"2024-09-12T22:35:28.731581+0000","last_active":"2024-09-12T22:35:32.750862+0000","last_peered":"2024-09-12T22:35:32.750862+0000","last_clean":"2024-09-12T22:35:32.750862+0000","last_became_active":"2024-09-12T22:35:28.730402+0000","last_became_peered":"2024-09-12T22:35:28.730402+0000","last_unstale":"2024-09-12T22:35:32.750862+0000","last_undegraded":"2024-09-12T22:35:32.750862+0000","last_fullsized":"2024-09-12T22:35:32.750862+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:25:37.428224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":17508,"num_write":431,"num_write_kb":67883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":200,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"60'355","reported_seq":479,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752557+0000","last_change":"2024-09-12T22:35:28.732887+0000","last_active":"2024-09-12T22:35:33.752557+0000","last_peered":"2024-09-12T22:35:33.752557+0000","last_clean":"2024-09-12T22:35:33.752557+0000","last_became_active":"2024-09-12T22:35:28.730931+0000","last_became_peered":"2024-09-12T22:35:28.730931+0000","last_unstale":"2024-09-12T22:35:33.752557+0000","last_undegraded":"2024-09-12T22:35:33.752557+0000","last_fullsized":"2024-09-12T22:35:33.752557+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":355,"log_dups_size":0,"ondisk_log_size":355,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:14:12.194559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":44561,"num_write":329,"num_write_kb":26431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"60'548","reported_seq":696,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.751429+0000","last_change":"2024-09-12T22:35:23.756287+0000","last_active":"2024-09-12T22:35:32.751429+0000","last_peered":"2024-09-12T22:35:32.751429+0000","last_clean":"2024-09-12T22:35:32.751429+0000","last_became_active":"2024-09-12T22:35:23.755812+0000","last_became_peered":"2024-09-12T22:35:23.755812+0000","last_unstale":"2024-09-12T22:35:32.751429+0000","last_undegraded":"2024-09-12T22:35:32.751429+0000","last_fullsized":"2024-09-12T22:35:32.751429+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":548,"log_dups_size":0,"ondisk_log_size":548,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:15:13.597427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":488,"num_write_kb":8420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"60'422","reported_seq":665,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.752174+0000","last_change":"2024-09-12T22:31:37.411183+0000","last_active":"2024-09-12T22:35:32.752174+0000","last_peered":"2024-09-12T22:35:32.752174+0000","last_clean":"2024-09-12T22:35:32.752174+0000","last_became_active":"2024-09-12T22:31:37.409796+0000","last_became_peered":"2024-09-12T22:31:37.409796+0000","last_unstale":"2024-09-12T22:35:32.752174+0000","last_undegraded":"2024-09-12T22:35:32.752174+0000","last_fullsized":"2024-09-12T22:35:32.752174+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:20:35.779810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":51020,"num_write":397,"num_write_kb":73116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"60'180","reported_seq":313,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.750946+0000","last_change":"2024-09-12T22:31:36.407402+0000","last_active":"2024-09-12T22:35:32.750946+0000","last_peered":"2024-09-12T22:35:32.750946+0000","last_clean":"2024-09-12T22:35:32.750946+0000","last_became_active":"2024-09-12T22:31:36.406681+0000","last_became_peered":"2024-09-12T22:31:36.406681+0000","last_unstale":"2024-09-12T22:35:32.750946+0000","last_undegraded":"2024-09-12T22:35:32.750946+0000","last_fullsized":"2024-09-12T22:35:32.750946+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:39:39.362573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":134,"num_write_kb":4167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"60'420","reported_seq":545,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.753501+0000","last_change":"2024-09-12T22:35:30.734995+0000","last_active":"2024-09-12T22:35:33.753501+0000","last_peered":"2024-09-12T22:35:33.753501+0000","last_clean":"2024-09-12T22:35:33.753501+0000","last_became_active":"2024-09-12T22:35:30.733182+0000","last_became_peered":"2024-09-12T22:35:30.733182+0000","last_unstale":"2024-09-12T22:35:33.753501+0000","last_undegraded":"2024-09-12T22:35:33.753501+0000","last_fullsized":"2024-09-12T22:35:33.753501+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:01:30.939801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":24901,"num_write":369,"num_write_kb":75198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"61'212","reported_seq":324,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.755961+0000","last_change":"2024-09-12T22:35:33.755961+0000","last_active":"2024-09-12T22:35:33.755961+0000","last_peered":"2024-09-12T22:35:33.755961+0000","last_clean":"2024-09-12T22:35:33.755961+0000","last_became_active":"2024-09-12T22:35:33.754931+0000","last_became_peered":"2024-09-12T22:35:33.754931+0000","last_unstale":"2024-09-12T22:35:33.755961+0000","last_undegraded":"2024-09-12T22:35:33.755961+0000","last_fullsized":"2024-09-12T22:35:33.755961+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:12:35.586196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12553847,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":12334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"60'398","reported_seq":539,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.763810+0000","last_change":"2024-09-12T22:35:33.763810+0000","last_active":"2024-09-12T22:35:33.763810+0000","last_peered":"2024-09-12T22:35:33.763810+0000","last_clean":"2024-09-12T22:35:33.763810+0000","last_became_active":"2024-09-12T22:35:33.755497+0000","last_became_peered":"2024-09-12T22:35:33.755497+0000","last_unstale":"2024-09-12T22:35:33.763810+0000","last_undegraded":"2024-09-12T22:35:33.763810+0000","last_fullsized":"2024-09-12T22:35:33.763810+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:19:50.330571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":11429,"num_write":361,"num_write_kb":88082,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"60'54","reported_seq":55,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752689+0000","last_change":"2024-09-12T22:35:20.759946+0000","last_active":"2024-09-12T22:35:33.752689+0000","last_peered":"2024-09-12T22:35:33.752689+0000","last_clean":"2024-09-12T22:35:33.752689+0000","last_became_active":"2024-09-12T22:35:20.733271+0000","last_became_peered":"2024-09-12T22:35:20.733271+0000","last_unstale":"2024-09-12T22:35:33.752689+0000","last_undegraded":"2024-09-12T22:35:33.752689+0000","last_fullsized":"2024-09-12T22:35:33.752689+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:49:02.164294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"60'359","reported_seq":510,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.751796+0000","last_change":"2024-09-12T22:31:37.415365+0000","last_active":"2024-09-12T22:35:32.751796+0000","last_peered":"2024-09-12T22:35:32.751796+0000","last_clean":"2024-09-12T22:35:32.751796+0000","last_became_active":"2024-09-12T22:31:37.413933+0000","last_became_peered":"2024-09-12T22:31:37.413933+0000","last_unstale":"2024-09-12T22:35:32.751796+0000","last_undegraded":"2024-09-12T22:35:32.751796+0000","last_fullsized":"2024-09-12T22:35:32.751796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:08:07.115355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":12324,"num_write":332,"num_write_kb":46371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"60'186","reported_seq":319,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.752668+0000","last_change":"2024-09-12T22:31:36.411665+0000","last_active":"2024-09-12T22:35:32.752668+0000","last_peered":"2024-09-12T22:35:32.752668+0000","last_clean":"2024-09-12T22:35:32.752668+0000","last_became_active":"2024-09-12T22:31:36.410182+0000","last_became_peered":"2024-09-12T22:31:36.410182+0000","last_unstale":"2024-09-12T22:35:32.752668+0000","last_undegraded":"2024-09-12T22:35:32.752668+0000","last_fullsized":"2024-09-12T22:35:32.752668+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:37:20.891838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":4160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"60'401","reported_seq":568,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.751515+0000","last_change":"2024-09-12T22:31:37.415172+0000","last_active":"2024-09-12T22:35:32.751515+0000","last_peered":"2024-09-12T22:35:32.751515+0000","last_clean":"2024-09-12T22:35:32.751515+0000","last_became_active":"2024-09-12T22:31:37.414776+0000","last_became_peered":"2024-09-12T22:31:37.414776+0000","last_unstale":"2024-09-12T22:35:32.751515+0000","last_undegraded":"2024-09-12T22:35:32.751515+0000","last_fullsized":"2024-09-12T22:35:32.751515+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:42:32.307876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":24207,"num_write":361,"num_write_kb":50515,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"60'244","reported_seq":365,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.759131+0000","last_change":"2024-09-12T22:35:33.759131+0000","last_active":"2024-09-12T22:35:33.759131+0000","last_peered":"2024-09-12T22:35:33.759131+0000","last_clean":"2024-09-12T22:35:33.759131+0000","last_became_active":"2024-09-12T22:35:33.757550+0000","last_became_peered":"2024-09-12T22:35:33.757550+0000","last_unstale":"2024-09-12T22:35:33.759131+0000","last_undegraded":"2024-09-12T22:35:33.759131+0000","last_fullsized":"2024-09-12T22:35:33.759131+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":244,"log_dups_size":0,"ondisk_log_size":244,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:16:17.926249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":12389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"60'439","reported_seq":925,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.750926+0000","last_change":"2024-09-12T22:35:27.731026+0000","last_active":"2024-09-12T22:35:32.750926+0000","last_peered":"2024-09-12T22:35:32.750926+0000","last_clean":"2024-09-12T22:35:32.750926+0000","last_became_active":"2024-09-12T22:35:27.729827+0000","last_became_peered":"2024-09-12T22:35:27.729827+0000","last_unstale":"2024-09-12T22:35:32.750926+0000","last_undegraded":"2024-09-12T22:35:32.750926+0000","last_fullsized":"2024-09-12T22:35:32.750926+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:21:02.543670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":6311,"num_write":403,"num_write_kb":64161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"60'51","reported_seq":196,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.752582+0000","last_change":"2024-09-12T22:35:20.764696+0000","last_active":"2024-09-12T22:35:32.752582+0000","last_peered":"2024-09-12T22:35:32.752582+0000","last_clean":"2024-09-12T22:35:32.752582+0000","last_became_active":"2024-09-12T22:35:20.737444+0000","last_became_peered":"2024-09-12T22:35:20.737444+0000","last_unstale":"2024-09-12T22:35:32.752582+0000","last_undegraded":"2024-09-12T22:35:32.752582+0000","last_fullsized":"2024-09-12T22:35:32.752582+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:14:54.424047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"60'438","reported_seq":622,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.751465+0000","last_change":"2024-09-12T22:31:37.415390+0000","last_active":"2024-09-12T22:35:32.751465+0000","last_peered":"2024-09-12T22:35:32.751465+0000","last_clean":"2024-09-12T22:35:32.751465+0000","last_became_active":"2024-09-12T22:31:37.414781+0000","last_became_peered":"2024-09-12T22:31:37.414781+0000","last_unstale":"2024-09-12T22:35:32.751465+0000","last_undegraded":"2024-09-12T22:35:32.751465+0000","last_fullsized":"2024-09-12T22:35:32.751465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:42:17.728844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":29290,"num_write":407,"num_write_kb":46733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"60'111","reported_seq":244,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.752877+0000","last_change":"2024-09-12T22:31:36.407945+0000","last_active":"2024-09-12T22:35:32.752877+0000","last_peered":"2024-09-12T22:35:32.752877+0000","last_clean":"2024-09-12T22:35:32.752877+0000","last_became_active":"2024-09-12T22:31:36.406959+0000","last_became_peered":"2024-09-12T22:31:36.406959+0000","last_unstale":"2024-09-12T22:35:32.752877+0000","last_undegraded":"2024-09-12T22:35:32.752877+0000","last_fullsized":"2024-09-12T22:35:32.752877+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:26:33.155850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61,"num_write_kb":4126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2747,"num_read_kb":1535780,"num_write":24498,"num_write_kb":4269351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5680,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26636,"ondisk_log_size":26636,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127268954,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":43,"num_read_kb":1462,"num_write":4457,"num_write_kb":127482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":54520159,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":254603264,"data_stored":254537908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4442,"internal_metadata":0},"log_size":6263,"ondisk_log_size":6263,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705718,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":174076,"kb_used_data":84640,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94197764,"statfs":{"total":96636764160,"available":96458510336,"internally_reserved":0,"allocated":86671360,"data_stored":86268364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":66,"seq":283467841541,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":145348,"kb_used_data":87272,"kb_used_omap":5,"kb_used_meta":58042,"kb_avail":94226492,"statfs":{"total":96636764160,"available":96487927808,"internally_reserved":0,"allocated":89366528,"data_stored":88969829,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6037,"internal_metadata":59435115},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738422,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":173516,"kb_used_data":79924,"kb_used_omap":1,"kb_used_meta":93566,"kb_avail":94198324,"statfs":{"total":96636764160,"available":96459083776,"internally_reserved":0,"allocated":81842176,"data_stored":81458063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":95812037},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":88076288,"data_stored":88052173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4442,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81141760,"data_stored":81130756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":85385216,"data_stored":85354979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T22:35:35.635 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T22:35:35.965 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:35:35.967 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-12T22:35:35.976 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":203,"stamp":"2024-09-12T22:35:34.252943+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":127859341,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":2926,"num_read_kb":1537360,"num_write":29160,"num_write_kb":4400295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5694,"num_bytes_recovered":54520159,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33059,"ondisk_log_size":33059,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":492940,"kb_used_data":251836,"kb_used_omap":9,"kb_used_meta":241014,"kb_avail":282622580,"statfs":{"total":289910292480,"available":289405521920,"internally_reserved":0,"allocated":257880064,"data_stored":256696256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9227,"internal_metadata":246799349},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-1580,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":78,"num_bytes_recovered":-33525457,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000724"},"pg_stats":[{"pgid":"4.3f","version":"60'422","reported_seq":536,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.753683+0000","last_change":"2024-09-12T22:35:30.733306+0000","last_active":"2024-09-12T22:35:33.753683+0000","last_peered":"2024-09-12T22:35:33.753683+0000","last_clean":"2024-09-12T22:35:33.753683+0000","last_became_active":"2024-09-12T22:35:30.731323+0000","last_became_peered":"2024-09-12T22:35:30.731323+0000","last_unstale":"2024-09-12T22:35:33.753683+0000","last_undegraded":"2024-09-12T22:35:33.753683+0000","last_fullsized":"2024-09-12T22:35:33.753683+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:14:12.288153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":29437,"num_write":385,"num_write_kb":96431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"60'470","reported_seq":631,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.764988+0000","last_change":"2024-09-12T22:35:33.764988+0000","last_active":"2024-09-12T22:35:33.764988+0000","last_peered":"2024-09-12T22:35:33.764988+0000","last_clean":"2024-09-12T22:35:33.764988+0000","last_became_active":"2024-09-12T22:35:33.759906+0000","last_became_peered":"2024-09-12T22:35:33.759906+0000","last_unstale":"2024-09-12T22:35:33.764988+0000","last_undegraded":"2024-09-12T22:35:33.764988+0000","last_fullsized":"2024-09-12T22:35:33.764988+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:06:06.794825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":18334,"num_write":442,"num_write_kb":109282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"60'391","reported_seq":910,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.751884+0000","last_change":"2024-09-12T22:35:30.732861+0000","last_active":"2024-09-12T22:35:32.751884+0000","last_peered":"2024-09-12T22:35:32.751884+0000","last_clean":"2024-09-12T22:35:32.751884+0000","last_became_active":"2024-09-12T22:35:30.731086+0000","last_became_peered":"2024-09-12T22:35:30.731086+0000","last_unstale":"2024-09-12T22:35:32.751884+0000","last_undegraded":"2024-09-12T22:35:32.751884+0000","last_fullsized":"2024-09-12T22:35:32.751884+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:56:09.762357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":32771,"num_write":355,"num_write_kb":71120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"60'397","reported_seq":578,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.752135+0000","last_change":"2024-09-12T22:31:37.413094+0000","last_active":"2024-09-12T22:35:32.752135+0000","last_peered":"2024-09-12T22:35:32.752135+0000","last_clean":"2024-09-12T22:35:32.752135+0000","last_became_active":"2024-09-12T22:31:37.412746+0000","last_became_peered":"2024-09-12T22:31:37.412746+0000","last_unstale":"2024-09-12T22:35:32.752135+0000","last_undegraded":"2024-09-12T22:35:32.752135+0000","last_fullsized":"2024-09-12T22:35:32.752135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:32:14.415120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":28544,"num_write":368,"num_write_kb":83737,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"60'458","reported_seq":591,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752878+0000","last_change":"2024-09-12T22:35:24.759019+0000","last_active":"2024-09-12T22:35:33.752878+0000","last_peered":"2024-09-12T22:35:33.752878+0000","last_clean":"2024-09-12T22:35:33.752878+0000","last_became_active":"2024-09-12T22:35:24.756373+0000","last_became_peered":"2024-09-12T22:35:24.756373+0000","last_unstale":"2024-09-12T22:35:33.752878+0000","last_undegraded":"2024-09-12T22:35:33.752878+0000","last_fullsized":"2024-09-12T22:35:33.752878+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":458,"log_dups_size":0,"ondisk_log_size":458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:49:34.350038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":28467,"num_write":430,"num_write_kb":81329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":198,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"60'381","reported_seq":513,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.751146+0000","last_change":"2024-09-12T22:31:37.409177+0000","last_active":"2024-09-12T22:35:32.751146+0000","last_peered":"2024-09-12T22:35:32.751146+0000","last_clean":"2024-09-12T22:35:32.751146+0000","last_became_active":"2024-09-12T22:31:37.408811+0000","last_became_peered":"2024-09-12T22:31:37.408811+0000","last_unstale":"2024-09-12T22:35:32.751146+0000","last_undegraded":"2024-09-12T22:35:32.751146+0000","last_fullsized":"2024-09-12T22:35:32.751146+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:17:21.695079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":60,"num_write":353,"num_write_kb":58419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"60'439","reported_seq":616,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.751293+0000","last_change":"2024-09-12T22:31:37.413023+0000","last_active":"2024-09-12T22:35:32.751293+0000","last_peered":"2024-09-12T22:35:32.751293+0000","last_clean":"2024-09-12T22:35:32.751293+0000","last_became_active":"2024-09-12T22:31:37.412691+0000","last_became_peered":"2024-09-12T22:31:37.412691+0000","last_unstale":"2024-09-12T22:35:32.751293+0000","last_undegraded":"2024-09-12T22:35:32.751293+0000","last_fullsized":"2024-09-12T22:35:32.751293+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:02:36.454134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":27053,"num_write":405,"num_write_kb":79743,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"60'384","reported_seq":587,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.750909+0000","last_change":"2024-09-12T22:31:37.411074+0000","last_active":"2024-09-12T22:35:32.750909+0000","last_peered":"2024-09-12T22:35:32.750909+0000","last_clean":"2024-09-12T22:35:32.750909+0000","last_became_active":"2024-09-12T22:31:37.410633+0000","last_became_peered":"2024-09-12T22:31:37.410633+0000","last_unstale":"2024-09-12T22:35:32.750909+0000","last_undegraded":"2024-09-12T22:35:32.750909+0000","last_fullsized":"2024-09-12T22:35:32.750909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:39:20.383152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":44358,"num_write":338,"num_write_kb":67411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"60'418","reported_seq":1000,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.751692+0000","last_change":"2024-09-12T22:35:28.732156+0000","last_active":"2024-09-12T22:35:32.751692+0000","last_peered":"2024-09-12T22:35:32.751692+0000","last_clean":"2024-09-12T22:35:32.751692+0000","last_became_active":"2024-09-12T22:35:28.731002+0000","last_became_peered":"2024-09-12T22:35:28.731002+0000","last_unstale":"2024-09-12T22:35:32.751692+0000","last_undegraded":"2024-09-12T22:35:32.751692+0000","last_fullsized":"2024-09-12T22:35:32.751692+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:52:19.679715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":48711,"num_write":384,"num_write_kb":63228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"60'406","reported_seq":520,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.753178+0000","last_change":"2024-09-12T22:35:27.732831+0000","last_active":"2024-09-12T22:35:33.753178+0000","last_peered":"2024-09-12T22:35:33.753178+0000","last_clean":"2024-09-12T22:35:33.753178+0000","last_became_active":"2024-09-12T22:35:27.729480+0000","last_became_peered":"2024-09-12T22:35:27.729480+0000","last_unstale":"2024-09-12T22:35:33.753178+0000","last_undegraded":"2024-09-12T22:35:33.753178+0000","last_fullsized":"2024-09-12T22:35:33.753178+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:38:13.307443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":21851,"num_write":367,"num_write_kb":79913,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"60'338","reported_seq":477,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.752028+0000","last_change":"2024-09-12T22:31:37.414469+0000","last_active":"2024-09-12T22:35:32.752028+0000","last_peered":"2024-09-12T22:35:32.752028+0000","last_clean":"2024-09-12T22:35:32.752028+0000","last_became_active":"2024-09-12T22:31:37.414165+0000","last_became_peered":"2024-09-12T22:31:37.414165+0000","last_unstale":"2024-09-12T22:35:32.752028+0000","last_undegraded":"2024-09-12T22:35:32.752028+0000","last_fullsized":"2024-09-12T22:35:32.752028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":338,"log_dups_size":0,"ondisk_log_size":338,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:25:38.148636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":4053,"num_write":316,"num_write_kb":21475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"60'359","reported_seq":495,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.764173+0000","last_change":"2024-09-12T22:35:33.764173+0000","last_active":"2024-09-12T22:35:33.764173+0000","last_peered":"2024-09-12T22:35:33.764173+0000","last_clean":"2024-09-12T22:35:33.764173+0000","last_became_active":"2024-09-12T22:35:33.760739+0000","last_became_peered":"2024-09-12T22:35:33.760739+0000","last_unstale":"2024-09-12T22:35:33.764173+0000","last_undegraded":"2024-09-12T22:35:33.764173+0000","last_fullsized":"2024-09-12T22:35:33.764173+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:58:38.596224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":6688,"num_write":330,"num_write_kb":38146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"60'402","reported_seq":537,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.761962+0000","last_change":"2024-09-12T22:35:33.761962+0000","last_active":"2024-09-12T22:35:33.761962+0000","last_peered":"2024-09-12T22:35:33.761962+0000","last_clean":"2024-09-12T22:35:33.761962+0000","last_became_active":"2024-09-12T22:35:33.754938+0000","last_became_peered":"2024-09-12T22:35:33.754938+0000","last_unstale":"2024-09-12T22:35:33.761962+0000","last_undegraded":"2024-09-12T22:35:33.761962+0000","last_fullsized":"2024-09-12T22:35:33.761962+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:01:27.181524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":16384,"num_write":363,"num_write_kb":62556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"60'409","reported_seq":933,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.751196+0000","last_change":"2024-09-12T22:35:29.737252+0000","last_active":"2024-09-12T22:35:32.751196+0000","last_peered":"2024-09-12T22:35:32.751196+0000","last_clean":"2024-09-12T22:35:32.751196+0000","last_became_active":"2024-09-12T22:35:29.735835+0000","last_became_peered":"2024-09-12T22:35:29.735835+0000","last_unstale":"2024-09-12T22:35:32.751196+0000","last_undegraded":"2024-09-12T22:35:32.751196+0000","last_fullsized":"2024-09-12T22:35:32.751196+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:32:12.014289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":13943,"num_write":382,"num_write_kb":54682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"60'412","reported_seq":946,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.751376+0000","last_change":"2024-09-12T22:35:28.731566+0000","last_active":"2024-09-12T22:35:32.751376+0000","last_peered":"2024-09-12T22:35:32.751376+0000","last_clean":"2024-09-12T22:35:32.751376+0000","last_became_active":"2024-09-12T22:35:28.730413+0000","last_became_peered":"2024-09-12T22:35:28.730413+0000","last_unstale":"2024-09-12T22:35:32.751376+0000","last_undegraded":"2024-09-12T22:35:32.751376+0000","last_fullsized":"2024-09-12T22:35:32.751376+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:47:47.029549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":19700,"num_write":377,"num_write_kb":67929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"60'404","reported_seq":535,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.751031+0000","last_change":"2024-09-12T22:31:37.411006+0000","last_active":"2024-09-12T22:35:32.751031+0000","last_peered":"2024-09-12T22:35:32.751031+0000","last_clean":"2024-09-12T22:35:32.751031+0000","last_became_active":"2024-09-12T22:31:37.410557+0000","last_became_peered":"2024-09-12T22:31:37.410557+0000","last_unstale":"2024-09-12T22:35:32.751031+0000","last_undegraded":"2024-09-12T22:35:32.751031+0000","last_fullsized":"2024-09-12T22:35:32.751031+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:08:21.709770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":368,"num_write_kb":25652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"60'405","reported_seq":938,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.752906+0000","last_change":"2024-09-12T22:35:31.732234+0000","last_active":"2024-09-12T22:35:32.752906+0000","last_peered":"2024-09-12T22:35:32.752906+0000","last_clean":"2024-09-12T22:35:32.752906+0000","last_became_active":"2024-09-12T22:35:31.730883+0000","last_became_peered":"2024-09-12T22:35:31.730883+0000","last_unstale":"2024-09-12T22:35:32.752906+0000","last_undegraded":"2024-09-12T22:35:32.752906+0000","last_fullsized":"2024-09-12T22:35:32.752906+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:50:20.904744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":18251,"num_write":369,"num_write_kb":34203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"60'406","reported_seq":579,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.760018+0000","last_change":"2024-09-12T22:35:33.760018+0000","last_active":"2024-09-12T22:35:33.760018+0000","last_peered":"2024-09-12T22:35:33.760018+0000","last_clean":"2024-09-12T22:35:33.760018+0000","last_became_active":"2024-09-12T22:35:33.754915+0000","last_became_peered":"2024-09-12T22:35:33.754915+0000","last_unstale":"2024-09-12T22:35:33.760018+0000","last_undegraded":"2024-09-12T22:35:33.760018+0000","last_fullsized":"2024-09-12T22:35:33.760018+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:36:51.477439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":45843,"num_write":367,"num_write_kb":59097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"60'413","reported_seq":930,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.751645+0000","last_change":"2024-09-12T22:35:31.731988+0000","last_active":"2024-09-12T22:35:32.751645+0000","last_peered":"2024-09-12T22:35:32.751645+0000","last_clean":"2024-09-12T22:35:32.751645+0000","last_became_active":"2024-09-12T22:35:31.730742+0000","last_became_peered":"2024-09-12T22:35:31.730742+0000","last_unstale":"2024-09-12T22:35:32.751645+0000","last_undegraded":"2024-09-12T22:35:32.751645+0000","last_fullsized":"2024-09-12T22:35:32.751645+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:33:38.616668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":20855,"num_write":371,"num_write_kb":71095,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"60'441","reported_seq":619,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.752308+0000","last_change":"2024-09-12T22:31:37.414235+0000","last_active":"2024-09-12T22:35:32.752308+0000","last_peered":"2024-09-12T22:35:32.752308+0000","last_clean":"2024-09-12T22:35:32.752308+0000","last_became_active":"2024-09-12T22:31:37.413786+0000","last_became_peered":"2024-09-12T22:31:37.413786+0000","last_unstale":"2024-09-12T22:35:32.752308+0000","last_undegraded":"2024-09-12T22:35:32.752308+0000","last_fullsized":"2024-09-12T22:35:32.752308+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:21:11.866973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":23954,"num_write":419,"num_write_kb":72528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"60'414","reported_seq":620,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.752179+0000","last_change":"2024-09-12T22:31:37.415382+0000","last_active":"2024-09-12T22:35:32.752179+0000","last_peered":"2024-09-12T22:35:32.752179+0000","last_clean":"2024-09-12T22:35:32.752179+0000","last_became_active":"2024-09-12T22:31:37.414319+0000","last_became_peered":"2024-09-12T22:31:37.414319+0000","last_unstale":"2024-09-12T22:35:32.752179+0000","last_undegraded":"2024-09-12T22:35:32.752179+0000","last_fullsized":"2024-09-12T22:35:32.752179+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:26:25.578693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":44129,"num_write":387,"num_write_kb":104899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"60'444","reported_seq":551,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.753335+0000","last_change":"2024-09-12T22:35:25.729851+0000","last_active":"2024-09-12T22:35:33.753335+0000","last_peered":"2024-09-12T22:35:33.753335+0000","last_clean":"2024-09-12T22:35:33.753335+0000","last_became_active":"2024-09-12T22:35:25.727269+0000","last_became_peered":"2024-09-12T22:35:25.727269+0000","last_unstale":"2024-09-12T22:35:33.753335+0000","last_undegraded":"2024-09-12T22:35:33.753335+0000","last_fullsized":"2024-09-12T22:35:33.753335+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:30:26.718280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":17411,"num_write":407,"num_write_kb":87850,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"60'421","reported_seq":644,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.750673+0000","last_change":"2024-09-12T22:31:37.410364+0000","last_active":"2024-09-12T22:35:32.750673+0000","last_peered":"2024-09-12T22:35:32.750673+0000","last_clean":"2024-09-12T22:35:32.750673+0000","last_became_active":"2024-09-12T22:31:37.409951+0000","last_became_peered":"2024-09-12T22:31:37.409951+0000","last_unstale":"2024-09-12T22:35:32.750673+0000","last_undegraded":"2024-09-12T22:35:32.750673+0000","last_fullsized":"2024-09-12T22:35:32.750673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:39:17.785755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":44074,"num_write":389,"num_write_kb":44104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"60'459","reported_seq":614,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.760584+0000","last_change":"2024-09-12T22:35:33.760584+0000","last_active":"2024-09-12T22:35:33.760584+0000","last_peered":"2024-09-12T22:35:33.760584+0000","last_clean":"2024-09-12T22:35:33.760584+0000","last_became_active":"2024-09-12T22:35:33.754576+0000","last_became_peered":"2024-09-12T22:35:33.754576+0000","last_unstale":"2024-09-12T22:35:33.760584+0000","last_undegraded":"2024-09-12T22:35:33.760584+0000","last_fullsized":"2024-09-12T22:35:33.760584+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:14:34.676855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":28605,"num_write":432,"num_write_kb":100377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"60'419","reported_seq":516,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752435+0000","last_change":"2024-09-12T22:35:29.738235+0000","last_active":"2024-09-12T22:35:33.752435+0000","last_peered":"2024-09-12T22:35:33.752435+0000","last_clean":"2024-09-12T22:35:33.752435+0000","last_became_active":"2024-09-12T22:35:29.735450+0000","last_became_peered":"2024-09-12T22:35:29.735450+0000","last_unstale":"2024-09-12T22:35:33.752435+0000","last_undegraded":"2024-09-12T22:35:33.752435+0000","last_fullsized":"2024-09-12T22:35:33.752435+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:24.582229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":16852,"num_write":404,"num_write_kb":34622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"60'494","reported_seq":708,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.752021+0000","last_change":"2024-09-12T22:31:37.411880+0000","last_active":"2024-09-12T22:35:32.752021+0000","last_peered":"2024-09-12T22:35:32.752021+0000","last_clean":"2024-09-12T22:35:32.752021+0000","last_became_active":"2024-09-12T22:31:37.410563+0000","last_became_peered":"2024-09-12T22:31:37.410563+0000","last_unstale":"2024-09-12T22:35:32.752021+0000","last_undegraded":"2024-09-12T22:35:32.752021+0000","last_fullsized":"2024-09-12T22:35:32.752021+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":494,"log_dups_size":0,"ondisk_log_size":494,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:47:52.560533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":35239,"num_write":450,"num_write_kb":76898,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"60'401","reported_seq":921,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.752165+0000","last_change":"2024-09-12T22:35:30.732843+0000","last_active":"2024-09-12T22:35:32.752165+0000","last_peered":"2024-09-12T22:35:32.752165+0000","last_clean":"2024-09-12T22:35:32.752165+0000","last_became_active":"2024-09-12T22:35:30.731155+0000","last_became_peered":"2024-09-12T22:35:30.731155+0000","last_unstale":"2024-09-12T22:35:32.752165+0000","last_undegraded":"2024-09-12T22:35:32.752165+0000","last_fullsized":"2024-09-12T22:35:32.752165+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:54:33.926426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":10993,"num_write":369,"num_write_kb":55171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"60'390","reported_seq":538,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.763890+0000","last_change":"2024-09-12T22:35:33.763890+0000","last_active":"2024-09-12T22:35:33.763890+0000","last_peered":"2024-09-12T22:35:33.763890+0000","last_clean":"2024-09-12T22:35:33.763890+0000","last_became_active":"2024-09-12T22:35:33.756108+0000","last_became_peered":"2024-09-12T22:35:33.756108+0000","last_unstale":"2024-09-12T22:35:33.763890+0000","last_undegraded":"2024-09-12T22:35:33.763890+0000","last_fullsized":"2024-09-12T22:35:33.763890+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:53:03.258457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":18588,"num_write":360,"num_write_kb":59307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"60'429","reported_seq":1005,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.752084+0000","last_change":"2024-09-12T22:35:23.756871+0000","last_active":"2024-09-12T22:35:32.752084+0000","last_peered":"2024-09-12T22:35:32.752084+0000","last_clean":"2024-09-12T22:35:32.752084+0000","last_became_active":"2024-09-12T22:35:23.755618+0000","last_became_peered":"2024-09-12T22:35:23.755618+0000","last_unstale":"2024-09-12T22:35:32.752084+0000","last_undegraded":"2024-09-12T22:35:32.752084+0000","last_fullsized":"2024-09-12T22:35:32.752084+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:21:46.470290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":32541,"num_write":398,"num_write_kb":76609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"60'458","reported_seq":575,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.753011+0000","last_change":"2024-09-12T22:35:28.732538+0000","last_active":"2024-09-12T22:35:33.753011+0000","last_peered":"2024-09-12T22:35:33.753011+0000","last_clean":"2024-09-12T22:35:33.753011+0000","last_became_active":"2024-09-12T22:35:28.730337+0000","last_became_peered":"2024-09-12T22:35:28.730337+0000","last_unstale":"2024-09-12T22:35:33.753011+0000","last_undegraded":"2024-09-12T22:35:33.753011+0000","last_fullsized":"2024-09-12T22:35:33.753011+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":458,"log_dups_size":0,"ondisk_log_size":458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:55:45.185896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":16425,"num_write":413,"num_write_kb":47110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"60'432","reported_seq":980,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.750757+0000","last_change":"2024-09-12T22:35:26.732243+0000","last_active":"2024-09-12T22:35:32.750757+0000","last_peered":"2024-09-12T22:35:32.750757+0000","last_clean":"2024-09-12T22:35:32.750757+0000","last_became_active":"2024-09-12T22:35:26.731135+0000","last_became_peered":"2024-09-12T22:35:26.731135+0000","last_unstale":"2024-09-12T22:35:32.750757+0000","last_undegraded":"2024-09-12T22:35:32.750757+0000","last_fullsized":"2024-09-12T22:35:32.750757+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:34:06.084746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":21090,"num_write":393,"num_write_kb":67477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"60'458","reported_seq":634,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.751172+0000","last_change":"2024-09-12T22:31:37.415190+0000","last_active":"2024-09-12T22:35:32.751172+0000","last_peered":"2024-09-12T22:35:32.751172+0000","last_clean":"2024-09-12T22:35:32.751172+0000","last_became_active":"2024-09-12T22:31:37.414265+0000","last_became_peered":"2024-09-12T22:31:37.414265+0000","last_unstale":"2024-09-12T22:35:32.751172+0000","last_undegraded":"2024-09-12T22:35:32.751172+0000","last_fullsized":"2024-09-12T22:35:32.751172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":458,"log_dups_size":0,"ondisk_log_size":458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:07:02.173590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":37395,"num_write":421,"num_write_kb":73250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"60'411","reported_seq":583,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.764162+0000","last_change":"2024-09-12T22:35:33.764162+0000","last_active":"2024-09-12T22:35:33.764162+0000","last_peered":"2024-09-12T22:35:33.764162+0000","last_clean":"2024-09-12T22:35:33.764162+0000","last_became_active":"2024-09-12T22:35:33.761121+0000","last_became_peered":"2024-09-12T22:35:33.761121+0000","last_unstale":"2024-09-12T22:35:33.764162+0000","last_undegraded":"2024-09-12T22:35:33.764162+0000","last_fullsized":"2024-09-12T22:35:33.764162+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:03:51.948278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":36400,"num_write":371,"num_write_kb":92142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"60'546","reported_seq":679,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.752305+0000","last_change":"2024-09-12T22:31:36.412082+0000","last_active":"2024-09-12T22:35:32.752305+0000","last_peered":"2024-09-12T22:35:32.752305+0000","last_clean":"2024-09-12T22:35:32.752305+0000","last_became_active":"2024-09-12T22:31:36.410871+0000","last_became_peered":"2024-09-12T22:31:36.410871+0000","last_unstale":"2024-09-12T22:35:32.752305+0000","last_undegraded":"2024-09-12T22:35:32.752305+0000","last_fullsized":"2024-09-12T22:35:32.752305+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":546,"log_dups_size":0,"ondisk_log_size":546,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:30:49.127253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":495,"num_write_kb":8426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"60'427","reported_seq":598,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.753291+0000","last_change":"2024-09-12T22:35:31.732681+0000","last_active":"2024-09-12T22:35:33.753291+0000","last_peered":"2024-09-12T22:35:33.753291+0000","last_clean":"2024-09-12T22:35:33.753291+0000","last_became_active":"2024-09-12T22:35:31.730237+0000","last_became_peered":"2024-09-12T22:35:31.730237+0000","last_unstale":"2024-09-12T22:35:33.753291+0000","last_undegraded":"2024-09-12T22:35:33.753291+0000","last_fullsized":"2024-09-12T22:35:33.753291+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:51:57.088855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":59223,"num_write":394,"num_write_kb":80309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":175,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"60'55","reported_seq":188,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.751522+0000","last_change":"2024-09-12T22:31:36.408563+0000","last_active":"2024-09-12T22:35:32.751522+0000","last_peered":"2024-09-12T22:35:32.751522+0000","last_clean":"2024-09-12T22:35:32.751522+0000","last_became_active":"2024-09-12T22:31:36.407447+0000","last_became_peered":"2024-09-12T22:31:36.407447+0000","last_unstale":"2024-09-12T22:35:32.751522+0000","last_undegraded":"2024-09-12T22:35:32.751522+0000","last_fullsized":"2024-09-12T22:35:32.751522+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:29:37.933109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"60'424","reported_seq":586,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.752707+0000","last_change":"2024-09-12T22:31:37.411680+0000","last_active":"2024-09-12T22:35:32.752707+0000","last_peered":"2024-09-12T22:35:32.752707+0000","last_clean":"2024-09-12T22:35:32.752707+0000","last_became_active":"2024-09-12T22:31:37.411168+0000","last_became_peered":"2024-09-12T22:31:37.411168+0000","last_unstale":"2024-09-12T22:35:32.752707+0000","last_undegraded":"2024-09-12T22:35:32.752707+0000","last_fullsized":"2024-09-12T22:35:32.752707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:27.706282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":13992,"num_write":386,"num_write_kb":38510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"60'70","reported_seq":47,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752499+0000","last_change":"2024-09-12T22:35:20.734652+0000","last_active":"2024-09-12T22:35:33.752499+0000","last_peered":"2024-09-12T22:35:33.752499+0000","last_clean":"2024-09-12T22:35:33.752499+0000","last_became_active":"2024-09-12T22:35:20.734023+0000","last_became_peered":"2024-09-12T22:35:20.734023+0000","last_unstale":"2024-09-12T22:35:33.752499+0000","last_undegraded":"2024-09-12T22:35:33.752499+0000","last_fullsized":"2024-09-12T22:35:33.752499+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:18:27.888573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"60'395","reported_seq":575,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.751711+0000","last_change":"2024-09-12T22:31:37.411218+0000","last_active":"2024-09-12T22:35:32.751711+0000","last_peered":"2024-09-12T22:35:32.751711+0000","last_clean":"2024-09-12T22:35:32.751711+0000","last_became_active":"2024-09-12T22:31:37.409666+0000","last_became_peered":"2024-09-12T22:31:37.409666+0000","last_unstale":"2024-09-12T22:35:32.751711+0000","last_undegraded":"2024-09-12T22:35:32.751711+0000","last_fullsized":"2024-09-12T22:35:32.751711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:45:34.230090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":24198,"num_write":363,"num_write_kb":67056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"60'68","reported_seq":209,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.751319+0000","last_change":"2024-09-12T22:35:20.737076+0000","last_active":"2024-09-12T22:35:32.751319+0000","last_peered":"2024-09-12T22:35:32.751319+0000","last_clean":"2024-09-12T22:35:32.751319+0000","last_became_active":"2024-09-12T22:35:20.736755+0000","last_became_peered":"2024-09-12T22:35:20.736755+0000","last_unstale":"2024-09-12T22:35:32.751319+0000","last_undegraded":"2024-09-12T22:35:32.751319+0000","last_fullsized":"2024-09-12T22:35:32.751319+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:57:36.195186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"60'158","reported_seq":305,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.752766+0000","last_change":"2024-09-12T22:35:23.756940+0000","last_active":"2024-09-12T22:35:32.752766+0000","last_peered":"2024-09-12T22:35:32.752766+0000","last_clean":"2024-09-12T22:35:32.752766+0000","last_became_active":"2024-09-12T22:35:23.756663+0000","last_became_peered":"2024-09-12T22:35:23.756663+0000","last_unstale":"2024-09-12T22:35:32.752766+0000","last_undegraded":"2024-09-12T22:35:32.752766+0000","last_fullsized":"2024-09-12T22:35:32.752766+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:08:58.453420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":105,"num_write_kb":4159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"60'426","reported_seq":545,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.753740+0000","last_change":"2024-09-12T22:35:26.735223+0000","last_active":"2024-09-12T22:35:33.753740+0000","last_peered":"2024-09-12T22:35:33.753740+0000","last_clean":"2024-09-12T22:35:33.753740+0000","last_became_active":"2024-09-12T22:35:26.732245+0000","last_became_peered":"2024-09-12T22:35:26.732245+0000","last_unstale":"2024-09-12T22:35:33.753740+0000","last_undegraded":"2024-09-12T22:35:33.753740+0000","last_fullsized":"2024-09-12T22:35:33.753740+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:29:27.860798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":29225,"num_write":390,"num_write_kb":83737,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"60'274","reported_seq":367,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752328+0000","last_change":"2024-09-12T22:35:23.755688+0000","last_active":"2024-09-12T22:35:33.752328+0000","last_peered":"2024-09-12T22:35:33.752328+0000","last_clean":"2024-09-12T22:35:33.752328+0000","last_became_active":"2024-09-12T22:35:23.755282+0000","last_became_peered":"2024-09-12T22:35:23.755282+0000","last_unstale":"2024-09-12T22:35:33.752328+0000","last_undegraded":"2024-09-12T22:35:33.752328+0000","last_fullsized":"2024-09-12T22:35:33.752328+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":274,"log_dups_size":0,"ondisk_log_size":274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:44:38.920273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":213,"num_write_kb":4214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"60'455","reported_seq":607,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.760415+0000","last_change":"2024-09-12T22:35:33.760415+0000","last_active":"2024-09-12T22:35:33.760415+0000","last_peered":"2024-09-12T22:35:33.760415+0000","last_clean":"2024-09-12T22:35:33.760415+0000","last_became_active":"2024-09-12T22:35:33.754299+0000","last_became_peered":"2024-09-12T22:35:33.754299+0000","last_unstale":"2024-09-12T22:35:33.760415+0000","last_undegraded":"2024-09-12T22:35:33.760415+0000","last_fullsized":"2024-09-12T22:35:33.760415+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:26:00.753338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":20747,"num_write":425,"num_write_kb":56005,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"60'423","reported_seq":570,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.753143+0000","last_change":"2024-09-12T22:35:23.757047+0000","last_active":"2024-09-12T22:35:32.753143+0000","last_peered":"2024-09-12T22:35:32.753143+0000","last_clean":"2024-09-12T22:35:32.753143+0000","last_became_active":"2024-09-12T22:35:23.756668+0000","last_became_peered":"2024-09-12T22:35:23.756668+0000","last_unstale":"2024-09-12T22:35:32.753143+0000","last_undegraded":"2024-09-12T22:35:32.753143+0000","last_fullsized":"2024-09-12T22:35:32.753143+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:53:35.298628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":371,"num_write_kb":4254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"60'431","reported_seq":596,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.751328+0000","last_change":"2024-09-12T22:31:37.414809+0000","last_active":"2024-09-12T22:35:32.751328+0000","last_peered":"2024-09-12T22:35:32.751328+0000","last_clean":"2024-09-12T22:35:32.751328+0000","last_became_active":"2024-09-12T22:31:37.414492+0000","last_became_peered":"2024-09-12T22:31:37.414492+0000","last_unstale":"2024-09-12T22:35:32.751328+0000","last_undegraded":"2024-09-12T22:35:32.751328+0000","last_fullsized":"2024-09-12T22:35:32.751328+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:50:48.426898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":21479,"num_write":394,"num_write_kb":83756,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"60'70","reported_seq":203,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.752793+0000","last_change":"2024-09-12T22:31:36.412068+0000","last_active":"2024-09-12T22:35:32.752793+0000","last_peered":"2024-09-12T22:35:32.752793+0000","last_clean":"2024-09-12T22:35:32.752793+0000","last_became_active":"2024-09-12T22:31:36.411366+0000","last_became_peered":"2024-09-12T22:31:36.411366+0000","last_unstale":"2024-09-12T22:35:32.752793+0000","last_undegraded":"2024-09-12T22:35:32.752793+0000","last_fullsized":"2024-09-12T22:35:32.752793+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:35:51.647051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"60'471","reported_seq":671,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.752314+0000","last_change":"2024-09-12T22:31:37.410303+0000","last_active":"2024-09-12T22:35:32.752314+0000","last_peered":"2024-09-12T22:35:32.752314+0000","last_clean":"2024-09-12T22:35:32.752314+0000","last_became_active":"2024-09-12T22:31:37.409607+0000","last_became_peered":"2024-09-12T22:31:37.409607+0000","last_unstale":"2024-09-12T22:35:32.752314+0000","last_undegraded":"2024-09-12T22:35:32.752314+0000","last_fullsized":"2024-09-12T22:35:32.752314+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":471,"log_dups_size":0,"ondisk_log_size":471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:53:42.732654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":37922,"num_write":440,"num_write_kb":138112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"60'209","reported_seq":342,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.752462+0000","last_change":"2024-09-12T22:31:36.407974+0000","last_active":"2024-09-12T22:35:32.752462+0000","last_peered":"2024-09-12T22:35:32.752462+0000","last_clean":"2024-09-12T22:35:32.752462+0000","last_became_active":"2024-09-12T22:31:36.406955+0000","last_became_peered":"2024-09-12T22:31:36.406955+0000","last_unstale":"2024-09-12T22:35:32.752462+0000","last_undegraded":"2024-09-12T22:35:32.752462+0000","last_fullsized":"2024-09-12T22:35:32.752462+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:07:34.831264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":8267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"60'437","reported_seq":578,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.752444+0000","last_change":"2024-09-12T22:31:37.415285+0000","last_active":"2024-09-12T22:35:32.752444+0000","last_peered":"2024-09-12T22:35:32.752444+0000","last_clean":"2024-09-12T22:35:32.752444+0000","last_became_active":"2024-09-12T22:31:37.414890+0000","last_became_peered":"2024-09-12T22:31:37.414890+0000","last_unstale":"2024-09-12T22:35:32.752444+0000","last_undegraded":"2024-09-12T22:35:32.752444+0000","last_fullsized":"2024-09-12T22:35:32.752444+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:38:16.956786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":4587,"num_write":407,"num_write_kb":50860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"60'108","reported_seq":241,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.751610+0000","last_change":"2024-09-12T22:31:36.412147+0000","last_active":"2024-09-12T22:35:32.751610+0000","last_peered":"2024-09-12T22:35:32.751610+0000","last_clean":"2024-09-12T22:35:32.751610+0000","last_became_active":"2024-09-12T22:31:36.411382+0000","last_became_peered":"2024-09-12T22:31:36.411382+0000","last_unstale":"2024-09-12T22:35:32.751610+0000","last_undegraded":"2024-09-12T22:35:32.751610+0000","last_fullsized":"2024-09-12T22:35:32.751610+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:54:51.454867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":4129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"60'407","reported_seq":925,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.752981+0000","last_change":"2024-09-12T22:35:31.732325+0000","last_active":"2024-09-12T22:35:32.752981+0000","last_peered":"2024-09-12T22:35:32.752981+0000","last_clean":"2024-09-12T22:35:32.752981+0000","last_became_active":"2024-09-12T22:35:31.729817+0000","last_became_peered":"2024-09-12T22:35:31.729817+0000","last_unstale":"2024-09-12T22:35:32.752981+0000","last_undegraded":"2024-09-12T22:35:32.752981+0000","last_fullsized":"2024-09-12T22:35:32.752981+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:21:52.633068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":5615,"num_write":375,"num_write_kb":50827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"60'57","reported_seq":47,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.751984+0000","last_change":"2024-09-12T22:35:20.734244+0000","last_active":"2024-09-12T22:35:33.751984+0000","last_peered":"2024-09-12T22:35:33.751984+0000","last_clean":"2024-09-12T22:35:33.751984+0000","last_became_active":"2024-09-12T22:35:20.733664+0000","last_became_peered":"2024-09-12T22:35:20.733664+0000","last_unstale":"2024-09-12T22:35:33.751984+0000","last_undegraded":"2024-09-12T22:35:33.751984+0000","last_fullsized":"2024-09-12T22:35:33.751984+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:41:11.108676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"60'357","reported_seq":831,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.752466+0000","last_change":"2024-09-12T22:35:27.734437+0000","last_active":"2024-09-12T22:35:32.752466+0000","last_peered":"2024-09-12T22:35:32.752466+0000","last_clean":"2024-09-12T22:35:32.752466+0000","last_became_active":"2024-09-12T22:35:27.733274+0000","last_became_peered":"2024-09-12T22:35:27.733274+0000","last_unstale":"2024-09-12T22:35:32.752466+0000","last_undegraded":"2024-09-12T22:35:32.752466+0000","last_fullsized":"2024-09-12T22:35:32.752466+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":357,"log_dups_size":0,"ondisk_log_size":357,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:35:58.820958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":2460,"num_write":324,"num_write_kb":37873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"60'417","reported_seq":501,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.753610+0000","last_change":"2024-09-12T22:35:23.755080+0000","last_active":"2024-09-12T22:35:33.753610+0000","last_peered":"2024-09-12T22:35:33.753610+0000","last_clean":"2024-09-12T22:35:33.753610+0000","last_became_active":"2024-09-12T22:35:23.754683+0000","last_became_peered":"2024-09-12T22:35:23.754683+0000","last_unstale":"2024-09-12T22:35:33.753610+0000","last_undegraded":"2024-09-12T22:35:33.753610+0000","last_fullsized":"2024-09-12T22:35:33.753610+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:34:00.150680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":359,"num_write_kb":4251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"60'416","reported_seq":961,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.751903+0000","last_change":"2024-09-12T22:35:30.730978+0000","last_active":"2024-09-12T22:35:32.751903+0000","last_peered":"2024-09-12T22:35:32.751903+0000","last_clean":"2024-09-12T22:35:32.751903+0000","last_became_active":"2024-09-12T22:35:30.729912+0000","last_became_peered":"2024-09-12T22:35:30.729912+0000","last_unstale":"2024-09-12T22:35:32.751903+0000","last_undegraded":"2024-09-12T22:35:32.751903+0000","last_fullsized":"2024-09-12T22:35:32.751903+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:32:25.562466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":42190,"num_write":377,"num_write_kb":87849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":351,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.751576+0000","last_change":"2024-09-12T22:35:20.737092+0000","last_active":"2024-09-12T22:35:32.751576+0000","last_peered":"2024-09-12T22:35:32.751576+0000","last_clean":"2024-09-12T22:35:32.751576+0000","last_became_active":"2024-09-12T22:35:20.736721+0000","last_became_peered":"2024-09-12T22:35:20.736721+0000","last_unstale":"2024-09-12T22:35:32.751576+0000","last_undegraded":"2024-09-12T22:35:32.751576+0000","last_fullsized":"2024-09-12T22:35:32.751576+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:26.229539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:26.229539+0000","last_clean_scrub_stamp":"2024-09-12T22:31:26.229539+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:44:38.486987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":147,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.752551+0000","last_change":"2024-09-12T22:31:34.286952+0000","last_active":"2024-09-12T22:35:32.752551+0000","last_peered":"2024-09-12T22:35:32.752551+0000","last_clean":"2024-09-12T22:35:32.752551+0000","last_became_active":"2024-09-12T22:31:32.283661+0000","last_became_peered":"2024-09-12T22:31:32.283661+0000","last_unstale":"2024-09-12T22:35:32.752551+0000","last_undegraded":"2024-09-12T22:35:32.752551+0000","last_fullsized":"2024-09-12T22:35:32.752551+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:21.681390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000621274,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"60'678","reported_seq":826,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.751874+0000","last_change":"2024-09-12T22:35:23.755996+0000","last_active":"2024-09-12T22:35:32.751874+0000","last_peered":"2024-09-12T22:35:32.751874+0000","last_clean":"2024-09-12T22:35:32.751874+0000","last_became_active":"2024-09-12T22:35:23.755652+0000","last_became_peered":"2024-09-12T22:35:23.755652+0000","last_unstale":"2024-09-12T22:35:32.751874+0000","last_undegraded":"2024-09-12T22:35:32.751874+0000","last_fullsized":"2024-09-12T22:35:32.751874+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":678,"log_dups_size":0,"ondisk_log_size":678,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:05:19.284888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":608,"num_write_kb":8482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"60'426","reported_seq":974,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.753120+0000","last_change":"2024-09-12T22:35:31.732344+0000","last_active":"2024-09-12T22:35:32.753120+0000","last_peered":"2024-09-12T22:35:32.753120+0000","last_clean":"2024-09-12T22:35:32.753120+0000","last_became_active":"2024-09-12T22:35:31.730242+0000","last_became_peered":"2024-09-12T22:35:31.730242+0000","last_unstale":"2024-09-12T22:35:32.753120+0000","last_undegraded":"2024-09-12T22:35:32.753120+0000","last_fullsized":"2024-09-12T22:35:32.753120+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:45:28.259069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":24636,"num_write":392,"num_write_kb":59176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":153,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.751568+0000","last_change":"2024-09-12T22:35:20.735913+0000","last_active":"2024-09-12T22:35:32.751568+0000","last_peered":"2024-09-12T22:35:32.751568+0000","last_clean":"2024-09-12T22:35:32.751568+0000","last_became_active":"2024-09-12T22:35:20.735545+0000","last_became_peered":"2024-09-12T22:35:20.735545+0000","last_unstale":"2024-09-12T22:35:32.751568+0000","last_undegraded":"2024-09-12T22:35:32.751568+0000","last_fullsized":"2024-09-12T22:35:32.751568+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:37:09.150338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037858999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"60'106","reported_seq":282,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.751154+0000","last_change":"2024-09-12T22:31:36.407395+0000","last_active":"2024-09-12T22:35:32.751154+0000","last_peered":"2024-09-12T22:35:32.751154+0000","last_clean":"2024-09-12T22:35:32.751154+0000","last_became_active":"2024-09-12T22:31:36.406770+0000","last_became_peered":"2024-09-12T22:31:36.406770+0000","last_unstale":"2024-09-12T22:35:32.751154+0000","last_undegraded":"2024-09-12T22:35:32.751154+0000","last_fullsized":"2024-09-12T22:35:32.751154+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:49:26.547848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1467429,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":43,"num_read_kb":1462,"num_write":43,"num_write_kb":1462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"60'448","reported_seq":547,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.753927+0000","last_change":"2024-09-12T22:35:27.733064+0000","last_active":"2024-09-12T22:35:33.753927+0000","last_peered":"2024-09-12T22:35:33.753927+0000","last_clean":"2024-09-12T22:35:33.753927+0000","last_became_active":"2024-09-12T22:35:27.729522+0000","last_became_peered":"2024-09-12T22:35:27.729522+0000","last_unstale":"2024-09-12T22:35:33.753927+0000","last_undegraded":"2024-09-12T22:35:33.753927+0000","last_fullsized":"2024-09-12T22:35:33.753927+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:59:06.989020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":10436,"num_write":420,"num_write_kb":67816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":153,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.751267+0000","last_change":"2024-09-12T22:35:20.735217+0000","last_active":"2024-09-12T22:35:32.751267+0000","last_peered":"2024-09-12T22:35:32.751267+0000","last_clean":"2024-09-12T22:35:32.751267+0000","last_became_active":"2024-09-12T22:35:20.734643+0000","last_became_peered":"2024-09-12T22:35:20.734643+0000","last_unstale":"2024-09-12T22:35:32.751267+0000","last_undegraded":"2024-09-12T22:35:32.751267+0000","last_fullsized":"2024-09-12T22:35:32.751267+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:27:17.331198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039540700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"60'292","reported_seq":404,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.761303+0000","last_change":"2024-09-12T22:35:33.761303+0000","last_active":"2024-09-12T22:35:33.761303+0000","last_peered":"2024-09-12T22:35:33.761303+0000","last_clean":"2024-09-12T22:35:33.761303+0000","last_became_active":"2024-09-12T22:35:33.760742+0000","last_became_peered":"2024-09-12T22:35:33.760742+0000","last_unstale":"2024-09-12T22:35:33.761303+0000","last_undegraded":"2024-09-12T22:35:33.761303+0000","last_fullsized":"2024-09-12T22:35:33.761303+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":292,"log_dups_size":0,"ondisk_log_size":292,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:48:04.210933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":235,"num_write_kb":8293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"60'375","reported_seq":910,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.752023+0000","last_change":"2024-09-12T22:35:29.740484+0000","last_active":"2024-09-12T22:35:32.752023+0000","last_peered":"2024-09-12T22:35:32.752023+0000","last_clean":"2024-09-12T22:35:32.752023+0000","last_became_active":"2024-09-12T22:35:29.738755+0000","last_became_peered":"2024-09-12T22:35:29.738755+0000","last_unstale":"2024-09-12T22:35:32.752023+0000","last_undegraded":"2024-09-12T22:35:32.752023+0000","last_fullsized":"2024-09-12T22:35:32.752023+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:07:35.007529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":43566,"num_write":354,"num_write_kb":92229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":160,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":148,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.751641+0000","last_change":"2024-09-12T22:31:34.286938+0000","last_active":"2024-09-12T22:35:32.751641+0000","last_peered":"2024-09-12T22:35:32.751641+0000","last_clean":"2024-09-12T22:35:32.751641+0000","last_became_active":"2024-09-12T22:31:32.282230+0000","last_became_peered":"2024-09-12T22:31:32.282230+0000","last_unstale":"2024-09-12T22:35:32.751641+0000","last_undegraded":"2024-09-12T22:35:32.751641+0000","last_fullsized":"2024-09-12T22:35:32.751641+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:11:05.988384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000615758,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"60'63","reported_seq":196,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.752347+0000","last_change":"2024-09-12T22:31:36.410694+0000","last_active":"2024-09-12T22:35:32.752347+0000","last_peered":"2024-09-12T22:35:32.752347+0000","last_clean":"2024-09-12T22:35:32.752347+0000","last_became_active":"2024-09-12T22:31:36.409816+0000","last_became_peered":"2024-09-12T22:31:36.409816+0000","last_unstale":"2024-09-12T22:35:32.752347+0000","last_undegraded":"2024-09-12T22:35:32.752347+0000","last_fullsized":"2024-09-12T22:35:32.752347+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:40:35.369213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"60'405","reported_seq":927,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.752175+0000","last_change":"2024-09-12T22:35:29.736704+0000","last_active":"2024-09-12T22:35:32.752175+0000","last_peered":"2024-09-12T22:35:32.752175+0000","last_clean":"2024-09-12T22:35:32.752175+0000","last_became_active":"2024-09-12T22:35:29.735499+0000","last_became_peered":"2024-09-12T22:35:29.735499+0000","last_unstale":"2024-09-12T22:35:32.752175+0000","last_undegraded":"2024-09-12T22:35:32.752175+0000","last_fullsized":"2024-09-12T22:35:32.752175+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:26:06.464684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":20152,"num_write":366,"num_write_kb":92447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"60'277","reported_seq":361,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.753169+0000","last_change":"2024-09-12T22:35:23.755555+0000","last_active":"2024-09-12T22:35:33.753169+0000","last_peered":"2024-09-12T22:35:33.753169+0000","last_clean":"2024-09-12T22:35:33.753169+0000","last_became_active":"2024-09-12T22:35:23.755237+0000","last_became_peered":"2024-09-12T22:35:23.755237+0000","last_unstale":"2024-09-12T22:35:33.753169+0000","last_undegraded":"2024-09-12T22:35:33.753169+0000","last_fullsized":"2024-09-12T22:35:33.753169+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":277,"log_dups_size":0,"ondisk_log_size":277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:10:23.649578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":216,"num_write_kb":4193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":153,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.752317+0000","last_change":"2024-09-12T22:35:20.736644+0000","last_active":"2024-09-12T22:35:32.752317+0000","last_peered":"2024-09-12T22:35:32.752317+0000","last_clean":"2024-09-12T22:35:32.752317+0000","last_became_active":"2024-09-12T22:35:20.736428+0000","last_became_peered":"2024-09-12T22:35:20.736428+0000","last_unstale":"2024-09-12T22:35:32.752317+0000","last_undegraded":"2024-09-12T22:35:32.752317+0000","last_fullsized":"2024-09-12T22:35:32.752317+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:42:12.023369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041972500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"60'355","reported_seq":457,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752866+0000","last_change":"2024-09-12T22:35:25.729864+0000","last_active":"2024-09-12T22:35:33.752866+0000","last_peered":"2024-09-12T22:35:33.752866+0000","last_clean":"2024-09-12T22:35:33.752866+0000","last_became_active":"2024-09-12T22:35:25.727299+0000","last_became_peered":"2024-09-12T22:35:25.727299+0000","last_unstale":"2024-09-12T22:35:33.752866+0000","last_undegraded":"2024-09-12T22:35:33.752866+0000","last_fullsized":"2024-09-12T22:35:33.752866+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":355,"log_dups_size":0,"ondisk_log_size":355,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:56:40.812767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13196,"num_write":321,"num_write_kb":41797,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"60'55","reported_seq":195,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.752178+0000","last_change":"2024-09-12T22:35:20.738078+0000","last_active":"2024-09-12T22:35:32.752178+0000","last_peered":"2024-09-12T22:35:32.752178+0000","last_clean":"2024-09-12T22:35:32.752178+0000","last_became_active":"2024-09-12T22:35:20.737705+0000","last_became_peered":"2024-09-12T22:35:20.737705+0000","last_unstale":"2024-09-12T22:35:32.752178+0000","last_undegraded":"2024-09-12T22:35:32.752178+0000","last_fullsized":"2024-09-12T22:35:32.752178+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:04:15.554381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":68,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.754453+0000","last_change":"2024-09-12T22:35:20.738327+0000","last_active":"2024-09-12T22:35:33.754453+0000","last_peered":"2024-09-12T22:35:33.754453+0000","last_clean":"2024-09-12T22:35:33.754453+0000","last_became_active":"2024-09-12T22:35:20.737799+0000","last_became_peered":"2024-09-12T22:35:20.737799+0000","last_unstale":"2024-09-12T22:35:33.754453+0000","last_undegraded":"2024-09-12T22:35:33.754453+0000","last_fullsized":"2024-09-12T22:35:33.754453+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:03:16.381453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"60'385","reported_seq":533,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.761943+0000","last_change":"2024-09-12T22:35:33.761943+0000","last_active":"2024-09-12T22:35:33.761943+0000","last_peered":"2024-09-12T22:35:33.761943+0000","last_clean":"2024-09-12T22:35:33.761943+0000","last_became_active":"2024-09-12T22:35:33.754546+0000","last_became_peered":"2024-09-12T22:35:33.754546+0000","last_unstale":"2024-09-12T22:35:33.761943+0000","last_undegraded":"2024-09-12T22:35:33.761943+0000","last_fullsized":"2024-09-12T22:35:33.761943+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:35:36.478089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":22437,"num_write":347,"num_write_kb":30121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"60'61","reported_seq":202,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.753022+0000","last_change":"2024-09-12T22:35:20.738494+0000","last_active":"2024-09-12T22:35:32.753022+0000","last_peered":"2024-09-12T22:35:32.753022+0000","last_clean":"2024-09-12T22:35:32.753022+0000","last_became_active":"2024-09-12T22:35:20.738129+0000","last_became_peered":"2024-09-12T22:35:20.738129+0000","last_unstale":"2024-09-12T22:35:32.753022+0000","last_undegraded":"2024-09-12T22:35:32.753022+0000","last_fullsized":"2024-09-12T22:35:32.753022+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:27:06.987354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":153,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.752907+0000","last_change":"2024-09-12T22:35:20.736934+0000","last_active":"2024-09-12T22:35:32.752907+0000","last_peered":"2024-09-12T22:35:32.752907+0000","last_clean":"2024-09-12T22:35:32.752907+0000","last_became_active":"2024-09-12T22:35:20.736628+0000","last_became_peered":"2024-09-12T22:35:20.736628+0000","last_unstale":"2024-09-12T22:35:32.752907+0000","last_undegraded":"2024-09-12T22:35:32.752907+0000","last_fullsized":"2024-09-12T22:35:32.752907+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:04:03.284313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058589999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"60'402","reported_seq":551,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.750986+0000","last_change":"2024-09-12T22:31:37.411152+0000","last_active":"2024-09-12T22:35:32.750986+0000","last_peered":"2024-09-12T22:35:32.750986+0000","last_clean":"2024-09-12T22:35:32.750986+0000","last_became_active":"2024-09-12T22:31:37.410558+0000","last_became_peered":"2024-09-12T22:31:37.410558+0000","last_unstale":"2024-09-12T22:35:32.750986+0000","last_undegraded":"2024-09-12T22:35:32.750986+0000","last_fullsized":"2024-09-12T22:35:32.750986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:14:29.892478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":10169,"num_write":370,"num_write_kb":38130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"61'105","reported_seq":238,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.752870+0000","last_change":"2024-09-12T22:31:36.407460+0000","last_active":"2024-09-12T22:35:32.752870+0000","last_peered":"2024-09-12T22:35:32.752870+0000","last_clean":"2024-09-12T22:35:32.752870+0000","last_became_active":"2024-09-12T22:31:36.406729+0000","last_became_peered":"2024-09-12T22:31:36.406729+0000","last_unstale":"2024-09-12T22:35:32.752870+0000","last_undegraded":"2024-09-12T22:35:32.752870+0000","last_fullsized":"2024-09-12T22:35:32.752870+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:27:58.012573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103,"num_write_kb":1085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":153,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.752840+0000","last_change":"2024-09-12T22:35:20.737068+0000","last_active":"2024-09-12T22:35:32.752840+0000","last_peered":"2024-09-12T22:35:32.752840+0000","last_clean":"2024-09-12T22:35:32.752840+0000","last_became_active":"2024-09-12T22:35:20.736769+0000","last_became_peered":"2024-09-12T22:35:20.736769+0000","last_unstale":"2024-09-12T22:35:32.752840+0000","last_undegraded":"2024-09-12T22:35:32.752840+0000","last_fullsized":"2024-09-12T22:35:32.752840+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:44:36.675350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000382109,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"60'412","reported_seq":550,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752676+0000","last_change":"2024-09-12T22:35:26.734859+0000","last_active":"2024-09-12T22:35:33.752676+0000","last_peered":"2024-09-12T22:35:33.752676+0000","last_clean":"2024-09-12T22:35:33.752676+0000","last_became_active":"2024-09-12T22:35:26.732923+0000","last_became_peered":"2024-09-12T22:35:26.732923+0000","last_unstale":"2024-09-12T22:35:33.752676+0000","last_undegraded":"2024-09-12T22:35:33.752676+0000","last_fullsized":"2024-09-12T22:35:33.752676+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:48:09.924688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":34504,"num_write":385,"num_write_kb":100438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"60'415","reported_seq":966,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.751921+0000","last_change":"2024-09-12T22:35:24.760883+0000","last_active":"2024-09-12T22:35:32.751921+0000","last_peered":"2024-09-12T22:35:32.751921+0000","last_clean":"2024-09-12T22:35:32.751921+0000","last_became_active":"2024-09-12T22:35:24.759441+0000","last_became_peered":"2024-09-12T22:35:24.759441+0000","last_unstale":"2024-09-12T22:35:32.751921+0000","last_undegraded":"2024-09-12T22:35:32.751921+0000","last_fullsized":"2024-09-12T22:35:32.751921+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:26:21.054210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":37207,"num_write":375,"num_write_kb":84660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"60'221","reported_seq":372,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.752659+0000","last_change":"2024-09-12T22:35:23.756290+0000","last_active":"2024-09-12T22:35:32.752659+0000","last_peered":"2024-09-12T22:35:32.752659+0000","last_clean":"2024-09-12T22:35:32.752659+0000","last_became_active":"2024-09-12T22:35:23.755918+0000","last_became_peered":"2024-09-12T22:35:23.755918+0000","last_unstale":"2024-09-12T22:35:32.752659+0000","last_undegraded":"2024-09-12T22:35:32.752659+0000","last_fullsized":"2024-09-12T22:35:32.752659+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":221,"log_dups_size":0,"ondisk_log_size":221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:08:03.811119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":175,"num_write_kb":8282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":8382815,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"60'429","reported_seq":959,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.751022+0000","last_change":"2024-09-12T22:35:25.728726+0000","last_active":"2024-09-12T22:35:32.751022+0000","last_peered":"2024-09-12T22:35:32.751022+0000","last_clean":"2024-09-12T22:35:32.751022+0000","last_became_active":"2024-09-12T22:35:25.726837+0000","last_became_peered":"2024-09-12T22:35:25.726837+0000","last_unstale":"2024-09-12T22:35:32.751022+0000","last_undegraded":"2024-09-12T22:35:32.751022+0000","last_fullsized":"2024-09-12T22:35:32.751022+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:38.996042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":12230,"num_write":389,"num_write_kb":71746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"60'98","reported_seq":217,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.760239+0000","last_change":"2024-09-12T22:35:33.760239+0000","last_active":"2024-09-12T22:35:33.760239+0000","last_peered":"2024-09-12T22:35:33.760239+0000","last_clean":"2024-09-12T22:35:33.760239+0000","last_became_active":"2024-09-12T22:35:33.758640+0000","last_became_peered":"2024-09-12T22:35:33.758640+0000","last_unstale":"2024-09-12T22:35:33.760239+0000","last_undegraded":"2024-09-12T22:35:33.760239+0000","last_fullsized":"2024-09-12T22:35:33.760239+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:24:11.251168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"60'214","reported_seq":347,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.752646+0000","last_change":"2024-09-12T22:31:36.411549+0000","last_active":"2024-09-12T22:35:32.752646+0000","last_peered":"2024-09-12T22:35:32.752646+0000","last_clean":"2024-09-12T22:35:32.752646+0000","last_became_active":"2024-09-12T22:31:36.410674+0000","last_became_peered":"2024-09-12T22:31:36.410674+0000","last_unstale":"2024-09-12T22:35:32.752646+0000","last_undegraded":"2024-09-12T22:35:32.752646+0000","last_fullsized":"2024-09-12T22:35:32.752646+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:58:05.676197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":151,"num_write_kb":4168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"60'460","reported_seq":620,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.750802+0000","last_change":"2024-09-12T22:31:37.411254+0000","last_active":"2024-09-12T22:35:32.750802+0000","last_peered":"2024-09-12T22:35:32.750802+0000","last_clean":"2024-09-12T22:35:32.750802+0000","last_became_active":"2024-09-12T22:31:37.410404+0000","last_became_peered":"2024-09-12T22:31:37.410404+0000","last_unstale":"2024-09-12T22:35:32.750802+0000","last_undegraded":"2024-09-12T22:35:32.750802+0000","last_fullsized":"2024-09-12T22:35:32.750802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:42:00.856616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":15059,"num_write":431,"num_write_kb":59615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"60'52","reported_seq":185,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.752698+0000","last_change":"2024-09-12T22:31:36.408390+0000","last_active":"2024-09-12T22:35:32.752698+0000","last_peered":"2024-09-12T22:35:32.752698+0000","last_clean":"2024-09-12T22:35:32.752698+0000","last_became_active":"2024-09-12T22:31:36.407062+0000","last_became_peered":"2024-09-12T22:31:36.407062+0000","last_unstale":"2024-09-12T22:35:32.752698+0000","last_undegraded":"2024-09-12T22:35:32.752698+0000","last_fullsized":"2024-09-12T22:35:32.752698+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:09:10.618195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"60'461","reported_seq":1023,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.750862+0000","last_change":"2024-09-12T22:35:28.731581+0000","last_active":"2024-09-12T22:35:32.750862+0000","last_peered":"2024-09-12T22:35:32.750862+0000","last_clean":"2024-09-12T22:35:32.750862+0000","last_became_active":"2024-09-12T22:35:28.730402+0000","last_became_peered":"2024-09-12T22:35:28.730402+0000","last_unstale":"2024-09-12T22:35:32.750862+0000","last_undegraded":"2024-09-12T22:35:32.750862+0000","last_fullsized":"2024-09-12T22:35:32.750862+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:25:37.428224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":17508,"num_write":431,"num_write_kb":67883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":200,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"60'355","reported_seq":479,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752557+0000","last_change":"2024-09-12T22:35:28.732887+0000","last_active":"2024-09-12T22:35:33.752557+0000","last_peered":"2024-09-12T22:35:33.752557+0000","last_clean":"2024-09-12T22:35:33.752557+0000","last_became_active":"2024-09-12T22:35:28.730931+0000","last_became_peered":"2024-09-12T22:35:28.730931+0000","last_unstale":"2024-09-12T22:35:33.752557+0000","last_undegraded":"2024-09-12T22:35:33.752557+0000","last_fullsized":"2024-09-12T22:35:33.752557+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":355,"log_dups_size":0,"ondisk_log_size":355,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:14:12.194559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":44561,"num_write":329,"num_write_kb":26431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"60'548","reported_seq":696,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.751429+0000","last_change":"2024-09-12T22:35:23.756287+0000","last_active":"2024-09-12T22:35:32.751429+0000","last_peered":"2024-09-12T22:35:32.751429+0000","last_clean":"2024-09-12T22:35:32.751429+0000","last_became_active":"2024-09-12T22:35:23.755812+0000","last_became_peered":"2024-09-12T22:35:23.755812+0000","last_unstale":"2024-09-12T22:35:32.751429+0000","last_undegraded":"2024-09-12T22:35:32.751429+0000","last_fullsized":"2024-09-12T22:35:32.751429+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":548,"log_dups_size":0,"ondisk_log_size":548,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:15:13.597427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":488,"num_write_kb":8420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"60'422","reported_seq":665,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.752174+0000","last_change":"2024-09-12T22:31:37.411183+0000","last_active":"2024-09-12T22:35:32.752174+0000","last_peered":"2024-09-12T22:35:32.752174+0000","last_clean":"2024-09-12T22:35:32.752174+0000","last_became_active":"2024-09-12T22:31:37.409796+0000","last_became_peered":"2024-09-12T22:31:37.409796+0000","last_unstale":"2024-09-12T22:35:32.752174+0000","last_undegraded":"2024-09-12T22:35:32.752174+0000","last_fullsized":"2024-09-12T22:35:32.752174+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:20:35.779810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":51020,"num_write":397,"num_write_kb":73116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"60'180","reported_seq":313,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.750946+0000","last_change":"2024-09-12T22:31:36.407402+0000","last_active":"2024-09-12T22:35:32.750946+0000","last_peered":"2024-09-12T22:35:32.750946+0000","last_clean":"2024-09-12T22:35:32.750946+0000","last_became_active":"2024-09-12T22:31:36.406681+0000","last_became_peered":"2024-09-12T22:31:36.406681+0000","last_unstale":"2024-09-12T22:35:32.750946+0000","last_undegraded":"2024-09-12T22:35:32.750946+0000","last_fullsized":"2024-09-12T22:35:32.750946+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:39:39.362573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":134,"num_write_kb":4167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"60'420","reported_seq":545,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.753501+0000","last_change":"2024-09-12T22:35:30.734995+0000","last_active":"2024-09-12T22:35:33.753501+0000","last_peered":"2024-09-12T22:35:33.753501+0000","last_clean":"2024-09-12T22:35:33.753501+0000","last_became_active":"2024-09-12T22:35:30.733182+0000","last_became_peered":"2024-09-12T22:35:30.733182+0000","last_unstale":"2024-09-12T22:35:33.753501+0000","last_undegraded":"2024-09-12T22:35:33.753501+0000","last_fullsized":"2024-09-12T22:35:33.753501+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:01:30.939801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":24901,"num_write":369,"num_write_kb":75198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"61'212","reported_seq":324,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.755961+0000","last_change":"2024-09-12T22:35:33.755961+0000","last_active":"2024-09-12T22:35:33.755961+0000","last_peered":"2024-09-12T22:35:33.755961+0000","last_clean":"2024-09-12T22:35:33.755961+0000","last_became_active":"2024-09-12T22:35:33.754931+0000","last_became_peered":"2024-09-12T22:35:33.754931+0000","last_unstale":"2024-09-12T22:35:33.755961+0000","last_undegraded":"2024-09-12T22:35:33.755961+0000","last_fullsized":"2024-09-12T22:35:33.755961+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:12:35.586196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12553847,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":12334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"60'398","reported_seq":539,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.763810+0000","last_change":"2024-09-12T22:35:33.763810+0000","last_active":"2024-09-12T22:35:33.763810+0000","last_peered":"2024-09-12T22:35:33.763810+0000","last_clean":"2024-09-12T22:35:33.763810+0000","last_became_active":"2024-09-12T22:35:33.755497+0000","last_became_peered":"2024-09-12T22:35:33.755497+0000","last_unstale":"2024-09-12T22:35:33.763810+0000","last_undegraded":"2024-09-12T22:35:33.763810+0000","last_fullsized":"2024-09-12T22:35:33.763810+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:19:50.330571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":11429,"num_write":361,"num_write_kb":88082,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"60'54","reported_seq":55,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752689+0000","last_change":"2024-09-12T22:35:20.759946+0000","last_active":"2024-09-12T22:35:33.752689+0000","last_peered":"2024-09-12T22:35:33.752689+0000","last_clean":"2024-09-12T22:35:33.752689+0000","last_became_active":"2024-09-12T22:35:20.733271+0000","last_became_peered":"2024-09-12T22:35:20.733271+0000","last_unstale":"2024-09-12T22:35:33.752689+0000","last_undegraded":"2024-09-12T22:35:33.752689+0000","last_fullsized":"2024-09-12T22:35:33.752689+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:49:02.164294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"60'359","reported_seq":510,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.751796+0000","last_change":"2024-09-12T22:31:37.415365+0000","last_active":"2024-09-12T22:35:32.751796+0000","last_peered":"2024-09-12T22:35:32.751796+0000","last_clean":"2024-09-12T22:35:32.751796+0000","last_became_active":"2024-09-12T22:31:37.413933+0000","last_became_peered":"2024-09-12T22:31:37.413933+0000","last_unstale":"2024-09-12T22:35:32.751796+0000","last_undegraded":"2024-09-12T22:35:32.751796+0000","last_fullsized":"2024-09-12T22:35:32.751796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:08:07.115355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":12324,"num_write":332,"num_write_kb":46371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"60'186","reported_seq":319,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.752668+0000","last_change":"2024-09-12T22:31:36.411665+0000","last_active":"2024-09-12T22:35:32.752668+0000","last_peered":"2024-09-12T22:35:32.752668+0000","last_clean":"2024-09-12T22:35:32.752668+0000","last_became_active":"2024-09-12T22:31:36.410182+0000","last_became_peered":"2024-09-12T22:31:36.410182+0000","last_unstale":"2024-09-12T22:35:32.752668+0000","last_undegraded":"2024-09-12T22:35:32.752668+0000","last_fullsized":"2024-09-12T22:35:32.752668+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:37:20.891838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":4160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"60'401","reported_seq":568,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.751515+0000","last_change":"2024-09-12T22:31:37.415172+0000","last_active":"2024-09-12T22:35:32.751515+0000","last_peered":"2024-09-12T22:35:32.751515+0000","last_clean":"2024-09-12T22:35:32.751515+0000","last_became_active":"2024-09-12T22:31:37.414776+0000","last_became_peered":"2024-09-12T22:31:37.414776+0000","last_unstale":"2024-09-12T22:35:32.751515+0000","last_undegraded":"2024-09-12T22:35:32.751515+0000","last_fullsized":"2024-09-12T22:35:32.751515+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:42:32.307876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":24207,"num_write":361,"num_write_kb":50515,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"60'244","reported_seq":365,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.759131+0000","last_change":"2024-09-12T22:35:33.759131+0000","last_active":"2024-09-12T22:35:33.759131+0000","last_peered":"2024-09-12T22:35:33.759131+0000","last_clean":"2024-09-12T22:35:33.759131+0000","last_became_active":"2024-09-12T22:35:33.757550+0000","last_became_peered":"2024-09-12T22:35:33.757550+0000","last_unstale":"2024-09-12T22:35:33.759131+0000","last_undegraded":"2024-09-12T22:35:33.759131+0000","last_fullsized":"2024-09-12T22:35:33.759131+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":244,"log_dups_size":0,"ondisk_log_size":244,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:16:17.926249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":12389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"60'439","reported_seq":925,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.750926+0000","last_change":"2024-09-12T22:35:27.731026+0000","last_active":"2024-09-12T22:35:32.750926+0000","last_peered":"2024-09-12T22:35:32.750926+0000","last_clean":"2024-09-12T22:35:32.750926+0000","last_became_active":"2024-09-12T22:35:27.729827+0000","last_became_peered":"2024-09-12T22:35:27.729827+0000","last_unstale":"2024-09-12T22:35:32.750926+0000","last_undegraded":"2024-09-12T22:35:32.750926+0000","last_fullsized":"2024-09-12T22:35:32.750926+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:21:02.543670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":6311,"num_write":403,"num_write_kb":64161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"60'51","reported_seq":196,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.752582+0000","last_change":"2024-09-12T22:35:20.764696+0000","last_active":"2024-09-12T22:35:32.752582+0000","last_peered":"2024-09-12T22:35:32.752582+0000","last_clean":"2024-09-12T22:35:32.752582+0000","last_became_active":"2024-09-12T22:35:20.737444+0000","last_became_peered":"2024-09-12T22:35:20.737444+0000","last_unstale":"2024-09-12T22:35:32.752582+0000","last_undegraded":"2024-09-12T22:35:32.752582+0000","last_fullsized":"2024-09-12T22:35:32.752582+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:14:54.424047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"60'438","reported_seq":622,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.751465+0000","last_change":"2024-09-12T22:31:37.415390+0000","last_active":"2024-09-12T22:35:32.751465+0000","last_peered":"2024-09-12T22:35:32.751465+0000","last_clean":"2024-09-12T22:35:32.751465+0000","last_became_active":"2024-09-12T22:31:37.414781+0000","last_became_peered":"2024-09-12T22:31:37.414781+0000","last_unstale":"2024-09-12T22:35:32.751465+0000","last_undegraded":"2024-09-12T22:35:32.751465+0000","last_fullsized":"2024-09-12T22:35:32.751465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:42:17.728844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":29290,"num_write":407,"num_write_kb":46733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"60'111","reported_seq":244,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T22:35:32.752877+0000","last_change":"2024-09-12T22:31:36.407945+0000","last_active":"2024-09-12T22:35:32.752877+0000","last_peered":"2024-09-12T22:35:32.752877+0000","last_clean":"2024-09-12T22:35:32.752877+0000","last_became_active":"2024-09-12T22:31:36.406959+0000","last_became_peered":"2024-09-12T22:31:36.406959+0000","last_unstale":"2024-09-12T22:35:32.752877+0000","last_undegraded":"2024-09-12T22:35:32.752877+0000","last_fullsized":"2024-09-12T22:35:32.752877+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:26:33.155850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61,"num_write_kb":4126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2747,"num_read_kb":1535780,"num_write":24498,"num_write_kb":4269351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5680,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26636,"ondisk_log_size":26636,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127268954,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":43,"num_read_kb":1462,"num_write":4457,"num_write_kb":127482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":54520159,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":254603264,"data_stored":254537908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4442,"internal_metadata":0},"log_size":6263,"ondisk_log_size":6263,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705718,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":174076,"kb_used_data":84640,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94197764,"statfs":{"total":96636764160,"available":96458510336,"internally_reserved":0,"allocated":86671360,"data_stored":86268364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":66,"seq":283467841541,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":145348,"kb_used_data":87272,"kb_used_omap":5,"kb_used_meta":58042,"kb_avail":94226492,"statfs":{"total":96636764160,"available":96487927808,"internally_reserved":0,"allocated":89366528,"data_stored":88969829,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6037,"internal_metadata":59435115},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738422,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":173516,"kb_used_data":79924,"kb_used_omap":1,"kb_used_meta":93566,"kb_avail":94198324,"statfs":{"total":96636764160,"available":96459083776,"internally_reserved":0,"allocated":81842176,"data_stored":81458063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":95812037},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":88076288,"data_stored":88052173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4442,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81141760,"data_stored":81130756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":85385216,"data_stored":85354979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T22:35:35.980 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-12T22:35:35.980 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr_debug_aggressive_pg_num_changes 2024-09-12T22:35:36.324 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-12T22:35:36.341 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T22:35:36.342 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T22:35:36.637 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:35:36.638 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-12T22:35:36.648 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":204,"stamp":"2024-09-12T22:35:36.253310+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":127859341,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":2926,"num_read_kb":1537360,"num_write":29160,"num_write_kb":4400295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5694,"num_bytes_recovered":54520159,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33059,"ondisk_log_size":33059,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":492964,"kb_used_data":251860,"kb_used_omap":9,"kb_used_meta":241014,"kb_avail":282622556,"statfs":{"total":289910292480,"available":289405497344,"internally_reserved":0,"allocated":257904640,"data_stored":256709126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9227,"internal_metadata":246799349},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-1580,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":78,"num_bytes_recovered":-33525457,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.528794"},"pg_stats":[{"pgid":"4.3f","version":"60'422","reported_seq":536,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.753683+0000","last_change":"2024-09-12T22:35:30.733306+0000","last_active":"2024-09-12T22:35:33.753683+0000","last_peered":"2024-09-12T22:35:33.753683+0000","last_clean":"2024-09-12T22:35:33.753683+0000","last_became_active":"2024-09-12T22:35:30.731323+0000","last_became_peered":"2024-09-12T22:35:30.731323+0000","last_unstale":"2024-09-12T22:35:33.753683+0000","last_undegraded":"2024-09-12T22:35:33.753683+0000","last_fullsized":"2024-09-12T22:35:33.753683+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:14:12.288153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":29437,"num_write":385,"num_write_kb":96431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"60'470","reported_seq":631,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.764988+0000","last_change":"2024-09-12T22:35:33.764988+0000","last_active":"2024-09-12T22:35:33.764988+0000","last_peered":"2024-09-12T22:35:33.764988+0000","last_clean":"2024-09-12T22:35:33.764988+0000","last_became_active":"2024-09-12T22:35:33.759906+0000","last_became_peered":"2024-09-12T22:35:33.759906+0000","last_unstale":"2024-09-12T22:35:33.764988+0000","last_undegraded":"2024-09-12T22:35:33.764988+0000","last_fullsized":"2024-09-12T22:35:33.764988+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:06:06.794825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":18334,"num_write":442,"num_write_kb":109282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"60'391","reported_seq":912,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752455+0000","last_change":"2024-09-12T22:35:30.732861+0000","last_active":"2024-09-12T22:35:33.752455+0000","last_peered":"2024-09-12T22:35:33.752455+0000","last_clean":"2024-09-12T22:35:33.752455+0000","last_became_active":"2024-09-12T22:35:30.731086+0000","last_became_peered":"2024-09-12T22:35:30.731086+0000","last_unstale":"2024-09-12T22:35:33.752455+0000","last_undegraded":"2024-09-12T22:35:33.752455+0000","last_fullsized":"2024-09-12T22:35:33.752455+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:56:09.762357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":32771,"num_write":355,"num_write_kb":71120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"60'397","reported_seq":580,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752271+0000","last_change":"2024-09-12T22:31:37.413094+0000","last_active":"2024-09-12T22:35:33.752271+0000","last_peered":"2024-09-12T22:35:33.752271+0000","last_clean":"2024-09-12T22:35:33.752271+0000","last_became_active":"2024-09-12T22:31:37.412746+0000","last_became_peered":"2024-09-12T22:31:37.412746+0000","last_unstale":"2024-09-12T22:35:33.752271+0000","last_undegraded":"2024-09-12T22:35:33.752271+0000","last_fullsized":"2024-09-12T22:35:33.752271+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:32:14.415120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":28544,"num_write":368,"num_write_kb":83737,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"60'458","reported_seq":591,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752878+0000","last_change":"2024-09-12T22:35:24.759019+0000","last_active":"2024-09-12T22:35:33.752878+0000","last_peered":"2024-09-12T22:35:33.752878+0000","last_clean":"2024-09-12T22:35:33.752878+0000","last_became_active":"2024-09-12T22:35:24.756373+0000","last_became_peered":"2024-09-12T22:35:24.756373+0000","last_unstale":"2024-09-12T22:35:33.752878+0000","last_undegraded":"2024-09-12T22:35:33.752878+0000","last_fullsized":"2024-09-12T22:35:33.752878+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":458,"log_dups_size":0,"ondisk_log_size":458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:49:34.350038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":28467,"num_write":430,"num_write_kb":81329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":198,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"60'381","reported_seq":515,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.751680+0000","last_change":"2024-09-12T22:31:37.409177+0000","last_active":"2024-09-12T22:35:33.751680+0000","last_peered":"2024-09-12T22:35:33.751680+0000","last_clean":"2024-09-12T22:35:33.751680+0000","last_became_active":"2024-09-12T22:31:37.408811+0000","last_became_peered":"2024-09-12T22:31:37.408811+0000","last_unstale":"2024-09-12T22:35:33.751680+0000","last_undegraded":"2024-09-12T22:35:33.751680+0000","last_fullsized":"2024-09-12T22:35:33.751680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:17:21.695079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":60,"num_write":353,"num_write_kb":58419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"60'439","reported_seq":618,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.751757+0000","last_change":"2024-09-12T22:31:37.413023+0000","last_active":"2024-09-12T22:35:33.751757+0000","last_peered":"2024-09-12T22:35:33.751757+0000","last_clean":"2024-09-12T22:35:33.751757+0000","last_became_active":"2024-09-12T22:31:37.412691+0000","last_became_peered":"2024-09-12T22:31:37.412691+0000","last_unstale":"2024-09-12T22:35:33.751757+0000","last_undegraded":"2024-09-12T22:35:33.751757+0000","last_fullsized":"2024-09-12T22:35:33.751757+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:02:36.454134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":27053,"num_write":405,"num_write_kb":79743,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"60'384","reported_seq":589,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.751463+0000","last_change":"2024-09-12T22:31:37.411074+0000","last_active":"2024-09-12T22:35:33.751463+0000","last_peered":"2024-09-12T22:35:33.751463+0000","last_clean":"2024-09-12T22:35:33.751463+0000","last_became_active":"2024-09-12T22:31:37.410633+0000","last_became_peered":"2024-09-12T22:31:37.410633+0000","last_unstale":"2024-09-12T22:35:33.751463+0000","last_undegraded":"2024-09-12T22:35:33.751463+0000","last_fullsized":"2024-09-12T22:35:33.751463+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:39:20.383152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":44358,"num_write":338,"num_write_kb":67411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"60'418","reported_seq":1002,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752278+0000","last_change":"2024-09-12T22:35:28.732156+0000","last_active":"2024-09-12T22:35:33.752278+0000","last_peered":"2024-09-12T22:35:33.752278+0000","last_clean":"2024-09-12T22:35:33.752278+0000","last_became_active":"2024-09-12T22:35:28.731002+0000","last_became_peered":"2024-09-12T22:35:28.731002+0000","last_unstale":"2024-09-12T22:35:33.752278+0000","last_undegraded":"2024-09-12T22:35:33.752278+0000","last_fullsized":"2024-09-12T22:35:33.752278+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:52:19.679715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":48711,"num_write":384,"num_write_kb":63228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"60'406","reported_seq":520,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.753178+0000","last_change":"2024-09-12T22:35:27.732831+0000","last_active":"2024-09-12T22:35:33.753178+0000","last_peered":"2024-09-12T22:35:33.753178+0000","last_clean":"2024-09-12T22:35:33.753178+0000","last_became_active":"2024-09-12T22:35:27.729480+0000","last_became_peered":"2024-09-12T22:35:27.729480+0000","last_unstale":"2024-09-12T22:35:33.753178+0000","last_undegraded":"2024-09-12T22:35:33.753178+0000","last_fullsized":"2024-09-12T22:35:33.753178+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:38:13.307443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":21851,"num_write":367,"num_write_kb":79913,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"60'338","reported_seq":479,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752488+0000","last_change":"2024-09-12T22:31:37.414469+0000","last_active":"2024-09-12T22:35:33.752488+0000","last_peered":"2024-09-12T22:35:33.752488+0000","last_clean":"2024-09-12T22:35:33.752488+0000","last_became_active":"2024-09-12T22:31:37.414165+0000","last_became_peered":"2024-09-12T22:31:37.414165+0000","last_unstale":"2024-09-12T22:35:33.752488+0000","last_undegraded":"2024-09-12T22:35:33.752488+0000","last_fullsized":"2024-09-12T22:35:33.752488+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":338,"log_dups_size":0,"ondisk_log_size":338,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:25:38.148636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":4053,"num_write":316,"num_write_kb":21475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"60'359","reported_seq":495,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.764173+0000","last_change":"2024-09-12T22:35:33.764173+0000","last_active":"2024-09-12T22:35:33.764173+0000","last_peered":"2024-09-12T22:35:33.764173+0000","last_clean":"2024-09-12T22:35:33.764173+0000","last_became_active":"2024-09-12T22:35:33.760739+0000","last_became_peered":"2024-09-12T22:35:33.760739+0000","last_unstale":"2024-09-12T22:35:33.764173+0000","last_undegraded":"2024-09-12T22:35:33.764173+0000","last_fullsized":"2024-09-12T22:35:33.764173+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:58:38.596224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":6688,"num_write":330,"num_write_kb":38146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"60'402","reported_seq":537,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.761962+0000","last_change":"2024-09-12T22:35:33.761962+0000","last_active":"2024-09-12T22:35:33.761962+0000","last_peered":"2024-09-12T22:35:33.761962+0000","last_clean":"2024-09-12T22:35:33.761962+0000","last_became_active":"2024-09-12T22:35:33.754938+0000","last_became_peered":"2024-09-12T22:35:33.754938+0000","last_unstale":"2024-09-12T22:35:33.761962+0000","last_undegraded":"2024-09-12T22:35:33.761962+0000","last_fullsized":"2024-09-12T22:35:33.761962+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:01:27.181524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":16384,"num_write":363,"num_write_kb":62556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"60'409","reported_seq":935,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.751724+0000","last_change":"2024-09-12T22:35:29.737252+0000","last_active":"2024-09-12T22:35:33.751724+0000","last_peered":"2024-09-12T22:35:33.751724+0000","last_clean":"2024-09-12T22:35:33.751724+0000","last_became_active":"2024-09-12T22:35:29.735835+0000","last_became_peered":"2024-09-12T22:35:29.735835+0000","last_unstale":"2024-09-12T22:35:33.751724+0000","last_undegraded":"2024-09-12T22:35:33.751724+0000","last_fullsized":"2024-09-12T22:35:33.751724+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:32:12.014289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":13943,"num_write":382,"num_write_kb":54682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"60'412","reported_seq":948,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.751812+0000","last_change":"2024-09-12T22:35:28.731566+0000","last_active":"2024-09-12T22:35:33.751812+0000","last_peered":"2024-09-12T22:35:33.751812+0000","last_clean":"2024-09-12T22:35:33.751812+0000","last_became_active":"2024-09-12T22:35:28.730413+0000","last_became_peered":"2024-09-12T22:35:28.730413+0000","last_unstale":"2024-09-12T22:35:33.751812+0000","last_undegraded":"2024-09-12T22:35:33.751812+0000","last_fullsized":"2024-09-12T22:35:33.751812+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:47:47.029549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":19700,"num_write":377,"num_write_kb":67929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"60'404","reported_seq":537,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.751489+0000","last_change":"2024-09-12T22:31:37.411006+0000","last_active":"2024-09-12T22:35:33.751489+0000","last_peered":"2024-09-12T22:35:33.751489+0000","last_clean":"2024-09-12T22:35:33.751489+0000","last_became_active":"2024-09-12T22:31:37.410557+0000","last_became_peered":"2024-09-12T22:31:37.410557+0000","last_unstale":"2024-09-12T22:35:33.751489+0000","last_undegraded":"2024-09-12T22:35:33.751489+0000","last_fullsized":"2024-09-12T22:35:33.751489+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:08:21.709770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":368,"num_write_kb":25652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"60'405","reported_seq":940,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752667+0000","last_change":"2024-09-12T22:35:31.732234+0000","last_active":"2024-09-12T22:35:33.752667+0000","last_peered":"2024-09-12T22:35:33.752667+0000","last_clean":"2024-09-12T22:35:33.752667+0000","last_became_active":"2024-09-12T22:35:31.730883+0000","last_became_peered":"2024-09-12T22:35:31.730883+0000","last_unstale":"2024-09-12T22:35:33.752667+0000","last_undegraded":"2024-09-12T22:35:33.752667+0000","last_fullsized":"2024-09-12T22:35:33.752667+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:50:20.904744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":18251,"num_write":369,"num_write_kb":34203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"60'406","reported_seq":579,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.760018+0000","last_change":"2024-09-12T22:35:33.760018+0000","last_active":"2024-09-12T22:35:33.760018+0000","last_peered":"2024-09-12T22:35:33.760018+0000","last_clean":"2024-09-12T22:35:33.760018+0000","last_became_active":"2024-09-12T22:35:33.754915+0000","last_became_peered":"2024-09-12T22:35:33.754915+0000","last_unstale":"2024-09-12T22:35:33.760018+0000","last_undegraded":"2024-09-12T22:35:33.760018+0000","last_fullsized":"2024-09-12T22:35:33.760018+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:36:51.477439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":45843,"num_write":367,"num_write_kb":59097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"60'413","reported_seq":932,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752397+0000","last_change":"2024-09-12T22:35:31.731988+0000","last_active":"2024-09-12T22:35:33.752397+0000","last_peered":"2024-09-12T22:35:33.752397+0000","last_clean":"2024-09-12T22:35:33.752397+0000","last_became_active":"2024-09-12T22:35:31.730742+0000","last_became_peered":"2024-09-12T22:35:31.730742+0000","last_unstale":"2024-09-12T22:35:33.752397+0000","last_undegraded":"2024-09-12T22:35:33.752397+0000","last_fullsized":"2024-09-12T22:35:33.752397+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:33:38.616668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":20855,"num_write":371,"num_write_kb":71095,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"60'441","reported_seq":621,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752348+0000","last_change":"2024-09-12T22:31:37.414235+0000","last_active":"2024-09-12T22:35:33.752348+0000","last_peered":"2024-09-12T22:35:33.752348+0000","last_clean":"2024-09-12T22:35:33.752348+0000","last_became_active":"2024-09-12T22:31:37.413786+0000","last_became_peered":"2024-09-12T22:31:37.413786+0000","last_unstale":"2024-09-12T22:35:33.752348+0000","last_undegraded":"2024-09-12T22:35:33.752348+0000","last_fullsized":"2024-09-12T22:35:33.752348+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:21:11.866973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":23954,"num_write":419,"num_write_kb":72528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"60'414","reported_seq":622,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752077+0000","last_change":"2024-09-12T22:31:37.415382+0000","last_active":"2024-09-12T22:35:33.752077+0000","last_peered":"2024-09-12T22:35:33.752077+0000","last_clean":"2024-09-12T22:35:33.752077+0000","last_became_active":"2024-09-12T22:31:37.414319+0000","last_became_peered":"2024-09-12T22:31:37.414319+0000","last_unstale":"2024-09-12T22:35:33.752077+0000","last_undegraded":"2024-09-12T22:35:33.752077+0000","last_fullsized":"2024-09-12T22:35:33.752077+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:26:25.578693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":44129,"num_write":387,"num_write_kb":104899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"60'444","reported_seq":551,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.753335+0000","last_change":"2024-09-12T22:35:25.729851+0000","last_active":"2024-09-12T22:35:33.753335+0000","last_peered":"2024-09-12T22:35:33.753335+0000","last_clean":"2024-09-12T22:35:33.753335+0000","last_became_active":"2024-09-12T22:35:25.727269+0000","last_became_peered":"2024-09-12T22:35:25.727269+0000","last_unstale":"2024-09-12T22:35:33.753335+0000","last_undegraded":"2024-09-12T22:35:33.753335+0000","last_fullsized":"2024-09-12T22:35:33.753335+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:30:26.718280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":17411,"num_write":407,"num_write_kb":87850,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"60'421","reported_seq":646,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.751298+0000","last_change":"2024-09-12T22:31:37.410364+0000","last_active":"2024-09-12T22:35:33.751298+0000","last_peered":"2024-09-12T22:35:33.751298+0000","last_clean":"2024-09-12T22:35:33.751298+0000","last_became_active":"2024-09-12T22:31:37.409951+0000","last_became_peered":"2024-09-12T22:31:37.409951+0000","last_unstale":"2024-09-12T22:35:33.751298+0000","last_undegraded":"2024-09-12T22:35:33.751298+0000","last_fullsized":"2024-09-12T22:35:33.751298+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:39:17.785755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":44074,"num_write":389,"num_write_kb":44104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"60'459","reported_seq":614,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.760584+0000","last_change":"2024-09-12T22:35:33.760584+0000","last_active":"2024-09-12T22:35:33.760584+0000","last_peered":"2024-09-12T22:35:33.760584+0000","last_clean":"2024-09-12T22:35:33.760584+0000","last_became_active":"2024-09-12T22:35:33.754576+0000","last_became_peered":"2024-09-12T22:35:33.754576+0000","last_unstale":"2024-09-12T22:35:33.760584+0000","last_undegraded":"2024-09-12T22:35:33.760584+0000","last_fullsized":"2024-09-12T22:35:33.760584+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:14:34.676855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":28605,"num_write":432,"num_write_kb":100377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"60'419","reported_seq":516,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752435+0000","last_change":"2024-09-12T22:35:29.738235+0000","last_active":"2024-09-12T22:35:33.752435+0000","last_peered":"2024-09-12T22:35:33.752435+0000","last_clean":"2024-09-12T22:35:33.752435+0000","last_became_active":"2024-09-12T22:35:29.735450+0000","last_became_peered":"2024-09-12T22:35:29.735450+0000","last_unstale":"2024-09-12T22:35:33.752435+0000","last_undegraded":"2024-09-12T22:35:33.752435+0000","last_fullsized":"2024-09-12T22:35:33.752435+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:24.582229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":16852,"num_write":404,"num_write_kb":34622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"60'494","reported_seq":710,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752455+0000","last_change":"2024-09-12T22:31:37.411880+0000","last_active":"2024-09-12T22:35:33.752455+0000","last_peered":"2024-09-12T22:35:33.752455+0000","last_clean":"2024-09-12T22:35:33.752455+0000","last_became_active":"2024-09-12T22:31:37.410563+0000","last_became_peered":"2024-09-12T22:31:37.410563+0000","last_unstale":"2024-09-12T22:35:33.752455+0000","last_undegraded":"2024-09-12T22:35:33.752455+0000","last_fullsized":"2024-09-12T22:35:33.752455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":494,"log_dups_size":0,"ondisk_log_size":494,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:47:52.560533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":35239,"num_write":450,"num_write_kb":76898,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"60'401","reported_seq":923,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752642+0000","last_change":"2024-09-12T22:35:30.732843+0000","last_active":"2024-09-12T22:35:33.752642+0000","last_peered":"2024-09-12T22:35:33.752642+0000","last_clean":"2024-09-12T22:35:33.752642+0000","last_became_active":"2024-09-12T22:35:30.731155+0000","last_became_peered":"2024-09-12T22:35:30.731155+0000","last_unstale":"2024-09-12T22:35:33.752642+0000","last_undegraded":"2024-09-12T22:35:33.752642+0000","last_fullsized":"2024-09-12T22:35:33.752642+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:54:33.926426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":10993,"num_write":369,"num_write_kb":55171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"60'390","reported_seq":538,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.763890+0000","last_change":"2024-09-12T22:35:33.763890+0000","last_active":"2024-09-12T22:35:33.763890+0000","last_peered":"2024-09-12T22:35:33.763890+0000","last_clean":"2024-09-12T22:35:33.763890+0000","last_became_active":"2024-09-12T22:35:33.756108+0000","last_became_peered":"2024-09-12T22:35:33.756108+0000","last_unstale":"2024-09-12T22:35:33.763890+0000","last_undegraded":"2024-09-12T22:35:33.763890+0000","last_fullsized":"2024-09-12T22:35:33.763890+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:53:03.258457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":18588,"num_write":360,"num_write_kb":59307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"60'429","reported_seq":1007,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.751986+0000","last_change":"2024-09-12T22:35:23.756871+0000","last_active":"2024-09-12T22:35:33.751986+0000","last_peered":"2024-09-12T22:35:33.751986+0000","last_clean":"2024-09-12T22:35:33.751986+0000","last_became_active":"2024-09-12T22:35:23.755618+0000","last_became_peered":"2024-09-12T22:35:23.755618+0000","last_unstale":"2024-09-12T22:35:33.751986+0000","last_undegraded":"2024-09-12T22:35:33.751986+0000","last_fullsized":"2024-09-12T22:35:33.751986+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:21:46.470290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":32541,"num_write":398,"num_write_kb":76609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"60'458","reported_seq":575,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.753011+0000","last_change":"2024-09-12T22:35:28.732538+0000","last_active":"2024-09-12T22:35:33.753011+0000","last_peered":"2024-09-12T22:35:33.753011+0000","last_clean":"2024-09-12T22:35:33.753011+0000","last_became_active":"2024-09-12T22:35:28.730337+0000","last_became_peered":"2024-09-12T22:35:28.730337+0000","last_unstale":"2024-09-12T22:35:33.753011+0000","last_undegraded":"2024-09-12T22:35:33.753011+0000","last_fullsized":"2024-09-12T22:35:33.753011+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":458,"log_dups_size":0,"ondisk_log_size":458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:55:45.185896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":16425,"num_write":413,"num_write_kb":47110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"60'432","reported_seq":982,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.751401+0000","last_change":"2024-09-12T22:35:26.732243+0000","last_active":"2024-09-12T22:35:33.751401+0000","last_peered":"2024-09-12T22:35:33.751401+0000","last_clean":"2024-09-12T22:35:33.751401+0000","last_became_active":"2024-09-12T22:35:26.731135+0000","last_became_peered":"2024-09-12T22:35:26.731135+0000","last_unstale":"2024-09-12T22:35:33.751401+0000","last_undegraded":"2024-09-12T22:35:33.751401+0000","last_fullsized":"2024-09-12T22:35:33.751401+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:34:06.084746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":21090,"num_write":393,"num_write_kb":67477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"60'458","reported_seq":636,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.751620+0000","last_change":"2024-09-12T22:31:37.415190+0000","last_active":"2024-09-12T22:35:33.751620+0000","last_peered":"2024-09-12T22:35:33.751620+0000","last_clean":"2024-09-12T22:35:33.751620+0000","last_became_active":"2024-09-12T22:31:37.414265+0000","last_became_peered":"2024-09-12T22:31:37.414265+0000","last_unstale":"2024-09-12T22:35:33.751620+0000","last_undegraded":"2024-09-12T22:35:33.751620+0000","last_fullsized":"2024-09-12T22:35:33.751620+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":458,"log_dups_size":0,"ondisk_log_size":458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:07:02.173590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":37395,"num_write":421,"num_write_kb":73250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"60'411","reported_seq":583,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.764162+0000","last_change":"2024-09-12T22:35:33.764162+0000","last_active":"2024-09-12T22:35:33.764162+0000","last_peered":"2024-09-12T22:35:33.764162+0000","last_clean":"2024-09-12T22:35:33.764162+0000","last_became_active":"2024-09-12T22:35:33.761121+0000","last_became_peered":"2024-09-12T22:35:33.761121+0000","last_unstale":"2024-09-12T22:35:33.764162+0000","last_undegraded":"2024-09-12T22:35:33.764162+0000","last_fullsized":"2024-09-12T22:35:33.764162+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:03:51.948278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":36400,"num_write":371,"num_write_kb":92142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"60'546","reported_seq":681,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752153+0000","last_change":"2024-09-12T22:31:36.412082+0000","last_active":"2024-09-12T22:35:33.752153+0000","last_peered":"2024-09-12T22:35:33.752153+0000","last_clean":"2024-09-12T22:35:33.752153+0000","last_became_active":"2024-09-12T22:31:36.410871+0000","last_became_peered":"2024-09-12T22:31:36.410871+0000","last_unstale":"2024-09-12T22:35:33.752153+0000","last_undegraded":"2024-09-12T22:35:33.752153+0000","last_fullsized":"2024-09-12T22:35:33.752153+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":546,"log_dups_size":0,"ondisk_log_size":546,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:30:49.127253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":495,"num_write_kb":8426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"60'427","reported_seq":598,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.753291+0000","last_change":"2024-09-12T22:35:31.732681+0000","last_active":"2024-09-12T22:35:33.753291+0000","last_peered":"2024-09-12T22:35:33.753291+0000","last_clean":"2024-09-12T22:35:33.753291+0000","last_became_active":"2024-09-12T22:35:31.730237+0000","last_became_peered":"2024-09-12T22:35:31.730237+0000","last_unstale":"2024-09-12T22:35:33.753291+0000","last_undegraded":"2024-09-12T22:35:33.753291+0000","last_fullsized":"2024-09-12T22:35:33.753291+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:51:57.088855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":59223,"num_write":394,"num_write_kb":80309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":175,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"60'55","reported_seq":190,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752085+0000","last_change":"2024-09-12T22:31:36.408563+0000","last_active":"2024-09-12T22:35:33.752085+0000","last_peered":"2024-09-12T22:35:33.752085+0000","last_clean":"2024-09-12T22:35:33.752085+0000","last_became_active":"2024-09-12T22:31:36.407447+0000","last_became_peered":"2024-09-12T22:31:36.407447+0000","last_unstale":"2024-09-12T22:35:33.752085+0000","last_undegraded":"2024-09-12T22:35:33.752085+0000","last_fullsized":"2024-09-12T22:35:33.752085+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:29:37.933109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"60'424","reported_seq":588,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752743+0000","last_change":"2024-09-12T22:31:37.411680+0000","last_active":"2024-09-12T22:35:33.752743+0000","last_peered":"2024-09-12T22:35:33.752743+0000","last_clean":"2024-09-12T22:35:33.752743+0000","last_became_active":"2024-09-12T22:31:37.411168+0000","last_became_peered":"2024-09-12T22:31:37.411168+0000","last_unstale":"2024-09-12T22:35:33.752743+0000","last_undegraded":"2024-09-12T22:35:33.752743+0000","last_fullsized":"2024-09-12T22:35:33.752743+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:27.706282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":13992,"num_write":386,"num_write_kb":38510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"60'70","reported_seq":47,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752499+0000","last_change":"2024-09-12T22:35:20.734652+0000","last_active":"2024-09-12T22:35:33.752499+0000","last_peered":"2024-09-12T22:35:33.752499+0000","last_clean":"2024-09-12T22:35:33.752499+0000","last_became_active":"2024-09-12T22:35:20.734023+0000","last_became_peered":"2024-09-12T22:35:20.734023+0000","last_unstale":"2024-09-12T22:35:33.752499+0000","last_undegraded":"2024-09-12T22:35:33.752499+0000","last_fullsized":"2024-09-12T22:35:33.752499+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:18:27.888573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"60'395","reported_seq":577,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752328+0000","last_change":"2024-09-12T22:31:37.411218+0000","last_active":"2024-09-12T22:35:33.752328+0000","last_peered":"2024-09-12T22:35:33.752328+0000","last_clean":"2024-09-12T22:35:33.752328+0000","last_became_active":"2024-09-12T22:31:37.409666+0000","last_became_peered":"2024-09-12T22:31:37.409666+0000","last_unstale":"2024-09-12T22:35:33.752328+0000","last_undegraded":"2024-09-12T22:35:33.752328+0000","last_fullsized":"2024-09-12T22:35:33.752328+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:45:34.230090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":24198,"num_write":363,"num_write_kb":67056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"60'68","reported_seq":211,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.751638+0000","last_change":"2024-09-12T22:35:20.737076+0000","last_active":"2024-09-12T22:35:33.751638+0000","last_peered":"2024-09-12T22:35:33.751638+0000","last_clean":"2024-09-12T22:35:33.751638+0000","last_became_active":"2024-09-12T22:35:20.736755+0000","last_became_peered":"2024-09-12T22:35:20.736755+0000","last_unstale":"2024-09-12T22:35:33.751638+0000","last_undegraded":"2024-09-12T22:35:33.751638+0000","last_fullsized":"2024-09-12T22:35:33.751638+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:57:36.195186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"60'158","reported_seq":307,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752919+0000","last_change":"2024-09-12T22:35:23.756940+0000","last_active":"2024-09-12T22:35:33.752919+0000","last_peered":"2024-09-12T22:35:33.752919+0000","last_clean":"2024-09-12T22:35:33.752919+0000","last_became_active":"2024-09-12T22:35:23.756663+0000","last_became_peered":"2024-09-12T22:35:23.756663+0000","last_unstale":"2024-09-12T22:35:33.752919+0000","last_undegraded":"2024-09-12T22:35:33.752919+0000","last_fullsized":"2024-09-12T22:35:33.752919+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:08:58.453420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":105,"num_write_kb":4159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"60'426","reported_seq":545,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.753740+0000","last_change":"2024-09-12T22:35:26.735223+0000","last_active":"2024-09-12T22:35:33.753740+0000","last_peered":"2024-09-12T22:35:33.753740+0000","last_clean":"2024-09-12T22:35:33.753740+0000","last_became_active":"2024-09-12T22:35:26.732245+0000","last_became_peered":"2024-09-12T22:35:26.732245+0000","last_unstale":"2024-09-12T22:35:33.753740+0000","last_undegraded":"2024-09-12T22:35:33.753740+0000","last_fullsized":"2024-09-12T22:35:33.753740+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:29:27.860798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":29225,"num_write":390,"num_write_kb":83737,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"60'274","reported_seq":367,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752328+0000","last_change":"2024-09-12T22:35:23.755688+0000","last_active":"2024-09-12T22:35:33.752328+0000","last_peered":"2024-09-12T22:35:33.752328+0000","last_clean":"2024-09-12T22:35:33.752328+0000","last_became_active":"2024-09-12T22:35:23.755282+0000","last_became_peered":"2024-09-12T22:35:23.755282+0000","last_unstale":"2024-09-12T22:35:33.752328+0000","last_undegraded":"2024-09-12T22:35:33.752328+0000","last_fullsized":"2024-09-12T22:35:33.752328+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":274,"log_dups_size":0,"ondisk_log_size":274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:44:38.920273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":213,"num_write_kb":4214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"60'455","reported_seq":607,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.760415+0000","last_change":"2024-09-12T22:35:33.760415+0000","last_active":"2024-09-12T22:35:33.760415+0000","last_peered":"2024-09-12T22:35:33.760415+0000","last_clean":"2024-09-12T22:35:33.760415+0000","last_became_active":"2024-09-12T22:35:33.754299+0000","last_became_peered":"2024-09-12T22:35:33.754299+0000","last_unstale":"2024-09-12T22:35:33.760415+0000","last_undegraded":"2024-09-12T22:35:33.760415+0000","last_fullsized":"2024-09-12T22:35:33.760415+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:26:00.753338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":20747,"num_write":425,"num_write_kb":56005,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"60'423","reported_seq":572,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752919+0000","last_change":"2024-09-12T22:35:23.757047+0000","last_active":"2024-09-12T22:35:33.752919+0000","last_peered":"2024-09-12T22:35:33.752919+0000","last_clean":"2024-09-12T22:35:33.752919+0000","last_became_active":"2024-09-12T22:35:23.756668+0000","last_became_peered":"2024-09-12T22:35:23.756668+0000","last_unstale":"2024-09-12T22:35:33.752919+0000","last_undegraded":"2024-09-12T22:35:33.752919+0000","last_fullsized":"2024-09-12T22:35:33.752919+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:53:35.298628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":371,"num_write_kb":4254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"60'431","reported_seq":598,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.751837+0000","last_change":"2024-09-12T22:31:37.414809+0000","last_active":"2024-09-12T22:35:33.751837+0000","last_peered":"2024-09-12T22:35:33.751837+0000","last_clean":"2024-09-12T22:35:33.751837+0000","last_became_active":"2024-09-12T22:31:37.414492+0000","last_became_peered":"2024-09-12T22:31:37.414492+0000","last_unstale":"2024-09-12T22:35:33.751837+0000","last_undegraded":"2024-09-12T22:35:33.751837+0000","last_fullsized":"2024-09-12T22:35:33.751837+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:50:48.426898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":21479,"num_write":394,"num_write_kb":83756,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"60'70","reported_seq":205,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752868+0000","last_change":"2024-09-12T22:31:36.412068+0000","last_active":"2024-09-12T22:35:33.752868+0000","last_peered":"2024-09-12T22:35:33.752868+0000","last_clean":"2024-09-12T22:35:33.752868+0000","last_became_active":"2024-09-12T22:31:36.411366+0000","last_became_peered":"2024-09-12T22:31:36.411366+0000","last_unstale":"2024-09-12T22:35:33.752868+0000","last_undegraded":"2024-09-12T22:35:33.752868+0000","last_fullsized":"2024-09-12T22:35:33.752868+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:35:51.647051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"60'471","reported_seq":673,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752040+0000","last_change":"2024-09-12T22:31:37.410303+0000","last_active":"2024-09-12T22:35:33.752040+0000","last_peered":"2024-09-12T22:35:33.752040+0000","last_clean":"2024-09-12T22:35:33.752040+0000","last_became_active":"2024-09-12T22:31:37.409607+0000","last_became_peered":"2024-09-12T22:31:37.409607+0000","last_unstale":"2024-09-12T22:35:33.752040+0000","last_undegraded":"2024-09-12T22:35:33.752040+0000","last_fullsized":"2024-09-12T22:35:33.752040+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":471,"log_dups_size":0,"ondisk_log_size":471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:53:42.732654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":37922,"num_write":440,"num_write_kb":138112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"60'209","reported_seq":344,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752205+0000","last_change":"2024-09-12T22:31:36.407974+0000","last_active":"2024-09-12T22:35:33.752205+0000","last_peered":"2024-09-12T22:35:33.752205+0000","last_clean":"2024-09-12T22:35:33.752205+0000","last_became_active":"2024-09-12T22:31:36.406955+0000","last_became_peered":"2024-09-12T22:31:36.406955+0000","last_unstale":"2024-09-12T22:35:33.752205+0000","last_undegraded":"2024-09-12T22:35:33.752205+0000","last_fullsized":"2024-09-12T22:35:33.752205+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:07:34.831264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":8267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"60'437","reported_seq":580,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752455+0000","last_change":"2024-09-12T22:31:37.415285+0000","last_active":"2024-09-12T22:35:33.752455+0000","last_peered":"2024-09-12T22:35:33.752455+0000","last_clean":"2024-09-12T22:35:33.752455+0000","last_became_active":"2024-09-12T22:31:37.414890+0000","last_became_peered":"2024-09-12T22:31:37.414890+0000","last_unstale":"2024-09-12T22:35:33.752455+0000","last_undegraded":"2024-09-12T22:35:33.752455+0000","last_fullsized":"2024-09-12T22:35:33.752455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:38:16.956786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":4587,"num_write":407,"num_write_kb":50860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"60'108","reported_seq":243,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752050+0000","last_change":"2024-09-12T22:31:36.412147+0000","last_active":"2024-09-12T22:35:33.752050+0000","last_peered":"2024-09-12T22:35:33.752050+0000","last_clean":"2024-09-12T22:35:33.752050+0000","last_became_active":"2024-09-12T22:31:36.411382+0000","last_became_peered":"2024-09-12T22:31:36.411382+0000","last_unstale":"2024-09-12T22:35:33.752050+0000","last_undegraded":"2024-09-12T22:35:33.752050+0000","last_fullsized":"2024-09-12T22:35:33.752050+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:54:51.454867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":4129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"60'407","reported_seq":927,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752793+0000","last_change":"2024-09-12T22:35:31.732325+0000","last_active":"2024-09-12T22:35:33.752793+0000","last_peered":"2024-09-12T22:35:33.752793+0000","last_clean":"2024-09-12T22:35:33.752793+0000","last_became_active":"2024-09-12T22:35:31.729817+0000","last_became_peered":"2024-09-12T22:35:31.729817+0000","last_unstale":"2024-09-12T22:35:33.752793+0000","last_undegraded":"2024-09-12T22:35:33.752793+0000","last_fullsized":"2024-09-12T22:35:33.752793+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:21:52.633068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":5615,"num_write":375,"num_write_kb":50827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"60'57","reported_seq":47,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.751984+0000","last_change":"2024-09-12T22:35:20.734244+0000","last_active":"2024-09-12T22:35:33.751984+0000","last_peered":"2024-09-12T22:35:33.751984+0000","last_clean":"2024-09-12T22:35:33.751984+0000","last_became_active":"2024-09-12T22:35:20.733664+0000","last_became_peered":"2024-09-12T22:35:20.733664+0000","last_unstale":"2024-09-12T22:35:33.751984+0000","last_undegraded":"2024-09-12T22:35:33.751984+0000","last_fullsized":"2024-09-12T22:35:33.751984+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:41:11.108676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"60'357","reported_seq":833,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752606+0000","last_change":"2024-09-12T22:35:27.734437+0000","last_active":"2024-09-12T22:35:33.752606+0000","last_peered":"2024-09-12T22:35:33.752606+0000","last_clean":"2024-09-12T22:35:33.752606+0000","last_became_active":"2024-09-12T22:35:27.733274+0000","last_became_peered":"2024-09-12T22:35:27.733274+0000","last_unstale":"2024-09-12T22:35:33.752606+0000","last_undegraded":"2024-09-12T22:35:33.752606+0000","last_fullsized":"2024-09-12T22:35:33.752606+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":357,"log_dups_size":0,"ondisk_log_size":357,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:35:58.820958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":2460,"num_write":324,"num_write_kb":37873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"60'417","reported_seq":501,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.753610+0000","last_change":"2024-09-12T22:35:23.755080+0000","last_active":"2024-09-12T22:35:33.753610+0000","last_peered":"2024-09-12T22:35:33.753610+0000","last_clean":"2024-09-12T22:35:33.753610+0000","last_became_active":"2024-09-12T22:35:23.754683+0000","last_became_peered":"2024-09-12T22:35:23.754683+0000","last_unstale":"2024-09-12T22:35:33.753610+0000","last_undegraded":"2024-09-12T22:35:33.753610+0000","last_fullsized":"2024-09-12T22:35:33.753610+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:34:00.150680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":359,"num_write_kb":4251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"60'416","reported_seq":963,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752396+0000","last_change":"2024-09-12T22:35:30.730978+0000","last_active":"2024-09-12T22:35:33.752396+0000","last_peered":"2024-09-12T22:35:33.752396+0000","last_clean":"2024-09-12T22:35:33.752396+0000","last_became_active":"2024-09-12T22:35:30.729912+0000","last_became_peered":"2024-09-12T22:35:30.729912+0000","last_unstale":"2024-09-12T22:35:33.752396+0000","last_undegraded":"2024-09-12T22:35:33.752396+0000","last_fullsized":"2024-09-12T22:35:33.752396+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:32:25.562466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":42190,"num_write":377,"num_write_kb":87849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":353,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.751924+0000","last_change":"2024-09-12T22:35:20.737092+0000","last_active":"2024-09-12T22:35:33.751924+0000","last_peered":"2024-09-12T22:35:33.751924+0000","last_clean":"2024-09-12T22:35:33.751924+0000","last_became_active":"2024-09-12T22:35:20.736721+0000","last_became_peered":"2024-09-12T22:35:20.736721+0000","last_unstale":"2024-09-12T22:35:33.751924+0000","last_undegraded":"2024-09-12T22:35:33.751924+0000","last_fullsized":"2024-09-12T22:35:33.751924+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:26.229539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:26.229539+0000","last_clean_scrub_stamp":"2024-09-12T22:31:26.229539+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:44:38.486987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":149,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752279+0000","last_change":"2024-09-12T22:31:34.286952+0000","last_active":"2024-09-12T22:35:33.752279+0000","last_peered":"2024-09-12T22:35:33.752279+0000","last_clean":"2024-09-12T22:35:33.752279+0000","last_became_active":"2024-09-12T22:31:32.283661+0000","last_became_peered":"2024-09-12T22:31:32.283661+0000","last_unstale":"2024-09-12T22:35:33.752279+0000","last_undegraded":"2024-09-12T22:35:33.752279+0000","last_fullsized":"2024-09-12T22:35:33.752279+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:21.681390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000621274,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"60'678","reported_seq":828,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752160+0000","last_change":"2024-09-12T22:35:23.755996+0000","last_active":"2024-09-12T22:35:33.752160+0000","last_peered":"2024-09-12T22:35:33.752160+0000","last_clean":"2024-09-12T22:35:33.752160+0000","last_became_active":"2024-09-12T22:35:23.755652+0000","last_became_peered":"2024-09-12T22:35:23.755652+0000","last_unstale":"2024-09-12T22:35:33.752160+0000","last_undegraded":"2024-09-12T22:35:33.752160+0000","last_fullsized":"2024-09-12T22:35:33.752160+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":678,"log_dups_size":0,"ondisk_log_size":678,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:05:19.284888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":608,"num_write_kb":8482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"60'426","reported_seq":976,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752894+0000","last_change":"2024-09-12T22:35:31.732344+0000","last_active":"2024-09-12T22:35:33.752894+0000","last_peered":"2024-09-12T22:35:33.752894+0000","last_clean":"2024-09-12T22:35:33.752894+0000","last_became_active":"2024-09-12T22:35:31.730242+0000","last_became_peered":"2024-09-12T22:35:31.730242+0000","last_unstale":"2024-09-12T22:35:33.752894+0000","last_undegraded":"2024-09-12T22:35:33.752894+0000","last_fullsized":"2024-09-12T22:35:33.752894+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:45:28.259069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":24636,"num_write":392,"num_write_kb":59176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":156,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.751942+0000","last_change":"2024-09-12T22:35:20.735913+0000","last_active":"2024-09-12T22:35:33.751942+0000","last_peered":"2024-09-12T22:35:33.751942+0000","last_clean":"2024-09-12T22:35:33.751942+0000","last_became_active":"2024-09-12T22:35:20.735545+0000","last_became_peered":"2024-09-12T22:35:20.735545+0000","last_unstale":"2024-09-12T22:35:33.751942+0000","last_undegraded":"2024-09-12T22:35:33.751942+0000","last_fullsized":"2024-09-12T22:35:33.751942+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:37:09.150338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037858999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"60'106","reported_seq":284,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.751775+0000","last_change":"2024-09-12T22:31:36.407395+0000","last_active":"2024-09-12T22:35:33.751775+0000","last_peered":"2024-09-12T22:35:33.751775+0000","last_clean":"2024-09-12T22:35:33.751775+0000","last_became_active":"2024-09-12T22:31:36.406770+0000","last_became_peered":"2024-09-12T22:31:36.406770+0000","last_unstale":"2024-09-12T22:35:33.751775+0000","last_undegraded":"2024-09-12T22:35:33.751775+0000","last_fullsized":"2024-09-12T22:35:33.751775+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:49:26.547848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1467429,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":43,"num_read_kb":1462,"num_write":43,"num_write_kb":1462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"60'448","reported_seq":547,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.753927+0000","last_change":"2024-09-12T22:35:27.733064+0000","last_active":"2024-09-12T22:35:33.753927+0000","last_peered":"2024-09-12T22:35:33.753927+0000","last_clean":"2024-09-12T22:35:33.753927+0000","last_became_active":"2024-09-12T22:35:27.729522+0000","last_became_peered":"2024-09-12T22:35:27.729522+0000","last_unstale":"2024-09-12T22:35:33.753927+0000","last_undegraded":"2024-09-12T22:35:33.753927+0000","last_fullsized":"2024-09-12T22:35:33.753927+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:59:06.989020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":10436,"num_write":420,"num_write_kb":67816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":155,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.751845+0000","last_change":"2024-09-12T22:35:20.735217+0000","last_active":"2024-09-12T22:35:33.751845+0000","last_peered":"2024-09-12T22:35:33.751845+0000","last_clean":"2024-09-12T22:35:33.751845+0000","last_became_active":"2024-09-12T22:35:20.734643+0000","last_became_peered":"2024-09-12T22:35:20.734643+0000","last_unstale":"2024-09-12T22:35:33.751845+0000","last_undegraded":"2024-09-12T22:35:33.751845+0000","last_fullsized":"2024-09-12T22:35:33.751845+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:27:17.331198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039540700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"60'292","reported_seq":404,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.761303+0000","last_change":"2024-09-12T22:35:33.761303+0000","last_active":"2024-09-12T22:35:33.761303+0000","last_peered":"2024-09-12T22:35:33.761303+0000","last_clean":"2024-09-12T22:35:33.761303+0000","last_became_active":"2024-09-12T22:35:33.760742+0000","last_became_peered":"2024-09-12T22:35:33.760742+0000","last_unstale":"2024-09-12T22:35:33.761303+0000","last_undegraded":"2024-09-12T22:35:33.761303+0000","last_fullsized":"2024-09-12T22:35:33.761303+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":292,"log_dups_size":0,"ondisk_log_size":292,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:48:04.210933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":235,"num_write_kb":8293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"60'375","reported_seq":912,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752503+0000","last_change":"2024-09-12T22:35:29.740484+0000","last_active":"2024-09-12T22:35:33.752503+0000","last_peered":"2024-09-12T22:35:33.752503+0000","last_clean":"2024-09-12T22:35:33.752503+0000","last_became_active":"2024-09-12T22:35:29.738755+0000","last_became_peered":"2024-09-12T22:35:29.738755+0000","last_unstale":"2024-09-12T22:35:33.752503+0000","last_undegraded":"2024-09-12T22:35:33.752503+0000","last_fullsized":"2024-09-12T22:35:33.752503+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:07:35.007529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":43566,"num_write":354,"num_write_kb":92229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":160,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":150,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752179+0000","last_change":"2024-09-12T22:31:34.286938+0000","last_active":"2024-09-12T22:35:33.752179+0000","last_peered":"2024-09-12T22:35:33.752179+0000","last_clean":"2024-09-12T22:35:33.752179+0000","last_became_active":"2024-09-12T22:31:32.282230+0000","last_became_peered":"2024-09-12T22:31:32.282230+0000","last_unstale":"2024-09-12T22:35:33.752179+0000","last_undegraded":"2024-09-12T22:35:33.752179+0000","last_fullsized":"2024-09-12T22:35:33.752179+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:11:05.988384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000615758,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"60'63","reported_seq":198,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752204+0000","last_change":"2024-09-12T22:31:36.410694+0000","last_active":"2024-09-12T22:35:33.752204+0000","last_peered":"2024-09-12T22:35:33.752204+0000","last_clean":"2024-09-12T22:35:33.752204+0000","last_became_active":"2024-09-12T22:31:36.409816+0000","last_became_peered":"2024-09-12T22:31:36.409816+0000","last_unstale":"2024-09-12T22:35:33.752204+0000","last_undegraded":"2024-09-12T22:35:33.752204+0000","last_fullsized":"2024-09-12T22:35:33.752204+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:40:35.369213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"60'405","reported_seq":929,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752072+0000","last_change":"2024-09-12T22:35:29.736704+0000","last_active":"2024-09-12T22:35:33.752072+0000","last_peered":"2024-09-12T22:35:33.752072+0000","last_clean":"2024-09-12T22:35:33.752072+0000","last_became_active":"2024-09-12T22:35:29.735499+0000","last_became_peered":"2024-09-12T22:35:29.735499+0000","last_unstale":"2024-09-12T22:35:33.752072+0000","last_undegraded":"2024-09-12T22:35:33.752072+0000","last_fullsized":"2024-09-12T22:35:33.752072+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:26:06.464684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":20152,"num_write":366,"num_write_kb":92447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"60'277","reported_seq":361,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.753169+0000","last_change":"2024-09-12T22:35:23.755555+0000","last_active":"2024-09-12T22:35:33.753169+0000","last_peered":"2024-09-12T22:35:33.753169+0000","last_clean":"2024-09-12T22:35:33.753169+0000","last_became_active":"2024-09-12T22:35:23.755237+0000","last_became_peered":"2024-09-12T22:35:23.755237+0000","last_unstale":"2024-09-12T22:35:33.753169+0000","last_undegraded":"2024-09-12T22:35:33.753169+0000","last_fullsized":"2024-09-12T22:35:33.753169+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":277,"log_dups_size":0,"ondisk_log_size":277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:10:23.649578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":216,"num_write_kb":4193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":155,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752207+0000","last_change":"2024-09-12T22:35:20.736644+0000","last_active":"2024-09-12T22:35:33.752207+0000","last_peered":"2024-09-12T22:35:33.752207+0000","last_clean":"2024-09-12T22:35:33.752207+0000","last_became_active":"2024-09-12T22:35:20.736428+0000","last_became_peered":"2024-09-12T22:35:20.736428+0000","last_unstale":"2024-09-12T22:35:33.752207+0000","last_undegraded":"2024-09-12T22:35:33.752207+0000","last_fullsized":"2024-09-12T22:35:33.752207+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:42:12.023369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041972500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"60'355","reported_seq":457,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752866+0000","last_change":"2024-09-12T22:35:25.729864+0000","last_active":"2024-09-12T22:35:33.752866+0000","last_peered":"2024-09-12T22:35:33.752866+0000","last_clean":"2024-09-12T22:35:33.752866+0000","last_became_active":"2024-09-12T22:35:25.727299+0000","last_became_peered":"2024-09-12T22:35:25.727299+0000","last_unstale":"2024-09-12T22:35:33.752866+0000","last_undegraded":"2024-09-12T22:35:33.752866+0000","last_fullsized":"2024-09-12T22:35:33.752866+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":355,"log_dups_size":0,"ondisk_log_size":355,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:56:40.812767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13196,"num_write":321,"num_write_kb":41797,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"60'55","reported_seq":197,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752072+0000","last_change":"2024-09-12T22:35:20.738078+0000","last_active":"2024-09-12T22:35:33.752072+0000","last_peered":"2024-09-12T22:35:33.752072+0000","last_clean":"2024-09-12T22:35:33.752072+0000","last_became_active":"2024-09-12T22:35:20.737705+0000","last_became_peered":"2024-09-12T22:35:20.737705+0000","last_unstale":"2024-09-12T22:35:33.752072+0000","last_undegraded":"2024-09-12T22:35:33.752072+0000","last_fullsized":"2024-09-12T22:35:33.752072+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:04:15.554381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":68,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.754453+0000","last_change":"2024-09-12T22:35:20.738327+0000","last_active":"2024-09-12T22:35:33.754453+0000","last_peered":"2024-09-12T22:35:33.754453+0000","last_clean":"2024-09-12T22:35:33.754453+0000","last_became_active":"2024-09-12T22:35:20.737799+0000","last_became_peered":"2024-09-12T22:35:20.737799+0000","last_unstale":"2024-09-12T22:35:33.754453+0000","last_undegraded":"2024-09-12T22:35:33.754453+0000","last_fullsized":"2024-09-12T22:35:33.754453+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:03:16.381453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"60'385","reported_seq":533,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.761943+0000","last_change":"2024-09-12T22:35:33.761943+0000","last_active":"2024-09-12T22:35:33.761943+0000","last_peered":"2024-09-12T22:35:33.761943+0000","last_clean":"2024-09-12T22:35:33.761943+0000","last_became_active":"2024-09-12T22:35:33.754546+0000","last_became_peered":"2024-09-12T22:35:33.754546+0000","last_unstale":"2024-09-12T22:35:33.761943+0000","last_undegraded":"2024-09-12T22:35:33.761943+0000","last_fullsized":"2024-09-12T22:35:33.761943+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:35:36.478089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":22437,"num_write":347,"num_write_kb":30121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"60'61","reported_seq":204,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752744+0000","last_change":"2024-09-12T22:35:20.738494+0000","last_active":"2024-09-12T22:35:33.752744+0000","last_peered":"2024-09-12T22:35:33.752744+0000","last_clean":"2024-09-12T22:35:33.752744+0000","last_became_active":"2024-09-12T22:35:20.738129+0000","last_became_peered":"2024-09-12T22:35:20.738129+0000","last_unstale":"2024-09-12T22:35:33.752744+0000","last_undegraded":"2024-09-12T22:35:33.752744+0000","last_fullsized":"2024-09-12T22:35:33.752744+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:27:06.987354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":155,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752846+0000","last_change":"2024-09-12T22:35:20.736934+0000","last_active":"2024-09-12T22:35:33.752846+0000","last_peered":"2024-09-12T22:35:33.752846+0000","last_clean":"2024-09-12T22:35:33.752846+0000","last_became_active":"2024-09-12T22:35:20.736628+0000","last_became_peered":"2024-09-12T22:35:20.736628+0000","last_unstale":"2024-09-12T22:35:33.752846+0000","last_undegraded":"2024-09-12T22:35:33.752846+0000","last_fullsized":"2024-09-12T22:35:33.752846+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:04:03.284313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058589999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"60'402","reported_seq":553,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.751534+0000","last_change":"2024-09-12T22:31:37.411152+0000","last_active":"2024-09-12T22:35:33.751534+0000","last_peered":"2024-09-12T22:35:33.751534+0000","last_clean":"2024-09-12T22:35:33.751534+0000","last_became_active":"2024-09-12T22:31:37.410558+0000","last_became_peered":"2024-09-12T22:31:37.410558+0000","last_unstale":"2024-09-12T22:35:33.751534+0000","last_undegraded":"2024-09-12T22:35:33.751534+0000","last_fullsized":"2024-09-12T22:35:33.751534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:14:29.892478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":10169,"num_write":370,"num_write_kb":38130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"61'105","reported_seq":240,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752736+0000","last_change":"2024-09-12T22:31:36.407460+0000","last_active":"2024-09-12T22:35:33.752736+0000","last_peered":"2024-09-12T22:35:33.752736+0000","last_clean":"2024-09-12T22:35:33.752736+0000","last_became_active":"2024-09-12T22:31:36.406729+0000","last_became_peered":"2024-09-12T22:31:36.406729+0000","last_unstale":"2024-09-12T22:35:33.752736+0000","last_undegraded":"2024-09-12T22:35:33.752736+0000","last_fullsized":"2024-09-12T22:35:33.752736+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:27:58.012573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103,"num_write_kb":1085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":155,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752930+0000","last_change":"2024-09-12T22:35:20.737068+0000","last_active":"2024-09-12T22:35:33.752930+0000","last_peered":"2024-09-12T22:35:33.752930+0000","last_clean":"2024-09-12T22:35:33.752930+0000","last_became_active":"2024-09-12T22:35:20.736769+0000","last_became_peered":"2024-09-12T22:35:20.736769+0000","last_unstale":"2024-09-12T22:35:33.752930+0000","last_undegraded":"2024-09-12T22:35:33.752930+0000","last_fullsized":"2024-09-12T22:35:33.752930+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:44:36.675350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000382109,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"60'412","reported_seq":550,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752676+0000","last_change":"2024-09-12T22:35:26.734859+0000","last_active":"2024-09-12T22:35:33.752676+0000","last_peered":"2024-09-12T22:35:33.752676+0000","last_clean":"2024-09-12T22:35:33.752676+0000","last_became_active":"2024-09-12T22:35:26.732923+0000","last_became_peered":"2024-09-12T22:35:26.732923+0000","last_unstale":"2024-09-12T22:35:33.752676+0000","last_undegraded":"2024-09-12T22:35:33.752676+0000","last_fullsized":"2024-09-12T22:35:33.752676+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:48:09.924688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":34504,"num_write":385,"num_write_kb":100438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"60'415","reported_seq":968,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.751983+0000","last_change":"2024-09-12T22:35:24.760883+0000","last_active":"2024-09-12T22:35:33.751983+0000","last_peered":"2024-09-12T22:35:33.751983+0000","last_clean":"2024-09-12T22:35:33.751983+0000","last_became_active":"2024-09-12T22:35:24.759441+0000","last_became_peered":"2024-09-12T22:35:24.759441+0000","last_unstale":"2024-09-12T22:35:33.751983+0000","last_undegraded":"2024-09-12T22:35:33.751983+0000","last_fullsized":"2024-09-12T22:35:33.751983+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:26:21.054210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":37207,"num_write":375,"num_write_kb":84660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"60'221","reported_seq":374,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752760+0000","last_change":"2024-09-12T22:35:23.756290+0000","last_active":"2024-09-12T22:35:33.752760+0000","last_peered":"2024-09-12T22:35:33.752760+0000","last_clean":"2024-09-12T22:35:33.752760+0000","last_became_active":"2024-09-12T22:35:23.755918+0000","last_became_peered":"2024-09-12T22:35:23.755918+0000","last_unstale":"2024-09-12T22:35:33.752760+0000","last_undegraded":"2024-09-12T22:35:33.752760+0000","last_fullsized":"2024-09-12T22:35:33.752760+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":221,"log_dups_size":0,"ondisk_log_size":221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:08:03.811119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":175,"num_write_kb":8282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":8382815,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"60'429","reported_seq":961,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.751615+0000","last_change":"2024-09-12T22:35:25.728726+0000","last_active":"2024-09-12T22:35:33.751615+0000","last_peered":"2024-09-12T22:35:33.751615+0000","last_clean":"2024-09-12T22:35:33.751615+0000","last_became_active":"2024-09-12T22:35:25.726837+0000","last_became_peered":"2024-09-12T22:35:25.726837+0000","last_unstale":"2024-09-12T22:35:33.751615+0000","last_undegraded":"2024-09-12T22:35:33.751615+0000","last_fullsized":"2024-09-12T22:35:33.751615+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:38.996042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":12230,"num_write":389,"num_write_kb":71746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"60'98","reported_seq":217,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.760239+0000","last_change":"2024-09-12T22:35:33.760239+0000","last_active":"2024-09-12T22:35:33.760239+0000","last_peered":"2024-09-12T22:35:33.760239+0000","last_clean":"2024-09-12T22:35:33.760239+0000","last_became_active":"2024-09-12T22:35:33.758640+0000","last_became_peered":"2024-09-12T22:35:33.758640+0000","last_unstale":"2024-09-12T22:35:33.760239+0000","last_undegraded":"2024-09-12T22:35:33.760239+0000","last_fullsized":"2024-09-12T22:35:33.760239+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:24:11.251168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"60'214","reported_seq":349,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752661+0000","last_change":"2024-09-12T22:31:36.411549+0000","last_active":"2024-09-12T22:35:33.752661+0000","last_peered":"2024-09-12T22:35:33.752661+0000","last_clean":"2024-09-12T22:35:33.752661+0000","last_became_active":"2024-09-12T22:31:36.410674+0000","last_became_peered":"2024-09-12T22:31:36.410674+0000","last_unstale":"2024-09-12T22:35:33.752661+0000","last_undegraded":"2024-09-12T22:35:33.752661+0000","last_fullsized":"2024-09-12T22:35:33.752661+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:58:05.676197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":151,"num_write_kb":4168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"60'460","reported_seq":622,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.751479+0000","last_change":"2024-09-12T22:31:37.411254+0000","last_active":"2024-09-12T22:35:33.751479+0000","last_peered":"2024-09-12T22:35:33.751479+0000","last_clean":"2024-09-12T22:35:33.751479+0000","last_became_active":"2024-09-12T22:31:37.410404+0000","last_became_peered":"2024-09-12T22:31:37.410404+0000","last_unstale":"2024-09-12T22:35:33.751479+0000","last_undegraded":"2024-09-12T22:35:33.751479+0000","last_fullsized":"2024-09-12T22:35:33.751479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:42:00.856616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":15059,"num_write":431,"num_write_kb":59615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"60'52","reported_seq":187,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752633+0000","last_change":"2024-09-12T22:31:36.408390+0000","last_active":"2024-09-12T22:35:33.752633+0000","last_peered":"2024-09-12T22:35:33.752633+0000","last_clean":"2024-09-12T22:35:33.752633+0000","last_became_active":"2024-09-12T22:31:36.407062+0000","last_became_peered":"2024-09-12T22:31:36.407062+0000","last_unstale":"2024-09-12T22:35:33.752633+0000","last_undegraded":"2024-09-12T22:35:33.752633+0000","last_fullsized":"2024-09-12T22:35:33.752633+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:09:10.618195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"60'461","reported_seq":1025,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.751489+0000","last_change":"2024-09-12T22:35:28.731581+0000","last_active":"2024-09-12T22:35:33.751489+0000","last_peered":"2024-09-12T22:35:33.751489+0000","last_clean":"2024-09-12T22:35:33.751489+0000","last_became_active":"2024-09-12T22:35:28.730402+0000","last_became_peered":"2024-09-12T22:35:28.730402+0000","last_unstale":"2024-09-12T22:35:33.751489+0000","last_undegraded":"2024-09-12T22:35:33.751489+0000","last_fullsized":"2024-09-12T22:35:33.751489+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:25:37.428224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":17508,"num_write":431,"num_write_kb":67883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":200,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"60'355","reported_seq":479,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752557+0000","last_change":"2024-09-12T22:35:28.732887+0000","last_active":"2024-09-12T22:35:33.752557+0000","last_peered":"2024-09-12T22:35:33.752557+0000","last_clean":"2024-09-12T22:35:33.752557+0000","last_became_active":"2024-09-12T22:35:28.730931+0000","last_became_peered":"2024-09-12T22:35:28.730931+0000","last_unstale":"2024-09-12T22:35:33.752557+0000","last_undegraded":"2024-09-12T22:35:33.752557+0000","last_fullsized":"2024-09-12T22:35:33.752557+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":355,"log_dups_size":0,"ondisk_log_size":355,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:14:12.194559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":44561,"num_write":329,"num_write_kb":26431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"60'548","reported_seq":698,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.751631+0000","last_change":"2024-09-12T22:35:23.756287+0000","last_active":"2024-09-12T22:35:33.751631+0000","last_peered":"2024-09-12T22:35:33.751631+0000","last_clean":"2024-09-12T22:35:33.751631+0000","last_became_active":"2024-09-12T22:35:23.755812+0000","last_became_peered":"2024-09-12T22:35:23.755812+0000","last_unstale":"2024-09-12T22:35:33.751631+0000","last_undegraded":"2024-09-12T22:35:33.751631+0000","last_fullsized":"2024-09-12T22:35:33.751631+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":548,"log_dups_size":0,"ondisk_log_size":548,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:15:13.597427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":488,"num_write_kb":8420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"60'422","reported_seq":667,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752477+0000","last_change":"2024-09-12T22:31:37.411183+0000","last_active":"2024-09-12T22:35:33.752477+0000","last_peered":"2024-09-12T22:35:33.752477+0000","last_clean":"2024-09-12T22:35:33.752477+0000","last_became_active":"2024-09-12T22:31:37.409796+0000","last_became_peered":"2024-09-12T22:31:37.409796+0000","last_unstale":"2024-09-12T22:35:33.752477+0000","last_undegraded":"2024-09-12T22:35:33.752477+0000","last_fullsized":"2024-09-12T22:35:33.752477+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:20:35.779810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":51020,"num_write":397,"num_write_kb":73116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"60'180","reported_seq":315,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.751693+0000","last_change":"2024-09-12T22:31:36.407402+0000","last_active":"2024-09-12T22:35:33.751693+0000","last_peered":"2024-09-12T22:35:33.751693+0000","last_clean":"2024-09-12T22:35:33.751693+0000","last_became_active":"2024-09-12T22:31:36.406681+0000","last_became_peered":"2024-09-12T22:31:36.406681+0000","last_unstale":"2024-09-12T22:35:33.751693+0000","last_undegraded":"2024-09-12T22:35:33.751693+0000","last_fullsized":"2024-09-12T22:35:33.751693+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:39:39.362573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":134,"num_write_kb":4167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"60'420","reported_seq":545,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.753501+0000","last_change":"2024-09-12T22:35:30.734995+0000","last_active":"2024-09-12T22:35:33.753501+0000","last_peered":"2024-09-12T22:35:33.753501+0000","last_clean":"2024-09-12T22:35:33.753501+0000","last_became_active":"2024-09-12T22:35:30.733182+0000","last_became_peered":"2024-09-12T22:35:30.733182+0000","last_unstale":"2024-09-12T22:35:33.753501+0000","last_undegraded":"2024-09-12T22:35:33.753501+0000","last_fullsized":"2024-09-12T22:35:33.753501+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:01:30.939801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":24901,"num_write":369,"num_write_kb":75198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"61'212","reported_seq":324,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.755961+0000","last_change":"2024-09-12T22:35:33.755961+0000","last_active":"2024-09-12T22:35:33.755961+0000","last_peered":"2024-09-12T22:35:33.755961+0000","last_clean":"2024-09-12T22:35:33.755961+0000","last_became_active":"2024-09-12T22:35:33.754931+0000","last_became_peered":"2024-09-12T22:35:33.754931+0000","last_unstale":"2024-09-12T22:35:33.755961+0000","last_undegraded":"2024-09-12T22:35:33.755961+0000","last_fullsized":"2024-09-12T22:35:33.755961+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:12:35.586196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12553847,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":12334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"60'398","reported_seq":539,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.763810+0000","last_change":"2024-09-12T22:35:33.763810+0000","last_active":"2024-09-12T22:35:33.763810+0000","last_peered":"2024-09-12T22:35:33.763810+0000","last_clean":"2024-09-12T22:35:33.763810+0000","last_became_active":"2024-09-12T22:35:33.755497+0000","last_became_peered":"2024-09-12T22:35:33.755497+0000","last_unstale":"2024-09-12T22:35:33.763810+0000","last_undegraded":"2024-09-12T22:35:33.763810+0000","last_fullsized":"2024-09-12T22:35:33.763810+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:19:50.330571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":11429,"num_write":361,"num_write_kb":88082,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"60'54","reported_seq":55,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752689+0000","last_change":"2024-09-12T22:35:20.759946+0000","last_active":"2024-09-12T22:35:33.752689+0000","last_peered":"2024-09-12T22:35:33.752689+0000","last_clean":"2024-09-12T22:35:33.752689+0000","last_became_active":"2024-09-12T22:35:20.733271+0000","last_became_peered":"2024-09-12T22:35:20.733271+0000","last_unstale":"2024-09-12T22:35:33.752689+0000","last_undegraded":"2024-09-12T22:35:33.752689+0000","last_fullsized":"2024-09-12T22:35:33.752689+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:49:02.164294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"60'359","reported_seq":512,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.751925+0000","last_change":"2024-09-12T22:31:37.415365+0000","last_active":"2024-09-12T22:35:33.751925+0000","last_peered":"2024-09-12T22:35:33.751925+0000","last_clean":"2024-09-12T22:35:33.751925+0000","last_became_active":"2024-09-12T22:31:37.413933+0000","last_became_peered":"2024-09-12T22:31:37.413933+0000","last_unstale":"2024-09-12T22:35:33.751925+0000","last_undegraded":"2024-09-12T22:35:33.751925+0000","last_fullsized":"2024-09-12T22:35:33.751925+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:08:07.115355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":12324,"num_write":332,"num_write_kb":46371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"60'186","reported_seq":321,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752637+0000","last_change":"2024-09-12T22:31:36.411665+0000","last_active":"2024-09-12T22:35:33.752637+0000","last_peered":"2024-09-12T22:35:33.752637+0000","last_clean":"2024-09-12T22:35:33.752637+0000","last_became_active":"2024-09-12T22:31:36.410182+0000","last_became_peered":"2024-09-12T22:31:36.410182+0000","last_unstale":"2024-09-12T22:35:33.752637+0000","last_undegraded":"2024-09-12T22:35:33.752637+0000","last_fullsized":"2024-09-12T22:35:33.752637+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:37:20.891838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":4160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"60'401","reported_seq":570,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752012+0000","last_change":"2024-09-12T22:31:37.415172+0000","last_active":"2024-09-12T22:35:33.752012+0000","last_peered":"2024-09-12T22:35:33.752012+0000","last_clean":"2024-09-12T22:35:33.752012+0000","last_became_active":"2024-09-12T22:31:37.414776+0000","last_became_peered":"2024-09-12T22:31:37.414776+0000","last_unstale":"2024-09-12T22:35:33.752012+0000","last_undegraded":"2024-09-12T22:35:33.752012+0000","last_fullsized":"2024-09-12T22:35:33.752012+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:42:32.307876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":24207,"num_write":361,"num_write_kb":50515,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"60'244","reported_seq":365,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.759131+0000","last_change":"2024-09-12T22:35:33.759131+0000","last_active":"2024-09-12T22:35:33.759131+0000","last_peered":"2024-09-12T22:35:33.759131+0000","last_clean":"2024-09-12T22:35:33.759131+0000","last_became_active":"2024-09-12T22:35:33.757550+0000","last_became_peered":"2024-09-12T22:35:33.757550+0000","last_unstale":"2024-09-12T22:35:33.759131+0000","last_undegraded":"2024-09-12T22:35:33.759131+0000","last_fullsized":"2024-09-12T22:35:33.759131+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":244,"log_dups_size":0,"ondisk_log_size":244,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:16:17.926249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":12389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"60'439","reported_seq":927,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.751404+0000","last_change":"2024-09-12T22:35:27.731026+0000","last_active":"2024-09-12T22:35:33.751404+0000","last_peered":"2024-09-12T22:35:33.751404+0000","last_clean":"2024-09-12T22:35:33.751404+0000","last_became_active":"2024-09-12T22:35:27.729827+0000","last_became_peered":"2024-09-12T22:35:27.729827+0000","last_unstale":"2024-09-12T22:35:33.751404+0000","last_undegraded":"2024-09-12T22:35:33.751404+0000","last_fullsized":"2024-09-12T22:35:33.751404+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:21:02.543670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":6311,"num_write":403,"num_write_kb":64161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"60'51","reported_seq":198,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752598+0000","last_change":"2024-09-12T22:35:20.764696+0000","last_active":"2024-09-12T22:35:33.752598+0000","last_peered":"2024-09-12T22:35:33.752598+0000","last_clean":"2024-09-12T22:35:33.752598+0000","last_became_active":"2024-09-12T22:35:20.737444+0000","last_became_peered":"2024-09-12T22:35:20.737444+0000","last_unstale":"2024-09-12T22:35:33.752598+0000","last_undegraded":"2024-09-12T22:35:33.752598+0000","last_fullsized":"2024-09-12T22:35:33.752598+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:14:54.424047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"60'438","reported_seq":624,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.751812+0000","last_change":"2024-09-12T22:31:37.415390+0000","last_active":"2024-09-12T22:35:33.751812+0000","last_peered":"2024-09-12T22:35:33.751812+0000","last_clean":"2024-09-12T22:35:33.751812+0000","last_became_active":"2024-09-12T22:31:37.414781+0000","last_became_peered":"2024-09-12T22:31:37.414781+0000","last_unstale":"2024-09-12T22:35:33.751812+0000","last_undegraded":"2024-09-12T22:35:33.751812+0000","last_fullsized":"2024-09-12T22:35:33.751812+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:42:17.728844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":29290,"num_write":407,"num_write_kb":46733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"60'111","reported_seq":246,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752515+0000","last_change":"2024-09-12T22:31:36.407945+0000","last_active":"2024-09-12T22:35:33.752515+0000","last_peered":"2024-09-12T22:35:33.752515+0000","last_clean":"2024-09-12T22:35:33.752515+0000","last_became_active":"2024-09-12T22:31:36.406959+0000","last_became_peered":"2024-09-12T22:31:36.406959+0000","last_unstale":"2024-09-12T22:35:33.752515+0000","last_undegraded":"2024-09-12T22:35:33.752515+0000","last_fullsized":"2024-09-12T22:35:33.752515+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:26:33.155850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61,"num_write_kb":4126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2747,"num_read_kb":1535780,"num_write":24498,"num_write_kb":4269351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5680,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26636,"ondisk_log_size":26636,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127268954,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":43,"num_read_kb":1462,"num_write":4457,"num_write_kb":127482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":54520159,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":254603264,"data_stored":254537908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4442,"internal_metadata":0},"log_size":6263,"ondisk_log_size":6263,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705719,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":174088,"kb_used_data":84656,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94197752,"statfs":{"total":96636764160,"available":96458498048,"internally_reserved":0,"allocated":86687744,"data_stored":86276944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":66,"seq":283467841541,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":145348,"kb_used_data":87272,"kb_used_omap":5,"kb_used_meta":58042,"kb_avail":94226492,"statfs":{"total":96636764160,"available":96487927808,"internally_reserved":0,"allocated":89366528,"data_stored":88969829,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6037,"internal_metadata":59435115},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738423,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":173528,"kb_used_data":79932,"kb_used_omap":1,"kb_used_meta":93566,"kb_avail":94198312,"statfs":{"total":96636764160,"available":96459071488,"internally_reserved":0,"allocated":81850368,"data_stored":81462353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":95812037},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":88076288,"data_stored":88052173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4442,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81141760,"data_stored":81130756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":85385216,"data_stored":85354979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T22:35:36.653 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T22:35:36.985 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:35:36.987 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-12T22:35:36.997 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":204,"stamp":"2024-09-12T22:35:36.253310+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":127859341,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":2926,"num_read_kb":1537360,"num_write":29160,"num_write_kb":4400295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5694,"num_bytes_recovered":54520159,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33059,"ondisk_log_size":33059,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":492964,"kb_used_data":251860,"kb_used_omap":9,"kb_used_meta":241014,"kb_avail":282622556,"statfs":{"total":289910292480,"available":289405497344,"internally_reserved":0,"allocated":257904640,"data_stored":256709126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9227,"internal_metadata":246799349},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-1580,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":78,"num_bytes_recovered":-33525457,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.528794"},"pg_stats":[{"pgid":"4.3f","version":"60'422","reported_seq":536,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.753683+0000","last_change":"2024-09-12T22:35:30.733306+0000","last_active":"2024-09-12T22:35:33.753683+0000","last_peered":"2024-09-12T22:35:33.753683+0000","last_clean":"2024-09-12T22:35:33.753683+0000","last_became_active":"2024-09-12T22:35:30.731323+0000","last_became_peered":"2024-09-12T22:35:30.731323+0000","last_unstale":"2024-09-12T22:35:33.753683+0000","last_undegraded":"2024-09-12T22:35:33.753683+0000","last_fullsized":"2024-09-12T22:35:33.753683+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:14:12.288153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":29437,"num_write":385,"num_write_kb":96431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"60'470","reported_seq":631,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.764988+0000","last_change":"2024-09-12T22:35:33.764988+0000","last_active":"2024-09-12T22:35:33.764988+0000","last_peered":"2024-09-12T22:35:33.764988+0000","last_clean":"2024-09-12T22:35:33.764988+0000","last_became_active":"2024-09-12T22:35:33.759906+0000","last_became_peered":"2024-09-12T22:35:33.759906+0000","last_unstale":"2024-09-12T22:35:33.764988+0000","last_undegraded":"2024-09-12T22:35:33.764988+0000","last_fullsized":"2024-09-12T22:35:33.764988+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:06:06.794825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":18334,"num_write":442,"num_write_kb":109282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"60'391","reported_seq":912,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752455+0000","last_change":"2024-09-12T22:35:30.732861+0000","last_active":"2024-09-12T22:35:33.752455+0000","last_peered":"2024-09-12T22:35:33.752455+0000","last_clean":"2024-09-12T22:35:33.752455+0000","last_became_active":"2024-09-12T22:35:30.731086+0000","last_became_peered":"2024-09-12T22:35:30.731086+0000","last_unstale":"2024-09-12T22:35:33.752455+0000","last_undegraded":"2024-09-12T22:35:33.752455+0000","last_fullsized":"2024-09-12T22:35:33.752455+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:56:09.762357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":32771,"num_write":355,"num_write_kb":71120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"60'397","reported_seq":580,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752271+0000","last_change":"2024-09-12T22:31:37.413094+0000","last_active":"2024-09-12T22:35:33.752271+0000","last_peered":"2024-09-12T22:35:33.752271+0000","last_clean":"2024-09-12T22:35:33.752271+0000","last_became_active":"2024-09-12T22:31:37.412746+0000","last_became_peered":"2024-09-12T22:31:37.412746+0000","last_unstale":"2024-09-12T22:35:33.752271+0000","last_undegraded":"2024-09-12T22:35:33.752271+0000","last_fullsized":"2024-09-12T22:35:33.752271+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:32:14.415120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":28544,"num_write":368,"num_write_kb":83737,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"60'458","reported_seq":591,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752878+0000","last_change":"2024-09-12T22:35:24.759019+0000","last_active":"2024-09-12T22:35:33.752878+0000","last_peered":"2024-09-12T22:35:33.752878+0000","last_clean":"2024-09-12T22:35:33.752878+0000","last_became_active":"2024-09-12T22:35:24.756373+0000","last_became_peered":"2024-09-12T22:35:24.756373+0000","last_unstale":"2024-09-12T22:35:33.752878+0000","last_undegraded":"2024-09-12T22:35:33.752878+0000","last_fullsized":"2024-09-12T22:35:33.752878+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":458,"log_dups_size":0,"ondisk_log_size":458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:49:34.350038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":28467,"num_write":430,"num_write_kb":81329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":198,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"60'381","reported_seq":515,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.751680+0000","last_change":"2024-09-12T22:31:37.409177+0000","last_active":"2024-09-12T22:35:33.751680+0000","last_peered":"2024-09-12T22:35:33.751680+0000","last_clean":"2024-09-12T22:35:33.751680+0000","last_became_active":"2024-09-12T22:31:37.408811+0000","last_became_peered":"2024-09-12T22:31:37.408811+0000","last_unstale":"2024-09-12T22:35:33.751680+0000","last_undegraded":"2024-09-12T22:35:33.751680+0000","last_fullsized":"2024-09-12T22:35:33.751680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:17:21.695079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":60,"num_write":353,"num_write_kb":58419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"60'439","reported_seq":618,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.751757+0000","last_change":"2024-09-12T22:31:37.413023+0000","last_active":"2024-09-12T22:35:33.751757+0000","last_peered":"2024-09-12T22:35:33.751757+0000","last_clean":"2024-09-12T22:35:33.751757+0000","last_became_active":"2024-09-12T22:31:37.412691+0000","last_became_peered":"2024-09-12T22:31:37.412691+0000","last_unstale":"2024-09-12T22:35:33.751757+0000","last_undegraded":"2024-09-12T22:35:33.751757+0000","last_fullsized":"2024-09-12T22:35:33.751757+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:02:36.454134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":27053,"num_write":405,"num_write_kb":79743,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"60'384","reported_seq":589,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.751463+0000","last_change":"2024-09-12T22:31:37.411074+0000","last_active":"2024-09-12T22:35:33.751463+0000","last_peered":"2024-09-12T22:35:33.751463+0000","last_clean":"2024-09-12T22:35:33.751463+0000","last_became_active":"2024-09-12T22:31:37.410633+0000","last_became_peered":"2024-09-12T22:31:37.410633+0000","last_unstale":"2024-09-12T22:35:33.751463+0000","last_undegraded":"2024-09-12T22:35:33.751463+0000","last_fullsized":"2024-09-12T22:35:33.751463+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:39:20.383152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":44358,"num_write":338,"num_write_kb":67411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"60'418","reported_seq":1002,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752278+0000","last_change":"2024-09-12T22:35:28.732156+0000","last_active":"2024-09-12T22:35:33.752278+0000","last_peered":"2024-09-12T22:35:33.752278+0000","last_clean":"2024-09-12T22:35:33.752278+0000","last_became_active":"2024-09-12T22:35:28.731002+0000","last_became_peered":"2024-09-12T22:35:28.731002+0000","last_unstale":"2024-09-12T22:35:33.752278+0000","last_undegraded":"2024-09-12T22:35:33.752278+0000","last_fullsized":"2024-09-12T22:35:33.752278+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:52:19.679715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":48711,"num_write":384,"num_write_kb":63228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"60'406","reported_seq":520,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.753178+0000","last_change":"2024-09-12T22:35:27.732831+0000","last_active":"2024-09-12T22:35:33.753178+0000","last_peered":"2024-09-12T22:35:33.753178+0000","last_clean":"2024-09-12T22:35:33.753178+0000","last_became_active":"2024-09-12T22:35:27.729480+0000","last_became_peered":"2024-09-12T22:35:27.729480+0000","last_unstale":"2024-09-12T22:35:33.753178+0000","last_undegraded":"2024-09-12T22:35:33.753178+0000","last_fullsized":"2024-09-12T22:35:33.753178+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:38:13.307443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":21851,"num_write":367,"num_write_kb":79913,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"60'338","reported_seq":479,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752488+0000","last_change":"2024-09-12T22:31:37.414469+0000","last_active":"2024-09-12T22:35:33.752488+0000","last_peered":"2024-09-12T22:35:33.752488+0000","last_clean":"2024-09-12T22:35:33.752488+0000","last_became_active":"2024-09-12T22:31:37.414165+0000","last_became_peered":"2024-09-12T22:31:37.414165+0000","last_unstale":"2024-09-12T22:35:33.752488+0000","last_undegraded":"2024-09-12T22:35:33.752488+0000","last_fullsized":"2024-09-12T22:35:33.752488+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":338,"log_dups_size":0,"ondisk_log_size":338,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:25:38.148636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":4053,"num_write":316,"num_write_kb":21475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"60'359","reported_seq":495,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.764173+0000","last_change":"2024-09-12T22:35:33.764173+0000","last_active":"2024-09-12T22:35:33.764173+0000","last_peered":"2024-09-12T22:35:33.764173+0000","last_clean":"2024-09-12T22:35:33.764173+0000","last_became_active":"2024-09-12T22:35:33.760739+0000","last_became_peered":"2024-09-12T22:35:33.760739+0000","last_unstale":"2024-09-12T22:35:33.764173+0000","last_undegraded":"2024-09-12T22:35:33.764173+0000","last_fullsized":"2024-09-12T22:35:33.764173+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:58:38.596224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":6688,"num_write":330,"num_write_kb":38146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"60'402","reported_seq":537,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.761962+0000","last_change":"2024-09-12T22:35:33.761962+0000","last_active":"2024-09-12T22:35:33.761962+0000","last_peered":"2024-09-12T22:35:33.761962+0000","last_clean":"2024-09-12T22:35:33.761962+0000","last_became_active":"2024-09-12T22:35:33.754938+0000","last_became_peered":"2024-09-12T22:35:33.754938+0000","last_unstale":"2024-09-12T22:35:33.761962+0000","last_undegraded":"2024-09-12T22:35:33.761962+0000","last_fullsized":"2024-09-12T22:35:33.761962+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:01:27.181524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":16384,"num_write":363,"num_write_kb":62556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"60'409","reported_seq":935,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.751724+0000","last_change":"2024-09-12T22:35:29.737252+0000","last_active":"2024-09-12T22:35:33.751724+0000","last_peered":"2024-09-12T22:35:33.751724+0000","last_clean":"2024-09-12T22:35:33.751724+0000","last_became_active":"2024-09-12T22:35:29.735835+0000","last_became_peered":"2024-09-12T22:35:29.735835+0000","last_unstale":"2024-09-12T22:35:33.751724+0000","last_undegraded":"2024-09-12T22:35:33.751724+0000","last_fullsized":"2024-09-12T22:35:33.751724+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:32:12.014289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":13943,"num_write":382,"num_write_kb":54682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"60'412","reported_seq":948,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.751812+0000","last_change":"2024-09-12T22:35:28.731566+0000","last_active":"2024-09-12T22:35:33.751812+0000","last_peered":"2024-09-12T22:35:33.751812+0000","last_clean":"2024-09-12T22:35:33.751812+0000","last_became_active":"2024-09-12T22:35:28.730413+0000","last_became_peered":"2024-09-12T22:35:28.730413+0000","last_unstale":"2024-09-12T22:35:33.751812+0000","last_undegraded":"2024-09-12T22:35:33.751812+0000","last_fullsized":"2024-09-12T22:35:33.751812+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:47:47.029549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":19700,"num_write":377,"num_write_kb":67929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"60'404","reported_seq":537,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.751489+0000","last_change":"2024-09-12T22:31:37.411006+0000","last_active":"2024-09-12T22:35:33.751489+0000","last_peered":"2024-09-12T22:35:33.751489+0000","last_clean":"2024-09-12T22:35:33.751489+0000","last_became_active":"2024-09-12T22:31:37.410557+0000","last_became_peered":"2024-09-12T22:31:37.410557+0000","last_unstale":"2024-09-12T22:35:33.751489+0000","last_undegraded":"2024-09-12T22:35:33.751489+0000","last_fullsized":"2024-09-12T22:35:33.751489+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:08:21.709770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":368,"num_write_kb":25652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"60'405","reported_seq":940,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752667+0000","last_change":"2024-09-12T22:35:31.732234+0000","last_active":"2024-09-12T22:35:33.752667+0000","last_peered":"2024-09-12T22:35:33.752667+0000","last_clean":"2024-09-12T22:35:33.752667+0000","last_became_active":"2024-09-12T22:35:31.730883+0000","last_became_peered":"2024-09-12T22:35:31.730883+0000","last_unstale":"2024-09-12T22:35:33.752667+0000","last_undegraded":"2024-09-12T22:35:33.752667+0000","last_fullsized":"2024-09-12T22:35:33.752667+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:50:20.904744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":18251,"num_write":369,"num_write_kb":34203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"60'406","reported_seq":579,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.760018+0000","last_change":"2024-09-12T22:35:33.760018+0000","last_active":"2024-09-12T22:35:33.760018+0000","last_peered":"2024-09-12T22:35:33.760018+0000","last_clean":"2024-09-12T22:35:33.760018+0000","last_became_active":"2024-09-12T22:35:33.754915+0000","last_became_peered":"2024-09-12T22:35:33.754915+0000","last_unstale":"2024-09-12T22:35:33.760018+0000","last_undegraded":"2024-09-12T22:35:33.760018+0000","last_fullsized":"2024-09-12T22:35:33.760018+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:36:51.477439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":45843,"num_write":367,"num_write_kb":59097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"60'413","reported_seq":932,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752397+0000","last_change":"2024-09-12T22:35:31.731988+0000","last_active":"2024-09-12T22:35:33.752397+0000","last_peered":"2024-09-12T22:35:33.752397+0000","last_clean":"2024-09-12T22:35:33.752397+0000","last_became_active":"2024-09-12T22:35:31.730742+0000","last_became_peered":"2024-09-12T22:35:31.730742+0000","last_unstale":"2024-09-12T22:35:33.752397+0000","last_undegraded":"2024-09-12T22:35:33.752397+0000","last_fullsized":"2024-09-12T22:35:33.752397+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:33:38.616668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":20855,"num_write":371,"num_write_kb":71095,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"60'441","reported_seq":621,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752348+0000","last_change":"2024-09-12T22:31:37.414235+0000","last_active":"2024-09-12T22:35:33.752348+0000","last_peered":"2024-09-12T22:35:33.752348+0000","last_clean":"2024-09-12T22:35:33.752348+0000","last_became_active":"2024-09-12T22:31:37.413786+0000","last_became_peered":"2024-09-12T22:31:37.413786+0000","last_unstale":"2024-09-12T22:35:33.752348+0000","last_undegraded":"2024-09-12T22:35:33.752348+0000","last_fullsized":"2024-09-12T22:35:33.752348+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:21:11.866973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":23954,"num_write":419,"num_write_kb":72528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"60'414","reported_seq":622,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752077+0000","last_change":"2024-09-12T22:31:37.415382+0000","last_active":"2024-09-12T22:35:33.752077+0000","last_peered":"2024-09-12T22:35:33.752077+0000","last_clean":"2024-09-12T22:35:33.752077+0000","last_became_active":"2024-09-12T22:31:37.414319+0000","last_became_peered":"2024-09-12T22:31:37.414319+0000","last_unstale":"2024-09-12T22:35:33.752077+0000","last_undegraded":"2024-09-12T22:35:33.752077+0000","last_fullsized":"2024-09-12T22:35:33.752077+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:26:25.578693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":44129,"num_write":387,"num_write_kb":104899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"60'444","reported_seq":551,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.753335+0000","last_change":"2024-09-12T22:35:25.729851+0000","last_active":"2024-09-12T22:35:33.753335+0000","last_peered":"2024-09-12T22:35:33.753335+0000","last_clean":"2024-09-12T22:35:33.753335+0000","last_became_active":"2024-09-12T22:35:25.727269+0000","last_became_peered":"2024-09-12T22:35:25.727269+0000","last_unstale":"2024-09-12T22:35:33.753335+0000","last_undegraded":"2024-09-12T22:35:33.753335+0000","last_fullsized":"2024-09-12T22:35:33.753335+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:30:26.718280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":17411,"num_write":407,"num_write_kb":87850,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"60'421","reported_seq":646,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.751298+0000","last_change":"2024-09-12T22:31:37.410364+0000","last_active":"2024-09-12T22:35:33.751298+0000","last_peered":"2024-09-12T22:35:33.751298+0000","last_clean":"2024-09-12T22:35:33.751298+0000","last_became_active":"2024-09-12T22:31:37.409951+0000","last_became_peered":"2024-09-12T22:31:37.409951+0000","last_unstale":"2024-09-12T22:35:33.751298+0000","last_undegraded":"2024-09-12T22:35:33.751298+0000","last_fullsized":"2024-09-12T22:35:33.751298+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:39:17.785755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":44074,"num_write":389,"num_write_kb":44104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"60'459","reported_seq":614,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.760584+0000","last_change":"2024-09-12T22:35:33.760584+0000","last_active":"2024-09-12T22:35:33.760584+0000","last_peered":"2024-09-12T22:35:33.760584+0000","last_clean":"2024-09-12T22:35:33.760584+0000","last_became_active":"2024-09-12T22:35:33.754576+0000","last_became_peered":"2024-09-12T22:35:33.754576+0000","last_unstale":"2024-09-12T22:35:33.760584+0000","last_undegraded":"2024-09-12T22:35:33.760584+0000","last_fullsized":"2024-09-12T22:35:33.760584+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:14:34.676855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":28605,"num_write":432,"num_write_kb":100377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"60'419","reported_seq":516,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752435+0000","last_change":"2024-09-12T22:35:29.738235+0000","last_active":"2024-09-12T22:35:33.752435+0000","last_peered":"2024-09-12T22:35:33.752435+0000","last_clean":"2024-09-12T22:35:33.752435+0000","last_became_active":"2024-09-12T22:35:29.735450+0000","last_became_peered":"2024-09-12T22:35:29.735450+0000","last_unstale":"2024-09-12T22:35:33.752435+0000","last_undegraded":"2024-09-12T22:35:33.752435+0000","last_fullsized":"2024-09-12T22:35:33.752435+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:24.582229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":16852,"num_write":404,"num_write_kb":34622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"60'494","reported_seq":710,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752455+0000","last_change":"2024-09-12T22:31:37.411880+0000","last_active":"2024-09-12T22:35:33.752455+0000","last_peered":"2024-09-12T22:35:33.752455+0000","last_clean":"2024-09-12T22:35:33.752455+0000","last_became_active":"2024-09-12T22:31:37.410563+0000","last_became_peered":"2024-09-12T22:31:37.410563+0000","last_unstale":"2024-09-12T22:35:33.752455+0000","last_undegraded":"2024-09-12T22:35:33.752455+0000","last_fullsized":"2024-09-12T22:35:33.752455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":494,"log_dups_size":0,"ondisk_log_size":494,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:47:52.560533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":35239,"num_write":450,"num_write_kb":76898,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"60'401","reported_seq":923,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752642+0000","last_change":"2024-09-12T22:35:30.732843+0000","last_active":"2024-09-12T22:35:33.752642+0000","last_peered":"2024-09-12T22:35:33.752642+0000","last_clean":"2024-09-12T22:35:33.752642+0000","last_became_active":"2024-09-12T22:35:30.731155+0000","last_became_peered":"2024-09-12T22:35:30.731155+0000","last_unstale":"2024-09-12T22:35:33.752642+0000","last_undegraded":"2024-09-12T22:35:33.752642+0000","last_fullsized":"2024-09-12T22:35:33.752642+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:54:33.926426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":10993,"num_write":369,"num_write_kb":55171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"60'390","reported_seq":538,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.763890+0000","last_change":"2024-09-12T22:35:33.763890+0000","last_active":"2024-09-12T22:35:33.763890+0000","last_peered":"2024-09-12T22:35:33.763890+0000","last_clean":"2024-09-12T22:35:33.763890+0000","last_became_active":"2024-09-12T22:35:33.756108+0000","last_became_peered":"2024-09-12T22:35:33.756108+0000","last_unstale":"2024-09-12T22:35:33.763890+0000","last_undegraded":"2024-09-12T22:35:33.763890+0000","last_fullsized":"2024-09-12T22:35:33.763890+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:53:03.258457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":18588,"num_write":360,"num_write_kb":59307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"60'429","reported_seq":1007,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.751986+0000","last_change":"2024-09-12T22:35:23.756871+0000","last_active":"2024-09-12T22:35:33.751986+0000","last_peered":"2024-09-12T22:35:33.751986+0000","last_clean":"2024-09-12T22:35:33.751986+0000","last_became_active":"2024-09-12T22:35:23.755618+0000","last_became_peered":"2024-09-12T22:35:23.755618+0000","last_unstale":"2024-09-12T22:35:33.751986+0000","last_undegraded":"2024-09-12T22:35:33.751986+0000","last_fullsized":"2024-09-12T22:35:33.751986+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:21:46.470290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":32541,"num_write":398,"num_write_kb":76609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"60'458","reported_seq":575,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.753011+0000","last_change":"2024-09-12T22:35:28.732538+0000","last_active":"2024-09-12T22:35:33.753011+0000","last_peered":"2024-09-12T22:35:33.753011+0000","last_clean":"2024-09-12T22:35:33.753011+0000","last_became_active":"2024-09-12T22:35:28.730337+0000","last_became_peered":"2024-09-12T22:35:28.730337+0000","last_unstale":"2024-09-12T22:35:33.753011+0000","last_undegraded":"2024-09-12T22:35:33.753011+0000","last_fullsized":"2024-09-12T22:35:33.753011+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":458,"log_dups_size":0,"ondisk_log_size":458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:55:45.185896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":16425,"num_write":413,"num_write_kb":47110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"60'432","reported_seq":982,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.751401+0000","last_change":"2024-09-12T22:35:26.732243+0000","last_active":"2024-09-12T22:35:33.751401+0000","last_peered":"2024-09-12T22:35:33.751401+0000","last_clean":"2024-09-12T22:35:33.751401+0000","last_became_active":"2024-09-12T22:35:26.731135+0000","last_became_peered":"2024-09-12T22:35:26.731135+0000","last_unstale":"2024-09-12T22:35:33.751401+0000","last_undegraded":"2024-09-12T22:35:33.751401+0000","last_fullsized":"2024-09-12T22:35:33.751401+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:34:06.084746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":21090,"num_write":393,"num_write_kb":67477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"60'458","reported_seq":636,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.751620+0000","last_change":"2024-09-12T22:31:37.415190+0000","last_active":"2024-09-12T22:35:33.751620+0000","last_peered":"2024-09-12T22:35:33.751620+0000","last_clean":"2024-09-12T22:35:33.751620+0000","last_became_active":"2024-09-12T22:31:37.414265+0000","last_became_peered":"2024-09-12T22:31:37.414265+0000","last_unstale":"2024-09-12T22:35:33.751620+0000","last_undegraded":"2024-09-12T22:35:33.751620+0000","last_fullsized":"2024-09-12T22:35:33.751620+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":458,"log_dups_size":0,"ondisk_log_size":458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:07:02.173590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":37395,"num_write":421,"num_write_kb":73250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"60'411","reported_seq":583,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.764162+0000","last_change":"2024-09-12T22:35:33.764162+0000","last_active":"2024-09-12T22:35:33.764162+0000","last_peered":"2024-09-12T22:35:33.764162+0000","last_clean":"2024-09-12T22:35:33.764162+0000","last_became_active":"2024-09-12T22:35:33.761121+0000","last_became_peered":"2024-09-12T22:35:33.761121+0000","last_unstale":"2024-09-12T22:35:33.764162+0000","last_undegraded":"2024-09-12T22:35:33.764162+0000","last_fullsized":"2024-09-12T22:35:33.764162+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:03:51.948278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":36400,"num_write":371,"num_write_kb":92142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"60'546","reported_seq":681,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752153+0000","last_change":"2024-09-12T22:31:36.412082+0000","last_active":"2024-09-12T22:35:33.752153+0000","last_peered":"2024-09-12T22:35:33.752153+0000","last_clean":"2024-09-12T22:35:33.752153+0000","last_became_active":"2024-09-12T22:31:36.410871+0000","last_became_peered":"2024-09-12T22:31:36.410871+0000","last_unstale":"2024-09-12T22:35:33.752153+0000","last_undegraded":"2024-09-12T22:35:33.752153+0000","last_fullsized":"2024-09-12T22:35:33.752153+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":546,"log_dups_size":0,"ondisk_log_size":546,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:30:49.127253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":495,"num_write_kb":8426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"60'427","reported_seq":598,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.753291+0000","last_change":"2024-09-12T22:35:31.732681+0000","last_active":"2024-09-12T22:35:33.753291+0000","last_peered":"2024-09-12T22:35:33.753291+0000","last_clean":"2024-09-12T22:35:33.753291+0000","last_became_active":"2024-09-12T22:35:31.730237+0000","last_became_peered":"2024-09-12T22:35:31.730237+0000","last_unstale":"2024-09-12T22:35:33.753291+0000","last_undegraded":"2024-09-12T22:35:33.753291+0000","last_fullsized":"2024-09-12T22:35:33.753291+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:51:57.088855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":59223,"num_write":394,"num_write_kb":80309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":175,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"60'55","reported_seq":190,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752085+0000","last_change":"2024-09-12T22:31:36.408563+0000","last_active":"2024-09-12T22:35:33.752085+0000","last_peered":"2024-09-12T22:35:33.752085+0000","last_clean":"2024-09-12T22:35:33.752085+0000","last_became_active":"2024-09-12T22:31:36.407447+0000","last_became_peered":"2024-09-12T22:31:36.407447+0000","last_unstale":"2024-09-12T22:35:33.752085+0000","last_undegraded":"2024-09-12T22:35:33.752085+0000","last_fullsized":"2024-09-12T22:35:33.752085+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:29:37.933109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"60'424","reported_seq":588,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752743+0000","last_change":"2024-09-12T22:31:37.411680+0000","last_active":"2024-09-12T22:35:33.752743+0000","last_peered":"2024-09-12T22:35:33.752743+0000","last_clean":"2024-09-12T22:35:33.752743+0000","last_became_active":"2024-09-12T22:31:37.411168+0000","last_became_peered":"2024-09-12T22:31:37.411168+0000","last_unstale":"2024-09-12T22:35:33.752743+0000","last_undegraded":"2024-09-12T22:35:33.752743+0000","last_fullsized":"2024-09-12T22:35:33.752743+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:27.706282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":13992,"num_write":386,"num_write_kb":38510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"60'70","reported_seq":47,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752499+0000","last_change":"2024-09-12T22:35:20.734652+0000","last_active":"2024-09-12T22:35:33.752499+0000","last_peered":"2024-09-12T22:35:33.752499+0000","last_clean":"2024-09-12T22:35:33.752499+0000","last_became_active":"2024-09-12T22:35:20.734023+0000","last_became_peered":"2024-09-12T22:35:20.734023+0000","last_unstale":"2024-09-12T22:35:33.752499+0000","last_undegraded":"2024-09-12T22:35:33.752499+0000","last_fullsized":"2024-09-12T22:35:33.752499+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:18:27.888573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"60'395","reported_seq":577,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752328+0000","last_change":"2024-09-12T22:31:37.411218+0000","last_active":"2024-09-12T22:35:33.752328+0000","last_peered":"2024-09-12T22:35:33.752328+0000","last_clean":"2024-09-12T22:35:33.752328+0000","last_became_active":"2024-09-12T22:31:37.409666+0000","last_became_peered":"2024-09-12T22:31:37.409666+0000","last_unstale":"2024-09-12T22:35:33.752328+0000","last_undegraded":"2024-09-12T22:35:33.752328+0000","last_fullsized":"2024-09-12T22:35:33.752328+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:45:34.230090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":24198,"num_write":363,"num_write_kb":67056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"60'68","reported_seq":211,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.751638+0000","last_change":"2024-09-12T22:35:20.737076+0000","last_active":"2024-09-12T22:35:33.751638+0000","last_peered":"2024-09-12T22:35:33.751638+0000","last_clean":"2024-09-12T22:35:33.751638+0000","last_became_active":"2024-09-12T22:35:20.736755+0000","last_became_peered":"2024-09-12T22:35:20.736755+0000","last_unstale":"2024-09-12T22:35:33.751638+0000","last_undegraded":"2024-09-12T22:35:33.751638+0000","last_fullsized":"2024-09-12T22:35:33.751638+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:57:36.195186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"60'158","reported_seq":307,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752919+0000","last_change":"2024-09-12T22:35:23.756940+0000","last_active":"2024-09-12T22:35:33.752919+0000","last_peered":"2024-09-12T22:35:33.752919+0000","last_clean":"2024-09-12T22:35:33.752919+0000","last_became_active":"2024-09-12T22:35:23.756663+0000","last_became_peered":"2024-09-12T22:35:23.756663+0000","last_unstale":"2024-09-12T22:35:33.752919+0000","last_undegraded":"2024-09-12T22:35:33.752919+0000","last_fullsized":"2024-09-12T22:35:33.752919+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:08:58.453420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":105,"num_write_kb":4159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"60'426","reported_seq":545,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.753740+0000","last_change":"2024-09-12T22:35:26.735223+0000","last_active":"2024-09-12T22:35:33.753740+0000","last_peered":"2024-09-12T22:35:33.753740+0000","last_clean":"2024-09-12T22:35:33.753740+0000","last_became_active":"2024-09-12T22:35:26.732245+0000","last_became_peered":"2024-09-12T22:35:26.732245+0000","last_unstale":"2024-09-12T22:35:33.753740+0000","last_undegraded":"2024-09-12T22:35:33.753740+0000","last_fullsized":"2024-09-12T22:35:33.753740+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:29:27.860798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":29225,"num_write":390,"num_write_kb":83737,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"60'274","reported_seq":367,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752328+0000","last_change":"2024-09-12T22:35:23.755688+0000","last_active":"2024-09-12T22:35:33.752328+0000","last_peered":"2024-09-12T22:35:33.752328+0000","last_clean":"2024-09-12T22:35:33.752328+0000","last_became_active":"2024-09-12T22:35:23.755282+0000","last_became_peered":"2024-09-12T22:35:23.755282+0000","last_unstale":"2024-09-12T22:35:33.752328+0000","last_undegraded":"2024-09-12T22:35:33.752328+0000","last_fullsized":"2024-09-12T22:35:33.752328+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":274,"log_dups_size":0,"ondisk_log_size":274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:44:38.920273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":213,"num_write_kb":4214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"60'455","reported_seq":607,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.760415+0000","last_change":"2024-09-12T22:35:33.760415+0000","last_active":"2024-09-12T22:35:33.760415+0000","last_peered":"2024-09-12T22:35:33.760415+0000","last_clean":"2024-09-12T22:35:33.760415+0000","last_became_active":"2024-09-12T22:35:33.754299+0000","last_became_peered":"2024-09-12T22:35:33.754299+0000","last_unstale":"2024-09-12T22:35:33.760415+0000","last_undegraded":"2024-09-12T22:35:33.760415+0000","last_fullsized":"2024-09-12T22:35:33.760415+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:26:00.753338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":20747,"num_write":425,"num_write_kb":56005,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"60'423","reported_seq":572,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752919+0000","last_change":"2024-09-12T22:35:23.757047+0000","last_active":"2024-09-12T22:35:33.752919+0000","last_peered":"2024-09-12T22:35:33.752919+0000","last_clean":"2024-09-12T22:35:33.752919+0000","last_became_active":"2024-09-12T22:35:23.756668+0000","last_became_peered":"2024-09-12T22:35:23.756668+0000","last_unstale":"2024-09-12T22:35:33.752919+0000","last_undegraded":"2024-09-12T22:35:33.752919+0000","last_fullsized":"2024-09-12T22:35:33.752919+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:53:35.298628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":371,"num_write_kb":4254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"60'431","reported_seq":598,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.751837+0000","last_change":"2024-09-12T22:31:37.414809+0000","last_active":"2024-09-12T22:35:33.751837+0000","last_peered":"2024-09-12T22:35:33.751837+0000","last_clean":"2024-09-12T22:35:33.751837+0000","last_became_active":"2024-09-12T22:31:37.414492+0000","last_became_peered":"2024-09-12T22:31:37.414492+0000","last_unstale":"2024-09-12T22:35:33.751837+0000","last_undegraded":"2024-09-12T22:35:33.751837+0000","last_fullsized":"2024-09-12T22:35:33.751837+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:50:48.426898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":21479,"num_write":394,"num_write_kb":83756,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"60'70","reported_seq":205,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752868+0000","last_change":"2024-09-12T22:31:36.412068+0000","last_active":"2024-09-12T22:35:33.752868+0000","last_peered":"2024-09-12T22:35:33.752868+0000","last_clean":"2024-09-12T22:35:33.752868+0000","last_became_active":"2024-09-12T22:31:36.411366+0000","last_became_peered":"2024-09-12T22:31:36.411366+0000","last_unstale":"2024-09-12T22:35:33.752868+0000","last_undegraded":"2024-09-12T22:35:33.752868+0000","last_fullsized":"2024-09-12T22:35:33.752868+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:35:51.647051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"60'471","reported_seq":673,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752040+0000","last_change":"2024-09-12T22:31:37.410303+0000","last_active":"2024-09-12T22:35:33.752040+0000","last_peered":"2024-09-12T22:35:33.752040+0000","last_clean":"2024-09-12T22:35:33.752040+0000","last_became_active":"2024-09-12T22:31:37.409607+0000","last_became_peered":"2024-09-12T22:31:37.409607+0000","last_unstale":"2024-09-12T22:35:33.752040+0000","last_undegraded":"2024-09-12T22:35:33.752040+0000","last_fullsized":"2024-09-12T22:35:33.752040+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":471,"log_dups_size":0,"ondisk_log_size":471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:53:42.732654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":37922,"num_write":440,"num_write_kb":138112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"60'209","reported_seq":344,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752205+0000","last_change":"2024-09-12T22:31:36.407974+0000","last_active":"2024-09-12T22:35:33.752205+0000","last_peered":"2024-09-12T22:35:33.752205+0000","last_clean":"2024-09-12T22:35:33.752205+0000","last_became_active":"2024-09-12T22:31:36.406955+0000","last_became_peered":"2024-09-12T22:31:36.406955+0000","last_unstale":"2024-09-12T22:35:33.752205+0000","last_undegraded":"2024-09-12T22:35:33.752205+0000","last_fullsized":"2024-09-12T22:35:33.752205+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:07:34.831264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":8267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"60'437","reported_seq":580,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752455+0000","last_change":"2024-09-12T22:31:37.415285+0000","last_active":"2024-09-12T22:35:33.752455+0000","last_peered":"2024-09-12T22:35:33.752455+0000","last_clean":"2024-09-12T22:35:33.752455+0000","last_became_active":"2024-09-12T22:31:37.414890+0000","last_became_peered":"2024-09-12T22:31:37.414890+0000","last_unstale":"2024-09-12T22:35:33.752455+0000","last_undegraded":"2024-09-12T22:35:33.752455+0000","last_fullsized":"2024-09-12T22:35:33.752455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:38:16.956786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":4587,"num_write":407,"num_write_kb":50860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"60'108","reported_seq":243,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752050+0000","last_change":"2024-09-12T22:31:36.412147+0000","last_active":"2024-09-12T22:35:33.752050+0000","last_peered":"2024-09-12T22:35:33.752050+0000","last_clean":"2024-09-12T22:35:33.752050+0000","last_became_active":"2024-09-12T22:31:36.411382+0000","last_became_peered":"2024-09-12T22:31:36.411382+0000","last_unstale":"2024-09-12T22:35:33.752050+0000","last_undegraded":"2024-09-12T22:35:33.752050+0000","last_fullsized":"2024-09-12T22:35:33.752050+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:54:51.454867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":4129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"60'407","reported_seq":927,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752793+0000","last_change":"2024-09-12T22:35:31.732325+0000","last_active":"2024-09-12T22:35:33.752793+0000","last_peered":"2024-09-12T22:35:33.752793+0000","last_clean":"2024-09-12T22:35:33.752793+0000","last_became_active":"2024-09-12T22:35:31.729817+0000","last_became_peered":"2024-09-12T22:35:31.729817+0000","last_unstale":"2024-09-12T22:35:33.752793+0000","last_undegraded":"2024-09-12T22:35:33.752793+0000","last_fullsized":"2024-09-12T22:35:33.752793+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:21:52.633068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":5615,"num_write":375,"num_write_kb":50827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"60'57","reported_seq":47,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.751984+0000","last_change":"2024-09-12T22:35:20.734244+0000","last_active":"2024-09-12T22:35:33.751984+0000","last_peered":"2024-09-12T22:35:33.751984+0000","last_clean":"2024-09-12T22:35:33.751984+0000","last_became_active":"2024-09-12T22:35:20.733664+0000","last_became_peered":"2024-09-12T22:35:20.733664+0000","last_unstale":"2024-09-12T22:35:33.751984+0000","last_undegraded":"2024-09-12T22:35:33.751984+0000","last_fullsized":"2024-09-12T22:35:33.751984+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:41:11.108676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"60'357","reported_seq":833,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752606+0000","last_change":"2024-09-12T22:35:27.734437+0000","last_active":"2024-09-12T22:35:33.752606+0000","last_peered":"2024-09-12T22:35:33.752606+0000","last_clean":"2024-09-12T22:35:33.752606+0000","last_became_active":"2024-09-12T22:35:27.733274+0000","last_became_peered":"2024-09-12T22:35:27.733274+0000","last_unstale":"2024-09-12T22:35:33.752606+0000","last_undegraded":"2024-09-12T22:35:33.752606+0000","last_fullsized":"2024-09-12T22:35:33.752606+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":357,"log_dups_size":0,"ondisk_log_size":357,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:35:58.820958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":2460,"num_write":324,"num_write_kb":37873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"60'417","reported_seq":501,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.753610+0000","last_change":"2024-09-12T22:35:23.755080+0000","last_active":"2024-09-12T22:35:33.753610+0000","last_peered":"2024-09-12T22:35:33.753610+0000","last_clean":"2024-09-12T22:35:33.753610+0000","last_became_active":"2024-09-12T22:35:23.754683+0000","last_became_peered":"2024-09-12T22:35:23.754683+0000","last_unstale":"2024-09-12T22:35:33.753610+0000","last_undegraded":"2024-09-12T22:35:33.753610+0000","last_fullsized":"2024-09-12T22:35:33.753610+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:34:00.150680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":359,"num_write_kb":4251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"60'416","reported_seq":963,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752396+0000","last_change":"2024-09-12T22:35:30.730978+0000","last_active":"2024-09-12T22:35:33.752396+0000","last_peered":"2024-09-12T22:35:33.752396+0000","last_clean":"2024-09-12T22:35:33.752396+0000","last_became_active":"2024-09-12T22:35:30.729912+0000","last_became_peered":"2024-09-12T22:35:30.729912+0000","last_unstale":"2024-09-12T22:35:33.752396+0000","last_undegraded":"2024-09-12T22:35:33.752396+0000","last_fullsized":"2024-09-12T22:35:33.752396+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:32:25.562466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":42190,"num_write":377,"num_write_kb":87849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":353,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.751924+0000","last_change":"2024-09-12T22:35:20.737092+0000","last_active":"2024-09-12T22:35:33.751924+0000","last_peered":"2024-09-12T22:35:33.751924+0000","last_clean":"2024-09-12T22:35:33.751924+0000","last_became_active":"2024-09-12T22:35:20.736721+0000","last_became_peered":"2024-09-12T22:35:20.736721+0000","last_unstale":"2024-09-12T22:35:33.751924+0000","last_undegraded":"2024-09-12T22:35:33.751924+0000","last_fullsized":"2024-09-12T22:35:33.751924+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:26.229539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:26.229539+0000","last_clean_scrub_stamp":"2024-09-12T22:31:26.229539+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:44:38.486987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":149,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752279+0000","last_change":"2024-09-12T22:31:34.286952+0000","last_active":"2024-09-12T22:35:33.752279+0000","last_peered":"2024-09-12T22:35:33.752279+0000","last_clean":"2024-09-12T22:35:33.752279+0000","last_became_active":"2024-09-12T22:31:32.283661+0000","last_became_peered":"2024-09-12T22:31:32.283661+0000","last_unstale":"2024-09-12T22:35:33.752279+0000","last_undegraded":"2024-09-12T22:35:33.752279+0000","last_fullsized":"2024-09-12T22:35:33.752279+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:21.681390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000621274,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"60'678","reported_seq":828,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752160+0000","last_change":"2024-09-12T22:35:23.755996+0000","last_active":"2024-09-12T22:35:33.752160+0000","last_peered":"2024-09-12T22:35:33.752160+0000","last_clean":"2024-09-12T22:35:33.752160+0000","last_became_active":"2024-09-12T22:35:23.755652+0000","last_became_peered":"2024-09-12T22:35:23.755652+0000","last_unstale":"2024-09-12T22:35:33.752160+0000","last_undegraded":"2024-09-12T22:35:33.752160+0000","last_fullsized":"2024-09-12T22:35:33.752160+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":678,"log_dups_size":0,"ondisk_log_size":678,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:05:19.284888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":608,"num_write_kb":8482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"60'426","reported_seq":976,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752894+0000","last_change":"2024-09-12T22:35:31.732344+0000","last_active":"2024-09-12T22:35:33.752894+0000","last_peered":"2024-09-12T22:35:33.752894+0000","last_clean":"2024-09-12T22:35:33.752894+0000","last_became_active":"2024-09-12T22:35:31.730242+0000","last_became_peered":"2024-09-12T22:35:31.730242+0000","last_unstale":"2024-09-12T22:35:33.752894+0000","last_undegraded":"2024-09-12T22:35:33.752894+0000","last_fullsized":"2024-09-12T22:35:33.752894+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:45:28.259069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":24636,"num_write":392,"num_write_kb":59176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":156,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.751942+0000","last_change":"2024-09-12T22:35:20.735913+0000","last_active":"2024-09-12T22:35:33.751942+0000","last_peered":"2024-09-12T22:35:33.751942+0000","last_clean":"2024-09-12T22:35:33.751942+0000","last_became_active":"2024-09-12T22:35:20.735545+0000","last_became_peered":"2024-09-12T22:35:20.735545+0000","last_unstale":"2024-09-12T22:35:33.751942+0000","last_undegraded":"2024-09-12T22:35:33.751942+0000","last_fullsized":"2024-09-12T22:35:33.751942+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:37:09.150338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037858999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"60'106","reported_seq":284,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.751775+0000","last_change":"2024-09-12T22:31:36.407395+0000","last_active":"2024-09-12T22:35:33.751775+0000","last_peered":"2024-09-12T22:35:33.751775+0000","last_clean":"2024-09-12T22:35:33.751775+0000","last_became_active":"2024-09-12T22:31:36.406770+0000","last_became_peered":"2024-09-12T22:31:36.406770+0000","last_unstale":"2024-09-12T22:35:33.751775+0000","last_undegraded":"2024-09-12T22:35:33.751775+0000","last_fullsized":"2024-09-12T22:35:33.751775+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:49:26.547848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1467429,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":43,"num_read_kb":1462,"num_write":43,"num_write_kb":1462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"60'448","reported_seq":547,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.753927+0000","last_change":"2024-09-12T22:35:27.733064+0000","last_active":"2024-09-12T22:35:33.753927+0000","last_peered":"2024-09-12T22:35:33.753927+0000","last_clean":"2024-09-12T22:35:33.753927+0000","last_became_active":"2024-09-12T22:35:27.729522+0000","last_became_peered":"2024-09-12T22:35:27.729522+0000","last_unstale":"2024-09-12T22:35:33.753927+0000","last_undegraded":"2024-09-12T22:35:33.753927+0000","last_fullsized":"2024-09-12T22:35:33.753927+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:59:06.989020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":10436,"num_write":420,"num_write_kb":67816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":155,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.751845+0000","last_change":"2024-09-12T22:35:20.735217+0000","last_active":"2024-09-12T22:35:33.751845+0000","last_peered":"2024-09-12T22:35:33.751845+0000","last_clean":"2024-09-12T22:35:33.751845+0000","last_became_active":"2024-09-12T22:35:20.734643+0000","last_became_peered":"2024-09-12T22:35:20.734643+0000","last_unstale":"2024-09-12T22:35:33.751845+0000","last_undegraded":"2024-09-12T22:35:33.751845+0000","last_fullsized":"2024-09-12T22:35:33.751845+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:27:17.331198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039540700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"60'292","reported_seq":404,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.761303+0000","last_change":"2024-09-12T22:35:33.761303+0000","last_active":"2024-09-12T22:35:33.761303+0000","last_peered":"2024-09-12T22:35:33.761303+0000","last_clean":"2024-09-12T22:35:33.761303+0000","last_became_active":"2024-09-12T22:35:33.760742+0000","last_became_peered":"2024-09-12T22:35:33.760742+0000","last_unstale":"2024-09-12T22:35:33.761303+0000","last_undegraded":"2024-09-12T22:35:33.761303+0000","last_fullsized":"2024-09-12T22:35:33.761303+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":292,"log_dups_size":0,"ondisk_log_size":292,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:48:04.210933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":235,"num_write_kb":8293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"60'375","reported_seq":912,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752503+0000","last_change":"2024-09-12T22:35:29.740484+0000","last_active":"2024-09-12T22:35:33.752503+0000","last_peered":"2024-09-12T22:35:33.752503+0000","last_clean":"2024-09-12T22:35:33.752503+0000","last_became_active":"2024-09-12T22:35:29.738755+0000","last_became_peered":"2024-09-12T22:35:29.738755+0000","last_unstale":"2024-09-12T22:35:33.752503+0000","last_undegraded":"2024-09-12T22:35:33.752503+0000","last_fullsized":"2024-09-12T22:35:33.752503+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:07:35.007529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":43566,"num_write":354,"num_write_kb":92229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":160,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":150,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752179+0000","last_change":"2024-09-12T22:31:34.286938+0000","last_active":"2024-09-12T22:35:33.752179+0000","last_peered":"2024-09-12T22:35:33.752179+0000","last_clean":"2024-09-12T22:35:33.752179+0000","last_became_active":"2024-09-12T22:31:32.282230+0000","last_became_peered":"2024-09-12T22:31:32.282230+0000","last_unstale":"2024-09-12T22:35:33.752179+0000","last_undegraded":"2024-09-12T22:35:33.752179+0000","last_fullsized":"2024-09-12T22:35:33.752179+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:11:05.988384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000615758,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"60'63","reported_seq":198,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752204+0000","last_change":"2024-09-12T22:31:36.410694+0000","last_active":"2024-09-12T22:35:33.752204+0000","last_peered":"2024-09-12T22:35:33.752204+0000","last_clean":"2024-09-12T22:35:33.752204+0000","last_became_active":"2024-09-12T22:31:36.409816+0000","last_became_peered":"2024-09-12T22:31:36.409816+0000","last_unstale":"2024-09-12T22:35:33.752204+0000","last_undegraded":"2024-09-12T22:35:33.752204+0000","last_fullsized":"2024-09-12T22:35:33.752204+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:40:35.369213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"60'405","reported_seq":929,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752072+0000","last_change":"2024-09-12T22:35:29.736704+0000","last_active":"2024-09-12T22:35:33.752072+0000","last_peered":"2024-09-12T22:35:33.752072+0000","last_clean":"2024-09-12T22:35:33.752072+0000","last_became_active":"2024-09-12T22:35:29.735499+0000","last_became_peered":"2024-09-12T22:35:29.735499+0000","last_unstale":"2024-09-12T22:35:33.752072+0000","last_undegraded":"2024-09-12T22:35:33.752072+0000","last_fullsized":"2024-09-12T22:35:33.752072+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:26:06.464684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":20152,"num_write":366,"num_write_kb":92447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"60'277","reported_seq":361,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.753169+0000","last_change":"2024-09-12T22:35:23.755555+0000","last_active":"2024-09-12T22:35:33.753169+0000","last_peered":"2024-09-12T22:35:33.753169+0000","last_clean":"2024-09-12T22:35:33.753169+0000","last_became_active":"2024-09-12T22:35:23.755237+0000","last_became_peered":"2024-09-12T22:35:23.755237+0000","last_unstale":"2024-09-12T22:35:33.753169+0000","last_undegraded":"2024-09-12T22:35:33.753169+0000","last_fullsized":"2024-09-12T22:35:33.753169+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":277,"log_dups_size":0,"ondisk_log_size":277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:10:23.649578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":216,"num_write_kb":4193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":155,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752207+0000","last_change":"2024-09-12T22:35:20.736644+0000","last_active":"2024-09-12T22:35:33.752207+0000","last_peered":"2024-09-12T22:35:33.752207+0000","last_clean":"2024-09-12T22:35:33.752207+0000","last_became_active":"2024-09-12T22:35:20.736428+0000","last_became_peered":"2024-09-12T22:35:20.736428+0000","last_unstale":"2024-09-12T22:35:33.752207+0000","last_undegraded":"2024-09-12T22:35:33.752207+0000","last_fullsized":"2024-09-12T22:35:33.752207+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:42:12.023369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041972500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"60'355","reported_seq":457,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752866+0000","last_change":"2024-09-12T22:35:25.729864+0000","last_active":"2024-09-12T22:35:33.752866+0000","last_peered":"2024-09-12T22:35:33.752866+0000","last_clean":"2024-09-12T22:35:33.752866+0000","last_became_active":"2024-09-12T22:35:25.727299+0000","last_became_peered":"2024-09-12T22:35:25.727299+0000","last_unstale":"2024-09-12T22:35:33.752866+0000","last_undegraded":"2024-09-12T22:35:33.752866+0000","last_fullsized":"2024-09-12T22:35:33.752866+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":355,"log_dups_size":0,"ondisk_log_size":355,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:56:40.812767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13196,"num_write":321,"num_write_kb":41797,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"60'55","reported_seq":197,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752072+0000","last_change":"2024-09-12T22:35:20.738078+0000","last_active":"2024-09-12T22:35:33.752072+0000","last_peered":"2024-09-12T22:35:33.752072+0000","last_clean":"2024-09-12T22:35:33.752072+0000","last_became_active":"2024-09-12T22:35:20.737705+0000","last_became_peered":"2024-09-12T22:35:20.737705+0000","last_unstale":"2024-09-12T22:35:33.752072+0000","last_undegraded":"2024-09-12T22:35:33.752072+0000","last_fullsized":"2024-09-12T22:35:33.752072+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:04:15.554381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":68,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.754453+0000","last_change":"2024-09-12T22:35:20.738327+0000","last_active":"2024-09-12T22:35:33.754453+0000","last_peered":"2024-09-12T22:35:33.754453+0000","last_clean":"2024-09-12T22:35:33.754453+0000","last_became_active":"2024-09-12T22:35:20.737799+0000","last_became_peered":"2024-09-12T22:35:20.737799+0000","last_unstale":"2024-09-12T22:35:33.754453+0000","last_undegraded":"2024-09-12T22:35:33.754453+0000","last_fullsized":"2024-09-12T22:35:33.754453+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:03:16.381453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"60'385","reported_seq":533,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.761943+0000","last_change":"2024-09-12T22:35:33.761943+0000","last_active":"2024-09-12T22:35:33.761943+0000","last_peered":"2024-09-12T22:35:33.761943+0000","last_clean":"2024-09-12T22:35:33.761943+0000","last_became_active":"2024-09-12T22:35:33.754546+0000","last_became_peered":"2024-09-12T22:35:33.754546+0000","last_unstale":"2024-09-12T22:35:33.761943+0000","last_undegraded":"2024-09-12T22:35:33.761943+0000","last_fullsized":"2024-09-12T22:35:33.761943+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:35:36.478089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":22437,"num_write":347,"num_write_kb":30121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"60'61","reported_seq":204,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752744+0000","last_change":"2024-09-12T22:35:20.738494+0000","last_active":"2024-09-12T22:35:33.752744+0000","last_peered":"2024-09-12T22:35:33.752744+0000","last_clean":"2024-09-12T22:35:33.752744+0000","last_became_active":"2024-09-12T22:35:20.738129+0000","last_became_peered":"2024-09-12T22:35:20.738129+0000","last_unstale":"2024-09-12T22:35:33.752744+0000","last_undegraded":"2024-09-12T22:35:33.752744+0000","last_fullsized":"2024-09-12T22:35:33.752744+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:27:06.987354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":155,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752846+0000","last_change":"2024-09-12T22:35:20.736934+0000","last_active":"2024-09-12T22:35:33.752846+0000","last_peered":"2024-09-12T22:35:33.752846+0000","last_clean":"2024-09-12T22:35:33.752846+0000","last_became_active":"2024-09-12T22:35:20.736628+0000","last_became_peered":"2024-09-12T22:35:20.736628+0000","last_unstale":"2024-09-12T22:35:33.752846+0000","last_undegraded":"2024-09-12T22:35:33.752846+0000","last_fullsized":"2024-09-12T22:35:33.752846+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:04:03.284313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058589999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"60'402","reported_seq":553,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.751534+0000","last_change":"2024-09-12T22:31:37.411152+0000","last_active":"2024-09-12T22:35:33.751534+0000","last_peered":"2024-09-12T22:35:33.751534+0000","last_clean":"2024-09-12T22:35:33.751534+0000","last_became_active":"2024-09-12T22:31:37.410558+0000","last_became_peered":"2024-09-12T22:31:37.410558+0000","last_unstale":"2024-09-12T22:35:33.751534+0000","last_undegraded":"2024-09-12T22:35:33.751534+0000","last_fullsized":"2024-09-12T22:35:33.751534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:14:29.892478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":10169,"num_write":370,"num_write_kb":38130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"61'105","reported_seq":240,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752736+0000","last_change":"2024-09-12T22:31:36.407460+0000","last_active":"2024-09-12T22:35:33.752736+0000","last_peered":"2024-09-12T22:35:33.752736+0000","last_clean":"2024-09-12T22:35:33.752736+0000","last_became_active":"2024-09-12T22:31:36.406729+0000","last_became_peered":"2024-09-12T22:31:36.406729+0000","last_unstale":"2024-09-12T22:35:33.752736+0000","last_undegraded":"2024-09-12T22:35:33.752736+0000","last_fullsized":"2024-09-12T22:35:33.752736+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:27:58.012573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103,"num_write_kb":1085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":155,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752930+0000","last_change":"2024-09-12T22:35:20.737068+0000","last_active":"2024-09-12T22:35:33.752930+0000","last_peered":"2024-09-12T22:35:33.752930+0000","last_clean":"2024-09-12T22:35:33.752930+0000","last_became_active":"2024-09-12T22:35:20.736769+0000","last_became_peered":"2024-09-12T22:35:20.736769+0000","last_unstale":"2024-09-12T22:35:33.752930+0000","last_undegraded":"2024-09-12T22:35:33.752930+0000","last_fullsized":"2024-09-12T22:35:33.752930+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:44:36.675350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000382109,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"60'412","reported_seq":550,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752676+0000","last_change":"2024-09-12T22:35:26.734859+0000","last_active":"2024-09-12T22:35:33.752676+0000","last_peered":"2024-09-12T22:35:33.752676+0000","last_clean":"2024-09-12T22:35:33.752676+0000","last_became_active":"2024-09-12T22:35:26.732923+0000","last_became_peered":"2024-09-12T22:35:26.732923+0000","last_unstale":"2024-09-12T22:35:33.752676+0000","last_undegraded":"2024-09-12T22:35:33.752676+0000","last_fullsized":"2024-09-12T22:35:33.752676+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:48:09.924688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":34504,"num_write":385,"num_write_kb":100438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"60'415","reported_seq":968,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.751983+0000","last_change":"2024-09-12T22:35:24.760883+0000","last_active":"2024-09-12T22:35:33.751983+0000","last_peered":"2024-09-12T22:35:33.751983+0000","last_clean":"2024-09-12T22:35:33.751983+0000","last_became_active":"2024-09-12T22:35:24.759441+0000","last_became_peered":"2024-09-12T22:35:24.759441+0000","last_unstale":"2024-09-12T22:35:33.751983+0000","last_undegraded":"2024-09-12T22:35:33.751983+0000","last_fullsized":"2024-09-12T22:35:33.751983+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:26:21.054210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":37207,"num_write":375,"num_write_kb":84660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"60'221","reported_seq":374,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752760+0000","last_change":"2024-09-12T22:35:23.756290+0000","last_active":"2024-09-12T22:35:33.752760+0000","last_peered":"2024-09-12T22:35:33.752760+0000","last_clean":"2024-09-12T22:35:33.752760+0000","last_became_active":"2024-09-12T22:35:23.755918+0000","last_became_peered":"2024-09-12T22:35:23.755918+0000","last_unstale":"2024-09-12T22:35:33.752760+0000","last_undegraded":"2024-09-12T22:35:33.752760+0000","last_fullsized":"2024-09-12T22:35:33.752760+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":221,"log_dups_size":0,"ondisk_log_size":221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:08:03.811119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":175,"num_write_kb":8282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":8382815,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"60'429","reported_seq":961,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.751615+0000","last_change":"2024-09-12T22:35:25.728726+0000","last_active":"2024-09-12T22:35:33.751615+0000","last_peered":"2024-09-12T22:35:33.751615+0000","last_clean":"2024-09-12T22:35:33.751615+0000","last_became_active":"2024-09-12T22:35:25.726837+0000","last_became_peered":"2024-09-12T22:35:25.726837+0000","last_unstale":"2024-09-12T22:35:33.751615+0000","last_undegraded":"2024-09-12T22:35:33.751615+0000","last_fullsized":"2024-09-12T22:35:33.751615+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:38.996042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":12230,"num_write":389,"num_write_kb":71746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"60'98","reported_seq":217,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.760239+0000","last_change":"2024-09-12T22:35:33.760239+0000","last_active":"2024-09-12T22:35:33.760239+0000","last_peered":"2024-09-12T22:35:33.760239+0000","last_clean":"2024-09-12T22:35:33.760239+0000","last_became_active":"2024-09-12T22:35:33.758640+0000","last_became_peered":"2024-09-12T22:35:33.758640+0000","last_unstale":"2024-09-12T22:35:33.760239+0000","last_undegraded":"2024-09-12T22:35:33.760239+0000","last_fullsized":"2024-09-12T22:35:33.760239+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:24:11.251168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"60'214","reported_seq":349,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752661+0000","last_change":"2024-09-12T22:31:36.411549+0000","last_active":"2024-09-12T22:35:33.752661+0000","last_peered":"2024-09-12T22:35:33.752661+0000","last_clean":"2024-09-12T22:35:33.752661+0000","last_became_active":"2024-09-12T22:31:36.410674+0000","last_became_peered":"2024-09-12T22:31:36.410674+0000","last_unstale":"2024-09-12T22:35:33.752661+0000","last_undegraded":"2024-09-12T22:35:33.752661+0000","last_fullsized":"2024-09-12T22:35:33.752661+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:58:05.676197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":151,"num_write_kb":4168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"60'460","reported_seq":622,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.751479+0000","last_change":"2024-09-12T22:31:37.411254+0000","last_active":"2024-09-12T22:35:33.751479+0000","last_peered":"2024-09-12T22:35:33.751479+0000","last_clean":"2024-09-12T22:35:33.751479+0000","last_became_active":"2024-09-12T22:31:37.410404+0000","last_became_peered":"2024-09-12T22:31:37.410404+0000","last_unstale":"2024-09-12T22:35:33.751479+0000","last_undegraded":"2024-09-12T22:35:33.751479+0000","last_fullsized":"2024-09-12T22:35:33.751479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:42:00.856616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":15059,"num_write":431,"num_write_kb":59615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"60'52","reported_seq":187,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752633+0000","last_change":"2024-09-12T22:31:36.408390+0000","last_active":"2024-09-12T22:35:33.752633+0000","last_peered":"2024-09-12T22:35:33.752633+0000","last_clean":"2024-09-12T22:35:33.752633+0000","last_became_active":"2024-09-12T22:31:36.407062+0000","last_became_peered":"2024-09-12T22:31:36.407062+0000","last_unstale":"2024-09-12T22:35:33.752633+0000","last_undegraded":"2024-09-12T22:35:33.752633+0000","last_fullsized":"2024-09-12T22:35:33.752633+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:09:10.618195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"60'461","reported_seq":1025,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.751489+0000","last_change":"2024-09-12T22:35:28.731581+0000","last_active":"2024-09-12T22:35:33.751489+0000","last_peered":"2024-09-12T22:35:33.751489+0000","last_clean":"2024-09-12T22:35:33.751489+0000","last_became_active":"2024-09-12T22:35:28.730402+0000","last_became_peered":"2024-09-12T22:35:28.730402+0000","last_unstale":"2024-09-12T22:35:33.751489+0000","last_undegraded":"2024-09-12T22:35:33.751489+0000","last_fullsized":"2024-09-12T22:35:33.751489+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:25:37.428224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":17508,"num_write":431,"num_write_kb":67883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":200,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"60'355","reported_seq":479,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752557+0000","last_change":"2024-09-12T22:35:28.732887+0000","last_active":"2024-09-12T22:35:33.752557+0000","last_peered":"2024-09-12T22:35:33.752557+0000","last_clean":"2024-09-12T22:35:33.752557+0000","last_became_active":"2024-09-12T22:35:28.730931+0000","last_became_peered":"2024-09-12T22:35:28.730931+0000","last_unstale":"2024-09-12T22:35:33.752557+0000","last_undegraded":"2024-09-12T22:35:33.752557+0000","last_fullsized":"2024-09-12T22:35:33.752557+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":355,"log_dups_size":0,"ondisk_log_size":355,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:14:12.194559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":44561,"num_write":329,"num_write_kb":26431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"60'548","reported_seq":698,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.751631+0000","last_change":"2024-09-12T22:35:23.756287+0000","last_active":"2024-09-12T22:35:33.751631+0000","last_peered":"2024-09-12T22:35:33.751631+0000","last_clean":"2024-09-12T22:35:33.751631+0000","last_became_active":"2024-09-12T22:35:23.755812+0000","last_became_peered":"2024-09-12T22:35:23.755812+0000","last_unstale":"2024-09-12T22:35:33.751631+0000","last_undegraded":"2024-09-12T22:35:33.751631+0000","last_fullsized":"2024-09-12T22:35:33.751631+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":548,"log_dups_size":0,"ondisk_log_size":548,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:15:13.597427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":488,"num_write_kb":8420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"60'422","reported_seq":667,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752477+0000","last_change":"2024-09-12T22:31:37.411183+0000","last_active":"2024-09-12T22:35:33.752477+0000","last_peered":"2024-09-12T22:35:33.752477+0000","last_clean":"2024-09-12T22:35:33.752477+0000","last_became_active":"2024-09-12T22:31:37.409796+0000","last_became_peered":"2024-09-12T22:31:37.409796+0000","last_unstale":"2024-09-12T22:35:33.752477+0000","last_undegraded":"2024-09-12T22:35:33.752477+0000","last_fullsized":"2024-09-12T22:35:33.752477+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:20:35.779810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":51020,"num_write":397,"num_write_kb":73116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"60'180","reported_seq":315,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.751693+0000","last_change":"2024-09-12T22:31:36.407402+0000","last_active":"2024-09-12T22:35:33.751693+0000","last_peered":"2024-09-12T22:35:33.751693+0000","last_clean":"2024-09-12T22:35:33.751693+0000","last_became_active":"2024-09-12T22:31:36.406681+0000","last_became_peered":"2024-09-12T22:31:36.406681+0000","last_unstale":"2024-09-12T22:35:33.751693+0000","last_undegraded":"2024-09-12T22:35:33.751693+0000","last_fullsized":"2024-09-12T22:35:33.751693+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:39:39.362573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":134,"num_write_kb":4167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"60'420","reported_seq":545,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.753501+0000","last_change":"2024-09-12T22:35:30.734995+0000","last_active":"2024-09-12T22:35:33.753501+0000","last_peered":"2024-09-12T22:35:33.753501+0000","last_clean":"2024-09-12T22:35:33.753501+0000","last_became_active":"2024-09-12T22:35:30.733182+0000","last_became_peered":"2024-09-12T22:35:30.733182+0000","last_unstale":"2024-09-12T22:35:33.753501+0000","last_undegraded":"2024-09-12T22:35:33.753501+0000","last_fullsized":"2024-09-12T22:35:33.753501+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:01:30.939801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":24901,"num_write":369,"num_write_kb":75198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"61'212","reported_seq":324,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.755961+0000","last_change":"2024-09-12T22:35:33.755961+0000","last_active":"2024-09-12T22:35:33.755961+0000","last_peered":"2024-09-12T22:35:33.755961+0000","last_clean":"2024-09-12T22:35:33.755961+0000","last_became_active":"2024-09-12T22:35:33.754931+0000","last_became_peered":"2024-09-12T22:35:33.754931+0000","last_unstale":"2024-09-12T22:35:33.755961+0000","last_undegraded":"2024-09-12T22:35:33.755961+0000","last_fullsized":"2024-09-12T22:35:33.755961+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:12:35.586196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12553847,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":12334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"60'398","reported_seq":539,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.763810+0000","last_change":"2024-09-12T22:35:33.763810+0000","last_active":"2024-09-12T22:35:33.763810+0000","last_peered":"2024-09-12T22:35:33.763810+0000","last_clean":"2024-09-12T22:35:33.763810+0000","last_became_active":"2024-09-12T22:35:33.755497+0000","last_became_peered":"2024-09-12T22:35:33.755497+0000","last_unstale":"2024-09-12T22:35:33.763810+0000","last_undegraded":"2024-09-12T22:35:33.763810+0000","last_fullsized":"2024-09-12T22:35:33.763810+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:19:50.330571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":11429,"num_write":361,"num_write_kb":88082,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"60'54","reported_seq":55,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752689+0000","last_change":"2024-09-12T22:35:20.759946+0000","last_active":"2024-09-12T22:35:33.752689+0000","last_peered":"2024-09-12T22:35:33.752689+0000","last_clean":"2024-09-12T22:35:33.752689+0000","last_became_active":"2024-09-12T22:35:20.733271+0000","last_became_peered":"2024-09-12T22:35:20.733271+0000","last_unstale":"2024-09-12T22:35:33.752689+0000","last_undegraded":"2024-09-12T22:35:33.752689+0000","last_fullsized":"2024-09-12T22:35:33.752689+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:49:02.164294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"60'359","reported_seq":512,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.751925+0000","last_change":"2024-09-12T22:31:37.415365+0000","last_active":"2024-09-12T22:35:33.751925+0000","last_peered":"2024-09-12T22:35:33.751925+0000","last_clean":"2024-09-12T22:35:33.751925+0000","last_became_active":"2024-09-12T22:31:37.413933+0000","last_became_peered":"2024-09-12T22:31:37.413933+0000","last_unstale":"2024-09-12T22:35:33.751925+0000","last_undegraded":"2024-09-12T22:35:33.751925+0000","last_fullsized":"2024-09-12T22:35:33.751925+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:08:07.115355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":12324,"num_write":332,"num_write_kb":46371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"60'186","reported_seq":321,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752637+0000","last_change":"2024-09-12T22:31:36.411665+0000","last_active":"2024-09-12T22:35:33.752637+0000","last_peered":"2024-09-12T22:35:33.752637+0000","last_clean":"2024-09-12T22:35:33.752637+0000","last_became_active":"2024-09-12T22:31:36.410182+0000","last_became_peered":"2024-09-12T22:31:36.410182+0000","last_unstale":"2024-09-12T22:35:33.752637+0000","last_undegraded":"2024-09-12T22:35:33.752637+0000","last_fullsized":"2024-09-12T22:35:33.752637+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:37:20.891838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":4160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"60'401","reported_seq":570,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752012+0000","last_change":"2024-09-12T22:31:37.415172+0000","last_active":"2024-09-12T22:35:33.752012+0000","last_peered":"2024-09-12T22:35:33.752012+0000","last_clean":"2024-09-12T22:35:33.752012+0000","last_became_active":"2024-09-12T22:31:37.414776+0000","last_became_peered":"2024-09-12T22:31:37.414776+0000","last_unstale":"2024-09-12T22:35:33.752012+0000","last_undegraded":"2024-09-12T22:35:33.752012+0000","last_fullsized":"2024-09-12T22:35:33.752012+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:42:32.307876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":24207,"num_write":361,"num_write_kb":50515,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"60'244","reported_seq":365,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.759131+0000","last_change":"2024-09-12T22:35:33.759131+0000","last_active":"2024-09-12T22:35:33.759131+0000","last_peered":"2024-09-12T22:35:33.759131+0000","last_clean":"2024-09-12T22:35:33.759131+0000","last_became_active":"2024-09-12T22:35:33.757550+0000","last_became_peered":"2024-09-12T22:35:33.757550+0000","last_unstale":"2024-09-12T22:35:33.759131+0000","last_undegraded":"2024-09-12T22:35:33.759131+0000","last_fullsized":"2024-09-12T22:35:33.759131+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":244,"log_dups_size":0,"ondisk_log_size":244,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:16:17.926249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":12389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"60'439","reported_seq":927,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.751404+0000","last_change":"2024-09-12T22:35:27.731026+0000","last_active":"2024-09-12T22:35:33.751404+0000","last_peered":"2024-09-12T22:35:33.751404+0000","last_clean":"2024-09-12T22:35:33.751404+0000","last_became_active":"2024-09-12T22:35:27.729827+0000","last_became_peered":"2024-09-12T22:35:27.729827+0000","last_unstale":"2024-09-12T22:35:33.751404+0000","last_undegraded":"2024-09-12T22:35:33.751404+0000","last_fullsized":"2024-09-12T22:35:33.751404+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:21:02.543670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":6311,"num_write":403,"num_write_kb":64161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"60'51","reported_seq":198,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752598+0000","last_change":"2024-09-12T22:35:20.764696+0000","last_active":"2024-09-12T22:35:33.752598+0000","last_peered":"2024-09-12T22:35:33.752598+0000","last_clean":"2024-09-12T22:35:33.752598+0000","last_became_active":"2024-09-12T22:35:20.737444+0000","last_became_peered":"2024-09-12T22:35:20.737444+0000","last_unstale":"2024-09-12T22:35:33.752598+0000","last_undegraded":"2024-09-12T22:35:33.752598+0000","last_fullsized":"2024-09-12T22:35:33.752598+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:14:54.424047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"60'438","reported_seq":624,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.751812+0000","last_change":"2024-09-12T22:31:37.415390+0000","last_active":"2024-09-12T22:35:33.751812+0000","last_peered":"2024-09-12T22:35:33.751812+0000","last_clean":"2024-09-12T22:35:33.751812+0000","last_became_active":"2024-09-12T22:31:37.414781+0000","last_became_peered":"2024-09-12T22:31:37.414781+0000","last_unstale":"2024-09-12T22:35:33.751812+0000","last_undegraded":"2024-09-12T22:35:33.751812+0000","last_fullsized":"2024-09-12T22:35:33.751812+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:42:17.728844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":29290,"num_write":407,"num_write_kb":46733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"60'111","reported_seq":246,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752515+0000","last_change":"2024-09-12T22:31:36.407945+0000","last_active":"2024-09-12T22:35:33.752515+0000","last_peered":"2024-09-12T22:35:33.752515+0000","last_clean":"2024-09-12T22:35:33.752515+0000","last_became_active":"2024-09-12T22:31:36.406959+0000","last_became_peered":"2024-09-12T22:31:36.406959+0000","last_unstale":"2024-09-12T22:35:33.752515+0000","last_undegraded":"2024-09-12T22:35:33.752515+0000","last_fullsized":"2024-09-12T22:35:33.752515+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:26:33.155850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61,"num_write_kb":4126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2747,"num_read_kb":1535780,"num_write":24498,"num_write_kb":4269351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5680,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26636,"ondisk_log_size":26636,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127268954,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":43,"num_read_kb":1462,"num_write":4457,"num_write_kb":127482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":54520159,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":254603264,"data_stored":254537908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4442,"internal_metadata":0},"log_size":6263,"ondisk_log_size":6263,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705719,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":174088,"kb_used_data":84656,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94197752,"statfs":{"total":96636764160,"available":96458498048,"internally_reserved":0,"allocated":86687744,"data_stored":86276944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":66,"seq":283467841541,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":145348,"kb_used_data":87272,"kb_used_omap":5,"kb_used_meta":58042,"kb_avail":94226492,"statfs":{"total":96636764160,"available":96487927808,"internally_reserved":0,"allocated":89366528,"data_stored":88969829,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6037,"internal_metadata":59435115},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738423,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":173528,"kb_used_data":79932,"kb_used_omap":1,"kb_used_meta":93566,"kb_avail":94198312,"statfs":{"total":96636764160,"available":96459071488,"internally_reserved":0,"allocated":81850368,"data_stored":81462353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":95812037},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":88076288,"data_stored":88052173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4442,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81141760,"data_stored":81130756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":85385216,"data_stored":85354979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T22:35:37.001 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T22:35:37.002 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T22:35:37.332 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:35:37.333 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-12T22:35:37.343 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":204,"stamp":"2024-09-12T22:35:36.253310+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":127859341,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":2926,"num_read_kb":1537360,"num_write":29160,"num_write_kb":4400295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5694,"num_bytes_recovered":54520159,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33059,"ondisk_log_size":33059,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":492964,"kb_used_data":251860,"kb_used_omap":9,"kb_used_meta":241014,"kb_avail":282622556,"statfs":{"total":289910292480,"available":289405497344,"internally_reserved":0,"allocated":257904640,"data_stored":256709126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9227,"internal_metadata":246799349},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-1580,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":78,"num_bytes_recovered":-33525457,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.528794"},"pg_stats":[{"pgid":"4.3f","version":"60'422","reported_seq":536,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.753683+0000","last_change":"2024-09-12T22:35:30.733306+0000","last_active":"2024-09-12T22:35:33.753683+0000","last_peered":"2024-09-12T22:35:33.753683+0000","last_clean":"2024-09-12T22:35:33.753683+0000","last_became_active":"2024-09-12T22:35:30.731323+0000","last_became_peered":"2024-09-12T22:35:30.731323+0000","last_unstale":"2024-09-12T22:35:33.753683+0000","last_undegraded":"2024-09-12T22:35:33.753683+0000","last_fullsized":"2024-09-12T22:35:33.753683+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:14:12.288153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":29437,"num_write":385,"num_write_kb":96431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"60'470","reported_seq":631,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.764988+0000","last_change":"2024-09-12T22:35:33.764988+0000","last_active":"2024-09-12T22:35:33.764988+0000","last_peered":"2024-09-12T22:35:33.764988+0000","last_clean":"2024-09-12T22:35:33.764988+0000","last_became_active":"2024-09-12T22:35:33.759906+0000","last_became_peered":"2024-09-12T22:35:33.759906+0000","last_unstale":"2024-09-12T22:35:33.764988+0000","last_undegraded":"2024-09-12T22:35:33.764988+0000","last_fullsized":"2024-09-12T22:35:33.764988+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:06:06.794825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":18334,"num_write":442,"num_write_kb":109282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"60'391","reported_seq":912,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752455+0000","last_change":"2024-09-12T22:35:30.732861+0000","last_active":"2024-09-12T22:35:33.752455+0000","last_peered":"2024-09-12T22:35:33.752455+0000","last_clean":"2024-09-12T22:35:33.752455+0000","last_became_active":"2024-09-12T22:35:30.731086+0000","last_became_peered":"2024-09-12T22:35:30.731086+0000","last_unstale":"2024-09-12T22:35:33.752455+0000","last_undegraded":"2024-09-12T22:35:33.752455+0000","last_fullsized":"2024-09-12T22:35:33.752455+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:56:09.762357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":32771,"num_write":355,"num_write_kb":71120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"60'397","reported_seq":580,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752271+0000","last_change":"2024-09-12T22:31:37.413094+0000","last_active":"2024-09-12T22:35:33.752271+0000","last_peered":"2024-09-12T22:35:33.752271+0000","last_clean":"2024-09-12T22:35:33.752271+0000","last_became_active":"2024-09-12T22:31:37.412746+0000","last_became_peered":"2024-09-12T22:31:37.412746+0000","last_unstale":"2024-09-12T22:35:33.752271+0000","last_undegraded":"2024-09-12T22:35:33.752271+0000","last_fullsized":"2024-09-12T22:35:33.752271+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:32:14.415120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":28544,"num_write":368,"num_write_kb":83737,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"60'458","reported_seq":591,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752878+0000","last_change":"2024-09-12T22:35:24.759019+0000","last_active":"2024-09-12T22:35:33.752878+0000","last_peered":"2024-09-12T22:35:33.752878+0000","last_clean":"2024-09-12T22:35:33.752878+0000","last_became_active":"2024-09-12T22:35:24.756373+0000","last_became_peered":"2024-09-12T22:35:24.756373+0000","last_unstale":"2024-09-12T22:35:33.752878+0000","last_undegraded":"2024-09-12T22:35:33.752878+0000","last_fullsized":"2024-09-12T22:35:33.752878+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":458,"log_dups_size":0,"ondisk_log_size":458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:49:34.350038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":28467,"num_write":430,"num_write_kb":81329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":198,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"60'381","reported_seq":515,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.751680+0000","last_change":"2024-09-12T22:31:37.409177+0000","last_active":"2024-09-12T22:35:33.751680+0000","last_peered":"2024-09-12T22:35:33.751680+0000","last_clean":"2024-09-12T22:35:33.751680+0000","last_became_active":"2024-09-12T22:31:37.408811+0000","last_became_peered":"2024-09-12T22:31:37.408811+0000","last_unstale":"2024-09-12T22:35:33.751680+0000","last_undegraded":"2024-09-12T22:35:33.751680+0000","last_fullsized":"2024-09-12T22:35:33.751680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:17:21.695079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":60,"num_write":353,"num_write_kb":58419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"60'439","reported_seq":618,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.751757+0000","last_change":"2024-09-12T22:31:37.413023+0000","last_active":"2024-09-12T22:35:33.751757+0000","last_peered":"2024-09-12T22:35:33.751757+0000","last_clean":"2024-09-12T22:35:33.751757+0000","last_became_active":"2024-09-12T22:31:37.412691+0000","last_became_peered":"2024-09-12T22:31:37.412691+0000","last_unstale":"2024-09-12T22:35:33.751757+0000","last_undegraded":"2024-09-12T22:35:33.751757+0000","last_fullsized":"2024-09-12T22:35:33.751757+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:02:36.454134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":27053,"num_write":405,"num_write_kb":79743,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"60'384","reported_seq":589,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.751463+0000","last_change":"2024-09-12T22:31:37.411074+0000","last_active":"2024-09-12T22:35:33.751463+0000","last_peered":"2024-09-12T22:35:33.751463+0000","last_clean":"2024-09-12T22:35:33.751463+0000","last_became_active":"2024-09-12T22:31:37.410633+0000","last_became_peered":"2024-09-12T22:31:37.410633+0000","last_unstale":"2024-09-12T22:35:33.751463+0000","last_undegraded":"2024-09-12T22:35:33.751463+0000","last_fullsized":"2024-09-12T22:35:33.751463+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:39:20.383152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":44358,"num_write":338,"num_write_kb":67411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"60'418","reported_seq":1002,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752278+0000","last_change":"2024-09-12T22:35:28.732156+0000","last_active":"2024-09-12T22:35:33.752278+0000","last_peered":"2024-09-12T22:35:33.752278+0000","last_clean":"2024-09-12T22:35:33.752278+0000","last_became_active":"2024-09-12T22:35:28.731002+0000","last_became_peered":"2024-09-12T22:35:28.731002+0000","last_unstale":"2024-09-12T22:35:33.752278+0000","last_undegraded":"2024-09-12T22:35:33.752278+0000","last_fullsized":"2024-09-12T22:35:33.752278+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:52:19.679715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":48711,"num_write":384,"num_write_kb":63228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"60'406","reported_seq":520,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.753178+0000","last_change":"2024-09-12T22:35:27.732831+0000","last_active":"2024-09-12T22:35:33.753178+0000","last_peered":"2024-09-12T22:35:33.753178+0000","last_clean":"2024-09-12T22:35:33.753178+0000","last_became_active":"2024-09-12T22:35:27.729480+0000","last_became_peered":"2024-09-12T22:35:27.729480+0000","last_unstale":"2024-09-12T22:35:33.753178+0000","last_undegraded":"2024-09-12T22:35:33.753178+0000","last_fullsized":"2024-09-12T22:35:33.753178+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:38:13.307443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":21851,"num_write":367,"num_write_kb":79913,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"60'338","reported_seq":479,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752488+0000","last_change":"2024-09-12T22:31:37.414469+0000","last_active":"2024-09-12T22:35:33.752488+0000","last_peered":"2024-09-12T22:35:33.752488+0000","last_clean":"2024-09-12T22:35:33.752488+0000","last_became_active":"2024-09-12T22:31:37.414165+0000","last_became_peered":"2024-09-12T22:31:37.414165+0000","last_unstale":"2024-09-12T22:35:33.752488+0000","last_undegraded":"2024-09-12T22:35:33.752488+0000","last_fullsized":"2024-09-12T22:35:33.752488+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":338,"log_dups_size":0,"ondisk_log_size":338,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:25:38.148636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":4053,"num_write":316,"num_write_kb":21475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"60'359","reported_seq":495,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.764173+0000","last_change":"2024-09-12T22:35:33.764173+0000","last_active":"2024-09-12T22:35:33.764173+0000","last_peered":"2024-09-12T22:35:33.764173+0000","last_clean":"2024-09-12T22:35:33.764173+0000","last_became_active":"2024-09-12T22:35:33.760739+0000","last_became_peered":"2024-09-12T22:35:33.760739+0000","last_unstale":"2024-09-12T22:35:33.764173+0000","last_undegraded":"2024-09-12T22:35:33.764173+0000","last_fullsized":"2024-09-12T22:35:33.764173+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:58:38.596224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":6688,"num_write":330,"num_write_kb":38146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"60'402","reported_seq":537,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.761962+0000","last_change":"2024-09-12T22:35:33.761962+0000","last_active":"2024-09-12T22:35:33.761962+0000","last_peered":"2024-09-12T22:35:33.761962+0000","last_clean":"2024-09-12T22:35:33.761962+0000","last_became_active":"2024-09-12T22:35:33.754938+0000","last_became_peered":"2024-09-12T22:35:33.754938+0000","last_unstale":"2024-09-12T22:35:33.761962+0000","last_undegraded":"2024-09-12T22:35:33.761962+0000","last_fullsized":"2024-09-12T22:35:33.761962+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:01:27.181524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":16384,"num_write":363,"num_write_kb":62556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"60'409","reported_seq":935,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.751724+0000","last_change":"2024-09-12T22:35:29.737252+0000","last_active":"2024-09-12T22:35:33.751724+0000","last_peered":"2024-09-12T22:35:33.751724+0000","last_clean":"2024-09-12T22:35:33.751724+0000","last_became_active":"2024-09-12T22:35:29.735835+0000","last_became_peered":"2024-09-12T22:35:29.735835+0000","last_unstale":"2024-09-12T22:35:33.751724+0000","last_undegraded":"2024-09-12T22:35:33.751724+0000","last_fullsized":"2024-09-12T22:35:33.751724+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:32:12.014289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":13943,"num_write":382,"num_write_kb":54682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"60'412","reported_seq":948,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.751812+0000","last_change":"2024-09-12T22:35:28.731566+0000","last_active":"2024-09-12T22:35:33.751812+0000","last_peered":"2024-09-12T22:35:33.751812+0000","last_clean":"2024-09-12T22:35:33.751812+0000","last_became_active":"2024-09-12T22:35:28.730413+0000","last_became_peered":"2024-09-12T22:35:28.730413+0000","last_unstale":"2024-09-12T22:35:33.751812+0000","last_undegraded":"2024-09-12T22:35:33.751812+0000","last_fullsized":"2024-09-12T22:35:33.751812+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:47:47.029549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":19700,"num_write":377,"num_write_kb":67929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"60'404","reported_seq":537,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.751489+0000","last_change":"2024-09-12T22:31:37.411006+0000","last_active":"2024-09-12T22:35:33.751489+0000","last_peered":"2024-09-12T22:35:33.751489+0000","last_clean":"2024-09-12T22:35:33.751489+0000","last_became_active":"2024-09-12T22:31:37.410557+0000","last_became_peered":"2024-09-12T22:31:37.410557+0000","last_unstale":"2024-09-12T22:35:33.751489+0000","last_undegraded":"2024-09-12T22:35:33.751489+0000","last_fullsized":"2024-09-12T22:35:33.751489+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:08:21.709770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":368,"num_write_kb":25652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"60'405","reported_seq":940,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752667+0000","last_change":"2024-09-12T22:35:31.732234+0000","last_active":"2024-09-12T22:35:33.752667+0000","last_peered":"2024-09-12T22:35:33.752667+0000","last_clean":"2024-09-12T22:35:33.752667+0000","last_became_active":"2024-09-12T22:35:31.730883+0000","last_became_peered":"2024-09-12T22:35:31.730883+0000","last_unstale":"2024-09-12T22:35:33.752667+0000","last_undegraded":"2024-09-12T22:35:33.752667+0000","last_fullsized":"2024-09-12T22:35:33.752667+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:50:20.904744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":18251,"num_write":369,"num_write_kb":34203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"60'406","reported_seq":579,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.760018+0000","last_change":"2024-09-12T22:35:33.760018+0000","last_active":"2024-09-12T22:35:33.760018+0000","last_peered":"2024-09-12T22:35:33.760018+0000","last_clean":"2024-09-12T22:35:33.760018+0000","last_became_active":"2024-09-12T22:35:33.754915+0000","last_became_peered":"2024-09-12T22:35:33.754915+0000","last_unstale":"2024-09-12T22:35:33.760018+0000","last_undegraded":"2024-09-12T22:35:33.760018+0000","last_fullsized":"2024-09-12T22:35:33.760018+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:36:51.477439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":45843,"num_write":367,"num_write_kb":59097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"60'413","reported_seq":932,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752397+0000","last_change":"2024-09-12T22:35:31.731988+0000","last_active":"2024-09-12T22:35:33.752397+0000","last_peered":"2024-09-12T22:35:33.752397+0000","last_clean":"2024-09-12T22:35:33.752397+0000","last_became_active":"2024-09-12T22:35:31.730742+0000","last_became_peered":"2024-09-12T22:35:31.730742+0000","last_unstale":"2024-09-12T22:35:33.752397+0000","last_undegraded":"2024-09-12T22:35:33.752397+0000","last_fullsized":"2024-09-12T22:35:33.752397+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:33:38.616668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":20855,"num_write":371,"num_write_kb":71095,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"60'441","reported_seq":621,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752348+0000","last_change":"2024-09-12T22:31:37.414235+0000","last_active":"2024-09-12T22:35:33.752348+0000","last_peered":"2024-09-12T22:35:33.752348+0000","last_clean":"2024-09-12T22:35:33.752348+0000","last_became_active":"2024-09-12T22:31:37.413786+0000","last_became_peered":"2024-09-12T22:31:37.413786+0000","last_unstale":"2024-09-12T22:35:33.752348+0000","last_undegraded":"2024-09-12T22:35:33.752348+0000","last_fullsized":"2024-09-12T22:35:33.752348+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:21:11.866973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":23954,"num_write":419,"num_write_kb":72528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"60'414","reported_seq":622,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752077+0000","last_change":"2024-09-12T22:31:37.415382+0000","last_active":"2024-09-12T22:35:33.752077+0000","last_peered":"2024-09-12T22:35:33.752077+0000","last_clean":"2024-09-12T22:35:33.752077+0000","last_became_active":"2024-09-12T22:31:37.414319+0000","last_became_peered":"2024-09-12T22:31:37.414319+0000","last_unstale":"2024-09-12T22:35:33.752077+0000","last_undegraded":"2024-09-12T22:35:33.752077+0000","last_fullsized":"2024-09-12T22:35:33.752077+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:26:25.578693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":44129,"num_write":387,"num_write_kb":104899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"60'444","reported_seq":551,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.753335+0000","last_change":"2024-09-12T22:35:25.729851+0000","last_active":"2024-09-12T22:35:33.753335+0000","last_peered":"2024-09-12T22:35:33.753335+0000","last_clean":"2024-09-12T22:35:33.753335+0000","last_became_active":"2024-09-12T22:35:25.727269+0000","last_became_peered":"2024-09-12T22:35:25.727269+0000","last_unstale":"2024-09-12T22:35:33.753335+0000","last_undegraded":"2024-09-12T22:35:33.753335+0000","last_fullsized":"2024-09-12T22:35:33.753335+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:30:26.718280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":17411,"num_write":407,"num_write_kb":87850,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"60'421","reported_seq":646,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.751298+0000","last_change":"2024-09-12T22:31:37.410364+0000","last_active":"2024-09-12T22:35:33.751298+0000","last_peered":"2024-09-12T22:35:33.751298+0000","last_clean":"2024-09-12T22:35:33.751298+0000","last_became_active":"2024-09-12T22:31:37.409951+0000","last_became_peered":"2024-09-12T22:31:37.409951+0000","last_unstale":"2024-09-12T22:35:33.751298+0000","last_undegraded":"2024-09-12T22:35:33.751298+0000","last_fullsized":"2024-09-12T22:35:33.751298+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:39:17.785755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":44074,"num_write":389,"num_write_kb":44104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"60'459","reported_seq":614,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.760584+0000","last_change":"2024-09-12T22:35:33.760584+0000","last_active":"2024-09-12T22:35:33.760584+0000","last_peered":"2024-09-12T22:35:33.760584+0000","last_clean":"2024-09-12T22:35:33.760584+0000","last_became_active":"2024-09-12T22:35:33.754576+0000","last_became_peered":"2024-09-12T22:35:33.754576+0000","last_unstale":"2024-09-12T22:35:33.760584+0000","last_undegraded":"2024-09-12T22:35:33.760584+0000","last_fullsized":"2024-09-12T22:35:33.760584+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:14:34.676855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":28605,"num_write":432,"num_write_kb":100377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"60'419","reported_seq":516,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752435+0000","last_change":"2024-09-12T22:35:29.738235+0000","last_active":"2024-09-12T22:35:33.752435+0000","last_peered":"2024-09-12T22:35:33.752435+0000","last_clean":"2024-09-12T22:35:33.752435+0000","last_became_active":"2024-09-12T22:35:29.735450+0000","last_became_peered":"2024-09-12T22:35:29.735450+0000","last_unstale":"2024-09-12T22:35:33.752435+0000","last_undegraded":"2024-09-12T22:35:33.752435+0000","last_fullsized":"2024-09-12T22:35:33.752435+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:24.582229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":16852,"num_write":404,"num_write_kb":34622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"60'494","reported_seq":710,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752455+0000","last_change":"2024-09-12T22:31:37.411880+0000","last_active":"2024-09-12T22:35:33.752455+0000","last_peered":"2024-09-12T22:35:33.752455+0000","last_clean":"2024-09-12T22:35:33.752455+0000","last_became_active":"2024-09-12T22:31:37.410563+0000","last_became_peered":"2024-09-12T22:31:37.410563+0000","last_unstale":"2024-09-12T22:35:33.752455+0000","last_undegraded":"2024-09-12T22:35:33.752455+0000","last_fullsized":"2024-09-12T22:35:33.752455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":494,"log_dups_size":0,"ondisk_log_size":494,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:47:52.560533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":35239,"num_write":450,"num_write_kb":76898,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"60'401","reported_seq":923,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752642+0000","last_change":"2024-09-12T22:35:30.732843+0000","last_active":"2024-09-12T22:35:33.752642+0000","last_peered":"2024-09-12T22:35:33.752642+0000","last_clean":"2024-09-12T22:35:33.752642+0000","last_became_active":"2024-09-12T22:35:30.731155+0000","last_became_peered":"2024-09-12T22:35:30.731155+0000","last_unstale":"2024-09-12T22:35:33.752642+0000","last_undegraded":"2024-09-12T22:35:33.752642+0000","last_fullsized":"2024-09-12T22:35:33.752642+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:54:33.926426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":10993,"num_write":369,"num_write_kb":55171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"60'390","reported_seq":538,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.763890+0000","last_change":"2024-09-12T22:35:33.763890+0000","last_active":"2024-09-12T22:35:33.763890+0000","last_peered":"2024-09-12T22:35:33.763890+0000","last_clean":"2024-09-12T22:35:33.763890+0000","last_became_active":"2024-09-12T22:35:33.756108+0000","last_became_peered":"2024-09-12T22:35:33.756108+0000","last_unstale":"2024-09-12T22:35:33.763890+0000","last_undegraded":"2024-09-12T22:35:33.763890+0000","last_fullsized":"2024-09-12T22:35:33.763890+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:53:03.258457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":18588,"num_write":360,"num_write_kb":59307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"60'429","reported_seq":1007,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.751986+0000","last_change":"2024-09-12T22:35:23.756871+0000","last_active":"2024-09-12T22:35:33.751986+0000","last_peered":"2024-09-12T22:35:33.751986+0000","last_clean":"2024-09-12T22:35:33.751986+0000","last_became_active":"2024-09-12T22:35:23.755618+0000","last_became_peered":"2024-09-12T22:35:23.755618+0000","last_unstale":"2024-09-12T22:35:33.751986+0000","last_undegraded":"2024-09-12T22:35:33.751986+0000","last_fullsized":"2024-09-12T22:35:33.751986+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:21:46.470290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":32541,"num_write":398,"num_write_kb":76609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"60'458","reported_seq":575,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.753011+0000","last_change":"2024-09-12T22:35:28.732538+0000","last_active":"2024-09-12T22:35:33.753011+0000","last_peered":"2024-09-12T22:35:33.753011+0000","last_clean":"2024-09-12T22:35:33.753011+0000","last_became_active":"2024-09-12T22:35:28.730337+0000","last_became_peered":"2024-09-12T22:35:28.730337+0000","last_unstale":"2024-09-12T22:35:33.753011+0000","last_undegraded":"2024-09-12T22:35:33.753011+0000","last_fullsized":"2024-09-12T22:35:33.753011+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":458,"log_dups_size":0,"ondisk_log_size":458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:55:45.185896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":16425,"num_write":413,"num_write_kb":47110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"60'432","reported_seq":982,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.751401+0000","last_change":"2024-09-12T22:35:26.732243+0000","last_active":"2024-09-12T22:35:33.751401+0000","last_peered":"2024-09-12T22:35:33.751401+0000","last_clean":"2024-09-12T22:35:33.751401+0000","last_became_active":"2024-09-12T22:35:26.731135+0000","last_became_peered":"2024-09-12T22:35:26.731135+0000","last_unstale":"2024-09-12T22:35:33.751401+0000","last_undegraded":"2024-09-12T22:35:33.751401+0000","last_fullsized":"2024-09-12T22:35:33.751401+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:34:06.084746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":21090,"num_write":393,"num_write_kb":67477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"60'458","reported_seq":636,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.751620+0000","last_change":"2024-09-12T22:31:37.415190+0000","last_active":"2024-09-12T22:35:33.751620+0000","last_peered":"2024-09-12T22:35:33.751620+0000","last_clean":"2024-09-12T22:35:33.751620+0000","last_became_active":"2024-09-12T22:31:37.414265+0000","last_became_peered":"2024-09-12T22:31:37.414265+0000","last_unstale":"2024-09-12T22:35:33.751620+0000","last_undegraded":"2024-09-12T22:35:33.751620+0000","last_fullsized":"2024-09-12T22:35:33.751620+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":458,"log_dups_size":0,"ondisk_log_size":458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:07:02.173590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":37395,"num_write":421,"num_write_kb":73250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"60'411","reported_seq":583,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.764162+0000","last_change":"2024-09-12T22:35:33.764162+0000","last_active":"2024-09-12T22:35:33.764162+0000","last_peered":"2024-09-12T22:35:33.764162+0000","last_clean":"2024-09-12T22:35:33.764162+0000","last_became_active":"2024-09-12T22:35:33.761121+0000","last_became_peered":"2024-09-12T22:35:33.761121+0000","last_unstale":"2024-09-12T22:35:33.764162+0000","last_undegraded":"2024-09-12T22:35:33.764162+0000","last_fullsized":"2024-09-12T22:35:33.764162+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:03:51.948278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":36400,"num_write":371,"num_write_kb":92142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"60'546","reported_seq":681,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752153+0000","last_change":"2024-09-12T22:31:36.412082+0000","last_active":"2024-09-12T22:35:33.752153+0000","last_peered":"2024-09-12T22:35:33.752153+0000","last_clean":"2024-09-12T22:35:33.752153+0000","last_became_active":"2024-09-12T22:31:36.410871+0000","last_became_peered":"2024-09-12T22:31:36.410871+0000","last_unstale":"2024-09-12T22:35:33.752153+0000","last_undegraded":"2024-09-12T22:35:33.752153+0000","last_fullsized":"2024-09-12T22:35:33.752153+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":546,"log_dups_size":0,"ondisk_log_size":546,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:30:49.127253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":495,"num_write_kb":8426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"60'427","reported_seq":598,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.753291+0000","last_change":"2024-09-12T22:35:31.732681+0000","last_active":"2024-09-12T22:35:33.753291+0000","last_peered":"2024-09-12T22:35:33.753291+0000","last_clean":"2024-09-12T22:35:33.753291+0000","last_became_active":"2024-09-12T22:35:31.730237+0000","last_became_peered":"2024-09-12T22:35:31.730237+0000","last_unstale":"2024-09-12T22:35:33.753291+0000","last_undegraded":"2024-09-12T22:35:33.753291+0000","last_fullsized":"2024-09-12T22:35:33.753291+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:51:57.088855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":59223,"num_write":394,"num_write_kb":80309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":175,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"60'55","reported_seq":190,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752085+0000","last_change":"2024-09-12T22:31:36.408563+0000","last_active":"2024-09-12T22:35:33.752085+0000","last_peered":"2024-09-12T22:35:33.752085+0000","last_clean":"2024-09-12T22:35:33.752085+0000","last_became_active":"2024-09-12T22:31:36.407447+0000","last_became_peered":"2024-09-12T22:31:36.407447+0000","last_unstale":"2024-09-12T22:35:33.752085+0000","last_undegraded":"2024-09-12T22:35:33.752085+0000","last_fullsized":"2024-09-12T22:35:33.752085+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:29:37.933109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"60'424","reported_seq":588,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752743+0000","last_change":"2024-09-12T22:31:37.411680+0000","last_active":"2024-09-12T22:35:33.752743+0000","last_peered":"2024-09-12T22:35:33.752743+0000","last_clean":"2024-09-12T22:35:33.752743+0000","last_became_active":"2024-09-12T22:31:37.411168+0000","last_became_peered":"2024-09-12T22:31:37.411168+0000","last_unstale":"2024-09-12T22:35:33.752743+0000","last_undegraded":"2024-09-12T22:35:33.752743+0000","last_fullsized":"2024-09-12T22:35:33.752743+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:27.706282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":13992,"num_write":386,"num_write_kb":38510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"60'70","reported_seq":47,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752499+0000","last_change":"2024-09-12T22:35:20.734652+0000","last_active":"2024-09-12T22:35:33.752499+0000","last_peered":"2024-09-12T22:35:33.752499+0000","last_clean":"2024-09-12T22:35:33.752499+0000","last_became_active":"2024-09-12T22:35:20.734023+0000","last_became_peered":"2024-09-12T22:35:20.734023+0000","last_unstale":"2024-09-12T22:35:33.752499+0000","last_undegraded":"2024-09-12T22:35:33.752499+0000","last_fullsized":"2024-09-12T22:35:33.752499+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:18:27.888573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"60'395","reported_seq":577,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752328+0000","last_change":"2024-09-12T22:31:37.411218+0000","last_active":"2024-09-12T22:35:33.752328+0000","last_peered":"2024-09-12T22:35:33.752328+0000","last_clean":"2024-09-12T22:35:33.752328+0000","last_became_active":"2024-09-12T22:31:37.409666+0000","last_became_peered":"2024-09-12T22:31:37.409666+0000","last_unstale":"2024-09-12T22:35:33.752328+0000","last_undegraded":"2024-09-12T22:35:33.752328+0000","last_fullsized":"2024-09-12T22:35:33.752328+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:45:34.230090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":24198,"num_write":363,"num_write_kb":67056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"60'68","reported_seq":211,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.751638+0000","last_change":"2024-09-12T22:35:20.737076+0000","last_active":"2024-09-12T22:35:33.751638+0000","last_peered":"2024-09-12T22:35:33.751638+0000","last_clean":"2024-09-12T22:35:33.751638+0000","last_became_active":"2024-09-12T22:35:20.736755+0000","last_became_peered":"2024-09-12T22:35:20.736755+0000","last_unstale":"2024-09-12T22:35:33.751638+0000","last_undegraded":"2024-09-12T22:35:33.751638+0000","last_fullsized":"2024-09-12T22:35:33.751638+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:57:36.195186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"60'158","reported_seq":307,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752919+0000","last_change":"2024-09-12T22:35:23.756940+0000","last_active":"2024-09-12T22:35:33.752919+0000","last_peered":"2024-09-12T22:35:33.752919+0000","last_clean":"2024-09-12T22:35:33.752919+0000","last_became_active":"2024-09-12T22:35:23.756663+0000","last_became_peered":"2024-09-12T22:35:23.756663+0000","last_unstale":"2024-09-12T22:35:33.752919+0000","last_undegraded":"2024-09-12T22:35:33.752919+0000","last_fullsized":"2024-09-12T22:35:33.752919+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:08:58.453420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":105,"num_write_kb":4159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"60'426","reported_seq":545,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.753740+0000","last_change":"2024-09-12T22:35:26.735223+0000","last_active":"2024-09-12T22:35:33.753740+0000","last_peered":"2024-09-12T22:35:33.753740+0000","last_clean":"2024-09-12T22:35:33.753740+0000","last_became_active":"2024-09-12T22:35:26.732245+0000","last_became_peered":"2024-09-12T22:35:26.732245+0000","last_unstale":"2024-09-12T22:35:33.753740+0000","last_undegraded":"2024-09-12T22:35:33.753740+0000","last_fullsized":"2024-09-12T22:35:33.753740+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:29:27.860798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":29225,"num_write":390,"num_write_kb":83737,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"60'274","reported_seq":367,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752328+0000","last_change":"2024-09-12T22:35:23.755688+0000","last_active":"2024-09-12T22:35:33.752328+0000","last_peered":"2024-09-12T22:35:33.752328+0000","last_clean":"2024-09-12T22:35:33.752328+0000","last_became_active":"2024-09-12T22:35:23.755282+0000","last_became_peered":"2024-09-12T22:35:23.755282+0000","last_unstale":"2024-09-12T22:35:33.752328+0000","last_undegraded":"2024-09-12T22:35:33.752328+0000","last_fullsized":"2024-09-12T22:35:33.752328+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":274,"log_dups_size":0,"ondisk_log_size":274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:44:38.920273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":213,"num_write_kb":4214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"60'455","reported_seq":607,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.760415+0000","last_change":"2024-09-12T22:35:33.760415+0000","last_active":"2024-09-12T22:35:33.760415+0000","last_peered":"2024-09-12T22:35:33.760415+0000","last_clean":"2024-09-12T22:35:33.760415+0000","last_became_active":"2024-09-12T22:35:33.754299+0000","last_became_peered":"2024-09-12T22:35:33.754299+0000","last_unstale":"2024-09-12T22:35:33.760415+0000","last_undegraded":"2024-09-12T22:35:33.760415+0000","last_fullsized":"2024-09-12T22:35:33.760415+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:26:00.753338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":20747,"num_write":425,"num_write_kb":56005,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"60'423","reported_seq":572,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752919+0000","last_change":"2024-09-12T22:35:23.757047+0000","last_active":"2024-09-12T22:35:33.752919+0000","last_peered":"2024-09-12T22:35:33.752919+0000","last_clean":"2024-09-12T22:35:33.752919+0000","last_became_active":"2024-09-12T22:35:23.756668+0000","last_became_peered":"2024-09-12T22:35:23.756668+0000","last_unstale":"2024-09-12T22:35:33.752919+0000","last_undegraded":"2024-09-12T22:35:33.752919+0000","last_fullsized":"2024-09-12T22:35:33.752919+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:53:35.298628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":371,"num_write_kb":4254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"60'431","reported_seq":598,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.751837+0000","last_change":"2024-09-12T22:31:37.414809+0000","last_active":"2024-09-12T22:35:33.751837+0000","last_peered":"2024-09-12T22:35:33.751837+0000","last_clean":"2024-09-12T22:35:33.751837+0000","last_became_active":"2024-09-12T22:31:37.414492+0000","last_became_peered":"2024-09-12T22:31:37.414492+0000","last_unstale":"2024-09-12T22:35:33.751837+0000","last_undegraded":"2024-09-12T22:35:33.751837+0000","last_fullsized":"2024-09-12T22:35:33.751837+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:50:48.426898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":21479,"num_write":394,"num_write_kb":83756,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"60'70","reported_seq":205,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752868+0000","last_change":"2024-09-12T22:31:36.412068+0000","last_active":"2024-09-12T22:35:33.752868+0000","last_peered":"2024-09-12T22:35:33.752868+0000","last_clean":"2024-09-12T22:35:33.752868+0000","last_became_active":"2024-09-12T22:31:36.411366+0000","last_became_peered":"2024-09-12T22:31:36.411366+0000","last_unstale":"2024-09-12T22:35:33.752868+0000","last_undegraded":"2024-09-12T22:35:33.752868+0000","last_fullsized":"2024-09-12T22:35:33.752868+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:35:51.647051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"60'471","reported_seq":673,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752040+0000","last_change":"2024-09-12T22:31:37.410303+0000","last_active":"2024-09-12T22:35:33.752040+0000","last_peered":"2024-09-12T22:35:33.752040+0000","last_clean":"2024-09-12T22:35:33.752040+0000","last_became_active":"2024-09-12T22:31:37.409607+0000","last_became_peered":"2024-09-12T22:31:37.409607+0000","last_unstale":"2024-09-12T22:35:33.752040+0000","last_undegraded":"2024-09-12T22:35:33.752040+0000","last_fullsized":"2024-09-12T22:35:33.752040+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":471,"log_dups_size":0,"ondisk_log_size":471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:53:42.732654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":37922,"num_write":440,"num_write_kb":138112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"60'209","reported_seq":344,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752205+0000","last_change":"2024-09-12T22:31:36.407974+0000","last_active":"2024-09-12T22:35:33.752205+0000","last_peered":"2024-09-12T22:35:33.752205+0000","last_clean":"2024-09-12T22:35:33.752205+0000","last_became_active":"2024-09-12T22:31:36.406955+0000","last_became_peered":"2024-09-12T22:31:36.406955+0000","last_unstale":"2024-09-12T22:35:33.752205+0000","last_undegraded":"2024-09-12T22:35:33.752205+0000","last_fullsized":"2024-09-12T22:35:33.752205+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:07:34.831264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":8267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"60'437","reported_seq":580,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752455+0000","last_change":"2024-09-12T22:31:37.415285+0000","last_active":"2024-09-12T22:35:33.752455+0000","last_peered":"2024-09-12T22:35:33.752455+0000","last_clean":"2024-09-12T22:35:33.752455+0000","last_became_active":"2024-09-12T22:31:37.414890+0000","last_became_peered":"2024-09-12T22:31:37.414890+0000","last_unstale":"2024-09-12T22:35:33.752455+0000","last_undegraded":"2024-09-12T22:35:33.752455+0000","last_fullsized":"2024-09-12T22:35:33.752455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:38:16.956786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":4587,"num_write":407,"num_write_kb":50860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"60'108","reported_seq":243,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752050+0000","last_change":"2024-09-12T22:31:36.412147+0000","last_active":"2024-09-12T22:35:33.752050+0000","last_peered":"2024-09-12T22:35:33.752050+0000","last_clean":"2024-09-12T22:35:33.752050+0000","last_became_active":"2024-09-12T22:31:36.411382+0000","last_became_peered":"2024-09-12T22:31:36.411382+0000","last_unstale":"2024-09-12T22:35:33.752050+0000","last_undegraded":"2024-09-12T22:35:33.752050+0000","last_fullsized":"2024-09-12T22:35:33.752050+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:54:51.454867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":4129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"60'407","reported_seq":927,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752793+0000","last_change":"2024-09-12T22:35:31.732325+0000","last_active":"2024-09-12T22:35:33.752793+0000","last_peered":"2024-09-12T22:35:33.752793+0000","last_clean":"2024-09-12T22:35:33.752793+0000","last_became_active":"2024-09-12T22:35:31.729817+0000","last_became_peered":"2024-09-12T22:35:31.729817+0000","last_unstale":"2024-09-12T22:35:33.752793+0000","last_undegraded":"2024-09-12T22:35:33.752793+0000","last_fullsized":"2024-09-12T22:35:33.752793+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:21:52.633068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":5615,"num_write":375,"num_write_kb":50827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"60'57","reported_seq":47,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.751984+0000","last_change":"2024-09-12T22:35:20.734244+0000","last_active":"2024-09-12T22:35:33.751984+0000","last_peered":"2024-09-12T22:35:33.751984+0000","last_clean":"2024-09-12T22:35:33.751984+0000","last_became_active":"2024-09-12T22:35:20.733664+0000","last_became_peered":"2024-09-12T22:35:20.733664+0000","last_unstale":"2024-09-12T22:35:33.751984+0000","last_undegraded":"2024-09-12T22:35:33.751984+0000","last_fullsized":"2024-09-12T22:35:33.751984+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:41:11.108676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"60'357","reported_seq":833,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752606+0000","last_change":"2024-09-12T22:35:27.734437+0000","last_active":"2024-09-12T22:35:33.752606+0000","last_peered":"2024-09-12T22:35:33.752606+0000","last_clean":"2024-09-12T22:35:33.752606+0000","last_became_active":"2024-09-12T22:35:27.733274+0000","last_became_peered":"2024-09-12T22:35:27.733274+0000","last_unstale":"2024-09-12T22:35:33.752606+0000","last_undegraded":"2024-09-12T22:35:33.752606+0000","last_fullsized":"2024-09-12T22:35:33.752606+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":357,"log_dups_size":0,"ondisk_log_size":357,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:35:58.820958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":2460,"num_write":324,"num_write_kb":37873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"60'417","reported_seq":501,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.753610+0000","last_change":"2024-09-12T22:35:23.755080+0000","last_active":"2024-09-12T22:35:33.753610+0000","last_peered":"2024-09-12T22:35:33.753610+0000","last_clean":"2024-09-12T22:35:33.753610+0000","last_became_active":"2024-09-12T22:35:23.754683+0000","last_became_peered":"2024-09-12T22:35:23.754683+0000","last_unstale":"2024-09-12T22:35:33.753610+0000","last_undegraded":"2024-09-12T22:35:33.753610+0000","last_fullsized":"2024-09-12T22:35:33.753610+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:34:00.150680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":359,"num_write_kb":4251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"60'416","reported_seq":963,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752396+0000","last_change":"2024-09-12T22:35:30.730978+0000","last_active":"2024-09-12T22:35:33.752396+0000","last_peered":"2024-09-12T22:35:33.752396+0000","last_clean":"2024-09-12T22:35:33.752396+0000","last_became_active":"2024-09-12T22:35:30.729912+0000","last_became_peered":"2024-09-12T22:35:30.729912+0000","last_unstale":"2024-09-12T22:35:33.752396+0000","last_undegraded":"2024-09-12T22:35:33.752396+0000","last_fullsized":"2024-09-12T22:35:33.752396+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:32:25.562466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":42190,"num_write":377,"num_write_kb":87849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":353,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.751924+0000","last_change":"2024-09-12T22:35:20.737092+0000","last_active":"2024-09-12T22:35:33.751924+0000","last_peered":"2024-09-12T22:35:33.751924+0000","last_clean":"2024-09-12T22:35:33.751924+0000","last_became_active":"2024-09-12T22:35:20.736721+0000","last_became_peered":"2024-09-12T22:35:20.736721+0000","last_unstale":"2024-09-12T22:35:33.751924+0000","last_undegraded":"2024-09-12T22:35:33.751924+0000","last_fullsized":"2024-09-12T22:35:33.751924+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:26.229539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:26.229539+0000","last_clean_scrub_stamp":"2024-09-12T22:31:26.229539+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:44:38.486987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":149,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752279+0000","last_change":"2024-09-12T22:31:34.286952+0000","last_active":"2024-09-12T22:35:33.752279+0000","last_peered":"2024-09-12T22:35:33.752279+0000","last_clean":"2024-09-12T22:35:33.752279+0000","last_became_active":"2024-09-12T22:31:32.283661+0000","last_became_peered":"2024-09-12T22:31:32.283661+0000","last_unstale":"2024-09-12T22:35:33.752279+0000","last_undegraded":"2024-09-12T22:35:33.752279+0000","last_fullsized":"2024-09-12T22:35:33.752279+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:21.681390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000621274,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"60'678","reported_seq":828,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752160+0000","last_change":"2024-09-12T22:35:23.755996+0000","last_active":"2024-09-12T22:35:33.752160+0000","last_peered":"2024-09-12T22:35:33.752160+0000","last_clean":"2024-09-12T22:35:33.752160+0000","last_became_active":"2024-09-12T22:35:23.755652+0000","last_became_peered":"2024-09-12T22:35:23.755652+0000","last_unstale":"2024-09-12T22:35:33.752160+0000","last_undegraded":"2024-09-12T22:35:33.752160+0000","last_fullsized":"2024-09-12T22:35:33.752160+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":678,"log_dups_size":0,"ondisk_log_size":678,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:05:19.284888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":608,"num_write_kb":8482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"60'426","reported_seq":976,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752894+0000","last_change":"2024-09-12T22:35:31.732344+0000","last_active":"2024-09-12T22:35:33.752894+0000","last_peered":"2024-09-12T22:35:33.752894+0000","last_clean":"2024-09-12T22:35:33.752894+0000","last_became_active":"2024-09-12T22:35:31.730242+0000","last_became_peered":"2024-09-12T22:35:31.730242+0000","last_unstale":"2024-09-12T22:35:33.752894+0000","last_undegraded":"2024-09-12T22:35:33.752894+0000","last_fullsized":"2024-09-12T22:35:33.752894+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:45:28.259069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":24636,"num_write":392,"num_write_kb":59176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":156,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.751942+0000","last_change":"2024-09-12T22:35:20.735913+0000","last_active":"2024-09-12T22:35:33.751942+0000","last_peered":"2024-09-12T22:35:33.751942+0000","last_clean":"2024-09-12T22:35:33.751942+0000","last_became_active":"2024-09-12T22:35:20.735545+0000","last_became_peered":"2024-09-12T22:35:20.735545+0000","last_unstale":"2024-09-12T22:35:33.751942+0000","last_undegraded":"2024-09-12T22:35:33.751942+0000","last_fullsized":"2024-09-12T22:35:33.751942+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:37:09.150338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037858999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"60'106","reported_seq":284,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.751775+0000","last_change":"2024-09-12T22:31:36.407395+0000","last_active":"2024-09-12T22:35:33.751775+0000","last_peered":"2024-09-12T22:35:33.751775+0000","last_clean":"2024-09-12T22:35:33.751775+0000","last_became_active":"2024-09-12T22:31:36.406770+0000","last_became_peered":"2024-09-12T22:31:36.406770+0000","last_unstale":"2024-09-12T22:35:33.751775+0000","last_undegraded":"2024-09-12T22:35:33.751775+0000","last_fullsized":"2024-09-12T22:35:33.751775+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:49:26.547848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1467429,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":43,"num_read_kb":1462,"num_write":43,"num_write_kb":1462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"60'448","reported_seq":547,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.753927+0000","last_change":"2024-09-12T22:35:27.733064+0000","last_active":"2024-09-12T22:35:33.753927+0000","last_peered":"2024-09-12T22:35:33.753927+0000","last_clean":"2024-09-12T22:35:33.753927+0000","last_became_active":"2024-09-12T22:35:27.729522+0000","last_became_peered":"2024-09-12T22:35:27.729522+0000","last_unstale":"2024-09-12T22:35:33.753927+0000","last_undegraded":"2024-09-12T22:35:33.753927+0000","last_fullsized":"2024-09-12T22:35:33.753927+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:59:06.989020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":10436,"num_write":420,"num_write_kb":67816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":155,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.751845+0000","last_change":"2024-09-12T22:35:20.735217+0000","last_active":"2024-09-12T22:35:33.751845+0000","last_peered":"2024-09-12T22:35:33.751845+0000","last_clean":"2024-09-12T22:35:33.751845+0000","last_became_active":"2024-09-12T22:35:20.734643+0000","last_became_peered":"2024-09-12T22:35:20.734643+0000","last_unstale":"2024-09-12T22:35:33.751845+0000","last_undegraded":"2024-09-12T22:35:33.751845+0000","last_fullsized":"2024-09-12T22:35:33.751845+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:27:17.331198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039540700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"60'292","reported_seq":404,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.761303+0000","last_change":"2024-09-12T22:35:33.761303+0000","last_active":"2024-09-12T22:35:33.761303+0000","last_peered":"2024-09-12T22:35:33.761303+0000","last_clean":"2024-09-12T22:35:33.761303+0000","last_became_active":"2024-09-12T22:35:33.760742+0000","last_became_peered":"2024-09-12T22:35:33.760742+0000","last_unstale":"2024-09-12T22:35:33.761303+0000","last_undegraded":"2024-09-12T22:35:33.761303+0000","last_fullsized":"2024-09-12T22:35:33.761303+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":292,"log_dups_size":0,"ondisk_log_size":292,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:48:04.210933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":235,"num_write_kb":8293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"60'375","reported_seq":912,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752503+0000","last_change":"2024-09-12T22:35:29.740484+0000","last_active":"2024-09-12T22:35:33.752503+0000","last_peered":"2024-09-12T22:35:33.752503+0000","last_clean":"2024-09-12T22:35:33.752503+0000","last_became_active":"2024-09-12T22:35:29.738755+0000","last_became_peered":"2024-09-12T22:35:29.738755+0000","last_unstale":"2024-09-12T22:35:33.752503+0000","last_undegraded":"2024-09-12T22:35:33.752503+0000","last_fullsized":"2024-09-12T22:35:33.752503+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:07:35.007529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":43566,"num_write":354,"num_write_kb":92229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":160,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":150,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752179+0000","last_change":"2024-09-12T22:31:34.286938+0000","last_active":"2024-09-12T22:35:33.752179+0000","last_peered":"2024-09-12T22:35:33.752179+0000","last_clean":"2024-09-12T22:35:33.752179+0000","last_became_active":"2024-09-12T22:31:32.282230+0000","last_became_peered":"2024-09-12T22:31:32.282230+0000","last_unstale":"2024-09-12T22:35:33.752179+0000","last_undegraded":"2024-09-12T22:35:33.752179+0000","last_fullsized":"2024-09-12T22:35:33.752179+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:11:05.988384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000615758,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"60'63","reported_seq":198,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752204+0000","last_change":"2024-09-12T22:31:36.410694+0000","last_active":"2024-09-12T22:35:33.752204+0000","last_peered":"2024-09-12T22:35:33.752204+0000","last_clean":"2024-09-12T22:35:33.752204+0000","last_became_active":"2024-09-12T22:31:36.409816+0000","last_became_peered":"2024-09-12T22:31:36.409816+0000","last_unstale":"2024-09-12T22:35:33.752204+0000","last_undegraded":"2024-09-12T22:35:33.752204+0000","last_fullsized":"2024-09-12T22:35:33.752204+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:40:35.369213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"60'405","reported_seq":929,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752072+0000","last_change":"2024-09-12T22:35:29.736704+0000","last_active":"2024-09-12T22:35:33.752072+0000","last_peered":"2024-09-12T22:35:33.752072+0000","last_clean":"2024-09-12T22:35:33.752072+0000","last_became_active":"2024-09-12T22:35:29.735499+0000","last_became_peered":"2024-09-12T22:35:29.735499+0000","last_unstale":"2024-09-12T22:35:33.752072+0000","last_undegraded":"2024-09-12T22:35:33.752072+0000","last_fullsized":"2024-09-12T22:35:33.752072+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:26:06.464684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":20152,"num_write":366,"num_write_kb":92447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"60'277","reported_seq":361,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.753169+0000","last_change":"2024-09-12T22:35:23.755555+0000","last_active":"2024-09-12T22:35:33.753169+0000","last_peered":"2024-09-12T22:35:33.753169+0000","last_clean":"2024-09-12T22:35:33.753169+0000","last_became_active":"2024-09-12T22:35:23.755237+0000","last_became_peered":"2024-09-12T22:35:23.755237+0000","last_unstale":"2024-09-12T22:35:33.753169+0000","last_undegraded":"2024-09-12T22:35:33.753169+0000","last_fullsized":"2024-09-12T22:35:33.753169+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":277,"log_dups_size":0,"ondisk_log_size":277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:10:23.649578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":216,"num_write_kb":4193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":155,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752207+0000","last_change":"2024-09-12T22:35:20.736644+0000","last_active":"2024-09-12T22:35:33.752207+0000","last_peered":"2024-09-12T22:35:33.752207+0000","last_clean":"2024-09-12T22:35:33.752207+0000","last_became_active":"2024-09-12T22:35:20.736428+0000","last_became_peered":"2024-09-12T22:35:20.736428+0000","last_unstale":"2024-09-12T22:35:33.752207+0000","last_undegraded":"2024-09-12T22:35:33.752207+0000","last_fullsized":"2024-09-12T22:35:33.752207+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:42:12.023369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041972500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"60'355","reported_seq":457,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752866+0000","last_change":"2024-09-12T22:35:25.729864+0000","last_active":"2024-09-12T22:35:33.752866+0000","last_peered":"2024-09-12T22:35:33.752866+0000","last_clean":"2024-09-12T22:35:33.752866+0000","last_became_active":"2024-09-12T22:35:25.727299+0000","last_became_peered":"2024-09-12T22:35:25.727299+0000","last_unstale":"2024-09-12T22:35:33.752866+0000","last_undegraded":"2024-09-12T22:35:33.752866+0000","last_fullsized":"2024-09-12T22:35:33.752866+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":355,"log_dups_size":0,"ondisk_log_size":355,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:56:40.812767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13196,"num_write":321,"num_write_kb":41797,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"60'55","reported_seq":197,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752072+0000","last_change":"2024-09-12T22:35:20.738078+0000","last_active":"2024-09-12T22:35:33.752072+0000","last_peered":"2024-09-12T22:35:33.752072+0000","last_clean":"2024-09-12T22:35:33.752072+0000","last_became_active":"2024-09-12T22:35:20.737705+0000","last_became_peered":"2024-09-12T22:35:20.737705+0000","last_unstale":"2024-09-12T22:35:33.752072+0000","last_undegraded":"2024-09-12T22:35:33.752072+0000","last_fullsized":"2024-09-12T22:35:33.752072+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:04:15.554381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":68,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.754453+0000","last_change":"2024-09-12T22:35:20.738327+0000","last_active":"2024-09-12T22:35:33.754453+0000","last_peered":"2024-09-12T22:35:33.754453+0000","last_clean":"2024-09-12T22:35:33.754453+0000","last_became_active":"2024-09-12T22:35:20.737799+0000","last_became_peered":"2024-09-12T22:35:20.737799+0000","last_unstale":"2024-09-12T22:35:33.754453+0000","last_undegraded":"2024-09-12T22:35:33.754453+0000","last_fullsized":"2024-09-12T22:35:33.754453+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:03:16.381453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"60'385","reported_seq":533,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.761943+0000","last_change":"2024-09-12T22:35:33.761943+0000","last_active":"2024-09-12T22:35:33.761943+0000","last_peered":"2024-09-12T22:35:33.761943+0000","last_clean":"2024-09-12T22:35:33.761943+0000","last_became_active":"2024-09-12T22:35:33.754546+0000","last_became_peered":"2024-09-12T22:35:33.754546+0000","last_unstale":"2024-09-12T22:35:33.761943+0000","last_undegraded":"2024-09-12T22:35:33.761943+0000","last_fullsized":"2024-09-12T22:35:33.761943+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:35:36.478089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":22437,"num_write":347,"num_write_kb":30121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"60'61","reported_seq":204,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752744+0000","last_change":"2024-09-12T22:35:20.738494+0000","last_active":"2024-09-12T22:35:33.752744+0000","last_peered":"2024-09-12T22:35:33.752744+0000","last_clean":"2024-09-12T22:35:33.752744+0000","last_became_active":"2024-09-12T22:35:20.738129+0000","last_became_peered":"2024-09-12T22:35:20.738129+0000","last_unstale":"2024-09-12T22:35:33.752744+0000","last_undegraded":"2024-09-12T22:35:33.752744+0000","last_fullsized":"2024-09-12T22:35:33.752744+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:27:06.987354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":155,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752846+0000","last_change":"2024-09-12T22:35:20.736934+0000","last_active":"2024-09-12T22:35:33.752846+0000","last_peered":"2024-09-12T22:35:33.752846+0000","last_clean":"2024-09-12T22:35:33.752846+0000","last_became_active":"2024-09-12T22:35:20.736628+0000","last_became_peered":"2024-09-12T22:35:20.736628+0000","last_unstale":"2024-09-12T22:35:33.752846+0000","last_undegraded":"2024-09-12T22:35:33.752846+0000","last_fullsized":"2024-09-12T22:35:33.752846+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:04:03.284313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058589999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"60'402","reported_seq":553,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.751534+0000","last_change":"2024-09-12T22:31:37.411152+0000","last_active":"2024-09-12T22:35:33.751534+0000","last_peered":"2024-09-12T22:35:33.751534+0000","last_clean":"2024-09-12T22:35:33.751534+0000","last_became_active":"2024-09-12T22:31:37.410558+0000","last_became_peered":"2024-09-12T22:31:37.410558+0000","last_unstale":"2024-09-12T22:35:33.751534+0000","last_undegraded":"2024-09-12T22:35:33.751534+0000","last_fullsized":"2024-09-12T22:35:33.751534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:14:29.892478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":10169,"num_write":370,"num_write_kb":38130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"61'105","reported_seq":240,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752736+0000","last_change":"2024-09-12T22:31:36.407460+0000","last_active":"2024-09-12T22:35:33.752736+0000","last_peered":"2024-09-12T22:35:33.752736+0000","last_clean":"2024-09-12T22:35:33.752736+0000","last_became_active":"2024-09-12T22:31:36.406729+0000","last_became_peered":"2024-09-12T22:31:36.406729+0000","last_unstale":"2024-09-12T22:35:33.752736+0000","last_undegraded":"2024-09-12T22:35:33.752736+0000","last_fullsized":"2024-09-12T22:35:33.752736+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:27:58.012573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103,"num_write_kb":1085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":155,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752930+0000","last_change":"2024-09-12T22:35:20.737068+0000","last_active":"2024-09-12T22:35:33.752930+0000","last_peered":"2024-09-12T22:35:33.752930+0000","last_clean":"2024-09-12T22:35:33.752930+0000","last_became_active":"2024-09-12T22:35:20.736769+0000","last_became_peered":"2024-09-12T22:35:20.736769+0000","last_unstale":"2024-09-12T22:35:33.752930+0000","last_undegraded":"2024-09-12T22:35:33.752930+0000","last_fullsized":"2024-09-12T22:35:33.752930+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:44:36.675350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000382109,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"60'412","reported_seq":550,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752676+0000","last_change":"2024-09-12T22:35:26.734859+0000","last_active":"2024-09-12T22:35:33.752676+0000","last_peered":"2024-09-12T22:35:33.752676+0000","last_clean":"2024-09-12T22:35:33.752676+0000","last_became_active":"2024-09-12T22:35:26.732923+0000","last_became_peered":"2024-09-12T22:35:26.732923+0000","last_unstale":"2024-09-12T22:35:33.752676+0000","last_undegraded":"2024-09-12T22:35:33.752676+0000","last_fullsized":"2024-09-12T22:35:33.752676+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:48:09.924688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":34504,"num_write":385,"num_write_kb":100438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"60'415","reported_seq":968,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.751983+0000","last_change":"2024-09-12T22:35:24.760883+0000","last_active":"2024-09-12T22:35:33.751983+0000","last_peered":"2024-09-12T22:35:33.751983+0000","last_clean":"2024-09-12T22:35:33.751983+0000","last_became_active":"2024-09-12T22:35:24.759441+0000","last_became_peered":"2024-09-12T22:35:24.759441+0000","last_unstale":"2024-09-12T22:35:33.751983+0000","last_undegraded":"2024-09-12T22:35:33.751983+0000","last_fullsized":"2024-09-12T22:35:33.751983+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:26:21.054210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":37207,"num_write":375,"num_write_kb":84660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"60'221","reported_seq":374,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752760+0000","last_change":"2024-09-12T22:35:23.756290+0000","last_active":"2024-09-12T22:35:33.752760+0000","last_peered":"2024-09-12T22:35:33.752760+0000","last_clean":"2024-09-12T22:35:33.752760+0000","last_became_active":"2024-09-12T22:35:23.755918+0000","last_became_peered":"2024-09-12T22:35:23.755918+0000","last_unstale":"2024-09-12T22:35:33.752760+0000","last_undegraded":"2024-09-12T22:35:33.752760+0000","last_fullsized":"2024-09-12T22:35:33.752760+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":221,"log_dups_size":0,"ondisk_log_size":221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:08:03.811119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":175,"num_write_kb":8282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":8382815,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"60'429","reported_seq":961,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.751615+0000","last_change":"2024-09-12T22:35:25.728726+0000","last_active":"2024-09-12T22:35:33.751615+0000","last_peered":"2024-09-12T22:35:33.751615+0000","last_clean":"2024-09-12T22:35:33.751615+0000","last_became_active":"2024-09-12T22:35:25.726837+0000","last_became_peered":"2024-09-12T22:35:25.726837+0000","last_unstale":"2024-09-12T22:35:33.751615+0000","last_undegraded":"2024-09-12T22:35:33.751615+0000","last_fullsized":"2024-09-12T22:35:33.751615+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:38.996042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":12230,"num_write":389,"num_write_kb":71746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"60'98","reported_seq":217,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.760239+0000","last_change":"2024-09-12T22:35:33.760239+0000","last_active":"2024-09-12T22:35:33.760239+0000","last_peered":"2024-09-12T22:35:33.760239+0000","last_clean":"2024-09-12T22:35:33.760239+0000","last_became_active":"2024-09-12T22:35:33.758640+0000","last_became_peered":"2024-09-12T22:35:33.758640+0000","last_unstale":"2024-09-12T22:35:33.760239+0000","last_undegraded":"2024-09-12T22:35:33.760239+0000","last_fullsized":"2024-09-12T22:35:33.760239+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:24:11.251168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"60'214","reported_seq":349,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752661+0000","last_change":"2024-09-12T22:31:36.411549+0000","last_active":"2024-09-12T22:35:33.752661+0000","last_peered":"2024-09-12T22:35:33.752661+0000","last_clean":"2024-09-12T22:35:33.752661+0000","last_became_active":"2024-09-12T22:31:36.410674+0000","last_became_peered":"2024-09-12T22:31:36.410674+0000","last_unstale":"2024-09-12T22:35:33.752661+0000","last_undegraded":"2024-09-12T22:35:33.752661+0000","last_fullsized":"2024-09-12T22:35:33.752661+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:58:05.676197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":151,"num_write_kb":4168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"60'460","reported_seq":622,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.751479+0000","last_change":"2024-09-12T22:31:37.411254+0000","last_active":"2024-09-12T22:35:33.751479+0000","last_peered":"2024-09-12T22:35:33.751479+0000","last_clean":"2024-09-12T22:35:33.751479+0000","last_became_active":"2024-09-12T22:31:37.410404+0000","last_became_peered":"2024-09-12T22:31:37.410404+0000","last_unstale":"2024-09-12T22:35:33.751479+0000","last_undegraded":"2024-09-12T22:35:33.751479+0000","last_fullsized":"2024-09-12T22:35:33.751479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:42:00.856616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":15059,"num_write":431,"num_write_kb":59615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"60'52","reported_seq":187,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752633+0000","last_change":"2024-09-12T22:31:36.408390+0000","last_active":"2024-09-12T22:35:33.752633+0000","last_peered":"2024-09-12T22:35:33.752633+0000","last_clean":"2024-09-12T22:35:33.752633+0000","last_became_active":"2024-09-12T22:31:36.407062+0000","last_became_peered":"2024-09-12T22:31:36.407062+0000","last_unstale":"2024-09-12T22:35:33.752633+0000","last_undegraded":"2024-09-12T22:35:33.752633+0000","last_fullsized":"2024-09-12T22:35:33.752633+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:09:10.618195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"60'461","reported_seq":1025,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.751489+0000","last_change":"2024-09-12T22:35:28.731581+0000","last_active":"2024-09-12T22:35:33.751489+0000","last_peered":"2024-09-12T22:35:33.751489+0000","last_clean":"2024-09-12T22:35:33.751489+0000","last_became_active":"2024-09-12T22:35:28.730402+0000","last_became_peered":"2024-09-12T22:35:28.730402+0000","last_unstale":"2024-09-12T22:35:33.751489+0000","last_undegraded":"2024-09-12T22:35:33.751489+0000","last_fullsized":"2024-09-12T22:35:33.751489+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:25:37.428224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":17508,"num_write":431,"num_write_kb":67883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":200,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"60'355","reported_seq":479,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752557+0000","last_change":"2024-09-12T22:35:28.732887+0000","last_active":"2024-09-12T22:35:33.752557+0000","last_peered":"2024-09-12T22:35:33.752557+0000","last_clean":"2024-09-12T22:35:33.752557+0000","last_became_active":"2024-09-12T22:35:28.730931+0000","last_became_peered":"2024-09-12T22:35:28.730931+0000","last_unstale":"2024-09-12T22:35:33.752557+0000","last_undegraded":"2024-09-12T22:35:33.752557+0000","last_fullsized":"2024-09-12T22:35:33.752557+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":355,"log_dups_size":0,"ondisk_log_size":355,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:14:12.194559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":44561,"num_write":329,"num_write_kb":26431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"60'548","reported_seq":698,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.751631+0000","last_change":"2024-09-12T22:35:23.756287+0000","last_active":"2024-09-12T22:35:33.751631+0000","last_peered":"2024-09-12T22:35:33.751631+0000","last_clean":"2024-09-12T22:35:33.751631+0000","last_became_active":"2024-09-12T22:35:23.755812+0000","last_became_peered":"2024-09-12T22:35:23.755812+0000","last_unstale":"2024-09-12T22:35:33.751631+0000","last_undegraded":"2024-09-12T22:35:33.751631+0000","last_fullsized":"2024-09-12T22:35:33.751631+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":548,"log_dups_size":0,"ondisk_log_size":548,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:15:13.597427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":488,"num_write_kb":8420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"60'422","reported_seq":667,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752477+0000","last_change":"2024-09-12T22:31:37.411183+0000","last_active":"2024-09-12T22:35:33.752477+0000","last_peered":"2024-09-12T22:35:33.752477+0000","last_clean":"2024-09-12T22:35:33.752477+0000","last_became_active":"2024-09-12T22:31:37.409796+0000","last_became_peered":"2024-09-12T22:31:37.409796+0000","last_unstale":"2024-09-12T22:35:33.752477+0000","last_undegraded":"2024-09-12T22:35:33.752477+0000","last_fullsized":"2024-09-12T22:35:33.752477+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:20:35.779810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":51020,"num_write":397,"num_write_kb":73116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"60'180","reported_seq":315,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.751693+0000","last_change":"2024-09-12T22:31:36.407402+0000","last_active":"2024-09-12T22:35:33.751693+0000","last_peered":"2024-09-12T22:35:33.751693+0000","last_clean":"2024-09-12T22:35:33.751693+0000","last_became_active":"2024-09-12T22:31:36.406681+0000","last_became_peered":"2024-09-12T22:31:36.406681+0000","last_unstale":"2024-09-12T22:35:33.751693+0000","last_undegraded":"2024-09-12T22:35:33.751693+0000","last_fullsized":"2024-09-12T22:35:33.751693+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:39:39.362573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":134,"num_write_kb":4167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"60'420","reported_seq":545,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.753501+0000","last_change":"2024-09-12T22:35:30.734995+0000","last_active":"2024-09-12T22:35:33.753501+0000","last_peered":"2024-09-12T22:35:33.753501+0000","last_clean":"2024-09-12T22:35:33.753501+0000","last_became_active":"2024-09-12T22:35:30.733182+0000","last_became_peered":"2024-09-12T22:35:30.733182+0000","last_unstale":"2024-09-12T22:35:33.753501+0000","last_undegraded":"2024-09-12T22:35:33.753501+0000","last_fullsized":"2024-09-12T22:35:33.753501+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:01:30.939801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":24901,"num_write":369,"num_write_kb":75198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"61'212","reported_seq":324,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.755961+0000","last_change":"2024-09-12T22:35:33.755961+0000","last_active":"2024-09-12T22:35:33.755961+0000","last_peered":"2024-09-12T22:35:33.755961+0000","last_clean":"2024-09-12T22:35:33.755961+0000","last_became_active":"2024-09-12T22:35:33.754931+0000","last_became_peered":"2024-09-12T22:35:33.754931+0000","last_unstale":"2024-09-12T22:35:33.755961+0000","last_undegraded":"2024-09-12T22:35:33.755961+0000","last_fullsized":"2024-09-12T22:35:33.755961+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:12:35.586196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12553847,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":12334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"60'398","reported_seq":539,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.763810+0000","last_change":"2024-09-12T22:35:33.763810+0000","last_active":"2024-09-12T22:35:33.763810+0000","last_peered":"2024-09-12T22:35:33.763810+0000","last_clean":"2024-09-12T22:35:33.763810+0000","last_became_active":"2024-09-12T22:35:33.755497+0000","last_became_peered":"2024-09-12T22:35:33.755497+0000","last_unstale":"2024-09-12T22:35:33.763810+0000","last_undegraded":"2024-09-12T22:35:33.763810+0000","last_fullsized":"2024-09-12T22:35:33.763810+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:19:50.330571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":11429,"num_write":361,"num_write_kb":88082,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"60'54","reported_seq":55,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752689+0000","last_change":"2024-09-12T22:35:20.759946+0000","last_active":"2024-09-12T22:35:33.752689+0000","last_peered":"2024-09-12T22:35:33.752689+0000","last_clean":"2024-09-12T22:35:33.752689+0000","last_became_active":"2024-09-12T22:35:20.733271+0000","last_became_peered":"2024-09-12T22:35:20.733271+0000","last_unstale":"2024-09-12T22:35:33.752689+0000","last_undegraded":"2024-09-12T22:35:33.752689+0000","last_fullsized":"2024-09-12T22:35:33.752689+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:49:02.164294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"60'359","reported_seq":512,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.751925+0000","last_change":"2024-09-12T22:31:37.415365+0000","last_active":"2024-09-12T22:35:33.751925+0000","last_peered":"2024-09-12T22:35:33.751925+0000","last_clean":"2024-09-12T22:35:33.751925+0000","last_became_active":"2024-09-12T22:31:37.413933+0000","last_became_peered":"2024-09-12T22:31:37.413933+0000","last_unstale":"2024-09-12T22:35:33.751925+0000","last_undegraded":"2024-09-12T22:35:33.751925+0000","last_fullsized":"2024-09-12T22:35:33.751925+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:08:07.115355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":12324,"num_write":332,"num_write_kb":46371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"60'186","reported_seq":321,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752637+0000","last_change":"2024-09-12T22:31:36.411665+0000","last_active":"2024-09-12T22:35:33.752637+0000","last_peered":"2024-09-12T22:35:33.752637+0000","last_clean":"2024-09-12T22:35:33.752637+0000","last_became_active":"2024-09-12T22:31:36.410182+0000","last_became_peered":"2024-09-12T22:31:36.410182+0000","last_unstale":"2024-09-12T22:35:33.752637+0000","last_undegraded":"2024-09-12T22:35:33.752637+0000","last_fullsized":"2024-09-12T22:35:33.752637+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:37:20.891838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":4160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"60'401","reported_seq":570,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752012+0000","last_change":"2024-09-12T22:31:37.415172+0000","last_active":"2024-09-12T22:35:33.752012+0000","last_peered":"2024-09-12T22:35:33.752012+0000","last_clean":"2024-09-12T22:35:33.752012+0000","last_became_active":"2024-09-12T22:31:37.414776+0000","last_became_peered":"2024-09-12T22:31:37.414776+0000","last_unstale":"2024-09-12T22:35:33.752012+0000","last_undegraded":"2024-09-12T22:35:33.752012+0000","last_fullsized":"2024-09-12T22:35:33.752012+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:42:32.307876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":24207,"num_write":361,"num_write_kb":50515,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"60'244","reported_seq":365,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.759131+0000","last_change":"2024-09-12T22:35:33.759131+0000","last_active":"2024-09-12T22:35:33.759131+0000","last_peered":"2024-09-12T22:35:33.759131+0000","last_clean":"2024-09-12T22:35:33.759131+0000","last_became_active":"2024-09-12T22:35:33.757550+0000","last_became_peered":"2024-09-12T22:35:33.757550+0000","last_unstale":"2024-09-12T22:35:33.759131+0000","last_undegraded":"2024-09-12T22:35:33.759131+0000","last_fullsized":"2024-09-12T22:35:33.759131+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":244,"log_dups_size":0,"ondisk_log_size":244,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:16:17.926249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":12389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"60'439","reported_seq":927,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.751404+0000","last_change":"2024-09-12T22:35:27.731026+0000","last_active":"2024-09-12T22:35:33.751404+0000","last_peered":"2024-09-12T22:35:33.751404+0000","last_clean":"2024-09-12T22:35:33.751404+0000","last_became_active":"2024-09-12T22:35:27.729827+0000","last_became_peered":"2024-09-12T22:35:27.729827+0000","last_unstale":"2024-09-12T22:35:33.751404+0000","last_undegraded":"2024-09-12T22:35:33.751404+0000","last_fullsized":"2024-09-12T22:35:33.751404+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:21:02.543670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":6311,"num_write":403,"num_write_kb":64161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"60'51","reported_seq":198,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752598+0000","last_change":"2024-09-12T22:35:20.764696+0000","last_active":"2024-09-12T22:35:33.752598+0000","last_peered":"2024-09-12T22:35:33.752598+0000","last_clean":"2024-09-12T22:35:33.752598+0000","last_became_active":"2024-09-12T22:35:20.737444+0000","last_became_peered":"2024-09-12T22:35:20.737444+0000","last_unstale":"2024-09-12T22:35:33.752598+0000","last_undegraded":"2024-09-12T22:35:33.752598+0000","last_fullsized":"2024-09-12T22:35:33.752598+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:14:54.424047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"60'438","reported_seq":624,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.751812+0000","last_change":"2024-09-12T22:31:37.415390+0000","last_active":"2024-09-12T22:35:33.751812+0000","last_peered":"2024-09-12T22:35:33.751812+0000","last_clean":"2024-09-12T22:35:33.751812+0000","last_became_active":"2024-09-12T22:31:37.414781+0000","last_became_peered":"2024-09-12T22:31:37.414781+0000","last_unstale":"2024-09-12T22:35:33.751812+0000","last_undegraded":"2024-09-12T22:35:33.751812+0000","last_fullsized":"2024-09-12T22:35:33.751812+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:42:17.728844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":29290,"num_write":407,"num_write_kb":46733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"60'111","reported_seq":246,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752515+0000","last_change":"2024-09-12T22:31:36.407945+0000","last_active":"2024-09-12T22:35:33.752515+0000","last_peered":"2024-09-12T22:35:33.752515+0000","last_clean":"2024-09-12T22:35:33.752515+0000","last_became_active":"2024-09-12T22:31:36.406959+0000","last_became_peered":"2024-09-12T22:31:36.406959+0000","last_unstale":"2024-09-12T22:35:33.752515+0000","last_undegraded":"2024-09-12T22:35:33.752515+0000","last_fullsized":"2024-09-12T22:35:33.752515+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:26:33.155850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61,"num_write_kb":4126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2747,"num_read_kb":1535780,"num_write":24498,"num_write_kb":4269351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5680,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26636,"ondisk_log_size":26636,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127268954,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":43,"num_read_kb":1462,"num_write":4457,"num_write_kb":127482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":54520159,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":254603264,"data_stored":254537908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4442,"internal_metadata":0},"log_size":6263,"ondisk_log_size":6263,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705719,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":174088,"kb_used_data":84656,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94197752,"statfs":{"total":96636764160,"available":96458498048,"internally_reserved":0,"allocated":86687744,"data_stored":86276944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":66,"seq":283467841541,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":145348,"kb_used_data":87272,"kb_used_omap":5,"kb_used_meta":58042,"kb_avail":94226492,"statfs":{"total":96636764160,"available":96487927808,"internally_reserved":0,"allocated":89366528,"data_stored":88969829,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6037,"internal_metadata":59435115},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738423,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":173528,"kb_used_data":79932,"kb_used_omap":1,"kb_used_meta":93566,"kb_avail":94198312,"statfs":{"total":96636764160,"available":96459071488,"internally_reserved":0,"allocated":81850368,"data_stored":81462353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":95812037},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":88076288,"data_stored":88052173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4442,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81141760,"data_stored":81130756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":85385216,"data_stored":85354979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T22:35:37.347 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T22:35:37.677 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:35:37.678 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":80,"fsid":"957ce235-19cb-4350-8fee-febd6e3f2199","created":"2024-09-12T22:31:15.903133+0000","modified":"2024-09-12T22:35:33.748166+0000","last_up_change":"2024-09-12T22:35:19.733135+0000","last_in_change":"2024-09-12T22:31:16.757598+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T22:31:26.228956+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T22:31:30.975989+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":16,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-12T22:31:35.267679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-12T22:31:35.724475+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.0800000429153442,"score_stable":1.0800000429153442,"optimal_score":1,"raw_score_acting":1.0800000429153442,"raw_score_stable":1.0800000429153442,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73b96314-15d5-4058-9993-ac103e997b27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":42,"up_from":66,"up_thru":79,"down_at":43,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6800","nonce":1671177249},{"type":"v1","addr":"172.21.15.76:6801","nonce":1671177249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6802","nonce":1671177249},{"type":"v1","addr":"172.21.15.76:6803","nonce":1671177249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6806","nonce":1671177249},{"type":"v1","addr":"172.21.15.76:6807","nonce":1671177249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6804","nonce":1671177249},{"type":"v1","addr":"172.21.15.76:6805","nonce":1671177249}]},"public_addr":"172.21.15.76:6801/1671177249","cluster_addr":"172.21.15.76:6803/1671177249","heartbeat_back_addr":"172.21.15.76:6807/1671177249","heartbeat_front_addr":"172.21.15.76:6805/1671177249","state":["exists","up"]},{"osd":1,"uuid":"f82ad621-e9cf-41cb-b9c0-43470cf7ddb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":616952176},{"type":"v1","addr":"172.21.15.148:6801","nonce":616952176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":616952176},{"type":"v1","addr":"172.21.15.148:6803","nonce":616952176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":616952176},{"type":"v1","addr":"172.21.15.148:6807","nonce":616952176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":616952176},{"type":"v1","addr":"172.21.15.148:6805","nonce":616952176}]},"public_addr":"172.21.15.148:6801/616952176","cluster_addr":"172.21.15.148:6803/616952176","heartbeat_back_addr":"172.21.15.148:6807/616952176","heartbeat_front_addr":"172.21.15.148:6805/616952176","state":["exists","up"]},{"osd":2,"uuid":"f30dda36-a84c-4a01-a81a-afbfb88c0aed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":533442754},{"type":"v1","addr":"172.21.15.163:6801","nonce":533442754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":533442754},{"type":"v1","addr":"172.21.15.163:6803","nonce":533442754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":533442754},{"type":"v1","addr":"172.21.15.163:6807","nonce":533442754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":533442754},{"type":"v1","addr":"172.21.15.163:6805","nonce":533442754}]},"public_addr":"172.21.15.163:6801/533442754","cluster_addr":"172.21.15.163:6803/533442754","heartbeat_back_addr":"172.21.15.163:6807/533442754","heartbeat_front_addr":"172.21.15.163:6805/533442754","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T22:31:23.899591+0000","dead_epoch":42},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T22:31:22.988274+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T22:31:23.932109+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"3.5","osds":[0,1]},{"pgid":"4.19","osds":[2,0]}],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T22:35:38.691 INFO:tasks.ceph:Scrubbing osd.0 2024-09-12T22:35:38.691 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-12T22:35:38.822 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T22:35:38.822 INFO:teuthology.orchestra.run.smithi019.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2024-09-12T22:35:38.822 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T22:35:38.833 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-12T22:35:39.123 INFO:teuthology.orchestra.run.smithi019.stderr:instructed osd(s) 0 to deep-scrub 2024-09-12T22:35:39.136 INFO:tasks.ceph:Scrubbing osd.1 2024-09-12T22:35:39.136 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-12T22:35:39.263 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T22:35:39.264 INFO:teuthology.orchestra.run.smithi019.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T22:35:39.264 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T22:35:39.274 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-12T22:35:39.562 INFO:teuthology.orchestra.run.smithi019.stderr:instructed osd(s) 1 to deep-scrub 2024-09-12T22:35:39.575 INFO:tasks.ceph:Scrubbing osd.2 2024-09-12T22:35:39.575 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-12T22:35:39.702 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T22:35:39.703 INFO:teuthology.orchestra.run.smithi019.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T22:35:39.703 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T22:35:39.713 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-12T22:35:40.004 INFO:teuthology.orchestra.run.smithi019.stderr:instructed osd(s) 2 to deep-scrub 2024-09-12T22:35:40.017 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T22:35:40.312 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:35:40.314 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-12T22:35:40.323 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":206,"stamp":"2024-09-12T22:35:40.254096+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":127859341,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":2926,"num_read_kb":1537360,"num_write":29160,"num_write_kb":4400295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5694,"num_bytes_recovered":54520159,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33059,"ondisk_log_size":33059,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":492964,"kb_used_data":251868,"kb_used_omap":9,"kb_used_meta":241014,"kb_avail":282622556,"statfs":{"total":289910292480,"available":289405497344,"internally_reserved":0,"allocated":257912832,"data_stored":256713416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9227,"internal_metadata":246799349},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-523,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-1046,"num_bytes_recovered":-33525457,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001452"},"pg_stats":[{"pgid":"4.3f","version":"60'422","reported_seq":536,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.753683+0000","last_change":"2024-09-12T22:35:30.733306+0000","last_active":"2024-09-12T22:35:33.753683+0000","last_peered":"2024-09-12T22:35:33.753683+0000","last_clean":"2024-09-12T22:35:33.753683+0000","last_became_active":"2024-09-12T22:35:30.731323+0000","last_became_peered":"2024-09-12T22:35:30.731323+0000","last_unstale":"2024-09-12T22:35:33.753683+0000","last_undegraded":"2024-09-12T22:35:33.753683+0000","last_fullsized":"2024-09-12T22:35:33.753683+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:14:12.288153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":29437,"num_write":385,"num_write_kb":96431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"60'470","reported_seq":631,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.764988+0000","last_change":"2024-09-12T22:35:33.764988+0000","last_active":"2024-09-12T22:35:33.764988+0000","last_peered":"2024-09-12T22:35:33.764988+0000","last_clean":"2024-09-12T22:35:33.764988+0000","last_became_active":"2024-09-12T22:35:33.759906+0000","last_became_peered":"2024-09-12T22:35:33.759906+0000","last_unstale":"2024-09-12T22:35:33.764988+0000","last_undegraded":"2024-09-12T22:35:33.764988+0000","last_fullsized":"2024-09-12T22:35:33.764988+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:06:06.794825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":18334,"num_write":442,"num_write_kb":109282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"60'391","reported_seq":912,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752455+0000","last_change":"2024-09-12T22:35:30.732861+0000","last_active":"2024-09-12T22:35:33.752455+0000","last_peered":"2024-09-12T22:35:33.752455+0000","last_clean":"2024-09-12T22:35:33.752455+0000","last_became_active":"2024-09-12T22:35:30.731086+0000","last_became_peered":"2024-09-12T22:35:30.731086+0000","last_unstale":"2024-09-12T22:35:33.752455+0000","last_undegraded":"2024-09-12T22:35:33.752455+0000","last_fullsized":"2024-09-12T22:35:33.752455+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:56:09.762357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":32771,"num_write":355,"num_write_kb":71120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"60'397","reported_seq":580,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752271+0000","last_change":"2024-09-12T22:31:37.413094+0000","last_active":"2024-09-12T22:35:33.752271+0000","last_peered":"2024-09-12T22:35:33.752271+0000","last_clean":"2024-09-12T22:35:33.752271+0000","last_became_active":"2024-09-12T22:31:37.412746+0000","last_became_peered":"2024-09-12T22:31:37.412746+0000","last_unstale":"2024-09-12T22:35:33.752271+0000","last_undegraded":"2024-09-12T22:35:33.752271+0000","last_fullsized":"2024-09-12T22:35:33.752271+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:32:14.415120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":28544,"num_write":368,"num_write_kb":83737,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"60'458","reported_seq":591,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752878+0000","last_change":"2024-09-12T22:35:24.759019+0000","last_active":"2024-09-12T22:35:33.752878+0000","last_peered":"2024-09-12T22:35:33.752878+0000","last_clean":"2024-09-12T22:35:33.752878+0000","last_became_active":"2024-09-12T22:35:24.756373+0000","last_became_peered":"2024-09-12T22:35:24.756373+0000","last_unstale":"2024-09-12T22:35:33.752878+0000","last_undegraded":"2024-09-12T22:35:33.752878+0000","last_fullsized":"2024-09-12T22:35:33.752878+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":458,"log_dups_size":0,"ondisk_log_size":458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:49:34.350038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":28467,"num_write":430,"num_write_kb":81329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":198,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"60'381","reported_seq":515,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.751680+0000","last_change":"2024-09-12T22:31:37.409177+0000","last_active":"2024-09-12T22:35:33.751680+0000","last_peered":"2024-09-12T22:35:33.751680+0000","last_clean":"2024-09-12T22:35:33.751680+0000","last_became_active":"2024-09-12T22:31:37.408811+0000","last_became_peered":"2024-09-12T22:31:37.408811+0000","last_unstale":"2024-09-12T22:35:33.751680+0000","last_undegraded":"2024-09-12T22:35:33.751680+0000","last_fullsized":"2024-09-12T22:35:33.751680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:17:21.695079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":60,"num_write":353,"num_write_kb":58419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"60'439","reported_seq":618,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.751757+0000","last_change":"2024-09-12T22:31:37.413023+0000","last_active":"2024-09-12T22:35:33.751757+0000","last_peered":"2024-09-12T22:35:33.751757+0000","last_clean":"2024-09-12T22:35:33.751757+0000","last_became_active":"2024-09-12T22:31:37.412691+0000","last_became_peered":"2024-09-12T22:31:37.412691+0000","last_unstale":"2024-09-12T22:35:33.751757+0000","last_undegraded":"2024-09-12T22:35:33.751757+0000","last_fullsized":"2024-09-12T22:35:33.751757+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:02:36.454134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":27053,"num_write":405,"num_write_kb":79743,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"60'384","reported_seq":589,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.751463+0000","last_change":"2024-09-12T22:31:37.411074+0000","last_active":"2024-09-12T22:35:33.751463+0000","last_peered":"2024-09-12T22:35:33.751463+0000","last_clean":"2024-09-12T22:35:33.751463+0000","last_became_active":"2024-09-12T22:31:37.410633+0000","last_became_peered":"2024-09-12T22:31:37.410633+0000","last_unstale":"2024-09-12T22:35:33.751463+0000","last_undegraded":"2024-09-12T22:35:33.751463+0000","last_fullsized":"2024-09-12T22:35:33.751463+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:39:20.383152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":44358,"num_write":338,"num_write_kb":67411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"60'418","reported_seq":1003,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752329+0000","last_change":"2024-09-12T22:35:28.732156+0000","last_active":"2024-09-12T22:35:33.752329+0000","last_peered":"2024-09-12T22:35:33.752329+0000","last_clean":"2024-09-12T22:35:33.752329+0000","last_became_active":"2024-09-12T22:35:28.731002+0000","last_became_peered":"2024-09-12T22:35:28.731002+0000","last_unstale":"2024-09-12T22:35:33.752329+0000","last_undegraded":"2024-09-12T22:35:33.752329+0000","last_fullsized":"2024-09-12T22:35:33.752329+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":48711,"num_write":384,"num_write_kb":63228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"60'406","reported_seq":520,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.753178+0000","last_change":"2024-09-12T22:35:27.732831+0000","last_active":"2024-09-12T22:35:33.753178+0000","last_peered":"2024-09-12T22:35:33.753178+0000","last_clean":"2024-09-12T22:35:33.753178+0000","last_became_active":"2024-09-12T22:35:27.729480+0000","last_became_peered":"2024-09-12T22:35:27.729480+0000","last_unstale":"2024-09-12T22:35:33.753178+0000","last_undegraded":"2024-09-12T22:35:33.753178+0000","last_fullsized":"2024-09-12T22:35:33.753178+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:38:13.307443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":21851,"num_write":367,"num_write_kb":79913,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"60'338","reported_seq":479,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752488+0000","last_change":"2024-09-12T22:31:37.414469+0000","last_active":"2024-09-12T22:35:33.752488+0000","last_peered":"2024-09-12T22:35:33.752488+0000","last_clean":"2024-09-12T22:35:33.752488+0000","last_became_active":"2024-09-12T22:31:37.414165+0000","last_became_peered":"2024-09-12T22:31:37.414165+0000","last_unstale":"2024-09-12T22:35:33.752488+0000","last_undegraded":"2024-09-12T22:35:33.752488+0000","last_fullsized":"2024-09-12T22:35:33.752488+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":338,"log_dups_size":0,"ondisk_log_size":338,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:25:38.148636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":4053,"num_write":316,"num_write_kb":21475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"60'359","reported_seq":495,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.764173+0000","last_change":"2024-09-12T22:35:33.764173+0000","last_active":"2024-09-12T22:35:33.764173+0000","last_peered":"2024-09-12T22:35:33.764173+0000","last_clean":"2024-09-12T22:35:33.764173+0000","last_became_active":"2024-09-12T22:35:33.760739+0000","last_became_peered":"2024-09-12T22:35:33.760739+0000","last_unstale":"2024-09-12T22:35:33.764173+0000","last_undegraded":"2024-09-12T22:35:33.764173+0000","last_fullsized":"2024-09-12T22:35:33.764173+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:58:38.596224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":6688,"num_write":330,"num_write_kb":38146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"60'402","reported_seq":537,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.761962+0000","last_change":"2024-09-12T22:35:33.761962+0000","last_active":"2024-09-12T22:35:33.761962+0000","last_peered":"2024-09-12T22:35:33.761962+0000","last_clean":"2024-09-12T22:35:33.761962+0000","last_became_active":"2024-09-12T22:35:33.754938+0000","last_became_peered":"2024-09-12T22:35:33.754938+0000","last_unstale":"2024-09-12T22:35:33.761962+0000","last_undegraded":"2024-09-12T22:35:33.761962+0000","last_fullsized":"2024-09-12T22:35:33.761962+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:01:27.181524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":16384,"num_write":363,"num_write_kb":62556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"60'409","reported_seq":935,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.751724+0000","last_change":"2024-09-12T22:35:29.737252+0000","last_active":"2024-09-12T22:35:33.751724+0000","last_peered":"2024-09-12T22:35:33.751724+0000","last_clean":"2024-09-12T22:35:33.751724+0000","last_became_active":"2024-09-12T22:35:29.735835+0000","last_became_peered":"2024-09-12T22:35:29.735835+0000","last_unstale":"2024-09-12T22:35:33.751724+0000","last_undegraded":"2024-09-12T22:35:33.751724+0000","last_fullsized":"2024-09-12T22:35:33.751724+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:32:12.014289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":13943,"num_write":382,"num_write_kb":54682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"60'412","reported_seq":948,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.751812+0000","last_change":"2024-09-12T22:35:28.731566+0000","last_active":"2024-09-12T22:35:33.751812+0000","last_peered":"2024-09-12T22:35:33.751812+0000","last_clean":"2024-09-12T22:35:33.751812+0000","last_became_active":"2024-09-12T22:35:28.730413+0000","last_became_peered":"2024-09-12T22:35:28.730413+0000","last_unstale":"2024-09-12T22:35:33.751812+0000","last_undegraded":"2024-09-12T22:35:33.751812+0000","last_fullsized":"2024-09-12T22:35:33.751812+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:47:47.029549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":19700,"num_write":377,"num_write_kb":67929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"60'404","reported_seq":537,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.751489+0000","last_change":"2024-09-12T22:31:37.411006+0000","last_active":"2024-09-12T22:35:33.751489+0000","last_peered":"2024-09-12T22:35:33.751489+0000","last_clean":"2024-09-12T22:35:33.751489+0000","last_became_active":"2024-09-12T22:31:37.410557+0000","last_became_peered":"2024-09-12T22:31:37.410557+0000","last_unstale":"2024-09-12T22:35:33.751489+0000","last_undegraded":"2024-09-12T22:35:33.751489+0000","last_fullsized":"2024-09-12T22:35:33.751489+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:08:21.709770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":368,"num_write_kb":25652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"60'405","reported_seq":941,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752745+0000","last_change":"2024-09-12T22:35:31.732234+0000","last_active":"2024-09-12T22:35:33.752745+0000","last_peered":"2024-09-12T22:35:33.752745+0000","last_clean":"2024-09-12T22:35:33.752745+0000","last_became_active":"2024-09-12T22:35:31.730883+0000","last_became_peered":"2024-09-12T22:35:31.730883+0000","last_unstale":"2024-09-12T22:35:33.752745+0000","last_undegraded":"2024-09-12T22:35:33.752745+0000","last_fullsized":"2024-09-12T22:35:33.752745+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":18251,"num_write":369,"num_write_kb":34203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"60'406","reported_seq":579,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.760018+0000","last_change":"2024-09-12T22:35:33.760018+0000","last_active":"2024-09-12T22:35:33.760018+0000","last_peered":"2024-09-12T22:35:33.760018+0000","last_clean":"2024-09-12T22:35:33.760018+0000","last_became_active":"2024-09-12T22:35:33.754915+0000","last_became_peered":"2024-09-12T22:35:33.754915+0000","last_unstale":"2024-09-12T22:35:33.760018+0000","last_undegraded":"2024-09-12T22:35:33.760018+0000","last_fullsized":"2024-09-12T22:35:33.760018+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:36:51.477439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":45843,"num_write":367,"num_write_kb":59097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"60'413","reported_seq":933,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752466+0000","last_change":"2024-09-12T22:35:31.731988+0000","last_active":"2024-09-12T22:35:33.752466+0000","last_peered":"2024-09-12T22:35:33.752466+0000","last_clean":"2024-09-12T22:35:33.752466+0000","last_became_active":"2024-09-12T22:35:31.730742+0000","last_became_peered":"2024-09-12T22:35:31.730742+0000","last_unstale":"2024-09-12T22:35:33.752466+0000","last_undegraded":"2024-09-12T22:35:33.752466+0000","last_fullsized":"2024-09-12T22:35:33.752466+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":20855,"num_write":371,"num_write_kb":71095,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"60'441","reported_seq":621,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752348+0000","last_change":"2024-09-12T22:31:37.414235+0000","last_active":"2024-09-12T22:35:33.752348+0000","last_peered":"2024-09-12T22:35:33.752348+0000","last_clean":"2024-09-12T22:35:33.752348+0000","last_became_active":"2024-09-12T22:31:37.413786+0000","last_became_peered":"2024-09-12T22:31:37.413786+0000","last_unstale":"2024-09-12T22:35:33.752348+0000","last_undegraded":"2024-09-12T22:35:33.752348+0000","last_fullsized":"2024-09-12T22:35:33.752348+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:21:11.866973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":23954,"num_write":419,"num_write_kb":72528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"60'414","reported_seq":622,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752077+0000","last_change":"2024-09-12T22:31:37.415382+0000","last_active":"2024-09-12T22:35:33.752077+0000","last_peered":"2024-09-12T22:35:33.752077+0000","last_clean":"2024-09-12T22:35:33.752077+0000","last_became_active":"2024-09-12T22:31:37.414319+0000","last_became_peered":"2024-09-12T22:31:37.414319+0000","last_unstale":"2024-09-12T22:35:33.752077+0000","last_undegraded":"2024-09-12T22:35:33.752077+0000","last_fullsized":"2024-09-12T22:35:33.752077+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:26:25.578693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":44129,"num_write":387,"num_write_kb":104899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"60'444","reported_seq":551,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.753335+0000","last_change":"2024-09-12T22:35:25.729851+0000","last_active":"2024-09-12T22:35:33.753335+0000","last_peered":"2024-09-12T22:35:33.753335+0000","last_clean":"2024-09-12T22:35:33.753335+0000","last_became_active":"2024-09-12T22:35:25.727269+0000","last_became_peered":"2024-09-12T22:35:25.727269+0000","last_unstale":"2024-09-12T22:35:33.753335+0000","last_undegraded":"2024-09-12T22:35:33.753335+0000","last_fullsized":"2024-09-12T22:35:33.753335+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:30:26.718280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":17411,"num_write":407,"num_write_kb":87850,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"60'421","reported_seq":647,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.751371+0000","last_change":"2024-09-12T22:31:37.410364+0000","last_active":"2024-09-12T22:35:33.751371+0000","last_peered":"2024-09-12T22:35:33.751371+0000","last_clean":"2024-09-12T22:35:33.751371+0000","last_became_active":"2024-09-12T22:31:37.409951+0000","last_became_peered":"2024-09-12T22:31:37.409951+0000","last_unstale":"2024-09-12T22:35:33.751371+0000","last_undegraded":"2024-09-12T22:35:33.751371+0000","last_fullsized":"2024-09-12T22:35:33.751371+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":44074,"num_write":389,"num_write_kb":44104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"60'459","reported_seq":614,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.760584+0000","last_change":"2024-09-12T22:35:33.760584+0000","last_active":"2024-09-12T22:35:33.760584+0000","last_peered":"2024-09-12T22:35:33.760584+0000","last_clean":"2024-09-12T22:35:33.760584+0000","last_became_active":"2024-09-12T22:35:33.754576+0000","last_became_peered":"2024-09-12T22:35:33.754576+0000","last_unstale":"2024-09-12T22:35:33.760584+0000","last_undegraded":"2024-09-12T22:35:33.760584+0000","last_fullsized":"2024-09-12T22:35:33.760584+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:14:34.676855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":28605,"num_write":432,"num_write_kb":100377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"60'419","reported_seq":516,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752435+0000","last_change":"2024-09-12T22:35:29.738235+0000","last_active":"2024-09-12T22:35:33.752435+0000","last_peered":"2024-09-12T22:35:33.752435+0000","last_clean":"2024-09-12T22:35:33.752435+0000","last_became_active":"2024-09-12T22:35:29.735450+0000","last_became_peered":"2024-09-12T22:35:29.735450+0000","last_unstale":"2024-09-12T22:35:33.752435+0000","last_undegraded":"2024-09-12T22:35:33.752435+0000","last_fullsized":"2024-09-12T22:35:33.752435+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:24.582229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":16852,"num_write":404,"num_write_kb":34622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"60'494","reported_seq":711,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752517+0000","last_change":"2024-09-12T22:31:37.411880+0000","last_active":"2024-09-12T22:35:33.752517+0000","last_peered":"2024-09-12T22:35:33.752517+0000","last_clean":"2024-09-12T22:35:33.752517+0000","last_became_active":"2024-09-12T22:31:37.410563+0000","last_became_peered":"2024-09-12T22:31:37.410563+0000","last_unstale":"2024-09-12T22:35:33.752517+0000","last_undegraded":"2024-09-12T22:35:33.752517+0000","last_fullsized":"2024-09-12T22:35:33.752517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":494,"log_dups_size":0,"ondisk_log_size":494,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":35239,"num_write":450,"num_write_kb":76898,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"60'401","reported_seq":923,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752642+0000","last_change":"2024-09-12T22:35:30.732843+0000","last_active":"2024-09-12T22:35:33.752642+0000","last_peered":"2024-09-12T22:35:33.752642+0000","last_clean":"2024-09-12T22:35:33.752642+0000","last_became_active":"2024-09-12T22:35:30.731155+0000","last_became_peered":"2024-09-12T22:35:30.731155+0000","last_unstale":"2024-09-12T22:35:33.752642+0000","last_undegraded":"2024-09-12T22:35:33.752642+0000","last_fullsized":"2024-09-12T22:35:33.752642+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:54:33.926426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":10993,"num_write":369,"num_write_kb":55171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"60'390","reported_seq":538,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.763890+0000","last_change":"2024-09-12T22:35:33.763890+0000","last_active":"2024-09-12T22:35:33.763890+0000","last_peered":"2024-09-12T22:35:33.763890+0000","last_clean":"2024-09-12T22:35:33.763890+0000","last_became_active":"2024-09-12T22:35:33.756108+0000","last_became_peered":"2024-09-12T22:35:33.756108+0000","last_unstale":"2024-09-12T22:35:33.763890+0000","last_undegraded":"2024-09-12T22:35:33.763890+0000","last_fullsized":"2024-09-12T22:35:33.763890+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:53:03.258457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":18588,"num_write":360,"num_write_kb":59307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"60'429","reported_seq":1008,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752053+0000","last_change":"2024-09-12T22:35:23.756871+0000","last_active":"2024-09-12T22:35:33.752053+0000","last_peered":"2024-09-12T22:35:33.752053+0000","last_clean":"2024-09-12T22:35:33.752053+0000","last_became_active":"2024-09-12T22:35:23.755618+0000","last_became_peered":"2024-09-12T22:35:23.755618+0000","last_unstale":"2024-09-12T22:35:33.752053+0000","last_undegraded":"2024-09-12T22:35:33.752053+0000","last_fullsized":"2024-09-12T22:35:33.752053+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":32541,"num_write":398,"num_write_kb":76609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"60'458","reported_seq":575,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.753011+0000","last_change":"2024-09-12T22:35:28.732538+0000","last_active":"2024-09-12T22:35:33.753011+0000","last_peered":"2024-09-12T22:35:33.753011+0000","last_clean":"2024-09-12T22:35:33.753011+0000","last_became_active":"2024-09-12T22:35:28.730337+0000","last_became_peered":"2024-09-12T22:35:28.730337+0000","last_unstale":"2024-09-12T22:35:33.753011+0000","last_undegraded":"2024-09-12T22:35:33.753011+0000","last_fullsized":"2024-09-12T22:35:33.753011+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":458,"log_dups_size":0,"ondisk_log_size":458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:55:45.185896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":16425,"num_write":413,"num_write_kb":47110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"60'432","reported_seq":991,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:40.156740+0000","last_change":"2024-09-12T22:35:40.156788+0000","last_active":"2024-09-12T22:35:40.156740+0000","last_peered":"2024-09-12T22:35:40.156740+0000","last_clean":"2024-09-12T22:35:40.156740+0000","last_became_active":"2024-09-12T22:35:26.731135+0000","last_became_peered":"2024-09-12T22:35:26.731135+0000","last_unstale":"2024-09-12T22:35:40.156740+0000","last_undegraded":"2024-09-12T22:35:40.156740+0000","last_fullsized":"2024-09-12T22:35:40.156740+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'432","last_scrub_stamp":"2024-09-12T22:35:40.156631+0000","last_deep_scrub":"60'432","last_deep_scrub_stamp":"2024-09-12T22:35:40.156631+0000","last_clean_scrub_stamp":"2024-09-12T22:35:40.156631+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:37:49.074651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":21090,"num_write":393,"num_write_kb":67477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"60'458","reported_seq":636,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.751620+0000","last_change":"2024-09-12T22:31:37.415190+0000","last_active":"2024-09-12T22:35:33.751620+0000","last_peered":"2024-09-12T22:35:33.751620+0000","last_clean":"2024-09-12T22:35:33.751620+0000","last_became_active":"2024-09-12T22:31:37.414265+0000","last_became_peered":"2024-09-12T22:31:37.414265+0000","last_unstale":"2024-09-12T22:35:33.751620+0000","last_undegraded":"2024-09-12T22:35:33.751620+0000","last_fullsized":"2024-09-12T22:35:33.751620+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":458,"log_dups_size":0,"ondisk_log_size":458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:07:02.173590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":37395,"num_write":421,"num_write_kb":73250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"60'411","reported_seq":583,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.764162+0000","last_change":"2024-09-12T22:35:33.764162+0000","last_active":"2024-09-12T22:35:33.764162+0000","last_peered":"2024-09-12T22:35:33.764162+0000","last_clean":"2024-09-12T22:35:33.764162+0000","last_became_active":"2024-09-12T22:35:33.761121+0000","last_became_peered":"2024-09-12T22:35:33.761121+0000","last_unstale":"2024-09-12T22:35:33.764162+0000","last_undegraded":"2024-09-12T22:35:33.764162+0000","last_fullsized":"2024-09-12T22:35:33.764162+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:03:51.948278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":36400,"num_write":371,"num_write_kb":92142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"60'546","reported_seq":681,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752153+0000","last_change":"2024-09-12T22:31:36.412082+0000","last_active":"2024-09-12T22:35:33.752153+0000","last_peered":"2024-09-12T22:35:33.752153+0000","last_clean":"2024-09-12T22:35:33.752153+0000","last_became_active":"2024-09-12T22:31:36.410871+0000","last_became_peered":"2024-09-12T22:31:36.410871+0000","last_unstale":"2024-09-12T22:35:33.752153+0000","last_undegraded":"2024-09-12T22:35:33.752153+0000","last_fullsized":"2024-09-12T22:35:33.752153+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":546,"log_dups_size":0,"ondisk_log_size":546,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:30:49.127253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":495,"num_write_kb":8426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"60'427","reported_seq":598,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.753291+0000","last_change":"2024-09-12T22:35:31.732681+0000","last_active":"2024-09-12T22:35:33.753291+0000","last_peered":"2024-09-12T22:35:33.753291+0000","last_clean":"2024-09-12T22:35:33.753291+0000","last_became_active":"2024-09-12T22:35:31.730237+0000","last_became_peered":"2024-09-12T22:35:31.730237+0000","last_unstale":"2024-09-12T22:35:33.753291+0000","last_undegraded":"2024-09-12T22:35:33.753291+0000","last_fullsized":"2024-09-12T22:35:33.753291+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:51:57.088855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":59223,"num_write":394,"num_write_kb":80309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":175,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"60'55","reported_seq":191,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752139+0000","last_change":"2024-09-12T22:31:36.408563+0000","last_active":"2024-09-12T22:35:33.752139+0000","last_peered":"2024-09-12T22:35:33.752139+0000","last_clean":"2024-09-12T22:35:33.752139+0000","last_became_active":"2024-09-12T22:31:36.407447+0000","last_became_peered":"2024-09-12T22:31:36.407447+0000","last_unstale":"2024-09-12T22:35:33.752139+0000","last_undegraded":"2024-09-12T22:35:33.752139+0000","last_fullsized":"2024-09-12T22:35:33.752139+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"60'424","reported_seq":589,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752809+0000","last_change":"2024-09-12T22:31:37.411680+0000","last_active":"2024-09-12T22:35:33.752809+0000","last_peered":"2024-09-12T22:35:33.752809+0000","last_clean":"2024-09-12T22:35:33.752809+0000","last_became_active":"2024-09-12T22:31:37.411168+0000","last_became_peered":"2024-09-12T22:31:37.411168+0000","last_unstale":"2024-09-12T22:35:33.752809+0000","last_undegraded":"2024-09-12T22:35:33.752809+0000","last_fullsized":"2024-09-12T22:35:33.752809+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":13992,"num_write":386,"num_write_kb":38510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"60'70","reported_seq":47,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752499+0000","last_change":"2024-09-12T22:35:20.734652+0000","last_active":"2024-09-12T22:35:33.752499+0000","last_peered":"2024-09-12T22:35:33.752499+0000","last_clean":"2024-09-12T22:35:33.752499+0000","last_became_active":"2024-09-12T22:35:20.734023+0000","last_became_peered":"2024-09-12T22:35:20.734023+0000","last_unstale":"2024-09-12T22:35:33.752499+0000","last_undegraded":"2024-09-12T22:35:33.752499+0000","last_fullsized":"2024-09-12T22:35:33.752499+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:18:27.888573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"60'395","reported_seq":578,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752398+0000","last_change":"2024-09-12T22:31:37.411218+0000","last_active":"2024-09-12T22:35:33.752398+0000","last_peered":"2024-09-12T22:35:33.752398+0000","last_clean":"2024-09-12T22:35:33.752398+0000","last_became_active":"2024-09-12T22:31:37.409666+0000","last_became_peered":"2024-09-12T22:31:37.409666+0000","last_unstale":"2024-09-12T22:35:33.752398+0000","last_undegraded":"2024-09-12T22:35:33.752398+0000","last_fullsized":"2024-09-12T22:35:33.752398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":24198,"num_write":363,"num_write_kb":67056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"60'68","reported_seq":211,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.751638+0000","last_change":"2024-09-12T22:35:20.737076+0000","last_active":"2024-09-12T22:35:33.751638+0000","last_peered":"2024-09-12T22:35:33.751638+0000","last_clean":"2024-09-12T22:35:33.751638+0000","last_became_active":"2024-09-12T22:35:20.736755+0000","last_became_peered":"2024-09-12T22:35:20.736755+0000","last_unstale":"2024-09-12T22:35:33.751638+0000","last_undegraded":"2024-09-12T22:35:33.751638+0000","last_fullsized":"2024-09-12T22:35:33.751638+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:57:36.195186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"60'158","reported_seq":307,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752919+0000","last_change":"2024-09-12T22:35:23.756940+0000","last_active":"2024-09-12T22:35:33.752919+0000","last_peered":"2024-09-12T22:35:33.752919+0000","last_clean":"2024-09-12T22:35:33.752919+0000","last_became_active":"2024-09-12T22:35:23.756663+0000","last_became_peered":"2024-09-12T22:35:23.756663+0000","last_unstale":"2024-09-12T22:35:33.752919+0000","last_undegraded":"2024-09-12T22:35:33.752919+0000","last_fullsized":"2024-09-12T22:35:33.752919+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:08:58.453420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":105,"num_write_kb":4159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"60'426","reported_seq":545,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.753740+0000","last_change":"2024-09-12T22:35:26.735223+0000","last_active":"2024-09-12T22:35:33.753740+0000","last_peered":"2024-09-12T22:35:33.753740+0000","last_clean":"2024-09-12T22:35:33.753740+0000","last_became_active":"2024-09-12T22:35:26.732245+0000","last_became_peered":"2024-09-12T22:35:26.732245+0000","last_unstale":"2024-09-12T22:35:33.753740+0000","last_undegraded":"2024-09-12T22:35:33.753740+0000","last_fullsized":"2024-09-12T22:35:33.753740+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:29:27.860798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":29225,"num_write":390,"num_write_kb":83737,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"60'274","reported_seq":367,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752328+0000","last_change":"2024-09-12T22:35:23.755688+0000","last_active":"2024-09-12T22:35:33.752328+0000","last_peered":"2024-09-12T22:35:33.752328+0000","last_clean":"2024-09-12T22:35:33.752328+0000","last_became_active":"2024-09-12T22:35:23.755282+0000","last_became_peered":"2024-09-12T22:35:23.755282+0000","last_unstale":"2024-09-12T22:35:33.752328+0000","last_undegraded":"2024-09-12T22:35:33.752328+0000","last_fullsized":"2024-09-12T22:35:33.752328+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":274,"log_dups_size":0,"ondisk_log_size":274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:44:38.920273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":213,"num_write_kb":4214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"60'455","reported_seq":607,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.760415+0000","last_change":"2024-09-12T22:35:33.760415+0000","last_active":"2024-09-12T22:35:33.760415+0000","last_peered":"2024-09-12T22:35:33.760415+0000","last_clean":"2024-09-12T22:35:33.760415+0000","last_became_active":"2024-09-12T22:35:33.754299+0000","last_became_peered":"2024-09-12T22:35:33.754299+0000","last_unstale":"2024-09-12T22:35:33.760415+0000","last_undegraded":"2024-09-12T22:35:33.760415+0000","last_fullsized":"2024-09-12T22:35:33.760415+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:26:00.753338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":20747,"num_write":425,"num_write_kb":56005,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"60'423","reported_seq":572,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752919+0000","last_change":"2024-09-12T22:35:23.757047+0000","last_active":"2024-09-12T22:35:33.752919+0000","last_peered":"2024-09-12T22:35:33.752919+0000","last_clean":"2024-09-12T22:35:33.752919+0000","last_became_active":"2024-09-12T22:35:23.756668+0000","last_became_peered":"2024-09-12T22:35:23.756668+0000","last_unstale":"2024-09-12T22:35:33.752919+0000","last_undegraded":"2024-09-12T22:35:33.752919+0000","last_fullsized":"2024-09-12T22:35:33.752919+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:53:35.298628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":371,"num_write_kb":4254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"60'431","reported_seq":598,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.751837+0000","last_change":"2024-09-12T22:31:37.414809+0000","last_active":"2024-09-12T22:35:33.751837+0000","last_peered":"2024-09-12T22:35:33.751837+0000","last_clean":"2024-09-12T22:35:33.751837+0000","last_became_active":"2024-09-12T22:31:37.414492+0000","last_became_peered":"2024-09-12T22:31:37.414492+0000","last_unstale":"2024-09-12T22:35:33.751837+0000","last_undegraded":"2024-09-12T22:35:33.751837+0000","last_fullsized":"2024-09-12T22:35:33.751837+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:50:48.426898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":21479,"num_write":394,"num_write_kb":83756,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"60'70","reported_seq":205,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752868+0000","last_change":"2024-09-12T22:31:36.412068+0000","last_active":"2024-09-12T22:35:33.752868+0000","last_peered":"2024-09-12T22:35:33.752868+0000","last_clean":"2024-09-12T22:35:33.752868+0000","last_became_active":"2024-09-12T22:31:36.411366+0000","last_became_peered":"2024-09-12T22:31:36.411366+0000","last_unstale":"2024-09-12T22:35:33.752868+0000","last_undegraded":"2024-09-12T22:35:33.752868+0000","last_fullsized":"2024-09-12T22:35:33.752868+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:35:51.647051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"60'471","reported_seq":674,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752114+0000","last_change":"2024-09-12T22:31:37.410303+0000","last_active":"2024-09-12T22:35:33.752114+0000","last_peered":"2024-09-12T22:35:33.752114+0000","last_clean":"2024-09-12T22:35:33.752114+0000","last_became_active":"2024-09-12T22:31:37.409607+0000","last_became_peered":"2024-09-12T22:31:37.409607+0000","last_unstale":"2024-09-12T22:35:33.752114+0000","last_undegraded":"2024-09-12T22:35:33.752114+0000","last_fullsized":"2024-09-12T22:35:33.752114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":471,"log_dups_size":0,"ondisk_log_size":471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":37922,"num_write":440,"num_write_kb":138112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"60'209","reported_seq":345,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752264+0000","last_change":"2024-09-12T22:31:36.407974+0000","last_active":"2024-09-12T22:35:33.752264+0000","last_peered":"2024-09-12T22:35:33.752264+0000","last_clean":"2024-09-12T22:35:33.752264+0000","last_became_active":"2024-09-12T22:31:36.406955+0000","last_became_peered":"2024-09-12T22:31:36.406955+0000","last_unstale":"2024-09-12T22:35:33.752264+0000","last_undegraded":"2024-09-12T22:35:33.752264+0000","last_fullsized":"2024-09-12T22:35:33.752264+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":8267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"60'437","reported_seq":580,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752455+0000","last_change":"2024-09-12T22:31:37.415285+0000","last_active":"2024-09-12T22:35:33.752455+0000","last_peered":"2024-09-12T22:35:33.752455+0000","last_clean":"2024-09-12T22:35:33.752455+0000","last_became_active":"2024-09-12T22:31:37.414890+0000","last_became_peered":"2024-09-12T22:31:37.414890+0000","last_unstale":"2024-09-12T22:35:33.752455+0000","last_undegraded":"2024-09-12T22:35:33.752455+0000","last_fullsized":"2024-09-12T22:35:33.752455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:38:16.956786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":4587,"num_write":407,"num_write_kb":50860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"60'108","reported_seq":243,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752050+0000","last_change":"2024-09-12T22:31:36.412147+0000","last_active":"2024-09-12T22:35:33.752050+0000","last_peered":"2024-09-12T22:35:33.752050+0000","last_clean":"2024-09-12T22:35:33.752050+0000","last_became_active":"2024-09-12T22:31:36.411382+0000","last_became_peered":"2024-09-12T22:31:36.411382+0000","last_unstale":"2024-09-12T22:35:33.752050+0000","last_undegraded":"2024-09-12T22:35:33.752050+0000","last_fullsized":"2024-09-12T22:35:33.752050+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:54:51.454867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":4129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"60'407","reported_seq":927,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752793+0000","last_change":"2024-09-12T22:35:31.732325+0000","last_active":"2024-09-12T22:35:33.752793+0000","last_peered":"2024-09-12T22:35:33.752793+0000","last_clean":"2024-09-12T22:35:33.752793+0000","last_became_active":"2024-09-12T22:35:31.729817+0000","last_became_peered":"2024-09-12T22:35:31.729817+0000","last_unstale":"2024-09-12T22:35:33.752793+0000","last_undegraded":"2024-09-12T22:35:33.752793+0000","last_fullsized":"2024-09-12T22:35:33.752793+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:21:52.633068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":5615,"num_write":375,"num_write_kb":50827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"60'57","reported_seq":47,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.751984+0000","last_change":"2024-09-12T22:35:20.734244+0000","last_active":"2024-09-12T22:35:33.751984+0000","last_peered":"2024-09-12T22:35:33.751984+0000","last_clean":"2024-09-12T22:35:33.751984+0000","last_became_active":"2024-09-12T22:35:20.733664+0000","last_became_peered":"2024-09-12T22:35:20.733664+0000","last_unstale":"2024-09-12T22:35:33.751984+0000","last_undegraded":"2024-09-12T22:35:33.751984+0000","last_fullsized":"2024-09-12T22:35:33.751984+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:41:11.108676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"60'357","reported_seq":833,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752606+0000","last_change":"2024-09-12T22:35:27.734437+0000","last_active":"2024-09-12T22:35:33.752606+0000","last_peered":"2024-09-12T22:35:33.752606+0000","last_clean":"2024-09-12T22:35:33.752606+0000","last_became_active":"2024-09-12T22:35:27.733274+0000","last_became_peered":"2024-09-12T22:35:27.733274+0000","last_unstale":"2024-09-12T22:35:33.752606+0000","last_undegraded":"2024-09-12T22:35:33.752606+0000","last_fullsized":"2024-09-12T22:35:33.752606+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":357,"log_dups_size":0,"ondisk_log_size":357,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:35:58.820958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":2460,"num_write":324,"num_write_kb":37873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"60'417","reported_seq":501,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.753610+0000","last_change":"2024-09-12T22:35:23.755080+0000","last_active":"2024-09-12T22:35:33.753610+0000","last_peered":"2024-09-12T22:35:33.753610+0000","last_clean":"2024-09-12T22:35:33.753610+0000","last_became_active":"2024-09-12T22:35:23.754683+0000","last_became_peered":"2024-09-12T22:35:23.754683+0000","last_unstale":"2024-09-12T22:35:33.753610+0000","last_undegraded":"2024-09-12T22:35:33.753610+0000","last_fullsized":"2024-09-12T22:35:33.753610+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:34:00.150680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":359,"num_write_kb":4251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"60'416","reported_seq":964,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752439+0000","last_change":"2024-09-12T22:35:30.730978+0000","last_active":"2024-09-12T22:35:33.752439+0000","last_peered":"2024-09-12T22:35:33.752439+0000","last_clean":"2024-09-12T22:35:33.752439+0000","last_became_active":"2024-09-12T22:35:30.729912+0000","last_became_peered":"2024-09-12T22:35:30.729912+0000","last_unstale":"2024-09-12T22:35:33.752439+0000","last_undegraded":"2024-09-12T22:35:33.752439+0000","last_fullsized":"2024-09-12T22:35:33.752439+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":42190,"num_write":377,"num_write_kb":87849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'157","reported_seq":353,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.751924+0000","last_change":"2024-09-12T22:35:20.737092+0000","last_active":"2024-09-12T22:35:33.751924+0000","last_peered":"2024-09-12T22:35:33.751924+0000","last_clean":"2024-09-12T22:35:33.751924+0000","last_became_active":"2024-09-12T22:35:20.736721+0000","last_became_peered":"2024-09-12T22:35:20.736721+0000","last_unstale":"2024-09-12T22:35:33.751924+0000","last_undegraded":"2024-09-12T22:35:33.751924+0000","last_fullsized":"2024-09-12T22:35:33.751924+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:26.229539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:26.229539+0000","last_clean_scrub_stamp":"2024-09-12T22:31:26.229539+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:44:38.486987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":149,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752279+0000","last_change":"2024-09-12T22:31:34.286952+0000","last_active":"2024-09-12T22:35:33.752279+0000","last_peered":"2024-09-12T22:35:33.752279+0000","last_clean":"2024-09-12T22:35:33.752279+0000","last_became_active":"2024-09-12T22:31:32.283661+0000","last_became_peered":"2024-09-12T22:31:32.283661+0000","last_unstale":"2024-09-12T22:35:33.752279+0000","last_undegraded":"2024-09-12T22:35:33.752279+0000","last_fullsized":"2024-09-12T22:35:33.752279+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:21.681390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000621274,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"60'678","reported_seq":829,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752213+0000","last_change":"2024-09-12T22:35:23.755996+0000","last_active":"2024-09-12T22:35:33.752213+0000","last_peered":"2024-09-12T22:35:33.752213+0000","last_clean":"2024-09-12T22:35:33.752213+0000","last_became_active":"2024-09-12T22:35:23.755652+0000","last_became_peered":"2024-09-12T22:35:23.755652+0000","last_unstale":"2024-09-12T22:35:33.752213+0000","last_undegraded":"2024-09-12T22:35:33.752213+0000","last_fullsized":"2024-09-12T22:35:33.752213+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":678,"log_dups_size":0,"ondisk_log_size":678,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":608,"num_write_kb":8482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"60'426","reported_seq":976,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752894+0000","last_change":"2024-09-12T22:35:31.732344+0000","last_active":"2024-09-12T22:35:33.752894+0000","last_peered":"2024-09-12T22:35:33.752894+0000","last_clean":"2024-09-12T22:35:33.752894+0000","last_became_active":"2024-09-12T22:35:31.730242+0000","last_became_peered":"2024-09-12T22:35:31.730242+0000","last_unstale":"2024-09-12T22:35:33.752894+0000","last_undegraded":"2024-09-12T22:35:33.752894+0000","last_fullsized":"2024-09-12T22:35:33.752894+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:45:28.259069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":24636,"num_write":392,"num_write_kb":59176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":156,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.751942+0000","last_change":"2024-09-12T22:35:20.735913+0000","last_active":"2024-09-12T22:35:33.751942+0000","last_peered":"2024-09-12T22:35:33.751942+0000","last_clean":"2024-09-12T22:35:33.751942+0000","last_became_active":"2024-09-12T22:35:20.735545+0000","last_became_peered":"2024-09-12T22:35:20.735545+0000","last_unstale":"2024-09-12T22:35:33.751942+0000","last_undegraded":"2024-09-12T22:35:33.751942+0000","last_fullsized":"2024-09-12T22:35:33.751942+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:37:09.150338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037858999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"60'106","reported_seq":285,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.751855+0000","last_change":"2024-09-12T22:31:36.407395+0000","last_active":"2024-09-12T22:35:33.751855+0000","last_peered":"2024-09-12T22:35:33.751855+0000","last_clean":"2024-09-12T22:35:33.751855+0000","last_became_active":"2024-09-12T22:31:36.406770+0000","last_became_peered":"2024-09-12T22:31:36.406770+0000","last_unstale":"2024-09-12T22:35:33.751855+0000","last_undegraded":"2024-09-12T22:35:33.751855+0000","last_fullsized":"2024-09-12T22:35:33.751855+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1467429,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":43,"num_read_kb":1462,"num_write":43,"num_write_kb":1462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"60'448","reported_seq":547,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.753927+0000","last_change":"2024-09-12T22:35:27.733064+0000","last_active":"2024-09-12T22:35:33.753927+0000","last_peered":"2024-09-12T22:35:33.753927+0000","last_clean":"2024-09-12T22:35:33.753927+0000","last_became_active":"2024-09-12T22:35:27.729522+0000","last_became_peered":"2024-09-12T22:35:27.729522+0000","last_unstale":"2024-09-12T22:35:33.753927+0000","last_undegraded":"2024-09-12T22:35:33.753927+0000","last_fullsized":"2024-09-12T22:35:33.753927+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:59:06.989020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":10436,"num_write":420,"num_write_kb":67816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":156,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.751913+0000","last_change":"2024-09-12T22:35:20.735217+0000","last_active":"2024-09-12T22:35:33.751913+0000","last_peered":"2024-09-12T22:35:33.751913+0000","last_clean":"2024-09-12T22:35:33.751913+0000","last_became_active":"2024-09-12T22:35:20.734643+0000","last_became_peered":"2024-09-12T22:35:20.734643+0000","last_unstale":"2024-09-12T22:35:33.751913+0000","last_undegraded":"2024-09-12T22:35:33.751913+0000","last_fullsized":"2024-09-12T22:35:33.751913+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039540700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"60'292","reported_seq":404,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.761303+0000","last_change":"2024-09-12T22:35:33.761303+0000","last_active":"2024-09-12T22:35:33.761303+0000","last_peered":"2024-09-12T22:35:33.761303+0000","last_clean":"2024-09-12T22:35:33.761303+0000","last_became_active":"2024-09-12T22:35:33.760742+0000","last_became_peered":"2024-09-12T22:35:33.760742+0000","last_unstale":"2024-09-12T22:35:33.761303+0000","last_undegraded":"2024-09-12T22:35:33.761303+0000","last_fullsized":"2024-09-12T22:35:33.761303+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":292,"log_dups_size":0,"ondisk_log_size":292,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:48:04.210933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":235,"num_write_kb":8293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"60'375","reported_seq":913,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752559+0000","last_change":"2024-09-12T22:35:29.740484+0000","last_active":"2024-09-12T22:35:33.752559+0000","last_peered":"2024-09-12T22:35:33.752559+0000","last_clean":"2024-09-12T22:35:33.752559+0000","last_became_active":"2024-09-12T22:35:29.738755+0000","last_became_peered":"2024-09-12T22:35:29.738755+0000","last_unstale":"2024-09-12T22:35:33.752559+0000","last_undegraded":"2024-09-12T22:35:33.752559+0000","last_fullsized":"2024-09-12T22:35:33.752559+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":43566,"num_write":354,"num_write_kb":92229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":160,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":150,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752179+0000","last_change":"2024-09-12T22:31:34.286938+0000","last_active":"2024-09-12T22:35:33.752179+0000","last_peered":"2024-09-12T22:35:33.752179+0000","last_clean":"2024-09-12T22:35:33.752179+0000","last_became_active":"2024-09-12T22:31:32.282230+0000","last_became_peered":"2024-09-12T22:31:32.282230+0000","last_unstale":"2024-09-12T22:35:33.752179+0000","last_undegraded":"2024-09-12T22:35:33.752179+0000","last_fullsized":"2024-09-12T22:35:33.752179+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:11:05.988384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000615758,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"60'63","reported_seq":198,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752204+0000","last_change":"2024-09-12T22:31:36.410694+0000","last_active":"2024-09-12T22:35:33.752204+0000","last_peered":"2024-09-12T22:35:33.752204+0000","last_clean":"2024-09-12T22:35:33.752204+0000","last_became_active":"2024-09-12T22:31:36.409816+0000","last_became_peered":"2024-09-12T22:31:36.409816+0000","last_unstale":"2024-09-12T22:35:33.752204+0000","last_undegraded":"2024-09-12T22:35:33.752204+0000","last_fullsized":"2024-09-12T22:35:33.752204+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:40:35.369213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"60'405","reported_seq":930,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752141+0000","last_change":"2024-09-12T22:35:29.736704+0000","last_active":"2024-09-12T22:35:33.752141+0000","last_peered":"2024-09-12T22:35:33.752141+0000","last_clean":"2024-09-12T22:35:33.752141+0000","last_became_active":"2024-09-12T22:35:29.735499+0000","last_became_peered":"2024-09-12T22:35:29.735499+0000","last_unstale":"2024-09-12T22:35:33.752141+0000","last_undegraded":"2024-09-12T22:35:33.752141+0000","last_fullsized":"2024-09-12T22:35:33.752141+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":20152,"num_write":366,"num_write_kb":92447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"60'277","reported_seq":361,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.753169+0000","last_change":"2024-09-12T22:35:23.755555+0000","last_active":"2024-09-12T22:35:33.753169+0000","last_peered":"2024-09-12T22:35:33.753169+0000","last_clean":"2024-09-12T22:35:33.753169+0000","last_became_active":"2024-09-12T22:35:23.755237+0000","last_became_peered":"2024-09-12T22:35:23.755237+0000","last_unstale":"2024-09-12T22:35:33.753169+0000","last_undegraded":"2024-09-12T22:35:33.753169+0000","last_fullsized":"2024-09-12T22:35:33.753169+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":277,"log_dups_size":0,"ondisk_log_size":277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:10:23.649578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":216,"num_write_kb":4193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":156,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752259+0000","last_change":"2024-09-12T22:35:20.736644+0000","last_active":"2024-09-12T22:35:33.752259+0000","last_peered":"2024-09-12T22:35:33.752259+0000","last_clean":"2024-09-12T22:35:33.752259+0000","last_became_active":"2024-09-12T22:35:20.736428+0000","last_became_peered":"2024-09-12T22:35:20.736428+0000","last_unstale":"2024-09-12T22:35:33.752259+0000","last_undegraded":"2024-09-12T22:35:33.752259+0000","last_fullsized":"2024-09-12T22:35:33.752259+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041972500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"60'355","reported_seq":457,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752866+0000","last_change":"2024-09-12T22:35:25.729864+0000","last_active":"2024-09-12T22:35:33.752866+0000","last_peered":"2024-09-12T22:35:33.752866+0000","last_clean":"2024-09-12T22:35:33.752866+0000","last_became_active":"2024-09-12T22:35:25.727299+0000","last_became_peered":"2024-09-12T22:35:25.727299+0000","last_unstale":"2024-09-12T22:35:33.752866+0000","last_undegraded":"2024-09-12T22:35:33.752866+0000","last_fullsized":"2024-09-12T22:35:33.752866+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":355,"log_dups_size":0,"ondisk_log_size":355,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:56:40.812767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13196,"num_write":321,"num_write_kb":41797,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"60'55","reported_seq":198,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752145+0000","last_change":"2024-09-12T22:35:20.738078+0000","last_active":"2024-09-12T22:35:33.752145+0000","last_peered":"2024-09-12T22:35:33.752145+0000","last_clean":"2024-09-12T22:35:33.752145+0000","last_became_active":"2024-09-12T22:35:20.737705+0000","last_became_peered":"2024-09-12T22:35:20.737705+0000","last_unstale":"2024-09-12T22:35:33.752145+0000","last_undegraded":"2024-09-12T22:35:33.752145+0000","last_fullsized":"2024-09-12T22:35:33.752145+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":68,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.754453+0000","last_change":"2024-09-12T22:35:20.738327+0000","last_active":"2024-09-12T22:35:33.754453+0000","last_peered":"2024-09-12T22:35:33.754453+0000","last_clean":"2024-09-12T22:35:33.754453+0000","last_became_active":"2024-09-12T22:35:20.737799+0000","last_became_peered":"2024-09-12T22:35:20.737799+0000","last_unstale":"2024-09-12T22:35:33.754453+0000","last_undegraded":"2024-09-12T22:35:33.754453+0000","last_fullsized":"2024-09-12T22:35:33.754453+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:03:16.381453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"60'385","reported_seq":533,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.761943+0000","last_change":"2024-09-12T22:35:33.761943+0000","last_active":"2024-09-12T22:35:33.761943+0000","last_peered":"2024-09-12T22:35:33.761943+0000","last_clean":"2024-09-12T22:35:33.761943+0000","last_became_active":"2024-09-12T22:35:33.754546+0000","last_became_peered":"2024-09-12T22:35:33.754546+0000","last_unstale":"2024-09-12T22:35:33.761943+0000","last_undegraded":"2024-09-12T22:35:33.761943+0000","last_fullsized":"2024-09-12T22:35:33.761943+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:35:36.478089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":22437,"num_write":347,"num_write_kb":30121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"60'61","reported_seq":205,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752809+0000","last_change":"2024-09-12T22:35:20.738494+0000","last_active":"2024-09-12T22:35:33.752809+0000","last_peered":"2024-09-12T22:35:33.752809+0000","last_clean":"2024-09-12T22:35:33.752809+0000","last_became_active":"2024-09-12T22:35:20.738129+0000","last_became_peered":"2024-09-12T22:35:20.738129+0000","last_unstale":"2024-09-12T22:35:33.752809+0000","last_undegraded":"2024-09-12T22:35:33.752809+0000","last_fullsized":"2024-09-12T22:35:33.752809+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":156,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752870+0000","last_change":"2024-09-12T22:35:20.736934+0000","last_active":"2024-09-12T22:35:33.752870+0000","last_peered":"2024-09-12T22:35:33.752870+0000","last_clean":"2024-09-12T22:35:33.752870+0000","last_became_active":"2024-09-12T22:35:20.736628+0000","last_became_peered":"2024-09-12T22:35:20.736628+0000","last_unstale":"2024-09-12T22:35:33.752870+0000","last_undegraded":"2024-09-12T22:35:33.752870+0000","last_fullsized":"2024-09-12T22:35:33.752870+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058589999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"60'402","reported_seq":555,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:39.562686+0000","last_change":"2024-09-12T22:31:37.411152+0000","last_active":"2024-09-12T22:35:39.562686+0000","last_peered":"2024-09-12T22:35:39.562686+0000","last_clean":"2024-09-12T22:35:39.562686+0000","last_became_active":"2024-09-12T22:31:37.410558+0000","last_became_peered":"2024-09-12T22:31:37.410558+0000","last_unstale":"2024-09-12T22:35:39.562686+0000","last_undegraded":"2024-09-12T22:35:39.562686+0000","last_fullsized":"2024-09-12T22:35:39.562686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":10169,"num_write":370,"num_write_kb":38130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"61'105","reported_seq":241,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752788+0000","last_change":"2024-09-12T22:31:36.407460+0000","last_active":"2024-09-12T22:35:33.752788+0000","last_peered":"2024-09-12T22:35:33.752788+0000","last_clean":"2024-09-12T22:35:33.752788+0000","last_became_active":"2024-09-12T22:31:36.406729+0000","last_became_peered":"2024-09-12T22:31:36.406729+0000","last_unstale":"2024-09-12T22:35:33.752788+0000","last_undegraded":"2024-09-12T22:35:33.752788+0000","last_fullsized":"2024-09-12T22:35:33.752788+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103,"num_write_kb":1085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":155,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752930+0000","last_change":"2024-09-12T22:35:20.737068+0000","last_active":"2024-09-12T22:35:33.752930+0000","last_peered":"2024-09-12T22:35:33.752930+0000","last_clean":"2024-09-12T22:35:33.752930+0000","last_became_active":"2024-09-12T22:35:20.736769+0000","last_became_peered":"2024-09-12T22:35:20.736769+0000","last_unstale":"2024-09-12T22:35:33.752930+0000","last_undegraded":"2024-09-12T22:35:33.752930+0000","last_fullsized":"2024-09-12T22:35:33.752930+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:44:36.675350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000382109,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"60'412","reported_seq":550,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752676+0000","last_change":"2024-09-12T22:35:26.734859+0000","last_active":"2024-09-12T22:35:33.752676+0000","last_peered":"2024-09-12T22:35:33.752676+0000","last_clean":"2024-09-12T22:35:33.752676+0000","last_became_active":"2024-09-12T22:35:26.732923+0000","last_became_peered":"2024-09-12T22:35:26.732923+0000","last_unstale":"2024-09-12T22:35:33.752676+0000","last_undegraded":"2024-09-12T22:35:33.752676+0000","last_fullsized":"2024-09-12T22:35:33.752676+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:48:09.924688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":34504,"num_write":385,"num_write_kb":100438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"60'415","reported_seq":968,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.751983+0000","last_change":"2024-09-12T22:35:24.760883+0000","last_active":"2024-09-12T22:35:33.751983+0000","last_peered":"2024-09-12T22:35:33.751983+0000","last_clean":"2024-09-12T22:35:33.751983+0000","last_became_active":"2024-09-12T22:35:24.759441+0000","last_became_peered":"2024-09-12T22:35:24.759441+0000","last_unstale":"2024-09-12T22:35:33.751983+0000","last_undegraded":"2024-09-12T22:35:33.751983+0000","last_fullsized":"2024-09-12T22:35:33.751983+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:26:21.054210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":37207,"num_write":375,"num_write_kb":84660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"60'221","reported_seq":374,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752760+0000","last_change":"2024-09-12T22:35:23.756290+0000","last_active":"2024-09-12T22:35:33.752760+0000","last_peered":"2024-09-12T22:35:33.752760+0000","last_clean":"2024-09-12T22:35:33.752760+0000","last_became_active":"2024-09-12T22:35:23.755918+0000","last_became_peered":"2024-09-12T22:35:23.755918+0000","last_unstale":"2024-09-12T22:35:33.752760+0000","last_undegraded":"2024-09-12T22:35:33.752760+0000","last_fullsized":"2024-09-12T22:35:33.752760+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":221,"log_dups_size":0,"ondisk_log_size":221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:08:03.811119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":175,"num_write_kb":8282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":8382815,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"60'429","reported_seq":962,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.751668+0000","last_change":"2024-09-12T22:35:25.728726+0000","last_active":"2024-09-12T22:35:33.751668+0000","last_peered":"2024-09-12T22:35:33.751668+0000","last_clean":"2024-09-12T22:35:33.751668+0000","last_became_active":"2024-09-12T22:35:25.726837+0000","last_became_peered":"2024-09-12T22:35:25.726837+0000","last_unstale":"2024-09-12T22:35:33.751668+0000","last_undegraded":"2024-09-12T22:35:33.751668+0000","last_fullsized":"2024-09-12T22:35:33.751668+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":12230,"num_write":389,"num_write_kb":71746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"60'98","reported_seq":217,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.760239+0000","last_change":"2024-09-12T22:35:33.760239+0000","last_active":"2024-09-12T22:35:33.760239+0000","last_peered":"2024-09-12T22:35:33.760239+0000","last_clean":"2024-09-12T22:35:33.760239+0000","last_became_active":"2024-09-12T22:35:33.758640+0000","last_became_peered":"2024-09-12T22:35:33.758640+0000","last_unstale":"2024-09-12T22:35:33.760239+0000","last_undegraded":"2024-09-12T22:35:33.760239+0000","last_fullsized":"2024-09-12T22:35:33.760239+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:24:11.251168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"60'214","reported_seq":349,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752661+0000","last_change":"2024-09-12T22:31:36.411549+0000","last_active":"2024-09-12T22:35:33.752661+0000","last_peered":"2024-09-12T22:35:33.752661+0000","last_clean":"2024-09-12T22:35:33.752661+0000","last_became_active":"2024-09-12T22:31:36.410674+0000","last_became_peered":"2024-09-12T22:31:36.410674+0000","last_unstale":"2024-09-12T22:35:33.752661+0000","last_undegraded":"2024-09-12T22:35:33.752661+0000","last_fullsized":"2024-09-12T22:35:33.752661+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:58:05.676197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":151,"num_write_kb":4168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"60'460","reported_seq":623,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.751713+0000","last_change":"2024-09-12T22:31:37.411254+0000","last_active":"2024-09-12T22:35:33.751713+0000","last_peered":"2024-09-12T22:35:33.751713+0000","last_clean":"2024-09-12T22:35:33.751713+0000","last_became_active":"2024-09-12T22:31:37.410404+0000","last_became_peered":"2024-09-12T22:31:37.410404+0000","last_unstale":"2024-09-12T22:35:33.751713+0000","last_undegraded":"2024-09-12T22:35:33.751713+0000","last_fullsized":"2024-09-12T22:35:33.751713+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":15059,"num_write":431,"num_write_kb":59615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"60'52","reported_seq":188,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752687+0000","last_change":"2024-09-12T22:31:36.408390+0000","last_active":"2024-09-12T22:35:33.752687+0000","last_peered":"2024-09-12T22:35:33.752687+0000","last_clean":"2024-09-12T22:35:33.752687+0000","last_became_active":"2024-09-12T22:31:36.407062+0000","last_became_peered":"2024-09-12T22:31:36.407062+0000","last_unstale":"2024-09-12T22:35:33.752687+0000","last_undegraded":"2024-09-12T22:35:33.752687+0000","last_fullsized":"2024-09-12T22:35:33.752687+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"60'461","reported_seq":1026,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.751547+0000","last_change":"2024-09-12T22:35:28.731581+0000","last_active":"2024-09-12T22:35:33.751547+0000","last_peered":"2024-09-12T22:35:33.751547+0000","last_clean":"2024-09-12T22:35:33.751547+0000","last_became_active":"2024-09-12T22:35:28.730402+0000","last_became_peered":"2024-09-12T22:35:28.730402+0000","last_unstale":"2024-09-12T22:35:33.751547+0000","last_undegraded":"2024-09-12T22:35:33.751547+0000","last_fullsized":"2024-09-12T22:35:33.751547+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":17508,"num_write":431,"num_write_kb":67883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":200,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"60'355","reported_seq":479,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752557+0000","last_change":"2024-09-12T22:35:28.732887+0000","last_active":"2024-09-12T22:35:33.752557+0000","last_peered":"2024-09-12T22:35:33.752557+0000","last_clean":"2024-09-12T22:35:33.752557+0000","last_became_active":"2024-09-12T22:35:28.730931+0000","last_became_peered":"2024-09-12T22:35:28.730931+0000","last_unstale":"2024-09-12T22:35:33.752557+0000","last_undegraded":"2024-09-12T22:35:33.752557+0000","last_fullsized":"2024-09-12T22:35:33.752557+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":355,"log_dups_size":0,"ondisk_log_size":355,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:14:12.194559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":44561,"num_write":329,"num_write_kb":26431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"60'548","reported_seq":699,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.751686+0000","last_change":"2024-09-12T22:35:23.756287+0000","last_active":"2024-09-12T22:35:33.751686+0000","last_peered":"2024-09-12T22:35:33.751686+0000","last_clean":"2024-09-12T22:35:33.751686+0000","last_became_active":"2024-09-12T22:35:23.755812+0000","last_became_peered":"2024-09-12T22:35:23.755812+0000","last_unstale":"2024-09-12T22:35:33.751686+0000","last_undegraded":"2024-09-12T22:35:33.751686+0000","last_fullsized":"2024-09-12T22:35:33.751686+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":548,"log_dups_size":0,"ondisk_log_size":548,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":488,"num_write_kb":8420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"60'422","reported_seq":669,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:39.562882+0000","last_change":"2024-09-12T22:31:37.411183+0000","last_active":"2024-09-12T22:35:39.562882+0000","last_peered":"2024-09-12T22:35:39.562882+0000","last_clean":"2024-09-12T22:35:39.562882+0000","last_became_active":"2024-09-12T22:31:37.409796+0000","last_became_peered":"2024-09-12T22:31:37.409796+0000","last_unstale":"2024-09-12T22:35:39.562882+0000","last_undegraded":"2024-09-12T22:35:39.562882+0000","last_fullsized":"2024-09-12T22:35:39.562882+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":51020,"num_write":397,"num_write_kb":73116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"60'180","reported_seq":316,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.751759+0000","last_change":"2024-09-12T22:31:36.407402+0000","last_active":"2024-09-12T22:35:33.751759+0000","last_peered":"2024-09-12T22:35:33.751759+0000","last_clean":"2024-09-12T22:35:33.751759+0000","last_became_active":"2024-09-12T22:31:36.406681+0000","last_became_peered":"2024-09-12T22:31:36.406681+0000","last_unstale":"2024-09-12T22:35:33.751759+0000","last_undegraded":"2024-09-12T22:35:33.751759+0000","last_fullsized":"2024-09-12T22:35:33.751759+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":134,"num_write_kb":4167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"60'420","reported_seq":545,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.753501+0000","last_change":"2024-09-12T22:35:30.734995+0000","last_active":"2024-09-12T22:35:33.753501+0000","last_peered":"2024-09-12T22:35:33.753501+0000","last_clean":"2024-09-12T22:35:33.753501+0000","last_became_active":"2024-09-12T22:35:30.733182+0000","last_became_peered":"2024-09-12T22:35:30.733182+0000","last_unstale":"2024-09-12T22:35:33.753501+0000","last_undegraded":"2024-09-12T22:35:33.753501+0000","last_fullsized":"2024-09-12T22:35:33.753501+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:01:30.939801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":24901,"num_write":369,"num_write_kb":75198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"61'212","reported_seq":324,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.755961+0000","last_change":"2024-09-12T22:35:33.755961+0000","last_active":"2024-09-12T22:35:33.755961+0000","last_peered":"2024-09-12T22:35:33.755961+0000","last_clean":"2024-09-12T22:35:33.755961+0000","last_became_active":"2024-09-12T22:35:33.754931+0000","last_became_peered":"2024-09-12T22:35:33.754931+0000","last_unstale":"2024-09-12T22:35:33.755961+0000","last_undegraded":"2024-09-12T22:35:33.755961+0000","last_fullsized":"2024-09-12T22:35:33.755961+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:12:35.586196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12553847,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":12334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"60'398","reported_seq":539,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.763810+0000","last_change":"2024-09-12T22:35:33.763810+0000","last_active":"2024-09-12T22:35:33.763810+0000","last_peered":"2024-09-12T22:35:33.763810+0000","last_clean":"2024-09-12T22:35:33.763810+0000","last_became_active":"2024-09-12T22:35:33.755497+0000","last_became_peered":"2024-09-12T22:35:33.755497+0000","last_unstale":"2024-09-12T22:35:33.763810+0000","last_undegraded":"2024-09-12T22:35:33.763810+0000","last_fullsized":"2024-09-12T22:35:33.763810+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:19:50.330571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":11429,"num_write":361,"num_write_kb":88082,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"60'54","reported_seq":55,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752689+0000","last_change":"2024-09-12T22:35:20.759946+0000","last_active":"2024-09-12T22:35:33.752689+0000","last_peered":"2024-09-12T22:35:33.752689+0000","last_clean":"2024-09-12T22:35:33.752689+0000","last_became_active":"2024-09-12T22:35:20.733271+0000","last_became_peered":"2024-09-12T22:35:20.733271+0000","last_unstale":"2024-09-12T22:35:33.752689+0000","last_undegraded":"2024-09-12T22:35:33.752689+0000","last_fullsized":"2024-09-12T22:35:33.752689+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:49:02.164294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"60'359","reported_seq":512,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.751925+0000","last_change":"2024-09-12T22:31:37.415365+0000","last_active":"2024-09-12T22:35:33.751925+0000","last_peered":"2024-09-12T22:35:33.751925+0000","last_clean":"2024-09-12T22:35:33.751925+0000","last_became_active":"2024-09-12T22:31:37.413933+0000","last_became_peered":"2024-09-12T22:31:37.413933+0000","last_unstale":"2024-09-12T22:35:33.751925+0000","last_undegraded":"2024-09-12T22:35:33.751925+0000","last_fullsized":"2024-09-12T22:35:33.751925+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:08:07.115355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":12324,"num_write":332,"num_write_kb":46371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"60'186","reported_seq":321,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752637+0000","last_change":"2024-09-12T22:31:36.411665+0000","last_active":"2024-09-12T22:35:33.752637+0000","last_peered":"2024-09-12T22:35:33.752637+0000","last_clean":"2024-09-12T22:35:33.752637+0000","last_became_active":"2024-09-12T22:31:36.410182+0000","last_became_peered":"2024-09-12T22:31:36.410182+0000","last_unstale":"2024-09-12T22:35:33.752637+0000","last_undegraded":"2024-09-12T22:35:33.752637+0000","last_fullsized":"2024-09-12T22:35:33.752637+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:37:20.891838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":4160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"60'401","reported_seq":570,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752012+0000","last_change":"2024-09-12T22:31:37.415172+0000","last_active":"2024-09-12T22:35:33.752012+0000","last_peered":"2024-09-12T22:35:33.752012+0000","last_clean":"2024-09-12T22:35:33.752012+0000","last_became_active":"2024-09-12T22:31:37.414776+0000","last_became_peered":"2024-09-12T22:31:37.414776+0000","last_unstale":"2024-09-12T22:35:33.752012+0000","last_undegraded":"2024-09-12T22:35:33.752012+0000","last_fullsized":"2024-09-12T22:35:33.752012+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:42:32.307876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":24207,"num_write":361,"num_write_kb":50515,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"60'244","reported_seq":365,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.759131+0000","last_change":"2024-09-12T22:35:33.759131+0000","last_active":"2024-09-12T22:35:33.759131+0000","last_peered":"2024-09-12T22:35:33.759131+0000","last_clean":"2024-09-12T22:35:33.759131+0000","last_became_active":"2024-09-12T22:35:33.757550+0000","last_became_peered":"2024-09-12T22:35:33.757550+0000","last_unstale":"2024-09-12T22:35:33.759131+0000","last_undegraded":"2024-09-12T22:35:33.759131+0000","last_fullsized":"2024-09-12T22:35:33.759131+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":244,"log_dups_size":0,"ondisk_log_size":244,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:16:17.926249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":12389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"60'439","reported_seq":927,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.751404+0000","last_change":"2024-09-12T22:35:27.731026+0000","last_active":"2024-09-12T22:35:33.751404+0000","last_peered":"2024-09-12T22:35:33.751404+0000","last_clean":"2024-09-12T22:35:33.751404+0000","last_became_active":"2024-09-12T22:35:27.729827+0000","last_became_peered":"2024-09-12T22:35:27.729827+0000","last_unstale":"2024-09-12T22:35:33.751404+0000","last_undegraded":"2024-09-12T22:35:33.751404+0000","last_fullsized":"2024-09-12T22:35:33.751404+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:21:02.543670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":6311,"num_write":403,"num_write_kb":64161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"60'51","reported_seq":200,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:39.562645+0000","last_change":"2024-09-12T22:35:20.764696+0000","last_active":"2024-09-12T22:35:39.562645+0000","last_peered":"2024-09-12T22:35:39.562645+0000","last_clean":"2024-09-12T22:35:39.562645+0000","last_became_active":"2024-09-12T22:35:20.737444+0000","last_became_peered":"2024-09-12T22:35:20.737444+0000","last_unstale":"2024-09-12T22:35:39.562645+0000","last_undegraded":"2024-09-12T22:35:39.562645+0000","last_fullsized":"2024-09-12T22:35:39.562645+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"60'438","reported_seq":624,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.751812+0000","last_change":"2024-09-12T22:31:37.415390+0000","last_active":"2024-09-12T22:35:33.751812+0000","last_peered":"2024-09-12T22:35:33.751812+0000","last_clean":"2024-09-12T22:35:33.751812+0000","last_became_active":"2024-09-12T22:31:37.414781+0000","last_became_peered":"2024-09-12T22:31:37.414781+0000","last_unstale":"2024-09-12T22:35:33.751812+0000","last_undegraded":"2024-09-12T22:35:33.751812+0000","last_fullsized":"2024-09-12T22:35:33.751812+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:42:17.728844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":29290,"num_write":407,"num_write_kb":46733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"60'111","reported_seq":247,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752572+0000","last_change":"2024-09-12T22:31:36.407945+0000","last_active":"2024-09-12T22:35:33.752572+0000","last_peered":"2024-09-12T22:35:33.752572+0000","last_clean":"2024-09-12T22:35:33.752572+0000","last_became_active":"2024-09-12T22:31:36.406959+0000","last_became_peered":"2024-09-12T22:31:36.406959+0000","last_unstale":"2024-09-12T22:35:33.752572+0000","last_undegraded":"2024-09-12T22:35:33.752572+0000","last_fullsized":"2024-09-12T22:35:33.752572+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61,"num_write_kb":4126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2747,"num_read_kb":1535780,"num_write":24498,"num_write_kb":4269351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5680,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26636,"ondisk_log_size":26636,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127268954,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":43,"num_read_kb":1462,"num_write":4457,"num_write_kb":127482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":54520159,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":254603264,"data_stored":254537908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4442,"internal_metadata":0},"log_size":6263,"ondisk_log_size":6263,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705719,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":174088,"kb_used_data":84656,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94197752,"statfs":{"total":96636764160,"available":96458498048,"internally_reserved":0,"allocated":86687744,"data_stored":86276944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":66,"seq":283467841542,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":145348,"kb_used_data":87280,"kb_used_omap":5,"kb_used_meta":58042,"kb_avail":94226492,"statfs":{"total":96636764160,"available":96487927808,"internally_reserved":0,"allocated":89374720,"data_stored":88974119,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6037,"internal_metadata":59435115},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738424,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":173528,"kb_used_data":79932,"kb_used_omap":1,"kb_used_meta":93566,"kb_avail":94198312,"statfs":{"total":96636764160,"available":96459071488,"internally_reserved":0,"allocated":81850368,"data_stored":81462353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":95812037},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":88076288,"data_stored":88052173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4442,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81141760,"data_stored":81130756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":85385216,"data_stored":85354979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T22:35:40.331 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-12T22:31:36.386296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:35:40.331 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-12T22:31:36.386296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:35:40.331 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-12T22:31:36.386296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:35:40.332 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-12T22:31:36.386296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:35:40.332 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-12T22:31:36.386296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:35:40.332 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-12T22:31:36.386296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:35:40.332 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-12T22:31:36.386296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:35:40.332 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-12T22:31:36.386296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:35:40.332 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-12T22:31:36.386296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:35:40.332 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-12T22:31:36.386296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:35:40.332 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-12T22:31:36.386296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:35:40.332 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-12T22:31:36.386296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:35:40.333 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-09-12T22:31:36.386296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:35:40.333 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-12T22:31:36.386296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:35:40.333 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-09-12T22:31:36.386296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:35:40.333 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-12T22:31:36.386296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:35:40.333 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-09-12T22:31:36.386296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:35:40.333 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-12T22:31:36.386296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:35:40.333 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-12T22:31:36.386296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:35:40.333 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-12T22:31:36.386296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:35:40.334 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-09-12T22:31:36.386296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:35:40.334 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-09-12T22:31:36.386296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:35:40.334 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-12T22:31:36.386296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:35:40.334 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-09-12T22:31:36.386296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:35:40.334 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-09-12T22:31:36.386296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:35:40.334 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-09-12T22:31:36.386296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:35:40.334 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-12T22:31:36.386296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:35:40.334 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-12T22:31:36.386296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:35:40.334 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-12T22:31:36.386296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:35:40.335 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-12T22:31:36.386296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:35:40.335 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-09-12T22:31:36.386296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:35:40.335 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-12T22:31:36.386296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:35:40.335 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-12T22:31:35.383905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:35:40.335 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-12T22:31:36.386296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:35:40.335 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-12T22:31:35.383905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:35:40.335 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-12T22:31:36.386296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:35:40.335 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-12T22:31:35.383905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:35:40.336 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-12T22:31:36.386296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:35:40.336 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-12T22:31:35.383905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:35:40.336 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-12T22:31:35.383905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:35:40.336 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-12T22:31:36.386296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:35:40.336 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-12T22:31:35.383905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:35:40.336 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-12T22:31:36.386296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:35:40.336 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-12T22:31:35.383905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:35:40.336 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-12T22:31:36.386296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:35:40.336 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-12T22:31:35.383905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:35:40.337 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-12T22:31:36.386296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:35:40.337 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-12T22:31:35.383905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:35:40.337 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-12T22:31:36.386296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:35:40.337 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-12T22:31:35.383905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:35:40.337 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-12T22:31:36.386296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:35:40.337 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-12T22:31:35.383905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:35:40.337 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-12T22:31:36.386296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:35:40.337 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-12T22:31:35.383905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:35:40.337 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-12T22:31:36.386296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:35:40.338 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-12T22:31:26.229539+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:35:40.338 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-12T22:31:31.264226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:35:40.338 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-12T22:31:35.383905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:35:40.338 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-12T22:31:36.386296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:35:40.338 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-12T22:31:31.264226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:35:40.338 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-12T22:31:35.383905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:35:40.338 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-12T22:31:36.386296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:35:40.338 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-12T22:31:31.264226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:35:40.338 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-12T22:31:35.383905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:35:40.339 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-12T22:31:36.386296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:35:40.339 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-12T22:31:31.264226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:35:40.339 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-12T22:31:35.383905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:35:40.339 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-12T22:31:36.386296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:35:40.339 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-12T22:31:35.383905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:35:40.339 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-12T22:31:31.264226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:35:40.339 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-12T22:31:36.386296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:35:40.339 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-12T22:31:35.383905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:35:40.340 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-12T22:31:31.264226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:35:40.340 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-12T22:31:36.386296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:35:40.340 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-12T22:31:35.383905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:35:40.340 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-12T22:31:31.264226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:35:40.340 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-12T22:31:36.386296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:35:40.340 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-12T22:31:35.383905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:35:40.340 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-12T22:31:31.264226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:35:40.340 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-09-12T22:31:36.386296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:35:40.341 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-12T22:31:36.386296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:35:40.341 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-12T22:31:35.383905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:35:40.341 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-12T22:31:36.386296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:35:40.341 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-12T22:31:35.383905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:35:40.341 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-12T22:31:35.383905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:35:40.341 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-12T22:31:36.386296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:35:40.341 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-12T22:31:35.383905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:35:40.341 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-12T22:31:36.386296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:35:40.341 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-12T22:31:36.386296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:35:40.342 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-12T22:31:35.383905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:35:40.342 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-12T22:31:36.386296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:35:40.342 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-12T22:31:35.383905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:35:40.342 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-12T22:31:36.386296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:35:40.342 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-12T22:31:35.383905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:35:40.342 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-12T22:31:36.386296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:35:40.342 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-12T22:31:35.383905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:35:40.342 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-12T22:31:36.386296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:35:40.343 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-12T22:31:35.383905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:35:40.343 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-12T22:31:36.386296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:35:40.343 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-12T22:31:35.383905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:35:40.343 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-12T22:31:36.386296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:35:40.343 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-12T22:31:35.383905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:35:40.343 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-12T22:31:36.386296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:35:40.343 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-12T22:31:35.383905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:35:40.343 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T22:36:00.344 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T22:36:00.658 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:36:00.665 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-12T22:36:00.668 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":216,"stamp":"2024-09-12T22:36:00.259721+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":127859341,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":2926,"num_read_kb":1537360,"num_write":29160,"num_write_kb":4400295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5694,"num_bytes_recovered":54520159,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33090,"ondisk_log_size":33090,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":492940,"kb_used_data":251868,"kb_used_omap":9,"kb_used_meta":241014,"kb_avail":282622580,"statfs":{"total":289910292480,"available":289405521920,"internally_reserved":0,"allocated":257912832,"data_stored":256713416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9227,"internal_metadata":246799349},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003258"},"pg_stats":[{"pgid":"4.3f","version":"60'422","reported_seq":545,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:44.101676+0000","last_change":"2024-09-12T22:35:44.101722+0000","last_active":"2024-09-12T22:35:44.101676+0000","last_peered":"2024-09-12T22:35:44.101676+0000","last_clean":"2024-09-12T22:35:44.101676+0000","last_became_active":"2024-09-12T22:35:30.731323+0000","last_became_peered":"2024-09-12T22:35:30.731323+0000","last_unstale":"2024-09-12T22:35:44.101676+0000","last_undegraded":"2024-09-12T22:35:44.101676+0000","last_fullsized":"2024-09-12T22:35:44.101676+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'422","last_scrub_stamp":"2024-09-12T22:35:44.101553+0000","last_deep_scrub":"60'422","last_deep_scrub_stamp":"2024-09-12T22:35:44.101553+0000","last_clean_scrub_stamp":"2024-09-12T22:35:44.101553+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:34:46.406008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":29437,"num_write":385,"num_write_kb":96431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"60'470","reported_seq":632,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.765375+0000","last_change":"2024-09-12T22:35:33.764988+0000","last_active":"2024-09-12T22:35:33.765375+0000","last_peered":"2024-09-12T22:35:33.765375+0000","last_clean":"2024-09-12T22:35:33.765375+0000","last_became_active":"2024-09-12T22:35:33.759906+0000","last_became_peered":"2024-09-12T22:35:33.759906+0000","last_unstale":"2024-09-12T22:35:33.765375+0000","last_undegraded":"2024-09-12T22:35:33.765375+0000","last_fullsized":"2024-09-12T22:35:33.765375+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":18334,"num_write":442,"num_write_kb":109282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"60'391","reported_seq":914,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:40.004593+0000","last_change":"2024-09-12T22:35:30.732861+0000","last_active":"2024-09-12T22:35:40.004593+0000","last_peered":"2024-09-12T22:35:40.004593+0000","last_clean":"2024-09-12T22:35:40.004593+0000","last_became_active":"2024-09-12T22:35:30.731086+0000","last_became_peered":"2024-09-12T22:35:30.731086+0000","last_unstale":"2024-09-12T22:35:40.004593+0000","last_undegraded":"2024-09-12T22:35:40.004593+0000","last_fullsized":"2024-09-12T22:35:40.004593+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":32771,"num_write":355,"num_write_kb":71120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"60'397","reported_seq":590,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:53.683296+0000","last_change":"2024-09-12T22:35:53.683323+0000","last_active":"2024-09-12T22:35:53.683296+0000","last_peered":"2024-09-12T22:35:53.683296+0000","last_clean":"2024-09-12T22:35:53.683296+0000","last_became_active":"2024-09-12T22:31:37.412746+0000","last_became_peered":"2024-09-12T22:31:37.412746+0000","last_unstale":"2024-09-12T22:35:53.683296+0000","last_undegraded":"2024-09-12T22:35:53.683296+0000","last_fullsized":"2024-09-12T22:35:53.683296+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'397","last_scrub_stamp":"2024-09-12T22:35:53.683164+0000","last_deep_scrub":"60'397","last_deep_scrub_stamp":"2024-09-12T22:35:53.683164+0000","last_clean_scrub_stamp":"2024-09-12T22:35:53.683164+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:26:18.488292+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":28544,"num_write":368,"num_write_kb":83737,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"60'458","reported_seq":592,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752936+0000","last_change":"2024-09-12T22:35:24.759019+0000","last_active":"2024-09-12T22:35:33.752936+0000","last_peered":"2024-09-12T22:35:33.752936+0000","last_clean":"2024-09-12T22:35:33.752936+0000","last_became_active":"2024-09-12T22:35:24.756373+0000","last_became_peered":"2024-09-12T22:35:24.756373+0000","last_unstale":"2024-09-12T22:35:33.752936+0000","last_undegraded":"2024-09-12T22:35:33.752936+0000","last_fullsized":"2024-09-12T22:35:33.752936+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":458,"log_dups_size":0,"ondisk_log_size":458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":28467,"num_write":430,"num_write_kb":81329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":198,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"60'381","reported_seq":516,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.751758+0000","last_change":"2024-09-12T22:31:37.409177+0000","last_active":"2024-09-12T22:35:33.751758+0000","last_peered":"2024-09-12T22:35:33.751758+0000","last_clean":"2024-09-12T22:35:33.751758+0000","last_became_active":"2024-09-12T22:31:37.408811+0000","last_became_peered":"2024-09-12T22:31:37.408811+0000","last_unstale":"2024-09-12T22:35:33.751758+0000","last_undegraded":"2024-09-12T22:35:33.751758+0000","last_fullsized":"2024-09-12T22:35:33.751758+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":60,"num_write":353,"num_write_kb":58419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"60'439","reported_seq":627,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:55.713294+0000","last_change":"2024-09-12T22:35:55.713323+0000","last_active":"2024-09-12T22:35:55.713294+0000","last_peered":"2024-09-12T22:35:55.713294+0000","last_clean":"2024-09-12T22:35:55.713294+0000","last_became_active":"2024-09-12T22:31:37.412691+0000","last_became_peered":"2024-09-12T22:31:37.412691+0000","last_unstale":"2024-09-12T22:35:55.713294+0000","last_undegraded":"2024-09-12T22:35:55.713294+0000","last_fullsized":"2024-09-12T22:35:55.713294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'439","last_scrub_stamp":"2024-09-12T22:35:55.713169+0000","last_deep_scrub":"60'439","last_deep_scrub_stamp":"2024-09-12T22:35:55.713169+0000","last_clean_scrub_stamp":"2024-09-12T22:35:55.713169+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:43:06.981277+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":27053,"num_write":405,"num_write_kb":79743,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"60'384","reported_seq":590,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.751527+0000","last_change":"2024-09-12T22:31:37.411074+0000","last_active":"2024-09-12T22:35:33.751527+0000","last_peered":"2024-09-12T22:35:33.751527+0000","last_clean":"2024-09-12T22:35:33.751527+0000","last_became_active":"2024-09-12T22:31:37.410633+0000","last_became_peered":"2024-09-12T22:31:37.410633+0000","last_unstale":"2024-09-12T22:35:33.751527+0000","last_undegraded":"2024-09-12T22:35:33.751527+0000","last_fullsized":"2024-09-12T22:35:33.751527+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":44358,"num_write":338,"num_write_kb":67411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"60'418","reported_seq":1003,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752329+0000","last_change":"2024-09-12T22:35:28.732156+0000","last_active":"2024-09-12T22:35:33.752329+0000","last_peered":"2024-09-12T22:35:33.752329+0000","last_clean":"2024-09-12T22:35:33.752329+0000","last_became_active":"2024-09-12T22:35:28.731002+0000","last_became_peered":"2024-09-12T22:35:28.731002+0000","last_unstale":"2024-09-12T22:35:33.752329+0000","last_undegraded":"2024-09-12T22:35:33.752329+0000","last_fullsized":"2024-09-12T22:35:33.752329+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":48711,"num_write":384,"num_write_kb":63228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"60'406","reported_seq":529,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:49.059929+0000","last_change":"2024-09-12T22:35:49.059973+0000","last_active":"2024-09-12T22:35:49.059929+0000","last_peered":"2024-09-12T22:35:49.059929+0000","last_clean":"2024-09-12T22:35:49.059929+0000","last_became_active":"2024-09-12T22:35:27.729480+0000","last_became_peered":"2024-09-12T22:35:27.729480+0000","last_unstale":"2024-09-12T22:35:49.059929+0000","last_undegraded":"2024-09-12T22:35:49.059929+0000","last_fullsized":"2024-09-12T22:35:49.059929+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'406","last_scrub_stamp":"2024-09-12T22:35:49.059789+0000","last_deep_scrub":"60'406","last_deep_scrub_stamp":"2024-09-12T22:35:49.059789+0000","last_clean_scrub_stamp":"2024-09-12T22:35:49.059789+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:38:19.067922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":21851,"num_write":367,"num_write_kb":79913,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"60'338","reported_seq":488,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:49.695521+0000","last_change":"2024-09-12T22:35:49.695572+0000","last_active":"2024-09-12T22:35:49.695521+0000","last_peered":"2024-09-12T22:35:49.695521+0000","last_clean":"2024-09-12T22:35:49.695521+0000","last_became_active":"2024-09-12T22:31:37.414165+0000","last_became_peered":"2024-09-12T22:31:37.414165+0000","last_unstale":"2024-09-12T22:35:49.695521+0000","last_undegraded":"2024-09-12T22:35:49.695521+0000","last_fullsized":"2024-09-12T22:35:49.695521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'338","last_scrub_stamp":"2024-09-12T22:35:49.695416+0000","last_deep_scrub":"60'338","last_deep_scrub_stamp":"2024-09-12T22:35:49.695416+0000","last_clean_scrub_stamp":"2024-09-12T22:35:49.695416+0000","objects_scrubbed":0,"log_size":338,"log_dups_size":0,"ondisk_log_size":338,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:04:19.237182+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":4053,"num_write":316,"num_write_kb":21475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"60'359","reported_seq":496,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.764680+0000","last_change":"2024-09-12T22:35:33.764173+0000","last_active":"2024-09-12T22:35:33.764680+0000","last_peered":"2024-09-12T22:35:33.764680+0000","last_clean":"2024-09-12T22:35:33.764680+0000","last_became_active":"2024-09-12T22:35:33.760739+0000","last_became_peered":"2024-09-12T22:35:33.760739+0000","last_unstale":"2024-09-12T22:35:33.764680+0000","last_undegraded":"2024-09-12T22:35:33.764680+0000","last_fullsized":"2024-09-12T22:35:33.764680+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":6688,"num_write":330,"num_write_kb":38146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"60'402","reported_seq":538,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.762637+0000","last_change":"2024-09-12T22:35:33.761962+0000","last_active":"2024-09-12T22:35:33.762637+0000","last_peered":"2024-09-12T22:35:33.762637+0000","last_clean":"2024-09-12T22:35:33.762637+0000","last_became_active":"2024-09-12T22:35:33.754938+0000","last_became_peered":"2024-09-12T22:35:33.754938+0000","last_unstale":"2024-09-12T22:35:33.762637+0000","last_undegraded":"2024-09-12T22:35:33.762637+0000","last_fullsized":"2024-09-12T22:35:33.762637+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":16384,"num_write":363,"num_write_kb":62556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"60'409","reported_seq":936,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.751820+0000","last_change":"2024-09-12T22:35:29.737252+0000","last_active":"2024-09-12T22:35:33.751820+0000","last_peered":"2024-09-12T22:35:33.751820+0000","last_clean":"2024-09-12T22:35:33.751820+0000","last_became_active":"2024-09-12T22:35:29.735835+0000","last_became_peered":"2024-09-12T22:35:29.735835+0000","last_unstale":"2024-09-12T22:35:33.751820+0000","last_undegraded":"2024-09-12T22:35:33.751820+0000","last_fullsized":"2024-09-12T22:35:33.751820+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":13943,"num_write":382,"num_write_kb":54682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"60'412","reported_seq":949,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.751865+0000","last_change":"2024-09-12T22:35:28.731566+0000","last_active":"2024-09-12T22:35:33.751865+0000","last_peered":"2024-09-12T22:35:33.751865+0000","last_clean":"2024-09-12T22:35:33.751865+0000","last_became_active":"2024-09-12T22:35:28.730413+0000","last_became_peered":"2024-09-12T22:35:28.730413+0000","last_unstale":"2024-09-12T22:35:33.751865+0000","last_undegraded":"2024-09-12T22:35:33.751865+0000","last_fullsized":"2024-09-12T22:35:33.751865+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":19700,"num_write":377,"num_write_kb":67929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"60'404","reported_seq":538,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.751551+0000","last_change":"2024-09-12T22:31:37.411006+0000","last_active":"2024-09-12T22:35:33.751551+0000","last_peered":"2024-09-12T22:35:33.751551+0000","last_clean":"2024-09-12T22:35:33.751551+0000","last_became_active":"2024-09-12T22:31:37.410557+0000","last_became_peered":"2024-09-12T22:31:37.410557+0000","last_unstale":"2024-09-12T22:35:33.751551+0000","last_undegraded":"2024-09-12T22:35:33.751551+0000","last_fullsized":"2024-09-12T22:35:33.751551+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":368,"num_write_kb":25652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"60'405","reported_seq":941,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752745+0000","last_change":"2024-09-12T22:35:31.732234+0000","last_active":"2024-09-12T22:35:33.752745+0000","last_peered":"2024-09-12T22:35:33.752745+0000","last_clean":"2024-09-12T22:35:33.752745+0000","last_became_active":"2024-09-12T22:35:31.730883+0000","last_became_peered":"2024-09-12T22:35:31.730883+0000","last_unstale":"2024-09-12T22:35:33.752745+0000","last_undegraded":"2024-09-12T22:35:33.752745+0000","last_fullsized":"2024-09-12T22:35:33.752745+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":18251,"num_write":369,"num_write_kb":34203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"60'406","reported_seq":588,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:54.128320+0000","last_change":"2024-09-12T22:35:54.128349+0000","last_active":"2024-09-12T22:35:54.128320+0000","last_peered":"2024-09-12T22:35:54.128320+0000","last_clean":"2024-09-12T22:35:54.128320+0000","last_became_active":"2024-09-12T22:35:33.754915+0000","last_became_peered":"2024-09-12T22:35:33.754915+0000","last_unstale":"2024-09-12T22:35:54.128320+0000","last_undegraded":"2024-09-12T22:35:54.128320+0000","last_fullsized":"2024-09-12T22:35:54.128320+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'406","last_scrub_stamp":"2024-09-12T22:35:54.128229+0000","last_deep_scrub":"60'406","last_deep_scrub_stamp":"2024-09-12T22:35:54.128229+0000","last_clean_scrub_stamp":"2024-09-12T22:35:54.128229+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:30:39.517247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":45843,"num_write":367,"num_write_kb":59097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"60'413","reported_seq":933,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752466+0000","last_change":"2024-09-12T22:35:31.731988+0000","last_active":"2024-09-12T22:35:33.752466+0000","last_peered":"2024-09-12T22:35:33.752466+0000","last_clean":"2024-09-12T22:35:33.752466+0000","last_became_active":"2024-09-12T22:35:31.730742+0000","last_became_peered":"2024-09-12T22:35:31.730742+0000","last_unstale":"2024-09-12T22:35:33.752466+0000","last_undegraded":"2024-09-12T22:35:33.752466+0000","last_fullsized":"2024-09-12T22:35:33.752466+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":20855,"num_write":371,"num_write_kb":71095,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"60'441","reported_seq":630,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:51.677957+0000","last_change":"2024-09-12T22:35:51.678006+0000","last_active":"2024-09-12T22:35:51.677957+0000","last_peered":"2024-09-12T22:35:51.677957+0000","last_clean":"2024-09-12T22:35:51.677957+0000","last_became_active":"2024-09-12T22:31:37.413786+0000","last_became_peered":"2024-09-12T22:31:37.413786+0000","last_unstale":"2024-09-12T22:35:51.677957+0000","last_undegraded":"2024-09-12T22:35:51.677957+0000","last_fullsized":"2024-09-12T22:35:51.677957+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'441","last_scrub_stamp":"2024-09-12T22:35:51.677862+0000","last_deep_scrub":"60'441","last_deep_scrub_stamp":"2024-09-12T22:35:51.677862+0000","last_clean_scrub_stamp":"2024-09-12T22:35:51.677862+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:34:24.660095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":23954,"num_write":419,"num_write_kb":72528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"60'414","reported_seq":623,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752132+0000","last_change":"2024-09-12T22:31:37.415382+0000","last_active":"2024-09-12T22:35:33.752132+0000","last_peered":"2024-09-12T22:35:33.752132+0000","last_clean":"2024-09-12T22:35:33.752132+0000","last_became_active":"2024-09-12T22:31:37.414319+0000","last_became_peered":"2024-09-12T22:31:37.414319+0000","last_unstale":"2024-09-12T22:35:33.752132+0000","last_undegraded":"2024-09-12T22:35:33.752132+0000","last_fullsized":"2024-09-12T22:35:33.752132+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":44129,"num_write":387,"num_write_kb":104899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"60'444","reported_seq":560,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:57.082767+0000","last_change":"2024-09-12T22:35:57.082793+0000","last_active":"2024-09-12T22:35:57.082767+0000","last_peered":"2024-09-12T22:35:57.082767+0000","last_clean":"2024-09-12T22:35:57.082767+0000","last_became_active":"2024-09-12T22:35:25.727269+0000","last_became_peered":"2024-09-12T22:35:25.727269+0000","last_unstale":"2024-09-12T22:35:57.082767+0000","last_undegraded":"2024-09-12T22:35:57.082767+0000","last_fullsized":"2024-09-12T22:35:57.082767+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'444","last_scrub_stamp":"2024-09-12T22:35:57.082674+0000","last_deep_scrub":"60'444","last_deep_scrub_stamp":"2024-09-12T22:35:57.082674+0000","last_clean_scrub_stamp":"2024-09-12T22:35:57.082674+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:11:01.171297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":17411,"num_write":407,"num_write_kb":87850,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"60'421","reported_seq":655,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:56.242217+0000","last_change":"2024-09-12T22:35:56.242246+0000","last_active":"2024-09-12T22:35:56.242217+0000","last_peered":"2024-09-12T22:35:56.242217+0000","last_clean":"2024-09-12T22:35:56.242217+0000","last_became_active":"2024-09-12T22:31:37.409951+0000","last_became_peered":"2024-09-12T22:31:37.409951+0000","last_unstale":"2024-09-12T22:35:56.242217+0000","last_undegraded":"2024-09-12T22:35:56.242217+0000","last_fullsized":"2024-09-12T22:35:56.242217+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'421","last_scrub_stamp":"2024-09-12T22:35:56.242126+0000","last_deep_scrub":"60'421","last_deep_scrub_stamp":"2024-09-12T22:35:56.242126+0000","last_clean_scrub_stamp":"2024-09-12T22:35:56.242126+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:53:59.255839+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":44074,"num_write":389,"num_write_kb":44104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"60'459","reported_seq":623,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:40.989070+0000","last_change":"2024-09-12T22:35:40.989130+0000","last_active":"2024-09-12T22:35:40.989070+0000","last_peered":"2024-09-12T22:35:40.989070+0000","last_clean":"2024-09-12T22:35:40.989070+0000","last_became_active":"2024-09-12T22:35:33.754576+0000","last_became_peered":"2024-09-12T22:35:33.754576+0000","last_unstale":"2024-09-12T22:35:40.989070+0000","last_undegraded":"2024-09-12T22:35:40.989070+0000","last_fullsized":"2024-09-12T22:35:40.989070+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'459","last_scrub_stamp":"2024-09-12T22:35:40.988963+0000","last_deep_scrub":"60'459","last_deep_scrub_stamp":"2024-09-12T22:35:40.988963+0000","last_clean_scrub_stamp":"2024-09-12T22:35:40.988963+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:27:58.591980+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":28605,"num_write":432,"num_write_kb":100377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"60'419","reported_seq":525,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:42.024749+0000","last_change":"2024-09-12T22:35:42.024809+0000","last_active":"2024-09-12T22:35:42.024749+0000","last_peered":"2024-09-12T22:35:42.024749+0000","last_clean":"2024-09-12T22:35:42.024749+0000","last_became_active":"2024-09-12T22:35:29.735450+0000","last_became_peered":"2024-09-12T22:35:29.735450+0000","last_unstale":"2024-09-12T22:35:42.024749+0000","last_undegraded":"2024-09-12T22:35:42.024749+0000","last_fullsized":"2024-09-12T22:35:42.024749+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'419","last_scrub_stamp":"2024-09-12T22:35:42.024639+0000","last_deep_scrub":"60'419","last_deep_scrub_stamp":"2024-09-12T22:35:42.024639+0000","last_clean_scrub_stamp":"2024-09-12T22:35:42.024639+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:53:06.906248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":16852,"num_write":404,"num_write_kb":34622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"60'494","reported_seq":720,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:44.209175+0000","last_change":"2024-09-12T22:35:44.209175+0000","last_active":"2024-09-12T22:35:44.209175+0000","last_peered":"2024-09-12T22:35:44.209175+0000","last_clean":"2024-09-12T22:35:44.209175+0000","last_became_active":"2024-09-12T22:31:37.410563+0000","last_became_peered":"2024-09-12T22:31:37.410563+0000","last_unstale":"2024-09-12T22:35:44.209175+0000","last_undegraded":"2024-09-12T22:35:44.209175+0000","last_fullsized":"2024-09-12T22:35:44.209175+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'494","last_scrub_stamp":"2024-09-12T22:35:44.209026+0000","last_deep_scrub":"60'494","last_deep_scrub_stamp":"2024-09-12T22:35:44.209026+0000","last_clean_scrub_stamp":"2024-09-12T22:35:44.209026+0000","objects_scrubbed":0,"log_size":494,"log_dups_size":0,"ondisk_log_size":494,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:13:03.173567+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":35239,"num_write":450,"num_write_kb":76898,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"60'401","reported_seq":924,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752695+0000","last_change":"2024-09-12T22:35:30.732843+0000","last_active":"2024-09-12T22:35:33.752695+0000","last_peered":"2024-09-12T22:35:33.752695+0000","last_clean":"2024-09-12T22:35:33.752695+0000","last_became_active":"2024-09-12T22:35:30.731155+0000","last_became_peered":"2024-09-12T22:35:30.731155+0000","last_unstale":"2024-09-12T22:35:33.752695+0000","last_undegraded":"2024-09-12T22:35:33.752695+0000","last_fullsized":"2024-09-12T22:35:33.752695+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":10993,"num_write":369,"num_write_kb":55171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"60'390","reported_seq":539,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.764484+0000","last_change":"2024-09-12T22:35:33.763890+0000","last_active":"2024-09-12T22:35:33.764484+0000","last_peered":"2024-09-12T22:35:33.764484+0000","last_clean":"2024-09-12T22:35:33.764484+0000","last_became_active":"2024-09-12T22:35:33.756108+0000","last_became_peered":"2024-09-12T22:35:33.756108+0000","last_unstale":"2024-09-12T22:35:33.764484+0000","last_undegraded":"2024-09-12T22:35:33.764484+0000","last_fullsized":"2024-09-12T22:35:33.764484+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":18588,"num_write":360,"num_write_kb":59307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"60'429","reported_seq":1017,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:55.226657+0000","last_change":"2024-09-12T22:35:55.226704+0000","last_active":"2024-09-12T22:35:55.226657+0000","last_peered":"2024-09-12T22:35:55.226657+0000","last_clean":"2024-09-12T22:35:55.226657+0000","last_became_active":"2024-09-12T22:35:23.755618+0000","last_became_peered":"2024-09-12T22:35:23.755618+0000","last_unstale":"2024-09-12T22:35:55.226657+0000","last_undegraded":"2024-09-12T22:35:55.226657+0000","last_fullsized":"2024-09-12T22:35:55.226657+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'429","last_scrub_stamp":"2024-09-12T22:35:55.226556+0000","last_deep_scrub":"60'429","last_deep_scrub_stamp":"2024-09-12T22:35:55.226556+0000","last_clean_scrub_stamp":"2024-09-12T22:35:55.226556+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:42:10.514737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":32541,"num_write":398,"num_write_kb":76609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"60'458","reported_seq":584,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:45.065775+0000","last_change":"2024-09-12T22:35:45.065802+0000","last_active":"2024-09-12T22:35:45.065775+0000","last_peered":"2024-09-12T22:35:45.065775+0000","last_clean":"2024-09-12T22:35:45.065775+0000","last_became_active":"2024-09-12T22:35:28.730337+0000","last_became_peered":"2024-09-12T22:35:28.730337+0000","last_unstale":"2024-09-12T22:35:45.065775+0000","last_undegraded":"2024-09-12T22:35:45.065775+0000","last_fullsized":"2024-09-12T22:35:45.065775+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'458","last_scrub_stamp":"2024-09-12T22:35:45.065680+0000","last_deep_scrub":"60'458","last_deep_scrub_stamp":"2024-09-12T22:35:45.065680+0000","last_clean_scrub_stamp":"2024-09-12T22:35:45.065680+0000","objects_scrubbed":0,"log_size":458,"log_dups_size":0,"ondisk_log_size":458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:54.975726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":16425,"num_write":413,"num_write_kb":47110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"60'432","reported_seq":992,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:40.156788+0000","last_change":"2024-09-12T22:35:40.156788+0000","last_active":"2024-09-12T22:35:40.156788+0000","last_peered":"2024-09-12T22:35:40.156788+0000","last_clean":"2024-09-12T22:35:40.156788+0000","last_became_active":"2024-09-12T22:35:26.731135+0000","last_became_peered":"2024-09-12T22:35:26.731135+0000","last_unstale":"2024-09-12T22:35:40.156788+0000","last_undegraded":"2024-09-12T22:35:40.156788+0000","last_fullsized":"2024-09-12T22:35:40.156788+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'432","last_scrub_stamp":"2024-09-12T22:35:40.156631+0000","last_deep_scrub":"60'432","last_deep_scrub_stamp":"2024-09-12T22:35:40.156631+0000","last_clean_scrub_stamp":"2024-09-12T22:35:40.156631+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:37:49.074651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":21090,"num_write":393,"num_write_kb":67477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"60'458","reported_seq":646,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:48.723864+0000","last_change":"2024-09-12T22:35:48.723864+0000","last_active":"2024-09-12T22:35:48.723864+0000","last_peered":"2024-09-12T22:35:48.723864+0000","last_clean":"2024-09-12T22:35:48.723864+0000","last_became_active":"2024-09-12T22:31:37.414265+0000","last_became_peered":"2024-09-12T22:31:37.414265+0000","last_unstale":"2024-09-12T22:35:48.723864+0000","last_undegraded":"2024-09-12T22:35:48.723864+0000","last_fullsized":"2024-09-12T22:35:48.723864+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'458","last_scrub_stamp":"2024-09-12T22:35:48.723701+0000","last_deep_scrub":"60'458","last_deep_scrub_stamp":"2024-09-12T22:35:48.723701+0000","last_clean_scrub_stamp":"2024-09-12T22:35:48.723701+0000","objects_scrubbed":0,"log_size":458,"log_dups_size":0,"ondisk_log_size":458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:22:45.422855+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":37395,"num_write":421,"num_write_kb":73250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"60'411","reported_seq":584,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.764662+0000","last_change":"2024-09-12T22:35:33.764162+0000","last_active":"2024-09-12T22:35:33.764662+0000","last_peered":"2024-09-12T22:35:33.764662+0000","last_clean":"2024-09-12T22:35:33.764662+0000","last_became_active":"2024-09-12T22:35:33.761121+0000","last_became_peered":"2024-09-12T22:35:33.761121+0000","last_unstale":"2024-09-12T22:35:33.764662+0000","last_undegraded":"2024-09-12T22:35:33.764662+0000","last_fullsized":"2024-09-12T22:35:33.764662+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":36400,"num_write":371,"num_write_kb":92142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"60'546","reported_seq":682,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752214+0000","last_change":"2024-09-12T22:31:36.412082+0000","last_active":"2024-09-12T22:35:33.752214+0000","last_peered":"2024-09-12T22:35:33.752214+0000","last_clean":"2024-09-12T22:35:33.752214+0000","last_became_active":"2024-09-12T22:31:36.410871+0000","last_became_peered":"2024-09-12T22:31:36.410871+0000","last_unstale":"2024-09-12T22:35:33.752214+0000","last_undegraded":"2024-09-12T22:35:33.752214+0000","last_fullsized":"2024-09-12T22:35:33.752214+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":546,"log_dups_size":0,"ondisk_log_size":546,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":495,"num_write_kb":8426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"60'427","reported_seq":607,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:48.109072+0000","last_change":"2024-09-12T22:35:48.109100+0000","last_active":"2024-09-12T22:35:48.109072+0000","last_peered":"2024-09-12T22:35:48.109072+0000","last_clean":"2024-09-12T22:35:48.109072+0000","last_became_active":"2024-09-12T22:35:31.730237+0000","last_became_peered":"2024-09-12T22:35:31.730237+0000","last_unstale":"2024-09-12T22:35:48.109072+0000","last_undegraded":"2024-09-12T22:35:48.109072+0000","last_fullsized":"2024-09-12T22:35:48.109072+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'427","last_scrub_stamp":"2024-09-12T22:35:48.108962+0000","last_deep_scrub":"60'427","last_deep_scrub_stamp":"2024-09-12T22:35:48.108962+0000","last_clean_scrub_stamp":"2024-09-12T22:35:48.108962+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:37:11.699764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":59223,"num_write":394,"num_write_kb":80309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":175,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"60'55","reported_seq":191,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752139+0000","last_change":"2024-09-12T22:31:36.408563+0000","last_active":"2024-09-12T22:35:33.752139+0000","last_peered":"2024-09-12T22:35:33.752139+0000","last_clean":"2024-09-12T22:35:33.752139+0000","last_became_active":"2024-09-12T22:31:36.407447+0000","last_became_peered":"2024-09-12T22:31:36.407447+0000","last_unstale":"2024-09-12T22:35:33.752139+0000","last_undegraded":"2024-09-12T22:35:33.752139+0000","last_fullsized":"2024-09-12T22:35:33.752139+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"60'424","reported_seq":597,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:46.125858+0000","last_change":"2024-09-12T22:35:46.125885+0000","last_active":"2024-09-12T22:35:46.125858+0000","last_peered":"2024-09-12T22:35:46.125858+0000","last_clean":"2024-09-12T22:35:46.125858+0000","last_became_active":"2024-09-12T22:31:37.411168+0000","last_became_peered":"2024-09-12T22:31:37.411168+0000","last_unstale":"2024-09-12T22:35:46.125858+0000","last_undegraded":"2024-09-12T22:35:46.125858+0000","last_fullsized":"2024-09-12T22:35:46.125858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'424","last_scrub_stamp":"2024-09-12T22:35:46.125739+0000","last_deep_scrub":"60'424","last_deep_scrub_stamp":"2024-09-12T22:35:46.125739+0000","last_clean_scrub_stamp":"2024-09-12T22:35:46.125739+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:21:18.641116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":13992,"num_write":386,"num_write_kb":38510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"60'70","reported_seq":48,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752571+0000","last_change":"2024-09-12T22:35:20.734652+0000","last_active":"2024-09-12T22:35:33.752571+0000","last_peered":"2024-09-12T22:35:33.752571+0000","last_clean":"2024-09-12T22:35:33.752571+0000","last_became_active":"2024-09-12T22:35:20.734023+0000","last_became_peered":"2024-09-12T22:35:20.734023+0000","last_unstale":"2024-09-12T22:35:33.752571+0000","last_undegraded":"2024-09-12T22:35:33.752571+0000","last_fullsized":"2024-09-12T22:35:33.752571+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"60'395","reported_seq":586,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:50.208551+0000","last_change":"2024-09-12T22:35:50.208596+0000","last_active":"2024-09-12T22:35:50.208551+0000","last_peered":"2024-09-12T22:35:50.208551+0000","last_clean":"2024-09-12T22:35:50.208551+0000","last_became_active":"2024-09-12T22:31:37.409666+0000","last_became_peered":"2024-09-12T22:31:37.409666+0000","last_unstale":"2024-09-12T22:35:50.208551+0000","last_undegraded":"2024-09-12T22:35:50.208551+0000","last_fullsized":"2024-09-12T22:35:50.208551+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'395","last_scrub_stamp":"2024-09-12T22:35:50.208421+0000","last_deep_scrub":"60'395","last_deep_scrub_stamp":"2024-09-12T22:35:50.208421+0000","last_clean_scrub_stamp":"2024-09-12T22:35:50.208421+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:31:45.148484+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":24198,"num_write":363,"num_write_kb":67056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"60'68","reported_seq":212,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.751722+0000","last_change":"2024-09-12T22:35:20.737076+0000","last_active":"2024-09-12T22:35:33.751722+0000","last_peered":"2024-09-12T22:35:33.751722+0000","last_clean":"2024-09-12T22:35:33.751722+0000","last_became_active":"2024-09-12T22:35:20.736755+0000","last_became_peered":"2024-09-12T22:35:20.736755+0000","last_unstale":"2024-09-12T22:35:33.751722+0000","last_undegraded":"2024-09-12T22:35:33.751722+0000","last_fullsized":"2024-09-12T22:35:33.751722+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"80'160","reported_seq":318,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:42.614215+0000","last_change":"2024-09-12T22:35:42.614262+0000","last_active":"2024-09-12T22:35:42.614215+0000","last_peered":"2024-09-12T22:35:42.614215+0000","last_clean":"2024-09-12T22:35:42.614215+0000","last_became_active":"2024-09-12T22:35:23.756663+0000","last_became_peered":"2024-09-12T22:35:23.756663+0000","last_unstale":"2024-09-12T22:35:42.614215+0000","last_undegraded":"2024-09-12T22:35:42.614215+0000","last_fullsized":"2024-09-12T22:35:42.614215+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'160","last_scrub_stamp":"2024-09-12T22:35:42.614122+0000","last_deep_scrub":"80'160","last_deep_scrub_stamp":"2024-09-12T22:35:42.614122+0000","last_clean_scrub_stamp":"2024-09-12T22:35:42.614122+0000","objects_scrubbed":2,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:26:42.466587+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":105,"num_write_kb":4159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"60'426","reported_seq":554,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:51.030342+0000","last_change":"2024-09-12T22:35:51.030373+0000","last_active":"2024-09-12T22:35:51.030342+0000","last_peered":"2024-09-12T22:35:51.030342+0000","last_clean":"2024-09-12T22:35:51.030342+0000","last_became_active":"2024-09-12T22:35:26.732245+0000","last_became_peered":"2024-09-12T22:35:26.732245+0000","last_unstale":"2024-09-12T22:35:51.030342+0000","last_undegraded":"2024-09-12T22:35:51.030342+0000","last_fullsized":"2024-09-12T22:35:51.030342+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'426","last_scrub_stamp":"2024-09-12T22:35:51.030253+0000","last_deep_scrub":"60'426","last_deep_scrub_stamp":"2024-09-12T22:35:51.030253+0000","last_clean_scrub_stamp":"2024-09-12T22:35:51.030253+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:00:21.991066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":29225,"num_write":390,"num_write_kb":83737,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"60'274","reported_seq":368,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752418+0000","last_change":"2024-09-12T22:35:23.755688+0000","last_active":"2024-09-12T22:35:33.752418+0000","last_peered":"2024-09-12T22:35:33.752418+0000","last_clean":"2024-09-12T22:35:33.752418+0000","last_became_active":"2024-09-12T22:35:23.755282+0000","last_became_peered":"2024-09-12T22:35:23.755282+0000","last_unstale":"2024-09-12T22:35:33.752418+0000","last_undegraded":"2024-09-12T22:35:33.752418+0000","last_fullsized":"2024-09-12T22:35:33.752418+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":274,"log_dups_size":0,"ondisk_log_size":274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":213,"num_write_kb":4214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"60'455","reported_seq":608,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.761234+0000","last_change":"2024-09-12T22:35:33.760415+0000","last_active":"2024-09-12T22:35:33.761234+0000","last_peered":"2024-09-12T22:35:33.761234+0000","last_clean":"2024-09-12T22:35:33.761234+0000","last_became_active":"2024-09-12T22:35:33.754299+0000","last_became_peered":"2024-09-12T22:35:33.754299+0000","last_unstale":"2024-09-12T22:35:33.761234+0000","last_undegraded":"2024-09-12T22:35:33.761234+0000","last_fullsized":"2024-09-12T22:35:33.761234+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":20747,"num_write":425,"num_write_kb":56005,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"80'425","reported_seq":583,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:41.573041+0000","last_change":"2024-09-12T22:35:41.573087+0000","last_active":"2024-09-12T22:35:41.573041+0000","last_peered":"2024-09-12T22:35:41.573041+0000","last_clean":"2024-09-12T22:35:41.573041+0000","last_became_active":"2024-09-12T22:35:23.756668+0000","last_became_peered":"2024-09-12T22:35:23.756668+0000","last_unstale":"2024-09-12T22:35:41.573041+0000","last_undegraded":"2024-09-12T22:35:41.573041+0000","last_fullsized":"2024-09-12T22:35:41.573041+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'425","last_scrub_stamp":"2024-09-12T22:35:41.572931+0000","last_deep_scrub":"80'425","last_deep_scrub_stamp":"2024-09-12T22:35:41.572931+0000","last_clean_scrub_stamp":"2024-09-12T22:35:41.572931+0000","objects_scrubbed":2,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:00:40.614135+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":371,"num_write_kb":4254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"60'431","reported_seq":607,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:47.683317+0000","last_change":"2024-09-12T22:35:47.683345+0000","last_active":"2024-09-12T22:35:47.683317+0000","last_peered":"2024-09-12T22:35:47.683317+0000","last_clean":"2024-09-12T22:35:47.683317+0000","last_became_active":"2024-09-12T22:31:37.414492+0000","last_became_peered":"2024-09-12T22:31:37.414492+0000","last_unstale":"2024-09-12T22:35:47.683317+0000","last_undegraded":"2024-09-12T22:35:47.683317+0000","last_fullsized":"2024-09-12T22:35:47.683317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'431","last_scrub_stamp":"2024-09-12T22:35:47.683226+0000","last_deep_scrub":"60'431","last_deep_scrub_stamp":"2024-09-12T22:35:47.683226+0000","last_clean_scrub_stamp":"2024-09-12T22:35:47.683226+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:14:15.439665+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":21479,"num_write":394,"num_write_kb":83756,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"60'70","reported_seq":206,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752931+0000","last_change":"2024-09-12T22:31:36.412068+0000","last_active":"2024-09-12T22:35:33.752931+0000","last_peered":"2024-09-12T22:35:33.752931+0000","last_clean":"2024-09-12T22:35:33.752931+0000","last_became_active":"2024-09-12T22:31:36.411366+0000","last_became_peered":"2024-09-12T22:31:36.411366+0000","last_unstale":"2024-09-12T22:35:33.752931+0000","last_undegraded":"2024-09-12T22:35:33.752931+0000","last_fullsized":"2024-09-12T22:35:33.752931+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"60'471","reported_seq":674,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752114+0000","last_change":"2024-09-12T22:31:37.410303+0000","last_active":"2024-09-12T22:35:33.752114+0000","last_peered":"2024-09-12T22:35:33.752114+0000","last_clean":"2024-09-12T22:35:33.752114+0000","last_became_active":"2024-09-12T22:31:37.409607+0000","last_became_peered":"2024-09-12T22:31:37.409607+0000","last_unstale":"2024-09-12T22:35:33.752114+0000","last_undegraded":"2024-09-12T22:35:33.752114+0000","last_fullsized":"2024-09-12T22:35:33.752114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":471,"log_dups_size":0,"ondisk_log_size":471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":37922,"num_write":440,"num_write_kb":138112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"60'209","reported_seq":345,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752264+0000","last_change":"2024-09-12T22:31:36.407974+0000","last_active":"2024-09-12T22:35:33.752264+0000","last_peered":"2024-09-12T22:35:33.752264+0000","last_clean":"2024-09-12T22:35:33.752264+0000","last_became_active":"2024-09-12T22:31:36.406955+0000","last_became_peered":"2024-09-12T22:31:36.406955+0000","last_unstale":"2024-09-12T22:35:33.752264+0000","last_undegraded":"2024-09-12T22:35:33.752264+0000","last_fullsized":"2024-09-12T22:35:33.752264+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":8267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"60'437","reported_seq":589,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:50.673507+0000","last_change":"2024-09-12T22:35:50.673545+0000","last_active":"2024-09-12T22:35:50.673507+0000","last_peered":"2024-09-12T22:35:50.673507+0000","last_clean":"2024-09-12T22:35:50.673507+0000","last_became_active":"2024-09-12T22:31:37.414890+0000","last_became_peered":"2024-09-12T22:31:37.414890+0000","last_unstale":"2024-09-12T22:35:50.673507+0000","last_undegraded":"2024-09-12T22:35:50.673507+0000","last_fullsized":"2024-09-12T22:35:50.673507+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'437","last_scrub_stamp":"2024-09-12T22:35:50.673415+0000","last_deep_scrub":"60'437","last_deep_scrub_stamp":"2024-09-12T22:35:50.673415+0000","last_clean_scrub_stamp":"2024-09-12T22:35:50.673415+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:32:48.287703+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":4587,"num_write":407,"num_write_kb":50860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"60'108","reported_seq":245,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:40.004076+0000","last_change":"2024-09-12T22:31:36.412147+0000","last_active":"2024-09-12T22:35:40.004076+0000","last_peered":"2024-09-12T22:35:40.004076+0000","last_clean":"2024-09-12T22:35:40.004076+0000","last_became_active":"2024-09-12T22:31:36.411382+0000","last_became_peered":"2024-09-12T22:31:36.411382+0000","last_unstale":"2024-09-12T22:35:40.004076+0000","last_undegraded":"2024-09-12T22:35:40.004076+0000","last_fullsized":"2024-09-12T22:35:40.004076+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":4129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"60'407","reported_seq":928,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752851+0000","last_change":"2024-09-12T22:35:31.732325+0000","last_active":"2024-09-12T22:35:33.752851+0000","last_peered":"2024-09-12T22:35:33.752851+0000","last_clean":"2024-09-12T22:35:33.752851+0000","last_became_active":"2024-09-12T22:35:31.729817+0000","last_became_peered":"2024-09-12T22:35:31.729817+0000","last_unstale":"2024-09-12T22:35:33.752851+0000","last_undegraded":"2024-09-12T22:35:33.752851+0000","last_fullsized":"2024-09-12T22:35:33.752851+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":5615,"num_write":375,"num_write_kb":50827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"60'57","reported_seq":56,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:58.108871+0000","last_change":"2024-09-12T22:35:58.108901+0000","last_active":"2024-09-12T22:35:58.108871+0000","last_peered":"2024-09-12T22:35:58.108871+0000","last_clean":"2024-09-12T22:35:58.108871+0000","last_became_active":"2024-09-12T22:35:20.733664+0000","last_became_peered":"2024-09-12T22:35:20.733664+0000","last_unstale":"2024-09-12T22:35:58.108871+0000","last_undegraded":"2024-09-12T22:35:58.108871+0000","last_fullsized":"2024-09-12T22:35:58.108871+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'57","last_scrub_stamp":"2024-09-12T22:35:58.108771+0000","last_deep_scrub":"60'57","last_deep_scrub_stamp":"2024-09-12T22:35:58.108771+0000","last_clean_scrub_stamp":"2024-09-12T22:35:58.108771+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:30:25.204368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"60'357","reported_seq":834,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752659+0000","last_change":"2024-09-12T22:35:27.734437+0000","last_active":"2024-09-12T22:35:33.752659+0000","last_peered":"2024-09-12T22:35:33.752659+0000","last_clean":"2024-09-12T22:35:33.752659+0000","last_became_active":"2024-09-12T22:35:27.733274+0000","last_became_peered":"2024-09-12T22:35:27.733274+0000","last_unstale":"2024-09-12T22:35:33.752659+0000","last_undegraded":"2024-09-12T22:35:33.752659+0000","last_fullsized":"2024-09-12T22:35:33.752659+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":357,"log_dups_size":0,"ondisk_log_size":357,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":2460,"num_write":324,"num_write_kb":37873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"60'417","reported_seq":502,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.753667+0000","last_change":"2024-09-12T22:35:23.755080+0000","last_active":"2024-09-12T22:35:33.753667+0000","last_peered":"2024-09-12T22:35:33.753667+0000","last_clean":"2024-09-12T22:35:33.753667+0000","last_became_active":"2024-09-12T22:35:23.754683+0000","last_became_peered":"2024-09-12T22:35:23.754683+0000","last_unstale":"2024-09-12T22:35:33.753667+0000","last_undegraded":"2024-09-12T22:35:33.753667+0000","last_fullsized":"2024-09-12T22:35:33.753667+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":359,"num_write_kb":4251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"60'416","reported_seq":964,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752439+0000","last_change":"2024-09-12T22:35:30.730978+0000","last_active":"2024-09-12T22:35:33.752439+0000","last_peered":"2024-09-12T22:35:33.752439+0000","last_clean":"2024-09-12T22:35:33.752439+0000","last_became_active":"2024-09-12T22:35:30.729912+0000","last_became_peered":"2024-09-12T22:35:30.729912+0000","last_unstale":"2024-09-12T22:35:33.752439+0000","last_undegraded":"2024-09-12T22:35:33.752439+0000","last_fullsized":"2024-09-12T22:35:33.752439+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":42190,"num_write":377,"num_write_kb":87849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"80'159","reported_seq":364,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:45.649463+0000","last_change":"2024-09-12T22:35:45.649509+0000","last_active":"2024-09-12T22:35:45.649463+0000","last_peered":"2024-09-12T22:35:45.649463+0000","last_clean":"2024-09-12T22:35:45.649463+0000","last_became_active":"2024-09-12T22:35:20.736721+0000","last_became_peered":"2024-09-12T22:35:20.736721+0000","last_unstale":"2024-09-12T22:35:45.649463+0000","last_undegraded":"2024-09-12T22:35:45.649463+0000","last_fullsized":"2024-09-12T22:35:45.649463+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'159","last_scrub_stamp":"2024-09-12T22:35:45.649377+0000","last_deep_scrub":"80'159","last_deep_scrub_stamp":"2024-09-12T22:35:45.649377+0000","last_clean_scrub_stamp":"2024-09-12T22:35:45.649377+0000","objects_scrubbed":2,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:54:50.820256+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":151,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:40.003953+0000","last_change":"2024-09-12T22:31:34.286952+0000","last_active":"2024-09-12T22:35:40.003953+0000","last_peered":"2024-09-12T22:35:40.003953+0000","last_clean":"2024-09-12T22:35:40.003953+0000","last_became_active":"2024-09-12T22:31:32.283661+0000","last_became_peered":"2024-09-12T22:31:32.283661+0000","last_unstale":"2024-09-12T22:35:40.003953+0000","last_undegraded":"2024-09-12T22:35:40.003953+0000","last_fullsized":"2024-09-12T22:35:40.003953+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000621274,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"80'680","reported_seq":840,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:51.253978+0000","last_change":"2024-09-12T22:35:51.254012+0000","last_active":"2024-09-12T22:35:51.253978+0000","last_peered":"2024-09-12T22:35:51.253978+0000","last_clean":"2024-09-12T22:35:51.253978+0000","last_became_active":"2024-09-12T22:35:23.755652+0000","last_became_peered":"2024-09-12T22:35:23.755652+0000","last_unstale":"2024-09-12T22:35:51.253978+0000","last_undegraded":"2024-09-12T22:35:51.253978+0000","last_fullsized":"2024-09-12T22:35:51.253978+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'680","last_scrub_stamp":"2024-09-12T22:35:51.253878+0000","last_deep_scrub":"80'680","last_deep_scrub_stamp":"2024-09-12T22:35:51.253878+0000","last_clean_scrub_stamp":"2024-09-12T22:35:51.253878+0000","objects_scrubbed":2,"log_size":680,"log_dups_size":0,"ondisk_log_size":680,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:09:03.140393+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":608,"num_write_kb":8482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"60'426","reported_seq":978,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:40.004174+0000","last_change":"2024-09-12T22:35:31.732344+0000","last_active":"2024-09-12T22:35:40.004174+0000","last_peered":"2024-09-12T22:35:40.004174+0000","last_clean":"2024-09-12T22:35:40.004174+0000","last_became_active":"2024-09-12T22:35:31.730242+0000","last_became_peered":"2024-09-12T22:35:31.730242+0000","last_unstale":"2024-09-12T22:35:40.004174+0000","last_undegraded":"2024-09-12T22:35:40.004174+0000","last_fullsized":"2024-09-12T22:35:40.004174+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":24636,"num_write":392,"num_write_kb":59176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":157,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:36.242348+0000","last_change":"2024-09-12T22:35:20.735913+0000","last_active":"2024-09-12T22:35:36.242348+0000","last_peered":"2024-09-12T22:35:36.242348+0000","last_clean":"2024-09-12T22:35:36.242348+0000","last_became_active":"2024-09-12T22:35:20.735545+0000","last_became_peered":"2024-09-12T22:35:20.735545+0000","last_unstale":"2024-09-12T22:35:36.242348+0000","last_undegraded":"2024-09-12T22:35:36.242348+0000","last_fullsized":"2024-09-12T22:35:36.242348+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037858999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"80'107","reported_seq":295,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:57.223035+0000","last_change":"2024-09-12T22:35:57.223072+0000","last_active":"2024-09-12T22:35:57.223035+0000","last_peered":"2024-09-12T22:35:57.223035+0000","last_clean":"2024-09-12T22:35:57.223035+0000","last_became_active":"2024-09-12T22:31:36.406770+0000","last_became_peered":"2024-09-12T22:31:36.406770+0000","last_unstale":"2024-09-12T22:35:57.223035+0000","last_undegraded":"2024-09-12T22:35:57.223035+0000","last_fullsized":"2024-09-12T22:35:57.223035+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'107","last_scrub_stamp":"2024-09-12T22:35:57.222948+0000","last_deep_scrub":"80'107","last_deep_scrub_stamp":"2024-09-12T22:35:57.222948+0000","last_clean_scrub_stamp":"2024-09-12T22:35:57.222948+0000","objects_scrubbed":1,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:49:29.104800+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1467429,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":43,"num_read_kb":1462,"num_write":43,"num_write_kb":1462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"60'448","reported_seq":556,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:47.106736+0000","last_change":"2024-09-12T22:35:47.106764+0000","last_active":"2024-09-12T22:35:47.106736+0000","last_peered":"2024-09-12T22:35:47.106736+0000","last_clean":"2024-09-12T22:35:47.106736+0000","last_became_active":"2024-09-12T22:35:27.729522+0000","last_became_peered":"2024-09-12T22:35:27.729522+0000","last_unstale":"2024-09-12T22:35:47.106736+0000","last_undegraded":"2024-09-12T22:35:47.106736+0000","last_fullsized":"2024-09-12T22:35:47.106736+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'448","last_scrub_stamp":"2024-09-12T22:35:47.106643+0000","last_deep_scrub":"60'448","last_deep_scrub_stamp":"2024-09-12T22:35:47.106643+0000","last_clean_scrub_stamp":"2024-09-12T22:35:47.106643+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:54:12.406887+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":10436,"num_write":420,"num_write_kb":67816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":165,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:42.160892+0000","last_change":"2024-09-12T22:35:42.160892+0000","last_active":"2024-09-12T22:35:42.160892+0000","last_peered":"2024-09-12T22:35:42.160892+0000","last_clean":"2024-09-12T22:35:42.160892+0000","last_became_active":"2024-09-12T22:35:20.734643+0000","last_became_peered":"2024-09-12T22:35:20.734643+0000","last_unstale":"2024-09-12T22:35:42.160892+0000","last_undegraded":"2024-09-12T22:35:42.160892+0000","last_fullsized":"2024-09-12T22:35:42.160892+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:35:42.160772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:35:42.160772+0000","last_clean_scrub_stamp":"2024-09-12T22:35:42.160772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:47:29.886284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039540700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"80'294","reported_seq":415,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:40.037943+0000","last_change":"2024-09-12T22:35:40.038017+0000","last_active":"2024-09-12T22:35:40.037943+0000","last_peered":"2024-09-12T22:35:40.037943+0000","last_clean":"2024-09-12T22:35:40.037943+0000","last_became_active":"2024-09-12T22:35:33.760742+0000","last_became_peered":"2024-09-12T22:35:33.760742+0000","last_unstale":"2024-09-12T22:35:40.037943+0000","last_undegraded":"2024-09-12T22:35:40.037943+0000","last_fullsized":"2024-09-12T22:35:40.037943+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'294","last_scrub_stamp":"2024-09-12T22:35:40.037799+0000","last_deep_scrub":"80'294","last_deep_scrub_stamp":"2024-09-12T22:35:40.037799+0000","last_clean_scrub_stamp":"2024-09-12T22:35:40.037799+0000","objects_scrubbed":2,"log_size":294,"log_dups_size":0,"ondisk_log_size":294,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:30:06.166314+0000","scrub_duration":17,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":235,"num_write_kb":8293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"60'375","reported_seq":914,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:39.562921+0000","last_change":"2024-09-12T22:35:29.740484+0000","last_active":"2024-09-12T22:35:39.562921+0000","last_peered":"2024-09-12T22:35:39.562921+0000","last_clean":"2024-09-12T22:35:39.562921+0000","last_became_active":"2024-09-12T22:35:29.738755+0000","last_became_peered":"2024-09-12T22:35:29.738755+0000","last_unstale":"2024-09-12T22:35:39.562921+0000","last_undegraded":"2024-09-12T22:35:39.562921+0000","last_fullsized":"2024-09-12T22:35:39.562921+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":43566,"num_write":354,"num_write_kb":92229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":160,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":152,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:40.003991+0000","last_change":"2024-09-12T22:31:34.286938+0000","last_active":"2024-09-12T22:35:40.003991+0000","last_peered":"2024-09-12T22:35:40.003991+0000","last_clean":"2024-09-12T22:35:40.003991+0000","last_became_active":"2024-09-12T22:31:32.282230+0000","last_became_peered":"2024-09-12T22:31:32.282230+0000","last_unstale":"2024-09-12T22:35:40.003991+0000","last_undegraded":"2024-09-12T22:35:40.003991+0000","last_fullsized":"2024-09-12T22:35:40.003991+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000615758,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"60'63","reported_seq":200,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:40.003971+0000","last_change":"2024-09-12T22:31:36.410694+0000","last_active":"2024-09-12T22:35:40.003971+0000","last_peered":"2024-09-12T22:35:40.003971+0000","last_clean":"2024-09-12T22:35:40.003971+0000","last_became_active":"2024-09-12T22:31:36.409816+0000","last_became_peered":"2024-09-12T22:31:36.409816+0000","last_unstale":"2024-09-12T22:35:40.003971+0000","last_undegraded":"2024-09-12T22:35:40.003971+0000","last_fullsized":"2024-09-12T22:35:40.003971+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"60'405","reported_seq":931,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:39.562705+0000","last_change":"2024-09-12T22:35:29.736704+0000","last_active":"2024-09-12T22:35:39.562705+0000","last_peered":"2024-09-12T22:35:39.562705+0000","last_clean":"2024-09-12T22:35:39.562705+0000","last_became_active":"2024-09-12T22:35:29.735499+0000","last_became_peered":"2024-09-12T22:35:29.735499+0000","last_unstale":"2024-09-12T22:35:39.562705+0000","last_undegraded":"2024-09-12T22:35:39.562705+0000","last_fullsized":"2024-09-12T22:35:39.562705+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":20152,"num_write":366,"num_write_kb":92447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"60'277","reported_seq":362,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.753228+0000","last_change":"2024-09-12T22:35:23.755555+0000","last_active":"2024-09-12T22:35:33.753228+0000","last_peered":"2024-09-12T22:35:33.753228+0000","last_clean":"2024-09-12T22:35:33.753228+0000","last_became_active":"2024-09-12T22:35:23.755237+0000","last_became_peered":"2024-09-12T22:35:23.755237+0000","last_unstale":"2024-09-12T22:35:33.753228+0000","last_undegraded":"2024-09-12T22:35:33.753228+0000","last_fullsized":"2024-09-12T22:35:33.753228+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":277,"log_dups_size":0,"ondisk_log_size":277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":216,"num_write_kb":4193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":165,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:41.149203+0000","last_change":"2024-09-12T22:35:41.149203+0000","last_active":"2024-09-12T22:35:41.149203+0000","last_peered":"2024-09-12T22:35:41.149203+0000","last_clean":"2024-09-12T22:35:41.149203+0000","last_became_active":"2024-09-12T22:35:20.736428+0000","last_became_peered":"2024-09-12T22:35:20.736428+0000","last_unstale":"2024-09-12T22:35:41.149203+0000","last_undegraded":"2024-09-12T22:35:41.149203+0000","last_fullsized":"2024-09-12T22:35:41.149203+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:35:41.149090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:35:41.149090+0000","last_clean_scrub_stamp":"2024-09-12T22:35:41.149090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:47:16.938339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041972500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"60'355","reported_seq":466,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:55.102250+0000","last_change":"2024-09-12T22:35:55.102278+0000","last_active":"2024-09-12T22:35:55.102250+0000","last_peered":"2024-09-12T22:35:55.102250+0000","last_clean":"2024-09-12T22:35:55.102250+0000","last_became_active":"2024-09-12T22:35:25.727299+0000","last_became_peered":"2024-09-12T22:35:25.727299+0000","last_unstale":"2024-09-12T22:35:55.102250+0000","last_undegraded":"2024-09-12T22:35:55.102250+0000","last_fullsized":"2024-09-12T22:35:55.102250+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'355","last_scrub_stamp":"2024-09-12T22:35:55.102155+0000","last_deep_scrub":"60'355","last_deep_scrub_stamp":"2024-09-12T22:35:55.102155+0000","last_clean_scrub_stamp":"2024-09-12T22:35:55.102155+0000","objects_scrubbed":0,"log_size":355,"log_dups_size":0,"ondisk_log_size":355,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:22:31.666894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13196,"num_write":321,"num_write_kb":41797,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"60'55","reported_seq":207,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:45.163041+0000","last_change":"2024-09-12T22:35:45.163041+0000","last_active":"2024-09-12T22:35:45.163041+0000","last_peered":"2024-09-12T22:35:45.163041+0000","last_clean":"2024-09-12T22:35:45.163041+0000","last_became_active":"2024-09-12T22:35:20.737705+0000","last_became_peered":"2024-09-12T22:35:20.737705+0000","last_unstale":"2024-09-12T22:35:45.163041+0000","last_undegraded":"2024-09-12T22:35:45.163041+0000","last_fullsized":"2024-09-12T22:35:45.163041+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'55","last_scrub_stamp":"2024-09-12T22:35:45.162870+0000","last_deep_scrub":"60'55","last_deep_scrub_stamp":"2024-09-12T22:35:45.162870+0000","last_clean_scrub_stamp":"2024-09-12T22:35:45.162870+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:58:31.877549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":69,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.754507+0000","last_change":"2024-09-12T22:35:20.738327+0000","last_active":"2024-09-12T22:35:33.754507+0000","last_peered":"2024-09-12T22:35:33.754507+0000","last_clean":"2024-09-12T22:35:33.754507+0000","last_became_active":"2024-09-12T22:35:20.737799+0000","last_became_peered":"2024-09-12T22:35:20.737799+0000","last_unstale":"2024-09-12T22:35:33.754507+0000","last_undegraded":"2024-09-12T22:35:33.754507+0000","last_fullsized":"2024-09-12T22:35:33.754507+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"60'385","reported_seq":534,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.762396+0000","last_change":"2024-09-12T22:35:33.761943+0000","last_active":"2024-09-12T22:35:33.762396+0000","last_peered":"2024-09-12T22:35:33.762396+0000","last_clean":"2024-09-12T22:35:33.762396+0000","last_became_active":"2024-09-12T22:35:33.754546+0000","last_became_peered":"2024-09-12T22:35:33.754546+0000","last_unstale":"2024-09-12T22:35:33.762396+0000","last_undegraded":"2024-09-12T22:35:33.762396+0000","last_fullsized":"2024-09-12T22:35:33.762396+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":22437,"num_write":347,"num_write_kb":30121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"80'62","reported_seq":215,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:47.131052+0000","last_change":"2024-09-12T22:35:47.131052+0000","last_active":"2024-09-12T22:35:47.131052+0000","last_peered":"2024-09-12T22:35:47.131052+0000","last_clean":"2024-09-12T22:35:47.131052+0000","last_became_active":"2024-09-12T22:35:20.738129+0000","last_became_peered":"2024-09-12T22:35:20.738129+0000","last_unstale":"2024-09-12T22:35:47.131052+0000","last_undegraded":"2024-09-12T22:35:47.131052+0000","last_fullsized":"2024-09-12T22:35:47.131052+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'62","last_scrub_stamp":"2024-09-12T22:35:47.130895+0000","last_deep_scrub":"80'62","last_deep_scrub_stamp":"2024-09-12T22:35:47.130895+0000","last_clean_scrub_stamp":"2024-09-12T22:35:47.130895+0000","objects_scrubbed":1,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:43:10.950680+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":165,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:43.170600+0000","last_change":"2024-09-12T22:35:43.170600+0000","last_active":"2024-09-12T22:35:43.170600+0000","last_peered":"2024-09-12T22:35:43.170600+0000","last_clean":"2024-09-12T22:35:43.170600+0000","last_became_active":"2024-09-12T22:35:20.736628+0000","last_became_peered":"2024-09-12T22:35:20.736628+0000","last_unstale":"2024-09-12T22:35:43.170600+0000","last_undegraded":"2024-09-12T22:35:43.170600+0000","last_fullsized":"2024-09-12T22:35:43.170600+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:35:43.170448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:35:43.170448+0000","last_clean_scrub_stamp":"2024-09-12T22:35:43.170448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:28:09.526317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058589999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"60'402","reported_seq":563,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:54.246956+0000","last_change":"2024-09-12T22:35:54.246984+0000","last_active":"2024-09-12T22:35:54.246956+0000","last_peered":"2024-09-12T22:35:54.246956+0000","last_clean":"2024-09-12T22:35:54.246956+0000","last_became_active":"2024-09-12T22:31:37.410558+0000","last_became_peered":"2024-09-12T22:31:37.410558+0000","last_unstale":"2024-09-12T22:35:54.246956+0000","last_undegraded":"2024-09-12T22:35:54.246956+0000","last_fullsized":"2024-09-12T22:35:54.246956+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'402","last_scrub_stamp":"2024-09-12T22:35:54.246766+0000","last_deep_scrub":"60'402","last_deep_scrub_stamp":"2024-09-12T22:35:54.246766+0000","last_clean_scrub_stamp":"2024-09-12T22:35:54.246766+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:05:37.233132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":10169,"num_write":370,"num_write_kb":38130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"80'106","reported_seq":251,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:58.248310+0000","last_change":"2024-09-12T22:35:58.248310+0000","last_active":"2024-09-12T22:35:58.248310+0000","last_peered":"2024-09-12T22:35:58.248310+0000","last_clean":"2024-09-12T22:35:58.248310+0000","last_became_active":"2024-09-12T22:31:36.406729+0000","last_became_peered":"2024-09-12T22:31:36.406729+0000","last_unstale":"2024-09-12T22:35:58.248310+0000","last_undegraded":"2024-09-12T22:35:58.248310+0000","last_fullsized":"2024-09-12T22:35:58.248310+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'106","last_scrub_stamp":"2024-09-12T22:35:58.248136+0000","last_deep_scrub":"80'106","last_deep_scrub_stamp":"2024-09-12T22:35:58.248136+0000","last_clean_scrub_stamp":"2024-09-12T22:35:58.248136+0000","objects_scrubbed":1,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:47:40.016268+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103,"num_write_kb":1085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":157,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:40.003948+0000","last_change":"2024-09-12T22:35:20.737068+0000","last_active":"2024-09-12T22:35:40.003948+0000","last_peered":"2024-09-12T22:35:40.003948+0000","last_clean":"2024-09-12T22:35:40.003948+0000","last_became_active":"2024-09-12T22:35:20.736769+0000","last_became_peered":"2024-09-12T22:35:20.736769+0000","last_unstale":"2024-09-12T22:35:40.003948+0000","last_undegraded":"2024-09-12T22:35:40.003948+0000","last_fullsized":"2024-09-12T22:35:40.003948+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:31.264226+0000","last_clean_scrub_stamp":"2024-09-12T22:31:31.264226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000382109,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"60'412","reported_seq":559,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:53.080906+0000","last_change":"2024-09-12T22:35:53.080933+0000","last_active":"2024-09-12T22:35:53.080906+0000","last_peered":"2024-09-12T22:35:53.080906+0000","last_clean":"2024-09-12T22:35:53.080906+0000","last_became_active":"2024-09-12T22:35:26.732923+0000","last_became_peered":"2024-09-12T22:35:26.732923+0000","last_unstale":"2024-09-12T22:35:53.080906+0000","last_undegraded":"2024-09-12T22:35:53.080906+0000","last_fullsized":"2024-09-12T22:35:53.080906+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'412","last_scrub_stamp":"2024-09-12T22:35:53.080800+0000","last_deep_scrub":"60'412","last_deep_scrub_stamp":"2024-09-12T22:35:53.080800+0000","last_clean_scrub_stamp":"2024-09-12T22:35:53.080800+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:07:41.110097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":34504,"num_write":385,"num_write_kb":100438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"60'415","reported_seq":977,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:40.560544+0000","last_change":"2024-09-12T22:35:40.560589+0000","last_active":"2024-09-12T22:35:40.560544+0000","last_peered":"2024-09-12T22:35:40.560544+0000","last_clean":"2024-09-12T22:35:40.560544+0000","last_became_active":"2024-09-12T22:35:24.759441+0000","last_became_peered":"2024-09-12T22:35:24.759441+0000","last_unstale":"2024-09-12T22:35:40.560544+0000","last_undegraded":"2024-09-12T22:35:40.560544+0000","last_fullsized":"2024-09-12T22:35:40.560544+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'415","last_scrub_stamp":"2024-09-12T22:35:40.560400+0000","last_deep_scrub":"60'415","last_deep_scrub_stamp":"2024-09-12T22:35:40.560400+0000","last_clean_scrub_stamp":"2024-09-12T22:35:40.560400+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:38:43.470540+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":37207,"num_write":375,"num_write_kb":84660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"80'226","reported_seq":388,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:43.615836+0000","last_change":"2024-09-12T22:35:43.615871+0000","last_active":"2024-09-12T22:35:43.615836+0000","last_peered":"2024-09-12T22:35:43.615836+0000","last_clean":"2024-09-12T22:35:43.615836+0000","last_became_active":"2024-09-12T22:35:23.755918+0000","last_became_peered":"2024-09-12T22:35:23.755918+0000","last_unstale":"2024-09-12T22:35:43.615836+0000","last_undegraded":"2024-09-12T22:35:43.615836+0000","last_fullsized":"2024-09-12T22:35:43.615836+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'226","last_scrub_stamp":"2024-09-12T22:35:43.615755+0000","last_deep_scrub":"80'226","last_deep_scrub_stamp":"2024-09-12T22:35:43.615755+0000","last_clean_scrub_stamp":"2024-09-12T22:35:43.615755+0000","objects_scrubbed":5,"log_size":226,"log_dups_size":0,"ondisk_log_size":226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:21:37.577770+0000","scrub_duration":17,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":175,"num_write_kb":8282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":8382815,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"60'429","reported_seq":962,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.751668+0000","last_change":"2024-09-12T22:35:25.728726+0000","last_active":"2024-09-12T22:35:33.751668+0000","last_peered":"2024-09-12T22:35:33.751668+0000","last_clean":"2024-09-12T22:35:33.751668+0000","last_became_active":"2024-09-12T22:35:25.726837+0000","last_became_peered":"2024-09-12T22:35:25.726837+0000","last_unstale":"2024-09-12T22:35:33.751668+0000","last_undegraded":"2024-09-12T22:35:33.751668+0000","last_fullsized":"2024-09-12T22:35:33.751668+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":12230,"num_write":389,"num_write_kb":71746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"80'100","reported_seq":228,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:56.131114+0000","last_change":"2024-09-12T22:35:56.131150+0000","last_active":"2024-09-12T22:35:56.131114+0000","last_peered":"2024-09-12T22:35:56.131114+0000","last_clean":"2024-09-12T22:35:56.131114+0000","last_became_active":"2024-09-12T22:35:33.758640+0000","last_became_peered":"2024-09-12T22:35:33.758640+0000","last_unstale":"2024-09-12T22:35:56.131114+0000","last_undegraded":"2024-09-12T22:35:56.131114+0000","last_fullsized":"2024-09-12T22:35:56.131114+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'100","last_scrub_stamp":"2024-09-12T22:35:56.131027+0000","last_deep_scrub":"80'100","last_deep_scrub_stamp":"2024-09-12T22:35:56.131027+0000","last_clean_scrub_stamp":"2024-09-12T22:35:56.131027+0000","objects_scrubbed":2,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:56:59.679732+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"60'214","reported_seq":350,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752721+0000","last_change":"2024-09-12T22:31:36.411549+0000","last_active":"2024-09-12T22:35:33.752721+0000","last_peered":"2024-09-12T22:35:33.752721+0000","last_clean":"2024-09-12T22:35:33.752721+0000","last_became_active":"2024-09-12T22:31:36.410674+0000","last_became_peered":"2024-09-12T22:31:36.410674+0000","last_unstale":"2024-09-12T22:35:33.752721+0000","last_undegraded":"2024-09-12T22:35:33.752721+0000","last_fullsized":"2024-09-12T22:35:33.752721+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":151,"num_write_kb":4168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"60'460","reported_seq":631,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:48.178610+0000","last_change":"2024-09-12T22:35:48.178638+0000","last_active":"2024-09-12T22:35:48.178610+0000","last_peered":"2024-09-12T22:35:48.178610+0000","last_clean":"2024-09-12T22:35:48.178610+0000","last_became_active":"2024-09-12T22:31:37.410404+0000","last_became_peered":"2024-09-12T22:31:37.410404+0000","last_unstale":"2024-09-12T22:35:48.178610+0000","last_undegraded":"2024-09-12T22:35:48.178610+0000","last_fullsized":"2024-09-12T22:35:48.178610+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'460","last_scrub_stamp":"2024-09-12T22:35:48.178488+0000","last_deep_scrub":"60'460","last_deep_scrub_stamp":"2024-09-12T22:35:48.178488+0000","last_clean_scrub_stamp":"2024-09-12T22:35:48.178488+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:51:08.618621+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":15059,"num_write":431,"num_write_kb":59615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"60'52","reported_seq":188,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752687+0000","last_change":"2024-09-12T22:31:36.408390+0000","last_active":"2024-09-12T22:35:33.752687+0000","last_peered":"2024-09-12T22:35:33.752687+0000","last_clean":"2024-09-12T22:35:33.752687+0000","last_became_active":"2024-09-12T22:31:36.407062+0000","last_became_peered":"2024-09-12T22:31:36.407062+0000","last_unstale":"2024-09-12T22:35:33.752687+0000","last_undegraded":"2024-09-12T22:35:33.752687+0000","last_fullsized":"2024-09-12T22:35:33.752687+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"60'461","reported_seq":1026,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.751547+0000","last_change":"2024-09-12T22:35:28.731581+0000","last_active":"2024-09-12T22:35:33.751547+0000","last_peered":"2024-09-12T22:35:33.751547+0000","last_clean":"2024-09-12T22:35:33.751547+0000","last_became_active":"2024-09-12T22:35:28.730402+0000","last_became_peered":"2024-09-12T22:35:28.730402+0000","last_unstale":"2024-09-12T22:35:33.751547+0000","last_undegraded":"2024-09-12T22:35:33.751547+0000","last_fullsized":"2024-09-12T22:35:33.751547+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":17508,"num_write":431,"num_write_kb":67883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":200,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"60'355","reported_seq":488,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:43.066248+0000","last_change":"2024-09-12T22:35:43.066272+0000","last_active":"2024-09-12T22:35:43.066248+0000","last_peered":"2024-09-12T22:35:43.066248+0000","last_clean":"2024-09-12T22:35:43.066248+0000","last_became_active":"2024-09-12T22:35:28.730931+0000","last_became_peered":"2024-09-12T22:35:28.730931+0000","last_unstale":"2024-09-12T22:35:43.066248+0000","last_undegraded":"2024-09-12T22:35:43.066248+0000","last_fullsized":"2024-09-12T22:35:43.066248+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'355","last_scrub_stamp":"2024-09-12T22:35:43.066163+0000","last_deep_scrub":"60'355","last_deep_scrub_stamp":"2024-09-12T22:35:43.066163+0000","last_clean_scrub_stamp":"2024-09-12T22:35:43.066163+0000","objects_scrubbed":0,"log_size":355,"log_dups_size":0,"ondisk_log_size":355,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:10:10.050148+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":44561,"num_write":329,"num_write_kb":26431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"80'550","reported_seq":709,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:53.229974+0000","last_change":"2024-09-12T22:35:53.230003+0000","last_active":"2024-09-12T22:35:53.229974+0000","last_peered":"2024-09-12T22:35:53.229974+0000","last_clean":"2024-09-12T22:35:53.229974+0000","last_became_active":"2024-09-12T22:35:23.755812+0000","last_became_peered":"2024-09-12T22:35:23.755812+0000","last_unstale":"2024-09-12T22:35:53.229974+0000","last_undegraded":"2024-09-12T22:35:53.229974+0000","last_fullsized":"2024-09-12T22:35:53.229974+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'550","last_scrub_stamp":"2024-09-12T22:35:53.229883+0000","last_deep_scrub":"80'550","last_deep_scrub_stamp":"2024-09-12T22:35:53.229883+0000","last_clean_scrub_stamp":"2024-09-12T22:35:53.229883+0000","objects_scrubbed":2,"log_size":550,"log_dups_size":0,"ondisk_log_size":550,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:00:59.857643+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":488,"num_write_kb":8420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"60'422","reported_seq":677,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:52.206636+0000","last_change":"2024-09-12T22:35:52.206697+0000","last_active":"2024-09-12T22:35:52.206636+0000","last_peered":"2024-09-12T22:35:52.206636+0000","last_clean":"2024-09-12T22:35:52.206636+0000","last_became_active":"2024-09-12T22:31:37.409796+0000","last_became_peered":"2024-09-12T22:31:37.409796+0000","last_unstale":"2024-09-12T22:35:52.206636+0000","last_undegraded":"2024-09-12T22:35:52.206636+0000","last_fullsized":"2024-09-12T22:35:52.206636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'422","last_scrub_stamp":"2024-09-12T22:35:52.206509+0000","last_deep_scrub":"60'422","last_deep_scrub_stamp":"2024-09-12T22:35:52.206509+0000","last_clean_scrub_stamp":"2024-09-12T22:35:52.206509+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:14:27.519681+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":51020,"num_write":397,"num_write_kb":73116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"80'181","reported_seq":325,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:59.288653+0000","last_change":"2024-09-12T22:35:59.288682+0000","last_active":"2024-09-12T22:35:59.288653+0000","last_peered":"2024-09-12T22:35:59.288653+0000","last_clean":"2024-09-12T22:35:59.288653+0000","last_became_active":"2024-09-12T22:31:36.406681+0000","last_became_peered":"2024-09-12T22:31:36.406681+0000","last_unstale":"2024-09-12T22:35:59.288653+0000","last_undegraded":"2024-09-12T22:35:59.288653+0000","last_fullsized":"2024-09-12T22:35:59.288653+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'181","last_scrub_stamp":"2024-09-12T22:35:59.288563+0000","last_deep_scrub":"80'181","last_deep_scrub_stamp":"2024-09-12T22:35:59.288563+0000","last_clean_scrub_stamp":"2024-09-12T22:35:59.288563+0000","objects_scrubbed":1,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:18:46.826462+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":134,"num_write_kb":4167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"60'420","reported_seq":554,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:46.075092+0000","last_change":"2024-09-12T22:35:46.075123+0000","last_active":"2024-09-12T22:35:46.075092+0000","last_peered":"2024-09-12T22:35:46.075092+0000","last_clean":"2024-09-12T22:35:46.075092+0000","last_became_active":"2024-09-12T22:35:30.733182+0000","last_became_peered":"2024-09-12T22:35:30.733182+0000","last_unstale":"2024-09-12T22:35:46.075092+0000","last_undegraded":"2024-09-12T22:35:46.075092+0000","last_fullsized":"2024-09-12T22:35:46.075092+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'420","last_scrub_stamp":"2024-09-12T22:35:46.074989+0000","last_deep_scrub":"60'420","last_deep_scrub_stamp":"2024-09-12T22:35:46.074989+0000","last_clean_scrub_stamp":"2024-09-12T22:35:46.074989+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:56.187326+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":24901,"num_write":369,"num_write_kb":75198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"80'215","reported_seq":336,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:50.096276+0000","last_change":"2024-09-12T22:35:50.096311+0000","last_active":"2024-09-12T22:35:50.096276+0000","last_peered":"2024-09-12T22:35:50.096276+0000","last_clean":"2024-09-12T22:35:50.096276+0000","last_became_active":"2024-09-12T22:35:33.754931+0000","last_became_peered":"2024-09-12T22:35:33.754931+0000","last_unstale":"2024-09-12T22:35:50.096276+0000","last_undegraded":"2024-09-12T22:35:50.096276+0000","last_fullsized":"2024-09-12T22:35:50.096276+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'215","last_scrub_stamp":"2024-09-12T22:35:50.096191+0000","last_deep_scrub":"80'215","last_deep_scrub_stamp":"2024-09-12T22:35:50.096191+0000","last_clean_scrub_stamp":"2024-09-12T22:35:50.096191+0000","objects_scrubbed":3,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:33:18.847054+0000","scrub_duration":26,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12553847,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":12334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"60'398","reported_seq":540,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.764463+0000","last_change":"2024-09-12T22:35:33.763810+0000","last_active":"2024-09-12T22:35:33.764463+0000","last_peered":"2024-09-12T22:35:33.764463+0000","last_clean":"2024-09-12T22:35:33.764463+0000","last_became_active":"2024-09-12T22:35:33.755497+0000","last_became_peered":"2024-09-12T22:35:33.755497+0000","last_unstale":"2024-09-12T22:35:33.764463+0000","last_undegraded":"2024-09-12T22:35:33.764463+0000","last_fullsized":"2024-09-12T22:35:33.764463+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":11429,"num_write":361,"num_write_kb":88082,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"60'54","reported_seq":56,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752761+0000","last_change":"2024-09-12T22:35:20.759946+0000","last_active":"2024-09-12T22:35:33.752761+0000","last_peered":"2024-09-12T22:35:33.752761+0000","last_clean":"2024-09-12T22:35:33.752761+0000","last_became_active":"2024-09-12T22:35:20.733271+0000","last_became_peered":"2024-09-12T22:35:20.733271+0000","last_unstale":"2024-09-12T22:35:33.752761+0000","last_undegraded":"2024-09-12T22:35:33.752761+0000","last_fullsized":"2024-09-12T22:35:33.752761+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"60'359","reported_seq":521,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:52.680398+0000","last_change":"2024-09-12T22:35:52.680424+0000","last_active":"2024-09-12T22:35:52.680398+0000","last_peered":"2024-09-12T22:35:52.680398+0000","last_clean":"2024-09-12T22:35:52.680398+0000","last_became_active":"2024-09-12T22:31:37.413933+0000","last_became_peered":"2024-09-12T22:31:37.413933+0000","last_unstale":"2024-09-12T22:35:52.680398+0000","last_undegraded":"2024-09-12T22:35:52.680398+0000","last_fullsized":"2024-09-12T22:35:52.680398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'359","last_scrub_stamp":"2024-09-12T22:35:52.680287+0000","last_deep_scrub":"60'359","last_deep_scrub_stamp":"2024-09-12T22:35:52.680287+0000","last_clean_scrub_stamp":"2024-09-12T22:35:52.680287+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:42:43.940274+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":12324,"num_write":332,"num_write_kb":46371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"60'186","reported_seq":322,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:33.752706+0000","last_change":"2024-09-12T22:31:36.411665+0000","last_active":"2024-09-12T22:35:33.752706+0000","last_peered":"2024-09-12T22:35:33.752706+0000","last_clean":"2024-09-12T22:35:33.752706+0000","last_became_active":"2024-09-12T22:31:36.410182+0000","last_became_peered":"2024-09-12T22:31:36.410182+0000","last_unstale":"2024-09-12T22:35:33.752706+0000","last_undegraded":"2024-09-12T22:35:33.752706+0000","last_fullsized":"2024-09-12T22:35:33.752706+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":4160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"60'401","reported_seq":579,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:46.684410+0000","last_change":"2024-09-12T22:35:46.684439+0000","last_active":"2024-09-12T22:35:46.684410+0000","last_peered":"2024-09-12T22:35:46.684410+0000","last_clean":"2024-09-12T22:35:46.684410+0000","last_became_active":"2024-09-12T22:31:37.414776+0000","last_became_peered":"2024-09-12T22:31:37.414776+0000","last_unstale":"2024-09-12T22:35:46.684410+0000","last_undegraded":"2024-09-12T22:35:46.684410+0000","last_fullsized":"2024-09-12T22:35:46.684410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'401","last_scrub_stamp":"2024-09-12T22:35:46.684315+0000","last_deep_scrub":"60'401","last_deep_scrub_stamp":"2024-09-12T22:35:46.684315+0000","last_clean_scrub_stamp":"2024-09-12T22:35:46.684315+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:23:36.280912+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":24207,"num_write":361,"num_write_kb":50515,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"80'248","reported_seq":378,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:52.060187+0000","last_change":"2024-09-12T22:35:52.060226+0000","last_active":"2024-09-12T22:35:52.060187+0000","last_peered":"2024-09-12T22:35:52.060187+0000","last_clean":"2024-09-12T22:35:52.060187+0000","last_became_active":"2024-09-12T22:35:33.757550+0000","last_became_peered":"2024-09-12T22:35:33.757550+0000","last_unstale":"2024-09-12T22:35:52.060187+0000","last_undegraded":"2024-09-12T22:35:52.060187+0000","last_fullsized":"2024-09-12T22:35:52.060187+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'248","last_scrub_stamp":"2024-09-12T22:35:52.060095+0000","last_deep_scrub":"80'248","last_deep_scrub_stamp":"2024-09-12T22:35:52.060095+0000","last_clean_scrub_stamp":"2024-09-12T22:35:52.060095+0000","objects_scrubbed":4,"log_size":248,"log_dups_size":0,"ondisk_log_size":248,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:08:43.710152+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":12389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"60'439","reported_seq":936,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:44.642559+0000","last_change":"2024-09-12T22:35:44.642586+0000","last_active":"2024-09-12T22:35:44.642559+0000","last_peered":"2024-09-12T22:35:44.642559+0000","last_clean":"2024-09-12T22:35:44.642559+0000","last_became_active":"2024-09-12T22:35:27.729827+0000","last_became_peered":"2024-09-12T22:35:27.729827+0000","last_unstale":"2024-09-12T22:35:44.642559+0000","last_undegraded":"2024-09-12T22:35:44.642559+0000","last_fullsized":"2024-09-12T22:35:44.642559+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'439","last_scrub_stamp":"2024-09-12T22:35:44.642475+0000","last_deep_scrub":"60'439","last_deep_scrub_stamp":"2024-09-12T22:35:44.642475+0000","last_clean_scrub_stamp":"2024-09-12T22:35:44.642475+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:34:56.761822+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":6311,"num_write":403,"num_write_kb":64161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"80'52","reported_seq":209,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:49.201592+0000","last_change":"2024-09-12T22:35:49.201638+0000","last_active":"2024-09-12T22:35:49.201592+0000","last_peered":"2024-09-12T22:35:49.201592+0000","last_clean":"2024-09-12T22:35:49.201592+0000","last_became_active":"2024-09-12T22:35:20.737444+0000","last_became_peered":"2024-09-12T22:35:20.737444+0000","last_unstale":"2024-09-12T22:35:49.201592+0000","last_undegraded":"2024-09-12T22:35:49.201592+0000","last_fullsized":"2024-09-12T22:35:49.201592+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'52","last_scrub_stamp":"2024-09-12T22:35:49.201490+0000","last_deep_scrub":"80'52","last_deep_scrub_stamp":"2024-09-12T22:35:49.201490+0000","last_clean_scrub_stamp":"2024-09-12T22:35:49.201490+0000","objects_scrubbed":1,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:51:42.104127+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"60'438","reported_seq":633,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:54.672183+0000","last_change":"2024-09-12T22:35:54.672211+0000","last_active":"2024-09-12T22:35:54.672183+0000","last_peered":"2024-09-12T22:35:54.672183+0000","last_clean":"2024-09-12T22:35:54.672183+0000","last_became_active":"2024-09-12T22:31:37.414781+0000","last_became_peered":"2024-09-12T22:31:37.414781+0000","last_unstale":"2024-09-12T22:35:54.672183+0000","last_undegraded":"2024-09-12T22:35:54.672183+0000","last_fullsized":"2024-09-12T22:35:54.672183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'438","last_scrub_stamp":"2024-09-12T22:35:54.672094+0000","last_deep_scrub":"60'438","last_deep_scrub_stamp":"2024-09-12T22:35:54.672094+0000","last_clean_scrub_stamp":"2024-09-12T22:35:54.672094+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:37:17.072941+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":29290,"num_write":407,"num_write_kb":46733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"60'111","reported_seq":248,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:39.562670+0000","last_change":"2024-09-12T22:31:36.407945+0000","last_active":"2024-09-12T22:35:39.562670+0000","last_peered":"2024-09-12T22:35:39.562670+0000","last_clean":"2024-09-12T22:35:39.562670+0000","last_became_active":"2024-09-12T22:31:36.406959+0000","last_became_peered":"2024-09-12T22:31:36.406959+0000","last_unstale":"2024-09-12T22:35:39.562670+0000","last_undegraded":"2024-09-12T22:35:39.562670+0000","last_fullsized":"2024-09-12T22:35:39.562670+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:35.383905+0000","last_clean_scrub_stamp":"2024-09-12T22:31:35.383905+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61,"num_write_kb":4126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2747,"num_read_kb":1535780,"num_write":24498,"num_write_kb":4269351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5680,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26636,"ondisk_log_size":26636,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127268954,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":43,"num_read_kb":1462,"num_write":4457,"num_write_kb":127482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":54520159,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":254603264,"data_stored":254537908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4442,"internal_metadata":0},"log_size":6292,"ondisk_log_size":6292,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705723,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":174080,"kb_used_data":84656,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94197760,"statfs":{"total":96636764160,"available":96458506240,"internally_reserved":0,"allocated":86687744,"data_stored":86276944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":66,"seq":283467841546,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":145344,"kb_used_data":87280,"kb_used_omap":5,"kb_used_meta":58042,"kb_avail":94226496,"statfs":{"total":96636764160,"available":96487931904,"internally_reserved":0,"allocated":89374720,"data_stored":88974119,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6037,"internal_metadata":59435115},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738428,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":173516,"kb_used_data":79932,"kb_used_omap":1,"kb_used_meta":93566,"kb_avail":94198324,"statfs":{"total":96636764160,"available":96459083776,"internally_reserved":0,"allocated":81850368,"data_stored":81462353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":95812037},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":88076288,"data_stored":88052173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4442,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81141760,"data_stored":81130756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":85385216,"data_stored":85354979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T22:36:00.673 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-12T22:31:36.386296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:36:00.673 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-12T22:31:36.386296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:36:00.674 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-12T22:31:36.386296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:36:00.674 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-12T22:31:36.386296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:36:00.674 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-12T22:31:36.386296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:36:00.674 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-12T22:31:36.386296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:36:00.674 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-12T22:31:36.386296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:36:00.674 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-09-12T22:31:36.386296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:36:00.674 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-12T22:31:36.386296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:36:00.674 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-09-12T22:31:36.386296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:36:00.675 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-12T22:31:36.386296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:36:00.675 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-09-12T22:31:36.386296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:36:00.675 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-12T22:31:36.386296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:36:00.675 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-09-12T22:31:36.386296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:36:00.675 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-12T22:31:36.386296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:36:00.675 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-12T22:31:36.386296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:36:00.675 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-12T22:31:36.386296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:36:00.676 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-12T22:31:35.383905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:36:00.676 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-12T22:31:35.383905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:36:00.676 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-12T22:31:35.383905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:36:00.676 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-12T22:31:35.383905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:36:00.676 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-12T22:31:35.383905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:36:00.676 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-12T22:31:36.386296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:36:00.676 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-12T22:31:35.383905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:36:00.677 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-12T22:31:36.386296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:36:00.677 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-12T22:31:35.383905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:36:00.677 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-12T22:31:35.383905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:36:00.677 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-12T22:31:36.386296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:36:00.677 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-12T22:31:36.386296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:36:00.677 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-12T22:31:35.383905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:36:00.677 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-12T22:31:36.386296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:36:00.677 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-12T22:31:31.264226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:36:00.677 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-12T22:31:36.386296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:36:00.678 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-12T22:31:31.264226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:36:00.678 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-12T22:31:36.386296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:36:00.678 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-12T22:31:31.264226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:36:00.678 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-12T22:31:35.383905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:36:00.678 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-12T22:31:36.386296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:36:00.678 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-12T22:31:35.383905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:36:00.678 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-12T22:31:31.264226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:36:00.678 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-12T22:31:36.386296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:36:00.679 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-12T22:31:31.264226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:36:00.679 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-12T22:31:36.386296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:36:00.679 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-12T22:31:35.383905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:36:00.679 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-12T22:31:35.383905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:36:00.679 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-12T22:31:36.386296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:36:00.679 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-12T22:31:36.386296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:36:00.679 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-12T22:31:35.383905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:36:00.680 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-12T22:31:35.383905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:36:00.680 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-12T22:31:35.383905+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:36:00.680 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T22:36:20.681 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T22:36:20.991 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:36:20.993 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-12T22:36:21.002 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":226,"stamp":"2024-09-12T22:36:20.264813+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":127859341,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":2926,"num_read_kb":1537360,"num_write":29160,"num_write_kb":4400295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5694,"num_bytes_recovered":54520159,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33115,"ondisk_log_size":33115,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":492940,"kb_used_data":251868,"kb_used_omap":9,"kb_used_meta":241014,"kb_avail":282622580,"statfs":{"total":289910292480,"available":289405521920,"internally_reserved":0,"allocated":257912832,"data_stored":256713416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9227,"internal_metadata":246799349},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002889"},"pg_stats":[{"pgid":"4.3f","version":"60'422","reported_seq":545,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:44.101676+0000","last_change":"2024-09-12T22:35:44.101722+0000","last_active":"2024-09-12T22:35:44.101676+0000","last_peered":"2024-09-12T22:35:44.101676+0000","last_clean":"2024-09-12T22:35:44.101676+0000","last_became_active":"2024-09-12T22:35:30.731323+0000","last_became_peered":"2024-09-12T22:35:30.731323+0000","last_unstale":"2024-09-12T22:35:44.101676+0000","last_undegraded":"2024-09-12T22:35:44.101676+0000","last_fullsized":"2024-09-12T22:35:44.101676+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'422","last_scrub_stamp":"2024-09-12T22:35:44.101553+0000","last_deep_scrub":"60'422","last_deep_scrub_stamp":"2024-09-12T22:35:44.101553+0000","last_clean_scrub_stamp":"2024-09-12T22:35:44.101553+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:34:46.406008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":29437,"num_write":385,"num_write_kb":96431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"60'470","reported_seq":640,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:36:13.158395+0000","last_change":"2024-09-12T22:36:13.158422+0000","last_active":"2024-09-12T22:36:13.158395+0000","last_peered":"2024-09-12T22:36:13.158395+0000","last_clean":"2024-09-12T22:36:13.158395+0000","last_became_active":"2024-09-12T22:35:33.759906+0000","last_became_peered":"2024-09-12T22:35:33.759906+0000","last_unstale":"2024-09-12T22:36:13.158395+0000","last_undegraded":"2024-09-12T22:36:13.158395+0000","last_fullsized":"2024-09-12T22:36:13.158395+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'470","last_scrub_stamp":"2024-09-12T22:36:13.158312+0000","last_deep_scrub":"60'470","last_deep_scrub_stamp":"2024-09-12T22:36:13.158312+0000","last_clean_scrub_stamp":"2024-09-12T22:36:13.158312+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:55:18.158459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":18334,"num_write":442,"num_write_kb":109282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"60'391","reported_seq":922,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:36:16.161515+0000","last_change":"2024-09-12T22:36:16.161543+0000","last_active":"2024-09-12T22:36:16.161515+0000","last_peered":"2024-09-12T22:36:16.161515+0000","last_clean":"2024-09-12T22:36:16.161515+0000","last_became_active":"2024-09-12T22:35:30.731086+0000","last_became_peered":"2024-09-12T22:35:30.731086+0000","last_unstale":"2024-09-12T22:36:16.161515+0000","last_undegraded":"2024-09-12T22:36:16.161515+0000","last_fullsized":"2024-09-12T22:36:16.161515+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'391","last_scrub_stamp":"2024-09-12T22:36:16.161422+0000","last_deep_scrub":"60'391","last_deep_scrub_stamp":"2024-09-12T22:36:16.161422+0000","last_clean_scrub_stamp":"2024-09-12T22:36:16.161422+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:00:56.211938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":32771,"num_write":355,"num_write_kb":71120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"60'397","reported_seq":590,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:53.683296+0000","last_change":"2024-09-12T22:35:53.683323+0000","last_active":"2024-09-12T22:35:53.683296+0000","last_peered":"2024-09-12T22:35:53.683296+0000","last_clean":"2024-09-12T22:35:53.683296+0000","last_became_active":"2024-09-12T22:31:37.412746+0000","last_became_peered":"2024-09-12T22:31:37.412746+0000","last_unstale":"2024-09-12T22:35:53.683296+0000","last_undegraded":"2024-09-12T22:35:53.683296+0000","last_fullsized":"2024-09-12T22:35:53.683296+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'397","last_scrub_stamp":"2024-09-12T22:35:53.683164+0000","last_deep_scrub":"60'397","last_deep_scrub_stamp":"2024-09-12T22:35:53.683164+0000","last_clean_scrub_stamp":"2024-09-12T22:35:53.683164+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:26:18.488292+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":28544,"num_write":368,"num_write_kb":83737,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"60'458","reported_seq":600,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:36:05.182613+0000","last_change":"2024-09-12T22:36:05.182641+0000","last_active":"2024-09-12T22:36:05.182613+0000","last_peered":"2024-09-12T22:36:05.182613+0000","last_clean":"2024-09-12T22:36:05.182613+0000","last_became_active":"2024-09-12T22:35:24.756373+0000","last_became_peered":"2024-09-12T22:35:24.756373+0000","last_unstale":"2024-09-12T22:36:05.182613+0000","last_undegraded":"2024-09-12T22:36:05.182613+0000","last_fullsized":"2024-09-12T22:36:05.182613+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'458","last_scrub_stamp":"2024-09-12T22:36:05.182473+0000","last_deep_scrub":"60'458","last_deep_scrub_stamp":"2024-09-12T22:36:05.182473+0000","last_clean_scrub_stamp":"2024-09-12T22:36:05.182473+0000","objects_scrubbed":0,"log_size":458,"log_dups_size":0,"ondisk_log_size":458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:58:01.920961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":28467,"num_write":430,"num_write_kb":81329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":198,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"60'381","reported_seq":524,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:36:01.764053+0000","last_change":"2024-09-12T22:36:01.764105+0000","last_active":"2024-09-12T22:36:01.764053+0000","last_peered":"2024-09-12T22:36:01.764053+0000","last_clean":"2024-09-12T22:36:01.764053+0000","last_became_active":"2024-09-12T22:31:37.408811+0000","last_became_peered":"2024-09-12T22:31:37.408811+0000","last_unstale":"2024-09-12T22:36:01.764053+0000","last_undegraded":"2024-09-12T22:36:01.764053+0000","last_fullsized":"2024-09-12T22:36:01.764053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'381","last_scrub_stamp":"2024-09-12T22:36:01.763935+0000","last_deep_scrub":"60'381","last_deep_scrub_stamp":"2024-09-12T22:36:01.763935+0000","last_clean_scrub_stamp":"2024-09-12T22:36:01.763935+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:20:25.290299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":60,"num_write":353,"num_write_kb":58419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"60'439","reported_seq":627,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:55.713294+0000","last_change":"2024-09-12T22:35:55.713323+0000","last_active":"2024-09-12T22:35:55.713294+0000","last_peered":"2024-09-12T22:35:55.713294+0000","last_clean":"2024-09-12T22:35:55.713294+0000","last_became_active":"2024-09-12T22:31:37.412691+0000","last_became_peered":"2024-09-12T22:31:37.412691+0000","last_unstale":"2024-09-12T22:35:55.713294+0000","last_undegraded":"2024-09-12T22:35:55.713294+0000","last_fullsized":"2024-09-12T22:35:55.713294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'439","last_scrub_stamp":"2024-09-12T22:35:55.713169+0000","last_deep_scrub":"60'439","last_deep_scrub_stamp":"2024-09-12T22:35:55.713169+0000","last_clean_scrub_stamp":"2024-09-12T22:35:55.713169+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:43:06.981277+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":27053,"num_write":405,"num_write_kb":79743,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"60'384","reported_seq":598,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:57.714269+0000","last_change":"2024-09-12T22:35:57.714299+0000","last_active":"2024-09-12T22:35:57.714269+0000","last_peered":"2024-09-12T22:35:57.714269+0000","last_clean":"2024-09-12T22:35:57.714269+0000","last_became_active":"2024-09-12T22:31:37.410633+0000","last_became_peered":"2024-09-12T22:31:37.410633+0000","last_unstale":"2024-09-12T22:35:57.714269+0000","last_undegraded":"2024-09-12T22:35:57.714269+0000","last_fullsized":"2024-09-12T22:35:57.714269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'384","last_scrub_stamp":"2024-09-12T22:35:57.714181+0000","last_deep_scrub":"60'384","last_deep_scrub_stamp":"2024-09-12T22:35:57.714181+0000","last_clean_scrub_stamp":"2024-09-12T22:35:57.714181+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:10:02.068838+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":44358,"num_write":338,"num_write_kb":67411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"60'418","reported_seq":1011,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:36:07.453864+0000","last_change":"2024-09-12T22:36:07.453891+0000","last_active":"2024-09-12T22:36:07.453864+0000","last_peered":"2024-09-12T22:36:07.453864+0000","last_clean":"2024-09-12T22:36:07.453864+0000","last_became_active":"2024-09-12T22:35:28.731002+0000","last_became_peered":"2024-09-12T22:35:28.731002+0000","last_unstale":"2024-09-12T22:36:07.453864+0000","last_undegraded":"2024-09-12T22:36:07.453864+0000","last_fullsized":"2024-09-12T22:36:07.453864+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'418","last_scrub_stamp":"2024-09-12T22:36:07.453765+0000","last_deep_scrub":"60'418","last_deep_scrub_stamp":"2024-09-12T22:36:07.453765+0000","last_clean_scrub_stamp":"2024-09-12T22:36:07.453765+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:20:15.583655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":48711,"num_write":384,"num_write_kb":63228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"60'406","reported_seq":529,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:49.059929+0000","last_change":"2024-09-12T22:35:49.059973+0000","last_active":"2024-09-12T22:35:49.059929+0000","last_peered":"2024-09-12T22:35:49.059929+0000","last_clean":"2024-09-12T22:35:49.059929+0000","last_became_active":"2024-09-12T22:35:27.729480+0000","last_became_peered":"2024-09-12T22:35:27.729480+0000","last_unstale":"2024-09-12T22:35:49.059929+0000","last_undegraded":"2024-09-12T22:35:49.059929+0000","last_fullsized":"2024-09-12T22:35:49.059929+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'406","last_scrub_stamp":"2024-09-12T22:35:49.059789+0000","last_deep_scrub":"60'406","last_deep_scrub_stamp":"2024-09-12T22:35:49.059789+0000","last_clean_scrub_stamp":"2024-09-12T22:35:49.059789+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:38:19.067922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":21851,"num_write":367,"num_write_kb":79913,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"60'338","reported_seq":488,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:49.695521+0000","last_change":"2024-09-12T22:35:49.695572+0000","last_active":"2024-09-12T22:35:49.695521+0000","last_peered":"2024-09-12T22:35:49.695521+0000","last_clean":"2024-09-12T22:35:49.695521+0000","last_became_active":"2024-09-12T22:31:37.414165+0000","last_became_peered":"2024-09-12T22:31:37.414165+0000","last_unstale":"2024-09-12T22:35:49.695521+0000","last_undegraded":"2024-09-12T22:35:49.695521+0000","last_fullsized":"2024-09-12T22:35:49.695521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'338","last_scrub_stamp":"2024-09-12T22:35:49.695416+0000","last_deep_scrub":"60'338","last_deep_scrub_stamp":"2024-09-12T22:35:49.695416+0000","last_clean_scrub_stamp":"2024-09-12T22:35:49.695416+0000","objects_scrubbed":0,"log_size":338,"log_dups_size":0,"ondisk_log_size":338,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:04:19.237182+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":4053,"num_write":316,"num_write_kb":21475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"60'359","reported_seq":504,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:36:12.134942+0000","last_change":"2024-09-12T22:36:12.134980+0000","last_active":"2024-09-12T22:36:12.134942+0000","last_peered":"2024-09-12T22:36:12.134942+0000","last_clean":"2024-09-12T22:36:12.134942+0000","last_became_active":"2024-09-12T22:35:33.760739+0000","last_became_peered":"2024-09-12T22:35:33.760739+0000","last_unstale":"2024-09-12T22:36:12.134942+0000","last_undegraded":"2024-09-12T22:36:12.134942+0000","last_fullsized":"2024-09-12T22:36:12.134942+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'359","last_scrub_stamp":"2024-09-12T22:36:12.134850+0000","last_deep_scrub":"60'359","last_deep_scrub_stamp":"2024-09-12T22:36:12.134850+0000","last_clean_scrub_stamp":"2024-09-12T22:36:12.134850+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:34:38.433704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":6688,"num_write":330,"num_write_kb":38146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"60'402","reported_seq":546,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:36:08.207410+0000","last_change":"2024-09-12T22:36:08.207438+0000","last_active":"2024-09-12T22:36:08.207410+0000","last_peered":"2024-09-12T22:36:08.207410+0000","last_clean":"2024-09-12T22:36:08.207410+0000","last_became_active":"2024-09-12T22:35:33.754938+0000","last_became_peered":"2024-09-12T22:35:33.754938+0000","last_unstale":"2024-09-12T22:36:08.207410+0000","last_undegraded":"2024-09-12T22:36:08.207410+0000","last_fullsized":"2024-09-12T22:36:08.207410+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'402","last_scrub_stamp":"2024-09-12T22:36:08.207310+0000","last_deep_scrub":"60'402","last_deep_scrub_stamp":"2024-09-12T22:36:08.207310+0000","last_clean_scrub_stamp":"2024-09-12T22:36:08.207310+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:29:01.537795+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":16384,"num_write":363,"num_write_kb":62556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"60'409","reported_seq":944,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:36:14.095692+0000","last_change":"2024-09-12T22:36:14.095717+0000","last_active":"2024-09-12T22:36:14.095692+0000","last_peered":"2024-09-12T22:36:14.095692+0000","last_clean":"2024-09-12T22:36:14.095692+0000","last_became_active":"2024-09-12T22:35:29.735835+0000","last_became_peered":"2024-09-12T22:35:29.735835+0000","last_unstale":"2024-09-12T22:36:14.095692+0000","last_undegraded":"2024-09-12T22:36:14.095692+0000","last_fullsized":"2024-09-12T22:36:14.095692+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'409","last_scrub_stamp":"2024-09-12T22:36:14.095602+0000","last_deep_scrub":"60'409","last_deep_scrub_stamp":"2024-09-12T22:36:14.095602+0000","last_clean_scrub_stamp":"2024-09-12T22:36:14.095602+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:03:48.742803+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":13943,"num_write":382,"num_write_kb":54682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"60'412","reported_seq":957,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:36:13.112788+0000","last_change":"2024-09-12T22:36:13.112815+0000","last_active":"2024-09-12T22:36:13.112788+0000","last_peered":"2024-09-12T22:36:13.112788+0000","last_clean":"2024-09-12T22:36:13.112788+0000","last_became_active":"2024-09-12T22:35:28.730413+0000","last_became_peered":"2024-09-12T22:35:28.730413+0000","last_unstale":"2024-09-12T22:36:13.112788+0000","last_undegraded":"2024-09-12T22:36:13.112788+0000","last_fullsized":"2024-09-12T22:36:13.112788+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'412","last_scrub_stamp":"2024-09-12T22:36:13.112694+0000","last_deep_scrub":"60'412","last_deep_scrub_stamp":"2024-09-12T22:36:13.112694+0000","last_clean_scrub_stamp":"2024-09-12T22:36:13.112694+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:18:19.359470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":19700,"num_write":377,"num_write_kb":67929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"60'404","reported_seq":546,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:59.747485+0000","last_change":"2024-09-12T22:35:59.747527+0000","last_active":"2024-09-12T22:35:59.747485+0000","last_peered":"2024-09-12T22:35:59.747485+0000","last_clean":"2024-09-12T22:35:59.747485+0000","last_became_active":"2024-09-12T22:31:37.410557+0000","last_became_peered":"2024-09-12T22:31:37.410557+0000","last_unstale":"2024-09-12T22:35:59.747485+0000","last_undegraded":"2024-09-12T22:35:59.747485+0000","last_fullsized":"2024-09-12T22:35:59.747485+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'404","last_scrub_stamp":"2024-09-12T22:35:59.747393+0000","last_deep_scrub":"60'404","last_deep_scrub_stamp":"2024-09-12T22:35:59.747393+0000","last_clean_scrub_stamp":"2024-09-12T22:35:59.747393+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:39:16.963301+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":368,"num_write_kb":25652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"60'405","reported_seq":950,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:36:12.392515+0000","last_change":"2024-09-12T22:36:12.392515+0000","last_active":"2024-09-12T22:36:12.392515+0000","last_peered":"2024-09-12T22:36:12.392515+0000","last_clean":"2024-09-12T22:36:12.392515+0000","last_became_active":"2024-09-12T22:35:31.730883+0000","last_became_peered":"2024-09-12T22:35:31.730883+0000","last_unstale":"2024-09-12T22:36:12.392515+0000","last_undegraded":"2024-09-12T22:36:12.392515+0000","last_fullsized":"2024-09-12T22:36:12.392515+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'405","last_scrub_stamp":"2024-09-12T22:36:12.392397+0000","last_deep_scrub":"60'405","last_deep_scrub_stamp":"2024-09-12T22:36:12.392397+0000","last_clean_scrub_stamp":"2024-09-12T22:36:12.392397+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:06:06.178507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":18251,"num_write":369,"num_write_kb":34203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"60'406","reported_seq":588,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:54.128320+0000","last_change":"2024-09-12T22:35:54.128349+0000","last_active":"2024-09-12T22:35:54.128320+0000","last_peered":"2024-09-12T22:35:54.128320+0000","last_clean":"2024-09-12T22:35:54.128320+0000","last_became_active":"2024-09-12T22:35:33.754915+0000","last_became_peered":"2024-09-12T22:35:33.754915+0000","last_unstale":"2024-09-12T22:35:54.128320+0000","last_undegraded":"2024-09-12T22:35:54.128320+0000","last_fullsized":"2024-09-12T22:35:54.128320+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'406","last_scrub_stamp":"2024-09-12T22:35:54.128229+0000","last_deep_scrub":"60'406","last_deep_scrub_stamp":"2024-09-12T22:35:54.128229+0000","last_clean_scrub_stamp":"2024-09-12T22:35:54.128229+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:30:39.517247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":45843,"num_write":367,"num_write_kb":59097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"60'413","reported_seq":942,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:36:11.365130+0000","last_change":"2024-09-12T22:36:11.365156+0000","last_active":"2024-09-12T22:36:11.365130+0000","last_peered":"2024-09-12T22:36:11.365130+0000","last_clean":"2024-09-12T22:36:11.365130+0000","last_became_active":"2024-09-12T22:35:31.730742+0000","last_became_peered":"2024-09-12T22:35:31.730742+0000","last_unstale":"2024-09-12T22:36:11.365130+0000","last_undegraded":"2024-09-12T22:36:11.365130+0000","last_fullsized":"2024-09-12T22:36:11.365130+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'413","last_scrub_stamp":"2024-09-12T22:36:11.365040+0000","last_deep_scrub":"60'413","last_deep_scrub_stamp":"2024-09-12T22:36:11.365040+0000","last_clean_scrub_stamp":"2024-09-12T22:36:11.365040+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:21:35.011158+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":20855,"num_write":371,"num_write_kb":71095,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"60'441","reported_seq":631,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:51.678006+0000","last_change":"2024-09-12T22:35:51.678006+0000","last_active":"2024-09-12T22:35:51.678006+0000","last_peered":"2024-09-12T22:35:51.678006+0000","last_clean":"2024-09-12T22:35:51.678006+0000","last_became_active":"2024-09-12T22:31:37.413786+0000","last_became_peered":"2024-09-12T22:31:37.413786+0000","last_unstale":"2024-09-12T22:35:51.678006+0000","last_undegraded":"2024-09-12T22:35:51.678006+0000","last_fullsized":"2024-09-12T22:35:51.678006+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'441","last_scrub_stamp":"2024-09-12T22:35:51.677862+0000","last_deep_scrub":"60'441","last_deep_scrub_stamp":"2024-09-12T22:35:51.677862+0000","last_clean_scrub_stamp":"2024-09-12T22:35:51.677862+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:34:24.660095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":23954,"num_write":419,"num_write_kb":72528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"60'414","reported_seq":632,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:56.675365+0000","last_change":"2024-09-12T22:35:56.675365+0000","last_active":"2024-09-12T22:35:56.675365+0000","last_peered":"2024-09-12T22:35:56.675365+0000","last_clean":"2024-09-12T22:35:56.675365+0000","last_became_active":"2024-09-12T22:31:37.414319+0000","last_became_peered":"2024-09-12T22:31:37.414319+0000","last_unstale":"2024-09-12T22:35:56.675365+0000","last_undegraded":"2024-09-12T22:35:56.675365+0000","last_fullsized":"2024-09-12T22:35:56.675365+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'414","last_scrub_stamp":"2024-09-12T22:35:56.675192+0000","last_deep_scrub":"60'414","last_deep_scrub_stamp":"2024-09-12T22:35:56.675192+0000","last_clean_scrub_stamp":"2024-09-12T22:35:56.675192+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:17:56.600295+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":44129,"num_write":387,"num_write_kb":104899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"60'444","reported_seq":560,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:57.082767+0000","last_change":"2024-09-12T22:35:57.082793+0000","last_active":"2024-09-12T22:35:57.082767+0000","last_peered":"2024-09-12T22:35:57.082767+0000","last_clean":"2024-09-12T22:35:57.082767+0000","last_became_active":"2024-09-12T22:35:25.727269+0000","last_became_peered":"2024-09-12T22:35:25.727269+0000","last_unstale":"2024-09-12T22:35:57.082767+0000","last_undegraded":"2024-09-12T22:35:57.082767+0000","last_fullsized":"2024-09-12T22:35:57.082767+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'444","last_scrub_stamp":"2024-09-12T22:35:57.082674+0000","last_deep_scrub":"60'444","last_deep_scrub_stamp":"2024-09-12T22:35:57.082674+0000","last_clean_scrub_stamp":"2024-09-12T22:35:57.082674+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:11:01.171297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":17411,"num_write":407,"num_write_kb":87850,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"60'421","reported_seq":656,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:56.242246+0000","last_change":"2024-09-12T22:35:56.242246+0000","last_active":"2024-09-12T22:35:56.242246+0000","last_peered":"2024-09-12T22:35:56.242246+0000","last_clean":"2024-09-12T22:35:56.242246+0000","last_became_active":"2024-09-12T22:31:37.409951+0000","last_became_peered":"2024-09-12T22:31:37.409951+0000","last_unstale":"2024-09-12T22:35:56.242246+0000","last_undegraded":"2024-09-12T22:35:56.242246+0000","last_fullsized":"2024-09-12T22:35:56.242246+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'421","last_scrub_stamp":"2024-09-12T22:35:56.242126+0000","last_deep_scrub":"60'421","last_deep_scrub_stamp":"2024-09-12T22:35:56.242126+0000","last_clean_scrub_stamp":"2024-09-12T22:35:56.242126+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:53:59.255839+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":44074,"num_write":389,"num_write_kb":44104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"60'459","reported_seq":623,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:40.989070+0000","last_change":"2024-09-12T22:35:40.989130+0000","last_active":"2024-09-12T22:35:40.989070+0000","last_peered":"2024-09-12T22:35:40.989070+0000","last_clean":"2024-09-12T22:35:40.989070+0000","last_became_active":"2024-09-12T22:35:33.754576+0000","last_became_peered":"2024-09-12T22:35:33.754576+0000","last_unstale":"2024-09-12T22:35:40.989070+0000","last_undegraded":"2024-09-12T22:35:40.989070+0000","last_fullsized":"2024-09-12T22:35:40.989070+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'459","last_scrub_stamp":"2024-09-12T22:35:40.988963+0000","last_deep_scrub":"60'459","last_deep_scrub_stamp":"2024-09-12T22:35:40.988963+0000","last_clean_scrub_stamp":"2024-09-12T22:35:40.988963+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:27:58.591980+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":28605,"num_write":432,"num_write_kb":100377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"60'419","reported_seq":525,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:42.024749+0000","last_change":"2024-09-12T22:35:42.024809+0000","last_active":"2024-09-12T22:35:42.024749+0000","last_peered":"2024-09-12T22:35:42.024749+0000","last_clean":"2024-09-12T22:35:42.024749+0000","last_became_active":"2024-09-12T22:35:29.735450+0000","last_became_peered":"2024-09-12T22:35:29.735450+0000","last_unstale":"2024-09-12T22:35:42.024749+0000","last_undegraded":"2024-09-12T22:35:42.024749+0000","last_fullsized":"2024-09-12T22:35:42.024749+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'419","last_scrub_stamp":"2024-09-12T22:35:42.024639+0000","last_deep_scrub":"60'419","last_deep_scrub_stamp":"2024-09-12T22:35:42.024639+0000","last_clean_scrub_stamp":"2024-09-12T22:35:42.024639+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:53:06.906248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":16852,"num_write":404,"num_write_kb":34622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"60'494","reported_seq":720,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:44.209175+0000","last_change":"2024-09-12T22:35:44.209175+0000","last_active":"2024-09-12T22:35:44.209175+0000","last_peered":"2024-09-12T22:35:44.209175+0000","last_clean":"2024-09-12T22:35:44.209175+0000","last_became_active":"2024-09-12T22:31:37.410563+0000","last_became_peered":"2024-09-12T22:31:37.410563+0000","last_unstale":"2024-09-12T22:35:44.209175+0000","last_undegraded":"2024-09-12T22:35:44.209175+0000","last_fullsized":"2024-09-12T22:35:44.209175+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'494","last_scrub_stamp":"2024-09-12T22:35:44.209026+0000","last_deep_scrub":"60'494","last_deep_scrub_stamp":"2024-09-12T22:35:44.209026+0000","last_clean_scrub_stamp":"2024-09-12T22:35:44.209026+0000","objects_scrubbed":0,"log_size":494,"log_dups_size":0,"ondisk_log_size":494,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:13:03.173567+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":35239,"num_write":450,"num_write_kb":76898,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"60'401","reported_seq":933,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:36:15.139912+0000","last_change":"2024-09-12T22:36:15.139982+0000","last_active":"2024-09-12T22:36:15.139912+0000","last_peered":"2024-09-12T22:36:15.139912+0000","last_clean":"2024-09-12T22:36:15.139912+0000","last_became_active":"2024-09-12T22:35:30.731155+0000","last_became_peered":"2024-09-12T22:35:30.731155+0000","last_unstale":"2024-09-12T22:36:15.139912+0000","last_undegraded":"2024-09-12T22:36:15.139912+0000","last_fullsized":"2024-09-12T22:36:15.139912+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'401","last_scrub_stamp":"2024-09-12T22:36:15.139807+0000","last_deep_scrub":"60'401","last_deep_scrub_stamp":"2024-09-12T22:36:15.139807+0000","last_clean_scrub_stamp":"2024-09-12T22:36:15.139807+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:28:07.010769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":10993,"num_write":369,"num_write_kb":55171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"60'390","reported_seq":547,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:36:10.187625+0000","last_change":"2024-09-12T22:36:10.187652+0000","last_active":"2024-09-12T22:36:10.187625+0000","last_peered":"2024-09-12T22:36:10.187625+0000","last_clean":"2024-09-12T22:36:10.187625+0000","last_became_active":"2024-09-12T22:35:33.756108+0000","last_became_peered":"2024-09-12T22:35:33.756108+0000","last_unstale":"2024-09-12T22:36:10.187625+0000","last_undegraded":"2024-09-12T22:36:10.187625+0000","last_fullsized":"2024-09-12T22:36:10.187625+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'390","last_scrub_stamp":"2024-09-12T22:36:10.187539+0000","last_deep_scrub":"60'390","last_deep_scrub_stamp":"2024-09-12T22:36:10.187539+0000","last_clean_scrub_stamp":"2024-09-12T22:36:10.187539+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:46:47.612005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":18588,"num_write":360,"num_write_kb":59307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"60'429","reported_seq":1017,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:55.226657+0000","last_change":"2024-09-12T22:35:55.226704+0000","last_active":"2024-09-12T22:35:55.226657+0000","last_peered":"2024-09-12T22:35:55.226657+0000","last_clean":"2024-09-12T22:35:55.226657+0000","last_became_active":"2024-09-12T22:35:23.755618+0000","last_became_peered":"2024-09-12T22:35:23.755618+0000","last_unstale":"2024-09-12T22:35:55.226657+0000","last_undegraded":"2024-09-12T22:35:55.226657+0000","last_fullsized":"2024-09-12T22:35:55.226657+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'429","last_scrub_stamp":"2024-09-12T22:35:55.226556+0000","last_deep_scrub":"60'429","last_deep_scrub_stamp":"2024-09-12T22:35:55.226556+0000","last_clean_scrub_stamp":"2024-09-12T22:35:55.226556+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:42:10.514737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":32541,"num_write":398,"num_write_kb":76609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"60'458","reported_seq":584,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:45.065775+0000","last_change":"2024-09-12T22:35:45.065802+0000","last_active":"2024-09-12T22:35:45.065775+0000","last_peered":"2024-09-12T22:35:45.065775+0000","last_clean":"2024-09-12T22:35:45.065775+0000","last_became_active":"2024-09-12T22:35:28.730337+0000","last_became_peered":"2024-09-12T22:35:28.730337+0000","last_unstale":"2024-09-12T22:35:45.065775+0000","last_undegraded":"2024-09-12T22:35:45.065775+0000","last_fullsized":"2024-09-12T22:35:45.065775+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'458","last_scrub_stamp":"2024-09-12T22:35:45.065680+0000","last_deep_scrub":"60'458","last_deep_scrub_stamp":"2024-09-12T22:35:45.065680+0000","last_clean_scrub_stamp":"2024-09-12T22:35:45.065680+0000","objects_scrubbed":0,"log_size":458,"log_dups_size":0,"ondisk_log_size":458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:54.975726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":16425,"num_write":413,"num_write_kb":47110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"60'432","reported_seq":992,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:40.156788+0000","last_change":"2024-09-12T22:35:40.156788+0000","last_active":"2024-09-12T22:35:40.156788+0000","last_peered":"2024-09-12T22:35:40.156788+0000","last_clean":"2024-09-12T22:35:40.156788+0000","last_became_active":"2024-09-12T22:35:26.731135+0000","last_became_peered":"2024-09-12T22:35:26.731135+0000","last_unstale":"2024-09-12T22:35:40.156788+0000","last_undegraded":"2024-09-12T22:35:40.156788+0000","last_fullsized":"2024-09-12T22:35:40.156788+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'432","last_scrub_stamp":"2024-09-12T22:35:40.156631+0000","last_deep_scrub":"60'432","last_deep_scrub_stamp":"2024-09-12T22:35:40.156631+0000","last_clean_scrub_stamp":"2024-09-12T22:35:40.156631+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:37:49.074651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":21090,"num_write":393,"num_write_kb":67477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"60'458","reported_seq":646,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:48.723864+0000","last_change":"2024-09-12T22:35:48.723864+0000","last_active":"2024-09-12T22:35:48.723864+0000","last_peered":"2024-09-12T22:35:48.723864+0000","last_clean":"2024-09-12T22:35:48.723864+0000","last_became_active":"2024-09-12T22:31:37.414265+0000","last_became_peered":"2024-09-12T22:31:37.414265+0000","last_unstale":"2024-09-12T22:35:48.723864+0000","last_undegraded":"2024-09-12T22:35:48.723864+0000","last_fullsized":"2024-09-12T22:35:48.723864+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'458","last_scrub_stamp":"2024-09-12T22:35:48.723701+0000","last_deep_scrub":"60'458","last_deep_scrub_stamp":"2024-09-12T22:35:48.723701+0000","last_clean_scrub_stamp":"2024-09-12T22:35:48.723701+0000","objects_scrubbed":0,"log_size":458,"log_dups_size":0,"ondisk_log_size":458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:22:45.422855+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":37395,"num_write":421,"num_write_kb":73250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"60'411","reported_seq":592,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:36:11.171452+0000","last_change":"2024-09-12T22:36:11.171479+0000","last_active":"2024-09-12T22:36:11.171452+0000","last_peered":"2024-09-12T22:36:11.171452+0000","last_clean":"2024-09-12T22:36:11.171452+0000","last_became_active":"2024-09-12T22:35:33.761121+0000","last_became_peered":"2024-09-12T22:35:33.761121+0000","last_unstale":"2024-09-12T22:36:11.171452+0000","last_undegraded":"2024-09-12T22:36:11.171452+0000","last_fullsized":"2024-09-12T22:36:11.171452+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'411","last_scrub_stamp":"2024-09-12T22:36:11.171351+0000","last_deep_scrub":"60'411","last_deep_scrub_stamp":"2024-09-12T22:36:11.171351+0000","last_clean_scrub_stamp":"2024-09-12T22:36:11.171351+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:40:10.374607+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":36400,"num_write":371,"num_write_kb":92142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"80'550","reported_seq":695,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:36:08.966248+0000","last_change":"2024-09-12T22:36:08.966248+0000","last_active":"2024-09-12T22:36:08.966248+0000","last_peered":"2024-09-12T22:36:08.966248+0000","last_clean":"2024-09-12T22:36:08.966248+0000","last_became_active":"2024-09-12T22:31:36.410871+0000","last_became_peered":"2024-09-12T22:31:36.410871+0000","last_unstale":"2024-09-12T22:36:08.966248+0000","last_undegraded":"2024-09-12T22:36:08.966248+0000","last_fullsized":"2024-09-12T22:36:08.966248+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'550","last_scrub_stamp":"2024-09-12T22:36:08.966117+0000","last_deep_scrub":"80'550","last_deep_scrub_stamp":"2024-09-12T22:36:08.966117+0000","last_clean_scrub_stamp":"2024-09-12T22:36:08.966117+0000","objects_scrubbed":4,"log_size":550,"log_dups_size":0,"ondisk_log_size":550,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:17:33.384373+0000","scrub_duration":18,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":495,"num_write_kb":8426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"60'427","reported_seq":607,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:48.109072+0000","last_change":"2024-09-12T22:35:48.109100+0000","last_active":"2024-09-12T22:35:48.109072+0000","last_peered":"2024-09-12T22:35:48.109072+0000","last_clean":"2024-09-12T22:35:48.109072+0000","last_became_active":"2024-09-12T22:35:31.730237+0000","last_became_peered":"2024-09-12T22:35:31.730237+0000","last_unstale":"2024-09-12T22:35:48.109072+0000","last_undegraded":"2024-09-12T22:35:48.109072+0000","last_fullsized":"2024-09-12T22:35:48.109072+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'427","last_scrub_stamp":"2024-09-12T22:35:48.108962+0000","last_deep_scrub":"60'427","last_deep_scrub_stamp":"2024-09-12T22:35:48.108962+0000","last_clean_scrub_stamp":"2024-09-12T22:35:48.108962+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:37:11.699764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":59223,"num_write":394,"num_write_kb":80309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":175,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"60'55","reported_seq":200,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:36:03.381600+0000","last_change":"2024-09-12T22:36:03.381600+0000","last_active":"2024-09-12T22:36:03.381600+0000","last_peered":"2024-09-12T22:36:03.381600+0000","last_clean":"2024-09-12T22:36:03.381600+0000","last_became_active":"2024-09-12T22:31:36.407447+0000","last_became_peered":"2024-09-12T22:31:36.407447+0000","last_unstale":"2024-09-12T22:36:03.381600+0000","last_undegraded":"2024-09-12T22:36:03.381600+0000","last_fullsized":"2024-09-12T22:36:03.381600+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'55","last_scrub_stamp":"2024-09-12T22:36:03.381475+0000","last_deep_scrub":"60'55","last_deep_scrub_stamp":"2024-09-12T22:36:03.381475+0000","last_clean_scrub_stamp":"2024-09-12T22:36:03.381475+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:24:57.286221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"60'424","reported_seq":597,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:46.125858+0000","last_change":"2024-09-12T22:35:46.125885+0000","last_active":"2024-09-12T22:35:46.125858+0000","last_peered":"2024-09-12T22:35:46.125858+0000","last_clean":"2024-09-12T22:35:46.125858+0000","last_became_active":"2024-09-12T22:31:37.411168+0000","last_became_peered":"2024-09-12T22:31:37.411168+0000","last_unstale":"2024-09-12T22:35:46.125858+0000","last_undegraded":"2024-09-12T22:35:46.125858+0000","last_fullsized":"2024-09-12T22:35:46.125858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'424","last_scrub_stamp":"2024-09-12T22:35:46.125739+0000","last_deep_scrub":"60'424","last_deep_scrub_stamp":"2024-09-12T22:35:46.125739+0000","last_clean_scrub_stamp":"2024-09-12T22:35:46.125739+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:21:18.641116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":13992,"num_write":386,"num_write_kb":38510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"60'70","reported_seq":56,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:59.109576+0000","last_change":"2024-09-12T22:35:59.109607+0000","last_active":"2024-09-12T22:35:59.109576+0000","last_peered":"2024-09-12T22:35:59.109576+0000","last_clean":"2024-09-12T22:35:59.109576+0000","last_became_active":"2024-09-12T22:35:20.734023+0000","last_became_peered":"2024-09-12T22:35:20.734023+0000","last_unstale":"2024-09-12T22:35:59.109576+0000","last_undegraded":"2024-09-12T22:35:59.109576+0000","last_fullsized":"2024-09-12T22:35:59.109576+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'70","last_scrub_stamp":"2024-09-12T22:35:59.109487+0000","last_deep_scrub":"60'70","last_deep_scrub_stamp":"2024-09-12T22:35:59.109487+0000","last_clean_scrub_stamp":"2024-09-12T22:35:59.109487+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:39.399204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"60'395","reported_seq":586,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:50.208551+0000","last_change":"2024-09-12T22:35:50.208596+0000","last_active":"2024-09-12T22:35:50.208551+0000","last_peered":"2024-09-12T22:35:50.208551+0000","last_clean":"2024-09-12T22:35:50.208551+0000","last_became_active":"2024-09-12T22:31:37.409666+0000","last_became_peered":"2024-09-12T22:31:37.409666+0000","last_unstale":"2024-09-12T22:35:50.208551+0000","last_undegraded":"2024-09-12T22:35:50.208551+0000","last_fullsized":"2024-09-12T22:35:50.208551+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'395","last_scrub_stamp":"2024-09-12T22:35:50.208421+0000","last_deep_scrub":"60'395","last_deep_scrub_stamp":"2024-09-12T22:35:50.208421+0000","last_clean_scrub_stamp":"2024-09-12T22:35:50.208421+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:31:45.148484+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":24198,"num_write":363,"num_write_kb":67056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"80'72","reported_seq":225,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:36:11.039474+0000","last_change":"2024-09-12T22:36:11.039474+0000","last_active":"2024-09-12T22:36:11.039474+0000","last_peered":"2024-09-12T22:36:11.039474+0000","last_clean":"2024-09-12T22:36:11.039474+0000","last_became_active":"2024-09-12T22:35:20.736755+0000","last_became_peered":"2024-09-12T22:35:20.736755+0000","last_unstale":"2024-09-12T22:36:11.039474+0000","last_undegraded":"2024-09-12T22:36:11.039474+0000","last_fullsized":"2024-09-12T22:36:11.039474+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'72","last_scrub_stamp":"2024-09-12T22:36:11.039343+0000","last_deep_scrub":"80'72","last_deep_scrub_stamp":"2024-09-12T22:36:11.039343+0000","last_clean_scrub_stamp":"2024-09-12T22:36:11.039343+0000","objects_scrubbed":4,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:23:26.594644+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"80'160","reported_seq":319,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:42.614262+0000","last_change":"2024-09-12T22:35:42.614262+0000","last_active":"2024-09-12T22:35:42.614262+0000","last_peered":"2024-09-12T22:35:42.614262+0000","last_clean":"2024-09-12T22:35:42.614262+0000","last_became_active":"2024-09-12T22:35:23.756663+0000","last_became_peered":"2024-09-12T22:35:23.756663+0000","last_unstale":"2024-09-12T22:35:42.614262+0000","last_undegraded":"2024-09-12T22:35:42.614262+0000","last_fullsized":"2024-09-12T22:35:42.614262+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'160","last_scrub_stamp":"2024-09-12T22:35:42.614122+0000","last_deep_scrub":"80'160","last_deep_scrub_stamp":"2024-09-12T22:35:42.614122+0000","last_clean_scrub_stamp":"2024-09-12T22:35:42.614122+0000","objects_scrubbed":2,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:26:42.466587+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":105,"num_write_kb":4159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"60'426","reported_seq":554,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:51.030342+0000","last_change":"2024-09-12T22:35:51.030373+0000","last_active":"2024-09-12T22:35:51.030342+0000","last_peered":"2024-09-12T22:35:51.030342+0000","last_clean":"2024-09-12T22:35:51.030342+0000","last_became_active":"2024-09-12T22:35:26.732245+0000","last_became_peered":"2024-09-12T22:35:26.732245+0000","last_unstale":"2024-09-12T22:35:51.030342+0000","last_undegraded":"2024-09-12T22:35:51.030342+0000","last_fullsized":"2024-09-12T22:35:51.030342+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'426","last_scrub_stamp":"2024-09-12T22:35:51.030253+0000","last_deep_scrub":"60'426","last_deep_scrub_stamp":"2024-09-12T22:35:51.030253+0000","last_clean_scrub_stamp":"2024-09-12T22:35:51.030253+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:00:21.991066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":29225,"num_write":390,"num_write_kb":83737,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"80'276","reported_seq":378,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:36:04.144415+0000","last_change":"2024-09-12T22:36:04.144452+0000","last_active":"2024-09-12T22:36:04.144415+0000","last_peered":"2024-09-12T22:36:04.144415+0000","last_clean":"2024-09-12T22:36:04.144415+0000","last_became_active":"2024-09-12T22:35:23.755282+0000","last_became_peered":"2024-09-12T22:35:23.755282+0000","last_unstale":"2024-09-12T22:36:04.144415+0000","last_undegraded":"2024-09-12T22:36:04.144415+0000","last_fullsized":"2024-09-12T22:36:04.144415+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'276","last_scrub_stamp":"2024-09-12T22:36:04.144326+0000","last_deep_scrub":"80'276","last_deep_scrub_stamp":"2024-09-12T22:36:04.144326+0000","last_clean_scrub_stamp":"2024-09-12T22:36:04.144326+0000","objects_scrubbed":2,"log_size":276,"log_dups_size":0,"ondisk_log_size":276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:09:12.664650+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":213,"num_write_kb":4214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"60'455","reported_seq":616,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:36:06.154917+0000","last_change":"2024-09-12T22:36:06.154948+0000","last_active":"2024-09-12T22:36:06.154917+0000","last_peered":"2024-09-12T22:36:06.154917+0000","last_clean":"2024-09-12T22:36:06.154917+0000","last_became_active":"2024-09-12T22:35:33.754299+0000","last_became_peered":"2024-09-12T22:35:33.754299+0000","last_unstale":"2024-09-12T22:36:06.154917+0000","last_undegraded":"2024-09-12T22:36:06.154917+0000","last_fullsized":"2024-09-12T22:36:06.154917+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'455","last_scrub_stamp":"2024-09-12T22:36:06.154801+0000","last_deep_scrub":"60'455","last_deep_scrub_stamp":"2024-09-12T22:36:06.154801+0000","last_clean_scrub_stamp":"2024-09-12T22:36:06.154801+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:44:18.076846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":20747,"num_write":425,"num_write_kb":56005,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"80'425","reported_seq":584,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:41.573087+0000","last_change":"2024-09-12T22:35:41.573087+0000","last_active":"2024-09-12T22:35:41.573087+0000","last_peered":"2024-09-12T22:35:41.573087+0000","last_clean":"2024-09-12T22:35:41.573087+0000","last_became_active":"2024-09-12T22:35:23.756668+0000","last_became_peered":"2024-09-12T22:35:23.756668+0000","last_unstale":"2024-09-12T22:35:41.573087+0000","last_undegraded":"2024-09-12T22:35:41.573087+0000","last_fullsized":"2024-09-12T22:35:41.573087+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'425","last_scrub_stamp":"2024-09-12T22:35:41.572931+0000","last_deep_scrub":"80'425","last_deep_scrub_stamp":"2024-09-12T22:35:41.572931+0000","last_clean_scrub_stamp":"2024-09-12T22:35:41.572931+0000","objects_scrubbed":2,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:00:40.614135+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":371,"num_write_kb":4254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"60'431","reported_seq":608,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:47.683345+0000","last_change":"2024-09-12T22:35:47.683345+0000","last_active":"2024-09-12T22:35:47.683345+0000","last_peered":"2024-09-12T22:35:47.683345+0000","last_clean":"2024-09-12T22:35:47.683345+0000","last_became_active":"2024-09-12T22:31:37.414492+0000","last_became_peered":"2024-09-12T22:31:37.414492+0000","last_unstale":"2024-09-12T22:35:47.683345+0000","last_undegraded":"2024-09-12T22:35:47.683345+0000","last_fullsized":"2024-09-12T22:35:47.683345+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'431","last_scrub_stamp":"2024-09-12T22:35:47.683226+0000","last_deep_scrub":"60'431","last_deep_scrub_stamp":"2024-09-12T22:35:47.683226+0000","last_clean_scrub_stamp":"2024-09-12T22:35:47.683226+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:14:15.439665+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":21479,"num_write":394,"num_write_kb":83756,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"60'70","reported_seq":215,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:36:07.915377+0000","last_change":"2024-09-12T22:36:07.915403+0000","last_active":"2024-09-12T22:36:07.915377+0000","last_peered":"2024-09-12T22:36:07.915377+0000","last_clean":"2024-09-12T22:36:07.915377+0000","last_became_active":"2024-09-12T22:31:36.411366+0000","last_became_peered":"2024-09-12T22:31:36.411366+0000","last_unstale":"2024-09-12T22:36:07.915377+0000","last_undegraded":"2024-09-12T22:36:07.915377+0000","last_fullsized":"2024-09-12T22:36:07.915377+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'70","last_scrub_stamp":"2024-09-12T22:36:07.915271+0000","last_deep_scrub":"60'70","last_deep_scrub_stamp":"2024-09-12T22:36:07.915271+0000","last_clean_scrub_stamp":"2024-09-12T22:36:07.915271+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:13:01.877613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"60'471","reported_seq":683,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:36:04.402093+0000","last_change":"2024-09-12T22:36:04.402093+0000","last_active":"2024-09-12T22:36:04.402093+0000","last_peered":"2024-09-12T22:36:04.402093+0000","last_clean":"2024-09-12T22:36:04.402093+0000","last_became_active":"2024-09-12T22:31:37.409607+0000","last_became_peered":"2024-09-12T22:31:37.409607+0000","last_unstale":"2024-09-12T22:36:04.402093+0000","last_undegraded":"2024-09-12T22:36:04.402093+0000","last_fullsized":"2024-09-12T22:36:04.402093+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'471","last_scrub_stamp":"2024-09-12T22:36:04.401975+0000","last_deep_scrub":"60'471","last_deep_scrub_stamp":"2024-09-12T22:36:04.401975+0000","last_clean_scrub_stamp":"2024-09-12T22:36:04.401975+0000","objects_scrubbed":0,"log_size":471,"log_dups_size":0,"ondisk_log_size":471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:16:47.649191+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":37922,"num_write":440,"num_write_kb":138112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"80'212","reported_seq":357,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:36:01.361497+0000","last_change":"2024-09-12T22:36:01.361497+0000","last_active":"2024-09-12T22:36:01.361497+0000","last_peered":"2024-09-12T22:36:01.361497+0000","last_clean":"2024-09-12T22:36:01.361497+0000","last_became_active":"2024-09-12T22:31:36.406955+0000","last_became_peered":"2024-09-12T22:31:36.406955+0000","last_unstale":"2024-09-12T22:36:01.361497+0000","last_undegraded":"2024-09-12T22:36:01.361497+0000","last_fullsized":"2024-09-12T22:36:01.361497+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'212","last_scrub_stamp":"2024-09-12T22:36:01.361389+0000","last_deep_scrub":"80'212","last_deep_scrub_stamp":"2024-09-12T22:36:01.361389+0000","last_clean_scrub_stamp":"2024-09-12T22:36:01.361389+0000","objects_scrubbed":3,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:27:35.464359+0000","scrub_duration":18,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":8267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"60'437","reported_seq":590,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:50.673545+0000","last_change":"2024-09-12T22:35:50.673545+0000","last_active":"2024-09-12T22:35:50.673545+0000","last_peered":"2024-09-12T22:35:50.673545+0000","last_clean":"2024-09-12T22:35:50.673545+0000","last_became_active":"2024-09-12T22:31:37.414890+0000","last_became_peered":"2024-09-12T22:31:37.414890+0000","last_unstale":"2024-09-12T22:35:50.673545+0000","last_undegraded":"2024-09-12T22:35:50.673545+0000","last_fullsized":"2024-09-12T22:35:50.673545+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'437","last_scrub_stamp":"2024-09-12T22:35:50.673415+0000","last_deep_scrub":"60'437","last_deep_scrub_stamp":"2024-09-12T22:35:50.673415+0000","last_clean_scrub_stamp":"2024-09-12T22:35:50.673415+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:32:48.287703+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":4587,"num_write":407,"num_write_kb":50860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"80'109","reported_seq":254,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:36:10.004020+0000","last_change":"2024-09-12T22:36:10.004051+0000","last_active":"2024-09-12T22:36:10.004020+0000","last_peered":"2024-09-12T22:36:10.004020+0000","last_clean":"2024-09-12T22:36:10.004020+0000","last_became_active":"2024-09-12T22:31:36.411382+0000","last_became_peered":"2024-09-12T22:31:36.411382+0000","last_unstale":"2024-09-12T22:36:10.004020+0000","last_undegraded":"2024-09-12T22:36:10.004020+0000","last_fullsized":"2024-09-12T22:36:10.004020+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'109","last_scrub_stamp":"2024-09-12T22:36:10.003929+0000","last_deep_scrub":"80'109","last_deep_scrub_stamp":"2024-09-12T22:36:10.003929+0000","last_clean_scrub_stamp":"2024-09-12T22:36:10.003929+0000","objects_scrubbed":1,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:30:20.329127+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":4129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"60'407","reported_seq":929,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:40.004211+0000","last_change":"2024-09-12T22:35:31.732325+0000","last_active":"2024-09-12T22:35:40.004211+0000","last_peered":"2024-09-12T22:35:40.004211+0000","last_clean":"2024-09-12T22:35:40.004211+0000","last_became_active":"2024-09-12T22:35:31.729817+0000","last_became_peered":"2024-09-12T22:35:31.729817+0000","last_unstale":"2024-09-12T22:35:40.004211+0000","last_undegraded":"2024-09-12T22:35:40.004211+0000","last_fullsized":"2024-09-12T22:35:40.004211+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":5615,"num_write":375,"num_write_kb":50827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"60'57","reported_seq":56,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:58.108871+0000","last_change":"2024-09-12T22:35:58.108901+0000","last_active":"2024-09-12T22:35:58.108871+0000","last_peered":"2024-09-12T22:35:58.108871+0000","last_clean":"2024-09-12T22:35:58.108871+0000","last_became_active":"2024-09-12T22:35:20.733664+0000","last_became_peered":"2024-09-12T22:35:20.733664+0000","last_unstale":"2024-09-12T22:35:58.108871+0000","last_undegraded":"2024-09-12T22:35:58.108871+0000","last_fullsized":"2024-09-12T22:35:58.108871+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'57","last_scrub_stamp":"2024-09-12T22:35:58.108771+0000","last_deep_scrub":"60'57","last_deep_scrub_stamp":"2024-09-12T22:35:58.108771+0000","last_clean_scrub_stamp":"2024-09-12T22:35:58.108771+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:30:25.204368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"60'357","reported_seq":843,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:36:12.077821+0000","last_change":"2024-09-12T22:36:12.077848+0000","last_active":"2024-09-12T22:36:12.077821+0000","last_peered":"2024-09-12T22:36:12.077821+0000","last_clean":"2024-09-12T22:36:12.077821+0000","last_became_active":"2024-09-12T22:35:27.733274+0000","last_became_peered":"2024-09-12T22:35:27.733274+0000","last_unstale":"2024-09-12T22:36:12.077821+0000","last_undegraded":"2024-09-12T22:36:12.077821+0000","last_fullsized":"2024-09-12T22:36:12.077821+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'357","last_scrub_stamp":"2024-09-12T22:36:12.077724+0000","last_deep_scrub":"60'357","last_deep_scrub_stamp":"2024-09-12T22:36:12.077724+0000","last_clean_scrub_stamp":"2024-09-12T22:36:12.077724+0000","objects_scrubbed":0,"log_size":357,"log_dups_size":0,"ondisk_log_size":357,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:15:54.246000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":2460,"num_write":324,"num_write_kb":37873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"80'418","reported_seq":511,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:36:02.147058+0000","last_change":"2024-09-12T22:36:02.147114+0000","last_active":"2024-09-12T22:36:02.147058+0000","last_peered":"2024-09-12T22:36:02.147058+0000","last_clean":"2024-09-12T22:36:02.147058+0000","last_became_active":"2024-09-12T22:35:23.754683+0000","last_became_peered":"2024-09-12T22:35:23.754683+0000","last_unstale":"2024-09-12T22:36:02.147058+0000","last_undegraded":"2024-09-12T22:36:02.147058+0000","last_fullsized":"2024-09-12T22:36:02.147058+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'418","last_scrub_stamp":"2024-09-12T22:36:02.146931+0000","last_deep_scrub":"80'418","last_deep_scrub_stamp":"2024-09-12T22:36:02.146931+0000","last_clean_scrub_stamp":"2024-09-12T22:36:02.146931+0000","objects_scrubbed":1,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:12:43.222856+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":359,"num_write_kb":4251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"60'416","reported_seq":973,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:36:10.381460+0000","last_change":"2024-09-12T22:36:10.381488+0000","last_active":"2024-09-12T22:36:10.381460+0000","last_peered":"2024-09-12T22:36:10.381460+0000","last_clean":"2024-09-12T22:36:10.381460+0000","last_became_active":"2024-09-12T22:35:30.729912+0000","last_became_peered":"2024-09-12T22:35:30.729912+0000","last_unstale":"2024-09-12T22:36:10.381460+0000","last_undegraded":"2024-09-12T22:36:10.381460+0000","last_fullsized":"2024-09-12T22:36:10.381460+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'416","last_scrub_stamp":"2024-09-12T22:36:10.381367+0000","last_deep_scrub":"60'416","last_deep_scrub_stamp":"2024-09-12T22:36:10.381367+0000","last_clean_scrub_stamp":"2024-09-12T22:36:10.381367+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:09:52.259354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":42190,"num_write":377,"num_write_kb":87849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"80'159","reported_seq":364,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:45.649463+0000","last_change":"2024-09-12T22:35:45.649509+0000","last_active":"2024-09-12T22:35:45.649463+0000","last_peered":"2024-09-12T22:35:45.649463+0000","last_clean":"2024-09-12T22:35:45.649463+0000","last_became_active":"2024-09-12T22:35:20.736721+0000","last_became_peered":"2024-09-12T22:35:20.736721+0000","last_unstale":"2024-09-12T22:35:45.649463+0000","last_undegraded":"2024-09-12T22:35:45.649463+0000","last_fullsized":"2024-09-12T22:35:45.649463+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'159","last_scrub_stamp":"2024-09-12T22:35:45.649377+0000","last_deep_scrub":"80'159","last_deep_scrub_stamp":"2024-09-12T22:35:45.649377+0000","last_clean_scrub_stamp":"2024-09-12T22:35:45.649377+0000","objects_scrubbed":2,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:54:50.820256+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"80'2","reported_seq":160,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:36:03.859960+0000","last_change":"2024-09-12T22:36:03.860000+0000","last_active":"2024-09-12T22:36:03.859960+0000","last_peered":"2024-09-12T22:36:03.859960+0000","last_clean":"2024-09-12T22:36:03.859960+0000","last_became_active":"2024-09-12T22:31:32.283661+0000","last_became_peered":"2024-09-12T22:31:32.283661+0000","last_unstale":"2024-09-12T22:36:03.859960+0000","last_undegraded":"2024-09-12T22:36:03.859960+0000","last_fullsized":"2024-09-12T22:36:03.859960+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2","last_scrub_stamp":"2024-09-12T22:36:03.859839+0000","last_deep_scrub":"80'2","last_deep_scrub_stamp":"2024-09-12T22:36:03.859839+0000","last_clean_scrub_stamp":"2024-09-12T22:36:03.859839+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:13:19.150315+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.000621274,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"80'680","reported_seq":840,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:51.253978+0000","last_change":"2024-09-12T22:35:51.254012+0000","last_active":"2024-09-12T22:35:51.253978+0000","last_peered":"2024-09-12T22:35:51.253978+0000","last_clean":"2024-09-12T22:35:51.253978+0000","last_became_active":"2024-09-12T22:35:23.755652+0000","last_became_peered":"2024-09-12T22:35:23.755652+0000","last_unstale":"2024-09-12T22:35:51.253978+0000","last_undegraded":"2024-09-12T22:35:51.253978+0000","last_fullsized":"2024-09-12T22:35:51.253978+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'680","last_scrub_stamp":"2024-09-12T22:35:51.253878+0000","last_deep_scrub":"80'680","last_deep_scrub_stamp":"2024-09-12T22:35:51.253878+0000","last_clean_scrub_stamp":"2024-09-12T22:35:51.253878+0000","objects_scrubbed":2,"log_size":680,"log_dups_size":0,"ondisk_log_size":680,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:09:03.140393+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":608,"num_write_kb":8482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"60'426","reported_seq":978,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:40.004174+0000","last_change":"2024-09-12T22:35:31.732344+0000","last_active":"2024-09-12T22:35:40.004174+0000","last_peered":"2024-09-12T22:35:40.004174+0000","last_clean":"2024-09-12T22:35:40.004174+0000","last_became_active":"2024-09-12T22:35:31.730242+0000","last_became_peered":"2024-09-12T22:35:31.730242+0000","last_unstale":"2024-09-12T22:35:40.004174+0000","last_undegraded":"2024-09-12T22:35:40.004174+0000","last_fullsized":"2024-09-12T22:35:40.004174+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:31:36.386296+0000","last_clean_scrub_stamp":"2024-09-12T22:31:36.386296+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":24636,"num_write":392,"num_write_kb":59176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":165,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:58.762400+0000","last_change":"2024-09-12T22:35:58.762443+0000","last_active":"2024-09-12T22:35:58.762400+0000","last_peered":"2024-09-12T22:35:58.762400+0000","last_clean":"2024-09-12T22:35:58.762400+0000","last_became_active":"2024-09-12T22:35:20.735545+0000","last_became_peered":"2024-09-12T22:35:20.735545+0000","last_unstale":"2024-09-12T22:35:58.762400+0000","last_undegraded":"2024-09-12T22:35:58.762400+0000","last_fullsized":"2024-09-12T22:35:58.762400+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:35:58.762297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:35:58.762297+0000","last_clean_scrub_stamp":"2024-09-12T22:35:58.762297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:51:26.381629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037858999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"80'107","reported_seq":295,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:57.223035+0000","last_change":"2024-09-12T22:35:57.223072+0000","last_active":"2024-09-12T22:35:57.223035+0000","last_peered":"2024-09-12T22:35:57.223035+0000","last_clean":"2024-09-12T22:35:57.223035+0000","last_became_active":"2024-09-12T22:31:36.406770+0000","last_became_peered":"2024-09-12T22:31:36.406770+0000","last_unstale":"2024-09-12T22:35:57.223035+0000","last_undegraded":"2024-09-12T22:35:57.223035+0000","last_fullsized":"2024-09-12T22:35:57.223035+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'107","last_scrub_stamp":"2024-09-12T22:35:57.222948+0000","last_deep_scrub":"80'107","last_deep_scrub_stamp":"2024-09-12T22:35:57.222948+0000","last_clean_scrub_stamp":"2024-09-12T22:35:57.222948+0000","objects_scrubbed":1,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:49:29.104800+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1467429,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":43,"num_read_kb":1462,"num_write":43,"num_write_kb":1462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"60'448","reported_seq":556,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:47.106736+0000","last_change":"2024-09-12T22:35:47.106764+0000","last_active":"2024-09-12T22:35:47.106736+0000","last_peered":"2024-09-12T22:35:47.106736+0000","last_clean":"2024-09-12T22:35:47.106736+0000","last_became_active":"2024-09-12T22:35:27.729522+0000","last_became_peered":"2024-09-12T22:35:27.729522+0000","last_unstale":"2024-09-12T22:35:47.106736+0000","last_undegraded":"2024-09-12T22:35:47.106736+0000","last_fullsized":"2024-09-12T22:35:47.106736+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'448","last_scrub_stamp":"2024-09-12T22:35:47.106643+0000","last_deep_scrub":"60'448","last_deep_scrub_stamp":"2024-09-12T22:35:47.106643+0000","last_clean_scrub_stamp":"2024-09-12T22:35:47.106643+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:54:12.406887+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":10436,"num_write":420,"num_write_kb":67816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":165,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:42.160892+0000","last_change":"2024-09-12T22:35:42.160892+0000","last_active":"2024-09-12T22:35:42.160892+0000","last_peered":"2024-09-12T22:35:42.160892+0000","last_clean":"2024-09-12T22:35:42.160892+0000","last_became_active":"2024-09-12T22:35:20.734643+0000","last_became_peered":"2024-09-12T22:35:20.734643+0000","last_unstale":"2024-09-12T22:35:42.160892+0000","last_undegraded":"2024-09-12T22:35:42.160892+0000","last_fullsized":"2024-09-12T22:35:42.160892+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:35:42.160772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:35:42.160772+0000","last_clean_scrub_stamp":"2024-09-12T22:35:42.160772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:47:29.886284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039540700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"80'294","reported_seq":415,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:40.037943+0000","last_change":"2024-09-12T22:35:40.038017+0000","last_active":"2024-09-12T22:35:40.037943+0000","last_peered":"2024-09-12T22:35:40.037943+0000","last_clean":"2024-09-12T22:35:40.037943+0000","last_became_active":"2024-09-12T22:35:33.760742+0000","last_became_peered":"2024-09-12T22:35:33.760742+0000","last_unstale":"2024-09-12T22:35:40.037943+0000","last_undegraded":"2024-09-12T22:35:40.037943+0000","last_fullsized":"2024-09-12T22:35:40.037943+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'294","last_scrub_stamp":"2024-09-12T22:35:40.037799+0000","last_deep_scrub":"80'294","last_deep_scrub_stamp":"2024-09-12T22:35:40.037799+0000","last_clean_scrub_stamp":"2024-09-12T22:35:40.037799+0000","objects_scrubbed":2,"log_size":294,"log_dups_size":0,"ondisk_log_size":294,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:30:06.166314+0000","scrub_duration":17,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":235,"num_write_kb":8293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"60'375","reported_seq":922,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:36:09.391491+0000","last_change":"2024-09-12T22:36:09.391516+0000","last_active":"2024-09-12T22:36:09.391491+0000","last_peered":"2024-09-12T22:36:09.391491+0000","last_clean":"2024-09-12T22:36:09.391491+0000","last_became_active":"2024-09-12T22:35:29.738755+0000","last_became_peered":"2024-09-12T22:35:29.738755+0000","last_unstale":"2024-09-12T22:36:09.391491+0000","last_undegraded":"2024-09-12T22:36:09.391491+0000","last_fullsized":"2024-09-12T22:36:09.391491+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'375","last_scrub_stamp":"2024-09-12T22:36:09.391398+0000","last_deep_scrub":"60'375","last_deep_scrub_stamp":"2024-09-12T22:36:09.391398+0000","last_clean_scrub_stamp":"2024-09-12T22:36:09.391398+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:16:29.060119+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":43566,"num_write":354,"num_write_kb":92229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":160,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"80'3","reported_seq":161,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:36:02.810216+0000","last_change":"2024-09-12T22:36:02.810270+0000","last_active":"2024-09-12T22:36:02.810216+0000","last_peered":"2024-09-12T22:36:02.810216+0000","last_clean":"2024-09-12T22:36:02.810216+0000","last_became_active":"2024-09-12T22:31:32.282230+0000","last_became_peered":"2024-09-12T22:31:32.282230+0000","last_unstale":"2024-09-12T22:36:02.810216+0000","last_undegraded":"2024-09-12T22:36:02.810216+0000","last_fullsized":"2024-09-12T22:36:02.810216+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'3","last_scrub_stamp":"2024-09-12T22:36:02.810108+0000","last_deep_scrub":"80'3","last_deep_scrub_stamp":"2024-09-12T22:36:02.810108+0000","last_clean_scrub_stamp":"2024-09-12T22:36:02.810108+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:08:50.989662+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.000615758,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"60'63","reported_seq":208,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:36:04.877645+0000","last_change":"2024-09-12T22:36:04.877674+0000","last_active":"2024-09-12T22:36:04.877645+0000","last_peered":"2024-09-12T22:36:04.877645+0000","last_clean":"2024-09-12T22:36:04.877645+0000","last_became_active":"2024-09-12T22:31:36.409816+0000","last_became_peered":"2024-09-12T22:31:36.409816+0000","last_unstale":"2024-09-12T22:36:04.877645+0000","last_undegraded":"2024-09-12T22:36:04.877645+0000","last_fullsized":"2024-09-12T22:36:04.877645+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'63","last_scrub_stamp":"2024-09-12T22:36:04.877535+0000","last_deep_scrub":"60'63","last_deep_scrub_stamp":"2024-09-12T22:36:04.877535+0000","last_clean_scrub_stamp":"2024-09-12T22:36:04.877535+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:06:23.085839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"60'405","reported_seq":939,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:36:08.411751+0000","last_change":"2024-09-12T22:36:08.411778+0000","last_active":"2024-09-12T22:36:08.411751+0000","last_peered":"2024-09-12T22:36:08.411751+0000","last_clean":"2024-09-12T22:36:08.411751+0000","last_became_active":"2024-09-12T22:35:29.735499+0000","last_became_peered":"2024-09-12T22:35:29.735499+0000","last_unstale":"2024-09-12T22:36:08.411751+0000","last_undegraded":"2024-09-12T22:36:08.411751+0000","last_fullsized":"2024-09-12T22:36:08.411751+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'405","last_scrub_stamp":"2024-09-12T22:36:08.411649+0000","last_deep_scrub":"60'405","last_deep_scrub_stamp":"2024-09-12T22:36:08.411649+0000","last_clean_scrub_stamp":"2024-09-12T22:36:08.411649+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:56:21.759170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":20152,"num_write":366,"num_write_kb":92447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"80'278","reported_seq":371,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:36:03.137779+0000","last_change":"2024-09-12T22:36:03.137854+0000","last_active":"2024-09-12T22:36:03.137779+0000","last_peered":"2024-09-12T22:36:03.137779+0000","last_clean":"2024-09-12T22:36:03.137779+0000","last_became_active":"2024-09-12T22:35:23.755237+0000","last_became_peered":"2024-09-12T22:35:23.755237+0000","last_unstale":"2024-09-12T22:36:03.137779+0000","last_undegraded":"2024-09-12T22:36:03.137779+0000","last_fullsized":"2024-09-12T22:36:03.137779+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'278","last_scrub_stamp":"2024-09-12T22:36:03.137687+0000","last_deep_scrub":"80'278","last_deep_scrub_stamp":"2024-09-12T22:36:03.137687+0000","last_clean_scrub_stamp":"2024-09-12T22:36:03.137687+0000","objects_scrubbed":1,"log_size":278,"log_dups_size":0,"ondisk_log_size":278,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:10:12.964476+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":216,"num_write_kb":4193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":165,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:41.149203+0000","last_change":"2024-09-12T22:35:41.149203+0000","last_active":"2024-09-12T22:35:41.149203+0000","last_peered":"2024-09-12T22:35:41.149203+0000","last_clean":"2024-09-12T22:35:41.149203+0000","last_became_active":"2024-09-12T22:35:20.736428+0000","last_became_peered":"2024-09-12T22:35:20.736428+0000","last_unstale":"2024-09-12T22:35:41.149203+0000","last_undegraded":"2024-09-12T22:35:41.149203+0000","last_fullsized":"2024-09-12T22:35:41.149203+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:35:41.149090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:35:41.149090+0000","last_clean_scrub_stamp":"2024-09-12T22:35:41.149090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:47:16.938339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041972500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"60'355","reported_seq":466,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:55.102250+0000","last_change":"2024-09-12T22:35:55.102278+0000","last_active":"2024-09-12T22:35:55.102250+0000","last_peered":"2024-09-12T22:35:55.102250+0000","last_clean":"2024-09-12T22:35:55.102250+0000","last_became_active":"2024-09-12T22:35:25.727299+0000","last_became_peered":"2024-09-12T22:35:25.727299+0000","last_unstale":"2024-09-12T22:35:55.102250+0000","last_undegraded":"2024-09-12T22:35:55.102250+0000","last_fullsized":"2024-09-12T22:35:55.102250+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'355","last_scrub_stamp":"2024-09-12T22:35:55.102155+0000","last_deep_scrub":"60'355","last_deep_scrub_stamp":"2024-09-12T22:35:55.102155+0000","last_clean_scrub_stamp":"2024-09-12T22:35:55.102155+0000","objects_scrubbed":0,"log_size":355,"log_dups_size":0,"ondisk_log_size":355,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:22:31.666894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13196,"num_write":321,"num_write_kb":41797,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"60'55","reported_seq":207,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:45.163041+0000","last_change":"2024-09-12T22:35:45.163041+0000","last_active":"2024-09-12T22:35:45.163041+0000","last_peered":"2024-09-12T22:35:45.163041+0000","last_clean":"2024-09-12T22:35:45.163041+0000","last_became_active":"2024-09-12T22:35:20.737705+0000","last_became_peered":"2024-09-12T22:35:20.737705+0000","last_unstale":"2024-09-12T22:35:45.163041+0000","last_undegraded":"2024-09-12T22:35:45.163041+0000","last_fullsized":"2024-09-12T22:35:45.163041+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'55","last_scrub_stamp":"2024-09-12T22:35:45.162870+0000","last_deep_scrub":"60'55","last_deep_scrub_stamp":"2024-09-12T22:35:45.162870+0000","last_clean_scrub_stamp":"2024-09-12T22:35:45.162870+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:58:31.877549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":77,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:36:00.131574+0000","last_change":"2024-09-12T22:36:00.131602+0000","last_active":"2024-09-12T22:36:00.131574+0000","last_peered":"2024-09-12T22:36:00.131574+0000","last_clean":"2024-09-12T22:36:00.131574+0000","last_became_active":"2024-09-12T22:35:20.737799+0000","last_became_peered":"2024-09-12T22:35:20.737799+0000","last_unstale":"2024-09-12T22:36:00.131574+0000","last_undegraded":"2024-09-12T22:36:00.131574+0000","last_fullsized":"2024-09-12T22:36:00.131574+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:36:00.131483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:36:00.131483+0000","last_clean_scrub_stamp":"2024-09-12T22:36:00.131483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:33:00.726981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"60'385","reported_seq":542,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:36:07.176673+0000","last_change":"2024-09-12T22:36:07.176701+0000","last_active":"2024-09-12T22:36:07.176673+0000","last_peered":"2024-09-12T22:36:07.176673+0000","last_clean":"2024-09-12T22:36:07.176673+0000","last_became_active":"2024-09-12T22:35:33.754546+0000","last_became_peered":"2024-09-12T22:35:33.754546+0000","last_unstale":"2024-09-12T22:36:07.176673+0000","last_undegraded":"2024-09-12T22:36:07.176673+0000","last_fullsized":"2024-09-12T22:36:07.176673+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'385","last_scrub_stamp":"2024-09-12T22:36:07.176574+0000","last_deep_scrub":"60'385","last_deep_scrub_stamp":"2024-09-12T22:36:07.176574+0000","last_clean_scrub_stamp":"2024-09-12T22:36:07.176574+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:39:04.487637+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":22437,"num_write":347,"num_write_kb":30121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"80'62","reported_seq":215,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:47.131052+0000","last_change":"2024-09-12T22:35:47.131052+0000","last_active":"2024-09-12T22:35:47.131052+0000","last_peered":"2024-09-12T22:35:47.131052+0000","last_clean":"2024-09-12T22:35:47.131052+0000","last_became_active":"2024-09-12T22:35:20.738129+0000","last_became_peered":"2024-09-12T22:35:20.738129+0000","last_unstale":"2024-09-12T22:35:47.131052+0000","last_undegraded":"2024-09-12T22:35:47.131052+0000","last_fullsized":"2024-09-12T22:35:47.131052+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'62","last_scrub_stamp":"2024-09-12T22:35:47.130895+0000","last_deep_scrub":"80'62","last_deep_scrub_stamp":"2024-09-12T22:35:47.130895+0000","last_clean_scrub_stamp":"2024-09-12T22:35:47.130895+0000","objects_scrubbed":1,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:43:10.950680+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":165,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:43.170600+0000","last_change":"2024-09-12T22:35:43.170600+0000","last_active":"2024-09-12T22:35:43.170600+0000","last_peered":"2024-09-12T22:35:43.170600+0000","last_clean":"2024-09-12T22:35:43.170600+0000","last_became_active":"2024-09-12T22:35:20.736628+0000","last_became_peered":"2024-09-12T22:35:20.736628+0000","last_unstale":"2024-09-12T22:35:43.170600+0000","last_undegraded":"2024-09-12T22:35:43.170600+0000","last_fullsized":"2024-09-12T22:35:43.170600+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:35:43.170448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:35:43.170448+0000","last_clean_scrub_stamp":"2024-09-12T22:35:43.170448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:28:09.526317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058589999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"60'402","reported_seq":563,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:54.246956+0000","last_change":"2024-09-12T22:35:54.246984+0000","last_active":"2024-09-12T22:35:54.246956+0000","last_peered":"2024-09-12T22:35:54.246956+0000","last_clean":"2024-09-12T22:35:54.246956+0000","last_became_active":"2024-09-12T22:31:37.410558+0000","last_became_peered":"2024-09-12T22:31:37.410558+0000","last_unstale":"2024-09-12T22:35:54.246956+0000","last_undegraded":"2024-09-12T22:35:54.246956+0000","last_fullsized":"2024-09-12T22:35:54.246956+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'402","last_scrub_stamp":"2024-09-12T22:35:54.246766+0000","last_deep_scrub":"60'402","last_deep_scrub_stamp":"2024-09-12T22:35:54.246766+0000","last_clean_scrub_stamp":"2024-09-12T22:35:54.246766+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:05:37.233132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":10169,"num_write":370,"num_write_kb":38130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"80'106","reported_seq":251,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:58.248310+0000","last_change":"2024-09-12T22:35:58.248310+0000","last_active":"2024-09-12T22:35:58.248310+0000","last_peered":"2024-09-12T22:35:58.248310+0000","last_clean":"2024-09-12T22:35:58.248310+0000","last_became_active":"2024-09-12T22:31:36.406729+0000","last_became_peered":"2024-09-12T22:31:36.406729+0000","last_unstale":"2024-09-12T22:35:58.248310+0000","last_undegraded":"2024-09-12T22:35:58.248310+0000","last_fullsized":"2024-09-12T22:35:58.248310+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'106","last_scrub_stamp":"2024-09-12T22:35:58.248136+0000","last_deep_scrub":"80'106","last_deep_scrub_stamp":"2024-09-12T22:35:58.248136+0000","last_clean_scrub_stamp":"2024-09-12T22:35:58.248136+0000","objects_scrubbed":1,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:47:40.016268+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103,"num_write_kb":1085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":165,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:36:00.787234+0000","last_change":"2024-09-12T22:36:00.787285+0000","last_active":"2024-09-12T22:36:00.787234+0000","last_peered":"2024-09-12T22:36:00.787234+0000","last_clean":"2024-09-12T22:36:00.787234+0000","last_became_active":"2024-09-12T22:35:20.736769+0000","last_became_peered":"2024-09-12T22:35:20.736769+0000","last_unstale":"2024-09-12T22:36:00.787234+0000","last_undegraded":"2024-09-12T22:36:00.787234+0000","last_fullsized":"2024-09-12T22:36:00.787234+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:36:00.787104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:36:00.787104+0000","last_clean_scrub_stamp":"2024-09-12T22:36:00.787104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:16:52.622022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000382109,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"60'412","reported_seq":559,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:53.080906+0000","last_change":"2024-09-12T22:35:53.080933+0000","last_active":"2024-09-12T22:35:53.080906+0000","last_peered":"2024-09-12T22:35:53.080906+0000","last_clean":"2024-09-12T22:35:53.080906+0000","last_became_active":"2024-09-12T22:35:26.732923+0000","last_became_peered":"2024-09-12T22:35:26.732923+0000","last_unstale":"2024-09-12T22:35:53.080906+0000","last_undegraded":"2024-09-12T22:35:53.080906+0000","last_fullsized":"2024-09-12T22:35:53.080906+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'412","last_scrub_stamp":"2024-09-12T22:35:53.080800+0000","last_deep_scrub":"60'412","last_deep_scrub_stamp":"2024-09-12T22:35:53.080800+0000","last_clean_scrub_stamp":"2024-09-12T22:35:53.080800+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:07:41.110097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":34504,"num_write":385,"num_write_kb":100438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"60'415","reported_seq":977,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:40.560544+0000","last_change":"2024-09-12T22:35:40.560589+0000","last_active":"2024-09-12T22:35:40.560544+0000","last_peered":"2024-09-12T22:35:40.560544+0000","last_clean":"2024-09-12T22:35:40.560544+0000","last_became_active":"2024-09-12T22:35:24.759441+0000","last_became_peered":"2024-09-12T22:35:24.759441+0000","last_unstale":"2024-09-12T22:35:40.560544+0000","last_undegraded":"2024-09-12T22:35:40.560544+0000","last_fullsized":"2024-09-12T22:35:40.560544+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'415","last_scrub_stamp":"2024-09-12T22:35:40.560400+0000","last_deep_scrub":"60'415","last_deep_scrub_stamp":"2024-09-12T22:35:40.560400+0000","last_clean_scrub_stamp":"2024-09-12T22:35:40.560400+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:38:43.470540+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":37207,"num_write":375,"num_write_kb":84660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"80'226","reported_seq":389,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:43.615871+0000","last_change":"2024-09-12T22:35:43.615871+0000","last_active":"2024-09-12T22:35:43.615871+0000","last_peered":"2024-09-12T22:35:43.615871+0000","last_clean":"2024-09-12T22:35:43.615871+0000","last_became_active":"2024-09-12T22:35:23.755918+0000","last_became_peered":"2024-09-12T22:35:23.755918+0000","last_unstale":"2024-09-12T22:35:43.615871+0000","last_undegraded":"2024-09-12T22:35:43.615871+0000","last_fullsized":"2024-09-12T22:35:43.615871+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'226","last_scrub_stamp":"2024-09-12T22:35:43.615755+0000","last_deep_scrub":"80'226","last_deep_scrub_stamp":"2024-09-12T22:35:43.615755+0000","last_clean_scrub_stamp":"2024-09-12T22:35:43.615755+0000","objects_scrubbed":5,"log_size":226,"log_dups_size":0,"ondisk_log_size":226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:21:37.577770+0000","scrub_duration":17,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":175,"num_write_kb":8282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":8382815,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"60'429","reported_seq":971,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:36:05.377888+0000","last_change":"2024-09-12T22:36:05.377888+0000","last_active":"2024-09-12T22:36:05.377888+0000","last_peered":"2024-09-12T22:36:05.377888+0000","last_clean":"2024-09-12T22:36:05.377888+0000","last_became_active":"2024-09-12T22:35:25.726837+0000","last_became_peered":"2024-09-12T22:35:25.726837+0000","last_unstale":"2024-09-12T22:36:05.377888+0000","last_undegraded":"2024-09-12T22:36:05.377888+0000","last_fullsized":"2024-09-12T22:36:05.377888+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'429","last_scrub_stamp":"2024-09-12T22:36:05.377757+0000","last_deep_scrub":"60'429","last_deep_scrub_stamp":"2024-09-12T22:36:05.377757+0000","last_clean_scrub_stamp":"2024-09-12T22:36:05.377757+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:55:23.938145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":12230,"num_write":389,"num_write_kb":71746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"80'100","reported_seq":228,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:56.131114+0000","last_change":"2024-09-12T22:35:56.131150+0000","last_active":"2024-09-12T22:35:56.131114+0000","last_peered":"2024-09-12T22:35:56.131114+0000","last_clean":"2024-09-12T22:35:56.131114+0000","last_became_active":"2024-09-12T22:35:33.758640+0000","last_became_peered":"2024-09-12T22:35:33.758640+0000","last_unstale":"2024-09-12T22:35:56.131114+0000","last_undegraded":"2024-09-12T22:35:56.131114+0000","last_fullsized":"2024-09-12T22:35:56.131114+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'100","last_scrub_stamp":"2024-09-12T22:35:56.131027+0000","last_deep_scrub":"80'100","last_deep_scrub_stamp":"2024-09-12T22:35:56.131027+0000","last_clean_scrub_stamp":"2024-09-12T22:35:56.131027+0000","objects_scrubbed":2,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:56:59.679732+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"80'215","reported_seq":359,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:36:05.865726+0000","last_change":"2024-09-12T22:36:05.865791+0000","last_active":"2024-09-12T22:36:05.865726+0000","last_peered":"2024-09-12T22:36:05.865726+0000","last_clean":"2024-09-12T22:36:05.865726+0000","last_became_active":"2024-09-12T22:31:36.410674+0000","last_became_peered":"2024-09-12T22:31:36.410674+0000","last_unstale":"2024-09-12T22:36:05.865726+0000","last_undegraded":"2024-09-12T22:36:05.865726+0000","last_fullsized":"2024-09-12T22:36:05.865726+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'215","last_scrub_stamp":"2024-09-12T22:36:05.865618+0000","last_deep_scrub":"80'215","last_deep_scrub_stamp":"2024-09-12T22:36:05.865618+0000","last_clean_scrub_stamp":"2024-09-12T22:36:05.865618+0000","objects_scrubbed":1,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:02:16.567469+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":151,"num_write_kb":4168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"60'460","reported_seq":632,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:48.178638+0000","last_change":"2024-09-12T22:35:48.178638+0000","last_active":"2024-09-12T22:35:48.178638+0000","last_peered":"2024-09-12T22:35:48.178638+0000","last_clean":"2024-09-12T22:35:48.178638+0000","last_became_active":"2024-09-12T22:31:37.410404+0000","last_became_peered":"2024-09-12T22:31:37.410404+0000","last_unstale":"2024-09-12T22:35:48.178638+0000","last_undegraded":"2024-09-12T22:35:48.178638+0000","last_fullsized":"2024-09-12T22:35:48.178638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'460","last_scrub_stamp":"2024-09-12T22:35:48.178488+0000","last_deep_scrub":"60'460","last_deep_scrub_stamp":"2024-09-12T22:35:48.178488+0000","last_clean_scrub_stamp":"2024-09-12T22:35:48.178488+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:51:08.618621+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":15059,"num_write":431,"num_write_kb":59615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"60'52","reported_seq":196,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:36:02.353009+0000","last_change":"2024-09-12T22:36:02.353037+0000","last_active":"2024-09-12T22:36:02.353009+0000","last_peered":"2024-09-12T22:36:02.353009+0000","last_clean":"2024-09-12T22:36:02.353009+0000","last_became_active":"2024-09-12T22:31:36.407062+0000","last_became_peered":"2024-09-12T22:31:36.407062+0000","last_unstale":"2024-09-12T22:36:02.353009+0000","last_undegraded":"2024-09-12T22:36:02.353009+0000","last_fullsized":"2024-09-12T22:36:02.353009+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'52","last_scrub_stamp":"2024-09-12T22:36:02.352916+0000","last_deep_scrub":"60'52","last_deep_scrub_stamp":"2024-09-12T22:36:02.352916+0000","last_clean_scrub_stamp":"2024-09-12T22:36:02.352916+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:15:24.918087+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"60'461","reported_seq":1035,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:36:06.409638+0000","last_change":"2024-09-12T22:36:06.409638+0000","last_active":"2024-09-12T22:36:06.409638+0000","last_peered":"2024-09-12T22:36:06.409638+0000","last_clean":"2024-09-12T22:36:06.409638+0000","last_became_active":"2024-09-12T22:35:28.730402+0000","last_became_peered":"2024-09-12T22:35:28.730402+0000","last_unstale":"2024-09-12T22:36:06.409638+0000","last_undegraded":"2024-09-12T22:36:06.409638+0000","last_fullsized":"2024-09-12T22:36:06.409638+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'461","last_scrub_stamp":"2024-09-12T22:36:06.409520+0000","last_deep_scrub":"60'461","last_deep_scrub_stamp":"2024-09-12T22:36:06.409520+0000","last_clean_scrub_stamp":"2024-09-12T22:36:06.409520+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:43:03.168620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":17508,"num_write":431,"num_write_kb":67883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":200,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"60'355","reported_seq":488,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:43.066248+0000","last_change":"2024-09-12T22:35:43.066272+0000","last_active":"2024-09-12T22:35:43.066248+0000","last_peered":"2024-09-12T22:35:43.066248+0000","last_clean":"2024-09-12T22:35:43.066248+0000","last_became_active":"2024-09-12T22:35:28.730931+0000","last_became_peered":"2024-09-12T22:35:28.730931+0000","last_unstale":"2024-09-12T22:35:43.066248+0000","last_undegraded":"2024-09-12T22:35:43.066248+0000","last_fullsized":"2024-09-12T22:35:43.066248+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'355","last_scrub_stamp":"2024-09-12T22:35:43.066163+0000","last_deep_scrub":"60'355","last_deep_scrub_stamp":"2024-09-12T22:35:43.066163+0000","last_clean_scrub_stamp":"2024-09-12T22:35:43.066163+0000","objects_scrubbed":0,"log_size":355,"log_dups_size":0,"ondisk_log_size":355,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:10:10.050148+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":44561,"num_write":329,"num_write_kb":26431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"80'550","reported_seq":709,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:53.229974+0000","last_change":"2024-09-12T22:35:53.230003+0000","last_active":"2024-09-12T22:35:53.229974+0000","last_peered":"2024-09-12T22:35:53.229974+0000","last_clean":"2024-09-12T22:35:53.229974+0000","last_became_active":"2024-09-12T22:35:23.755812+0000","last_became_peered":"2024-09-12T22:35:23.755812+0000","last_unstale":"2024-09-12T22:35:53.229974+0000","last_undegraded":"2024-09-12T22:35:53.229974+0000","last_fullsized":"2024-09-12T22:35:53.229974+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'550","last_scrub_stamp":"2024-09-12T22:35:53.229883+0000","last_deep_scrub":"80'550","last_deep_scrub_stamp":"2024-09-12T22:35:53.229883+0000","last_clean_scrub_stamp":"2024-09-12T22:35:53.229883+0000","objects_scrubbed":2,"log_size":550,"log_dups_size":0,"ondisk_log_size":550,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:00:59.857643+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":488,"num_write_kb":8420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"60'422","reported_seq":677,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:52.206636+0000","last_change":"2024-09-12T22:35:52.206697+0000","last_active":"2024-09-12T22:35:52.206636+0000","last_peered":"2024-09-12T22:35:52.206636+0000","last_clean":"2024-09-12T22:35:52.206636+0000","last_became_active":"2024-09-12T22:31:37.409796+0000","last_became_peered":"2024-09-12T22:31:37.409796+0000","last_unstale":"2024-09-12T22:35:52.206636+0000","last_undegraded":"2024-09-12T22:35:52.206636+0000","last_fullsized":"2024-09-12T22:35:52.206636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'422","last_scrub_stamp":"2024-09-12T22:35:52.206509+0000","last_deep_scrub":"60'422","last_deep_scrub_stamp":"2024-09-12T22:35:52.206509+0000","last_clean_scrub_stamp":"2024-09-12T22:35:52.206509+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:14:27.519681+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":51020,"num_write":397,"num_write_kb":73116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"80'181","reported_seq":325,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:59.288653+0000","last_change":"2024-09-12T22:35:59.288682+0000","last_active":"2024-09-12T22:35:59.288653+0000","last_peered":"2024-09-12T22:35:59.288653+0000","last_clean":"2024-09-12T22:35:59.288653+0000","last_became_active":"2024-09-12T22:31:36.406681+0000","last_became_peered":"2024-09-12T22:31:36.406681+0000","last_unstale":"2024-09-12T22:35:59.288653+0000","last_undegraded":"2024-09-12T22:35:59.288653+0000","last_fullsized":"2024-09-12T22:35:59.288653+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'181","last_scrub_stamp":"2024-09-12T22:35:59.288563+0000","last_deep_scrub":"80'181","last_deep_scrub_stamp":"2024-09-12T22:35:59.288563+0000","last_clean_scrub_stamp":"2024-09-12T22:35:59.288563+0000","objects_scrubbed":1,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:18:46.826462+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":134,"num_write_kb":4167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"60'420","reported_seq":554,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:46.075092+0000","last_change":"2024-09-12T22:35:46.075123+0000","last_active":"2024-09-12T22:35:46.075092+0000","last_peered":"2024-09-12T22:35:46.075092+0000","last_clean":"2024-09-12T22:35:46.075092+0000","last_became_active":"2024-09-12T22:35:30.733182+0000","last_became_peered":"2024-09-12T22:35:30.733182+0000","last_unstale":"2024-09-12T22:35:46.075092+0000","last_undegraded":"2024-09-12T22:35:46.075092+0000","last_fullsized":"2024-09-12T22:35:46.075092+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'420","last_scrub_stamp":"2024-09-12T22:35:46.074989+0000","last_deep_scrub":"60'420","last_deep_scrub_stamp":"2024-09-12T22:35:46.074989+0000","last_clean_scrub_stamp":"2024-09-12T22:35:46.074989+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:56.187326+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":24901,"num_write":369,"num_write_kb":75198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"80'215","reported_seq":336,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:50.096276+0000","last_change":"2024-09-12T22:35:50.096311+0000","last_active":"2024-09-12T22:35:50.096276+0000","last_peered":"2024-09-12T22:35:50.096276+0000","last_clean":"2024-09-12T22:35:50.096276+0000","last_became_active":"2024-09-12T22:35:33.754931+0000","last_became_peered":"2024-09-12T22:35:33.754931+0000","last_unstale":"2024-09-12T22:35:50.096276+0000","last_undegraded":"2024-09-12T22:35:50.096276+0000","last_fullsized":"2024-09-12T22:35:50.096276+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'215","last_scrub_stamp":"2024-09-12T22:35:50.096191+0000","last_deep_scrub":"80'215","last_deep_scrub_stamp":"2024-09-12T22:35:50.096191+0000","last_clean_scrub_stamp":"2024-09-12T22:35:50.096191+0000","objects_scrubbed":3,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:33:18.847054+0000","scrub_duration":26,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12553847,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":12334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"60'398","reported_seq":548,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:36:09.217428+0000","last_change":"2024-09-12T22:36:09.217456+0000","last_active":"2024-09-12T22:36:09.217428+0000","last_peered":"2024-09-12T22:36:09.217428+0000","last_clean":"2024-09-12T22:36:09.217428+0000","last_became_active":"2024-09-12T22:35:33.755497+0000","last_became_peered":"2024-09-12T22:35:33.755497+0000","last_unstale":"2024-09-12T22:36:09.217428+0000","last_undegraded":"2024-09-12T22:36:09.217428+0000","last_fullsized":"2024-09-12T22:36:09.217428+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'398","last_scrub_stamp":"2024-09-12T22:36:09.217343+0000","last_deep_scrub":"60'398","last_deep_scrub_stamp":"2024-09-12T22:36:09.217343+0000","last_clean_scrub_stamp":"2024-09-12T22:36:09.217343+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:30:43.483081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":11429,"num_write":361,"num_write_kb":88082,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"80'55","reported_seq":65,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:36:01.096500+0000","last_change":"2024-09-12T22:36:01.096548+0000","last_active":"2024-09-12T22:36:01.096500+0000","last_peered":"2024-09-12T22:36:01.096500+0000","last_clean":"2024-09-12T22:36:01.096500+0000","last_became_active":"2024-09-12T22:35:20.733271+0000","last_became_peered":"2024-09-12T22:35:20.733271+0000","last_unstale":"2024-09-12T22:36:01.096500+0000","last_undegraded":"2024-09-12T22:36:01.096500+0000","last_fullsized":"2024-09-12T22:36:01.096500+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'55","last_scrub_stamp":"2024-09-12T22:36:01.096385+0000","last_deep_scrub":"80'55","last_deep_scrub_stamp":"2024-09-12T22:36:01.096385+0000","last_clean_scrub_stamp":"2024-09-12T22:36:01.096385+0000","objects_scrubbed":1,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:33:03.657662+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"60'359","reported_seq":521,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:52.680398+0000","last_change":"2024-09-12T22:35:52.680424+0000","last_active":"2024-09-12T22:35:52.680398+0000","last_peered":"2024-09-12T22:35:52.680398+0000","last_clean":"2024-09-12T22:35:52.680398+0000","last_became_active":"2024-09-12T22:31:37.413933+0000","last_became_peered":"2024-09-12T22:31:37.413933+0000","last_unstale":"2024-09-12T22:35:52.680398+0000","last_undegraded":"2024-09-12T22:35:52.680398+0000","last_fullsized":"2024-09-12T22:35:52.680398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'359","last_scrub_stamp":"2024-09-12T22:35:52.680287+0000","last_deep_scrub":"60'359","last_deep_scrub_stamp":"2024-09-12T22:35:52.680287+0000","last_clean_scrub_stamp":"2024-09-12T22:35:52.680287+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:42:43.940274+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":12324,"num_write":332,"num_write_kb":46371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"80'188","reported_seq":332,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:36:06.889748+0000","last_change":"2024-09-12T22:36:06.889789+0000","last_active":"2024-09-12T22:36:06.889748+0000","last_peered":"2024-09-12T22:36:06.889748+0000","last_clean":"2024-09-12T22:36:06.889748+0000","last_became_active":"2024-09-12T22:31:36.410182+0000","last_became_peered":"2024-09-12T22:31:36.410182+0000","last_unstale":"2024-09-12T22:36:06.889748+0000","last_undegraded":"2024-09-12T22:36:06.889748+0000","last_fullsized":"2024-09-12T22:36:06.889748+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'188","last_scrub_stamp":"2024-09-12T22:36:06.889614+0000","last_deep_scrub":"80'188","last_deep_scrub_stamp":"2024-09-12T22:36:06.889614+0000","last_clean_scrub_stamp":"2024-09-12T22:36:06.889614+0000","objects_scrubbed":2,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:22:36.046828+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":4160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"60'401","reported_seq":579,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:46.684410+0000","last_change":"2024-09-12T22:35:46.684439+0000","last_active":"2024-09-12T22:35:46.684410+0000","last_peered":"2024-09-12T22:35:46.684410+0000","last_clean":"2024-09-12T22:35:46.684410+0000","last_became_active":"2024-09-12T22:31:37.414776+0000","last_became_peered":"2024-09-12T22:31:37.414776+0000","last_unstale":"2024-09-12T22:35:46.684410+0000","last_undegraded":"2024-09-12T22:35:46.684410+0000","last_fullsized":"2024-09-12T22:35:46.684410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'401","last_scrub_stamp":"2024-09-12T22:35:46.684315+0000","last_deep_scrub":"60'401","last_deep_scrub_stamp":"2024-09-12T22:35:46.684315+0000","last_clean_scrub_stamp":"2024-09-12T22:35:46.684315+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:23:36.280912+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":24207,"num_write":361,"num_write_kb":50515,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"80'248","reported_seq":378,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:52.060187+0000","last_change":"2024-09-12T22:35:52.060226+0000","last_active":"2024-09-12T22:35:52.060187+0000","last_peered":"2024-09-12T22:35:52.060187+0000","last_clean":"2024-09-12T22:35:52.060187+0000","last_became_active":"2024-09-12T22:35:33.757550+0000","last_became_peered":"2024-09-12T22:35:33.757550+0000","last_unstale":"2024-09-12T22:35:52.060187+0000","last_undegraded":"2024-09-12T22:35:52.060187+0000","last_fullsized":"2024-09-12T22:35:52.060187+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'248","last_scrub_stamp":"2024-09-12T22:35:52.060095+0000","last_deep_scrub":"80'248","last_deep_scrub_stamp":"2024-09-12T22:35:52.060095+0000","last_clean_scrub_stamp":"2024-09-12T22:35:52.060095+0000","objects_scrubbed":4,"log_size":248,"log_dups_size":0,"ondisk_log_size":248,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:08:43.710152+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":12389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"60'439","reported_seq":936,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:44.642559+0000","last_change":"2024-09-12T22:35:44.642586+0000","last_active":"2024-09-12T22:35:44.642559+0000","last_peered":"2024-09-12T22:35:44.642559+0000","last_clean":"2024-09-12T22:35:44.642559+0000","last_became_active":"2024-09-12T22:35:27.729827+0000","last_became_peered":"2024-09-12T22:35:27.729827+0000","last_unstale":"2024-09-12T22:35:44.642559+0000","last_undegraded":"2024-09-12T22:35:44.642559+0000","last_fullsized":"2024-09-12T22:35:44.642559+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'439","last_scrub_stamp":"2024-09-12T22:35:44.642475+0000","last_deep_scrub":"60'439","last_deep_scrub_stamp":"2024-09-12T22:35:44.642475+0000","last_clean_scrub_stamp":"2024-09-12T22:35:44.642475+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:34:56.761822+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":6311,"num_write":403,"num_write_kb":64161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"80'52","reported_seq":209,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:49.201592+0000","last_change":"2024-09-12T22:35:49.201638+0000","last_active":"2024-09-12T22:35:49.201592+0000","last_peered":"2024-09-12T22:35:49.201592+0000","last_clean":"2024-09-12T22:35:49.201592+0000","last_became_active":"2024-09-12T22:35:20.737444+0000","last_became_peered":"2024-09-12T22:35:20.737444+0000","last_unstale":"2024-09-12T22:35:49.201592+0000","last_undegraded":"2024-09-12T22:35:49.201592+0000","last_fullsized":"2024-09-12T22:35:49.201592+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'52","last_scrub_stamp":"2024-09-12T22:35:49.201490+0000","last_deep_scrub":"80'52","last_deep_scrub_stamp":"2024-09-12T22:35:49.201490+0000","last_clean_scrub_stamp":"2024-09-12T22:35:49.201490+0000","objects_scrubbed":1,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:51:42.104127+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"60'438","reported_seq":633,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:54.672183+0000","last_change":"2024-09-12T22:35:54.672211+0000","last_active":"2024-09-12T22:35:54.672183+0000","last_peered":"2024-09-12T22:35:54.672183+0000","last_clean":"2024-09-12T22:35:54.672183+0000","last_became_active":"2024-09-12T22:31:37.414781+0000","last_became_peered":"2024-09-12T22:31:37.414781+0000","last_unstale":"2024-09-12T22:35:54.672183+0000","last_undegraded":"2024-09-12T22:35:54.672183+0000","last_fullsized":"2024-09-12T22:35:54.672183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'438","last_scrub_stamp":"2024-09-12T22:35:54.672094+0000","last_deep_scrub":"60'438","last_deep_scrub_stamp":"2024-09-12T22:35:54.672094+0000","last_clean_scrub_stamp":"2024-09-12T22:35:54.672094+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:37:17.072941+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":29290,"num_write":407,"num_write_kb":46733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"80'114","reported_seq":259,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:36:00.320012+0000","last_change":"2024-09-12T22:36:00.320048+0000","last_active":"2024-09-12T22:36:00.320012+0000","last_peered":"2024-09-12T22:36:00.320012+0000","last_clean":"2024-09-12T22:36:00.320012+0000","last_became_active":"2024-09-12T22:31:36.406959+0000","last_became_peered":"2024-09-12T22:31:36.406959+0000","last_unstale":"2024-09-12T22:36:00.320012+0000","last_undegraded":"2024-09-12T22:36:00.320012+0000","last_fullsized":"2024-09-12T22:36:00.320012+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'114","last_scrub_stamp":"2024-09-12T22:36:00.319924+0000","last_deep_scrub":"80'114","last_deep_scrub_stamp":"2024-09-12T22:36:00.319924+0000","last_clean_scrub_stamp":"2024-09-12T22:36:00.319924+0000","objects_scrubbed":3,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:04:20.373200+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61,"num_write_kb":4126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2747,"num_read_kb":1535780,"num_write":24498,"num_write_kb":4269351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5680,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26636,"ondisk_log_size":26636,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127268954,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":43,"num_read_kb":1462,"num_write":4457,"num_write_kb":127482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":54520159,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":254603264,"data_stored":254537908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4442,"internal_metadata":0},"log_size":6315,"ondisk_log_size":6315,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705727,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":174080,"kb_used_data":84656,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94197760,"statfs":{"total":96636764160,"available":96458506240,"internally_reserved":0,"allocated":86687744,"data_stored":86276944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":66,"seq":283467841550,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":145344,"kb_used_data":87280,"kb_used_omap":5,"kb_used_meta":58042,"kb_avail":94226496,"statfs":{"total":96636764160,"available":96487931904,"internally_reserved":0,"allocated":89374720,"data_stored":88974119,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6037,"internal_metadata":59435115},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738432,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":173516,"kb_used_data":79932,"kb_used_omap":1,"kb_used_meta":93566,"kb_avail":94198324,"statfs":{"total":96636764160,"available":96459083776,"internally_reserved":0,"allocated":81850368,"data_stored":81462353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":95812037},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":88076288,"data_stored":88052173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4442,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81141760,"data_stored":81130756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":85385216,"data_stored":85354979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T22:36:21.007 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-12T22:31:36.386296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:36:21.008 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-12T22:31:36.386296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=31, tm_sec=36, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=22, tm_min=35, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T22:36:21.008 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T22:36:41.010 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T22:36:41.315 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:36:41.317 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-12T22:36:41.326 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":236,"stamp":"2024-09-12T22:36:40.270137+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":127859341,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":2926,"num_read_kb":1537360,"num_write":29160,"num_write_kb":4400295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5694,"num_bytes_recovered":54520159,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33115,"ondisk_log_size":33115,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":492940,"kb_used_data":251868,"kb_used_omap":9,"kb_used_meta":241014,"kb_avail":282622580,"statfs":{"total":289910292480,"available":289405521920,"internally_reserved":0,"allocated":257912832,"data_stored":256713416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9227,"internal_metadata":246799349},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002859"},"pg_stats":[{"pgid":"4.3f","version":"60'422","reported_seq":545,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:44.101676+0000","last_change":"2024-09-12T22:35:44.101722+0000","last_active":"2024-09-12T22:35:44.101676+0000","last_peered":"2024-09-12T22:35:44.101676+0000","last_clean":"2024-09-12T22:35:44.101676+0000","last_became_active":"2024-09-12T22:35:30.731323+0000","last_became_peered":"2024-09-12T22:35:30.731323+0000","last_unstale":"2024-09-12T22:35:44.101676+0000","last_undegraded":"2024-09-12T22:35:44.101676+0000","last_fullsized":"2024-09-12T22:35:44.101676+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'422","last_scrub_stamp":"2024-09-12T22:35:44.101553+0000","last_deep_scrub":"60'422","last_deep_scrub_stamp":"2024-09-12T22:35:44.101553+0000","last_clean_scrub_stamp":"2024-09-12T22:35:44.101553+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:34:46.406008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":29437,"num_write":385,"num_write_kb":96431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"60'470","reported_seq":640,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:36:13.158395+0000","last_change":"2024-09-12T22:36:13.158422+0000","last_active":"2024-09-12T22:36:13.158395+0000","last_peered":"2024-09-12T22:36:13.158395+0000","last_clean":"2024-09-12T22:36:13.158395+0000","last_became_active":"2024-09-12T22:35:33.759906+0000","last_became_peered":"2024-09-12T22:35:33.759906+0000","last_unstale":"2024-09-12T22:36:13.158395+0000","last_undegraded":"2024-09-12T22:36:13.158395+0000","last_fullsized":"2024-09-12T22:36:13.158395+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'470","last_scrub_stamp":"2024-09-12T22:36:13.158312+0000","last_deep_scrub":"60'470","last_deep_scrub_stamp":"2024-09-12T22:36:13.158312+0000","last_clean_scrub_stamp":"2024-09-12T22:36:13.158312+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:55:18.158459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":18334,"num_write":442,"num_write_kb":109282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"60'391","reported_seq":922,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:36:16.161515+0000","last_change":"2024-09-12T22:36:16.161543+0000","last_active":"2024-09-12T22:36:16.161515+0000","last_peered":"2024-09-12T22:36:16.161515+0000","last_clean":"2024-09-12T22:36:16.161515+0000","last_became_active":"2024-09-12T22:35:30.731086+0000","last_became_peered":"2024-09-12T22:35:30.731086+0000","last_unstale":"2024-09-12T22:36:16.161515+0000","last_undegraded":"2024-09-12T22:36:16.161515+0000","last_fullsized":"2024-09-12T22:36:16.161515+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'391","last_scrub_stamp":"2024-09-12T22:36:16.161422+0000","last_deep_scrub":"60'391","last_deep_scrub_stamp":"2024-09-12T22:36:16.161422+0000","last_clean_scrub_stamp":"2024-09-12T22:36:16.161422+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:00:56.211938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":32771,"num_write":355,"num_write_kb":71120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"60'397","reported_seq":590,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:53.683296+0000","last_change":"2024-09-12T22:35:53.683323+0000","last_active":"2024-09-12T22:35:53.683296+0000","last_peered":"2024-09-12T22:35:53.683296+0000","last_clean":"2024-09-12T22:35:53.683296+0000","last_became_active":"2024-09-12T22:31:37.412746+0000","last_became_peered":"2024-09-12T22:31:37.412746+0000","last_unstale":"2024-09-12T22:35:53.683296+0000","last_undegraded":"2024-09-12T22:35:53.683296+0000","last_fullsized":"2024-09-12T22:35:53.683296+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'397","last_scrub_stamp":"2024-09-12T22:35:53.683164+0000","last_deep_scrub":"60'397","last_deep_scrub_stamp":"2024-09-12T22:35:53.683164+0000","last_clean_scrub_stamp":"2024-09-12T22:35:53.683164+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:26:18.488292+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":28544,"num_write":368,"num_write_kb":83737,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"60'458","reported_seq":600,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:36:05.182613+0000","last_change":"2024-09-12T22:36:05.182641+0000","last_active":"2024-09-12T22:36:05.182613+0000","last_peered":"2024-09-12T22:36:05.182613+0000","last_clean":"2024-09-12T22:36:05.182613+0000","last_became_active":"2024-09-12T22:35:24.756373+0000","last_became_peered":"2024-09-12T22:35:24.756373+0000","last_unstale":"2024-09-12T22:36:05.182613+0000","last_undegraded":"2024-09-12T22:36:05.182613+0000","last_fullsized":"2024-09-12T22:36:05.182613+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'458","last_scrub_stamp":"2024-09-12T22:36:05.182473+0000","last_deep_scrub":"60'458","last_deep_scrub_stamp":"2024-09-12T22:36:05.182473+0000","last_clean_scrub_stamp":"2024-09-12T22:36:05.182473+0000","objects_scrubbed":0,"log_size":458,"log_dups_size":0,"ondisk_log_size":458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:58:01.920961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":28467,"num_write":430,"num_write_kb":81329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":198,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"60'381","reported_seq":524,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:36:01.764053+0000","last_change":"2024-09-12T22:36:01.764105+0000","last_active":"2024-09-12T22:36:01.764053+0000","last_peered":"2024-09-12T22:36:01.764053+0000","last_clean":"2024-09-12T22:36:01.764053+0000","last_became_active":"2024-09-12T22:31:37.408811+0000","last_became_peered":"2024-09-12T22:31:37.408811+0000","last_unstale":"2024-09-12T22:36:01.764053+0000","last_undegraded":"2024-09-12T22:36:01.764053+0000","last_fullsized":"2024-09-12T22:36:01.764053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'381","last_scrub_stamp":"2024-09-12T22:36:01.763935+0000","last_deep_scrub":"60'381","last_deep_scrub_stamp":"2024-09-12T22:36:01.763935+0000","last_clean_scrub_stamp":"2024-09-12T22:36:01.763935+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:20:25.290299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":60,"num_write":353,"num_write_kb":58419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"60'439","reported_seq":627,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:55.713294+0000","last_change":"2024-09-12T22:35:55.713323+0000","last_active":"2024-09-12T22:35:55.713294+0000","last_peered":"2024-09-12T22:35:55.713294+0000","last_clean":"2024-09-12T22:35:55.713294+0000","last_became_active":"2024-09-12T22:31:37.412691+0000","last_became_peered":"2024-09-12T22:31:37.412691+0000","last_unstale":"2024-09-12T22:35:55.713294+0000","last_undegraded":"2024-09-12T22:35:55.713294+0000","last_fullsized":"2024-09-12T22:35:55.713294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'439","last_scrub_stamp":"2024-09-12T22:35:55.713169+0000","last_deep_scrub":"60'439","last_deep_scrub_stamp":"2024-09-12T22:35:55.713169+0000","last_clean_scrub_stamp":"2024-09-12T22:35:55.713169+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:43:06.981277+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":27053,"num_write":405,"num_write_kb":79743,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"60'384","reported_seq":598,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:57.714269+0000","last_change":"2024-09-12T22:35:57.714299+0000","last_active":"2024-09-12T22:35:57.714269+0000","last_peered":"2024-09-12T22:35:57.714269+0000","last_clean":"2024-09-12T22:35:57.714269+0000","last_became_active":"2024-09-12T22:31:37.410633+0000","last_became_peered":"2024-09-12T22:31:37.410633+0000","last_unstale":"2024-09-12T22:35:57.714269+0000","last_undegraded":"2024-09-12T22:35:57.714269+0000","last_fullsized":"2024-09-12T22:35:57.714269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'384","last_scrub_stamp":"2024-09-12T22:35:57.714181+0000","last_deep_scrub":"60'384","last_deep_scrub_stamp":"2024-09-12T22:35:57.714181+0000","last_clean_scrub_stamp":"2024-09-12T22:35:57.714181+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:10:02.068838+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":44358,"num_write":338,"num_write_kb":67411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"60'418","reported_seq":1012,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:36:07.453891+0000","last_change":"2024-09-12T22:36:07.453891+0000","last_active":"2024-09-12T22:36:07.453891+0000","last_peered":"2024-09-12T22:36:07.453891+0000","last_clean":"2024-09-12T22:36:07.453891+0000","last_became_active":"2024-09-12T22:35:28.731002+0000","last_became_peered":"2024-09-12T22:35:28.731002+0000","last_unstale":"2024-09-12T22:36:07.453891+0000","last_undegraded":"2024-09-12T22:36:07.453891+0000","last_fullsized":"2024-09-12T22:36:07.453891+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'418","last_scrub_stamp":"2024-09-12T22:36:07.453765+0000","last_deep_scrub":"60'418","last_deep_scrub_stamp":"2024-09-12T22:36:07.453765+0000","last_clean_scrub_stamp":"2024-09-12T22:36:07.453765+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:20:15.583655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":48711,"num_write":384,"num_write_kb":63228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"60'406","reported_seq":529,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:49.059929+0000","last_change":"2024-09-12T22:35:49.059973+0000","last_active":"2024-09-12T22:35:49.059929+0000","last_peered":"2024-09-12T22:35:49.059929+0000","last_clean":"2024-09-12T22:35:49.059929+0000","last_became_active":"2024-09-12T22:35:27.729480+0000","last_became_peered":"2024-09-12T22:35:27.729480+0000","last_unstale":"2024-09-12T22:35:49.059929+0000","last_undegraded":"2024-09-12T22:35:49.059929+0000","last_fullsized":"2024-09-12T22:35:49.059929+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'406","last_scrub_stamp":"2024-09-12T22:35:49.059789+0000","last_deep_scrub":"60'406","last_deep_scrub_stamp":"2024-09-12T22:35:49.059789+0000","last_clean_scrub_stamp":"2024-09-12T22:35:49.059789+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:38:19.067922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":21851,"num_write":367,"num_write_kb":79913,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"60'338","reported_seq":489,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:49.695572+0000","last_change":"2024-09-12T22:35:49.695572+0000","last_active":"2024-09-12T22:35:49.695572+0000","last_peered":"2024-09-12T22:35:49.695572+0000","last_clean":"2024-09-12T22:35:49.695572+0000","last_became_active":"2024-09-12T22:31:37.414165+0000","last_became_peered":"2024-09-12T22:31:37.414165+0000","last_unstale":"2024-09-12T22:35:49.695572+0000","last_undegraded":"2024-09-12T22:35:49.695572+0000","last_fullsized":"2024-09-12T22:35:49.695572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'338","last_scrub_stamp":"2024-09-12T22:35:49.695416+0000","last_deep_scrub":"60'338","last_deep_scrub_stamp":"2024-09-12T22:35:49.695416+0000","last_clean_scrub_stamp":"2024-09-12T22:35:49.695416+0000","objects_scrubbed":0,"log_size":338,"log_dups_size":0,"ondisk_log_size":338,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:04:19.237182+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":4053,"num_write":316,"num_write_kb":21475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"60'359","reported_seq":504,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:36:12.134942+0000","last_change":"2024-09-12T22:36:12.134980+0000","last_active":"2024-09-12T22:36:12.134942+0000","last_peered":"2024-09-12T22:36:12.134942+0000","last_clean":"2024-09-12T22:36:12.134942+0000","last_became_active":"2024-09-12T22:35:33.760739+0000","last_became_peered":"2024-09-12T22:35:33.760739+0000","last_unstale":"2024-09-12T22:36:12.134942+0000","last_undegraded":"2024-09-12T22:36:12.134942+0000","last_fullsized":"2024-09-12T22:36:12.134942+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'359","last_scrub_stamp":"2024-09-12T22:36:12.134850+0000","last_deep_scrub":"60'359","last_deep_scrub_stamp":"2024-09-12T22:36:12.134850+0000","last_clean_scrub_stamp":"2024-09-12T22:36:12.134850+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:34:38.433704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":6688,"num_write":330,"num_write_kb":38146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"60'402","reported_seq":546,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:36:08.207410+0000","last_change":"2024-09-12T22:36:08.207438+0000","last_active":"2024-09-12T22:36:08.207410+0000","last_peered":"2024-09-12T22:36:08.207410+0000","last_clean":"2024-09-12T22:36:08.207410+0000","last_became_active":"2024-09-12T22:35:33.754938+0000","last_became_peered":"2024-09-12T22:35:33.754938+0000","last_unstale":"2024-09-12T22:36:08.207410+0000","last_undegraded":"2024-09-12T22:36:08.207410+0000","last_fullsized":"2024-09-12T22:36:08.207410+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'402","last_scrub_stamp":"2024-09-12T22:36:08.207310+0000","last_deep_scrub":"60'402","last_deep_scrub_stamp":"2024-09-12T22:36:08.207310+0000","last_clean_scrub_stamp":"2024-09-12T22:36:08.207310+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:29:01.537795+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":16384,"num_write":363,"num_write_kb":62556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"60'409","reported_seq":945,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:36:14.095717+0000","last_change":"2024-09-12T22:36:14.095717+0000","last_active":"2024-09-12T22:36:14.095717+0000","last_peered":"2024-09-12T22:36:14.095717+0000","last_clean":"2024-09-12T22:36:14.095717+0000","last_became_active":"2024-09-12T22:35:29.735835+0000","last_became_peered":"2024-09-12T22:35:29.735835+0000","last_unstale":"2024-09-12T22:36:14.095717+0000","last_undegraded":"2024-09-12T22:36:14.095717+0000","last_fullsized":"2024-09-12T22:36:14.095717+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'409","last_scrub_stamp":"2024-09-12T22:36:14.095602+0000","last_deep_scrub":"60'409","last_deep_scrub_stamp":"2024-09-12T22:36:14.095602+0000","last_clean_scrub_stamp":"2024-09-12T22:36:14.095602+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:03:48.742803+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":13943,"num_write":382,"num_write_kb":54682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"60'412","reported_seq":958,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:36:13.112815+0000","last_change":"2024-09-12T22:36:13.112815+0000","last_active":"2024-09-12T22:36:13.112815+0000","last_peered":"2024-09-12T22:36:13.112815+0000","last_clean":"2024-09-12T22:36:13.112815+0000","last_became_active":"2024-09-12T22:35:28.730413+0000","last_became_peered":"2024-09-12T22:35:28.730413+0000","last_unstale":"2024-09-12T22:36:13.112815+0000","last_undegraded":"2024-09-12T22:36:13.112815+0000","last_fullsized":"2024-09-12T22:36:13.112815+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'412","last_scrub_stamp":"2024-09-12T22:36:13.112694+0000","last_deep_scrub":"60'412","last_deep_scrub_stamp":"2024-09-12T22:36:13.112694+0000","last_clean_scrub_stamp":"2024-09-12T22:36:13.112694+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:18:19.359470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":19700,"num_write":377,"num_write_kb":67929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"60'404","reported_seq":547,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:59.747527+0000","last_change":"2024-09-12T22:35:59.747527+0000","last_active":"2024-09-12T22:35:59.747527+0000","last_peered":"2024-09-12T22:35:59.747527+0000","last_clean":"2024-09-12T22:35:59.747527+0000","last_became_active":"2024-09-12T22:31:37.410557+0000","last_became_peered":"2024-09-12T22:31:37.410557+0000","last_unstale":"2024-09-12T22:35:59.747527+0000","last_undegraded":"2024-09-12T22:35:59.747527+0000","last_fullsized":"2024-09-12T22:35:59.747527+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'404","last_scrub_stamp":"2024-09-12T22:35:59.747393+0000","last_deep_scrub":"60'404","last_deep_scrub_stamp":"2024-09-12T22:35:59.747393+0000","last_clean_scrub_stamp":"2024-09-12T22:35:59.747393+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:39:16.963301+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":368,"num_write_kb":25652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"60'405","reported_seq":950,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:36:12.392515+0000","last_change":"2024-09-12T22:36:12.392515+0000","last_active":"2024-09-12T22:36:12.392515+0000","last_peered":"2024-09-12T22:36:12.392515+0000","last_clean":"2024-09-12T22:36:12.392515+0000","last_became_active":"2024-09-12T22:35:31.730883+0000","last_became_peered":"2024-09-12T22:35:31.730883+0000","last_unstale":"2024-09-12T22:36:12.392515+0000","last_undegraded":"2024-09-12T22:36:12.392515+0000","last_fullsized":"2024-09-12T22:36:12.392515+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'405","last_scrub_stamp":"2024-09-12T22:36:12.392397+0000","last_deep_scrub":"60'405","last_deep_scrub_stamp":"2024-09-12T22:36:12.392397+0000","last_clean_scrub_stamp":"2024-09-12T22:36:12.392397+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:06:06.178507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":18251,"num_write":369,"num_write_kb":34203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"60'406","reported_seq":588,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:54.128320+0000","last_change":"2024-09-12T22:35:54.128349+0000","last_active":"2024-09-12T22:35:54.128320+0000","last_peered":"2024-09-12T22:35:54.128320+0000","last_clean":"2024-09-12T22:35:54.128320+0000","last_became_active":"2024-09-12T22:35:33.754915+0000","last_became_peered":"2024-09-12T22:35:33.754915+0000","last_unstale":"2024-09-12T22:35:54.128320+0000","last_undegraded":"2024-09-12T22:35:54.128320+0000","last_fullsized":"2024-09-12T22:35:54.128320+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'406","last_scrub_stamp":"2024-09-12T22:35:54.128229+0000","last_deep_scrub":"60'406","last_deep_scrub_stamp":"2024-09-12T22:35:54.128229+0000","last_clean_scrub_stamp":"2024-09-12T22:35:54.128229+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:30:39.517247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":45843,"num_write":367,"num_write_kb":59097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"60'413","reported_seq":942,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:36:11.365130+0000","last_change":"2024-09-12T22:36:11.365156+0000","last_active":"2024-09-12T22:36:11.365130+0000","last_peered":"2024-09-12T22:36:11.365130+0000","last_clean":"2024-09-12T22:36:11.365130+0000","last_became_active":"2024-09-12T22:35:31.730742+0000","last_became_peered":"2024-09-12T22:35:31.730742+0000","last_unstale":"2024-09-12T22:36:11.365130+0000","last_undegraded":"2024-09-12T22:36:11.365130+0000","last_fullsized":"2024-09-12T22:36:11.365130+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'413","last_scrub_stamp":"2024-09-12T22:36:11.365040+0000","last_deep_scrub":"60'413","last_deep_scrub_stamp":"2024-09-12T22:36:11.365040+0000","last_clean_scrub_stamp":"2024-09-12T22:36:11.365040+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:21:35.011158+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":20855,"num_write":371,"num_write_kb":71095,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"60'441","reported_seq":631,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:51.678006+0000","last_change":"2024-09-12T22:35:51.678006+0000","last_active":"2024-09-12T22:35:51.678006+0000","last_peered":"2024-09-12T22:35:51.678006+0000","last_clean":"2024-09-12T22:35:51.678006+0000","last_became_active":"2024-09-12T22:31:37.413786+0000","last_became_peered":"2024-09-12T22:31:37.413786+0000","last_unstale":"2024-09-12T22:35:51.678006+0000","last_undegraded":"2024-09-12T22:35:51.678006+0000","last_fullsized":"2024-09-12T22:35:51.678006+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'441","last_scrub_stamp":"2024-09-12T22:35:51.677862+0000","last_deep_scrub":"60'441","last_deep_scrub_stamp":"2024-09-12T22:35:51.677862+0000","last_clean_scrub_stamp":"2024-09-12T22:35:51.677862+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:34:24.660095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":23954,"num_write":419,"num_write_kb":72528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"60'414","reported_seq":632,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:56.675365+0000","last_change":"2024-09-12T22:35:56.675365+0000","last_active":"2024-09-12T22:35:56.675365+0000","last_peered":"2024-09-12T22:35:56.675365+0000","last_clean":"2024-09-12T22:35:56.675365+0000","last_became_active":"2024-09-12T22:31:37.414319+0000","last_became_peered":"2024-09-12T22:31:37.414319+0000","last_unstale":"2024-09-12T22:35:56.675365+0000","last_undegraded":"2024-09-12T22:35:56.675365+0000","last_fullsized":"2024-09-12T22:35:56.675365+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'414","last_scrub_stamp":"2024-09-12T22:35:56.675192+0000","last_deep_scrub":"60'414","last_deep_scrub_stamp":"2024-09-12T22:35:56.675192+0000","last_clean_scrub_stamp":"2024-09-12T22:35:56.675192+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:17:56.600295+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":44129,"num_write":387,"num_write_kb":104899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"60'444","reported_seq":560,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:57.082767+0000","last_change":"2024-09-12T22:35:57.082793+0000","last_active":"2024-09-12T22:35:57.082767+0000","last_peered":"2024-09-12T22:35:57.082767+0000","last_clean":"2024-09-12T22:35:57.082767+0000","last_became_active":"2024-09-12T22:35:25.727269+0000","last_became_peered":"2024-09-12T22:35:25.727269+0000","last_unstale":"2024-09-12T22:35:57.082767+0000","last_undegraded":"2024-09-12T22:35:57.082767+0000","last_fullsized":"2024-09-12T22:35:57.082767+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'444","last_scrub_stamp":"2024-09-12T22:35:57.082674+0000","last_deep_scrub":"60'444","last_deep_scrub_stamp":"2024-09-12T22:35:57.082674+0000","last_clean_scrub_stamp":"2024-09-12T22:35:57.082674+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:11:01.171297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":17411,"num_write":407,"num_write_kb":87850,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"60'421","reported_seq":656,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:56.242246+0000","last_change":"2024-09-12T22:35:56.242246+0000","last_active":"2024-09-12T22:35:56.242246+0000","last_peered":"2024-09-12T22:35:56.242246+0000","last_clean":"2024-09-12T22:35:56.242246+0000","last_became_active":"2024-09-12T22:31:37.409951+0000","last_became_peered":"2024-09-12T22:31:37.409951+0000","last_unstale":"2024-09-12T22:35:56.242246+0000","last_undegraded":"2024-09-12T22:35:56.242246+0000","last_fullsized":"2024-09-12T22:35:56.242246+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'421","last_scrub_stamp":"2024-09-12T22:35:56.242126+0000","last_deep_scrub":"60'421","last_deep_scrub_stamp":"2024-09-12T22:35:56.242126+0000","last_clean_scrub_stamp":"2024-09-12T22:35:56.242126+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:53:59.255839+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":44074,"num_write":389,"num_write_kb":44104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"60'459","reported_seq":623,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:40.989070+0000","last_change":"2024-09-12T22:35:40.989130+0000","last_active":"2024-09-12T22:35:40.989070+0000","last_peered":"2024-09-12T22:35:40.989070+0000","last_clean":"2024-09-12T22:35:40.989070+0000","last_became_active":"2024-09-12T22:35:33.754576+0000","last_became_peered":"2024-09-12T22:35:33.754576+0000","last_unstale":"2024-09-12T22:35:40.989070+0000","last_undegraded":"2024-09-12T22:35:40.989070+0000","last_fullsized":"2024-09-12T22:35:40.989070+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'459","last_scrub_stamp":"2024-09-12T22:35:40.988963+0000","last_deep_scrub":"60'459","last_deep_scrub_stamp":"2024-09-12T22:35:40.988963+0000","last_clean_scrub_stamp":"2024-09-12T22:35:40.988963+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:27:58.591980+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":28605,"num_write":432,"num_write_kb":100377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"60'419","reported_seq":525,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:42.024749+0000","last_change":"2024-09-12T22:35:42.024809+0000","last_active":"2024-09-12T22:35:42.024749+0000","last_peered":"2024-09-12T22:35:42.024749+0000","last_clean":"2024-09-12T22:35:42.024749+0000","last_became_active":"2024-09-12T22:35:29.735450+0000","last_became_peered":"2024-09-12T22:35:29.735450+0000","last_unstale":"2024-09-12T22:35:42.024749+0000","last_undegraded":"2024-09-12T22:35:42.024749+0000","last_fullsized":"2024-09-12T22:35:42.024749+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'419","last_scrub_stamp":"2024-09-12T22:35:42.024639+0000","last_deep_scrub":"60'419","last_deep_scrub_stamp":"2024-09-12T22:35:42.024639+0000","last_clean_scrub_stamp":"2024-09-12T22:35:42.024639+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:53:06.906248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":16852,"num_write":404,"num_write_kb":34622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"60'494","reported_seq":720,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:44.209175+0000","last_change":"2024-09-12T22:35:44.209175+0000","last_active":"2024-09-12T22:35:44.209175+0000","last_peered":"2024-09-12T22:35:44.209175+0000","last_clean":"2024-09-12T22:35:44.209175+0000","last_became_active":"2024-09-12T22:31:37.410563+0000","last_became_peered":"2024-09-12T22:31:37.410563+0000","last_unstale":"2024-09-12T22:35:44.209175+0000","last_undegraded":"2024-09-12T22:35:44.209175+0000","last_fullsized":"2024-09-12T22:35:44.209175+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'494","last_scrub_stamp":"2024-09-12T22:35:44.209026+0000","last_deep_scrub":"60'494","last_deep_scrub_stamp":"2024-09-12T22:35:44.209026+0000","last_clean_scrub_stamp":"2024-09-12T22:35:44.209026+0000","objects_scrubbed":0,"log_size":494,"log_dups_size":0,"ondisk_log_size":494,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:13:03.173567+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":35239,"num_write":450,"num_write_kb":76898,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"60'401","reported_seq":933,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:36:15.139912+0000","last_change":"2024-09-12T22:36:15.139982+0000","last_active":"2024-09-12T22:36:15.139912+0000","last_peered":"2024-09-12T22:36:15.139912+0000","last_clean":"2024-09-12T22:36:15.139912+0000","last_became_active":"2024-09-12T22:35:30.731155+0000","last_became_peered":"2024-09-12T22:35:30.731155+0000","last_unstale":"2024-09-12T22:36:15.139912+0000","last_undegraded":"2024-09-12T22:36:15.139912+0000","last_fullsized":"2024-09-12T22:36:15.139912+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'401","last_scrub_stamp":"2024-09-12T22:36:15.139807+0000","last_deep_scrub":"60'401","last_deep_scrub_stamp":"2024-09-12T22:36:15.139807+0000","last_clean_scrub_stamp":"2024-09-12T22:36:15.139807+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:28:07.010769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":10993,"num_write":369,"num_write_kb":55171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"60'390","reported_seq":547,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:36:10.187625+0000","last_change":"2024-09-12T22:36:10.187652+0000","last_active":"2024-09-12T22:36:10.187625+0000","last_peered":"2024-09-12T22:36:10.187625+0000","last_clean":"2024-09-12T22:36:10.187625+0000","last_became_active":"2024-09-12T22:35:33.756108+0000","last_became_peered":"2024-09-12T22:35:33.756108+0000","last_unstale":"2024-09-12T22:36:10.187625+0000","last_undegraded":"2024-09-12T22:36:10.187625+0000","last_fullsized":"2024-09-12T22:36:10.187625+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'390","last_scrub_stamp":"2024-09-12T22:36:10.187539+0000","last_deep_scrub":"60'390","last_deep_scrub_stamp":"2024-09-12T22:36:10.187539+0000","last_clean_scrub_stamp":"2024-09-12T22:36:10.187539+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:46:47.612005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":18588,"num_write":360,"num_write_kb":59307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"60'429","reported_seq":1017,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:55.226657+0000","last_change":"2024-09-12T22:35:55.226704+0000","last_active":"2024-09-12T22:35:55.226657+0000","last_peered":"2024-09-12T22:35:55.226657+0000","last_clean":"2024-09-12T22:35:55.226657+0000","last_became_active":"2024-09-12T22:35:23.755618+0000","last_became_peered":"2024-09-12T22:35:23.755618+0000","last_unstale":"2024-09-12T22:35:55.226657+0000","last_undegraded":"2024-09-12T22:35:55.226657+0000","last_fullsized":"2024-09-12T22:35:55.226657+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'429","last_scrub_stamp":"2024-09-12T22:35:55.226556+0000","last_deep_scrub":"60'429","last_deep_scrub_stamp":"2024-09-12T22:35:55.226556+0000","last_clean_scrub_stamp":"2024-09-12T22:35:55.226556+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:42:10.514737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":32541,"num_write":398,"num_write_kb":76609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"60'458","reported_seq":584,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:45.065775+0000","last_change":"2024-09-12T22:35:45.065802+0000","last_active":"2024-09-12T22:35:45.065775+0000","last_peered":"2024-09-12T22:35:45.065775+0000","last_clean":"2024-09-12T22:35:45.065775+0000","last_became_active":"2024-09-12T22:35:28.730337+0000","last_became_peered":"2024-09-12T22:35:28.730337+0000","last_unstale":"2024-09-12T22:35:45.065775+0000","last_undegraded":"2024-09-12T22:35:45.065775+0000","last_fullsized":"2024-09-12T22:35:45.065775+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'458","last_scrub_stamp":"2024-09-12T22:35:45.065680+0000","last_deep_scrub":"60'458","last_deep_scrub_stamp":"2024-09-12T22:35:45.065680+0000","last_clean_scrub_stamp":"2024-09-12T22:35:45.065680+0000","objects_scrubbed":0,"log_size":458,"log_dups_size":0,"ondisk_log_size":458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:54.975726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":16425,"num_write":413,"num_write_kb":47110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"60'432","reported_seq":992,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:40.156788+0000","last_change":"2024-09-12T22:35:40.156788+0000","last_active":"2024-09-12T22:35:40.156788+0000","last_peered":"2024-09-12T22:35:40.156788+0000","last_clean":"2024-09-12T22:35:40.156788+0000","last_became_active":"2024-09-12T22:35:26.731135+0000","last_became_peered":"2024-09-12T22:35:26.731135+0000","last_unstale":"2024-09-12T22:35:40.156788+0000","last_undegraded":"2024-09-12T22:35:40.156788+0000","last_fullsized":"2024-09-12T22:35:40.156788+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'432","last_scrub_stamp":"2024-09-12T22:35:40.156631+0000","last_deep_scrub":"60'432","last_deep_scrub_stamp":"2024-09-12T22:35:40.156631+0000","last_clean_scrub_stamp":"2024-09-12T22:35:40.156631+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:37:49.074651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":21090,"num_write":393,"num_write_kb":67477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"60'458","reported_seq":646,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:48.723864+0000","last_change":"2024-09-12T22:35:48.723864+0000","last_active":"2024-09-12T22:35:48.723864+0000","last_peered":"2024-09-12T22:35:48.723864+0000","last_clean":"2024-09-12T22:35:48.723864+0000","last_became_active":"2024-09-12T22:31:37.414265+0000","last_became_peered":"2024-09-12T22:31:37.414265+0000","last_unstale":"2024-09-12T22:35:48.723864+0000","last_undegraded":"2024-09-12T22:35:48.723864+0000","last_fullsized":"2024-09-12T22:35:48.723864+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'458","last_scrub_stamp":"2024-09-12T22:35:48.723701+0000","last_deep_scrub":"60'458","last_deep_scrub_stamp":"2024-09-12T22:35:48.723701+0000","last_clean_scrub_stamp":"2024-09-12T22:35:48.723701+0000","objects_scrubbed":0,"log_size":458,"log_dups_size":0,"ondisk_log_size":458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:22:45.422855+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":37395,"num_write":421,"num_write_kb":73250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"60'411","reported_seq":592,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:36:11.171452+0000","last_change":"2024-09-12T22:36:11.171479+0000","last_active":"2024-09-12T22:36:11.171452+0000","last_peered":"2024-09-12T22:36:11.171452+0000","last_clean":"2024-09-12T22:36:11.171452+0000","last_became_active":"2024-09-12T22:35:33.761121+0000","last_became_peered":"2024-09-12T22:35:33.761121+0000","last_unstale":"2024-09-12T22:36:11.171452+0000","last_undegraded":"2024-09-12T22:36:11.171452+0000","last_fullsized":"2024-09-12T22:36:11.171452+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'411","last_scrub_stamp":"2024-09-12T22:36:11.171351+0000","last_deep_scrub":"60'411","last_deep_scrub_stamp":"2024-09-12T22:36:11.171351+0000","last_clean_scrub_stamp":"2024-09-12T22:36:11.171351+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:40:10.374607+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":36400,"num_write":371,"num_write_kb":92142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"80'550","reported_seq":695,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:36:08.966248+0000","last_change":"2024-09-12T22:36:08.966248+0000","last_active":"2024-09-12T22:36:08.966248+0000","last_peered":"2024-09-12T22:36:08.966248+0000","last_clean":"2024-09-12T22:36:08.966248+0000","last_became_active":"2024-09-12T22:31:36.410871+0000","last_became_peered":"2024-09-12T22:31:36.410871+0000","last_unstale":"2024-09-12T22:36:08.966248+0000","last_undegraded":"2024-09-12T22:36:08.966248+0000","last_fullsized":"2024-09-12T22:36:08.966248+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'550","last_scrub_stamp":"2024-09-12T22:36:08.966117+0000","last_deep_scrub":"80'550","last_deep_scrub_stamp":"2024-09-12T22:36:08.966117+0000","last_clean_scrub_stamp":"2024-09-12T22:36:08.966117+0000","objects_scrubbed":4,"log_size":550,"log_dups_size":0,"ondisk_log_size":550,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:17:33.384373+0000","scrub_duration":18,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":495,"num_write_kb":8426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"60'427","reported_seq":607,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:48.109072+0000","last_change":"2024-09-12T22:35:48.109100+0000","last_active":"2024-09-12T22:35:48.109072+0000","last_peered":"2024-09-12T22:35:48.109072+0000","last_clean":"2024-09-12T22:35:48.109072+0000","last_became_active":"2024-09-12T22:35:31.730237+0000","last_became_peered":"2024-09-12T22:35:31.730237+0000","last_unstale":"2024-09-12T22:35:48.109072+0000","last_undegraded":"2024-09-12T22:35:48.109072+0000","last_fullsized":"2024-09-12T22:35:48.109072+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'427","last_scrub_stamp":"2024-09-12T22:35:48.108962+0000","last_deep_scrub":"60'427","last_deep_scrub_stamp":"2024-09-12T22:35:48.108962+0000","last_clean_scrub_stamp":"2024-09-12T22:35:48.108962+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:37:11.699764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":59223,"num_write":394,"num_write_kb":80309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":175,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"60'55","reported_seq":200,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:36:03.381600+0000","last_change":"2024-09-12T22:36:03.381600+0000","last_active":"2024-09-12T22:36:03.381600+0000","last_peered":"2024-09-12T22:36:03.381600+0000","last_clean":"2024-09-12T22:36:03.381600+0000","last_became_active":"2024-09-12T22:31:36.407447+0000","last_became_peered":"2024-09-12T22:31:36.407447+0000","last_unstale":"2024-09-12T22:36:03.381600+0000","last_undegraded":"2024-09-12T22:36:03.381600+0000","last_fullsized":"2024-09-12T22:36:03.381600+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'55","last_scrub_stamp":"2024-09-12T22:36:03.381475+0000","last_deep_scrub":"60'55","last_deep_scrub_stamp":"2024-09-12T22:36:03.381475+0000","last_clean_scrub_stamp":"2024-09-12T22:36:03.381475+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:24:57.286221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"60'424","reported_seq":598,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:46.125885+0000","last_change":"2024-09-12T22:35:46.125885+0000","last_active":"2024-09-12T22:35:46.125885+0000","last_peered":"2024-09-12T22:35:46.125885+0000","last_clean":"2024-09-12T22:35:46.125885+0000","last_became_active":"2024-09-12T22:31:37.411168+0000","last_became_peered":"2024-09-12T22:31:37.411168+0000","last_unstale":"2024-09-12T22:35:46.125885+0000","last_undegraded":"2024-09-12T22:35:46.125885+0000","last_fullsized":"2024-09-12T22:35:46.125885+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'424","last_scrub_stamp":"2024-09-12T22:35:46.125739+0000","last_deep_scrub":"60'424","last_deep_scrub_stamp":"2024-09-12T22:35:46.125739+0000","last_clean_scrub_stamp":"2024-09-12T22:35:46.125739+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:21:18.641116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":13992,"num_write":386,"num_write_kb":38510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"60'70","reported_seq":56,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:59.109576+0000","last_change":"2024-09-12T22:35:59.109607+0000","last_active":"2024-09-12T22:35:59.109576+0000","last_peered":"2024-09-12T22:35:59.109576+0000","last_clean":"2024-09-12T22:35:59.109576+0000","last_became_active":"2024-09-12T22:35:20.734023+0000","last_became_peered":"2024-09-12T22:35:20.734023+0000","last_unstale":"2024-09-12T22:35:59.109576+0000","last_undegraded":"2024-09-12T22:35:59.109576+0000","last_fullsized":"2024-09-12T22:35:59.109576+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'70","last_scrub_stamp":"2024-09-12T22:35:59.109487+0000","last_deep_scrub":"60'70","last_deep_scrub_stamp":"2024-09-12T22:35:59.109487+0000","last_clean_scrub_stamp":"2024-09-12T22:35:59.109487+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:39.399204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"60'395","reported_seq":587,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:50.208596+0000","last_change":"2024-09-12T22:35:50.208596+0000","last_active":"2024-09-12T22:35:50.208596+0000","last_peered":"2024-09-12T22:35:50.208596+0000","last_clean":"2024-09-12T22:35:50.208596+0000","last_became_active":"2024-09-12T22:31:37.409666+0000","last_became_peered":"2024-09-12T22:31:37.409666+0000","last_unstale":"2024-09-12T22:35:50.208596+0000","last_undegraded":"2024-09-12T22:35:50.208596+0000","last_fullsized":"2024-09-12T22:35:50.208596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'395","last_scrub_stamp":"2024-09-12T22:35:50.208421+0000","last_deep_scrub":"60'395","last_deep_scrub_stamp":"2024-09-12T22:35:50.208421+0000","last_clean_scrub_stamp":"2024-09-12T22:35:50.208421+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:31:45.148484+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":24198,"num_write":363,"num_write_kb":67056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"80'72","reported_seq":225,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:36:11.039474+0000","last_change":"2024-09-12T22:36:11.039474+0000","last_active":"2024-09-12T22:36:11.039474+0000","last_peered":"2024-09-12T22:36:11.039474+0000","last_clean":"2024-09-12T22:36:11.039474+0000","last_became_active":"2024-09-12T22:35:20.736755+0000","last_became_peered":"2024-09-12T22:35:20.736755+0000","last_unstale":"2024-09-12T22:36:11.039474+0000","last_undegraded":"2024-09-12T22:36:11.039474+0000","last_fullsized":"2024-09-12T22:36:11.039474+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'72","last_scrub_stamp":"2024-09-12T22:36:11.039343+0000","last_deep_scrub":"80'72","last_deep_scrub_stamp":"2024-09-12T22:36:11.039343+0000","last_clean_scrub_stamp":"2024-09-12T22:36:11.039343+0000","objects_scrubbed":4,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:23:26.594644+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"80'160","reported_seq":319,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:42.614262+0000","last_change":"2024-09-12T22:35:42.614262+0000","last_active":"2024-09-12T22:35:42.614262+0000","last_peered":"2024-09-12T22:35:42.614262+0000","last_clean":"2024-09-12T22:35:42.614262+0000","last_became_active":"2024-09-12T22:35:23.756663+0000","last_became_peered":"2024-09-12T22:35:23.756663+0000","last_unstale":"2024-09-12T22:35:42.614262+0000","last_undegraded":"2024-09-12T22:35:42.614262+0000","last_fullsized":"2024-09-12T22:35:42.614262+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'160","last_scrub_stamp":"2024-09-12T22:35:42.614122+0000","last_deep_scrub":"80'160","last_deep_scrub_stamp":"2024-09-12T22:35:42.614122+0000","last_clean_scrub_stamp":"2024-09-12T22:35:42.614122+0000","objects_scrubbed":2,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:26:42.466587+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":105,"num_write_kb":4159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"60'426","reported_seq":554,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:51.030342+0000","last_change":"2024-09-12T22:35:51.030373+0000","last_active":"2024-09-12T22:35:51.030342+0000","last_peered":"2024-09-12T22:35:51.030342+0000","last_clean":"2024-09-12T22:35:51.030342+0000","last_became_active":"2024-09-12T22:35:26.732245+0000","last_became_peered":"2024-09-12T22:35:26.732245+0000","last_unstale":"2024-09-12T22:35:51.030342+0000","last_undegraded":"2024-09-12T22:35:51.030342+0000","last_fullsized":"2024-09-12T22:35:51.030342+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'426","last_scrub_stamp":"2024-09-12T22:35:51.030253+0000","last_deep_scrub":"60'426","last_deep_scrub_stamp":"2024-09-12T22:35:51.030253+0000","last_clean_scrub_stamp":"2024-09-12T22:35:51.030253+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:00:21.991066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":29225,"num_write":390,"num_write_kb":83737,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"80'276","reported_seq":378,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:36:04.144415+0000","last_change":"2024-09-12T22:36:04.144452+0000","last_active":"2024-09-12T22:36:04.144415+0000","last_peered":"2024-09-12T22:36:04.144415+0000","last_clean":"2024-09-12T22:36:04.144415+0000","last_became_active":"2024-09-12T22:35:23.755282+0000","last_became_peered":"2024-09-12T22:35:23.755282+0000","last_unstale":"2024-09-12T22:36:04.144415+0000","last_undegraded":"2024-09-12T22:36:04.144415+0000","last_fullsized":"2024-09-12T22:36:04.144415+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'276","last_scrub_stamp":"2024-09-12T22:36:04.144326+0000","last_deep_scrub":"80'276","last_deep_scrub_stamp":"2024-09-12T22:36:04.144326+0000","last_clean_scrub_stamp":"2024-09-12T22:36:04.144326+0000","objects_scrubbed":2,"log_size":276,"log_dups_size":0,"ondisk_log_size":276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:09:12.664650+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":213,"num_write_kb":4214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"60'455","reported_seq":616,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:36:06.154917+0000","last_change":"2024-09-12T22:36:06.154948+0000","last_active":"2024-09-12T22:36:06.154917+0000","last_peered":"2024-09-12T22:36:06.154917+0000","last_clean":"2024-09-12T22:36:06.154917+0000","last_became_active":"2024-09-12T22:35:33.754299+0000","last_became_peered":"2024-09-12T22:35:33.754299+0000","last_unstale":"2024-09-12T22:36:06.154917+0000","last_undegraded":"2024-09-12T22:36:06.154917+0000","last_fullsized":"2024-09-12T22:36:06.154917+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'455","last_scrub_stamp":"2024-09-12T22:36:06.154801+0000","last_deep_scrub":"60'455","last_deep_scrub_stamp":"2024-09-12T22:36:06.154801+0000","last_clean_scrub_stamp":"2024-09-12T22:36:06.154801+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:44:18.076846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":20747,"num_write":425,"num_write_kb":56005,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"80'425","reported_seq":584,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:41.573087+0000","last_change":"2024-09-12T22:35:41.573087+0000","last_active":"2024-09-12T22:35:41.573087+0000","last_peered":"2024-09-12T22:35:41.573087+0000","last_clean":"2024-09-12T22:35:41.573087+0000","last_became_active":"2024-09-12T22:35:23.756668+0000","last_became_peered":"2024-09-12T22:35:23.756668+0000","last_unstale":"2024-09-12T22:35:41.573087+0000","last_undegraded":"2024-09-12T22:35:41.573087+0000","last_fullsized":"2024-09-12T22:35:41.573087+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'425","last_scrub_stamp":"2024-09-12T22:35:41.572931+0000","last_deep_scrub":"80'425","last_deep_scrub_stamp":"2024-09-12T22:35:41.572931+0000","last_clean_scrub_stamp":"2024-09-12T22:35:41.572931+0000","objects_scrubbed":2,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:00:40.614135+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":371,"num_write_kb":4254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"60'431","reported_seq":608,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:47.683345+0000","last_change":"2024-09-12T22:35:47.683345+0000","last_active":"2024-09-12T22:35:47.683345+0000","last_peered":"2024-09-12T22:35:47.683345+0000","last_clean":"2024-09-12T22:35:47.683345+0000","last_became_active":"2024-09-12T22:31:37.414492+0000","last_became_peered":"2024-09-12T22:31:37.414492+0000","last_unstale":"2024-09-12T22:35:47.683345+0000","last_undegraded":"2024-09-12T22:35:47.683345+0000","last_fullsized":"2024-09-12T22:35:47.683345+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'431","last_scrub_stamp":"2024-09-12T22:35:47.683226+0000","last_deep_scrub":"60'431","last_deep_scrub_stamp":"2024-09-12T22:35:47.683226+0000","last_clean_scrub_stamp":"2024-09-12T22:35:47.683226+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:14:15.439665+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":21479,"num_write":394,"num_write_kb":83756,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"60'70","reported_seq":215,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:36:07.915377+0000","last_change":"2024-09-12T22:36:07.915403+0000","last_active":"2024-09-12T22:36:07.915377+0000","last_peered":"2024-09-12T22:36:07.915377+0000","last_clean":"2024-09-12T22:36:07.915377+0000","last_became_active":"2024-09-12T22:31:36.411366+0000","last_became_peered":"2024-09-12T22:31:36.411366+0000","last_unstale":"2024-09-12T22:36:07.915377+0000","last_undegraded":"2024-09-12T22:36:07.915377+0000","last_fullsized":"2024-09-12T22:36:07.915377+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'70","last_scrub_stamp":"2024-09-12T22:36:07.915271+0000","last_deep_scrub":"60'70","last_deep_scrub_stamp":"2024-09-12T22:36:07.915271+0000","last_clean_scrub_stamp":"2024-09-12T22:36:07.915271+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:13:01.877613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"60'471","reported_seq":683,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:36:04.402093+0000","last_change":"2024-09-12T22:36:04.402093+0000","last_active":"2024-09-12T22:36:04.402093+0000","last_peered":"2024-09-12T22:36:04.402093+0000","last_clean":"2024-09-12T22:36:04.402093+0000","last_became_active":"2024-09-12T22:31:37.409607+0000","last_became_peered":"2024-09-12T22:31:37.409607+0000","last_unstale":"2024-09-12T22:36:04.402093+0000","last_undegraded":"2024-09-12T22:36:04.402093+0000","last_fullsized":"2024-09-12T22:36:04.402093+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'471","last_scrub_stamp":"2024-09-12T22:36:04.401975+0000","last_deep_scrub":"60'471","last_deep_scrub_stamp":"2024-09-12T22:36:04.401975+0000","last_clean_scrub_stamp":"2024-09-12T22:36:04.401975+0000","objects_scrubbed":0,"log_size":471,"log_dups_size":0,"ondisk_log_size":471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:16:47.649191+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":37922,"num_write":440,"num_write_kb":138112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"80'212","reported_seq":357,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:36:01.361497+0000","last_change":"2024-09-12T22:36:01.361497+0000","last_active":"2024-09-12T22:36:01.361497+0000","last_peered":"2024-09-12T22:36:01.361497+0000","last_clean":"2024-09-12T22:36:01.361497+0000","last_became_active":"2024-09-12T22:31:36.406955+0000","last_became_peered":"2024-09-12T22:31:36.406955+0000","last_unstale":"2024-09-12T22:36:01.361497+0000","last_undegraded":"2024-09-12T22:36:01.361497+0000","last_fullsized":"2024-09-12T22:36:01.361497+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'212","last_scrub_stamp":"2024-09-12T22:36:01.361389+0000","last_deep_scrub":"80'212","last_deep_scrub_stamp":"2024-09-12T22:36:01.361389+0000","last_clean_scrub_stamp":"2024-09-12T22:36:01.361389+0000","objects_scrubbed":3,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:27:35.464359+0000","scrub_duration":18,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":8267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"60'437","reported_seq":590,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:50.673545+0000","last_change":"2024-09-12T22:35:50.673545+0000","last_active":"2024-09-12T22:35:50.673545+0000","last_peered":"2024-09-12T22:35:50.673545+0000","last_clean":"2024-09-12T22:35:50.673545+0000","last_became_active":"2024-09-12T22:31:37.414890+0000","last_became_peered":"2024-09-12T22:31:37.414890+0000","last_unstale":"2024-09-12T22:35:50.673545+0000","last_undegraded":"2024-09-12T22:35:50.673545+0000","last_fullsized":"2024-09-12T22:35:50.673545+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'437","last_scrub_stamp":"2024-09-12T22:35:50.673415+0000","last_deep_scrub":"60'437","last_deep_scrub_stamp":"2024-09-12T22:35:50.673415+0000","last_clean_scrub_stamp":"2024-09-12T22:35:50.673415+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:32:48.287703+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":4587,"num_write":407,"num_write_kb":50860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"80'109","reported_seq":254,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:36:10.004020+0000","last_change":"2024-09-12T22:36:10.004051+0000","last_active":"2024-09-12T22:36:10.004020+0000","last_peered":"2024-09-12T22:36:10.004020+0000","last_clean":"2024-09-12T22:36:10.004020+0000","last_became_active":"2024-09-12T22:31:36.411382+0000","last_became_peered":"2024-09-12T22:31:36.411382+0000","last_unstale":"2024-09-12T22:36:10.004020+0000","last_undegraded":"2024-09-12T22:36:10.004020+0000","last_fullsized":"2024-09-12T22:36:10.004020+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'109","last_scrub_stamp":"2024-09-12T22:36:10.003929+0000","last_deep_scrub":"80'109","last_deep_scrub_stamp":"2024-09-12T22:36:10.003929+0000","last_clean_scrub_stamp":"2024-09-12T22:36:10.003929+0000","objects_scrubbed":1,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:30:20.329127+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":4129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"60'407","reported_seq":937,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:36:17.192186+0000","last_change":"2024-09-12T22:36:17.192214+0000","last_active":"2024-09-12T22:36:17.192186+0000","last_peered":"2024-09-12T22:36:17.192186+0000","last_clean":"2024-09-12T22:36:17.192186+0000","last_became_active":"2024-09-12T22:35:31.729817+0000","last_became_peered":"2024-09-12T22:35:31.729817+0000","last_unstale":"2024-09-12T22:36:17.192186+0000","last_undegraded":"2024-09-12T22:36:17.192186+0000","last_fullsized":"2024-09-12T22:36:17.192186+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'407","last_scrub_stamp":"2024-09-12T22:36:17.192097+0000","last_deep_scrub":"60'407","last_deep_scrub_stamp":"2024-09-12T22:36:17.192097+0000","last_clean_scrub_stamp":"2024-09-12T22:36:17.192097+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:45:16.312939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":5615,"num_write":375,"num_write_kb":50827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"60'57","reported_seq":56,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:58.108871+0000","last_change":"2024-09-12T22:35:58.108901+0000","last_active":"2024-09-12T22:35:58.108871+0000","last_peered":"2024-09-12T22:35:58.108871+0000","last_clean":"2024-09-12T22:35:58.108871+0000","last_became_active":"2024-09-12T22:35:20.733664+0000","last_became_peered":"2024-09-12T22:35:20.733664+0000","last_unstale":"2024-09-12T22:35:58.108871+0000","last_undegraded":"2024-09-12T22:35:58.108871+0000","last_fullsized":"2024-09-12T22:35:58.108871+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'57","last_scrub_stamp":"2024-09-12T22:35:58.108771+0000","last_deep_scrub":"60'57","last_deep_scrub_stamp":"2024-09-12T22:35:58.108771+0000","last_clean_scrub_stamp":"2024-09-12T22:35:58.108771+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:30:25.204368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"60'357","reported_seq":843,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:36:12.077821+0000","last_change":"2024-09-12T22:36:12.077848+0000","last_active":"2024-09-12T22:36:12.077821+0000","last_peered":"2024-09-12T22:36:12.077821+0000","last_clean":"2024-09-12T22:36:12.077821+0000","last_became_active":"2024-09-12T22:35:27.733274+0000","last_became_peered":"2024-09-12T22:35:27.733274+0000","last_unstale":"2024-09-12T22:36:12.077821+0000","last_undegraded":"2024-09-12T22:36:12.077821+0000","last_fullsized":"2024-09-12T22:36:12.077821+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'357","last_scrub_stamp":"2024-09-12T22:36:12.077724+0000","last_deep_scrub":"60'357","last_deep_scrub_stamp":"2024-09-12T22:36:12.077724+0000","last_clean_scrub_stamp":"2024-09-12T22:36:12.077724+0000","objects_scrubbed":0,"log_size":357,"log_dups_size":0,"ondisk_log_size":357,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:15:54.246000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":2460,"num_write":324,"num_write_kb":37873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"80'418","reported_seq":511,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:36:02.147058+0000","last_change":"2024-09-12T22:36:02.147114+0000","last_active":"2024-09-12T22:36:02.147058+0000","last_peered":"2024-09-12T22:36:02.147058+0000","last_clean":"2024-09-12T22:36:02.147058+0000","last_became_active":"2024-09-12T22:35:23.754683+0000","last_became_peered":"2024-09-12T22:35:23.754683+0000","last_unstale":"2024-09-12T22:36:02.147058+0000","last_undegraded":"2024-09-12T22:36:02.147058+0000","last_fullsized":"2024-09-12T22:36:02.147058+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'418","last_scrub_stamp":"2024-09-12T22:36:02.146931+0000","last_deep_scrub":"80'418","last_deep_scrub_stamp":"2024-09-12T22:36:02.146931+0000","last_clean_scrub_stamp":"2024-09-12T22:36:02.146931+0000","objects_scrubbed":1,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:12:43.222856+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":359,"num_write_kb":4251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"60'416","reported_seq":973,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:36:10.381460+0000","last_change":"2024-09-12T22:36:10.381488+0000","last_active":"2024-09-12T22:36:10.381460+0000","last_peered":"2024-09-12T22:36:10.381460+0000","last_clean":"2024-09-12T22:36:10.381460+0000","last_became_active":"2024-09-12T22:35:30.729912+0000","last_became_peered":"2024-09-12T22:35:30.729912+0000","last_unstale":"2024-09-12T22:36:10.381460+0000","last_undegraded":"2024-09-12T22:36:10.381460+0000","last_fullsized":"2024-09-12T22:36:10.381460+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'416","last_scrub_stamp":"2024-09-12T22:36:10.381367+0000","last_deep_scrub":"60'416","last_deep_scrub_stamp":"2024-09-12T22:36:10.381367+0000","last_clean_scrub_stamp":"2024-09-12T22:36:10.381367+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:09:52.259354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":42190,"num_write":377,"num_write_kb":87849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"80'159","reported_seq":364,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:45.649463+0000","last_change":"2024-09-12T22:35:45.649509+0000","last_active":"2024-09-12T22:35:45.649463+0000","last_peered":"2024-09-12T22:35:45.649463+0000","last_clean":"2024-09-12T22:35:45.649463+0000","last_became_active":"2024-09-12T22:35:20.736721+0000","last_became_peered":"2024-09-12T22:35:20.736721+0000","last_unstale":"2024-09-12T22:35:45.649463+0000","last_undegraded":"2024-09-12T22:35:45.649463+0000","last_fullsized":"2024-09-12T22:35:45.649463+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'159","last_scrub_stamp":"2024-09-12T22:35:45.649377+0000","last_deep_scrub":"80'159","last_deep_scrub_stamp":"2024-09-12T22:35:45.649377+0000","last_clean_scrub_stamp":"2024-09-12T22:35:45.649377+0000","objects_scrubbed":2,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:54:50.820256+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"80'2","reported_seq":160,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:36:03.859960+0000","last_change":"2024-09-12T22:36:03.860000+0000","last_active":"2024-09-12T22:36:03.859960+0000","last_peered":"2024-09-12T22:36:03.859960+0000","last_clean":"2024-09-12T22:36:03.859960+0000","last_became_active":"2024-09-12T22:31:32.283661+0000","last_became_peered":"2024-09-12T22:31:32.283661+0000","last_unstale":"2024-09-12T22:36:03.859960+0000","last_undegraded":"2024-09-12T22:36:03.859960+0000","last_fullsized":"2024-09-12T22:36:03.859960+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2","last_scrub_stamp":"2024-09-12T22:36:03.859839+0000","last_deep_scrub":"80'2","last_deep_scrub_stamp":"2024-09-12T22:36:03.859839+0000","last_clean_scrub_stamp":"2024-09-12T22:36:03.859839+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:13:19.150315+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.000621274,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"80'680","reported_seq":840,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:51.253978+0000","last_change":"2024-09-12T22:35:51.254012+0000","last_active":"2024-09-12T22:35:51.253978+0000","last_peered":"2024-09-12T22:35:51.253978+0000","last_clean":"2024-09-12T22:35:51.253978+0000","last_became_active":"2024-09-12T22:35:23.755652+0000","last_became_peered":"2024-09-12T22:35:23.755652+0000","last_unstale":"2024-09-12T22:35:51.253978+0000","last_undegraded":"2024-09-12T22:35:51.253978+0000","last_fullsized":"2024-09-12T22:35:51.253978+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'680","last_scrub_stamp":"2024-09-12T22:35:51.253878+0000","last_deep_scrub":"80'680","last_deep_scrub_stamp":"2024-09-12T22:35:51.253878+0000","last_clean_scrub_stamp":"2024-09-12T22:35:51.253878+0000","objects_scrubbed":2,"log_size":680,"log_dups_size":0,"ondisk_log_size":680,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:09:03.140393+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":608,"num_write_kb":8482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"60'426","reported_seq":986,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:36:18.191675+0000","last_change":"2024-09-12T22:36:18.191718+0000","last_active":"2024-09-12T22:36:18.191675+0000","last_peered":"2024-09-12T22:36:18.191675+0000","last_clean":"2024-09-12T22:36:18.191675+0000","last_became_active":"2024-09-12T22:35:31.730242+0000","last_became_peered":"2024-09-12T22:35:31.730242+0000","last_unstale":"2024-09-12T22:36:18.191675+0000","last_undegraded":"2024-09-12T22:36:18.191675+0000","last_fullsized":"2024-09-12T22:36:18.191675+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'426","last_scrub_stamp":"2024-09-12T22:36:18.191549+0000","last_deep_scrub":"60'426","last_deep_scrub_stamp":"2024-09-12T22:36:18.191549+0000","last_clean_scrub_stamp":"2024-09-12T22:36:18.191549+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:22:01.180407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":24636,"num_write":392,"num_write_kb":59176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":165,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:58.762400+0000","last_change":"2024-09-12T22:35:58.762443+0000","last_active":"2024-09-12T22:35:58.762400+0000","last_peered":"2024-09-12T22:35:58.762400+0000","last_clean":"2024-09-12T22:35:58.762400+0000","last_became_active":"2024-09-12T22:35:20.735545+0000","last_became_peered":"2024-09-12T22:35:20.735545+0000","last_unstale":"2024-09-12T22:35:58.762400+0000","last_undegraded":"2024-09-12T22:35:58.762400+0000","last_fullsized":"2024-09-12T22:35:58.762400+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:35:58.762297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:35:58.762297+0000","last_clean_scrub_stamp":"2024-09-12T22:35:58.762297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:51:26.381629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037858999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"80'107","reported_seq":295,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:57.223035+0000","last_change":"2024-09-12T22:35:57.223072+0000","last_active":"2024-09-12T22:35:57.223035+0000","last_peered":"2024-09-12T22:35:57.223035+0000","last_clean":"2024-09-12T22:35:57.223035+0000","last_became_active":"2024-09-12T22:31:36.406770+0000","last_became_peered":"2024-09-12T22:31:36.406770+0000","last_unstale":"2024-09-12T22:35:57.223035+0000","last_undegraded":"2024-09-12T22:35:57.223035+0000","last_fullsized":"2024-09-12T22:35:57.223035+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'107","last_scrub_stamp":"2024-09-12T22:35:57.222948+0000","last_deep_scrub":"80'107","last_deep_scrub_stamp":"2024-09-12T22:35:57.222948+0000","last_clean_scrub_stamp":"2024-09-12T22:35:57.222948+0000","objects_scrubbed":1,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:49:29.104800+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1467429,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":43,"num_read_kb":1462,"num_write":43,"num_write_kb":1462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"60'448","reported_seq":556,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:47.106736+0000","last_change":"2024-09-12T22:35:47.106764+0000","last_active":"2024-09-12T22:35:47.106736+0000","last_peered":"2024-09-12T22:35:47.106736+0000","last_clean":"2024-09-12T22:35:47.106736+0000","last_became_active":"2024-09-12T22:35:27.729522+0000","last_became_peered":"2024-09-12T22:35:27.729522+0000","last_unstale":"2024-09-12T22:35:47.106736+0000","last_undegraded":"2024-09-12T22:35:47.106736+0000","last_fullsized":"2024-09-12T22:35:47.106736+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'448","last_scrub_stamp":"2024-09-12T22:35:47.106643+0000","last_deep_scrub":"60'448","last_deep_scrub_stamp":"2024-09-12T22:35:47.106643+0000","last_clean_scrub_stamp":"2024-09-12T22:35:47.106643+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:54:12.406887+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":10436,"num_write":420,"num_write_kb":67816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":165,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:42.160892+0000","last_change":"2024-09-12T22:35:42.160892+0000","last_active":"2024-09-12T22:35:42.160892+0000","last_peered":"2024-09-12T22:35:42.160892+0000","last_clean":"2024-09-12T22:35:42.160892+0000","last_became_active":"2024-09-12T22:35:20.734643+0000","last_became_peered":"2024-09-12T22:35:20.734643+0000","last_unstale":"2024-09-12T22:35:42.160892+0000","last_undegraded":"2024-09-12T22:35:42.160892+0000","last_fullsized":"2024-09-12T22:35:42.160892+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:35:42.160772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:35:42.160772+0000","last_clean_scrub_stamp":"2024-09-12T22:35:42.160772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:47:29.886284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039540700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"80'294","reported_seq":415,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:40.037943+0000","last_change":"2024-09-12T22:35:40.038017+0000","last_active":"2024-09-12T22:35:40.037943+0000","last_peered":"2024-09-12T22:35:40.037943+0000","last_clean":"2024-09-12T22:35:40.037943+0000","last_became_active":"2024-09-12T22:35:33.760742+0000","last_became_peered":"2024-09-12T22:35:33.760742+0000","last_unstale":"2024-09-12T22:35:40.037943+0000","last_undegraded":"2024-09-12T22:35:40.037943+0000","last_fullsized":"2024-09-12T22:35:40.037943+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'294","last_scrub_stamp":"2024-09-12T22:35:40.037799+0000","last_deep_scrub":"80'294","last_deep_scrub_stamp":"2024-09-12T22:35:40.037799+0000","last_clean_scrub_stamp":"2024-09-12T22:35:40.037799+0000","objects_scrubbed":2,"log_size":294,"log_dups_size":0,"ondisk_log_size":294,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:30:06.166314+0000","scrub_duration":17,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":235,"num_write_kb":8293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"60'375","reported_seq":922,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:36:09.391491+0000","last_change":"2024-09-12T22:36:09.391516+0000","last_active":"2024-09-12T22:36:09.391491+0000","last_peered":"2024-09-12T22:36:09.391491+0000","last_clean":"2024-09-12T22:36:09.391491+0000","last_became_active":"2024-09-12T22:35:29.738755+0000","last_became_peered":"2024-09-12T22:35:29.738755+0000","last_unstale":"2024-09-12T22:36:09.391491+0000","last_undegraded":"2024-09-12T22:36:09.391491+0000","last_fullsized":"2024-09-12T22:36:09.391491+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'375","last_scrub_stamp":"2024-09-12T22:36:09.391398+0000","last_deep_scrub":"60'375","last_deep_scrub_stamp":"2024-09-12T22:36:09.391398+0000","last_clean_scrub_stamp":"2024-09-12T22:36:09.391398+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:16:29.060119+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":43566,"num_write":354,"num_write_kb":92229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":160,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"80'3","reported_seq":161,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:36:02.810216+0000","last_change":"2024-09-12T22:36:02.810270+0000","last_active":"2024-09-12T22:36:02.810216+0000","last_peered":"2024-09-12T22:36:02.810216+0000","last_clean":"2024-09-12T22:36:02.810216+0000","last_became_active":"2024-09-12T22:31:32.282230+0000","last_became_peered":"2024-09-12T22:31:32.282230+0000","last_unstale":"2024-09-12T22:36:02.810216+0000","last_undegraded":"2024-09-12T22:36:02.810216+0000","last_fullsized":"2024-09-12T22:36:02.810216+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'3","last_scrub_stamp":"2024-09-12T22:36:02.810108+0000","last_deep_scrub":"80'3","last_deep_scrub_stamp":"2024-09-12T22:36:02.810108+0000","last_clean_scrub_stamp":"2024-09-12T22:36:02.810108+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:08:50.989662+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.000615758,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"60'63","reported_seq":208,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:36:04.877645+0000","last_change":"2024-09-12T22:36:04.877674+0000","last_active":"2024-09-12T22:36:04.877645+0000","last_peered":"2024-09-12T22:36:04.877645+0000","last_clean":"2024-09-12T22:36:04.877645+0000","last_became_active":"2024-09-12T22:31:36.409816+0000","last_became_peered":"2024-09-12T22:31:36.409816+0000","last_unstale":"2024-09-12T22:36:04.877645+0000","last_undegraded":"2024-09-12T22:36:04.877645+0000","last_fullsized":"2024-09-12T22:36:04.877645+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'63","last_scrub_stamp":"2024-09-12T22:36:04.877535+0000","last_deep_scrub":"60'63","last_deep_scrub_stamp":"2024-09-12T22:36:04.877535+0000","last_clean_scrub_stamp":"2024-09-12T22:36:04.877535+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:06:23.085839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"60'405","reported_seq":939,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:36:08.411751+0000","last_change":"2024-09-12T22:36:08.411778+0000","last_active":"2024-09-12T22:36:08.411751+0000","last_peered":"2024-09-12T22:36:08.411751+0000","last_clean":"2024-09-12T22:36:08.411751+0000","last_became_active":"2024-09-12T22:35:29.735499+0000","last_became_peered":"2024-09-12T22:35:29.735499+0000","last_unstale":"2024-09-12T22:36:08.411751+0000","last_undegraded":"2024-09-12T22:36:08.411751+0000","last_fullsized":"2024-09-12T22:36:08.411751+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'405","last_scrub_stamp":"2024-09-12T22:36:08.411649+0000","last_deep_scrub":"60'405","last_deep_scrub_stamp":"2024-09-12T22:36:08.411649+0000","last_clean_scrub_stamp":"2024-09-12T22:36:08.411649+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:56:21.759170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":20152,"num_write":366,"num_write_kb":92447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"80'278","reported_seq":371,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:36:03.137779+0000","last_change":"2024-09-12T22:36:03.137854+0000","last_active":"2024-09-12T22:36:03.137779+0000","last_peered":"2024-09-12T22:36:03.137779+0000","last_clean":"2024-09-12T22:36:03.137779+0000","last_became_active":"2024-09-12T22:35:23.755237+0000","last_became_peered":"2024-09-12T22:35:23.755237+0000","last_unstale":"2024-09-12T22:36:03.137779+0000","last_undegraded":"2024-09-12T22:36:03.137779+0000","last_fullsized":"2024-09-12T22:36:03.137779+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'278","last_scrub_stamp":"2024-09-12T22:36:03.137687+0000","last_deep_scrub":"80'278","last_deep_scrub_stamp":"2024-09-12T22:36:03.137687+0000","last_clean_scrub_stamp":"2024-09-12T22:36:03.137687+0000","objects_scrubbed":1,"log_size":278,"log_dups_size":0,"ondisk_log_size":278,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:10:12.964476+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":216,"num_write_kb":4193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":165,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:41.149203+0000","last_change":"2024-09-12T22:35:41.149203+0000","last_active":"2024-09-12T22:35:41.149203+0000","last_peered":"2024-09-12T22:35:41.149203+0000","last_clean":"2024-09-12T22:35:41.149203+0000","last_became_active":"2024-09-12T22:35:20.736428+0000","last_became_peered":"2024-09-12T22:35:20.736428+0000","last_unstale":"2024-09-12T22:35:41.149203+0000","last_undegraded":"2024-09-12T22:35:41.149203+0000","last_fullsized":"2024-09-12T22:35:41.149203+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:35:41.149090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:35:41.149090+0000","last_clean_scrub_stamp":"2024-09-12T22:35:41.149090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:47:16.938339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041972500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"60'355","reported_seq":466,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:55.102250+0000","last_change":"2024-09-12T22:35:55.102278+0000","last_active":"2024-09-12T22:35:55.102250+0000","last_peered":"2024-09-12T22:35:55.102250+0000","last_clean":"2024-09-12T22:35:55.102250+0000","last_became_active":"2024-09-12T22:35:25.727299+0000","last_became_peered":"2024-09-12T22:35:25.727299+0000","last_unstale":"2024-09-12T22:35:55.102250+0000","last_undegraded":"2024-09-12T22:35:55.102250+0000","last_fullsized":"2024-09-12T22:35:55.102250+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'355","last_scrub_stamp":"2024-09-12T22:35:55.102155+0000","last_deep_scrub":"60'355","last_deep_scrub_stamp":"2024-09-12T22:35:55.102155+0000","last_clean_scrub_stamp":"2024-09-12T22:35:55.102155+0000","objects_scrubbed":0,"log_size":355,"log_dups_size":0,"ondisk_log_size":355,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:22:31.666894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13196,"num_write":321,"num_write_kb":41797,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":155,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"60'55","reported_seq":207,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:45.163041+0000","last_change":"2024-09-12T22:35:45.163041+0000","last_active":"2024-09-12T22:35:45.163041+0000","last_peered":"2024-09-12T22:35:45.163041+0000","last_clean":"2024-09-12T22:35:45.163041+0000","last_became_active":"2024-09-12T22:35:20.737705+0000","last_became_peered":"2024-09-12T22:35:20.737705+0000","last_unstale":"2024-09-12T22:35:45.163041+0000","last_undegraded":"2024-09-12T22:35:45.163041+0000","last_fullsized":"2024-09-12T22:35:45.163041+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'55","last_scrub_stamp":"2024-09-12T22:35:45.162870+0000","last_deep_scrub":"60'55","last_deep_scrub_stamp":"2024-09-12T22:35:45.162870+0000","last_clean_scrub_stamp":"2024-09-12T22:35:45.162870+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:58:31.877549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":77,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:36:00.131574+0000","last_change":"2024-09-12T22:36:00.131602+0000","last_active":"2024-09-12T22:36:00.131574+0000","last_peered":"2024-09-12T22:36:00.131574+0000","last_clean":"2024-09-12T22:36:00.131574+0000","last_became_active":"2024-09-12T22:35:20.737799+0000","last_became_peered":"2024-09-12T22:35:20.737799+0000","last_unstale":"2024-09-12T22:36:00.131574+0000","last_undegraded":"2024-09-12T22:36:00.131574+0000","last_fullsized":"2024-09-12T22:36:00.131574+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:36:00.131483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:36:00.131483+0000","last_clean_scrub_stamp":"2024-09-12T22:36:00.131483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:33:00.726981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"60'385","reported_seq":542,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:36:07.176673+0000","last_change":"2024-09-12T22:36:07.176701+0000","last_active":"2024-09-12T22:36:07.176673+0000","last_peered":"2024-09-12T22:36:07.176673+0000","last_clean":"2024-09-12T22:36:07.176673+0000","last_became_active":"2024-09-12T22:35:33.754546+0000","last_became_peered":"2024-09-12T22:35:33.754546+0000","last_unstale":"2024-09-12T22:36:07.176673+0000","last_undegraded":"2024-09-12T22:36:07.176673+0000","last_fullsized":"2024-09-12T22:36:07.176673+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'385","last_scrub_stamp":"2024-09-12T22:36:07.176574+0000","last_deep_scrub":"60'385","last_deep_scrub_stamp":"2024-09-12T22:36:07.176574+0000","last_clean_scrub_stamp":"2024-09-12T22:36:07.176574+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:39:04.487637+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":22437,"num_write":347,"num_write_kb":30121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"80'62","reported_seq":215,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:47.131052+0000","last_change":"2024-09-12T22:35:47.131052+0000","last_active":"2024-09-12T22:35:47.131052+0000","last_peered":"2024-09-12T22:35:47.131052+0000","last_clean":"2024-09-12T22:35:47.131052+0000","last_became_active":"2024-09-12T22:35:20.738129+0000","last_became_peered":"2024-09-12T22:35:20.738129+0000","last_unstale":"2024-09-12T22:35:47.131052+0000","last_undegraded":"2024-09-12T22:35:47.131052+0000","last_fullsized":"2024-09-12T22:35:47.131052+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'62","last_scrub_stamp":"2024-09-12T22:35:47.130895+0000","last_deep_scrub":"80'62","last_deep_scrub_stamp":"2024-09-12T22:35:47.130895+0000","last_clean_scrub_stamp":"2024-09-12T22:35:47.130895+0000","objects_scrubbed":1,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:43:10.950680+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":165,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:43.170600+0000","last_change":"2024-09-12T22:35:43.170600+0000","last_active":"2024-09-12T22:35:43.170600+0000","last_peered":"2024-09-12T22:35:43.170600+0000","last_clean":"2024-09-12T22:35:43.170600+0000","last_became_active":"2024-09-12T22:35:20.736628+0000","last_became_peered":"2024-09-12T22:35:20.736628+0000","last_unstale":"2024-09-12T22:35:43.170600+0000","last_undegraded":"2024-09-12T22:35:43.170600+0000","last_fullsized":"2024-09-12T22:35:43.170600+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:35:43.170448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:35:43.170448+0000","last_clean_scrub_stamp":"2024-09-12T22:35:43.170448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:28:09.526317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058589999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"60'402","reported_seq":563,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:54.246956+0000","last_change":"2024-09-12T22:35:54.246984+0000","last_active":"2024-09-12T22:35:54.246956+0000","last_peered":"2024-09-12T22:35:54.246956+0000","last_clean":"2024-09-12T22:35:54.246956+0000","last_became_active":"2024-09-12T22:31:37.410558+0000","last_became_peered":"2024-09-12T22:31:37.410558+0000","last_unstale":"2024-09-12T22:35:54.246956+0000","last_undegraded":"2024-09-12T22:35:54.246956+0000","last_fullsized":"2024-09-12T22:35:54.246956+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'402","last_scrub_stamp":"2024-09-12T22:35:54.246766+0000","last_deep_scrub":"60'402","last_deep_scrub_stamp":"2024-09-12T22:35:54.246766+0000","last_clean_scrub_stamp":"2024-09-12T22:35:54.246766+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:05:37.233132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":10169,"num_write":370,"num_write_kb":38130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"80'106","reported_seq":251,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:58.248310+0000","last_change":"2024-09-12T22:35:58.248310+0000","last_active":"2024-09-12T22:35:58.248310+0000","last_peered":"2024-09-12T22:35:58.248310+0000","last_clean":"2024-09-12T22:35:58.248310+0000","last_became_active":"2024-09-12T22:31:36.406729+0000","last_became_peered":"2024-09-12T22:31:36.406729+0000","last_unstale":"2024-09-12T22:35:58.248310+0000","last_undegraded":"2024-09-12T22:35:58.248310+0000","last_fullsized":"2024-09-12T22:35:58.248310+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'106","last_scrub_stamp":"2024-09-12T22:35:58.248136+0000","last_deep_scrub":"80'106","last_deep_scrub_stamp":"2024-09-12T22:35:58.248136+0000","last_clean_scrub_stamp":"2024-09-12T22:35:58.248136+0000","objects_scrubbed":1,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:47:40.016268+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103,"num_write_kb":1085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":165,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:36:00.787234+0000","last_change":"2024-09-12T22:36:00.787285+0000","last_active":"2024-09-12T22:36:00.787234+0000","last_peered":"2024-09-12T22:36:00.787234+0000","last_clean":"2024-09-12T22:36:00.787234+0000","last_became_active":"2024-09-12T22:35:20.736769+0000","last_became_peered":"2024-09-12T22:35:20.736769+0000","last_unstale":"2024-09-12T22:36:00.787234+0000","last_undegraded":"2024-09-12T22:36:00.787234+0000","last_fullsized":"2024-09-12T22:36:00.787234+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T22:36:00.787104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T22:36:00.787104+0000","last_clean_scrub_stamp":"2024-09-12T22:36:00.787104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:16:52.622022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000382109,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"60'412","reported_seq":559,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:53.080906+0000","last_change":"2024-09-12T22:35:53.080933+0000","last_active":"2024-09-12T22:35:53.080906+0000","last_peered":"2024-09-12T22:35:53.080906+0000","last_clean":"2024-09-12T22:35:53.080906+0000","last_became_active":"2024-09-12T22:35:26.732923+0000","last_became_peered":"2024-09-12T22:35:26.732923+0000","last_unstale":"2024-09-12T22:35:53.080906+0000","last_undegraded":"2024-09-12T22:35:53.080906+0000","last_fullsized":"2024-09-12T22:35:53.080906+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'412","last_scrub_stamp":"2024-09-12T22:35:53.080800+0000","last_deep_scrub":"60'412","last_deep_scrub_stamp":"2024-09-12T22:35:53.080800+0000","last_clean_scrub_stamp":"2024-09-12T22:35:53.080800+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:07:41.110097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":34504,"num_write":385,"num_write_kb":100438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"60'415","reported_seq":978,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:40.560589+0000","last_change":"2024-09-12T22:35:40.560589+0000","last_active":"2024-09-12T22:35:40.560589+0000","last_peered":"2024-09-12T22:35:40.560589+0000","last_clean":"2024-09-12T22:35:40.560589+0000","last_became_active":"2024-09-12T22:35:24.759441+0000","last_became_peered":"2024-09-12T22:35:24.759441+0000","last_unstale":"2024-09-12T22:35:40.560589+0000","last_undegraded":"2024-09-12T22:35:40.560589+0000","last_fullsized":"2024-09-12T22:35:40.560589+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'415","last_scrub_stamp":"2024-09-12T22:35:40.560400+0000","last_deep_scrub":"60'415","last_deep_scrub_stamp":"2024-09-12T22:35:40.560400+0000","last_clean_scrub_stamp":"2024-09-12T22:35:40.560400+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:38:43.470540+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":37207,"num_write":375,"num_write_kb":84660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"80'226","reported_seq":389,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:43.615871+0000","last_change":"2024-09-12T22:35:43.615871+0000","last_active":"2024-09-12T22:35:43.615871+0000","last_peered":"2024-09-12T22:35:43.615871+0000","last_clean":"2024-09-12T22:35:43.615871+0000","last_became_active":"2024-09-12T22:35:23.755918+0000","last_became_peered":"2024-09-12T22:35:23.755918+0000","last_unstale":"2024-09-12T22:35:43.615871+0000","last_undegraded":"2024-09-12T22:35:43.615871+0000","last_fullsized":"2024-09-12T22:35:43.615871+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'226","last_scrub_stamp":"2024-09-12T22:35:43.615755+0000","last_deep_scrub":"80'226","last_deep_scrub_stamp":"2024-09-12T22:35:43.615755+0000","last_clean_scrub_stamp":"2024-09-12T22:35:43.615755+0000","objects_scrubbed":5,"log_size":226,"log_dups_size":0,"ondisk_log_size":226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:21:37.577770+0000","scrub_duration":17,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":175,"num_write_kb":8282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":8382815,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"60'429","reported_seq":971,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:36:05.377888+0000","last_change":"2024-09-12T22:36:05.377888+0000","last_active":"2024-09-12T22:36:05.377888+0000","last_peered":"2024-09-12T22:36:05.377888+0000","last_clean":"2024-09-12T22:36:05.377888+0000","last_became_active":"2024-09-12T22:35:25.726837+0000","last_became_peered":"2024-09-12T22:35:25.726837+0000","last_unstale":"2024-09-12T22:36:05.377888+0000","last_undegraded":"2024-09-12T22:36:05.377888+0000","last_fullsized":"2024-09-12T22:36:05.377888+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'429","last_scrub_stamp":"2024-09-12T22:36:05.377757+0000","last_deep_scrub":"60'429","last_deep_scrub_stamp":"2024-09-12T22:36:05.377757+0000","last_clean_scrub_stamp":"2024-09-12T22:36:05.377757+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:55:23.938145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":12230,"num_write":389,"num_write_kb":71746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"80'100","reported_seq":228,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:56.131114+0000","last_change":"2024-09-12T22:35:56.131150+0000","last_active":"2024-09-12T22:35:56.131114+0000","last_peered":"2024-09-12T22:35:56.131114+0000","last_clean":"2024-09-12T22:35:56.131114+0000","last_became_active":"2024-09-12T22:35:33.758640+0000","last_became_peered":"2024-09-12T22:35:33.758640+0000","last_unstale":"2024-09-12T22:35:56.131114+0000","last_undegraded":"2024-09-12T22:35:56.131114+0000","last_fullsized":"2024-09-12T22:35:56.131114+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'100","last_scrub_stamp":"2024-09-12T22:35:56.131027+0000","last_deep_scrub":"80'100","last_deep_scrub_stamp":"2024-09-12T22:35:56.131027+0000","last_clean_scrub_stamp":"2024-09-12T22:35:56.131027+0000","objects_scrubbed":2,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:56:59.679732+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"80'215","reported_seq":360,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:36:05.865791+0000","last_change":"2024-09-12T22:36:05.865791+0000","last_active":"2024-09-12T22:36:05.865791+0000","last_peered":"2024-09-12T22:36:05.865791+0000","last_clean":"2024-09-12T22:36:05.865791+0000","last_became_active":"2024-09-12T22:31:36.410674+0000","last_became_peered":"2024-09-12T22:31:36.410674+0000","last_unstale":"2024-09-12T22:36:05.865791+0000","last_undegraded":"2024-09-12T22:36:05.865791+0000","last_fullsized":"2024-09-12T22:36:05.865791+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'215","last_scrub_stamp":"2024-09-12T22:36:05.865618+0000","last_deep_scrub":"80'215","last_deep_scrub_stamp":"2024-09-12T22:36:05.865618+0000","last_clean_scrub_stamp":"2024-09-12T22:36:05.865618+0000","objects_scrubbed":1,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:02:16.567469+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":151,"num_write_kb":4168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"60'460","reported_seq":632,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:48.178638+0000","last_change":"2024-09-12T22:35:48.178638+0000","last_active":"2024-09-12T22:35:48.178638+0000","last_peered":"2024-09-12T22:35:48.178638+0000","last_clean":"2024-09-12T22:35:48.178638+0000","last_became_active":"2024-09-12T22:31:37.410404+0000","last_became_peered":"2024-09-12T22:31:37.410404+0000","last_unstale":"2024-09-12T22:35:48.178638+0000","last_undegraded":"2024-09-12T22:35:48.178638+0000","last_fullsized":"2024-09-12T22:35:48.178638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'460","last_scrub_stamp":"2024-09-12T22:35:48.178488+0000","last_deep_scrub":"60'460","last_deep_scrub_stamp":"2024-09-12T22:35:48.178488+0000","last_clean_scrub_stamp":"2024-09-12T22:35:48.178488+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:51:08.618621+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":15059,"num_write":431,"num_write_kb":59615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"60'52","reported_seq":197,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:36:02.353037+0000","last_change":"2024-09-12T22:36:02.353037+0000","last_active":"2024-09-12T22:36:02.353037+0000","last_peered":"2024-09-12T22:36:02.353037+0000","last_clean":"2024-09-12T22:36:02.353037+0000","last_became_active":"2024-09-12T22:31:36.407062+0000","last_became_peered":"2024-09-12T22:31:36.407062+0000","last_unstale":"2024-09-12T22:36:02.353037+0000","last_undegraded":"2024-09-12T22:36:02.353037+0000","last_fullsized":"2024-09-12T22:36:02.353037+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'52","last_scrub_stamp":"2024-09-12T22:36:02.352916+0000","last_deep_scrub":"60'52","last_deep_scrub_stamp":"2024-09-12T22:36:02.352916+0000","last_clean_scrub_stamp":"2024-09-12T22:36:02.352916+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:15:24.918087+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"60'461","reported_seq":1035,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:36:06.409638+0000","last_change":"2024-09-12T22:36:06.409638+0000","last_active":"2024-09-12T22:36:06.409638+0000","last_peered":"2024-09-12T22:36:06.409638+0000","last_clean":"2024-09-12T22:36:06.409638+0000","last_became_active":"2024-09-12T22:35:28.730402+0000","last_became_peered":"2024-09-12T22:35:28.730402+0000","last_unstale":"2024-09-12T22:36:06.409638+0000","last_undegraded":"2024-09-12T22:36:06.409638+0000","last_fullsized":"2024-09-12T22:36:06.409638+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'461","last_scrub_stamp":"2024-09-12T22:36:06.409520+0000","last_deep_scrub":"60'461","last_deep_scrub_stamp":"2024-09-12T22:36:06.409520+0000","last_clean_scrub_stamp":"2024-09-12T22:36:06.409520+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:43:03.168620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":17508,"num_write":431,"num_write_kb":67883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":200,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"60'355","reported_seq":488,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:43.066248+0000","last_change":"2024-09-12T22:35:43.066272+0000","last_active":"2024-09-12T22:35:43.066248+0000","last_peered":"2024-09-12T22:35:43.066248+0000","last_clean":"2024-09-12T22:35:43.066248+0000","last_became_active":"2024-09-12T22:35:28.730931+0000","last_became_peered":"2024-09-12T22:35:28.730931+0000","last_unstale":"2024-09-12T22:35:43.066248+0000","last_undegraded":"2024-09-12T22:35:43.066248+0000","last_fullsized":"2024-09-12T22:35:43.066248+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'355","last_scrub_stamp":"2024-09-12T22:35:43.066163+0000","last_deep_scrub":"60'355","last_deep_scrub_stamp":"2024-09-12T22:35:43.066163+0000","last_clean_scrub_stamp":"2024-09-12T22:35:43.066163+0000","objects_scrubbed":0,"log_size":355,"log_dups_size":0,"ondisk_log_size":355,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:10:10.050148+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":44561,"num_write":329,"num_write_kb":26431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"80'550","reported_seq":710,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:53.230003+0000","last_change":"2024-09-12T22:35:53.230003+0000","last_active":"2024-09-12T22:35:53.230003+0000","last_peered":"2024-09-12T22:35:53.230003+0000","last_clean":"2024-09-12T22:35:53.230003+0000","last_became_active":"2024-09-12T22:35:23.755812+0000","last_became_peered":"2024-09-12T22:35:23.755812+0000","last_unstale":"2024-09-12T22:35:53.230003+0000","last_undegraded":"2024-09-12T22:35:53.230003+0000","last_fullsized":"2024-09-12T22:35:53.230003+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'550","last_scrub_stamp":"2024-09-12T22:35:53.229883+0000","last_deep_scrub":"80'550","last_deep_scrub_stamp":"2024-09-12T22:35:53.229883+0000","last_clean_scrub_stamp":"2024-09-12T22:35:53.229883+0000","objects_scrubbed":2,"log_size":550,"log_dups_size":0,"ondisk_log_size":550,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:00:59.857643+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":488,"num_write_kb":8420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"60'422","reported_seq":677,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:52.206636+0000","last_change":"2024-09-12T22:35:52.206697+0000","last_active":"2024-09-12T22:35:52.206636+0000","last_peered":"2024-09-12T22:35:52.206636+0000","last_clean":"2024-09-12T22:35:52.206636+0000","last_became_active":"2024-09-12T22:31:37.409796+0000","last_became_peered":"2024-09-12T22:31:37.409796+0000","last_unstale":"2024-09-12T22:35:52.206636+0000","last_undegraded":"2024-09-12T22:35:52.206636+0000","last_fullsized":"2024-09-12T22:35:52.206636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'422","last_scrub_stamp":"2024-09-12T22:35:52.206509+0000","last_deep_scrub":"60'422","last_deep_scrub_stamp":"2024-09-12T22:35:52.206509+0000","last_clean_scrub_stamp":"2024-09-12T22:35:52.206509+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:14:27.519681+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":51020,"num_write":397,"num_write_kb":73116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"80'181","reported_seq":326,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:59.288682+0000","last_change":"2024-09-12T22:35:59.288682+0000","last_active":"2024-09-12T22:35:59.288682+0000","last_peered":"2024-09-12T22:35:59.288682+0000","last_clean":"2024-09-12T22:35:59.288682+0000","last_became_active":"2024-09-12T22:31:36.406681+0000","last_became_peered":"2024-09-12T22:31:36.406681+0000","last_unstale":"2024-09-12T22:35:59.288682+0000","last_undegraded":"2024-09-12T22:35:59.288682+0000","last_fullsized":"2024-09-12T22:35:59.288682+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'181","last_scrub_stamp":"2024-09-12T22:35:59.288563+0000","last_deep_scrub":"80'181","last_deep_scrub_stamp":"2024-09-12T22:35:59.288563+0000","last_clean_scrub_stamp":"2024-09-12T22:35:59.288563+0000","objects_scrubbed":1,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:18:46.826462+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":134,"num_write_kb":4167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"60'420","reported_seq":554,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:46.075092+0000","last_change":"2024-09-12T22:35:46.075123+0000","last_active":"2024-09-12T22:35:46.075092+0000","last_peered":"2024-09-12T22:35:46.075092+0000","last_clean":"2024-09-12T22:35:46.075092+0000","last_became_active":"2024-09-12T22:35:30.733182+0000","last_became_peered":"2024-09-12T22:35:30.733182+0000","last_unstale":"2024-09-12T22:35:46.075092+0000","last_undegraded":"2024-09-12T22:35:46.075092+0000","last_fullsized":"2024-09-12T22:35:46.075092+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'420","last_scrub_stamp":"2024-09-12T22:35:46.074989+0000","last_deep_scrub":"60'420","last_deep_scrub_stamp":"2024-09-12T22:35:46.074989+0000","last_clean_scrub_stamp":"2024-09-12T22:35:46.074989+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:56.187326+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":24901,"num_write":369,"num_write_kb":75198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"80'215","reported_seq":336,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:50.096276+0000","last_change":"2024-09-12T22:35:50.096311+0000","last_active":"2024-09-12T22:35:50.096276+0000","last_peered":"2024-09-12T22:35:50.096276+0000","last_clean":"2024-09-12T22:35:50.096276+0000","last_became_active":"2024-09-12T22:35:33.754931+0000","last_became_peered":"2024-09-12T22:35:33.754931+0000","last_unstale":"2024-09-12T22:35:50.096276+0000","last_undegraded":"2024-09-12T22:35:50.096276+0000","last_fullsized":"2024-09-12T22:35:50.096276+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'215","last_scrub_stamp":"2024-09-12T22:35:50.096191+0000","last_deep_scrub":"80'215","last_deep_scrub_stamp":"2024-09-12T22:35:50.096191+0000","last_clean_scrub_stamp":"2024-09-12T22:35:50.096191+0000","objects_scrubbed":3,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:33:18.847054+0000","scrub_duration":26,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12553847,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":12334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"60'398","reported_seq":548,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:36:09.217428+0000","last_change":"2024-09-12T22:36:09.217456+0000","last_active":"2024-09-12T22:36:09.217428+0000","last_peered":"2024-09-12T22:36:09.217428+0000","last_clean":"2024-09-12T22:36:09.217428+0000","last_became_active":"2024-09-12T22:35:33.755497+0000","last_became_peered":"2024-09-12T22:35:33.755497+0000","last_unstale":"2024-09-12T22:36:09.217428+0000","last_undegraded":"2024-09-12T22:36:09.217428+0000","last_fullsized":"2024-09-12T22:36:09.217428+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'398","last_scrub_stamp":"2024-09-12T22:36:09.217343+0000","last_deep_scrub":"60'398","last_deep_scrub_stamp":"2024-09-12T22:36:09.217343+0000","last_clean_scrub_stamp":"2024-09-12T22:36:09.217343+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:30:43.483081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":11429,"num_write":361,"num_write_kb":88082,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"80'55","reported_seq":65,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:36:01.096500+0000","last_change":"2024-09-12T22:36:01.096548+0000","last_active":"2024-09-12T22:36:01.096500+0000","last_peered":"2024-09-12T22:36:01.096500+0000","last_clean":"2024-09-12T22:36:01.096500+0000","last_became_active":"2024-09-12T22:35:20.733271+0000","last_became_peered":"2024-09-12T22:35:20.733271+0000","last_unstale":"2024-09-12T22:36:01.096500+0000","last_undegraded":"2024-09-12T22:36:01.096500+0000","last_fullsized":"2024-09-12T22:36:01.096500+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'55","last_scrub_stamp":"2024-09-12T22:36:01.096385+0000","last_deep_scrub":"80'55","last_deep_scrub_stamp":"2024-09-12T22:36:01.096385+0000","last_clean_scrub_stamp":"2024-09-12T22:36:01.096385+0000","objects_scrubbed":1,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:33:03.657662+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"60'359","reported_seq":521,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:52.680398+0000","last_change":"2024-09-12T22:35:52.680424+0000","last_active":"2024-09-12T22:35:52.680398+0000","last_peered":"2024-09-12T22:35:52.680398+0000","last_clean":"2024-09-12T22:35:52.680398+0000","last_became_active":"2024-09-12T22:31:37.413933+0000","last_became_peered":"2024-09-12T22:31:37.413933+0000","last_unstale":"2024-09-12T22:35:52.680398+0000","last_undegraded":"2024-09-12T22:35:52.680398+0000","last_fullsized":"2024-09-12T22:35:52.680398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'359","last_scrub_stamp":"2024-09-12T22:35:52.680287+0000","last_deep_scrub":"60'359","last_deep_scrub_stamp":"2024-09-12T22:35:52.680287+0000","last_clean_scrub_stamp":"2024-09-12T22:35:52.680287+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:42:43.940274+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":12324,"num_write":332,"num_write_kb":46371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"80'188","reported_seq":333,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:36:06.889789+0000","last_change":"2024-09-12T22:36:06.889789+0000","last_active":"2024-09-12T22:36:06.889789+0000","last_peered":"2024-09-12T22:36:06.889789+0000","last_clean":"2024-09-12T22:36:06.889789+0000","last_became_active":"2024-09-12T22:31:36.410182+0000","last_became_peered":"2024-09-12T22:31:36.410182+0000","last_unstale":"2024-09-12T22:36:06.889789+0000","last_undegraded":"2024-09-12T22:36:06.889789+0000","last_fullsized":"2024-09-12T22:36:06.889789+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'188","last_scrub_stamp":"2024-09-12T22:36:06.889614+0000","last_deep_scrub":"80'188","last_deep_scrub_stamp":"2024-09-12T22:36:06.889614+0000","last_clean_scrub_stamp":"2024-09-12T22:36:06.889614+0000","objects_scrubbed":2,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:22:36.046828+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":4160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"60'401","reported_seq":579,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:46.684410+0000","last_change":"2024-09-12T22:35:46.684439+0000","last_active":"2024-09-12T22:35:46.684410+0000","last_peered":"2024-09-12T22:35:46.684410+0000","last_clean":"2024-09-12T22:35:46.684410+0000","last_became_active":"2024-09-12T22:31:37.414776+0000","last_became_peered":"2024-09-12T22:31:37.414776+0000","last_unstale":"2024-09-12T22:35:46.684410+0000","last_undegraded":"2024-09-12T22:35:46.684410+0000","last_fullsized":"2024-09-12T22:35:46.684410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'401","last_scrub_stamp":"2024-09-12T22:35:46.684315+0000","last_deep_scrub":"60'401","last_deep_scrub_stamp":"2024-09-12T22:35:46.684315+0000","last_clean_scrub_stamp":"2024-09-12T22:35:46.684315+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:23:36.280912+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":24207,"num_write":361,"num_write_kb":50515,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"80'248","reported_seq":378,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:52.060187+0000","last_change":"2024-09-12T22:35:52.060226+0000","last_active":"2024-09-12T22:35:52.060187+0000","last_peered":"2024-09-12T22:35:52.060187+0000","last_clean":"2024-09-12T22:35:52.060187+0000","last_became_active":"2024-09-12T22:35:33.757550+0000","last_became_peered":"2024-09-12T22:35:33.757550+0000","last_unstale":"2024-09-12T22:35:52.060187+0000","last_undegraded":"2024-09-12T22:35:52.060187+0000","last_fullsized":"2024-09-12T22:35:52.060187+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'248","last_scrub_stamp":"2024-09-12T22:35:52.060095+0000","last_deep_scrub":"80'248","last_deep_scrub_stamp":"2024-09-12T22:35:52.060095+0000","last_clean_scrub_stamp":"2024-09-12T22:35:52.060095+0000","objects_scrubbed":4,"log_size":248,"log_dups_size":0,"ondisk_log_size":248,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:08:43.710152+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":12389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"60'439","reported_seq":936,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:44.642559+0000","last_change":"2024-09-12T22:35:44.642586+0000","last_active":"2024-09-12T22:35:44.642559+0000","last_peered":"2024-09-12T22:35:44.642559+0000","last_clean":"2024-09-12T22:35:44.642559+0000","last_became_active":"2024-09-12T22:35:27.729827+0000","last_became_peered":"2024-09-12T22:35:27.729827+0000","last_unstale":"2024-09-12T22:35:44.642559+0000","last_undegraded":"2024-09-12T22:35:44.642559+0000","last_fullsized":"2024-09-12T22:35:44.642559+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'439","last_scrub_stamp":"2024-09-12T22:35:44.642475+0000","last_deep_scrub":"60'439","last_deep_scrub_stamp":"2024-09-12T22:35:44.642475+0000","last_clean_scrub_stamp":"2024-09-12T22:35:44.642475+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:34:56.761822+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":6311,"num_write":403,"num_write_kb":64161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"80'52","reported_seq":209,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:49.201592+0000","last_change":"2024-09-12T22:35:49.201638+0000","last_active":"2024-09-12T22:35:49.201592+0000","last_peered":"2024-09-12T22:35:49.201592+0000","last_clean":"2024-09-12T22:35:49.201592+0000","last_became_active":"2024-09-12T22:35:20.737444+0000","last_became_peered":"2024-09-12T22:35:20.737444+0000","last_unstale":"2024-09-12T22:35:49.201592+0000","last_undegraded":"2024-09-12T22:35:49.201592+0000","last_fullsized":"2024-09-12T22:35:49.201592+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'52","last_scrub_stamp":"2024-09-12T22:35:49.201490+0000","last_deep_scrub":"80'52","last_deep_scrub_stamp":"2024-09-12T22:35:49.201490+0000","last_clean_scrub_stamp":"2024-09-12T22:35:49.201490+0000","objects_scrubbed":1,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:51:42.104127+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"60'438","reported_seq":634,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:35:54.672211+0000","last_change":"2024-09-12T22:35:54.672211+0000","last_active":"2024-09-12T22:35:54.672211+0000","last_peered":"2024-09-12T22:35:54.672211+0000","last_clean":"2024-09-12T22:35:54.672211+0000","last_became_active":"2024-09-12T22:31:37.414781+0000","last_became_peered":"2024-09-12T22:31:37.414781+0000","last_unstale":"2024-09-12T22:35:54.672211+0000","last_undegraded":"2024-09-12T22:35:54.672211+0000","last_fullsized":"2024-09-12T22:35:54.672211+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'438","last_scrub_stamp":"2024-09-12T22:35:54.672094+0000","last_deep_scrub":"60'438","last_deep_scrub_stamp":"2024-09-12T22:35:54.672094+0000","last_clean_scrub_stamp":"2024-09-12T22:35:54.672094+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:37:17.072941+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":29290,"num_write":407,"num_write_kb":46733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"80'114","reported_seq":259,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T22:36:00.320012+0000","last_change":"2024-09-12T22:36:00.320048+0000","last_active":"2024-09-12T22:36:00.320012+0000","last_peered":"2024-09-12T22:36:00.320012+0000","last_clean":"2024-09-12T22:36:00.320012+0000","last_became_active":"2024-09-12T22:31:36.406959+0000","last_became_peered":"2024-09-12T22:31:36.406959+0000","last_unstale":"2024-09-12T22:36:00.320012+0000","last_undegraded":"2024-09-12T22:36:00.320012+0000","last_fullsized":"2024-09-12T22:36:00.320012+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'114","last_scrub_stamp":"2024-09-12T22:36:00.319924+0000","last_deep_scrub":"80'114","last_deep_scrub_stamp":"2024-09-12T22:36:00.319924+0000","last_clean_scrub_stamp":"2024-09-12T22:36:00.319924+0000","objects_scrubbed":3,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:04:20.373200+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61,"num_write_kb":4126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2747,"num_read_kb":1535780,"num_write":24498,"num_write_kb":4269351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5680,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26636,"ondisk_log_size":26636,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":127268954,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":43,"num_read_kb":1462,"num_write":4457,"num_write_kb":127482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":54520159,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":254603264,"data_stored":254537908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4442,"internal_metadata":0},"log_size":6315,"ondisk_log_size":6315,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705731,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":174080,"kb_used_data":84656,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94197760,"statfs":{"total":96636764160,"available":96458506240,"internally_reserved":0,"allocated":86687744,"data_stored":86276944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":66,"seq":283467841554,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":145344,"kb_used_data":87280,"kb_used_omap":5,"kb_used_meta":58042,"kb_avail":94226496,"statfs":{"total":96636764160,"available":96487931904,"internally_reserved":0,"allocated":89374720,"data_stored":88974119,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6037,"internal_metadata":59435115},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738436,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":173516,"kb_used_data":79932,"kb_used_omap":1,"kb_used_meta":93566,"kb_avail":94198324,"statfs":{"total":96636764160,"available":96459083776,"internally_reserved":0,"allocated":81850368,"data_stored":81462353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":95812037},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":88076288,"data_stored":88052173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4442,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81141760,"data_stored":81130756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":85385216,"data_stored":85354979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T22:36:41.332 DEBUG:teuthology.orchestra.run.smithi019:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-12T22:36:41.672 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-12T22:36:41.672 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T22:36:41.996 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:36:41.996 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":5,"btime":"2024-09-12T22:31:39:408658+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T22:31:36.753879+0000","modified":"2024-09-12T22:31:38.748818+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4239},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4239":{"gid":4239,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":2,"addr":"172.21.15.19:6803/1589279329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":1589279329},{"type":"v1","addr":"172.21.15.19:6803","nonce":1589279329}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4239,"qdb_cluster":[4239]},"id":1}]} 2024-09-12T22:36:41.996 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 5 2024-09-12T22:36:42.009 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T22:36:42.336 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:36:42.336 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":5,"btime":"2024-09-12T22:31:39:408658+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T22:31:36.753879+0000","modified":"2024-09-12T22:31:38.748818+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4239},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4239":{"gid":4239,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":2,"addr":"172.21.15.19:6803/1589279329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":1589279329},{"type":"v1","addr":"172.21.15.19:6803","nonce":1589279329}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4239,"qdb_cluster":[4239]},"id":1}]} 2024-09-12T22:36:42.336 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 5 2024-09-12T22:36:42.349 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T22:36:42.641 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T22:36:42.641 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":80,"fsid":"957ce235-19cb-4350-8fee-febd6e3f2199","created":"2024-09-12T22:31:15.903133+0000","modified":"2024-09-12T22:35:33.748166+0000","last_up_change":"2024-09-12T22:35:19.733135+0000","last_in_change":"2024-09-12T22:31:16.757598+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T22:31:26.228956+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T22:31:30.975989+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":16,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-12T22:31:35.267679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-12T22:31:35.724475+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.0800000429153442,"score_stable":1.0800000429153442,"optimal_score":1,"raw_score_acting":1.0800000429153442,"raw_score_stable":1.0800000429153442,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73b96314-15d5-4058-9993-ac103e997b27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":42,"up_from":66,"up_thru":79,"down_at":43,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6800","nonce":1671177249},{"type":"v1","addr":"172.21.15.76:6801","nonce":1671177249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6802","nonce":1671177249},{"type":"v1","addr":"172.21.15.76:6803","nonce":1671177249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6806","nonce":1671177249},{"type":"v1","addr":"172.21.15.76:6807","nonce":1671177249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6804","nonce":1671177249},{"type":"v1","addr":"172.21.15.76:6805","nonce":1671177249}]},"public_addr":"172.21.15.76:6801/1671177249","cluster_addr":"172.21.15.76:6803/1671177249","heartbeat_back_addr":"172.21.15.76:6807/1671177249","heartbeat_front_addr":"172.21.15.76:6805/1671177249","state":["exists","up"]},{"osd":1,"uuid":"f82ad621-e9cf-41cb-b9c0-43470cf7ddb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":616952176},{"type":"v1","addr":"172.21.15.148:6801","nonce":616952176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":616952176},{"type":"v1","addr":"172.21.15.148:6803","nonce":616952176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":616952176},{"type":"v1","addr":"172.21.15.148:6807","nonce":616952176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":616952176},{"type":"v1","addr":"172.21.15.148:6805","nonce":616952176}]},"public_addr":"172.21.15.148:6801/616952176","cluster_addr":"172.21.15.148:6803/616952176","heartbeat_back_addr":"172.21.15.148:6807/616952176","heartbeat_front_addr":"172.21.15.148:6805/616952176","state":["exists","up"]},{"osd":2,"uuid":"f30dda36-a84c-4a01-a81a-afbfb88c0aed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":533442754},{"type":"v1","addr":"172.21.15.163:6801","nonce":533442754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":533442754},{"type":"v1","addr":"172.21.15.163:6803","nonce":533442754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":533442754},{"type":"v1","addr":"172.21.15.163:6807","nonce":533442754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":533442754},{"type":"v1","addr":"172.21.15.163:6805","nonce":533442754}]},"public_addr":"172.21.15.163:6801/533442754","cluster_addr":"172.21.15.163:6803/533442754","heartbeat_back_addr":"172.21.15.163:6807/533442754","heartbeat_front_addr":"172.21.15.163:6805/533442754","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T22:31:23.899591+0000","dead_epoch":42},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T22:31:22.988274+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T22:31:23.932109+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"3.5","osds":[0,1]},{"pgid":"4.19","osds":[2,0]}],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T22:36:42.654 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-12T22:36:42.986 INFO:teuthology.orchestra.run.smithi019.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-12T22:36:43.001 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-12T22:36:43.026 INFO:tasks.ceph.mds.a.smithi019.stdout:starting mds.a at 2024-09-12T22:36:44.005 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-12T22:36:44.992 INFO:teuthology.orchestra.run.smithi019.stderr:pool 'cephfs_metadata' removed 2024-09-12T22:36:45.009 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-12T22:36:46.002 INFO:teuthology.orchestra.run.smithi019.stderr:pool 'cephfs_data' removed 2024-09-12T22:36:46.016 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-12T22:36:46.016 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-12T22:36:46.017 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T22:36:46.026 INFO:tasks.ceph.mds.a:Stopped 2024-09-12T22:36:46.026 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-12T22:36:46.027 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-12T22:36:46.027 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T22:36:46.065 INFO:tasks.ceph.osd.0:Stopped 2024-09-12T22:36:46.065 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-12T22:36:46.065 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T22:36:46.109 INFO:tasks.ceph.osd.1:Stopped 2024-09-12T22:36:46.109 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-12T22:36:46.110 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T22:36:46.153 INFO:tasks.ceph.osd.2:Stopped 2024-09-12T22:36:46.153 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-12T22:36:46.153 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-12T22:36:46.153 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T22:36:46.180 INFO:tasks.ceph.mgr.x:Stopped 2024-09-12T22:36:46.180 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-12T22:36:46.181 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T22:36:46.248 INFO:tasks.ceph.mgr.y:Stopped 2024-09-12T22:36:46.249 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-12T22:36:46.249 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-12T22:36:46.249 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T22:36:46.250 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~0s 2024-09-12T22:36:46.302 INFO:tasks.ceph.mon.a:Stopped 2024-09-12T22:36:46.302 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-12T22:36:46.302 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T22:36:46.354 INFO:tasks.ceph.mon.b:Stopped 2024-09-12T22:36:46.354 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-12T22:36:46.354 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T22:36:46.406 INFO:tasks.ceph.mon.c:Stopped 2024-09-12T22:36:46.407 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-12T22:36:46.407 DEBUG:teuthology.orchestra.run.smithi019:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(MDS_TRIM\)' | egrep -v '\(MDS_SLOW_REQUEST\)' | egrep -v MDS_SLOW_METADATA_IO | egrep -v 'Behind on trimming' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | egrep -v MON_DOWN | egrep -v OSDMAP_FLAGS | egrep -v OSD_DOWN | egrep -v PG_DEGRADED | egrep -v PG_AVAILABILITY | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'mons down' | egrep -v 'mon down' | egrep -v 'out of quorum' | egrep -v noscrub | egrep -v nodeep-scrub | head -n 1 2024-09-12T22:36:46.506 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi076.front.sepia.ceph.com 2024-09-12T22:36:46.506 DEBUG:teuthology.orchestra.run.smithi076:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-12T22:36:46.586 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi148.front.sepia.ceph.com 2024-09-12T22:36:46.586 DEBUG:teuthology.orchestra.run.smithi148:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-12T22:36:46.802 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi163.front.sepia.ceph.com 2024-09-12T22:36:46.803 DEBUG:teuthology.orchestra.run.smithi163:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-12T22:36:46.931 INFO:tasks.ceph:Archiving mon data... 2024-09-12T22:36:46.932 DEBUG:teuthology.misc:Transferring archived files from smithi019:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-09-12_21:32:03-powercycle-squid-distro-default-smithi/7902933/data/mon.a.tgz 2024-09-12T22:36:46.932 DEBUG:teuthology.orchestra.run.smithi019:> mktemp 2024-09-12T22:36:46.950 INFO:teuthology.orchestra.run.smithi019.stdout:/tmp/tmp.gO40x0jtL8 2024-09-12T22:36:46.950 DEBUG:teuthology.orchestra.run.smithi019:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.gO40x0jtL8 2024-09-12T22:36:47.092 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 0666 /tmp/tmp.gO40x0jtL8 2024-09-12T22:36:47.177 DEBUG:teuthology.orchestra.remote:smithi019:/tmp/tmp.gO40x0jtL8 is 367KB 2024-09-12T22:36:47.246 DEBUG:teuthology.orchestra.run.smithi019:> rm -fr /tmp/tmp.gO40x0jtL8 2024-09-12T22:36:47.261 DEBUG:teuthology.misc:Transferring archived files from smithi019:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-09-12_21:32:03-powercycle-squid-distro-default-smithi/7902933/data/mon.b.tgz 2024-09-12T22:36:47.261 DEBUG:teuthology.orchestra.run.smithi019:> mktemp 2024-09-12T22:36:47.316 INFO:teuthology.orchestra.run.smithi019.stdout:/tmp/tmp.hbWYH7sjiS 2024-09-12T22:36:47.317 DEBUG:teuthology.orchestra.run.smithi019:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.hbWYH7sjiS 2024-09-12T22:36:47.486 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 0666 /tmp/tmp.hbWYH7sjiS 2024-09-12T22:36:47.571 DEBUG:teuthology.orchestra.remote:smithi019:/tmp/tmp.hbWYH7sjiS is 512KB 2024-09-12T22:36:47.670 DEBUG:teuthology.orchestra.run.smithi019:> rm -fr /tmp/tmp.hbWYH7sjiS 2024-09-12T22:36:47.686 DEBUG:teuthology.misc:Transferring archived files from smithi019:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-09-12_21:32:03-powercycle-squid-distro-default-smithi/7902933/data/mon.c.tgz 2024-09-12T22:36:47.686 DEBUG:teuthology.orchestra.run.smithi019:> mktemp 2024-09-12T22:36:47.740 INFO:teuthology.orchestra.run.smithi019.stdout:/tmp/tmp.Ex1o4suvwv 2024-09-12T22:36:47.740 DEBUG:teuthology.orchestra.run.smithi019:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.Ex1o4suvwv 2024-09-12T22:36:47.910 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 0666 /tmp/tmp.Ex1o4suvwv 2024-09-12T22:36:47.994 DEBUG:teuthology.orchestra.remote:smithi019:/tmp/tmp.Ex1o4suvwv is 512KB 2024-09-12T22:36:48.092 DEBUG:teuthology.orchestra.run.smithi019:> rm -fr /tmp/tmp.Ex1o4suvwv 2024-09-12T22:36:48.107 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-12T22:36:48.107 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-12T22:36:48.150 DEBUG:teuthology.orchestra.run.smithi076:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-12T22:36:48.152 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-12T22:36:48.155 DEBUG:teuthology.orchestra.run.smithi163:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-12T22:36:48.229 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-12T22:36:48.253 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-12T22:36:48.271 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-12T22:36:48.290 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-12T22:36:48.290 INFO:tasks.ceph:Archiving crash dumps... 2024-09-12T22:36:48.291 DEBUG:teuthology.misc:Transferring archived files from smithi019:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-12_21:32:03-powercycle-squid-distro-default-smithi/7902933/remote/smithi019/crash 2024-09-12T22:36:48.292 DEBUG:teuthology.orchestra.run.smithi019:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-12T22:36:48.317 DEBUG:teuthology.misc:Transferring archived files from smithi076:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-12_21:32:03-powercycle-squid-distro-default-smithi/7902933/remote/smithi076/crash 2024-09-12T22:36:48.318 DEBUG:teuthology.orchestra.run.smithi076:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-12T22:36:48.363 DEBUG:teuthology.misc:Transferring archived files from smithi148:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-12_21:32:03-powercycle-squid-distro-default-smithi/7902933/remote/smithi148/crash 2024-09-12T22:36:48.364 DEBUG:teuthology.orchestra.run.smithi148:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-12T22:36:48.527 DEBUG:teuthology.misc:Transferring archived files from smithi163:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-12_21:32:03-powercycle-squid-distro-default-smithi/7902933/remote/smithi163/crash 2024-09-12T22:36:48.528 DEBUG:teuthology.orchestra.run.smithi163:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-12T22:36:48.569 INFO:tasks.ceph:Compressing logs... 2024-09-12T22:36:48.570 DEBUG:teuthology.orchestra.run.smithi019:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T22:36:48.574 DEBUG:teuthology.orchestra.run.smithi076:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T22:36:48.577 DEBUG:teuthology.orchestra.run.smithi148:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T22:36:48.579 DEBUG:teuthology.orchestra.run.smithi163:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T22:36:48.596 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35683.log 2024-09-12T22:36:48.611 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-12T22:36:48.624 INFO:teuthology.orchestra.run.smithi076.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-12T22:36:48.625 INFO:teuthology.orchestra.run.smithi076.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.789.log 2024-09-12T22:36:48.625 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-osd.0.log: /var/log/ceph/ceph-client.admin.789.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.789.log.gz 2024-09-12T22:36:48.649 INFO:teuthology.orchestra.run.smithi163.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30634.log 2024-09-12T22:36:48.649 INFO:teuthology.orchestra.run.smithi163.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-12T22:36:48.649 INFO:teuthology.orchestra.run.smithi163.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30594.log 2024-09-12T22:36:48.649 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.30634.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30634.log.gz 2024-09-12T22:36:48.649 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30554.log 2024-09-12T22:36:48.649 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.30594.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30594.log.gz 2024-09-12T22:36:48.650 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.admin.30554.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30554.log.gz 2024-09-12T22:36:48.695 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36069.log 2024-09-12T22:36:48.695 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5/var/log/ceph/ceph-client.admin.35683.log: --verbose -- /var/log/ceph/ceph-client.admin.31541.log 2024-09-12T22:36:48.695 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35683.log.gz 2024-09-12T22:36:48.695 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.36069.log: -- /var/log/ceph/ceph-client.admin.31082.log 2024-09-12T22:36:48.695 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36069.log.gz 2024-09-12T22:36:48.695 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.31541.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39327.log 2024-09-12T22:36:48.695 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31541.log.gz 2024-09-12T22:36:48.696 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.31082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31502.log 2024-09-12T22:36:48.696 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31082.log.gz 2024-09-12T22:36:48.696 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.39327.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35154.log 2024-09-12T22:36:48.696 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39327.log.gz 2024-09-12T22:36:48.696 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38526.log 2024-09-12T22:36:48.696 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.31502.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31502.log.gz 2024-09-12T22:36:48.696 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31288.log 2024-09-12T22:36:48.696 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.35154.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35154.log.gz 2024-09-12T22:36:48.696 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.38526.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39284.log 2024-09-12T22:36:48.696 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38526.log.gz 2024-09-12T22:36:48.697 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33924.log 2024-09-12T22:36:48.697 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.31288.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31288.log.gz 2024-09-12T22:36:48.697 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.39284.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33524.log 2024-09-12T22:36:48.697 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39284.log.gz 2024-09-12T22:36:48.697 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.33924.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38652.log 2024-09-12T22:36:48.697 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33924.log.gz 2024-09-12T22:36:48.697 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.33524.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33414.log 2024-09-12T22:36:48.697 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33524.log.gz 2024-09-12T22:36:48.697 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.38652.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33786.log 2024-09-12T22:36:48.697 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38652.log.gz 2024-09-12T22:36:48.697 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.33414.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36374.log 2024-09-12T22:36:48.697 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33414.log.gz 2024-09-12T22:36:48.698 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39031.log 2024-09-12T22:36:48.698 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.33786.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33786.log.gz 2024-09-12T22:36:48.698 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.36374.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34379.log 2024-09-12T22:36:48.698 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36374.log.gz 2024-09-12T22:36:48.698 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.39031.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35018.log 2024-09-12T22:36:48.698 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39031.log.gz 2024-09-12T22:36:48.698 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.34379.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38439.log 2024-09-12T22:36:48.698 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34379.log.gz 2024-09-12T22:36:48.698 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.35018.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30998.log 2024-09-12T22:36:48.698 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35018.log.gz 2024-09-12T22:36:48.698 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.38439.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35290.log 2024-09-12T22:36:48.698 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38439.log.gz 2024-09-12T22:36:48.699 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33656.log 2024-09-12T22:36:48.699 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.30998.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30998.log.gz 2024-09-12T22:36:48.699 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.35290.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39593.log 2024-09-12T22:36:48.699 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35290.log.gz 2024-09-12T22:36:48.699 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.33656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36937.log 2024-09-12T22:36:48.699 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33656.log.gz 2024-09-12T22:36:48.699 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31414.log 2024-09-12T22:36:48.699 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.39593.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39593.log.gz 2024-09-12T22:36:48.699 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.36937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36545.log 2024-09-12T22:36:48.699 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36937.log.gz 2024-09-12T22:36:48.699 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.31414.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39535.log 2024-09-12T22:36:48.700 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31414.log.gz 2024-09-12T22:36:48.700 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.36545.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33413.log 2024-09-12T22:36:48.700 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36545.log.gz 2024-09-12T22:36:48.700 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.39535.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35377.log 2024-09-12T22:36:48.700 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39535.log.gz 2024-09-12T22:36:48.700 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39073.log 2024-09-12T22:36:48.700 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.33413.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33413.log.gz 2024-09-12T22:36:48.700 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35957.log 2024-09-12T22:36:48.700 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.35377.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35377.log.gz 2024-09-12T22:36:48.700 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.39073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35107.log 2024-09-12T22:36:48.700 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39073.log.gz 2024-09-12T22:36:48.700 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.35957.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33474.log 2024-09-12T22:36:48.701 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35957.log.gz 2024-09-12T22:36:48.701 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.35107.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30620.log 2024-09-12T22:36:48.701 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35107.log.gz 2024-09-12T22:36:48.701 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.33474.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34663.log 2024-09-12T22:36:48.701 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33474.log.gz 2024-09-12T22:36:48.701 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.30620.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34013.log 2024-09-12T22:36:48.701 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30620.log.gz 2024-09-12T22:36:48.701 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.34663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38586.log 2024-09-12T22:36:48.701 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34663.log.gz 2024-09-12T22:36:48.701 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.34013.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36776.log 2024-09-12T22:36:48.701 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34013.log.gz 2024-09-12T22:36:48.702 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.38586.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36493.log 2024-09-12T22:36:48.702 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38586.log.gz 2024-09-12T22:36:48.702 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.36776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38313.log 2024-09-12T22:36:48.702 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36776.log.gz 2024-09-12T22:36:48.702 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.36493.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33854.log 2024-09-12T22:36:48.702 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36493.log.gz 2024-09-12T22:36:48.702 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.38313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30956.log 2024-09-12T22:36:48.702 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38313.log.gz 2024-09-12T22:36:48.702 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38820.log 2024-09-12T22:36:48.702 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.33854.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33854.log.gz 2024-09-12T22:36:48.702 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.30956.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38947.log 2024-09-12T22:36:48.702 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30956.log.gz 2024-09-12T22:36:48.703 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.38820.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37133.log 2024-09-12T22:36:48.703 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38820.log.gz 2024-09-12T22:36:48.703 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35724.log 2024-09-12T22:36:48.703 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.38947.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38947.log.gz 2024-09-12T22:36:48.703 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.37133.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38064.log 2024-09-12T22:36:48.703 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37133.log.gz 2024-09-12T22:36:48.703 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.35724.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37494.log 2024-09-12T22:36:48.703 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35724.log.gz 2024-09-12T22:36:48.703 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.38064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31922.log 2024-09-12T22:36:48.703 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38064.log.gz 2024-09-12T22:36:48.703 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.37494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30788.log 2024-09-12T22:36:48.703 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37494.log.gz 2024-09-12T22:36:48.704 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.31922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38778.log 2024-09-12T22:36:48.704 INFO:teuthology.orchestra.run.smithi019.stderr: 48.6% -- replaced with /var/log/ceph/ceph-client.admin.31922.log.gz 2024-09-12T22:36:48.704 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.30788.log: /var/log/ceph/ceph-client.admin.34180.log 2024-09-12T22:36:48.704 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30788.log.gz 2024-09-12T22:36:48.704 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.38778.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33352.log 2024-09-12T22:36:48.704 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38778.log.gz 2024-09-12T22:36:48.704 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.34180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34621.log 2024-09-12T22:36:48.704 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34180.log.gz 2024-09-12T22:36:48.704 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33566.log 2024-09-12T22:36:48.704 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.33352.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33352.log.gz 2024-09-12T22:36:48.704 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.34621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31290.log 2024-09-12T22:36:48.705 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34621.log.gz 2024-09-12T22:36:48.705 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.33566.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33263.log 2024-09-12T22:36:48.705 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33566.log.gz 2024-09-12T22:36:48.705 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30704.log 2024-09-12T22:36:48.705 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.31290.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31290.log.gz 2024-09-12T22:36:48.705 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.33263.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31163.log 2024-09-12T22:36:48.705 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33263.log.gz 2024-09-12T22:36:48.705 INFO:teuthology.orchestra.run.smithi019.stderr:gzip/var/log/ceph/ceph-client.admin.30704.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.29878.log 2024-09-12T22:36:48.705 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30704.log.gz 2024-09-12T22:36:48.705 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36333.log 2024-09-12T22:36:48.705 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.31163.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31163.log.gz 2024-09-12T22:36:48.705 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.29878.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29878.log.gz 2024-09-12T22:36:48.706 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39409.log 2024-09-12T22:36:48.706 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36620.log 2024-09-12T22:36:48.706 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.36333.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36333.log.gz 2024-09-12T22:36:48.706 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.39409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30439.log 2024-09-12T22:36:48.706 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39409.log.gz 2024-09-12T22:36:48.706 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.36620.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38190.log 2024-09-12T22:36:48.706 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36620.log.gz 2024-09-12T22:36:48.706 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.30439.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31712.log 2024-09-12T22:36:48.706 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30439.log.gz 2024-09-12T22:36:48.706 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.38190.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34270.log 2024-09-12T22:36:48.706 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38190.log.gz 2024-09-12T22:36:48.707 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.31712.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30532.log 2024-09-12T22:36:48.707 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31712.log.gz 2024-09-12T22:36:48.707 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.34270.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39367.log 2024-09-12T22:36:48.707 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34270.log.gz 2024-09-12T22:36:48.707 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36698.log 2024-09-12T22:36:48.707 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.30532.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30532.log.gz 2024-09-12T22:36:48.707 INFO:teuthology.orchestra.run.smithi019.stderr:gzip/var/log/ceph/ceph-client.admin.39367.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.39115.log 2024-09-12T22:36:48.707 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39367.log.gz 2024-09-12T22:36:48.707 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.36698.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37926.log 2024-09-12T22:36:48.707 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36698.log.gz 2024-09-12T22:36:48.707 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-12T22:36:48.707 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.39115.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39115.log.gz 2024-09-12T22:36:48.708 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.37926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37046.log 2024-09-12T22:36:48.708 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37926.log.gz 2024-09-12T22:36:48.708 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31880.log 2024-09-12T22:36:48.708 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31542.log 2024-09-12T22:36:48.708 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.37046.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37046.log.gz 2024-09-12T22:36:48.708 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.31880.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38022.log 2024-09-12T22:36:48.708 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31880.log.gz 2024-09-12T22:36:48.708 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.31542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39157.log 2024-09-12T22:36:48.708 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31542.log.gz 2024-09-12T22:36:48.708 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.38022.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31040.log 2024-09-12T22:36:48.709 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38022.log.gz 2024-09-12T22:36:48.709 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30574.log 2024-09-12T22:36:48.709 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.39157.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39157.log.gz 2024-09-12T22:36:48.709 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.31040.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32400.log 2024-09-12T22:36:48.709 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31040.log.gz 2024-09-12T22:36:48.709 INFO:teuthology.orchestra.run.smithi019.stderr: 95.1% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-12T22:36:48.709 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.30574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34095.log 2024-09-12T22:36:48.709 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30574.log.gz 2024-09-12T22:36:48.709 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33609.log 2024-09-12T22:36:48.709 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.32400.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32400.log.gz 2024-09-12T22:36:48.709 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.34095.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35332.log 2024-09-12T22:36:48.709 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34095.log.gz 2024-09-12T22:36:48.709 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.33609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36896.log 2024-09-12T22:36:48.710 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33609.log.gz 2024-09-12T22:36:48.710 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39638.log 2024-09-12T22:36:48.710 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.35332.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35332.log.gz 2024-09-12T22:36:48.710 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.36896.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38546.log 2024-09-12T22:36:48.710 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36896.log.gz 2024-09-12T22:36:48.710 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.39638.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36201.log 2024-09-12T22:36:48.710 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39638.log.gz 2024-09-12T22:36:48.710 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.38546.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30662.log 2024-09-12T22:36:48.710 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38546.log.gz 2024-09-12T22:36:48.710 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.36201.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36114.log 2024-09-12T22:36:48.710 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36201.log.gz 2024-09-12T22:36:48.710 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.30662.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31376.log 2024-09-12T22:36:48.711 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30662.log.gz 2024-09-12T22:36:48.711 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.36114.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37539.log 2024-09-12T22:36:48.711 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36114.log.gz 2024-09-12T22:36:48.711 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.31376.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39242.log 2024-09-12T22:36:48.711 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31376.log.gz 2024-09-12T22:36:48.711 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.37539.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30490.log 2024-09-12T22:36:48.711 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37539.log.gz 2024-09-12T22:36:48.711 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.39242.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31164.log 2024-09-12T22:36:48.711 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39242.log.gz 2024-09-12T22:36:48.711 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.30490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37001.log 2024-09-12T22:36:48.711 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30490.log.gz 2024-09-12T22:36:48.711 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.31164.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37581.log 2024-09-12T22:36:48.712 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31164.log.gz 2024-09-12T22:36:48.712 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.37001.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34574.log 2024-09-12T22:36:48.712 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37001.log.gz 2024-09-12T22:36:48.712 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.37581.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30351.log 2024-09-12T22:36:48.712 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37581.log.gz 2024-09-12T22:36:48.712 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.34574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36026.log 2024-09-12T22:36:48.712 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34574.log.gz 2024-09-12T22:36:48.712 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.30351.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30351.log.gzgzip 2024-09-12T22:36:48.712 INFO:teuthology.orchestra.run.smithi019.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.32046.log 2024-09-12T22:36:48.712 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35243.log 2024-09-12T22:36:48.712 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.36026.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36026.log.gz 2024-09-12T22:36:48.712 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.32046.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38106.log 2024-09-12T22:36:48.712 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32046.log.gz 2024-09-12T22:36:48.713 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34845.log 2024-09-12T22:36:48.713 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.35243.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35243.log.gz 2024-09-12T22:36:48.713 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-12T22:36:48.713 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.38106.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38106.log.gz 2024-09-12T22:36:48.713 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33179.log 2024-09-12T22:36:48.713 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.34845.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34845.log.gz 2024-09-12T22:36:48.713 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-09-12T22:36:48.713 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34223.log 2024-09-12T22:36:48.713 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.33179.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33179.log.gz 2024-09-12T22:36:48.713 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32004.log 2024-09-12T22:36:48.713 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.34223.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37260.log 2024-09-12T22:36:48.713 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34223.log.gz 2024-09-12T22:36:48.713 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.32004.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31628.log 2024-09-12T22:36:48.714 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32004.log.gz 2024-09-12T22:36:48.714 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.37260.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30309.log 2024-09-12T22:36:48.714 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37260.log.gz 2024-09-12T22:36:48.714 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.31628.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32130.log 2024-09-12T22:36:48.714 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31628.log.gz 2024-09-12T22:36:48.714 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.30309.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33745.log 2024-09-12T22:36:48.714 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30309.log.gz 2024-09-12T22:36:48.714 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.32130.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37220.log 2024-09-12T22:36:48.714 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32130.log.gz 2024-09-12T22:36:48.714 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.33745.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.33745.log.gz --verbose 2024-09-12T22:36:48.714 INFO:teuthology.orchestra.run.smithi019.stderr: -- /var/log/ceph/ceph-client.admin.39199.log 2024-09-12T22:36:48.714 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.37220.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34137.log 2024-09-12T22:36:48.714 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37220.log.gz 2024-09-12T22:36:48.715 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.39199.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33853.log 2024-09-12T22:36:48.715 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39199.log.gz 2024-09-12T22:36:48.715 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.34137.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-12T22:36:48.715 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34137.log.gz 2024-09-12T22:36:48.715 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.33853.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37626.log 2024-09-12T22:36:48.715 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33853.log.gz 2024-09-12T22:36:48.715 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38736.log 2024-09-12T22:36:48.715 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.37626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30830.log 0.0% 2024-09-12T22:36:48.715 INFO:teuthology.orchestra.run.smithi019.stderr: -- replaced with /var/log/ceph/ceph-client.admin.37626.log.gz 2024-09-12T22:36:48.715 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38989.log 2024-09-12T22:36:48.715 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.38736.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38736.log.gz 2024-09-12T22:36:48.715 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.30830.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38312.log 2024-09-12T22:36:48.715 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30830.log.gz 2024-09-12T22:36:48.715 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.38989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29855.log 2024-09-12T22:36:48.716 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38989.log.gz 2024-09-12T22:36:48.716 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34489.log 2024-09-12T22:36:48.716 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.38312.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38312.log.gz 2024-09-12T22:36:48.716 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.29855.log: gzip -5 0.0% --verbose -- replaced with /var/log/ceph/ceph-client.admin.29855.log.gz -- 2024-09-12T22:36:48.716 INFO:teuthology.orchestra.run.smithi019.stderr: /var/log/ceph/ceph-client.admin.38314.log 2024-09-12T22:36:48.716 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38440.log 2024-09-12T22:36:48.716 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.34489.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34489.log.gz 2024-09-12T22:36:48.716 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38862.log 2024-09-12T22:36:48.716 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.38314.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38314.log.gz 2024-09-12T22:36:48.716 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.38440.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34928.log 2024-09-12T22:36:48.716 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38440.log.gz 2024-09-12T22:36:48.716 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35551.log 2024-09-12T22:36:48.717 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.38862.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38862.log.gz 2024-09-12T22:36:48.717 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.34928.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.34928.log.gz --verbose 2024-09-12T22:36:48.717 INFO:teuthology.orchestra.run.smithi019.stderr: -- /var/log/ceph/ceph-client.admin.39451.log 2024-09-12T22:36:48.717 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33283.log 2024-09-12T22:36:48.717 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.35551.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35551.log.gz 2024-09-12T22:36:48.717 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.39451.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39493.log 0.0% 2024-09-12T22:36:48.717 INFO:teuthology.orchestra.run.smithi019.stderr: -- replaced with /var/log/ceph/ceph-client.admin.39451.log.gz 2024-09-12T22:36:48.717 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33698.log 2024-09-12T22:36:48.717 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.33283.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33283.log.gz 2024-09-12T22:36:48.717 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.39493.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33077.log 2024-09-12T22:36:48.717 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39493.log.gz 2024-09-12T22:36:48.717 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.33698.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38232.log 2024-09-12T22:36:48.717 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33698.log.gz 2024-09-12T22:36:48.718 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-12T22:36:48.718 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.33077.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33077.log.gz 2024-09-12T22:36:48.718 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.38232.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38232.log.gz 2024-09-12T22:36:48.718 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34378.log 2024-09-12T22:36:48.718 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38400.log 2024-09-12T22:36:48.718 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-mgr.y.log: /var/log/ceph/ceph-client.admin.34378.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35419.log 2024-09-12T22:36:48.718 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34378.log.gz 2024-09-12T22:36:48.719 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.38400.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30914.log 2024-09-12T22:36:48.719 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38400.log.gz 2024-09-12T22:36:48.719 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.35419.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35638.log 2024-09-12T22:36:48.719 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35419.log.gz 2024-09-12T22:36:48.719 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.30914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36288.log 2024-09-12T22:36:48.720 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30914.log.gz 2024-09-12T22:36:48.720 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.35638.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37837.log 2024-09-12T22:36:48.720 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35638.log.gz 2024-09-12T22:36:48.720 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.36288.log: gzip -5 --verbose 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36288.log.gz 2024-09-12T22:36:48.720 INFO:teuthology.orchestra.run.smithi019.stderr: -- /var/log/ceph/ceph.log 2024-09-12T22:36:48.720 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.37837.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37837.log.gz 2024-09-12T22:36:48.721 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35816.log 2024-09-12T22:36:48.721 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34887.log 2024-09-12T22:36:48.721 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.35816.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35816.log.gz 2024-09-12T22:36:48.721 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37667.log 2024-09-12T22:36:48.721 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.34887.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34887.log.gz 2024-09-12T22:36:48.721 INFO:teuthology.orchestra.run.smithi019.stderr: --verbose -- /var/log/ceph/ceph-client.admin.33964.log 2024-09-12T22:36:48.722 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.37667.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37667.log.gz 2024-09-12T22:36:48.722 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34531.log 2024-09-12T22:36:48.722 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.33964.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33964.log.gz 2024-09-12T22:36:48.722 INFO:teuthology.orchestra.run.smithi019.stderr: --verbose -- /var/log/ceph/ceph-client.admin.31796.log 2024-09-12T22:36:48.722 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.34531.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34531.log.gz 2024-09-12T22:36:48.723 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38148.log 2024-09-12T22:36:48.723 INFO:teuthology.orchestra.run.smithi019.stderr: 92.5% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-09-12T22:36:48.723 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.31796.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31796.log.gz 2024-09-12T22:36:48.723 INFO:teuthology.orchestra.run.smithi019.stderr: --verbose -- /var/log/ceph/ceph-client.admin.36154.log 2024-09-12T22:36:48.723 INFO:teuthology.orchestra.run.smithi019.stderr: 94.4%/var/log/ceph/ceph-client.admin.38148.log: -- replaced with /var/log/ceph/ceph.log.gz 2024-09-12T22:36:48.723 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38148.log.gz 2024-09-12T22:36:48.723 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35464.log 2024-09-12T22:36:48.723 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38694.log 2024-09-12T22:36:48.724 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.36154.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36154.log.gz 2024-09-12T22:36:48.724 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.35464.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37175.log 2024-09-12T22:36:48.724 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35464.log.gz 2024-09-12T22:36:48.724 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.38694.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30872.log 2024-09-12T22:36:48.724 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38694.log.gz 2024-09-12T22:36:48.725 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.37175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33199.log 2024-09-12T22:36:48.725 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37175.log.gz 2024-09-12T22:36:48.725 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.30872.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30746.log 2024-09-12T22:36:48.725 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30872.log.gz 2024-09-12T22:36:48.725 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.33199.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-12T22:36:48.725 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33199.log.gz 2024-09-12T22:36:48.726 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37375.log 2024-09-12T22:36:48.726 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.30746.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30746.log.gz 2024-09-12T22:36:48.726 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38904.log 2024-09-12T22:36:48.726 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.37375.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36423.log 2024-09-12T22:36:48.726 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37375.log.gz 2024-09-12T22:36:48.727 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.38904.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37088.log 2024-09-12T22:36:48.727 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38904.log.gz 2024-09-12T22:36:48.727 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.36423.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31838.log 2024-09-12T22:36:48.727 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36423.log.gz 2024-09-12T22:36:48.727 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.37088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32940.log 2024-09-12T22:36:48.727 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37088.log.gz 2024-09-12T22:36:48.728 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.31838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.32819.log 2024-09-12T22:36:48.728 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31838.log.gz 2024-09-12T22:36:48.728 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.32940.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36848.log 2024-09-12T22:36:48.728 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32940.log.gz 2024-09-12T22:36:48.728 INFO:teuthology.orchestra.run.smithi019.stderr:gzip/var/log/ceph/ceph-client.0.32819.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.31754.log 2024-09-12T22:36:48.728 INFO:teuthology.orchestra.run.smithi019.stderr: 33.1% -- replaced with /var/log/ceph/ceph-client.0.32819.log.gz 2024-09-12T22:36:48.728 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.36848.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36848.log.gz 2024-09-12T22:36:48.728 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34440.log 2024-09-12T22:36:48.728 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.31754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36246.log 2024-09-12T22:36:48.729 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31754.log.gz 2024-09-12T22:36:48.729 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37433.log 2024-09-12T22:36:48.729 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.34440.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34440.log.gz 2024-09-12T22:36:48.729 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.36246.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36246.log.gz 2024-09-12T22:36:48.729 INFO:teuthology.orchestra.run.smithi019.stderr: --verbose -- /var/log/ceph/ceph-client.admin.30177.log 2024-09-12T22:36:48.729 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.37433.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37433.log.gz 2024-09-12T22:36:48.729 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32192.log 2024-09-12T22:36:48.729 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.30177.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30177.log.gz 2024-09-12T22:36:48.729 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-12T22:36:48.729 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.32192.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32192.log.gz 2024-09-12T22:36:48.729 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- 93.7% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-12T22:36:48.729 INFO:teuthology.orchestra.run.smithi019.stderr: /var/log/ceph/ceph-client.admin.33132.log 2024-09-12T22:36:48.729 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34055.log 2024-09-12T22:36:48.730 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.33132.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33132.log.gz 2024-09-12T22:36:48.730 INFO:teuthology.orchestra.run.smithi019.stderr: --verbose -- /var/log/ceph/ceph-client.admin.32294.log 2024-09-12T22:36:48.731 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.34055.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34055.log.gz 2024-09-12T22:36:48.731 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29645.log 2024-09-12T22:36:48.731 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.32294.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30152.log 2024-09-12T22:36:48.731 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32294.log.gz 2024-09-12T22:36:48.731 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.29645.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31289.log 2024-09-12T22:36:48.731 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29645.log.gz 2024-09-12T22:36:48.731 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34755.log 2024-09-12T22:36:48.731 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.30152.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30152.log.gz 2024-09-12T22:36:48.731 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34803.log 2024-09-12T22:36:48.731 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.31289.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31289.log.gz 2024-09-12T22:36:48.731 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.34755.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35596.log 2024-09-12T22:36:48.731 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34755.log.gz 2024-09-12T22:36:48.731 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.34803.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35194.log 2024-09-12T22:36:48.731 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34803.log.gz 2024-09-12T22:36:48.732 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31162.log 2024-09-12T22:36:48.732 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.35596.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35596.log.gz 2024-09-12T22:36:48.732 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.35194.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32088.log 2024-09-12T22:36:48.732 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35194.log.gz 2024-09-12T22:36:48.732 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.31162.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30096.log 2024-09-12T22:36:48.732 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31162.log.gz 2024-09-12T22:36:48.732 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.32088.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32088.log.gz 2024-09-12T22:36:48.732 INFO:teuthology.orchestra.run.smithi019.stderr: --verbose -- /var/log/ceph/ceph-client.admin.31416.log 2024-09-12T22:36:48.732 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.30096.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30096.log.gz 2024-09-12T22:36:48.732 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30395.log 2024-09-12T22:36:48.733 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.31416.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31416.log.gz 2024-09-12T22:36:48.733 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30247.log 2024-09-12T22:36:48.733 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.30395.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30395.log.gz 2024-09-12T22:36:48.733 INFO:teuthology.orchestra.run.smithi019.stderr: --verbose -- /var/log/ceph/ceph-client.admin.39680.log 2024-09-12T22:36:48.733 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.30247.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30247.log.gz 2024-09-12T22:36:48.733 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30019.log 2024-09-12T22:36:48.733 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.39680.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39680.log.gz 2024-09-12T22:36:48.733 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34311.log 2024-09-12T22:36:48.733 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.30019.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30019.log.gz 2024-09-12T22:36:48.733 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35771.log 2024-09-12T22:36:48.733 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.34311.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34311.log.gz 2024-09-12T22:36:48.733 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37879.log 2024-09-12T22:36:48.734 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.35771.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35771.log.gz 2024-09-12T22:36:48.734 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35504.log 2024-09-12T22:36:48.734 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.37879.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37879.log.gz 2024-09-12T22:36:48.734 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34976.log 2024-09-12T22:36:48.734 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.35504.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35504.log.gz 2024-09-12T22:36:48.734 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.28784.log 2024-09-12T22:36:48.734 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.34976.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34976.log.gz 2024-09-12T22:36:48.734 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34714.log 2024-09-12T22:36:48.734 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph.tmp-client.admin.28784.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.28784.log.gz 2024-09-12T22:36:48.734 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37795.log 2024-09-12T22:36:48.734 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.34714.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34714.log.gz 2024-09-12T22:36:48.734 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32295.log 2024-09-12T22:36:48.734 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.37795.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37795.log.gz 2024-09-12T22:36:48.734 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31670.log 2024-09-12T22:36:48.735 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.32295.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32295.log.gz 2024-09-12T22:36:48.735 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35065.log 2024-09-12T22:36:48.735 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.31670.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31670.log.gz 2024-09-12T22:36:48.735 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37973.log 2024-09-12T22:36:48.735 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.35065.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32293.log 2024-09-12T22:36:48.735 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35065.log.gz 2024-09-12T22:36:48.735 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.37973.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37973.log.gz 2024-09-12T22:36:48.735 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.32293.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32293.log.gz 2024-09-12T22:36:48.735 INFO:teuthology.orchestra.run.smithi019.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-12T22:36:48.736 INFO:teuthology.orchestra.run.smithi019.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-12T22:36:48.752 INFO:teuthology.orchestra.run.smithi019.stderr: 91.9% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-12T22:36:48.875 INFO:teuthology.orchestra.run.smithi019.stderr: 90.5% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-12T22:36:48.877 INFO:teuthology.orchestra.run.smithi019.stderr: 2024-09-12T22:36:48.877 INFO:teuthology.orchestra.run.smithi019.stderr:real 0m0.291s 2024-09-12T22:36:48.877 INFO:teuthology.orchestra.run.smithi019.stderr:user 0m0.592s 2024-09-12T22:36:48.877 INFO:teuthology.orchestra.run.smithi019.stderr:sys 0m0.122s 2024-09-12T22:36:49.477 INFO:teuthology.orchestra.run.smithi076.stderr: 94.3% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-12T22:36:49.479 INFO:teuthology.orchestra.run.smithi076.stderr: 2024-09-12T22:36:49.479 INFO:teuthology.orchestra.run.smithi076.stderr:real 0m0.888s 2024-09-12T22:36:49.479 INFO:teuthology.orchestra.run.smithi076.stderr:user 0m0.791s 2024-09-12T22:36:49.479 INFO:teuthology.orchestra.run.smithi076.stderr:sys 0m0.061s 2024-09-12T22:36:51.251 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y has been restored 2024-09-12T22:36:53.538 INFO:teuthology.orchestra.run.smithi163.stderr: 94.2% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-12T22:36:53.540 INFO:teuthology.orchestra.run.smithi163.stderr: 2024-09-12T22:36:53.540 INFO:teuthology.orchestra.run.smithi163.stderr:real 0m4.908s 2024-09-12T22:36:53.540 INFO:teuthology.orchestra.run.smithi163.stderr:user 0m4.718s 2024-09-12T22:36:53.540 INFO:teuthology.orchestra.run.smithi163.stderr:sys 0m0.195s 2024-09-12T22:36:53.580 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-osd.1.log: 94.1% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-12T22:36:53.582 INFO:teuthology.orchestra.run.smithi148.stderr: 2024-09-12T22:36:53.582 INFO:teuthology.orchestra.run.smithi148.stderr:real 0m4.988s 2024-09-12T22:36:53.583 INFO:teuthology.orchestra.run.smithi148.stderr:user 0m4.814s 2024-09-12T22:36:53.583 INFO:teuthology.orchestra.run.smithi148.stderr:sys 0m0.177s 2024-09-12T22:36:53.583 INFO:tasks.ceph:Archiving logs... 2024-09-12T22:36:53.583 DEBUG:teuthology.misc:Transferring archived files from smithi019:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-12_21:32:03-powercycle-squid-distro-default-smithi/7902933/remote/smithi019/log 2024-09-12T22:36:53.584 DEBUG:teuthology.orchestra.run.smithi019:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T22:36:53.865 DEBUG:teuthology.misc:Transferring archived files from smithi076:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-12_21:32:03-powercycle-squid-distro-default-smithi/7902933/remote/smithi076/log 2024-09-12T22:36:53.866 DEBUG:teuthology.orchestra.run.smithi076:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T22:36:54.015 DEBUG:teuthology.misc:Transferring archived files from smithi148:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-12_21:32:03-powercycle-squid-distro-default-smithi/7902933/remote/smithi148/log 2024-09-12T22:36:54.016 DEBUG:teuthology.orchestra.run.smithi148:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T22:36:54.737 DEBUG:teuthology.misc:Transferring archived files from smithi163:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-12_21:32:03-powercycle-squid-distro-default-smithi/7902933/remote/smithi163/log 2024-09-12T22:36:54.739 DEBUG:teuthology.orchestra.run.smithi163:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T22:36:55.481 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-12T22:36:55.496 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-12T22:36:55.496 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T22:36:55.500 DEBUG:teuthology.orchestra.run.smithi076:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T22:36:55.502 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T22:36:55.505 DEBUG:teuthology.orchestra.run.smithi163:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T22:36:55.624 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-12T22:36:55.634 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-12T22:36:55.634 DEBUG:teuthology.orchestra.run.smithi019:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T22:36:55.637 DEBUG:teuthology.orchestra.run.smithi076:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T22:36:55.640 DEBUG:teuthology.orchestra.run.smithi148:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T22:36:55.642 DEBUG:teuthology.orchestra.run.smithi163:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T22:36:55.653 INFO:teuthology.orchestra.run.smithi019.stderr:bash: line 1: ntpq: command not found 2024-09-12T22:36:55.653 INFO:teuthology.orchestra.run.smithi076.stderr:bash: line 1: ntpq: command not found 2024-09-12T22:36:55.657 INFO:teuthology.orchestra.run.smithi148.stderr:bash: line 1: ntpq: command not found 2024-09-12T22:36:55.657 INFO:teuthology.orchestra.run.smithi076.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T22:36:55.658 INFO:teuthology.orchestra.run.smithi076.stdout:=============================================================================== 2024-09-12T22:36:55.658 INFO:teuthology.orchestra.run.smithi076.stdout:^* hv01.front.sepia.ceph.com 3 6 37 44 -357us[ -426us] +/- 53ms 2024-09-12T22:36:55.658 INFO:teuthology.orchestra.run.smithi076.stdout:^+ hv02.front.sepia.ceph.com 3 6 37 43 +33us[ +33us] +/- 68ms 2024-09-12T22:36:55.658 INFO:teuthology.orchestra.run.smithi076.stdout:^+ hv03.front.sepia.ceph.com 3 6 37 44 +573us[ +573us] +/- 70ms 2024-09-12T22:36:55.658 INFO:teuthology.orchestra.run.smithi076.stdout:^? hv04.front.sepia.ceph.com 0 7 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T22:36:55.659 INFO:teuthology.orchestra.run.smithi019.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T22:36:55.660 INFO:teuthology.orchestra.run.smithi019.stdout:=============================================================================== 2024-09-12T22:36:55.660 INFO:teuthology.orchestra.run.smithi019.stdout:^* hv01.front.sepia.ceph.com 3 6 377 10 -380us[ -376us] +/- 54ms 2024-09-12T22:36:55.660 INFO:teuthology.orchestra.run.smithi019.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 10 -7267ns[-7267ns] +/- 68ms 2024-09-12T22:36:55.660 INFO:teuthology.orchestra.run.smithi019.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 9 +527us[ +527us] +/- 70ms 2024-09-12T22:36:55.660 INFO:teuthology.orchestra.run.smithi019.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T22:36:55.660 INFO:teuthology.orchestra.run.smithi163.stderr:bash: line 1: ntpq: command not found 2024-09-12T22:36:55.661 INFO:teuthology.orchestra.run.smithi148.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T22:36:55.661 INFO:teuthology.orchestra.run.smithi148.stdout:=============================================================================== 2024-09-12T22:36:55.661 INFO:teuthology.orchestra.run.smithi148.stdout:^* hv01.front.sepia.ceph.com 3 6 377 10 -377us[ -370us] +/- 54ms 2024-09-12T22:36:55.661 INFO:teuthology.orchestra.run.smithi148.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 9 +4598ns[+4598ns] +/- 68ms 2024-09-12T22:36:55.661 INFO:teuthology.orchestra.run.smithi148.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 10 +527us[ +527us] +/- 70ms 2024-09-12T22:36:55.662 INFO:teuthology.orchestra.run.smithi148.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T22:36:55.664 INFO:teuthology.orchestra.run.smithi163.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T22:36:55.665 INFO:teuthology.orchestra.run.smithi163.stdout:=============================================================================== 2024-09-12T22:36:55.665 INFO:teuthology.orchestra.run.smithi163.stdout:^* hv01.front.sepia.ceph.com 3 6 377 10 -383us[ -363us] +/- 54ms 2024-09-12T22:36:55.665 INFO:teuthology.orchestra.run.smithi163.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 11 +165ns[ +20us] +/- 68ms 2024-09-12T22:36:55.665 INFO:teuthology.orchestra.run.smithi163.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 11 +534us[ +553us] +/- 70ms 2024-09-12T22:36:55.665 INFO:teuthology.orchestra.run.smithi163.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T22:36:55.666 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-12T22:36:55.674 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-12T22:36:55.676 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-12T22:36:55.691 DEBUG:teuthology.orchestra.run.smithi019:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-12T22:36:55.774 DEBUG:teuthology.orchestra.run.smithi076:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-12T22:36:55.956 DEBUG:teuthology.orchestra.run.smithi148:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-12T22:36:56.028 DEBUG:teuthology.orchestra.run.smithi163:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-12T22:36:56.100 DEBUG:teuthology.orchestra.run.smithi019:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T22:36:56.134 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T22:36:56.134 DEBUG:teuthology.orchestra.run.smithi076:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T22:36:56.165 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T22:36:56.166 DEBUG:teuthology.orchestra.run.smithi148:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T22:36:56.196 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T22:36:56.197 DEBUG:teuthology.orchestra.run.smithi163:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T22:36:56.228 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T22:36:56.229 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-12T22:36:56.238 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-12T22:36:56.274 INFO:teuthology.task.internal:Duration was 700.541461 seconds 2024-09-12T22:36:56.275 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-12T22:36:56.300 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-12T22:36:56.300 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T22:36:56.303 DEBUG:teuthology.orchestra.run.smithi076:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T22:36:56.306 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T22:36:56.308 DEBUG:teuthology.orchestra.run.smithi163:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T22:36:56.348 INFO:teuthology.orchestra.run.smithi019.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T22:36:56.349 INFO:teuthology.orchestra.run.smithi148.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T22:36:56.351 INFO:teuthology.orchestra.run.smithi163.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T22:36:56.368 INFO:teuthology.orchestra.run.smithi076.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T22:36:56.750 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-12T22:36:56.750 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi019.front.sepia.ceph.com 2024-09-12T22:36:56.750 DEBUG:teuthology.orchestra.run.smithi019:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T22:36:56.776 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi076.front.sepia.ceph.com 2024-09-12T22:36:56.776 DEBUG:teuthology.orchestra.run.smithi076:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T22:36:56.809 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi148.front.sepia.ceph.com 2024-09-12T22:36:56.809 DEBUG:teuthology.orchestra.run.smithi148:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T22:36:56.835 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi163.front.sepia.ceph.com 2024-09-12T22:36:56.835 DEBUG:teuthology.orchestra.run.smithi163:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T22:36:56.872 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-12T22:36:56.873 DEBUG:teuthology.orchestra.run.smithi019:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T22:36:56.875 DEBUG:teuthology.orchestra.run.smithi076:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T22:36:56.878 DEBUG:teuthology.orchestra.run.smithi148:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T22:36:56.880 DEBUG:teuthology.orchestra.run.smithi163:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T22:36:56.943 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-12T22:36:56.943 DEBUG:teuthology.orchestra.run.smithi019:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T22:36:56.950 DEBUG:teuthology.orchestra.run.smithi076:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T22:36:56.952 DEBUG:teuthology.orchestra.run.smithi148:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T22:36:56.956 DEBUG:teuthology.orchestra.run.smithi163:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T22:36:57.092 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-12T22:36:57.104 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-12T22:36:57.104 DEBUG:teuthology.orchestra.run.smithi019:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T22:36:57.131 DEBUG:teuthology.orchestra.run.smithi076:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T22:36:57.160 DEBUG:teuthology.orchestra.run.smithi148:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T22:36:57.185 DEBUG:teuthology.orchestra.run.smithi163:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T22:36:57.210 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-12T22:36:57.220 DEBUG:teuthology.orchestra.run.smithi019:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T22:36:57.222 DEBUG:teuthology.orchestra.run.smithi076:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T22:36:57.225 DEBUG:teuthology.orchestra.run.smithi148:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T22:36:57.228 DEBUG:teuthology.orchestra.run.smithi163:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T22:36:57.245 INFO:teuthology.orchestra.run.smithi019.stdout:kernel.core_pattern = core 2024-09-12T22:36:57.253 INFO:teuthology.orchestra.run.smithi148.stdout:kernel.core_pattern = core 2024-09-12T22:36:57.254 INFO:teuthology.orchestra.run.smithi076.stdout:kernel.core_pattern = core 2024-09-12T22:36:57.276 INFO:teuthology.orchestra.run.smithi163.stdout:kernel.core_pattern = core 2024-09-12T22:36:57.300 DEBUG:teuthology.orchestra.run.smithi019:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T22:36:57.315 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T22:36:57.316 DEBUG:teuthology.orchestra.run.smithi076:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T22:36:57.343 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T22:36:57.343 DEBUG:teuthology.orchestra.run.smithi148:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T22:36:57.357 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T22:36:57.358 DEBUG:teuthology.orchestra.run.smithi163:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T22:36:57.372 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T22:36:57.372 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-12T22:36:57.383 INFO:teuthology.task.internal:Transferring archived files... 2024-09-12T22:36:57.384 DEBUG:teuthology.misc:Transferring archived files from smithi019:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-12_21:32:03-powercycle-squid-distro-default-smithi/7902933/remote/smithi019 2024-09-12T22:36:57.384 DEBUG:teuthology.orchestra.run.smithi019:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T22:36:57.420 DEBUG:teuthology.misc:Transferring archived files from smithi076:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-12_21:32:03-powercycle-squid-distro-default-smithi/7902933/remote/smithi076 2024-09-12T22:36:57.421 DEBUG:teuthology.orchestra.run.smithi076:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T22:36:57.454 DEBUG:teuthology.misc:Transferring archived files from smithi148:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-12_21:32:03-powercycle-squid-distro-default-smithi/7902933/remote/smithi148 2024-09-12T22:36:57.455 DEBUG:teuthology.orchestra.run.smithi148:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T22:36:57.488 DEBUG:teuthology.misc:Transferring archived files from smithi163:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-12_21:32:03-powercycle-squid-distro-default-smithi/7902933/remote/smithi163 2024-09-12T22:36:57.488 DEBUG:teuthology.orchestra.run.smithi163:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T22:36:57.521 INFO:teuthology.task.internal:Removing archive directory... 2024-09-12T22:36:57.521 DEBUG:teuthology.orchestra.run.smithi019:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T22:36:57.524 DEBUG:teuthology.orchestra.run.smithi076:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T22:36:57.526 DEBUG:teuthology.orchestra.run.smithi148:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T22:36:57.529 DEBUG:teuthology.orchestra.run.smithi163:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T22:36:57.571 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-12T22:36:57.585 INFO:teuthology.task.internal:Not uploading archives. 2024-09-12T22:36:57.585 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-12T22:36:57.600 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-12T22:36:57.600 DEBUG:teuthology.orchestra.run.smithi019:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T22:36:57.603 DEBUG:teuthology.orchestra.run.smithi076:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T22:36:57.605 DEBUG:teuthology.orchestra.run.smithi148:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T22:36:57.608 DEBUG:teuthology.orchestra.run.smithi163:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T22:36:57.617 INFO:teuthology.orchestra.run.smithi019.stdout: 265324 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 22:36 /home/ubuntu/cephtest 2024-09-12T22:36:57.619 INFO:teuthology.orchestra.run.smithi076.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 22:36 /home/ubuntu/cephtest 2024-09-12T22:36:57.620 INFO:teuthology.orchestra.run.smithi148.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 22:36 /home/ubuntu/cephtest 2024-09-12T22:36:57.627 INFO:teuthology.orchestra.run.smithi163.stdout: 266063 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 22:36 /home/ubuntu/cephtest 2024-09-12T22:36:57.628 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-12T22:36:57.639 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-12T22:36:57.686 INFO:teuthology.run:Summary data: description: powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-bitmap powercycle/default supported-distros/centos_latest tasks/cfuse_workunit_suites_fsstress thrashosds-health} duration: 700.5414609909058 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-09-12T22:36:57.687 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-12T22:36:57.756 INFO:teuthology.run:pass